greyhole and 3tb drives

[rcrh]

The problem is if the drive dies, both your copies are gone.

Exactly.

I'll be looking at this over the weekend.

Hopefully someone with some greyhole knowledge will
a) identify if this is true, and
b) come up with a solution to the original problem!

[ListerD]

Amen, brother. I'm just about done with rebuilding my new file server and will hopefully have everything up and running tomorrow. If that works out, I'll try to bring up a vm running amahi on another box and attach the 3tb to it via usb, partition, and see where the replicated files start dropping. Or if you can verify the issue with your current setup, I'll see if there's anything I can tweak on the vm within greyhole to get it to recognize the full partition size and transfer files. Based on what I saw in the logs, it looks like its having issues specifically when calculating the remaining space during the balance operation, as if it is subtracting from a fixed number. The balance shows 2.54 available when assessing the remaining space available on all drives, but -1.46 available when determining the target drive size of the 3TB drive, which is 2.54TB - 4 TB = -1.46 TB. Not sure if that means anything to anyone, but its a place to start.

Wonder if an arbitrary legacy limit was put in place for drives exceeding 2tb.

[rcrh]

Amen, brother. ...

Let's stay on this.

My plan is to simply shut down my server, disconnect the drive, move it to my ubuntu laptop and look at the directories. I'll either find duplicate files (and confirm the bad news) or not. If there aren't any duplicates that won't be evidence that it's working so then I'll have to start thinking. But, I'm saving that until after the easy step.

Have a happy Turkey Day (if you're in the US).

[bigfoot65]

The perfect person to ask about this would be the author of Greyhole. He frequents this forum area, so hopefully he can shed some light on your questions.

[ListerD]

I posted to the greyhole forum last night and received the following reply:

Guillaume Boudreau (Developer) 10 hours ago
Looks like a 32-bit overflow somewhere in Amahi or Greyhole.

What's the result of those commands:
grep drive15 /etc/greyhole.conf
df -k /var/hda/files/drives/drive15
uname -m

BTW, you seem to not have configured your data drives to NOT reserve space for privileged processes. You should use tune2fs to free up that space for Greyhole to use:
tune2fs -m 0 /dev/sdh1
(repeat for all data drives)


I'll provide the requested feedback as soon as I'm fully back up and running, but you may want to try the command listed above where drive15 = your 3TB drive. Nothing like a little holiday hacking.

[ListerD]

Well, after having to reinstall linux/amahi on my repurposed HTPC, I reconnected the 3tb drive via a SansDigital raid tower (not using it for raid). During the build of the driver I ended up updating the kernel, and now the balance operation is recognizing the space available. Here's a snippet from the log during a currently running balance:


Nov 24 21:19:50 7 balance: Drives with available space: /var/hda/files/drives/drive7/gh (2.52TB avail) - /var/hda/files/drives/drive6/gh (187GB avail) - /var/hda/files/drives/drive3/gh (181GB avail) - /var/hda/files/drives/drive4/gh (177GB avail) - /var/hda/files/drives/drive5/gh (175GB avail) - /var/hda/files/drives/drive2/gh (174GB avail) - /var/hda/files/drives/drive1/gh (166GB avail)
Nov 24 21:19:50 7 balance: Target drive: /var/hda/files/drives/drive7/gh (2.52TB available)
Nov 24 21:19:50 7 balance: Moving file copy...
Nov 24 21:19:50 7 balance: Updating symlink at /var/hda/files/books/Comics/X-Men/X-Men 374.cbz to point to /var/hda/files/drives/drive7/gh/Books/Comics/X-Men/X-Men 374.cbz

Here's the updated kernel I'm running:
2.6.35.14-103.fc14.x86_64
version of Amahi:
6.1.0-1

The old system I was running on was an Intel Atom (acer easystore h340), new one is an Intel Q6600.
I guess the good news is its not an inherent problem with Amahi/greyhole. Not sure if upgrading the kernel will get you past the issue, or if this may have been a hardware/software combo issue. If you have any other questions about my setup, let me know.