Added 3 new drives and GH isn't using them...

techlife
Posts: 63
Joined: Sat Dec 18, 2010 3:26 pm

Added 3 new drives and GH isn't using them...

Postby techlife » Fri Feb 25, 2011 6:08 pm

As the title states, I added 3 new drives and GH isn't using them. I have tried a few times now to balance storage and there is no change after. I am finding the following error in the logs:

Code: Select all

Feb 24 21:26:24 7 balance: Working on file: DVD/General_Movies/The Reaping/VIDEO_TS/VTS_01_2.VOB (1,024MB) Feb 24 21:26:24 7 balance: Drives with available space: /var/hda/files/drives/drive12/gh (1.62TB avail) - /var/hda/files/drives/drive13/gh (1.62TB avail) - /var/hda/files/drives/drive11/gh (1.26TB avail) - /var/hda/files/drives/drive8/gh (147GB avail) - /var/hda/files/drives/drive3/gh (112GB avail) - /var/hda/files/drives/drive10/gh (109GB avail) - /var/hda/files/drives/drive9/gh (93.4GB avail) - /var/hda/files/drives/drive4/gh (70.5GB avail) - /var/hda/files/drives/drive7/gh (61.1GB avail) - /var/hda/files/drives/drive1/gh (54.6GB avail) - /var/hda/files/drives/drive2/gh (52.0GB avail) Feb 24 21:26:24 4 balance: PHP Warning [8]: Undefined index: /var/hda/files/drives/drive12/gh in /usr/bin/greyhole on line 3905 Feb 24 21:26:24 7 balance: Target drive: /var/hda/files/drives/drive12/gh (0.00B available) Feb 24 21:26:24 4 balance: PHP Warning [8]: Undefined index: /var/hda/files/drives/drive12/gh in /usr/bin/greyhole on line 3909 Feb 24 21:26:24 7 balance: Moving this file wouldn't help balancing available space. Skipping.
The log is full of the same errors...like every file I the server, I think...

FWIW, I have the "--if-conf-changed was specified" error with -fsck as well. I don't know if it's related or not but I thought it worth a mention.

I didn't realize that there have been several versions since the one I'm using...do you recommend an update? What is the proper way (for dummies) to do this at this point???

Thanks in advance!!!!!!!!!!!

Requested Info:

Code: Select all

# uname -r; rpm -q samba hda-greyhole 2.6.32.26-175.fc12.x86_64 samba-3.4.9-60.fc12.x86_64 hda-greyhole-0.8.3-2.x86_64
http://fpaste.org/AwxS/
http://fpaste.org/MOo4/

Code: Select all

[root@Xavier ~]# mount; fdisk -l; df -h; greyhole --stats /dev/mapper/vg_xavier-lv_root on / type ext4 (rw) proc on /proc type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs (rw) /dev/sdd1 on /boot type ext4 (rw) /dev/sdl1 on /var/hda/files/drives/drive1 type ext4 (rw) /dev/sdi1 on /var/hda/files/drives/drive2 type ext4 (rw) /dev/sda1 on /var/hda/files/drives/drive3 type ext4 (rw) /dev/sdj1 on /var/hda/files/drives/drive4 type ext4 (rw) /dev/sdb1 on /var/hda/files/drives/drive7 type ext4 (rw) /dev/sdc1 on /var/hda/files/drives/drive8 type ext4 (rw) /dev/sde1 on /var/hda/files/drives/drive9 type ext4 (rw) /dev/sdk1 on /var/hda/files/drives/drive10 type ext4 (rw) /dev/sdf1 on /var/hda/files/drives/drive11 type ext4 (rw) /dev/sdg1 on /var/hda/files/drives/drive12 type ext4 (rw) /dev/sdh1 on /var/hda/files/drives/drive13 type ext4 (rw) none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) gvfs-fuse-daemon on /home/bigdaddy/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=bigdaddy) Disk /dev/sda: 1500.3 GB, 1500301910016 bytes 255 heads, 63 sectors/track, 182401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000e7bc0 Device Boot Start End Blocks Id System /dev/sda1 1 182402 1465137152 83 Linux Disk /dev/sdb: 1500.3 GB, 1500297682432 bytes 255 heads, 63 sectors/track, 182400 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0007c4ba Device Boot Start End Blocks Id System /dev/sdb1 1 182401 1465133056 83 Linux Disk /dev/sdc: 1500.3 GB, 1500297682432 bytes 255 heads, 63 sectors/track, 182400 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00044a34 Device Boot Start End Blocks Id System /dev/sdc1 1 182401 1465133056 83 Linux Disk /dev/sdd: 320.1 GB, 320071851520 bytes 255 heads, 63 sectors/track, 38913 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0xcb8bc459 Device Boot Start End Blocks Id System /dev/sdd1 * 1 26 204800 83 Linux Partition 1 does not end on cylinder boundary. /dev/sdd2 26 38913 312363841 8e Linux LVM Disk /dev/sde: 1500.3 GB, 1500301910016 bytes 255 heads, 63 sectors/track, 182401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000e065f Device Boot Start End Blocks Id System /dev/sde1 1 182402 1465137152 83 Linux Disk /dev/sdf: 1500.3 GB, 1500301910016 bytes 255 heads, 63 sectors/track, 182401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000d722a Device Boot Start End Blocks Id System /dev/sdf1 1 182402 1465137152 83 Linux Disk /dev/sdg: 2000.4 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0006168d Device Boot Start End Blocks Id System /dev/sdg1 1 243202 1953513472 83 Linux Disk /dev/sdh: 2000.4 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0000bbd2 Device Boot Start End Blocks Id System /dev/sdh1 1 243202 1953513472 83 Linux Disk /dev/sdi: 1000.2 GB, 1000200658432 bytes 255 heads, 63 sectors/track, 121600 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x9d994cdf Device Boot Start End Blocks Id System /dev/sdi1 1 121601 976756736 83 Linux Disk /dev/sdj: 2000.4 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0002c68f Device Boot Start End Blocks Id System /dev/sdj1 1 243202 1953513472 83 Linux Disk /dev/sdk: 2000.4 GB, 2000394706432 bytes 255 heads, 63 sectors/track, 243200 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000492e7 Device Boot Start End Blocks Id System /dev/sdk1 1 243201 1953509376 83 Linux Disk /dev/sdl: 1500.3 GB, 1500297682432 bytes 255 heads, 63 sectors/track, 182400 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0006196a Device Boot Start End Blocks Id System /dev/sdl1 1 182401 1465133056 83 Linux Disk /dev/dm-0: 311.4 GB, 311435460608 bytes 255 heads, 63 sectors/track, 37863 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-0 doesn't contain a valid partition table Disk /dev/dm-1: 8422 MB, 8422162432 bytes 255 heads, 63 sectors/track, 1023 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-1 doesn't contain a valid partition table Filesystem Size Used Avail Use% Mounted on /dev/mapper/vg_xavier-lv_root 286G 61G 211G 23% / tmpfs 3.0G 248K 3.0G 1% /dev/shm /dev/sdd1 194M 40M 144M 22% /boot /dev/sdl1 1.4T 1.3T 65G 96% /var/hda/files/drives/drive1 /dev/sdi1 917G 809G 63G 93% /var/hda/files/drives/drive2 /dev/sda1 1.4T 1.2T 123G 91% /var/hda/files/drives/drive3 /dev/sdj1 1.8T 1.7T 81G 96% /var/hda/files/drives/drive4 /dev/sdb1 1.4T 1.3T 72G 95% /var/hda/files/drives/drive7 /dev/sdc1 1.4T 1.2T 158G 88% /var/hda/files/drives/drive8 /dev/sde1 1.4T 1.2T 104G 93% /var/hda/files/drives/drive9 /dev/sdk1 1.8T 1.6T 119G 94% /var/hda/files/drives/drive10 /dev/sdf1 1.4T 198M 1.3T 1% /var/hda/files/drives/drive11 /dev/sdg1 1.8T 73G 1.7T 5% /var/hda/files/drives/drive12 /dev/sdh1 1.8T 73G 1.7T 5% /var/hda/files/drives/drive13 Greyhole Statistics =================== Storage Pool Total - Used = Free + Attic = Possible /var/hda/files/drives/drive1/gh: 1375G - 1241G = 65G + 0G = 65G /var/hda/files/drives/drive2/gh: 917G - 808G = 62G + 0G = 62G /var/hda/files/drives/drive3/gh: 1375G - 1183G = 122G + 0G = 122G /var/hda/files/drives/drive4/gh: 1834G - 1660G = 80G + 0G = 80G /var/hda/files/drives/drive7/gh: 1375G - 1234G = 71G + 0G = 71G /var/hda/files/drives/drive8/gh: 1375G - 1148G = 157G + 0G = 157G /var/hda/files/drives/drive9/gh: 1375G - 1202G = 103G + 0G = 103G /var/hda/files/drives/drive10/gh: 1834G - 1622G = 119G + 0G = 119G /var/hda/files/drives/drive11/gh: 1375G - 0G = 1305G + 0G = 1305G /var/hda/files/drives/drive12/gh: 1834G - 73G = 1668G + 0G = 1668G /var/hda/files/drives/drive13/gh: 1834G - 73G = 1668G + 0G = 1668G

Code: Select all

[root@Xavier ~]# mysql -u root -phda -e "select * from disk_pool_partitions" hda_production +----+-------------------------------+--------------+---------------------+---------------------+ | id | path | minimum_free | created_at | updated_at | +----+-------------------------------+--------------+---------------------+---------------------+ | 1 | /var/hda/files/drives/drive1 | 10 | 2010-12-27 00:16:44 | 2010-12-27 00:16:44 | | 2 | /var/hda/files/drives/drive2 | 10 | 2010-12-27 21:49:01 | 2010-12-27 21:49:01 | | 3 | /var/hda/files/drives/drive3 | 10 | 2010-12-27 23:03:52 | 2010-12-27 23:03:52 | | 4 | /var/hda/files/drives/drive4 | 10 | 2011-01-06 01:31:42 | 2011-01-06 01:31:42 | | 5 | /var/hda/files/drives/drive7 | 10 | 2011-01-17 03:40:38 | 2011-01-17 03:40:38 | | 6 | /var/hda/files/drives/drive8 | 10 | 2011-01-17 04:57:26 | 2011-01-17 04:57:26 | | 7 | /var/hda/files/drives/drive9 | 10 | 2011-01-17 04:57:27 | 2011-01-17 04:57:27 | | 8 | /var/hda/files/drives/drive10 | 10 | 2011-01-29 21:02:22 | 2011-01-29 21:02:22 | | 9 | /var/hda/files/drives/drive11 | 10 | 2011-02-20 00:18:07 | 2011-02-20 00:18:07 | | 10 | /var/hda/files/drives/drive12 | 10 | 2011-02-20 00:18:08 | 2011-02-20 00:18:08 | | 11 | /var/hda/files/drives/drive13 | 10 | 2011-02-20 00:18:10 | 2011-02-20 00:18:10 | +----+-------------------------------+--------------+---------------------+---------------------+
http://fpaste.org/boPB/

Code: Select all

[root@Xavier ~]# greyhole --view-queue Greyhole Work Queue Statistics ============================== This table gives you the number of pending operations queued for the Greyhole daemon, per share. Write Delete Rename Bluray 0 0 0 Documents 0 0 0 DVD 0 0 0 Movies 0 0 0 Music 0 0 0 Pictures 0 0 0 Software 0 0 0 TV 0 0 0 Videos 0 0 0 ========= Total 0 + 0 + 0 = 0 The following is the number of pending operations that the Greyhole daemon still needs to parse. Until it does, the nature of those operations is unknown. Spooled operations that have been parsed will be listed above and disappear from the count below. Spooled 0

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Added 3 new drives and GH isn't using them...

Postby gboudreau » Sat Feb 26, 2011 8:54 am

You probably hit a known issue, where if you have multiple storage pool directories that have the same prefix, GH mix them up.

This is your case, with /var/hda/files/drives/drive1 and /var/hda/files/drives/drive10, drive11, drive12 and drive13.
I suggest that you rename the drive10-drive13 directories to driveA, driveB, etc.

- Rename them in /etc/fstab first
- Then, in a terminal:

Code: Select all

cd /var/hda/files/drives/ umount drive10 umount drive11 umount drive12 umount drive13 mv drive10 driveA mv drive11 driveB mv drive12 driveC mv drive13 driveD mount -a
- Check if the driveA-D contain your files (if the mount worked).
- Then go back in the Amahi Dashboard Storage Pool page, and de-select drive10-drive13 and add driveA-driveD.

A --fsck should fix your problems after that.
And a --balance after that, if you want to.
- Guillaume Boudreau

techlife
Posts: 63
Joined: Sat Dec 18, 2010 3:26 pm

Re: Added 3 new drives and GH isn't using them...

Postby techlife » Sat Feb 26, 2011 9:47 pm

Hi & Thanks for the quick response! I followed your instructions very carefully double checking along the way. Unfortunately, it doesn't seem to have helped anything. This is just a random clipping from the log file but the errors are the same for all files.

Code: Select all

Feb 26 18:33:31 7 balance: Moving this file wouldn't help balancing available space. Skipping. Feb 26 18:33:31 7 balance: Working on file: TV/Two and A Half Men/Season 6/14 - David Copperfield Slipped Me A Roofie/VIDEO_TS/VTS_01_1.VOB (898MB) Feb 26 18:33:31 7 balance: Drives with available space: /var/hda/files/drives/driveC/gh (1.60TB avail) - /var/hda/files/drives/driveD/gh (1.60TB avail) - /var/hda/files/drives/driveB/gh (1.26TB avail) - /var/hda/files/drives/drive8/gh (147GB avail) - /var/hda/files/drives/drive3/gh (112GB avail) - /var/hda/files/drives/driveA/gh (109GB avail) - /var/hda/files/drives/drive9/gh (93.4GB avail) - /var/hda/files/drives/drive4/gh (70.5GB avail) - /var/hda/files/drives/drive7/gh (61.1GB avail) - /var/hda/files/drives/drive1/gh (54.6GB avail) - /var/hda/files/drives/drive2/gh (52.0GB avail) Feb 26 18:33:31 4 balance: PHP Warning [8]: Undefined index: /var/hda/files/drives/driveC/gh in /usr/bin/greyhole on line 3905 Feb 26 18:33:31 7 balance: Target drive: /var/hda/files/drives/driveC/gh (0.00B available) Feb 26 18:33:31 4 balance: PHP Warning [8]: Undefined index: /var/hda/files/drives/driveC/gh in /usr/bin/greyhole on line 3909 Feb 26 18:33:31 7 balance: Moving this file wouldn't help balancing available space. Skipping.
It should be noted that after this, I did try updating and the results where the same. (I still have the "--if-config-changed" -fsck error too.)

Code: Select all

[root@Xavier ~]# uname -r; rpm -q samba hda-greyhole 2.6.32.26-175.fc12.x86_64 samba-3.4.9-60.fc12.x86_64 hda-greyhole-0.9.0-1.x86_64
my (modified) fstab:

Code: Select all

[root@Xavier drives]# cat /etc/fstab # # /etc/fstab # Created by anaconda on Sun Dec 26 15:56:15 2010 # # Accessible filesystems, by reference, are maintained under '/dev/disk' # See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info # /dev/mapper/vg_xavier-lv_root / ext4 defaults 1 1 UUID=a4d51941-d55d-435b-a1e7-93f29b24b533 /boot ext4 defaults 1 2 /dev/mapper/vg_xavier-lv_swap swap swap defaults 0 0 tmpfs /dev/shm tmpfs defaults 0 0 devpts /dev/pts devpts gid=5,mode=620 0 0 sysfs /sys sysfs defaults 0 0 proc /proc proc defaults 0 0 UUID=c4311f17-97c7-4efb-833a-f9505bb8b383 /var/hda/files/drives/drive1 ext4 defaults 1 2 UUID=f7a247bb-23a6-4779-ac07-67fb4f2d20ea /var/hda/files/drives/drive2 ext4 defaults 1 2 UUID=e6b2c723-236a-4640-b5c8-0d95ece9806c /var/hda/files/drives/drive3 ext4 defaults 1 2 UUID=a4268042-3819-41df-86e2-dbe942e27672 /var/hda/files/drives/drive4 ext4 defaults 1 2 UUID=7655f19d-cb88-4ab2-8464-7034dc91ae29 /var/hda/files/drives/drive7 ext4 defaults 1 2 UUID=cbed6ea5-6630-4285-9878-44b2a826ebe9 /var/hda/files/drives/drive8 ext4 defaults 1 2 UUID=bd23ce51-acc3-4f09-86cf-f273fd1d2572 /var/hda/files/drives/drive9 ext4 defaults 1 2 UUID=50dc863c-9d05-4504-976a-04ffe03527ca /var/hda/files/drives/driveA ext4 defaults 1 2 UUID=fc0c9c72-e5b6-48c7-bc3c-34388f2ceef3 /var/hda/files/drives/driveB ext4 defaults 1 2 UUID=54cca1f3-3677-4123-aeac-8224c49f94ef /var/hda/files/drives/driveC ext4 defaults 1 2 UUID=1574cc45-de39-4b93-b8fd-217d7bfab457 /var/hda/files/drives/driveD ext4 defaults 1 2
and FWIW:

Code: Select all

[root@Xavier drives]# mount; fdisk -l; df -h; greyhole --stats /dev/mapper/vg_xavier-lv_root on / type ext4 (rw) proc on /proc type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs (rw) /dev/sdd1 on /boot type ext4 (rw) /dev/sdl1 on /var/hda/files/drives/drive1 type ext4 (rw) /dev/sdi1 on /var/hda/files/drives/drive2 type ext4 (rw) /dev/sda1 on /var/hda/files/drives/drive3 type ext4 (rw) /dev/sdj1 on /var/hda/files/drives/drive4 type ext4 (rw) /dev/sdb1 on /var/hda/files/drives/drive7 type ext4 (rw) /dev/sdc1 on /var/hda/files/drives/drive8 type ext4 (rw) /dev/sde1 on /var/hda/files/drives/drive9 type ext4 (rw) none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) gvfs-fuse-daemon on /home/bigdaddy/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=bigdaddy) /dev/sdf1 on /var/hda/files/drives/driveB type ext4 (rw) /dev/sdg1 on /var/hda/files/drives/driveC type ext4 (rw) /dev/sdh1 on /var/hda/files/drives/driveD type ext4 (rw) /dev/sdk1 on /var/hda/files/drives/driveA type ext4 (rw) Disk /dev/sda: 1500.3 GB, 1500301910016 bytes 255 heads, 63 sectors/track, 182401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000e7bc0 Device Boot Start End Blocks Id System /dev/sda1 1 182402 1465137152 83 Linux Disk /dev/sdb: 1500.3 GB, 1500297682432 bytes 255 heads, 63 sectors/track, 182400 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0007c4ba Device Boot Start End Blocks Id System /dev/sdb1 1 182401 1465133056 83 Linux Disk /dev/sdc: 1500.3 GB, 1500297682432 bytes 255 heads, 63 sectors/track, 182400 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00044a34 Device Boot Start End Blocks Id System /dev/sdc1 1 182401 1465133056 83 Linux Disk /dev/sdd: 320.1 GB, 320071851520 bytes 255 heads, 63 sectors/track, 38913 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0xcb8bc459 Device Boot Start End Blocks Id System /dev/sdd1 * 1 26 204800 83 Linux Partition 1 does not end on cylinder boundary. /dev/sdd2 26 38913 312363841 8e Linux LVM Disk /dev/sde: 1500.3 GB, 1500301910016 bytes 255 heads, 63 sectors/track, 182401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000e065f Device Boot Start End Blocks Id System /dev/sde1 1 182402 1465137152 83 Linux Disk /dev/sdf: 1500.3 GB, 1500301910016 bytes 255 heads, 63 sectors/track, 182401 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000d722a Device Boot Start End Blocks Id System /dev/sdf1 1 182402 1465137152 83 Linux Disk /dev/sdg: 2000.4 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0006168d Device Boot Start End Blocks Id System /dev/sdg1 1 243202 1953513472 83 Linux Disk /dev/sdh: 2000.4 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0000bbd2 Device Boot Start End Blocks Id System /dev/sdh1 1 243202 1953513472 83 Linux Disk /dev/sdi: 1000.2 GB, 1000200658432 bytes 255 heads, 63 sectors/track, 121600 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x9d994cdf Device Boot Start End Blocks Id System /dev/sdi1 1 121601 976756736 83 Linux Disk /dev/sdj: 2000.4 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0002c68f Device Boot Start End Blocks Id System /dev/sdj1 1 243202 1953513472 83 Linux Disk /dev/sdk: 2000.4 GB, 2000394706432 bytes 255 heads, 63 sectors/track, 243200 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000492e7 Device Boot Start End Blocks Id System /dev/sdk1 1 243201 1953509376 83 Linux Disk /dev/sdl: 1500.3 GB, 1500297682432 bytes 255 heads, 63 sectors/track, 182400 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0006196a Device Boot Start End Blocks Id System /dev/sdl1 1 182401 1465133056 83 Linux Disk /dev/dm-0: 311.4 GB, 311435460608 bytes 255 heads, 63 sectors/track, 37863 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-0 doesn't contain a valid partition table Disk /dev/dm-1: 8422 MB, 8422162432 bytes 255 heads, 63 sectors/track, 1023 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-1 doesn't contain a valid partition table Filesystem Size Used Avail Use% Mounted on /dev/mapper/vg_xavier-lv_root 286G 61G 211G 23% / tmpfs 3.0G 396K 3.0G 1% /dev/shm /dev/sdd1 194M 40M 144M 22% /boot /dev/sdl1 1.4T 1.3T 65G 96% /var/hda/files/drives/drive1 /dev/sdi1 917G 809G 63G 93% /var/hda/files/drives/drive2 /dev/sda1 1.4T 1.2T 123G 91% /var/hda/files/drives/drive3 /dev/sdj1 1.8T 1.7T 81G 96% /var/hda/files/drives/drive4 /dev/sdb1 1.4T 1.3T 72G 95% /var/hda/files/drives/drive7 /dev/sdc1 1.4T 1.2T 158G 88% /var/hda/files/drives/drive8 /dev/sde1 1.4T 1.2T 104G 93% /var/hda/files/drives/drive9 /dev/sdf1 1.4T 198M 1.3T 1% /var/hda/files/drives/driveB /dev/sdg1 1.8T 89G 1.7T 6% /var/hda/files/drives/driveC /dev/sdh1 1.8T 89G 1.7T 6% /var/hda/files/drives/driveD /dev/sdk1 1.8T 1.6T 119G 94% /var/hda/files/drives/driveA Greyhole Statistics =================== Storage Pool Total - Used = Free + Attic = Possible /var/hda/files/drives/drive1/gh: 1375G - 1241G = 65G + 0G = 65G /var/hda/files/drives/drive2/gh: 917G - 808G = 62G + 0G = 62G /var/hda/files/drives/drive3/gh: 1375G - 1183G = 122G + 0G = 122G /var/hda/files/drives/drive4/gh: 1834G - 1660G = 80G + 0G = 80G /var/hda/files/drives/drive7/gh: 1375G - 1234G = 71G + 0G = 71G /var/hda/files/drives/drive8/gh: 1375G - 1148G = 157G + 0G = 157G /var/hda/files/drives/drive9/gh: 1375G - 1202G = 103G + 0G = 103G /var/hda/files/drives/driveB/gh: 1375G - 0G = 1305G + 0G = 1305G /var/hda/files/drives/driveC/gh: 1834G - 88G = 1652G + 1G = 1653G /var/hda/files/drives/driveD/gh: 1834G - 88G = 1652G + 1G = 1653G /var/hda/files/drives/driveA/gh: 1834G - 1622G = 119G + 0G = 119G

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Added 3 new drives and GH isn't using them...

Postby gboudreau » Sun Feb 27, 2011 5:21 am

Edit /usr/bin/greyhole in a text editor.

Above line 4186: gh_log(DEBUG, " Target drive: $target_drive (". bytes_to_human($pool_drives_avail_space[$target_drive]*1024, FALSE) ." available)");

Add 3 new lines like this:

Code: Select all

gh_log(DEBUG, var_export($pool_drives_avail_space, TRUE)); $x = sort_storage_dirs_available_space(); gh_log(DEBUG, var_export($x, TRUE));
End result should be:

Code: Select all

gh_log(DEBUG, var_export($pool_drives_avail_space, TRUE)); $x = sort_storage_dirs_available_space(); gh_log(DEBUG, var_export($x, TRUE)); gh_log(DEBUG, " Target drive: $target_drive (". bytes_to_human($pool_drives_avail_space[$target_drive]*1024, FALSE) ." available)");
Then try to --balance again, and post another excerpt from your greyhole.log
- Guillaume Boudreau

techlife
Posts: 63
Joined: Sat Dec 18, 2010 3:26 pm

Re: Added 3 new drives and GH isn't using them...

Postby techlife » Sun Feb 27, 2011 11:08 am

As inserted:

Code: Select all

if (!isset($target_drive)) { // Can't find a drive that doesn't have this file; skipping. if ($is_sticky) { gh_log(DEBUG, " Sticky file is already where it should be. Skipping."); } continue; } gh_log(DEBUG, var_export($pool_drives_avail_space, TRUE)); $x = sort_storage_dirs_available_space(); gh_log(DEBUG, var_export($x, TRUE)); gh_log(DEBUG, " Target drive: $target_drive (". bytes_to_human($pool_drives_avail_space[$target_drive]*1024, FALSE) ." available)"); if ($is_sticky) { gh_log(DEBUG, " Moving sticky file, even if that means it won't help balancing available space."); } else if ($pool_drives_avail_space[$source_drive]+$filesize+1*1024*1024 /*1GB*/ > $pool_drives_avail_space[$target_drive]-$filesize || $pool_drives_avail_space[$source_drive]+$filesize > $target_avail_space || $pool_drives_avail_space[$target_drive] < $target_avail_space) { gh_log(DEBUG, " Moving this file wouldn't help balancing available space. Skipping."); continue; }
Result:

Code: Select all

Feb 27 09:36:56 7 balance: Working on file: DVD/Kids_Movies/The Dark Knight/VIDEO_TS/VTS_01_5.VOB (1,024MB) Feb 27 09:36:56 7 balance: Drives with available space: /var/hda/files/drives/driveC/gh (1.60TB avail) - /var/hda/files/drives/driveD/gh (1.60TB avail) - /var/hda/files/drives/driveB/gh (1.26TB avail) - /var/hda/files/drives/drive8/gh (147GB avail) - /var/hda/files/drives/drive3/gh (112GB avail) - /var/hda/files/drives/driveA/gh (109GB avail) - /var/hda/files/drives/drive9/gh (93.4GB avail) - /var/hda/files/drives/drive4/gh (70.5GB avail) - /var/hda/files/drives/drive7/gh (61.1GB avail) - /var/hda/files/drives/drive1/gh (54.6GB avail) - /var/hda/files/drives/drive2/gh (52.0GB avail) Feb 27 09:36:56 7 balance: array ( '/var/hda/files/drives/drive2/gh' => 54567948, '/var/hda/files/drives/drive1/gh' => 57199908, '/var/hda/files/drives/drive7/gh' => 64082048, '/var/hda/files/drives/drive4/gh' => 73881532, '/var/hda/files/drives/drive9/gh' => 97977952, '/var/hda/files/drives/driveA/gh' => 114204404, '/var/hda/files/drives/drive3/gh' => 117921296, '/var/hda/files/drives/drive8/gh' => 154535716, '/var/hda/files/drives/driveB/gh' => 1358201368, '/var/hda/files/drives/driveD/gh' => 1722201864, ) Feb 27 09:36:56 7 balance: array ( 54567948 => '/var/hda/files/drives/drive2/gh', 57199908 => '/var/hda/files/drives/drive1/gh', 64082048 => '/var/hda/files/drives/drive7/gh', 73881532 => '/var/hda/files/drives/drive4/gh', 97977952 => '/var/hda/files/drives/drive9/gh', 114204404 => '/var/hda/files/drives/driveA/gh', 117921296 => '/var/hda/files/drives/drive3/gh', 154535716 => '/var/hda/files/drives/drive8/gh', 1358201368 => '/var/hda/files/drives/driveB/gh', 1722201864 => '/var/hda/files/drives/driveD/gh', ) Feb 27 09:36:56 4 balance: PHP Warning [8]: Undefined index: /var/hda/files/drives/driveC/gh in /usr/bin/greyhole on line 4188 Feb 27 09:36:56 7 balance: Target drive: /var/hda/files/drives/driveC/gh (0.00B available) Feb 27 09:36:56 4 balance: PHP Warning [8]: Undefined index: /var/hda/files/drives/driveC/gh in /usr/bin/greyhole on line 4192 Feb 27 09:36:56 7 balance: Moving this file wouldn't help balancing available space. Skipping.
EDIT: I have tried (as a troubleshooting measure) removing "driveC" from the storage pool. The balance operation appears to be working:

Code: Select all

Feb 27 12:06:13 7 balance: Balancing storage pool directory: /var/hda/files/drives/drive2/gh (52.0GB available, target: 360GB) Feb 27 12:06:13 7 balance: Found 1 files that can be moved. Feb 27 12:06:13 7 balance: Working on file: Bluray/Red/BDMV/STREAM/00000.m2ts (4.84GB) Feb 27 12:06:13 7 balance: Drives with available space: /var/hda/files/drives/driveD/gh (1.57TB avail) - /var/hda/files/drives/driveB/gh (1.26TB avail) - /var/hda/files/drives/drive8/gh (147GB avail) - /var/hda/files/drives/drive3/gh (112GB avail) - /var/hda/files/drives/driveA/gh (109GB avail) - /var/hda/files/drives/drive9/gh (93.4GB avail) - /var/hda/files/drives/drive4/gh (70.5GB avail) - /var/hda/files/drives/drive7/gh (61.1GB avail) - /var/hda/files/drives/drive1/gh (54.6GB avail) - /var/hda/files/drives/drive2/gh (52.0GB avail) Feb 27 12:06:13 7 balance: array ( '/var/hda/files/drives/drive2/gh' => 54567948, '/var/hda/files/drives/drive1/gh' => 57199908, '/var/hda/files/drives/drive7/gh' => 64082048, '/var/hda/files/drives/drive4/gh' => 73881532, '/var/hda/files/drives/drive9/gh' => 97977952, '/var/hda/files/drives/driveA/gh' => 114204404, '/var/hda/files/drives/drive3/gh' => 117921296, '/var/hda/files/drives/drive8/gh' => 154535716, '/var/hda/files/drives/driveB/gh' => 1358201368, '/var/hda/files/drives/driveD/gh' => 1685534940, ) Feb 27 12:06:13 7 balance: array ( 54567948 => '/var/hda/files/drives/drive2/gh', 57199908 => '/var/hda/files/drives/drive1/gh', 64082048 => '/var/hda/files/drives/drive7/gh', 73881532 => '/var/hda/files/drives/drive4/gh', 97977952 => '/var/hda/files/drives/drive9/gh', 114204404 => '/var/hda/files/drives/driveA/gh', 117921296 => '/var/hda/files/drives/drive3/gh', 154535716 => '/var/hda/files/drives/drive8/gh', 1358201368 => '/var/hda/files/drives/driveB/gh', 1685534940 => '/var/hda/files/drives/driveD/gh', ) Feb 27 12:06:13 7 balance: Target drive: /var/hda/files/drives/driveD/gh (1.57TB available) Feb 27 12:06:13 7 balance: Moving file copy...
The balance just started so I'll keep you posted. Any initial ideas why this may be happening? Could it be an issue with the drive? FWIW, palimpsest reports the drive as being fine...FWIW

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Added 3 new drives and GH isn't using them...

Postby gboudreau » Sun Feb 27, 2011 2:42 pm

This seems like a GH bug. Your driveC is not returned by the sort_storage_dirs_available_space function, for some reason.
And since it's the drive with the most space, --balance always select it as the target of files to move to balance free space, thus why having it in the pool doesn't balance anything.

*edit: I found the problem.
Your driveC and driveD (were drive12 and drive13) had the exact same amount of free space.
When that happens, GH 'looses' the first one, in the sort_storage_dirs_available_space function.
The next version of Greyhole will fix this.

Now, since you did a balance without driveC, your driveD free space is not equal to the driveC free space anymore. So you can safely re-add driveC, and re-do a --balance, and all will work as expected.

Thanks for your time.

PS You can remove the 3 lines you added. Won't hurt really to leave them there, it will only
- Guillaume Boudreau

techlife
Posts: 63
Joined: Sat Dec 18, 2010 3:26 pm

Re: Added 3 new drives and GH isn't using them...

Postby techlife » Sun Feb 27, 2011 3:13 pm

Once this balance completes, I will try again and let you know how I make out

Thank you very much for looking into this for me and getting to the bottom of it!!!

techlife
Posts: 63
Joined: Sat Dec 18, 2010 3:26 pm

Re: Added 3 new drives and GH isn't using them...

Postby techlife » Mon Feb 28, 2011 9:21 pm

Works perfectly now. Saw the update on Twitter and installed tonight which also fixed my --fsck issue.

Thanks for all the hard work and great support!!!!!!!!!!

t0bbe
Posts: 38
Joined: Mon Apr 26, 2010 5:09 am

Re: Added 3 new drives and GH isn't using them...

Postby t0bbe » Sat May 28, 2011 12:20 am

I had the same problem, I installed two new 2TB drives and had the same "PHP errors" in the greyhole.log.

Just by chance I removed one of them, did a balance, and then installed it again, and that fixed it.

How do I update to the latest issue of greyhole?

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Added 3 new drives and GH isn't using them...

Postby gboudreau » Sat May 28, 2011 2:41 am

- Guillaume Boudreau

Who is online

Users browsing this forum: No registered users and 19 guests