Greyhole always busy with more than 90000 tasks queued

[paurey]

Hi I am having a problem with greyhole. I dumped a lot of GB into my shares in the pool, like 130 GB in a day, but greyhole just never ends doing tasks after month already ON.....I don't think I am missing files (or at least I am not aware of it). Thanks for your help and advice.

Code: Select all

rpm -q samba hda-greyhole 2.6.35.6-45.fc14.x86_64 samba-3.5.5-68.fc14.1.x86_64 hda-greyhole-0.9.2-1.x86_64

Code: Select all

fpaste /etc/samba/smb.conf http://fpaste.org/XzX3/ fpaste /etc/greyhole.conf​ http://fpaste.org/L46X/

Code: Select all

/dev/mapper/vg_servidorfaura-lv_root on / type ext4 (rw,user_xattr) proc on /proc type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs (rw) /dev/sda1 on /boot type ext4 (rw) /dev/mapper/vg_servidorfaura-lv_home on /home type ext4 (rw) /dev/sdb1 on /var/hda/files type ext4 (rw) /dev/sdc1 on /var/hda/files/drives/drive8 type ext4 (rw) /dev/sdd1 on /var/hda/files/drives/drive9 type ext4 (rw) none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) fusectl on /sys/fs/fuse/connections type fusectl (rw) gvfs-fuse-daemon on /home/pau/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=pau) Disk /dev/sda: 80.0 GB, 80026361856 bytes 255 heads, 63 sectors/track, 9729 cylinders, total 156301488 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x9c879c87 Device Boot Start End Blocks Id System /dev/sda1 * 2048 1026047 512000 83 Linux /dev/sda2 1026048 156301311 77637632 8e Linux LVM Disk /dev/sdb: 2000.4 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x0009cfd4 Device Boot Start End Blocks Id System /dev/sdb1 63 3907029167 1953514552+ 83 Linux Disk /dev/sdc: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders, total 1953525168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x000d3918 Device Boot Start End Blocks Id System /dev/sdc1 2048 1953523711 976760832 83 Linux Disk /dev/sdd: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders, total 1953525168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0xd5ef77c7 Device Boot Start End Blocks Id System /dev/sdd1 63 1953525167 976762552+ 83 Linux Disk /dev/dm-0: 53.7 GB, 53687091200 bytes 255 heads, 63 sectors/track, 6527 cylinders, total 104857600 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x00000000 Disk /dev/dm-0 doesn't contain a valid partition table Disk /dev/dm-1: 4194 MB, 4194304000 bytes 255 heads, 63 sectors/track, 509 cylinders, total 8192000 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x00000000 Disk /dev/dm-1 doesn't contain a valid partition table Disk /dev/dm-2: 21.6 GB, 21609054208 bytes 255 heads, 63 sectors/track, 2627 cylinders, total 42205184 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x00000000 Disk /dev/dm-2 doesn't contain a valid partition table Filesystem Size Used Avail Use% Mounted on /dev/mapper/vg_servidorfaura-lv_root 50G 8.6G 39G 19% / tmpfs 1000M 456K 999M 1% /dev/shm /dev/sda1 485M 30M 430M 7% /boot /dev/mapper/vg_servidorfaura-lv_home 20G 5.1G 14G 27% /home /dev/sdb1 1.8T 854G 888G 50% /var/hda/files /dev/sdc1 917G 427G 445G 49% /var/hda/files/drives/drive8 /dev/sdd1 917G 427G 444G 50% /var/hda/files/drives/drive9 Greyhole Statistics =================== Storage Pool Total - Used = Free + Attic = Possible /var/hda/files/gh: 1834G - 853G = 888G + 0G = 888G /var/hda/files/drives/drive8/gh: 917G - 426G = 444G + 6G = 451G /var/hda/files/drives/drive9/gh: 917G - 426G = 444G + 1G = 445G ========================================== Total: 3668G - 1706G = 1775G + 7G = 1783G

Code: Select all

mysql -u root -phda -e "select * from disk_pool_partitions" hda_production +----+------------------------------+--------------+---------------------+---------------------+ | id | path | minimum_free | created_at | updated_at | +----+------------------------------+--------------+---------------------+---------------------+ | 1 | /var/hda/files | 10 | 2011-06-20 19:31:09 | 2011-06-20 19:31:09 | | 3 | /var/hda/files/drives/drive8 | 10 | 2011-08-20 10:59:45 | 2011-08-20 10:59:45 | | 4 | /var/hda/files/drives/drive9 | 10 | 2011-08-21 15:22:59 | 2011-08-21 15:22:59 | +----+------------------------------+--------------+---------------------+---------------------+

Code: Select all

mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" hda_production | grep -v 'concat(' | xargs ls -la | fpaste http://fpaste.org/4Jbu/

Code: Select all

greyhole --view-queue Greyhole Work Queue Statistics ============================== This table gives you the number of pending operations queued for the Greyhole daemon, per share. Write Delete Rename arxiu 0 0 0 arxiudup 0 0 0 copiasseguridad 51398 0 0 Fotos 0 0 0 Music 0 0 0 papi 0 0 0 paucoses 0 0 0 paucosesdup 0 0 0 Pelis 0 0 0 Temp 112 0 0 =============== Total 51510 + 0 + 0 = 51510 The following is the number of pending operations that the Greyhole daemon still needs to parse. Until it does, the nature of those operations is unknown. Spooled operations that have been parsed will be listed above and disappear from the count below. Spooled 748345

[minnalova]

Have you tried to restart your Amahi-server? For me Greyhole was stuck on Amahi for Ubuntu after I had created shares and dumped files to them until I restared Amahi. Seems like you still have a lot of files in your Landing Zone /var/hda/files if they shouldn't be there (i.e. you have a lot of files not in the storage pool).

[paurey]

Thanks but I have tried restarting the server several times actually.
Yes there are a lot of files in the LZ but it just never ends sorting them out.

[bigfoot65]

Have you done greyhole -f? That might speed things along.

[paurey]

greyhole -f, yes, that is what I have been trying so far unsuccessfully.

I restarted the server again, and put the next two commands:

greyhole --cancel-fsck

greyhole -f


But still more than 90000 tasks queued
but now I get the meesage: only locked files operations pending...Sleeping

This is new. Any suggestions?

[bigfoot65]

If only locked files are pending, you need to determine what those files are and why they are locked. One thing you can do is ensure only the HDA is online until it finishes. That should ensure no files are locked. I would also recommend you stop any services for apps, i.e. DLNA, VNC, etc.

Then run greyhole -f again and monitor it's status. Do you have the mount_shares_locally script installed and running? If not, might consider doing that as well. Guidance can be found in the wiki.

[paurey]

Finally.....I found it.

It was the VNCSERVER that was locking folders apparently. I had to stop it, and restart amahi so greyhole could start doing its homework. After a couple of days it seems that the queue is finally going down.

How can I uninstall VNCSERVER ? Unless an easy and quick solution proposed, I already lost too much time with it already, and don't want more trouble.


Thanks

[bigfoot65]

Depends on how you installed it. If it is the Amahi app, select uninstall. If you manually installed it, you will need to reverse the steps for the most part.

VNC Server is not installed by default to the best of my knowledge, so it's one of those two options.