Stuck in renaming loop

evylrat
Posts: 106
Joined: Sun Jan 02, 2011 6:37 pm

Stuck in renaming loop

Postby evylrat » Sun Feb 20, 2011 11:10 am

Issue was apparent this morning. It's renaming, or looking for tombstones, files that are no longer available. The greyhole.log so far today is 8Gb, think I'm going to have to kill the greyhole service.

uname -r; rpm -q samba hda-greyhole

Code: Select all

2.6.31.5-127.fc12.x86_64 samba-3.4.9-60.fc12.x86_64 hda-greyhole-0.8.99-1.x86_64
did an update, still in a loop

Code: Select all

2.6.31.5-127.fc12.x86_64 samba-3.4.9-60.fc12.x86_64 hda-greyhole-0.9.0-1.x86_64
/etc/samba/smb.conf - http://fpaste.org/2pbQ/
/etc/greyhole.conf - http://fpaste.org/LJo2/

mount; fdisk -l; df -h; greyhole --stats

Code: Select all

/dev/mapper/vg_evylrat-lv_root on / type ext4 (rw) proc on /proc type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs (rw) /dev/sdc1 on /boot type ext4 (rw) /dev/sdb1 on /var/hda/files/drives/drive4 type ext4 (rw) /dev/sda1 on /var/hda/files/drives/drive5 type ext4 (rw) none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) Disk /dev/sda: 2000.4 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000b737a Device Boot Start End Blocks Id System /dev/sda1 1 243202 1953514464+ 83 Linux Disk /dev/sdb: 2000.4 GB, 2000398934016 bytes 255 heads, 63 sectors/track, 243201 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000616c9 Device Boot Start End Blocks Id System /dev/sdb1 1 243202 1953514464+ 83 Linux Disk /dev/sdc: 120.0 GB, 120034123776 bytes 255 heads, 63 sectors/track, 14593 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0004282b Device Boot Start End Blocks Id System /dev/sdc1 * 1 26 204800 83 Linux Partition 1 does not end on cylinder boundary. /dev/sdc2 26 14593 117013441 8e Linux LVM Disk /dev/dm-0: 115.6 GB, 115590823936 bytes 255 heads, 63 sectors/track, 14053 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-0 doesn't contain a valid partition table Disk /dev/dm-1: 4227 MB, 4227858432 bytes 255 heads, 63 sectors/track, 514 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-1 doesn't contain a valid partition table Filesystem Size Used Avail Use% Mounted on /dev/mapper/vg_evylrat-lv_root 106G 37G 65G 37% / tmpfs 1001M 88K 1001M 1% /dev/shm /dev/sdc1 194M 23M 162M 13% /boot /dev/sdb1 1.8T 1.2T 527G 70% /var/hda/files/drives/drive4 /dev/sda1 1.8T 1.2T 608G 66% /var/hda/files/drives/drive5 Greyhole Statistics =================== Storage Pool Total - Used = Free + Attic = Possible /var/hda/files/drives/drive4/gh: 1834G - 1214G = 527G + 0G = 527G /var/hda/files/drives/drive5/gh: 1834G - 1133G = 608G + 0G = 608G ========================================== Total: 3668G - 2347G = 1135G + 0G = 1135G
mysql -u root -phda -e "select * from disk_pool_partitions" hda_production

Code: Select all

+----+------------------------------+--------------+---------------------+---------------------+ | id | path | minimum_free | created_at | updated_at | +----+------------------------------+--------------+---------------------+---------------------+ | 2 | /var/hda/files/drives/drive4 | 10 | 2011-01-29 10:25:27 | 2011-01-29 10:25:27 | | 3 | /var/hda/files/drives/drive5 | 10 | 2011-01-29 10:25:28 | 2011-01-29 10:25:28 | +----+------------------------------+--------------+---------------------+---------------------+
mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" hda_production | grep -v 'concat(' | xargs ls -la | fpaste
http://fpaste.org/Ptov/

greyhole --view-queue

Code: Select all

Write Delete Rename Backup 0 157 0 Movies 0 3 0 Music 63 0 0 Pictures 0 0 0 Public 63365 27154 56 Purchases 0 0 0 TvShows 0 0 0 Videos 1 0 0 ========= Total 63429 + 27314 + 56 = 90799 The following is the number of pending operations that the Greyhole daemon still needs to parse. Until it does, the nature of those operations is unknown. Spooled operations that have been parsed will be listed above and disappear from the count below. Spooled 71
This spooled value keeps jumping up over 100,000.

EXTRACT from greyhole.log

Code: Select all

Feb 20 18:09:27 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/SLV... Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/SLV/HDMISLV.dll... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/SLV/license.txt... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/sve... Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/sve/HDMIsve.dll... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/sve/license.txt... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ita... Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ita/HDMIita.dll... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ita/license.txt... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/nld... Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/nld/HDMInld.dll... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/nld/license.txt... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/jpn... Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/jpn/license.txt... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/jpn/HDMIjpn.dll... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ell... Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ell/HDMIell.dll... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ell/license.txt... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ptg... Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ptg/HDMIptg.dll... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ptg/license.txt... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/nor... Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/nor/HDMInor.dll... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/nor/license.txt... Got 1 tombstones. Feb 20 18:09:27 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Vista/v64/Graphics/LANG/HDMI/ENU...
This just keeps going on and on and on.

Can anyone give any pointers?

evylrat
Posts: 106
Joined: Sun Jan 02, 2011 6:37 pm

Re: Stuck in renaming loop

Postby evylrat » Mon Feb 21, 2011 3:16 pm

extract from today's log

Code: Select all

Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/heb... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/heb/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/heb/HDMIheb.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/jpn... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/jpn/HDMIjpn.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/jpn/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ptb... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ptb/HDMIptb.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ptb/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ell... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ell/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ell/HDMIell.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ptg... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ptg/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ptg/HDMIptg.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/SKY... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/SKY/HDMISKY.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/SKY/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/nor... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/nor/HDMInor.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/nor/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/cht... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/cht/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/cht/HDMIcht.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/kor... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/kor/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/kor/HDMIkor.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/fin... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/fin/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/fin/HDMIfin.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/deu... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/deu/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/deu/HDMIdeu.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/trk... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/trk/HDMItrk.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/trk/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI... Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/hun... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/hun/HDMIhun.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/hun/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/sve... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/sve/HDMIsve.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/sve/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ell... Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ell/license.txt... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ell/HDMIell.dll... Got 1 tombstones. Feb 21 22:13:02 7 rename: Loading tombstones for (dir) Public/library/drivers/Shuttle/SG33G5M/CD/Share/VGA/Win2KXP/x32/Graphics/LANG/HDMI/ENU...

Code: Select all

Greyhole Work Queue Statistics ============================== This table gives you the number of pending operations queued for the Greyhole daemon, per share. Write Delete Rename Backup 0 157 0 Movies 0 3 0 Music 63 0 0 Pictures 0 0 0 Public 63365 27154 56 Purchases 0 0 0 TvShows 0 0 0 Videos 1 0 0 ========= Total 63429 + 27314 + 56 = 90799 The following is the number of pending operations that the Greyhole daemon still needs to parse. Until it does, the nature of those operations is unknown. Spooled operations that have been parsed will be listed above and disappear from the count below. Spooled 15242
Spooled operations up from yesterday's count. Amahi's been running for about 1.5 hrs, and log is at 800mb.

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Stuck in renaming loop

Postby gboudreau » Tue Feb 22, 2011 8:22 am

Code: Select all

mysql -u greyhole -pgreyhole -e "delete from tasks where action = 'rename'" greyhole greyhole --fsck service greyhole restart
Should fix this.
This is a bug where renaming a directory sends Greyhole in what looks like an infinite loop, but isn't. It just takes a long long time trying to find all files in the renamed directory.
The bigger the directory (and sub-directories), the longer it will take greyhole.
The issue is tracked in the GH bug tracker: http://code.google.com/p/greyhole/issues/detail?id=62
- Guillaume Boudreau

evylrat
Posts: 106
Joined: Sun Jan 02, 2011 6:37 pm

Re: Stuck in renaming loop

Postby evylrat » Tue Feb 22, 2011 4:53 pm

That did the trick; spooled says ZERO and the pending operations is slowly returning to ZERO. I think I copied lots of files to Greyhole whilst it was busy doing all the other operations, then I went and deleted the files.

UPDATE: All my files have disappeared from Greyhole shares. I'm guessing once Greyhole finishes it's pass they should all appear?
(slightly nervous!)

2ndUPDATE: All files returned now. Thanks for your help.

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Stuck in renaming loop

Postby gboudreau » Sun Feb 27, 2011 7:29 pm

The bug should be resolved in the latest Greyhole.
You can try it with:

Code: Select all

rpm -Uvh http://www.greyhole.net/releases/hda-greyhole-0.9.1-1.`uname -i`.rpm
- Guillaume Boudreau

evylrat
Posts: 106
Joined: Sun Jan 02, 2011 6:37 pm

Re: Stuck in renaming loop

Postby evylrat » Mon Feb 28, 2011 5:32 am

Thanks, updated, all seems ok so far, will keep an eye on that. Keep up the great work!

aphex242
Posts: 30
Joined: Fri Mar 04, 2011 2:36 pm

Re: Stuck in renaming loop

Postby aphex242 » Thu Mar 10, 2011 9:52 am

This actually helped me on the latest version. To summarize:

I had just installed Amahi and copied a lot of small files to a greyhole share. Then I realized I had accidentally nested the folder, so I canceled through the copy (quite a ways in) and began the copy again, this time correctly. While the copy was going, I deleted the accidentally nested subfolder (that probably had 140k files in it).

This created a huge greyhole queue (which I wasn't aware of at the time, I figured this out over the past few days). It is very slow processing entries that have been subsequently deleted. It finally got through all that and then seemed stuck in this renaming loop for me too. The queue wasn't dropping at all over several hours even though greyhole.log continued to churn entries.

Anyway this fixed things for me too, thanks. Seems like there might still be a persistent error in the latest version as well.

User avatar
lrevxl
Posts: 82
Joined: Fri Mar 04, 2011 7:23 pm
Location: Chicago, IL, USA
Contact:

Re: Stuck in renaming loop

Postby lrevxl » Thu Mar 10, 2011 4:27 pm

Anyway this fixed things for me too, thanks. Seems like there might still be a persistent error in the latest version as well.
Can you provide some more information? The original issue was never infinite, though it was exponential. The fix I put in 0.9.1 should have removed the scenario where a rename would fire up an exponential number of tombstone calls. (Actually with the way I cleaned up the function if the issue were still present any call to look up tombstones for a directory would trigger it -- which doesn't seem to be the case.)
  • Were you watching the tasks, was the count going down?
    Were you actually seeing the same file get its tombstone loaded multiple times and if so are you specifying >1 copy for the share?
    Can you provide log samples?
    Can you verify the version of Greyhole that you're running?
Those are all the questions I can think of off the top of my head. :shock:

aphex242
Posts: 30
Joined: Fri Mar 04, 2011 2:36 pm

Re: Stuck in renaming loop

Postby aphex242 » Thu Mar 10, 2011 4:36 pm

Sorry, I suspected my vague post would generate a response like this. I'll try to answer as best I can, totally a noob here.

1. The count had been going down until I got to these renaming tasks, then it stopped. It actually went up slightly at one point, but that may have been something I did. It definitely was fairly stable. It wasn't moving down at all, but it wasn't going up much either.

2. It did appear that it kept hopping back and forth between rename on two directories. The files I described were structured in lots of nested subfolders (2-3 levels deep only though) and between 200-4000 files in each. I wasn't seeing identical files, but that would have been hard to spot. It did seem to keep going back and forth between like 3-4 directories. Like it had a rotating list of directories it was visiting. This went on long enough that I could tell there was an issue, because these folders didn't have THAT many files.

3. As far as logs, I'm not even sure how to get at them, as I said the problem is resolved now and it's merrily chugging away on the sleeping message now.

4. Version, I'm not 100% sure. I'm running Amahi 6 with Fedora 14, and I installed it on the day after it became public (not beta). If you could tell me where to find the version I could post it, sure.

4. (edit) - Aha! I googled it and found the command. I'm running 0.9.2-1

User avatar
lrevxl
Posts: 82
Joined: Fri Mar 04, 2011 7:23 pm
Location: Chicago, IL, USA
Contact:

Re: Stuck in renaming loop

Postby lrevxl » Thu Mar 10, 2011 7:40 pm

Okay, so your version should definitely have the fix that I put in. The fact that tasks weren't going down makes it sounds like it is indeed more of an infinite loop than an exponential slow down.

To get access to the logs you can go to /var/log and you'll find your old Greyhole logs with names like greyhole.log-YYYYMMDD.gz if you can dig up one of the logs and send it along I can try to deduce exactly where the code is getting stuck in a loop.

I'm glad your issue is resolved but I'd like to try to make sure others don't run into it as well. (Myself included.) :P

Who is online

Users browsing this forum: No registered users and 6 guests