Greyhole getting stuck

jkbuckethead
Posts: 56
Joined: Sat Jan 31, 2015 5:35 pm

Greyhole getting stuck

Postby jkbuckethead » Mon Jul 31, 2017 2:33 am

I recently began an effort to bring order to the chaos that is my media collection. This has resulted in a good deal of renaming and deleting (similar) files, but not actually much new information. I know that changing lot of files is not greyhole's strong suit, but I'm beginning to wonder if I need to start over from scratch.

The greyhole queue keeps getting stuck in endless loops where it repeats the same small set of commands over and over. Viewed in real time using the TAIL command, I can often see a pattern emerge visually, based on the different line lengths because it is moving so fast. Using the GH Logmon app, I can view a snapshot of the queue. I'll search for unique piece of text from the queue using the browser's find command, and see that text repeated over and over dozens of times.

I am able to stop the queue to from looping using the procedure on the greyhole troubleshooting page (https://wiki.amahi.org/index.php/Greyho ... Work Queue), but eventually the loop starts again during the subsequent fsck. At this point I'm not certain it will ever complete an fsck.

I had this happen infrequently with amahi 9, but it's become more common for me since upgrading to amahi 10. Of course, this could just be a coincidence since I've done similar large scale adds/moves/deletes before without this happening. I'm wondering if anyone else has seen an increase in greyhole problems since amahi 10?

If this continues I'm not really sure of my next step. I prefer to not rebuild my landing zone unless absolutely necessary because of the possibility this error could continue to occur. If it does and I've deleted my landing zone shares, then I'm even worse off. At least for now most of my files are readily accessible.

I'd appreciate some help determining the cause, and the best next step. I've included some troubleshooting info below. This represents items 1 & 2 at the top of the troubleshooting page. I haven't included #3 because I don't know how to capture the results to a text file, and the raw results are rather lengthy. #4 isn't included because when I executed the command it asked for a password. I entered my password, the only one I know to be associated with my hda, and it was rejected with an error (see below). I'm not sure what the error means.

#1
4.11.9-200.fc25.x86_64
samba-4.5.11-0.fc25.x86_64
amahi-greyhole-0.10.10-1.x86_64

#2
smb.conf https://da.gd/E5WD
greyhole.conf https://da.gd/knoR

#4
[root@hda ~]# mysql -u root -p -e "select * from disk_pool_partitions" hda_production
Enter password:
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)

Thanks in advance.

User avatar
bigfoot65
Project Manager
Posts: 10546
Joined: Mon May 25, 2009 4:31 pm

Re: Greyhole getting stuck

Postby bigfoot65 » Mon Jul 31, 2017 7:59 am

This has resulted in a good deal of renaming and deleting (similar) files, but not actually much new information.
Did you do this through Samba or via command line?
I had this happen infrequently with amahi 9, but it's become more common for me since upgrading to amahi 10.
I don't believe it's related to #Amahi. This release will likely correct your issue.

We have not updated #Amahi yet, but expect to soon.
ßîgƒσστ65
Applications Manager

jkbuckethead
Posts: 56
Joined: Sat Jan 31, 2015 5:35 pm

Re: Greyhole getting stuck

Postby jkbuckethead » Mon Jul 31, 2017 4:43 pm

The changes were made from a windows PC over the network, so samba I guess.

Hopefully the GH update will help.

The good news is that it appears to have completed an FSCK today without getting stuck in a loop. The landing zone is empty of files so I'm less concerned about data loss if I need to do something else. I performed a second FSCK just to be sure, and it completed as well, but I noticed something odd. The last few tasks on the second FSCK were exactly the same as the prior one. I scrolled up and saw that the sequence (below) of "Now working on task..." followed by "WARNING! No copies of the file are available..." was repeated hundreds, possibly thousands of times. After the warning there is never a resolution or action. This explains why they are showing up in multiple FSCK.

Jul 31 19:16:05 INFO fsck_file: Now working on task ID 75210: fsck_file Videos/insert filename
Jul 31 19:16:05 WARN fsck_file: WARNING! No copies of this file are available in the Greyhole storage pool: "Videos/insert filename

I couldn't possibly recognize every file, but it just so happens that I did the last one. It is a file that was sorted and moved to a sub-directory some time ago. It wasn't sorted recently while I was experiencing the loop problem. The path in the FSCK results is the original unsorted path. I checked and the file exists in the sorted directory as it should. It appears the FSCK is generating tasks based on old information. Is there a painless way to clean up this old info?

User avatar
bigfoot65
Project Manager
Posts: 10546
Joined: Mon May 25, 2009 4:31 pm

Re: Greyhole getting stuck

Postby bigfoot65 » Mon Jul 31, 2017 5:25 pm

Is there a painless way to clean up this old info?
Yes do the following for syntax:

Code: Select all

greyhole
There are options that will delete metadata with no file copies and orphaned files.
ßîgƒσστ65
Applications Manager

Who is online

Users browsing this forum: No registered users and 1 guest