Page 1 of 1

Greyhole not picking up new files without fsck

Posted: Mon Dec 17, 2018 7:20 am
by modem7
I've got my sab download folder set to:

/var/hda/files/drives/bay1/downloads

This is a dedicated 1TB hdd for this purpose, not on greyhole. When I transfer files from this (via samba) to let's say the TV share (which is on greyhole), gh doesn't seem to pick up the transaction, or if it does, it doesn't do anything with it:

E.g.

Transferring Johnny English from /var/hda/files/drives/bay1/downloads to /var/hda/files/tv. This is done via windows shares (not locally)

Greyhole reports this at the start of the transaction:
Dec 17 13:59:40 DEBUG read_smb_spool: Processing Samba spool...
Dec 17 13:59:40 DEBUG read_smb_spool: Directory created: Movies/Johnny English Strikes Again 2018 HD
Dec 17 13:59:40 DEBUG read_smb_spool: Found 1 new tasks in spool.
At the end of the transaction it states the following:
Dec 17 14:03:11 DEBUG read_smb_spool: Processing Samba spool...
Dec 17 14:03:11 DEBUG read_smb_spool: File pointer to Johnny English Strikes Again 2018 HD/Johnny English Strikes Again 2018 1080p Bluray X264 1-EVO-xpost.mkv was closed without being written to. Ignoring.
Inbetween each of these, there's only:
Dec 17 14:03:11 DEBUG sleep: Nothing to do... Sleeping.
Dec 17 14:03:22 DEBUG sleep: Nothing to do... Sleeping.
Dec 17 14:03:32 DEBUG sleep: Nothing to do... Sleeping.
Only when I run a manual fsck via sudo greyhole -f --dir=/var/hda/files/tv/ does it pick this up.

This poses a problem during large file transfers where the greyhole LZ fills up to 100% not allowing further transfers until a fsck is run.

Any ideas?

Re: Greyhole not picking up new files without fsck

Posted: Mon Dec 17, 2018 10:13 am
by bigfoot65
Any ideas?
Might be best to check with the Greyhole author. Amahi support of Greyhole is limited.

Re: Greyhole not picking up new files without fsck

Posted: Tue Dec 18, 2018 1:41 am
by madhatta
All paths in SabNZBd should point to your locally mounted samba shares whether Greyhole is managing them or not. If not the spool won't detect changes. It looks like you are telling SabNZBd to work directly with the file paths. If that is the case, you are going to run into a lot of headaches later when trying to modify files in your share (delete/rename/move) on top of the issues you are having now.

Edit: So yeah ideally the following action

"...from /var/hda/files/drives/bay1/downloads to /var/hda/files/tv"

Would look something like (however you have your local samba shares set up)... from /mnt/samba/downloads to /mnt/samba/tv

Greyhole will only pick up changes made within the samba shares.

You say it's done with Windows shares and not locally but your file path examples make it look like it's not being done within the samba shares. If this is not correct, maybe you can provide a bit more information and I can try to help out.

Re: Greyhole not picking up new files without fsck

Posted: Mon Dec 24, 2018 3:22 am
by modem7
Thanks!

I'll give it another whirl at explaining what's going on! Just got back from a work trip abroad, so apologies for the delay in replying!

Edit:

Right, so I've had even weirder things happening (just transferring some files that downloaded whilst I was away):
Dec 24 10:14:06 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:14:16 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:14:26 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:14:36 DEBUG read_smb_spool: Processing Samba spool...
Dec 24 10:14:36 DEBUG read_smb_spool: Directory created: Movies/Bad Times at the El Royale 2018 HD
Dec 24 10:14:36 DEBUG read_smb_spool: File pointer to Assassination Nation 2018 HD/Assassination Nation 2018 1080p BluRay x264-DRONES-4P.mkv was closed without being written to. Ignoring.
Dec 24 10:14:36 DEBUG read_smb_spool: Found 1 new tasks in spool.
Dec 24 10:14:36 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:14:46 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:14:56 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:15:06 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:15:16 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:15:26 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:15:37 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:15:47 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:15:57 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:16:07 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:16:17 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:16:27 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:16:37 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:16:47 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:16:57 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:17:07 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:17:17 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:17:27 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:17:37 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:17:47 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:17:57 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:18:07 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:18:17 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:18:27 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:18:37 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:18:47 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:18:57 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:19:07 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:19:17 DEBUG read_smb_spool: Processing Samba spool...
Dec 24 10:19:17 DEBUG read_smb_spool: Directory created: Movies/I Still See You 2018 HD
Dec 24 10:19:17 DEBUG read_smb_spool: Found 1 new tasks in spool.
Dec 24 10:19:17 INFO write: Now working on task ID 4723201: write Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv

Dec 24 10:19:17 INFO write: File created: Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv - 10.9GB
Dec 24 10:19:17 DEBUG write: Loading metafiles for Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv ...
Dec 24 10:19:18 DEBUG write: Got 0 metadata files.
Dec 24 10:19:18 DEBUG write: 0 metafiles loaded.
Dec 24 10:19:18 DEBUG write: Drives with available space: /var/hda/files/drives/bay5/gh (1.19TB avail) - /var/hda/files/drives/bay6/gh (1.19TB avail) - /var/hda/files/drives/bay8/gh (1.19TB avail) - /var/hda/files/drives/drive6/gh (1.19TB avail) - /var/hda/files/drives/drive9/gh (1.19TB avail) - /var/hda/files/drives/drive10/gh (1.19TB avail) - /var/hda/files/drives/drive8/gh (1.19TB avail)
Dec 24 10:19:18 DEBUG write: Saving 2 metadata files for Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:19:18 DEBUG write: Saving metadata in /var/hda/files/drives/bay6/gh/.gh_metastore/Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:19:18 DEBUG write: Saving metadata in /var/hda/files/drives/bay5/gh/.gh_metastore/Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:19:18 DEBUG write: Copying 10.9GB file to /var/hda/files/drives/bay6/gh/Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:21:00 DEBUG write: Copy created at 109.6 MBps.
Dec 24 10:21:00 DEBUG write: Creating symlink in share pointing to the above file copy.
Dec 24 10:21:00 DEBUG write: Saving 2 metadata files for Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:21:00 DEBUG write: Saving metadata in /var/hda/files/drives/bay6/gh/.gh_metastore/Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:21:00 DEBUG write: Saving metadata in /var/hda/files/drives/bay5/gh/.gh_metastore/Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:21:00 DEBUG write: Copying 10.9GB file to /var/hda/files/drives/bay5/gh/Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:22:56 DEBUG write: Copy created at 96.4 MBps.
Dec 24 10:22:56 DEBUG write: Saving 2 metadata files for Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:22:56 DEBUG write: Saving metadata in /var/hda/files/drives/bay6/gh/.gh_metastore/Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:22:56 DEBUG write: Saving metadata in /var/hda/files/drives/bay5/gh/.gh_metastore/Movies/Bad Times at the El Royale 2018 HD/Bad Times At The El Royale 2018 1080p BluRay x264-BLOW-4P.mkv
Dec 24 10:22:57 DEBUG read_smb_spool: Processing Samba spool...
Dec 24 10:22:57 DEBUG read_smb_spool: Directory created: Movies/Night School 2018 HD
Dec 24 10:22:57 DEBUG read_smb_spool: Found 1 new tasks in spool.
Dec 24 10:22:57 INFO write: Now working on task ID 4723202: write Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv
Dec 24 10:22:57 INFO write: File created: Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv - 7.02GB
Dec 24 10:22:57 DEBUG write: Loading metafiles for Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv ...
Dec 24 10:22:58 DEBUG write: Got 0 metadata files.
Dec 24 10:22:58 DEBUG write: 0 metafiles loaded.
Dec 24 10:22:58 DEBUG write: Drives with available space: /var/hda/files/drives/bay8/gh (1.19TB avail) - /var/hda/files/drives/drive6/gh (1.19TB avail) - /var/hda/files/drives/drive9/gh (1.19TB avail) - /var/hda/files/drives/drive10/gh (1.19TB avail) - /var/hda/files/drives/drive8/gh (1.19TB avail) - /var/hda/files/drives/bay5/gh (1.18TB avail) - /var/hda/files/drives/bay6/gh (1.18TB avail)
Dec 24 10:22:58 DEBUG write: Saving 2 metadata files for Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv
Dec 24 10:22:58 DEBUG write: Saving metadata in /var/hda/files/drives/drive6/gh/.gh_metastore/Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv
Dec 24 10:22:58 DEBUG write: Saving metadata in /var/hda/files/drives/bay8/gh/.gh_metastore/Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv
Dec 24 10:22:58 DEBUG write: Copying 7.02GB file to /var/hda/files/drives/drive6/gh/Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv
Dec 24 10:23:52 DEBUG write: Copy created at 133.1 MBps.
Dec 24 10:23:52 DEBUG write: Creating symlink in share pointing to the above file copy.
Dec 24 10:23:53 DEBUG write: Saving 2 metadata files for Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv
Dec 24 10:23:53 DEBUG write: Saving metadata in /var/hda/files/drives/drive6/gh/.gh_metastore/Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv
Dec 24 10:23:53 DEBUG write: Saving metadata in /var/hda/files/drives/bay8/gh/.gh_metastore/Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv
Dec 24 10:23:53 DEBUG write: Copying 7.02GB file to /var/hda/files/drives/bay8/gh/Movies/I Still See You 2018 HD/I Still See You 2018 INTERNAL 1080p BluRay DTS x264-AMIABLE-xpost.mkv

The setup is as follows:

https://www.dropbox.com/s/4cw7oaa2h69bs ... s.JPG?dl=0
https://www.dropbox.com/s/9ah7c4cpdegu1 ... s.JPG?dl=0

The windows shares are mounted to the shares above (via //hda/sharename)
https://www.dropbox.com/s/cpgdrkc820vys ... s.JPG?dl=0

I only transfer via windows rather than locally via cp on the server.

As you can see above, the new issue is that it seems to be doing some, but not others (as can be seen on Dec 24 10:14:36 vs Dec 24 10:19:17) - however, I do wonder if this is due to me running a ~]$ sudo greyhole -f --dir=/var/hda/files/tv at ~10:10)

I hope this helps explain!



Edit v2:

Had another instance just now:
Dec 24 10:38:45 DEBUG read_smb_spool: Processing Samba spool...
Dec 24 10:38:45 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:38:55 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:39:05 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:39:15 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:39:25 DEBUG sleep: Nothing to do... Sleeping.
Dec 24 10:39:35 DEBUG read_smb_spool: Processing Samba spool...
Dec 24 10:39:35 DEBUG read_smb_spool: File pointer to The 13th Warrior 1999 HD/The 13th Warrior 1999 1080p BluRay DTS x264-HDC.mkv was closed without being written to. Ignoring.
Dec 24 10:39:35 DEBUG sleep: Nothing to do... Sleeping.

Re: Greyhole not picking up new files without fsck

Posted: Sat Jan 05, 2019 11:28 am
by modem7
Out of curiosity, is there an easy way to reinstall greyhole to get things back to default settings? Might be the easiest resolution initially.

Re: Greyhole not picking up new files without fsck

Posted: Mon Jan 07, 2019 10:33 am
by bigfoot65
You would need to do the following:
1. Uninstall the greyhole-ui App if installed
2. Erase amahi-greyhole package
3. Delete the Greyhole database

Then reinstall the app which should add back #2 & 3.