strange behaviour of greyhole

[jimtremblay]

Hi,
I have make a share (music) and copy all my music into this folder classified by artist and album. If I execute command greyhole --fsck, greyhole always report missing file copies for every mp3 files in shared folder. If I check in gh folder on 2 hard drives, every files are there. Every tombstones are there too, but if I let greyhole finish the full scan and restart one later, it will report the same missing files like previous scan. Why?

Jim

[gboudreau]

Please post an excerpt from your greyhole.log
Something like all the the fsck lines for 3 consecutive files.

[jimtremblay]

Code: Select all

Nov 28 11:04:25 7 fsck: Found /var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/18 International Cover-up.Mp3 Nov 28 11:04:25 7 fsck: Found /var/hda/files/drives/drive1/gh/music/Rancid/Let's Go/18 International Cover-up.Mp3 Nov 28 11:04:25 7 fsck: Loading tombstones for music/Rancid/Let's Go/18 International Cover-up.Mp3... Got 2 tombstones. Nov 28 11:04:25 6 fsck: Missing file copies. Expected 2, got 1. Will create more copies using /var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/18 International Cover-up.Mp3 Nov 28 11:04:25 7 fsck: Updating symlink at /var/hda/files/music/Rancid/Let's Go/18 International Cover-up.Mp3 to point to /var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/18 International Cover-up.Mp3 Nov 28 11:04:25 7 fsck: Saving 2 tombstones for music/Rancid/Let's Go/18 International Cover-up.Mp3 Nov 28 11:04:25 7 fsck: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/music/Rancid/Let's Go/18 International Cover-up.Mp3 Nov 28 11:04:25 7 fsck: Saving tombstones in /var/hda/files/drives/drive1/gh/.gh_graveyard/music/Rancid/Let's Go/18 International Cover-up.Mp3 Nov 28 11:04:25 7 fsck: Found /var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/11 I Am The One.Mp3 Nov 28 11:04:25 7 fsck: Found /var/hda/files/drives/drive1/gh/music/Rancid/Let's Go/11 I Am The One.Mp3 Nov 28 11:04:25 7 fsck: Loading tombstones for music/Rancid/Let's Go/11 I Am The One.Mp3... Got 2 tombstones. Nov 28 11:04:25 6 fsck: Missing file copies. Expected 2, got 1. Will create more copies using /var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/11 I Am The One.Mp3 Nov 28 11:04:25 7 fsck: Updating symlink at /var/hda/files/music/Rancid/Let's Go/11 I Am The One.Mp3 to point to /var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/11 I Am The One.Mp3 Nov 28 11:04:25 7 fsck: Saving 2 tombstones for music/Rancid/Let's Go/11 I Am The One.Mp3 Nov 28 11:04:25 7 fsck: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/music/Rancid/Let's Go/11 I Am The One.Mp3 Nov 28 11:04:25 7 fsck: Saving tombstones in /var/hda/files/drives/drive1/gh/.gh_graveyard/music/Rancid/Let's Go/11 I Am The One.Mp3 Nov 28 11:04:25 7 fsck: Found /var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/22 Name.Mp3 Nov 28 11:04:25 7 fsck: Found /var/hda/files/drives/drive1/gh/music/Rancid/Let's Go/22 Name.Mp3 Nov 28 11:04:25 7 fsck: Loading tombstones for music/Rancid/Let's Go/22 Name.Mp3... Got 2 tombstones. Nov 28 11:04:25 6 fsck: Missing file copies. Expected 2, got 1. Will create more copies using /var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/22 Name.Mp3 Nov 28 11:04:25 7 fsck: Updating symlink at /var/hda/files/music/Rancid/Let's Go/22 Name.Mp3 to point to /var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/22 Name.Mp3 Nov 28 11:04:25 7 fsck: Saving 2 tombstones for music/Rancid/Let's Go/22 Name.Mp3 Nov 28 11:04:25 7 fsck: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/music/Rancid/Let's Go/22 Name.Mp3 Nov 28 11:04:25 7 fsck: Saving tombstones in /var/hda/files/drives/drive1/gh/.gh_graveyard/music/Rancid/Let's Go/22 Name.Mp3

This is a part of my log from a scan.
As you can see, greyhole has found 2 files, but it tells one is missing. This is the same thing for all my files.

Thank you

Jim

[gboudreau]

Greyhole seems to think both files are in fact only one file...
Or something...

Post the result of this:

Code: Select all

cat /etc/greyhole.conf mount fdisk -l df -h stat '/var/hda/files/drives/drive1/gh/music/Rancid/Let's Go/22 Name.Mp3' stat '/var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/22 Name.Mp3'

[jimtremblay]

Code: Select all

cat /etc/greyhole.conf # This file is automatically generated by Amahi on Sun Nov 28 11:02:21 -0500 2010 # Any manual changes WILL BE OVERWRITTEN! # Set the defaults (carefully) in /var/hda/platform/html/config/greyhole.yml db_engine = sqlite db_path = /var/cache/greyhole.sqlite balance_modified_files = false email_to = root samba_log_file = /var/log/messages greyhole_log_file = /var/log/greyhole.log log_level = DEBUG log_memory_usage = false dir_selection_algorithm = most_available_space df_cache_time = 15 delete_moves_to_attic = true # sticky_files and stick_into options are nested - see http://wiki.amahi.org/index.php/Greyhole#Greyhole_advanced_options sticky_files = Music/ # add any group of other settings # here in multiple lines storage_pool_directory = /var/hda/files/drives/drive2/gh, min_free: 10gb storage_pool_directory = /var/hda/files/drives/drive1/gh, min_free: 10gb num_copies[music] = 999 num_copies[video] = 2 num_copies[photo] = 999 num_copies[doc] = 999 num_copies[backup] = 999

Code: Select all

mount /dev/mapper/vg_server-lv_root on / type ext4 (rw) proc on /proc type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs (rw) /dev/sda1 on /boot type ext4 (rw) /dev/sdb1 on /var/hda/files/drives/drive1 type ext4 (rw) /dev/sdc1 on /var/hda/files/drives/drive2 type ext4 (rw) none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)

Code: Select all

fdisk -l Disk /dev/sda: 41.1 GB, 41110142976 bytes 255 heads, 63 sectors/track, 4998 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x000505ad Device Boot Start End Blocks Id System /dev/sda1 * 1 26 204800 83 Linux Partition 1 does not end on cylinder boundary. /dev/sda2 26 4998 39941603+ 8e Linux LVM Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x3c0791ea Device Boot Start End Blocks Id System /dev/sdb1 1 121601 976760001 83 Linux Disk /dev/sdc: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0xad11d9a3 Device Boot Start End Blocks Id System /dev/sdc1 1 121601 976760001 83 Linux Disk /dev/dm-0: 36.7 GB, 36670799872 bytes 255 heads, 63 sectors/track, 4458 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-0 doesn't contain a valid partition table Disk /dev/dm-1: 4227 MB, 4227858432 bytes 255 heads, 63 sectors/track, 514 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x00000000 Disk /dev/dm-1 doesn't contain a valid partition table

I don't know what are these dm-0 and dm1. I only have 3 disk in my server (sda is system disk and sdb and sdc are disks for backup)

Code: Select all

df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/vg_server-lv_root 34G 3.2G 29G 10% / tmpfs 1007M 0 1007M 0% /dev/shm /dev/sda1 194M 22M 163M 12% /boot /dev/sdb1 917G 118G 753G 14% /var/hda/files/drives/drive1 /dev/sdc1 917G 118G 753G 14% /var/hda/files/drives/drive2

Code: Select all

stat '/var/hda/files/drives/drive1/gh/music/Rancid/Let's Go/22 Name.Mp3' File: `/var/hda/files/drives/drive1/gh/music/Rancid/Let\'s Go/22 Name.Mp3' Size: 3217408 Blocks: 6288 IO Block: 4096 regular file Device: 811h/2065d Inode: 2883771 Links: 1 Access: (0777/-rwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2010-11-25 17:58:13.605396072 -0500 Modify: 2010-11-25 17:58:13.700395752 -0500 Change: 2010-11-25 17:58:13.766398146 -0500

Code: Select all

stat '/var/hda/files/drives/drive2/gh/music/Rancid/Let's Go/22 Name.Mp3' File: `/var/hda/files/drives/drive2/gh/music/Rancid/Let\'s Go/22 Name.Mp3' Size: 3217408 Blocks: 6288 IO Block: 4096 regular file Device: 821h/2081d Inode: 2883771 Links: 1 Access: (0764/-rwxrw-r--) Uid: ( 500/ admin) Gid: ( 100/ users) Access: 2010-11-25 17:58:13.605396072 -0500 Modify: 2010-11-25 17:58:13.483395173 -0500 Change: 2010-11-25 17:58:13.551398125 -0500

Jim

[gboudreau]

Wow. Never thought this could happen... Both files have the same inode #!
This will require a new version of GH to fix.
But until then, know that your files are correctly protected. There are really two file copies, it's just that GH uses the inode# to identify files during fsck, and since both have the same #, GH thinks you only have one.

You can star the issue here to know when this will be fixed (should be soon):
http://code.google.com/p/greyhole/issues/detail?id=40

Your greyhole should automatically update itself some time after the issue gets resolved.