Hi
I am trying to copy about 9.5GB of digital photographs to my greyhole share and I have noticed about 8GB files are being sent to the attic and are not available from the share. Can you help
Thanks
2.6.31.5-127.fc12.x86_64
samba-3.4.9-60.fc12.x86_64
hda-greyhole-0.7.5-1.x86_64
fpaste /etc/samba/smb.conf
http://fpaste.org/OEaB/
fpaste /etc/greyhole.conf
http://fpaste.org/NOp6/
mount; fdisk -l; df -h; greyhole --stats
# mount; fdisk -l; df -h; greyhole --stats
/dev/sda3 on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sda1 on /boot type ext4 (rw)
/dev/sda2 on /var/hda/files/drives/drive1 type ext4 (rw)
/dev/sdb1 on /var/hda/files/drives/drive2 type ext4 (rw)
/dev/sdc1 on /var/hda/files/drives/drive3 type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
//127.0.0.1/Videos on /mnt/samba/Videos type cifs (rw,mand)
//127.0.0.1/Software on /mnt/samba/Software type cifs (rw,mand)
//127.0.0.1/Music on /mnt/samba/Music type cifs (rw,mand)
//127.0.0.1/Photos on /mnt/samba/Photos type cifs (rw,mand)
//127.0.0.1/Users on /mnt/samba/Users type cifs (rw,mand)
gvfs-fuse-daemon on /home/localrt/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=localrt)
Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x8312cc11
Device Boot Start End Blocks Id System
/dev/sda1 * 1 26 204800 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2 26 95595 767657984 83 Linux
/dev/sda3 95595 121091 204800000 83 Linux
/dev/sda4 121091 121601 4096000 82 Linux swap / Solaris
Disk /dev/sdc: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x701a4e52
Device Boot Start End Blocks Id System
/dev/sdc1 1 121600 976751968+ 83 Linux
Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x701a4e6a
Device Boot Start End Blocks Id System
/dev/sdb1 1 121602 976760832 83 Linux
Filesystem Size Used Avail Use% Mounted on
/dev/sda3 193G 3.1G 180G 2% /
tmpfs 997M 444K 997M 1% /dev/shm
/dev/sda1 194M 23M 162M 13% /boot
/dev/sda2 721G 337G 348G 50% /var/hda/files/drives/drive1
/dev/sdb1 917G 522G 349G 60% /var/hda/files/drives/drive2
/dev/sdc1 917G 850G 21G 98% /var/hda/files/drives/drive3
//127.0.0.1/Videos 1.6T 942G 697G 58% /mnt/samba/Videos
//127.0.0.1/Software 1.6T 942G 697G 58% /mnt/samba/Software
//127.0.0.1/Music 1.6T 942G 697G 58% /mnt/samba/Music
//127.0.0.1/Photos 1.6T 942G 697G 58% /mnt/samba/Photos
//127.0.0.1/Users 1.6T 942G 697G 58% /mnt/samba/Users
Greyhole Statistics
===================
Storage Pool
Total - Used = Free + Attic = Possible
/var/hda/files/drives/drive1/gh: 721G - 337G = 347G + 0G = 347G
/var/hda/files/drives/drive2/gh: 917G - 521G = 349G + 8G = 357G
# mysql -u root -phda -e "select * from disk_pool_partitions" hda_production
+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 1 | /var/hda/files/drives/drive1 | 10 | 2010-12-15 17:37:29 | 2010-12-15 17:37:29 |
| 2 | /var/hda/files/drives/drive2 | 10 | 2010-12-15 17:37:30 | 2010-12-15 17:37:30 |
+----+------------------------------+--------------+---------------------+---------------------+
# mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" hda_production | grep -v 'concat(' | xargs ls -la | fpaste
http://fpaste.org/PCuR/
# greyhole --view-queue
Greyhole Work Queue Statistics
==============================
This table gives you the number of pending operations queued for the Greyhole daemon, per share.
Write Delete Rename
Music 0 0 0
Photos 0 0 0
Software 0 0 0
Users 0 0 0
Videos 0 0 0
========
Total 0 + 0 + 0 = 0
Most files being sent to attic
Re: Most files being sent to attic
Try this, and show here what you get:
Example:
Code: Select all
greyhole --debug a_filename_that_isnt_in_your_share_and_should_be_but_is_in_the_attic_instead
Code: Select all
greyhole --debug DSC_10273.jpg
- Guillaume Boudreau
Re: Most files being sent to attic
$ greyhole --debug DSC01419.JPG
Debugging file operations for file named "/DSC01419.JPG"
From DB
=======
[2010-12-17 13:47:36] Task ID 24162: write Photos/2004/DSC01419.JPG
[2010-12-17 13:51:38] Task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
From logs
=========
Dec 17 13:51:09 7 parse_logs: Done parsing.
Dec 17 13:51:09 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG
Dec 17 13:51:09 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB
Dec 17 13:51:09 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones.
Dec 17 13:51:09 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
--
Dec 17 13:51:10 7 parse_logs: Done parsing.
Dec 17 13:51:10 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG
Dec 17 13:51:10 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB
Dec 17 13:51:10 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones.
Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 parse_logs: Parsing Samba logs...
--
Dec 17 13:51:10 4 write: Failed file copy. Will mark this tombstone 'Gone'.
Dec 17 13:51:10 7 write: Moved copy from /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG to attic: /var/hda/files/drives/drive2/gh/.gh_attic/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Now working on task ID 24163: write Photos/2004/DSC01420.JPG
--
Dec 17 14:18:52 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01122.JPG
Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB
Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones.
Dec 17 14:18:52 7 write: Creating symlink in share pointing to the above file copy.
--
Dec 17 14:18:52 7 parse_logs: Done parsing.
Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB
Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones.
Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 parse_logs: Parsing Samba logs...
--
Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Now working on task ID 28418: write Photos/Uncatalogued/DSC01420.JPG
--
Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 parse_logs: Parsing Samba logs...
From filesystem
===============
Landing Zone:
lrwxrwxrwx 1 root root 64 2010-12-17 14:18 /var/hda/files/drives/drive2/Photos/Uncatalogued/DSC01419.JPG -> /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Graveyard:
-rw-rw-rw- 1 root root 153 2010-12-17 14:18 /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
array (
0 =>
stdClass::__set_state(array(
'path' => '/var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG',
'is_linked' => true,
'state' => 'OK',
)),
)
File copies:
-rwxrw-r-- 1 localrt users 64282 2004-07-07 17:20 /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Debugging file operations for file named "/DSC01419.JPG"
From DB
=======
[2010-12-17 13:47:36] Task ID 24162: write Photos/2004/DSC01419.JPG
[2010-12-17 13:51:38] Task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
From logs
=========
Dec 17 13:51:09 7 parse_logs: Done parsing.
Dec 17 13:51:09 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG
Dec 17 13:51:09 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB
Dec 17 13:51:09 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones.
Dec 17 13:51:09 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
--
Dec 17 13:51:10 7 parse_logs: Done parsing.
Dec 17 13:51:10 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG
Dec 17 13:51:10 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB
Dec 17 13:51:10 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones.
Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 parse_logs: Parsing Samba logs...
--
Dec 17 13:51:10 4 write: Failed file copy. Will mark this tombstone 'Gone'.
Dec 17 13:51:10 7 write: Moved copy from /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG to attic: /var/hda/files/drives/drive2/gh/.gh_attic/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Now working on task ID 24163: write Photos/2004/DSC01420.JPG
--
Dec 17 14:18:52 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01122.JPG
Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB
Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones.
Dec 17 14:18:52 7 write: Creating symlink in share pointing to the above file copy.
--
Dec 17 14:18:52 7 parse_logs: Done parsing.
Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB
Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones.
Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 parse_logs: Parsing Samba logs...
--
Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Now working on task ID 28418: write Photos/Uncatalogued/DSC01420.JPG
--
Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 parse_logs: Parsing Samba logs...
From filesystem
===============
Landing Zone:
lrwxrwxrwx 1 root root 64 2010-12-17 14:18 /var/hda/files/drives/drive2/Photos/Uncatalogued/DSC01419.JPG -> /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Graveyard:
-rw-rw-rw- 1 root root 153 2010-12-17 14:18 /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
array (
0 =>
stdClass::__set_state(array(
'path' => '/var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG',
'is_linked' => true,
'state' => 'OK',
)),
)
File copies:
-rwxrw-r-- 1 localrt users 64282 2004-07-07 17:20 /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Re: Most files being sent to attic
That looks fine, except for the fact that you have two Greyhole daemons running!
the following code should return just one number, but I'm guessing it's returning two:
To fix:
Then verify again that only one number if returned by the first command.
When this is fixed, run a to fix whatever problems running two daemons might have caused.
the following code should return just one number, but I'm guessing it's returning two:
Code: Select all
ps auxww | grep greyhole.*daemon | grep -v grep | awk '{print $2}'
Code: Select all
service greyhole stop
kill `ps auxww | grep greyhole.*daemon | grep -v grep | awk '{print $2}'`
service greyhole start
When this is fixed, run a
Code: Select all
greyhole --fsck
- Guillaume Boudreau
Re: Most files being sent to attic
I don't think I am running 2 daemons because when I run command I get this
$ ps auxww | grep greyhole.*daemon | grep -v grep | awk '{print $2}'
1800
$ ps auxww | grep greyhole.*daemon | grep -v grep | awk '{print $2}'
1800
Re: Most files being sent to attic
Well, when those entries above (that you see in the --debug result) were logged, there were two, I'm pretty sure.
Paste the result of this:
That should tell us if there is really one or two daemons still running.
Also, you can run --fsck after you ran the above command. All your files should be where they should be after that.
Paste the result of this:
Code: Select all
tail /var/log/greyhole.log | fpaste
Also, you can run --fsck after you ran the above command. All your files should be where they should be after that.
- Guillaume Boudreau
Re: Most files being sent to attic
OK my mistake
Correction to my previous post I was adding a 4th drive from another pc that I was going to copy files from that also has a / partiton of fedora 12 on it. When I booted up like this there where 2 greyhole daemons running. I will run greyhole --fsck to see if that repairs links
Correction to my previous post I was adding a 4th drive from another pc that I was going to copy files from that also has a / partiton of fedora 12 on it. When I booted up like this there where 2 greyhole daemons running. I will run greyhole --fsck to see if that repairs links
Re: Most files being sent to attic
running greyhole --fsck has not repaired error. Its seems to have deleted symbolic link and left the files in the attic.
Code: Select all
$ greyhole --debug DSC01419.JPGDebugging file operations for file named "/DSC01419.JPG"
From DB
=======
[2010-12-17 13:47:36] Task ID 24162: write Photos/2004/DSC01419.JPG
[2010-12-17 13:51:38] Task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
[2010-12-17 16:55:52] Task ID 30214: fsck_file Photos/2004/DSC01419.JPG
[2010-12-17 16:55:58] Task ID 33601: fsck_file Photos/2004/DSC01419.JPG
[2010-12-17 16:56:01] Task ID 38539: fsck_file Photos/2004/DSC01419.JPG
[2010-12-17 16:56:42] Task ID 40382: write Photos/2004/DSC01419.JPG
[2010-12-17 16:58:40] Task ID 43768: write Photos/2004/DSC01419.JPG
[2010-12-17 17:00:51] Task ID 48697: write Photos/2004/DSC01419.JPG
From logs
=========
Dec 17 13:51:09 7 parse_logs: Done parsing.
Dec 17 13:51:09 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG
Dec 17 13:51:09 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB
Dec 17 13:51:09 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones.
Dec 17 13:51:09 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
--
Dec 17 13:51:10 7 parse_logs: Done parsing.
Dec 17 13:51:10 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG
Dec 17 13:51:10 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB
Dec 17 13:51:10 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones.
Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 parse_logs: Parsing Samba logs...
--
Dec 17 13:51:10 4 write: Failed file copy. Will mark this tombstone 'Gone'.
Dec 17 13:51:10 7 write: Moved copy from /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG to attic: /var/hda/files/drives/drive2/gh/.gh_attic/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Now working on task ID 24163: write Photos/2004/DSC01420.JPG
--
Dec 17 14:18:52 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01122.JPG
Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB
Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones.
Dec 17 14:18:52 7 write: Creating symlink in share pointing to the above file copy.
--
Dec 17 14:18:52 7 parse_logs: Done parsing.
Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB
Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones.
Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 parse_logs: Parsing Samba logs...
--
Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Now working on task ID 28418: write Photos/Uncatalogued/DSC01420.JPG
--
Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 parse_logs: Parsing Samba logs...
--
Dec 17 16:55:55 7 fsck: Loading tombstones for Photos/Uncatalogued/Picture 057.jpg... Got 1 tombstones.
Dec 17 16:55:55 7 fsck: Found /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Dec 17 16:55:55 7 fsck: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 1 tombstones.
Dec 17 16:55:55 7 fsck: Found /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/Photo-0077.jpg
--
Dec 17 16:56:42 7 parse_logs: Done parsing.
Dec 17 16:56:42 7 fsck_file: Now working on task ID 30214: fsck_file Photos/2004/DSC01419.JPG
Dec 17 16:56:42 7 fsck_file: Loading tombstones for Photos/2004/DSC01419.JPG... Got 1 tombstones.
Dec 17 16:56:42 4 fsck_file: WARNING! No copies of this file are available in the Greyhole storage pool. Did you copy that file there without using your Samba shares..? (If you did, don't do that in the future!)
Dec 17 16:56:42 6 fsck_file: 2004/DSC01419.JPG is a file (not a symlink). Adding a new 'write' pending task for that file.
Dec 17 16:56:42 7 fsck_file: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 16:56:42 7 fsck_file: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 16:56:42 7 fsck_file: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 16:56:42 7 parse_logs: Parsing Samba logs...
Dec 17 16:56:42 7 parse_logs: Done parsing.
Dec 17 16:56:42 7 write: Now working on task ID 40382: write Photos/2004/DSC01419.JPG
Dec 17 16:56:42 7 write: File write: /var/hda/files/drives/drive2/Photos/2004/DSC01419.JPG doesn't exist anymore. Skipping.
Dec 17 16:56:42 7 parse_logs: Parsing Samba logs...
--
Dec 17 16:58:40 7 parse_logs: Done parsing.
Dec 17 16:58:40 7 fsck_file: Now working on task ID 33601: fsck_file Photos/2004/DSC01419.JPG
Dec 17 16:58:40 7 fsck_file: Loading tombstones for Photos/2004/DSC01419.JPG... Got 1 tombstones.
Dec 17 16:58:40 4 fsck_file: WARNING! No copies of this file are available in the Greyhole storage pool. Did you copy that file there without using your Samba shares..? (If you did, don't do that in the future!)
Dec 17 16:58:40 6 fsck_file: 2004/DSC01419.JPG is a file (not a symlink). Adding a new 'write' pending task for that file.
Dec 17 16:58:40 7 fsck_file: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 16:58:40 7 fsck_file: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 16:58:40 7 fsck_file: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 16:58:40 7 parse_logs: Parsing Samba logs...
Dec 17 16:58:40 7 parse_logs: Done parsing.
Dec 17 16:58:40 7 write: Now working on task ID 43768: write Photos/2004/DSC01419.JPG
Dec 17 16:58:40 7 write: File write: /var/hda/files/drives/drive2/Photos/2004/DSC01419.JPG doesn't exist anymore. Skipping.
Dec 17 16:58:40 7 parse_logs: Parsing Samba logs...
--
Dec 17 17:00:51 7 parse_logs: Done parsing.
Dec 17 17:00:51 7 fsck_file: Now working on task ID 38539: fsck_file Photos/2004/DSC01419.JPG
Dec 17 17:00:51 7 fsck_file: Loading tombstones for Photos/2004/DSC01419.JPG... Got 1 tombstones.
Dec 17 17:00:51 4 fsck_file: WARNING! No copies of this file are available in the Greyhole storage pool. Did you copy that file there without using your Samba shares..? (If you did, don't do that in the future!)
Dec 17 17:00:51 6 fsck_file: 2004/DSC01419.JPG is a file (not a symlink). Adding a new 'write' pending task for that file.
Dec 17 17:00:51 7 fsck_file: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 17:00:51 7 fsck_file: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 17:00:51 7 fsck_file: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 17:00:51 7 parse_logs: Parsing Samba logs...
Dec 17 17:00:51 7 parse_logs: Done parsing.
Dec 17 17:00:51 7 write: Now working on task ID 48697: write Photos/2004/DSC01419.JPG
Dec 17 17:00:51 7 write: File write: /var/hda/files/drives/drive2/Photos/2004/DSC01419.JPG doesn't exist anymore. Skipping.
Dec 17 17:00:51 7 parse_logs: Parsing Samba logs...
From filesystem
===============
Landing Zone:
ls: cannot access /var/hda/files/drives/drive2/Photos/2004/DSC01419.JPG: No such file or directory
Graveyard:
-rw-rw-rw- 1 root root 147 2010-12-17 17:00 /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
array (
0 =>
stdClass::__set_state(array(
'path' => '/var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG',
'is_linked' => false,
'state' => 'Gone',
)),
)
File copies:
Re: Most files being sent to attic
Ah, the 2004/DSC01419.JPG one is in the attic. I was looking at the Uncatalogued/DSC01419.JPG, which is fine.
You'll need to manually move the files from the attic into their original location:
You'll need to manually move the files from the attic into their original location:
Code: Select all
cp -r /var/hda/files/drives/drive1/gh/.gh_attic/Photos/* /var/hda/files/drives/drive1/gh/Photos/
cp -r /var/hda/files/drives/drive2/gh/.gh_attic/Photos/* /var/hda/files/drives/drive2/gh/Photos/
greyhole --fsck
- Guillaume Boudreau
Re: Most files being sent to attic
Ok thanks all files are in place.
Any reason why 4th drive with 2nd system would cause greyhole to start twice?
Any reason why 4th drive with 2nd system would cause greyhole to start twice?
Who is online
Users browsing this forum: No registered users and 13 guests