Most files being sent to attic

jfk365
Posts: 10
Joined: Fri Dec 17, 2010 6:18 am

Most files being sent to attic

Postby jfk365 » Fri Dec 17, 2010 6:45 am

Hi

I am trying to copy about 9.5GB of digital photographs to my greyhole share and I have noticed about 8GB files are being sent to the attic and are not available from the share. Can you help

Thanks

2.6.31.5-127.fc12.x86_64
samba-3.4.9-60.fc12.x86_64
hda-greyhole-0.7.5-1.x86_64

fpaste /etc/samba/smb.conf
http://fpaste.org/OEaB/

fpaste /etc/greyhole.conf
http://fpaste.org/NOp6/

mount; fdisk -l; df -h; greyhole --stats

# mount; fdisk -l; df -h; greyhole --stats
/dev/sda3 on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sda1 on /boot type ext4 (rw)
/dev/sda2 on /var/hda/files/drives/drive1 type ext4 (rw)
/dev/sdb1 on /var/hda/files/drives/drive2 type ext4 (rw)
/dev/sdc1 on /var/hda/files/drives/drive3 type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
//127.0.0.1/Videos on /mnt/samba/Videos type cifs (rw,mand)
//127.0.0.1/Software on /mnt/samba/Software type cifs (rw,mand)
//127.0.0.1/Music on /mnt/samba/Music type cifs (rw,mand)
//127.0.0.1/Photos on /mnt/samba/Photos type cifs (rw,mand)
//127.0.0.1/Users on /mnt/samba/Users type cifs (rw,mand)
gvfs-fuse-daemon on /home/localrt/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=localrt)

Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x8312cc11

Device Boot Start End Blocks Id System
/dev/sda1 * 1 26 204800 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2 26 95595 767657984 83 Linux
/dev/sda3 95595 121091 204800000 83 Linux
/dev/sda4 121091 121601 4096000 82 Linux swap / Solaris

Disk /dev/sdc: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x701a4e52

Device Boot Start End Blocks Id System
/dev/sdc1 1 121600 976751968+ 83 Linux

Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x701a4e6a

Device Boot Start End Blocks Id System
/dev/sdb1 1 121602 976760832 83 Linux
Filesystem Size Used Avail Use% Mounted on
/dev/sda3 193G 3.1G 180G 2% /
tmpfs 997M 444K 997M 1% /dev/shm
/dev/sda1 194M 23M 162M 13% /boot
/dev/sda2 721G 337G 348G 50% /var/hda/files/drives/drive1
/dev/sdb1 917G 522G 349G 60% /var/hda/files/drives/drive2
/dev/sdc1 917G 850G 21G 98% /var/hda/files/drives/drive3
//127.0.0.1/Videos 1.6T 942G 697G 58% /mnt/samba/Videos
//127.0.0.1/Software 1.6T 942G 697G 58% /mnt/samba/Software
//127.0.0.1/Music 1.6T 942G 697G 58% /mnt/samba/Music
//127.0.0.1/Photos 1.6T 942G 697G 58% /mnt/samba/Photos
//127.0.0.1/Users 1.6T 942G 697G 58% /mnt/samba/Users

Greyhole Statistics
===================

Storage Pool
Total - Used = Free + Attic = Possible
/var/hda/files/drives/drive1/gh: 721G - 337G = 347G + 0G = 347G
/var/hda/files/drives/drive2/gh: 917G - 521G = 349G + 8G = 357G

# mysql -u root -phda -e "select * from disk_pool_partitions" hda_production
+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 1 | /var/hda/files/drives/drive1 | 10 | 2010-12-15 17:37:29 | 2010-12-15 17:37:29 |
| 2 | /var/hda/files/drives/drive2 | 10 | 2010-12-15 17:37:30 | 2010-12-15 17:37:30 |
+----+------------------------------+--------------+---------------------+---------------------+

# mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" hda_production | grep -v 'concat(' | xargs ls -la | fpaste
http://fpaste.org/PCuR/

# greyhole --view-queue

Greyhole Work Queue Statistics
==============================

This table gives you the number of pending operations queued for the Greyhole daemon, per share.

Write Delete Rename
Music 0 0 0
Photos 0 0 0
Software 0 0 0
Users 0 0 0
Videos 0 0 0
========
Total 0 + 0 + 0 = 0

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Most files being sent to attic

Postby gboudreau » Fri Dec 17, 2010 7:00 am

Try this, and show here what you get:

Code: Select all

greyhole --debug a_filename_that_isnt_in_your_share_and_should_be_but_is_in_the_attic_instead
Example:

Code: Select all

greyhole --debug DSC_10273.jpg
- Guillaume Boudreau

jfk365
Posts: 10
Joined: Fri Dec 17, 2010 6:18 am

Re: Most files being sent to attic

Postby jfk365 » Fri Dec 17, 2010 7:13 am

$ greyhole --debug DSC01419.JPG
Debugging file operations for file named "/DSC01419.JPG"

From DB
=======
[2010-12-17 13:47:36] Task ID 24162: write Photos/2004/DSC01419.JPG
[2010-12-17 13:51:38] Task ID 28417: write Photos/Uncatalogued/DSC01419.JPG

From logs
=========
Dec 17 13:51:09 7 parse_logs: Done parsing.
Dec 17 13:51:09 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG
Dec 17 13:51:09 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB
Dec 17 13:51:09 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones.
Dec 17 13:51:09 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
--
Dec 17 13:51:10 7 parse_logs: Done parsing.
Dec 17 13:51:10 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG
Dec 17 13:51:10 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB
Dec 17 13:51:10 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones.
Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 parse_logs: Parsing Samba logs...
--
Dec 17 13:51:10 4 write: Failed file copy. Will mark this tombstone 'Gone'.
Dec 17 13:51:10 7 write: Moved copy from /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG to attic: /var/hda/files/drives/drive2/gh/.gh_attic/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG
Dec 17 13:51:10 7 write: Now working on task ID 24163: write Photos/2004/DSC01420.JPG
--
Dec 17 14:18:52 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01122.JPG
Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB
Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones.
Dec 17 14:18:52 7 write: Creating symlink in share pointing to the above file copy.
--
Dec 17 14:18:52 7 parse_logs: Done parsing.
Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB
Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones.
Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 parse_logs: Parsing Samba logs...
--
Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail)
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Now working on task ID 28418: write Photos/Uncatalogued/DSC01420.JPG
--
Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy.
Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG
Dec 17 14:18:53 7 parse_logs: Parsing Samba logs...

From filesystem
===============
Landing Zone:
lrwxrwxrwx 1 root root 64 2010-12-17 14:18 /var/hda/files/drives/drive2/Photos/Uncatalogued/DSC01419.JPG -> /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG

Graveyard:
-rw-rw-rw- 1 root root 153 2010-12-17 14:18 /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG
array (
0 =>
stdClass::__set_state(array(
'path' => '/var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG',
'is_linked' => true,
'state' => 'OK',
)),
)

File copies:
-rwxrw-r-- 1 localrt users 64282 2004-07-07 17:20 /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Most files being sent to attic

Postby gboudreau » Fri Dec 17, 2010 7:21 am

That looks fine, except for the fact that you have two Greyhole daemons running!

the following code should return just one number, but I'm guessing it's returning two:

Code: Select all

ps auxww | grep greyhole.*daemon | grep -v grep | awk '{print $2}'
To fix:

Code: Select all

service greyhole stop kill `ps auxww | grep greyhole.*daemon | grep -v grep | awk '{print $2}'` service greyhole start
Then verify again that only one number if returned by the first command.

When this is fixed, run a

Code: Select all

greyhole --fsck
to fix whatever problems running two daemons might have caused.
- Guillaume Boudreau

jfk365
Posts: 10
Joined: Fri Dec 17, 2010 6:18 am

Re: Most files being sent to attic

Postby jfk365 » Fri Dec 17, 2010 7:26 am

I don't think I am running 2 daemons because when I run command I get this

$ ps auxww | grep greyhole.*daemon | grep -v grep | awk '{print $2}'
1800

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Most files being sent to attic

Postby gboudreau » Fri Dec 17, 2010 7:38 am

Well, when those entries above (that you see in the --debug result) were logged, there were two, I'm pretty sure.

Paste the result of this:

Code: Select all

tail /var/log/greyhole.log | fpaste
That should tell us if there is really one or two daemons still running.

Also, you can run --fsck after you ran the above command. All your files should be where they should be after that.
- Guillaume Boudreau

jfk365
Posts: 10
Joined: Fri Dec 17, 2010 6:18 am

Re: Most files being sent to attic

Postby jfk365 » Fri Dec 17, 2010 7:53 am

OK my mistake

Correction to my previous post I was adding a 4th drive from another pc that I was going to copy files from that also has a / partiton of fedora 12 on it. When I booted up like this there where 2 greyhole daemons running. I will run greyhole --fsck to see if that repairs links

jfk365
Posts: 10
Joined: Fri Dec 17, 2010 6:18 am

Re: Most files being sent to attic

Postby jfk365 » Fri Dec 17, 2010 8:22 am

running greyhole --fsck has not repaired error. Its seems to have deleted symbolic link and left the files in the attic.

Code: Select all

$ greyhole --debug DSC01419.JPGDebugging file operations for file named "/DSC01419.JPG" From DB ======= [2010-12-17 13:47:36] Task ID 24162: write Photos/2004/DSC01419.JPG [2010-12-17 13:51:38] Task ID 28417: write Photos/Uncatalogued/DSC01419.JPG [2010-12-17 16:55:52] Task ID 30214: fsck_file Photos/2004/DSC01419.JPG [2010-12-17 16:55:58] Task ID 33601: fsck_file Photos/2004/DSC01419.JPG [2010-12-17 16:56:01] Task ID 38539: fsck_file Photos/2004/DSC01419.JPG [2010-12-17 16:56:42] Task ID 40382: write Photos/2004/DSC01419.JPG [2010-12-17 16:58:40] Task ID 43768: write Photos/2004/DSC01419.JPG [2010-12-17 17:00:51] Task ID 48697: write Photos/2004/DSC01419.JPG From logs ========= Dec 17 13:51:09 7 parse_logs: Done parsing. Dec 17 13:51:09 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG Dec 17 13:51:09 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB Dec 17 13:51:09 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones. Dec 17 13:51:09 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail) -- Dec 17 13:51:10 7 parse_logs: Done parsing. Dec 17 13:51:10 7 write: Now working on task ID 24162: write Photos/2004/DSC01419.JPG Dec 17 13:51:10 6 write: File created: Photos/2004/DSC01419.JPG - 62.8KB Dec 17 13:51:10 7 write: Loading tombstones for Photos/2004/DSC01419.JPG... Got 0 tombstones. Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail) Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (341GB avail) - /var/hda/files/drives/drive1/gh (337GB avail) Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Creating symlink in share pointing to the above file copy. Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 parse_logs: Parsing Samba logs... -- Dec 17 13:51:10 4 write: Failed file copy. Will mark this tombstone 'Gone'. Dec 17 13:51:10 7 write: Moved copy from /var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG to attic: /var/hda/files/drives/drive2/gh/.gh_attic/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Saving 1 tombstones for Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG Dec 17 13:51:10 7 write: Now working on task ID 24163: write Photos/2004/DSC01420.JPG -- Dec 17 14:18:52 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01122.JPG Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones. Dec 17 14:18:52 7 write: Creating symlink in share pointing to the above file copy. -- Dec 17 14:18:52 7 parse_logs: Done parsing. Dec 17 14:18:52 7 write: Now working on task ID 28417: write Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:52 6 write: File created: Photos/Uncatalogued/DSC01419.JPG - 62.8KB Dec 17 14:18:52 7 write: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 0 tombstones. Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail) Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy. Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 parse_logs: Parsing Samba logs... -- Dec 17 14:18:53 7 write: Drives with available space: /var/hda/files/drives/drive2/gh (339GB avail) - /var/hda/files/drives/drive1/gh (337GB avail) Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Copying file to /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Now working on task ID 28418: write Photos/Uncatalogued/DSC01420.JPG -- Dec 17 14:18:53 7 write: Creating symlink in share pointing to the above file copy. Dec 17 14:18:53 7 write: Saving 1 tombstones for Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 write: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/Uncatalogued/DSC01419.JPG Dec 17 14:18:53 7 parse_logs: Parsing Samba logs... -- Dec 17 16:55:55 7 fsck: Loading tombstones for Photos/Uncatalogued/Picture 057.jpg... Got 1 tombstones. Dec 17 16:55:55 7 fsck: Found /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/DSC01419.JPG Dec 17 16:55:55 7 fsck: Loading tombstones for Photos/Uncatalogued/DSC01419.JPG... Got 1 tombstones. Dec 17 16:55:55 7 fsck: Found /var/hda/files/drives/drive2/gh/Photos/Uncatalogued/Photo-0077.jpg -- Dec 17 16:56:42 7 parse_logs: Done parsing. Dec 17 16:56:42 7 fsck_file: Now working on task ID 30214: fsck_file Photos/2004/DSC01419.JPG Dec 17 16:56:42 7 fsck_file: Loading tombstones for Photos/2004/DSC01419.JPG... Got 1 tombstones. Dec 17 16:56:42 4 fsck_file: WARNING! No copies of this file are available in the Greyhole storage pool. Did you copy that file there without using your Samba shares..? (If you did, don't do that in the future!) Dec 17 16:56:42 6 fsck_file: 2004/DSC01419.JPG is a file (not a symlink). Adding a new 'write' pending task for that file. Dec 17 16:56:42 7 fsck_file: Saving 1 tombstones for Photos/2004/DSC01419.JPG Dec 17 16:56:42 7 fsck_file: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG Dec 17 16:56:42 7 fsck_file: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG Dec 17 16:56:42 7 parse_logs: Parsing Samba logs... Dec 17 16:56:42 7 parse_logs: Done parsing. Dec 17 16:56:42 7 write: Now working on task ID 40382: write Photos/2004/DSC01419.JPG Dec 17 16:56:42 7 write: File write: /var/hda/files/drives/drive2/Photos/2004/DSC01419.JPG doesn't exist anymore. Skipping. Dec 17 16:56:42 7 parse_logs: Parsing Samba logs... -- Dec 17 16:58:40 7 parse_logs: Done parsing. Dec 17 16:58:40 7 fsck_file: Now working on task ID 33601: fsck_file Photos/2004/DSC01419.JPG Dec 17 16:58:40 7 fsck_file: Loading tombstones for Photos/2004/DSC01419.JPG... Got 1 tombstones. Dec 17 16:58:40 4 fsck_file: WARNING! No copies of this file are available in the Greyhole storage pool. Did you copy that file there without using your Samba shares..? (If you did, don't do that in the future!) Dec 17 16:58:40 6 fsck_file: 2004/DSC01419.JPG is a file (not a symlink). Adding a new 'write' pending task for that file. Dec 17 16:58:40 7 fsck_file: Saving 1 tombstones for Photos/2004/DSC01419.JPG Dec 17 16:58:40 7 fsck_file: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG Dec 17 16:58:40 7 fsck_file: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG Dec 17 16:58:40 7 parse_logs: Parsing Samba logs... Dec 17 16:58:40 7 parse_logs: Done parsing. Dec 17 16:58:40 7 write: Now working on task ID 43768: write Photos/2004/DSC01419.JPG Dec 17 16:58:40 7 write: File write: /var/hda/files/drives/drive2/Photos/2004/DSC01419.JPG doesn't exist anymore. Skipping. Dec 17 16:58:40 7 parse_logs: Parsing Samba logs... -- Dec 17 17:00:51 7 parse_logs: Done parsing. Dec 17 17:00:51 7 fsck_file: Now working on task ID 38539: fsck_file Photos/2004/DSC01419.JPG Dec 17 17:00:51 7 fsck_file: Loading tombstones for Photos/2004/DSC01419.JPG... Got 1 tombstones. Dec 17 17:00:51 4 fsck_file: WARNING! No copies of this file are available in the Greyhole storage pool. Did you copy that file there without using your Samba shares..? (If you did, don't do that in the future!) Dec 17 17:00:51 6 fsck_file: 2004/DSC01419.JPG is a file (not a symlink). Adding a new 'write' pending task for that file. Dec 17 17:00:51 7 fsck_file: Saving 1 tombstones for Photos/2004/DSC01419.JPG Dec 17 17:00:51 7 fsck_file: Saving tombstones in /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG Dec 17 17:00:51 7 fsck_file: Saving tombstones (backup) in /var/hda/files/drives/drive1/gh/.gh_graveyard_backup/Photos/2004/DSC01419.JPG Dec 17 17:00:51 7 parse_logs: Parsing Samba logs... Dec 17 17:00:51 7 parse_logs: Done parsing. Dec 17 17:00:51 7 write: Now working on task ID 48697: write Photos/2004/DSC01419.JPG Dec 17 17:00:51 7 write: File write: /var/hda/files/drives/drive2/Photos/2004/DSC01419.JPG doesn't exist anymore. Skipping. Dec 17 17:00:51 7 parse_logs: Parsing Samba logs... From filesystem =============== Landing Zone: ls: cannot access /var/hda/files/drives/drive2/Photos/2004/DSC01419.JPG: No such file or directory Graveyard: -rw-rw-rw- 1 root root 147 2010-12-17 17:00 /var/hda/files/drives/drive2/gh/.gh_graveyard/Photos/2004/DSC01419.JPG array ( 0 => stdClass::__set_state(array( 'path' => '/var/hda/files/drives/drive2/gh/Photos/2004/DSC01419.JPG', 'is_linked' => false, 'state' => 'Gone', )), ) File copies:

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Most files being sent to attic

Postby gboudreau » Fri Dec 17, 2010 8:52 am

Ah, the 2004/DSC01419.JPG one is in the attic. I was looking at the Uncatalogued/DSC01419.JPG, which is fine.

You'll need to manually move the files from the attic into their original location:

Code: Select all

cp -r /var/hda/files/drives/drive1/gh/.gh_attic/Photos/* /var/hda/files/drives/drive1/gh/Photos/ cp -r /var/hda/files/drives/drive2/gh/.gh_attic/Photos/* /var/hda/files/drives/drive2/gh/Photos/ greyhole --fsck
- Guillaume Boudreau

jfk365
Posts: 10
Joined: Fri Dec 17, 2010 6:18 am

Re: Most files being sent to attic

Postby jfk365 » Fri Dec 17, 2010 9:59 am

Ok thanks all files are in place.

Any reason why 4th drive with 2nd system would cause greyhole to start twice?

Who is online

Users browsing this forum: No registered users and 30 guests