Some files missing after "syncing" large amounts of data

[techlife]

Hi!

I'm very new here and am in the process of converting from WHS fail. If I posted this in the wrong section, I apologize in advance.

I pulled the the first 4 of my drives from the WHS server and connected them to my Win7 test box. I have 4 drives (of greater or equal size) in the Greyhole storage pool. I created shares in Greyhole to match those that I had on WHS (and what is on these 1st drives). I then used SyncToy to copy all of the data to the shares. ex: d:\dvd -> \\HDA\dvd

The issue I am having is that some files in some folders (seems to be random) did not copy.
For example: \tv\Criminal Minds\Season 3\05 - Seven Seconds\VIDEO_TS\ contains the following files:
VIDEO_TS.BUP
VIDEO_TS.IFO
VTS_01_0.IFO
VTS_01_0.BUP
VTS_01_1.VOB
VTS_01_2.VOB

When I browse to \HDA\tv\Criminal Minds\Season 3\05 - Seven Seconds\VIDEO_TS\ all of the files are there EXCEPT VTS_01_2.VOB. If I try to copy the file manually (drag and drop within windows) nothing happens at all. If I rename the file VTS_01_2.VO_ then copy, then rename it finally stays there.

If I run SyncToy, it says there is nothing to do yet there are directories like \bluray\IronMan that are COMPLETELY empty on the HDA.

I have googled and searched SourceForge for a different sync program but haven't found anything worth trying.

I have run greyhole -fsck and checked again but there were no changes.

I want to get all of this data on the server, verify it bit for bit, then add the drives it's currently on to the server and enable duplication. If it were only a few files I would do it manually but we're talking a difference of 323 files across 2417 folders on the FIRST drive ALONE. There are 4 drives in this first batch. Yeah, that takes a LONG time to fix manually. It took SyncToy almost 3 days just to get this far...

Any suggestions at this point would be greatly appreciated!!! Thanks in advance!!

2.6.32.26-175.fc12.x86_64
samba-3.4.9-60.fc12.x86_64
hda-greyhole-0.7.5-1.x86_64

http://fpaste.org/fP7j/
http://fpaste.org/L8ww/

/dev/mapper/vg_xavier-lv_root on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sdb1 on /boot type ext4 (rw)
/dev/sdd1 on /var/hda/files/drives/drive3 type ext4 (rw)
/dev/sdc1 on /var/hda/files/drives/drive5 type ext4 (rw)
/dev/sde1 on /var/hda/files/drives/drive6 type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
gvfs-fuse-daemon on /home/Xavier/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=Xavier)
/dev/sr0 on /media/UDF Volume type udf (ro,nosuid,nodev,uhelper=devkit,uid=500,gid=500,iocharset=utf8,umask=0077)
/dev/sda1 on /var/hda/files/drives/drive7 type ext3 (rw)

Disk /dev/sda: 1000.2 GB, 1000200658432 bytes
255 heads, 63 sectors/track, 121600 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x9d994cdf

Device Boot Start End Blocks Id System
/dev/sda1 1 121601 976756736 83 Linux

Disk /dev/sdb: 320.1 GB, 320071851520 bytes
255 heads, 63 sectors/track, 38913 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0xcb8bc459

Device Boot Start End Blocks Id System
/dev/sdb1 * 1 26 204800 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sdb2 26 38913 312363841 8e Linux LVM

Disk /dev/sdc: 1500.3 GB, 1500300828160 bytes
255 heads, 63 sectors/track, 182401 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00098381

Device Boot Start End Blocks Id System
/dev/sdc1 1 182402 1465136128 83 Linux

Disk /dev/sdd: 1500.3 GB, 1500300828160 bytes
255 heads, 63 sectors/track, 182401 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x000b6210

Device Boot Start End Blocks Id System
/dev/sdd1 1 182401 1465136001 83 Linux

Disk /dev/sde: 1500.3 GB, 1500297682432 bytes
255 heads, 63 sectors/track, 182400 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x0006196a

Device Boot Start End Blocks Id System
/dev/sde1 1 182401 1465133056 83 Linux

Disk /dev/dm-0: 311.4 GB, 311435460608 bytes
255 heads, 63 sectors/track, 37863 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-0 doesn't contain a valid partition table

Disk /dev/dm-1: 8422 MB, 8422162432 bytes
255 heads, 63 sectors/track, 1023 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-1 doesn't contain a valid partition table
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_xavier-lv_root
286G 11G 261G 4% /
tmpfs 3.0G 420K 3.0G 1% /dev/shm
/dev/sdb1 194M 40M 145M 22% /boot
/dev/sdd1 1.4T 1.3T 29G 98% /var/hda/files/drives/drive3
/dev/sdc1 1.4T 1.3T 63G 96% /var/hda/files/drives/drive5
/dev/sde1 1.4T 1.3T 32G 98% /var/hda/files/drives/drive6
/dev/sr0 2.4G 2.4G 0 100% /media/UDF Volume
/dev/sda1 917G 835G 36G 96% /var/hda/files/drives/drive7

Greyhole Statistics
===================

Storage Pool
Total - Used = Free + Attic = Possible
/var/hda/files/drives/drive3/gh: 1375G - 1277G = 28G + 460G = 489G
/var/hda/files/drives/drive5/gh: 1375G - 1243G = 62G + 4G = 66G
/var/hda/files/drives/drive6/gh: 1375G - 1274G = 31G + 4G = 35G
/var/hda/files/drives/drive7/gh: 917G - 835G = 36G + 0G = 36G

+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 1 | /var/hda/files/drives/drive3 | 10 | 2010-12-18 14:17:09 | 2010-12-18 14:17:09 |
| 2 | /var/hda/files/drives/drive5 | 10 | 2010-12-18 14:41:05 | 2010-12-18 14:41:05 |
| 3 | /var/hda/files/drives/drive6 | 10 | 2010-12-18 15:45:55 | 2010-12-18 15:45:55 |
| 4 | /var/hda/files/drives/drive7 | 10 | 2010-12-21 05:21:16 | 2010-12-21 05:21:16 |
+----+------------------------------+--------------+---------------------+---------------------+

http://fpaste.org/rACZ/

Greyhole Work Queue Statistics
==============================

This table gives you the number of pending operations queued for the Greyhole daemon, per share.

Write Delete Rename
Backup 0 0 0
bluray 0 0 0
Documents 0 0 0
DVD 0 0 0
Music 0 0 0
Pictures 0 0 0
Software 0 0 0
TV 1 0 0
TV2 0 0 0
Videos 0 0 0
=========
Total 1 + 0 + 0 = 1

[techlife]

Anyone? Even a place to start maybe??

[gboudreau]

greyhole --debug "Criminal Minds/Season 3/05 - Seven Seconds/VIDEO_TS/VTS_01_2.VOB"

But you probably want to do this with a file you didn't play with afterwards.
So find a missing file that you didn't play with, and execute greyhole --debug "part/of/path/filename"

Post the result here.

[techlife]

I haven't touched this directory at all:

http://fpaste.org/rjBT/

[techlife]

On another interesting note...I decided to copy all of my music to the HDA this morning. A simply dragged and dropped the music folder on my desktop to the music share on the HDA. No SyncToy or anything. Folders were generated for everything but not a single file copied. Not one!!!

I randomly choose a file and generated the info below. Hope all this helps....I really want to get this working!!!!

http://fpaste.org/8kZy/



I don't want to jump the gun here but I'm not that far into this and I have the whole week off; If you think it may be easier to just wipe the server and start over from a fresh install I'd be willing to do it....

Thanks in advance and for all your help so far!!

[gboudreau]

That file ("Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/VTS_01_2.VOB") doesn't appear gone. Are you sure it does not appear from your share?
Is it the only one that is missing from that directory?

If it doesn't appear, try those, to compare with other files that appear in the same directory:

Code: Select all

ls -la "/var/hda/files/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/" ls -la /var/hda/files/drives/drive*/gh/TV/Friends/Season\ 9/04\ -\ The\ One\ With\ The\ Sharks/VIDEO_TS/

[gboudreau]

Looking at the music debug log, I see that all you music files are probably stored on drive3 (per the sticky config that Amahi has by default).
Which makes me think your problem is that drive3.
The files permissions for your files on that drive appear funky: -rwxrw-r-- (764)...

Can you confirm that all the symlinks that point to a file on drive3 are indeed the files you don't see on your shares?
You can look in /var/hda/files/share_name (with ls -l) for files that point to drive3, and then compare with what you see on your share.

Can you show me your fstab file ?
The mount and fdisk -l commands seems to indicate that drive is similar to the others, so I don't see why that drive would cause problems.

Also, maybe there's a permission that is wrong in there, that would cause files to be unaccessible. Let's check with:

Code: Select all

ls -la /var/hda/files/drives/drive3/gh/TV/Friends/Season\ 9/04\ -\ The\ One\ With\ The\ Sharks/VIDEO_TS/ ls -la /var/hda/files/drives/drive3/gh/TV/Friends/Season\ 9/04\ -\ The\ One\ With\ The\ Sharks/ ls -la /var/hda/files/drives/drive3/gh/TV/Friends/ ls -la /var/hda/files/drives/drive3/gh/TV/ ls -la /var/hda/files/drives/drive3/gh/

[techlife]

That file ("Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/VTS_01_2.VOB") doesn't appear gone. Are you sure it does not appear from your share?
Is it the only one that is missing from that directory?

http://ScrnSht.com/ahziqm - Yeah, unfortunately it does not show up...

http://ScrnSht.com/hvjvll - On the left is the HDA, on the right is the HDD containing the original data. As you can see, it is the only file missing...

If it doesn't appear, try those, to compare with other files that appear in the same directory:

Code: Select all

ls -la "/var/hda/files/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/"

[root@Xavier ~]# ls -la "/var/hda/files/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/"
total 32
drwxrwxr-x 2 bigdaddy users 4096 2010-12-21 08:37 .
drwxrwxr-x 4 bigdaddy users 4096 2010-12-19 03:53 ..
lrwxrwxrwx 1 root root 102 2010-12-19 03:55 VIDEO_TS.BUP -> /var/hda/files/drives/drive6/gh/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/VIDEO_TS.BUP
lrwxrwxrwx 1 root root 102 2010-12-19 03:55 VIDEO_TS.IFO -> /var/hda/files/drives/drive6/gh/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/VIDEO_TS.IFO
lrwxrwxrwx 1 root root 102 2010-12-19 03:55 VTS_01_0.BUP -> /var/hda/files/drives/drive6/gh/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/VTS_01_0.BUP
lrwxrwxrwx 1 root root 102 2010-12-19 03:55 VTS_01_0.IFO -> /var/hda/files/drives/drive6/gh/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/VTS_01_0.IFO
lrwxrwxrwx 1 root root 102 2010-12-19 03:56 VTS_01_1.VOB -> /var/hda/files/drives/drive6/gh/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/VTS_01_1.VOB
lrwxrwxrwx 1 root root 102 2010-12-21 08:37 VTS_01_2.VOB -> /var/hda/files/drives/drive3/gh/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/VTS_01_2.VOB

Code: Select all

ls -la /var/hda/files/drives/drive*/gh/TV/Friends/Season\ 9/04\ -\ The\ One\ With\ The\ Sharks/VIDEO_TS/

[root@Xavier ~]# ls -la /var/hda/files/drives/drive*/gh/TV/Friends/Season\ 9/04\ -\ The\ One\ With\ The\ Sharks/VIDEO_TS/
/var/hda/files/drives/drive3/gh/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/:
total 17828
drwxrwxr-x 2 bigdaddy users 4096 2010-12-21 08:37 .
drwxrwxr-x 3 bigdaddy users 4096 2010-12-19 03:56 ..
-rwxrw-r-- 1 bigdaddy users 18223104 2010-12-21 08:37 VTS_01_2.VOB

/var/hda/files/drives/drive6/gh/TV/Friends/Season 9/04 - The One With The Sharks/VIDEO_TS/:
total 1049692
drwxrwxr-x 2 bigdaddy users 4096 2010-12-19 03:56 .
drwxrwxr-x 3 bigdaddy users 4096 2010-12-19 03:55 ..
-rwxrw-r-- 1 bigdaddy users 6144 2010-12-19 03:55 VIDEO_TS.BUP
-rwxrw-r-- 1 bigdaddy users 6144 2010-12-19 03:55 VIDEO_TS.IFO
-rwxrw-r-- 1 bigdaddy users 30720 2010-12-19 03:55 VTS_01_0.BUP
-rwxrw-r-- 1 bigdaddy users 30720 2010-12-19 03:55 VTS_01_0.IFO
-rwxrw-r-- 1 bigdaddy users 1073739776 2010-12-19 03:56 VTS_01_1.VOB

[techlife]

Looking at the music debug log, I see that all you music files are probably stored on drive3 (per the sticky config that Amahi has by default).
Which makes me think your problem is that drive3.
The files permissions for your files on that drive appear funky: -rwxrw-r-- (764)...

Can you confirm that all the symlinks that point to a file on drive3 are indeed the files you don't see on your shares? You can look in /var/hda/files/share_name (with ls -l) for files that point to drive3, and then compare with what you see on your share.

I will check more closely, but yes it does to seem to be files on drive 3. Of notable interest, I have just started receiving a message on the server that the "Disk has many bad sectors" referring to the same HDD. See here: http://ScrnSht.com/idgvpt

I have read some reports of false messages from palimpset so I will run some diags (MHDD and/or SpinRite) on the drive and see what's up.

If it is in fact the drive and I add another to replace, can I then run some sort "remove" command like is possible in WHS? It's really not necessary as I will probably rebuild all the shares anyway... I'm more curious about this for the future for when the HDA is in full service and I do have a drive fail. Is it as easy as popping in a replacement drive?? (A little off-topic I know, sorry but I have been wondering this the whole time and wanted to ask while I was thinking about it...)

Can you show me your fstab file ?

http://fpaste.org/tiqg/

The mount and fdisk -l commands seems to indicate that drive is similar to the others, so I don't see why that drive would cause problems.

Also, maybe there's a permission that is wrong in there, that would cause files to be unaccessible. Let's check with:

Code: Select all

ls -la /var/hda/files/drives/drive3/gh/TV/Friends/Season\ 9/04\ -\ The\ One\ With\ The\ Sharks/VIDEO_TS/

[root@Xavier ~]# ls -la /var/hda/files/drives/drive3/gh/TV/Friends/Season\ 9/04\ -\ The\ One\ With\ The\ Sharks/VIDEO_TS/
total 17828
drwxrwxr-x 2 bigdaddy users 4096 2010-12-21 08:37 .
drwxrwxr-x 3 bigdaddy users 4096 2010-12-19 03:56 ..
-rwxrw-r-- 1 bigdaddy users 18223104 2010-12-21 08:37 VTS_01_2.VOB

Code: Select all

ls -la /var/hda/files/drives/drive3/gh/TV/Friends/Season\ 9/04\ -\ The\ One\ With\ The\ Sharks/

[root@Xavier ~]# ls -la /var/hda/files/drives/drive3/gh/TV/Friends/Season\ 9/04\ -\ The\ One\ With\ The\ Sharks/
total 12
drwxrwxr-x 3 bigdaddy users 4096 2010-12-19 03:56 .
drwxrwxr-x 14 bigdaddy users 4096 2010-12-19 04:13 ..
drwxrwxr-x 2 bigdaddy users 4096 2010-12-21 08:37 VIDEO_TS

Code: Select all

ls -la /var/hda/files/drives/drive3/gh/TV/Friends/

[root@Xavier ~]# ls -la /var/hda/files/drives/drive3/gh/TV/Friends/
total 48
drwxrwxr-x 12 bigdaddy users 4096 2010-12-19 03:53 .
drwxrwxr-x 12 bigdaddy users 4096 2010-12-21 09:05 ..
drwxrwxr-x 10 bigdaddy users 4096 2010-12-18 23:32 Season 1
drwxrwxr-x 11 bigdaddy users 4096 2010-12-18 23:40 Season 10
drwxrwxr-x 10 bigdaddy users 4096 2010-12-18 23:49 Season 2
drwxrwxr-x 10 bigdaddy users 4096 2010-12-18 23:59 Season 3
drwxrwxr-x 10 bigdaddy users 4096 2010-12-19 00:08 Season 4
drwxrwxr-x 10 bigdaddy users 4096 2010-12-19 00:18 Season 5
drwxrwxr-x 10 bigdaddy users 4096 2010-12-19 12:43 Season 6
drwxrwxr-x 11 bigdaddy users 4096 2010-12-19 03:25 Season 7
drwxrwxr-x 11 bigdaddy users 4096 2010-12-19 03:50 Season 8
drwxrwxr-x 14 bigdaddy users 4096 2010-12-19 04:13 Season 9

Code: Select all

ls -la /var/hda/files/drives/drive3/gh/TV/

[root@Xavier ~]# ls -la /var/hda/files/drives/drive3/gh/TV/
total 60
drwxrwxr-x 12 bigdaddy users 4096 2010-12-21 09:05 .
drwxr-xr-x 9 root root 4096 2010-12-25 02:45 ..
drwxrwxr-x 7 bigdaddy users 4096 2010-12-18 10:41 Alias
drwxrwxr-x 7 bigdaddy users 4096 2010-12-18 13:06 Ally McBeal
drwxrwxr-x 8 bigdaddy users 4096 2010-12-18 15:45 Bones
drwxrwxr-x 13 bigdaddy users 4096 2010-12-18 20:32 Crime Scene Investigation
drwxrwxr-x 8 bigdaddy users 4096 2010-12-18 23:00 Criminal Minds
drwxrwxr-x 5 bigdaddy users 4096 2010-12-18 23:17 Dexter
drwxrwxr-x 3 bigdaddy users 4096 2010-12-18 23:22 Dirty Jobs
drwxrwxr-x 12 bigdaddy users 4096 2010-12-19 03:53 Friends
drwxrwxr-x 5 bigdaddy users 4096 2010-12-19 13:08 Fringe
drwxrwxr-x 9 bigdaddy users 4096 2010-12-19 16:30 House
-rw-rw-r-- 1 bigdaddy users 16 2010-12-19 02:31 SyncToy_019573e0-cadc-48f3-9c25-41d9131d40c0.dat
-rw-rw-r-- 1 bigdaddy users 16 2010-12-19 21:20 SyncToy_4096a7f7-bce4-4d21-bf08-ede3241b4570.dat
-rw-rw-r-- 1 bigdaddy users 16 2010-12-19 07:25 SyncToy_470d405b-6186-49c3-a676-8c7a43e4838c.dat

Code: Select all

ls -la /var/hda/files/drives/drive3/gh/

[root@Xavier ~]# ls -la /var/hda/files/drives/drive3/gh/
total 36
drwxr-xr-x 9 root root 4096 2010-12-25 02:45 .
drwx------ 4 Xavier users 4096 2010-12-18 07:17 ..
drwxrwxr-x 9 Xavier users 4096 2010-12-24 07:24 bluray
drwxrwxr-x 156 Xavier users 4096 2010-12-20 20:56 DVD
drwxrwxr-x 7 bigdaddy users 4096 2010-12-25 02:45 .gh_graveyard
drwxrwxrwx 6 root root 4096 2010-12-20 11:24 .gh_graveyard_backup
-rw-r--r-- 1 root root 0 2010-12-25 06:39 .greyhole_uses_this
drwxrwxr-x 4 bigdaddy users 4096 2010-12-25 03:14 Music
drwxrwxr-x 12 bigdaddy users 4096 2010-12-21 09:05 TV
drwxrwxr-x 17 Xavier users 4096 2010-12-20 10:56 TV2

[gboudreau]

I will check more closely, but yes it does to seem to be files on drive 3. If it is infact the drive and I add another to replace, can I then run some sort "remove" command like is possible in WHS? Would this be advised at this point? I'm cool with RA'ing the drive. I have just started receiving a message on the server that the "Disk has many bad sectors".

Replacing that drive is indeed the right solution.
From a terminal:

Code: Select all

greyhole --going=/var/hda/files/drives/drive3/gh

Will try to move the files away from that drive, and onto the other drives, but if it has too many bad sectors, some of those files copy will fail, and you might end up with invalid copies on your other drives.