Greyhole set up, but no files visible only folders

camnz
Posts: 6
Joined: Mon Mar 29, 2010 7:03 pm

Greyhole set up, but no files visible only folders

Postby camnz » Wed Feb 16, 2011 5:25 pm

Hi there,

When I mount shares, the directory structure is mostly there, but very few files at all.

I've just migrated my files from RAID 5 to Greyhole using the reduntant drive from the array as an intermediary drive (formatted ext4). The RAID array was then disbanded to provide drives for Greyhole.

I followed the 10 step walkthru at: http://wiki.amahi.org/index.php/Greyhole, including editing the path (using Amahi) of each of the shares so they pointed to their temporary home on the intermediary drive.

All of the data was copied off the intermediary drive when I used greyhole --fsck. Only sym links were left there.

I then moved all of the directories and sym links as per step 8, then edited the paths back to /var/hda/files/share_name etc

I can see that there's a fair bit of data on the drives, so the files have got to be somewhere... It's just that they're not showing up where they should be...

Here's some info

Fedora: 2.6.32.14-127.fc12.x86_64
samba-3.4.7-58.fc12.x86_64
hda-greyhole-0.7.5-1.x86_64

http://fpaste.org/mwMr/
http://fpaste.org/CjJ9/

[cam@localhost /]$ mount
/dev/mapper/VolGroup-lv_root on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sda1 on /boot type ext4 (rw)
/dev/sdd1 on /var/hda/files/drives/drive3 type ext4 (rw)
/dev/sdc1 on /var/hda/files/drives/drive2 type ext4 (rw)
/dev/sdb1 on /var/hda/files/drives/drive1 type ext4 (rw)
/dev/sde1 on /var/hda/files/drives/drive4 type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
gvfs-fuse-daemon on /home/cam/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=cam)

[cam@localhost /]$ fdisk -l
Nothing returned

[cam@localhost /]$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup-lv_root
290G 165G 111G 60% /
tmpfs 877M 112K 877M 1% /dev/shm
/dev/sda1 194M 57M 128M 31% /boot
/dev/sdd1 1.4T 480G 897G 35% /var/hda/files/drives/drive3
/dev/sdc1 1.4T 309G 1.1T 23% /var/hda/files/drives/drive2
/dev/sdb1 1.4T 417G 959G 31% /var/hda/files/drives/drive1
/dev/sde1 1.4T 462G 915G 34% /var/hda/files/drives/drive4

[cam@localhost /]$ greyhole --stats

Greyhole Statistics
===================

Storage Pool
Total - Used = Free + Attic = Possible
/var/hda/files/drives/drive4/gh: 1375G - 461G = 914G + 0G = 914G
/var/hda/files/drives/drive1/gh: 1375G - 416G = 959G + 0G = 959G
/var/hda/files/drives/drive2/gh: 1375G - 309G = 1066G + 0G = 1066G
/var/hda/files/drives/drive3/gh: 1375G - 479G = 896G + 0G = 896G

[cam@localhost /]$ mysql -u root -phda -e "select * from disk_pool_partitions" hda_production
+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 1 | /var/hda/files/drives/drive4 | 10 | 2011-02-15 08:35:19 | 2011-02-15 08:35:19 |
| 4 | /var/hda/files/drives/drive1 | 10 | 2011-02-16 21:17:48 | 2011-02-16 21:17:48 |
| 5 | /var/hda/files/drives/drive2 | 10 | 2011-02-16 21:17:49 | 2011-02-16 21:17:49 |
| 6 | /var/hda/files/drives/drive3 | 10 | 2011-02-16 21:17:50 | 2011-02-16 21:17:50 |
+----+------------------------------+--------------+---------------------+---------------------+

http://fpaste.org/MdI2/

[cam@localhost /]$ greyhole --view-queue

Greyhole Work Queue Statistics
==============================

This table gives you the number of pending operations queued for the Greyhole daemon, per share.

Write Delete Rename
Andreas Docs 0 0 0
Andreas Photos 0 0 0
Applications 0 0 0
Backups 0 0 0
Books 0 0 0
Business 0 0 0
Cams Docs 0 0 0
Cams Photos 0 0 0
Crashplan 0 0 0
Docs 0 0 0
Movies 0 0 0
Music 0 0 0
Photo Vault 0 0 0
Pictures 0 0 0
Projects 0 0 0
Torrents 0 0 0
Videos 0 0 0
Websites 0 0 0
==============
Total 0 + 0 + 0 = 0


Thanks heaps,
-Cam

camnz
Posts: 6
Joined: Mon Mar 29, 2010 7:03 pm

Re: Greyhole set up, but no files visible only folders

Postby camnz » Wed Feb 16, 2011 9:19 pm

Update:

Looks like greyhole is slowly sync'ing the files across the drives. Files are visible in shares now... :roll:

Strange though, there's nothing in the queue but the log is getting heaps of fsck_file entries added - thousands over the past couple of hours! :?

Will report back later

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: Greyhole set up, but no files visible only folders

Postby gboudreau » Sat Feb 19, 2011 5:58 am

fsck tasks that will re-create the symlinks to not appear in --stats, that's normal.
Look in /var/log/greyhole.log to see if it's still working, and when it's done.
- Guillaume Boudreau

Who is online

Users browsing this forum: No registered users and 25 guests