Staging Area full and files not moving

[globier]

Hi All,
Just setup my new server (Amahi newbie) and started to copy my data across to the shares when I got a disk full error. Once I looked around I have found the fles are notbeing moved to the data disks in the pool.
I have left it overnight but there is no change.

so I have 1 x 1TB OS and staging disk and 2 x 2TB data disk in pool.

Heres the info as per the posting rules.

Versions

2.6.31.5-127.fc12.x86_64
samba-3.4.2-47.fc12.x86_64
hda-greyhole-0.6.28-1.x86_64


conf files

http://fpaste.org/d91Z/
http://fpaste.org/PBTR/


mount, fdisk, df, greyhole stats

/dev/mapper/vg_amahi-lv_root on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sdc1 on /boot type ext4 (rw)
/dev/sda1 on /var/hda/files/drives/drive1 type ext4 (rw)
/dev/sdb1 on /var/hda/files/drives/drive3 type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)

Disk /dev/sda: 2000.4 GB, 2000394706432 bytes
255 heads, 63 sectors/track, 243200 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x0004a54f

Device Boot Start End Blocks Id System
/dev/sda1 1 243201 1953509376 83 Linux

Disk /dev/sdb: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00006bc5

Device Boot Start End Blocks Id System
/dev/sdb1 1 243202 1953513472 83 Linux

Disk /dev/sdc: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0xa4651843

Device Boot Start End Blocks Id System
/dev/sdc1 * 1 26 204800 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sdc2 26 121601 976555201 8e Linux LVM

Disk /dev/dm-0: 993.7 GB, 993680949248 bytes
255 heads, 63 sectors/track, 120808 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-0 doesn't contain a valid partition table

Disk /dev/dm-1: 6308 MB, 6308233216 bytes
255 heads, 63 sectors/track, 766 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-1 doesn't contain a valid partition table
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_amahi-lv_root
911G 857G 8.0G 100% /
tmpfs 2.0G 88K 2.0G 1% /dev/shm
/dev/sdc1 194M 23M 162M 13% /boot
/dev/sda1 1.8T 196M 1.7T 1% /var/hda/files/drives/drive1
/dev/sdb1 1.8T 196M 1.7T 1% /var/hda/files/drives/drive3

Greyhole Statistics
===================

Storage Pool
Total - Used = Free + Attic = Possible
/var/hda/files/drives/drive1/gh: 1834G - 0G = 1740G + 0G = 1740G
/var/hda/files/drives/drive3/gh: 1834G - 0G = 1740G + 0G = 1740G




Drives in storage pool

+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 2 | /var/hda/files/drives/drive1 | 10 | 2010-12-10 20:29:04 | 2010-12-10 20:29:04 |
| 3 | /var/hda/files/drives/drive3 | 10 | 2010-12-10 20:37:13 | 2010-12-10 20:37:13 |
+----+------------------------------+--------------+---------------------+---------------------+



List of the directories on the root of the drives

http://fpaste.org/eEcN/



Greyhole Work Queue Statistics
==============================

This table gives you the number of pending operations queued for the Greyhole daemon, per share.

Write Delete Rename
Docs 17 0 0
Kids 721 0 0
Movies 3355 0 0
Music 14531 0 0
Pictures 41958 0 0
TV Series 1193 0 0
=========
Total 61775 + 0 + 0 = 61775

[globier]

FYI, I've cleared 130GB on the staging drive just incase the lack of space was a problem and will leave it overnight.

[gboudreau]

Check what the Greyhole daemon is doing (as root):

Code: Select all

tail -f /var/log/greyhole.log

And check that the daemon is actually running (as root again):

Code: Select all

service greyhole status

If you see it's running, but seems quite slow, I suggest you switch to MySQL:
http://wiki.amahi.org/index.php/Greyhol ... e_to_MySQL

You'll need to update your Greyhole to the latest version to be able to switch to MySQL:

Code: Select all

yum clean all; yum -y update hda-greyhole

This normally happens automatically (it would in the upcoming day), but you can force the update.

[globier]

Thanks, The update and mysql migration has fixed it.

My log was incrementing approx 1 entry every 2 seconds prior and it looks like it never caught up.

Once the update and migration was done the log was processing approx 15-20 files per sec then I saw some write entries which I have never seen in the log before so I checked if files were in the /var/hda/files/drives/drive1/gh location and they were so I'll let it do it's thing overnight and see if everything moves OK.

Thanks for the help.

Cheers