Page 1 of 2

Free Space filling up fast, please help

Posted: Tue Dec 14, 2010 12:18 am
by ralfb
Hello,

I have 3 x 2TB drives assigned to one greyhole storage pool. The O/S is running on a separate 80GB drive.

ALL shares are assigned to the Storage Pool.

I'm concerned that now my free space shown at Computer:Filesystem (using Fedora 12 Desktop) only shows 37GB, down from 69 GB.

I am in the process of copying files over via the network.

What is happening, what do I need to do. This is my first Amahi server and I've only had it up an running for a day now.

Many thanks

Ralf

Below is the info as per: http://forums.amahi.org/viewtopic.php?f=39&t=1989

Re: Free Space filling up?

Posted: Tue Dec 14, 2010 12:31 am
by ralfb
uname -r; rpm -q samba hda-greyhole

2.6.31.5-127.fc12.i686.PAE
samba-3.4.2-47.fc12.i686
hda-greyhole-0.7.5-1.i386

yum -y install fpaste; fpaste /etc/samba/smb.conf; fpaste /etc/greyhole.conf

Loaded plugins: fastestmirror, presto, refresh-packagekit
Loading mirror speeds from cached hostfile
* fedora: ftp.cuhk.edu.hk
* updates: ftp.cuhk.edu.hk
Setting up Install Process
Package fpaste-0.3.4-1.fc12.noarch already installed and latest version
Nothing to do
Uploading (5.1K)...
http://fpaste.org/wEMa/
Uploading (1.5K)...
http://fpaste.org/mDqH/

fdisk -l; df -h; greyhole --stats

/dev/mapper/vg_padme-lv_root on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sda1 on /boot type ext4 (rw)
/dev/sdb5 on /var/hda/files/drives/drive1 type ext4 (rw)
/dev/sdc5 on /var/hda/files/drives/drive2 type ext4 (rw)
/dev/sdd5 on /var/hda/files/drives/drive3 type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
gvfs-fuse-daemon on /home/ralf/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=ralf)

Disk /dev/sda: 80.0 GB, 80030957056 bytes
255 heads, 63 sectors/track, 9729 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x0000510b

Device Boot Start End Blocks Id System
/dev/sda1 * 1 26 204800 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2 26 9729 77943361 8e Linux LVM

Disk /dev/sdb: 2000.4 GB, 2000397852160 bytes
255 heads, 63 sectors/track, 243201 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x000262f8

Device Boot Start End Blocks Id System
/dev/sdb1 1 243202 1953512448 5 Extended
/dev/sdb5 1 243202 1953511424 83 Linux

Disk /dev/sdc: 2000.4 GB, 2000397852160 bytes
255 heads, 63 sectors/track, 243201 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x000ab1c0

Device Boot Start End Blocks Id System
/dev/sdc1 1 243202 1953512448 5 Extended
/dev/sdc5 1 243202 1953511424 83 Linux

Disk /dev/sdd: 2000.4 GB, 2000398934016 bytes
255 heads, 63 sectors/track, 243201 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00096095

Device Boot Start End Blocks Id System
/dev/sdd1 1 243202 1953513472 5 Extended
/dev/sdd5 1 243202 1953512448 83 Linux

Disk /dev/dm-0: 75.6 GB, 75585552384 bytes
255 heads, 63 sectors/track, 9189 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-0 doesn't contain a valid partition table

Disk /dev/dm-1: 4227 MB, 4227858432 bytes
255 heads, 63 sectors/track, 514 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-1 doesn't contain a valid partition table
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_padme-lv_root
70G 34G 33G 51% /
tmpfs 1003M 216K 1003M 1% /dev/shm
/dev/sda1 194M 22M 163M 12% /boot
/dev/sdb5 1.8T 211G 1.5T 13% /var/hda/files/drives/drive1
/dev/sdc5 1.8T 211G 1.5T 13% /var/hda/files/drives/drive2
/dev/sdd5 1.8T 211G 1.5T 13% /var/hda/files/drives/drive3

Greyhole Statistics
===================

Storage Pool
Total - Used = Free + Attic = Possible
/var/hda/files/drives/drive1/gh: 1834G - 211G = 1530G + 0G = 1530G
/var/hda/files/drives/drive2/gh: 1834G - 211G = 1530G + 1G = 1531G
/var/hda/files/drives/drive3/gh: 1834G - 211G = 1530G + 0G = 1530G




mysql -u root -phda -e "select * from disk_pool_partitions" hda_production


+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 1 | /var/hda/files/drives/drive1 | 10 | 2010-12-12 16:12:56 | 2010-12-12 16:12:56 |
| 2 | /var/hda/files/drives/drive2 | 10 | 2010-12-12 16:12:57 | 2010-12-12 16:12:57 |
| 3 | /var/hda/files/drives/drive3 | 10 | 2010-12-12 16:12:58 | 2010-12-12 16:12:58 |
+----+------------------------------+--------------+---------------------+---------------------+
[root@padme ralf]#
[root@padme ralf]#
[root@padme ralf]#
[root@padme ralf]#
[root@padme ralf]#
[root@padme ralf]#
[root@padme ralf]#
[root@padme ralf]# mysql -u root -phda -e "select * from disk_pool_partitions" hda_production
+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 1 | /var/hda/files/drives/drive1 | 10 | 2010-12-12 16:12:56 | 2010-12-12 16:12:56 |
| 2 | /var/hda/files/drives/drive2 | 10 | 2010-12-12 16:12:57 | 2010-12-12 16:12:57 |
| 3 | /var/hda/files/drives/drive3 | 10 | 2010-12-12 16:12:58 | 2010-12-12 16:12:58 |
+----+------------------------------+--------------+---------------------+---------------------+



mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" hda_production | grep -v 'concat(' | xargs ls -la | fpaste

Uploading (1.7K)...
http://fpaste.org/7cnc/

greyhole --view-queue

Greyhole Work Queue Statistics
==============================

This table gives you the number of pending operations queued for the Greyhole daemon, per share.

Write Delete Rename
Books 0 0 0
Docs 0 0 0
Janet 0 0 0
Movies 0 0 0
Movies_Best 0 0 0
movie_ripping 0 0 0
Music 0 0 0
Pictures 0 0 0
Ralf 940 0 0
2movies 0 0 0
=============
Total 940 + 0 + 0 = 940

Re: Free Space filling up fast, please help

Posted: Tue Dec 14, 2010 5:35 am
by gboudreau
I suggest you switch to MySQL:
http://wiki.amahi.org/index.php/Greyhol ... e_to_MySQL

This should fix that problem.

Re: Free Space filling up fast, please help

Posted: Tue Dec 14, 2010 9:41 am
by ralfb
Many thanks, did that like below.

Correct?

/usr/share/greyhole/db_migration-sqlite2mysql.sh

Stopping Greyhole service watchdog...
rm: cannot remove `/etc/monit.d/greyhole.conf': No such file or directory
Reloading monit: /etc/monit.d/mt-daapd.conf:1: Error: syntax error 'translation'

Done.

Stopping Greyhole service...
Shutting down Greyhole: [ OK ]
Done.

Creating MySQL database and user...
hda-create-db-and-user: creating greyhole
Done.

Modifying Greyhole configuration to use MySQL...
Done.

Migrating data from SQLite to MySQL...
Done.

Starting Greyhole service...
Starting Greyhole ... [ OK ]
Done.

Starting Greyhole service watchdog...
Reloading monit: /etc/monit.d/mt-daapd.conf:1: Error: syntax error 'translation'

Done.


regards,
Ralf

Re: Free Space filling up fast, please help

Posted: Tue Dec 14, 2010 9:58 am
by gboudreau
For Greyhole, yes, but this tells me your monit daemon (what Amahi calls the watchdog) isn't running because of an Amahi bug:
http://bugs.amahi.org/issues/show/685
http://bugs.amahi.org/issues/show/687
http://bugs.amahi.org/issues/show/689

The last one contains a new RPM that you could install to fix this.

Re: Free Space filling up fast, please help

Posted: Tue Dec 14, 2010 10:16 am
by ralfb
Hi Guillaume,

many thanks yet I don't know what you mean.

Please excuse,I'm new to Linux .

Could you give me simpler instructions?

Many thanks

Ralf

Re: Free Space filling up fast, please help

Posted: Tue Dec 14, 2010 10:39 am
by moncapitaine
I just ran the migration script and came up with a similar error:

Reloading monit: /etc/monit.d/crashplan.conf:1: Error: syntax error ':'

Does it mean crashplan is not running any more?

I tried to install the package from the last bug, but yum couldn't ffind it.

Re: Free Space filling up fast, please help

Posted: Tue Dec 14, 2010 11:28 am
by gboudreau
Please continue this discussion in the above bug reports.

Re: Free Space filling up fast, please help

Posted: Tue Dec 14, 2010 8:29 pm
by ralfb
I now have 0 kb disk space reported and can not copy anymore files to the server.

Is this related to the bug you mentioned?

thanks

Ralf

Re: Free Space filling up fast, please help

Posted: Tue Dec 14, 2010 11:20 pm
by moncapitaine
I'm sorry, usally I'm not that blind, but how do I add a comment there?