Greyhole Bug #676

[blackbird]

Ive copied some data to my landing zone (/var/hda/files/)
Normally Greyhole should start to move files after 10sec. to shares. This starts in my case in more than 1 or 2 HOURS.
AND the Greyhole process is working the hole day on Root drive and i dont know why. But the system is damn slow since then and the transferrate from landing zone to shares is down to 100KB/s.
So now u can calculate how much time greyhole needs to move 120GB data to shares

But also if there are no data to move and if landing zone and shares completely empty greyhole works the hole time on root drive.

So i think my HDD will die when i let him work 365 days...

[gboudreau]

I posted a new sticky in this forum (http://forums.amahi.org/viewtopic.php?f=39&t=1989)

If you need help on this, please provide the information requested in this post.

Thanks.

[blackbird]

1. What version of Fedora, Samba & Greyhole are you running?
2.6.32.23-170.fc12.i686.PAE
samba-3.4.9-60.fc12.i686
hda-greyhole-0.6.28-1.i386

2. The content of the /etc/samba/smb.conf & /etc/greyhole.conf files (provide paste URLs):

http://fpaste.org/OPAv/
http://fpaste.org/pJAd/

3. The result of the following commands:

/dev/sda1 on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sda3 on /var/hda/files type ext4 (rw,noatime)
/dev/sdb1 on /var/hda/files/drives/drive1 type ext4 (rw,noatime)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
gvfs-fuse-daemon on /home/blackbird/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,user=blackbird)

Platte /dev/sda: 160.0 GByte, 160041885696 Byte
255 Köpfe, 63 Sektoren/Spur, 19457 Zylinder
Einheiten = Zylinder von 16065 × 512 = 8225280 Bytes
Disk identifier: 0x000f0044

Gerät boot. Anfang Ende Blöcke Id System
/dev/sda1 * 1 893 7168000 83 Linux
Partition 1 endet nicht an einer Zylindergrenze.
/dev/sda2 893 1275 3072000 82 Linux Swap / Solaris
/dev/sda3 1275 19457 146048321 83 Linux

Platte /dev/sdb: 1000.2 GByte, 1000204886016 Byte
255 Köpfe, 63 Sektoren/Spur, 121601 Zylinder
Einheiten = Zylinder von 16065 × 512 = 8225280 Bytes
Disk identifier: 0x126b1512

Gerät boot. Anfang Ende Blöcke Id System
/dev/sdb1 1 121601 976760001 83 Linux
Dateisystem Größe Benut Verf Ben% Eingehängt auf
/dev/sda1 6,8G 3,4G 3,1G 52% /
tmpfs 1007M 524K 1006M 1% /dev/shm
/dev/sda3 138G 487M 130G 1% /var/hda/files
/dev/sdb1 917G 129G 742G 15% /var/hda/files/drives/drive1

Greyhole Statistics
===================

Storage Pool
Total - Used = Free + Attic = Possible
/var/hda/files/drives/drive1/gh: 917G - 129G = 741G + 0G = 741G
/var/hda/files/gh: 137G - 0G = 130G + 0G = 130G

4. The list drives in your storage pool (per Amahi platform):

+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 1 | /var/hda/files/drives/drive1 | 10 | 2010-11-08 21:54:02 | 2010-11-08 21:54:02 |
| 2 | /var/hda/files | 10 | 2010-11-09 01:12:39 | 2010-11-09 01:12:39 |
+----+------------------------------+--------------+---------------------+---------------------+

5. A list of the directories on the root of the drives included in your storage pool, obtained with the following command (provide a paste URL):

Uploading (0.9K)...
Server Error: 500 - INTERNAL SERVER ERROR
500 often means your paste was too large. You tried uploading 0KiB. A pastebin is NOT a file hosting service!

And by the way, who is waisting time? This is the first time u write to me. I try since 2 Weeks to get Amahi and Greyhole working. I have installed it 5 or 6 times. Readed the complete wiki and destroed nearly half of my Data (because i thought Amahi and Greyhole workes).
Nobody could help me. Not here and not in the chat.
cpg tried to help, but he said he is not a Greyhole specialist.
Im not a linux hacker and i only want to give Amahi and Greyhole a chance because it looks and most of it works good. But the Main Idea behind a server is to secure and share Data. And if this doesnt work then its not a server software. A simple conclusion. But anyway, i ll give it a try and spend some hours more. But if nobody helps me (the noob) then its only cut&try...So who is waisting time???

It was an good idea to post this "read befor u post" because NOW, for the first time, i know what informations u need. So i hope this informations will help you to help me.
Btw. Greyhole is already moving data from landing zone to shares with 100KB/s.

[gboudreau]

My suggestion is to re-install Amahi, and not use Greyhole on your new install.
I already replied to your question regarding a reinstall in the other thread, where you asked how to re-install without touching the 1TB hard drive you have.
In addition, if you have files in the / or /var/hda/files/ partitions that you don't have anywhere else, you'll need to copy them manually to the 1TB drive (/var/hda/files/drives/drive1/) before you re-install, because you'll probably format those during install.
And remember to leave the 1TB drive disconnected until the re-install is complete, or you risk having it formatted.

Final word of advice:

(The opinion below is my own, as Greyhole's sole developer, and does not necessarily reflect the opinion of Amahi developers. I am not an Amahi developer, just a power user who just happen to have written software that the Amahi developers decided to integrate to their offering.)

If you want something that just works, and doesn't require time to manage, or any tinkering to make it work, I suggest paying for it. It's the easiest way I know of to get good support (most of the time).
I hear Microsoft makes a very good home server software you can buy, and they'll be happy to support you as soon as you hit any issue, via their support hotline (or via the OEM support hotline).

Using open source software, made by individuals on their own free time, never guarantees any level of support. You've been given something for free; it's up to you to decide if you'll use that, and cope with any issue that arise, or pay someone else to get something equivalent that comes with support that you can turn to when needed.
Sometimes, both options are available for open source software (MySQL, Alfresco, ...), but this is not the case for Greyhole.

[blackbird]

So, i have reinstalled Amahi WITH Greyhole 2 times. One reason is that i dont know how to install it without and the other reason is that i dont want do invent something new. Amahi comes with Greyhole, so i want to use it.
My suggestion is that u are not longer interested to help me. Slightly i can understand u because i think that i was not really friendly.
So, sorry if my formulation hits ur proud, but dont start kidding me.

In the past i have also worked on 2 opensource projects (Windows based). So i really know what that means. I was only the designer but i have done what i could to make this projects a success.
These projects died because nobody wants to support the Users and the Documentation was really bad. And if u have not enough users u dont have enough Bug finders and different Hard- and Software configurations. And U know how to use UR programm. So if u want to write a programm and make it official u need to make support and documentation. Else it is only a fun project which dies on ur HDD. And the answer "the solution for ur problem is not using our programm" is not a solution.

I am ready to learn some things about Linux, Greyhole and Amahi. And i ll also spend hours ( i have already done that ) on this programms to understand how they are working and what i should do that they work in the way i like. After this i can help u to support other users. This is the way opensources works!!! But i dont want to invent them new. There are so many commands scattered through the Forum and the Wiki. and the FAQ's are not for problems.

Amahi and Greyhole are very powerfull projects and i already believe in them...
So, back to topic :

As i said ive reinstalled Amahi 2 times. First install doesnt work (Fedora wont start). Is it possible that there are some problems with Ext4?
But anyway, my second install workes bedder than ever!
I have found my second 160GB disc and use them with the onboard raid controller in Raid 0 for Root, Swap and /var/hda/files/. This is also not in the pool. This means the pool is only the 1TB atm.

Everything seems to work fine. Now Greyhole starts moving files after 10sec to shares. But the transfer was REALLY slow. Never over 10MB/s. I mean client to Server AND disc to disc (landing zone to shares)
Then i have tried yum update and 500MB later the transferate ramps up to 35MB/s for much small files and nearly 75MB/s for big files. But only client to server. Disc to disc (landing zone to shares) is damn slow (below 10MB/s). During the Copy process AND also when its finished and greyhole moves the rest of files to shares.

So i have only one question open :
How can i increase the transfer rate from Greyhole. If i manually copy files i move files with 80MB/s.
Or with other words : Which informations do u need to make it easier to help