Greyhole constant disk activity, is this normal?

[fitzy89]

Hi all

I setup my Amahi server about 19 days ago, I have been very impressed with it so far.

I have noticed that Greyhole is constantly working with files on the disks for over 2 weeks now. I haven't written any major number of files to the shares since it was first setup, but for over 2 weeks the disk activity is flat out. Greyhole appears to be doing it's job and the queue numbers do change but sort of hover around similar numbers so it's moving things around, but is it normal for it to be hammering the disks for such a long time (around 2 weeks now?). I worry that the lifespan of the drives may decrease if they are being written to all day every day over a long period of time that's all.

Here is the info provided on your guide:

Code: Select all

[root@localhost ~]# uname -r; rpm -q samba hda-greyhole 2.6.35.14-106.fc14.x86_64 samba-3.5.11-79.fc14.x86_64 hda-greyhole-0.9.2-1.x86_64

FPaste didn't seem to work correctly and didn't give me an ID to view the paste so here's smb.conf:

Code: Select all

# This file is automatically generated for WORKGROUP setup. # Any manual changes MAY BE OVERWRITTEN # Amahi configuration, generated on Mon Jul 08 14:46:27 +0100 2013 [global] large readwrite = yes log file = /var/log/samba/%m.log display charset = LOCALE load printers = yes socket options = TCP_NODELAY map to guest = Bad User encrypt passwords = yes time server = yes public = yes veto files = /*.nws/riched20.dll/*.{*}/ printer admin = root, @ntadmin, administrator wins support = yes unix extensions = no netbios name = hda cups options = raw username map script = /usr/share/hda-platform/hda-usermap wide links = yes server string = ta.local printing = cups dos charset = CP850 workgroup = WORKGROUP os level = 60 printcap name = cups security = user unix charset = UTF8 preferred master = yes max log size = 150 log level = 0 [homes] comment = Home Directories valid users = %S browseable = no writable = yes create mask = 0644 directory mask = 0755 [print$] path = /var/lib/samba/drivers read only = yes force group = root write list = @ntadmin root force group = root create mask = 0664 directory mask = 0775 guest ok = yes [printers] path = /var/spool/samba writeable = yes browseable = yes printable = yes public = yes [Pictures] comment = Pictures path = /home/files/pictures writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 guest ok = yes dfree command = /usr/bin/greyhole-dfree vfs objects = greyhole [Movies] comment = Movies path = /home/files/movies writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 guest ok = yes dfree command = /usr/bin/greyhole-dfree vfs objects = greyhole [Music] comment = Music path = /home/files/music writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 guest ok = yes dfree command = /usr/bin/greyhole-dfree vfs objects = greyhole [Docs] comment = Docs path = /var/hda/files/docs writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 [Owncloud] comment = Owncloud path = /home/files/owncloud writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 dfree command = /usr/bin/greyhole-dfree vfs objects = greyhole [Tine] comment = Tine path = /var/hda/files/tine writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 [Series] comment = Series path = /var/hda/files/Series writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 guest ok = yes dfree command = /usr/bin/greyhole-dfree vfs objects = greyhole [Newsgroups] comment = Newsgroups path = /var/hda/files/newsgroups writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 dfree command = /usr/bin/greyhole-dfree vfs objects = greyhole [Downloads] comment = Downloads path = /var/hda/files/Downloads writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 guest ok = yes dfree command = /usr/bin/greyhole-dfree vfs objects = greyhole [Backups] comment = Backups path = /home/files/backups writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 dfree command = /usr/bin/greyhole-dfree vfs objects = greyhole [Transfer] comment = Transfer path = /home/files/transfer writeable = yes browseable = yes create mask = 0775 force create mode = 0664 directory mask = 0775 force directory mode = 0775 dfree command = /usr/bin/greyhole-dfree vfs objects = greyhole

And greyhole.conf:

Code: Select all

# This file is automatically generated by Amahi on Mon Jul 08 14:46:27 +0100 2013 # Any manual changes WILL BE OVERWRITTEN! # Set the defaults (carefully) in /var/hda/platform/html/config/greyhole.yml db_engine = mysql db_host = localhost db_user = greyhole db_pass = greyhole db_name = greyhole balance_modified_files = false email_to = root greyhole_log_file = /var/log/greyhole.log log_level = DEBUG log_memory_usage = false dir_selection_algorithm = most_available_space df_cache_time = 15 delete_moves_to_attic = true # sticky_files and stick_into options are nested - see http://wiki.amahi.org/index.php/Greyhole#Greyhole_advanced_options sticky_files = Music/ # add any group of other settings # here in multiple lines storage_pool_directory = /home/gh, min_free: 10gb storage_pool_directory = /var/hda/files/drives/drive1/gh, min_free: 10gb num_copies[Pictures] = 1 num_copies[Movies] = 1 num_copies[Music] = 1 num_copies[Owncloud] = 1 num_copies[Series] = 1 num_copies[Newsgroups] = 1 num_copies[Downloads] = 1 num_copies[Backups] = 1 num_copies[Transfer] = 1

And the next bunch of commands:

Code: Select all

[root@localhost ~]# mount /dev/mapper/VolGroup-lv_root on / type ext4 (rw) proc on /proc type proc (rw) sysfs on /sys type sysfs (rw) devpts on /dev/pts type devpts (rw,gid=5,mode=620) tmpfs on /dev/shm type tmpfs (rw) /dev/sda1 on /boot type ext4 (rw) /dev/mapper/VolGroup-lv_home on /home type ext4 (rw) /dev/sdb1 on /var/hda/files/drives/drive1 type ext4 (rw) none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw) //127.0.0.1/Backups on /mnt/samba/Backups type cifs (rw) //127.0.0.1/Docs on /mnt/samba/Docs type cifs (rw) //127.0.0.1/Downloads on /mnt/samba/Downloads type cifs (rw) //127.0.0.1/Movies on /mnt/samba/Movies type cifs (rw) //127.0.0.1/Music on /mnt/samba/Music type cifs (rw) //127.0.0.1/newsgroups on /mnt/samba/newsgroups type cifs (rw) //127.0.0.1/Newsgroups on /mnt/samba/Newsgroups type cifs (rw) //127.0.0.1/Owncloud on /mnt/samba/Owncloud type cifs (rw) //127.0.0.1/Pictures on /mnt/samba/Pictures type cifs (rw) //127.0.0.1/Series on /mnt/samba/Series type cifs (rw) //127.0.0.1/Tine on /mnt/samba/Tine type cifs (rw) //127.0.0.1/Transfer on /mnt/samba/Transfer type cifs (rw) [root@localhost ~]# fdisk -l Disk /dev/sda: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders, total 1953525168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x9cc6b9ff Device Boot Start End Blocks Id System /dev/sda1 * 2048 1026047 512000 83 Linux /dev/sda2 1026048 1953523711 976248832 8e Linux LVM Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders, total 1953525168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0xe8900690 Device Boot Start End Blocks Id System /dev/sdb1 63 1953525167 976762552+ 83 Linux Disk /dev/dm-0: 53.7 GB, 53687091200 bytes 255 heads, 63 sectors/track, 6527 cylinders, total 104857600 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x00000000 Disk /dev/dm-0 doesn't contain a valid partition table Disk /dev/dm-1: 2080 MB, 2080374784 bytes 255 heads, 63 sectors/track, 252 cylinders, total 4063232 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x00000000 Disk /dev/dm-1 doesn't contain a valid partition table Disk /dev/dm-2: 943.9 GB, 943886172160 bytes 255 heads, 63 sectors/track, 114754 cylinders, total 1843527680 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x00000000 Disk /dev/dm-2 doesn't contain a valid partition table [root@localhost ~]# df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/VolGroup-lv_root 50G 33G 15G 70% / tmpfs 496M 0 496M 0% /dev/shm /dev/sda1 485M 29M 431M 7% /boot /dev/mapper/VolGroup-lv_home 866G 741G 81G 91% /home /dev/sdb1 917G 791G 80G 91% /var/hda/files/drives/drive1 //127.0.0.1/Backups 1.8T 1.6T 160G 92% /mnt/samba/Backups //127.0.0.1/Docs 50G 36G 15G 72% /mnt/samba/Docs //127.0.0.1/Downloads 1.8T 1.6T 160G 92% /mnt/samba/Downloads //127.0.0.1/Movies 1.8T 1.6T 160G 92% /mnt/samba/Movies //127.0.0.1/Music 1.8T 1.6T 160G 92% /mnt/samba/Music //127.0.0.1/newsgroups 1.8T 1.6T 160G 92% /mnt/samba/newsgroups //127.0.0.1/Newsgroups 1.8T 1.6T 160G 92% /mnt/samba/Newsgroups //127.0.0.1/Owncloud 1.8T 1.6T 160G 92% /mnt/samba/Owncloud //127.0.0.1/Pictures 1.8T 1.6T 160G 92% /mnt/samba/Pictures //127.0.0.1/Series 1.8T 1.6T 160G 92% /mnt/samba/Series //127.0.0.1/Tine 50G 36G 15G 72% /mnt/samba/Tine //127.0.0.1/Transfer 1.8T 1.6T 160G 92% /mnt/samba/Transfer [root@localhost ~]# greyhole --stats Greyhole Statistics =================== Storage Pool Total - Used = Free + Attic = Possible /home/gh: 865G - 741G = 80G + 43G = 123G /var/hda/files/drives/drive1/gh: 917G - 791G = 79G + 38G = 117G ========================================== Total: 1782G - 1532G = 159G + 81G = 240G

List of Storage Pool drives:

Code: Select all

[root@localhost ~]# mysql -u root -phda -e "select * from disk_pool_partitions" hda_production +----+------------------------------+--------------+---------------------+---------------------+ | id | path | minimum_free | created_at | updated_at | +----+------------------------------+--------------+---------------------+---------------------+ | 1 | /home | 10 | 2013-07-02 06:26:56 | 2013-07-02 06:26:56 | | 2 | /var/hda/files/drives/drive1 | 10 | 2013-07-02 16:37:42 | 2013-07-02 16:37:42 | +----+------------------------------+--------------+---------------------+---------------------+

Again FPaste not giving me an ID, here is the output instead:

Code: Select all

[root@localhost ~]# mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" hda_production | grep -v 'concat(' | xargs ls -la /home/gh: total 52 drwxr-xr-x 10 root root 4096 Jul 8 16:09 . drwxr-xr-x. 7 root root 4096 Jul 2 16:47 .. drwxrwxr-x 4 rob users 4096 Jul 7 22:21 Downloads drwxrwxrwx 4 root root 4096 Jul 11 04:09 .gh_attic drwxrwxr-x 7 admin users 4096 Jul 8 16:09 .gh_graveyard drwxrwxrwx 8 root root 4096 Jul 8 16:04 .gh_graveyard_backup -rw-r--r-- 1 root root 0 Jul 8 14:46 .greyhole_uses_this drwxrwxr-x 2 admin users 16384 Jul 3 03:40 Movies drwxrwxr-x 4 rob users 4096 Jul 15 05:28 Newsgroups drwxrwxr-x 52 admin users 4096 Jul 6 15:32 Series drwxrwxr-x 3 rob users 4096 Jul 8 16:09 Transfer /var/hda/files/drives/drive1/gh: total 44 drwxrwxrwx 11 root root 4096 Jul 8 16:04 . drwxrwxrwx 5 root root 4096 Jul 5 16:20 .. drwxrwxr-x 4 rob users 4096 Jul 7 22:22 Downloads drwxrwxrwx 4 root root 4096 Jul 11 04:13 .gh_attic drwxrwxrwx 8 admin users 4096 Jul 8 16:04 .gh_graveyard drwxrwxrwx 7 root root 4096 Jul 8 16:09 .gh_graveyard_backup -rwxrwxrwx 1 root root 0 Jul 8 14:46 .greyhole_uses_this drwxrwxrwx 2 admin users 4096 Jul 3 03:40 Movies drwxrwxrwx 11 admin users 4096 Jul 7 22:05 Music drwxrwxr-x 4 rob users 4096 Jul 11 04:03 Newsgroups drwxrwxrwx 64 admin users 4096 Jul 3 18:54 Series drwxrwxr-x 3 rob users 4096 Jul 8 16:04 Transfer

Greyhole queue:

Code: Select all

[root@localhost ~]# greyhole --view-queue Greyhole Work Queue Statistics ============================== This table gives you the number of pending operations queued for the Greyhole daemon, per share. Write Delete Rename Backups 0 0 0 Downloads 0 0 0 Movies 0 0 0 Music 0 0 0 Newsgroups 0 0 0 Owncloud 0 0 0 Pictures 0 0 0 Series 39 22 0 Transfer 0 0 0 ========== Total 39 + 22 + 0 = 61 The following is the number of pending operations that the Greyhole daemon still needs to parse. Until it does, the nature of those operations is unknown. Spooled operations that have been parsed will be listed above and disappear from the count below. Spooled 5

Hopefully that's all you need

[sgtfoo]

Does your owncloud have a lot of activity?

Are the backup or transfer shares getting a lot of data from clients? ... lots of activity?

I ran into similar system resource-eating scenarios with the F14 install with greyhole.
If there's an endless supply of changes to be made, and especially with small files, then greyhole and samba work frantically to apply the changes.

Every time something changes in a greyhole pooled share, something more needs to be done for indexing. If you have those heavy-access folders outside the pool, you're prone to much less thrashing.

It seems that you have 1 drive in the pool; please ensure none of your shares are asking for more than a single copy to be kept.

[bigfoot65]

Also we would appreciate if you attached a text file rather than posting hundred's of lines of text. Makes it hard to read in my opinion.

Thanks