CLOSED: Greyhole, drives keep going offline frequently

[kikkegek]

he guys,

foe some reason I can find, my drives keep going offline about once a month.

somestimes drive2 sometimes drive3

its very annoying, and and can track down the readon why.

lease help and look at my info below.

[root@localhost jochen]# uname -r; rpm -q samba amahi-greyhole
4.1.6-100.fc21.x86_64
samba-4.1.17-1.fc21.x86_64
amahi-greyhole-0.9.63-0.x86_64
[root@localhost jochen]# yum -y install fpaste;
Loaded plugins: fastestmirror, langpacks
Loading mirror speeds from cached hostfile
* fedora: mirror.datacenter.by
* rpmfusion-free: mirrors.netix.net
* rpmfusion-free-updates: mirrors.netix.net
* rpmfusion-nonfree: mirrors.netix.net
* rpmfusion-nonfree-updates: mirrors.netix.net
* updates: mirror.datacenter.by
Package fpaste-0.3.7.4-1.fc21.noarch already installed and latest version
Nothing to do

[root@localhost jochen]# fpaste /etc/samba/smb.conf
Uploading (4.9KiB)...
http://paste.fedoraproject.org/349215/97527451/ -> http://paste.fedoraproject.org/349215/97527451
[root@localhost jochen]# fpaste /etc/greyhole.conf
Uploading (1.5KiB)...
http://paste.fedoraproject.org/349216/45975277/ -> http://paste.fedoraproject.org/349216/45975277

[root@localhost jochen]# mount
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,size=1009284k,nr_inodes=252321,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/sda5 on / type ext4 (rw,relatime,data=ordered)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=28,pgrp=1,timeout=300,minproto=5,maxproto=5,direct)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
tmpfs on /tmp type tmpfs (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
nfsd on /proc/fs/nfsd type nfsd (rw,relatime)
/dev/sdb1 on /var/hda/files/drives/drive2 type ext4 (rw,relatime,data=ordered)
/dev/sda1 on /boot type ext4 (rw,relatime,data=ordered)
/dev/sdc1 on /var/hda/files/drives/drive1 type ext4 (rw,relatime,data=ordered)
/dev/sdd1 on /var/hda/files/drives/drive3 type ext4 (rw,relatime,data=ordered)
none on /var/spool/greyhole/mem type tmpfs (rw,relatime,size=4096k)
//127.0.0.1/Docs on /mnt/samba/Docs type cifs (rw,relatime,vers=1.0,cache=strict,username=jochen,domain=HOME,uid=1000,forceuid,gid=100,forcegid,addr=127.0.0.1,file_mode=0660,dir_mode=0770,hard,nounix,mapposix,nobrl,mfsymlinks,rsize=61440,wsize=65536,actimeo=1)
//127.0.0.1/Greyhole Trash on /mnt/samba/Greyhole Trash type cifs (rw,relatime,vers=1.0,cache=strict,username=jochen,domain=HOME,uid=1000,forceuid,gid=100,forcegid,addr=127.0.0.1,file_mode=0660,dir_mode=0770,hard,nounix,mapposix,nobrl,mfsymlinks,rsize=61440,wsize=65536,actimeo=1)
//127.0.0.1/Lifeplus on /mnt/samba/Lifeplus type cifs (rw,relatime,vers=1.0,cache=strict,username=jochen,domain=HOME,uid=1000,forceuid,gid=100,forcegid,addr=127.0.0.1,file_mode=0660,dir_mode=0770,hard,nounix,mapposix,nobrl,mfsymlinks,rsize=61440,wsize=65536,actimeo=1)
//127.0.0.1/Movies on /mnt/samba/Movies type cifs (rw,relatime,vers=1.0,cache=strict,username=jochen,domain=HOME,uid=1000,forceuid,gid=100,forcegid,addr=127.0.0.1,file_mode=0660,dir_mode=0770,hard,nounix,mapposix,nobrl,mfsymlinks,rsize=61440,wsize=65536,actimeo=1)
//127.0.0.1/Music on /mnt/samba/Music type cifs (rw,relatime,vers=1.0,cache=strict,username=jochen,domain=HOME,uid=1000,forceuid,gid=100,forcegid,addr=127.0.0.1,file_mode=0660,dir_mode=0770,hard,nounix,mapposix,nobrl,mfsymlinks,rsize=61440,wsize=65536,actimeo=1)
//127.0.0.1/Newsgroups on /mnt/samba/Newsgroups type cifs (rw,relatime,vers=1.0,cache=strict,username=jochen,domain=HOME,uid=1000,forceuid,gid=100,forcegid,addr=127.0.0.1,file_mode=0660,dir_mode=0770,hard,nounix,mapposix,nobrl,mfsymlinks,rsize=61440,wsize=65536,actimeo=1)
//127.0.0.1/Pictures on /mnt/samba/Pictures type cifs (rw,relatime,vers=1.0,cache=strict,username=jochen,domain=HOME,uid=1000,forceuid,gid=100,forcegid,addr=127.0.0.1,file_mode=0660,dir_mode=0770,hard,nounix,mapposix,nobrl,mfsymlinks,rsize=61440,wsize=65536,actimeo=1)
//127.0.0.1/Software on /mnt/samba/Software type cifs (rw,relatime,vers=1.0,cache=strict,username=jochen,domain=HOME,uid=1000,forceuid,gid=100,forcegid,addr=127.0.0.1,file_mode=0660,dir_mode=0770,hard,nounix,mapposix,nobrl,mfsymlinks,rsize=61440,wsize=65536,actimeo=1)
//127.0.0.1/Torrents on /mnt/samba/Torrents type cifs (rw,relatime,vers=1.0,cache=strict,username=jochen,domain=HOME,uid=1000,forceuid,gid=100,forcegid,addr=127.0.0.1,file_mode=0660,dir_mode=0770,hard,nounix,mapposix,nobrl,mfsymlinks,rsize=61440,wsize=65536,actimeo=1)
tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,size=203912k,mode=700,uid=1000,gid=100)

[root@localhost jochen]# fdisk -l

Disk /dev/sda: 37,3 GiB, 40018599936 bytes, 78161328 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x00069118

Device Boot Start End Sectors Size Id Type
/dev/sda1 * 2048 411647 409600 200M 83 Linux
/dev/sda2 411648 4638719 4227072 2G 82 Linux swap / Solaris
/dev/sda3 4638720 8865791 4227072 2G 82 Linux swap / Solaris
/dev/sda4 8865792 78161327 69295536 33G 5 Extended
/dev/sda5 8867840 78159871 69292032 33G 83 Linux

Disk /dev/sdb: 931,5 GiB, 1000204886016 bytes, 1953525168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: dos
Disk identifier: 0x7f04484c

Device Boot Start End Sectors Size Id Type
/dev/sdb1 63 1953525167 1953525105 931,5G 83 Linux

Partition 2 does not start on physical sector boundary.


Disk /dev/sdc: 698,7 GiB, 750156374016 bytes, 1465149168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x9310de50

Device Boot Start End Sectors Size Id Type
/dev/sdc1 2048 1465147391 1465145344 698,7G 83 Linux

Disk /dev/sdd: 1,8 TiB, 2000398934016 bytes, 3907029168 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: dos
Disk identifier: 0x00000000

Device Boot Start End Sectors Size Id Type
/dev/sdd1 63 3907029167 3907029105 1,8T 83 Linux

Partition 2 does not start on physical sector boundary.

[root@localhost jochen]# df -h
Filesystem Size Used Avail Use% Mounted on
devtmpfs 986M 0 986M 0% /dev
tmpfs 996M 0 996M 0% /dev/shm
tmpfs 996M 752K 995M 1% /run
tmpfs 996M 0 996M 0% /sys/fs/cgroup
/dev/sda5 33G 15G 17G 47% /
tmpfs 996M 32K 996M 1% /tmp
/dev/sdb1 917G 768G 103G 89% /var/hda/files/drives/drive2
/dev/sda1 190M 99M 77M 57% /boot
/dev/sdc1 688G 645G 8,5G 99% /var/hda/files/drives/drive1
/dev/sdd1 1,8T 1,3T 418G 76% /var/hda/files/drives/drive3
none 4,0M 0 4,0M 0% /var/spool/greyhole/mem
//127.0.0.1/Docs 3,4T 2,9T 529G 85% /mnt/samba/Docs
//127.0.0.1/Greyhole Trash 3,4T 2,9T 529G 85% /mnt/samba/Greyhole Trash
//127.0.0.1/Lifeplus 3,4T 2,9T 529G 85% /mnt/samba/Lifeplus
//127.0.0.1/Movies 3,4T 2,9T 529G 85% /mnt/samba/Movies
//127.0.0.1/Music 3,4T 2,9T 529G 85% /mnt/samba/Music
//127.0.0.1/Newsgroups 33G 16G 17G 50% /mnt/samba/Newsgroups
//127.0.0.1/Pictures 3,4T 2,9T 529G 85% /mnt/samba/Pictures
//127.0.0.1/Software 3,4T 2,9T 529G 85% /mnt/samba/Software
//127.0.0.1/Torrents 3,4T 2,9T 529G 85% /mnt/samba/Torrents
tmpfs 200M 0 200M 0% /run/user/1000

[root@localhost jochen]# greyhole --stats

Greyhole Statistics
===================

Storage Pool
Total - Used = Free + Trash = Possible
/var/hda/files/drives/drive2/gh: 917G - 768G = 103G + 0G = 103G
/var/hda/files/drives/drive3/gh: Offline
/var/hda/files/drives/drive1/gh: 688G - 644G = 8G + 0G = 8G
==========================================
Total: 1604G - 1412G = 111G + 0G = 111G

[root@localhost jochen]# mysql -u root -phda -e "select * from disk_pool_partitions" hda_production
+----+------------------------------+--------------+---------------------+---------------------+
| id | path | minimum_free | created_at | updated_at |
+----+------------------------------+--------------+---------------------+---------------------+
| 1 | /var/hda/files/drives/drive2 | 10 | 2014-09-03 08:57:27 | 2014-09-03 08:57:27 |
| 2 | /var/hda/files/drives/drive3 | 10 | 2014-09-03 08:57:28 | 2014-09-03 08:57:28 |
| 3 | /var/hda/files/drives/drive1 | 10 | 2014-09-03 18:40:00 | 2014-09-03 18:40:00 |
+----+------------------------------+--------------+---------------------+---------------------+

[root@localhost jochen]# mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" \
> hda_production | grep -v 'concat(' | xargs ls -la
/var/hda/files/drives/drive1/gh:
total 84
drwxrwxr-x 13 jochen users 4096 4 apr 08:43 .
drwxrwxr-x 4 jochen users 4096 11 sep 2011 ..
drwxrwxr-x 18 jochen users 4096 1 feb 20:15 Docs
drwxrwxr-x 3 jochen users 4096 15 aug 2013 Downloads
drwxrwxr-x 11 jochen users 4096 25 feb 03:33 .gh_metastore
drwxrwxrwx 11 jochen users 4096 6 mrt 17:00 .gh_metastore_backup
-rw-rw-rw- 1 jochen users 1309 21 mrt 13:16 .gh_settings.bak
drwxrwxr-x 14 jochen users 4096 4 apr 04:02 Lifeplus
drwxrwxrwx 8 jochen users 4096 26 feb 20:09 Movies
drwxrwxr-x 10 jochen users 4096 3 mrt 04:31 Music
drwxrwxrwx 8 jochen users 4096 20 nov 09:29 Newsgroups
drwxrwxr-x 42 jochen users 4096 28 jan 07:37 Pictures
drwxrwxr-x 122 jochen users 12288 26 jan 20:40 Software
drwxrwxr-x 4 jochen users 24576 4 jan 19:40 Torrents

/var/hda/files/drives/drive2/gh:
total 60
drwxr-xr-x 12 root root 4096 4 apr 08:43 .
drwxrwxr-x 14 jochen users 4096 24 feb 20:40 ..
drwxrwxr-x 18 jochen users 4096 18 feb 04:07 Docs
drwxrwxr-x 10 jochen users 4096 24 feb 20:56 .gh_metastore
drwxrwxrwx 11 root root 4096 25 feb 06:06 .gh_metastore_backup
-rw-rw-rw- 1 root root 1309 21 mrt 13:16 .gh_settings.bak
drwxrwxr-x 14 jochen users 4096 22 mrt 18:56 Lifeplus
drwxrwxr-x 7 jochen users 4096 26 feb 20:09 Movies
drwxrwxr-x 14 jochen users 4096 18 dec 12:46 Music
drwxrwxrwx 6 jochen users 4096 22 okt 04:48 Newsgroups
drwxrwxr-x 42 jochen users 4096 28 jan 03:37 Pictures
drwxrwxr-x 12 jochen users 4096 26 jan 20:40 Software
drwxrwxr-x 14 jochen users 12288 4 apr 09:35 Torrents

/var/hda/files/drives/drive3/gh:
total 64
drwxr-xr-x 11 root root 4096 4 apr 08:43 .
drwxr-xr-x 4 root root 4096 17 apr 2014 ..
drwxrwxr-x 10 jochen users 4096 24 jan 21:09 Docs
drwxrwxrwx 9 root root 4096 1 sep 2014 .gh_metastore
drwxrwxrwx 8 root root 4096 3 sep 2014 .gh_metastore_backup
-rw-rw-rw- 1 root root 1340 16 jan 08:39 .gh_settings.bak
drwxrwxrwx 8 root root 4096 21 dec 19:03 Movies
drwxrwxr-x 3 jochen users 4096 1 okt 2014 Music
drwxrwxrwx 7 jochen users 4096 18 sep 2015 Newsgroups
drwxrwxr-x 39 jochen users 4096 5 jan 07:40 Pictures
drwxrwxr-x 57 jochen users 4096 5 dec 09:33 Software
drwxrwxr-x 18 jochen users 20480 21 jan 04:04 Torrents
[root@localhost jochen]#
[root@localhost jochen]#
[root@localhost jochen]#
[root@localhost jochen]# mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" \
> hda_production | grep -v 'concat(' | xargs ls -la | fpaste
Uploading (2.6KiB)...
http://paste.fedoraproject.org/349223/59756697/ -> http://paste.fedoraproject.org/349223/59756697

[root@localhost jochen]# greyhole --view-queue

Greyhole Work Queue Statistics
==============================

This table gives you the number of pending operations queued for the Greyhole daemon, per share.

Write Delete Rename Check
Docs 0 0 0 0
Lifeplus 0 0 0 0
Movies 0 0 0 0
Music 0 0 0 0
Pictures 0 0 0 0
Software 0 0 0 0
Torrents 0 0 0 0
============================================
Total 0 0 0 0
Write Delete Rename Check

The following is the number of pending operations that the Greyhole daemon still needs to parse.
Until it does, the nature of those operations is unknown.
Spooled operations that have been parsed will be listed above and disappear from the count below.

Spooled 8

[bigfoot65]

Could this be a hardware issue?

Did you customize your HDA for the drives to sleep or spin down after so much time of inactivity?

In future, please attach files vs all the LONG output. makes it easier for us to read when it's short and concise.

Something is causing the issue, but not sure where to begin diagnosing.

This might be something best captured in a bug report.

We can then better help you resolve the issue.

[kikkegek]

hi Bigfoot65,

I filed a bug report:
https://bugs.amahi.org/issues/2023

no I dont have any spindown time set for my drives (not that I know of) and no power features. Not that I know of. Just full-on mode on energy efficient hardware.

[bigfoot65]

Thanks!

I will close this thread and continue dialogue in the bug report.