can not remove drive from pool

kcossabo
Posts: 36
Joined: Sat Mar 05, 2011 11:42 am

can not remove drive from pool

Postby kcossabo » Mon Mar 14, 2011 10:28 am

I am getting the following when trying to remove drive from pool;

Code: Select all

[root@cossaboon kcossabo]# greyhole --going /var/hda/files/drives/drive4/gh Please use one of the following with the --going option: /var/hda/files/drives/drive1/gh /var/hda/files/drives/drive2/gh /var/hda/files/drives/drive4/gh /var/hda/files/drives/drive3/gh
I hope this is all the DIAG stuff needed, one command did end in an error

Code: Select all

[root@cossaboon kcossabo]# uname -r; rpm -q samba hda-greyhole 2.6.35.6-45.fc14.i686 samba-3.5.5-68.fc14.1.i686 hda-greyhole-0.9.2-1.i386

Code: Select all

Complete! Uploading (5.3K)... http://fpaste.org/ipae/ Uploading (1.5K)... http://fpaste.org/DDH6/

Code: Select all

[root@cossaboon kcossabo]# mysql -u root -phda -e "select concat(path, '/gh') from disk_pool_partitions" hda_production | grep -v 'concat(' | xargs ls -la | fpaste Uploading (2.4K)... Server Error: 500 - INTERNAL SERVER ERROR 500 often means your paste was too large. You tried uploading 2KiB. A pastebin is NOT a file hosting service! [root@cossaboon kcossabo]#

Code: Select all

[root@cossaboon kcossabo]# greyhole --view-queue Greyhole Work Queue Statistics ============================== This table gives you the number of pending operations queued for the Greyhole daemon, per share. Write Delete Rename Cisco_files 87834 0 0 MacPro_Documents 0 0 0 MacPro_Download 0 0 0 Music_vault 0 0 0 My_Software 0 0 0 Time_Pro 0 0 0 Video_Storage 0 0 0 ================ Total 87834 + 0 + 0 = 87834 The following is the number of pending operations that the Greyhole daemon still needs to parse. Until it does, the nature of those operations is unknown. Spooled operations that have been parsed will be listed above and disappear from the count below. Spooled 0 [root@cossaboon kcossabo]#

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: can not remove drive from pool

Postby gboudreau » Mon Mar 14, 2011 10:36 am

You're missing an = character:

Code: Select all

greyhole --going=/var/hda/files/drives/drive4/gh
- Guillaume Boudreau

kcossabo
Posts: 36
Joined: Sat Mar 05, 2011 11:42 am

Re: can not remove drive from pool

Postby kcossabo » Mon Mar 14, 2011 11:35 am

thank you.

kcossabo
Posts: 36
Joined: Sat Mar 05, 2011 11:42 am

Re: can not remove drive from pool

Postby kcossabo » Mon Mar 14, 2011 4:49 pm

I think I did something bad, when working through an issue :(

Drive4 is going bad, SMART is continuing to increase bad blocks, and is part of the pool.
Landing Zone had 80G to move, and is activity choosing Drive4

Around 2pm I issue the 'going' command, and got the please wait, then

Code: Select all

[root@cossaboon mail]# greyhole --going=/var/hda/files/drives/drive4/gh Storage pool directory /var/hda/files/drives/drive4/gh will be removed from the storage pool. Moving file copies for share 'Cisco_files'... Please be patient... Done. Moving file copies for share 'MacPro_Documents'... Please be patient... rsync: read errors mapping "/var/hda/files/drives/drive4/gh/MacPro_Documents/01-01-11/Devon-Home.dtBase2/Backup.1/DEVONthink-9.dtMeta": Input/output error (5) rsync: read errors mapping "/var/hda/files/drives/drive4/gh/MacPro_Documents/01-01-11/Devon-Home.dtBase2/Backup.1/DEVONthink-9.dtMeta": Input/output error (5) ERROR: DEVONthink-9.dtMeta failed verification -- update discarded. rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] Done. Moving file copies for share 'MacPro_Download'... Please be patient... rsync: read errors mapping "/var/hda/files/drives/drive4/gh/MacPro_Download/10-30-10/before 9-11-2010/complete/Movies/A xxxx Heart (2007)/BSVCD.BIN": Input/output error (5) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] rsync: read errors mapping "/var/hda/files/drives/drive4/gh/MacPro_Download/10-30-10/before 9-11-2010/complete/TV/xx Rock -4x06 - Sun Tea/xx.Rock.x.720p.HDTV.X264-DIMENSION.mkv": Input/output error (5) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] rsync: read errors mapping "/var/hda/files/drives/drive4/gh/MacPro_Download/10-30-10/before 9-11-2010/alt.binaries.mac.applications/readiris 12 mac [~ of 14] Readiris.Pro.v12.0.1.103.MacOSX-RBS.zip. yEnc/Readiris.Pro.v12.0.1.103.MacOSX-RBS/readiris_12_pro.dmg": Input/output error (5) rsync: read errors mapping "/var/hda/files/drives/drive4/gh/MacPro_Download/10-30-10/before 9-11-2010/alt.binaries.mac.applications/readiris 12 mac [~ of 14] Readiris.Pro.v12.0.1.103.MacOSX-RBS.zip. yEnc/Readiris.Pro.v12.0.1.103.MacOSX-RBS/readiris_12_pro.dmg": Input/output error (5) ERROR: readiris_12_pro.dmg failed verification -- update discarded. rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] Done. Moving file copies for share 'My_Software'... Please be patient... Done. Moving file copies for share 'Time_Pro'... Please be patient... rsync: read errors mapping "/var/hda/files/drives/drive4/gh/Time_Pro/sync-doc/Parallels/Windows 7 (experimental).pvm/{xxxx-a399-49f0-b591-xxxx}.mem": Input/output error (5) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7] rsync: read errors mapping "/var/hda/files/drives/drive4/gh/Time_Pro/iTunes/iTunes/iTunes Media/TV Shows/xx of Brothers/Season 1/xxx.Of.Brothers.2001.E07.The.xx.Point.720p.HDDVD.x264-hV.mov": Input/output error (5) rsync: read errors mapping "/var/hda/files/drives/drive4/gh/Time_Pro/iTunes/iTunes/iTunes Media/TV Shows/xxx of Brothers/Season 1/Band.Of.Brothers.2001.E07.The.xx.Point.720p.HDDVD.x264-hV.mov": Input/output error (5) ERROR: xxx.Of.Brothers.2001.E07.The.xxxx.Point.720p.HDDVD.x264-hV.mov failed verification -- update discarded. rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1042) [sender=3.0.7]
Then at 7:30, giving up as files were still being written to Drive4 from landing zone, I went to the config page, and unchecked it from the pool

Code: Select all

cat /var/log/greyhole.log | grep drive4 <snip> Mar 14 19:31:50 7 write: Drives with available space: /var/hda/files/drives/drive4/gh (695GB avail) - /var/hda/files/drives/drive3/gh (687GB avail) - /var/hda/files/drives/drive2/gh (687GB avail) - /var/hda/files/drives/drive5/gh (643GB avail) - /var/hda/files/drives/drive1/gh (424GB avail) Mar 14 19:31:50 7 write: Saving tombstones in /var/hda/files/drives/drive4/gh/.gh_graveyard/Cisco_files/fy09/FileMaker and EEAX/2009/03/Email ID 311459/image007.png Mar 14 19:31:50 7 write: Copying file to /var/hda/files/drives/drive4/gh/Cisco_files/fy09/FileMaker and EEAX/2009/03/Email ID 311459/image007.png Mar 14 19:31:51 7 write: Saving tombstones in /var/hda/files/drives/drive4/gh/.gh_graveyard/Cisco_files/fy09/FileMaker and EEAX/2009/03/Email ID 311459/image007.png Mar 14 19:31:51 7 write: Drives with available space: /var/hda/files/drives/drive4/gh (695GB avail) - /var/hda/files/drives/drive3/gh (687GB avail) - /var/hda/files/drives/drive2/gh (687GB avail) - /var/hda/files/drives/drive5/gh (643GB avail) - /var/hda/files/drives/drive1/gh (424GB avail) Mar 14 19:31:51 7 write: Saving tombstones in /var/hda/files/drives/drive4/gh/.gh_graveyard/Cisco_files/fy09/FileMaker and EEAX/2009/03/Email ID 311460/(311460) eeaxMsgBackup.eml Mar 14 19:31:51 7 write: Copying file to /var/hda/files/drives/drive4/gh/Cisco_files/fy09/FileMaker and EEAX/2009/03/Email ID 311460/(311460) eeaxMsgBackup.eml Mar 14 19:31:51 7 write: Saving tombstones in /var/hda/files/drives/drive4/gh/.gh_graveyard/Cisco_files/fy09/FileMaker and EEAX/2009/03/Email ID 311460/(311460) eeaxMsgBackup.eml Mar 14 19:31:51 7 write: Drives with available space: /var/hda/files/drives/drive4/gh (695GB avail) - /var/hda/files/drives/drive3/gh (687GB avail) - /var/hda/files/drives/drive2/gh (687GB avail) - /var/hda/files/drives/drive5/gh (643GB avail) - /var/hda/files/drives/drive1/gh (424GB avail) Mar 14 19:34:49 7 going: Found /var/hda/files/drives/drive4/gh/Time_Pro/iTunes/iTunes/iTunes Media/TV Shows/xx Trek TOS Remastered/Season 2/A Piece of The Action 1.mp4 Mar 14 19:34:49 7 going: Directory /var/hda/files/drives/drive4/gh is not part of the Greyhole storage pool anymore. The above file will not be counted as a valid file copy, but can be used to create a new valid copy. Mar 14 19:34:49 6 going: Missing file copies. Expected 1, got 0. Will create more copies using /var/hda/files/drives/drive4/gh/Time_Pro/iTunes/iTunes/iTunes Media/TV Shows/xxx Trek TOS Remastered/Season 2/A Piece of The Action 1.mp4
So now I think I am out of sync?

Since it appears that the greyhole going command is using rsync, and no updates to files are being made (all file activities are new files), Can I Issue the Going command on a drive not in the pool, and have it try to recopy the files over?

User avatar
gboudreau
Posts: 606
Joined: Sat Jan 23, 2010 1:15 pm
Location: Montréal, Canada
Contact:

Re: can not remove drive from pool

Postby gboudreau » Mon Mar 14, 2011 5:34 pm

No, you can't do a --going on a drive that is not in the pool.

What you should do is stop the Greyhole service: in the Amahi Dashboard, go in the Advanced > Servers page.
For Greyhole, uncheck the watchdog option, then stop the service.

At this point, issue the --going command.
Note that it might be impossible for GH to move some files if the drive is failing.

Once this is done, uncheck the drive from the Amahi Storage Pool page, and restart the Greyhole service, and re-check the watchdog option.

Not sure why this situation is occurring. This was a problem before v0.8.4 of GH, but it should have been fixed in that version. Since you're running 0.9.2, you should have that fix, and going drives should not be chosen as a target for new file copies... I'll re-open the bug in the GH bug tracker to verify what is wrong.
- Guillaume Boudreau

Who is online

Users browsing this forum: No registered users and 13 guests