CLOSED: First time file transfer into storage pool

[tomtheappraiser]

I currently have about 5.5 TB of space in my newly created storage pool. This is from 3- 2 TB drives.
I have about 3 tb of data to move into it from external hard drives.
My LZ is on my / drive which is only 42 GB.
As I understand it, Greyhole will only move the data from the LZ to the storage pool at midnight.
It would take me weeks to transfer that data at 42 GB a day.
Is there a way I can unmount one of my 2 TB drives from the pool and then move the LZ to that drive? Then, when I have migrated all of my data, move it back into the storage pool?

[bigfoot65]

I would not complicate things. You can force Greyhole to move files as root user:

Code: Select all

greyhole -f

I recommend you do some reading in the wiki about Greyhole. It outlines many of the commands you may want to use in the future.

[tomtheappraiser]

I entered that and it said
fsck of all shares has been scheduled. It will start after all currently pending tasks have been completed.
then:
Total (in red) and then 4 0's.

So then I entered this
tail -f /var/log/greyhole.log

and it repeats:
Feb 06 19:05:19 DEBUG sleep: Nothing to do... Sleeping.

[bigfoot65]

Ok. That tells me you have not set the shares to be used in the storage pool. You also need to specify number of copies if you want extras on other drives.

Refer to Configure Greyhole in the Amahi wiki.

[tomtheappraiser]

I was pretty sure I had them in the pool and was taking a screen shot to post here to make sure. I guess the Greyhole monitor was still running on one of my other screens because when I went to save that screen shot to my photos share all kinds of stuff started happening on my SSH screen. So heres the attached pics of what my shares and pool look like and here is the code that popped up when I saved it to the pictures share:

Feb 06 20:36:44 DEBUG sleep: Nothing to do... Sleeping.
Feb 06 20:36:54 DEBUG read_smb_spool: Processing Samba spool...
Feb 06 20:36:54 DEBUG read_smb_spool: File pointer to Pooled.jpg was closed without being written to. Ignoring.
Feb 06 20:36:54 DEBUG read_smb_spool: Found 4 new tasks in spool.
Feb 06 20:36:54 INFO unlink: Now working on task ID 45: unlink Pictures/Pooled.jpg
Feb 06 20:36:54 INFO unlink: File deleted: /var/hda/files/pictures/Pooled.jpg
Feb 06 20:36:54 DEBUG unlink: File still exists in landing zone; a new file replaced the one deleted here. Skipping.
Feb 06 20:36:54 INFO write: Now working on task ID 46: write Pictures/Pooled.jpg
Feb 06 20:36:54 INFO write: File created: Pictures/Pooled.jpg - 47.0KB
Feb 06 20:36:54 DEBUG write: Loading metafiles for Pictures/Pooled.jpg ...
Feb 06 20:36:54 DEBUG write: Got 0 metadata files.
Feb 06 20:36:54 DEBUG write: 0 metafiles loaded.
Feb 06 20:36:54 DEBUG write: File /var/hda/files/pictures/Pooled.jpg is locked by another process. Will wait until it's unlocked to work on any file in this share.
Feb 06 20:36:54 INFO write: Now working on task ID 47: write Pictures/Pooled.jpg
Feb 06 20:36:54 INFO write: Share is locked because another file operation is waiting for a file handle to be released. Skipping.
Feb 06 20:36:54 DEBUG sleep: Nothing to do... Sleeping.
Feb 06 20:37:04 DEBUG read_smb_spool: Processing Samba spool...
Feb 06 20:37:04 INFO write: Now working on task ID 46: write Pictures/Pooled.jpg
Feb 06 20:37:04 INFO write: File created: Pictures/Pooled.jpg - 47.0KB
Feb 06 20:37:04 DEBUG write: Loading metafiles for Pictures/Pooled.jpg ...
Feb 06 20:37:04 DEBUG write: Got 0 metadata files.
Feb 06 20:37:04 DEBUG write: 0 metafiles loaded.
Feb 06 20:37:04 DEBUG write: Drives with available space: /var/hda/files/drives/drive2/gh (1.69TB avail) - /var/hda/files/drives/drive4/gh (1.69TB avail) - /var/hda/files/drives/drive3/gh (1.69TB avail)
Feb 06 20:37:04 DEBUG write: Saving 2 metadata files for Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Saving metadata in /var/hda/files/drives/drive2/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Saving metadata in /var/hda/files/drives/drive4/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Copying 47.0KB file to /var/hda/files/drives/drive4/gh/Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Creating symlink in share pointing to the above file copy.
Feb 06 20:37:04 DEBUG write: Saving 2 metadata files for Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Saving metadata in /var/hda/files/drives/drive2/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Saving metadata in /var/hda/files/drives/drive4/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Copying 47.0KB file to /var/hda/files/drives/drive2/gh/Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Saving 2 metadata files for Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Saving metadata in /var/hda/files/drives/drive2/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:04 DEBUG write: Saving metadata in /var/hda/files/drives/drive4/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:05 INFO write: Now working on task ID 47: write Pictures/Pooled.jpg
Feb 06 20:37:05 INFO write: File changed: Pictures/Pooled.jpg - 47.0KB
Feb 06 20:37:05 DEBUG write: Will use source file: /var/hda/files/drives/drive4/gh/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Loading metafiles for Pictures/Pooled.jpg ...
Feb 06 20:37:05 DEBUG write: Got 2 metadata files.
Feb 06 20:37:05 DEBUG write: Will remove copy at /var/hda/files/drives/drive2/gh/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Moved copy from /var/hda/files/drives/drive2/gh/Pictures/Pooled.jpg to trash: /var/hda/files/drives/drive2/gh/.gh_trash/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Drives with available space: /var/hda/files/drives/drive2/gh (1.69TB avail) - /var/hda/files/drives/drive4/gh (1.69TB avail) - /var/hda/files/drives/drive3/gh (1.69TB avail)
Feb 06 20:37:05 DEBUG write: Saving 2 metadata files for Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Saving metadata in /var/hda/files/drives/drive2/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Saving metadata in /var/hda/files/drives/drive4/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Copying 47.0KB file to /var/hda/files/drives/drive4/gh/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: (using rename)
Feb 06 20:37:05 DEBUG write: Creating symlink in share pointing to the above file copy.
Feb 06 20:37:05 DEBUG write: Saving 2 metadata files for Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Saving metadata in /var/hda/files/drives/drive2/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Saving metadata in /var/hda/files/drives/drive4/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Copying 47.0KB file to /var/hda/files/drives/drive2/gh/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Saving 2 metadata files for Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Saving metadata in /var/hda/files/drives/drive2/gh/.gh_metastore/Pictures/Pooled.jpg
Feb 06 20:37:05 DEBUG write: Saving metadata in /var/hda/files/drives/drive4/gh/.gh_metastore/Pictures/Pooled.jpg

[bigfoot65]

Yep it's working as designed. Watch the log and when it goes back to sleeping, it will be ready for more files.

Sometimes you have to give a few

[tomtheappraiser]

Well it looks like there is still a problem. When I hda-diskmounted the drives, it made sda5 disk 1. I have no idea why. So that is where all of my shares are, even though (if you look at the pic above) I don't have that drive included in the share pool. The drives in my pool are sdb, sdc, and sdd partitioned as drive 2,3, & 4 respectively.
So, my question is, how do I move my all of my shares to the pool, because drive 1 partition is only 7 gigs, which is the maximum it can be.