Greyhole creates an issue with CrashPlan?

achmetinternet
Posts: 71
Joined: Tue Sep 20, 2011 8:02 am

Greyhole creates an issue with CrashPlan?

Postby achmetinternet » Wed Jun 12, 2013 5:06 am

I have recently (and accidentally) downgraded my greyhole version. After re-installing the newest version it seems as if CrashPlan has made no backup of my data and now it needs to run more than 30 days to make a backup of approx. 2.4TB.

User avatar
bigfoot65
Project Manager
Posts: 11924
Joined: Mon May 25, 2009 4:31 pm

Re: Greyhole creates an issue with CrashPlan?

Postby bigfoot65 » Wed Jun 12, 2013 5:13 am

Is there a question here?
ßîgƒσστ65
Applications Manager

My HDA: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz on MSI board, 16GB RAM, 1TBx1+2TBx2+4TBx2

achmetinternet
Posts: 71
Joined: Tue Sep 20, 2011 8:02 am

Re: Greyhole creates an issue with CrashPlan?

Postby achmetinternet » Wed Jun 12, 2013 5:29 am

Is there a question here?
The title of the thread was an attempt at one ;) I would have liked to know if there is something that the described process could have changed and lead CrashPlan to believe I had no backups in existence. For me it was the first time I encountered this. In parallel I have also asked their support to respond.

User avatar
sgtfoo
Posts: 419
Joined: Sun Jul 18, 2010 8:27 pm

Re: Greyhole creates an issue with CrashPlan?

Postby sgtfoo » Wed Jun 12, 2013 8:08 am

In my experience, If you're going to use CrashPlan on your HDA, it's best done without affecting any greyhole-affecting directories.

Crashplan monitors changes to filesystems and greyhole makes changes that are something drastic.

The best approach for using Crashplan with Amahi, is to avoid using greyhole because the changes an additional files end up signaling Crashplan to make drastic reads/writes and the system starts nearly thrashing the folders you're backing up.

Having Crashplan only pull a designated backup partition might be a better idea if you really need greyhole active.

eg:

/var/hda/files/crashplan <-- with no duplication and not part of greyhole

and rsync to a LZ such as
/var/hda/files
which would in turn, offload to the greyhole pool.

... thus allowing a backup solution and greyhole pooling, with or without greyhole duplication.

When setting up crashplan on the HDA, do keep in mind that Crashplan itself allows other machines to backup to your HDA, so you will need sufficient drive space in this supposed /var/hda/files/crashplan partition to accommodate other machine backups too.
SgtFoo
HDA: VM inside oVirt FX-8300 95w (2 cores for HDA), 32GB RAM (2GB for HDA)
My PC: FX-8300, 16GB RAM, 3x 1TB HDDs, Radeon HD6970 2GB video; Win10 Pro x64
Other: PC, Asus 1215n (LXLE), Debian openZFS server (3x(2x2tb) mirrors)
Modem&Network: Thomson DCM475; Asus RT-AC66U; HP 1800-24G switch

achmetinternet
Posts: 71
Joined: Tue Sep 20, 2011 8:02 am

Re: Greyhole creates an issue with CrashPlan?

Postby achmetinternet » Wed Jun 12, 2013 8:23 am

But what if I locally mount the shares on my HDA and then have CrashPlan access them?

User avatar
sgtfoo
Posts: 419
Joined: Sun Jul 18, 2010 8:27 pm

Re: Greyhole creates an issue with CrashPlan?

Postby sgtfoo » Wed Jun 12, 2013 8:31 am

But what if I locally mount the shares on my HDA and then have CrashPlan access them?
That's where I learned of the issue described...

I wanted my HDA to be backed up and also backup my other PCs, and was overflowing data into a partition, because Crashplan also uses up cache. When Greyhole looks at the Samba file system changes (which will rise quickly with all the Crashplan caching) there are so many that my Greyhole would just crash.

Mind you this was on my Fedora 14 HDA and there could be other factors in this, but all the numerous file system changes are the problem.

I ended up opting for running a separate virtual server with Crashplan on it so that it's isolated and can hold backups and upload backups to cloud without other things in the way.
SgtFoo
HDA: VM inside oVirt FX-8300 95w (2 cores for HDA), 32GB RAM (2GB for HDA)
My PC: FX-8300, 16GB RAM, 3x 1TB HDDs, Radeon HD6970 2GB video; Win10 Pro x64
Other: PC, Asus 1215n (LXLE), Debian openZFS server (3x(2x2tb) mirrors)
Modem&Network: Thomson DCM475; Asus RT-AC66U; HP 1800-24G switch

achmetinternet
Posts: 71
Joined: Tue Sep 20, 2011 8:02 am

Re: Greyhole creates an issue with CrashPlan?

Postby achmetinternet » Wed Jun 12, 2013 8:46 am

But what if I locally mount the shares on my HDA and then have CrashPlan access them?
That's where I learned of the issue described...

I wanted my HDA to be backed up and also backup my other PCs, and was overflowing data into a partition, because Crashplan also uses up cache. When Greyhole looks at the Samba file system changes (which will rise quickly with all the Crashplan caching) there are so many that my Greyhole would just crash.

Mind you this was on my Fedora 14 HDA and there could be other factors in this, but all the numerous file system changes are the problem.

I ended up opting for running a separate virtual server with Crashplan on it so that it's isolated and can hold backups and upload backups to cloud without other things in the way.
But I am not using the CrashPlan folder on a pooled drive and am not backing up any other PCs to my HDA. So the only changes are the local Samba mounts. Am I missing something? Is CrashPlan writing into the /mnt/samba/letscallitmedia folder? I thought this would only be mirroring what greyhole writes into the .gh folder on the pooled drives?

User avatar
sgtfoo
Posts: 419
Joined: Sun Jul 18, 2010 8:27 pm

Re: Greyhole creates an issue with CrashPlan?

Postby sgtfoo » Wed Jun 12, 2013 9:08 am

When greyhole monitors samba activity, ANY related folders are tracked, which includes locally mounted partitions. It generates a lot of reads and writes.

If your Crashplan folder is within the mounted shares, it SHOULD be fine, but I had some messy activity when I did this because I also wanted the entire shares to be backed up. You may be fine, but I suggest keeping an eye on the size of the crashplan folders and caches.
SgtFoo
HDA: VM inside oVirt FX-8300 95w (2 cores for HDA), 32GB RAM (2GB for HDA)
My PC: FX-8300, 16GB RAM, 3x 1TB HDDs, Radeon HD6970 2GB video; Win10 Pro x64
Other: PC, Asus 1215n (LXLE), Debian openZFS server (3x(2x2tb) mirrors)
Modem&Network: Thomson DCM475; Asus RT-AC66U; HP 1800-24G switch

achmetinternet
Posts: 71
Joined: Tue Sep 20, 2011 8:02 am

Re: Greyhole creates an issue with CrashPlan?

Postby achmetinternet » Wed Jun 12, 2013 11:29 pm

When greyhole monitors samba activity, ANY related folders are tracked, which includes locally mounted partitions. It generates a lot of reads and writes.

If your Crashplan folder is within the mounted shares, it SHOULD be fine, but I had some messy activity when I did this because I also wanted the entire shares to be backed up. You may be fine, but I suggest keeping an eye on the size of the crashplan folders and caches.
But what I am saying is that I DON'T have the CrashPlan folder in the greyhole pool and that it is not locally mounted under /mnt/samba. So that should be fine, doesn't it?

User avatar
sgtfoo
Posts: 419
Joined: Sun Jul 18, 2010 8:27 pm

Re: Greyhole creates an issue with CrashPlan?

Postby sgtfoo » Thu Jun 13, 2013 6:52 am

where is your crashplan folder mounted?
SgtFoo
HDA: VM inside oVirt FX-8300 95w (2 cores for HDA), 32GB RAM (2GB for HDA)
My PC: FX-8300, 16GB RAM, 3x 1TB HDDs, Radeon HD6970 2GB video; Win10 Pro x64
Other: PC, Asus 1215n (LXLE), Debian openZFS server (3x(2x2tb) mirrors)
Modem&Network: Thomson DCM475; Asus RT-AC66U; HP 1800-24G switch

Who is online

Users browsing this forum: No registered users and 9 guests