Deduplication Support

teixemf
Posts: 4
Joined: Fri Dec 11, 2009 4:43 pm

Deduplication Support

Postby teixemf » Fri Dec 11, 2009 4:47 pm

Couldn't you guys work on some solution to make Deduplication Support simple? Something like the way Windows Home Server do it.

User avatar
cpg
Administrator
Posts: 2618
Joined: Wed Dec 03, 2008 7:40 am
Contact:

Re: Deduplication Support

Postby cpg » Sat Dec 12, 2009 2:38 pm

We do not have a large development team.

Are you aware of any linux solution for deduplication that we can leverage?
(personally i never used deduplication)
My HDA: Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz on MSI board, 8GB RAM, 1TBx2+3TBx1

User avatar
moredruid
Expert
Posts: 791
Joined: Tue Jan 20, 2009 1:33 am
Location: Netherlands
Contact:

Re: Deduplication Support

Postby moredruid » Sun Dec 13, 2009 11:22 am

I've personally used fslint
It's a gui tool and has some nice features.
It takes a very _very_ long time on a big disk, but that's because it checks for filenames and then does an sha & md5sum on the files to eliminate an accidental removal of files with the same name but just 1 bit difference.
echo '16i[q]sa[ln0=aln100%Pln100/snlbx]sbA0D2173656C7572206968616D41snlbxq' | dc
Galileo - HP Proliant ML110 G6 quad core Xeon 2.4GHz, 4GB RAM, 2x750GB RAID1 + 2x1TB RAID1 HDD

Who is online

Users browsing this forum: No registered users and 71 guests