Clean up duplicate files

[andrebaros]

These may be the first of many questions...

I finally set up my Amahi Home Server and it was super easy... now to use it.

1. I'm using it to consolidate files from 4 old machines into one place, especially photos and music. What I'm ending up with is a LOT of duplicates because I ripped the same CD to multiple machines or downloaded photos to more than one place... over the years it's added up and was a big reason for me to set up the server. What is a good duplicate file cleanup app I can run on Fedora?

Thanks
Andre

[moredruid]

I personally use fslint
you can install it with:
yum install fslint

great tool, is quite resource intensive since it checks duplicates on the basis of filenames and content (by sha and md5 summing)

[cpg]

NICE TOOL!!

i did not know about this disk deduplication tool!

i am on the road on a slow connection, and i was hoping the command line tool would be included, alas, it does not seem to be included, even if yum info advertises it.

i will be putting it through it's paces just as soon as i can!

thanks for sharing!

[hfxrzw]

Team, sounds like a very usefull app for the HDA. How would one go about getting it installed/useable on the server? Thanks, Rene.

[abateman]

It's not the best program in the world, but if you're after a command-line one you can try fdupes: http://en.wikipedia.org/wiki/Fdupes

I had a similar situation (combining a couple/few different hard drives) and it did a good job of picking up al the duplicates.