suggestions for dealing with duplicate files

[chrisNova777]

hey there guys
so i have a crazy amount of files.. lots of doubles.. i need some way of removing the duplicates..

any trusted solution suggestions?

[robespierre]

Roxio Toast has a Compare Folders command that can tell you whether the files rooted in two different folders are identical, or whether they differ or are missing on one or the other side. You can use it on anything, not just CDs.

There are command line tools in OSX that will work for finding duplicates if appropriately used. It's kind of a pain to make them handle resource forks but can be done.

[joevt]

I used File Buddy in the past.
 https://www.skytag.com/file_buddy/
What OS are you doing this in?

[ssp3]

Never had to use anything like that on OS7-OS9, but, while on OSX, I've used Araxis Find Duplicate Files and for folder content comparisions - Araxis Merge. For large image or archive file comparisions - Hex Fiend (2.1.2) All Intel, although early Araxis versons were PPC too. There's also an app called Dupe Guru, but it somehow didn't convinced me.
Araxis FDF calculates each file's hash on the fly, but, unfortunately, all files that contain resource forks only (many OS7-9 apps) are recognized as 0B in size and all will have the same hash.