Find duplicate files

Shell Programming and Scripting
1

What utility do you recommend for simply finding all duplicate files among all files?

2

Diff. This will find duplicates in current directory:

for i in *; do for j in *; do diff $i $j > /dev/null; if [ $? == "0" ]; then if [ "$i" != "$j" ]; \
then echo "$i,$j are duplicates"; fi fi done; done
3

I use this script to find and remove duplicate files on linux system Script: rmdupe IgnorantGuru's Blog and use Clone Remover from Ashisoft to find duplicate files on windows.

4

i use my own tool : Finddup - Find duplicate files by content

5

Hi.

On many Linux systems, such as:

OS, ker|rel, machine: Linux, 2.6.26-2-amd64, x86_64
Distribution        : Debian GNU/Linux 5.0

there is a provided utility:

fdupes - finds duplicate files in a given set of directories

see man fdupes for details ... cheers, drl