Duplicate files

duff the duplicate file finder can find recursively such files using duff -r <directory> or create a file list (skipping one of the files to be kept) using duff -re <directory> > ../del.txt

After that while read file ; do rm "$file" ; done < ../del.txt will remove the files

A duplicate file finder for Linux file system should understand links. duff has command line options for that.

To improve speed most programs look first for the disk space and even for the first bytes to match and if everything is identical the time consuming checksum is calculated.

Linurs Hosttech startpage