dupd - A fast and convenient CLI tool for finding duplicate files

dupd is a file duplicate detection CLI utility.

The build currently supports Linux (tested on Debian), Solaris (tested on OpenIndiana), OpenBSD, FreeBSD and Mac OS X. Other UNIX variants should work with minimal effort.

dupd seeks to be fast and efficient. For most file sets it performs better than other popular tools.
Most recent performance comparison: Duplicate finder performance (2018 edition)

Aside from performance, the other primary advantage of dupd is that it enables a more exploratory style of discovering duplicate files instead of simply dumping out a big list as the other popular duplicate finder tools do (although dupd can also do that, if you really want).


License
GNU GENERAL PUBLIC LICENSE Version 3
Copyright
Jyri J. Virkki
Latest release
1.7.1 (08/25/2021)
Source code
Currently hosted on github: https://github.com/jvirkki/dupd
Bug tracker
Currently using github issues: https://github.com/jvirkki/dupd/issues
More info
See the README, man page, ChangeLog and documentation.
Blogs
http://www.virkki.com/jyri/articles/index.php/category/tech/dupd/

Installing pre-packaged dupd

Mac OS X

MacPorts has dupd available.
port install dupd

FreeBSD

FreeBSD ports has dupd available.
pkg install dupd

NixOS

NixOS has dupd available.
nix-env -i dupd


How to install dupd from source

Released versions

For the most stable version of dupd, build the most recent release. After untaring the sources, refer to the top-level BUILDING file for build instructions.

Version
Checksums
Download URLs
1.7.1
sha256 70aaad030d88acd561f8f58bd5189964bc30f40d7027e6acff5c5b28df32ffc1
http://www.virkki.com/dupd/dupd-1.7.1.tar.gz
https://github.com/jvirkki/dupd/archive/refs/tags/1.7.1.tar.gz
1.7
sha256 547eb62931ca524e9966db0bb84cdc806c6a7fa8cbdcf9ac52b043df88ca222d
http://www.virkki.com/dupd/dupd-1.7.tar.gz
https://github.com/jvirkki/dupd/archive/1.7.tar.gz
1.6
sha256 68bce4d5ac0b8a00ac50da65634950eb46fb11a571e546fb543fc6c6bf6b79da
http://www.virkki.com/dupd/dupd-1.6.tar.gz
https://github.com/jvirkki/dupd/archive/1.6.tar.gz
1.5
sha256 28073847aa6a7b7704e1684e7bda99344715f364976046144e8fe16efec3b2f3
http://www.virkki.com/dupd/dupd-1.5.tar.gz
https://github.com/jvirkki/dupd/archive/1.5.tar.gz
1.4
sha256 be98c8fe60bdcc281898930b2604a1b97570de611fecc02732af4a81329438d3
http://www.virkki.com/dupd/dupd-1.4.tar.gz
https://github.com/jvirkki/dupd/archive/1.4.tar.gz

For older released versions, refer to the archived releases on github.

Latest development snapshot

Check out the source from github and refer to the BUILDING file for more info.

Most of the time the latest sources should be buildable but bear in mind the master branch is a work in progress so it might not always work.

For most use cases, I recommend using the latest released version (see above) unless you really need the very latest changes.



Other links of interest (that I've run across):