DskDitto: Ultra-fast, parallel duplicate-file detector
by ingve on 7/22/2026, 6:52:20 AM
https://github.com/jdefrancesco/dskDitto
Comments
by: jdefr89
Wow. Wasn’t expecting to see this here… I am the author…
7/26/2026, 9:33:42 AM
by:
7/26/2026, 9:19:34 AM
by: akoboldfrying
Interested to know what algorithm you use for --fuzzy. Presumably not any of the worst-case-quadratic diff algorithms... MinHash on n-grams?
7/26/2026, 8:39:55 AM
by: jauntywundrkind
imo fclones is the one to beat, <a href="https://github.com/pkolaczk/fclones#benchmarks" rel="nofollow">https://github.com/pkolaczk/fclones#benchmarks</a><p>nice that there are actually some ok interfaces here. with fclones, i tend to generate a file of candidates then do a little review to make super certain everything is square / as expected. it's very built for intermediary files a core pattern, which is very unix, very convenient. but it did take me a little while to settle on this, and it felt like i wasn't being offered a ton of options for management out of box. looks like some real attempts to be more user friendly here.
7/26/2026, 8:30:09 AM