Partial MD5 Before Full MD5

The best solution for finding and removing duplicate files.
Post Reply
User avatar
pyro226

Partial MD5 Before Full MD5

Post by pyro226 »

I have used Duplicate Cleaner a lot in the past. About a month ago, I switched to linux and found a different duplicate file finder. The new program seems to find files faster than Duplicate Cleaner. I read in it's documentation that it does an MD5 based on the first 4Kb. If the MD5 from the first 4Kb match, it calculates a md5 from the entire file. Does Duplicate Cleaner take a similar approach to reduce scanning time?
User avatar
DV

Post by DV »

Yes it does this. It also will abort the check at the first byte difference when in byte-by-byte mode.
Post Reply