Page 1 of 1

Partial MD5 Before Full MD5

Posted: Sun May 15, 2011 8:22 pm
by pyro226
I have used Duplicate Cleaner a lot in the past. About a month ago, I switched to linux and found a different duplicate file finder. The new program seems to find files faster than Duplicate Cleaner. I read in it's documentation that it does an MD5 based on the first 4Kb. If the MD5 from the first 4Kb match, it calculates a md5 from the entire file. Does Duplicate Cleaner take a similar approach to reduce scanning time?

Posted: Sun May 15, 2011 9:12 pm
by DV
Yes it does this. It also will abort the check at the first byte difference when in byte-by-byte mode.