Page 1 of 1

Very slow hash calculation on one large HDD

Posted: Sun Aug 03, 2025 4:03 am
by lbeck02
I've been using Duplicate Cleaner Pro for more than a year and am very positively impressed.

A couple of days ago I decided to consolidate my files. I have more than a dozen TB capacity, each drive partially filled. I know that the process will be slow. It progressed smoothly until this evening and the software has gotten bogged down - so slow that the hash calculation on one 5TB HDD will take days, maybe weeks. I believe that something is wrong with my settings or procedure. The other HDD/SSDs completed the tasks much faster.

As you can see from the attached image the software has run for more than a day already and I hope not to start over. My questions are:

1.) Is there some way to accelerate the process for the one 5TB HDD?
2.) If I truncate the process by hitting "Delete" will I get valid reports from the other 8-9 drives?

If I need to resort to 2. above I can run DCP on the 5TB drive separately. I'm fairly proficient with Excel and I believe that I can use the data to accomplish my goals.

Your expert advice is appreciated. I'm happy to provide additional information.
Image

Re: Very slow hash calculation on one large HDD

Posted: Sun Aug 03, 2025 10:38 pm
by lbeck02
ADDITIONAL INFORMATION FROM LEE BECK

Further thinking on this. What happens if I simply hit "X Cancel"? I think that I did this a few months back and DCP produced information on the selected drives without addressing the drive that froze the program (or reported incorrect information on the errant drive?). Will all the drives EXCEPT "A" show duplicates found?
I'm tempted to cancel but really don't want to start over, which now shows "Total time taken 1:21:48:52" (One day, 21 hours and about 110.xxx/477,527).

Thanks again,

Lee

Re: Very slow hash calculation on one large HDD

Posted: Mon Aug 04, 2025 12:37 pm
by DigitalVolcano
It's possible that there are a sequence of very large, duplicated files on that drive. So it is having to hash them all and this is causing the slowdown.

It you do cancel in hash mode it won't display partial results. It will cache all calculated hashes though so the work won't be wasted. You can then re-scan with fewer /narrowed down inputs.

Re: Very slow hash calculation on one large HDD

Posted: Tue Aug 05, 2025 3:50 am
by lbeck02
Thank you very much for your expertise. I'll try as you suggest and re-scan with fewer /narrowed down inputs.

3 days into tis project and I'm glad that all is not lost.

Lee