Very slow hash calculation on one large HDD

The best solution for finding and removing duplicate files.
lbeck02
Posts: 3
Joined: Sun Aug 03, 2025 2:46 am

Very slow hash calculation on one large HDD

Post by lbeck02 »

I've been using Duplicate Cleaner Pro for more than a year and am very positively impressed.

A couple of days ago I decided to consolidate my files. I have more than a dozen TB capacity, each drive partially filled. I know that the process will be slow. It progressed smoothly until this evening and the software has gotten bogged down - so slow that the hash calculation on one 5TB HDD will take days, maybe weeks. I believe that something is wrong with my settings or procedure. The other HDD/SSDs completed the tasks much faster.

As you can see from the attached image the software has run for more than a day already and I hope not to start over. My questions are:

1.) Is there some way to accelerate the process for the one 5TB HDD?
2.) If I truncate the process by hitting "Delete" will I get valid reports from the other 8-9 drives?

If I need to resort to 2. above I can run DCP on the 5TB drive separately. I'm fairly proficient with Excel and I believe that I can use the data to accomplish my goals.

Your expert advice is appreciated. I'm happy to provide additional information.
Image
Attachments
DCP Screenshot.jpg
lbeck02
Posts: 3
Joined: Sun Aug 03, 2025 2:46 am

Re: Very slow hash calculation on one large HDD

Post by lbeck02 »

ADDITIONAL INFORMATION FROM LEE BECK

Further thinking on this. What happens if I simply hit "X Cancel"? I think that I did this a few months back and DCP produced information on the selected drives without addressing the drive that froze the program (or reported incorrect information on the errant drive?). Will all the drives EXCEPT "A" show duplicates found?
I'm tempted to cancel but really don't want to start over, which now shows "Total time taken 1:21:48:52" (One day, 21 hours and about 110.xxx/477,527).

Thanks again,

Lee
User avatar
DigitalVolcano
Site Admin
Posts: 1883
Joined: Thu Jun 09, 2011 10:04 am

Re: Very slow hash calculation on one large HDD

Post by DigitalVolcano »

It's possible that there are a sequence of very large, duplicated files on that drive. So it is having to hash them all and this is causing the slowdown.

It you do cancel in hash mode it won't display partial results. It will cache all calculated hashes though so the work won't be wasted. You can then re-scan with fewer /narrowed down inputs.
lbeck02
Posts: 3
Joined: Sun Aug 03, 2025 2:46 am

Re: Very slow hash calculation on one large HDD

Post by lbeck02 »

Thank you very much for your expertise. I'll try as you suggest and re-scan with fewer /narrowed down inputs.

3 days into tis project and I'm glad that all is not lost.

Lee
Attachments
3 days into DCP project.jpg
Post Reply