Scanning Lots of Small Files is Inefficient

The best solution for finding and removing duplicate files.
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Scanning Lots of Small Files is Inefficient

Post by therube »

Scanning Lots of Small Files is Inefficient.
Inefficiency is is during the comparison mode.

File Sizes set to: 0:min 10 KB:max
80,000 files
272 MB

I cancelled this scan, I believe it was around 60% complete.

Additionally, seem there was more disk related activity then expected.

Code: Select all

Scanning: Regular Mode
- Same Content (SHA-1)
- Same File Name
- Ignore extensions when comparing file names

Included: *.*
Excluded: X\*.ARJ
C:\out\ - Included

01/26/2016 01:23:36 PM
Scan Complete
Total Time Taken: 00:09:37
9729/84523 Files Scanned (270 MB)
634 Groups of duplicates
48800 Files have duplicates(162 MB)
Hashes calculated: 49375
Quick Hashes calculated: 0
User avatar
DigitalVolcano
Site Admin
Posts: 1864
Joined: Thu Jun 09, 2011 10:04 am

Re: Scanning Lots of Small Files is Inefficient

Post by DigitalVolcano »

Which version is this ?
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: Scanning Lots of Small Files is Inefficient

Post by therube »

3.2.7.

(I'd like to try 4, there are a number of different features that 4 has, that I would be interested in trying, but in my current situation, what I'm dealing with happens to be on XP, & 4 won't run there.)
Post Reply