Page 1 of 1

Scanning Lots of Small Files is Inefficient

Posted: Tue Jan 26, 2016 6:35 pm
by therube
Scanning Lots of Small Files is Inefficient.
Inefficiency is is during the comparison mode.

File Sizes set to: 0:min 10 KB:max
80,000 files
272 MB

I cancelled this scan, I believe it was around 60% complete.

Additionally, seem there was more disk related activity then expected.

Code: Select all

Scanning: Regular Mode
- Same Content (SHA-1)
- Same File Name
- Ignore extensions when comparing file names

Included: *.*
Excluded: X\*.ARJ
C:\out\ - Included

01/26/2016 01:23:36 PM
Scan Complete
Total Time Taken: 00:09:37
9729/84523 Files Scanned (270 MB)
634 Groups of duplicates
48800 Files have duplicates(162 MB)
Hashes calculated: 49375
Quick Hashes calculated: 0

Re: Scanning Lots of Small Files is Inefficient

Posted: Tue Jan 26, 2016 6:51 pm
by DigitalVolcano
Which version is this ?

Re: Scanning Lots of Small Files is Inefficient

Posted: Tue Jan 26, 2016 8:02 pm
by therube
3.2.7.

(I'd like to try 4, there are a number of different features that 4 has, that I would be interested in trying, but in my current situation, what I'm dealing with happens to be on XP, & 4 won't run there.)