NAS Scan Speed Extremely Slow

The best solution for finding and removing duplicate files.
User avatar
therube
Posts: 615
Joined: Tue Jun 28, 2011 4:38 pm

NAS Scan Speed Extremely Slow

Post by therube »

NAS Scan Speed Extremely Slow

Other then "visual" observation, two NetworkTrafficView (html) reports *attached.
(*attached ? at least I think I did, but I'm not seeing them ? let me know if they did not make it here.)

LinkStation Pro LS-XHLE6A (NAS)
Wired via LAN (not USB). 10/100/1000.

Code: Select all

02/06/2015 03:55:57 PM
Scanning: Regular Mode
- Same Created Date
- Same File Name
- Ignore extensions when comparing file names

Included: *.*
Excluded: 
C:\RECYCLER\ - Excluded
C:\My Documents\ - Excluded
M:\ - Excluded
\\NAS\USR\STEVEN\ - Included
User avatar
therube
Posts: 615
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

(Bump. Did my attachments actually make it up to you?)
User avatar
DigitalVolcano
Site Admin
Posts: 1729
Joined: Thu Jun 09, 2011 10:04 am

Re: NAS Scan Speed Extremely Slow

Post by DigitalVolcano »

Don't think the attachments appeared.

Is it slow in the 'building file list' stage, or the duplicate finding stage? I've found file discovery on NAS to be quite slow - looking into this.
User avatar
therube
Posts: 615
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

> Don't think the attachments appeared.

I try sending them up, but depending ..., might not be able to get to them till Monday or so.

> slow in the 'building file list' stage

Yes, pretty sure that was the case.
User avatar
therube
Posts: 615
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

(Well, this took me longer then expected...
And it still looks like its not working?
These are .html files (reports).
Upload attachment, Browse to the wanted file, it shows the file name, Add the file,... yet nothing seems to actually make it up here?)

Ah, I see - now that I see, "The extension html is not allowed."
So that's why.

So let me see...
report_other.png
report_DC.png
Point here is that there is a HUGE difference in speed.
20 KB/s vs 600 KB/s (& packet size too; 130 vs 840).
Duplicate Cleaner being very slow performing the scan.

> slow in the 'building file list' stage

Yes, pretty sure that was the case.
Yes, slow in the 'Building File List..." stage.
(So slow, that I am not about to let it finish to see if other areas are also affected.)
User avatar
DigitalVolcano
Site Admin
Posts: 1729
Joined: Thu Jun 09, 2011 10:04 am

Re: NAS Scan Speed Extremely Slow

Post by DigitalVolcano »

This is fixed now in 3.2.7 -coming very soon.

Test on QNAP NAS:-

3.2.6
Total Time Taken: 00:03:49
9719/9719 Files Scanned (3.56 GB)

3.2.7
Total Time Taken: 00:00:47
9719/9719 Files Scanned (3.56 GB)

The savings are in the file discovery stage - a huge difference (tested several times back and forth to allow for disk caching skewing the results).
User avatar
therube
Posts: 615
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

I am not seeing any improvement on my end...
networktrafficview duplicatecleaner327.png
Copy of networktrafficview other3.png
Copy of networktrafficview other4.png
User avatar
therube
Posts: 615
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

I'm 192.168.1.246
NAS is 192.168.1.64
Copy of networktrafficview duplicatecleaner327+other_JOINED.png
User avatar
DigitalVolcano
Site Admin
Posts: 1729
Joined: Thu Jun 09, 2011 10:04 am

Re: NAS Scan Speed Extremely Slow

Post by DigitalVolcano »

The packet speed won't change, but at the file discovery stage it is now making one trip per file rather than three - previous versions made two extra trips to fetch dates created and modified.
User avatar
therube
Posts: 615
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

I don't really know what the charts I posted "mean" - hoping you will... ;-).

And while there may have been changes made between 3.2.6 & 3.2.7, they are not being realized - at least on my end, as NAS scanning is still extremely slow.

(I've sent a PM.)
Post Reply