NAS Scan Speed Extremely Slow

The best solution for finding and removing duplicate files.
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

NAS Scan Speed Extremely Slow

Post by therube »

NAS Scan Speed Extremely Slow

Other then "visual" observation, two NetworkTrafficView (html) reports *attached.
(*attached ? at least I think I did, but I'm not seeing them ? let me know if they did not make it here.)

LinkStation Pro LS-XHLE6A (NAS)
Wired via LAN (not USB). 10/100/1000.

Code: Select all

02/06/2015 03:55:57 PM
Scanning: Regular Mode
- Same Created Date
- Same File Name
- Ignore extensions when comparing file names

Included: *.*
Excluded: 
C:\RECYCLER\ - Excluded
C:\My Documents\ - Excluded
M:\ - Excluded
\\NAS\USR\STEVEN\ - Included
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

(Bump. Did my attachments actually make it up to you?)
User avatar
DigitalVolcano
Site Admin
Posts: 1864
Joined: Thu Jun 09, 2011 10:04 am

Re: NAS Scan Speed Extremely Slow

Post by DigitalVolcano »

Don't think the attachments appeared.

Is it slow in the 'building file list' stage, or the duplicate finding stage? I've found file discovery on NAS to be quite slow - looking into this.
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

> Don't think the attachments appeared.

I try sending them up, but depending ..., might not be able to get to them till Monday or so.

> slow in the 'building file list' stage

Yes, pretty sure that was the case.
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

(Well, this took me longer then expected...
And it still looks like its not working?
These are .html files (reports).
Upload attachment, Browse to the wanted file, it shows the file name, Add the file,... yet nothing seems to actually make it up here?)

Ah, I see - now that I see, "The extension html is not allowed."
So that's why.

So let me see...
Network Traffic View - other
Network Traffic View - other
Network Traffic View - Duplicate Cleaner
Network Traffic View - Duplicate Cleaner
Point here is that there is a HUGE difference in speed.
20 KB/s vs 600 KB/s (& packet size too; 130 vs 840).
Duplicate Cleaner being very slow performing the scan.

> slow in the 'building file list' stage

Yes, pretty sure that was the case.
Yes, slow in the 'Building File List..." stage.
(So slow, that I am not about to let it finish to see if other areas are also affected.)
User avatar
DigitalVolcano
Site Admin
Posts: 1864
Joined: Thu Jun 09, 2011 10:04 am

Re: NAS Scan Speed Extremely Slow

Post by DigitalVolcano »

This is fixed now in 3.2.7 -coming very soon.

Test on QNAP NAS:-

3.2.6
Total Time Taken: 00:03:49
9719/9719 Files Scanned (3.56 GB)

3.2.7
Total Time Taken: 00:00:47
9719/9719 Files Scanned (3.56 GB)

The savings are in the file discovery stage - a huge difference (tested several times back and forth to allow for disk caching skewing the results).
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

I am not seeing any improvement on my end...
Duplicate Cleaner 3.2.7
Duplicate Cleaner 3.2.7
Other 3
Other 3
Other 4
Other 4
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

I'm 192.168.1.246
NAS is 192.168.1.64
Joined pic.
Joined pic.
User avatar
DigitalVolcano
Site Admin
Posts: 1864
Joined: Thu Jun 09, 2011 10:04 am

Re: NAS Scan Speed Extremely Slow

Post by DigitalVolcano »

The packet speed won't change, but at the file discovery stage it is now making one trip per file rather than three - previous versions made two extra trips to fetch dates created and modified.
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: NAS Scan Speed Extremely Slow

Post by therube »

I don't really know what the charts I posted "mean" - hoping you will... ;-).

And while there may have been changes made between 3.2.6 & 3.2.7, they are not being realized - at least on my end, as NAS scanning is still extremely slow.

(I've sent a PM.)
Post Reply