Hi,
I have just over 5 TB of music files on a Freenas SMB share.
Running the latest version (4) on windows pro 64 with 16 gigs of ram.
I have started a scan over a gigabit wired network which is very fast and stable.
Initial file discovery took 45 minutes.
First hash creation pass took 74 minutes.
Second pass is being run for over three hours and the total progress is just above 491 files of 34.935.
I am running a regular scan with default settings.
Other types of file operations within the NAS are quite fast and I don't think this is due to a network transport bottleneck.
What is causing this incredibly slow process?
Any suggestions?
I have no logs as of now as the very first scan has not been complete yet.
Thank you.
Ultra slow hash calculation pass 2 over network
Re: Ultra slow hash calculation pass 2 over network
About how many files?
To be clear, you're running a 'Regular' mode scan & not an 'Audio' mode scan?
This "second pass", is that a setting you selected in the program (if so where?) or is DC reporting back that it is running the "second pass"?
Do you have Logging enabled (in DC)?
Do you use Everything (search) by chance?
While this is different, perhaps something similar is happening with Everything or some other program potentially interfering, Slow "Querying" while compiling something ?
(Though if the initial parts of the program run seem to be running timely...)
To be clear, you're running a 'Regular' mode scan & not an 'Audio' mode scan?
This "second pass", is that a setting you selected in the program (if so where?) or is DC reporting back that it is running the "second pass"?
Do you have Logging enabled (in DC)?
Do you use Everything (search) by chance?
While this is different, perhaps something similar is happening with Everything or some other program potentially interfering, Slow "Querying" while compiling something ?
(Though if the initial parts of the program run seem to be running timely...)
Last edited by therube on Thu May 30, 2019 7:25 pm, edited 1 time in total.
Re: Ultra slow hash calculation pass 2 over network
If you take a smaller sample of your files, & copy them to a local disk, is there a significant time difference (accounting for the smaller sample size) in the scan?
Re: Ultra slow hash calculation pass 2 over network
Hi therube,
total file count is 34.935 as I have mentioned in my post.
Yes, I did use the Regular mode and not Audio mode as I have mentioed above.
There is no selection as to pass 2 option in the interface. So, it was done automatically by the program.
Logging was enabled.
I did not see an "Everything" option anywhere, and did not select it. I used version 4.1.2 of DC Pro and I don't see where the Everything selection is.
I was not running any parallel operations such as compiling or such neither on my PC nor on the NAS.
Thanks.
total file count is 34.935 as I have mentioned in my post.
Yes, I did use the Regular mode and not Audio mode as I have mentioed above.
There is no selection as to pass 2 option in the interface. So, it was done automatically by the program.
Logging was enabled.
I did not see an "Everything" option anywhere, and did not select it. I used version 4.1.2 of DC Pro and I don't see where the Everything selection is.
I was not running any parallel operations such as compiling or such neither on my PC nor on the NAS.
Thanks.
Re: Ultra slow hash calculation pass 2 over network
I just did a test run back in my office with another and much lower end NAS.
I have scanned a shared folder with about 23.000 files and of a 1.21 GB total size.
Whole process took only 4:32 minutes.
Then I have scanned a share with photos of 224 GB on the same NAS using Regular scan option.
It took 1:24 minutes to finish.
Then I have scanned the same photos folder using Image method.
This time scan took 1:47 hours.
I have scanned a shared folder with about 23.000 files and of a 1.21 GB total size.
Whole process took only 4:32 minutes.
Then I have scanned a share with photos of 224 GB on the same NAS using Regular scan option.
It took 1:24 minutes to finish.
Then I have scanned the same photos folder using Image method.
This time scan took 1:47 hours.