DigitalVolcano Software Support

Hi,

I recently purchased DC 3.0.
I was attempting to check two hard drives for duplicates and received the following message after the scan was completed:

Error building Duplicate Folders tree: Exception of type 'System.OutofMemoryException' was thrown.

After which the program was unresponsive.

The scan took about 25 hours, there seemed to be plenty of memory available when I checks.

I'm not sure what the deals is. I searched the forum and couldn't find a similar post. Any Ideas how I can avoid this?



Thanks

Sorry you are getting this error. Was it an image scan, or standard? There is currently an issue when scanning a large amount of files in one go (500,000+). It is unrelated to the amount of memory you have. We are looking into a fix for this. For now, you may have to break down your scans into smaller chunks.

thanks

Thanks, it was the standard scan of over 250,000 files. Smaller chunks is working fine.

I too am receiving this error while trying to delete approximately 250K files totaling 300GB or so. I am splitting up the .CSV file and reimporting which will hopefully work since it took 2+ days to complete the scan. But is there a fix for this yet?

Not only this, but as I have been trying to delete large blocks of files, the amount of free space on my NAS has actually been declining. Specifically, when I first tried to delete the 250K files, I had 311GB free. After 2-3 attempts with this memory crash, I now have only 278GB free. Is the application creating temp files of some kind?

as I have been trying to delete large blocks of files, the amount of free space on my NAS has actually been declining

Some NAS have a "recycle bin" feature.
(QNAP) Network Recycle Bin

DC doesn't create any temp files while deleting - it just deletes them using standard Windows API methods. The only occasion that it could leave temp files is if you were scanning zip files and it somehow crashed without cleaning up at the end. You'd find folders in your temp folder called dc_temp*.

I don't think that's it but it's feasible since eventually the space cleared up after running multiple sessions with the list split up.

Which brings me back to the original question about the memory error...is there a fix?

Progress with the deletion memory issue. You should expect a fix in 3.0.9.

It deleted 260,000 files without incident, and the deletion is much faster (less than half an hour for the 260K)

We hope to get a release out very soon.

Thank you. Do you have a reaction to the space reduction issue? I believe the other responder is a fellow user and I appreciate the reply but wanted to know if there is an official answer. The same thing just happened again.

I don't know what's causing the space reduction. One idea could be that the Windows swap file has grown (due to a large scan using more memory). Another is that the scan going through the files is causing Windows to re-index and report a more accurate drive usage figure. Other than that I'm not sure, as DC creates no files apart from opening Zip files in the temp folder (which are deleted after/during the scan)