File Deletion is Slow

The best solution for finding and removing duplicate files.
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

File Deletion is Slow

Post by therube »

File Deletion is Slow

Well, not really...

The actual file deletion seemed to go quite briskly.
Though the "entire" process was relatively long.

I believe the actual time consuming part was with the deletion of empty folders?

At least during the (what I going to say) actual file deletion, the count went from 0/183756 to 183750/183756 relatively quickly, but then there was a long lag (including disk activity) before the operation finally completed. And if the files were actually deleted during the quick part (which I believe to be the case), then seems the majority of the time was spent during the removal of empty folders (of which there were only 95 folders total to begin with, with 31 folders remaining after all was completed) [All remaining folders did in fact contain files.]


(My next set of files, I'll try disabling Remove Empty Folders & see what that does...)


Only 1800 files total in my next run, count went to 1800 & a few seconds later it was done.

I'll try to dig something up more representative...
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: File Deletion is Slow

Post by therube »

153 K files
95 folders (no subdirectories to those folders)

Deleting 151 K files
Do not remove empty folders

Same sort thing happened, so my above supposition was wrong.

(Relatively) quickly got up to Deleting ... 150969/151003, then it took a decent amount of time before disk access subsided & the operation actually completed.

I'll note that during this long time period, at that point, the files were already gone. A check showed 2021 files & 95 folders remaining, & those numbers stayed unchanged at Duplicate Cleaners completion.

So... enabling Remove empty folders, was not an issue.
Maybe clearing disk cache?
Or might it be writing / updating DuplicateCleanerPro.data?

(That seems of greater likelihood ... ?)


PS: Log events to file is unchecked - purposely (viewtopic.php?p=5651#p5651).
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: File Deletion is Slow

Post by therube »

Or might it be writing / updating DuplicateCleanerPro.data?
That seems to be it.
The actual deletions happen relatively quickly.
All the while DuplicateCleanerPro.data (which contains the "context state" of a Scan, I'm guessing) is being updated, & the updating of that could potentially take longer then the actual file deletions.
User avatar
DigitalVolcano
Site Admin
Posts: 1864
Joined: Thu Jun 09, 2011 10:04 am

Re: File Deletion is Slow

Post by DigitalVolcano »

Which version is this?

The first beta did have a delay updating the database after the deletion - that's been fixed now.
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: File Deletion is Slow

Post by therube »

Which version is this?
3.2.7

(Except for one post, pretty sure 4.0 related stuff I've put into the Beta thread.
And unfortunately, what I do on XP is different from what I don Wiin7, so issues I run into on one, I may or may not be able to test under 4.0 Beta to know if there is enhancement there.)
Post Reply