Deduping a large photo disorganized collection

The best solution for finding and removing duplicate files.
Post Reply
bsacco
Posts: 15
Joined: Sun Jan 02, 2022 9:47 pm

Deduping a large photo disorganized collection

Post by bsacco »

I need step-by-step instructions of how to dedupe and organize my large photo collection using Duplicate Cleaner 5 on my WIN 11 PC.

Is there somewhere here in this forum that can deliver these step-by-step instructions? Plus I need all the correct settings so that I get the results I need.

I'm having a tough time trying to figure this out.

Thanks, bob
User avatar
DigitalVolcano
Site Admin
Posts: 1729
Joined: Thu Jun 09, 2011 10:04 am

Re: Deduping a large photo disorganized collection

Post by DigitalVolcano »

Here's a good tutorial on cleaning up photos with DC for beginners:
https://www.youtube.com/watch?v=D1Mq8Rq ... WL&index=8

Basically, my process would be:-

Back up everything in a separate place first.
Run a Regular Mode 'Same Content' scan to eliminate exact file matches.
Run an Image mode scan to catch similar and resized images.

Some people like to copy everything to one location first, and then whittle down the duplicates in this location.
Vitor
Posts: 8
Joined: Mon Jan 21, 2013 3:06 pm

Re: Deduping a large photo disorganized collection

Post by Vitor »

I'm doing the same as you after recovering an external drive with a damaged filesystems. 35.000 photos deduplicate and sort.
I've seen the video and it seems about right. Do make a backup first because you'll possibly make a mistake and delete what you don't want to delete.
bsacco
Posts: 15
Joined: Sun Jan 02, 2022 9:47 pm

Re: Deduping a large photo disorganized collection

Post by bsacco »

I just ran a de-dupe of a large folder of loose single image and movie files.

The settings were REGULAR MODE with SAME CONTENT (Match files by their exact content) checked.

I choose MARK BY GROUP - ALL BUT ONE FILE IN EACH GROUP.

It found DUPLICATE 64,253 files.

When I try to select the CHECK FOR ISSUES FIRST button I get the following:

0 files name(s) will clash other files within the set you are copying
0 files name(s) will clash with other file name(s)
o file(s) have a subfolder name which is too long

Then WHen I attempt to MOVE these FILES to another folder by clicking on the MOVE FILES button it says "Are you sure you want to move 48,869 files" and I agree to do so by continuing. Then the program displays a progress bar like it is processing the files but then I get the message:

48,869 file(s) could not be processed. (check log)

below is a partial list of what is in the log files.

This is VERY FRUSTRATING as the tool is not working.

CAN you please advise why I cannot get your tool to work properly?

4/2/2024 11:37:05 PM
About to move 7,198 file(s). Are you sure?
Q:\1_Q_temp dupes
[Via Windows Shell]
hwnd must not be IntPtr.Zero (0) or null.: J:\1_LOOSE via Folder Merger\2015-05-29_001.JPG
The system cannot find the file specified. (Exception from HRESULT: 0x80070002): J:\1_LOOSE via Folder Merger\2015-05-29_IMG_3273.JPG
The system cannot find the file specified. (Exception from HRESULT: 0x80070002): J:\1_LOOSE via Folder Merger\2015-06-20_001-iphone (12).JPG
The system cannot find the file specified. (Exception from HRESULT: 0x80070002): J:\1_LOOSE via Folder Merger\2015-09-06_001-iphone (3).JPG
The system cannot find the file specified. (Exception from HRESULT: 0x80070002): J:\1_LOOSE via Folder Merger\2015-09-07_001-iphone (4).JPG
The system cannot find the file specified. (Exception from HRESULT: 0x80070002): J:\1_LOOSE via Folder Merger\2015-06-11_001-iphone (5).JPG
The system cannot find the file specified. (Exception from HRESULT: 0x80070002): J:\1_LOOSE via Folder Merger\2015-08-26_001-iphone (6).JPG
The system cannot find the file specified. (Exception from HRESULT: 0x80070002): J:\1_LOOSE via Folder Merger\2015-09-18_001-iphone (7).JPG
User avatar
DigitalVolcano
Site Admin
Posts: 1729
Joined: Thu Jun 09, 2011 10:04 am

Re: Deduping a large photo disorganized collection

Post by DigitalVolcano »

Looks like it's having trouble connecting with the drive, or there is a Windows issue.
If it's not possible that the drive is disconnected (see if you can still acress the files) try unchecking 'via Windows shell' - this tries an alternate way to move the files without asking Windows to do it.
Post Reply