Finding dups on multple ext hard drives

The best solution for finding and removing duplicate files.
vegarjb
Posts: 1
Joined: Thu Aug 01, 2013 5:01 am

Finding dups on multple ext hard drives

Post by vegarjb »

Let me ask a question using an example

I have 1 drive with 1 TB of data (music, pictures, video). Over the years I have backed up some of the files to multiple external hard drives lets say 5 hard drives . I will use numbers for files names in the example

The 1 TB drive has files 1 - 1000

Dirve 1 has files 1 - 200
Drive 2 has files 201- 400
Drive 3 has files 350 - 600
Drive 4 has files 500 -900
Drive 5 has file 901 - 1500
The ASK:

Using Duplicate Cleaner can I scan the 1 TB drive to build a list of files, then use that list of files to compare what is on Drive 1 and then delete the duplicates on drive 1?
Repeat this step for Drive 2-5. So the result should be files 1-1000 on the 1 TB drive , Drives 1 - 4 should be empty and file 1001-1500 on drive 5.

If this is possible then are there any limits on the type of compare (i.e hash, etc)

Thanks ray
User avatar
DigitalVolcano
Site Admin
Posts: 1864
Joined: Thu Jun 09, 2011 10:04 am

Re: Finding dups on multple ext hard drives

Post by DigitalVolcano »

This is best done using the 'Don't scan against self' option on Duplicate Cleaner Pro - you can use the setting on a folder to only find duplicates between drives/folders

So, scanning 1TB drive against Drive 1 with this option will only show a list of files which are shared by both drives. Then, you'll just select the files found on drive 1 for deletion.

MD5 hashing is fine in most cases, though you can use byte compare for extra confidence.
Post Reply