V5 Beta Project - Strategy Suggestions

The best solution for finding and removing duplicate files.
Post Reply
TNGeneWhiz
Posts: 8
Joined: Wed Sep 02, 2015 5:49 pm

V5 Beta Project - Strategy Suggestions

Post by TNGeneWhiz »

Apologies in advance because this is a lengthy post.

I have been using DC since version 3, but I never made a lot of headway with THIRTY years' worth of duplicated material in text, image, video, and audio formats. I have spent most of 2020 making a single pass through about 8TB, and I figured out how to crash DV4. Don't start out with 1.6 million duplicate files on a single drive.

Now I need to regroup with V5, which should give me long-needed and -awaited options. I thought I'd inquire here about strategy.

First, I've been a local and family historian who manages a hard-copy repository for certain communities and surnames. I am in the process of digitizing everything for on-line access.

My ultimate goal is to end up with multiple external drives that contain various topics: Photos, Video, Audio, Books I've Written, Massive Collection of Local and Family History Files (both my own research and that of others). I have thousands of PDF files containing the contents of about 50 linear feet (approx. 15 meters) of documents.

That is my base. However, there are multiple iterations and copies of most of the material.

After spending 2020 manually deduplicating (because I'm a data control freak who doesn't want to lose important files), I need to designate a single external drive as the "hub" for storage. Then I need to compare every byte on the media I started with in 2020 and ensure that ONE copy of the most-recently version of every file exists on the hub.

Then, I will feel comfortable storing those starter CD's, DVD's, floppy disks, and hard drives permanently and creating my topical drives (redundantly, of course) for vault storage.

The "master" concept was present in Version 4, but it wasn't terribly intuitive for me -- using multiple drives and media.

From what I've observed about the Comparison Wizard on the Version 5 splash screen, I should be able to accomplish my task of identifying MISSING files between two sources.

The problem is, I will have hundreds of thousands of missing files, and I don't want to go through the long process I had to go through in 2020.

So...

I'm looking for suggestions others might have successfully implemented in similar circumstances -- or may be planning -- before I spend months of 2021 pretty much going back through 1.6 million files.

As I create thousands more from a massive scanning project I've got slated for 2021.

If you made it this far, thanks for taking the time to read -- and thanks in advance for your recommendations!

Billie, snowed-in in the Smoky Mountains, USA :D
User avatar
DigitalVolcano
Site Admin
Posts: 1334
Joined: Thu Jun 09, 2011 10:04 am

Re: V5 Beta Project - Strategy Suggestions

Post by DigitalVolcano »

Thanks for the detailed post!

The comparison functions in version 5 are designed to try and make things a bit more intuitive to understand. The Wizards will aid this process, and it is possible for users to create their own Wizards.

The folder searching settings have also been overhauled- See screenshot here-
https://twitter.com/DigVolSoft/status/1 ... 5275177984

Feel free to try the beta- see
http://www.digitalvolcano.co.uk/board/v ... =16&t=2501
TNGeneWhiz
Posts: 8
Joined: Wed Sep 02, 2015 5:49 pm

Re: V5 Beta Project - Strategy Suggestions

Post by TNGeneWhiz »

Thanks for the wizards link.

I downloaded the beta 5 and plan to dive in as soon as I get finished with the version 4 session I'm in the midst of right now.
TNGeneWhiz
Posts: 8
Joined: Wed Sep 02, 2015 5:49 pm

Re: V5 Beta Project - Strategy Suggestions

Post by TNGeneWhiz »

DigitalVolcano wrote: Mon Jan 04, 2021 1:39 pm Feel free to try the beta- see
http://www.digitalvolcano.co.uk/board/v ... =16&t=2501
I have 5.02 and am ready to go. Some really basic questions:
  • How is the menu bar activated?
    How do I import a CSV file created in 4.1.4 so I can continue working with the list in 5.02?
    How do I change the font settings (under More Options/F10 in 4.1.4)
User avatar
DigitalVolcano
Site Admin
Posts: 1334
Joined: Thu Jun 09, 2011 10:04 am

Re: V5 Beta Project - Strategy Suggestions

Post by DigitalVolcano »

-There isn't a menu bar in 5.0
-The file import is being in integrated in a session state save/recall system that isn't live in the beta yet. This will also replace the v4 profile save/load.
-The font setting isn't in yet. Is it the duplicate list font you want to change?
Post Reply