Hardlinked files still being compared

The best solution for finding and removing duplicate files.
User avatar
Herman

Hardlinked files still being compared

Post by Herman »

I think Duplicate Cleaner could be much faster if it would check before comparing if the two files it is going to compare are already hardlinked.

I'm using the program regularly to check a folder which is reported by windows to be over 1 terabyte on a single 1 terabyte harddisk.

A lot of those files are hardlinked because they are texture files of 3D models that are reused over mutiple models and therefore need to be in many folders.

However it takes forever to check this folder with Duplicate Cleaner because it seems to be comparing files which are already hardlinked to each other.
User avatar
Anonymous

Post by Anonymous »

After making similar observations, I too would appreciate this proposed functionality.

In addition, if Duplicate Cleaner (DC) unhardlinks-then-rehardlinks files that are already hardlinked, I think it would be of greater efficiency to hardlink only the currently unlinked files to the group.

If there are multiple groups of hardlinked files that can be merged into one group, DC could use the group with the greatest number of hardlinked files as the base group for the unlinked files to link to.

I think these functions can yield significant performance increases, on subsequent runs, for some DC users.
User avatar
DV

Post by DV »

Good ideas - I'm revising the hardlink operations in DC2.0, as it does cause some slowdowns. Thanks
Post Reply