Is there anything I could do to make DC running faster (in audio mode)?

The best solution for finding and removing duplicate files.
Donk
Posts: 22
Joined: Sun Mar 17, 2024 12:39 am

Is there anything I could do to make DC running faster (in audio mode)?

Post by Donk »

In audio mode DC needs 2 and a half minutes for 68 mp3 files with identical audio data to finish. There are other duplicate finder programs needing a third of the time (comparing audio data, not tags). Is there anything I could do to make DC running faster (in audio mode)?
User avatar
therube
Posts: 634
Joined: Tue Jun 28, 2011 4:38 pm

Re: Is there anything I could do to make DC running faster (in audio mode)?

Post by therube »

Compared with my A/V hasher (something I whipped up), & for as much as I understand (or don't understand) it, I'm getting results in seconds, compared to minutes for DC.

The basic guts of it:

Code: Select all

for %%i in (%*) do (echo "%%~fi"  &  ffmpeg -v 4  -i "%%~i"  -map 0  -c copy  -f streamhash  -hash murmur3 -)  2>&1  |  tee -a  c:\out\0hashmedialist
And the important part of that:

Code: Select all

ffmpeg -v 4  -i "%%~i"  -map 0  -c copy  -f streamhash  -hash murmur3 -
The "as much as I understand" part.
(ffmpeg) has different ways to compute hashes (& different algorithms too). And some are faster then others.
Now why one would want to chose one over another, I'm not particularly sure.
In my notes, I have:

Code: Select all

ffmpeg -i input.mp4 -map 0:v -c copy -f md5 -
	- This just gets the MD5 (murmur3) hash using stream copy mode. There is no decoding.

ffmpeg -i input.mp4 -map 0   -c copy -f streamhash -hash md5 -
	- Show video and audio checksums separately
	- Using the streamhash muxer:

ffmpeg -i input.mp4 -map 0   -f framehash -
	- Per frame
	- Using the framehash muxer:
(Above relates to both audio & video, & using ffmpeg.)

And I get outputs like:

Code: Select all

"C:\out\MOVIES\White Flash In Firefox [k7wttjQ4xQVAf4z97GT].mp4"
0,v,murmur3=6d3cfdba48aa581be0257e92bcf82b08
"C:\out\MOVIES\What is an SRT File and How do I Make One [2Z1sxaLehdI].mp4"
0,v,murmur3=f41d96a3502c014881cf5e7ca1bf8e67
1,a,murmur3=716d881c31a22709cfce41f3ce81c526
"C:\out\MOVIES\FF tooltips.wmv"
0,a,murmur3=827c18feb3b6c307a8ecba854b0ab26d
1,v,murmur3=051a03f4a9d8369faf16d63c9e19d48b
"C:\out\MOVIES\Video_2023-02-15_142619.wmv"
0,a,murmur3=ddd7a36fe3879e9cf583c4fcbb4d9279
1,v,murmur3=201287cc0b5d813ce1d304f86ca522b5
"C:\out\MOVIES\FF Nightly Tooltips FLUTTER.wmv"
0,a,murmur3=6cdeb1fd3f3a772b28042f95f35e6349
1,v,murmur3=46b2b2d6dfdef672e67d2a5f7bf7f409"
C:\out\MOVIES\White Flash In Firefox [k7wttjQ4xQVAf4z97GT].mp4"
0,v,murmur3=6d3cfdba48aa581be0257e92bcf82b08
"C:\out\MOVIES\What is an SRT File and How do I Make One [2Z1sxaLehdI].mp4"
0,v,murmur3=f41d96a3502c014881cf5e7ca1bf8e67
1,a,murmur3=716d881c31a22709cfce41f3ce81c526
"C:\out\MOVIES\FF tooltips.wmv"
0,a,murmur3=827c18feb3b6c307a8ecba854b0ab26d
1,v,murmur3=051a03f4a9d8369faf16d63c9e19d48b
"C:\out\MOVIES\Video_2023-02-15_142619.wmv"
0,a,murmur3=ddd7a36fe3879e9cf583c4fcbb4d9279
1,v,murmur3=201287cc0b5d813ce1d304f86ca522b5
"C:\out\MOVIES\FF Nightly Tooltips FLUTTER.wmv"
0,a,murmur3=6cdeb1fd3f3a772b28042f95f35e6349
1,v,murmur3=46b2b2d6dfdef672e67d2a5f7bf7f409
Donk
Posts: 22
Joined: Sun Mar 17, 2024 12:39 am

Re: Is there anything I could do to make DC running faster (in audio mode)?

Post by Donk »

Thank you very much

That somehow looks quite complicated. What do I have to do now?
MegMac
Posts: 19
Joined: Tue Sep 14, 2021 6:00 pm

Re: Is there anything I could do to make DC running faster (in audio mode)?

Post by MegMac »

I use Windows Task Manager and set DCP priority to High. That speeds things up when I'm working with photos and videos.
Dupp
Posts: 3
Joined: Thu May 30, 2024 8:43 am

Re: Is there anything I could do to make DC running faster (in audio mode)?

Post by Dupp »

Yes, that can of course be a good thing, but then my computer would probably run unusably slowly for many hours with this setting. In any case, other certain programs might then hardly be useful.
Post Reply