duplicate Cleaner crashing.

The best solution for finding and removing duplicate files.
Post Reply
User avatar
andycham28

duplicate Cleaner crashing.

Post by andycham28 »

hi, just spent almost 3 days scanning 830gb for duplicates, it finally finished, i selected the first 22 out of 251,000 files to be deleted and clicked the file-removal button only for the program to go into not responding, and is now eating up between 90-98% cpu not sure if i want to close the program down and start again, as you have no way of reloading the duplicate data.

Just looked into the install folder and found the following log file

#
# A fatal error has been detected by the Java Runtime Environment:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d9ae7a6, pid=3376, tid=2244
#
# JRE version: 7.0-b147
# Java VM: Java HotSpot(TM) Client VM (21.0-b17 mixed mode, sharing windows-x86 )
# Problematic frame:
# V [jvm.dll+0x6e7a6]
#
# Failed to write core dump. Minidumps are not enabled by default on client versions of Windows
#
# If you would like to submit a bug report, please visit:
# http://bugreport.sun.com/bugreport/crash.jsp
#

--------------- T H R E A D ---------------

Current thread (0x02bb7400): VMThread [stack: 0x02d20000,0x02d70000] [id=2244]

siginfo: ExceptionCode=0xc0000005, reading address 0x0000000c

Registers:
EAX=0x00000002, EBX=0x02d6fa58, ECX=0x00000000, EDX=0x00000000
ESP=0x02d6fa2c, EBP=0x02d6fa38, ESI=0x329b0030, EDI=0x329b0028
EIP=0x6d9ae7a6, EFLAGS=0x00010212

Top of Stack: (sp=0x02d6fa2c)
0x02d6fa2c: 329b2800 329b0000 329b0000 02d6fa6c
0x02d6fa3c: 6d9adc9b 329b0000 00000a3e 329b0000
0x02d6fa4c: 329b28f8 02d6fa58 02b20070 6dba8d30
0x02d6fa5c: 6d950400 02bd7a38 329b0000 02d6fc4c
0x02d6fa6c: 02d6fa94 6d9adc27 329b0000 00000a3e
0x02d6fa7c: 329b0000 329b28f8 02a3ffff 00000a00
0x02d6fa8c: 329b0000 329b0000 02d6fabc 6d99d302
0x02d6fa9c: 329b0000 00000a00 003cf2b8 6dba59e4

Instructions: (pc=0x6d9ae7a6)
0x6d9ae786: 14 73 6e 8d a4 24 00 00 00 00 8b 4f 04 8b 41 08
0x6d9ae796: 8b 90 20 01 00 00 83 c1 08 53 57 ff d2 8b 4e 04
0x6d9ae7a6: 8b 41 0c 83 c1 08 8b fe 85 c0 7e 09 a8 01 75 31
0x6d9ae7b6: c1 f8 02 eb 34 79 2a 8b 56 08 8b c8 83 e1 3f d3


Register to memory mapping:

EAX=0x00000002 is an unknown value
EBX=0x02d6fa58 is an unknown value
ECX=0x00000000 is an unknown value
EDX=0x00000000 is an unknown value
ESP=0x02d6fa2c is an unknown value
EBP=0x02d6fa38 is an unknown value
ESI=
[error occurred during error reporting (printing register info), id 0xc0000005]

Stack: [0x02d20000,0x02d70000], sp=0x02d6fa2c, free space=318k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [jvm.dll+0x6e7a6]
V [jvm.dll+0x6dc9b]
V [jvm.dll+0x6dc27]
V [jvm.dll+0x5d302]
V [jvm.dll+0x5c79b]
V [jvm.dll+0x5cef8]
V [jvm.dll+0x6884c]
V [jvm.dll+0x5ee90]
V [jvm.dll+0x5cdb4]
V [jvm.dll+0x6d6b6]
V [jvm.dll+0x6778f]
V [jvm.dll+0x61afa]
V [jvm.dll+0x671d6]
V [jvm.dll+0x5ea03]
V [jvm.dll+0x16b106]
V [jvm.dll+0x148f35]
V [jvm.dll+0x14816e]
V [jvm.dll+0x14849c]
V [jvm.dll+0x148912]
V [jvm.dll+0x171549]
C [msvcr100.dll+0x5c6de] endthreadex+0x3a
C [msvcr100.dll+0x5c788] endthreadex+0xe4
C [kernel32.dll+0xb729] GetModuleFileNameA+0x1ba

VM_Operation (0x0352f9bc): GenCollectForAllocation, mode: safepoint, requested by thread 0x03285c00


--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
0x0332f400 JavaThread "AWT-EventQueue-0" [_thread_blocked, id=1712, stack(0x03850000,0x038a0000)]
0x0332ec00 JavaThread "AWT-EventQueue-1" [_thread_blocked, id=1720, stack(0x03800000,0x03850000)]
0x0331f400 JavaThread "AWT-EventQueue-2" [_thread_blocked, id=2100, stack(0x037b0000,0x03800000)]
0x03318c00 JavaThread "AWT-Shutdown" [_thread_blocked, id=2476, stack(0x03760000,0x037b0000)]
0x03317c00 JavaThread "JVM[id=1]-Heartbeat" daemon [_thread_blocked, id=3688, stack(0x03710000,0x03760000)]
0x03316800 JavaThread "Applet 1 LiveConnect Worker Thread" [_thread_blocked, id=4020, stack(0x035d0000,0x03620000)]
0x0330a800 JavaThread "Browser Side Object Cleanup Thread" [_thread_blocked, id=2584, stack(0x03620000,0x03670000)]
0x0329b800 JavaThread "CacheCleanUpThread" daemon [_thread_blocked, id=2180, stack(0x03580000,0x035d0000)]
0x032ae400 JavaThread "CacheMemoryCleanUpThread" daemon [_thread_blocked, id=1744, stack(0x036c0000,0x03710000)]
0x032a2800 JavaThread "SysExecutionTheadCreator" daemon [_thread_blocked, id=852, stack(0x03490000,0x034e0000)]
0x03295400 JavaThread "AWT-Windows" daemon [_thread_in_native, id=3340, stack(0x02c20000,0x02d20000)]
0x03292800 JavaThread "Java2D Disposer" daemon [_thread_blocked, id=4080, stack(0x03530000,0x03580000)]
0x03285c00 JavaThread "Java Plug-In Pipe Worker Thread (Client-Side)" daemon [_thread_blocked, id=3912, stack(0x034e0000,0x03530000)]
0x03273000 JavaThread "Timer-0" [_thread_blocked, id=1152, stack(0x03440000,0x03490000)]
0x02c08400 JavaThread "traceMsgQueueThread" daemon [_thread_blocked, id=2108, stack(0x031a0000,0x031f0000)]
0x02bd2800 JavaThread "Service Thread" daemon [_thread_blocked, id=1484, stack(0x02f80000,0x02fd0000)]
0x02bcfc00 JavaThread "C1 CompilerThread0" daemon [_thread_blocked, id=940, stack(0x02f20000,0x02f70000)]
0x02bce000 JavaThread "Attach Listener" daemon [_thread_blocked, id=3856, stack(0x02ed0000,0x02f20000)]
0x02bccc00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=3296, stack(0x02e80000,0x02ed0000)]
0x02bc8800 JavaThread "Finalizer" daemon [_thread_blocked, id=3696, stack(0x02dc0000,0x02e10000)]
0x02bb8c00 JavaThread "Reference Handler" daemon [_thread_blocked, id=2564, stack(0x02d70000,0x02dc0000)]
0x003c7400 JavaThread "main" [_thread_blocked, id=2900, stack(0x008c0000,0x00910000)]

Other Threads:
=>0x02bb7400 VMThread [stack: 0x02d20000,0x02d70000] [id=2244]
0x02bd4c00 WatcherThread [stack: 0x02fd0000,0x03020000] [id=3788]

VM state:at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x003c6480] Threads_lock - owner thread: 0x02bb7400
[0x003c6890] Heap_lock - owner thread: 0x03285c00

Heap
def new generation total 4928K, used 4416K [0x229b0000, 0x22f00000, 0x27f00000)
eden space 4416K, 100% used [0x229b0000, 0x22e00000, 0x22e00000)
from space 512K, 0% used [0x22e00000, 0x22e00000, 0x22e80000)
to space 512K, 36% used [0x22e80000, 0x22eaf340, 0x22f00000)
tenured generation total 10944K, used 0K [0x27f00000, 0x289b0000, 0x329b0000)
the space 10944K, 0% used [0x27f00000, 0x27f00000, 0x27f00200, 0x289b0000)
compacting perm gen total 12288K, used 2511K [0x329b0000, 0x335b0000, 0x369b0000)
the space 12288K, 20% used [0x329b0000, 0x32c23d58, 0x32c23e00, 0x335b0000)
ro space 10240K, 42% used [0x369b0000, 0x36dec660, 0x36dec800, 0x373b0000)
rw space 12288K, 53% used [0x373b0000, 0x37a28180, 0x37a28200, 0x37fb0000)

Code Cache [0x00940000, 0x009f0000, 0x02940000)
total_blobs=354 nmethods=143 adapters=144 free_code_cache=32084Kb largest_free_block=32854912

Dynamic libraries:
0x00400000 - 0x0042e000 C:\Program Files\Java\jre7\bin\java.exe
0x7c900000 - 0x7c9b2000 C:\WINDOWS\system32\ntdll.dll
0x7c800000 - 0x7c8f6000 C:\WINDOWS\system32\kernel32.dll
0x77dd0000 - 0x77e6b000 C:\WINDOWS\system32\ADVAPI32.dll
0x77e70000 - 0x77f02000 C:\WINDOWS\system32\RPCRT4.dll
0x77fe0000 - 0x77ff1000 C:\WINDOWS\system32\Secur32.dll
0x7e410000 - 0x7e4a1000 C:\WINDOWS\system32\USER32.dll
0x77f10000 - 0x77f59000 C:\WINDOWS\system32\GDI32.dll
0x773d0000 - 0x774d3000 C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.2600.5512_x-ww_35d4ce83\COMCTL32.dll
0x77c10000 - 0x77c68000 C:\WINDOWS\system32\msvcrt.dll
0x77f60000 - 0x77fd6000 C:\WINDOWS\system32\SHLWAPI.dll
0x76390000 - 0x763ad000 C:\WINDOWS\system32\IMM32.DLL
0x78aa0000 - 0x78b5e000 C:\Program Files\Java\jre7\bin\msvcr100.dll
0x6d940000 - 0x6dc61000 C:\Program Files\Java\jre7\bin\client\jvm.dll
0x71ad0000 - 0x71ad9000 C:\WINDOWS\system32\WSOCK32.dll
0x71ab0000 - 0x71ac7000 C:\WINDOWS\system32\WS2_32.dll
0x71aa0000 - 0x71aa8000 C:\WINDOWS\system32\WS2HELP.dll
0x76b40000 - 0x76b6d000 C:\WINDOWS\system32\WINMM.dll
0x76bf0000 - 0x76bfb000 C:\WINDOWS\system32\PSAPI.DLL
0x6d8d0000 - 0x6d8dc000 C:\Program Files\Java\jre7\bin\verify.dll
0x6d370000 - 0x6d390000 C:\Program Files\Java\jre7\bin\java.dll
0x6d000000 - 0x6d142000 C:\Program Files\Java\jre7\bin\awt.dll
0x77120000 - 0x771ab000 C:\WINDOWS\system32\OLEAUT32.dll
0x774e0000 - 0x7761d000 C:\WINDOWS\system32\ole32.dll
0x6d920000 - 0x6d933000 C:\Program Files\Java\jre7\bin\zip.dll
0x5ad70000 - 0x5ada8000 C:\WINDOWS\system32\uxtheme.dll
0x69240000 - 0x6924f000 C:\Program Files\WinSplit Revolution\winsplithook.dll
0x4fdd0000 - 0x4ff76000 C:\WINDOWS\system32\d3d9.dll
0x02f70000 - 0x02f76000 C:\WINDOWS\system32\d3d8thk.dll
0x77c00000 - 0x77c08000 C:\WINDOWS\system32\VERSION.dll
0x755c0000 - 0x755ee000 C:\WINDOWS\system32\msctfime.ime
0x6d450000 - 0x6d456000 C:\Program Files\Java\jre7\bin\jp2native.dll
0x6d1b0000 - 0x6d1e3000 C:\Program Files\Java\jre7\bin\deploy.dll
0x63000000 - 0x630e6000 C:\WINDOWS\system32\WININET.dll
0x03020000 - 0x03029000 C:\WINDOWS\system32\Normaliz.dll
0x1a400000 - 0x1a532000 C:\WINDOWS\system32\urlmon.dll
0x5dca0000 - 0x5de88000 C:\WINDOWS\system32\iertutil.dll
0x7c9c0000 - 0x7d1d7000 C:\WINDOWS\system32\SHELL32.dll
0x6d660000 - 0x6d674000 C:\Program Files\Java\jre7\bin\net.dll
0x6d680000 - 0x6d68f000 C:\Program Files\Java\jre7\bin\nio.dll
0x6d2c0000 - 0x6d2ea000 C:\Program Files\Java\jre7\bin\fontmanager.dll
0x71a50000 - 0x71a8f000 C:\WINDOWS\System32\mswsock.dll
0x76f20000 - 0x76f47000 C:\WINDOWS\system32\DNSAPI.dll
0x76fb0000 - 0x76fb8000 C:\WINDOWS\System32\winrnr.dll
0x76f60000 - 0x76f8c000 C:\WINDOWS\system32\WLDAP32.dll
0x76fc0000 - 0x76fc6000 C:\WINDOWS\system32\rasadhlp.dll
0x662b0000 - 0x66308000 C:\WINDOWS\system32\hnetcfg.dll
0x71a90000 - 0x71a98000 C:\WINDOWS\System32\wshtcpip.dll

VM Arguments:
jvm_args: -D__jvm_launched=183326654591 -D__applet_launched=183326585223 -Xbootclasspath/a:C:\PROGRA~1\Java\jre7\lib\deploy.jar;C:\PROGRA~1\Java\jre7\lib\javaws.jar;C:\PROGRA~1\Java\jre7\lib\plugin.jar -Dsun.awt.warmup=true
java_command: sun.plugin2.main.client.PluginMain write_pipe_name=jpi2_pid2044_pipe2,read_pipe_name=jpi2_pid2044_pipe1
Launcher Type: SUN_STANDARD

Environment Variables:
PATH=C:\Program Files\Mozilla Firefox;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\system32\wbem;C:\Program Files\Common Files\Ulead Systems\MPEG;C:\Program Files\IVT Corporation\BlueSoleil\Mobile;;C:\Program Files\Universal Extractor;C:\Program Files\Universal Extractor\bin;C:\Program Files\QT Lite\QTSystem;C:\Program Files\IDM Computer Solutions\UltraEdit\;
USERNAME=Andrew
OS=Windows_NT
PROCESSOR_IDENTIFIER=x86 Family 6 Model 10 Stepping 0, AuthenticAMD



--------------- S Y S T E M ---------------

OS: Windows XP Build 2600 Service Pack 3

CPU:total 1 (1 cores per cpu, 1 threads per core) family 6 model 10 stepping 0, cmov, cx8, fxsr, mmx, sse, mmxext, 3dnowpref

Memory: 4k page, physical 3145200k(2263352k free), swap 4032644k(3278824k free)

vm_info: Java HotSpot(TM) Client VM (21.0-b17) for windows-x86 JRE (1.7.0-b147), built on Jun 27 2011 02:25:52 by "java_re" with unknown MS VC++:1600

time: Fri Oct 14 13:54:55 2011
elapsed time: 744 seconds

could this be the reason.
User avatar
therube
Posts: 615
Joined: Tue Jun 28, 2011 4:38 pm

Re: duplicate Cleaner crashing.

Post by therube »

Just looked into the install folder
The install folder of what?

Java has nothing to do with DC, so nothing in that regard applies.
just spent almost 3 days scanning 830gb for duplicates
As a start, suggest you work with smaller chunks, & or methods when investigating a program.
830 GB is not all that much, but depending on your search criteria, the results could be extensive.

Depending ... you could start a search for dups by Name, or Name & Size. Now that does not confirm a dup, but maybe with that, you could separate those particular files out (into a different different directory tree) & scan those by Content to confirm the dups. (Or something similar. Doing so would most likely be quicker then blanket scanning 830gb by content.)

(Now that doesn't answer why the program responded as it did, but ...)

<Also, seems that there are duplicate posts on this board. Wonder if Duplicate Cleaner could clean that up :D.>
User avatar
andycham28

Re: duplicate Cleaner crashing.

Post by andycham28 »

834gb is nothing really considering i got 6tb of data to go through. and these where just folders of already split into groups.
reason i decided to do it now, is simple in the UK prices of 2tb hdd has risen from £65 to £130-£180 and i'm running out of space. I know i got duplicates, hence the reason. Should have selected the export csv file before selecting the 22 files i did. Then imported it after it crashed.
As for the log file regarding java no idea of why that log file was in the install folder of duplicate cleaner, due to the fact it uses framework.
Post Reply