JRockit JVM crash

Hi,
We are using JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2105-windows-ia32 with Weblogic 10.3 on Windows XP SP3 as well as Redhat 5.2.
There is a JVM crash (code generation) when hashCode() in called on a String. Error message is: Illegal memory access. We have tried turning off optimization using -XnoOpt as well -Xnoopt without success. Crash is seen on both the platforms.
Any suggestions or work arounds will be very much appreciated. Dump is given in the end of email.
Thanks,
Ajit
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:06:07 on Thu Apr 16 12:07:54 2009
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
D:\tools\bea103\user_projects\domains\cim8\jrockit.4588.dump
D:\tools\bea103\user_projects\domains\cim8\jrockit.4588.mdmp
Error Message: Illegal memory access. [54]
Exception Rec: EXCEPTION_ACCESS_VIOLATION (c0000005) at 0x0046D11A - memory at 0x0000001B could not be read.
Minidump : Wrote mdmp. Size is 770MB
SafeDllMode : -1
Version : BEA JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2105-windows-ia32
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#4.
: YC is not running. Last finished YC was YC#14.
OC History : Strategy genparpar was used for OC#1 to OC#4.
YC History : Ran 5 YCs before OC#1.
: Ran 7 YCs before OC#2.
: Ran 1 YCs before OC#3.
: Ran 1 YCs before OC#4.
: Ran 0 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x00C00000 - 0x20C00000 (Size: 512 MB)
Compaction : 0x02C00000 - 0x04C00000 (Current compaction type: internal)
NurseryList : 0x00F09148 - 0x0F8F6BE8
KeepArea : 0x101E3398 - 0x0FA7BB38
NurseryMarker: [ 0x101E3398, 0x0FA7BB38 ]
CompRefs : References are 32-bit.
CPU : Intel Pentium 4 SSE SSE2 SSE3 NetBurst EM64T
Number CPUs : 2
Tot Phys Mem : 3489136640 (3327 MB)
OS version : Microsoft Windows XP version 5.1 Service Pack 3 (Build 2600) (32-bit)
Thread System: Windows Threads
Java locking : Normal
State : JVM is running
Command Line : -Xms512m -Xmx512m -Xverify:none -da -Dplatform.home=D:\tools\bea103\WLSERV~1.3 -Dwls.home=D:\tools\bea103\WLSERV~1.3\server -Dweblogic.home=D:\tools\bea103\WLSERV~1.3\server -Dweblogic.management.discover=true -Dwlw.iterativeDev= -Dwlw.testConsole= -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=d:\tools\bea103\patch_wls1030\profiles\default\sysext_manifest_classpath;d:\tools\bea103\patch_cie660\profiles\default\sysext_manifest_classpath -Dweblogic.Name=AdminServer -Dtangosol.coherence.cacheconfig=d:/work/cim72/venus_dist_wlg/config/coherence-client-cache-config.xml -Dtangosol.coherence.override=d:/work/cim72/venus_dist_wlg/config/tangosol-coherence-override.xml -DMQ_HOME=d:/work/cim72/venus_dist_wlg -Dtangosol.coherence.log=d:/work/cim72/venus_dist_wlg/tangosol.log -DMQ_CONFIG_FILE=d:/work/cim72/venus_dist_wlg/config/ConfigValues.xml -DMQ_COMMON_DIR=d:/work/common/dev72 -DOS=Windows_NT -DORACLE_HOME=C:\oracle\ora92 -DNODE_ID=Amar -DMQ_LOG=d:/work/cim72/venus_dist_wlg/log -Xdebug -Xnoagent -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=5005 -Djavax.xml.transform.TransformerFactory=org.apache.xalan.processor.TransformerFactoryImpl -Djava.security.policy=D:\tools\bea103\WLSERV~1.3\server\lib\weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home : d:\tools\bea103\JROCKI~1\jre
j.class.path : ;d:\tools\bea103\patch_wls1030\profiles\default\sys_manifest_classpath\weblogic_patch.jar;d:\tools\bea103\patch_cie660\profiles\default\sys_manifest_classpath\weblogic_patch.jar;d:\tools\bea103\JROCKI~1\lib\tools.jar;D:\tools\bea103\WLSERV~1.3\server\lib\weblogic_sp.jar;D:\tools\bea103\WLSERV~1.3\server\lib\weblogic.jar;d:\tools\bea103\modules\features\weblogic.server.modules_10.3.0.0.jar;D:\tools\bea103\WLSERV~1.3\server\lib\webservices.jar;d:\tools\bea103\modules\ORGAPA~1.5/lib/ant-all.jar;d:\tools\bea103\modules\NETSFA~1.0_1/lib/ant-contrib.jar;;D:\tools\bea103\WLSERV~1.3\common\eval\pointbase\lib\pbclient57.jar;D:\tools\bea103\WLSERV~1.3\server\lib\xqrl.jar;;;d:/work/cim72/venus_dist_wlg/lib/external/serializer.jar;d:/work/cim72/venus_dist_wlg/lib/external/UserInfoService.jar;
j.lib.path : d:\tools\bea103\JROCKI~1\bin;.;C:\WINDOWS\system32;C:\WINDOWS;d:\tools\bea103\patch_wls1030\profiles\default\native;d:\tools\bea103\patch_cie660\profiles\default\native;D:\tools\bea103\WLSERV~1.3\server\native\win\32;D:\tools\bea103\WLSERV~1.3\server\bin;d:\tools\bea103\modules\ORGAPA~1.5\bin;d:\tools\bea103\JROCKI~1\jre\bin;d:\tools\bea103\JROCKI~1\bin;C:\tools\WebSphereMQ\Java\lib;C:\oracle\ora92\bin;C:\Program Files\O0racle\jre\1.3.1\bin;C:\Program Files\Oracle\jre\1.1.8\bin2;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\tools\apache-ant-1.5.4\bin;C:\tibco\tibrv\BIN;D:\bea81\jdk142_11\bin;D:\DB2\IBM\SQLLIB\BIN;D:\DB2\IBM\SQLLIB\FUNCTION;D:\DB2\IBM\SQLLIB\SAMPLES\REPL;D:/work/cim70HF1/venus_dist_was/bin/db2ldr;C:\tools\WebSphereMQ\bin;C:\tools\WebSphereMQ\tools\c\samples\bin;D:\tools\bea103\WLSERV~1.3\server\native\win\32\oci920_8
JAVA_HOME : d:\tools\bea103\JROCKI~1
JAVAOPTIONS: <not set>
PATH : d:\tools\bea103\JROCKI~1\jre\bin;d:\tools\bea103\patch_wls1030\profiles\default\native;d:\tools\bea103\patch_cie660\profiles\default\native;D:\tools\bea103\WLSERV~1.3\server\native\win\32;D:\tools\bea103\WLSERV~1.3\server\bin;d:\tools\bea103\modules\ORGAPA~1.5\bin;d:\tools\bea103\JROCKI~1\jre\bin;d:\tools\bea103\JROCKI~1\bin;C:\tools\WebSphereMQ\Java\lib;C:\oracle\ora92\bin;C:\Program Files\O0racle\jre\1.3.1\bin;C:\Program Files\Oracle\jre\1.1.8\bin2;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\tools\apache-ant-1.5.4\bin;C:\tibco\tibrv\BIN;D:\bea81\jdk142_11\bin;D:\DB2\IBM\SQLLIB\BIN;D:\DB2\IBM\SQLLIB\FUNCTION;D:\DB2\IBM\SQLLIB\SAMPLES\REPL;D:/work/cim70HF1/venus_dist_was/bin/db2ldr;C:\tools\WebSphereMQ\bin;C:\tools\WebSphereMQ\tools\c\samples\bin;D:\tools\bea103\WLSERV~1.3\server\native\win\32\oci920_8
C Heap : Good; no memory allocations have failed
Method : com/martquest/entity/roleassignment/RoleAssignmentEntPKey.hashCode()I
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x256BED00 / OS context: 0x256BF0EC):
eax = 0000001b ecx = 2ff00210 edx = 2ff00960 ebx = 2ff07a40
esp = 256bf3b8 ebp = 2ff04a28 esi = 256bf574 edi = 2f5626e8
es = 00000023 cs = 0000001b ss = 00000023 ds = 00000023
fs = 0000003b gs = 00000000
eip = 0046d11a eflags = 00010202
Stack:
(* marks the word pointed to by the stack pointer)
256bf3b8: 256bf574* 256bf5b5 000000b5 000000a9 00000000 0047b101
256bf3d0: 0000001b 2ff079b0 00000000 00000039 256bf574 00000038
256bf3e8: 000000a9 2432042c 256bf424 00000030 0042f73c 256bf5b5
256bf400: 00000039 2ff04a28 2ff048e0 2ff04a28 00000042 00000005
Code:
(* marks the word pointed to by the instruction pointer)
0046d0e8: 6a57006a e8515302 0003419c 833c468b c08540c4 0e8b5a75
0046d100: c085018b 008b0274 082440f6 518b4a75 003a830c 448b4274
0046d118: 108b1824* 0000e281 fa811ff0 00100000 d2330474 408b05eb
0046d130: 8b108b18 74c08501 f6008b02 74082440 ebc03304 0c498b05
Loaded modules:
(* denotes the module causing the exception)
00400000-00410fff d:\tools\bea103\JROCKI~1\bin\java.exe
7c900000-7c9aefff C:\WINDOWS\system32\ntdll.dll
7c800000-7c8f5fff C:\WINDOWS\system32\kernel32.dll
77dd0000-77e6afff C:\WINDOWS\system32\ADVAPI32.dll
77e70000-77f01fff C:\WINDOWS\system32\RPCRT4.dll
77fe0000-77ff0fff C:\WINDOWS\system32\Secur32.dll
77c10000-77c67fff C:\WINDOWS\system32\MSVCRT.dll
7c340000-7c395fff d:\tools\bea103\JROCKI~1\jre\bin\msvcr71.dll
00420000-006c3fff *d:\tools\bea103\JROCKI~1\jre\bin\jrockit\jvm.dll
76b40000-76b6cfff C:\WINDOWS\system32\WINMM.dll
77f10000-77f58fff C:\WINDOWS\system32\GDI32.dll
7e410000-7e4a0fff C:\WINDOWS\system32\USER32.dll
71ab0000-71ac6fff C:\WINDOWS\system32\WS2_32.dll
71aa0000-71aa7fff C:\WINDOWS\system32\WS2HELP.dll
6d410000-6d438fff d:\tools\bea103\JROCKI~1\jre\bin\jdwp.dll
6d770000-6d775fff d:\tools\bea103\JROCKI~1\jre\bin\npt.dll
6d820000-6d82bfff d:\tools\bea103\JROCKI~1\jre\bin\verify.dll
6d3c0000-6d3defff d:\tools\bea103\JROCKI~1\jre\bin\java.dll
6d320000-6d327fff d:\tools\bea103\JROCKI~1\jre\bin\hpi.dll
6d860000-6d86efff D:\tools\bea103\jrockit_160_05\jre\bin\zip.dll
6d290000-6d296fff d:\tools\bea103\JROCKI~1\jre\bin\dt_socket.dll
71a50000-71a8efff C:\WINDOWS\system32\mswsock.dll
662b0000-66307fff C:\WINDOWS\system32\hnetcfg.dll
71a90000-71a97fff C:\WINDOWS\System32\wshtcpip.dll
6d620000-6d632fff D:\tools\bea103\jrockit_160_05\jre\bin\net.dll
00bf0000-00bf7fff C:\WINDOWS\System32\winrnr.dll
237e0000-23806fff C:\WINDOWS\system32\DNSAPI.dll
23810000-2383bfff C:\WINDOWS\system32\WLDAP32.dll
23840000-2384dfff C:\Program Files\Neoteris\Secure Application Manager\samnsp.dll
23870000-23888fff C:\WINDOWS\system32\iphlpapi.dll
238a0000-238a5fff C:\WINDOWS\system32\rasadhlp.dll
6d570000-6d578fff D:\tools\bea103\jrockit_160_05\jre\bin\management.dll
6d640000-6d648fff D:\tools\bea103\jrockit_160_05\jre\bin\nio.dll
68000000-68035fff C:\WINDOWS\system32\rsaenh.dll
769c0000-76a73fff C:\WINDOWS\system32\USERENV.dll
5b860000-5b8b4fff C:\WINDOWS\system32\netapi32.dll
229c0000-229cafff D:\tools\bea103\jrockit_160_05\jre\bin\jmapi.dll
229d0000-229ddfff D:\tools\bea103\wlserver_10.3\server\native\win\32\wlfileio2.dll
25c10000-25c27fff C:\WINDOWS\system32\MPRAPI.dll
77cc0000-77cf1fff C:\WINDOWS\system32\ACTIVEDS.dll
25c30000-25c54fff C:\WINDOWS\system32\adsldpc.dll
76b20000-76b30fff C:\WINDOWS\system32\ATL.DLL
774e0000-7761cfff C:\WINDOWS\system32\ole32.dll
25c60000-25ceafff C:\WINDOWS\system32\OLEAUT32.dll
25cf0000-25cfdfff C:\WINDOWS\system32\rtutils.dll
71bf0000-71c02fff C:\WINDOWS\system32\SAMLIB.dll
77920000-77a12fff C:\WINDOWS\system32\SETUPAPI.dll
25d40000-25d44fff D:\tools\bea103\wlserver_10.3\server\native\win\32\wlntio.dll
6d800000-6d807fff D:\tools\bea103\jrockit_160_05\jre\bin\sunmscapi.dll
77a80000-77b14fff C:\WINDOWS\system32\CRYPT32.dll
77b20000-77b31fff C:\WINDOWS\system32\MSASN1.dll
76bf0000-76bfafff C:\WINDOWS\system32\psapi.dll
6d7c0000-6d7c5fff D:\tools\bea103\jrockit_160_05\jre\bin\rmi.dll
34340000-34452fff d:\tools\bea103\JROCKI~1\jre\bin\dbghelp.dll
"[ACTIVE] ExecuteThread: '0' for" id=17 idx=0x44 tid=4552 lastJavaFrame=0x256BF874
Stack 0: start=0x25680000, end=0x256C0000, guards=0x25683000 (ok), forbidden=0x25681000
Thread Stack Trace:
at modelPutField+458(efield.c:198+38)@0x0046D11A
at generateExpression+3841(expression.c:723+16)@0x0047B101
at generate_block+220(bc2hir.c:1284+0)@0x0042F73C
at generateIRFromOffset+262(bc2hir.c:1042+6)@0x0042FB16
at cgTranslateBC2HIR+87(bc2hir.c:172+0)@0x004305D7
at cmgrGenerateMethodFromPhase+121(codemanager.c:1107+25)@0x0044B719
at cmgrGenerateNormalMethod+81(codemanager.c:773+0)@0x0044C1B1
at cmgrGenerateCode+157(codemanager.c:732+0)@0x0044CA9D
at generate_code2+187(methodaccess.c:735+14)@0x005410CB
at generate_code+421(methodaccess.c:376+7)@0x00541AC5
at get_runnable_codeinfo2+157(methodaccess.c:508+10)@0x00541BED
at RJNI_jrockit_vm_RNI_generateVirtualCode+266(methodaccess.c:646+11)@0x00541F1A
-- Java stack --
at jrockit/vm/RNI.generateVirtualCode(Ljava/lang/Object;II)I(Native Method)
at com/martquest/entity/roleassignment/RoleAssignmentEntPKey.hashCode(RoleAssignmentEntPKey.java:0)
at weblogic/ejb/container/cache/CacheKey.<init>(CacheKey.java:26)
at weblogic/ejb/container/manager/DBManager.create(DBManager.java:1480)
at weblogic/ejb/container/manager/DBManager.remoteCreate(DBManager.java:1360)
at weblogic/ejb/container/internal/EntityEJBHome.create(EntityEJBHome.java:272)
at com/martquest/entity/roleassignment/RoleAssignmentEnt_d9pexc_HomeImpl.create(RoleAssignmentEnt_d9pexc_HomeImpl.java:74)
at com/martquest/session/role/RoleAssignmentSsnBean.createRoleAssignment(RoleAssignmentSsnBean.java:149)
at com/martquest/session/role/RoleAssignmentSsn_dgtk4w_EOImpl.createRoleAssignment(RoleAssignmentSsn_dgtk4w_EOImpl.java:644)
at com/martquest/eml/member/MemberViewServlet.insert(MemberViewServlet.java:1665)
at com/martquest/eml/member/MemberViewServlet.routeAction(MemberViewServlet.java:150)
at com/martquest/eml/member/MemberViewServlet.onService(MemberViewServlet.java:129)
at com/martquest/eml/MqServlet.service(MqServlet.java:487)
at javax/servlet/http/HttpServlet.service(HttpServlet.java:820)
at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)
at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:175)
at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3495)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic/security/service/SecurityManager.runAs(Lweblogic/security/acl/internal/AuthenticatedSubject;Lweblogic/security/acl/internal/AuthenticatedSubject;Ljava/security/PrivilegedAction;)Ljava/lang/Object;(Unknown Source)
at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2180)
at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2086)
at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1406)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================

Looks like JRockit crashes when JIT compiling the method com/martquest/entity/roleassignment/RoleAssignmentEntPKey.hashCode. You can try the latest JRockit version, R27.6.3, which is available from Oracle Support or bundled with JRMC 3.1 here:
http://www.oracle.com/technology/software/products/jrockit/index.html
If that doesn't help, I recommend that you open a ticket with Oracle Support and provide the text dump, the core file and compiled RoleAssignmentEntPKey.class; and ask for a JVM patch.
Henrik

Similar Messages

Determine the method optimizing which the Jrockit JVM crashed.

I have an application that is running on Jrockit JVM. which crashed after 3-4 hours.
From the jrockit.<pid>.dump I could determine that the crash was on the Thread: "(Code Optimization Thread 1) .
And by using -XnoOpt we can stop code Optimization.
However, how do we determine which exact method caused it so that i can use the option -XX:OptFile
I am running Jrockit R28.0.1-21-133393-1.6.0_20-20100512-2126-linux-x86_64
on RED HAT LINUX 5.3 (64 bit)
Thread:
"(Code Optimization Thread 1)" id=5 idx=0x54 tid=29997 lastJavaFrame=0xfffffffffffffffc
Stack 0: start=0x41a70000, end=0x41ab2000, guards=0x41a75000 (ok), forbidden=0x41a73000
Thread Stack Trace:
at mspace_free+473(osal_mspace.c:4608)
at irAliasValidate+1760(aliases.c:558)
at irInfoGet+61(irinfo.c:143)
at irAliasMustBeAliases+59(aliases.c:112)
at update_callvector+4976(inline.c:284)

Many bugs were reported for JVM crast at acGetOperand in JRockit R27.x
But no bugs are reported exactly with the same stack trace.
Regarding a workaround, the below stack is actually misleading us. It does not give us a clue about the reasons for the crash (whether it is happening due to concurrent GC or parallel GC or Compaction etc.), so we cannot really say what GC settings would avoid it.
I recommend that we collect another textual dump if the crash occurs again and hope that the stack trace generated the next time will give us better insight into the root cause.
Another suggestion would be to upgrade to R28.x

JRockit JVM crash using RHEL 4

Hi,
I am using BEA JRockit(R) R27.5.0-110-94909-1.5.0_14-20080204-1558-linux-x86_64 on RHEL 4 (update 5) running 64 bit AMD Athlon processor. I got a JVM crash from an application which has been running stable all this time. The crash occured 1 hour after the application was started. The error message is "Illegal memory access". From the older discussion forums in BEA I found that this crash is possibly due to a bug in JIT optimization. Below is the complete dump from the crash. It would be great if someone can confirm that this crash is due to the same bug or something else.
Thanks,
Rakesh
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 01:06:20 on Tue Jan 20 10:23:21 2009
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
/ha/apps/bin/jrockit.2041.dump
No snapshot file (core dump) will be created because core dumps have been
disabled. To enable core dumping, try "ulimit -c unlimited"
before starting JRockit again.
Error Message: Illegal memory access. 54
Signal info : si_signo=11, si_code=128 si_addr=(nil)
Version : BEA JRockit(R) R27.5.0-110-94909-1.5.0_14-20080204-1558-linux-x86_64
GC Strategy : Mode: static, with strategy: singleconcon
GC Status : OC currently running, in phase: marking. This is OC#746.
Heap : 0x2d00000 - 0x22d00000 (Size: 512 MB)
Compaction : 0xdd00000 - 0xe100000 (Current compaction type: internal)
CompRefs : References are compressed, with heap base 0x0.
CPU : AMD Opteron/Athlon64 SSE SSE2 SSE3 EM64T
Number CPUs : 8
Tot Phys Mem : 67561517056 (64431 MB)
OS version : Red Hat Enterprise Linux AS release 4 (Nahant Update 4)
Linux version 2.6.9-42.0.8.ELsmp ([email protected]) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Tue Jan 23 12:49:51 EST 2007 (x86_64)
Thread System: NPTL
Java locking : Normal
State : JVM is running
Command Line : -Xms512M -Xmx1024M -Xss128M -Xgc:singlecon -XXcompactratio:1 -Djava.ext.dirs=/cms/lib/:/cms/ext/:/ha/apps/lib/:/ha/OracleJar/:/ha/dbwrapper/:.: -DserverID=prod -DSystemProperties=/ha/hi/properties/HITcpBootstrap.prp -Dpid=2041 -Dsun.java.launcher=SUN_STANDARD com.ups.coii.tos.server.TOSServer
java.home : /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre
j.class.path : .
j.lib.path : /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/opt/mqm/java/lib64/:/opt/mqm/java/lib/
JAVA_HOME : <not set>
JAVAOPTIONS: <not set>
LD_LIBRARY_PATH: /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/opt/mqm/java/lib64/:/opt/mqm/java/lib/
LD_ASSUME_KERNEL: <not set>
C Heap : Good; no memory allocations have failed
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x42d82960 / OS context: 0x42d82a20):
rax = 040000000174c008 rcx = 0000000000000000
rdx = 0000002a95fe6b70 rbx = 0000000000000002
rsp = 0000000042d82e60 rbp = 0000000042d82fc0
rsi = 000000001450000c rdi = 0000000042d82ec0
r8 = 0000000000000001 r9 = 0000002a96002dac
r10 = 0000002c7a72c140 r11 = 0000000000000021
r12 = 0000000000000002 r13 = 0000000042d82ec0
r14 = 0000002ad6893ff0 r15 = 0000000014500000
cs = 000000000000ab30 fs = 0000000000000000
gs = 0000000000000000
rip = 0000002a95df7d2d flags = 0000000000000246
Stack:
(* marks the word pointed to by the stack pointer)
0000000042d82e60: 0000002ad6893ff0* 0000002ad6893ff0 0000000042d82ec0 0000000042d82f60
0000000042d82e80: 0000002a961222c0 0000002ad6893ff0 0000000014500008 0000002d00000000
0000000042d82ea0: 0000000014500008 0000002d00000000 0000000014500008 0000002d00000000
0000000042d82ec0: 0000000000000000 0000002d00000000 0000000014500008 0000002a00000000
0000000042d82ee0: 0000000014500000 0000000000000000 00000000004ce628 0000000000000001
0000000042d82f00: 0000002a00000000 000000001450000c 00000000059165d8 00000000059167d8
Code:
(* marks the word pointed to by the instruction pointer)
0000002a95df7cc8: bd831ceb028b4821 48097503fffffed8 0aebfffffed0858b 48fffffed0858b48
0000002a95df7ce8: c08548c38948008b 8b4c00000102840f c48949fffffea8b5 48002c1a69058b48
0000002a95df7d08: e9c148082b48d989 06e8c148c8894803 00000008c5048d48 48002c12b9158b48
0000002a95df7d28: 008b483fe1830203* 485a7501a8e8d348 8948002c1a32058b 03e9c148082b48d9
0000002a95df7d48: 8306e8c148c88948 4800000001ba3fe1 048d48d18948e2d3 158b4800000008c5
0000002a95df7d68: 48020348002c1274 2c1837058b480809 8948087400388300 894cfff7ffa2e8df
Loaded modules:
(* denotes the module causing the exception)
0000000000400000-000000000041196b /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/bin/java
0000002a9566c000-0000002a9567aff9 /lib64/tls/libpthread.so.0
0000002a95782000-0000002a9580659b /lib64/tls/libm.so.6
0000002a95908000-0000002a95909c73 /lib64/libdl.so.2
0000002a95a0b000-0000002a95b35df9 /lib64/tls/libc.so.6
0000002a95556000-0000002a9556a34f /lib64/ld-linux-x86-64.so.2
0000002a95c41000-0000002a95ee448f */opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit/libjvm.so
0000002a96137000-0000002a9613f95a /lib64/tls/librt.so.1
0000002a96251000-0000002a9625497b /usr/lib64/libnuma.so
0000002a96356000-0000002a9635ff13 /lib64/libnss_files.so.2
0000002a964c1000-0000002a964cd467 /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libverify.so
0000002a965d0000-0000002a965f321b /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libjava.so
0000002a96707000-0000002a9671a503 /lib64/libnsl.so.1
0000002ad69ae000-0000002ad69b463f /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/native_threads/libhpi.so
0000002ad9a30000-0000002ad9a3dd93 /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libzip.so
0000002ad9db4000-0000002ad9dc55cf /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libnet.so
Scan Dump Helper:
Iterating in objIter over object at address 0x14500000 (seems to be real).
The reference that caused the crash is a normal field.
Scanned object [0000000014500000 0000000014500018) of class java/lang/ThreadLocal$ThreadLocalMap
0x14500000 : 0x004ce580 classblock
0x14500004 : 0x00000000 flags
===> 0x14500008 : 0x00000002 .table [Ljava/lang/ThreadLocal$ThreadLocalMap$Entry; (java/lang/ThreadLocal$ThreadLocalMap)
0x1450000c : 0x00000002
0x14500010 : 0x0000000a
0x14500014 : 0x00000000
The field that caused the crash is marked with "===>"
The reference is bogus and pointing outside the heap.
Only reference to this object from another object is
object [00000000059191e8 0000000005919278) of class com/ups/coii/thread/util/ThreadPool$PooledThread
0x59191e8 : 0x017b55f0 classblock
0x59191ec : 0x80000000 flags
0x59191f0 : 0x05919280 .name [C (java/lang/Thread)
0x59191f4 : 0x00000000 .threadQ Ljava/lang/Thread; (java/lang/Thread)
0x59191f8 : 0x00000000 .target Ljava/lang/Runnable; (java/lang/Thread)
0x59191fc : 0x02d02ae8 .group Ljava/lang/ThreadGroup; (java/lang/Thread)
0x5919200 : 0x05d50b48 .contextClassLoader Ljava/lang/ClassLoader; (java/lang/Thread)
0x5919204 : 0x059192c0 .inheritedAccessControlContext Ljava/security/AccessControlContext; (java/lang/Thread)
===> 0x5919208 : 0x14500000 .threadLocals Ljava/lang/ThreadLocal$ThreadLocalMap; (java/lang/Thread)
0x591920c : 0x059192d8 .inheritableThreadLocals Ljava/lang/ThreadLocal$ThreadLocalMap; (java/lang/Thread)
0x5919210 : 0x00000000 .blocker Lsun/nio/ch/Interruptible; (java/lang/Thread)
0x5919214 : 0x05919278 .blockerLock Ljava/lang/Object; (java/lang/Thread)
0x5919218 : 0x00000000 .uncaughtExceptionHandler Ljava/lang/Thread$UncaughtExceptionHandler; (java/lang/Thread)
0x591921c : 0x05916d38 .cwObj Ljava/lang/Object; (java/lang/Thread)
0x5919220 : 0x00000000 .blockObj Ljava/lang/Object; (java/lang/Thread)
0x5919224 : 0x04102cf0 .waitNext Ljava/lang/Thread; (java/lang/Thread)
0x5919228 : 0x00000000 .lockNext Ljava/lang/Thread; (java/lang/Thread)
0x591922c : 0x059191e8 .blockThreadStop Ljava/lang/Object; (java/lang/Thread)
0x5919230 : 0x00000000 .accessControlContext Ljava/security/AccessControlContext; (java/lang/Thread)
0x5919234 : 0x00000005
0x5919238 : 0x00000000
0x591923c : 0x00000000
0x5919240 : 0x00000000
0x5919244 : 0x00000000
0x5919248 : 0x00000026
0x591924c : 0x00000000
0x5919250 : 0xda213db0
0x5919254 : 0x0000002a
0x5919258 : 0x00000000
0x591925c : 0x00000000
0x5919260 : 0x000001a1
0x5919264 : 0x00000000
0x5919268 : 0x00000001
0x591926c : 0x05916150 .this$0 Lcom/ups/coii/thread/util/ThreadPool; (com/ups/coii/thread/util/ThreadPool$PooledThread)
0x5919270 : 0x00000000
0x5919274 : 0x00000000
"(GC Main Thread)" id=3 idx=0xc tid=2058 lastJavaFrame=0xfffffffffffffffc
Stack 0: start=0x42d42000, end=0x42d84000, guards=0x42d47000 (ok), forbidden=0x42d45000
Thread Stack Trace:
at mmSingleConFollowReferences+481()@0x2a95df7d2d
at mmSingleConMark+220()@0x2a95df87ab
at mmMark+82()@0x2a95cab846
at mmGCMainLoop+101()@0x2a95cab8eb
at mmGCMainThread+51()@0x2a95ce826e
at tsiCallStartFunction+67()@0x2a95d62bfb
at tsiThreadStub+308()@0x2a95d63e05
at ptiThreadStub+14()@0x2a95dcb277
at start_thread+138()@0x2a9567210a
-- Java stack --
Extended, platform specific info:
libc release: 2.3.4-stable
Elf headers:
libc ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000001c4a0 PHOFF: 0000000000000040 SHOFF: 000000000013c290 EF: 0x0 HS: 64 PS: 56 PHN; 10 SS: 64 SHN: 66 STIDX: 63
libpthread ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 0000000000005620 PHOFF: 0000000000000040 SHOFF: 0000000000011e48 EF: 0x0 HS: 64 PS: 56 PHN; 9 SS: 64 SHN: 35 STIDX: 32
libjvm ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000003f820 PHOFF: 0000000000000040 SHOFF: 000000000037bd90 EF: 0x0 HS: 64 PS: 56 PHN; 3 SS: 64 SHN: 22 STIDX: 19
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================

Hello Rakesh,
The crash is in GC code, possiibly caused by an incorrect reference on the heap. This could have been caused by an earlier JIT optimization issue or by a bug in GC or something else - we would need to analyze the full core to know for sure. If you want to pursue this, contact Oracle Support and provide us with the core.
Another tip is to upgrade to the latest JRockit version. The latest version available bundled with Oracle products is R27.6.0, I believe R27.6.1 is on its way out with a WLS 10 service pack but don't know the exact date.
Regards,
Henrik

JRockit JVM crash using RHEL 4 (update 5)

Hi,
I am using BEA JRockit(R) R27.5.0-110-94909-1.5.0_14-20080204-1558-linux-x86_64 on RHEL 4 (update 5) running 64 bit AMD Athlon processor. I got a JVM crash from an application which has been running stable all this time. The crash occured 1 hour after the application was started. The error message is "Illegal memory access". From the older discussion forums in BEA I found that this crash is possibly due to a bug in JIT optimization. Below is the complete dump from the crash. It would be great if someone can confirm that this crash is due to the same bug or something else.
Thanks,
Rakesh
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 01:06:20 on Tue Jan 20 10:23:21 2009
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
/ha/apps/bin/jrockit.2041.dump
No snapshot file (core dump) will be created because core dumps have been
disabled. To enable core dumping, try "ulimit -c unlimited"
before starting JRockit again.
Error Message: Illegal memory access. [54]
Signal info : si_signo=11, si_code=128 si_addr=(nil)
Version : BEA JRockit(R) R27.5.0-110-94909-1.5.0_14-20080204-1558-linux-x86_64
GC Strategy : Mode: static, with strategy: singleconcon
GC Status : OC currently running, in phase: marking. This is OC#746.
Heap : 0x2d00000 - 0x22d00000 (Size: 512 MB)
Compaction : 0xdd00000 - 0xe100000 (Current compaction type: internal)
CompRefs : References are compressed, with heap base 0x0.
CPU : AMD Opteron/Athlon64 SSE SSE2 SSE3 EM64T
Number CPUs : 8
Tot Phys Mem : 67561517056 (64431 MB)
OS version : Red Hat Enterprise Linux AS release 4 (Nahant Update 4)
Linux version 2.6.9-42.0.8.ELsmp ([email protected]) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Tue Jan 23 12:49:51 EST 2007 (x86_64)
Thread System: NPTL
Java locking : Normal
State : JVM is running
Command Line : -Xms512M -Xmx1024M -Xss128M -Xgc:singlecon -XXcompactratio:1 -Djava.ext.dirs=/cms/lib/:/cms/ext/:/ha/apps/lib/:/ha/OracleJar/:/ha/dbwrapper/:.: -DserverID=prod -DSystemProperties=/ha/hi/properties/HITcpBootstrap.prp -Dpid=2041 -Dsun.java.launcher=SUN_STANDARD com.ups.coii.tos.server.TOSServer
java.home : /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre
j.class.path : .
j.lib.path : /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/opt/mqm/java/lib64/:/opt/mqm/java/lib/
JAVA_HOME : <not set>
JAVAOPTIONS: <not set>
LD_LIBRARY_PATH: /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/opt/mqm/java/lib64/:/opt/mqm/java/lib/
LD_ASSUME_KERNEL: <not set>
C Heap : Good; no memory allocations have failed
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x42d82960 / OS context: 0x42d82a20):
rax = 040000000174c008 rcx = 0000000000000000
rdx = 0000002a95fe6b70 rbx = 0000000000000002
rsp = 0000000042d82e60 rbp = 0000000042d82fc0
rsi = 000000001450000c rdi = 0000000042d82ec0
r8 = 0000000000000001 r9 = 0000002a96002dac
r10 = 0000002c7a72c140 r11 = 0000000000000021
r12 = 0000000000000002 r13 = 0000000042d82ec0
r14 = 0000002ad6893ff0 r15 = 0000000014500000
cs = 000000000000ab30 fs = 0000000000000000
gs = 0000000000000000
rip = 0000002a95df7d2d flags = 0000000000000246
Stack:
(* marks the word pointed to by the stack pointer)
0000000042d82e60: 0000002ad6893ff0* 0000002ad6893ff0 0000000042d82ec0 0000000042d82f60
0000000042d82e80: 0000002a961222c0 0000002ad6893ff0 0000000014500008 0000002d00000000
0000000042d82ea0: 0000000014500008 0000002d00000000 0000000014500008 0000002d00000000
0000000042d82ec0: 0000000000000000 0000002d00000000 0000000014500008 0000002a00000000
0000000042d82ee0: 0000000014500000 0000000000000000 00000000004ce628 0000000000000001
0000000042d82f00: 0000002a00000000 000000001450000c 00000000059165d8 00000000059167d8
Code:
(* marks the word pointed to by the instruction pointer)
0000002a95df7cc8: bd831ceb028b4821 48097503fffffed8 0aebfffffed0858b 48fffffed0858b48
0000002a95df7ce8: c08548c38948008b 8b4c00000102840f c48949fffffea8b5 48002c1a69058b48
0000002a95df7d08: e9c148082b48d989 06e8c148c8894803 00000008c5048d48 48002c12b9158b48
0000002a95df7d28: 008b483fe1830203* 485a7501a8e8d348 8948002c1a32058b 03e9c148082b48d9
0000002a95df7d48: 8306e8c148c88948 4800000001ba3fe1 048d48d18948e2d3 158b4800000008c5
0000002a95df7d68: 48020348002c1274 2c1837058b480809 8948087400388300 894cfff7ffa2e8df
Loaded modules:
(* denotes the module causing the exception)
0000000000400000-000000000041196b /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/bin/java
0000002a9566c000-0000002a9567aff9 /lib64/tls/libpthread.so.0
0000002a95782000-0000002a9580659b /lib64/tls/libm.so.6
0000002a95908000-0000002a95909c73 /lib64/libdl.so.2
0000002a95a0b000-0000002a95b35df9 /lib64/tls/libc.so.6
0000002a95556000-0000002a9556a34f /lib64/ld-linux-x86-64.so.2
0000002a95c41000-0000002a95ee448f */opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit/libjvm.so
0000002a96137000-0000002a9613f95a /lib64/tls/librt.so.1
0000002a96251000-0000002a9625497b /usr/lib64/libnuma.so
0000002a96356000-0000002a9635ff13 /lib64/libnss_files.so.2
0000002a964c1000-0000002a964cd467 /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libverify.so
0000002a965d0000-0000002a965f321b /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libjava.so
0000002a96707000-0000002a9671a503 /lib64/libnsl.so.1
0000002ad69ae000-0000002ad69b463f /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/native_threads/libhpi.so
0000002ad9a30000-0000002ad9a3dd93 /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libzip.so
0000002ad9db4000-0000002ad9dc55cf /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libnet.so
Scan Dump Helper:
Iterating in objIter over object at address 0x14500000 (seems to be real).
The reference that caused the crash is a normal field.
Scanned object [0000000014500000 0000000014500018) of class java/lang/ThreadLocal$ThreadLocalMap
0x14500000 : 0x004ce580 [classblock]
0x14500004 : 0x00000000 [flags]
===> 0x14500008 : 0x00000002 .table [Ljava/lang/ThreadLocal$ThreadLocalMap$Entry; (java/lang/ThreadLocal$ThreadLocalMap)
      0x1450000c : 0x00000002
      0x14500010 : 0x0000000a
      0x14500014 : 0x00000000
     The field that caused the crash is marked with "===>"
   The reference is bogus and pointing outside the heap.
   Only reference to this object from another object is
object [00000000059191e8 0000000005919278) of class com/ups/coii/thread/util/ThreadPool$PooledThread
      0x59191e8 : 0x017b55f0 [classblock]
0x59191ec : 0x80000000 [flags]
0x59191f0 : 0x05919280 .name [C (java/lang/Thread)
      0x59191f4 : 0x00000000 .threadQ Ljava/lang/Thread; (java/lang/Thread)
      0x59191f8 : 0x00000000 .target Ljava/lang/Runnable; (java/lang/Thread)
      0x59191fc : 0x02d02ae8 .group Ljava/lang/ThreadGroup; (java/lang/Thread)
      0x5919200 : 0x05d50b48 .contextClassLoader Ljava/lang/ClassLoader; (java/lang/Thread)
      0x5919204 : 0x059192c0 .inheritedAccessControlContext Ljava/security/AccessControlContext; (java/lang/Thread)
===> 0x5919208 : 0x14500000 .threadLocals Ljava/lang/ThreadLocal$ThreadLocalMap; (java/lang/Thread)
      0x591920c : 0x059192d8 .inheritableThreadLocals Ljava/lang/ThreadLocal$ThreadLocalMap; (java/lang/Thread)
      0x5919210 : 0x00000000 .blocker Lsun/nio/ch/Interruptible; (java/lang/Thread)
      0x5919214 : 0x05919278 .blockerLock Ljava/lang/Object; (java/lang/Thread)
      0x5919218 : 0x00000000 .uncaughtExceptionHandler Ljava/lang/Thread$UncaughtExceptionHandler; (java/lang/Thread)
      0x591921c : 0x05916d38 .cwObj Ljava/lang/Object; (java/lang/Thread)
      0x5919220 : 0x00000000 .blockObj Ljava/lang/Object; (java/lang/Thread)
      0x5919224 : 0x04102cf0 .waitNext Ljava/lang/Thread; (java/lang/Thread)
      0x5919228 : 0x00000000 .lockNext Ljava/lang/Thread; (java/lang/Thread)
      0x591922c : 0x059191e8 .blockThreadStop Ljava/lang/Object; (java/lang/Thread)
      0x5919230 : 0x00000000 .accessControlContext Ljava/security/AccessControlContext; (java/lang/Thread)
      0x5919234 : 0x00000005
      0x5919238 : 0x00000000
      0x591923c : 0x00000000
      0x5919240 : 0x00000000
      0x5919244 : 0x00000000
      0x5919248 : 0x00000026
      0x591924c : 0x00000000
      0x5919250 : 0xda213db0
      0x5919254 : 0x0000002a
      0x5919258 : 0x00000000
      0x591925c : 0x00000000
      0x5919260 : 0x000001a1
      0x5919264 : 0x00000000
      0x5919268 : 0x00000001
      0x591926c : 0x05916150 .this$0 Lcom/ups/coii/thread/util/ThreadPool; (com/ups/coii/thread/util/ThreadPool$PooledThread)
      0x5919270 : 0x00000000
      0x5919274 : 0x00000000
"(GC Main Thread)" id=3 idx=0xc tid=2058 lastJavaFrame=0xfffffffffffffffc
Stack 0: start=0x42d42000, end=0x42d84000, guards=0x42d47000 (ok), forbidden=0x42d45000
Thread Stack Trace:
    at mmSingleConFollowReferences+481()@0x2a95df7d2d
    at mmSingleConMark+220()@0x2a95df87ab
    at mmMark+82()@0x2a95cab846
    at mmGCMainLoop+101()@0x2a95cab8eb
    at mmGCMainThread+51()@0x2a95ce826e
    at tsiCallStartFunction+67()@0x2a95d62bfb
    at tsiThreadStub+308()@0x2a95d63e05
    at ptiThreadStub+14()@0x2a95dcb277
    at start_thread+138()@0x2a9567210a
    -- Java stack --
Extended, platform specific info:
libc release: 2.3.4-stable
Elf headers:
libc       ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000001c4a0 PHOFF: 0000000000000040 SHOFF: 000000000013c290 EF: 0x0 HS: 64 PS: 56 PHN; 10 SS: 64 SHN: 66 STIDX: 63
libpthread ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 0000000000005620 PHOFF: 0000000000000040 SHOFF: 0000000000011e48 EF: 0x0 HS: 64 PS: 56 PHN; 9 SS: 64 SHN: 35 STIDX: 32
libjvm     ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000003f820 PHOFF: 0000000000000040 SHOFF: 000000000037bd90 EF: 0x0 HS: 64 PS: 56 PHN; 3 SS: 64 SHN: 22 STIDX: 19
    * If you see this dump, please go to                    *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information.                      *
===== END DUMP ===============================================================

You should open a tar with support (http://metalink.oracle.com ; I am not sure if that is the correct support site for jrockit)
Because the information is all about jrockit and not linux, you probably are not going to get much help here.
You could try the jrockit forum: JRockit

JRockit JVM Crashed with the following dump

I am using JRockit VM as the JVM for the Integrated Weblogic Server with JDeveloper. I got this dump, when I was debugging my application. Just thought of sharing it here.
[JRockit] ERROR: The JVM has crashed. Writing crash information to /scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/jrockit.18628.dump.
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:46:27 on Sat Aug 20 19:49:11 2011
* If you see this dump, please go to *
* http://download.oracle.com/docs/cd/E15289_01/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/jrockit.18628.dump
No snapshot file (core dump) will be created because core dumps have been
disabled. To enable core dumping, try "ulimit -c unlimited"
before starting JRockit again.
Error Message: Illegal memory access. [54]
Signal info : si_signo=11, si_code=1 si_addr=0x13
Version : Oracle JRockit(R) R28.1.3-11-141760-1.6.0_24-20110301-1432-linux-x86_64
CPU : Intel Core 2 SSE SSE2 SSE3 SSSE3 SSE4.1 Core Intel64
Number CPUs : 2
Tot Phys Mem : 3978702848 (3794 MB)
OS version : Red Hat Enterprise Linux Server release 5.4 (Tikanga)
Linux version 2.6.18-164.0.0.0.1.el5 ([email protected]) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Thu Sep 3 00:21:28 EDT 2009 (x86_64)
Thread System: Linux NPTL
LibC release : 2.5-stable
Java locking : Normal
State : JVM is running
Command Line : -Xms256M -Xmx1536M -Dweblogic.Name=DefaultServer -Djava.security.policy=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/weblogic.policy -agentlib:jdwp=transport=dt_socket,server=y,address=8986 -Djavax.net.ssl.trustStore=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/DemoTrust.jks -Doracle.adfm.usemds=true -DAFLOG_ECHOED=Y -DAFLOG_ECHOED_PATTERN="[%t][%c][%m][%x]" -DAFLOG_ENABLED=Y -DAFLOG_LEVEL=FINEST -DAFLOG_MODULE=oracle.apps.projects.% -Djbo.debugoutput=silent -Djbo.jdbc.trace=false -Djbo.logging.trace.threshold=1 -Dweblogic.nodemanager.ServiceEnabled=true -Xverify:none -da -Dplatform.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3 -Dwls.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server -Dweblogic.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server -Djps.app.credential.overwrite.allowed=true -Dcommon.components.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common -Djrf.version=11.1.1 -Dorg.apache.commons.logging.Log=org.apache.commons.logging.impl.Jdk14Logger -Ddomain.home=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain -Djrockit.optfile=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.jrf_11.1.1/jrocket_optfile.txt -Doracle.server.config.dir=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig/servers/DefaultServer -Doracle.domain.config.dir=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig -Djava.util.logging.manager=oracle.core.ojdl.logging.ODLLogManager -Digf.arisidbeans.carmlloc=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig/carml -Digf.arisidstack.home=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig/arisidprovider -Doracle.security.jps.config=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig/jps-config.xml -Doracle.deployed.app.dir=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/servers/DefaultServer/tmp/_WL_user -Doracle.deployed.app.ext=/- -Dweblogic.alternateTypesDirectory=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.ossoiap_11.1.1,/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.oamprovider_11.1.1 -Djava.protocol.handler.pkgs=oracle.mds.net.protocol -Dweblogic.jdbc.remoteEnabled=false -Dwsm.repository.path=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/oracle/store/gmds -Datgpf.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Doracle.fusion.appsMode=true -DUSE_JAAS=false -Djps.policystore.hybrid.mode=false -Djps.combiner.optimize.lazyeval=true -Djps.combiner.optimize=true -Djps.auth=ACC -Doracle.core.ojdl.logging.usercontextprovider=oracle.core.ojdl.logging.impl.UserContextImpl -Xverify:none -Doracle.webcenter.analytics.disable-native-partitioning=false -Doracle.webcenter.tagging.scopeTags=false -Doracle.webcenter.framework.service.LOAD_FROM_MDS=true -Doracle.webcenter.framework.resource.authorizerClass.oracle.webcenter.page=oracle.webcenter.spaces.internal.model.GroupSpacePageResourceAuthorizer -Djrockit.codegen.newlockmatching=true -Dwc.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Dportlet.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Dweblogic.ejb.container.MDBDestinationPollIntervalMillis=30000 -Dweblogic.mdb.message.MinimizeAQSessions=true -Doracle.jdbc.createDescriptorUseCurrentSchemaForSchemaName=true -Djbo.ampool.minavailablesize=0 -Djbo.recyclethreshold=25 -Dbip.client.config.dir=/home/xxxxxxxx/XMLPClientConfigDir -Dweblogic.SocketReaders=3 -Djava.awt.headless=true -Dweblogic.transaction.blocking.commit=true -Dweblogic.transaction.blocking.rollback=true -Doracle.ecsf.crawl.mode.debug=true -Doracle.ecsf.applcore.session.enabled=true -DLWSSESSIONCONTEXT=oracle.apps.fnd.applcore.common.ApplSessionManagement -Dlog4j.debug=true -Djps.app.credential.overwrite.allowed=true -Dodi.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Dess.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Dweblogic.management.discover=true -Dwlw.iterativeDev= -Dwlw.testConsole= -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_wls1035/profiles/default/sysext_manifest_classpath:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_jdev1111/profiles/default/sysext_manifest_classpath -Dsun.java.launcher=SUN_STANDARD weblogic.Server
Repository : /tmp/2011_08_20_19_02_53_18628
java.home : /scratch/software/bea/jrockit/jre
j.class.path : /scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.jdbc_11.1.1/ojdbc6dms.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_wls1035/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_jdev1111/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/scratch/software/bea/jrockit/lib/tools.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/weblogic_sp.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/weblogic.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/modules/features/weblogic.server.modules_10.3.5.0.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/webservices.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/wcps-lib/derby-10.6.1.0.jar:/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/wcps-lib/derbytools-10.6.1.0.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper/modules/oracle.ess_11.1.1/ess-sec.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper/webcenter/modules/oracle.portlet.server_11.1.1/oracle-portlet-api.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.jrf_11.1.1/jrf.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper/webcenter/modules/wcps_11.1.1.4.0/wcps-connection-mbeans.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/common/derby/lib/derbyclient.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/xqrl.jar
j.lib.path : /scratch/software/bea/jrockit/jre/lib/amd64/jrockit:/scratch/software/bea/jrockit/jre/lib/amd64:/scratch/software/bea/jrockit/jre/../lib/amd64:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_wls1035/profiles/default/native:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_jdev1111/profiles/default/native:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/lib/i386/server:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/lib/i386:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/../lib/i386:/usr/lib:/ade/xxxxxxxx_fixcommit/dmsc/lib:/ade/xxxxxxxx_fixcommit/ldap/bin:/ade/xxxxxxxx_fixcommit/oracle/lib:/ade/xxxxxxxx_fixcommit/atgpf/lib/linuxx64:/ade/xxxxxxxx_fixcommit/fusionapps/lib/linuxx64:/ade/xxxxxxxx_fixcommit/fusionapps/hcm/pyt/lib/linuxx64:/ade/xxxxxxxx_fixcommit/bishiphome/dist/clients/epm/Essbase/EssbaseRTC/bin:/ade/xxxxxxxx_fixcommit/opmn/lib:/ade/xxxxxxxx_fixcommit/fatp/linuxx64/demantra/bin:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/native/linux/i686:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/native/linux/i686/oci920_8
JAVA_HOME : /scratch/software/bea/jrockit
JAVAOPTIONS: <not set>
LD_LIBRARY_PATH: /scratch/software/bea/jrockit/jre/lib/amd64/jrockit:/scratch/software/bea/jrockit/jre/lib/amd64:/scratch/software/bea/jrockit/jre/../lib/amd64:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_wls1035/profiles/default/native:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_jdev1111/profiles/default/native:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/lib/i386/server:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/lib/i386:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/../lib/i386:/usr/lib:/ade/xxxxxxxx_fixcommit/dmsc/lib:/ade/xxxxxxxx_fixcommit/ldap/bin:/ade/xxxxxxxx_fixcommit/oracle/lib:/ade/xxxxxxxx_fixcommit/atgpf/lib/linuxx64:/ade/xxxxxxxx_fixcommit/fusionapps/lib/linuxx64:/ade/xxxxxxxx_fixcommit/fusionapps/hcm/pyt/lib/linuxx64:/ade/xxxxxxxx_fixcommit/bishiphome/dist/clients/epm/Essbase/EssbaseRTC/bin:/ade/xxxxxxxx_fixcommit/opmn/lib:/ade/xxxxxxxx_fixcommit/fatp/linuxx64/demantra/bin:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/native/linux/i686:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/native/linux/i686/oci920_8
LD_ASSUME_KERNEL: <not set>
LD_PRELOAD : <not set>
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
C Heap : Good; no memory allocations have failed
GC Strategy : Mode: throughput, with strategy: genparpar (basic strategy: genparpar)
GC Status : OC is not running. Last finished OC was OC#18.
: YC is not running. Last finished YC was YC#150.
YC Promotion : Last YC successfully promoted all objects
YC History : Ran 7 YCs before OC#14.
: Ran 3 YCs before OC#15.
: Ran 26 YCs before OC#16.
: Ran 9 YCs before OC#17.
: Ran 18 YCs before OC#18.
: Ran 9 YCs since last OC.
Heap : 0xa0000000 - 0xbf417000 (Size: 500 MB)
Heap History : OC#7 - 0xb0000000 (256 MB -> 303 MB; +47856 KB)
: OC#11 - 0xb2ebc000 (303 MB -> 343 MB; +41060 KB)
: OC#12 - 0xb56d5000 (343 MB -> 393 MB; +51672 KB)
: OC#15 - 0xb894b000 (393 MB -> 443 MB; +50700 KB)
: OC#16 - 0xbbace000 (443 MB -> 500 MB; +58660 KB)
Compaction : (no compaction area)
Allocation : TLA-min: 2048, TLA-preferred: 65536 TLA-waste limit: 2048
NurseryList : 0xa1ac4930 - 0xb2659cf8
KeepArea : 0xad7221e8 - 0xaea1a448
KA Markers : [ 0xad7221e8, 0xaea1a448 , 0xb2659cf8 ]
Forbidden A : (none)
Previous KA : 0xaea1a448 - 0xb2659cf8
Previous FA : (none)
CompRefs : References are compressed, with heap base 0x0 and shift 0.
Registers (from ThreadContext: 0x40ee7820:
rax = 0000000000000000 rcx = 74752f6176616a4c
rdx = 0000000040ee7d60 rbx = 0000000000000000
rsp = 0000000040ee7c60 rbp = 0000000040ee7c90
rsi = 0000000000000001 rdi = 000000000d0b37e0
r8 = 003b7465532f6c69 r9 = 0000000000000001
r10 = 0000000000000000 r11 = 0000000000000001
r12 = 0000000000000001 r13 = 0000000040ee7d58
r14 = 0000000040ee7d60 r15 = 000000000db4d368
cs = 0000000000000033 fs = 0000000400000000
gs = 0004000000000000
rip = 00002ad027bc7a63 flags = 0000000000000202
Loaded modules:
(* denotes the module where the exception occured)
0000000000400000-0000000000412703 /scratch/software/bea/jrockit/bin/java
000000379b800000-000000379b801f93 /lib64/libdl.so.2
000000379c000000-000000379c0156ff /lib64/libpthread.so.0
000000379b400000-000000379b54ced7 /lib64/libc.so.6
000000379a400000-000000379a41bb3f /lib64/ld-linux-x86-64.so.2
00002ad027a60000-00002ad027d65343 */scratch/software/bea/jrockit/jre/lib/amd64/jrockit/libjvm.so
00002ad02803f000-00002ad02805d9eb /scratch/software/bea/jrockit/jre/lib/amd64/libosal.so
00002ad028260000-00002ad02826c4fb /scratch/software/bea/jrockit/jre/lib/amd64/libutil.so
000000379bc00000-000000379bc8122f /lib64/libm.so.6
000000379f400000-000000379f406e8b /lib64/librt.so.1
00002aaaaac00000-00002aaaaac35c17 /scratch/software/bea/jrockit/jre/lib/amd64/libjdwp.so
00002aaaaad3f000-00002aaaaad41307 /scratch/software/bea/jrockit/jre/lib/amd64/libnpt.so
00002aaaaae49000-00002aaaaae54d03 /scratch/software/bea/jrockit/jre/lib/amd64/libjfr.so
00002aaaee50b000-00002aaaee517337 /scratch/software/bea/jrockit/jre/lib/amd64/libverify.so
00002aaaee61a000-00002aaaee64219b /scratch/software/bea/jrockit/jre/lib/amd64/libjava.so
00000037a2000000-00000037a20140c7 /lib64/libnsl.so.1
00002aaaee789000-00002aaaee78f5bf /scratch/software/bea/jrockit/jre/lib/amd64/native_threads/libhpi.so
00002aaaee954000-00002aaaee961bc3 /scratch/software/bea/jrockit/jre/lib/amd64/libzip.so
00002aaaeeb28000-00002aaaeeb2ae73 /scratch/software/bea/jrockit/jre/lib/amd64/libdt_socket.so
00002aaaeec7b000-00002aaaeec8464b /lib64/libnss_files.so.2
00002aaaef086000-00002aaaef098d1f /scratch/software/bea/jrockit/jre/lib/amd64/libnet.so
00002aaaef652000-00002aaaef657f43 /scratch/software/bea/jrockit/jre/lib/amd64/liborii.so
00002aaaef919000-00002aaaef91f97b /scratch/software/bea/jrockit/jre/lib/amd64/libnio.so
00002aaaf4840000-00002aaaf484547b /scratch/software/bea/jrockit/jre/lib/amd64/libmanagement.so
00002aaaf740f000-00002aaaf7418bbb /scratch/software/bea/jrockit/jre/lib/amd64/libjmapi.so
00002aab02cbe000-00002aab02cbe8bb /scratch/software/bea/jrockit/jre/lib/amd64/librmi.so
00002aab05c3e000-00002aab05ccf86b /scratch/software/bea/jrockit/jre/lib/amd64/libawt.so
00002aab05e0d000-00002aab05e1199f /scratch/software/bea/jrockit/jre/lib/amd64/headless/libmawt.so
00002aab09453000-00002aab094cb21f /scratch/software/bea/jrockit/jre/lib/amd64/libfontmanager.so
Stack:
(* marks the word pointed to by the stack pointer)
0000000040ee7c60: 000000000d133ac0* 00002aaaf31531d0 0000000000000000 0000000040ee7d50
0000000040ee7c80: 0000000040ee7d58 000000000d0b37e0 0000000040ee7cd0 00002ad027bb10bf
0000000040ee7ca0: 0000000000000001 0000000000000064 000000000dd11ed0 000000000d0b37e0
0000000040ee7cc0: 0000000040ee7d60 0000000040ee7d58 0000000040ee7d40 00002ad027bb2404
0000000040ee7ce0: 0000000040ee7d60 000000000dd11ed0 0000000040ee7d50 00002aab08b2ea20
0000000040ee7d00: 0000000012469d70 00002aab08b2ea20 00002aab08b25a38 00002aaaaad360f0
Code:
(* marks the word pointed to by the instruction pointer)
00002ad027bc7a00: 00401f0fd7ebed31 480010b89f058d4c 8d48001249050d8d 3d8d48001025bb35
00002ad027bc7a20: 000018ba001024f1 ffed6d18e8c03100 2e66666666669eeb 0000000000841f0f
00002ad027bc7a40: e865894ce5894855 48f48949f875894c 48f06d894ce05d89 8949f6854830ec83
00002ad027bc7a60: 481246b70f4d74d6* 4c01688d4cd8558d 85fffffd99e8ee89 7d8b481775c389c0
00002ad027bc7a80: ea894c24348b49d8 458b48ffed793be8 8b4cd889068949d8 8b4ce05d8b48e865
00002ad027bc7aa0: c3c9f8758b4cf06d 0000000000841f0f 89fffffea9e8f631 0000441f0fd9ebc3
Last optimized methods:
No methods optimized.
Thread:
"JDWP Transport Listener: dt_soc" id=10 idx=0x30 tid=18640 lastJavaFrame=0xfffffffffffffffc
Stack 0: start=0x40ea7000, end=0x40ee9000, guards=0x40eac000 (ok), forbidden=0x40eaa000
Thread Stack Trace:
at jvmtiIStrdup+35(jvmtimemory.c:111)@0x2ad027bc7a63
at get_name_and_signatures+110(jvmticlass.c:931)@0x2ad027bb10bf
at jvmti_GetFieldName+611(jvmticlass.c:283)@0x2ad027bb2404
at fieldSignature+108()@0x2aaaaac27bdd
-- Java stack --
Memory usage report:
Total mapped 3530424KB (reserved=2192956KB)
- Java heap 1572864KB (reserved=1060772KB)
- GC tables 52620KB
- Thread stacks 32156KB (#threads=84)
- Compiled code 1048576KB (used=37710KB)
- Internal 1416KB
- OS 298768KB
- Other 192248KB
- Classblocks 18688KB (malloced=18313KB #46446)
Not tracing sites.
- Java class data 312064KB (malloced=310392KB #215032 in 46446 classes)
Not tracing sites.
- Native memory tracking 1024KB (malloced=153KB #10)
Not tracing sites.
Set the env variable TRACE_ALLOC_SITES=1 or use the print_memusage switch
trace_alloc_sites=true to enable alloc site tracing.
* If you see this dump, please go to *
* http://download.oracle.com/docs/cd/E15289_01/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================
/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/bin/startWebLogic.sh: line 180: 18628 Aborted ${JAVA_HOME}/bin/java ${JAVA_VM} ${MEM_ARGS} -Dweblogic.Name=${SERVER_NAME} -Djava.security.policy=${WL_HOME}/server/lib/weblogic.policy ${JAVA_OPTIONS} ${PROXY_SETTINGS} ${SERVER_CLASS}
Debugger connection to debuggee process has been lost.
[Server Instance IntegratedWebLogicServer is shutting down. All applications currently running will be terminated and undeployed.]

Hi DH,
This is a known issue to the engineering team and a future release will include a fix for this. Unfortunately, at this point there is no work around available.
I will recommend that you keep an eye on our release notes page to get more updates on it - Release notes | Adobe Muse CC
- Abhishek Maurya

JRockit JVM Crash Without Dump

I am running Windows Server 2003 with WebLogic Server Express 8.1 SP 4 and JRockit 1.4.2_05. I have an administrative server and 2 managed servers running on the same physical server with about 60 web applications spread across both managed servers. The administrative server starts as a Windows Service and the managed servers are started by calling weblogic.admin from a batch job that runs on server start.
My issue is that the 2 java.exe processes representing the managed servers both terminate without explanation at the same time. There is no dump or error messages from Jrockit. The only related messages on the server mention that commnication with the managed servers was lost.
The 2 managed servers run at times for a period of days before crashing and at other times they will crash twice in 20 minutes.
I have attempted to use the -Djrockit.waitonerror parameter in order to get a dump when the JVM is shutting down, but the process just crashes without prompting for a debug dump.
I have opened a case with BEA, but at this point they are saying that without a dump on crash they are not going to be able to do much....
Anyone out there know of any way to force JRockit to perform a dump if the process is terminating? Anyone come across an issue like this before? I find it unusual that they would be die at the same time each and every time.
Any help would be greatly appreciated.
Thanks-
Rich Platt

What have you done to make sure it's JRockit that is terminating
prematurely rather than the Java program? Those sound like exactly the
kinds of symptoms you'd get from a Java program doing System.exit(0).
//Johan
Richard Platt wrote:
I am running Windows Server 2003 with WebLogic Server Express 8.1 SP 4 and JRockit 1.4.2_05. I have an administrative server and 2 managed servers running on the same physical server with about 60 web applications spread across both managed servers. The administrative server starts as a Windows Service and the managed servers are started by calling weblogic.admin from a batch job that runs on server start.
My issue is that the 2 java.exe processes representing the managed servers both terminate without explanation at the same time. There is no dump or error messages from Jrockit. The only related messages on the server mention that commnication with the managed servers was lost.
The 2 managed servers run at times for a period of days before crashing and at other times they will crash twice in 20 minutes.
I have attempted to use the -Djrockit.waitonerror parameter in order to get a dump when the JVM is shutting down, but the process just crashes without prompting for a debug dump.
I have opened a case with BEA, but at this point they are saying that without a dump on crash they are not going to be able to do much....
Anyone out there know of any way to force JRockit to perform a dump if the process is terminating? Anyone come across an issue like this before? I find it unusual that they would be die at the same time each and every time.
Any help would be greatly appreciated.
Thanks-
Rich Platt

JVM crashes with jdeveloper 11g and jrockit 6

When i run my application its al going well, when i call some to show data, then all is going well,
but when i would like to save some, then the jvm crashes, and i have no idea, i've added arguments in the jvm run configuration, etc nothing seems to work, has anybody any idea, because im getting very desperate.
[JRockit] ERROR: The JVM has crashed. Writing crash information to C:\Oracle\Middleware\jdeveloper\system\system11.1.1.0.31.52.05\DefaultDomain\jrockit.6136.dump.
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:01:35 on Thu Aug 20 16:02:44 2009
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
C:\Oracle\Middleware\jdeveloper\system\system11.1.1.0.31.52.05\DefaultDomain\jrockit.6136.dump
C:\Oracle\Middleware\jdeveloper\system\system11.1.1.0.31.52.05\DefaultDomain\jrockit.6136.mdmp
Error Message: Illegal memory access. [54]
Exception Rec: EXCEPTION_ACCESS_VIOLATION (c0000005) at 0x00000000 - memory at 0x00000000 could not be read.
Minidump : Wrote mdmp. Size is 527MB
SafeDllMode : -1
Version : BEA JRockit(R) R27.6.3-40_o-112056-1.6.0_11-20090318-2104-windows-ia32
CPU : Intel Core 2 SSE SSE2 SSE3 SSSE3 SSE4.1 Core Intel64
Number CPUs : 2
Tot Phys Mem : 3715284992 (3543 MB)
OS version : Microsoft Windows XP version 5.1 Service Pack 3 (Build 2600) (32-bit)
Thread System: Windows Threads
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -Xms256m -Xmx512m -Djbo.debugoutput=console -Xmx512M -XX:MaxPermSize=512M -Xverify:none -da -Dplatform.home=C:\Oracle\MIDDLE~2\WLSERV~1.3 -Dwls.home=C:\Oracle\MIDDLE~2\WLSERV~1.3\server -Dweblogic.home=C:\Oracle\MIDDLE~2\WLSERV~1.3\server -Ddomain.home=C:\Oracle\MIDDLE~2\JDEVEL~1\system\SYSTEM~1.05\DEFAUL~1 -Doracle.home=C:\Oracle\Middleware\jdeveloper -Doracle.security.jps.config=C:\Oracle\MIDDLE~2\JDEVEL~1\system\SYSTEM~1.05\DEFAUL~1\config\oracle\jps-config.xml -Doracle.dms.context=OFF -Djava.protocol.handler.pkgs=oracle.mds.net.protocol -Dweblogic.management.discover=true -Dwlw.iterativeDev= -Dwlw.testConsole= -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=C:\Oracle\MIDDLE~2\patch_wls1030\profiles\default\sysext_manifest_classpath;C:\Oracle\MIDDLE~2\patch_jdev1111\profiles\default\sysext_manifest_classpath;C:\Oracle\MIDDLE~2\patch_cie660\profiles\default\sysext_manifest_classpath -Dweblogic.Name=DefaultServer -Djava.security.policy=C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home : C:\PROGRA~1\Java\JROCKI~1.0_1
j.class.path : ;C:\Oracle\MIDDLE~2\patch_wls1030\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\Oracle\MIDDLE~2\patch_jdev1111\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\Oracle\MIDDLE~2\patch_cie660\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\PROGRA~1\Java\JROCKI~1.0_1\lib\tools.jar;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\weblogic_sp.jar;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\weblogic.jar;C:\Oracle\MIDDLE~2\modules\features\weblogic.server.modules_10.3.0.0.jar;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\webservices.jar;C:\Oracle\MIDDLE~2\modules\ORGAPA~1.5/lib/ant-all.jar;C:\Oracle\MIDDLE~2\modules\NETSFA~1.0_1/lib/ant-contrib.jar;C:\Oracle\Middleware\jdeveloper\modules\features\adf.share_11.1.1.jar;;C:\Oracle\MIDDLE~2\WLSERV~1.3\common\eval\pointbase\lib\pbclient57.jar;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\xqrl.jar;;
j.lib.path : C:\PROGRA~1\Java\JROCKI~1.0_1\bin;.;C:\WINDOWS\system32;C:\WINDOWS;C:\Oracle\MIDDLE~2\patch_wls1030\profiles\default\native;C:\Oracle\MIDDLE~2\patch_jdev1111\profiles\default\native;C:\Oracle\MIDDLE~2\patch_cie660\profiles\default\native;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\native\win\32;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\bin;C:\Oracle\MIDDLE~2\modules\ORGAPA~1.5\bin;C:\PROGRA~1\Java\JROCKI~1.0_1\jre\bin;C:\PROGRA~1\Java\JROCKI~1.0_1\bin;C:\Oracle\OraClient10g\bin;C:\Oracle\DevSuite10G\bin;C:\Oracle\DevSuite10G\jdk\jre\bin\classic;C:\Oracle\DevSuite10G\jdk\jre\bin;C:\Oracle\DevSuite10G\jdk\jre\bin\client;C:\Oracle\DevSuite10G\jlib;C:\Oracle\DevSuite10G\jre\1.4.2\bin\client;C:\Oracle\DevSuite10G\jre\1.4.2\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\system32\nls;C:\WINDOWS\system32\nls\ENGLISH;C:\Program Files\TortoiseSVN\bin;C:\Oracle\jdevstudio10133\jdk\bin;C:\WINDOWS\system32\nls;C:\WINDOWS\system32\nls\ENGLISH;C:\Program Files\QuickTime\QTSystem\;Z:.;;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\native\win\32\oci920_8
JAVA_HOME : C:\PROGRA~1\Java\JROCKI~1.0_1
JAVAOPTIONS: <not set>
PATH : C:\PROGRA~1\Java\JROCKI~1.0_1\bin;C:\Oracle\MIDDLE~2\patch_wls1030\profiles\default\native;C:\Oracle\MIDDLE~2\patch_jdev1111\profiles\default\native;C:\Oracle\MIDDLE~2\patch_cie660\profiles\default\native;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\native\win\32;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\bin;C:\Oracle\MIDDLE~2\modules\ORGAPA~1.5\bin;C:\PROGRA~1\Java\JROCKI~1.0_1\jre\bin;C:\PROGRA~1\Java\JROCKI~1.0_1\bin;C:\Oracle\OraClient10g\bin;C:\Oracle\DevSuite10G\bin;C:\Oracle\DevSuite10G\jdk\jre\bin\classic;C:\Oracle\DevSuite10G\jdk\jre\bin;C:\Oracle\DevSuite10G\jdk\jre\bin\client;C:\Oracle\DevSuite10G\jlib;C:\Oracle\DevSuite10G\jre\1.4.2\bin\client;C:\Oracle\DevSuite10G\jre\1.4.2\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\system32\nls;C:\WINDOWS\system32\nls\ENGLISH;C:\Program Files\TortoiseSVN\bin;C:\Oracle\jdevstudio10133\jdk\bin;C:\WINDOWS\system32\nls;C:\WINDOWS\system32\nls\ENGLISH;C:\Program Files\QuickTime\QTSystem\;Z:.;;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\native\win\32\oci920_8
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
C Heap : Good; no memory allocations have failed
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#9.
: YC is not running. Last finished YC was YC#15.
OC History : Strategy genparpar was used for OC#1 to OC#6.
: Strategy singleparpar was used for OC#7.
: Strategy genparpar was used for OC#8 to OC#9.
YC History : Ran 1 YCs before OC#5.
: Ran 0 YCs before OC#6.
: Ran 0 YCs before OC#7.
: Ran 1 YCs before OC#8.
: Ran 4 YCs before OC#9.
: Ran 1 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x00C00000 - 0x10C00000 (Size: 256 MB)
Compaction : 0x0BC00030 - 0x0CC00038 (Current compaction type: external)
NurseryList : 0x0289B2D8 - 0x0A5D4488
KeepArea : 0x085ADA80 - 0x0A5D4488
NurseryMarker: [ 0x06479790, 0x085ADA80 ]
CompRefs : References are 32-bit.
Registers (from ThreadContext: 0x2562E340 / OS context: 0x2562E72C):
eax = 00000000 ecx = 00000000 edx = 2562e998 ebx = 07ab6220
esp = 2562e9f8 ebp = 07ab6220 esi = 2562ea18 edi = 242bae4c
es = 00000023 cs = 0000001b ss = 00000023 ds = 00000023
fs = 0000003b gs = 00000000
eip = 00000000 eflags = 00010212
Loaded modules:
(* denotes the module causing the exception)
00400000-00412fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\java.exe
7c900000-7c9b4fff C:\WINDOWS\system32\ntdll.dll
7c800000-7c8fffff C:\WINDOWS\system32\kernel32.dll
77f40000-77feafff C:\WINDOWS\system32\ADVAPI32.dll
77da0000-77e31fff C:\WINDOWS\system32\RPCRT4.dll
77f10000-77f20fff C:\WINDOWS\system32\Secur32.dll
77be0000-77c37fff C:\WINDOWS\system32\MSVCRT.dll
7c340000-7c395fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\msvcr71.dll
00420000-006c6fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\jrockit\jvm.dll
76af0000-76b1dfff C:\WINDOWS\system32\WINMM.dll
77e40000-77e88fff C:\WINDOWS\system32\GDI32.dll
7e390000-7e420fff C:\WINDOWS\system32\USER32.dll
71a30000-71a46fff C:\WINDOWS\system32\WS2_32.dll
71a20000-71a27fff C:\WINDOWS\system32\WS2HELP.dll
6d860000-6d86bfff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\verify.dll
6d3d0000-6d3eefff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\java.dll
6d330000-6d337fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\hpi.dll
6d8a0000-6d8aefff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\zip.dll
6d6c0000-6d6d2fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\net.dll
719d0000-71a0ffff C:\WINDOWS\system32\mswsock.dll
61200000-61258fff C:\WINDOWS\system32\hnetcfg.dll
71a10000-71a17fff C:\WINDOWS\System32\wshtcpip.dll
23750000-23776fff C:\WINDOWS\system32\DNSAPI.dll
23780000-23787fff C:\WINDOWS\System32\winrnr.dll
23790000-237bcfff C:\WINDOWS\system32\WLDAP32.dll
66210000-66218fff C:\WINDOWS\system32\netware\NWWS2NDS.DLL
50d50000-50d84fff C:\WINDOWS\system32\NETWIN32.DLL
50d00000-50d15fff C:\WINDOWS\system32\CLNWIN32.DLL
50df0000-50e14fff C:\WINDOWS\system32\LOCWIN32.dll
50db0000-50de4fff C:\WINDOWS\system32\NCPWIN32.dll
71a50000-71a59fff C:\WINDOWS\system32\WSOCK32.dll
66220000-6622bfff C:\WINDOWS\system32\netware\NWWS2SLP.DLL
66250000-66256fff C:\WINDOWS\system32\NWSRVLOC.dll
23850000-23855fff C:\WINDOWS\system32\rasadhlp.dll
6d610000-6d618fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\management.dll
6d6e0000-6d6e8fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\nio.dll
68000000-68035fff C:\WINDOWS\system32\rsaenh.dll
76970000-76a24fff C:\WINDOWS\system32\USERENV.dll
6ff20000-6ff74fff C:\WINDOWS\system32\netapi32.dll
00ba0000-00baafff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\jmapi.dll
22490000-2249dfff C:\Oracle\Middleware\wlserver_10.3\server\native\win\32\wlfileio2.dll
24fe0000-24ff8fff C:\WINDOWS\system32\iphlpapi.dll
25bc0000-25bd7fff C:\WINDOWS\system32\MPRAPI.dll
77c90000-77cc1fff C:\WINDOWS\system32\ACTIVEDS.dll
25be0000-25c04fff C:\WINDOWS\system32\adsldpc.dll
76ad0000-76ae0fff C:\WINDOWS\system32\ATL.DLL
774a0000-775dcfff C:\WINDOWS\system32\ole32.dll
25c10000-25c9afff C:\WINDOWS\system32\OLEAUT32.dll
25ca0000-25cadfff C:\WINDOWS\system32\rtutils.dll
71b80000-71b92fff C:\WINDOWS\system32\SAMLIB.dll
778e0000-779d6fff C:\WINDOWS\system32\SETUPAPI.dll
25cf0000-25cf4fff C:\Oracle\Middleware\wlserver_10.3\server\native\win\32\wlntio.dll
6d840000-6d847fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\sunmscapi.dll
77a40000-77ad5fff C:\WINDOWS\system32\CRYPT32.dll
77ae0000-77af1fff C:\WINDOWS\system32\MSASN1.dll
76bb0000-76bbafff C:\WINDOWS\system32\psapi.dll
6d0b0000-6d1e7fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\awt.dll
72f70000-72f95fff C:\WINDOWS\system32\WINSPOOL.DRV
76330000-7634cfff C:\WINDOWS\system32\IMM32.dll
5d4e0000-5d579fff C:\WINDOWS\system32\comctl32.dll
6d7b0000-6d7b5fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\rmi.dll
33230000-33342fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\dbghelp.dll
Stack:
(* marks the word pointed to by the stack pointer)
2562e9f8: 2562ea34* 00000000 242bace8 0059a501 242bae4c 2562ea34
2562ea10: 00000000 21941522 242bae4c 2562ea34 0d3829b8 2cfb78c0
2562ea28: 2194151d 242bb0b4 2562ea18 0d1018b8 242bace8 07ab6220
2562ea40: 07ab6220 21bfb985 0d1018b8 00000001 07ab6220 051988d8
Code:
(* marks the word pointed to by the instruction pointer)
ffffffd0: Unreadable
ffffffe8: Unreadable
00000000: Unreadable
00000018: Unreadable
"[ACTIVE] ExecuteThread: '0' for" id=15 idx=0x3c tid=6000 lastJavaFrame=0x2562EA24
Stack 0: start=0x255F0000, end=0x25630000, guards=0x255F3000 (ok), forbidden=0x255F1000
Thread Stack Trace:
at RJNI_jrockit_vm_Locks_monitorEnterUnmatched+17(rnilocks.c:65+17)@0x0059A501
-- Java stack --
at jrockit/vm/Locks.monitorEnterUnmatched(Ljava/lang/Object;)V(Native Method)
at oracle/jbo/server/ViewRowSetIteratorImpl.next(ViewRowSetIteratorImpl.java:1690)
at oracle/jbo/server/ViewRowSetIteratorImpl.first(ViewRowSetIteratorImpl.java:1548)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.first(ViewRowSetImpl.java:3202)
at oracle/jbo/server/ViewObjectImpl.first(ViewObjectImpl.java:8123)
at oracle/jbo/uicli/binding/JUCtrlListBinding.initFromServerBinding(JUCtrlListBinding.java:524)
at oracle/jbo/uicli/binding/JUCtrlListBinding.setupListItems(JUCtrlListBinding.java:630)
at oracle/jbo/uicli/binding/JUCtrlListBinding.findListIndex(JUCtrlListBinding.java:1783)
at oracle/jbo/uicli/binding/JUCtrlListBinding.setValueAt(JUCtrlListBinding.java:2686)
at oracle/jbo/uicli/binding/JUCtrlListBinding.updateValuesFromRow(JUCtrlListBinding.java:2118)
at oracle/jbo/uicli/binding/JUCtrlValueBinding.updateNavigated(JUCtrlValueBinding.java:268)
at oracle/jbo/uicli/binding/JUIteratorBinding.navigated(JUIteratorBinding.java:302)
^-- Holding lock: oracle/jbo/uicli/binding/JUApplication@0x0CECD4F0[biased lock]
at oracle/jbo/common/RowSetHelper.fireNavigationEvent(RowSetHelper.java:268)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigationToRow(ViewRowSetIteratorImpl.java:3624)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigation(ViewRowSetIteratorImpl.java:3595)
at oracle/jbo/server/ViewRowSetIteratorImpl.next(ViewRowSetIteratorImpl.java:1744)
at oracle/jbo/server/ViewRowSetIteratorImpl.first(ViewRowSetIteratorImpl.java:1548)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.first(ViewRowSetImpl.java:3202)
at oracle/jbo/server/ViewObjectImpl.first(ViewObjectImpl.java:8123)
at oracle/adf/model/binding/DCIteratorBinding.setupRSIstate(DCIteratorBinding.java:755)
at oracle/adf/model/binding/DCIteratorBinding.refreshControl(DCIteratorBinding.java:655)
at oracle/jbo/uicli/binding/JUIteratorBinding.refreshControl(JUIteratorBinding.java:475)
at oracle/adf/model/binding/DCIteratorBinding.rangeRefreshed(DCIteratorBinding.java:861)
at oracle/jbo/common/RowSetHelper.fireRangeRefreshed(RowSetHelper.java:179)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyRangeRefreshed(ViewRowSetIteratorImpl.java:3559)
at oracle/jbo/server/ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2776)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.refresh(ViewRowSetIteratorImpl.java:2996)
at oracle/jbo/server/ViewRowSetImpl.notifyRefresh(ViewRowSetImpl.java:2453)
at oracle/jbo/server/ViewRowSetImpl.execute(ViewRowSetImpl.java:1047)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.execute(ViewRowSetImpl.java:873)
at oracle/jbo/server/ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2738)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.refresh(ViewRowSetIteratorImpl.java:2996)
at oracle/jbo/server/ViewRowSetImpl.notifyRefresh(ViewRowSetImpl.java:2453)
at oracle/jbo/server/ViewRowSetImpl.refreshRowSet(ViewRowSetImpl.java:6106)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyDetailRowSets(ViewRowSetIteratorImpl.java:3493)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigationToRow(ViewRowSetIteratorImpl.java:3635)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigation(ViewRowSetIteratorImpl.java:3595)
at oracle/jbo/server/ViewRowSetIteratorImpl.internalSetCurrentRow(ViewRowSetIteratorImpl.java:3378)
at oracle/jbo/server/ViewRowSetIteratorImpl.first(ViewRowSetIteratorImpl.java:1551)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.first(ViewRowSetImpl.java:3202)
at oracle/jbo/server/ViewObjectImpl.first(ViewObjectImpl.java:8123)
at oracle/adf/model/binding/DCIteratorBinding.setupRSIstate(DCIteratorBinding.java:755)
at oracle/adf/model/binding/DCIteratorBinding.refreshControl(DCIteratorBinding.java:655)
at oracle/jbo/uicli/binding/JUIteratorBinding.refreshControl(JUIteratorBinding.java:475)
at oracle/adf/model/binding/DCIteratorBinding.rangeRefreshed(DCIteratorBinding.java:861)
at oracle/jbo/common/RowSetHelper.fireRangeRefreshed(RowSetHelper.java:179)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyRangeRefreshed(ViewRowSetIteratorImpl.java:3559)
at oracle/jbo/server/ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2776)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.refresh(ViewRowSetIteratorImpl.java:2996)
at oracle/jbo/server/ViewRowSetImpl.notifyRefresh(ViewRowSetImpl.java:2453)
at oracle/jbo/server/ViewRowSetImpl.execute(ViewRowSetImpl.java:1047)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.execute(ViewRowSetImpl.java:873)
at oracle/jbo/server/ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2738)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.refresh(ViewRowSetIteratorImpl.java:2996)
at oracle/jbo/server/ViewRowSetImpl.notifyRefresh(ViewRowSetImpl.java:2453)
at oracle/jbo/server/ViewRowSetImpl.refreshRowSet(ViewRowSetImpl.java:6106)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyDetailRowSets(ViewRowSetIteratorImpl.java:3493)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigationToRow(ViewRowSetIteratorImpl.java:3635)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigation(ViewRowSetIteratorImpl.java:3595)
at oracle/jbo/server/ViewRowSetIteratorImpl.internalSetCurrentRow(ViewRowSetIteratorImpl.java:3378)
at oracle/jbo/server/ViewRowSetIteratorImpl.setCurrentRow(ViewRowSetIteratorImpl.java:1018)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.activateIteratorState(ViewRowSetIteratorImpl.java:3955)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.activateIteratorState(ViewRowSetImpl.java:6228)
at oracle/jbo/server/ViewObjectImpl.activateIteratorState(ViewObjectImpl.java:16120)
at oracle/jbo/server/ViewRowSetIteratorImpl.activateIteratorState(ViewRowSetIteratorImpl.java:3874)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.activateIteratorState(ViewRowSetImpl.java:6228)
at oracle/jbo/server/ViewObjectImpl.activateIteratorState(ViewObjectImpl.java:16120)
at oracle/jbo/server/ViewRowSetIteratorImpl.activateIteratorState(ViewRowSetIteratorImpl.java:3874)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.activateIteratorState(ViewRowSetImpl.java:6228)
at oracle/jbo/server/ViewObjectImpl.activateIteratorState(ViewObjectImpl.java:16120)
at oracle/jbo/server/ApplicationModuleImpl.activateVOs(ApplicationModuleImpl.java:7675)
at oracle/jbo/server/ApplicationModuleImpl.doActivateState(ApplicationModuleImpl.java:7421)
at oracle/jbo/server/ApplicationModuleImpl.doActivateState(ApplicationModuleImpl.java:7453)
at oracle/jbo/server/ApplicationModuleImpl.doActivateAMState(ApplicationModuleImpl.java:7400)
at oracle/jbo/server/Serializer.activate(Serializer.java:284)
at oracle/jbo/server/DBSerializer.activateRootAM(DBSerializer.java:331)
at oracle/jbo/server/ApplicationModuleImpl.activateFromStack(ApplicationModuleImpl.java:6063)
at oracle/jbo/server/ApplicationModuleImpl.activateState(ApplicationModuleImpl.java:5923)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ApplicationModuleImpl.activateStateForUndo(ApplicationModuleImpl.java:8308)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at nl/nak/iva/RuleFrameTransactionImpl.activateStateForUndo(RuleFrameTransactionImpl.java:262)
at nl/nak/iva/RuleFrameTransactionImpl.handleSQLError(RuleFrameTransactionImpl.java:130)
at nl/nak/iva/RuleFrameTransactionImpl.doCommit(RuleFrameTransactionImpl.java:86)
at oracle/jbo/server/DBTransactionImpl.commitInternal(DBTransactionImpl.java:2244)
at oracle/jbo/server/DBTransactionImpl.commit(DBTransactionImpl.java:2382)
^-- Holding lock: nl/nak/iva/RuleFrameTransactionImpl@0x0E986690[biased lock]
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at nl/nak/iva/RuleFrameTransactionImpl.commit(RuleFrameTransactionImpl.java:103)
at oracle/adf/model/bc4j/DCJboDataControl.commitTransaction(DCJboDataControl.java:1565)
at oracle/adf/model/binding/DCDataControl.callCommitTransaction(DCDataControl.java:1407)
at oracle/jbo/uicli/binding/JUCtrlActionBinding.doIt(JUCtrlActionBinding.java:1293)
at oracle/adf/model/binding/DCDataControl.invokeOperation(DCDataControl.java:2126)
at oracle/jbo/uicli/binding/JUCtrlActionBinding.invoke(JUCtrlActionBinding.java:697)
at oracle/adf/controller/v2/lifecycle/PageLifecycleImpl.executeEvent(PageLifecycleImpl.java:392)
at oracle/adfinternal/view/faces/model/binding/FacesCtrlActionBinding._execute(FacesCtrlActionBinding.java:159)
at oracle/adfinternal/view/faces/model/binding/FacesCtrlActionBinding.execute(FacesCtrlActionBinding.java:118)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
    at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;) Ljava/lang/Object;(Native Method)
    at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java/lang/reflect/Method.invoke(Method.java:597)
    at com/sun/el/parser/AstValue.invoke(AstValue.java:157)
    at com/sun/el/MethodExpressionImpl.invoke(MethodExpressionImpl.java:283)
    at org/apache/myfaces/trinidadinternal/taglib/util/MethodExpressionMethodBinding.invoke(MethodExpressionMethodBinding.java:53)
    at org/apache/myfaces/trinidad/component/UIXComponentBase.broadcastToMethodBinding(UIXComponentBase.java:1227)
    at org/apache/myfaces/trinidad/component/UIXCommand.broadcast(UIXCommand.java:183)
    at oracle/adf/view/rich/component/fragment/ContextSwitchingComponent$1.run(ContextSwitchingComponent.java:70)
    at oracle/adf/view/rich/component/fragment/ContextSwitchingComponent._processPhase(ContextSwitchingComponent.java:274)
    at oracle/adf/view/rich/component/fragment/ContextSwitchingComponent.broadcast(ContextSwitchingComponent.java:74)
    at javax/faces/component/UIViewRoot.broadcastEvents(UIViewRoot.java:458)
    at javax/faces/component/UIViewRoot.processApplication(UIViewRoot.java:763)
    at oracle/adfinternal/view/faces/lifecycle/LifecycleImpl._invokeApplication(LifecycleImpl.java:640)
    at oracle/adfinternal/view/faces/lifecycle/LifecycleImpl._executePhase(LifecycleImpl.java:275)
    at oracle/adfinternal/view/faces/lifecycle/LifecycleImpl.execute(LifecycleImpl.java:175)
    at javax/faces/webapp/FacesServlet.service(FacesServlet.java:265)
    at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
    at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)
    at weblogic/servlet/internal/TailFilter.doFilter(TailFilter.java:26)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at oracle/adf/model/servlet/ADFBindingFilter.doFilter(ADFBindingFilter.java:181)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at oracle/adfinternal/view/faces/webapp/rich/RegistrationFilter.doFilter(RegistrationFilter.java:85)
    at org/apache/myfaces/trinidadinternal/webapp/TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:279)
    at org/apache/myfaces/trinidadinternal/webapp/TrinidadFilterImpl._invokeDoFilter(TrinidadFilterImpl.java:239)
    at org/apache/myfaces/trinidadinternal/webapp/TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:196)
    at org/apache/myfaces/trinidadinternal/webapp/TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:139)
    at org/apache/myfaces/trinidad/webapp/TrinidadFilter.doFilter(TrinidadFilter.java:92)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at oracle/security/jps/wls/JpsWlsFilter.doFilter(JpsWlsFilter.java:102)
    at oracle/security/jps/ee/http/JpsFilter.doFilter(JpsFilter.java:65)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at weblogic/servlet/internal/RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3496)
    at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic/security/service/SecurityManager.runAs(Lweblogic/security/acl/internal/AuthenticatedSubject;Lweblogic/security/acl/internal/AuthenticatedSubject;Ljava/security/PrivilegedAction;)Ljava/lang/Object;(Unknown Source)
    at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2180)
    at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2086)
    at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1406)
    at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)
    at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    * If you see this dump, please go to                    *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information.                      *
===== END DUMP ===============================================================

Core dumps are usually a bug, so I suggest filing a Service Request with support.

Jrockit JVM GC issue - weblogic performance and crashes at times

On enabling the verbose gc for memory debug, we have observer the following and we frequently face a JVM issue i.e JVM will be unresponsive due to GC pause and on checking we found the following in GC log.
[memdbg ][Tue Jul 13 01:02:12 2010][26381] GC reason: TLA allocation failed, cause: Get TLA From Nursery
[memdbg ][Tue Jul 13 01:02:12 2010][26381] Stopping of javathreads took 2.234 ms
As of now the following is the TLA size:-
[memdbg ][Tue Jul 13 01:00:10 2010][26381] Minimum TLA size is 2048 bytes
[memdbg ][Tue Jul 13 01:00:10 2010][26381] Preferred TLA size is 65536 bytes
[memdbg ][Tue Jul 13 01:00:10 2010][26381] Large object limit is 2048 bytes
After consultaion with oracle support team, they have asked to us increase the TLA size and we did as follows but we still see the same message.
tried setting
-XXlargeObjectLimit:16k -XXminBlockSize:16k -XXtlaSize:min=16k,preferred=32k
it was still a problem, tried
-XXlargeObjectLimit:32k -XXminBlockSize:32k -XXtlaSize:min=32k,preferred=64k
and we sill the following message.
[memdbg ][Wed Jul 21 03:14:06 2010][11864] f0 3.75Gb
[memdbg ][Wed Jul 21 03:14:06 2010][11864] Minimum TLA size is 16384 bytes
[memdbg ][Wed Jul 21 03:14:06 2010][11864] Preferred TLA size is 32768 bytes
[memdbg ][Wed Jul 21 03:14:06 2010][11864] Large object limit is 16384 bytes
[memdbg ][Wed Jul 21 03:14:06 2010][11864] Minimal blocksize on the freelist is 16384 bytes
[memdbg ][Wed Jul 21 03:14:06 2010][11864] Initial and maximum number of gc threads: 8, of which 8 parallel threads, 4 concurrent threads, and 8 yc threads.
[memdbg ][Wed Jul 21 03:14:06 2010][11864] Preferred free list cache percentage 10%.
[memdbg ][Wed Jul 21 03:14:06 2010][11864] Maximum nursery percentage of free heap is: 95.
[nursery][Wed Jul 21 03:14:06 2010][11864] Optimal nursery size: 536870912, free heap: 1073741824
[nursery][Wed Jul 21 03:14:06 2010][11864] Setting mmNurseryMarker[0] to 0x12affff8
[nursery][Wed Jul 21 03:14:06 2010][11864] Setting mmNurseryMarker[1] to 0x1aaffff0
[nursery][Wed Jul 21 03:14:06 2010][11864] Nursery size increased from 0kb to 524288kb. Parts: 1
[memdbg ][Wed Jul 21 03:14:06 2010][11864] Prefetch distance in balanced tree: 4
[compact][Wed Jul 21 03:14:06 2010][11864] Compactset limit: 7600010, Using matrixes: 0, Static: 0
[memory ][Wed Jul 21 03:14:06 2010][11864] GC mode: Garbage collection optimized for throughput, initial strategy: Generational Parallel Mark & Sweep
[memory ][Wed Jul 21 03:14:06 2010][11864] heap size: 1048576K, maximal heap size: 1048576K, nursery size: 524288K
[memory ][Wed Jul 21 03:14:06 2010][11864] <s>-<end>: GC <before>K-><after>K (<heap>K), <pause> ms
[memory ][Wed Jul 21 03:14:06 2010][11864] <s/start> - start time of collection (seconds since jvm start)
[memory ][Wed Jul 21 03:14:06 2010][11864] <end> - end time of collection (seconds since jvm start)
[memory ][Wed Jul 21 03:14:06 2010][11864] <before> - memory used by objects before collection (KB)
[memory ][Wed Jul 21 03:14:06 2010][11864] <after> - memory used by objects after collection (KB)
[memory ][Wed Jul 21 03:14:06 2010][11864] <heap> - size of heap after collection (KB)
[memory ][Wed Jul 21 03:14:06 2010][11864] <pause> - total sum of pauses during collection (milliseconds)
[memory ][Wed Jul 21 03:14:06 2010][11864] run with -Xverbose:gcpause to see individual pauses
[memdbg ][Wed Jul 21 03:14:39 2010][11864] GC reason: TLA allocation failed, cause: Get TLA From Nursery
[memdbg ][Wed Jul 21 03:14:39 2010][11864] Stopping of javathreads took 1.627 ms
[nursery][Wed Jul 21 03:14:39 2010][11864] KeepAreaStart: 0x1aaffff0 KeepAreaEnd: 0x22b00000
[nursery][Wed Jul 21 03:14:39 2010][11864] Young collection 1 started. This YC is running while the OC is in phase: not running.
[memdbg ][Wed Jul 21 03:14:39 2010][11864] A pinned object was found: 0x11a4d4a0
[memdbg ][Wed Jul 21 03:14:39 2010][11864] A pinned object was found: 0x11a30010
[nursery][Wed Jul 21 03:14:39 2010][11864] Found pinned object: 0x11a4d4a0 - 0x11a4f4b0
Are there any standard tuning recommendations for Jrockit JVM to come over this GC issue? At present, we are using following JAVA options.
-XXlargeObjectLimit:32k -XXminBlockSize:32k -XXtlaSize:min=32k,preferred=64k -verbose:gc -Xverboselog:/tmp/gc.log -Xverbose:memory,gcpause,memdbg,compaction,gc -Xverbosetimestamp -Xgcreport
-RR
Regards
Ranga

If you want to optimize for pausetime, you can use for example
-Xms512m -Xmx512m -Xns256m -XXkeepAreaRatio:25 -Xgcprio:pausetime -XpauseTarget:200msThe parameters xms and xmx can be adjusted to your wishes.

JVM crashes with illegal Memory Access ..

[JRockit] ERROR: The JVM has crashed. Writing crash information to C:\bea10.3\wlserver_10.3\samples\domains\wl_server\jrockit.3712.dump.
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:13:27 on Mon Dec 07 20:06:05 2009
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
C:\bea10.3\wlserver_10.3\samples\domains\wl_server\jrockit.3712.dump
C:\bea10.3\wlserver_10.3\samples\domains\wl_server\jrockit.3712.mdmp
Error Message: Illegal memory access. [54]
Exception Rec: EXCEPTION_ACCESS_VIOLATION (c0000005) at 0x00466F21 - memory at 0x00000000 could not be read.
Minidump : Wrote mdmp. Size is 472MB
SafeDllMode : -1
Version : BEA JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2105-windows-ia32
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#2.
: YC is not running. Last finished YC was YC#24.
OC History : Strategy genparpar was used for OC#1 to OC#2.
YC History : Ran 3 YCs before OC#1.
: Ran 3 YCs before OC#2.
: Ran 18 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x00C00000 - 0x10C00000 (Size: 256 MB)
Compaction : 0x00C00000 - 0x01C00000 (Current compaction type: internal)
NurseryList : 0x00E57CF0 - 0x08132978
KeepArea : 0x04693C88 - 0x06320918
NurseryMarker: [ 0x04693C88, 0x06320918 ]
CompRefs : References are 32-bit.
CPU : Intel Core 2 SSE SSE2 SSE3 SSSE3 SSE4.1 EM64T
Number CPUs : 2
Tot Phys Mem : 2096984064 (1999 MB)
OS version : Microsoft Windows XP version 5.1 Service Pack 3 (Build 2600) (32-bit)
Thread System: Windows Threads
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -Xverify:all -Xms256m -Xmx512m -Xverify:none -da -Dplatform.home=C:\bea10.3\WLSERV~1.3 -Dwls.home=C:\bea10.3\WLSERV~1.3\server -Dweblogic.home=C:\bea10.3\WLSERV~1.3\server -Dweblogic.management.discover=true -Dwlw.iterativeDev= -Dwlw.testConsole= -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=C:\bea10.3\patch_wlw1030\profiles\default\sysext_manifest_classpath;C:\bea10.3\patch_wls1030\profiles\default\sysext_manifest_classpath;C:\bea10.3\patch_cie660\profiles\default\sysext_manifest_classpath -Dweblogic.Name=examplesServer -Djava.security.policy=C:\bea10.3\WLSERV~1.3\server\lib\weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home : C:\bea10.3\JROCKI~1\jre
j.class.path : C:\bea10.3\wlserver_10.3\samples\server\examples\build\serverclasses;C:\bea10.3\patch_wlw1030\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\bea10.3\patch_wls1030\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\bea10.3\patch_cie660\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\bea10.3\JROCKI~1\lib\tools.jar;C:\bea10.3\WLSERV~1.3\server\lib\weblogic_sp.jar;C:\bea10.3\WLSERV~1.3\server\lib\weblogic.jar;C:\bea10.3\modules\features\weblogic.server.modules_10.3.0.0.jar;C:\bea10.3\WLSERV~1.3\server\lib\webservices.jar;C:\bea10.3\modules\ORGAPA~1.5/lib/ant-all.jar;C:\bea10.3\modules\NETSFA~1.0_1/lib/ant-contrib.jar;;C:\bea10.3\WLSERV~1.3\common\eval\pointbase\lib\pbembedded57.jar;C:\bea10.3\WLSERV~1.3\common\eval\pointbase\lib\pbclient57.jar;C:\bea10.3\WLSERV~1.3\server\lib\xqrl.jar;;C:\bea10.3\wlserver_10.3\server\lib\wlspy.jar;;
j.lib.path : C:\bea10.3\JROCKI~1\bin;.;C:\WINDOWS\system32;C:\WINDOWS;C:\bea10.3\patch_wlw1030\profiles\default\native;C:\bea10.3\patch_wls1030\profiles\default\native;C:\bea10.3\patch_cie660\profiles\default\native;C:\bea10.3\WLSERV~1.3\server\native\win\32;C:\bea10.3\WLSERV~1.3\server\bin;C:\bea10.3\modules\ORGAPA~1.5\bin;C:\bea10.3\JROCKI~1\jre\bin;C:\bea10.3\JROCKI~1\bin;C:/Program Files/Java/jre1.6.0_02/bin/client;C:/Program Files/Java/jre1.6.0_02/bin;C:\Program Files\IBM\WebSphere MQ\Java\lib;C:\oracle\product\10.2.0\bin;C:\Program Files\Documentum\Shared;c:\windows\system32;c:\windows;c:\windows\system32\wbem;c:\program files\ntru cryptosystems\ntru tcg software stack\bin\;c:\program files\wave systems corp\gemalto\access client\v5\;c:\program files\intel\dmix;c:\program files\intel\wifi\bin\;c:\program files\common files\roxio shared\dllshared\;c:\program files\common files\roxio shared\9.0\dllshared\;c:\program files\utimaco\safeguard easy\;C:\Program Files\Windows Imaging\;c:\program files\java\jdk1.6.0_05\bin;;C:\bea10.3\wlserver_10.3\server\lib\wlspy.jar;C:\Program Files\IBM\WebSphere MQ\bin;C:\Program Files\IBM\WebSphere MQ\tools\c\samples\bin;C:\Program Files\TortoiseSVN\bin;C:\Program Files\Subversion\bin;C:\bea10.3\WLSERV~1.3\server\native\win\32\oci920_8
JAVA_HOME : C:\bea10.3\JROCKI~1
JAVAOPTIONS: <not set>
PATH : C:\bea10.3\JROCKI~1\jre\bin;C:\bea10.3\patch_wlw1030\profiles\default\native;C:\bea10.3\patch_wls1030\profiles\default\native;C:\bea10.3\patch_cie660\profiles\default\native;C:\bea10.3\WLSERV~1.3\server\native\win\32;C:\bea10.3\WLSERV~1.3\server\bin;C:\bea10.3\modules\ORGAPA~1.5\bin;C:\bea10.3\JROCKI~1\jre\bin;C:\bea10.3\JROCKI~1\bin;C:/Program Files/Java/jre1.6.0_02/bin/client;C:/Program Files/Java/jre1.6.0_02/bin;C:\Program Files\IBM\WebSphere MQ\Java\lib;C:\oracle\product\10.2.0\bin;C:\Program Files\Documentum\Shared;c:\windows\system32;c:\windows;c:\windows\system32\wbem;c:\program files\ntru cryptosystems\ntru tcg software stack\bin\;c:\program files\wave systems corp\gemalto\access client\v5\;c:\program files\intel\dmix;c:\program files\intel\wifi\bin\;c:\program files\common files\roxio shared\dllshared\;c:\program files\common files\roxio shared\9.0\dllshared\;c:\program files\utimaco\safeguard easy\;C:\Program Files\Windows Imaging\;c:\program files\java\jdk1.6.0_05\bin;;C:\bea10.3\wlserver_10.3\server\lib\wlspy.jar;C:\Program Files\IBM\WebSphere MQ\bin;C:\Program Files\IBM\WebSphere MQ\tools\c\samples\bin;C:\Program Files\TortoiseSVN\bin;C:\Program Files\Subversion\bin;C:\bea10.3\WLSERV~1.3\server\native\win\32\oci920_8
C Heap : Good; no memory allocations have failed
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x319BD1FC / OS context: 0x319BD5F8):
eax = 2b1cdf58 ecx = 31b647a8 edx = 00000000 ebx = 0000002d
esp = 319bd8c4 ebp = 31b66400 esi = 00000000 edi = 00000001
es = 00000023 cs = 0000001b ss = 00000023 ds = 00000023
fs = 0000003b gs = 00000000
eip = 00466f21 eflags = 00010202
Stack:
(* marks the word pointed to by the stack pointer)
319bd8c4: 319bda40* 28ac5bdc 2d61e1c4 31b636f8 0000002c 31b66590
319bd8dc: 00000000 00000001 00000001 00000001 31b66588 00000000
319bd8f4: 0000002c 00000000 00000005 31b647a8 2d61e1c4 2d630700
319bd90c: 00001df5 00462f77 28ac5bdc 31b636f8 319bdec8 319bdf04
Code:
(* marks the word pointed to by the instruction pointer)
00466ef0: 08c8448d 28244489 89f8048d 8b142444 431c2444 c085f633
00466f08: 00f9860f ff8b0000 54244c8b 8b34518b 4c8bb204 518b3c24
00466f20: f20c8b2c* 1824548b 8bca0c8d 89142454 8b38244c 8928244c
00466f38: 5489f11c b70f04f1 00014e88 b8b70f00 0000014a 44c7f92b
Loaded modules:
(* denotes the module causing the exception)
00400000-00410fff C:\bea10.3\JROCKI~1\bin\java.exe
7c900000-7c9b1fff C:\WINDOWS\system32\ntdll.dll
7c800000-7c8f5fff C:\WINDOWS\system32\kernel32.dll
77dd0000-77e6afff C:\WINDOWS\system32\ADVAPI32.dll
77e70000-77f01fff C:\WINDOWS\system32\RPCRT4.dll
77fe0000-77ff0fff C:\WINDOWS\system32\Secur32.dll
77c10000-77c67fff C:\WINDOWS\system32\MSVCRT.dll
7c340000-7c395fff C:\bea10.3\JROCKI~1\jre\bin\msvcr71.dll
00420000-006c3fff *C:\bea10.3\JROCKI~1\jre\bin\jrockit\jvm.dll
76b40000-76b6cfff C:\WINDOWS\system32\WINMM.dll
77f10000-77f58fff C:\WINDOWS\system32\GDI32.dll
7e410000-7e4a0fff C:\WINDOWS\system32\USER32.dll
71ab0000-71ac6fff C:\WINDOWS\system32\WS2_32.dll
71aa0000-71aa7fff C:\WINDOWS\system32\WS2HELP.dll
76390000-763acfff C:\WINDOWS\system32\IMM32.DLL
6d820000-6d82bfff C:\bea10.3\JROCKI~1\jre\bin\verify.dll
6d3c0000-6d3defff C:\bea10.3\JROCKI~1\jre\bin\java.dll
6d320000-6d327fff C:\bea10.3\JROCKI~1\jre\bin\hpi.dll
6d860000-6d86efff C:\bea10.3\jrockit_160_05\jre\bin\zip.dll
6d570000-6d578fff C:\bea10.3\jrockit_160_05\jre\bin\management.dll
6d620000-6d632fff C:\bea10.3\jrockit_160_05\jre\bin\net.dll
237a0000-237cffff C:\Program Files\F-Secure\FSPS\program\FSLSP.DLL
237d0000-237e6fff c:\program files\f-secure\scanner-interface\fsgkiapi.dll
71a50000-71a8efff C:\WINDOWS\system32\mswsock.dll
662b0000-66307fff C:\WINDOWS\system32\hnetcfg.dll
71a90000-71a97fff C:\WINDOWS\System32\wshtcpip.dll
23ca0000-23cc6fff C:\WINDOWS\system32\DNSAPI.dll
23cd0000-23cd7fff C:\WINDOWS\System32\winrnr.dll
23ce0000-23d0bfff C:\WINDOWS\system32\WLDAP32.dll
23d60000-23d65fff C:\WINDOWS\system32\rasadhlp.dll
6d640000-6d648fff C:\bea10.3\jrockit_160_05\jre\bin\nio.dll
68000000-68035fff C:\WINDOWS\system32\rsaenh.dll
769c0000-76a73fff C:\WINDOWS\system32\USERENV.dll
5b860000-5b8b4fff C:\WINDOWS\system32\netapi32.dll
25c20000-25c2afff C:\bea10.3\jrockit_160_05\jre\bin\jmapi.dll
25e30000-25e3dfff C:\bea10.3\wlserver_10.3\server\native\win\32\wlfileio2.dll
26120000-26138fff C:\WINDOWS\system32\iphlpapi.dll
26150000-26167fff C:\WINDOWS\system32\MPRAPI.dll
77cc0000-77cf1fff C:\WINDOWS\system32\ACTIVEDS.dll
26170000-26194fff C:\WINDOWS\system32\adsldpc.dll
76b20000-76b30fff C:\WINDOWS\system32\ATL.DLL
774e0000-7761cfff C:\WINDOWS\system32\ole32.dll
261a0000-2622afff C:\WINDOWS\system32\OLEAUT32.dll
26230000-2623dfff C:\WINDOWS\system32\rtutils.dll
71bf0000-71c02fff C:\WINDOWS\system32\SAMLIB.dll
77920000-77a12fff C:\WINDOWS\system32\SETUPAPI.dll
26280000-26284fff C:\bea10.3\wlserver_10.3\server\native\win\32\wlntio.dll
6d800000-6d807fff C:\bea10.3\jrockit_160_05\jre\bin\sunmscapi.dll
77a80000-77b14fff C:\WINDOWS\system32\CRYPT32.dll
77b20000-77b31fff C:\WINDOWS\system32\MSASN1.dll
76bf0000-76bfafff C:\WINDOWS\system32\psapi.dll
6d7c0000-6d7c5fff C:\bea10.3\jrockit_160_05\jre\bin\rmi.dll
31c20000-31d32fff C:\bea10.3\JROCKI~1\jre\bin\dbghelp.dll
"[ACTIVE] ExecuteThread: '18' fo" id=54 idx=0xc8 tid=5456 lastJavaFrame=0x319BDEF4
Stack 0: start=0x31980000, end=0x319C0000, guards=0x31983000 (ok), forbidden=0x31981000
Thread Stack Trace:
at dtCreateDTable+1025(dispatchtables.c:298+7)@0x00466F21
at defineClass+167(defineclass.c:110+7)@0x00462F77
at lib_define_class+34(library.c:516+16)@0x005164C2
at libDefineClass+39(library.c:576+38)@0x00516707
at libDefineClass2+58(library.c:597+34)@0x0051685A
at JVM_DefineClassWithSource+43(jvmclass.c:59+43)@0x004E609B
at Javajava_lang_ClassLoader_defineClass1@32+235()@0x6D3C15DA
-- Java stack --
at java/lang/ClassLoader.defineClass1(Ljava/lang/String;[BIILjava/security/ProtectionDomain;Ljava/lang/String;)Ljava/lang/Class;(Native Method)
    at java/lang/ClassLoader.defineClass(ClassLoader.java:620)
    at java/security/SecureClassLoader.defineClass(SecureClassLoader.java:124)
    at weblogic/utils/classloaders/GenericClassLoader.defineClass(GenericClassLoader.java:335)
    at weblogic/utils/classloaders/GenericClassLoader.findLocalClass(GenericClassLoader.java:288)
    ^-- Holding lock: weblogic/utils/classloaders/GenericClassLoader@0x0E7FCE78[recursive]
at weblogic/utils/classloaders/GenericClassLoader.findClass(GenericClassLoader.java:256)
at java/lang/ClassLoader.loadClass(ClassLoader.java:306)
^-- Holding lock: weblogic/utils/classloaders/GenericClassLoader@0x0E7FCE78[recursive]
at java/lang/ClassLoader.loadClass(ClassLoader.java:251)
at weblogic/utils/classloaders/GenericClassLoader.loadClass(GenericClassLoader.java:176)
at jrockit/vm/Classes.loadClassInternal(Classes.java:75)
^-- Holding lock: weblogic/utils/classloaders/GenericClassLoader@0x0E7FCE78[recursive]
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at java/lang/ClassLoader.defineClass1(Ljava/lang/String;[BIILjava/security/ProtectionDomain;Ljava/lang/String;)Ljava/lang/Class;(Native Method)
    at java/lang/ClassLoader.defineClass(ClassLoader.java:620)
    at java/security/SecureClassLoader.defineClass(SecureClassLoader.java:124)
    at weblogic/utils/classloaders/GenericClassLoader.defineClass(GenericClassLoader.java:335)
    at weblogic/utils/classloaders/GenericClassLoader.findLocalClass(GenericClassLoader.java:288)
    ^-- Holding lock: weblogic/utils/classloaders/GenericClassLoader@0x0E7FCE78[recursive]
at weblogic/utils/classloaders/GenericClassLoader.findClass(GenericClassLoader.java:256)
at java/lang/ClassLoader.loadClass(ClassLoader.java:306)
^-- Holding lock: weblogic/utils/classloaders/GenericClassLoader@0x0E7FCE78[recursive]
at java/lang/ClassLoader.loadClass(ClassLoader.java:251)
at weblogic/utils/classloaders/GenericClassLoader.loadClass(GenericClassLoader.java:176)
at jrockit/vm/Classes.loadClassInternal(Classes.java:75)
^-- Holding lock: weblogic/utils/classloaders/GenericClassLoader@0x0E7FCE78[biased lock]
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Classes.forName0(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;(Native Method)
at java/lang/Class.forName0(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;(Native Method)
at java/lang/Class.forName(Class.java:247)
at sun/reflect/generics/factory/CoreReflectionFactory.makeNamedType(CoreReflectionFactory.java:95)
at sun/reflect/generics/visitor/Reifier.visitClassTypeSignature(Reifier.java:107)
at sun/reflect/generics/tree/ClassTypeSignature.accept(ClassTypeSignature.java:31)
at sun/reflect/annotation/AnnotationParser.parseSig(AnnotationParser.java:370)
at sun/reflect/annotation/AnnotationParser.parseClassValue(AnnotationParser.java:351)
at sun/reflect/annotation/AnnotationParser.parseMemberValue(AnnotationParser.java:280)
at sun/reflect/annotation/AnnotationParser.parseAnnotation(AnnotationParser.java:222)
at sun/reflect/annotation/AnnotationParser.parseAnnotations2(AnnotationParser.java:69)
at sun/reflect/annotation/AnnotationParser.parseAnnotations(AnnotationParser.java:52)
at java/lang/reflect/Field.declaredAnnotations(Field.java:1016)
^-- Holding lock: java/lang/reflect/Field@0x032BFE90[biased lock]
at java/lang/reflect/Field.getDeclaredAnnotations(Field.java:1009)
at java/lang/reflect/AccessibleObject.getAnnotations(AccessibleObject.java:175)
at org/apache/openjpa/lib/util/J2DoPriv5Helper$1.run(J2DoPriv5Helper.java:51)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:233)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:241)
at org/apache/openjpa/persistence/PersistenceMetaDataDefaults.annotated(PersistenceMetaDataDefaults.java:293)
at org/apache/openjpa/persistence/PersistenceMetaDataDefaults.getAccessType(PersistenceMetaDataDefaults.java:262)
at org/apache/openjpa/persistence/PersistenceMetaDataDefaults.getAccessType(PersistenceMetaDataDefaults.java:269)
at org/apache/openjpa/persistence/PersistenceMetaDataDefaults.getAccessType(PersistenceMetaDataDefaults.java:250)
at org/apache/openjpa/meta/AbstractMetaDataDefaults.populate(AbstractMetaDataDefaults.java:155)
at org/apache/openjpa/persistence/PersistenceMetaDataDefaults.populate(PersistenceMetaDataDefaults.java:227)
at org/apache/openjpa/meta/MetaDataRepository.addMetaData(MetaDataRepository.java:794)
at org/apache/openjpa/meta/MetaDataRepository.addMetaData(MetaDataRepository.java:780)
at org/apache/openjpa/persistence/AnnotationPersistenceMetaDataParser.getMetaData(AnnotationPersistenceMetaDataParser.java:657)
at org/apache/openjpa/persistence/AnnotationPersistenceMetaDataParser.parseClassAnnotations(AnnotationPersistenceMetaDataParser.java:480)
at org/apache/openjpa/persistence/AnnotationPersistenceMetaDataParser.parse(AnnotationPersistenceMetaDataParser.java:352)
at org/apache/openjpa/persistence/PersistenceMetaDataFactory.load(PersistenceMetaDataFactory.java:229)
at org/apache/openjpa/meta/MetaDataRepository.getMetaDataInternal(MetaDataRepository.java:474)
at org/apache/openjpa/meta/MetaDataRepository.getMetaData(MetaDataRepository.java:294)
^-- Holding lock: org/apache/openjpa/meta/MetaDataRepository@0x0E7FCDF0[biased lock]
at org/apache/openjpa/enhance/PCEnhancer.<init>(PCEnhancer.java:248)
at org/apache/openjpa/enhance/PCEnhancer.<init>(PCEnhancer.java:219)
at org/apache/openjpa/enhance/PCClassFileTransformer.transform0(PCClassFileTransformer.java:139)
at org/apache/openjpa/enhance/PCClassFileTransformer.transform(PCClassFileTransformer.java:120)
at org/apache/openjpa/persistence/PersistenceProviderImpl$ClassTransformerImpl.transform(PersistenceProviderImpl.java:210)
at weblogic/deployment/PersistenceUnitInfoImpl$ClassPreProcessorImpl.preProcess(PersistenceUnitInfoImpl.java:497)
at weblogic/utils/classloaders/ClassPreProcessor$ClassPreProcessorSupport.preProcess(ClassPreProcessor.java:95)
at weblogic/utils/classloaders/GenericClassLoader.doPreProcess(GenericClassLoader.java:348)
at weblogic/utils/classloaders/GenericClassLoader.defineClass(GenericClassLoader.java:329)
at weblogic/utils/classloaders/GenericClassLoader.findLocalClass(GenericClassLoader.java:288)
^-- Holding lock: weblogic/utils/classloaders/GenericClassLoader@0x0E093168[recursive]
at weblogic/utils/classloaders/GenericClassLoader.findClass(GenericClassLoader.java:256)
at java/lang/ClassLoader.loadClass(ClassLoader.java:306)
^-- Holding lock: weblogic/utils/classloaders/GenericClassLoader@0x0E093168[recursive]
at java/lang/ClassLoader.loadClass(ClassLoader.java:251)
at weblogic/utils/classloaders/GenericClassLoader.loadClass(GenericClassLoader.java:176)
at jrockit/vm/Classes.loadClassInternal(Classes.java:75)
^-- Holding lock: weblogic/utils/classloaders/GenericClassLoader@0x0E093168[biased lock]
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Classes.forName0(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;(Native Method)
at java/lang/Class.forName0(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;(Native Method)
at java/lang/Class.forName(Class.java:247)
at sun/reflect/generics/factory/CoreReflectionFactory.makeNamedType(CoreReflectionFactory.java:95)
at sun/reflect/generics/visitor/Reifier.visitClassTypeSignature(Reifier.java:107)
at sun/reflect/generics/tree/ClassTypeSignature.accept(ClassTypeSignature.java:31)
at sun/reflect/generics/visitor/Reifier.reifyTypeArguments(Reifier.java:50)
at sun/reflect/generics/visitor/Reifier.visitClassTypeSignature(Reifier.java:120)
at sun/reflect/generics/tree/ClassTypeSignature.accept(ClassTypeSignature.java:31)
at sun/reflect/generics/repository/MethodRepository.getReturnType(MethodRepository.java:50)
at java/lang/reflect/Method.getGenericReturnType(Method.java:236)
at java/lang/reflect/Method.toGenericString(Method.java:482)
at weblogic/ejb/container/ejbc/EjbCodeGenerator.setMethod(EjbCodeGenerator.java:3511)
at weblogic/ejb/container/ejbc/EjbCodeGenerator.remote_interface_methods(EjbCodeGenerator.java:2698)
at weblogic/ejb/container/ejbc/EjbCodeGenerator.remote_business_interface_methods(EjbCodeGenerator.java:2685)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
    at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
    at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java/lang/reflect/Method.invoke(Method.java:597)
    at weblogic/utils/compiler/CodeGenerator.processAt(CodeGenerator.java:688)
    at weblogic/utils/compiler/CodeGenerator.parse(CodeGenerator.java:582)
    at weblogic/utils/compiler/CodeGenerator.parse(CodeGenerator.java:539)
    at weblogic/utils/compiler/CodeGenerator.generateCode(CodeGenerator.java:341)
    at weblogic/utils/compiler/CodeGenerator.generate(CodeGenerator.java:242)
    at weblogic/utils/compiler/CodeGenerator.generate(CodeGenerator.java:197)
    at weblogic/ejb/container/ejbc/EJBCompiler.generateSourcesFromBeanInfo(EJBCompiler.java:1019)
    at weblogic/ejb/container/ejbc/EJBCompiler.doCompile(EJBCompiler.java:299)
    at weblogic/ejb/container/ejbc/EJBCompiler.compileEJB(EJBCompiler.java:552)
    at weblogic/ejb/container/ejbc/EJBCompiler.compileEJB(EJBCompiler.java:519)
    at weblogic/ejb/container/deployer/EJBDeployer.runEJBC(EJBDeployer.java:393)
    at weblogic/ejb/container/deployer/EJBDeployer.compileJar(EJBDeployer.java:715)
    at weblogic/ejb/container/deployer/EJBDeployer.compileIfNecessary(EJBDeployer.java:618)
    at weblogic/ejb/container/deployer/EJBDeployer.prepare(EJBDeployer.java:1154)
    at weblogic/ejb/container/deployer/EJBModule.prepare(EJBModule.java:425)
Stopping PointBase server...
PointBase server stopped.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                &n

Looks like a JVM crash during classloading. Have no idea what might cause it. I suggest you try upgrading to a more recent JRockit version (google for "download jrockit" and get the latest JRMC version you can find, it includes JRockit R27.6.5). If that doesn't help, open a ticket with Oracle Support and provide the text dump and the minidump for analysis.
Henrik

JVM crash on EM64T

Hello,
We are trying to run JRockit JDK1.5.0 on an Xeon64 system (RHEL 3.3). JVM crashes with Illegal memory access on the our main program (small tests are OK).
Thanks for any help.
Vartan Padaryan.
===== BEGIN DUMP ============================================================
JRockit dump produced after 0 days, 00:00:01 on Tue Mar 21 19:11:01 2006
Additional information is available in:
/home/yura/LLP-new/jrockit.19385.dump
No snapshot file (core dump) will be created because core dumps have been
disabled. To enable core dumping, try "ulimit -c unlimited"
before starting JRockit again.
If you see this dump, please open a support case with BEA and
supply as much information as you can on your system setup and
the program you were running. You can also search for solutions
to your problem at http://forums.bea.com in
the forum jrockit.developer.interest.general.
Error Message: Illegal memory access. [54]
Signal info : si_signo=12, si_code=1 si_addr=0x2a00000208
Version : BEA JRockit(R) R26.0.0-188-52875-1.5.0_04-20051110-0920-linux-x86_64
GC : System optimized over throughput (initial strategy singleparpar)
: mmHeap->data = 0x2a961a3000, mmHeap->top = 0x2a9a1a3000
CPU : Intel Pentium 4 SSE SSE2 NetBurst EM64T
Number CPUs : 2
Tot Phys Mem : 1033547776 (985 MB)
OS version : Red Hat Enterprise Linux AS release 3 (Taroon Update 3)
Linux version 2.4.21-20.EL ([email protected]) (gcc version 3.2.3 20030502 (Red Hat Linux 3.2.3-42)) #1 SMP Wed Aug 18 20:34:58 EDT 2004
Thread System: NPTL
State : JVM is running
Command Line : -Djrockit.launcher.type=jrockit.shipment -Xbootclasspath/p:/opt/mpiJava_b1/lib/bootclasses llp.LLP 0 512 10000 3 10 1
JAVA_HOME : <not set>
java.home : /opt/jrockit/jre
j.class.path : .:/opt/mpiJava_b1/lib/classes:/home/yura/PBSrun:/opt/mpiJava_b1/lib/classes:/home/yura/Hello
j.lib.path : /opt/jrockit/jre/lib/amd64/jrockit:/opt/jrockit/jre/lib/amd64:/opt/jrockit/jre/../lib/amd64:/opt/mpiJava_b1/lib:/opt/mpiJava_b1/lib
C Heap : Good; no memory allocations have failed
StackOverFlow: 0 StackOverFlowErrors have occured
Registers (from ThreadContext: 0x40c06b70 / OS context: 0x40c06c20):
rax = 0000000000000000 rcx = 0000000000000000
rdx = 0000002a00000200 rbx = 0000000000000000
rsp = 0000000040c07068 rbp = 0000000000000810
rsi = 0000000000000810 rdi = 0000000000529950
r8 = 0000000000000001 r9 = 0000000000000000
r10 = 000000000072ddd8 r11 = 000000000072dbb0
r12 = 0000000000000001 r13 = 0000000000000000
r14 = 000000000042e948 r15 = 000000000042e948
cs = 0000000000000033 fs = 0000000400000000
gs = 0004000000000000
rip = 0000002a95e4b300 flags = 0000000000000206
Stack:
(* marks the word pointed to by the stack pointer)
0000000040c07068: 0000002a95e4b943* 0000000000529950 0000000000529920 0000000000000810
0000000040c07088: 0000000000000000 0000000000000000 0000002a95e4be3c 000000000000005b
0000000040c070a8: 0000002a95ea213c 000000140000000c 0000000040c071d8 0000002a00000006
0000000040c070c8: 00000000005298f0 0000010000000001 000000000072df18 0000000040c071d8
0000000040c070e8: 0000000040c071a0 0000000000000006 0000002b067b9c5e 000000000000005b
0000000040c07108: 0000000000772760 0000000000772740 0000000000000100 0000000000000001
0000000040c07128: 0000000000000000 000000000042e948 000000000072df18 000000000072dbb0
0000000040c07148: 0000002a95e4bfbd 0000000000000001 0000000000000001 0000000040c071c0
0000000040c07168: 000000000042e948 0000000000000100 000000000072df18 000000000072dbb0
0000000040c07188: 0000000040c07230 0000000000000002 0000002a95e4d356 0000000000754750
0000000040c071a8: 0000000000000001 0000000000000001 000000000072ddd8 000000000042c498
0000000040c071c8: 0000002a95e4d537 0000002a96802958 000000000072ddd8 0000000040c07270
0000000040c071e8: 000000000072dbb0 0000002a96803848 0000000000000100 0000000040c07260
0000000040c07208: 0000000040c07290 000000000072dbb0 000000000021e5d0 0000000000000006
0000000040c07228: 0000002a95e4d74a 000000000021e5d0 000000000072df10 0000002a00000000
0000000040c07248: 000000000042e948 000000000072df18 0000002a00000000 000000000072ddd8
0000000040c07268: 0000002a95e4dc1f 0000010000000100 0000000000000100 0000000000000100
0000000040c07288: 0000002ac64032c5 0000000000000006 0000000000767220 0000002ac64032c0
0000000040c072a8: 000000000072df08 0000000040c07290 000000000072dbb0 0000002a967344a8
0000000040c072c8: 0000000000000100 0000000000000100 0000002ac640316c 0000000000000100
0000000040c072e8: 0000000000000006 0000002a00000000 0000000000000006 0000002a00000100
0000000040c07308: 0000002ac63c9ac7 0000002a00000000 00000000001a5278 0000000000421ad8
0000000040c07328: 0000000000000001 0000002a967344a8 0000002ac6402fe2 0000002a96731960
0000000040c07348: 0000000000000001 0000002a967344a8 0000002ac6402f3e 0000000000000006
0000000040c07368: 0000002a00000000 0000002a967e5c68 0000002a96731960 0000002a00000001
0000000040c07388: 0000000000000001 0000000000000000 0000002ac6402e61 0000000000000000
0000000040c073a8: 0000000000000006 0000002a967318e8 0000002a96804130 0000002a0000000a
0000000040c073c8: 0000002a00000009 0000000000000000 0000002a00000017 0000002a967318e8
0000000040c073e8: 0000002a96804130 0000002a968065c0 0000002ac6401d21 0000000000000000
0000000040c07408: 0000000000000002 0000002a96804130 0000002a968065a8 0000002a968065c0
0000000040c07428: 0000002a96804130 0000002a96804130 000000000072dbb0 fffffffffffffffc
0000000040c07448: 0000002ac6401919 0000000000000000 000000000072dbb0 fffffffffffffffc
0000000040c07468: 0000002ac63bccf4 fffffffffffffffc 0000002a95e40aaf 0000000040c07540
0000000040c07488: 0000002ac6401900 0000000040c07520 000000000072ddd8 0000000000000000
0000000040c074a8: 0000000000000001 0000000040c07540 000000000072ddd8 00000000005b24f0
0000000040c074c8: 0000002a95dd749e 0000000040c07540 0000002a95eb39a7 0000000000000000
0000000040c074e8: 0000000000554078 0000000000000000 000000000072dbb0 000000000072e430
0000000040c07508: 0000000000000000 000000000072ddd8 0000002a95e8fbaf 0000000000000000
0000000040c07528: 0000000040c07610 0000000000000001 000000000072e430 000000000072dbb0
0000000040c07548: 0000000000000000 0000000100000001 0000000000000001 00000000001fcc20
0000000040c07568: 000000000072ddd8 00000000001fe6e0 00000000001fcc20 0000000000554078
0000000040c07588: 0000000100000006 0000000100000001 0000000100000000 0000000000000000
0000000040c075a8: 0000000040c07610 001ffe0000000000 0000000040c07610 000000000045aea0
0000000040c075c8: 000000000072ddd8 000000000072dbb0 0000002a95eb3613 0000000040c07690
0000000040c075e8: 0000002a95ea5de3 0000002a95eb3613 0000000040c07680 0000002a95ed969f
0000000040c07608: 0000000000000000 000000000072e430 0000000000000000 0000000000000000
0000000040c07628: 000000000072de00 000000000072de00 000000000072dbb0 000000000072ddd8
0000000040c07648: 0000002a95ed969f 0000000000516930 0000000000000000 0000002a95ed969f
0000000040c07668: 0000002a95ea6e43 0000000800000000 0000000040c07680 0000000000000000
0000000040c07688: 0000002a95ea6828 0000003000000018 0000000040c07770 0000000040c076b0
0000000040c076a8: 0000000000000000 0000000000000000 000000000045a0c0 000000000072ddd8
0000000040c076c8: 0000000000000000 0000000000004bf3 0000000000000000 0000007fbfef3788
0000000040c076e8: 0000002a95e8e77f 0000007fbfef3788 0000002a95ea213c 000000000072dbb0
0000000040c07708: 0000007fbfef3788 302d646100000005 000000000072dbb0 000000000072ddd8
0000000040c07728: 000000000072dbb0 000000000072ddd8 000000000072dbb0 000000000072ddd8
0000000040c07748: 0000002a95ed9aa9 0000002a9612cfc0 0000000000000000 000000000072dbb0
0000000040c07768: 0000002a95ed9715 000000000072dbb0 0000000000000000 0000000040c077a0
0000000040c07788: 0000002a95ed8dff 0000007fbfef3590 000000000072dbb0 0000000000000000
0000000040c077a8: 0000002a95ed9df3 0000000000000000 000000000072db40 0000000000000000
0000000040c077c8: 0000000000000000 0000007fbfef3500 0000007fbfef34f0 000000000000003f
0000000040c077e8: 0000002a95ecdcb6 0000000040c07970 0000002a9577cc6b 0000000000000000
0000000040c07808: 0000000040c07970 0000000040c07970 0000000000000000 0000000000000000
0000000040c07828: 0000007fbfef3500 0000007fbfef34f0 000000000000003f 0000000040c07800
0000000040c07848: 0000002a9577cc48 0000000000000000 0000000000000000 0000000000000000
Code:
(* marks the word pointed to by the instruction pointer)
0000002a95e4b200: fef6e8c58949ffff 3d8348c68949ffff 4d0a74000025cf33 75c085480574ed85
0000002a95e4b220: c4e900000000b80a 00ad1c8d48000000 8948e8894d000000 000000beea8948d9
0000002a95e4b240: 0025cf003d8b4800 ec8949fffffefee8 4cf0894d05e4c149 0000beda8948e189
0000002a95e4b260: fee1e8ef894c0000 e1c148e98948ffff 4c00000000b84108 4c00000000bee289
0000002a95e4b280: 48fffffec4e8f789 89480033371a058b 03eac148ea894828 4800333779058b48
0000002a95e4b2a0: 25cea735894c1089 0025ceb73d834800 25cea305c70c7400 482beb0000000000
0000002a95e4b2c0: 00000025ce9e05c7 11140f3d8d480030 05890006569ae800 0a75c0850025ce84
0000002a95e4b2e0: 000a0025ce7605c7 5b00000001b80000 c35e415d415c415d 1174d28548178b48
0000002a95e4b300: f0d08948084a8b48* 75d039480fb10f48 0e8b48c3d08948e7 f0c88948084f8948
0000002a95e4b320: 75c839483eb10f48 151d8b4853c390ec 2574db85480025ce 3b48167208733b48
0000002a95e4b340: 4837894810731073 48ffffffc6e8de89 205b8b480eebd889 0000b8db75db8548
0000002a95e4b360: 54415541c35b0000 894808ec83485355 48378b48f58949fd 7308753b4908ee83
0000002a95e4b380: 00333620258b4c33 085d8b48087d8d48 90e8057224343b49 8548dd8948ffffff
0000002a95e4b3a0: 480000008d840fdb 3b4908ee8348338b 085d8b48d4720875 00758948086d8d48
0000002a95e4b3c0: 48ec8949085d8948 245c8b495174db85 08ee8348338b4808 8d48207308753b49
0000002a95e4b3e0: 894908438b48087b 35b6058b48082444 e81e72303b480033 8b4817ebffffff2f
Loaded modules:
(* denotes the module causing the exception)
0000000000400000-00000000004115a3 /opt/jrockit/bin/java
0000002a9566d000-0000002a9566e43f /opt/jrockit/jre/lib/amd64/libjsig.so
0000002a95777000-0000002a957858d8 /lib64/tls/libpthread.so.0
0000002a9588b000-0000002a95911d17 /lib64/tls/libm.so.6
0000002a95a13000-0000002a95a1544f /lib64/libdl.so.2
0000002a95b17000-0000002a95c518a8 /lib64/tls/libc.so.6
0000002a95556000-0000002a9556a97d /lib64/ld-linux-x86-64.so.2
0000002a95d5c000-0000002a95f86b0f */opt/jrockit/jre/lib/amd64/jrockit/libjvm.so
0000002ac5ee9000-0000002ac5ef42cf /lib64/libnss_files.so.2
0000002ac605b000-0000002ac607f473 /opt/jrockit/jre/lib/amd64/libjava.so
0000002ac6185000-0000002ac6191627 /opt/jrockit/jre/lib/amd64/libverify.so
0000002ac6294000-0000002ac62a7017 /lib64/libnsl.so.1
0000002b063fb000-0000002b06403e3f /opt/jrockit/jre/lib/amd64/native_threads/libhpi.so
0000002b06537000-0000002b06537917 /opt/mpiJava_b1/lib/libsavesignals.so
0000002b067a7000-0000002b067f17b7 /opt/mpiJava_b1/lib/libmpijava.so
0000002b06638000-0000002b06653f1f /opt/mx/lib/libmyriexpress.so
"Thread-0" id=9 idx=0x16 tid=19443 lastJavaFrame=0x40c07298
Stack 0: start=0x40be4000, end=0x40c08000, guards=0x40be9000 (ok), forbidden=0x40be7000
Thread Stack Trace:
at mmGetFirstElementFromList+8()@0x2a95e4b300

Hi!
You have the following three libraries loaded:
/opt/mpiJava_b1/lib/libsavesignals.so
/opt/mpiJava_b1/lib/libmpijava.so
/opt/mx/lib/libmyriexpress.so
Can you repro this without them?
Also, you seem to be running on RHEL3u3 on EM64T, which is not supported
(but may or may not work well anyway of course). Please see our list of
supported configurations:
http://e-docs.bea.com/jrockit/jrdocs/suppPlat/supp_50.html
Regards //Johan
Vartan Padaryan wrote:
Hello,
We are trying to run JRockit JDK1.5.0 on an Xeon64 system (RHEL 3.3). JVM crashes with Illegal memory access on the our main program (small tests are OK).
Thanks for any help.
Vartan Padaryan.
===== BEGIN DUMP ============================================================
JRockit dump produced after 0 days, 00:00:01 on Tue Mar 21 19:11:01 2006
Additional information is available in:
/home/yura/LLP-new/jrockit.19385.dump
No snapshot file (core dump) will be created because core dumps have been
disabled. To enable core dumping, try "ulimit -c unlimited"
before starting JRockit again.
If you see this dump, please open a support case with BEA and
supply as much information as you can on your system setup and
the program you were running. You can also search for solutions
to your problem at http://forums.bea.com in
the forum jrockit.developer.interest.general.
Error Message: Illegal memory access. [54]
Signal info : si_signo=12, si_code=1 si_addr=0x2a00000208
Version : BEA JRockit(R) R26.0.0-188-52875-1.5.0_04-20051110-0920-linux-x86_64
GC : System optimized over throughput (initial strategy singleparpar)
: mmHeap->data = 0x2a961a3000, mmHeap->top = 0x2a9a1a3000
CPU : Intel Pentium 4 SSE SSE2 NetBurst EM64T
Number CPUs : 2
Tot Phys Mem : 1033547776 (985 MB)
OS version : Red Hat Enterprise Linux AS release 3 (Taroon Update 3)
Linux version 2.4.21-20.EL ([email protected]) (gcc version 3.2.3 20030502 (Red Hat Linux 3.2.3-42)) #1 SMP Wed Aug 18 20:34:58 EDT 2004
Thread System: NPTL
State : JVM is running
Command Line : -Djrockit.launcher.type=jrockit.shipment -Xbootclasspath/p:/opt/mpiJava_b1/lib/bootclasses llp.LLP 0 512 10000 3 10 1
JAVA_HOME : <not set>
java.home : /opt/jrockit/jre
j.class.path : .:/opt/mpiJava_b1/lib/classes:/home/yura/PBSrun:/opt/mpiJava_b1/lib/classes:/home/yura/Hello
j.lib.path : /opt/jrockit/jre/lib/amd64/jrockit:/opt/jrockit/jre/lib/amd64:/opt/jrockit/jre/../lib/amd64:/opt/mpiJava_b1/lib:/opt/mpiJava_b1/lib
C Heap : Good; no memory allocations have failed
StackOverFlow: 0 StackOverFlowErrors have occured
Registers (from ThreadContext: 0x40c06b70 / OS context: 0x40c06c20):
rax = 0000000000000000 rcx = 0000000000000000
rdx = 0000002a00000200 rbx = 0000000000000000
rsp = 0000000040c07068 rbp = 0000000000000810
rsi = 0000000000000810 rdi = 0000000000529950
r8 = 0000000000000001 r9 = 0000000000000000
r10 = 000000000072ddd8 r11 = 000000000072dbb0
r12 = 0000000000000001 r13 = 0000000000000000
r14 = 000000000042e948 r15 = 000000000042e948
cs = 0000000000000033 fs = 0000000400000000
gs = 0004000000000000
rip = 0000002a95e4b300 flags = 0000000000000206
Stack:
(* marks the word pointed to by the stack pointer)
0000000040c07068: 0000002a95e4b943* 0000000000529950 0000000000529920 0000000000000810
0000000040c07088: 0000000000000000 0000000000000000 0000002a95e4be3c 000000000000005b
0000000040c070a8: 0000002a95ea213c 000000140000000c 0000000040c071d8 0000002a00000006
0000000040c070c8: 00000000005298f0 0000010000000001 000000000072df18 0000000040c071d8
0000000040c070e8: 0000000040c071a0 0000000000000006 0000002b067b9c5e 000000000000005b
0000000040c07108: 0000000000772760 0000000000772740 0000000000000100 0000000000000001
0000000040c07128: 0000000000000000 000000000042e948 000000000072df18 000000000072dbb0
0000000040c07148: 0000002a95e4bfbd 0000000000000001 0000000000000001 0000000040c071c0
0000000040c07168: 000000000042e948 0000000000000100 000000000072df18 000000000072dbb0
0000000040c07188: 0000000040c07230 0000000000000002 0000002a95e4d356 0000000000754750
0000000040c071a8: 0000000000000001 0000000000000001 000000000072ddd8 000000000042c498
0000000040c071c8: 0000002a95e4d537 0000002a96802958 000000000072ddd8 0000000040c07270
0000000040c071e8: 000000000072dbb0 0000002a96803848 0000000000000100 0000000040c07260
0000000040c07208: 0000000040c07290 000000000072dbb0 000000000021e5d0 0000000000000006
0000000040c07228: 0000002a95e4d74a 000000000021e5d0 000000000072df10 0000002a00000000
0000000040c07248: 000000000042e948 000000000072df18 0000002a00000000 000000000072ddd8
0000000040c07268: 0000002a95e4dc1f 0000010000000100 0000000000000100 0000000000000100
0000000040c07288: 0000002ac64032c5 0000000000000006 0000000000767220 0000002ac64032c0
0000000040c072a8: 000000000072df08 0000000040c07290 000000000072dbb0 0000002a967344a8
0000000040c072c8: 0000000000000100 0000000000000100 0000002ac640316c 0000000000000100
0000000040c072e8: 0000000000000006 0000002a00000000 0000000000000006 0000002a00000100
0000000040c07308: 0000002ac63c9ac7 0000002a00000000 00000000001a5278 0000000000421ad8
0000000040c07328: 0000000000000001 0000002a967344a8 0000002ac6402fe2 0000002a96731960
0000000040c07348: 0000000000000001 0000002a967344a8 0000002ac6402f3e 0000000000000006
0000000040c07368: 0000002a00000000 0000002a967e5c68 0000002a96731960 0000002a00000001
0000000040c07388: 0000000000000001 0000000000000000 0000002ac6402e61 0000000000000000
0000000040c073a8: 0000000000000006 0000002a967318e8 0000002a96804130 0000002a0000000a
0000000040c073c8: 0000002a00000009 0000000000000000 0000002a00000017 0000002a967318e8
0000000040c073e8: 0000002a96804130 0000002a968065c0 0000002ac6401d21 0000000000000000
0000000040c07408: 0000000000000002 0000002a96804130 0000002a968065a8 0000002a968065c0
0000000040c07428: 0000002a96804130 0000002a96804130 000000000072dbb0 fffffffffffffffc
0000000040c07448: 0000002ac6401919 0000000000000000 000000000072dbb0 fffffffffffffffc
0000000040c07468: 0000002ac63bccf4 fffffffffffffffc 0000002a95e40aaf 0000000040c07540
0000000040c07488: 0000002ac6401900 0000000040c07520 000000000072ddd8 0000000000000000
0000000040c074a8: 0000000000000001 0000000040c07540 000000000072ddd8 00000000005b24f0
0000000040c074c8: 0000002a95dd749e 0000000040c07540 0000002a95eb39a7 0000000000000000
0000000040c074e8: 0000000000554078 0000000000000000 000000000072dbb0 000000000072e430
0000000040c07508: 0000000000000000 000000000072ddd8 0000002a95e8fbaf 0000000000000000
0000000040c07528: 0000000040c07610 0000000000000001 000000000072e430 000000000072dbb0
0000000040c07548: 0000000000000000 0000000100000001 0000000000000001 00000000001fcc20
0000000040c07568: 000000000072ddd8 00000000001fe6e0 00000000001fcc20 0000000000554078
0000000040c07588: 0000000100000006 0000000100000001 0000000100000000 0000000000000000
0000000040c075a8: 0000000040c07610 001ffe0000000000 0000000040c07610 000000000045aea0
0000000040c075c8: 000000000072ddd8 000000000072dbb0 0000002a95eb3613 0000000040c07690
0000000040c075e8: 0000002a95ea5de3 0000002a95eb3613 0000000040c07680 0000002a95ed969f
0000000040c07608: 0000000000000000 000000000072e430 0000000000000000 0000000000000000
0000000040c07628: 000000000072de00 000000000072de00 000000000072dbb0 000000000072ddd8
0000000040c07648: 0000002a95ed969f 0000000000516930 0000000000000000 0000002a95ed969f
0000000040c07668: 0000002a95ea6e43 0000000800000000 0000000040c07680 0000000000000000
0000000040c07688: 0000002a95ea6828 0000003000000018 0000000040c07770 0000000040c076b0
0000000040c076a8: 0000000000000000 0000000000000000 000000000045a0c0 000000000072ddd8
0000000040c076c8: 0000000000000000 0000000000004bf3 0000000000000000 0000007fbfef3788
0000000040c076e8: 0000002a95e8e77f 0000007fbfef3788 0000002a95ea213c 000000000072dbb0
0000000040c07708: 0000007fbfef3788 302d646100000005 000000000072dbb0 000000000072ddd8
0000000040c07728: 000000000072dbb0 000000000072ddd8 000000000072dbb0 000000000072ddd8
0000000040c07748: 0000002a95ed9aa9 0000002a9612cfc0 0000000000000000 000000000072dbb0
0000000040c07768: 0000002a95ed9715 000000000072dbb0 0000000000000000 0000000040c077a0
0000000040c07788: 0000002a95ed8dff 0000007fbfef3590 000000000072dbb0 0000000000000000
0000000040c077a8: 0000002a95ed9df3 0000000000000000 000000000072db40 0000000000000000
0000000040c077c8: 0000000000000000 0000007fbfef3500 0000007fbfef34f0 000000000000003f
0000000040c077e8: 0000002a95ecdcb6 0000000040c07970 0000002a9577cc6b 0000000000000000
0000000040c07808: 0000000040c07970 0000000040c07970 0000000000000000 0000000000000000
0000000040c07828: 0000007fbfef3500 0000007fbfef34f0 000000000000003f 0000000040c07800
0000000040c07848: 0000002a9577cc48 0000000000000000 0000000000000000 0000000000000000
Code:
(* marks the word pointed to by the instruction pointer)
0000002a95e4b200: fef6e8c58949ffff 3d8348c68949ffff 4d0a74000025cf33 75c085480574ed85
0000002a95e4b220: c4e900000000b80a 00ad1c8d48000000 8948e8894d000000 000000beea8948d9
0000002a95e4b240: 0025cf003d8b4800 ec8949fffffefee8 4cf0894d05e4c149 0000beda8948e189
0000002a95e4b260: fee1e8ef894c0000 e1c148e98948ffff 4c00000000b84108 4c00000000bee289
0000002a95e4b280: 48fffffec4e8f789 89480033371a058b 03eac148ea894828 4800333779058b48
0000002a95e4b2a0: 25cea735894c1089 0025ceb73d834800 25cea305c70c7400 482beb0000000000
0000002a95e4b2c0: 00000025ce9e05c7 11140f3d8d480030 05890006569ae800 0a75c0850025ce84
0000002a95e4b2e0: 000a0025ce7605c7 5b00000001b80000 c35e415d415c415d 1174d28548178b48
0000002a95e4b300: f0d08948084a8b48* 75d039480fb10f48 0e8b48c3d08948e7 f0c88948084f8948
0000002a95e4b320: 75c839483eb10f48 151d8b4853c390ec 2574db85480025ce 3b48167208733b48
0000002a95e4b340: 4837894810731073 48ffffffc6e8de89 205b8b480eebd889 0000b8db75db8548
0000002a95e4b360: 54415541c35b0000 894808ec83485355 48378b48f58949fd 7308753b4908ee83
0000002a95e4b380: 00333620258b4c33 085d8b48087d8d48 90e8057224343b49 8548dd8948ffffff
0000002a95e4b3a0: 480000008d840fdb 3b4908ee8348338b 085d8b48d4720875 00758948086d8d48
0000002a95e4b3c0: 48ec8949085d8948 245c8b495174db85 08ee8348338b4808 8d48207308753b49
0000002a95e4b3e0: 894908438b48087b 35b6058b48082444 e81e72303b480033 8b4817ebffffff2f
Loaded modules:
(* denotes the module causing the exception)
0000000000400000-00000000004115a3 /opt/jrockit/bin/java
0000002a9566d000-0000002a9566e43f /opt/jrockit/jre/lib/amd64/libjsig.so
0000002a95777000-0000002a957858d8 /lib64/tls/libpthread.so.0
0000002a9588b000-0000002a95911d17 /lib64/tls/libm.so.6
0000002a95a13000-0000002a95a1544f /lib64/libdl.so.2
0000002a95b17000-0000002a95c518a8 /lib64/tls/libc.so.6
0000002a95556000-0000002a9556a97d /lib64/ld-linux-x86-64.so.2
0000002a95d5c000-0000002a95f86b0f */opt/jrockit/jre/lib/amd64/jrockit/libjvm.so
0000002ac5ee9000-0000002ac5ef42cf /lib64/libnss_files.so.2
0000002ac605b000-0000002ac607f473 /opt/jrockit/jre/lib/amd64/libjava.so
0000002ac6185000-0000002ac6191627 /opt/jrockit/jre/lib/amd64/libverify.so
0000002ac6294000-0000002ac62a7017 /lib64/libnsl.so.1
0000002b063fb000-0000002b06403e3f /opt/jrockit/jre/lib/amd64/native_threads/libhpi.so
0000002b06537000-0000002b06537917 /opt/mpiJava_b1/lib/libsavesignals.so
0000002b067a7000-0000002b067f17b7 /opt/mpiJava_b1/lib/libmpijava.so
0000002b06638000-0000002b06653f1f /opt/mx/lib/libmyriexpress.so
"Thread-0" id=9 idx=0x16 tid=19443 lastJavaFrame=0x40c07298
Stack 0: start=0x40be4000, end=0x40c08000, guards=0x40be9000 (ok), forbidden=0x40be7000
Thread Stack Trace:
at mmGetFirstElementFromList+8()@0x2a95e4b300

JVM Crash: ConcMarkSweepGC related?

We're experiencing the following JVM crash approximately 2-5 times per day on a well traffic application server running Tomcat 5.5 under Java 1.5 (05) on Linux with a 2.4.21-37 kernel. I'm posting here because we kind of have no route to take: I can't seem to work around the crash in any way. There's a potential that UseParallelGC might fix this, but I'm unable to run the app reliably with a ParallelGC, as we have a very large cache and the Full GC's get unbelievably long (2GB heap).
How can we find out what's going on? Is there a way to obtain a debug build so that:
V [libjvm.so+0x4c2c53]
V [libjvm.so+0x1bea7c]
We're also seeing this in the standard output:
An exception occurred on the SessionReaperDaemon[null, 2005-11-01 20:02:14.81] thread while processing (task="com.tangosol.coherence.servlet.SessionHelper$SessionReaperDaemon$IncrementalReapTask@1ba4ac8"):
java.lang.NullPointerException
     at com.tangosol.coherence.servlet.SessionHelper$SessionReaperDaemon$IncrementalReapTask.run(SessionHelper.java:3072)
     at com.tangosol.util.TaskDaemon.run(TaskDaemon.java:69)
     at com.tangosol.coherence.servlet.SessionHelper$SessionReaperDaemon.run(SessionHelper.java:2709)
     at com.tangosol.util.Daemon$1.run(Daemon.java:63)
Prior to the crash, but this is an impossible place for an exception:
3070: if (iter.hasNext())
3071: {
3072: String sId = (String) iter.next();3073: ...
Any help or next steps would be greatly appreciated.
An attached dump:
# An unexpected error has been detected by HotSpot Virtual Machine:
# Internal Error (4E4D4554484F440E4350500521), pid=1705, tid=907377584
# Java VM: Java HotSpot(TM) Server VM (1.5.0_05-b05 mixed mode)
--------------- T H R E A D ---------------
Current thread (0x36bc7068): JavaThread "SessionReaperDaemon[null, 2005-11-01 22:38:23.388]" daemon [_thread_in_Java, id=1739]
Stack: [0x360d7000,0x36158000), sp=0x36156eec, free space=511k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x4c2c53]
V [libjvm.so+0x1bea7c]
V [libjvm.so+0x3e2bee]
V [libjvm.so+0x4564cb]
V [libjvm.so+0x3f8956]
V [libjvm.so+0x3f5c64]
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x0894eba0 JavaThread "Keep-Alive-Timer" daemon [_thread_blocked, id=4871]
0x0864ea88 JavaThread "RMI TCP Connection(341)-192.168.100.62" daemon [_thread_in_native, id=4802]
0x083e6568 JavaThread "http-80-Processor300" daemon [_thread_in_native, id=4708]
0x08d4e058 JavaThread "http-80-Processor299" daemon [_thread_in_native, id=4707]
0x08bc7c20 JavaThread "http-80-Processor298" daemon [_thread_blocked, id=4706]
0x0845fd78 JavaThread "http-80-Processor297" daemon [_thread_in_native, id=4705]
0x08e39330 JavaThread "http-80-Processor296" daemon [_thread_in_native, id=4704]
0x08bceb30 JavaThread "http-80-Processor295" daemon [_thread_blocked, id=4703]
0x08bb9de8 JavaThread "http-80-Processor294" daemon [_thread_in_native, id=4702]
0x08b692d0 JavaThread "http-80-Processor293" daemon [_thread_in_native, id=4701]
0x084fa8e0 JavaThread "http-80-Processor292" daemon [_thread_in_native, id=4700]
0x08446908 JavaThread "http-80-Processor291" daemon [_thread_blocked, id=4699]
0x08e4c4c0 JavaThread "http-80-Processor290" daemon [_thread_in_native, id=4698]
0x08625e60 JavaThread "http-80-Processor289" daemon [_thread_blocked, id=4697]
0x0843d5b8 JavaThread "http-80-Processor288" daemon [_thread_in_native, id=4696]
0x08ca13b8 JavaThread "http-80-Processor287" daemon [_thread_in_native, id=4695]
0x08395e00 JavaThread "http-80-Processor286" daemon [_thread_in_native, id=4694]
0x084c8f28 JavaThread "http-80-Processor285" daemon [_thread_in_native, id=4693]
0x083f6490 JavaThread "http-80-Processor284" daemon [_thread_in_native, id=4692]
0x08e69368 JavaThread "http-80-Processor281" daemon [_thread_blocked, id=4689]
0x08df8218 JavaThread "http-80-Processor280" daemon [_thread_blocked, id=4688]
0x0861ba28 JavaThread "http-80-Processor279" daemon [_thread_blocked, id=4687]
0x083e22d0 JavaThread "http-80-Processor278" daemon [_thread_blocked, id=4686]
0x08e44e80 JavaThread "http-80-Processor277" daemon [_thread_blocked, id=4685]
0x08625478 JavaThread "http-80-Processor276" daemon [_thread_blocked, id=4684]
0x08547890 JavaThread "http-80-Processor275" daemon [_thread_in_native, id=4632]
0x0846c598 JavaThread "http-80-Processor274" daemon [_thread_in_native, id=4631]
0x08beadb8 JavaThread "http-80-Processor270" daemon [_thread_in_native, id=4627]
0x0865b3a0 JavaThread "http-80-Processor269" daemon [_thread_in_native, id=4626]
0x092899e0 JavaThread "http-80-Processor268" daemon [_thread_in_native, id=4625]
0x09277f58 JavaThread "http-80-Processor267" daemon [_thread_blocked, id=4624]
0x086790b0 JavaThread "http-80-Processor265" daemon [_thread_in_native, id=4622]
0x0844d920 JavaThread "http-80-Processor263" daemon [_thread_blocked, id=4620]
0x0846f478 JavaThread "http-80-Processor262" daemon [_thread_in_native, id=4619]
0x08c5f470 JavaThread "http-80-Processor261" daemon [_thread_in_native, id=4618]
0x088cd8d0 JavaThread "http-80-Processor260" daemon [_thread_in_native, id=4617]
0x08d5af30 JavaThread "http-80-Processor259" daemon [_thread_blocked, id=4616]
0x0884bc18 JavaThread "http-80-Processor258" daemon [_thread_blocked, id=4615]
0x08e618a0 JavaThread "http-80-Processor257" daemon [_thread_in_native, id=4614]
0x08be3de0 JavaThread "http-80-Processor256" daemon [_thread_in_native, id=4613]
0x085de680 JavaThread "http-80-Processor255" daemon [_thread_blocked, id=4612]
0x083b8420 JavaThread "http-80-Processor254" daemon [_thread_blocked, id=4611]
0x08e533e0 JavaThread "http-80-Processor253" daemon [_thread_in_native, id=4610]
0x083c5af8 JavaThread "http-80-Processor252" daemon [_thread_in_native, id=4609]
0x084701c0 JavaThread "http-80-Processor251" daemon [_thread_blocked, id=4608]
0x3639cff0 JavaThread "http-80-Processor250" daemon [_thread_in_native, id=4402]
0x2f41cd88 JavaThread "http-80-Processor249" daemon [_thread_in_native, id=4401]
0x36bf7a48 JavaThread "http-80-Processor247" daemon [_thread_blocked, id=4399]
0x35160748 JavaThread "http-80-Processor246" daemon [_thread_in_native, id=4398]
0x36b42ed0 JavaThread "http-80-Processor245" daemon [_thread_blocked, id=4397]
0x359b3ec0 JavaThread "http-80-Processor244" daemon [_thread_in_native, id=4396]
0x3633a1f8 JavaThread "http-80-Processor240" daemon [_thread_blocked, id=4392]
0x35a9ef28 JavaThread "http-80-Processor239" daemon [_thread_in_native, id=4391]
0x35a52840 JavaThread "http-80-Processor238" daemon [_thread_blocked, id=4390]
0x35a8e9e8 JavaThread "http-80-Processor236" daemon [_thread_blocked, id=4388]
0x35a8de38 JavaThread "http-80-Processor235" daemon [_thread_in_native, id=4387]
0x304703b8 JavaThread "http-80-Processor232" daemon [_thread_in_native, id=4384]
0x36b32498 JavaThread "http-80-Processor231" daemon [_thread_blocked, id=4383]
0x2e149a40 JavaThread "http-80-Processor230" daemon [_thread_blocked, id=4382]
0x304731f8 JavaThread "http-80-Processor229" daemon [_thread_blocked, id=4381]
0x2e186cd0 JavaThread "http-80-Processor228" daemon [_thread_in_native, id=4380]
0x35a53c68 JavaThread "http-80-Processor227" daemon [_thread_blocked, id=4379]
0x083a85d0 JavaThread "RMI TCP Connection(315)-192.168.100.62" daemon [_thread_blocked, id=4343]
0x08cdd748 JavaThread "JMX server connection timeout 1017" daemon [_thread_blocked, id=3885]
0x08df9fc0 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=3884]
0x083c7f68 JavaThread "http-80-Processor225" daemon [_thread_blocked, id=3816]
0x083c85b8 JavaThread "http-80-Processor223" daemon [_thread_blocked, id=3814]
0x08df3be8 JavaThread "http-80-Processor222" daemon [_thread_in_native, id=3813]
0x087a49b8 JavaThread "http-80-Processor221" daemon [_thread_in_native, id=3812]
0x084c9db8 JavaThread "http-80-Processor220" daemon [_thread_in_native, id=3811]
0x086203e0 JavaThread "http-80-Processor218" daemon [_thread_in_native, id=3809]
0x088e2090 JavaThread "http-80-Processor216" daemon [_thread_in_native, id=3807]
0x088bd2d0 JavaThread "http-80-Processor214" daemon [_thread_in_native, id=3805]
0x08863490 JavaThread "http-80-Processor211" daemon [_thread_in_native, id=3802]
0x08e9f4b8 JavaThread "http-80-Processor207" daemon [_thread_in_native, id=3798]
0x08c9f748 JavaThread "http-80-Processor206" daemon [_thread_in_native, id=3797]
0x0861fa00 JavaThread "http-80-Processor205" daemon [_thread_in_native, id=3796]
0x08408ec8 JavaThread "http-80-Processor204" daemon [_thread_blocked, id=3795]
0x0869bf28 JavaThread "http-80-Processor203" daemon [_thread_blocked, id=3794]
0x08ba2648 JavaThread "http-80-Processor201" daemon [_thread_blocked, id=3792]
0x08e70980 JavaThread "http-80-Processor200" daemon [_thread_blocked, id=3550]
0x08e707e8 JavaThread "http-80-Processor199" daemon [_thread_blocked, id=3549]
0x088e83b0 JavaThread "http-80-Processor196" daemon [_thread_blocked, id=3546]
0x08634758 JavaThread "http-80-Processor195" daemon [_thread_blocked, id=3545]
0x08198ea8 JavaThread "http-80-Processor194" daemon [_thread_blocked, id=3544]
0x0831d5a8 JavaThread "http-80-Processor191" daemon [_thread_in_native, id=3541]
0x088c6788 JavaThread "http-80-Processor189" daemon [_thread_in_native, id=3539]
0x0835d868 JavaThread "http-80-Processor187" daemon [_thread_blocked, id=3537]
0x08be2788 JavaThread "http-80-Processor186" daemon [_thread_in_native, id=3536]
0x08d5b638 JavaThread "http-80-Processor182" daemon [_thread_blocked, id=3532]
0x088c6488 JavaThread "http-80-Processor180" daemon [_thread_in_native, id=3530]
0x08d83d70 JavaThread "http-80-Processor173" daemon [_thread_blocked, id=3158]
0x088f3ca8 JavaThread "http-80-Processor171" daemon [_thread_blocked, id=3156]
0x08862858 JavaThread "http-80-Processor168" daemon [_thread_blocked, id=3153]
0x08629e38 JavaThread "http-80-Processor162" daemon [_thread_blocked, id=3147]
0x086b9dd0 JavaThread "http-80-Processor159" daemon [_thread_in_native, id=3144]
0x086e1c88 JavaThread "http-80-Processor153" daemon [_thread_in_native, id=3138]
0x082fae10 JavaThread "http-80-Processor151" daemon [_thread_in_native, id=3136]
0x084c7c40 JavaThread "http-80-Processor149" daemon [_thread_blocked, id=2489]
0x087a5568 JavaThread "http-80-Processor147" daemon [_thread_in_native, id=2487]
0x08c5f648 JavaThread "http-80-Processor146" daemon [_thread_blocked, id=2486]
0x08c64090 JavaThread "http-80-Processor135" daemon [_thread_blocked, id=2475]
0x08d60c68 JavaThread "http-80-Processor133" daemon [_thread_in_native, id=2473]
0x08cdc058 JavaThread "http-80-Processor129" daemon [_thread_blocked, id=2469]
0x0854a978 JavaThread "http-80-Processor128" daemon [_thread_blocked, id=2468]
0x08d940c0 JavaThread "http-80-Processor126" daemon [_thread_in_native, id=2466]
0x087c4998 JavaThread "http-80-Processor114" daemon [_thread_blocked, id=2186]
0x0895ec90 JavaThread "http-80-Processor113" daemon [_thread_in_native, id=2185]
0x0895e028 JavaThread "http-80-Processor112" daemon [_thread_blocked, id=2184]
0x08e9bbb8 JavaThread "http-80-Processor82" daemon [_thread_in_native, id=2147]
0x08634cf8 JavaThread "http-80-Processor80" daemon [_thread_in_native, id=2145]
0x085d93c0 JavaThread "http-80-Processor68" daemon [_thread_blocked, id=2129]
0x085d8658 JavaThread "http-80-Processor67" daemon [_thread_blocked, id=2128]
0x085d7310 JavaThread "http-80-Processor66" daemon [_thread_in_native, id=2127]
0x084c57e0 JavaThread "http-80-Processor60" daemon [_thread_blocked, id=2121]
0x084c4a78 JavaThread "http-80-Processor59" daemon [_thread_blocked, id=2120]
0x08588db8 JavaThread "http-80-Processor56" daemon [_thread_blocked, id=2117]
0x086a2130 JavaThread "http-80-Processor54" daemon [_thread_in_native, id=2115]
0x0878cfa8 JavaThread "http-80-Processor50" daemon [_thread_in_native, id=2108]
0x087b9148 JavaThread "http-80-Processor39" daemon [_thread_blocked, id=2097]
0x082f38c8 JavaThread "http-80-Processor29" daemon [_thread_blocked, id=2087]
0x087a6a30 JavaThread "http-80-Processor28" daemon [_thread_in_native, id=2086]
0x36b33540 JavaThread "http-80-Monitor" [_thread_blocked, id=1769]
0x351178e0 JavaThread "http-80-Processor4" daemon [_thread_blocked, id=1747]
0x35a72210 JavaThread "http-80-Processor1" daemon [_thread_blocked, id=1744]
0x363ed3b0 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=1743]
0x35a60238 JavaThread "Thread-4" [_thread_blocked, id=1742]
=>0x36bc7068 JavaThread "SessionReaperDaemon[null, 2005-11-01 22:38:23.388]" daemon [_thread_in_Java, id=1739]
0x363633c8 JavaThread "DistributedCache:DistributedSessions:EventDispatcher" daemon [_thread_blocked, id=1738]
0x363771a0 JavaThread "DistributedCache:DistributedSessions" daemon [_thread_blocked, id=1737]
0x36ba85f0 JavaThread "ReplicatedCache:ReplicatedSessionsMisc" daemon [_thread_blocked, id=1736]
0x36bbb118 JavaThread "TcpRingListener" daemon [_thread_in_native, id=1735]
0x36373478 JavaThread "Cluster" daemon [_thread_blocked, id=1733]
0x36351268 JavaThread "PacketPublisher" daemon [_thread_blocked, id=1732]
0x36350d60 JavaThread "PacketReceiver" daemon [_thread_blocked, id=1731]
0x36ba8858 JavaThread "PacketListenerN" daemon [_thread_in_native, id=1730]
0x36bb11e8 JavaThread "PacketListener1" daemon [_thread_in_native, id=1729]
0x36b9f530 JavaThread "Logger@9508926 3.0/315" daemon [_thread_blocked, id=1728]
0x081b0910 JavaThread "RMI TCP Accept-9000" daemon [_thread_in_native, id=1726]
0x081b5c90 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=1725]
0x081b57c0 JavaThread "Timer-0" daemon [_thread_blocked, id=1724]
0x08157b60 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=1722]
0x081566e8 JavaThread "CompilerThread1" daemon [_thread_blocked, id=1721]
0x08155698 JavaThread "CompilerThread0" daemon [_thread_blocked, id=1720]
0x08154578 JavaThread "AdapterThread" daemon [_thread_blocked, id=1719]
0x08153618 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=1718]
0x081528e8 JavaThread "Surrogate Locker Thread (CMS)" daemon [_thread_blocked, id=1717]
0x08148480 JavaThread "Finalizer" daemon [_thread_blocked, id=1716]
0x08148008 JavaThread "Reference Handler" daemon [_thread_blocked, id=1715]
0x0805c598 JavaThread "main" [_thread_in_native, id=1705]
Other Threads:
0x08145bc8 VMThread [id=1714]
0x082237b0 WatcherThread [id=1727]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
par new generation total 523840K, used 289536K [0x3d1c0000, 0x5d1c0000, 0x5d1c0000)
eden space 523392K, 55% used [0x3d1c0000, 0x4ec800f0, 0x5d0e0000)
from space 448K, 0% used [0x5d150000, 0x5d150000, 0x5d1c0000)
to space 448K, 0% used [0x5d0e0000, 0x5d0e0000, 0x5d150000)
concurrent mark-sweep generation total 1318912K, used 521347K [0x5d1c0000, 0xad9c0000, 0xad9c0000)
concurrent-mark-sweep perm gen total 30720K, used 30499K [0xad9c0000, 0xaf7c0000, 0xb19c0000)
Dynamic libraries:
08048000-08056000 r-xp 00000000 08:02 180163 /usr/java/jdk1.5.0_05/bin/java
08056000-08058000 rwxp 0000e000 08:02 180163 /usr/java/jdk1.5.0_05/bin/java
08058000-0aea7000 rwxp 00000000 00:00 0
2af40000-2b067000 rwxp 00001000 00:00 0
2b067000-2b06a000 ---p 00000000 00:00 0
2b06a000-2b0e8000 rwxp 00003000 00:00 0
2b0e8000-2b0eb000 ---p 00081000 00:00 0
2b0eb000-2b169000 rwxp 00084000 00:00 0
2b169000-2b16c000 ---p 00102000 00:00 0
2b16c000-2b1ea000 rwxp 00105000 00:00 0
2b1ea000-2b1ed000 ---p 00081000 00:00 0
2b1ed000-2b26b000 rwxp 00084000 00:00 0
2b26b000-2b26e000 ---p 00081000 00:00 0
2b26e000-2b2ec000 rwxp 00084000 00:00 0
2b2ec000-2b367000 r-xs 00000000 08:02 1784003 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xsdlib.jar
2b367000-2b382000 r-xs 00000000 08:02 1784002 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xmlrpc-1.2-b1.jar
2b382000-2b39d000 r-xs 00000000 08:02 1784001 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xml-apis.jar
2b39d000-2b476000 r-xs 00000000 08:02 1784000 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xercesImpl.jar
2b476000-2b554000 r-xs 00000000 08:02 1783999 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xalan.jar
2b554000-2b557000 ---p 00000000 00:00 0
2b557000-2b5d5000 rwxp 00003000 00:00 0
2b5d5000-2b5d8000 ---p 00081000 00:00 0
2b5d8000-2b656000 rwxp 00084000 00:00 0
2b656000-2b659000 ---p 00081000 00:00 0
2b659000-2b6d7000 rwxp 00084000 00:00 0
2b6d7000-2b6da000 ---p 00102000 00:00 0
2b6da000-2b758000 rwxp 00105000 00:00 0
2b758000-2b75b000 ---p 00183000 00:00 0
2b75b000-2b7d9000 rwxp 00186000 00:00 0
2b7d9000-2b7dc000 rwxp 00000000 00:00 0
2b7dc000-2b85a000 rwxp 00207000 00:00 0
2b85a000-2b85d000 ---p 00285000 00:00 0
2b85d000-2b8db000 rwxp 00288000 00:00 0
2b8db000-2b8de000 ---p 00102000 00:00 0
2b8de000-2b95c000 rwxp 00105000 00:00 0
2b95c000-2b95f000 ---p 00183000 00:00 0
2b95f000-2ba5d000 rwxp 00186000 00:00 0
2ba5d000-2ba60000 ---p 00182000 00:00 0
2ba60000-2bade000 rwxp 00185000 00:00 0
2bade000-2bae1000 ---p 00203000 00:00 0
2bae1000-2bb5f000 rwxp 00206000 00:00 0
2bb5f000-2bb62000 ---p 00284000 00:00 0
2bb62000-2bbe0000 rwxp 00287000 00:00 0
2bbe0000-2bbe3000 ---p 00305000 00:00 0
2bbe3000-2bc61000 rwxp 00308000 00:00 0
2bc61000-2bc64000 ---p 00204000 00:00 0
2bc64000-2bce2000 rwxp 00207000 00:00 0
2bce2000-2bce5000 ---p 00285000 00:00 0
2bce5000-2bd63000 rwxp 00288000 00:00 0
2bd63000-2bd66000 rwxp 00000000 00:00 0
2bd66000-2bde4000 rwxp 00186000 00:00 0
2bde4000-2bde7000 ---p 00204000 00:00 0
2bde7000-2be65000 rwxp 00207000 00:00 0
2be65000-2be68000 rwxp 00000000 00:00 0
2be68000-2bee6000 rwxp 00084000 00:00 0
2bee6000-2bee9000 ---p 00102000 00:00 0
2bee9000-2bf67000 rwxp 00105000 00:00 0
2bf67000-2bf6a000 ---p 00183000 00:00 0
2bf6a000-2bfe8000 rwxp 00186000 00:00 0
2bfe8000-2bfeb000 ---p 00204000 00:00 0
2bfeb000-2c069000 rwxp 00207000 00:00 0
2c069000-2c06c000 ---p 00081000 00:00 0
2c06c000-2c0ea000 rwxp 00084000 00:00 0
2c0ea000-2c0ed000 ---p 00102000 00:00 0
2c0ed000-2c16b000 rwxp 00105000 00:00 0
2c16b000-2c16e000 ---p 00183000 00:00 0
2c16e000-2c1ec000 rwxp 00186000 00:00 0
2c1ec000-2c1ef000 rwxp 00000000 00:00 0
2c1ef000-2c26d000 rwxp 00207000 00:00 0
2c26d000-2c270000 ---p 00285000 00:00 0
2c270000-2c2ee000 rwxp 00288000 00:00 0
2c2ee000-2c2f1000 ---p 00306000 00:00 0
2c2f1000-2c36f000 rwxp 00309000 00:00 0
2c36f000-2c372000 ---p 00387000 00:00 0
2c372000-2c3f0000 rwxp 0038a000 00:00 0
2c3f0000-2c3f3000 ---p 00204000 00:00 0
2c3f3000-2c471000 rwxp 00207000 00:00 0
2c471000-2c474000 ---p 00285000 00:00 0
2c474000-2c4f2000 rwxp 00288000 00:00 0
2c4f2000-2c4f5000 ---p 00102000 00:00 0
2c4f5000-2c573000 rwxp 00105000 00:00 0
2c573000-2c576000 ---p 00183000 00:00 0
2c576000-2c5f4000 rwxp 00186000 00:00 0
2c5f4000-2c5f7000 ---p 00204000 00:00 0
2c5f7000-2c675000 rwxp 00207000 00:00 0
2c675000-2c678000 ---p 00285000 00:00 0
2c678000-2c6f6000 rwxp 00288000 00:00 0
2c6f6000-2c6f9000 ---p 00306000 00:00 0
2c6f9000-2c777000 rwxp 00309000 00:00 0
2c777000-2c77a000 ---p 00387000 00:00 0
2c77a000-2c7f8000 rwxp 0038a000 00:00 0
2c7f8000-2c7fb000 ---p 00081000 00:00 0
2c7fb000-2c879000 rwxp 00084000 00:00 0
2c879000-2c87c000 ---p 00102000 00:00 0
2c87c000-2c8fa000 rwxp 00105000 00:00 0
2c8fa000-2c8fd000 ---p 00183000 00:00 0
2c8fd000-2c97b000 rwxp 00186000 00:00 0
2c97b000-2c97e000 rwxp 00000000 00:00 0
2c97e000-2c9fc000 rwxp 00207000 00:00 0
2c9fc000-2c9ff000 ---p 00285000 00:00 0
2c9ff000-2ca7d000 rwxp 00288000 00:00 0
2ca7d000-2ca80000 ---p 00285000 00:00 0
2ca80000-2cafe000 rwxp 00288000 00:00 0
2cafe000-2cb01000 rwxp 00000000 00:00 0
2cb01000-2cb7f000 rwxp 00309000 00:00 0
2cb7f000-2cb82000 ---p 00387000 00:00 0
2cb82000-2cc58000 rwxp 0038a000 00:00 0
2cc58000-2cd00000 ---p 00029000 00:00 0
2cd7f000-2cd82000 ---p 00000000 00:00 0
2cd82000-2cefe000 rwxp 00003000 00:00 0
2cefe000-2cf00000 ---p 00029000 00:00 0
2cf00000-2d0fe000 rwxp 0002b000 00:00 0
2d0fe000-2d100000 ---p 00038000 00:00 0
2d17b000-2d17e000 ---p 00000000 00:00 0
2d17e000-2d1fc000 rwxp 00003000 00:00 0
2d1fc000-2d1ff000 ---p 00081000 00:00 0
2d1ff000-2d27d000 rwxp 00084000 00:00 0
2d27d000-2d280000 rwxp 00000000 00:00 0
2d280000-2d2fe000 rwxp 00105000 00:00 0
2d2fe000-2d301000 ---p 00183000 00:00 0
2d301000-2d37f000 rwxp 00186000 00:00 0
2d37f000-2d382000 ---p 00204000 00:00 0
2d382000-2d600000 rwxp 00207000 00:00 0
2d67f000-2d682000 ---p 00000000 00:00 0
2d682000-2e1ff000 rwxp 00003000 00:00 0
2e1ff000-2e200000 ---p 00029000 00:00 0
2e200000-2e25d000 rwxp 0002a000 00:00 0
2e25d000-2e300000 ---p 00059000 00:00 0
2e300000-2e700000 rwxp 00000000 00:00 0
2e77f000-2e782000 ---p 00000000 00:00 0
2e782000-30500000 rwxp 00003000 00:00 0
3057f000-30582000 rwxp 00000000 00:00 0
30582000-30700000 rwxp 00003000 00:00 0
3077d000-30780000 ---p 00000000 00:00 0
30780000-307fe000 rwxp 00003000 00:00 0
307fe000-30801000 ---p 00081000 00:00 0
30801000-3087f000 rwxp 00084000 00:00 0
3087f000-30882000 ---p 00102000 00:00 0
30882000-30a00000 rwxp 00105000 00:00 0
30a7f000-30a82000 ---p 00000000 00:00 0
30a82000-30ffc000 rwxp 00003000 00:00 0
30ffc000-31000000 ---p 00029000 00:00 0
31000000-311fc000 rwxp 00095000 00:00 0
311fc000-31200000 ---p 00029000 00:00 0
31200000-313fc000 rwxp 0002d000 00:00 0
313fc000-31400000 ---p 000fd000 00:00 0
31416000-31434000 r-xs 00000000 08:02 1783998 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/wsdl4j.jar
31434000-31442000 r-xs 00000000 08:02 1783997 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/wrapper.jar
31442000-3147f000 r-xs 00000000 08:02 1783995 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/webInstaller.jar
3147f000-31482000 ---p 00000000 00:00 0
31482000-315ff000 rwxp 00003000 00:00 0
315ff000-31600000 ---p 00000000 00:00 0
31625000-3167f000 r-xs 00000000 08:02 1783994 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/velocity-1.4-rc1.jar
3167f000-31682000 ---p 00000000 00:00 0
31682000-31dfb000 rwxp 00003000 00:00 0
31dfb000-31e00000 ---p 00000000 00:00 0
31e14000-31e17000 ---p 00000000 00:00 0
31e17000-31e95000 rwxp 00003000 00:00 0
31e95000-31e98000 ---p 00081000 00:00 0
31e98000-31f16000 rwxp 00084000 00:00 0
31f16000-31f19000 ---p 00102000 00:00 0
31f19000-31f97000 rwxp 00105000 00:00 0
31f97000-31f9a000 ---p 00183000 00:00 0
31f9a000-32018000 rwxp 00186000 00:00 0
32018000-3201b000 ---p 00183000 00:00 0
3201b000-32099000 rwxp 00186000 00:00 0
32099000-3209c000 ---p 00204000 00:00 0
3209c000-3211a000 rwxp 00207000 00:00 0
3211a000-3211d000 ---p 00285000 00:00 0
3211d000-3219b000 rwxp 00288000 00:00 0
3219b000-3219e000 ---p 00102000 00:00 0
3219e000-3221c000 rwxp 00105000 00:00 0
3221c000-3221f000 ---p 00183000 00:00 0
3221f000-3229d000 rwxp 00186000 00:00 0
3229d000-322a0000 ---p 00204000 00:00 0
322a0000-3231e000 rwxp 00207000 00:00 0
3231e000-32321000 ---p 00285000 00:00 0
32321000-3239f000 rwxp 00288000 00:00 0
3239f000-323a2000 ---p 00306000 00:00 0
323a2000-32420000 rwxp 00309000 00:00 0
32420000-32423000 ---p 00387000 00:00 0
32423000-324a1000 rwxp 0038a000 00:00 0
324a1000-324a4000 ---p 00408000 00:00 0
324a4000-32522000 rwxp 0040b000 00:00 0
32522000-32525000 ---p 00285000 00:00 0
32525000-325a3000 rwxp 00288000 00:00 0
325a3000-325a6000 ---p 00102000 00:00 0
325a6000-32624000 rwxp 00105000 00:00 0
32624000-32627000 ---p 00183000 00:00 0
32627000-326a5000 rwxp 00186000 00:00 0
326a5000-326a8000 ---p 00204000 00:00 0
326a8000-32726000 rwxp 00207000 00:00 0
32726000-32729000 ---p 00285000 00:00 0
32729000-327a7000 rwxp 00288000 00:00 0
327a7000-327aa000 ---p 00102000 00:00 0
327aa000-32828000 rwxp 00105000 00:00 0
32828000-3282b000 rwxp 00000000 00:00 0
3282b000-328a9000 rwxp 00186000 00:00 0
328a9000-328ac000 ---p 00204000 00:00 0
328ac000-3292a000 rwxp 00207000 00:00 0
3292a000-3292d000 ---p 00285000 00:00 0
3292d000-329ab000 rwxp 00288000 00:00 0
329ab000-329ae000 rwxp 00000000 00:00 0
329ae000-32a2c000 rwxp 00309000 00:00 0
32a2c000-32a2f000 ---p 00183000 00:00 0
32a2f000-32aad000 rwxp 00186000 00:00 0
32aad000-32ab0000 rwxp 00000000 00:00 0
32ab0000-32b2e000 rwxp 00207000 00:00 0
32b2e000-32b31000 ---p 00000000 00:00 0
32b31000-32baf000 rwxp 00003000 00:00 0
32baf000-32bb2000 ---p 00081000 00:00 0
32bb2000-32c30000 rwxp 00084000 00:00 0
32c30000-32c33000 ---p 00102000 00:00 0
32c33000-32cb1000 rwxp 00105000 00:00 0
32cb1000-32cb4000 rwxp 00000000 00:00 0
32cb4000-32d32000 rwxp 00186000 00:00 0
32d32000-32d35000 rwxp 00000000 00:00 0
32d35000-32db3000 rwxp 00084000 00:00 0
32db3000-32db6000 ---p 00102000 00:00 0
32db6000-32e34000 rwxp 00105000 00:00 0
32e34000-32e37000 rwxp 00000000 00:00 0
32e37000-32eb5000 rwxp 00186000 00:00 0
32eb5000-32eb8000 ---p 00204000 00:00 0
32eb8000-32f36000 rwxp 00207000 00:00 0
32f36000-32f39000 rwxp 00000000 00:00 0
32f39000-32fb7000 rwxp 00288000 00:00 0
32fb7000-32fba000 ---p 00306000 00:00 0
32fba000-33038000 rwxp 00309000 00:00 0
33038000-3303b000 rwxp 00000000 00:00 0
3303b000-330b9000 rwxp 00186000 00:00 0
330b9000-330bc000 ---p 00204000 00:00 0
330bc000-3313a000 rwxp 00207000 00:00 0
3313a000-3313d000 ---p 00285000 00:00 0
3313d000-331bb000 rwxp 00288000 00:00 0
331bb000-331be000 ---p 00102000 00:00 0
331be000-3323c000 rwxp 00105000 00:00 0
3323c000-3323f000 ---p 00183000 00:00 0
3323f000-332bd000 rwxp 00186000 00:00 0
332bd000-332c0000 ---p 00204000 00:00 0
332c0000-3333e000 rwxp 00207000 00:00 0
3333e000-33341000 ---p 00285000 00:00 0
33341000-333bf000 rwxp 00288000 00:00 0
333bf000-333c2000 ---p 00306000 00:00 0
333c2000-33440000 rwxp 00309000 00:00 0
33440000-33443000 ---p 00183000 00:00 0
33443000-334c1000 rwxp 00186000 00:00 0
334e2000-33531000 r-xs 00000000 08:02 1783993 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/torque-3.0.2.jar
33531000-33537000 r-xs 00000000 08:02 1783992 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/textile4j-1.20.jar
33537000-336e9000 r-xs 00000000 08:02 1783991 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/tangosol.jar
336e9000-33710000 r-xs 00000000 08:02 1783990 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/ss_css2.jar
33710000-33716000 r-xs 00000000 08:02 1783989 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/smtp.jar
33716000-3371b000 r-xs 00000000 08:02 1783987 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/saaj.jar
3371b000-33720000 r-xs 00000000 08:02 1783986 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/relaxngDatatype.jar
33720000-33726000 r-xs 00000000 08:02 1783985 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/pop3.jar
33726000-3373e000 r-xs 00000000 08:02 1783984 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/p6spy.jar
3373e000-3375b000 r-xs 00000000 08:02 1783983 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/oscache-2.1.1.jar
3375b000-337ff000 r-xs 00000000 08:02 1783982 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/optional.jar
337ff000-3396a000 r-xs 00000000 08:02 1783981 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/msv.jar
3396a000-33979000 r-xs 00000000 08:02 1783980 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/msutil.jar
33979000-3398a000 r-xs 00000000 08:02 1783979 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/mssqlserver.jar
3398a000-339d1000 r-xs 00000000 08:02 1783978 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/msbase.jar
339d1000-339e8000 r-xs 00000000 08:02 1783977 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/metadata-extractor-2.2.2.jar
339e8000-33a15000 r-xs 00000000 08:02 1783976 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/mailapi.jar
33a15000-33a6c000 r-xs 00000000 08:02 1783975 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/log4j-1.2.8.jar
33a6c000-33a6e000 r-xs 00000000 08:02 1783974 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jdbc2_0-stdext.jar
33a6e000-33ab6000 r-xs 00000000 08:02 1783973 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jcs.jar
33ab6000-33ac2000 r-xs 00000000 08:02 1783972 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jazzy-core.jar
33ac2000-33acb000 r-xs 00000000 08:02 1783971 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jaxrpc.jar
33acb000-33b06000 r-xs 00000000 08:02 1783970 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jaxen-1.1-beta-4.jar
33b06000-33b0e000 r-xs 00000000 08:02 1783969 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jakarta-regexp-1.2.jar
33b0e000-33b1e000 r-xs 00000000 08:02 1783968 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jakarta-oro-2.0.6.jar
33b1e000-33c9f000 r-xs 00000000 08:02 1783967 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jai_core.jar
33c9f000-33cd3000 r-xs 00000000 08:02 1783966 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jai_codec.jar
33cd3000-33d03000 r-xs 00000000 08:02 1783965 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/isorelax.jar
33d03000-33d25000 r-xs 00000000 08:02 1783964 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/imap.jar
33d25000-33d54000 r-xs 00000000 08:02 1783963 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/hessian-3.0.13.jar
33d54000-33d58000 r-xs 00000000 08:02 1783962 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/fast-md5-2.5.jar
33d58000-33db8000 r-xs 00000000 08:02 1783961 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/dom4j-1.5-rc1.jar
33db8000-33df5000 r-xs 00000000 08:02 1783960 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/dnsjava-1.6.6.jar
33df5000-33ef6000 r-xs 00000000 08:02 1783958 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/db-ojb-1.0.1.jar
33ef6000-33f0f000 r-xs 00000000 08:02 1783957 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/crossdb.jar
33f0f000-33f1d000

An aside: When I switch to ParallelGC, afterrunning
for about 5-6 hours, GC times start doubling
(approximately) in time, eventually moving upwardsof
2 minutes per full GC.That sounds to me like you're swapping during full
GCs. I wouldn't assume that 2 GB of physical RAM is
sufficient to run an app with an 1800 MB heap. Have
you done any heap profiling to determine the real
working set of your application? When the GCs get
this pathologically long, is there disk activity on
the machine?Hmm.. So what should we size our heap to on a server with 2GB? The server is essentially only running the Java process. What would you consider "safe"?
While heap profiling with jconsole, the application only utilizes 1.1GB of the heap at peaks. We want to expand that eventually as we size our caches larger.
I don't believe there's disk activity with long GCs, but I can't confirm that 100% right now. The server is reading files from another machine, so the disks are more or less untouched while the app is running. There's heavy caching. The only reason disks would be hititng if your guess regarding the swapping turns out correct. After you suggest a safer way to calc a max heap size for our machine, I'll try again with ParallelGC and a smaller heap.
Some points:
- I tried increasing perm generation size. It'snot
even close to filled (according to gc log).(As you mentioned, "old generation" instead of "perm
generation".) What about when the full collection
times are taking 2 minutes in duration? Is there any
disk activity indicating swapping?Again, not positive on the disk situation -- should get an answer above to figure this out.
- I have not tried the -client VM, will this break
performance on a production application?The client VM does not generate as high quality
machine code as the server VM but on the x86
architecture many benchmark scores for the two
compilers are comparable. I would recommend you try
that option if only to narrow down the scope of the
crash you're seeing.
- I saw a bug related to a ConcMarkSweepGC crashon
4-cpu machines opened on Oct 17th. I've testedthis
on 4-cpu (2 proc with hyperthreading) and 2-cpu
(hyperthreading off) -- both exhibit this issue.What bug ID is this?http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6337544
- Are there any known issues with this collectorand
Linux 2.4.21-37.ELsmp? Should we be using
LD_ASSUME_KERNEL=2.2.5 or anything? For java to
recognize this variable, do we just need itspecified
anywhere in the environment at JVM start? How dowe
test if it worked?No issues as far as I know, but I am not a Linux
expert. I think in order to toggle which thread
library is used you just need that variable exported
in the environment when the JVM starts up. You can
probably use pmap to see which thread library got
loaded to verify the one you expect is present in the
loaded objects.Trying various combinations of LD_ASSUME_KERNEL to switch threading versions has no real effect on stability there. We're seeing crashes repeatedly still.
I'm going to attempt to deploy some machines with a new kernel as well and see if we can reproduce on those. I'll try ParallelGC again as soon as I get your recommendations on the configuration.

Problem calling two perl modules from java in seperate threads(JVM CRASHES)

Dear Friends,
I have one severe problem regarding calling perl modules from java
I had to call two perl modules simultaneously (i.e.) from two threads,,, but jvm crashes when one of the perl calls is exiting earlier
I am unable to spot out why ....
For calling perl from java ...., We are first calling C code from java using JNI and then Perl code from C
All works fine if we call only one perl call at a time.... If we call them in a synchronized manner the JVM is not crashing .... But we don't want blocking..
The following is the code snippet
<JAVA FILE>
class Sample
     static {
          System.loadLibrary("xyz"); // Here xyz is the library file generated by compiling c code
     public native void call_PrintList();
     public native void call_PrintListNew();
     Sample()
          new Thread1(this).start();
     public static void main(String args[])
          System.out.println("In the main Method");
          new Sample().call_PrintList();
     class Thread1 extends Thread
          Sample sample;
          Thread1(Sample sam)
               sample=sam;
          public void run()
               sample.call_PrintListNew();
}<C FILE>
#include <EXTERN.h>
#include <perl.h>
static PerlInterpreter *my_perl;
static char * words[] = {"alpha", "beta", "gamma", "delta", NULL } ;
static void
call_PrintList(){
     printf("\nIn the Call method of string.c\n");
        char *wor[] = {"hello", "sudha", NULL } ;
           char *my_argv[] = { "", "string.pl" };
           PERL_SYS_INIT3(&argc,&argv,&env);
           my_perl = perl_alloc();
               PL_perl_destruct_level = 1; //// We have mentioned this also and tried removing destruct call
           perl_construct( my_perl );
           perl_parse(my_perl, NULL, 2, my_argv, (char**)NULL);
          PL_exit_flags |= PERL_EXIT_DESTRUCT_END;
           perl_run(my_perl);
     dSP ;
        perl_call_argv("PrintList", G_DISCARD, wor) ;
PL_perl_destruct_level = 1;
//     perl_destruct(my_perl);
//          perl_free(my_perl);
//           PERL_SYS_TERM();
static void
call_PrintListNew(){
printf("In the new call method\n");
char *wor[] = {"Hiiiiiiiiiiiiiii", "Satyam123333", NULL } ;
        char *my_argv[] = { "", "string.pl" };
        PERL_SYS_INIT3(&argc,&argv,&env);
        my_perl = perl_alloc();
PL_perl_destruct_level = 1;
        perl_construct( my_perl );
        perl_parse(my_perl, NULL, 2, my_argv, (char**)NULL);
        PL_exit_flags |= PERL_EXIT_DESTRUCT_END;
        perl_run(my_perl);
        dSP ;
        perl_call_argv("PrintListNew", G_DISCARD, wor) ;
PL_perl_destruct_level = 1;
//      perl_destruct(my_perl);
//      perl_free(my_perl);
   //     PERL_SYS_TERM();
void callNew()
call_PrintListNew();
void call ( )
call_PrintList();
//char *wor[] = {"hello","sudha",NULL};
/*   char *my_argv[] = { "", "string.pl" };
      PERL_SYS_INIT3(&argc,&argv,&env);
      my_perl = perl_alloc();
      perl_construct( my_perl );
      perl_parse(my_perl, NULL, 2, my_argv, (char**)NULL);
     PL_exit_flags |= PERL_EXIT_DESTRUCT_END;
      perl_run(my_perl);*/
   //   call_PrintList();                      /*** Compute 3 ** 4 ***/
/*      perl_destruct(my_perl);
      perl_free(my_perl);
      PERL_SYS_TERM();*/
    }And Finally the perl code
sub PrintList
            my(@list) = @_ ;
            foreach (@list) { print "$_\n" }
sub PrintListNew
            my(@list) = @_ ;
            foreach (@list) { print "$_\n" }
        }Please help me in this regard

Dear Friends,
I have one severe problem regarding calling perl modules from java
I had to call two perl modules simultaneously (i.e.) from two threads,,, but jvm crashes when one of the perl calls is exiting earlier
I am unable to spot out why ....
For calling perl from java ...., We are first calling C code from java using JNI and then Perl code from C
All works fine if we call only one perl call at a time.... If we call them in a synchronized manner the JVM is not crashing .... But we don't want blocking..
The following is the code snippet
<JAVA FILE>
class Sample
     static {
          System.loadLibrary("xyz"); // Here xyz is the library file generated by compiling c code
     public native void call_PrintList();
     public native void call_PrintListNew();
     Sample()
          new Thread1(this).start();
     public static void main(String args[])
          System.out.println("In the main Method");
          new Sample().call_PrintList();
     class Thread1 extends Thread
          Sample sample;
          Thread1(Sample sam)
               sample=sam;
          public void run()
               sample.call_PrintListNew();
}<C FILE>
#include <EXTERN.h>
#include <perl.h>
static PerlInterpreter *my_perl;
static char * words[] = {"alpha", "beta", "gamma", "delta", NULL } ;
static void
call_PrintList(){
     printf("\nIn the Call method of string.c\n");
        char *wor[] = {"hello", "sudha", NULL } ;
           char *my_argv[] = { "", "string.pl" };
           PERL_SYS_INIT3(&argc,&argv,&env);
           my_perl = perl_alloc();
               PL_perl_destruct_level = 1; //// We have mentioned this also and tried removing destruct call
           perl_construct( my_perl );
           perl_parse(my_perl, NULL, 2, my_argv, (char**)NULL);
          PL_exit_flags |= PERL_EXIT_DESTRUCT_END;
           perl_run(my_perl);
     dSP ;
        perl_call_argv("PrintList", G_DISCARD, wor) ;
PL_perl_destruct_level = 1;
//     perl_destruct(my_perl);
//          perl_free(my_perl);
//           PERL_SYS_TERM();
static void
call_PrintListNew(){
printf("In the new call method\n");
char *wor[] = {"Hiiiiiiiiiiiiiii", "Satyam123333", NULL } ;
        char *my_argv[] = { "", "string.pl" };
        PERL_SYS_INIT3(&argc,&argv,&env);
        my_perl = perl_alloc();
PL_perl_destruct_level = 1;
        perl_construct( my_perl );
        perl_parse(my_perl, NULL, 2, my_argv, (char**)NULL);
        PL_exit_flags |= PERL_EXIT_DESTRUCT_END;
        perl_run(my_perl);
        dSP ;
        perl_call_argv("PrintListNew", G_DISCARD, wor) ;
PL_perl_destruct_level = 1;
//      perl_destruct(my_perl);
//      perl_free(my_perl);
   //     PERL_SYS_TERM();
void callNew()
call_PrintListNew();
void call ( )
call_PrintList();
//char *wor[] = {"hello","sudha",NULL};
/*   char *my_argv[] = { "", "string.pl" };
      PERL_SYS_INIT3(&argc,&argv,&env);
      my_perl = perl_alloc();
      perl_construct( my_perl );
      perl_parse(my_perl, NULL, 2, my_argv, (char**)NULL);
     PL_exit_flags |= PERL_EXIT_DESTRUCT_END;
      perl_run(my_perl);*/
   //   call_PrintList();                      /*** Compute 3 ** 4 ***/
/*      perl_destruct(my_perl);
      perl_free(my_perl);
      PERL_SYS_TERM();*/
    }And Finally the perl code
sub PrintList
            my(@list) = @_ ;
            foreach (@list) { print "$_\n" }
sub PrintListNew
            my(@list) = @_ ;
            foreach (@list) { print "$_\n" }
        }Please help me in this regard

JVM Crash ConcurrentGCThread (6u21 windows-amd64 jvm.dll+0x1291fb)

Hi,
a customer hit this JVM crash on Windows 2008 SP1 with JDK 6u21:
# A fatal error has been detected by the Java Runtime Environment:
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000006d9b91fb, pid=3944, tid=2912
# JRE version: 6.0_21-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (17.0-b17 mixed mode windows-amd64 )
# Problematic frame:
# V [jvm.dll+0x1291fb]
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
--------------- T H R E A D ---------------
Current thread (0x0000000001091000): ConcurrentGCThread [stack: 0x000000006cc80000,0x000000006cd80000] [id=2912]
siginfo: ExceptionCode=0xc0000005, reading address 0x0000000000000069
Registers:
EAX=0x0000000000000059, EBX=0x000000006cd7fab0, ECX=0x0000000000000069, EDX=0x0000000067186c30
ESP=0x000000006cd7f6f0, EBP=0x0000000000000012, ESI=0x00000000671868c0, EDI=0x000000006cd7fab0
EIP=0x000000006d9b91fb, EFLAGS=0x0000000000010246
Top of Stack: (sp=0x000000006cd7f6f0)
0x000000006cd7f6f0:   000000000110b960 000000006d9ba131
0x000000006cd7f700:   000000006cd7f790 000000006d9ba131
0x000000006cd7f710:   000000006cd7fab0 000000006dc56be0
0x000000006cd7f720:   000000006cd7fab0 000000006dbb42ce
0x000000006cd7f730:   0000000067186860 000000006cd7fab0
0x000000006cd7f740:   000000006cd7fab0 0000000000000000
0x000000006cd7f750:   000000006cd7fa60 000000006cd7f810
0x000000006cd7f760:   0000000067186830 000000006d9acee3
0x000000006cd7f770:   0000000000000880 00000000010917d0
0x000000006cd7f780:   0000000001064020 0000000000004400
0x000000006cd7f790:   0000000067183a00 0000000000000880
0x000000006cd7f7a0:   000000006cd7f810 000000006d9b281d
0x000000006cd7f7b0:   0000000067184cc0 000000006cd7f810
0x000000006cd7f7c0:   000000006cd7fa60 0000000067184e28
0x000000006cd7f7d0:   0000000067183a00 0000000000000880
0x000000006cd7f7e0:   00000000000000c4 000000006d986f1e
Instructions: (pc=0x000000006d9b91fb)
0x000000006d9b91eb:   51 00 eb 04 48 8b 42 08 48 8d 48 10 4c 8d 43 58
0x000000006d9b91fb:   48 8b 01 ff 90 20 02 00 00 80 bb c8 00 00 00 00
Stack: [0x000000006cc80000,0x000000006cd80000], sp=0x000000006cd7f6f0, free space=3fd0000000000000000k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [jvm.dll+0x1291fb]
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x00000000727e9000 JavaThread "http-0.0.0.0-8180-9" daemon [_thread_blocked, id=6104, stack(0x00000000774b0000,0x00000000775b0000)]
0x00000000727e8000 JavaThread "http-0.0.0.0-8180-8" daemon [_thread_in_native, id=1384, stack(0x00000000773b0000,0x00000000774b0000)]
0x00000000727e7800 JavaThread "http-0.0.0.0-8180-7" daemon [_thread_in_native, id=3076, stack(0x00000000772b0000,0x00000000773b0000)]
0x00000000727e6800 JavaThread "http-0.0.0.0-8180-6" daemon [_thread_in_native, id=5324, stack(0x00000000771b0000,0x00000000772b0000)]
0x00000000727e6000 JavaThread "http-0.0.0.0-8180-5" daemon [_thread_in_native, id=6116, stack(0x00000000770b0000,0x00000000771b0000)]
0x00000000727e5000 JavaThread "Keep-Alive-Timer" daemon [_thread_blocked, id=5132, stack(0x0000000076d60000,0x0000000076e60000)]
0x00000000727e4800 JavaThread "http-0.0.0.0-8180-4" daemon [_thread_in_vm, id=4436, stack(0x00000000736f0000,0x00000000737f0000)]
0x00000000727e3000 JavaThread "http-0.0.0.0-8180-3" daemon [_thread_in_native, id=1752, stack(0x0000000076e60000,0x0000000076f60000)]
0x00000000727e2800 JavaThread "Thread-12" daemon [_thread_in_native, id=4160, stack(0x0000000076c60000,0x0000000076d60000)]
0x00000000727e1800 JavaThread "http-0.0.0.0-8182-1" daemon [_thread_blocked, id=4256, stack(0x0000000076b60000,0x0000000076c60000)]
0x000000007392b000 JavaThread "http-0.0.0.0-8183-1" daemon [_thread_blocked, id=5972, stack(0x0000000076a60000,0x0000000076b60000)]
0x0000000073929800 JavaThread "http-0.0.0.0-8180-2" daemon [_thread_in_native, id=3724, stack(0x0000000076960000,0x0000000076a60000)]
0x0000000073929000 JavaThread "http-0.0.0.0-8180-1" daemon [_thread_in_native, id=4712, stack(0x0000000071220000,0x0000000071320000)]
0x000000007392a800 JavaThread "http-0.0.0.0-8183" daemon [_thread_in_native, id=6020, stack(0x0000000076860000,0x0000000076960000)]
0x0000000070992800 JavaThread "http-0.0.0.0-8182" daemon [_thread_in_native, id=2480, stack(0x0000000076760000,0x0000000076860000)]
0x0000000073928800 JavaThread "http-0.0.0.0-8181-1" daemon [_thread_blocked, id=5448, stack(0x0000000076660000,0x0000000076760000)]
0x0000000070991800 JavaThread "http-0.0.0.0-8180" daemon [_thread_in_native, id=1748, stack(0x0000000076560000,0x0000000076660000)]
0x0000000070991000 JavaThread "http-0.0.0.0-8181" daemon [_thread_in_native, id=4136, stack(0x00000000752a0000,0x00000000753a0000)]
0x0000000070990800 JavaThread "JBossLifeThread" [_thread_blocked, id=5844, stack(0x0000000075460000,0x0000000075560000)]
0x0000000070986000 JavaThread "SEO index monitor thread" daemon [_thread_blocked, id=1472, stack(0x00000000733f0000,0x00000000734f0000)]
0x000000007098f800 JavaThread "derby.rawStoreDaemon" daemon [_thread_blocked, id=4532, stack(0x00000000751a0000,0x00000000752a0000)]
0x000000007098f000 JavaThread "derby.NetworkServerStarter" daemon [_thread_blocked, id=4352, stack(0x00000000750a0000,0x00000000751a0000)]
0x000000007098e000 JavaThread "Timer-1" daemon [_thread_blocked, id=1484, stack(0x0000000074fa0000,0x00000000750a0000)]
0x000000007098d800 JavaThread "derby.antiGC" daemon [_thread_blocked, id=4316, stack(0x0000000074ea0000,0x0000000074fa0000)]
0x000000007098c800 JavaThread "Checkpoint Maintenance Service (CheckpointDirectory)" daemon [_thread_blocked, id=2496, stack(0x0000000074bc0000,0x0000000074cc0000)]
0x000000007098c000 JavaThread "Checkpoint Maintenance Service (watchdog)-0" daemon [_thread_blocked, id=6068, stack(0x0000000074ac0000,0x0000000074bc0000)]
0x000000007098b000 JavaThread "net.sf.ehcache.CacheManager@7889fe65" daemon [_thread_blocked, id=6040, stack(0x00000000749c0000,0x0000000074ac0000)]
0x000000007098a800 JavaThread "Maintenance-Thread" [_thread_blocked, id=4332, stack(0x00000000748c0000,0x00000000749c0000)]
0x0000000070989000 JavaThread "PageSavingThread-wicket.bm-translation-page" daemon [_thread_blocked, id=228, stack(0x00000000737f0000,0x00000000738f0000)]
0x0000000070987800 JavaThread "PageSavingThread-wicket.bm" daemon [_thread_blocked, id=5996, stack(0x00000000735f0000,0x00000000736f0000)]
0x0000000070987000 JavaThread "com.google.inject.internal.Finalizer" daemon [_thread_blocked, id=6080, stack(0x00000000734f0000,0x00000000735f0000)]
0x0000000070985800 JavaThread "Service auto starter-0" daemon [_thread_blocked, id=5524, stack(0x000000006d280000,0x000000006d380000)]
0x0000000070984800 JavaThread "ContainerBackgroundProcessor[StandardEngine[jboss.web]]" daemon [_thread_blocked, id=2964, stack(0x00000000732f0000,0x00000000733f0000)]
0x0000000070984000 JavaThread "RMI TCP Accept-4444" daemon [_thread_in_native, id=5740, stack(0x0000000072220000,0x0000000072320000)]
0x0000000070983800 JavaThread "ClassLoadingPool(2)-1" daemon [_thread_in_native, id=3928, stack(0x0000000072120000,0x0000000072220000)]
0x00000000709c4000 JavaThread "JBoss System Threads(1)-1" daemon [_thread_in_native, id=5380, stack(0x0000000072020000,0x0000000072120000)]
0x00000000709c3800 JavaThread "GC Daemon" daemon [_thread_blocked, id=3712, stack(0x0000000071f20000,0x0000000072020000)]
0x00000000709c1800 JavaThread "RMI Reaper" [_thread_blocked, id=5552, stack(0x0000000071e20000,0x0000000071f20000)]
0x00000000709c1000 JavaThread "RMI TCP Accept-1098" daemon [_thread_in_native, id=4328, stack(0x0000000071d20000,0x0000000071e20000)]
0x00000000709d5000 JavaThread "ScannerThread" daemon [_thread_blocked, id=4952, stack(0x0000000071c20000,0x0000000071d20000)]
0x00000000713f4800 JavaThread "Timer-0" daemon [_thread_blocked, id=6028, stack(0x0000000071b20000,0x0000000071c20000)]
0x0000000001020000 JavaThread "DestroyJavaVM" [_thread_blocked, id=5908, stack(0x00000000012a0000,0x00000000013a0000)]
0x000000007073e800 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=5588, stack(0x0000000070f70000,0x0000000071070000)]
0x00000000706fc800 JavaThread "RMI TCP Accept-8190" daemon [_thread_in_native, id=5176, stack(0x0000000070d50000,0x0000000070e50000)]
0x00000000706fc000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=5108, stack(0x0000000070a70000,0x0000000070b70000)]
0x000000006ce71800 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=1684, stack(0x0000000070570000,0x0000000070670000)]
0x000000006ce6f800 JavaThread "CompilerThread1" daemon [_thread_in_native, id=3716, stack(0x0000000070070000,0x0000000070170000)]
0x000000006ce60800 JavaThread "CompilerThread0" daemon [_thread_in_native, id=5816, stack(0x000000006ff70000,0x0000000070070000)]
0x000000006ce5d800 JavaThread "Attach Listener" daemon [_thread_blocked, id=5288, stack(0x000000006d680000,0x000000006d780000)]
0x000000006ce58800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=5756, stack(0x000000006d580000,0x000000006d680000)]
0x000000006ce57000 JavaThread "Surrogate Locker Thread (CMS)" daemon [_thread_blocked, id=6140, stack(0x000000006d480000,0x000000006d580000)]
0x000000006ce05000 JavaThread "Finalizer" daemon [_thread_blocked, id=3980, stack(0x000000006d180000,0x000000006d280000)]
0x000000006cdfa000 JavaThread "Reference Handler" daemon [_thread_blocked, id=776, stack(0x000000006d080000,0x000000006d180000)]
Other Threads:
0x000000006cdf3800 VMThread [stack: 0x000000006cf80000,0x000000006d080000] [id=3228]
0x00000000706b2000 WatcherThread [stack: 0x0000000071120000,0x0000000071220000] [id=5040]
=>0x0000000001091000 (exited) ConcurrentGCThread [stack: 0x000000006cc80000,0x000000006cd80000] [id=2912]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x000000000110d770] Heap_lock - owner thread: 0x00000000727e4800
Heap
par new generation   total 118016K, used 75017K [0x00000000046e0000, 0x000000000c6e0000, 0x000000000c6e0000)
eden space 104960K, 59% used [0x00000000046e0000, 0x0000000008362778, 0x000000000ad60000)
from space 13056K, 100% used [0x000000000ad60000, 0x000000000ba20000, 0x000000000ba20000)
to   space 13056K,   0% used [0x000000000ba20000, 0x000000000ba20000, 0x000000000c6e0000)
concurrent mark-sweep generation total 108264K, used 69074K [0x000000000c6e0000, 0x000000001309a000, 0x00000000622e0000)
concurrent-mark-sweep perm gen total 120720K, used 79760K [0x00000000622e0000, 0x00000000698c4000, 0x000000006a2e0000)
Dynamic libraries:
0x0000000000400000 - 0x000000000042e000      C:\Program Files\Java\jdk1.6.0_21\bin\java.exe
0x0000000077af0000 - 0x0000000077c70000      C:\Windows\system32\ntdll.dll
0x00000000778f0000 - 0x0000000077a1c000      C:\Windows\system32\kernel32.dll
0x000007feff820000 - 0x000007feff928000      C:\Windows\system32\ADVAPI32.dll
0x000007fefe230000 - 0x000007fefe36f000      C:\Windows\system32\RPCRT4.dll
0x000000006d890000 - 0x000000006df61000      C:\Program Files\Java\jdk1.6.0_21\jre\bin\server\jvm.dll
0x0000000077a20000 - 0x0000000077aed000      C:\Windows\system32\USER32.dll
0x000007fefe8d0000 - 0x000007fefe933000      C:\Windows\system32\GDI32.dll
0x000007fefc0c0000 - 0x000007fefc0f9000      C:\Windows\system32\WINMM.dll
0x000007feffbb0000 - 0x000007feffc4c000      C:\Windows\system32\msvcrt.dll
0x000007fefe370000 - 0x000007fefe548000      C:\Windows\system32\ole32.dll
0x000007feff740000 - 0x000007feff813000      C:\Windows\system32\OLEAUT32.dll
0x000007fefc070000 - 0x000007fefc0bf000      C:\Windows\system32\OLEACC.dll
0x000007fefe570000 - 0x000007fefe59d000      C:\Windows\system32\IMM32.DLL
0x000007fefe940000 - 0x000007fefea41000      C:\Windows\system32\MSCTF.dll
0x000007feffc50000 - 0x000007feffc5d000      C:\Windows\system32\LPK.DLL
0x000007feffd50000 - 0x000007feffdea000      C:\Windows\system32\USP10.dll
0x000000006d800000 - 0x000000006d80e000      C:\Program Files\Java\jdk1.6.0_21\jre\bin\verify.dll
0x000000006d450000 - 0x000000006d477000      C:\Program Files\Java\jdk1.6.0_21\jre\bin\java.dll
0x000000006d3b0000 - 0x000000006d3ba000      C:\Program Files\Java\jdk1.6.0_21\jre\bin\hpi.dll
0x0000000077c70000 - 0x0000000077c79000      C:\Windows\system32\PSAPI.DLL
0x000000006d850000 - 0x000000006d862000      C:\Program Files\Java\jdk1.6.0_21\jre\bin\zip.dll
0x000007fefea50000 - 0x000007feff6a2000      C:\Windows\system32\SHELL32.DLL
0x000007feff6b0000 - 0x000007feff723000      C:\Windows\system32\SHLWAPI.dll
0x000007fefc920000 - 0x000007fefcb19000      C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.6001.18000_none_152e7382f3bd50c6\comctl32.dll
0x000007fefe6f0000 - 0x000007fefe8cb000      C:\Windows\system32\SETUPAPI.dll
0x0000000000de0000 - 0x0000000000dea000      C:\Program Files\Java\jdk1.6.0_21\jre\bin\management.dll
0x000000006d380000 - 0x000000006d397000      C:\Program Files\Java\jdk1.6.0_21\jre\bin\net.dll
0x000007fefe5a0000 - 0x000007fefe5e4000      C:\Windows\system32\WS2_32.dll
0x000007feff730000 - 0x000007feff737000      C:\Windows\system32\NSI.dll
0x000007fefd590000 - 0x000007fefd5df000      C:\Windows\system32\mswsock.dll
0x000007fefd790000 - 0x000007fefd797000      C:\Windows\System32\wship6.dll
0x000007fefdb30000 - 0x000007fefdb69000      C:\Windows\system32\DNSAPI.dll
0x000007fefbdc0000 - 0x000007fefbdcb000      C:\Windows\System32\winrnr.dll
0x000007fefe5f0000 - 0x000007fefe645000      C:\Windows\system32\WLDAP32.dll
0x000007fefd010000 - 0x000007fefd023000      C:\Windows\system32\NLAapi.dll
0x000007fefd860000 - 0x000007fefd883000      C:\Windows\system32\IPHLPAPI.DLL
0x000007fefd810000 - 0x000007fefd855000      C:\Windows\system32\dhcpcsvc.DLL
0x000007fefe080000 - 0x000007fefe09c000      C:\Windows\system32\Secur32.dll
0x000007fefd800000 - 0x000007fefd80a000      C:\Windows\system32\WINNSI.DLL
0x000007fefd7d0000 - 0x000007fefd7fb000      C:\Windows\system32\dhcpcsvc6.DLL
0x000007fefbc50000 - 0x000007fefbc63000      C:\Windows\system32\napinsp.dll
0x000007fefd200000 - 0x000007fefd207000      C:\Windows\system32\wshtcpip.dll
0x000007fefbf10000 - 0x000007fefbf18000      C:\Windows\system32\rasadhlp.dll
0x000007fefd280000 - 0x000007fefd2c7000      C:\Windows\system32\rsaenh.dll
0x000007fefe0a0000 - 0x000007fefe0c6000      C:\Windows\system32\USERENV.dll
0x0000000000df0000 - 0x0000000000dfb000      C:\Program Files\Java\jdk1.6.0_21\jre\bin\nio.dll
VM Arguments:
jvm_args: -Dfile.encoding=UTF-8 -Djava.io.tmpdir=c:\...\tmp -Djava.library.path=c:\...\lib\win32-x86 -Djava.security.policy=c:\...\policy.all -XX:MaxPermSize=128m -XX:+CMSClassUnloadingEnabled -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:+CMSIncrementalMode -XX:+CMSParallelRemarkEnabled -XX:MaxNewSize=128m -XX:NewSize=128m -XX:+DisableExplicitGC -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -XX:+UseBiasedLocking -XX:+PrintConcurrentLocks -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -Dcom.sun.management.jmxremote.port=8190 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djboss.server.blockingshutdown=true -Djboss.server.exitonshutdown=false -Djboss.server.home.dir=c:\...\jboss-server -Djboss.server.home.url=file:/c:/.../jboss-server/ -Djboss.deploy.urls=file:/c:/.../jboss-server/deploy/, -Xmx1500m -Xloggc:c:\...\gc.log -Dderby.drda.portNumber=8191 -Dderby.drda.startNetworkServer=true
java_command: org.jboss.Main
Launcher Type: SUN_STANDARD
Environment Variables:
JAVA_HOME=C:\Program Files\Java\jdk1.6.0_21
CLASSPATH=...
PATH=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Program Files (x86)\Dell\SysMgt\RAC5;C:\Program Files (x86)\Dell\SysMgt\oma\bin;C:\Windows\System32\WindowsPowerShell\v1.0\
OS=Windows_NT
PROCESSOR_IDENTIFIER=AMD64 Family 15 Model 65 Stepping 3, AuthenticAMD
--------------- S Y S T E M ---------------
OS: Windows Server 2008 Build 6001 Service Pack 1
CPU:total 2 (2 cores per cpu, 1 threads per core) family 15 model 65 stepping 3, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnow, 3dnowext
Memory: 4k page, physical 8381904k(4689996k free), swap 16819076k(12156656k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (17.0-b17) for windows-amd64 JRE (1.6.0_21-b07), built on Jul 17 2010 01:05:36 by "java_re" with MS VC++ 8.0 (VS2005)
time: Thu Oct 21 10:54:48 2010
elapsed time: 4500 secondsI have tried using hs_err6.pl to get some closer information, but I don't have access to the required map files, and searching in the bugdatabase didn't come up with anything.
As far as I know this crash happened once.
Is this a known crash, and if so: any pointers to the bugid would be very appreciated!
Regards,
Andreas
Edited by: user12281825 on Oct 21, 2010 6:10 PM (replace 'noformat' by 'code')

Thank you.
Going through the suggestions:
* custom/3rd party JNI components: while the jvm args indicate a use of such components, there is actually none being used in this instance.
* overcommit: I'm not sure whether windows has any tunables for this, but from the memory information in the hs_err file I think this is not a problem here. The JVM has Xmx1500 + Xmn128 + permsize of 128, even with generous margins this should fit well into the 4G still available physical memory on the server.
* OS support: I'd believe that Windows 2008 SP1 is supported :)
* OS updates: I will check with the customer whether all updates are applied, and also whether an update of the OS itself is possible.
* hotspot/gc tuning: there are various tuning options applied, which have been determined by testing the application itself (load, functional, endurance tests), and have been found to work stable
There is one bug we're are aware of in 6u21 which affects the application (http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6938026), but without being able to decode the jvm.dll+0x1291fb address I cannot say for sure that this is the same bug.
Andreas

JVM crashes with Out of SWAP space

Hello every body,
We have a problem in a production environnement. The JVM crashes every time with the log file below.
The application which is running don't occupate all memory and we don't understand why an outofmemory exception is raised.
It's not probably due to an allocation inside the application because the exception should be an outofmemory exception : Java Heap space.
Please, somebody can help me to understant what append or to give me some advices?
Thank you a lot for help.
# An unexpected error has been detected by Java Runtime Environment:
# java.lang.OutOfMemoryError: requested 41943040 bytes for GrET in C:\BUILD_AREA\jdk6_07\hotspot\src\share\vm\utilities\growableArray.cpp. Out of swap space?
# Internal Error (allocation.inline.hpp:42), pid=2700, tid=2112
# Error: GrET in C:\BUILD_AREA\jdk6_07\hotspot\src\share\vm\utilities\growableArray.cpp
# Java VM: Java HotSpot(TM) Server VM (10.0-b23 mixed mode windows-x86)
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
--------------- T H R E A D ---------------
Current thread (0x65b97400): VMThread [stack: 0x65bd0000,0x65c20000] [id=2112]
Stack: [0x65bd0000,0x65c20000]
[error occurred during error reporting (printing stack bounds), id 0x80000001]
VM_Operation (0x66dffa14): ParallelGCSystemGC, mode: safepoint, requested by thread 0x65fb9400
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x65f3cc00 JavaThread "pool-3-thread-1" [_thread_blocked, id=2780, stack(0x67300000,0x67350000)]
0x66547800 JavaThread "RMI RenewClean-[192.16.252.55:3916]" daemon [_thread_blocked, id=3076, stack(0x672b0000,0x67300000)]
0x66547400 JavaThread "RMI RenewClean-[192.16.252.53:2046]" daemon [_thread_blocked, id=2292, stack(0x67260000,0x672b0000)]
0x6650d800 JavaThread "RMI RenewClean-[192.16.254.46:3126]" daemon [_thread_blocked, id=3012, stack(0x67210000,0x67260000)]
0x663e8400 JavaThread "RMI RenewClean-[192.16.254.45:3026]" daemon [_thread_blocked, id=2596, stack(0x671c0000,0x67210000)]
0x65f99800 JavaThread "RMI RenewClean-[192.16.252.54:1623]" daemon [_thread_blocked, id=3128, stack(0x67170000,0x671c0000)]
0x65f99400 JavaThread "RMI RenewClean-[192.16.254.55:1992]" daemon [_thread_blocked, id=2720, stack(0x67120000,0x67170000)]
0x66480800 JavaThread "RMI RenewClean-[192.16.254.54:4954]" daemon [_thread_blocked, id=2920, stack(0x670d0000,0x67120000)]
0x66480000 JavaThread "RMI RenewClean-[192.16.254.53:3093]" daemon [_thread_blocked, id=2068, stack(0x67080000,0x670d0000)]
0x6653f800 JavaThread "RMI RenewClean-[192.16.254.52:2543]" daemon [_thread_blocked, id=2156, stack(0x67030000,0x67080000)]
0x66411400 JavaThread "RMI RenewClean-[192.16.254.51:3893]" daemon [_thread_blocked, id=1688, stack(0x66fe0000,0x67030000)]
0x66468800 JavaThread "RMI RenewClean-[192.16.254.50:3371]" daemon [_thread_blocked, id=2688, stack(0x66f90000,0x66fe0000)]
0x663f8400 JavaThread "RMI RenewClean-[192.16.254.49:4374]" daemon [_thread_blocked, id=2656, stack(0x66f40000,0x66f90000)]
0x65f27800 JavaThread "RMI RenewClean-[192.16.254.48:3311]" daemon [_thread_blocked, id=748, stack(0x66ef0000,0x66f40000)]
0x65f27400 JavaThread "RMI RenewClean-[192.16.254.47:2571]" daemon [_thread_blocked, id=1048, stack(0x66ea0000,0x66ef0000)]
0x65f9e400 JavaThread "RMI RenewClean-[192.16.238.145:1673]" daemon [_thread_blocked, id=2332, stack(0x66e50000,0x66ea0000)]
0x6602e800 JavaThread "RMI RenewClean-[192.16.238.144:2332]" daemon [_thread_blocked, id=3100, stack(0x66e00000,0x66e50000)]
0x65fb9400 JavaThread "GC Daemon" daemon [_thread_blocked, id=1608, stack(0x66db0000,0x66e00000)]
0x6657a400 JavaThread "RMI RenewClean-[192.16.238.143:3902]" daemon [_thread_blocked, id=2668, stack(0x66d60000,0x66db0000)]
0x65fa9c00 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=2624, stack(0x66d10000,0x66d60000)]
0x65ff4c00 JavaThread "pool-4-thread-1" [_thread_blocked, id=2864, stack(0x66390000,0x663e0000)]
0x65fbf400 JavaThread "pool-2-thread-1" [_thread_blocked, id=2696, stack(0x66340000,0x66390000)]
0x65f6d400 JavaThread "Thread-0" [_thread_blocked, id=3016, stack(0x662f0000,0x66340000)]
0x65ebf000 JavaThread "WrapperSimpleAppMain" [_thread_blocked, id=696, stack(0x662a0000,0x662f0000)]
0x00265c00 JavaThread "DestroyJavaVM" [_thread_blocked, id=564, stack(0x00680000,0x006d0000)]
0x65fecc00 JavaThread "Wrapper-Connection" daemon [_thread_in_native, id=1224, stack(0x66170000,0x661c0000)]
0x65ec9c00 JavaThread "Wrapper-Control-Event-Monitor" daemon [_thread_blocked, id=2896, stack(0x660d0000,0x66120000)]
0x65bbf800 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=1284, stack(0x65e00000,0x65e50000)]
0x65bbd000 JavaThread "CompilerThread1" daemon [_thread_blocked, id=3040, stack(0x65db0000,0x65e00000)]
0x65bb8000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=1472, stack(0x65d60000,0x65db0000)]
0x65bb6c00 JavaThread "Attach Listener" daemon [_thread_blocked, id=2000, stack(0x65d10000,0x65d60000)]
0x65bb6000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=2732, stack(0x65cc0000,0x65d10000)]
0x65b9ec00 JavaThread "Finalizer" daemon [_thread_blocked, id=2008, stack(0x65c70000,0x65cc0000)]
0x65b9a800 JavaThread "Reference Handler" daemon [_thread_blocked, id=1304, stack(0x65c20000,0x65c70000)]
Other Threads:
=>0x65b97400 VMThread [stack: 0x65bd0000,0x65c20000] [id=2112]
0x65bc1000 WatcherThread [stack: 0x65e50000,0x65ea0000] [id=192]
VM state:at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x00265408/0x00000310] Threads_lock - owner thread: 0x65b97400
[0x002655a8/0x000002d0] Heap_lock - owner thread: 0x65fb9400
Heap
PSYoungGen      total 76928K, used 344K [0x5ad20000, 0x60d40000, 0x653c0000)
eden space 76544K, 0% used [0x5ad20000,0x5ad20000,0x5f7e0000)
from space 384K, 89% used [0x5f7e0000,0x5f836070,0x5f840000)
to   space 10944K, 0% used [0x60290000,0x60290000,0x60d40000)
PSOldGen        total 1341888K, used 529414K [0x077c0000, 0x59630000, 0x5ad20000)
object space 1341888K, 39% used [0x077c0000,0x27cc1b38,0x59630000)
PSPermGen       total 16384K, used 10204K [0x037c0000, 0x047c0000, 0x077c0000)
object space 16384K, 62% used [0x037c0000,0x041b73a0,0x047c0000)
Dynamic libraries:
0x00400000 - 0x00423000      D:\Java\jdk1.6.0_07\bin\java.exe
0x78460000 - 0x784e2000      C:\WINNT\system32\ntdll.dll
0x78ed0000 - 0x78f35000      C:\WINNT\system32\ADVAPI32.dll
0x77e70000 - 0x77f2f000      C:\WINNT\system32\KERNEL32.dll
0x770c0000 - 0x7712f000      C:\WINNT\system32\RPCRT4.dll
0x78fb0000 - 0x78fbf000      C:\WINNT\system32\Secur32.dll
0x7c340000 - 0x7c396000      D:\Java\jdk1.6.0_07\jre\bin\msvcr71.dll
0x6dac0000 - 0x6de7a000      D:\Java\jdk1.6.0_07\jre\bin\server\jvm.dll
0x77e00000 - 0x77e5f000      C:\WINNT\system32\USER32.dll
0x77f40000 - 0x77f7c000      C:\WINNT\system32\GDI32.dll
0x77540000 - 0x77571000      C:\WINNT\system32\WINMM.dll
0x6d320000 - 0x6d328000      D:\Java\jdk1.6.0_07\jre\bin\hpi.dll
0x68ea0000 - 0x68eab000      C:\WINNT\system32\PSAPI.DLL
0x6d820000 - 0x6d82c000      D:\Java\jdk1.6.0_07\jre\bin\verify.dll
0x6d3c0000 - 0x6d3df000      D:\Java\jdk1.6.0_07\jre\bin\java.dll
0x6d860000 - 0x6d86f000      D:\Java\jdk1.6.0_07\jre\bin\zip.dll
0x660a0000 - 0x660b7000      D:\Prism8.2\lib\wrapper.dll
0x6d620000 - 0x6d633000      D:\Java\jdk1.6.0_07\jre\bin\net.dll
0x74fb0000 - 0x74fc4000      C:\WINNT\system32\WS2_32.dll
0x78000000 - 0x78045000      C:\WINNT\system32\MSVCRT.DLL
0x74fa0000 - 0x74fa8000      C:\WINNT\system32\WS2HELP.DLL
0x74f50000 - 0x74f6e000      C:\WINNT\system32\msafd.dll
0x74f90000 - 0x74f97000      C:\WINNT\System32\wshtcpip.dll
0x77830000 - 0x7783c000      C:\WINNT\System32\rnr20.dll
0x77970000 - 0x77994000      C:\WINNT\system32\DNSAPI.DLL
0x74fd0000 - 0x74fd9000      C:\WINNT\system32\WSOCK32.dll
0x77310000 - 0x77323000      C:\WINNT\system32\iphlpapi.dll
0x774f0000 - 0x774f5000      C:\WINNT\system32\ICMP.dll
0x772f0000 - 0x77307000      C:\WINNT\system32\MPRAPI.dll
0x750d0000 - 0x750e0000      C:\WINNT\system32\SAMLIB.DLL
0x7ccc0000 - 0x7cd10000      C:\WINNT\system32\NETAPI32.DLL
0x77be0000 - 0x77bf1000      C:\WINNT\system32\NTDSAPI.dll
0x77940000 - 0x7796c000      C:\WINNT\system32\WLDAP32.DLL
0x75140000 - 0x75146000      C:\WINNT\system32\NETRAP.dll
0x7cd20000 - 0x7ce0f000      C:\WINNT\system32\OLE32.DLL
0x779a0000 - 0x77a3c000      C:\WINNT\system32\OLEAUT32.DLL
0x77380000 - 0x773b0000      C:\WINNT\system32\ACTIVEDS.DLL
0x77350000 - 0x77373000      C:\WINNT\system32\ADSLDPC.DLL
0x77820000 - 0x7782e000      C:\WINNT\system32\RTUTILS.DLL
0x783c0000 - 0x78451000      C:\WINNT\system32\SETUPAPI.DLL
0x78d20000 - 0x78d85000      C:\WINNT\system32\USERENV.DLL
0x774b0000 - 0x774e4000      C:\WINNT\system32\RASAPI32.dll
0x77490000 - 0x774a1000      C:\WINNT\system32\rasman.dll
0x77500000 - 0x77522000      C:\WINNT\system32\TAPI32.dll
0x77b40000 - 0x77bc4000      C:\WINNT\system32\COMCTL32.DLL
0x77c70000 - 0x77cb9000      C:\WINNT\system32\SHLWAPI.DLL
0x77330000 - 0x77349000      C:\WINNT\system32\DHCPCSVC.DLL
0x777d0000 - 0x777d8000      C:\WINNT\System32\winrnr.dll
0x777e0000 - 0x777e5000      C:\WINNT\system32\rasadhlp.dll
0x7ca00000 - 0x7ca23000      C:\WINNT\system32\rsaenh.dll
0x79570000 - 0x795fd000      C:\WINNT\system32\CRYPT32.dll
0x77400000 - 0x77411000      C:\WINNT\system32\MSASN1.dll
0x7ce30000 - 0x7d07d000      C:\WINNT\system32\shell32.dll
0x6d7c0000 - 0x6d7c6000      D:\Java\jdk1.6.0_07\jre\bin\rmi.dll
VM Arguments:
jvm_args: -Djava.rmi.server.codebase=file:.\Prism.jar -Djava.security.policy=.\policy -Xms64m -Xmx1500m -Djava.library.path=.\lib;.\config -Dwrapper.key=ouZmthkGY4rb0RsE -Dwrapper.port=32000 -Dwrapper.jvm.port.min=31000 -Dwrapper.jvm.port.max=31999 -Dwrapper.pid=1388 -Dwrapper.version=3.2.3 -Dwrapper.native_library=wrapper -Dwrapper.service=TRUE -Dwrapper.cpu.timeout=10 -Dwrapper.jvmid=1
java_command: org.tanukisoftware.wrapper.WrapperSimpleApp com.socgen.prism.simulateur.client.PrismSimulatorClientOld
Launcher Type: SUN_STANDARD
Environment Variables:
JAVA_HOME=D:\Java\jdk1.6.0_07
PATH=D:\Java\jdk1.6.0_07;D:\Java\jdk1.6.0_07\bin;C:\Program Files\nsr\bin;C:\WINNT\system32;C:\WINNT;C:\WINNT\System32\Wbem;C:\MSDE\BINN;ITAPaging;D:\PROGRA~1\patrol\Patrol3\bin;D:\Program Files\patrol\Patrol3\bin;D:\Program Files\patrol\Patrol3\Pamo;C:\Program Files\Resource Kit\;C:\Program Files\Support Tools\;C:\Program Files\Dell\SysMgt\oma\bin;C:\Program Files\Dell\SysMgt\RAC3
OS=Windows_NT
PROCESSOR_IDENTIFIER=x86 Family 15 Model 2 Stepping 7, GenuineIntel
--------------- S Y S T E M ---------------
OS: Windows 2000 Build 2195 Service Pack 4
CPU:total 4 (1 cores per cpu, 2 threads per core) family 15 model 2 stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, ht
Memory: 4k page, physical 2097151k(2059808k free), swap 4194303k(4194303k free)
vm_info: Java HotSpot(TM) Server VM (10.0-b23) for windows-x86 JRE (1.6.0_07-b06), built on Jun 10 2008 01:09:43 by "java_re" with MS VC++ 7.1
time: Sat Aug 09 17:44:47 2008
elapsed time: 79016 seconds

Answers are in this thread: http://forum.java.sun.com/thread.jspa?threadID=5139476
Be sure to read the whole thing.

JVM Crash When Using JNI and COM

I'm trying to call a DLL compiled from VB6 source code that I do not have access to. The VB6 code simply retrieves data from a DB2 database using ADO and my client code grabs that data and marshals it to my Java code. I'm attempting to achieve this using JNI and COM (without a third-party bridge). It works 75% of the time, but the other 25% of the time, the JVM crashes with the usual Hotspot crash log containing an access violation exception. However, I don't know what in my C++ code (VC++ 8) could be causing this except for passing a "wild" pointer to the code lying underneath the COM object interface. If that is the case, I don't know how I am doing that.
The Java code that is calling my native method is running on Tomcat 5.5.25 and just to be safe, I am not allowing multiple threads to concurrently call the method in my JNI DLL (though I realize that this will kill performance). Once I can get past this problem, I'll do the COM interfacing on a worker thread in my native code so I don't screw up CoInitialize and CoUninitialize calls in the case the same thread is concurrently executing multiple calls to my native code.
I've noticed that in most cases, the JVM crashes during my call to the pClsAccount->OpenConnection method. However, my DLL isn't what is listed on the top of the call stack, which is why I suspect the passing of a wild pointer, though I'm just taking a guess at that. Does anyone have an idea as to what's going on ?
JNIEXPORT jobject JNICALL Java_CustomerInfo_nGetCustomerAccountInfo(JNIEnv *env, jobject customerInfo, jstring accountNumber, jstring iniFileName)
jboolean isCopy;
// Account info class and instance to be instantiated
jclass accountInfoCls = NULL;
jobject accountInfoObj = NULL;
// The constructor ID of the accountInfoCls
jmethodID ctorID = NULL;
// Pointer to the interface for the ClsAccount COM object
_clsAccount *pClsAccount = NULL;
HRESULT hr;
BSTR bstrIniFileName(L"");
try
const char *nativeAccountNumber = NULL;
if (accountNumber != NULL)
nativeAccountNumber = env->GetStringUTFChars(accountNumber, &isCopy);
else
jclass newExcCls;
env->ExceptionDescribe();
env->ExceptionClear();
newExcCls = env->FindClass("java/lang/IllegalArgumentException");
env->ThrowNew(newExcCls, "accountNumber passed in was null !");
return NULL;
// Initialization
variantt varConnectionSucceeded = variantt(false);
variantt varGetAccountInfoSucceeded = variantt(false);
variantt varAccountNumber = variantt(nativeAccountNumber);
bstrt bstrLastPaymentDate = bstrt();
bstrt bstrLastErrorMessage = bstrt();
bstrt bstrLastErrorNumber = bstrt();
jlong jTotalDue = NULL;
jlong jEstablishedDueDay = NULL;
jlong jLastPaymentAmount = NULL;
jstring jLastPaymentDate = NULL;
jstring jLastErrorMessage = NULL;
jstring jLastErrorNumber = NULL;
jthrowable jException = NULL;
const char *chLastPaymentDate = NULL;
const char *chLastErrorMessage = NULL;
const char *chLastErrorNumber = NULL;
long long totalDue;
long long lastPaymentAmount;
long establishedDueDateDay;
//Convert string from Java string to C string to VB string
const char *nativeIniFileName = NULL;
if (iniFileName != NULL)
nativeIniFileName = env->GetStringUTFChars(iniFileName, &isCopy);
else
jclass newExcCls;
env->ExceptionDescribe();
env->ExceptionClear();
newExcCls = env->FindClass("java/lang/IllegalArgumentException");
env->ThrowNew(newExcCls, "iniFileName passed in was null");
return NULL;
bstrIniFileName = comutil::ConvertStringToBSTR(nativeIniFileName);
CoInitialize(NULL);
// Create an instance of the COClass with the interface over it
hr = CoCreateInstance(__uuidof(clsAccount), NULL, CLSCTX_INPROC_SERVER, __uuidof(_clsAccount), (void **)&pClsAccount);
if (hr == S_OK)
varConnectionSucceeded.boolVal = pClsAccount->OpenConnection(&bstrIniFileName);
　
if (varConnectionSucceeded.boolVal == -1)
varGetAccountInfoSucceeded.boolVal = pClsAccount->GetAccountPaymentInformation(&(varAccountNumber.GetVARIANT()));
env->ReleaseStringUTFChars(accountNumber, nativeAccountNumber);
// Extract all available account information from the ClsAccount object
if (varGetAccountInfoSucceeded.boolVal == -1)
totalDue = pClsAccount->TotalDue.int64;
establishedDueDateDay = pClsAccount->EstablishedDueDateDay;
lastPaymentAmount = pClsAccount->LastPaymentAmount.int64;
bstrLastPaymentDate = pClsAccount->LastPaymentDate;
chLastPaymentDate = comutil::ConvertBSTRToString(bstrLastPaymentDate.GetBSTR());
jTotalDue = (jlong)totalDue;
jEstablishedDueDay = (jlong)establishedDueDateDay;
jLastPaymentAmount = (jlong)lastPaymentAmount;
jLastPaymentDate = env->NewStringUTF(chLastPaymentDate);
delete[] chLastPaymentDate;
pClsAccount->CloseConnection();
// Populate error fields if any errors occur
bstrLastErrorMessage = pClsAccount->LastErrMessage;
chLastErrorMessage = comutil::ConvertBSTRToString(bstrLastErrorMessage.GetBSTR());
bstrLastErrorNumber = pClsAccount->LastErrNumber;
chLastErrorNumber = comutil::ConvertBSTRToString(bstrLastErrorNumber.GetBSTR());
jLastErrorMessage = env->NewStringUTF(chLastErrorMessage);
jLastErrorNumber = env->NewStringUTF(chLastErrorNumber);
delete[] chLastErrorMessage;
delete[] chLastErrorNumber;
const char* clsName = "com/nuance/merchantsmutual/businessentities/CustomerAccountInfo";
// Find the Java class and the ID of its constructor
accountInfoCls = env->FindClass(clsName);
ctorID = env->GetMethodID(accountInfoCls, "<init>", "(JJJLjava/lang/String;Ljava/lang/String;Ljava/lang/String;)V");
jException = env->ExceptionOccurred();
if (jException != NULL)
env->ExceptionDescribe();
env->ExceptionClear();
//Release all resources associated with the ClsAccount instance
pClsAccount->Release();
//Instantiate the class with the given parameters
accountInfoObj = env->NewObject(accountInfoCls, ctorID, jTotalDue, jEstablishedDueDay, jLastPaymentAmount, jLastPaymentDate, jLastErrorMessage, jLastErrorNumber);
jException = env->ExceptionOccurred();
if (jException != NULL)
env->ExceptionDescribe();
env->ExceptionClear();
else if (hr == REGDB_E_CLASSNOTREG)
cout << "COM class not registered" << endl;
else if ( hr == CLASS_E_NOAGGREGATION)
cout << "COM class can't be aggregated" << endl;
else if (hr == E_NOINTERFACE)
cout << "No interface for COM class clsAccount" << endl;
else if (hr == E_POINTER)
cout << "*ppv pointer was NULL !" << endl;
else
cout << "Error occurred while creating COM object. HR is [" << hr << "]" << endl;
// Free the BSTR because a new one was returned with a call to comutil::ConvertStringToBSTR
SysFreeString(bstrIniFileName);
// Release the string when it's no longer needed. MUST call if string won't be used
// anymore or else a memory leak will occur
env->ReleaseStringUTFChars(iniFileName, nativeIniFileName);
CoUninitialize();
　
catch (_com_error &e)
cout << "Encountered an exception in GetCustomerAccountInfo: Error was " << e.ErrorMessage();
pClsAccount->Release();
catch (...)
pClsAccount->Release();
return accountInfoObj;
Edited by: Cthulhu76 on Jan 5, 2010 9:18 AM

0x49202400 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=5340, stack(0x49bf0000,0x49c40000)]
0x48a7e800 JavaThread "Thread-1" [_thread_in_native, id=5976, stack(0x48f00000,0x48f50000)]
0x48a0dc00 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=3072, stack(0x48c60000,0x48cb0000)]
0x48a09000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=4988, stack(0x48c10000,0x48c60000)]
0x48a07c00 JavaThread "Attach Listener" daemon [_thread_blocked, id=3124, stack(0x48bc0000,0x48c10000)]
0x48a07000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=2572, stack(0x48b70000,0x48bc0000)]
0x489f5c00 JavaThread "Finalizer" daemon [_thread_blocked, id=5752, stack(0x48b20000,0x48b70000)]
0x489f4c00 JavaThread "Reference Handler" daemon [_thread_blocked, id=2596, stack(0x48ad0000,0x48b20000)]
0x003c6000 JavaThread "main" [_thread_in_native, id=4252, stack(0x00820000,0x00870000)]
Other Threads:
0x489f0400 VMThread [stack: 0x48a80000,0x48ad0000] [id=5624]
0x48a18800 WatcherThread [stack: 0x48cb0000,0x48d00000] [id=1192]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
def new generation total 36288K, used 12762K [0x02940000, 0x050a0000, 0x07800000)
eden space 32256K, 34% used [0x02940000, 0x0343af58, 0x048c0000)
from space 4032K, 37% used [0x04cb0000, 0x04e2ba28, 0x050a0000)
to space 4032K, 0% used [0x048c0000, 0x048c0000, 0x04cb0000)
tenured generation total 483968K, used 7518K [0x07800000, 0x250a0000, 0x42940000)
the space 483968K, 1% used [0x07800000, 0x07f57958, 0x07f57a00, 0x250a0000)
compacting perm gen total 14080K, used 14016K [0x42940000, 0x43700000, 0x46940000)
the space 14080K, 99% used [0x42940000, 0x436f0320, 0x436f0400, 0x43700000)
No shared spaces configured.
Dynamic libraries:
0x00400000 - 0x0040f000      C:\Program Files\Apache Software Foundation\Tomcat 5.5\bin\tomcat5.exe
0x7c800000 - 0x7c8c0000      C:\WINDOWS\system32\ntdll.dll
0x77e40000 - 0x77f42000      C:\WINDOWS\system32\kernel32.dll
0x77380000 - 0x77411000      C:\WINDOWS\system32\USER32.dll
0x77c00000 - 0x77c48000      C:\WINDOWS\system32\GDI32.dll
0x77f50000 - 0x77feb000      C:\WINDOWS\system32\ADVAPI32.dll
0x77c50000 - 0x77cef000      C:\WINDOWS\system32\RPCRT4.dll
0x76f50000 - 0x76f63000      C:\WINDOWS\system32\Secur32.dll
0x77ba0000 - 0x77bfa000      C:\WINDOWS\system32\MSVCRT.dll
0x7c8d0000 - 0x7d0cf000      C:\WINDOWS\system32\SHELL32.dll
0x77da0000 - 0x77df2000      C:\WINDOWS\system32\SHLWAPI.dll
0x76290000 - 0x762ad000      C:\WINDOWS\system32\IMM32.DLL
0x77420000 - 0x77523000      C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.3959_x-ww_D8713E55\comctl32.dll
0x6d7c0000 - 0x6da10000      C:\Program Files\Java\jre1.6.0_07\bin\client\jvm.dll
0x76aa0000 - 0x76acd000      C:\WINDOWS\system32\WINMM.dll
0x7c340000 - 0x7c396000      C:\WINDOWS\system32\MSVCR71.dll
0x6d270000 - 0x6d278000      C:\Program Files\Java\jre1.6.0_07\bin\hpi.dll
0x76b70000 - 0x76b7b000      C:\WINDOWS\system32\PSAPI.DLL
0x6d770000 - 0x6d77c000      C:\Program Files\Java\jre1.6.0_07\bin\verify.dll
0x6d310000 - 0x6d32f000      C:\Program Files\Java\jre1.6.0_07\bin\java.dll
0x6d7b0000 - 0x6d7bf000      C:\Program Files\Java\jre1.6.0_07\bin\zip.dll
0x6d570000 - 0x6d583000      C:\Program Files\Java\jre1.6.0_07\bin\net.dll
0x71c00000 - 0x71c17000      C:\WINDOWS\system32\WS2_32.dll
0x71bf0000 - 0x71bf8000      C:\WINDOWS\system32\WS2HELP.dll
0x71b20000 - 0x71b61000      C:\WINDOWS\system32\mswsock.dll
0x5f270000 - 0x5f2ca000      C:\WINDOWS\system32\hnetcfg.dll
0x71ae0000 - 0x71ae8000      C:\WINDOWS\System32\wshtcpip.dll
0x76ed0000 - 0x76efa000      C:\WINDOWS\system32\DNSAPI.dll
0x76f70000 - 0x76f77000      C:\WINDOWS\System32\winrnr.dll
0x76f10000 - 0x76f3e000      C:\WINDOWS\system32\WLDAP32.dll
0x76f80000 - 0x76f85000      C:\WINDOWS\system32\rasadhlp.dll
0x4a6a0000 - 0x4a6ac000      C:\Program Files\Apache Software Foundation\Tomcat 5.5\webapps\MMI\WEB-INF\lib\CustomerInfoProxy.dll
0x77670000 - 0x777a9000      C:\WINDOWS\system32\ole32.dll
0x77d00000 - 0x77d8b000      C:\WINDOWS\system32\OLEAUT32.dll
0x7c420000 - 0x7c4a7000      C:\WINDOWS\WinSxS\x86_Microsoft.VC80.CRT_1fc8b3b9a1e18e3b_8.0.50727.4053_x-ww_E6967989\MSVCP80.dll
0x78130000 - 0x781cb000      C:\WINDOWS\WinSxS\x86_Microsoft.VC80.CRT_1fc8b3b9a1e18e3b_8.0.50727.4053_x-ww_E6967989\MSVCR80.dll
0x777b0000 - 0x77833000      C:\WINDOWS\system32\CLBCatQ.DLL
0x77010000 - 0x770d6000      C:\WINDOWS\system32\COMRes.dll
0x77b90000 - 0x77b98000      C:\WINDOWS\system32\VERSION.dll
0x75da0000 - 0x75e5d000      C:\WINDOWS\system32\SXS.DLL
0x75e60000 - 0x75e87000      C:\WINDOWS\system32\apphelp.dll
0x4dc30000 - 0x4dc5e000      C:\WINDOWS\system32\msctfime.ime
0x4b0d0000 - 0x4b395000      C:\WINDOWS\system32\xpsp2res.dll
0x71bb0000 - 0x71bb9000      C:\WINDOWS\system32\WSOCK32.dll
0x4bbe0000 - 0x4bbea000      C:\Program Files\Apache Software Foundation\Tomcat 5.5\webapps\MMI\WEB-INF\lib\ClearTranProxy.dll
0x745e0000 - 0x7489e000      C:\WINDOWS\system32\msi.dll
0x71c40000 - 0x71c97000      C:\WINDOWS\system32\NETAPI32.dll
0x4bc50000 - 0x4bc6c000      C:\WINDOWS\system32\DBNETLIB.DLL
0x71f60000 - 0x71f64000      C:\WINDOWS\system32\security.dll
0x76c90000 - 0x76cb7000      C:\WINDOWS\system32\msv1_0.dll
0x76cf0000 - 0x76d0a000      C:\WINDOWS\system32\iphlpapi.dll
0x761b0000 - 0x76243000      C:\WINDOWS\system32\crypt32.dll
0x76190000 - 0x761a2000      C:\WINDOWS\system32\MSASN1.dll
0x4bcf0000 - 0x4bcff000      C:\Program Files\Common Files\System\Ole DB\SQLOLEDB.RLL
0x4a8a0000 - 0x4a8aa000      C:\Program Files\Apache Software Foundation\Tomcat 5.5\webapps\MMI\WEB-INF\lib\MIGI.DLL
0x73570000 - 0x736c2000      C:\Program Files\Apache Software Foundation\Tomcat 5.5\webapps\MMI\WEB-INF\lib\MSVBVM60.DLL
0x4a950000 - 0x4a9e2000      C:\Program Files\Common Files\System\ado\msado15.dll
0x74a50000 - 0x74a6a000      C:\WINDOWS\system32\MSDART.DLL
0x4c850000 - 0x4c8c9000      C:\Program Files\Common Files\System\Ole DB\oledb32.dll
0x4dbb0000 - 0x4dbc1000      C:\Program Files\Common Files\System\Ole DB\OLEDB32R.DLL
VM Arguments:
jvm_args: -Dcatalina.home=C:\Program Files\Apache Software Foundation\Tomcat 5.5 -Dcatalina.base=C:\Program Files\Apache Software Foundation\Tomcat 5.5 -Djava.endorsed.dirs=C:\Program Files\Apache Software Foundation\Tomcat 5.5\common\endorsed -Djava.io.tmpdir=C:\Program Files\Apache Software Foundation\Tomcat 5.5\temp -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=C:\Program Files\Apache Software Foundation\Tomcat 5.5\conf\logging.properties -Djava.library.path=C:\Program Files\Apache Software Foundation\Tomcat 5.5\webapps\MMI\WEB-INF\lib vfprintf -Xms512m -Xmx1024m
java_command: <unknown>
Launcher Type: generic
Environment Variables:
JAVA_HOME=C:\Program Files\Java\jdk1.6.0_07
[error occurred during error reporting (printing environment variables), id 0xc0000005]
--------------- S Y S T E M ---------------
OS: Windows Server 2003 family Build 3790 Service Pack 2
CPU:total 4 (4 cores per cpu, 1 threads per core) family 6 model 7 stepping 6, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3
Memory: 4k page, physical 2097151k(2097151k free), swap 4194303k(4194303k free)
vm_info: Java HotSpot(TM) Client VM (10.0-b23) for windows-x86 JRE (1.6.0_07-b06), built on Jun 10 2008 01:14:11 by "java_re" with MS VC++ 7.1
time: Mon Dec 28 15:24:00 2009
elapsed time: 600 seconds

JRockit JVM crash

Similar Messages

Maybe you are looking for