JRockit Crash - BEA JRockit(R) R27.5.0-110_o-99226-1.4.2_16-20080528-1505-l

Hi,
WebLogic Server 8.1SP5 + JRockit R27.5.0-110 has crashed with following DUMP.
It's the latest version fot this env, and upgraded recently because of crash.
Version : BEA JRockit(R) R27.5.0-110_o-99226-1.4.2_16-20080528-1505-linux-ia64
What can I do?
===== BEGIN DUMP =============================================================
JRockit dump produced after 31 days, 04:17:18 on Wed Oct 21 18:00:49 2009
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
/supp1/wldomains/sli_domain/pcms_server2/jrockit.23637.dump
/supp1/wldomains/sli_domain/pcms_server2/core or core.23637
Error Message: Illegal memory access. [54]
Signal info : si_signo=11, si_code=2 si_addr=(nil)
Version : BEA JRockit(R) R27.5.0-110_o-99226-1.4.2_16-20080528-1505-linux-ia64
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#18850.
: YC is currently running. This is YC#7431.
OC History : Strategy singleparpar was used for OC#18844.
: Strategy genparpar was used for OC#18845.
: Strategy singleparpar was used for OC#18846.
: Strategy genparpar was used for OC#18847 to OC#18849.
: Strategy singleparpar was used for OC#18850.
YC History : Ran 0 YCs before OC#18846.
: Ran 1 YCs before OC#18847.
: Ran 1 YCs before OC#18848.
: Ran 0 YCs before OC#18849.
: Ran 0 YCs before OC#18850.
: Started 1 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0xd00000 - 0x7d54000 (Size: 112 MB)
Compaction : 0x1405400 - 0x1b0a800 (Current compaction type: internal)
NurseryList : 0x25e1668 - 0x526a6a0
KeepArea : 0x52b3648 - 0x526a6a0
NurseryMarker: [ 0x52a7e80, 0x52b3648 ]
CompRefs : References are compressed, with heap base 0x0.
CPU : Intel Itanium 2 (McKinley)
Number CPUs : 4
Tot Phys Mem : 16989126656 (16202 MB)
OS version : Red Hat Enterprise Linux AS release 4 (Nahant Update 4)
Linux version 2.6.9-42.EL ([email protected]) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-2)) #1 SMP Wed Jul 12 23:25:09 EDT 2006 (ia64)
Thread System: NPTL
Java locking : Normal
State : JVM is running
Command Line : -Xms96m -Xmx256m -Xverify:none -Djennifer.config=/supp1/pkg/jennifer/agent32/conf/s52.conf -Xbootclasspath/p:/supp1/pkg/jennifer/agent32/jennifersys.jar:/supp1/pkg/jennifer/agent32/lwst30.ia64.jar -Dweblogic.Name=pcms_server2 -Dweblogic.ProductionModeEnabled= -Dweblogic.management.server=http://100.254.55.74:15100 -Djava.awt.headless=true -Djava.security.policy=/app1/was/bea/weblogic81/server/lib/weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home : /app1/was/bea/jrockit81sp5_142_16/jre
j.class.path : /supp1/pkg/jennifer/agent32/jennifer.jar:/supp1/pkg/ojdbc/ojdbc14-20070827.jar:/supp1/pkg/ojdbc/ojdbc14-20070827.jar:/app1/was/bea/jrockit81sp5_142_16/lib/tools.jar:/app1/was/bea/weblogic81/server/lib/patch/CR267161_810sp5.jar:/app1/was/bea/weblogic81/server/lib/patch/CR266573_81sp5.jar:/app1/was/bea/weblogic81/server/lib/patch/CR259992_81sp5.jar:/app1/was/bea/weblogic81/server/lib/patch/CR248397_810sp5.jar:/app1/was/bea/weblogic81/server/lib/patch/CR237801_810sp5.jar:/app1/was/bea/weblogic81/server/lib/weblogic_sp.jar:/app1/was/bea/weblogic81/server/lib/weblogic.jar::/app1/was/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/app1/was/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/app1/was/bea/jrockit81sp5_142_16/jre/lib/rt.jar:/app1/was/bea/weblogic81/server/lib/webservices.jar::/supp1/pkg/KeyService/KeyService.jar:/supp1/pkg/jalopy/1.0b10/jalopy.jar:/supp1/pkg/log4j/log4j.jar:/supp1/pkg/jdom/jdom-1.0.jar:/supp1/pkg/struts/commons-beanutils.jar:/supp1/pkg/struts/commons-collections.jar:/supp1/pkg/struts/commons-fileupload.jar:/supp1/pkg/struts/commons-digester.jar:/supp1/pkg/struts/commons-logging.jar:/supp1/pkg/struts/commons-validator.jar:/supp1/pkg/struts/struts.jar:/supp1/pkg/j2ee/1.3.1/j2ee.jar:/supp1/pkg/xalan-j/2.6.0/xalan.jar:/supp1/pkg/Xerces-J/2.6.2/xercesImpl.jar:/supp1/pkg/poi/2.5.1/poi-2.5.1-final-20040804.jar:/supp1/pkg/jSpeed40/:/supp1/pkg/jStar2.2_02/lib/jStarClient.jar:/supp1/pkg/secui/secui.jar:/supp1/pkg/sso/jce-jdk13-125.jar:/supp1/pkg/sftp/jar/sftp.jar:/supp1/pkg/sftp/jar/sftpClient.jar
j.lib.path : /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/jrockit:/app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64:/app1/was/bea/jrockit81sp5_142_16/jre/../lib/ia64:/supp1/pkg/jennifer/agent32/jni/linux:/app1/dbase/oracle9/lib:/supp1/supp/common:/supp1/pkg/secui/lib/sli_domain/pcms_server:/supp1/supp/common:/supp1/pkg/secui/lib/sli_domain/pcms_server:/app1/was/bea/weblogic81/server/lib/linux/ia64:/app1/was/bea/weblogic81/server/lib/linux/ia64/oci920_8
JAVA_HOME : /app1/was/bea/jrockit81sp5_142_16
JAVAOPTIONS: <not set>
LD_LIBRARY_PATH: /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/jrockit:/app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64:/app1/was/bea/jrockit81sp5_142_16/jre/../lib/ia64:/supp1/pkg/jennifer/agent32/jni/linux:/app1/dbase/oracle9/lib:/supp1/supp/common:/supp1/pkg/secui/lib/sli_domain/pcms_server:/supp1/supp/common:/supp1/pkg/secui/lib/sli_domain/pcms_server:/app1/was/bea/weblogic81/server/lib/linux/ia64:/app1/was/bea/weblogic81/server/lib/linux/ia64/oci920_8
LD_ASSUME_KERNEL: <not set>
C Heap : Good; no memory allocations have failed
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x102315d30 / OS context: 0x102315e00):
gr0 = 0000000000000000 gr1 = 2000000000a03ef8
gr2 = c00000000000038f gr3 = 0000000103c00024
gr4 = 0000000000000000 gr5 = 0000000000000000
gr6 = 0000000000000000 gr7 = 0000000000000000
gr8 = 0000000000000001 gr9 = 0000000000000001
gr10 = 0000000000000230 gr11 = 0000000000000023
gr12 = 0000000102316860 gr13 = 0000000102317920
gr14 = 0000000000000000 gr15 = 00000001046ab154
gr16 = 0000000102316870 gr17 = 0000000102316888
gr18 = 00000001046ab168 gr19 = 00000001046ab178
gr20 = 00000001046aafd0 gr21 = 00000001046ab158
gr22 = 00000001046aafd8 gr23 = 0000000103c00024
gr24 = ffffffffffffbfff gr25 = 0000000106008348
gr26 = 0000000000000061 gr27 = 00000001060083a0
gr28 = 0000000106008340 gr29 = 0000000106008350
gr30 = 0000000106008358 gr31 = 0000000040155550
fr0 = 0000000000000000 fr1 = 8000000000000000
fr2 = 0000000000000000 fr3 = 0000000000000000
fr4 = 0000000000000000 fr5 = 0000000000000000
fr6 = 0000000000000100 fr7 = 0000000000000010
fr8 = 0000000000000001 fr9 = 0000000000000001
fr10 = 0000000000000010 fr11 = 0000000000000001
fr12 = 0000000000000010 fr13 = 0000000000000030
fr14 = 0000000000000003 fr15 = 0000000000000010
fr16 = 0000000000000000 fr17 = 0000000000000000
fr18 = 0000000000000000 fr19 = 0000000000000000
fr20 = 0000000000000000 fr21 = 0000000000000000
fr22 = 0000000000000000 fr23 = 0000000000000000
fr24 = 0000000000000000 fr25 = 0000000000000000
fr26 = 0000000000000000 fr27 = 0000000000000000
fr28 = 0000000000000000 fr29 = 0000000000000000
fr30 = 0000000000000000 fr31 = 0000000000000000
fr32 = 0000000016b84468 fr33 = 0000000000000000
fr34 = 0000000000000000 fr35 = ffffffff00000032
fr36 = ffffffff0000002e fr37 = ffffffff0000002c
fr38 = ffffffff0000002a fr39 = ffffffff00000028
fr40 = ffffffff00000022 fr41 = ffffffff00000023
fr42 = 0000000000000000 fr43 = 0000000000000000
fr44 = 00000000167c4598 fr45 = 00000000167c4618
fr46 = 00000000167c45d8 fr47 = 00000000167c45c8
fr48 = 00000000167c45b8 fr49 = 00000000167c45a8
fr50 = 0000000016b84470 fr51 = 0000000000000000
fr52 = 0000000000000000 fr53 = ffffffff00000025
fr54 = ffffffff00000034 fr55 = ffffffff0000002d
fr56 = ffffffff0000002b fr57 = ffffffff00000029
fr58 = ffffffff00000027 fr59 = ffffffff00000024
fr60 = 0000000000000000 fr61 = 0000000000000000
fr62 = 0000000000000000 fr63 = 0000000000000000
fr64 = 0000000000000000 fr65 = 0000000000000000
fr66 = 0000000000000000 fr67 = 0000000000000000
fr68 = 0000000000000000 fr69 = 0000000000000000
fr70 = 0000000000000000 fr71 = 0000000000000000
fr72 = 0000000000000000 fr73 = 0000000000000000
fr74 = 0000000000000000 fr75 = 0000000000000000
fr76 = 0000000000000000 fr77 = 0000000000000000
fr78 = 0000000000000000 fr79 = 0000000000000000
fr80 = 0000000000000000 fr81 = 0000000000000000
fr82 = 0000000000000000 fr83 = 0000000000000000
fr84 = 0000000000000000 fr85 = 0000000000000000
fr86 = 0000000000000000 fr87 = 0000000000000000
fr88 = 0000000000000000 fr89 = 0000000000000000
fr90 = 0000000000000000 fr91 = 0000000000000000
fr92 = 0000000000000000 fr93 = 0000000000000000
fr94 = 0000000000000000 fr95 = 0000000000000000
fr96 = 0000000000000000 fr97 = 0000000000000000
fr98 = 0000000000000000 fr99 = 0000000000000000
fr100 = 0000000000000000 fr101 = 0000000000000000
fr102 = 0000000000000000 fr103 = 0000000000000000
fr104 = 0000000000000000 fr105 = 0000000000000000
fr106 = 0000000000000000 fr107 = 0000000000000000
fr108 = 0000000000000000 fr109 = 0000000000000000
fr110 = 0000000000000000 fr111 = 0000000000000000
fr112 = 0000000000000000 fr113 = 0000000000000000
fr114 = 0000000000000000 fr115 = 0000000000000000
fr116 = 0000000000000000 fr117 = 0000000000000000
fr118 = 0000000000000000 fr119 = 0000000000000000
fr120 = 0000000000000000 fr121 = 0000000000000000
fr122 = 00000000167c4608 fr123 = 00000000167c45e0
fr124 = 00000000167c45d0 fr125 = 00000000167c45c0
fr126 = 00000000167c45b0 fr127 = 00000000167c4580
rsc = 000000000000000f bsp = 0000000102298338
bspstore = 0000000102298338 rnat = 0000000000000000
unat = 0000000000000000 pfs = c000000000000409
ccv = 0000000000000000 itc = 000e617a543eee34
lc = 0000000000000000
br0 = 20000000007be910 br1 = 0000000000000000
br2 = 0000000000000000 br3 = 0000000000000000
br4 = 0000000000000000 br5 = 0000000000000000
br6 = 20000000007be8a0 br7 = 20000000007a0570
psr = 0000020000000000 pred = 0000000005555a81
ip = 20000000007be554 cfm = c00000000000050c
intnat = 0000000000000000 fpsr = 0009804c8a74433f
Stack:
(* marks the word pointed to by the stack pointer)
0000000102316860: 0000000000000000* ffffffffffffffff 0000000000000000 0000000000000001
0000000102316880: 0000000000ed9650 0000000000000003 0000000000ed9650 0000000000000003
00000001023168a0: 6000000000cd5d90 0000000100000001 0000000000ed9650 0000000000000003
00000001023168c0: 0000000000ed9650 0000000000000003 0000000000000000 2000000000aac380
00000001023168e0: 6000000000cd5d90 0000000100000001 0000000000000000 0000000100000001
0000000102316900: 2000000000aab8a0 0000000102316900 0000000000000000 0000000000000000
Register stack:
(* marks the word pointed to by BSP)
00000001022983b0: 0000000102315ce8 c000000000000510 2000000000844000 2000000000a03ef8
0000000102298390: 60000000000d2590 0000000102315ce0 c000000000000003 a0000000000107e0
0000000102298370: 0000000000000000 0000000102315d30 60000000000d26d0 60000000000d2590
0000000102298350: 2000000000a03ef8 0000000102315e00 0000000102315d80 000000000000000b*
0000000102298330: 0000000103c00028 000000001be85b00 c000000000000409 20000000007be910
0000000102298310: 00000001046ab150 00000001046aafe8 00000001046ab0e8 2000000000a03ef8
Code:
(* marks the word pointed to by the instruction pointer)
20000000007be4f0: 00e0119822000009 000400000020303c 0000119824380010 48ffff7000000200
20000000007be510: 0240210341013800 9000001460420004 00e021024161280b 000400000020209c
20000000007be530: 40e039861c003811 420001b003420083 02a010181c01080a 0004000000420084
20000000007be550: 022010184200700a* 0004000000203038 0000000100000011 58cfcb1800000200
20000000007be570: 0010210041407000 8401300540420090 02b021004461100a 0004000000203038
20000000007be590: 0000000100000011 58fff44800000200 8110210341609800 840d048200420880
Loaded modules:
(* denotes the module causing the exception)
4000000000000000-400000000001c3d7 /app1/was/bea/jrockit81sp5_142_16/bin/java
a000000000010000-a0000000000109cf /app1/was/bea/jrockit81sp5_142_16/bin/java
2000000000054000-20000000000fcf5f /lib/tls/libm.so.6.1
2000000000110000-2000000000113d6f /lib/libdl.so.2
2000000000128000-2000000000146d27 /lib/tls/libpthread.so.0
2000000000160000-20000000003b0b97 /lib/tls/libc.so.6.1
2000000000000000-200000000002ca97 /lib/ld-linux-ia64.so.2
20000000003e0000-200000000098b077 */app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/jrockit/libjvm.so
2000000000ad0000-2000000000ae1a0f /lib/tls/librt.so.1
0000000000ca0000-0000000000cb4d57 /lib/libnss_files.so.2
0000000000ccc000-0000000000cea3c7 /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/libverify.so
0000000010d08000-0000000010d56ea7 /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/libjava.so
0000000010d7c000-0000000010da33df /lib/libnsl.so.1
00000001020f0000-00000001021001c7 /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/native_threads/libhpi.so
0000000102030000-000000010204eff7 /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/libzip.so
00000001024d8000-00000001024ebf87 /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/libjmapi.so
0000000014d40000-0000000014d60fdf /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/libnet.so
00000000153b0000-00000000153b390f /app1/was/bea/weblogic81/server/lib/linux/ia64/libweblogicunix1.so
00000000186f0000-00000000186f9e97 /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/libnio.so
0000000019250000-0000000019256a97 /app1/was/bea/jrockit81sp5_142_16/jre/lib/ia64/libioser12.so
0000000103144000-00000001031486e7 /supp1/pkg/jennifer/agent32/jni/linux/libjennifer20.so
0000000103160000-000000010316602f /lib/libnss_dns.so.2
0000000103178000-000000010319860f /lib/libresolv.so.2
0000000103964000-0000000103965477 /supp1/supp/common/libSliService.so
0000000104a00000-0000000104b6d24f /supp1/pkg/secui/lib/sli_domain/pcms_server/libJniTrustNet.so
0000000105108000-000000010510be37 /usr/lib/gconv/EUC-KR.so
0000000105120000-000000010512aa4f /usr/lib/gconv/libKSC.so
Roots Dump Helper:
NOTE: Dump Helper crashed and was aborted
Scan Dump Helper:
Processing references from a Thread Stack Roots workchunk, with data: 0x6000000000cd5d90.
The thread being processed has tid 23756 and name "ExecuteThread: '20' for queue: ".
No objIter registered, this is probably a root reference.
"(GC Worker Thread 2)" id=? idx=0x14 tid=23643 lastJavaFrame=0xfffffffffffffffc
Stack 0: start=0x1022b8000, end=0x102318000, guards=0x102304000 (ok), forbidden=0x1022fc000
Stack 1: start=0x102298000, end=0x1022b8000, guards=0x1022ac000 (ok), forbidden=0x1022b4000
Thread Stack Trace:
at triWorkChunkIteratorStep+465()@0x20000000007be551
at triWorkChunkIteratorGetNext+112()@0x20000000007be910
at ycProcessWorkChunk+272()@0x200000000086ea10
at ycWorkerProcessRoots+352()@0x2000000000871720
at mmGCWorkerThread+448()@0x2000000000544f30
at tsiCallStartFunction+48()@0x2000000000649c50
at tsiThreadStub+320()@0x200000000064bcc0
at ptiThreadStub+80()@0x2000000000745660
at start_thread+352()@0x20000000001317f0
at __clone2+208()@0x20000000002fc890
-- Java stack --
Extended, platform specific info:
libc release: 2.3.4-stable
Elf headers:
libc ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 50 V: 1 ENTRY: 00000000000296a0 PHOFF: 0000000000000040 SHOFF: 0000000000261cb0 EF: 0x10 HS: 64 PS: 56 PHN; 9 SS: 64 SHN: 67 STIDX: 64
libpthread ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 50 V: 1 ENTRY: 00000000000078e0 PHOFF: 0000000000000040 SHOFF: 00000000000215b0 EF: 0x10 HS: 64 PS: 56 PHN; 8 SS: 64 SHN: 36 STIDX: 33
libjvm ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 50 V: 1 ENTRY: 0000000000072660 PHOFF: 0000000000000040 SHOFF: 000000000062ac70 EF: 0x10 HS: 64 PS: 56 PHN; 4 SS: 64 SHN: 25 STIDX: 22
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================

* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
**********************************************************

Similar Messages

BEA JRockit(R) R27.3.1-1-solaris-sparcv9 crashed

Hi, This happens in solaris sparc machine. Please find the dmp below, could anyone shed some lights on this issue, please?
Error Message: Illegal memory access. [54]
Signal info : si_signo=10, si_code=3 si_addr=0xffffffff76a08000
Version : BEA JRockit(R) R27.3.1-1-85830-1.5.0_11-20070716-1248-solaris-sparcv9
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#0.
: YC is not running. Last finished YC was YC#0.
YC History : Ran 0 YCs since last OC.
Heap : 0x1700000 - 0x5700000
Compaction : (no compaction area)
NurseryList : 0x1700000 - 0x3700000
KeepArea : (no keeparea in use)
NurseryMarker: [ 0x26ffff0, 0x2efffe8 ]
CompRefs : References are compressed.
<Nov 26, 2007 3:23:40 PM> <Debug> <NodeManager> <Waiting for the process to die: 4083>
<Nov 26, 2007 3:23:40 PM> <Info> <NodeManager> <Server failed during startup so will not be restarted>
<Nov 26, 2007 3:23:40 PM> <Debug> <NodeManager> <runMonitor returned, setting finished=true and notifying wai
ters>
Thanks
Tamil

Solaris installation provides only the details I have pasted already. I dont see the core details. However, I was able to reproduce the problem in windows 64 bit machine. Here is the core details.
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:03:36 on Tue Dec 04 20:44:05 2007
Additional information is available in:
c:\CT\dev\am\test\cases\wls\jrockit.3684.dump
c:\CT\dev\am\test\cases\wls\jrockit.3684.mdmp
If you see this dump, please open a support case with BEA and
supply as much information as you can on your system setup and
the program you were running. You can also search for solutions
to your problem at http://forums.bea.com in
the forum jrockit.developer.interest.general.
Error Message: Illegal memory access. [54]
Exception Rec: EXCEPTION_ACCESS_VIOLATION (00000000c0000005) at 0x000007FF7FC52B00 - memory at 0x0000000000000000 could not be written.
Minidump : Wrote mdmp. Size is 133MB
SafeDllMode : -1
Version : BEA JRockit(R) R27.3.1-1-85830-1.5.0_11-20070716-1248-windows-x86_64
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#145.
: YC is not running. Last finished YC was YC#51.
OC History : Strategy genparpar was used for OC#137.
: Strategy singleparpar was used for OC#138.
: Strategy genparpar was used for OC#139 to OC#140.
: Strategy singleparpar was used for OC#141.
: Strategy genparpar was used for OC#142 to OC#145.
YC History : Ran 0 YCs before OC#141.
: Ran 9 YCs before OC#142.
: Ran 1 YCs before OC#143.
: Ran 10 YCs before OC#144.
: Ran 20 YCs before OC#145.
: Ran 2 YCs since last OC.
Heap : 0x0000000010500000 - 0x0000000011E29000
Compaction : 0x00000000109B7B00 - 0x0000000010B9D200
NurseryList : 0x0000000010B8C180 - 0x000000001189CF78
KeepArea : 0x0000000011384B10 - 0x00000000116BCC40
NurseryMarker: [ 0x0000000011384B10, 0x00000000116BCC40 ]
CompRefs : References are compressed.
CPU : Intel Core SSE SSE2 SSE3 SSSE3 Core EM64T
Number CPUs : 1
Tot Phys Mem : 2184585216 (2083 MB)
OS version : Microsoft Windows Server 2003 version 5.2 Service Pack 1 (Build 3790) (64-bit)
Thread System: Windows Threads
State : JVM is running
Command Line : -Dbasedir=c:\CT\dev\am\test\cases\wls -Dims.test.wsdl.validate= -Dims.test.wsdl.validate.exclude=com.rsa.configuration.,com.rsa.authmgr.admin.configuration. -Dam.admin.seedfile.path=../test/config/kh0701.xml -Dam.admin.seedfile.password= -Dims.toplevel.dir=c:\CT\dev\am\test\cases\wls/../../.. -Djava.naming.factory.initial=weblogic.jndi.WLInitialContextFactory -Djava.naming.provider.url=t3s://am-install-w64.das.na.rsa.net:7002/ -Dims.test.admin.login=admin -Dims.test.admin.password=password -Dims.test.admin.ldap=false -Dims.test.admin.activedomain=ims.000000000000000000001000e0011000 -Dam.test.output.debug=false -Dam.test.config.dir.path=../test/config/ -Dam.test.seedfile.name=tknseed_fob_5.xml -Dam.test.64bit.seedfile.name=ENG0103_1_TOKEN.XML -Dam.test.level2=false -Djava.net.preferIPv4Stack=true -Dam.test.server.ipaddress=127.0.0.1 -Dam.test.nodesecret.search=false -Dam.test.nodesecret.path= -DSDCONF_LOC=../test/config/agent_autoreg/sdconf.rec -DSDNDSCRT_LOC=../test/config/agent_autoreg/securid -DSDSTATUS_LOC=../test/config/agent_autoreg/JAStatus.1 -DRSA_LOG_LEVEL=OFF -Dam.install=true -Dam.console.ssl=false -Dims.test.admin.password.install=5uperMan! -Dam.test.ctkip.seedfile.name=tknseed_software.xml -Dtest.ctkip.client_hello.xml=../test/config/ctkip/clienthellopdu.xml -Dam.test.token.import.nickname.seedfile.name=qa_sidsoft_nn.xml -Dam.test.token.import.nicknameserialnum.seedfile.name=qa_sidsoft_nnsn.xml -Dam.test.token.import.serialnum.seedfile.name=qa_sidsoft_sn.xml -Dtest.ctkip.client_provisioning_data=../test/config/ctkip/provisioningData.xml -Dtest.ctkip.client_nonce.xml=../test/config/ctkip/clientnoncepdu.xml -Dam.test.ldap=false -Dam.test.oa.client.type=lac -Dam.test.oa.dac.domain=SID4WIN -Dam.test.oa.run=false -Dam.test.oa.dps.ipaddress=127.0.0.1 -Dam.test.oa.dah.ipaddress=10.104.102.224 -Dam.test.output.debug.prependDate=false -Dam.test.oa.dah.nodesecret.export.path=. -Dam.test.cluster.primary.membernode.hostname.1=w2k3-qa-clstr2 -Dam.test.cluster.primary.membernode.hostname.2=w2k3-qa-clstr3 -Dam.test.cluster.primary.leadernode.hostname=w2k3-qa-clstr1 -Dam.test.cluster.primary.nodes=2 -Dam.test.cluster=false -Dproperties.directory=c:/opt/rsa/am-326425/utils/etc -Djava.library.path.systemtools= -Dbea.home=c:\CT\dev\am\test\cases\wls -Dweblogic.security.TrustKeyStore=CustomTrust -Dweblogic.security.CustomTrustKeyStoreFileName=c:/opt/rsa/am-326425/appserver/jdk/jre/lib/security/cacerts -Dssl.debug= -Dweblogic.StdoutDebugEnabled= -Dims.test.ldap.isAD=false -Dtest.level=1 -Dtest.cluster=false -Dtest.oa=false -Dtest.installer=false -Dtest.runbug=false -Dtest.admin.username=admin -Dtest.admin.password=5uperMan! -Dtest.replicas.count=0 -Dtest.ids.target=SystemIS -Dtest.realm.target=SystemDomain -Dtest.internalids.name=SystemIS -Dtest.systemdomain.name=SystemDomain -Dtest.config.dir=../test/config/ -Dtest.ns.dir=c:\CT\dev\am\test\cases\wls/../../../test/cases/wls/target -Dtest.trust.enabled=false -Dtest.trust.internalids.name=SystemIS -Dtest.trust.systemdomain.name=SystemDomain -Dtest.trust.admin.username=admin -Dtest.trust.admin.password=password -Dtest.trust.cmdclient.username=CmdClient -Dtest.trust.cmdclient.password=password -Dtest.trust.naming.factory.initial=weblogic.jndi.WLInitialContextFactory -Dtest.trust.naming.provider.url=t3://ims0.na.rsa.net:7001/ -Dam.test.config.migration.dir.path=../test/config/migration/6.1/ -Dam.test.config.migration.ldap.name=LDAP-STORE -Dims.test.admin.ldap=false -Dims.test.ldap.isAD=false -Dam.test.config.migration.ldap.enabled= -Dims.test.ldap.url=ldap://blah.na.rsa.net:389/ -Dims.test.ldap.username=uid=admin,ou=Administrators,ou=TopologyManagement,o=NetscapeRoot -Dims.test.ldap.password=adminadmin -Dtest.ids.target.ldap.url=ldap://blash.na.rsa.net:289 -Dtest.ids.target.ldap.username=uid=admin,ou=Administrators,ou=TopologyManagement,o=NetscapeRoot -Dtest.ids.target.ldap.password=adminadmin -Dhttp.keepAlive=true -Dhttp.maxConnections=5 -Dtest.cmdclient.username=CmdClient_45b0ormy -Dtest.cmdclient.password=Gy0SGr5mSH -Dtest.node1.provider.url= -Dtest.node2.provider.url= -Dtest.replica1.provider.url= -Dtest.replica2.provider.url= -Dtest.replica1.cmdclient.username=CmdClient -Dtest.replica1.cmdclient.password=password -Dtest.replica2.cmdclient.username=CmdClient -Dtest.replica2.cmdclient.password=password -Dtest.method= -Dsun.java.launcher=SUN_STANDARD org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner testsfile=C:\CT\dev\am\test\cases\wls\junittestcases198292503.properties filtertrace=true haltOnError=false haltOnFailure=false formatter=org.apache.tools.ant.taskdefs.optional.junit.SummaryJUnitResultFormatter showoutput=false formatter=org.apache.tools.ant.taskdefs.optional.junit.XMLJUnitResultFormatter,C:\CT\dev\am\test\cases\wls\target\test-reports\IGNORETHIS.xml formatter=org.apache.tools.ant.taskdefs.optional.junit.BriefJUnitResultFormatter propsfile=C:\CT\dev\am\test\cases\wls\junit533938511.properties
java.home : C:\opt\rsa\am-326425\appserver\jdk\jre
j.class.path : C:\CT\dev\am\test\cases\wls\target\test-classes;C:\CT\dev\am\test\cases\wls\target\classes;C:\Documents and Settings\Administrator\.maven\repository\hibernate\jars\hibernate-ejb-persistence-3.2.2.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\weblogic-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\oracle-jdbc\jars\ojdbc14-10.2.0.2.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\framework-common.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\framework-config.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\admin-am.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\radius-core.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\radius-am.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\eap32.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\adjudicator.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\core-api.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\samples.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\common-am.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\amtcgen.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\oa.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\token-transport.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\auth-method-am.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\activity-monitor.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\migration61.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\sms-admin.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\test-command.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\ct-kip.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\cases.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\ims-client.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\ims-server.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\test-command.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\lw-agent.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\liberty.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\systemfields.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\wsapi.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\clu-common.jar;C:\Documents and Settings\Administrator\.maven\repository\altova-xmlspy\jars\xmlspy-schema-2006-sp2.jar;C:\Documents and Settings\Administrator\.maven\repository\caucho\jars\hessian-3.0.19rsa-1.jar;C:\Documents and Settings\Administrator\.maven\repository\httpunit\jars\httpunit-1.6.jar;C:\Documents and Settings\Administrator\.maven\repository\junit\jars\junit-3.8.2.jar;C:\Documents and Settings\Administrator\.maven\repository\jline\jars\jline-0.9.91rsa-1.jar;C:\Documents and Settings\Administrator\.maven\repository\log4j\jars\log4j-1.2.11rsa-2.jar;C:\Documents and Settings\Administrator\.maven\repository\nekohtml\jars\nekohtml-0.7.7.jar;C:\Documents and Settings\Administrator\.maven\repository\jdom\jars\jdom-1.0.jar;C:\Documents and Settings\Administrator\.maven\repository\rsa-bsafe\jars\jsafe-3.6.jar;C:\Documents and Settings\Administrator\.maven\repository\rsa-bsafe\jars\jsafeJCE-3.6.jar;C:\Documents and Settings\Administrator\.maven\repository\rsa-bsafe\jars\sslj-4.1.6.3.jar;C:\Documents and Settings\Administrator\.maven\repository\rsa-bsafe\jars\rsajsse-4.1.6.3.jar;C:\Documents and Settings\Administrator\.maven\repository\rsa-bsafe\jars\certj-2.1.1.jar;C:\Documents and Settings\Administrator\.maven\repository\auth-elements\jars\tcgen-2.0.1-beta.jar;C:\Documents and Settings\Administrator\.maven\repository\commons-beanutils\jars\commons-beanutils-1.7.0.jar;C:\Documents and Settings\Administrator\.maven\repository\commons-collections\jars\commons-collections-3.0.jar;C:\Documents and Settings\Administrator\.maven\repository\commons-httpclient\jars\commons-httpclient-3.0.1.jar;C:\Documents and Settings\Administrator\.maven\repository\commons-logging\jars\commons-logging-1.0.4.jar;C:\Documents and Settings\Administrator\.maven\repository\jargs\jars\jargs-1.0.jar;C:\Documents and Settings\Administrator\.maven\repository\commons-lang\jars\commons-lang-2.2.jar;C:\Documents and Settings\Administrator\.maven\repository\commons-io\jars\commons-io-1.2.jar;C:\Documents and Settings\Administrator\.maven\repository\axis\jars\axis-1.3.jar;C:\Documents and Settings\Administrator\.maven\repository\jaxrpc\jars\jaxrpc-1.2.jar;C:\Documents and Settings\Administrator\.maven\repository\wsdl4j\jars\wsdl4j-1.5.1.jar;C:\Documents and Settings\Administrator\.maven\repository\commons-discovery\jars\commons-discovery-0.2.jar;C:\Documents and Settings\Administrator\.maven\repository\axis\jars\axis-saaj-1.3.jar;C:\Documents and Settings\Administrator\.maven\repository\springframework\jars\spring-2.0.7.jar;C:\Documents and Settings\Administrator\.maven\repository\rsa-aceagent_sdk\jars\authapi-internal-5.0.3.jar;C:\Documents and Settings\Administrator\.maven\repository\rsa-ctkip\jars\ctkip-toolkit-1.2.126.jar;C:\Documents and Settings\Administrator\.maven\repository\ims-soyuz-cd6p1\jars\dataManager.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\am-dataManager.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\aceclntjni.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\sidauthjni.jar;C:\Documents and Settings\Administrator\.maven\repository\easymock\jars\easymock-2.2.jar;C:\Documents and Settings\Administrator\.maven\repository\easymock\jars\easymockclassextension-2.2.jar;C:\Documents and Settings\Administrator\.maven\repository\am-326425\jars\aceclntjni-oo.jar;C:\Documents and Settings\Administrator\.maven\repository\ognl\jars\ognl-2.6.7.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\webservices-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\weblogic-domain-binding-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\weblogic-container-binding-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\diagnostics-binding-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\diagnostics-image-binding-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\wlxbean-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\wlw-langx-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javelinx-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\wlManagementImplSource-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\wlManagementMBean-10.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.antlr.runtime-2.7.5.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\org.apache.ant.patch-1.6.5.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.bcel-5.2.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.repackaged.apache.bcel-5.2.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.commons.collections-3.2.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.commons.lang-2.1.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.commons.pool-1.3.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.dom-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.logging-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\org.apache.openjpa-0.9.7.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.xml.security-1.3.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.xml.xmlbeans-2.2.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.logging-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.bea.opensaml-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.xml.staxb.buildtime-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.xml.staxb.runtime-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.annogen-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.kodo-4.1.3.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.kodo.integration-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.kodo.integration.tools-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.process-5.3.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.xml.beaxmlbeans-2.2.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.repackaged.aspectj.aspectjweaver-5.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.repackaged.apache.commons.logging-1.1.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.repackaged.springframework.spring-2.0.2.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.repackaged.springframework.pitchfork-1.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.common.engine.impl-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.common.engine.api-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.common.security.api-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.common.security.impl-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.common.security.jdkutils-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.common.security.utils-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.common.security.providers.utils-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.common.security.providers.env-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.commons.net-1.4.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\glassfish.el-2.1.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\glassfish.jaxb-2.0.5.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\glassfish.jaxws.resolver-2.0.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\glassfish.jaxws.rt-2.0.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\glassfish.jaxws.saaj.impl-2.0.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\glassfish.jaxws.sjsxp-2.0.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\glassfish.jaxws.tools-2.0.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\glassfish.stax.ex-1.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\glassfish.xmlstreambuffer-0.1.117.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.oro-2.0.8.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.activation-1.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.annotation-1.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.interceptor-1.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.ejb-3.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.jdo-2.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.enterprise.deploy-1.2.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.jms-1.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.jsp-2.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.jws-2.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.mail-1.4.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.management.j2ee-1.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.persistence-1.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.resource-1.5.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.servlet-2.5.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.transaction-1.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.xml.bind-2.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.xml.soap-1.3.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.xml.stream-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.xml.ws-2.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\javax.xml.rpc-1.1.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache.log4j-1.2.13.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\monfox.dsnmp.agent-4.6.5.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.jsafe-3.5.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.serp-1.12.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.apache-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.beangen-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.beaninfo-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.datasource-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.descriptor-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.repackaged.asm-1.5.2.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.diagnostics.core-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.diagnostics.instrumentor-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.i18n-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.i18n.generator-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.management.core-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.mbean.maker-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.mbean.support-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.messaging.kernel-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.resourcepool-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.weblogic.rmi.client-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.weblogic.security.wls-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.weblogic.saaj-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.weblogic.stax-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.store-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.store.gxa-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.transaction-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.utils.full-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.utils.classloaders-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.utils.expressions-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.utils.wrapper-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.timers-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.weblogic.workmanager-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.workarea-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.jatmi-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.weblogic.security-2.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.nodemanager.plugin-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\weblogic\jars\com.bea.core.jmspool-1.0.0.0.jar;C:\Documents and Settings\Administrator\.maven\repository\emma\jars\emma-2.0.5312.jar;C:\Documents and Settings\Administrator\.maven\repository\emma\jars\emma_ant-2.0.5312.jar;C:\Documents and Settings\Administrator\.maven\repository\rsa\jars\maven-rsa-ext-1.1.jar;C:\Documents and Settings\Administrator\.maven\repository\xdoclet\jars\xdoclet-xdoclet-module-1.2.3.jar;C:\Documents and Settings\Administrator\.maven\repository\clover\jars\clover-1.3.13.jar;C:\Documents and Settings\Administrator\.maven\repository\clover\jars\cenquatasks-1.3.14.jar;C:\Documents and Settings\Administrator\.maven\repository\xjavadoc\jars\xjavadoc-1.5-snapshot050611.jar;C:\Documents and Settings\Administrator\.maven\repository\xdoclet\jars\xdoclet-1.2.3.jar;C:\Documents and Settings\Administrator\.maven\repository\hibernate\jars\hibernate-3.2.2.jar;C:\Documents and Settings\Administrator\.maven\repository\hibernate\jars\hibernate-annotations-3.2.1.jar;C:\Documents and Settings\Administrator\.maven\repository\antlr\jars\antlr-2.7.6.jar;C:\Documents and Settings\Administrator\.maven\repository\iscreen\jars\iScreen-1-1-0rsa-1.jar;C:\Documents and Settings\Administrator\.maven\repository\iscreen\jars\iScreen-mvel-1-1-0rsa-1.jar;C:\Documents and Settings\Administrator\.maven\repository\iscreen\jars\mvel-1.1.8-java1.5.0_10.jar;C:\Documents and Settings\Administrator\.maven\repository\asm\jars\asm-1.5.3.jar;C:\Documents and Settings\Administrator\.maven\repository\cglib\jars\cglib-2.1_3.jar;C:\Documents and Settings\Administrator\.maven\repository\odmg\jars\odmg-3.0.jar;C:\Documents and Settings\Administrator\.maven\repository\dom4j\jars\dom4j-1.6.1.jar;C:\Documents and Settings\Administrator\.maven\repository\xerces\jars\xercesImpl-2.7.1.jar;C:\Documents and Settings\Administrator\.maven\repository\xml-apis\jars\xml-apis-1.3.02.jar;C:\Documents and Settings\Administrator\.maven\repository\hsqldb\jars\hsqldb-1.7.2.4.jar;C:\Documents and Settings\Administrator\.maven\repository\opensymphony-oscache\jars\oscache-2.3.2rsa-1.jar;C:\Documents and Settings\Administrator\.maven\repository\j2ee\jars\j2ee-1.5.jar;C:\Documents and Settings\Administrator\.maven\repository\xml-apis\jars\xml-apis-1.3.03.jar;C:\Documents and Settings\Administrator\.maven\repository\xerces\jars\xercesImpl-2.8.0.jar;C:\Documents and Settings\Administrator\.maven\repository\xml-resolver\jars\xml-resolver-1.1.jar;C:\CT\library\apache-maven\1.1\lib\ant-launcher-1.6.5.jar;C:\CT\library\apache-maven\1.1\lib\ant-1.6.5.jar;C:\CT\library\apache-maven\1.1\lib\ant-junit-1.6.5.jar
j.lib.path : C:\opt\rsa\am-326425\appserver\jdk\jre\bin;.;C:\WINDOWS\system32;C:\WINDOWS;c:\opt\rsa\am-326425\appserver\jdk\jre\bin;c:\opt\instantclient_10_2;C:\cygwin\bin;c:\CT\library\apache-maven\1.1\bin;c:\CT\library\activetcl\8.4.11\linux-x86\bin;C:\cygwin\bin;C:\cygwin\bin;C:\cygwin\usr\local\bin\;C:\cygwin\usr\sbin;c:\opt\instantclient_10_2;C:\cygwin\bin;c:\CT\library\apache-maven\1.1\bin;c:\CT\library\activetcl\8.4.11\linux-x86\bin;C:\cygwin\bin;C:\cygwin\bin;C:\cygwin\usr\local\bin\;C:\cygwin\usr\sbin;c:\opt\rsa\am-325621\db\bin;c:\opt\rsa\am-325471\db\bin;c:\opt\rsa\am-325281\db\bin;c:\opt\rsa\am-325250\db\bin;c:\opt\rsa\am-325240\db\bin;c:\opt\rsa\am-324877\db\bin;c:\opt\rsa\am-324751\db\bin;c:\opt\rsa\am-324743\db\bin;c:\opt\rsa\am-324632\db\bin;c:\opt\rsa\am-324516\db\bin;c:\opt\rsa\am-324412\db\bin;c:\opt\rsa\am-324131\db\bin;c:\opt\rsa\am-das-323485\db\bin;c:\opt\rsa\am-das-323453\db\bin;c:\opt\rsa\am-das-323386\db\bin;c:\opt\rsa\am-das-323315\db\bin;c:\opt\rsa\am-das-323052\db\bin;c:\opt\rsa\am-das-322733\db\bin;c:\opt\rsa\am-das-322676\db\bin;c:\opt\rsa\am-das-322622\db\bin;c:\opt\rsa\am-das-322471\db\bin;c:\opt\rsa\am-das-322445\db\bin;c:\opt\rsa\am-das-322264\db\bin;c:\opt\rsa\am-das-321939\db\bin;c:\opt\rsa\am-das-321144\db\bin;c:\opt\rsa\am-321052\db\bin;c:\opt\rsa\am-321006\db\bin;c:\opt\rsa\am-320711\db\bin;c:\opt\rsa\am-320613\db\bin;c:\opt\rsa\am-320550\db\bin;c:\opt\rsa\am-320535\db\bin;c:\opt\rsa\am-320466\db\bin;c:\WINDOWS\system32;c:\WINDOWS;c:\WINDOWS\System32\Wbem;C:\cygwin\bin
JAVA_HOME : c:\opt\rsa\am-326425\appserver\jdk

JRockit Release R27.6.3 - Corrected bugs

related to my previous post,
i would like to know which are the corrected bugs in this JRockit release ?
JLM

Here is the list of fixed issues in R27.6.3. Please note that R27.6.1 and R27.6.2 was internal releases only.
http://download.oracle.com/docs/cd/E13150_01/jrockit_jvm/jrockit/releases/R27/relnotes/r27_notes.html#wp1039507

Deploying 570 beans crashes bea

Hi guys
The situation is that we have 270 tables in the databse, and for each table we
have a CMP entity bean and a stateful bean.
We put the entity beans into a jar and the session beans into another jar.
We define two EJB applications, one for every jar (we have tried the alternative
of putting the jars into an ear but the behaviour and the error is the same).
We deploy the jars as follows:
- we deploy first the CMPs than the Sessions (it deploys all the CMPs and lets
say 100 sessions from 270 - i do not know exact the number, I just want to describe
the propotions)
- we deploy the Sessions first, then the CMP( it deploys all the sessions, and
about 200 CMPs from the 270)
BEA crashes with "Exception in thread main" and no other message. The verbosity
level in on INFO(the most detailed).
I mave hade no settings regarding the cache settings for the beans.
I have tried both on Windows(Pentium III 1000MHz 380MB) and Unix(Pentium III ~700
MHz - 512MB). My hunch is that somehow it runs out of memory, although it is hard
to belive that considering the configurations.
It remains the fact that the provided exception gives no details
about the cause of th error.
Is there a setting for this that we are not aware of?
Is there a limit in the number of beans to be deployed to BEA?
Besides these 540 beans we will have more for the business logic.
Thanx

Hi.
Have you tried changing your JVM heap size from the default of 64Mb? What happens when
you set it to 128 or 256?
I think you may be on the right track in that WLS may be running out of memory - heap
in this case. When the jvm runs out of memory it is in an unstable situation - you may
get an OutOfMemory exception, or it may just shut down as you are seeing.
Regards,
Michael
poc wrote:
Hi guys
The situation is that we have 270 tables in the databse, and for each table we
have a CMP entity bean and a stateful bean.
We put the entity beans into a jar and the session beans into another jar.
We define two EJB applications, one for every jar (we have tried the alternative
of putting the jars into an ear but the behaviour and the error is the same).
We deploy the jars as follows:
- we deploy first the CMPs than the Sessions (it deploys all the CMPs and lets
say 100 sessions from 270 - i do not know exact the number, I just want to describe
the propotions)
- we deploy the Sessions first, then the CMP( it deploys all the sessions, and
about 200 CMPs from the 270)
BEA crashes with "Exception in thread main" and no other message. The verbosity
level in on INFO(the most detailed).
I mave hade no settings regarding the cache settings for the beans.
I have tried both on Windows(Pentium III 1000MHz 380MB) and Unix(Pentium III ~700
MHz - 512MB). My hunch is that somehow it runs out of memory, although it is hard
to belive that considering the configurations.
It remains the fact that the provided exception gives no details
about the cause of th error.
Is there a setting for this that we are not aware of?
Is there a limit in the number of beans to be deployed to BEA?
Besides these 540 beans we will have more for the business logic.
Thanx--
Michael Young
Developer Relations Engineer
BEA Support

Random Weblogic startup crash

Hi,
We just migrated our test/prod environments to a new host, OS platform, from Windows Server 2003 R2 to Windows Server 2008 R2, using weblogic 10 MP1 with jrockit-R27.5.0-jdk1.5.0_14.
On the new host (on Win 2008), randomly the weblogic start crashes, with the following dump (this never happened on Win 2003). After a restart or two everything is OK.
The cmdline for start weblogic is:
-cmdline:"-jrockit -Xms1024m -Xmx1024m -Xmanagement -Djrockit.managementserver.port=8051 -XXcompressedrefs=false -Dweblogic.security.SSL.ignoreHostnameVerification
=true -Dweblogic.log.Log4jLoggingEnabled=true -javaagent:"c:\Java\jrebel.jar" -Drebel.log4j-plugin=true -noverify -classpath \".\lib\antlr-2.7.6.jar;.\lib\hzi-config.jar;.\lib\log4j-.2.8.jar;.\lib\jasperreports-3.7.6.jar;.\lib\commons-digester-1.6.jar;.\lib\commons-collections-3.2.jar;.\lib\commons-logging-1.1.jar;.\lib\commons-beanutils-1.7.0.jar;.\lib\iText-2.1.0.jar;.\lib\poi-3.6.jar;.\lib\commons-validator-1.3.0.jar;.\lib\commons-lang-2.4.jar;d:\bea100\patch_wls1001\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\Java\jrockit-R27.5.0-jdk1.5.0_14\lib\tools.jar;D:\bea100\WLSERV~1.0\server\lib\weblogic_sp.jar;D:\bea100\WLSERV~1.0\server\lib\weblogic.jar;d:\bea100\modules\features\weblogic.server.modules_10.0.1.0.jar;d:\bea100\modules\features\com.bea.cie.common-plugin.launch_2.1.2.0.jar;D:\bea100\WLSERV~1.0\server\lib\webservices.jar;d:\bea100\modules\ORGAPA~1.5/lib/ant-a
ll.jar;d:\bea100\modules\NETSFA~1.0/lib/ant-contrib.jar;D:\bea100\WLSERV~1.0\server\lib\wllog4j.jar;;\lib\logformatter.jar\" -Dweblogic.Name=DirectServer -Dweblogic.management.username=testdc-Dweblogic.ProductionModeEnabled= -Djava.security.policy=\"D:\bea100\WLSERV~1.0\server\lib\weblogic.policy\" weblogic.Server" -log:".\servers\DirectServer\logs\stdout.log
Please advice on how to proceed.
Thanks and regards
Elod, Software developer
The dump is:
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:01:57 on Wed Jun 27 02:20:16 2012
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
c:\nightlybuild\nextPatch_webconnect\dc\src\jrockit.9916.dump
c:\nightlybuild\nextPatch_webconnect\dc\src\jrockit.9916.mdmp
Error Message: Illegal memory access. [54]
Exception Rec: EXCEPTION_ACCESS_VIOLATION (00000000c0000005) at 0x000000001DD4E3D8 - memory at 0x000000001DD4E3D8 could not be written.
Minidump : Wrote mdmp. Size is 572MB
SafeDllMode : -1
Version : BEA JRockit(R) R27.5.0-110_o-99226-1.5.0_14-20080528-1505-windows-x86_64
GC Strategy : Mode: throughput. Currently using strategy: singleparpar
GC Status : OC is not running. Last finished OC was OC#87.
: YC is not running. Last finished YC was YC#264.
OC History : Strategy singleparpar was used for OC#73.
: Strategy genparpar was used for OC#74 to OC#79.
: Strategy singleparpar was used for OC#80.
: Strategy genparpar was used for OC#81 to OC#86.
: Strategy singleparpar was used for OC#87.
YC History : Ran 2 YCs before OC#83.
: Ran 1 YCs before OC#84.
: Ran 1 YCs before OC#85.
: Ran 0 YCs before OC#86.
: Ran 0 YCs before OC#87.
: Ran 0 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x0000000010500000 - 0x0000000026CFD000 (Size: 359 MB)
Compaction : 0x0000000010500000 - 0x0000000011B7FD00 (Current compaction type: internal)
CompRefs : References are compressed, with heap base 0x0.
CPU : AMD Opteron QC/Phenom SSE SSE2 SSE3 SSE4A EM64T
Number CPUs : 8
Tot Phys Mem : 68718944256 (65535 MB)
OS version : Microsoft Windows "Longhorn" version 6.1 Service Pack 1 (Build 7601) (64-bit)
Thread System: Windows Threads
Java locking : Normal
State : JVM is running
Command Line : -Xmx512m -Dsun.java.launcher=SUN_STANDARD weblogic.appc d:\bea100\user_projects\domains\NextPatchDirectDomain\applications/Direct.ear
java.home : C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre
j.class.path : d:\bea100\wlserver_10.0\server\lib\weblogic.jar;d:\bea100\wlserver_10.0\server\lib\wllog4j.jar;d:\bea100\wlserver_10.0\server\lib\webservices.jar;C:\Java\jrockit-R27.5.0-jdk1.5.0_14\lib\tools.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\commons-collections-2.0.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\commons-logging.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\log4j.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\xdoclet-1.2.3.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\xdoclet-bea-module-1.2.3.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\xdoclet-ejb-module-1.2.3.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\xdoclet-jmx-module-1.2.3.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\xdoclet-web-module-1.2.3.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\xdoclet-xdoclet-module-1.2.3.jar;c:\nightlybuild\nextPatch_webconnect\dc\tools\lib\xdoclet\xjavadoc-1.1.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\ant-contrib-1.0b3.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\antlr-2.7.6.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\asm-attrs.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\asm.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\cglib-2.1.3.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\commons-codec-1.3.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\commons-httpclient-3.0.1.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\commons-logging-1.1.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\dozer-4.0-HZI.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\ehcache-1.2.3.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\ftp4che-0.7.1.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\ftp4j-1.7.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\hibernate-annotations.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\hibernate-commons-annotations.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\hibernate-entitymanager.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\hibernate3.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\j2ssh-ant-0.2.9.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\j2ssh-common-0.2.9.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\j2ssh-core-0.2.9.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\j2ssh-daemon-0.2.9.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\javassist.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\jce-jdk13-119.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\jdom.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\jsch-0.1.42.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\log4j-1.2.8.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\objectprofiler.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\recaptcha4j-0.0.7.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\sevenzipjbinding-AllWindows.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\sevenzipjbinding.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\webservicetest.jar;c:\nightlybuild\nextPatch_webconnect\common\lib\xmlParserAPIs.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\activation.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\ant.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\aop\ant-1.5.2.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\aop\aspectwerkz-2.0.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\aop\aspectwerkz-core-2.0.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\aop\aspectwerkz-extensions-2.0.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\aop\aspectwerkz-jdk5-2.0.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\aop\dom4j-1.4.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\aop\jrexx-1.1.1.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\aop\trove-1.0.2.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\avalon.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\batik.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\carlsonContentBeans.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\castor-0.9.6-xml.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\commons-beanutils-1.7.0.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\commons-chain-1.1.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\commons-collections-3.2.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\commons-digester-1.6.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\commons-fileupload-1.1.1.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\commons-io-1.1.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\commons-lang-2.4.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\commons-validator-1.3.0.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\crimson.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\fastBookingContentBeans.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\flatpack-3.1.1.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\fop.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\hotusaContentBeans.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\htmlparser.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\hzi-config.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\hzi-dc-aop.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\i18n.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\iText-2.1.0.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\icu4j_3_4_4.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jasperreports-3.7.6.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jaxb-api.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jaxb-impl.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jaxb-xjc.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jaxp.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jaxws-api.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jaxws-rt.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jaxws-tools.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jsr173_api.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jsr181-api.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jtidy.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\jxl.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\logformatter.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\operaBeans.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\poi-3.6.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\poi-ooxml-3.6.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\poi-ooxml-schemas-3.6.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\saaj-api.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\saaj-impl.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\saxon8.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\serviceshutdown.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\sjsxp.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\slf4j-api-1.1.0-RC1.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\slf4j-simple-1.1.0-RC1.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\slide-webdavlib.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\sqlServerDriverWrapper.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\sqljdbc.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\stax-ex.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\streambuffer.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\supranationalContentBeans.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\test\junit.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\test\junitee-anttask.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\test\junitee.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\trustInternationalContentBeans.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\webservices-ota-hotelcontent.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\webservices-travelportcontent.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\wlDCAuthProvider.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\wsibeans.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\xerces.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\xml-apis.jar;c:\nightlybuild\nextPatch_webconnect\dc\lib\xmlbeans-2.3.0.jar
j.lib.path : C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin;.;C:\Windows\system32;C:\Windows;C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin;C:\apache-ant-1.7.0\bin;d:\bea100\wlserver_10.0\server\bin;C:\Java\jrockit-R27.5.0-jdk1.5.0_14\bin;C:\Program Files (x86)\Mail Enable\BIN;C:\Program Files\CollabNet\Subversion Client;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;c:\cygwin\bin;c:\Java\jdk150_11\bin;C:\Program Files\System Center Operations Manager 2007\;C:\Program Files\TortoiseSVN\bin;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files (x86)\Microsoft Visual Studio 9.0\Common7\IDE\PrivateAssemblies\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;c:\apache-ant-1.7.0\bin;c:\Program Files\7-Zip;C:\Program Files (x86)\Mail Enable\BIN64;C:\Program Files\SourceGear\Common\DiffMerge\
JAVA_HOME : C:\Java\jrockit-R27.5.0-jdk1.5.0_14
_JAVA_OPTIONS: <not set>
PATH : C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin;C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin;C:\apache-ant-1.7.0\bin;d:\bea100\wlserver_10.0\server\bin;C:\Java\jrockit-R27.5.0-jdk1.5.0_14\bin;C:\Program Files (x86)\Mail Enable\BIN;C:\Program Files\CollabNet\Subversion Client;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;c:\cygwin\bin;c:\Java\jdk150_11\bin;C:\Program Files\System Center Operations Manager 2007\;C:\Program Files\TortoiseSVN\bin;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files (x86)\Microsoft Visual Studio 9.0\Common7\IDE\PrivateAssemblies\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;c:\apache-ant-1.7.0\bin;c:\Program Files\7-Zip;C:\Program Files (x86)\Mail Enable\BIN64;C:\Program Files\SourceGear\Common\DiffMerge\
C Heap : Good; no memory allocations have failed
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x00000000061C9B70 / OS context: 0x00000000061CA350):
rax = 0000000000088d6d rcx = 000000001dd4e550
rdx = 0000000000000000 rbx = 000000001dd4e560
rsp = 00000000061ca910 rbp = 0000000011449c18
rsi = 000000001dd4e540 rdi = 000000001b95c008
r8 = 000000001dd4ea10 r9 = 00000000771dd870
r10 = 00000000048be300 r11 = 0000000000000000
r12 = 000000001dd4e988 r13 = 0000000000000003
r14 = 000000000000000e r15 = 0000000000000000
cs = 0000000000000033 fs = 0000000000000053
gs = 000000000000002b
rip = 000000001dd4e3d8 flags = 0000000000010213
Stack:
(* marks the word pointed to by the stack pointer)
00000000061ca910: 0000000012e5f7e8* 00000000309a7550 0000000012e5f7e8 0000000030581549
00000000061ca930: 000000001dd4e298 0000000030581535 0000000000000000 000000000000000a
00000000061ca950: 000000001dd4e298 00000000048be300 00000000111addd8 00000000309a7550
00000000061ca970: 00000000132187a8 00000000309a7508 00000000111addd8 0000000030a47da7
00000000061ca990: 0000000035df6354 000000001dd4e3d8 000000001dd4e580 00000000309ef726
00000000061ca9b0: 000000001dd4e3d8 0000000000000001 000000001dd4e580 00000000309d7d89
Code:
(* marks the word pointed to by the instruction pointer)
000000001dd4e378: 0000000078f8a110 10f28b2800000000 0000000078f88ba0 1dd4e3781dd4e378
000000001dd4e398: 0000000078f8a110 11406c3000000000 0000000078f88ba0 1dd4e3981dd4e398
000000001dd4e3b8: 0000000078f8a110 1333083000000000 0000000078f88ba0 1dd4e3b81dd4e3b8
000000001dd4e3d8: 0000000078f250d0* 000000001dd4e3e8 0000000000c8c8a0 0000000000000000
000000001dd4e3f8: 000000001dd4e420 0000000300000000 3f4000000000000c 1dd4e47000000003
000000001dd4e418: 0000000000000000 000000001046c5f0 0066006e00000010 0000000000000000
Loaded modules:
(* denotes the module causing the exception)
0000000000400000-0000000000414fff C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin\java.exe
0000000076f90000-0000000077138fff C:\Windows\SYSTEM32\ntdll.dll
0000000076e70000-0000000076f8efff C:\Windows\system32\kernel32.dll
000007fefcf90000-000007fefcffbfff C:\Windows\system32\KERNELBASE.dll
000007feff1c0000-000007feff29afff C:\Windows\system32\ADVAPI32.dll
000007fefd4d0000-000007fefd56efff C:\Windows\system32\msvcrt.dll
000007fefd580000-000007fefd59efff C:\Windows\SYSTEM32\sechost.dll
000007fefe000000-000007fefe12cfff C:\Windows\system32\RPCRT4.dll
0000000010000000-0000000010427fff C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin\jrockit\jvm.dll
000007fef30d0000-000007fef310afff C:\Windows\system32\WINMM.dll
0000000076d70000-0000000076e69fff C:\Windows\system32\USER32.dll
000007fefe130000-000007fefe196fff C:\Windows\system32\GDI32.dll
000007fefd570000-000007fefd57dfff C:\Windows\system32\LPK.dll
000007fefd890000-000007fefd958fff C:\Windows\system32\USP10.dll
000007fefdb70000-000007fefdbbcfff C:\Windows\system32\WS2_32.dll
000007fefe420000-000007fefe427fff C:\Windows\system32\NSI.dll
000007fefdfd0000-000007fefdffdfff C:\Windows\system32\IMM32.DLL
000007fefdea0000-000007fefdfa8fff C:\Windows\system32\MSCTF.dll
0000000077160000-0000000077166fff C:\Windows\system32\psapi.dll
000007fefcd40000-000007fefcd64fff C:\Windows\system32\SspiCli.dll
0000000000360000-0000000000370fff C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin\verify.dll
0000000000380000-00000000003abfff C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin\java.dll
0000000000c30000-0000000000c3afff C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin\hpi.dll
0000000001d60000-0000000001d75fff C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin\zip.dll
00000000039d0000-00000000039eafff C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin\net.dll
000007fefc710000-000007fefc764fff C:\Windows\system32\mswsock.dll
000007fefc2a0000-000007fefc2a6fff C:\Windows\System32\wshtcpip.dll
000007fefc6a0000-000007fefc6a6fff C:\Windows\System32\wship6.dll
000007fefb250000-000007fefb264fff C:\Windows\system32\NLAapi.dll
000007fefa680000-000007fefa694fff C:\Windows\system32\napinsp.dll
000007fefc570000-000007fefc5cafff C:\Windows\system32\DNSAPI.dll
000007fefa7a0000-000007fefa7aafff C:\Windows\System32\winrnr.dll
000007fefafc0000-000007fefafe6fff C:\Windows\system32\IPHLPAPI.DLL
000007fefaf80000-000007fefaf8afff C:\Windows\system32\WINNSI.DLL
000007fefa7b0000-000007fefa7b7fff C:\Windows\system32\rasadhlp.dll
000007fefae70000-000007fefaec2fff C:\Windows\System32\fwpuclnt.dll
0000000008760000-00000000088b9fff C:\Java\jrockit-R27.5.0-jdk1.5.0_14\jre\bin\dbghelp.dll
"Javelin Worker-4" id=21 idx=0x70 tid=26372 lastJavaFrame=0x0000000000000000
Stack 0: start=0x0000000006190000, end=0x00000000061D0000, guards=0x0000000006194000 (ok), forbidden=0x0000000006191000
Thread Stack Trace:
-- Java stack --
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================

googling around I found these options:
upgrade your JRockit (27 is fairly old)
use -Xverify:all flag
tweaking your gc parameters
change the classpath to remove unsupported versions of javax.xml.soap.SOAPPart
see:
http://satya-ghattu.blogspot.ch/2008/10/jrockit-error-message-illegal-memory.html
http://www.coderanch.com/t/425380/BEA-Weblogic/Weblogic-crash-after-Illegal-memory
http://objectmix.com/weblogic/528834-jrockit-r26-4-jdk1-5-illegal-memory-access.html

Out Of memory in prod

One of the prod clusters is running on below crashed both nodes with an out of memory exception which looks like below.
How do we get to know if the crash is due to a memory leak in the code or elsewhere?
Any inputs which helps to identify on the issue and submit data to application team supporting the need to update the systems is appreciated.
RHEL 4.6 on a 32 bit OS
BEA JRockit(R) R27.5.0
Below is the dump file generated when the JVM was crashed.
===== BEGIN DUMP =============================================================
JRockit dump produced after 21 days, 21:54:48 on Thu Aug 29 23:22:36 2013
    * If you see this dump, please go to                    *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information.                      *
Additional information is available in:
/wls_domains/prod_slimseu_wli_domain/jrockit.20717.dump
No snapshot file (core dump) will be created because core dumps have been
disabled. To enable core dumping, try "ulimit -c unlimited"
before starting JRockit again.
Error Message: Out of memory [68]
Signal info : si_signo=11, si_code=2 si_addr=(nil)
Fatal Error : Lock Iteration lockTokenIterInit src/jvm/code/runtime/refiter.c:233
Version      : BEA JRockit(R) R27.5.0-110_o-99226-1.5.0_14-20080528-1505-linux-ia32
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status    : OC is not running. Last finished OC was OC#6379.
             : YC is not running. Last finished YC was YC#46347.
OC History   : Strategy genparpar was used for OC#5680 to OC#5848.
             : Strategy singleparpar was used for OC#5849.
             : Strategy genparpar was used for OC#5850 to OC#6034.
             : Strategy singleparpar was used for OC#6035.
             : Strategy genparpar was used for OC#6036 to OC#6379.
YC History   : Ran 7 YCs before OC#6375.
             : Ran 6 YCs before OC#6376.
             : Ran 4 YCs before OC#6377.
             : Ran 7 YCs before OC#6378.
             : Ran 5 YCs before OC#6379.
             : Ran 0 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap         : 0x8100000 - 0x88100000 (Size: 2048 MB)
Compaction   : 0x80100000 - 0x88100000 (Current compaction type: external)
NurseryList : 0x6d634138 - 0x798afad0
KeepArea     : 0x79218a20 - 0x7c8122f0
NurseryMarker: [ 0x79218a20, 0x7c8122f0 ]
CompRefs     : References are 32-bit.
CPU          : Intel Core 2 SSE SSE2 SSE3 SSSE3 SSE4.1 EM64T
Number CPUs : 4
Tot Phys Mem : 21292417024 (20306 MB)
OS version   : Red Hat Enterprise Linux ES release 4 (Nahant Update 6)
Linux version 2.6.9-67.ELsmp ([email protected]) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-8)) #1 SMP Wed Nov 7 13:58:04 EST 2007 (i686)
Thread System: NPTL
Java locking : Normal
State        : JVM is running
Command Line : -Xms2048m -Xmx2048m -Xss=256k -da -Dplatform.home=/opt/bea922/aldsp301/weblogic92 -Dwls.home=/opt/bea922/aldsp301/weblogic92/server -Dwli.home=/opt/bea922/aldsp301/weblogic92/integration -Denvironment=prod -Dlog4j.configuration=file:/wls_domains/prod_slimseu_wli_domain/apacheLog4jCfg.xml -Dweblogic.management.discover=false -Dweblogic.management.server=http://meermin.european.idexxi.com:30050 -Dwlw.iterativeDev=false -Dwlw.testConsole=false -Dwlw.logErrorsToConsole=true -Dweblogic.ext.dirs=/opt/bea922/aldsp301/patch_weblogic922/profiles/default/sysext_manifest_classpath -Xverbose:gcreport,memdbg,gcpause -Xverboselog:/wls_logs/prod_slimseu_wli_domain/prod_slimseu_wli.gc -Duser.timezone=GMT -Dweblogic.Domain=prod_slimseu_wli_domain -Dweblogic.Name=prod_slimseu_wli_02 -Djava.security.policy=/opt/bea922/aldsp301/weblogic92/server/lib/weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home    : /opt/bea922/aldsp301/jrockit-R27.5.0/jre
j.class.path : /opt/bea922/aldsp301/aldsp_3.0/lib/binxml.jar:/opt/bea922/aldsp301/patch_weblogic922/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/opt/bea922/aldsp301/jrockit-R27.5.0/lib/tools.jar:/opt/bea922/aldsp301/weblogic92/server/lib/weblogic_sp.jar:/opt/bea922/aldsp301/weblogic92/server/lib/weblogic.jar:/opt/bea922/aldsp301/weblogic92/server/lib/webservices.jar::/opt/bea922/aldsp301/weblogic92/integration/lib/worklist-system-required.jar:/opt/bea922/aldsp301/weblogic92/server/lib/jpd.jar:/opt/bea922/aldsp301/weblogic92/integration/L10N:/opt/bea922/aldsp301/weblogic92/common/eval/pointbase/lib/pbclient51.jar:/opt/bea922/aldsp301/weblogic92/server/lib/xqrl.jar::
j.lib.path   : /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/jrockit:/opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386:/opt/bea922/aldsp301/jrockit-R27.5.0/jre/../lib/i386:/opt/bea922/aldsp301/patch_weblogic922/profiles/default/native:/opt/bea922/aldsp301/weblogic92/server/native/linux/i686:/opt/bea922/aldsp301/weblogic92/server/native/linux/i686/oci920_8
JAVA_HOME    : /opt/bea922/aldsp301/jrockit-R27.5.0
_JAVA_OPTIONS: <not set>
LD_LIBRARY_PATH: /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/jrockit:/opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386:/opt/bea922/aldsp301/jrockit-R27.5.0/jre/../lib/i386:/opt/bea922/aldsp301/patch_weblogic922/profiles/default/native:/opt/bea922/aldsp301/weblogic92/server/native/linux/i686:/opt/bea922/aldsp301/weblogic92/server/native/linux/i686/oci920_8
LD_ASSUME_KERNEL: <not set>
C Heap       : 1 memory allocations have failed
             : First failure was a mmMalloc of 20 bytes
             : Last failure was a mmMalloc of 20 bytes
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 3 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0xa96d4e94 / OS context: 0xa96d4f90):
   eax = 00001267    ecx = a96d520c    edx = 00000043    ebx = b7f5d74c
   esp = a96d5280    ebp = a96d5298    esi = 00000044    edi = a96d52e8
    es = 0000007b     cs = 00000073     ss = 0000007b     ds = 0000007b
    fs = 00000000     gs = 00000033
   eip = b7dabd55 eflags = 00000282
Stack:
(* marks the word pointed to by the stack pointer)
a96d5280: b7f72020* 00000200 b7f5d74c a96d52e8 a96d52e8 a96d52a4
a96d5298: a96d52b8 b7f258c4 00000044 b7f5d74c a96d52e8 a96d5310
a96d52b0: a96d5358 a96d5360 a96d52d8 b7f258ef 00000044 b7f5d74c
a96d52c8: a96d52e8 a96d5360 a96d5310 a96d5358 a96d52f8 b7ecee0a
Code:
(* marks the word pointed to by the instruction pointer)
b7dabd24: 4c892074 458b0824 2404c710 b7f72020 0c244489 000200b8
b7dabd3c: 24448900 92fae804 01b80017 a3000000 b7f72004 001267b8
b7dabd54: 0000a300* 04c70000 00003f24 9aeae800 768d0017 27bc8d00
b7dabd6c: 00000000 e589fc55 53c03157 b9e87d8d 00000004 00c0ec81
Loaded modules:
(* denotes the module causing the exception)
08048000-08056ff3 /opt/bea922/aldsp301/jrockit-R27.5.0/bin/java
0093f000-0094c85b /lib/tls/libpthread.so.0
00833000-00853c8f /lib/tls/libm.so.6
00858000-00859967 /lib/libdl.so.2
00705000-0082a578 /lib/tls/libc.so.6
006eb000-0070039b /lib/ld-linux.so.2
b7d16000-b7f6c6a7 */opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/jrockit/libjvm.so
00db2000-00db9a76 /lib/tls/librt.so.1
b7cdb000-b7cf9103 /lib/libnss_centrifydc.so.2
0099a000-009a8fef /lib/libresolv.so.2
00d76000-00d8866f /lib/libnsl.so.1
b7cd0000-b7cd8a57 /lib/libnss_files.so.2
b7be5000-b7bef81b /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libverify.so
b7bc2000-b7be2317 /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libjava.so
b6b1b000-b6b20f13 /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/native_threads/libhpi.so
b65ae000-b65bc4c4 /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libzip.so
b4e71000-b4e82f03 /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libnet.so
b4e69000-b4e6f207 /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libnio.so
b5f03000-b5f06313 /lib/libnss_dns.so.2
b3a6e000-b3a73246 /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libmanagement.so
b39e1000-b39ea357 /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libjmapi.so
b36d8000-b36d9de4 /opt/bea922/aldsp301/weblogic92/server/native/linux/i686/libwlfileio2.so
a59ed000-a5a4c026 /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libawt.so
a5926000-a59eb21f /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libmlib_image.so
a5920000-a5924f1c /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/headless/libmawt.so
a53f8000-a54710a7 /opt/bea922/aldsp301/jrockit-R27.5.0/jre/lib/i386/libfontmanager.so
"[ACTIVE] ExecuteThread: '25' fo" id=75 idx=0x128 tid=20894 lastJavaFrame=0xa96d54cc
Stack 0: start=0xa9698000, end=0xa96da000, guards=0xa969d000 (ok), forbidden=0xa969b000
Thread Stack Trace:
    at dumpForceDump+117()@0xb7dabd55
    at vmFatalErrorMsgV+84()@0xb7f258c4
    at vmFatalErrorMsg+31()@0xb7f258ef
    at fatalError+42()@0xb7ecee0a
    at lockTokenIterInit+151()@0xb7ecf317
    at trProcessLocksForThread+102()@0xb7edda26
    at get_all_locks+106()@0xb7df61ca
    at javalockConvertTokenForObject+74()@0xb7df83aa
    -- Java stack --
    at jrockit/vm/Locks.convertThinLockedToFatLocked(Ljava/lang/Object;)V(Native Method)
    at jrockit/vm/Locks.createMonitorAndConvert(Locks.java:1521)[inlined]
    at jrockit/vm/Locks.wait(Locks.java:2184)[inlined]
    at weblogic/rjvm/ResponseImpl.waitForData(ResponseImpl.java:81)[optimized]
    ^-- Holding lock: weblogic/rjvm/ResponseImpl@0x6daebaa8[thin lock]
    at weblogic/rjvm/ResponseImpl.getTxContext(ResponseImpl.java:108)[inlined]
    at weblogic/rjvm/BasicOutboundRequest.sendReceive(BasicOutboundRequest.java:109)[optimized]
    at weblogic/rmi/cluster/ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:335)[inlined]
    at weblogic/rmi/cluster/ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:252)[optimized]
    at com/bea/ld/Server_ydm4ie_EOImpl_1030_WLStub.executeOperationStreaming(Lcom/bea/dsp/ejb/QualName;[Ljava/lang/Object;Lcom/bea/ld/QueryAttributes;Lcom/bea/ld/filter/FilterXQuery;)Lcom/bea/dsp/ejb/StreamingQueryResult;(Unknown Source)[optimized]
    at com/bea/dsp/das/ejb/EJBClient.invokeOperation(EJBClient.java:148)[optimized]
    at com/bea/dsp/das/DataAccessServiceImpl.invokeOperation(DataAccessServiceImpl.java:171)[inlined]
    at com/bea/dsp/das/DataAccessServiceImpl.invoke(DataAccessServiceImpl.java:122)[inlined]
    at com/bea/dsp/control/core/delegates/impl/DSPControlInvocationDelegate.executeFunction(DSPControlInvocationDelegate.java:219)[inlined]
    at com/bea/dsp/control/core/delegates/impl/DSPControlInvocationDelegate.invokeOnDataService(DSPControlInvocationDelegate.java:64)[optimized]
    at com/bea/dsp/control/core/DSPControlImpl.invoke(DSPControlImpl.java:81)[optimized]
    at com/idexx/lims/controls/dsp/ResultsReportDSPControlFileBean.getPathEventTimeStampForDepartment(ResultsReportDSPControlFileBean.java:267)[optimized]
    at com/idexx/lims/orderresults/dao/OrderResultsDAOImpl.getPathEventTimeStampForDepartment(OrderResultsDAOImpl.java:109)[optimized]
    at com/idexx/lims/controls/OrderResultsCustomControlImpl.releaseResultsAndSaveReport(OrderResultsCustomControlImpl.java:360)[optimized]
    at com/idexx/lims/controls/OrderResultsCustomControlBean.releaseResultsAndSaveReport(OrderResultsCustomControlBean.java:440)[optimized]
    at sun/reflect/GeneratedMethodAccessor831.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)[optimized]
    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
    at java/lang/reflect/Method.invoke(Method.java:585)[optimized]
    at com/bea/wli/knex/runtime/jcs/container/JcsProxy.invokeBeehiveControl(JcsProxy.java:666)[optimized]
    at com/bea/wli/knex/runtime/jcs/container/JcsProxy.invoke(JcsProxy.java:433)[optimized]
    at $Proxy163.releaseResultsAndSaveReport(LorderResults/logical/orderResultsWs/ReleaseResultsAndSaveReportDocumentXmlBean;)LorderResults/logical/orderResultsWs/ReleaseResultsAndSaveReportResponseDocumentXmlBean;(Unknown Source)
    at com/idexx/lims/controls/process/OrderResultsProcess.orderResultsCustomControlReleaseResultsAndSaveReport(OrderResultsProcess.java:649)
    at sun/reflect/GeneratedMethodAccessor830.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)
    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
    at java/lang/reflect/Method.invoke(Method.java:585)[optimized]
    at com/bea/wli/bpm/runtime/Perform.invoke(Perform.java:39)[inlined]
    at com/bea/wli/bpm/runtime/Perform.execute(Perform.java:50)[optimized]
    at com/bea/wli/bpm/runtime/SyncReceive.messageDelivery(SyncReceive.java:63)[optimized]
    at com/bea/wli/bpm/runtime/ProcessState.processMessage(ProcessState.java:217)[optimized]
    at com/bea/wli/bpm/runtime/ProcessState.dispatchRequest(ProcessState.java:241)[inlined]
    at com/bea/wli/bpm/runtime/JpdContainer.dispatchProcessRequest(JpdContainer.java:1077)[optimized]
    at com/bea/wli/bpm/runtime/JpdContainer.preInvoke(JpdContainer.java:1041)[optimized]
    at com/bea/wli/knex/runtime/core/container/Invocable.invoke(Invocable.java:248)[optimized]
    at com/bea/wli/bpm/runtime/JpdContainer.invoke(JpdContainer.java:814)[optimized]
    at com/bea/wli/knex/runtime/core/bean/BaseContainerBean.invokeBase(BaseContainerBean.java:224)[optimized]
    at com/bea/wli/knex/runtime/core/bean/SLSBContainerBean.invoke(SLSBContainerBean.java:136)[optimized]
    at com/bea/wlwgen/StatelessContainer_2hozgx_ELOImpl.invoke(StatelessContainer_2hozgx_ELOImpl.java:137)[optimized]
    at com/bea/wlwgen/SLSBContAdpt.invokeOnBean(SLSBContAdpt.java:29)[optimized]
    at com/bea/wli/knex/runtime/core/bean/BaseDispatcherBean.runAsInvoke(BaseDispatcherBean.java:185)[optimized]
    at com/bea/wli/knex/runtime/core/bean/BaseDispatcherBean.invoke(BaseDispatcherBean.java:54)[optimized]
    at com/bea/wli/knex/runtime/core/bean/SyncDispatcherBean.invoke(SyncDispatcherBean.java:168)[optimized]
    at com/bea/wli/knex/runtime/core/bean/SyncDispatcher_k1mrl8_EOImpl.invoke(SyncDispatcher_k1mrl8_EOImpl.java:133)[optimized]
    at com/bea/wli/knex/runtime/core/dispatcher/Dispatcher.remoteDispatch(Dispatcher.java:165)[inlined]
    at com/bea/wli/knex/runtime/core/dispatcher/ServiceHandleImpl.invoke(ServiceHandleImpl.java:460)[optimized]
    at com/bea/wli/knex/runtime/core/call/JavaCall.invoke(JavaCall.java:56)[optimized]
    at com/bea/wli/bpm/runtime/SubFlowCall.invoke(SubFlowCall.java:112)[optimized]
    at com/bea/wli/knex/runtime/core/control/ServiceControlImpl.invoke(ServiceControlImpl.java:1307)[inlined]
    at com/bea/control/ProcessControlImpl.invoke(ProcessControlImpl.java:825)[optimized]
    at com/bea/wli/knex/runtime/core/control/ServiceControlImpl.invoke(ServiceControlImpl.java:1174)[optimized]
    at com/bea/control/ProcessControlImpl.invoke(ProcessControlImpl.java:760)[optimized]
    at com/idexx/lims/controls/process/OrderResultsProcessControlBean.releaseResultsClientRequestwithReturn(OrderResultsProcessControlBean.java:394)
    at sun/reflect/GeneratedMethodAccessor828.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)
    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
    at java/lang/reflect/Method.invoke(Method.java:585)[optimized]
    at com/bea/wli/knex/runtime/jcs/container/JcsProxy.invokeBeehiveControl(JcsProxy.java:666)[optimized]
    at com/bea/wli/knex/runtime/jcs/container/JcsProxy.invoke(JcsProxy.java:446)[optimized]
    at $Proxy171.releaseResultsClientRequestwithReturn(LorderResults/logical/orderResultsWs/ReleaseResultsAndSaveReportDocumentXmlBean;)LorderResults/logical/orderResultsWs/ReleaseResultsAndSaveReportResponseDocumentXmlBean;(Unknown Source)
    at com/idexx/lims/controls/process/OrderResultsProcess.orderResultsProcessControlReleaseResultsClientRequestwithReturn111(OrderResultsProcess.java:1686)[optimized]
    at sun/reflect/GeneratedMethodAccessor827.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)
    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
    at java/lang/reflect/Method.invoke(Method.java:585)[optimized]
    at com/bea/wli/bpm/runtime/Perform.invoke(Perform.java:39)[inlined]
    at com/bea/wli/bpm/runtime/Perform.execute(Perform.java:50)[optimized]
    at com/bea/wli/bpm/runtime/SyncReceive.messageDelivery(SyncReceive.java:63)[optimized]
    at com/bea/wli/bpm/runtime/ProcessState.processMessage(ProcessState.java:217)[optimized]
    at com/bea/wli/bpm/runtime/ProcessState.dispatchRequest(ProcessState.java:241)[inlined]
    at com/bea/wli/bpm/runtime/JpdContainer.dispatchProcessRequest(JpdContainer.java:1077)[optimized]
    at com/bea/wli/bpm/runtime/JpdContainer.preInvoke(JpdContainer.java:1041)[optimized]
    at com/bea/wli/knex/runtime/core/container/Invocable.invoke(Invocable.java:248)[optimized]
    at com/bea/wli/bpm/runtime/JpdContainer.invoke(JpdContainer.java:814)[optimized]
    at com/bea/wli/knex/runtime/core/bean/BaseContainerBean.invokeBase(BaseContainerBean.java:224)[optimized]
    at com/bea/wli/knex/runtime/core/bean/SLSBContainerBean.invoke(SLSBContainerBean.java:136)[optimized]
    at com/bea/wlwgen/StatelessContainer_2hozgx_ELOImpl.invoke(StatelessContainer_2hozgx_ELOImpl.java:137)[optimized]
    at com/bea/wlwgen/SLSBContAdpt.invokeOnBean(SLSBContAdpt.java:29)[optimized]
    at com/bea/wli/knex/runtime/core/bean/BaseDispatcherBean.runAsInvoke(BaseDispatcherBean.java:185)[optimized]
    at com/bea/wli/knex/runtime/core/bean/BaseDispatcherBean.invoke(BaseDispatcherBean.java:54)[optimized]
    at com/bea/wli/knex/runtime/core/bean/SyncDispatcherBean.invoke(SyncDispatcherBean.java:168)[optimized]
    at com/bea/wli/knex/runtime/core/bean/SyncDispatcher_k1mrl8_EOImpl.invoke(SyncDispatcher_k1mrl8_EOImpl.java:133)[optimized]
    at com/bea/wli/knex/runtime/core/dispatcher/Dispatcher.remoteDispatch(Dispatcher.java:165)[inlined]
    at com/bea/wli/knex/runtime/core/dispatcher/ServiceHandleImpl.invoke(ServiceHandleImpl.java:460)[optimized]
    at com/bea/wli/knex/runtime/core/call/JavaCall.invoke(JavaCall.java:56)[optimized]
    at com/bea/wli/bpm/runtime/SubFlowCall.invoke(SubFlowCall.java:112)[optimized]
    at com/bea/wli/knex/runtime/core/control/ServiceControlImpl.invoke(ServiceControlImpl.java:1307)[inlined]
    at com/bea/control/ProcessControlImpl.invoke(ProcessControlImpl.java:825)[optimized]
    at com/bea/wli/knex/runtime/core/control/ServiceControlImpl.invoke(ServiceControlImpl.java:1174)[optimized]
    at com/bea/control/ProcessControlImpl.invoke(ProcessControlImpl.java:760)[optimized]
    at com/idexx/lims/controls/process/OrderResultsProcessControlBean.releaseResultsToCustomer(OrderResultsProcessControlBean.java:677)[optimized]
    at sun/reflect/GeneratedMethodAccessor46336.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)
    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
    at java/lang/reflect/Method.invoke(Method.java:585)[optimized]
    at com/bea/wli/knex/runtime/jcs/container/JcsProxy.invokeBeehiveControl(JcsProxy.java:666)[optimized]
    at com/bea/wli/knex/runtime/jcs/container/JcsProxy.invoke(JcsProxy.java:446)[optimized]
    at $Proxy12611.releaseResultsToCustomer(LorderResults/logical/orderResultsWs/ReleaseResultsToCustomerDocumentXmlBean;)LorderResults/logical/orderResultsWs/ReleaseResultsToCustomerResponseDocumentXmlBean;(Unknown Source)
    at com/idexx/lims/processes/ReleaseResultsToCustomerProcess.sendReleaseRequest(ReleaseResultsToCustomerProcess.java:101)
    at sun/reflect/GeneratedMethodAccessor46335.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Unknown Source)
    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
    at java/lang/reflect/Method.invoke(Method.java:585)[optimized]
    at com/bea/wli/bpm/runtime/Perform.invoke(Perform.java:39)[inlined]
    at com/bea/wli/bpm/runtime/Perform.execute(Perform.java:50)[optimized]
    at com/bea/wli/bpm/runtime/Receive.messageDelivery(Receive.java:93)[optimized]
    at com/bea/wli/bpm/runtime/ProcessState.processMessage(ProcessState.java:217)[optimized]
    at com/bea/wli/bpm/runtime/ProcessState.dispatchRequest(ProcessState.java:241)[inlined]
    at com/bea/wli/bpm/runtime/JpdContainer.dispatchProcessRequest(JpdContainer.java:1077)[optimized]
    at com/bea/wli/bpm/runtime/JpdContainer.preInvoke(JpdContainer.java:1041)[optimized]
    at com/bea/wli/knex/runtime/core/container/Invocable.invoke(Invocable.java:248)[optimized]
    at com/bea/wli/bpm/runtime/JpdContainer.invoke(JpdContainer.java:814)[optimized]
    at com/bea/wli/knex/runtime/core/bean/BaseContainerBean.invokeBase(BaseContainerBean.java:224)[optimized]
    at com/bea/wli/knex/runtime/core/bean/SLSBContainerBean.invoke(SLSBContainerBean.java:136)[optimized]
    at com/bea/wlwgen/StatelessContainer_2hozgx_ELOImpl.invoke(StatelessContainer_2hozgx_ELOImpl.java:137)[optimized]
    at com/bea/wlwgen/SLSBContAdpt.invokeOnBean(SLSBContAdpt.java:29)[optimized]
    at com/bea/wli/knex/runtime/core/bean/BaseDispatcherBean.runAsInvoke(BaseDispatcherBean.java:185)[optimized]
    at com/bea/wli/knex/runtime/core/bean/BaseDispatcherBean.invoke(BaseDispatcherBean.java:54)[optimized]
    at com/bea/wli/knex/runtime/core/bean/AsyncDispatcherBean.onMessage(AsyncDispatcherBean.java:259)[optimized]
    at weblogic/ejb/container/internal/MDListener.execute(MDListener.java:429)[inlined]
    at weblogic/ejb/container/internal/MDListener.transactionalOnMessage(MDListener.java:335)[inlined]
    at weblogic/ejb/container/internal/MDListener.onMessage(MDListener.java:291)[optimized]
    at weblogic/jms/client/JMSSession.onMessage(JMSSession.java:4072)[optimized]
    at weblogic/jms/client/JMSSession.execute(JMSSession.java:3962)[optimized]
    at weblogic/jms/client/JMSSession$UseForRunnable.run(JMSSession.java:4490)[optimized]
    at weblogic/work/ServerWorkManagerImpl$WorkAdapterImpl.run(ServerWorkManagerImpl.java:518)[optimized]
    at weblogic/work/ExecuteThread.execute(ExecuteThread.java:209)[optimized]
    at weblogic/work/ExecuteThread.run(ExecuteThread.java:181)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
Extended, platform specific info:
libc release: 2.3.4-stable
Elf headers:
libc       ehdrs: EI: 7f454c46010101000000000000000000 ET: 3 EM: 3 V: 1 ENTRY: 00719ed0 PHOFF: 00000034 SHOFF: 00174ab8 EF: 0x0 HS: 52 PS: 32 PHN; 10 SS: 40 SHN: 67 STIDX: 66
libpthread ehdrs: EI: 7f454c46010101000000000000000000 ET: 3 EM: 3 V: 1 ENTRY: 00943850 PHOFF: 00000034 SHOFF: 00019f00 EF: 0x0 HS: 52 PS: 32 PHN; 9 SS: 40 SHN: 39 STIDX: 38
libjvm     ehdrs: EI: 7f454c46010101000000000000000000 ET: 3 EM: 3 V: 1 ENTRY: 0004bbe0 PHOFF: 00000034 SHOFF: 00297e24 EF: 0x0 HS: 52 PS: 32 PHN; 4 SS: 40 SHN: 19 STIDX: 16
    * If you see this dump, please go to                    *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information.                      *
===== END DUMP ===============================================================

Vicky77 wrote:
We are seeing memory leaks in our application, this is causing Out of Memory exception after every 5-7 days in prod environment. We tried to analyse our application with JPROBE and these are our findings...
1) Once these session is expiring, all application objects are getting garbage collected.
2) We are seeing huge increase in String and Char[] with each submitted applicationWhere are these coming from?
Are you using any libraries like JAXB? Are you binding XML to objects?
We are using Weblogic 10.0 with jdk version 1.5.0_06. Are there any known String related memory leak issues.
My understanding is that unless we are using any static variable or application scope objects we should have any memory leakage.Apparently not.
Can someone please validate if this understanding is correct? The JVM is telling you that it's incorrect. Believe the evidence you have before you.
Your JVM settings might help. What are the settings for the GC? How big is your perm space, and how is that changing with time?
What could be other possible causes of memory leaks? We are also using private static ThreadLocal variablesSounds like the perm space is exploding in size. It fills up and you're done.
I'd recommend that you download JVMStat from Sun and watch what memory is doing as you run your test. It's not a nice graphic view of eden, old & new gen, and perm spaces that will give you an idea of what's going on. It won't tell you why. Keep drilling down with JProbe.
%

Cannot start Weblogic 10.3 using JRockit-R27.5.0-jdk1.5.0_14

I'm having problems starting Weblogic Administration server. My setup is Oracle Enterprise Linux 5.0 64-bit on AMD platform. I've installed Weblogic 10.3 64bit and JRockit-R27.5.0-jdk1.5.0_14. When trying to start Weblogic within my domain by typing "./startWebLogic.sh" I get the following error:
JAVA Memory arguments: -Xms256m -Xmx512m
WLS Start Mode=Production
CLASSPATH=:/opt/bfapps/bea/patch_wls1030/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/opt/bfapps/bea/patch_cie660/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/opt/bfapps/bea/jrockit-R27.5.0-jdk1.5.0_14/lib/tools.jar:/opt/bfapps/bea/wlserver_10.3/server/lib/weblogic_sp.jar:/opt/bfapps/bea/wlserver_10.3/server/lib/weblogic.jar:/opt/bfapps/bea/modules/features/weblogic.server.modules_10.3.0.0.jar:/opt/bfapps/bea/wlserver_10.3/server/lib/webservices.jar:/opt/bfapps/bea/modules/org.apache.ant_1.6.5/lib/ant-all.jar:/opt/bfapps/bea/modules/net.sf.antcontrib_1.0.0.0_1-0b2/lib/ant-contrib.jar::/opt/bfapps/bea/wlserver_10.3/common/eval/pointbase/lib/pbclient57.jar:/opt/bfapps/bea/wlserver_10.3/server/lib/xqrl.jar::
PATH=/opt/bfapps/bea/wlserver_10.3/server/bin:/opt/bfapps/bea/modules/org.apache.ant_1.6.5/bin:/opt/bfapps/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/bin:/opt/bfapps/bea/jrockit-R27.5.0-jdk1.5.0_14/bin:/opt/bfapps/bea/jrockit-R27.5.0-jdk1.5.0_14/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/NX/bin:/usr/NX/bin:/home/jeff/bin:/usr/NX/bin:/usr/NX/bin
* To start WebLogic Server, use a username and *
* password assigned to an admin-level user. For *
* server administration, use the WebLogic Server *
* console at http://hostname:port/console *
starting weblogic with Java version:
java version "1.5.0_14"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_14-b03)
BEA JRockit(R) (build R27.5.0-110_o-99226-1.5.0_14-20080528-1505-linux-x86_64, compiled mode)
Starting WLS with line:
/opt/bfapps/bea/jrockit-R27.5.0-jdk1.5.0_14/bin/java -jrockit -Xms256m -Xmx512m -da -Dplatform.home=/opt/bfapps/bea/wlserver_10.3 -Dwls.home=/opt/bfapps/bea/wlserver_10.3/server -Dweblogic.home=/opt/bfapps/bea/wlserver_10.3/server -Dweblogic.management.discover=true -Dwlw.iterativeDev=false -Dwlw.testConsole=false -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=/opt/bfapps/bea/patch_wls1030/profiles/default/sysext_manifest_classpath:/opt/bfapps/bea/patch_cie660/profiles/default/sysext_manifest_classpath -Dweblogic.Name=Admin -Djava.security.policy=/opt/bfapps/bea/wlserver_10.3/server/lib/weblogic.policy weblogic.Server
<Jul 22, 2009 4:40:59 PM EDT> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with BEA JRockit(R) Version R27.5.0-110_o-99226-1.5.0_14-20080528-1505-linux-x86_64 from BEA Systems, Inc.>
<Jul 22, 2009 4:41:00 PM EDT> <Critical> <WebLogicServer> <BEA-000386> <Server subsystem failed. Reason: java.lang.UnsupportedClassVersionError: weblogic/jdbc/common/internal/ConnectionPool : unsupported classversion 50.0
java.lang.UnsupportedClassVersionError: weblogic/jdbc/common/internal/ConnectionPool : unsupported classversion 50.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:620)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
at java.net.URLClassLoader.access$100(URLClassLoader.java:56)
at java.net.URLClassLoader$1.run(URLClassLoader.java:195)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:164)
at weblogic.kernel.FinalThreadLocalList.initialize(FinalThreadLocalList.java:44)
at weblogic.t3.srvr.PreConfigBootService.start(PreConfigBootService.java:70)
at weblogic.t3.srvr.ServerServicesManager.startService(ServerServicesManager.java:459)
at weblogic.t3.srvr.ServerServicesManager.startInStandbyState(ServerServicesManager.java:164)
at weblogic.t3.srvr.T3Srvr.initializeStandby(T3Srvr.java:712)
at weblogic.t3.srvr.T3Srvr.startup(T3Srvr.java:486)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:440)
at weblogic.Server.main(Server.java:67)
>
<Jul 22, 2009 4:41:00 PM EDT> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FAILED>
<Jul 22, 2009 4:41:00 PM EDT> <Error> <WebLogicServer> <BEA-000383> <A critical service failed. The server will shut itself down>
<Jul 22, 2009 4:41:00 PM EDT> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FORCE_SHUTTING_DOWN>
I'm assuming I do not have my environment setup properly. Any ideas?
Thanks,
Jeff

WLS 10.3 and above require Java 1.6, and certain versions. It's recommend that you use one of the JVM's installed with the product. For 10.3, I think that is jdk160_05.

Slow startup CC&B 2.3.1

Anyone else out there seeing an extremely slow startup time with CC&B 2.3.1 (using RH Linux here, but have seen it on Windows servers as well, so I'm not so sure OS is really important here, but wanted to note it just in case).
It shows the following in weblogic_current.log, but I'm not seeing any errors. It just seems to HANG. Note the lengthy time lapse between the last few lines I've pasted below. It goes on just fine past this point and seems to start normally from there, but does a 4-5 minute time period seem realistic here? I've never seen this before with previous versions of CC&B so it has me scratching my chin. Thanks in advance for any input....
++ /opt/bea/jrockit/bin/java -Xms1024m -Xmx1024m -Dweblogic.security.SSL.trustedCAKeyStore=/spl/OSBDEV/product/bea/weblogic81/server/lib/cacerts -Dcom.sun.xml.namespace.QName.us$
<Apr 1, 2011 5:40:03 PM EDT> <Notice> <WebLogicServer> <BEA-000395> <Following extensions directory contents added to the end of the classpath:
/opt/bea/wlserver_10.0/platform/lib/p13n/p13n-schemas.jar:/opt/bea/wlserver_10.0/platform/lib/p13n/p13n_common.jar:/opt/bea/wlserver_10.0/platform/lib/p13n/p13n_system.jar:/opt/$
<Apr 1, 2011 5:40:03 PM EDT> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with BEA JRockit(R) Version R27.5.0-110_o-99226-1.5.0_14-20080528-1505-linux-x86_64 f$
<Apr 1, 2011 5:40:04 PM EDT> <Info> <Management> <BEA-141107> <Version: WebLogic Server 10.0 MP2 Sat Apr 25 01:45:38 EDT 2009 1213942 >
<Apr 1, 2011 5:44:11 PM EDT> <Info> <WebLogicServer> <BEA-000215> <Loaded License : /opt/bea/license.bea>
<Apr 1, 2011 5:44:11 PM EDT> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STARTING>

go with a higher RAM 4+ GB will instantly boost processing performance
Make sure the system is dedicated to run only ccb and no other things should affect ccb,hope this helps

JRockit crash : Version R27.5.0-110-94909-1.6.0_03-20080204-1558-windows-ia

I am consistently getting the following crash in R27.5.0-110-94909-1.6.0_03-20080204-1558-windows-ia. How do I report a JRockit bug?
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:01:45 on Wed Nov 05 12:40:25 2008
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
C:\Zorro\1\jrockit.3696.dump
C:\Zorro\1\jrockit.3696.mdmp
Error Message: Illegal memory access. [54]
Exception Rec: EXCEPTION_ACCESS_VIOLATION (c0000005) at 0x00525520 - memory at 0x00000000 could not be read.
Minidump : Wrote mdmp. Size is 169MB
SafeDllMode : -1
Version : BEA JRockit(R) R27.5.0-110-94909-1.6.0_03-20080204-1558-windows-ia32
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#11.
: YC is currently running. This is YC#587.
OC History : Strategy genparpar was used for OC#1 to OC#11.
YC History : Ran 61 YCs before OC#7.
: Ran 62 YCs before OC#8.
: Ran 131 YCs before OC#9.
: Ran 125 YCs before OC#10.
: Ran 4 YCs before OC#11.
: Started 100 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x00C00000 - 0x083F0000 (Size: 119 MB)
Compaction : 0x04C11418 - 0x05279600 (Current compaction type: external)
NurseryList : 0x029EC5A0 - 0x05B69028
KeepArea : 0x056F9340 - 0x05B69028
NurseryMarker: [ 0x04FB3A98, 0x056F9340 ]
CompRefs : References are 32-bit.
CPU : Intel Pentium 4 (HT) SSE SSE2 NetBurst
Number CPUs : 2
Tot Phys Mem : 3220680704 (3071 MB)
OS version : Microsoft Windows XP version 5.1 Service Pack 3 (Build 2600) (32-bit)
Thread System: Windows Threads
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -Xmx384m -Xverify -Dsun.java.launcher=SUN_STANDARD Test.jar ZKMTest1.txt
java.home : C:\JDK\jrockit1.6.0
j.class.path : TEST.jar
j.lib.path : C:\JDK\jrockit1.6.0\bin;.;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\system32\WBEM;C:\bat;C:\Program Files\Common Files\Autodesk Shared\;C:\Program Files\Common-Use Signing Interface\JRE\bin;C:\JDK\SunAppServer9\bin
JAVA_HOME : <not set>
JAVAOPTIONS: <not set>
PATH : C:\JDK\jrockit1.6.0\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\system32\WBEM;C:\bat;C:\Program Files\Common Files\Autodesk Shared\;C:\Program Files\Common-Use Signing Interface\JRE\bin;C:\JDK\SunAppServer9\bin
C Heap : Good; no memory allocations have failed
Method : com/zelix/gp.a(Ljava/lang/String;Ljava/util/Hashtable;)Ljava/util/Hashtable;
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x1A5CEA8C / OS context: 0x1A5CEE78):
eax = 1aa7e530 ecx = 00000000 edx = 00000025 ebx = 1b0f0210
esp = 1a5cf144 ebp = 1a5cf1b8 esi = 1b04fbd8 edi = 1aa821a8
es = 00000023 cs = 0000001b ss = 00000023 ds = 00000023
fs = 0000003b gs = 00000000
eip = 00525520 eflags = 00010202
Stack:
(* marks the word pointed to by the stack pointer)
1a5cf144: 1b0f0210* 00000007 00425bfa 1b0f0210 00000000 1b041c50
1a5cf15c: 000006b6 1b0f0210 00000001 1aa821a8 1beae028 1000073f
1a5cf174: 1b0f0210 1afb2ac8 1afb2acc 00000018 000006b8 00425ec5
1a5cf18c: 1a4bbf58 19ea381c 1a5cf360 1b0f0210 00000002 00000001
Code:
(* marks the word pointed to by the instruction pointer)
005254f0: c308408b cccccccc cccccccc cccccccc c304408b cccccccc
00525508: cccccccc cccccccc 0424448b e850076a fff88e34 10244c8b
00525520: 408b118b* 90048b0c c308c483 cccccccc 0424448b e850076a
00525538: fff88e14 10244c8b 408b118b 90048b10 c308c483 cccccccc
Loaded modules:
(* denotes the module causing the exception)
00400000-00410fff C:\JDK\jrockit1.6.0\bin\java.exe
7c900000-7c9aefff C:\WINDOWS\system32\ntdll.dll
7c800000-7c8f5fff C:\WINDOWS\system32\kernel32.dll
77dd0000-77e6afff C:\WINDOWS\system32\ADVAPI32.dll
77e70000-77f01fff C:\WINDOWS\system32\RPCRT4.dll
77fe0000-77ff0fff C:\WINDOWS\system32\Secur32.dll
77c10000-77c67fff C:\WINDOWS\system32\MSVCRT.dll
7c340000-7c395fff C:\JDK\jrockit1.6.0\bin\msvcr71.dll
00420000-006c3fff *C:\JDK\jrockit1.6.0\bin\jrockit\jvm.dll
76b40000-76b6cfff C:\WINDOWS\system32\WINMM.dll
77f10000-77f58fff C:\WINDOWS\system32\GDI32.dll
7e410000-7e4a0fff C:\WINDOWS\system32\USER32.dll
71ab0000-71ac6fff C:\WINDOWS\system32\WS2_32.dll
71aa0000-71aa7fff C:\WINDOWS\system32\WS2HELP.dll
76390000-763acfff C:\WINDOWS\system32\IMM32.DLL
629c0000-629c8fff C:\WINDOWS\system32\LPK.DLL
74d90000-74dfafff C:\WINDOWS\system32\USP10.dll
6d820000-6d82bfff C:\JDK\jrockit1.6.0\bin\verify.dll
6d460000-6d47efff C:\JDK\jrockit1.6.0\bin\java.dll
6d3c0000-6d3c7fff C:\JDK\jrockit1.6.0\bin\hpi.dll
6d860000-6d86efff C:\JDK\jrockit1.6.0\bin\zip.dll
76bf0000-76bfafff C:\WINDOWS\system32\psapi.dll
1bc20000-1bd32fff C:\JDK\jrockit1.6.0\bin\dbghelp.dll
"(Code Optimization Thread 1)" id=5 idx=0x1c tid=1196 lastJavaFrame=0xFFFFFFFC
Stack 0: start=0x1A590000, end=0x1A5D0000, guards=0x1A593000 (ok), forbidden=0x1A591000
Thread Stack Trace:
at _irBBGetLoopHeader+16()@0x00525520
at acMayHaveCausedExceptionpd+2954()@0x00425BFA
at acMayHaveCausedExceptionpd+3669()@0x00425EC5
at _optSSAStringAppend+114()@0x00426172
at _optmanOptimizeMIR+552()@0x0056FB48
at _cmgrGenerateMethodFromPhase+190()@0x0044B63E
at _cmgrGenerateNormalMethod+81()@0x0044C091
at _cmgrGenerateCode+157()@0x0044C97D
at _mtdQueuePrint+859()@0x0054060B
at _mtdQueuePrint+2018()@0x00540A92
-- Java stack --
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================

Thanks Staffan.
Can you please direct me to where I can get JRockit R27.6? I have spent hours trying to find it on the BEA and Oracle websites but always have ended up with links to either Oracle JRockit Mission Control 3.0.3 or Oracle JRockit Real Time 3.0 which is not what I need.
Looking ahead, does BEA still have "Evaluation Support"? I have been able to report a number of JRockit bugs in the past via this route but things appear to have changed.
Best regards,
Svet

JRockit Crash : R27.6.0-50_o-100423-1.6.0_05-20080626-2105-windows-ia32

I am still getting the following crash in the latest version of JRockit. I do not have a support contract. However, at http://e-docs.bea.com/jrockit/geninfo/diagnos/crash.html#wp1005354 it says "Note that *even if you do not have a Support contract with Oracle*, you should notify Oracle Support if you have encountered a problem in the JRockit JVM. This way, Oracle can make sure that the problem is fixed in the next release." How do I report this JRockit bug to Oracle Support? I have not been able to find any means of doing this. Please note that I have a self contained test case that reliably reproduces this crash.
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:00:16 on Mon Nov 10 14:36:43 2008
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
C:\Zorro\1\jrockit.2476.dump
C:\Zorro\1\jrockit.2476.mdmp
Error Message: Illegal memory access. [54]
Exception Rec: EXCEPTION_ACCESS_VIOLATION (c0000005) at 0x00525BE0 - memory at 0x00000000 could not be read.
Minidump : Wrote mdmp. Size is 99MB
SafeDllMode : -1
Version : BEA JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2105-windows-ia32
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#2.
: YC is currently running. This is YC#60.
OC History : Strategy genparpar was used for OC#1 to OC#2.
YC History : Ran 7 YCs before OC#1.
: Ran 24 YCs before OC#2.
: Started 29 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x00C00000 - 0x04C00000 (Size: 64 MB)
Compaction : 0x00C00000 - 0x01000000 (Current compaction type: internal)
NurseryList : 0x00ECA970 - 0x021BAAB0
KeepArea : 0x01860A90 - 0x01D0DA98
NurseryMarker: [ 0x01860A90, 0x01D0DA98 ]
CompRefs : References are 32-bit.
CPU : Intel Pentium 4 (HT) SSE SSE2 NetBurst
Number CPUs : 2
Tot Phys Mem : 3220680704 (3071 MB)
OS version : Microsoft Windows XP version 5.1 Service Pack 3 (Build 2600) (32-bit)
Thread System: Windows Threads
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -Xmx384m -Xverify -Dsun.java.launcher=SUN_STANDARD ZKM20081110.jar Test0.txt
java.home : C:\JDK\jrrt-3.0.0-1.6.0\jre
j.class.path : ZKM20081110.jar
j.lib.path : C:\JDK\jrrt-3.0.0-1.6.0\bin;.;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\system32\WBEM;C:\bat;C:\Program Files\Common Files\Autodesk Shared\;C:\Program Files\Common-Use Signing Interface\JRE\bin;C:\JDK\SunAppServer9\bin
JAVA_HOME : <not set>
JAVAOPTIONS: <not set>
PATH : C:\JDK\jrrt-3.0.0-1.6.0\jre\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\system32\WBEM;C:\bat;C:\Program Files\Common Files\Autodesk Shared\;C:\Program Files\Common-Use Signing Interface\JRE\bin;C:\JDK\SunAppServer9\bin
C Heap : Good; no memory allocations have failed
Method : jj.a(Ljava/lang/String;Ljava/util/Hashtable;)Ljava/util/Hashtable;
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x1A5CEA8C / OS context: 0x1A5CEE78):
eax = 1a992338 ecx = 00000000 edx = 00000005 ebx = 1a990210
esp = 1a5cf144 ebp = 1a5cf1b8 esi = 1a9a7cb0 edi = 1af92bc8
es = 00000023 cs = 0000001b ss = 00000023 ds = 00000023
fs = 0000003b gs = 00000000
eip = 00525be0 eflags = 00010202
Stack:
(* marks the word pointed to by the stack pointer)
1a5cf144: 1a990210* 00000007 00425d5a 1a990210 00000000 19fc5b28
1a5cf15c: 00000219 1a990210 00000001 1af92bc8 1af9d0f8 10000230
1a5cf174: 1a990210 19fc144c 19fc1450 0000001b 0000021b 00426025
1a5cf18c: 1a4bce38 19e8f0d4 1a5cf360 1a990210 00000002 00000001
Code:
(* marks the word pointed to by the instruction pointer)
00525bb0: c308408b cccccccc cccccccc cccccccc c304408b cccccccc
00525bc8: cccccccc cccccccc 0424448b e850076a fff88fb4 10244c8b
00525be0: 408b118b* 90048b0c c308c483 cccccccc 0424448b e850076a
00525bf8: fff88f94 10244c8b 408b118b 90048b10 c308c483 cccccccc
Loaded modules:
(* denotes the module causing the exception)
00400000-00410fff C:\JDK\jrrt-3.0.0-1.6.0\bin\java.exe
7c900000-7c9aefff C:\WINDOWS\system32\ntdll.dll
7c800000-7c8f5fff C:\WINDOWS\system32\kernel32.dll
77dd0000-77e6afff C:\WINDOWS\system32\ADVAPI32.dll
77e70000-77f01fff C:\WINDOWS\system32\RPCRT4.dll
77fe0000-77ff0fff C:\WINDOWS\system32\Secur32.dll
77c10000-77c67fff C:\WINDOWS\system32\MSVCRT.dll
7c340000-7c395fff C:\JDK\jrrt-3.0.0-1.6.0\jre\bin\msvcr71.dll
00420000-006c3fff *C:\JDK\jrrt-3.0.0-1.6.0\jre\bin\jrockit\jvm.dll
76b40000-76b6cfff C:\WINDOWS\system32\WINMM.dll
77f10000-77f58fff C:\WINDOWS\system32\GDI32.dll
7e410000-7e4a0fff C:\WINDOWS\system32\USER32.dll
71ab0000-71ac6fff C:\WINDOWS\system32\WS2_32.dll
71aa0000-71aa7fff C:\WINDOWS\system32\WS2HELP.dll
76390000-763acfff C:\WINDOWS\system32\IMM32.DLL
629c0000-629c8fff C:\WINDOWS\system32\LPK.DLL
74d90000-74dfafff C:\WINDOWS\system32\USP10.dll
6d820000-6d82bfff C:\JDK\jrrt-3.0.0-1.6.0\jre\bin\verify.dll
6d3c0000-6d3defff C:\JDK\jrrt-3.0.0-1.6.0\jre\bin\java.dll
6d320000-6d327fff C:\JDK\jrrt-3.0.0-1.6.0\jre\bin\hpi.dll
6d860000-6d86efff C:\JDK\jrrt-3.0.0-1.6.0\jre\bin\zip.dll
76bf0000-76bfafff C:\WINDOWS\system32\psapi.dll
1b8b0000-1b9c2fff C:\JDK\jrrt-3.0.0-1.6.0\jre\bin\dbghelp.dll
"(Code Optimization Thread 1)" id=5 idx=0x1c tid=3820 lastJavaFrame=0xFFFFFFFC
Stack 0: start=0x1A590000, end=0x1A5D0000, guards=0x1A593000 (ok), forbidden=0x1A591000
Thread Stack Trace:
at irBBGetLoopHeader+16(loops.c:57+4)@0x00525BE0
at create_set+266(append.c:419+10)@0x00425D5A
at create_chains+117(append.c:503+14)@0x00426025
at optSSAStringAppend+114(append.c:630+6)@0x004262D2
at optmanOptimizeMIR+552(optimizationmanager.c:510+0)@0x005700E8
at cmgrGenerateMethodFromPhase+190(codemanager.c:1107+94)@0x0044B75E
at cmgrGenerateNormalMethod+81(codemanager.c:773+0)@0x0044C1B1
at cmgrGenerateCode+157(codemanager.c:732+0)@0x0044CA9D
at generate_code2+187(methodaccess.c:735+14)@0x005410CB
at codegenThread+930(methodaccess.c:1096+13)@0x00541552
-- Java stack --
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================

Thank you for your reply. I have twice tried to e-mail the test case as requested. Once from my main account and once from a gmail.com account. Unfortunately I have received the following error message in both instances.
----- Transcript of session follows -----
... while talking to bigip-gmail-mail-rotor-adc.oracle.com.:
DATA<<< 550 5.7.1 Data command failed: Mail denied due to site's policy.
554 5.0.0 Service unavailable
Presumably there is some kind of SPAM filter at your end. Iis there another address to which I can send the test case?
Edited by: user10528330 on Nov 10, 2008 8:56 PM

JRockit R27.5 Crash

We have a crash with the Jrockit 1.5 R27.5 after a few minutes. The crash disappear when using -Xnoopt on the command line.
The optimizing compiler should be fixed.
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:08:38 on Tue Apr 22 15:33:00 2008
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
/opt/ciweb2g/applis/jrockit.6594.dump
No snapshot file (core dump) will be created because core dumps have been
disabled. To enable core dumping, try "ulimit -c unlimited"
before starting JRockit again.
Error Message: Illegal memory access. [54]
Signal info : si_signo=11, si_code=2 si_addr=(nil)
Version : BEA JRockit(R) R27.5.0-110-94909-1.5.0_14-20080204-1558-linux-x86_64
GC Strategy : Mode: static, with strategy: genconcon
GC Status : OC is not running. Last finished OC was OC#2.
: YC is not running. Last finished YC was YC#374.
YC History : Ran 166 YCs before OC#1.
: Ran 165 YCs before OC#2.
: Ran 43 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x2a95c00000 - 0x2b75c00000 (Size: 3584 MB)
Compaction : 0x2a95c00000 - 0x2aa3c00000 (Current compaction type: internal)
NurseryList : 0x2b53494300 - 0x2b5f081bf8
KeepArea : 0x2b59bd8a20 - 0x2b5c6a60a0
NurseryMarker: [ 0x2b5c6a60a0, 0x2b5c6a66a8 ]
CompRefs : References are uncompressed 64-bit.
CPU : Intel Core 2 SSE SSE2 SSE3 SSSE3 Core EM64T
Number CPUs : 4
Tot Phys Mem : 7299371008 (6961 MB)
OS version : Red Hat Enterprise Linux ES release 4 (Nahant Update 6)
Linux version 2.6.9-67.0.7.ELsmp ([email protected]) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-9)) #1 SMP Wed Feb 27 04:47:23 EST 2008 (x86_64)
Thread System: NPTL
Java locking : Normal
State : JVM is running
Command Line : -Xbootclasspath/a:/opt/ciweb2g/applis/current/lib/mysql-connector-java-3.1.14.jar -Xbootclasspath/a:/opt/ciweb2g/applis/current/conf -Xbootclasspath/a:/opt/ciweb2g/applis/reference -Xbootclasspath/a:/opt/ciweb2g/applis/current/config -Djavax.xml.transform.TransformerFactory=org.apache.xalan.processor.TransformerFactoryImpl -Xmanagement:port=7091,ssl=false,authenticate=false -Djrockit.lockprofiling=true -Xms3584m -Xmx3584m -XlargePages -XXcompressedRefs=0 -Xgc:gencon -Xns160m -Xverify:none -XXexitOnOutOfMemory -XXnoSystemGC -Xverbose:compaction -XverboseLog:/opt/ciweb2g/applis/current/logs/gc.log -Dorg.apache.commons.logging.Log=org.apache.commons.logging.impl.Jdk14Logger -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/opt/ciweb2g/applis/current/conf/logging.properties -Djava.endorsed.dirs=/opt/ciweb2g/products/apache-tomcat-5.5.23/common/endorsed -Dcatalina.base=/opt/ciweb2g/applis/current -Dcatalina.home=/opt/ciweb2g/products/apache-tomcat-5.5.23 -Djava.io.tmpdir=/opt/ciweb2g/applis/current/temp -Dsun.java.launcher=SUN_STANDARD org.apache.catalina.startup.Bootstrap start
java.home : /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre
j.class.path : :/opt/ciweb2g/products/apache-tomcat-5.5.23/bin/bootstrap.jar:/opt/ciweb2g/products/apache-tomcat-5.5.23/bin/commons-logging-api.jar
j.lib.path : /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/home/opj73was/PACK_AE/lib_ext
JAVA_HOME : /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14
JAVAOPTIONS: <not set>
LD_LIBRARY_PATH: /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/home/opj73was/PACK_AE/lib_ext
LD_ASSUME_KERNEL: <not set>
C Heap : Good; no memory allocations have failed
Method : fr/pagesjaunes/commun/base/impl/SBInscriptionPubliciteImpl.processModuleRappelGratuit(Lfr/pagesjaunes/commun/base/impl/ContexteTraitementModuleGraphique;Lfr/pagesjaunes/commun/metier/inscription/Inscription;)V
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x401ce250 / OS context: 0x401ce310):
rax = 0000002b85800300 rcx = 000000000000000d
rdx = 00000000000000b4 rbx = 0000000000000000
rsp = 00000000401ce750 rbp = 00000000401ce760
rsi = 0000000000000007 rdi = 0000002b857f3408
r8 = 0000002b859c91c8 r9 = 0000000000000001
r10 = 00000000b3cfa6f6 r11 = 0000000000567b92
r12 = 00000000401ce840 r13 = 0000002b857f3408
r14 = 000000000049cef8 r15 = 0000002b859cada0
cs = 0000000000000071 fs = 0000000400000000
gs = 0004000000000000
rip = 0000002a95692bc5 flags = 0000000000000202
Stack:
(* marks the word pointed to by the stack pointer)
00000000401ce750: 0000002b859153c0* 0000002b85915690 00000000401ce7e0 0000002a955a78d8
00000000401ce770: 00000001100000d5 0000002b85926b48 0000002b857f3408 0000002b8592d640
00000000401ce790: 0000002b8592d660 0000000000000028 00000000000000e8 0000002a956895b2
00000000401ce7b0: 00000000401ce840 0000002b85929cd0 00000000401ce840 00000000000000e7
00000000401ce7d0: 0000002b857f3408 0000000000000003 00000000401ce940 0000002a955a7bb1
00000000401ce7f0: 00000000401ce840 00000000401ce838 000000038590d1b0 0000002b859cf248
Code:
(* marks the word pointed to by the instruction pointer)
0000002a95692b60: a47d83c774c085ff 4ca8758d48157400 48000907d9e8f789 00064e18e8a87d8b
0000002a95692b80: ffff69d6e8e7894c 0002be0d74ff8545 73d2e8f7894c0000 c48348f88944fff9
0000002a95692ba0: 5e415d415c415b38 e5894855c3c95f41 f85d894810ec8348 00000007bef38948
0000002a95692bc0: 48138bfff972fae8* 481850034803e2c1 c3c9f85d8b48028b 10ec8348e5894855
0000002a95692be0: bef38948f85d8948 f972cee800000007 4803e2c148138bff 8b48028b48205003
0000002a95692c00: e5894855c3c9f85d f85d894810ec8348 00000007bef38948 48138bfff972a2e8
Loaded modules:
(* denotes the module causing the exception)
0000000000400000-000000000041196b /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/bin/java
00000036ac400000-00000036ac40f179 /lib64/tls/libpthread.so.0
00000036ac000000-00000036ac08459b /lib64/tls/libm.so.6
00000036ac200000-00000036ac201c73 /lib64/libdl.so.2
00000036abd00000-00000036abe2ba79 /lib64/tls/libc.so.6
00000036abb00000-00000036abb1480f /lib64/ld-linux-x86-64.so.2
0000002a95564000-0000002a9580748f */opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit/libjvm.so
00000036adb00000-00000036adb0895a /lib64/tls/librt.so.1
0000002b7da0c000-0000002b7da15f03 /lib64/libnss_files.so.2
0000002b7db77000-0000002b7db83467 /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libverify.so
0000002b7dc86000-0000002b7dca921b /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libjava.so
00000036acc00000-00000036acc140eb /lib64/libnsl.so.1
0000002b81e90000-0000002b81e9663f /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/native_threads/libhpi.so
0000002b84de0000-0000002b84dedd93 /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libzip.so
0000002a95abd000-0000002a95ace5cf /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libnet.so
0000002b84f24000-0000002b84f2a5db /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libnio.so
0000002b8502c000-0000002b8503118b /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libmanagement.so
0000002b88200000-0000002b8820096b /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/librmi.so
0000002b88401000-0000002b8840963f /opt/ciweb2g/products/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libjmapi.so
"(Code Optimization Thread 1)" id=5 idx=0x24 tid=6602 lastJavaFrame=0xfffffffffffffffc
Stack 0: start=0x401ae000, end=0x401d0000, guards=0x401b3000 (ok), forbidden=0x401b1000
Thread Stack Trace:
at irBBGetLoopHeader+25()@0x2a95692bc5
at create_set+229()@0x2a955a78d8
at create_chains+161()@0x2a955a7bb1
at optSSAStringAppend+95()@0x2a955a7f05
at optmanOptimizeMIR+607()@0x2a956dda68
at generateMethodWithStage+102()@0x2a955ca96b
at cmgrGenerateMethodFromPhase+216()@0x2a955cb7eb
at cmgrGenerateNormalMethod+91()@0x2a955ca8e1
at cmgrGenerateCode+209()@0x2a955ca775
at generate_code2+205()@0x2a956ac733
at codegenThread+1006()@0x2a956acdd5
at tsiCallStartFunction+67()@0x2a95685bfb
at tsiThreadStub+308()@0x2a95686e05
at ptiThreadStub+14()@0x2a956ee277
at start_thread+151(pthread_create.c)@0x36ac406137
-- Java stack --
Extended, platform specific info:
libc release: 2.3.4-stable
Elf headers:
libc ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 00000036abd1c4a0 PHOFF: 0000000000000040 SHOFF: 000000000018afd0 EF: 0x0 HS: 64 PS: 56 PHN; 10 SS: 64 SHN: 69 STIDX: 68
libpthread ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 00000036ac405620 PHOFF: 0000000000000040 SHOFF: 000000000001f220 EF: 0x0 HS: 64 PS: 56 PHN; 9 SS: 64 SHN: 38 STIDX: 37
libjvm ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000003f820 PHOFF: 0000000000000040 SHOFF: 000000000037bd90 EF: 0x0 HS: 64 PS: 56 PHN; 3 SS: 64 SHN: 22 STIDX: 19
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================

Hi,
As you point out, this looks like a problem with the JRockit code optimizer. The JVM has tried to optimize fr/pagesjaunes/commun/base/impl/SBInscriptionPubliciteImpl.processModuleRappelGratuit and crashed somewhere in the middle of optimization.
Is it possible for you to provide us with a reproducer (or reproduction instructions, download site etc) for this problem?
Regards,
Henrik
JRockit codegen team

JVM crashes with jdeveloper 11g and jrockit 6

When i run my application its al going well, when i call some to show data, then all is going well,
but when i would like to save some, then the jvm crashes, and i have no idea, i've added arguments in the jvm run configuration, etc nothing seems to work, has anybody any idea, because im getting very desperate.
[JRockit] ERROR: The JVM has crashed. Writing crash information to C:\Oracle\Middleware\jdeveloper\system\system11.1.1.0.31.52.05\DefaultDomain\jrockit.6136.dump.
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:01:35 on Thu Aug 20 16:02:44 2009
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
C:\Oracle\Middleware\jdeveloper\system\system11.1.1.0.31.52.05\DefaultDomain\jrockit.6136.dump
C:\Oracle\Middleware\jdeveloper\system\system11.1.1.0.31.52.05\DefaultDomain\jrockit.6136.mdmp
Error Message: Illegal memory access. [54]
Exception Rec: EXCEPTION_ACCESS_VIOLATION (c0000005) at 0x00000000 - memory at 0x00000000 could not be read.
Minidump : Wrote mdmp. Size is 527MB
SafeDllMode : -1
Version : BEA JRockit(R) R27.6.3-40_o-112056-1.6.0_11-20090318-2104-windows-ia32
CPU : Intel Core 2 SSE SSE2 SSE3 SSSE3 SSE4.1 Core Intel64
Number CPUs : 2
Tot Phys Mem : 3715284992 (3543 MB)
OS version : Microsoft Windows XP version 5.1 Service Pack 3 (Build 2600) (32-bit)
Thread System: Windows Threads
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -Xms256m -Xmx512m -Djbo.debugoutput=console -Xmx512M -XX:MaxPermSize=512M -Xverify:none -da -Dplatform.home=C:\Oracle\MIDDLE~2\WLSERV~1.3 -Dwls.home=C:\Oracle\MIDDLE~2\WLSERV~1.3\server -Dweblogic.home=C:\Oracle\MIDDLE~2\WLSERV~1.3\server -Ddomain.home=C:\Oracle\MIDDLE~2\JDEVEL~1\system\SYSTEM~1.05\DEFAUL~1 -Doracle.home=C:\Oracle\Middleware\jdeveloper -Doracle.security.jps.config=C:\Oracle\MIDDLE~2\JDEVEL~1\system\SYSTEM~1.05\DEFAUL~1\config\oracle\jps-config.xml -Doracle.dms.context=OFF -Djava.protocol.handler.pkgs=oracle.mds.net.protocol -Dweblogic.management.discover=true -Dwlw.iterativeDev= -Dwlw.testConsole= -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=C:\Oracle\MIDDLE~2\patch_wls1030\profiles\default\sysext_manifest_classpath;C:\Oracle\MIDDLE~2\patch_jdev1111\profiles\default\sysext_manifest_classpath;C:\Oracle\MIDDLE~2\patch_cie660\profiles\default\sysext_manifest_classpath -Dweblogic.Name=DefaultServer -Djava.security.policy=C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home : C:\PROGRA~1\Java\JROCKI~1.0_1
j.class.path : ;C:\Oracle\MIDDLE~2\patch_wls1030\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\Oracle\MIDDLE~2\patch_jdev1111\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\Oracle\MIDDLE~2\patch_cie660\profiles\default\sys_manifest_classpath\weblogic_patch.jar;C:\PROGRA~1\Java\JROCKI~1.0_1\lib\tools.jar;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\weblogic_sp.jar;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\weblogic.jar;C:\Oracle\MIDDLE~2\modules\features\weblogic.server.modules_10.3.0.0.jar;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\webservices.jar;C:\Oracle\MIDDLE~2\modules\ORGAPA~1.5/lib/ant-all.jar;C:\Oracle\MIDDLE~2\modules\NETSFA~1.0_1/lib/ant-contrib.jar;C:\Oracle\Middleware\jdeveloper\modules\features\adf.share_11.1.1.jar;;C:\Oracle\MIDDLE~2\WLSERV~1.3\common\eval\pointbase\lib\pbclient57.jar;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\lib\xqrl.jar;;
j.lib.path : C:\PROGRA~1\Java\JROCKI~1.0_1\bin;.;C:\WINDOWS\system32;C:\WINDOWS;C:\Oracle\MIDDLE~2\patch_wls1030\profiles\default\native;C:\Oracle\MIDDLE~2\patch_jdev1111\profiles\default\native;C:\Oracle\MIDDLE~2\patch_cie660\profiles\default\native;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\native\win\32;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\bin;C:\Oracle\MIDDLE~2\modules\ORGAPA~1.5\bin;C:\PROGRA~1\Java\JROCKI~1.0_1\jre\bin;C:\PROGRA~1\Java\JROCKI~1.0_1\bin;C:\Oracle\OraClient10g\bin;C:\Oracle\DevSuite10G\bin;C:\Oracle\DevSuite10G\jdk\jre\bin\classic;C:\Oracle\DevSuite10G\jdk\jre\bin;C:\Oracle\DevSuite10G\jdk\jre\bin\client;C:\Oracle\DevSuite10G\jlib;C:\Oracle\DevSuite10G\jre\1.4.2\bin\client;C:\Oracle\DevSuite10G\jre\1.4.2\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\system32\nls;C:\WINDOWS\system32\nls\ENGLISH;C:\Program Files\TortoiseSVN\bin;C:\Oracle\jdevstudio10133\jdk\bin;C:\WINDOWS\system32\nls;C:\WINDOWS\system32\nls\ENGLISH;C:\Program Files\QuickTime\QTSystem\;Z:.;;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\native\win\32\oci920_8
JAVA_HOME : C:\PROGRA~1\Java\JROCKI~1.0_1
JAVAOPTIONS: <not set>
PATH : C:\PROGRA~1\Java\JROCKI~1.0_1\bin;C:\Oracle\MIDDLE~2\patch_wls1030\profiles\default\native;C:\Oracle\MIDDLE~2\patch_jdev1111\profiles\default\native;C:\Oracle\MIDDLE~2\patch_cie660\profiles\default\native;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\native\win\32;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\bin;C:\Oracle\MIDDLE~2\modules\ORGAPA~1.5\bin;C:\PROGRA~1\Java\JROCKI~1.0_1\jre\bin;C:\PROGRA~1\Java\JROCKI~1.0_1\bin;C:\Oracle\OraClient10g\bin;C:\Oracle\DevSuite10G\bin;C:\Oracle\DevSuite10G\jdk\jre\bin\classic;C:\Oracle\DevSuite10G\jdk\jre\bin;C:\Oracle\DevSuite10G\jdk\jre\bin\client;C:\Oracle\DevSuite10G\jlib;C:\Oracle\DevSuite10G\jre\1.4.2\bin\client;C:\Oracle\DevSuite10G\jre\1.4.2\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\system32\nls;C:\WINDOWS\system32\nls\ENGLISH;C:\Program Files\TortoiseSVN\bin;C:\Oracle\jdevstudio10133\jdk\bin;C:\WINDOWS\system32\nls;C:\WINDOWS\system32\nls\ENGLISH;C:\Program Files\QuickTime\QTSystem\;Z:.;;C:\Oracle\MIDDLE~2\WLSERV~1.3\server\native\win\32\oci920_8
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
C Heap : Good; no memory allocations have failed
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#9.
: YC is not running. Last finished YC was YC#15.
OC History : Strategy genparpar was used for OC#1 to OC#6.
: Strategy singleparpar was used for OC#7.
: Strategy genparpar was used for OC#8 to OC#9.
YC History : Ran 1 YCs before OC#5.
: Ran 0 YCs before OC#6.
: Ran 0 YCs before OC#7.
: Ran 1 YCs before OC#8.
: Ran 4 YCs before OC#9.
: Ran 1 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x00C00000 - 0x10C00000 (Size: 256 MB)
Compaction : 0x0BC00030 - 0x0CC00038 (Current compaction type: external)
NurseryList : 0x0289B2D8 - 0x0A5D4488
KeepArea : 0x085ADA80 - 0x0A5D4488
NurseryMarker: [ 0x06479790, 0x085ADA80 ]
CompRefs : References are 32-bit.
Registers (from ThreadContext: 0x2562E340 / OS context: 0x2562E72C):
eax = 00000000 ecx = 00000000 edx = 2562e998 ebx = 07ab6220
esp = 2562e9f8 ebp = 07ab6220 esi = 2562ea18 edi = 242bae4c
es = 00000023 cs = 0000001b ss = 00000023 ds = 00000023
fs = 0000003b gs = 00000000
eip = 00000000 eflags = 00010212
Loaded modules:
(* denotes the module causing the exception)
00400000-00412fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\java.exe
7c900000-7c9b4fff C:\WINDOWS\system32\ntdll.dll
7c800000-7c8fffff C:\WINDOWS\system32\kernel32.dll
77f40000-77feafff C:\WINDOWS\system32\ADVAPI32.dll
77da0000-77e31fff C:\WINDOWS\system32\RPCRT4.dll
77f10000-77f20fff C:\WINDOWS\system32\Secur32.dll
77be0000-77c37fff C:\WINDOWS\system32\MSVCRT.dll
7c340000-7c395fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\msvcr71.dll
00420000-006c6fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\jrockit\jvm.dll
76af0000-76b1dfff C:\WINDOWS\system32\WINMM.dll
77e40000-77e88fff C:\WINDOWS\system32\GDI32.dll
7e390000-7e420fff C:\WINDOWS\system32\USER32.dll
71a30000-71a46fff C:\WINDOWS\system32\WS2_32.dll
71a20000-71a27fff C:\WINDOWS\system32\WS2HELP.dll
6d860000-6d86bfff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\verify.dll
6d3d0000-6d3eefff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\java.dll
6d330000-6d337fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\hpi.dll
6d8a0000-6d8aefff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\zip.dll
6d6c0000-6d6d2fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\net.dll
719d0000-71a0ffff C:\WINDOWS\system32\mswsock.dll
61200000-61258fff C:\WINDOWS\system32\hnetcfg.dll
71a10000-71a17fff C:\WINDOWS\System32\wshtcpip.dll
23750000-23776fff C:\WINDOWS\system32\DNSAPI.dll
23780000-23787fff C:\WINDOWS\System32\winrnr.dll
23790000-237bcfff C:\WINDOWS\system32\WLDAP32.dll
66210000-66218fff C:\WINDOWS\system32\netware\NWWS2NDS.DLL
50d50000-50d84fff C:\WINDOWS\system32\NETWIN32.DLL
50d00000-50d15fff C:\WINDOWS\system32\CLNWIN32.DLL
50df0000-50e14fff C:\WINDOWS\system32\LOCWIN32.dll
50db0000-50de4fff C:\WINDOWS\system32\NCPWIN32.dll
71a50000-71a59fff C:\WINDOWS\system32\WSOCK32.dll
66220000-6622bfff C:\WINDOWS\system32\netware\NWWS2SLP.DLL
66250000-66256fff C:\WINDOWS\system32\NWSRVLOC.dll
23850000-23855fff C:\WINDOWS\system32\rasadhlp.dll
6d610000-6d618fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\management.dll
6d6e0000-6d6e8fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\nio.dll
68000000-68035fff C:\WINDOWS\system32\rsaenh.dll
76970000-76a24fff C:\WINDOWS\system32\USERENV.dll
6ff20000-6ff74fff C:\WINDOWS\system32\netapi32.dll
00ba0000-00baafff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\jmapi.dll
22490000-2249dfff C:\Oracle\Middleware\wlserver_10.3\server\native\win\32\wlfileio2.dll
24fe0000-24ff8fff C:\WINDOWS\system32\iphlpapi.dll
25bc0000-25bd7fff C:\WINDOWS\system32\MPRAPI.dll
77c90000-77cc1fff C:\WINDOWS\system32\ACTIVEDS.dll
25be0000-25c04fff C:\WINDOWS\system32\adsldpc.dll
76ad0000-76ae0fff C:\WINDOWS\system32\ATL.DLL
774a0000-775dcfff C:\WINDOWS\system32\ole32.dll
25c10000-25c9afff C:\WINDOWS\system32\OLEAUT32.dll
25ca0000-25cadfff C:\WINDOWS\system32\rtutils.dll
71b80000-71b92fff C:\WINDOWS\system32\SAMLIB.dll
778e0000-779d6fff C:\WINDOWS\system32\SETUPAPI.dll
25cf0000-25cf4fff C:\Oracle\Middleware\wlserver_10.3\server\native\win\32\wlntio.dll
6d840000-6d847fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\sunmscapi.dll
77a40000-77ad5fff C:\WINDOWS\system32\CRYPT32.dll
77ae0000-77af1fff C:\WINDOWS\system32\MSASN1.dll
76bb0000-76bbafff C:\WINDOWS\system32\psapi.dll
6d0b0000-6d1e7fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\awt.dll
72f70000-72f95fff C:\WINDOWS\system32\WINSPOOL.DRV
76330000-7634cfff C:\WINDOWS\system32\IMM32.dll
5d4e0000-5d579fff C:\WINDOWS\system32\comctl32.dll
6d7b0000-6d7b5fff C:\Program Files\Java\jrockit-R27.6.3-jre1.6.0_11\bin\rmi.dll
33230000-33342fff C:\PROGRA~1\Java\JROCKI~1.0_1\bin\dbghelp.dll
Stack:
(* marks the word pointed to by the stack pointer)
2562e9f8: 2562ea34* 00000000 242bace8 0059a501 242bae4c 2562ea34
2562ea10: 00000000 21941522 242bae4c 2562ea34 0d3829b8 2cfb78c0
2562ea28: 2194151d 242bb0b4 2562ea18 0d1018b8 242bace8 07ab6220
2562ea40: 07ab6220 21bfb985 0d1018b8 00000001 07ab6220 051988d8
Code:
(* marks the word pointed to by the instruction pointer)
ffffffd0: Unreadable
ffffffe8: Unreadable
00000000: Unreadable
00000018: Unreadable
"[ACTIVE] ExecuteThread: '0' for" id=15 idx=0x3c tid=6000 lastJavaFrame=0x2562EA24
Stack 0: start=0x255F0000, end=0x25630000, guards=0x255F3000 (ok), forbidden=0x255F1000
Thread Stack Trace:
at RJNI_jrockit_vm_Locks_monitorEnterUnmatched+17(rnilocks.c:65+17)@0x0059A501
-- Java stack --
at jrockit/vm/Locks.monitorEnterUnmatched(Ljava/lang/Object;)V(Native Method)
at oracle/jbo/server/ViewRowSetIteratorImpl.next(ViewRowSetIteratorImpl.java:1690)
at oracle/jbo/server/ViewRowSetIteratorImpl.first(ViewRowSetIteratorImpl.java:1548)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.first(ViewRowSetImpl.java:3202)
at oracle/jbo/server/ViewObjectImpl.first(ViewObjectImpl.java:8123)
at oracle/jbo/uicli/binding/JUCtrlListBinding.initFromServerBinding(JUCtrlListBinding.java:524)
at oracle/jbo/uicli/binding/JUCtrlListBinding.setupListItems(JUCtrlListBinding.java:630)
at oracle/jbo/uicli/binding/JUCtrlListBinding.findListIndex(JUCtrlListBinding.java:1783)
at oracle/jbo/uicli/binding/JUCtrlListBinding.setValueAt(JUCtrlListBinding.java:2686)
at oracle/jbo/uicli/binding/JUCtrlListBinding.updateValuesFromRow(JUCtrlListBinding.java:2118)
at oracle/jbo/uicli/binding/JUCtrlValueBinding.updateNavigated(JUCtrlValueBinding.java:268)
at oracle/jbo/uicli/binding/JUIteratorBinding.navigated(JUIteratorBinding.java:302)
^-- Holding lock: oracle/jbo/uicli/binding/JUApplication@0x0CECD4F0[biased lock]
at oracle/jbo/common/RowSetHelper.fireNavigationEvent(RowSetHelper.java:268)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigationToRow(ViewRowSetIteratorImpl.java:3624)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigation(ViewRowSetIteratorImpl.java:3595)
at oracle/jbo/server/ViewRowSetIteratorImpl.next(ViewRowSetIteratorImpl.java:1744)
at oracle/jbo/server/ViewRowSetIteratorImpl.first(ViewRowSetIteratorImpl.java:1548)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.first(ViewRowSetImpl.java:3202)
at oracle/jbo/server/ViewObjectImpl.first(ViewObjectImpl.java:8123)
at oracle/adf/model/binding/DCIteratorBinding.setupRSIstate(DCIteratorBinding.java:755)
at oracle/adf/model/binding/DCIteratorBinding.refreshControl(DCIteratorBinding.java:655)
at oracle/jbo/uicli/binding/JUIteratorBinding.refreshControl(JUIteratorBinding.java:475)
at oracle/adf/model/binding/DCIteratorBinding.rangeRefreshed(DCIteratorBinding.java:861)
at oracle/jbo/common/RowSetHelper.fireRangeRefreshed(RowSetHelper.java:179)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyRangeRefreshed(ViewRowSetIteratorImpl.java:3559)
at oracle/jbo/server/ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2776)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.refresh(ViewRowSetIteratorImpl.java:2996)
at oracle/jbo/server/ViewRowSetImpl.notifyRefresh(ViewRowSetImpl.java:2453)
at oracle/jbo/server/ViewRowSetImpl.execute(ViewRowSetImpl.java:1047)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.execute(ViewRowSetImpl.java:873)
at oracle/jbo/server/ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2738)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.refresh(ViewRowSetIteratorImpl.java:2996)
at oracle/jbo/server/ViewRowSetImpl.notifyRefresh(ViewRowSetImpl.java:2453)
at oracle/jbo/server/ViewRowSetImpl.refreshRowSet(ViewRowSetImpl.java:6106)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyDetailRowSets(ViewRowSetIteratorImpl.java:3493)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigationToRow(ViewRowSetIteratorImpl.java:3635)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigation(ViewRowSetIteratorImpl.java:3595)
at oracle/jbo/server/ViewRowSetIteratorImpl.internalSetCurrentRow(ViewRowSetIteratorImpl.java:3378)
at oracle/jbo/server/ViewRowSetIteratorImpl.first(ViewRowSetIteratorImpl.java:1551)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.first(ViewRowSetImpl.java:3202)
at oracle/jbo/server/ViewObjectImpl.first(ViewObjectImpl.java:8123)
at oracle/adf/model/binding/DCIteratorBinding.setupRSIstate(DCIteratorBinding.java:755)
at oracle/adf/model/binding/DCIteratorBinding.refreshControl(DCIteratorBinding.java:655)
at oracle/jbo/uicli/binding/JUIteratorBinding.refreshControl(JUIteratorBinding.java:475)
at oracle/adf/model/binding/DCIteratorBinding.rangeRefreshed(DCIteratorBinding.java:861)
at oracle/jbo/common/RowSetHelper.fireRangeRefreshed(RowSetHelper.java:179)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyRangeRefreshed(ViewRowSetIteratorImpl.java:3559)
at oracle/jbo/server/ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2776)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.refresh(ViewRowSetIteratorImpl.java:2996)
at oracle/jbo/server/ViewRowSetImpl.notifyRefresh(ViewRowSetImpl.java:2453)
at oracle/jbo/server/ViewRowSetImpl.execute(ViewRowSetImpl.java:1047)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.execute(ViewRowSetImpl.java:873)
at oracle/jbo/server/ViewRowSetIteratorImpl.ensureRefreshed(ViewRowSetIteratorImpl.java:2738)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.refresh(ViewRowSetIteratorImpl.java:2996)
at oracle/jbo/server/ViewRowSetImpl.notifyRefresh(ViewRowSetImpl.java:2453)
at oracle/jbo/server/ViewRowSetImpl.refreshRowSet(ViewRowSetImpl.java:6106)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyDetailRowSets(ViewRowSetIteratorImpl.java:3493)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigationToRow(ViewRowSetIteratorImpl.java:3635)
at oracle/jbo/server/ViewRowSetIteratorImpl.notifyNavigation(ViewRowSetIteratorImpl.java:3595)
at oracle/jbo/server/ViewRowSetIteratorImpl.internalSetCurrentRow(ViewRowSetIteratorImpl.java:3378)
at oracle/jbo/server/ViewRowSetIteratorImpl.setCurrentRow(ViewRowSetIteratorImpl.java:1018)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetIteratorImpl.activateIteratorState(ViewRowSetIteratorImpl.java:3955)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.activateIteratorState(ViewRowSetImpl.java:6228)
at oracle/jbo/server/ViewObjectImpl.activateIteratorState(ViewObjectImpl.java:16120)
at oracle/jbo/server/ViewRowSetIteratorImpl.activateIteratorState(ViewRowSetIteratorImpl.java:3874)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.activateIteratorState(ViewRowSetImpl.java:6228)
at oracle/jbo/server/ViewObjectImpl.activateIteratorState(ViewObjectImpl.java:16120)
at oracle/jbo/server/ViewRowSetIteratorImpl.activateIteratorState(ViewRowSetIteratorImpl.java:3874)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ViewRowSetImpl.activateIteratorState(ViewRowSetImpl.java:6228)
at oracle/jbo/server/ViewObjectImpl.activateIteratorState(ViewObjectImpl.java:16120)
at oracle/jbo/server/ApplicationModuleImpl.activateVOs(ApplicationModuleImpl.java:7675)
at oracle/jbo/server/ApplicationModuleImpl.doActivateState(ApplicationModuleImpl.java:7421)
at oracle/jbo/server/ApplicationModuleImpl.doActivateState(ApplicationModuleImpl.java:7453)
at oracle/jbo/server/ApplicationModuleImpl.doActivateAMState(ApplicationModuleImpl.java:7400)
at oracle/jbo/server/Serializer.activate(Serializer.java:284)
at oracle/jbo/server/DBSerializer.activateRootAM(DBSerializer.java:331)
at oracle/jbo/server/ApplicationModuleImpl.activateFromStack(ApplicationModuleImpl.java:6063)
at oracle/jbo/server/ApplicationModuleImpl.activateState(ApplicationModuleImpl.java:5923)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at oracle/jbo/server/ApplicationModuleImpl.activateStateForUndo(ApplicationModuleImpl.java:8308)
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at nl/nak/iva/RuleFrameTransactionImpl.activateStateForUndo(RuleFrameTransactionImpl.java:262)
at nl/nak/iva/RuleFrameTransactionImpl.handleSQLError(RuleFrameTransactionImpl.java:130)
at nl/nak/iva/RuleFrameTransactionImpl.doCommit(RuleFrameTransactionImpl.java:86)
at oracle/jbo/server/DBTransactionImpl.commitInternal(DBTransactionImpl.java:2244)
at oracle/jbo/server/DBTransactionImpl.commit(DBTransactionImpl.java:2382)
^-- Holding lock: nl/nak/iva/RuleFrameTransactionImpl@0x0E986690[biased lock]
^-- Holding lock: oracle/jbo/JboSyncLock@0x0D1018B8[recursive]
at nl/nak/iva/RuleFrameTransactionImpl.commit(RuleFrameTransactionImpl.java:103)
at oracle/adf/model/bc4j/DCJboDataControl.commitTransaction(DCJboDataControl.java:1565)
at oracle/adf/model/binding/DCDataControl.callCommitTransaction(DCDataControl.java:1407)
at oracle/jbo/uicli/binding/JUCtrlActionBinding.doIt(JUCtrlActionBinding.java:1293)
at oracle/adf/model/binding/DCDataControl.invokeOperation(DCDataControl.java:2126)
at oracle/jbo/uicli/binding/JUCtrlActionBinding.invoke(JUCtrlActionBinding.java:697)
at oracle/adf/controller/v2/lifecycle/PageLifecycleImpl.executeEvent(PageLifecycleImpl.java:392)
at oracle/adfinternal/view/faces/model/binding/FacesCtrlActionBinding._execute(FacesCtrlActionBinding.java:159)
at oracle/adfinternal/view/faces/model/binding/FacesCtrlActionBinding.execute(FacesCtrlActionBinding.java:118)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
    at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;) Ljava/lang/Object;(Native Method)
    at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java/lang/reflect/Method.invoke(Method.java:597)
    at com/sun/el/parser/AstValue.invoke(AstValue.java:157)
    at com/sun/el/MethodExpressionImpl.invoke(MethodExpressionImpl.java:283)
    at org/apache/myfaces/trinidadinternal/taglib/util/MethodExpressionMethodBinding.invoke(MethodExpressionMethodBinding.java:53)
    at org/apache/myfaces/trinidad/component/UIXComponentBase.broadcastToMethodBinding(UIXComponentBase.java:1227)
    at org/apache/myfaces/trinidad/component/UIXCommand.broadcast(UIXCommand.java:183)
    at oracle/adf/view/rich/component/fragment/ContextSwitchingComponent$1.run(ContextSwitchingComponent.java:70)
    at oracle/adf/view/rich/component/fragment/ContextSwitchingComponent._processPhase(ContextSwitchingComponent.java:274)
    at oracle/adf/view/rich/component/fragment/ContextSwitchingComponent.broadcast(ContextSwitchingComponent.java:74)
    at javax/faces/component/UIViewRoot.broadcastEvents(UIViewRoot.java:458)
    at javax/faces/component/UIViewRoot.processApplication(UIViewRoot.java:763)
    at oracle/adfinternal/view/faces/lifecycle/LifecycleImpl._invokeApplication(LifecycleImpl.java:640)
    at oracle/adfinternal/view/faces/lifecycle/LifecycleImpl._executePhase(LifecycleImpl.java:275)
    at oracle/adfinternal/view/faces/lifecycle/LifecycleImpl.execute(LifecycleImpl.java:175)
    at javax/faces/webapp/FacesServlet.service(FacesServlet.java:265)
    at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
    at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)
    at weblogic/servlet/internal/TailFilter.doFilter(TailFilter.java:26)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at oracle/adf/model/servlet/ADFBindingFilter.doFilter(ADFBindingFilter.java:181)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at oracle/adfinternal/view/faces/webapp/rich/RegistrationFilter.doFilter(RegistrationFilter.java:85)
    at org/apache/myfaces/trinidadinternal/webapp/TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:279)
    at org/apache/myfaces/trinidadinternal/webapp/TrinidadFilterImpl._invokeDoFilter(TrinidadFilterImpl.java:239)
    at org/apache/myfaces/trinidadinternal/webapp/TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:196)
    at org/apache/myfaces/trinidadinternal/webapp/TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:139)
    at org/apache/myfaces/trinidad/webapp/TrinidadFilter.doFilter(TrinidadFilter.java:92)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at oracle/security/jps/wls/JpsWlsFilter.doFilter(JpsWlsFilter.java:102)
    at oracle/security/jps/ee/http/JpsFilter.doFilter(JpsFilter.java:65)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at weblogic/servlet/internal/RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
    at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:42)
    at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3496)
    at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic/security/service/SecurityManager.runAs(Lweblogic/security/acl/internal/AuthenticatedSubject;Lweblogic/security/acl/internal/AuthenticatedSubject;Ljava/security/PrivilegedAction;)Ljava/lang/Object;(Unknown Source)
    at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2180)
    at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2086)
    at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1406)
    at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)
    at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    * If you see this dump, please go to                    *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information.                      *
===== END DUMP ===============================================================

Core dumps are usually a bug, so I suggest filing a Service Request with support.

Jrockit crashes due to outofmemory and illegal memory acces

Hello,
We have been using jrmc-3.1.2-1.6.0 and lately we are seeing JVM crashes after every couple days. Note: We have been seeing these crashes recently , for last 1 year we did not see such crashes.
Following are different issues that we have seen over last few days:
1. Crash due to illegal memory access
2. Crash due to out of memory error
3. Sever becoming unresponsive/Idle
For illegal memory access and out of memory crashes, there was jRockit dump file created and Dump file seems to be pointing at Jrockit libjvm.so module for the exception/crash.
Any help would be appreciated!
*** Dump for Illegal Memory Access
Error Message: Illegal memory access. [54]
Signal info : si_signo=11, si_code=1 si_addr=0x10
Version : BEA JRockit(R) R27.6.5-32_o-121899-1.6.0_14-20091001-2113-linux-ia32
CPU : Intel Core i7 (HT) SSE SSE2 SSE3 SSSE3 SSE4.1 SSE4.2 Core Intel64
Number CPUs : 4
Tot Phys Mem : 12762509312 (12171 MB)
OS version : Red Hat Enterprise Linux Server release 5.6 (Tikanga)
Linux version 2.6.18-164.15.1.el5PAE ([email protected]) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Mon Mar 1 11:14:09 EST 2010 (i686)
Thread System: NPTL
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -Djava.util.logging.config.file=/usr/local/springsource/tcServer-6.0/zplus/conf/logging.properties -Djava.util.logging.manager=com.springsource.tcserver.serviceability.logging.TcServerLogManager -Xmx2048m -Xms2048m -Djava.rmi.server.hostname=300714-web8.echovox.com -XgcPrio:pausetime -DTERRACOTTA_URL=338449-web10.echovox.com:9510,338450-web11.echovox.com:9510 -Dapp_version= -Xmanagement -Dcom.sun.management.jmxremote.port=7091 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dehcache.monitor.enabled=True -Djava.endorsed.dirs=/usr/local/springsource/tcServer-6.0/tomcat-6.0.20.A/endorsed -Dcatalina.base=/usr/local/springsource/tcServer-6.0/zplus -Dcatalina.home=/usr/local/springsource/tcServer-6.0/tomcat-6.0.20.A -Djava.io.tmpdir=/usr/local/springsource/tcServer-6.0/zplus/temp -Dsun.java.launcher=SUN_STANDARD org.apache.catalina.startup.Bootstrap start
java.home : /usr/local/jrmc-3.1.2-1.6.0/jre
j.class.path : :/usr/local/springsource/tcServer-6.0/tomcat-6.0.20.A/bin/bootstrap.jar
j.lib.path : /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/jrockit:/usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386:/usr/local/jrmc-3.1.2-1.6.0/jre/../lib/i386
JAVA_HOME : <not set>
JAVAOPTIONS: <not set>
LD_LIBRARY_PATH: /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/jrockit:/usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386:/usr/local/jrmc-3.1.2-1.6.0/jre/../lib/i386
LD_PRELOAD : <not set>
LD_ASSUME_KERNEL: <not set>
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
C Heap : Good; no memory allocations have failed
GC Strategy : Mode: pausetime. Currently using strategy: genconcon
GC Status : OC currently running, in phase: marking. This is OC#2905.
: YC is not running. Last finished YC was YC#100045.
OC History : Strategy genconcon was used for OC#2776.
: Strategy genconpar was used for OC#2777 to OC#2781.
: Strategy genconcon was used for OC#2782 to OC#2783.
: Strategy genconpar was used for OC#2784 to OC#2790.
: Strategy genconcon was used for OC#2791 to OC#2905.
YC History : Ran 1 YCs before OC#2901.
: Ran 0 YCs before OC#2902.
: Ran 1 YCs before OC#2903.
: Ran 0 YCs before OC#2904.
: Ran 2 YCs before OC#2905.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x8b00000 - 0x88b00000 (Size: 2048 MB)
Compaction : 0x49b00000 - 0x51b00000 (Current compaction type: internal)
NurseryList : 0xaf67e18 - 0x8226c988
KeepArea : 0x817031e8 - 0x8226c988
NurseryMarker: [ 0x80d031f0, 0x817031e8 ]
CompRefs : References are 32-bit.
Registers (from ThreadContext: 0x96b75420 / OS context: 0x96b7551c):
eax = 00000000 ecx = ffffffcc edx = 8b80eb78 ebx = 8b80eb78
esp = 96b75814 ebp = 96b75960 esi = 96b75a48 edi = 00000000
es = 0000007b cs = 00000073 ss = 0000007b ds = 0000007b
fs = 00000000 gs = 00000033
eip = b7d3a397 eflags = 00210296
Loaded modules:
(* denotes the module causing the exception)
08048000-08058233 /usr/local/jrmc-3.1.2-1.6.0/jre/bin/java
b7f24000-b7f2462b /usr/local/jrmc-3.1.2-1.6.0/jre/bin/java
00754000-00768f17 /lib/libpthread.so.0
006b2000-006d8a23 /lib/libm.so.6
006ab000-006ad0fb /lib/libdl.so.2
00550000-006a2723 /lib/libc.so.6
00531000-0054b4f7 /lib/ld-linux.so.2
b7c46000-b7e9fea7 */usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/jrockit/libjvm.so
007a3000-007a9ebf /lib/librt.so.1
b722f000-b723839b /lib/libnss_files.so.2
b7118000-b71229bb /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libverify.so
b70f3000-b7115f57 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libjava.so
007ae000-007c27a7 /lib/libnsl.so.1
b723e000-b7243ef0 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/native_threads/libhpi.so
b59f0000-b59fe3e4 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libzip.so
b5805000-b580a666 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libmanagement.so
b5224000-b5236a18 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libnet.so
b723c000-b723c6ad /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/librmi.so
b2d42000-b2d45c2f /lib/libnss_dns.so.2
b2d2e000-b2d3d74b /lib/libresolv.so.2
b2d4a000-b2d503a4 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libnio.so
b1f9d000-b1fc5857 /usr/local/springsource/tcServer-6.0/zplus/temp/tmpSigarJars841342613926113968186721535772/libsigar-x86-linux-1.6.4.so
Stack:
(* marks the word pointed to by the stack pointer)
96b75814: b7cbce41* 00000000 006772e2 b04dbab8 006a4ff4 00000030
96b7582c: 00000002 96b758a0 00000000 00000000 00010000 0061eea8
96b75844: b7e48510 00010000 00000000 0061eeb9 b7d8f0f8 20000000
96b7585c: 00010000 00000000 00004022 ffffffff 00000000 96b75890
Code:
(* marks the word pointed to by the instruction pointer)
b7d3a364: c0a108ec e8b7f0fe ffffffa0 f0fed4a1 ff96e8b7 b8c9ffff
b7d3a37c: 00000001 900debc3 90909090 90909090 90909090 8be58955
b7d3a394: 8b5d0845* d2851050 0fc0950f b60fc0b6 768dc3c0 27bc8d00
b7d3a3ac: 00000000 53e58955 0134ec81 9d8d0000 fffffee8 04245c89
"RMI TCP Connection(idle)" id=440712 idx=0x7c4 tid=825 lastJavaFrame=0x96b75ecc
Stack 0: start=0x96b54000, end=0x96b78000, guards=0x96b59000 (ok), forbidden=0x96b57000
Thread Stack Trace:
at jniExceptionCheck+7()@0xb7d3a397
at cmgrGenerateCode+260()@0xb7cbe024
at generate_code2+937()@0xb7da6c99
at generate_code+97()@0xb7da6f11
at get_runnable_codeinfo2+275()@0xb7da74c3
at call_java+317()@0xb7d42f0d
at jniInvoke+110()@0xb7d451be
-- Java stack --
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
    at sun/reflect/NativeConstructorAccessorImpl.newInstance0(Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
    at sun/reflect/NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
    at sun/reflect/DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)[optimized]
at java/lang/reflect/Constructor.newInstance(Constructor.java:513)[optimized]
at java/lang/Class.newInstance0(Class.java:355)[inlined]
at java/lang/Class.newInstance(Class.java:308)[optimized]
at sun/reflect/MethodAccessorGenerator$1.run(MethodAccessorGenerator.java:381)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:233)[inlined]
at jrockit/vm/AccessController.doPrivileged(AccessController.java:241)[inlined]
at sun/reflect/MethodAccessorGenerator.generate(MethodAccessorGenerator.java:377)[optimized]
at sun/reflect/MethodAccessorGenerator.generateMethod(MethodAccessorGenerator.java:59)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:28)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[optimized]
at java/lang/reflect/Method.invoke(Method.java:597)[inlined]
at java/io/ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:945)[inlined]
at java/io/ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1461)[optimized]
at java/io/ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1392)[inlined]
at java/io/ObjectOutputStream.writeObject0(ObjectOutputStream.java:1150)[inlined]
at java/io/ObjectOutputStream.writeObject(ObjectOutputStream.java:326)[optimized]
at sun/rmi/server/UnicastRef.marshalValue(UnicastRef.java:274)
at sun/rmi/server/UnicastServerRef.dispatch(UnicastServerRef.java:315)
at sun/rmi/transport/Transport$1.run(Transport.java:159)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:255)[optimized]
at sun/rmi/transport/Transport.serviceCall(Transport.java:155)
at sun/rmi/transport/tcp/TCPTransport.handleMessages(TCPTransport.java:535)
at sun/rmi/transport/tcp/TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
at sun/rmi/transport/tcp/TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
at java/util/concurrent/ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)[inlined]
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)[optimized]
at java/lang/Thread.run(Thread.java:619)[optimized]
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
Extended, platform specific info:
libc release: 2.5-stable
Elf headers:
libc ehdrs: EI: 7f454c46010101000000000000000000 ET: 3 EM: 3 V: 1 ENTRY: 00565fe0 PHOFF: 00000034 SHOFF: 0019ccbc EF: 0x0 HS: 52 PS: 32 PHN; 10 SS: 40 SHN: 75 STIDX: 74
libpthread ehdrs: EI: 7f454c46010101000000000000000000 ET: 3 EM: 3 V: 1 ENTRY: 00758850 PHOFF: 00000034 SHOFF: 00021474 EF: 0x0 HS: 52 PS: 32 PHN; 9 SS: 40 SHN: 40 STIDX: 39
libjvm ehdrs: EI: 7f454c46010101000000000000000000 ET: 3 EM: 3 V: 1 ENTRY: 0004c3a0 PHOFF: 00000034 SHOFF: 012c9a58 EF: 0x0 HS: 52 PS: 32 PHN; 4 SS: 40 SHN: 29 STIDX: 26
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================
****** Dump for OutOfMemory error
Error Message: Out of memory [68]
Signal info : si_signo=11, si_code=1 si_addr=(nil)
Fatal Error : Reference Iteration refIterInit src/jvm/code/runtime/refiter.c:167
Version : BEA JRockit(R) R27.6.5-32_o-121899-1.6.0_14-20091001-2113-linux-ia32
CPU : Intel Core i7 (HT) SSE SSE2 SSE3 SSSE3 SSE4.1 SSE4.2 Core Intel64
Number CPUs : 4
Tot Phys Mem : 12762509312 (12171 MB)
OS version : Red Hat Enterprise Linux Server release 5.6 (Tikanga)
Linux version 2.6.18-164.15.1.el5PAE ([email protected]) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Mon Mar 1 11:14:09 EST 2010 (i686)
Thread System: NPTL
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -Djava.util.logging.config.file=/usr/local/springsource/tcServer-6.0/zplus/conf/logging.properties -Djava.util.logging.manager=com.springsource.tcserver.serviceability.logging.TcServerLogManager -Xmx2048m -Xms2048m -Djava.rmi.server.hostname=300714-web8.echovox.com -XgcPrio:pausetime -DTERRACOTTA_URL=338449-web10.echovox.com:9510,338450-web11.echovox.com:9510 -Dapp_version= -Xmanagement -Dcom.sun.management.jmxremote.port=7091 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dehcache.monitor.enabled=True -Djava.endorsed.dirs=/usr/local/springsource/tcServer-6.0/tomcat-6.0.20.A/endorsed -Dcatalina.base=/usr/local/springsource/tcServer-6.0/zplus -Dcatalina.home=/usr/local/springsource/tcServer-6.0/tomcat-6.0.20.A -Djava.io.tmpdir=/usr/local/springsource/tcServer-6.0/zplus/temp -Dsun.java.launcher=SUN_STANDARD org.apache.catalina.startup.Bootstrap start
java.home : /usr/local/jrmc-3.1.2-1.6.0/jre
j.class.path : :/usr/local/springsource/tcServer-6.0/tomcat-6.0.20.A/bin/bootstrap.jar
j.lib.path : /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/jrockit:/usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386:/usr/local/jrmc-3.1.2-1.6.0/jre/../lib/i386
JAVA_HOME : <not set>
JAVAOPTIONS: <not set>
LD_LIBRARY_PATH: /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/jrockit:/usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386:/usr/local/jrmc-3.1.2-1.6.0/jre/../lib/i386
LD_PRELOAD : <not set>
LD_ASSUME_KERNEL: <not set>
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
C Heap : 1 memory allocations have failed
: First failure was a mmMalloc of 20 bytes
: Last failure was a mmMalloc of 20 bytes
GC Strategy : Mode: pausetime. Currently using strategy: genconpar
GC Status : OC is not running. Last finished OC was OC#1945.
: YC is not running. Last finished YC was YC#90824.
OC History : Strategy genconpar was used for OC#1745 to OC#1755.
: Strategy genparpar was used for OC#1756 to OC#1757.
: Strategy genconpar was used for OC#1758 to OC#1938.
: Strategy genparpar was used for OC#1939 to OC#1940.
: Strategy genconpar was used for OC#1941 to OC#1945.
YC History : Ran 1 YCs before OC#1941.
: Ran 6 YCs before OC#1942.
: Ran 4 YCs before OC#1943.
: Ran 6 YCs before OC#1944.
: Ran 4 YCs before OC#1945.
: Ran 5 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x8100000 - 0x88100000 (Size: 2048 MB)
Compaction : 0x64100000 - 0x68100020 (Current compaction type: internal)
NurseryList : 0x8214640 - 0x84438f20
KeepArea : (no keeparea in use)
NurseryMarker: [ 0x827bfd10, 0x83996a00 ]
CompRefs : References are 32-bit.
Registers (from ThreadContext: 0x2a96c20 / OS context: 0x2a96d1c):
eax = 00001267 ecx = 00000000 edx = 00000042 ebx = b7eb0de4
esp = 02a97010 ebp = 02a97028 esi = 00000044 edi = 02a97078
es = 0000007b cs = 00000073 ss = 0000007b ds = 0000007b
fs = 00000000 gs = 00000033
eip = b7cfca45 eflags = 00010206
Loaded modules:
(* denotes the module causing the exception)
08048000-08058233 /usr/local/jrmc-3.1.2-1.6.0/jre/bin/java
b7f44000-b7f4462b /usr/local/jrmc-3.1.2-1.6.0/jre/bin/java
00754000-00768f17 /lib/libpthread.so.0
006b2000-006d8a23 /lib/libm.so.6
006ab000-006ad0fb /lib/libdl.so.2
00550000-006a2723 /lib/libc.so.6
00531000-0054b4f7 /lib/ld-linux.so.2
b7c66000-b7ebfea7 */usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/jrockit/libjvm.so
007a3000-007a9ebf /lib/librt.so.1
b724f000-b725839b /lib/libnss_files.so.2
b7138000-b71429bb /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libverify.so
b7113000-b7135f57 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libjava.so
007ae000-007c27a7 /lib/libnsl.so.1
b725e000-b7263ef0 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/native_threads/libhpi.so
b5972000-b59803e4 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libzip.so
b5803000-b5808666 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libmanagement.so
b51a8000-b51baa18 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libnet.so
b725c000-b725c6ad /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/librmi.so
b2dae000-b2db1c2f /lib/libnss_dns.so.2
b2d9a000-b2da974b /lib/libresolv.so.2
b47ae000-b47b43a4 /usr/local/jrmc-3.1.2-1.6.0/jre/lib/i386/libnio.so
b1ec7000-b1eef857 /usr/local/springsource/tcServer-6.0/zplus/temp/tmpSigarJars551489478996731294326116727652638760/libsigar-x86-linux-1.6.4.so
Stack:
(* marks the word pointed to by the stack pointer)
02a97010: b7ec5040* 00000200 b7eb0de4 02a97078 02a97078 02a97034
02a97028: 02a97048 b7e78894 00000044 b7eb0de4 02a97078 00000001
02a97040: 02a970d0 02a97110 02a97068 b7e788bf 00000044 b7eb0de4
02a97058: 02a97078 b666692a 00000001 02a970d0 02a97088 b7e2147a
Code:
(* marks the word pointed to by the instruction pointer)
b7cfca14: 4c892074 458b0824 2404c710 b7ec5040 0c244489 000200b8
b7cfca2c: 24448900 b5dae804 01b80017 a3000000 b7ec5024 001267b8
b7cfca44: 0000a300* 04c70000 00003f24 bdcae800 768d0017 27bc8d00
b7cfca5c: 00000000 e589fc55 53c03157 b9e87d8d 00000004 00c0ec81
"tomcat-http--119" id=24059 idx=0x60c tid=8771 lastJavaFrame=0xfffffffc
Stack 0: start=0x2a74000, end=0x2a98000, guards=0x2a79000 (ok), forbidden=0x2a77000
Thread Stack Trace:
at dumpForceDump+117()@0xb7cfca45
at vmFatalErrorMsgV+84()@0xb7e78894
at vmFatalErrorMsg+31()@0xb7e788bf
at fatalError+42()@0xb7e2147a
at refIterInit+111()@0xb7e215bf
at trProcessLocksForThread+41()@0xb7e300f9
at get_all_locks+106()@0xb7d476ca
at javaLockConvertLazyToThin+99()@0xb7d477b3
at javaLockUnmatchedLock+802()@0xb7d488f2
at jniMonitorEnter+48()@0xb7d66cf0
at vmtiDetachFromThreadObject+85()@0xb7d9ec85
at tsiThreadStub+147()@0xb7d9f0f3
at ptiThreadStub+18()@0xb7e0e1d2
at start_thread+226()@0x759832
at __clone+94()@0x62245e
-- Java stack --

From the command-line (-Dehcache.monitor.enabled=True) you are using some form of caching.
The out-of-memory occured as the JVM was unable the allocate an object: C Heap : 1 memory allocations have failed
Could you check how the live data set is going (or the memory leak detector)
Some concerns with regard to tune a JVM that runs a cache can be found here: http://middlewaremagic.com/weblogic/?p=7083
Note that the example given discusses Coherence, but can be adopted for another caching mechanism as well.

JRockit JVM crash

Hi,
We are using JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2105-windows-ia32 with Weblogic 10.3 on Windows XP SP3 as well as Redhat 5.2.
There is a JVM crash (code generation) when hashCode() in called on a String. Error message is: Illegal memory access. We have tried turning off optimization using -XnoOpt as well -Xnoopt without success. Crash is seen on both the platforms.
Any suggestions or work arounds will be very much appreciated. Dump is given in the end of email.
Thanks,
Ajit
===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:06:07 on Thu Apr 16 12:07:54 2009
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
Additional information is available in:
D:\tools\bea103\user_projects\domains\cim8\jrockit.4588.dump
D:\tools\bea103\user_projects\domains\cim8\jrockit.4588.mdmp
Error Message: Illegal memory access. [54]
Exception Rec: EXCEPTION_ACCESS_VIOLATION (c0000005) at 0x0046D11A - memory at 0x0000001B could not be read.
Minidump : Wrote mdmp. Size is 770MB
SafeDllMode : -1
Version : BEA JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2105-windows-ia32
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#4.
: YC is not running. Last finished YC was YC#14.
OC History : Strategy genparpar was used for OC#1 to OC#4.
YC History : Ran 5 YCs before OC#1.
: Ran 7 YCs before OC#2.
: Ran 1 YCs before OC#3.
: Ran 1 YCs before OC#4.
: Ran 0 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x00C00000 - 0x20C00000 (Size: 512 MB)
Compaction : 0x02C00000 - 0x04C00000 (Current compaction type: internal)
NurseryList : 0x00F09148 - 0x0F8F6BE8
KeepArea : 0x101E3398 - 0x0FA7BB38
NurseryMarker: [ 0x101E3398, 0x0FA7BB38 ]
CompRefs : References are 32-bit.
CPU : Intel Pentium 4 SSE SSE2 SSE3 NetBurst EM64T
Number CPUs : 2
Tot Phys Mem : 3489136640 (3327 MB)
OS version : Microsoft Windows XP version 5.1 Service Pack 3 (Build 2600) (32-bit)
Thread System: Windows Threads
Java locking : Normal
State : JVM is running
Command Line : -Xms512m -Xmx512m -Xverify:none -da -Dplatform.home=D:\tools\bea103\WLSERV~1.3 -Dwls.home=D:\tools\bea103\WLSERV~1.3\server -Dweblogic.home=D:\tools\bea103\WLSERV~1.3\server -Dweblogic.management.discover=true -Dwlw.iterativeDev= -Dwlw.testConsole= -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=d:\tools\bea103\patch_wls1030\profiles\default\sysext_manifest_classpath;d:\tools\bea103\patch_cie660\profiles\default\sysext_manifest_classpath -Dweblogic.Name=AdminServer -Dtangosol.coherence.cacheconfig=d:/work/cim72/venus_dist_wlg/config/coherence-client-cache-config.xml -Dtangosol.coherence.override=d:/work/cim72/venus_dist_wlg/config/tangosol-coherence-override.xml -DMQ_HOME=d:/work/cim72/venus_dist_wlg -Dtangosol.coherence.log=d:/work/cim72/venus_dist_wlg/tangosol.log -DMQ_CONFIG_FILE=d:/work/cim72/venus_dist_wlg/config/ConfigValues.xml -DMQ_COMMON_DIR=d:/work/common/dev72 -DOS=Windows_NT -DORACLE_HOME=C:\oracle\ora92 -DNODE_ID=Amar -DMQ_LOG=d:/work/cim72/venus_dist_wlg/log -Xdebug -Xnoagent -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=5005 -Djavax.xml.transform.TransformerFactory=org.apache.xalan.processor.TransformerFactoryImpl -Djava.security.policy=D:\tools\bea103\WLSERV~1.3\server\lib\weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home : d:\tools\bea103\JROCKI~1\jre
j.class.path : ;d:\tools\bea103\patch_wls1030\profiles\default\sys_manifest_classpath\weblogic_patch.jar;d:\tools\bea103\patch_cie660\profiles\default\sys_manifest_classpath\weblogic_patch.jar;d:\tools\bea103\JROCKI~1\lib\tools.jar;D:\tools\bea103\WLSERV~1.3\server\lib\weblogic_sp.jar;D:\tools\bea103\WLSERV~1.3\server\lib\weblogic.jar;d:\tools\bea103\modules\features\weblogic.server.modules_10.3.0.0.jar;D:\tools\bea103\WLSERV~1.3\server\lib\webservices.jar;d:\tools\bea103\modules\ORGAPA~1.5/lib/ant-all.jar;d:\tools\bea103\modules\NETSFA~1.0_1/lib/ant-contrib.jar;;D:\tools\bea103\WLSERV~1.3\common\eval\pointbase\lib\pbclient57.jar;D:\tools\bea103\WLSERV~1.3\server\lib\xqrl.jar;;;d:/work/cim72/venus_dist_wlg/lib/external/serializer.jar;d:/work/cim72/venus_dist_wlg/lib/external/UserInfoService.jar;
j.lib.path : d:\tools\bea103\JROCKI~1\bin;.;C:\WINDOWS\system32;C:\WINDOWS;d:\tools\bea103\patch_wls1030\profiles\default\native;d:\tools\bea103\patch_cie660\profiles\default\native;D:\tools\bea103\WLSERV~1.3\server\native\win\32;D:\tools\bea103\WLSERV~1.3\server\bin;d:\tools\bea103\modules\ORGAPA~1.5\bin;d:\tools\bea103\JROCKI~1\jre\bin;d:\tools\bea103\JROCKI~1\bin;C:\tools\WebSphereMQ\Java\lib;C:\oracle\ora92\bin;C:\Program Files\O0racle\jre\1.3.1\bin;C:\Program Files\Oracle\jre\1.1.8\bin2;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\tools\apache-ant-1.5.4\bin;C:\tibco\tibrv\BIN;D:\bea81\jdk142_11\bin;D:\DB2\IBM\SQLLIB\BIN;D:\DB2\IBM\SQLLIB\FUNCTION;D:\DB2\IBM\SQLLIB\SAMPLES\REPL;D:/work/cim70HF1/venus_dist_was/bin/db2ldr;C:\tools\WebSphereMQ\bin;C:\tools\WebSphereMQ\tools\c\samples\bin;D:\tools\bea103\WLSERV~1.3\server\native\win\32\oci920_8
JAVA_HOME : d:\tools\bea103\JROCKI~1
JAVAOPTIONS: <not set>
PATH : d:\tools\bea103\JROCKI~1\jre\bin;d:\tools\bea103\patch_wls1030\profiles\default\native;d:\tools\bea103\patch_cie660\profiles\default\native;D:\tools\bea103\WLSERV~1.3\server\native\win\32;D:\tools\bea103\WLSERV~1.3\server\bin;d:\tools\bea103\modules\ORGAPA~1.5\bin;d:\tools\bea103\JROCKI~1\jre\bin;d:\tools\bea103\JROCKI~1\bin;C:\tools\WebSphereMQ\Java\lib;C:\oracle\ora92\bin;C:\Program Files\O0racle\jre\1.3.1\bin;C:\Program Files\Oracle\jre\1.1.8\bin2;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\tools\apache-ant-1.5.4\bin;C:\tibco\tibrv\BIN;D:\bea81\jdk142_11\bin;D:\DB2\IBM\SQLLIB\BIN;D:\DB2\IBM\SQLLIB\FUNCTION;D:\DB2\IBM\SQLLIB\SAMPLES\REPL;D:/work/cim70HF1/venus_dist_was/bin/db2ldr;C:\tools\WebSphereMQ\bin;C:\tools\WebSphereMQ\tools\c\samples\bin;D:\tools\bea103\WLSERV~1.3\server\native\win\32\oci920_8
C Heap : Good; no memory allocations have failed
Method : com/martquest/entity/roleassignment/RoleAssignmentEntPKey.hashCode()I
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0x256BED00 / OS context: 0x256BF0EC):
eax = 0000001b ecx = 2ff00210 edx = 2ff00960 ebx = 2ff07a40
esp = 256bf3b8 ebp = 2ff04a28 esi = 256bf574 edi = 2f5626e8
es = 00000023 cs = 0000001b ss = 00000023 ds = 00000023
fs = 0000003b gs = 00000000
eip = 0046d11a eflags = 00010202
Stack:
(* marks the word pointed to by the stack pointer)
256bf3b8: 256bf574* 256bf5b5 000000b5 000000a9 00000000 0047b101
256bf3d0: 0000001b 2ff079b0 00000000 00000039 256bf574 00000038
256bf3e8: 000000a9 2432042c 256bf424 00000030 0042f73c 256bf5b5
256bf400: 00000039 2ff04a28 2ff048e0 2ff04a28 00000042 00000005
Code:
(* marks the word pointed to by the instruction pointer)
0046d0e8: 6a57006a e8515302 0003419c 833c468b c08540c4 0e8b5a75
0046d100: c085018b 008b0274 082440f6 518b4a75 003a830c 448b4274
0046d118: 108b1824* 0000e281 fa811ff0 00100000 d2330474 408b05eb
0046d130: 8b108b18 74c08501 f6008b02 74082440 ebc03304 0c498b05
Loaded modules:
(* denotes the module causing the exception)
00400000-00410fff d:\tools\bea103\JROCKI~1\bin\java.exe
7c900000-7c9aefff C:\WINDOWS\system32\ntdll.dll
7c800000-7c8f5fff C:\WINDOWS\system32\kernel32.dll
77dd0000-77e6afff C:\WINDOWS\system32\ADVAPI32.dll
77e70000-77f01fff C:\WINDOWS\system32\RPCRT4.dll
77fe0000-77ff0fff C:\WINDOWS\system32\Secur32.dll
77c10000-77c67fff C:\WINDOWS\system32\MSVCRT.dll
7c340000-7c395fff d:\tools\bea103\JROCKI~1\jre\bin\msvcr71.dll
00420000-006c3fff *d:\tools\bea103\JROCKI~1\jre\bin\jrockit\jvm.dll
76b40000-76b6cfff C:\WINDOWS\system32\WINMM.dll
77f10000-77f58fff C:\WINDOWS\system32\GDI32.dll
7e410000-7e4a0fff C:\WINDOWS\system32\USER32.dll
71ab0000-71ac6fff C:\WINDOWS\system32\WS2_32.dll
71aa0000-71aa7fff C:\WINDOWS\system32\WS2HELP.dll
6d410000-6d438fff d:\tools\bea103\JROCKI~1\jre\bin\jdwp.dll
6d770000-6d775fff d:\tools\bea103\JROCKI~1\jre\bin\npt.dll
6d820000-6d82bfff d:\tools\bea103\JROCKI~1\jre\bin\verify.dll
6d3c0000-6d3defff d:\tools\bea103\JROCKI~1\jre\bin\java.dll
6d320000-6d327fff d:\tools\bea103\JROCKI~1\jre\bin\hpi.dll
6d860000-6d86efff D:\tools\bea103\jrockit_160_05\jre\bin\zip.dll
6d290000-6d296fff d:\tools\bea103\JROCKI~1\jre\bin\dt_socket.dll
71a50000-71a8efff C:\WINDOWS\system32\mswsock.dll
662b0000-66307fff C:\WINDOWS\system32\hnetcfg.dll
71a90000-71a97fff C:\WINDOWS\System32\wshtcpip.dll
6d620000-6d632fff D:\tools\bea103\jrockit_160_05\jre\bin\net.dll
00bf0000-00bf7fff C:\WINDOWS\System32\winrnr.dll
237e0000-23806fff C:\WINDOWS\system32\DNSAPI.dll
23810000-2383bfff C:\WINDOWS\system32\WLDAP32.dll
23840000-2384dfff C:\Program Files\Neoteris\Secure Application Manager\samnsp.dll
23870000-23888fff C:\WINDOWS\system32\iphlpapi.dll
238a0000-238a5fff C:\WINDOWS\system32\rasadhlp.dll
6d570000-6d578fff D:\tools\bea103\jrockit_160_05\jre\bin\management.dll
6d640000-6d648fff D:\tools\bea103\jrockit_160_05\jre\bin\nio.dll
68000000-68035fff C:\WINDOWS\system32\rsaenh.dll
769c0000-76a73fff C:\WINDOWS\system32\USERENV.dll
5b860000-5b8b4fff C:\WINDOWS\system32\netapi32.dll
229c0000-229cafff D:\tools\bea103\jrockit_160_05\jre\bin\jmapi.dll
229d0000-229ddfff D:\tools\bea103\wlserver_10.3\server\native\win\32\wlfileio2.dll
25c10000-25c27fff C:\WINDOWS\system32\MPRAPI.dll
77cc0000-77cf1fff C:\WINDOWS\system32\ACTIVEDS.dll
25c30000-25c54fff C:\WINDOWS\system32\adsldpc.dll
76b20000-76b30fff C:\WINDOWS\system32\ATL.DLL
774e0000-7761cfff C:\WINDOWS\system32\ole32.dll
25c60000-25ceafff C:\WINDOWS\system32\OLEAUT32.dll
25cf0000-25cfdfff C:\WINDOWS\system32\rtutils.dll
71bf0000-71c02fff C:\WINDOWS\system32\SAMLIB.dll
77920000-77a12fff C:\WINDOWS\system32\SETUPAPI.dll
25d40000-25d44fff D:\tools\bea103\wlserver_10.3\server\native\win\32\wlntio.dll
6d800000-6d807fff D:\tools\bea103\jrockit_160_05\jre\bin\sunmscapi.dll
77a80000-77b14fff C:\WINDOWS\system32\CRYPT32.dll
77b20000-77b31fff C:\WINDOWS\system32\MSASN1.dll
76bf0000-76bfafff C:\WINDOWS\system32\psapi.dll
6d7c0000-6d7c5fff D:\tools\bea103\jrockit_160_05\jre\bin\rmi.dll
34340000-34452fff d:\tools\bea103\JROCKI~1\jre\bin\dbghelp.dll
"[ACTIVE] ExecuteThread: '0' for" id=17 idx=0x44 tid=4552 lastJavaFrame=0x256BF874
Stack 0: start=0x25680000, end=0x256C0000, guards=0x25683000 (ok), forbidden=0x25681000
Thread Stack Trace:
at modelPutField+458(efield.c:198+38)@0x0046D11A
at generateExpression+3841(expression.c:723+16)@0x0047B101
at generate_block+220(bc2hir.c:1284+0)@0x0042F73C
at generateIRFromOffset+262(bc2hir.c:1042+6)@0x0042FB16
at cgTranslateBC2HIR+87(bc2hir.c:172+0)@0x004305D7
at cmgrGenerateMethodFromPhase+121(codemanager.c:1107+25)@0x0044B719
at cmgrGenerateNormalMethod+81(codemanager.c:773+0)@0x0044C1B1
at cmgrGenerateCode+157(codemanager.c:732+0)@0x0044CA9D
at generate_code2+187(methodaccess.c:735+14)@0x005410CB
at generate_code+421(methodaccess.c:376+7)@0x00541AC5
at get_runnable_codeinfo2+157(methodaccess.c:508+10)@0x00541BED
at RJNI_jrockit_vm_RNI_generateVirtualCode+266(methodaccess.c:646+11)@0x00541F1A
-- Java stack --
at jrockit/vm/RNI.generateVirtualCode(Ljava/lang/Object;II)I(Native Method)
at com/martquest/entity/roleassignment/RoleAssignmentEntPKey.hashCode(RoleAssignmentEntPKey.java:0)
at weblogic/ejb/container/cache/CacheKey.<init>(CacheKey.java:26)
at weblogic/ejb/container/manager/DBManager.create(DBManager.java:1480)
at weblogic/ejb/container/manager/DBManager.remoteCreate(DBManager.java:1360)
at weblogic/ejb/container/internal/EntityEJBHome.create(EntityEJBHome.java:272)
at com/martquest/entity/roleassignment/RoleAssignmentEnt_d9pexc_HomeImpl.create(RoleAssignmentEnt_d9pexc_HomeImpl.java:74)
at com/martquest/session/role/RoleAssignmentSsnBean.createRoleAssignment(RoleAssignmentSsnBean.java:149)
at com/martquest/session/role/RoleAssignmentSsn_dgtk4w_EOImpl.createRoleAssignment(RoleAssignmentSsn_dgtk4w_EOImpl.java:644)
at com/martquest/eml/member/MemberViewServlet.insert(MemberViewServlet.java:1665)
at com/martquest/eml/member/MemberViewServlet.routeAction(MemberViewServlet.java:150)
at com/martquest/eml/member/MemberViewServlet.onService(MemberViewServlet.java:129)
at com/martquest/eml/MqServlet.service(MqServlet.java:487)
at javax/servlet/http/HttpServlet.service(HttpServlet.java:820)
at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)
at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:175)
at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3495)
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic/security/service/SecurityManager.runAs(Lweblogic/security/acl/internal/AuthenticatedSubject;Lweblogic/security/acl/internal/AuthenticatedSubject;Ljava/security/PrivilegedAction;)Ljava/lang/Object;(Unknown Source)
at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2180)
at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2086)
at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1406)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
* If you see this dump, please go to *
* http://edocs.bea.com/jrockit/go2troubleshooting.html *
* for troubleshooting information. *
===== END DUMP ===============================================================

Looks like JRockit crashes when JIT compiling the method com/martquest/entity/roleassignment/RoleAssignmentEntPKey.hashCode. You can try the latest JRockit version, R27.6.3, which is available from Oracle Support or bundled with JRMC 3.1 here:
http://www.oracle.com/technology/software/products/jrockit/index.html
If that doesn't help, I recommend that you open a ticket with Oracle Support and provide the text dump, the core file and compiled RoleAssignmentEntPKey.class; and ask for a JVM patch.
Henrik

JRockit R27.6.0 - Illegal Memory Access

Hi,
hopefully someone can help me understand what is going on. I'm getting Illegal Memory Access which is crashing the VM. We recently moved to WebLogic 10.3 using JRocking on x86-64. Yesterday under load we got this error.
Error Message: Illegal memory access. [54]
Signal info : si_signo=11, si_code=2 si_addr=(nil)
Version : BEA JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2104-linux-ia32
GC Strategy : Mode: throughput. Currently using strategy: genparpar
GC Status : OC is not running. Last finished OC was OC#2138.
: YC is not running. Last finished YC was YC#4709.
OC History : Strategy genparpar was used for OC#2115 to OC#2116.
: Strategy singleparpar was used for OC#2117 to OC#2120.
: Strategy genparpar was used for OC#2121 to OC#2124.
: Strategy singleparpar was used for OC#2125 to OC#2126.
: Strategy genparpar was used for OC#2127 to OC#2138.
YC History : Ran 1 YCs before OC#2134.
: Ran 1 YCs before OC#2135.
: Ran 1 YCs before OC#2136.
: Ran 1 YCs before OC#2137.
: Ran 1 YCs before OC#2138.
: Ran 0 YCs since last OC.
YC Promotion : Last YC successfully promoted all objects
Heap : 0x8100000 - 0x18100000 (Size: 256 MB)
Compaction : 0xb100000 - 0xc100000 (Current compaction type: internal)
NurseryList : 0xcf79cb0 - 0x130a8658
KeepArea : 0x130c5368 - 0x130b3278
NurseryMarker: [ 0x130c5368, 0x130b3278 ]
CompRefs : References are 32-bit.
CPU : Intel Core 2 SSE SSE2 SSE3 SSSE3 Core EM64T
Number CPUs : 4
Tot Phys Mem : 8370728960 (7982 MB)
OS version : SUSE Linux Enterprise Server 10 (x86_64)
VERSION = 10
PATCHLEVEL = 1
Linux version 2.6.16.54-0.2.12-smp (geeko@buildhost) (gcc version 4.1.2 20070115 (prerelease) (SUSE Linux)) #1 SMP Fri Oct 24 02:16:38 UTC 2008 (x86_64)
Thread System: NPTL
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -Xms256m -Xmx1500m -da -Dplatform.home=/dep/weblogic/wlserver_10.3 -Dwls.home=/dep/weblogic/wlserver_10.3/server -Dweblogic.home=/dep/weblogic/wlserver_10.3/server -Dweblogic.management.discover=true -Dwlw.iterativeDev=false -Dwlw.testConsole=false -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=/dep/weblogic/patch_wls1030/profiles/default/sysext_manifest_classpath:/dep/weblogic/patch_cie660/profiles/default/sysext_manifest_classpath -Dweblogic.Name=admin -Djava.security.policy=/dep/weblogic/wlserver_10.3/server/lib/weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
java.home : /dep/weblogic/jrockit_160_05/jre
j.class.path : :/dep/weblogic/patch_wls1030/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/dep/weblogic/patch_cie660/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/dep/weblogic/jrockit_160_05/lib/tools.jar:/dep/weblogic/wlserver_10.3/server/lib/weblogic_sp.jar:/dep/weblogic/wlserver_10.3/server/lib/weblogic.jar:/dep/weblogic/modules/features/weblogic.server.modules_10.3.0.0.jar:/dep/weblogic/wlserver_10.3/server/lib/webservices.jar:/dep/weblogic/modules/org.apache.ant_1.6.5/lib/ant-all.jar:/dep/weblogic/modules/net.sf.antcontrib_1.0.0.0_1-0b2/lib/ant-contrib.jar::/dep/weblogic/wlserver_10.3/common/eval/pointbase/lib/pbclient57.jar:/dep/weblogic/wlserver_10.3/server/lib/xqrl.jar:::/dep/weblogic/user_projects/domains/e1/config/e1conf
j.lib.path : /dep/weblogic/jrockit_160_05/jre/lib/i386/jrockit:/dep/weblogic/jrockit_160_05/jre/lib/i386:/dep/weblogic/jrockit_160_05/jre/../lib/i386::/dep/weblogic/wlserver_10.3/server/native/linux/i686:/dep/weblogic/wlserver_10.3/server/native/linux/i686/oci920_8
JAVA_HOME : /dep/weblogic/jrockit_160_05
JAVAOPTIONS: <not set>
LD_LIBRARY_PATH: /dep/weblogic/jrockit_160_05/jre/lib/i386/jrockit:/dep/weblogic/jrockit_160_05/jre/lib/i386:/dep/weblogic/jrockit_160_05/jre/../lib/i386::/dep/weblogic/wlserver_10.3/server/native/linux/i686:/dep/weblogic/wlserver_10.3/server/native/linux/i686/oci920_8
LD_ASSUME_KERNEL: <not set>
C Heap : Good; no memory allocations have failed
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
Registers (from ThreadContext: 0xf14b9a80 / OS context: 0xf14b9b7c):
eax = 00000000 ecx = 12f36148 edx = 000000c8 ebx = 12f36158
esp = f14b9e74 ebp = f14b9eb0 esi = 00000000 edi = 12f36158
es = 0000002b cs = 9bb00023 ss = f7ec002b ds = 0000002b
fs = 00000003 gs = 00000063
eip = f7e1cc4b eflags = 00200202
Stack:
(* marks the word pointed to by the stack pointer)
f14b9e74: 00000000* 00000032 12f36158 f14b9eb0 f7bcb666 12f36158
f14b9e8c: 00000000 000000c8 f14b9ea0 6ba3b238 f71be2b0 00000032
f14b9ea4: eb966680 6ba3b238 f14b9f28 f14b9ef0 eb93dac6 6ba3b238
f14b9ebc: c5f5dda0 00000000 00000032 00000000 ebb70088 cfe52138
Code:
(* marks the word pointed to by the instruction pointer)
f7e1cc18: c2f60000 0f077401 078806b6 c2f64746 0f0c7402 896606b7
f7e1cc30: 02c68307 f602c783 0a7404c2 0789068b 8304c683 c2f604c7
f7e1cc48: 8b107408* 044e8b06 4f890789 08c68304 8008c783 2174f0e2
f7e1cc60: 4e8b068b 085e8b04 890c6e8b 044f8907 89085f89 ea830c6f
Loaded modules:
(* denotes the module causing the exception)
08048000-08058253 /dep/weblogic/jrockit_160_05/bin/java
ffffe000-ffffe7d7 /dep/weblogic/jrockit_160_05/bin/java
f7efc000-f7f0c043 /lib/libpthread.so.0
f7ed7000-f7ef94ef /lib/libm.so.6
f7ed3000-f7ed4c3f /lib/libdl.so.2
f7db1000-f7ecade5 */lib/libc.so.6
f7f29000-f7f42db3 /lib/ld-linux.so.2
f7ae0000-f7d37367 /dep/weblogic/jrockit_160_05/jre/lib/i386/jrockit/libjvm.so
f7f1e000-f7f24734 /lib/librt.so.1
f71a8000-f71b29bb /dep/weblogic/jrockit_160_05/jre/lib/i386/libverify.so
f7183000-f71a5df7 /dep/weblogic/jrockit_160_05/jre/lib/i386/libjava.so
f7157000-f71675b7 /lib/libnsl.so.1
f716c000-f7171ef0 /dep/weblogic/jrockit_160_05/jre/lib/i386/native_threads/libhpi.so
f5daa000-f5db83e4 /dep/weblogic/jrockit_160_05/jre/lib/i386/libzip.so
f5147000-f514c666 /dep/weblogic/jrockit_160_05/jre/lib/i386/libmanagement.so
f4fb3000-f4fc5b38 /dep/weblogic/jrockit_160_05/jre/lib/i386/libnet.so
f4a44000-f4a4a424 /dep/weblogic/jrockit_160_05/jre/lib/i386/libnio.so
f3c93000-f3c9c357 /dep/weblogic/jrockit_160_05/jre/lib/i386/libjmapi.so
f7f13000-f7f14de4 /dep/weblogic/wlserver_10.3/server/native/linux/i686/libwlfileio2.so
eebd3000-eec4d966 /dep/weblogic/jrockit_160_05/jre/lib/i386/libawt.so
f60d1000-f60d4fa8 /dep/weblogic/jrockit_160_05/jre/lib/i386/headless/libmawt.so
f7f11000-f7f116ad /dep/weblogic/jrockit_160_05/jre/lib/i386/librmi.so
eb8df000-eb95cf8f /dep/weblogic/jrockit_160_05/jre/lib/i386/libfontmanager.so
eb397000-eb3ea966 /dep/weblogic/jrockit_160_05/jre/lib/i386/libcmm.so
eb368000-eb395a6f /dep/weblogic/jrockit_160_05/jre/lib/i386/libjpeg.so
eb300000-eb314477 /dep/weblogic/jrockit_160_05/jre/lib/i386/libdcpr.so
"Thread-606163" id=606200 idx=0x20c tid=11363 lastJavaFrame=0xf14b9f88
Stack 0: start=0xf149a000, end=0xf14bc000, guards=0xf149f000 (ok), forbidden=0xf149d000
Thread Stack Trace:
at memcpy+91()@0xf7e1cc4b
at ZN11GeneralPath8getShapeEP7JNIEnv+166()@0xeb93dac6
at Java_sun_font_FileFont_getGlyphOutline+120()@0xeb93ec08
-- Java stack --
at sun/font/FileFont.getGlyphOutline(JIFF)Ljava/awt/geom/GeneralPath;(Native Method)
^-- Holding lock: sun/font/TrueTypeFont@0x9c55410[thin lock]
at sun/font/FileFontStrike.getGlyphOutline(FileFontStrike.java:724)
at sun/font/CompositeStrike.getGlyphOutline(CompositeStrike.java:151)[optimized]
at sun/font/StandardGlyphVector$GlyphStrike.appendGlyphOutline(StandardGlyphVector.java:1781)[optimized]
at sun/font/StandardGlyphVector.getGlyphsOutline(StandardGlyphVector.java:1164)[inlined]
at sun/font/StandardGlyphVector.getOutline(StandardGlyphVector.java:402)[optimized]
at sun/font/ExtendedTextSourceLabel.handleGetOutline(ExtendedTextSourceLabel.java:168)
at sun/font/Decoration.getOutline(Decoration.java:115)
at sun/font/ExtendedTextSourceLabel.getOutline(ExtendedTextSourceLabel.java:172)
at java/awt/font/TextLine.getOutline(TextLine.java:843)[optimized]
at java/awt/font/TextLayout.getOutline(TextLayout.java:2674)[inlined]
at oracle/sdovis/style/StyleText.getWrappedOutline(StyleText.java:430)[inlined]
at oracle/sdovis/style/StyleText.getStringOutline2(StyleText.java:382)[optimized]
at oracle/sdovis/style/StyleText.getStringOutline(StyleText.java:369)[inlined]
at oracle/sdovis/TextLabeler.findTextLabelPointOnAreaFeature(TextLabeler.java:432)[optimized]
at oracle/sdovis/TextLabeler.labelPolygonWithText(TextLabeler.java:765)[inlined]
at oracle/sdovis/TextLabeler.applyTextLabel(TextLabeler.java:133)[optimized]
at oracle/sdovis/VectorRenderer.labelStyledFeature(VectorRenderer.java:1541)[optimized]
at oracle/sdovis/VectorRenderer.label(VectorRenderer.java:378)[optimized]
at oracle/sdovis/RenderingEngine.render(RenderingEngine.java:572)[optimized]
at oracle/sdovis/DBMapMaker.renderEm(DBMapMaker.java:1712)[optimized]
at oracle/sdovis/MapMaker.renderMap(MapMaker.java:1455)[optimized]
at oracle/lbs/mapserver/core/RealWorker.generateMapImage(RealWorker.java:737)[optimized]
at oracle/lbs/mapserver/core/RealWorker.process(RealWorker.java:354)[optimized]
at oracle/lbs/mapserver/MapServerImpl.renderMap(MapServerImpl.java:181)
at oracle/lbs/mapcache/cache/TileFetcher.fetchInternalMap(TileFetcher.java:428)
at oracle/lbs/mapcache/cache/TileFetcher.fetchTile(TileFetcher.java:256)[optimized]
at oracle/lbs/mapcache/cache/TileFetcher.run(TileFetcher.java:163)[optimized]
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
Extended, platform specific info:
libc release: 2.4-development
Elf headers:
libc ehdrs: EI: 7f454c46010101000000000000000000 ET: 3 EM: 3 V: 1 ENTRY: 000159c0 PHOFF: 00000034 SHOFF: 0012c2b8 EF: 0x0 HS: 52 PS: 32 PHN; 11 SS: 40 SHN: 67 STIDX: 64
libpthread ehdrs: EI: 7f454c46010101000000000000000000 ET: 3 EM: 3 V: 1 ENTRY: 00004b80 PHOFF: 00000034 SHOFF: 0001350c EF: 0x0 HS: 52 PS: 32 PHN; 10 SS: 40 SHN: 37 STIDX: 34
libjvm ehdrs: EI: 7f454c46010101000000000000000000 ET: 3 EM: 3 V: 1 ENTRY: 0004bf70 PHOFF: 00000034 SHOFF: 012c54a4 EF: 0x0 HS: 52 PS: 32 PHN; 4 SS: 40 SHN: 29 STIDX: 26

Please file a support case so we can investigate this issue properly.

JRockit Crash - BEA JRockit(R) R27.5.0-110_o-99226-1.4.2_16-20080528-1505-l

Similar Messages

Maybe you are looking for