Determine the method optimizing which the Jrockit JVM crashed.

I have an application that is running on Jrockit JVM. which crashed after 3-4 hours.
From the jrockit.<pid>.dump I could determine that the crash was on the Thread: "(Code Optimization Thread 1) .
And by using -XnoOpt we can stop code Optimization.
However, how do we determine which exact method caused it so that i can use the option -XX:OptFile
I am running Jrockit R28.0.1-21-133393-1.6.0_20-20100512-2126-linux-x86_64
on RED HAT LINUX 5.3 (64 bit)
Thread:
"(Code Optimization Thread 1)" id=5 idx=0x54 tid=29997 lastJavaFrame=0xfffffffffffffffc
Stack 0: start=0x41a70000, end=0x41ab2000, guards=0x41a75000 (ok), forbidden=0x41a73000
Thread Stack Trace:
at mspace_free+473(osal_mspace.c:4608)
at irAliasValidate+1760(aliases.c:558)
at irInfoGet+61(irinfo.c:143)
at irAliasMustBeAliases+59(aliases.c:112)
at update_callvector+4976(inline.c:284)

Many bugs were reported for JVM crast at acGetOperand in JRockit R27.x
But no bugs are reported exactly with the same stack trace.
Regarding a workaround, the below stack is actually misleading us. It does not give us a clue about the reasons for the crash (whether it is happening due to concurrent GC or parallel GC or Compaction etc.), so we cannot really say what GC settings would avoid it.
I recommend that we collect another textual dump if the crash occurs again and hope that the stack trace generated the next time will give us better insight into the root cause.
Another suggestion would be to upgrade to R28.x

Similar Messages

  • JRockit JVM Crashed with the following dump

    I am using JRockit VM as the JVM for the Integrated Weblogic Server with JDeveloper. I got this dump, when I was debugging my application. Just thought of sharing it here.
    [JRockit] ERROR: The JVM has crashed. Writing crash information to /scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/jrockit.18628.dump.
    ===== BEGIN DUMP =============================================================
    JRockit dump produced after 0 days, 00:46:27 on Sat Aug 20 19:49:11 2011
    * If you see this dump, please go to *
    * http://download.oracle.com/docs/cd/E15289_01/go2troubleshooting.html *
    * for troubleshooting information. *
    Additional information is available in:
    /scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/jrockit.18628.dump
    No snapshot file (core dump) will be created because core dumps have been
    disabled. To enable core dumping, try "ulimit -c unlimited"
    before starting JRockit again.
    Error Message: Illegal memory access. [54]
    Signal info : si_signo=11, si_code=1 si_addr=0x13
    Version : Oracle JRockit(R) R28.1.3-11-141760-1.6.0_24-20110301-1432-linux-x86_64
    CPU : Intel Core 2 SSE SSE2 SSE3 SSSE3 SSE4.1 Core Intel64
    Number CPUs : 2
    Tot Phys Mem : 3978702848 (3794 MB)
    OS version : Red Hat Enterprise Linux Server release 5.4 (Tikanga)
    Linux version 2.6.18-164.0.0.0.1.el5 ([email protected]) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-46)) #1 SMP Thu Sep 3 00:21:28 EDT 2009 (x86_64)
    Thread System: Linux NPTL
    LibC release : 2.5-stable
    Java locking : Normal
    State : JVM is running
    Command Line : -Xms256M -Xmx1536M -Dweblogic.Name=DefaultServer -Djava.security.policy=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/weblogic.policy -agentlib:jdwp=transport=dt_socket,server=y,address=8986 -Djavax.net.ssl.trustStore=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/DemoTrust.jks -Doracle.adfm.usemds=true -DAFLOG_ECHOED=Y -DAFLOG_ECHOED_PATTERN="[%t][%c][%m][%x]" -DAFLOG_ENABLED=Y -DAFLOG_LEVEL=FINEST -DAFLOG_MODULE=oracle.apps.projects.% -Djbo.debugoutput=silent -Djbo.jdbc.trace=false -Djbo.logging.trace.threshold=1 -Dweblogic.nodemanager.ServiceEnabled=true -Xverify:none -da -Dplatform.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3 -Dwls.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server -Dweblogic.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server -Djps.app.credential.overwrite.allowed=true -Dcommon.components.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common -Djrf.version=11.1.1 -Dorg.apache.commons.logging.Log=org.apache.commons.logging.impl.Jdk14Logger -Ddomain.home=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain -Djrockit.optfile=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.jrf_11.1.1/jrocket_optfile.txt -Doracle.server.config.dir=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig/servers/DefaultServer -Doracle.domain.config.dir=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig -Djava.util.logging.manager=oracle.core.ojdl.logging.ODLLogManager -Digf.arisidbeans.carmlloc=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig/carml -Digf.arisidstack.home=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig/arisidprovider -Doracle.security.jps.config=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/config/fmwconfig/jps-config.xml -Doracle.deployed.app.dir=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/servers/DefaultServer/tmp/_WL_user -Doracle.deployed.app.ext=/- -Dweblogic.alternateTypesDirectory=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.ossoiap_11.1.1,/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.oamprovider_11.1.1 -Djava.protocol.handler.pkgs=oracle.mds.net.protocol -Dweblogic.jdbc.remoteEnabled=false -Dwsm.repository.path=/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/oracle/store/gmds -Datgpf.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Doracle.fusion.appsMode=true -DUSE_JAAS=false -Djps.policystore.hybrid.mode=false -Djps.combiner.optimize.lazyeval=true -Djps.combiner.optimize=true -Djps.auth=ACC -Doracle.core.ojdl.logging.usercontextprovider=oracle.core.ojdl.logging.impl.UserContextImpl -Xverify:none -Doracle.webcenter.analytics.disable-native-partitioning=false -Doracle.webcenter.tagging.scopeTags=false -Doracle.webcenter.framework.service.LOAD_FROM_MDS=true -Doracle.webcenter.framework.resource.authorizerClass.oracle.webcenter.page=oracle.webcenter.spaces.internal.model.GroupSpacePageResourceAuthorizer -Djrockit.codegen.newlockmatching=true -Dwc.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Dportlet.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Dweblogic.ejb.container.MDBDestinationPollIntervalMillis=30000 -Dweblogic.mdb.message.MinimizeAQSessions=true -Doracle.jdbc.createDescriptorUseCurrentSchemaForSchemaName=true -Djbo.ampool.minavailablesize=0 -Djbo.recyclethreshold=25 -Dbip.client.config.dir=/home/xxxxxxxx/XMLPClientConfigDir -Dweblogic.SocketReaders=3 -Djava.awt.headless=true -Dweblogic.transaction.blocking.commit=true -Dweblogic.transaction.blocking.rollback=true -Doracle.ecsf.crawl.mode.debug=true -Doracle.ecsf.applcore.session.enabled=true -DLWSSESSIONCONTEXT=oracle.apps.fnd.applcore.common.ApplSessionManagement -Dlog4j.debug=true -Djps.app.credential.overwrite.allowed=true -Dodi.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Dess.oracle.home=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper -Dweblogic.management.discover=true -Dwlw.iterativeDev= -Dwlw.testConsole= -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_wls1035/profiles/default/sysext_manifest_classpath:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_jdev1111/profiles/default/sysext_manifest_classpath -Dsun.java.launcher=SUN_STANDARD weblogic.Server
    Repository : /tmp/2011_08_20_19_02_53_18628
    java.home : /scratch/software/bea/jrockit/jre
    j.class.path : /scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.jdbc_11.1.1/ojdbc6dms.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_wls1035/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_jdev1111/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/scratch/software/bea/jrockit/lib/tools.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/weblogic_sp.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/weblogic.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/modules/features/weblogic.server.modules_10.3.5.0.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/webservices.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/wcps-lib/derby-10.6.1.0.jar:/scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/wcps-lib/derbytools-10.6.1.0.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper/modules/oracle.ess_11.1.1/ess-sec.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper/webcenter/modules/oracle.portlet.server_11.1.1/oracle-portlet-api.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/oracle_common/modules/oracle.jrf_11.1.1/jrf.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/jdeveloper/webcenter/modules/wcps_11.1.1.4.0/wcps-connection-mbeans.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/common/derby/lib/derbyclient.jar:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/lib/xqrl.jar
    j.lib.path : /scratch/software/bea/jrockit/jre/lib/amd64/jrockit:/scratch/software/bea/jrockit/jre/lib/amd64:/scratch/software/bea/jrockit/jre/../lib/amd64:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_wls1035/profiles/default/native:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_jdev1111/profiles/default/native:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/lib/i386/server:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/lib/i386:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/../lib/i386:/usr/lib:/ade/xxxxxxxx_fixcommit/dmsc/lib:/ade/xxxxxxxx_fixcommit/ldap/bin:/ade/xxxxxxxx_fixcommit/oracle/lib:/ade/xxxxxxxx_fixcommit/atgpf/lib/linuxx64:/ade/xxxxxxxx_fixcommit/fusionapps/lib/linuxx64:/ade/xxxxxxxx_fixcommit/fusionapps/hcm/pyt/lib/linuxx64:/ade/xxxxxxxx_fixcommit/bishiphome/dist/clients/epm/Essbase/EssbaseRTC/bin:/ade/xxxxxxxx_fixcommit/opmn/lib:/ade/xxxxxxxx_fixcommit/fatp/linuxx64/demantra/bin:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/native/linux/i686:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/native/linux/i686/oci920_8
    JAVA_HOME : /scratch/software/bea/jrockit
    JAVAOPTIONS: <not set>
    LD_LIBRARY_PATH: /scratch/software/bea/jrockit/jre/lib/amd64/jrockit:/scratch/software/bea/jrockit/jre/lib/amd64:/scratch/software/bea/jrockit/jre/../lib/amd64:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_wls1035/profiles/default/native:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/patch_jdev1111/profiles/default/native:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/lib/i386/server:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/lib/i386:/ade_autofs/ade_fusion_linux/JDK6_MAIN_LINUX.rdd/090126.6.11.FCS.B03/jdk6/jre/../lib/i386:/usr/lib:/ade/xxxxxxxx_fixcommit/dmsc/lib:/ade/xxxxxxxx_fixcommit/ldap/bin:/ade/xxxxxxxx_fixcommit/oracle/lib:/ade/xxxxxxxx_fixcommit/atgpf/lib/linuxx64:/ade/xxxxxxxx_fixcommit/fusionapps/lib/linuxx64:/ade/xxxxxxxx_fixcommit/fusionapps/hcm/pyt/lib/linuxx64:/ade/xxxxxxxx_fixcommit/bishiphome/dist/clients/epm/Essbase/EssbaseRTC/bin:/ade/xxxxxxxx_fixcommit/opmn/lib:/ade/xxxxxxxx_fixcommit/fatp/linuxx64/demantra/bin:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/native/linux/i686:/scratch/software/mw_local/FMWTOOLS_11.1.1.5.0_GENERIC_110330.1115/xxxxxxxx/mw_home/wlserver_10.3/server/native/linux/i686/oci920_8
    LD_ASSUME_KERNEL: <not set>
    LD_PRELOAD : <not set>
    StackOverFlow: 0 StackOverFlowErrors have occured
    OutOfMemory : 0 OutOfMemoryErrors have occured
    C Heap : Good; no memory allocations have failed
    GC Strategy : Mode: throughput, with strategy: genparpar (basic strategy: genparpar)
    GC Status : OC is not running. Last finished OC was OC#18.
    : YC is not running. Last finished YC was YC#150.
    YC Promotion : Last YC successfully promoted all objects
    YC History : Ran 7 YCs before OC#14.
    : Ran 3 YCs before OC#15.
    : Ran 26 YCs before OC#16.
    : Ran 9 YCs before OC#17.
    : Ran 18 YCs before OC#18.
    : Ran 9 YCs since last OC.
    Heap : 0xa0000000 - 0xbf417000 (Size: 500 MB)
    Heap History : OC#7 - 0xb0000000 (256 MB -> 303 MB; +47856 KB)
    : OC#11 - 0xb2ebc000 (303 MB -> 343 MB; +41060 KB)
    : OC#12 - 0xb56d5000 (343 MB -> 393 MB; +51672 KB)
    : OC#15 - 0xb894b000 (393 MB -> 443 MB; +50700 KB)
    : OC#16 - 0xbbace000 (443 MB -> 500 MB; +58660 KB)
    Compaction : (no compaction area)
    Allocation : TLA-min: 2048, TLA-preferred: 65536 TLA-waste limit: 2048
    NurseryList : 0xa1ac4930 - 0xb2659cf8
    KeepArea : 0xad7221e8 - 0xaea1a448
    KA Markers : [ 0xad7221e8,  0xaea1a448 , 0xb2659cf8 ]
    Forbidden A : (none)
    Previous KA : 0xaea1a448 - 0xb2659cf8
    Previous FA : (none)
    CompRefs : References are compressed, with heap base 0x0 and shift 0.
    Registers (from ThreadContext: 0x40ee7820:
    rax = 0000000000000000 rcx = 74752f6176616a4c
    rdx = 0000000040ee7d60 rbx = 0000000000000000
    rsp = 0000000040ee7c60 rbp = 0000000040ee7c90
    rsi = 0000000000000001 rdi = 000000000d0b37e0
    r8 = 003b7465532f6c69 r9 = 0000000000000001
    r10 = 0000000000000000 r11 = 0000000000000001
    r12 = 0000000000000001 r13 = 0000000040ee7d58
    r14 = 0000000040ee7d60 r15 = 000000000db4d368
    cs = 0000000000000033 fs = 0000000400000000
    gs = 0004000000000000
    rip = 00002ad027bc7a63 flags = 0000000000000202
    Loaded modules:
    (* denotes the module where the exception occured)
    0000000000400000-0000000000412703 /scratch/software/bea/jrockit/bin/java
    000000379b800000-000000379b801f93 /lib64/libdl.so.2
    000000379c000000-000000379c0156ff /lib64/libpthread.so.0
    000000379b400000-000000379b54ced7 /lib64/libc.so.6
    000000379a400000-000000379a41bb3f /lib64/ld-linux-x86-64.so.2
    00002ad027a60000-00002ad027d65343 */scratch/software/bea/jrockit/jre/lib/amd64/jrockit/libjvm.so
    00002ad02803f000-00002ad02805d9eb /scratch/software/bea/jrockit/jre/lib/amd64/libosal.so
    00002ad028260000-00002ad02826c4fb /scratch/software/bea/jrockit/jre/lib/amd64/libutil.so
    000000379bc00000-000000379bc8122f /lib64/libm.so.6
    000000379f400000-000000379f406e8b /lib64/librt.so.1
    00002aaaaac00000-00002aaaaac35c17 /scratch/software/bea/jrockit/jre/lib/amd64/libjdwp.so
    00002aaaaad3f000-00002aaaaad41307 /scratch/software/bea/jrockit/jre/lib/amd64/libnpt.so
    00002aaaaae49000-00002aaaaae54d03 /scratch/software/bea/jrockit/jre/lib/amd64/libjfr.so
    00002aaaee50b000-00002aaaee517337 /scratch/software/bea/jrockit/jre/lib/amd64/libverify.so
    00002aaaee61a000-00002aaaee64219b /scratch/software/bea/jrockit/jre/lib/amd64/libjava.so
    00000037a2000000-00000037a20140c7 /lib64/libnsl.so.1
    00002aaaee789000-00002aaaee78f5bf /scratch/software/bea/jrockit/jre/lib/amd64/native_threads/libhpi.so
    00002aaaee954000-00002aaaee961bc3 /scratch/software/bea/jrockit/jre/lib/amd64/libzip.so
    00002aaaeeb28000-00002aaaeeb2ae73 /scratch/software/bea/jrockit/jre/lib/amd64/libdt_socket.so
    00002aaaeec7b000-00002aaaeec8464b /lib64/libnss_files.so.2
    00002aaaef086000-00002aaaef098d1f /scratch/software/bea/jrockit/jre/lib/amd64/libnet.so
    00002aaaef652000-00002aaaef657f43 /scratch/software/bea/jrockit/jre/lib/amd64/liborii.so
    00002aaaef919000-00002aaaef91f97b /scratch/software/bea/jrockit/jre/lib/amd64/libnio.so
    00002aaaf4840000-00002aaaf484547b /scratch/software/bea/jrockit/jre/lib/amd64/libmanagement.so
    00002aaaf740f000-00002aaaf7418bbb /scratch/software/bea/jrockit/jre/lib/amd64/libjmapi.so
    00002aab02cbe000-00002aab02cbe8bb /scratch/software/bea/jrockit/jre/lib/amd64/librmi.so
    00002aab05c3e000-00002aab05ccf86b /scratch/software/bea/jrockit/jre/lib/amd64/libawt.so
    00002aab05e0d000-00002aab05e1199f /scratch/software/bea/jrockit/jre/lib/amd64/headless/libmawt.so
    00002aab09453000-00002aab094cb21f /scratch/software/bea/jrockit/jre/lib/amd64/libfontmanager.so
    Stack:
    (* marks the word pointed to by the stack pointer)
    0000000040ee7c60: 000000000d133ac0* 00002aaaf31531d0 0000000000000000 0000000040ee7d50
    0000000040ee7c80: 0000000040ee7d58 000000000d0b37e0 0000000040ee7cd0 00002ad027bb10bf
    0000000040ee7ca0: 0000000000000001 0000000000000064 000000000dd11ed0 000000000d0b37e0
    0000000040ee7cc0: 0000000040ee7d60 0000000040ee7d58 0000000040ee7d40 00002ad027bb2404
    0000000040ee7ce0: 0000000040ee7d60 000000000dd11ed0 0000000040ee7d50 00002aab08b2ea20
    0000000040ee7d00: 0000000012469d70 00002aab08b2ea20 00002aab08b25a38 00002aaaaad360f0
    Code:
    (* marks the word pointed to by the instruction pointer)
    00002ad027bc7a00: 00401f0fd7ebed31 480010b89f058d4c 8d48001249050d8d 3d8d48001025bb35
    00002ad027bc7a20: 000018ba001024f1 ffed6d18e8c03100 2e66666666669eeb 0000000000841f0f
    00002ad027bc7a40: e865894ce5894855 48f48949f875894c 48f06d894ce05d89 8949f6854830ec83
    00002ad027bc7a60: 481246b70f4d74d6* 4c01688d4cd8558d 85fffffd99e8ee89 7d8b481775c389c0
    00002ad027bc7a80: ea894c24348b49d8 458b48ffed793be8 8b4cd889068949d8 8b4ce05d8b48e865
    00002ad027bc7aa0: c3c9f8758b4cf06d 0000000000841f0f 89fffffea9e8f631 0000441f0fd9ebc3
    Last optimized methods:
    No methods optimized.
    Thread:
    "JDWP Transport Listener: dt_soc" id=10 idx=0x30 tid=18640 lastJavaFrame=0xfffffffffffffffc
    Stack 0: start=0x40ea7000, end=0x40ee9000, guards=0x40eac000 (ok), forbidden=0x40eaa000
    Thread Stack Trace:
    at jvmtiIStrdup+35(jvmtimemory.c:111)@0x2ad027bc7a63
    at get_name_and_signatures+110(jvmticlass.c:931)@0x2ad027bb10bf
    at jvmti_GetFieldName+611(jvmticlass.c:283)@0x2ad027bb2404
    at fieldSignature+108()@0x2aaaaac27bdd
    -- Java stack --
    Memory usage report:
    Total mapped 3530424KB (reserved=2192956KB)
    - Java heap 1572864KB (reserved=1060772KB)
    - GC tables 52620KB
    - Thread stacks 32156KB (#threads=84)
    - Compiled code 1048576KB (used=37710KB)
    - Internal 1416KB
    - OS 298768KB
    - Other 192248KB
    - Classblocks 18688KB (malloced=18313KB #46446)
    Not tracing sites.
    - Java class data 312064KB (malloced=310392KB #215032 in 46446 classes)
    Not tracing sites.
    - Native memory tracking 1024KB (malloced=153KB #10)
    Not tracing sites.
    Set the env variable TRACE_ALLOC_SITES=1 or use the print_memusage switch
    trace_alloc_sites=true to enable alloc site tracing.
    * If you see this dump, please go to *
    * http://download.oracle.com/docs/cd/E15289_01/go2troubleshooting.html *
    * for troubleshooting information. *
    ===== END DUMP ===============================================================
    /scratch/xxxxxxxx/view_storage/xxxxxxxx_fixcommit/.jdev_user_home/system11.1.1.5.37.59.86/DefaultDomain/bin/startWebLogic.sh: line 180: 18628 Aborted ${JAVA_HOME}/bin/java ${JAVA_VM} ${MEM_ARGS} -Dweblogic.Name=${SERVER_NAME} -Djava.security.policy=${WL_HOME}/server/lib/weblogic.policy ${JAVA_OPTIONS} ${PROXY_SETTINGS} ${SERVER_CLASS}
    Debugger connection to debuggee process has been lost.
    [Server Instance IntegratedWebLogicServer is shutting down.  All applications currently running will be terminated and undeployed.]

    Hi DH,
    This is a known issue to the engineering team and a future release will include a fix for this. Unfortunately, at this point there is no work around available.
    I will recommend that you keep an eye on our release notes page to get more updates on it - Release notes | Adobe Muse CC
    - Abhishek Maurya

  • JRockit JVM crash

    Hi,
    We are using JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2105-windows-ia32 with Weblogic 10.3 on Windows XP SP3 as well as Redhat 5.2.
    There is a JVM crash (code generation) when hashCode() in called on a String. Error message is: Illegal memory access. We have tried turning off optimization using -XnoOpt as well -Xnoopt without success. Crash is seen on both the platforms.
    Any suggestions or work arounds will be very much appreciated. Dump is given in the end of email.
    Thanks,
    Ajit
    ===== BEGIN DUMP =============================================================
    JRockit dump produced after 0 days, 00:06:07 on Thu Apr 16 12:07:54 2009
    * If you see this dump, please go to *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information. *
    Additional information is available in:
    D:\tools\bea103\user_projects\domains\cim8\jrockit.4588.dump
    D:\tools\bea103\user_projects\domains\cim8\jrockit.4588.mdmp
    Error Message: Illegal memory access. [54]
    Exception Rec: EXCEPTION_ACCESS_VIOLATION (c0000005) at 0x0046D11A - memory at 0x0000001B could not be read.
    Minidump : Wrote mdmp. Size is 770MB
    SafeDllMode : -1
    Version : BEA JRockit(R) R27.6.0-50_o-100423-1.6.0_05-20080626-2105-windows-ia32
    GC Strategy : Mode: throughput. Currently using strategy: genparpar
    GC Status : OC is not running. Last finished OC was OC#4.
    : YC is not running. Last finished YC was YC#14.
    OC History : Strategy genparpar was used for OC#1 to OC#4.
    YC History : Ran 5 YCs before OC#1.
    : Ran 7 YCs before OC#2.
    : Ran 1 YCs before OC#3.
    : Ran 1 YCs before OC#4.
    : Ran 0 YCs since last OC.
    YC Promotion : Last YC successfully promoted all objects
    Heap : 0x00C00000 - 0x20C00000 (Size: 512 MB)
    Compaction : 0x02C00000 - 0x04C00000 (Current compaction type: internal)
    NurseryList : 0x00F09148 - 0x0F8F6BE8
    KeepArea : 0x101E3398 - 0x0FA7BB38
    NurseryMarker: [ 0x101E3398,  0x0FA7BB38 ]
    CompRefs : References are 32-bit.
    CPU : Intel Pentium 4 SSE SSE2 SSE3 NetBurst EM64T
    Number CPUs : 2
    Tot Phys Mem : 3489136640 (3327 MB)
    OS version : Microsoft Windows XP version 5.1 Service Pack 3 (Build 2600) (32-bit)
    Thread System: Windows Threads
    Java locking : Normal
    State : JVM is running
    Command Line : -Xms512m -Xmx512m -Xverify:none -da -Dplatform.home=D:\tools\bea103\WLSERV~1.3 -Dwls.home=D:\tools\bea103\WLSERV~1.3\server -Dweblogic.home=D:\tools\bea103\WLSERV~1.3\server -Dweblogic.management.discover=true -Dwlw.iterativeDev= -Dwlw.testConsole= -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=d:\tools\bea103\patch_wls1030\profiles\default\sysext_manifest_classpath;d:\tools\bea103\patch_cie660\profiles\default\sysext_manifest_classpath -Dweblogic.Name=AdminServer -Dtangosol.coherence.cacheconfig=d:/work/cim72/venus_dist_wlg/config/coherence-client-cache-config.xml -Dtangosol.coherence.override=d:/work/cim72/venus_dist_wlg/config/tangosol-coherence-override.xml -DMQ_HOME=d:/work/cim72/venus_dist_wlg -Dtangosol.coherence.log=d:/work/cim72/venus_dist_wlg/tangosol.log -DMQ_CONFIG_FILE=d:/work/cim72/venus_dist_wlg/config/ConfigValues.xml -DMQ_COMMON_DIR=d:/work/common/dev72 -DOS=Windows_NT -DORACLE_HOME=C:\oracle\ora92 -DNODE_ID=Amar -DMQ_LOG=d:/work/cim72/venus_dist_wlg/log -Xdebug -Xnoagent -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=5005 -Djavax.xml.transform.TransformerFactory=org.apache.xalan.processor.TransformerFactoryImpl -Djava.security.policy=D:\tools\bea103\WLSERV~1.3\server\lib\weblogic.policy -Dsun.java.launcher=SUN_STANDARD weblogic.Server
    java.home : d:\tools\bea103\JROCKI~1\jre
    j.class.path : ;d:\tools\bea103\patch_wls1030\profiles\default\sys_manifest_classpath\weblogic_patch.jar;d:\tools\bea103\patch_cie660\profiles\default\sys_manifest_classpath\weblogic_patch.jar;d:\tools\bea103\JROCKI~1\lib\tools.jar;D:\tools\bea103\WLSERV~1.3\server\lib\weblogic_sp.jar;D:\tools\bea103\WLSERV~1.3\server\lib\weblogic.jar;d:\tools\bea103\modules\features\weblogic.server.modules_10.3.0.0.jar;D:\tools\bea103\WLSERV~1.3\server\lib\webservices.jar;d:\tools\bea103\modules\ORGAPA~1.5/lib/ant-all.jar;d:\tools\bea103\modules\NETSFA~1.0_1/lib/ant-contrib.jar;;D:\tools\bea103\WLSERV~1.3\common\eval\pointbase\lib\pbclient57.jar;D:\tools\bea103\WLSERV~1.3\server\lib\xqrl.jar;;;d:/work/cim72/venus_dist_wlg/lib/external/serializer.jar;d:/work/cim72/venus_dist_wlg/lib/external/UserInfoService.jar;
    j.lib.path : d:\tools\bea103\JROCKI~1\bin;.;C:\WINDOWS\system32;C:\WINDOWS;d:\tools\bea103\patch_wls1030\profiles\default\native;d:\tools\bea103\patch_cie660\profiles\default\native;D:\tools\bea103\WLSERV~1.3\server\native\win\32;D:\tools\bea103\WLSERV~1.3\server\bin;d:\tools\bea103\modules\ORGAPA~1.5\bin;d:\tools\bea103\JROCKI~1\jre\bin;d:\tools\bea103\JROCKI~1\bin;C:\tools\WebSphereMQ\Java\lib;C:\oracle\ora92\bin;C:\Program Files\O0racle\jre\1.3.1\bin;C:\Program Files\Oracle\jre\1.1.8\bin2;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\tools\apache-ant-1.5.4\bin;C:\tibco\tibrv\BIN;D:\bea81\jdk142_11\bin;D:\DB2\IBM\SQLLIB\BIN;D:\DB2\IBM\SQLLIB\FUNCTION;D:\DB2\IBM\SQLLIB\SAMPLES\REPL;D:/work/cim70HF1/venus_dist_was/bin/db2ldr;C:\tools\WebSphereMQ\bin;C:\tools\WebSphereMQ\tools\c\samples\bin;D:\tools\bea103\WLSERV~1.3\server\native\win\32\oci920_8
    JAVA_HOME : d:\tools\bea103\JROCKI~1
    JAVAOPTIONS: <not set>
    PATH : d:\tools\bea103\JROCKI~1\jre\bin;d:\tools\bea103\patch_wls1030\profiles\default\native;d:\tools\bea103\patch_cie660\profiles\default\native;D:\tools\bea103\WLSERV~1.3\server\native\win\32;D:\tools\bea103\WLSERV~1.3\server\bin;d:\tools\bea103\modules\ORGAPA~1.5\bin;d:\tools\bea103\JROCKI~1\jre\bin;d:\tools\bea103\JROCKI~1\bin;C:\tools\WebSphereMQ\Java\lib;C:\oracle\ora92\bin;C:\Program Files\O0racle\jre\1.3.1\bin;C:\Program Files\Oracle\jre\1.1.8\bin2;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;D:\tools\apache-ant-1.5.4\bin;C:\tibco\tibrv\BIN;D:\bea81\jdk142_11\bin;D:\DB2\IBM\SQLLIB\BIN;D:\DB2\IBM\SQLLIB\FUNCTION;D:\DB2\IBM\SQLLIB\SAMPLES\REPL;D:/work/cim70HF1/venus_dist_was/bin/db2ldr;C:\tools\WebSphereMQ\bin;C:\tools\WebSphereMQ\tools\c\samples\bin;D:\tools\bea103\WLSERV~1.3\server\native\win\32\oci920_8
    C Heap : Good; no memory allocations have failed
    Method : com/martquest/entity/roleassignment/RoleAssignmentEntPKey.hashCode()I
    StackOverFlow: 0 StackOverFlowErrors have occured
    OutOfMemory : 0 OutOfMemoryErrors have occured
    Registers (from ThreadContext: 0x256BED00 / OS context: 0x256BF0EC):
    eax = 0000001b ecx = 2ff00210 edx = 2ff00960 ebx = 2ff07a40
    esp = 256bf3b8 ebp = 2ff04a28 esi = 256bf574 edi = 2f5626e8
    es = 00000023 cs = 0000001b ss = 00000023 ds = 00000023
    fs = 0000003b gs = 00000000
    eip = 0046d11a eflags = 00010202
    Stack:
    (* marks the word pointed to by the stack pointer)
    256bf3b8: 256bf574* 256bf5b5 000000b5 000000a9 00000000 0047b101
    256bf3d0: 0000001b 2ff079b0 00000000 00000039 256bf574 00000038
    256bf3e8: 000000a9 2432042c 256bf424 00000030 0042f73c 256bf5b5
    256bf400: 00000039 2ff04a28 2ff048e0 2ff04a28 00000042 00000005
    Code:
    (* marks the word pointed to by the instruction pointer)
    0046d0e8: 6a57006a e8515302 0003419c 833c468b c08540c4 0e8b5a75
    0046d100: c085018b 008b0274 082440f6 518b4a75 003a830c 448b4274
    0046d118: 108b1824* 0000e281 fa811ff0 00100000 d2330474 408b05eb
    0046d130: 8b108b18 74c08501 f6008b02 74082440 ebc03304 0c498b05
    Loaded modules:
    (* denotes the module causing the exception)
    00400000-00410fff d:\tools\bea103\JROCKI~1\bin\java.exe
    7c900000-7c9aefff C:\WINDOWS\system32\ntdll.dll
    7c800000-7c8f5fff C:\WINDOWS\system32\kernel32.dll
    77dd0000-77e6afff C:\WINDOWS\system32\ADVAPI32.dll
    77e70000-77f01fff C:\WINDOWS\system32\RPCRT4.dll
    77fe0000-77ff0fff C:\WINDOWS\system32\Secur32.dll
    77c10000-77c67fff C:\WINDOWS\system32\MSVCRT.dll
    7c340000-7c395fff d:\tools\bea103\JROCKI~1\jre\bin\msvcr71.dll
    00420000-006c3fff *d:\tools\bea103\JROCKI~1\jre\bin\jrockit\jvm.dll
    76b40000-76b6cfff C:\WINDOWS\system32\WINMM.dll
    77f10000-77f58fff C:\WINDOWS\system32\GDI32.dll
    7e410000-7e4a0fff C:\WINDOWS\system32\USER32.dll
    71ab0000-71ac6fff C:\WINDOWS\system32\WS2_32.dll
    71aa0000-71aa7fff C:\WINDOWS\system32\WS2HELP.dll
    6d410000-6d438fff d:\tools\bea103\JROCKI~1\jre\bin\jdwp.dll
    6d770000-6d775fff d:\tools\bea103\JROCKI~1\jre\bin\npt.dll
    6d820000-6d82bfff d:\tools\bea103\JROCKI~1\jre\bin\verify.dll
    6d3c0000-6d3defff d:\tools\bea103\JROCKI~1\jre\bin\java.dll
    6d320000-6d327fff d:\tools\bea103\JROCKI~1\jre\bin\hpi.dll
    6d860000-6d86efff D:\tools\bea103\jrockit_160_05\jre\bin\zip.dll
    6d290000-6d296fff d:\tools\bea103\JROCKI~1\jre\bin\dt_socket.dll
    71a50000-71a8efff C:\WINDOWS\system32\mswsock.dll
    662b0000-66307fff C:\WINDOWS\system32\hnetcfg.dll
    71a90000-71a97fff C:\WINDOWS\System32\wshtcpip.dll
    6d620000-6d632fff D:\tools\bea103\jrockit_160_05\jre\bin\net.dll
    00bf0000-00bf7fff C:\WINDOWS\System32\winrnr.dll
    237e0000-23806fff C:\WINDOWS\system32\DNSAPI.dll
    23810000-2383bfff C:\WINDOWS\system32\WLDAP32.dll
    23840000-2384dfff C:\Program Files\Neoteris\Secure Application Manager\samnsp.dll
    23870000-23888fff C:\WINDOWS\system32\iphlpapi.dll
    238a0000-238a5fff C:\WINDOWS\system32\rasadhlp.dll
    6d570000-6d578fff D:\tools\bea103\jrockit_160_05\jre\bin\management.dll
    6d640000-6d648fff D:\tools\bea103\jrockit_160_05\jre\bin\nio.dll
    68000000-68035fff C:\WINDOWS\system32\rsaenh.dll
    769c0000-76a73fff C:\WINDOWS\system32\USERENV.dll
    5b860000-5b8b4fff C:\WINDOWS\system32\netapi32.dll
    229c0000-229cafff D:\tools\bea103\jrockit_160_05\jre\bin\jmapi.dll
    229d0000-229ddfff D:\tools\bea103\wlserver_10.3\server\native\win\32\wlfileio2.dll
    25c10000-25c27fff C:\WINDOWS\system32\MPRAPI.dll
    77cc0000-77cf1fff C:\WINDOWS\system32\ACTIVEDS.dll
    25c30000-25c54fff C:\WINDOWS\system32\adsldpc.dll
    76b20000-76b30fff C:\WINDOWS\system32\ATL.DLL
    774e0000-7761cfff C:\WINDOWS\system32\ole32.dll
    25c60000-25ceafff C:\WINDOWS\system32\OLEAUT32.dll
    25cf0000-25cfdfff C:\WINDOWS\system32\rtutils.dll
    71bf0000-71c02fff C:\WINDOWS\system32\SAMLIB.dll
    77920000-77a12fff C:\WINDOWS\system32\SETUPAPI.dll
    25d40000-25d44fff D:\tools\bea103\wlserver_10.3\server\native\win\32\wlntio.dll
    6d800000-6d807fff D:\tools\bea103\jrockit_160_05\jre\bin\sunmscapi.dll
    77a80000-77b14fff C:\WINDOWS\system32\CRYPT32.dll
    77b20000-77b31fff C:\WINDOWS\system32\MSASN1.dll
    76bf0000-76bfafff C:\WINDOWS\system32\psapi.dll
    6d7c0000-6d7c5fff D:\tools\bea103\jrockit_160_05\jre\bin\rmi.dll
    34340000-34452fff d:\tools\bea103\JROCKI~1\jre\bin\dbghelp.dll
    "[ACTIVE] ExecuteThread: '0' for" id=17 idx=0x44 tid=4552 lastJavaFrame=0x256BF874
    Stack 0: start=0x25680000, end=0x256C0000, guards=0x25683000 (ok), forbidden=0x25681000
    Thread Stack Trace:
    at modelPutField+458(efield.c:198+38)@0x0046D11A
    at generateExpression+3841(expression.c:723+16)@0x0047B101
    at generate_block+220(bc2hir.c:1284+0)@0x0042F73C
    at generateIRFromOffset+262(bc2hir.c:1042+6)@0x0042FB16
    at cgTranslateBC2HIR+87(bc2hir.c:172+0)@0x004305D7
    at cmgrGenerateMethodFromPhase+121(codemanager.c:1107+25)@0x0044B719
    at cmgrGenerateNormalMethod+81(codemanager.c:773+0)@0x0044C1B1
    at cmgrGenerateCode+157(codemanager.c:732+0)@0x0044CA9D
    at generate_code2+187(methodaccess.c:735+14)@0x005410CB
    at generate_code+421(methodaccess.c:376+7)@0x00541AC5
    at get_runnable_codeinfo2+157(methodaccess.c:508+10)@0x00541BED
    at RJNI_jrockit_vm_RNI_generateVirtualCode+266(methodaccess.c:646+11)@0x00541F1A
    -- Java stack --
    at jrockit/vm/RNI.generateVirtualCode(Ljava/lang/Object;II)I(Native Method)
    at com/martquest/entity/roleassignment/RoleAssignmentEntPKey.hashCode(RoleAssignmentEntPKey.java:0)
    at weblogic/ejb/container/cache/CacheKey.<init>(CacheKey.java:26)
    at weblogic/ejb/container/manager/DBManager.create(DBManager.java:1480)
    at weblogic/ejb/container/manager/DBManager.remoteCreate(DBManager.java:1360)
    at weblogic/ejb/container/internal/EntityEJBHome.create(EntityEJBHome.java:272)
    at com/martquest/entity/roleassignment/RoleAssignmentEnt_d9pexc_HomeImpl.create(RoleAssignmentEnt_d9pexc_HomeImpl.java:74)
    at com/martquest/session/role/RoleAssignmentSsnBean.createRoleAssignment(RoleAssignmentSsnBean.java:149)
    at com/martquest/session/role/RoleAssignmentSsn_dgtk4w_EOImpl.createRoleAssignment(RoleAssignmentSsn_dgtk4w_EOImpl.java:644)
    at com/martquest/eml/member/MemberViewServlet.insert(MemberViewServlet.java:1665)
    at com/martquest/eml/member/MemberViewServlet.routeAction(MemberViewServlet.java:150)
    at com/martquest/eml/member/MemberViewServlet.onService(MemberViewServlet.java:129)
    at com/martquest/eml/MqServlet.service(MqServlet.java:487)
    at javax/servlet/http/HttpServlet.service(HttpServlet.java:820)
    at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
    at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:292)
    at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3495)
    at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic/security/service/SecurityManager.runAs(Lweblogic/security/acl/internal/AuthenticatedSubject;Lweblogic/security/acl/internal/AuthenticatedSubject;Ljava/security/PrivilegedAction;)Ljava/lang/Object;(Unknown Source)
    at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2180)
    at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2086)
    at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1406)
    at weblogic/work/ExecuteThread.execute(ExecuteThread.java:201)
    at weblogic/work/ExecuteThread.run(ExecuteThread.java:173)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    * If you see this dump, please go to *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information. *
    ===== END DUMP ===============================================================

    Looks like JRockit crashes when JIT compiling the method com/martquest/entity/roleassignment/RoleAssignmentEntPKey.hashCode. You can try the latest JRockit version, R27.6.3, which is available from Oracle Support or bundled with JRMC 3.1 here:
    http://www.oracle.com/technology/software/products/jrockit/index.html
    If that doesn't help, I recommend that you open a ticket with Oracle Support and provide the text dump, the core file and compiled RoleAssignmentEntPKey.class; and ask for a JVM patch.
    Henrik

  • JRockit JVM crash using RHEL 4

    Hi,
    I am using BEA JRockit(R) R27.5.0-110-94909-1.5.0_14-20080204-1558-linux-x86_64 on RHEL 4 (update 5) running 64 bit AMD Athlon processor. I got a JVM crash from an application which has been running stable all this time. The crash occured 1 hour after the application was started. The error message is "Illegal memory access". From the older discussion forums in BEA I found that this crash is possibly due to a bug in JIT optimization. Below is the complete dump from the crash. It would be great if someone can confirm that this crash is due to the same bug or something else.
    Thanks,
    Rakesh
    ===== BEGIN DUMP =============================================================
    JRockit dump produced after 0 days, 01:06:20 on Tue Jan 20 10:23:21 2009
    * If you see this dump, please go to *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information. *
    Additional information is available in:
    /ha/apps/bin/jrockit.2041.dump
    No snapshot file (core dump) will be created because core dumps have been
    disabled. To enable core dumping, try "ulimit -c unlimited"
    before starting JRockit again.
    Error Message: Illegal memory access. 54
    Signal info : si_signo=11, si_code=128 si_addr=(nil)
    Version : BEA JRockit(R) R27.5.0-110-94909-1.5.0_14-20080204-1558-linux-x86_64
    GC Strategy : Mode: static, with strategy: singleconcon
    GC Status : OC currently running, in phase: marking. This is OC#746.
    Heap : 0x2d00000 - 0x22d00000 (Size: 512 MB)
    Compaction : 0xdd00000 - 0xe100000 (Current compaction type: internal)
    CompRefs : References are compressed, with heap base 0x0.
    CPU : AMD Opteron/Athlon64 SSE SSE2 SSE3 EM64T
    Number CPUs : 8
    Tot Phys Mem : 67561517056 (64431 MB)
    OS version : Red Hat Enterprise Linux AS release 4 (Nahant Update 4)
    Linux version 2.6.9-42.0.8.ELsmp ([email protected]) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Tue Jan 23 12:49:51 EST 2007 (x86_64)
    Thread System: NPTL
    Java locking : Normal
    State : JVM is running
    Command Line : -Xms512M -Xmx1024M -Xss128M -Xgc:singlecon -XXcompactratio:1 -Djava.ext.dirs=/cms/lib/:/cms/ext/:/ha/apps/lib/:/ha/OracleJar/:/ha/dbwrapper/:.: -DserverID=prod -DSystemProperties=/ha/hi/properties/HITcpBootstrap.prp -Dpid=2041 -Dsun.java.launcher=SUN_STANDARD com.ups.coii.tos.server.TOSServer
    java.home : /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre
    j.class.path : .
    j.lib.path : /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/opt/mqm/java/lib64/:/opt/mqm/java/lib/
    JAVA_HOME : <not set>
    JAVAOPTIONS: <not set>
    LD_LIBRARY_PATH: /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/opt/mqm/java/lib64/:/opt/mqm/java/lib/
    LD_ASSUME_KERNEL: <not set>
    C Heap : Good; no memory allocations have failed
    StackOverFlow: 0 StackOverFlowErrors have occured
    OutOfMemory : 0 OutOfMemoryErrors have occured
    Registers (from ThreadContext: 0x42d82960 / OS context: 0x42d82a20):
    rax = 040000000174c008 rcx = 0000000000000000
    rdx = 0000002a95fe6b70 rbx = 0000000000000002
    rsp = 0000000042d82e60 rbp = 0000000042d82fc0
    rsi = 000000001450000c rdi = 0000000042d82ec0
    r8 = 0000000000000001 r9 = 0000002a96002dac
    r10 = 0000002c7a72c140 r11 = 0000000000000021
    r12 = 0000000000000002 r13 = 0000000042d82ec0
    r14 = 0000002ad6893ff0 r15 = 0000000014500000
    cs = 000000000000ab30 fs = 0000000000000000
    gs = 0000000000000000
    rip = 0000002a95df7d2d flags = 0000000000000246
    Stack:
    (* marks the word pointed to by the stack pointer)
    0000000042d82e60: 0000002ad6893ff0* 0000002ad6893ff0 0000000042d82ec0 0000000042d82f60
    0000000042d82e80: 0000002a961222c0 0000002ad6893ff0 0000000014500008 0000002d00000000
    0000000042d82ea0: 0000000014500008 0000002d00000000 0000000014500008 0000002d00000000
    0000000042d82ec0: 0000000000000000 0000002d00000000 0000000014500008 0000002a00000000
    0000000042d82ee0: 0000000014500000 0000000000000000 00000000004ce628 0000000000000001
    0000000042d82f00: 0000002a00000000 000000001450000c 00000000059165d8 00000000059167d8
    Code:
    (* marks the word pointed to by the instruction pointer)
    0000002a95df7cc8: bd831ceb028b4821 48097503fffffed8 0aebfffffed0858b 48fffffed0858b48
    0000002a95df7ce8: c08548c38948008b 8b4c00000102840f c48949fffffea8b5 48002c1a69058b48
    0000002a95df7d08: e9c148082b48d989 06e8c148c8894803 00000008c5048d48 48002c12b9158b48
    0000002a95df7d28: 008b483fe1830203* 485a7501a8e8d348 8948002c1a32058b 03e9c148082b48d9
    0000002a95df7d48: 8306e8c148c88948 4800000001ba3fe1 048d48d18948e2d3 158b4800000008c5
    0000002a95df7d68: 48020348002c1274 2c1837058b480809 8948087400388300 894cfff7ffa2e8df
    Loaded modules:
    (* denotes the module causing the exception)
    0000000000400000-000000000041196b /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/bin/java
    0000002a9566c000-0000002a9567aff9 /lib64/tls/libpthread.so.0
    0000002a95782000-0000002a9580659b /lib64/tls/libm.so.6
    0000002a95908000-0000002a95909c73 /lib64/libdl.so.2
    0000002a95a0b000-0000002a95b35df9 /lib64/tls/libc.so.6
    0000002a95556000-0000002a9556a34f /lib64/ld-linux-x86-64.so.2
    0000002a95c41000-0000002a95ee448f */opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit/libjvm.so
    0000002a96137000-0000002a9613f95a /lib64/tls/librt.so.1
    0000002a96251000-0000002a9625497b /usr/lib64/libnuma.so
    0000002a96356000-0000002a9635ff13 /lib64/libnss_files.so.2
    0000002a964c1000-0000002a964cd467 /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libverify.so
    0000002a965d0000-0000002a965f321b /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libjava.so
    0000002a96707000-0000002a9671a503 /lib64/libnsl.so.1
    0000002ad69ae000-0000002ad69b463f /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/native_threads/libhpi.so
    0000002ad9a30000-0000002ad9a3dd93 /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libzip.so
    0000002ad9db4000-0000002ad9dc55cf /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libnet.so
    Scan Dump Helper:
    Iterating in objIter over object at address 0x14500000 (seems to be real).
    The reference that caused the crash is a normal field.
    Scanned object [0000000014500000 0000000014500018) of class java/lang/ThreadLocal$ThreadLocalMap
    0x14500000 : 0x004ce580 classblock
    0x14500004 : 0x00000000 flags
    ===> 0x14500008 : 0x00000002 .table [Ljava/lang/ThreadLocal$ThreadLocalMap$Entry; (java/lang/ThreadLocal$ThreadLocalMap)
    0x1450000c : 0x00000002
    0x14500010 : 0x0000000a
    0x14500014 : 0x00000000
    The field that caused the crash is marked with "===>"
    The reference is bogus and pointing outside the heap.
    Only reference to this object from another object is
    object [00000000059191e8 0000000005919278) of class com/ups/coii/thread/util/ThreadPool$PooledThread
    0x59191e8 : 0x017b55f0 classblock
    0x59191ec : 0x80000000 flags
    0x59191f0 : 0x05919280 .name [C (java/lang/Thread)
    0x59191f4 : 0x00000000 .threadQ Ljava/lang/Thread; (java/lang/Thread)
    0x59191f8 : 0x00000000 .target Ljava/lang/Runnable; (java/lang/Thread)
    0x59191fc : 0x02d02ae8 .group Ljava/lang/ThreadGroup; (java/lang/Thread)
    0x5919200 : 0x05d50b48 .contextClassLoader Ljava/lang/ClassLoader; (java/lang/Thread)
    0x5919204 : 0x059192c0 .inheritedAccessControlContext Ljava/security/AccessControlContext; (java/lang/Thread)
    ===> 0x5919208 : 0x14500000 .threadLocals Ljava/lang/ThreadLocal$ThreadLocalMap; (java/lang/Thread)
    0x591920c : 0x059192d8 .inheritableThreadLocals Ljava/lang/ThreadLocal$ThreadLocalMap; (java/lang/Thread)
    0x5919210 : 0x00000000 .blocker Lsun/nio/ch/Interruptible; (java/lang/Thread)
    0x5919214 : 0x05919278 .blockerLock Ljava/lang/Object; (java/lang/Thread)
    0x5919218 : 0x00000000 .uncaughtExceptionHandler Ljava/lang/Thread$UncaughtExceptionHandler; (java/lang/Thread)
    0x591921c : 0x05916d38 .cwObj Ljava/lang/Object; (java/lang/Thread)
    0x5919220 : 0x00000000 .blockObj Ljava/lang/Object; (java/lang/Thread)
    0x5919224 : 0x04102cf0 .waitNext Ljava/lang/Thread; (java/lang/Thread)
    0x5919228 : 0x00000000 .lockNext Ljava/lang/Thread; (java/lang/Thread)
    0x591922c : 0x059191e8 .blockThreadStop Ljava/lang/Object; (java/lang/Thread)
    0x5919230 : 0x00000000 .accessControlContext Ljava/security/AccessControlContext; (java/lang/Thread)
    0x5919234 : 0x00000005
    0x5919238 : 0x00000000
    0x591923c : 0x00000000
    0x5919240 : 0x00000000
    0x5919244 : 0x00000000
    0x5919248 : 0x00000026
    0x591924c : 0x00000000
    0x5919250 : 0xda213db0
    0x5919254 : 0x0000002a
    0x5919258 : 0x00000000
    0x591925c : 0x00000000
    0x5919260 : 0x000001a1
    0x5919264 : 0x00000000
    0x5919268 : 0x00000001
    0x591926c : 0x05916150 .this$0 Lcom/ups/coii/thread/util/ThreadPool; (com/ups/coii/thread/util/ThreadPool$PooledThread)
    0x5919270 : 0x00000000
    0x5919274 : 0x00000000
    "(GC Main Thread)" id=3 idx=0xc tid=2058 lastJavaFrame=0xfffffffffffffffc
    Stack 0: start=0x42d42000, end=0x42d84000, guards=0x42d47000 (ok), forbidden=0x42d45000
    Thread Stack Trace:
    at mmSingleConFollowReferences+481()@0x2a95df7d2d
    at mmSingleConMark+220()@0x2a95df87ab
    at mmMark+82()@0x2a95cab846
    at mmGCMainLoop+101()@0x2a95cab8eb
    at mmGCMainThread+51()@0x2a95ce826e
    at tsiCallStartFunction+67()@0x2a95d62bfb
    at tsiThreadStub+308()@0x2a95d63e05
    at ptiThreadStub+14()@0x2a95dcb277
    at start_thread+138()@0x2a9567210a
    -- Java stack --
    Extended, platform specific info:
    libc release: 2.3.4-stable
    Elf headers:
    libc ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000001c4a0 PHOFF: 0000000000000040 SHOFF: 000000000013c290 EF: 0x0 HS: 64 PS: 56 PHN; 10 SS: 64 SHN: 66 STIDX: 63
    libpthread ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 0000000000005620 PHOFF: 0000000000000040 SHOFF: 0000000000011e48 EF: 0x0 HS: 64 PS: 56 PHN; 9 SS: 64 SHN: 35 STIDX: 32
    libjvm ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000003f820 PHOFF: 0000000000000040 SHOFF: 000000000037bd90 EF: 0x0 HS: 64 PS: 56 PHN; 3 SS: 64 SHN: 22 STIDX: 19
    * If you see this dump, please go to *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information. *
    ===== END DUMP ===============================================================                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       

    Hello Rakesh,
    The crash is in GC code, possiibly caused by an incorrect reference on the heap. This could have been caused by an earlier JIT optimization issue or by a bug in GC or something else - we would need to analyze the full core to know for sure. If you want to pursue this, contact Oracle Support and provide us with the core.
    Another tip is to upgrade to the latest JRockit version. The latest version available bundled with Oracle products is R27.6.0, I believe R27.6.1 is on its way out with a WLS 10 service pack but don't know the exact date.
    Regards,
    Henrik

  • JRockit JVM crash using RHEL 4 (update 5)

    Hi,
    I am using BEA JRockit(R) R27.5.0-110-94909-1.5.0_14-20080204-1558-linux-x86_64 on RHEL 4 (update 5) running 64 bit AMD Athlon processor. I got a JVM crash from an application which has been running stable all this time. The crash occured 1 hour after the application was started. The error message is "Illegal memory access". From the older discussion forums in BEA I found that this crash is possibly due to a bug in JIT optimization. Below is the complete dump from the crash. It would be great if someone can confirm that this crash is due to the same bug or something else.
    Thanks,
    Rakesh
    ===== BEGIN DUMP =============================================================
    JRockit dump produced after 0 days, 01:06:20 on Tue Jan 20 10:23:21 2009
    * If you see this dump, please go to *
    * http://edocs.bea.com/jrockit/go2troubleshooting.html *
    * for troubleshooting information. *
    Additional information is available in:
    /ha/apps/bin/jrockit.2041.dump
    No snapshot file (core dump) will be created because core dumps have been
    disabled. To enable core dumping, try "ulimit -c unlimited"
    before starting JRockit again.
    Error Message: Illegal memory access. [54]
    Signal info : si_signo=11, si_code=128 si_addr=(nil)
    Version : BEA JRockit(R) R27.5.0-110-94909-1.5.0_14-20080204-1558-linux-x86_64
    GC Strategy : Mode: static, with strategy: singleconcon
    GC Status : OC currently running, in phase: marking. This is OC#746.
    Heap : 0x2d00000 - 0x22d00000 (Size: 512 MB)
    Compaction : 0xdd00000 - 0xe100000 (Current compaction type: internal)
    CompRefs : References are compressed, with heap base 0x0.
    CPU : AMD Opteron/Athlon64 SSE SSE2 SSE3 EM64T
    Number CPUs : 8
    Tot Phys Mem : 67561517056 (64431 MB)
    OS version : Red Hat Enterprise Linux AS release 4 (Nahant Update 4)
    Linux version 2.6.9-42.0.8.ELsmp ([email protected]) (gcc version 3.4.6 20060404 (Red Hat 3.4.6-3)) #1 SMP Tue Jan 23 12:49:51 EST 2007 (x86_64)
    Thread System: NPTL
    Java locking : Normal
    State : JVM is running
    Command Line : -Xms512M -Xmx1024M -Xss128M -Xgc:singlecon -XXcompactratio:1 -Djava.ext.dirs=/cms/lib/:/cms/ext/:/ha/apps/lib/:/ha/OracleJar/:/ha/dbwrapper/:.: -DserverID=prod -DSystemProperties=/ha/hi/properties/HITcpBootstrap.prp -Dpid=2041 -Dsun.java.launcher=SUN_STANDARD com.ups.coii.tos.server.TOSServer
    java.home : /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre
    j.class.path : .
    j.lib.path : /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/opt/mqm/java/lib64/:/opt/mqm/java/lib/
    JAVA_HOME : <not set>
    JAVAOPTIONS: <not set>
    LD_LIBRARY_PATH: /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64:/opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/../lib/amd64::/opt/mqm/java/lib64/:/opt/mqm/java/lib/
    LD_ASSUME_KERNEL: <not set>
    C Heap : Good; no memory allocations have failed
    StackOverFlow: 0 StackOverFlowErrors have occured
    OutOfMemory : 0 OutOfMemoryErrors have occured
    Registers (from ThreadContext: 0x42d82960 / OS context: 0x42d82a20):
    rax = 040000000174c008 rcx = 0000000000000000
    rdx = 0000002a95fe6b70 rbx = 0000000000000002
    rsp = 0000000042d82e60 rbp = 0000000042d82fc0
    rsi = 000000001450000c rdi = 0000000042d82ec0
    r8 = 0000000000000001 r9 = 0000002a96002dac
    r10 = 0000002c7a72c140 r11 = 0000000000000021
    r12 = 0000000000000002 r13 = 0000000042d82ec0
    r14 = 0000002ad6893ff0 r15 = 0000000014500000
    cs = 000000000000ab30 fs = 0000000000000000
    gs = 0000000000000000
    rip = 0000002a95df7d2d flags = 0000000000000246
    Stack:
    (* marks the word pointed to by the stack pointer)
    0000000042d82e60: 0000002ad6893ff0* 0000002ad6893ff0 0000000042d82ec0 0000000042d82f60
    0000000042d82e80: 0000002a961222c0 0000002ad6893ff0 0000000014500008 0000002d00000000
    0000000042d82ea0: 0000000014500008 0000002d00000000 0000000014500008 0000002d00000000
    0000000042d82ec0: 0000000000000000 0000002d00000000 0000000014500008 0000002a00000000
    0000000042d82ee0: 0000000014500000 0000000000000000 00000000004ce628 0000000000000001
    0000000042d82f00: 0000002a00000000 000000001450000c 00000000059165d8 00000000059167d8
    Code:
    (* marks the word pointed to by the instruction pointer)
    0000002a95df7cc8: bd831ceb028b4821 48097503fffffed8 0aebfffffed0858b 48fffffed0858b48
    0000002a95df7ce8: c08548c38948008b 8b4c00000102840f c48949fffffea8b5 48002c1a69058b48
    0000002a95df7d08: e9c148082b48d989 06e8c148c8894803 00000008c5048d48 48002c12b9158b48
    0000002a95df7d28: 008b483fe1830203* 485a7501a8e8d348 8948002c1a32058b 03e9c148082b48d9
    0000002a95df7d48: 8306e8c148c88948 4800000001ba3fe1 048d48d18948e2d3 158b4800000008c5
    0000002a95df7d68: 48020348002c1274 2c1837058b480809 8948087400388300 894cfff7ffa2e8df
    Loaded modules:
    (* denotes the module causing the exception)
    0000000000400000-000000000041196b /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/bin/java
    0000002a9566c000-0000002a9567aff9 /lib64/tls/libpthread.so.0
    0000002a95782000-0000002a9580659b /lib64/tls/libm.so.6
    0000002a95908000-0000002a95909c73 /lib64/libdl.so.2
    0000002a95a0b000-0000002a95b35df9 /lib64/tls/libc.so.6
    0000002a95556000-0000002a9556a34f /lib64/ld-linux-x86-64.so.2
    0000002a95c41000-0000002a95ee448f */opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/jrockit/libjvm.so
    0000002a96137000-0000002a9613f95a /lib64/tls/librt.so.1
    0000002a96251000-0000002a9625497b /usr/lib64/libnuma.so
    0000002a96356000-0000002a9635ff13 /lib64/libnss_files.so.2
    0000002a964c1000-0000002a964cd467 /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libverify.so
    0000002a965d0000-0000002a965f321b /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libjava.so
    0000002a96707000-0000002a9671a503 /lib64/libnsl.so.1
    0000002ad69ae000-0000002ad69b463f /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/native_threads/libhpi.so
    0000002ad9a30000-0000002ad9a3dd93 /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libzip.so
    0000002ad9db4000-0000002ad9dc55cf /opt/bea/jrockit-R27.5.0-jdk1.5.0_14/jre/lib/amd64/libnet.so
    Scan Dump Helper:
    Iterating in objIter over object at address 0x14500000 (seems to be real).
    The reference that caused the crash is a normal field.
    Scanned object [0000000014500000 0000000014500018) of class java/lang/ThreadLocal$ThreadLocalMap
    0x14500000 : 0x004ce580 [classblock]
    0x14500004 : 0x00000000 [flags]
    ===> 0x14500008 : 0x00000002 .table [Ljava/lang/ThreadLocal$ThreadLocalMap$Entry; (java/lang/ThreadLocal$ThreadLocalMap)
          0x1450000c : 0x00000002
          0x14500010 : 0x0000000a
          0x14500014 : 0x00000000
         The field that caused the crash is marked with "===>"
       The reference is bogus and pointing outside the heap.
       Only reference to this object from another object is
    object [00000000059191e8 0000000005919278) of class com/ups/coii/thread/util/ThreadPool$PooledThread
          0x59191e8 : 0x017b55f0 [classblock]
    0x59191ec : 0x80000000 [flags]
    0x59191f0 : 0x05919280 .name [C (java/lang/Thread)
          0x59191f4 : 0x00000000 .threadQ Ljava/lang/Thread; (java/lang/Thread)
          0x59191f8 : 0x00000000 .target Ljava/lang/Runnable; (java/lang/Thread)
          0x59191fc : 0x02d02ae8 .group Ljava/lang/ThreadGroup; (java/lang/Thread)
          0x5919200 : 0x05d50b48 .contextClassLoader Ljava/lang/ClassLoader; (java/lang/Thread)
          0x5919204 : 0x059192c0 .inheritedAccessControlContext Ljava/security/AccessControlContext; (java/lang/Thread)
    ===> 0x5919208 : 0x14500000 .threadLocals Ljava/lang/ThreadLocal$ThreadLocalMap; (java/lang/Thread)
          0x591920c : 0x059192d8 .inheritableThreadLocals Ljava/lang/ThreadLocal$ThreadLocalMap; (java/lang/Thread)
          0x5919210 : 0x00000000 .blocker Lsun/nio/ch/Interruptible; (java/lang/Thread)
          0x5919214 : 0x05919278 .blockerLock Ljava/lang/Object; (java/lang/Thread)
          0x5919218 : 0x00000000 .uncaughtExceptionHandler Ljava/lang/Thread$UncaughtExceptionHandler; (java/lang/Thread)
          0x591921c : 0x05916d38 .cwObj Ljava/lang/Object; (java/lang/Thread)
          0x5919220 : 0x00000000 .blockObj Ljava/lang/Object; (java/lang/Thread)
          0x5919224 : 0x04102cf0 .waitNext Ljava/lang/Thread; (java/lang/Thread)
          0x5919228 : 0x00000000 .lockNext Ljava/lang/Thread; (java/lang/Thread)
          0x591922c : 0x059191e8 .blockThreadStop Ljava/lang/Object; (java/lang/Thread)
          0x5919230 : 0x00000000 .accessControlContext Ljava/security/AccessControlContext; (java/lang/Thread)
          0x5919234 : 0x00000005
          0x5919238 : 0x00000000
          0x591923c : 0x00000000
          0x5919240 : 0x00000000
          0x5919244 : 0x00000000
          0x5919248 : 0x00000026
          0x591924c : 0x00000000
          0x5919250 : 0xda213db0
          0x5919254 : 0x0000002a
          0x5919258 : 0x00000000
          0x591925c : 0x00000000
          0x5919260 : 0x000001a1
          0x5919264 : 0x00000000
          0x5919268 : 0x00000001
          0x591926c : 0x05916150 .this$0 Lcom/ups/coii/thread/util/ThreadPool; (com/ups/coii/thread/util/ThreadPool$PooledThread)
          0x5919270 : 0x00000000
          0x5919274 : 0x00000000
    "(GC Main Thread)" id=3 idx=0xc tid=2058 lastJavaFrame=0xfffffffffffffffc
    Stack 0: start=0x42d42000, end=0x42d84000, guards=0x42d47000 (ok), forbidden=0x42d45000
    Thread Stack Trace:
        at mmSingleConFollowReferences+481()@0x2a95df7d2d
        at mmSingleConMark+220()@0x2a95df87ab
        at mmMark+82()@0x2a95cab846
        at mmGCMainLoop+101()@0x2a95cab8eb
        at mmGCMainThread+51()@0x2a95ce826e
        at tsiCallStartFunction+67()@0x2a95d62bfb
        at tsiThreadStub+308()@0x2a95d63e05
        at ptiThreadStub+14()@0x2a95dcb277
        at start_thread+138()@0x2a9567210a
        -- Java stack --
    Extended, platform specific info:
    libc release: 2.3.4-stable
    Elf headers:
    libc       ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000001c4a0 PHOFF: 0000000000000040 SHOFF: 000000000013c290 EF: 0x0 HS: 64 PS: 56 PHN; 10 SS: 64 SHN: 66 STIDX: 63
    libpthread ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 0000000000005620 PHOFF: 0000000000000040 SHOFF: 0000000000011e48 EF: 0x0 HS: 64 PS: 56 PHN; 9 SS: 64 SHN: 35 STIDX: 32
    libjvm     ehdrs: EI: 7f454c46020101000000000000000000 ET: 3 EM: 62 V: 1 ENTRY: 000000000003f820 PHOFF: 0000000000000040 SHOFF: 000000000037bd90 EF: 0x0 HS: 64 PS: 56 PHN; 3 SS: 64 SHN: 22 STIDX: 19
        *  If you see this dump, please go to                    *
        *  http://edocs.bea.com/jrockit/go2troubleshooting.html  *
        *  for troubleshooting information.                      *
    ===== END DUMP ===============================================================                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       

    You should open a tar with support (http://metalink.oracle.com ; I am not sure if that is the correct support site for jrockit)
    Because the information is all about jrockit and not linux, you probably are not going to get much help here.
    You could try the jrockit forum: JRockit

  • JRockit JVM Crash Without Dump

    I am running Windows Server 2003 with WebLogic Server Express 8.1 SP 4 and JRockit 1.4.2_05. I have an administrative server and 2 managed servers running on the same physical server with about 60 web applications spread across both managed servers. The administrative server starts as a Windows Service and the managed servers are started by calling weblogic.admin from a batch job that runs on server start.
    My issue is that the 2 java.exe processes representing the managed servers both terminate without explanation at the same time. There is no dump or error messages from Jrockit. The only related messages on the server mention that commnication with the managed servers was lost.
    The 2 managed servers run at times for a period of days before crashing and at other times they will crash twice in 20 minutes.
    I have attempted to use the -Djrockit.waitonerror parameter in order to get a dump when the JVM is shutting down, but the process just crashes without prompting for a debug dump.
    I have opened a case with BEA, but at this point they are saying that without a dump on crash they are not going to be able to do much....
    Anyone out there know of any way to force JRockit to perform a dump if the process is terminating? Anyone come across an issue like this before? I find it unusual that they would be die at the same time each and every time.
    Any help would be greatly appreciated.
    Thanks-
    Rich Platt

    What have you done to make sure it's JRockit that is terminating
    prematurely rather than the Java program? Those sound like exactly the
    kinds of symptoms you'd get from a Java program doing System.exit(0).
    //Johan
    Richard Platt wrote:
    I am running Windows Server 2003 with WebLogic Server Express 8.1 SP 4 and JRockit 1.4.2_05. I have an administrative server and 2 managed servers running on the same physical server with about 60 web applications spread across both managed servers. The administrative server starts as a Windows Service and the managed servers are started by calling weblogic.admin from a batch job that runs on server start.
    My issue is that the 2 java.exe processes representing the managed servers both terminate without explanation at the same time. There is no dump or error messages from Jrockit. The only related messages on the server mention that commnication with the managed servers was lost.
    The 2 managed servers run at times for a period of days before crashing and at other times they will crash twice in 20 minutes.
    I have attempted to use the -Djrockit.waitonerror parameter in order to get a dump when the JVM is shutting down, but the process just crashes without prompting for a debug dump.
    I have opened a case with BEA, but at this point they are saying that without a dump on crash they are not going to be able to do much....
    Anyone out there know of any way to force JRockit to perform a dump if the process is terminating? Anyone come across an issue like this before? I find it unusual that they would be die at the same time each and every time.
    Any help would be greatly appreciated.
    Thanks-
    Rich Platt

  • Steps to enable "-Xmanagement" option in JRockit JVM?

    Hello,
    I am trying to enable the "-Xmanagement" option in the Jrockit JVM 1.4.2_04 to enable the management server to listen to the JVM running on our server. Therefore, we can use the JRA to profile our JVM in realtime, using the JRockit Management console.
    We are running W2K3 and use the registry to pass all the necessary options (i.e. -classpath, verbose:gc, min/max heap size, -D options etc.) when starting the Weblogic service. However, when I attempt to add the -Xmanagement option to anywhere in the registry setting, the service will fail to start, regardless of where I place the option in the field.
    If I cannot set this option, I recieve the below error when attempting to connect to the server via the management console ( I have tried various ports as well )
    com.jrockit.common.rmp.JRockitServerNotListeningException: Can't create connection to JRockit on perfd-rpd2a at port 7001
    (Encapsulated exception: Connection refused: connect)
         at com.jrockit.console.connection.RmpConnection.<init>(RmpConnection.java:124)
         at com.jrockit.console.connection.ConnectorModel.connect(ConnectorModel.java:315)
         at com.jrockit.console.browser.BrowserAbstractNode.connectNode(BrowserAbstractNode.java:124)
         at com.jrockit.console.application.AllUIOperations$4.doAction(AllUIOperations.java:120)
         at com.jrockit.console.application.AllUIOperations.executeAction(AllUIOperations.java:621)
         at com.jrockit.console.application.UIOperation.actionPerformed(UIOperation.java:310)
         at javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
         at javax.swing.AbstractButton$ForwardActionEvents.actionPerformed(Unknown Source)
         at javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
         at javax.swing.DefaultButtonModel.setPressed(Unknown Source)
         at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(Unknown Source)
         at java.awt.AWTEventMulticaster.mouseReleased(Unknown Source)
         at java.awt.AWTEventMulticaster.mouseReleased(Unknown Source)
         at java.awt.Component.processMouseEvent(Unknown Source)
         at java.awt.Component.processEvent(Unknown Source)
         at java.awt.Container.processEvent(Unknown Source)
         at java.awt.Component.dispatchEventImpl(Unknown Source)
         at java.awt.Container.dispatchEventImpl(Unknown Source)
         at java.awt.Component.dispatchEvent(Unknown Source)
         at java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
         at java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
         at java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
         at java.awt.Container.dispatchEventImpl(Unknown Source)
         at java.awt.Window.dispatchEventImpl(Unknown Source)
         at java.awt.Component.dispatchEvent(Unknown Source)
         at java.awt.EventQueue.dispatchEvent(Unknown Source)
         at com.jrockit.console.util.WaitCursorEventQueue.dispatchEvent(WaitCursorEventQueue.java:101)
         at java.awt.EventDispatchThread.pumpOneEventForHierarchy(Unknown Source)
         at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
         at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
         at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
         at java.awt.EventDispatchThread.run(Unknown Source)
    === Encapsulated exception ===
    java.net.ConnectException: Connection refused: connect
    Any ideas/suggestions?
    TIA.
    -Nader

    Hi Helena,
    Below are the values from the registry key we are passing to the weblogic service.
    We do not use any of the "Start(WLS)(Weblogic).cmd" scripts to start the Weblogic service, only the WSM (Windows Service Manager).
    Please let me know if you have any further questions.
    Thanks for the assitance.
    Regards,
    -Nader
    -server -mx1024m -verbose:gc -XX:MaxPermSize=128m -Xmanagement -classpath d:\bea\JROCKI~1\lib\tools.jar;d:\bea\WEBLOG~1\server\lib\weblogic_sp.jar;d:\bea\WEBLOG~1\server\lib\weblogic.jar;d:\bea\jdk142_04\jre\lib\rt.jar;d:\bea\WEBLOG~1\server\lib\webservices.jar -Dweblogic.RootDirectory=d:\bea\j2ee\domains\PERFD-RD2 -Dweblogic.Name=perfd-rpd2a -Dbea.home=d:\bea -Dweblogic.management.username=system -Dweblogic.management.password=weblogic -Dweblogic.management.server=http://10.198.39.237:7001 -Djava.security.policy=d:\bea\WEBLOG~1\server\lib\weblogic.policy -Dsun.net.inetaddr.ttl=0 weblogic.Server

  • JVM Crash: ConcMarkSweepGC related?

    We're experiencing the following JVM crash approximately 2-5 times per day on a well traffic application server running Tomcat 5.5 under Java 1.5 (05) on Linux with a 2.4.21-37 kernel. I'm posting here because we kind of have no route to take: I can't seem to work around the crash in any way. There's a potential that UseParallelGC might fix this, but I'm unable to run the app reliably with a ParallelGC, as we have a very large cache and the Full GC's get unbelievably long (2GB heap).
    How can we find out what's going on? Is there a way to obtain a debug build so that:
    V [libjvm.so+0x4c2c53]
    V [libjvm.so+0x1bea7c]
    We're also seeing this in the standard output:
    An exception occurred on the SessionReaperDaemon[null, 2005-11-01 20:02:14.81] thread while processing (task="com.tangosol.coherence.servlet.SessionHelper$SessionReaperDaemon$IncrementalReapTask@1ba4ac8"):
    java.lang.NullPointerException
         at com.tangosol.coherence.servlet.SessionHelper$SessionReaperDaemon$IncrementalReapTask.run(SessionHelper.java:3072)
         at com.tangosol.util.TaskDaemon.run(TaskDaemon.java:69)
         at com.tangosol.coherence.servlet.SessionHelper$SessionReaperDaemon.run(SessionHelper.java:2709)
         at com.tangosol.util.Daemon$1.run(Daemon.java:63)
    Prior to the crash, but this is an impossible place for an exception:
    3070: if (iter.hasNext())
    3071: {
    3072: String sId = (String) iter.next();3073: ...
    Any help or next steps would be greatly appreciated.
    An attached dump:
    # An unexpected error has been detected by HotSpot Virtual Machine:
    # Internal Error (4E4D4554484F440E4350500521), pid=1705, tid=907377584
    # Java VM: Java HotSpot(TM) Server VM (1.5.0_05-b05 mixed mode)
    --------------- T H R E A D ---------------
    Current thread (0x36bc7068): JavaThread "SessionReaperDaemon[null, 2005-11-01 22:38:23.388]" daemon [_thread_in_Java, id=1739]
    Stack: [0x360d7000,0x36158000), sp=0x36156eec, free space=511k
    Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
    V [libjvm.so+0x4c2c53]
    V [libjvm.so+0x1bea7c]
    V [libjvm.so+0x3e2bee]
    V [libjvm.so+0x4564cb]
    V [libjvm.so+0x3f8956]
    V [libjvm.so+0x3f5c64]
    --------------- P R O C E S S ---------------
    Java Threads: ( => current thread )
    0x0894eba0 JavaThread "Keep-Alive-Timer" daemon [_thread_blocked, id=4871]
    0x0864ea88 JavaThread "RMI TCP Connection(341)-192.168.100.62" daemon [_thread_in_native, id=4802]
    0x083e6568 JavaThread "http-80-Processor300" daemon [_thread_in_native, id=4708]
    0x08d4e058 JavaThread "http-80-Processor299" daemon [_thread_in_native, id=4707]
    0x08bc7c20 JavaThread "http-80-Processor298" daemon [_thread_blocked, id=4706]
    0x0845fd78 JavaThread "http-80-Processor297" daemon [_thread_in_native, id=4705]
    0x08e39330 JavaThread "http-80-Processor296" daemon [_thread_in_native, id=4704]
    0x08bceb30 JavaThread "http-80-Processor295" daemon [_thread_blocked, id=4703]
    0x08bb9de8 JavaThread "http-80-Processor294" daemon [_thread_in_native, id=4702]
    0x08b692d0 JavaThread "http-80-Processor293" daemon [_thread_in_native, id=4701]
    0x084fa8e0 JavaThread "http-80-Processor292" daemon [_thread_in_native, id=4700]
    0x08446908 JavaThread "http-80-Processor291" daemon [_thread_blocked, id=4699]
    0x08e4c4c0 JavaThread "http-80-Processor290" daemon [_thread_in_native, id=4698]
    0x08625e60 JavaThread "http-80-Processor289" daemon [_thread_blocked, id=4697]
    0x0843d5b8 JavaThread "http-80-Processor288" daemon [_thread_in_native, id=4696]
    0x08ca13b8 JavaThread "http-80-Processor287" daemon [_thread_in_native, id=4695]
    0x08395e00 JavaThread "http-80-Processor286" daemon [_thread_in_native, id=4694]
    0x084c8f28 JavaThread "http-80-Processor285" daemon [_thread_in_native, id=4693]
    0x083f6490 JavaThread "http-80-Processor284" daemon [_thread_in_native, id=4692]
    0x08e69368 JavaThread "http-80-Processor281" daemon [_thread_blocked, id=4689]
    0x08df8218 JavaThread "http-80-Processor280" daemon [_thread_blocked, id=4688]
    0x0861ba28 JavaThread "http-80-Processor279" daemon [_thread_blocked, id=4687]
    0x083e22d0 JavaThread "http-80-Processor278" daemon [_thread_blocked, id=4686]
    0x08e44e80 JavaThread "http-80-Processor277" daemon [_thread_blocked, id=4685]
    0x08625478 JavaThread "http-80-Processor276" daemon [_thread_blocked, id=4684]
    0x08547890 JavaThread "http-80-Processor275" daemon [_thread_in_native, id=4632]
    0x0846c598 JavaThread "http-80-Processor274" daemon [_thread_in_native, id=4631]
    0x08beadb8 JavaThread "http-80-Processor270" daemon [_thread_in_native, id=4627]
    0x0865b3a0 JavaThread "http-80-Processor269" daemon [_thread_in_native, id=4626]
    0x092899e0 JavaThread "http-80-Processor268" daemon [_thread_in_native, id=4625]
    0x09277f58 JavaThread "http-80-Processor267" daemon [_thread_blocked, id=4624]
    0x086790b0 JavaThread "http-80-Processor265" daemon [_thread_in_native, id=4622]
    0x0844d920 JavaThread "http-80-Processor263" daemon [_thread_blocked, id=4620]
    0x0846f478 JavaThread "http-80-Processor262" daemon [_thread_in_native, id=4619]
    0x08c5f470 JavaThread "http-80-Processor261" daemon [_thread_in_native, id=4618]
    0x088cd8d0 JavaThread "http-80-Processor260" daemon [_thread_in_native, id=4617]
    0x08d5af30 JavaThread "http-80-Processor259" daemon [_thread_blocked, id=4616]
    0x0884bc18 JavaThread "http-80-Processor258" daemon [_thread_blocked, id=4615]
    0x08e618a0 JavaThread "http-80-Processor257" daemon [_thread_in_native, id=4614]
    0x08be3de0 JavaThread "http-80-Processor256" daemon [_thread_in_native, id=4613]
    0x085de680 JavaThread "http-80-Processor255" daemon [_thread_blocked, id=4612]
    0x083b8420 JavaThread "http-80-Processor254" daemon [_thread_blocked, id=4611]
    0x08e533e0 JavaThread "http-80-Processor253" daemon [_thread_in_native, id=4610]
    0x083c5af8 JavaThread "http-80-Processor252" daemon [_thread_in_native, id=4609]
    0x084701c0 JavaThread "http-80-Processor251" daemon [_thread_blocked, id=4608]
    0x3639cff0 JavaThread "http-80-Processor250" daemon [_thread_in_native, id=4402]
    0x2f41cd88 JavaThread "http-80-Processor249" daemon [_thread_in_native, id=4401]
    0x36bf7a48 JavaThread "http-80-Processor247" daemon [_thread_blocked, id=4399]
    0x35160748 JavaThread "http-80-Processor246" daemon [_thread_in_native, id=4398]
    0x36b42ed0 JavaThread "http-80-Processor245" daemon [_thread_blocked, id=4397]
    0x359b3ec0 JavaThread "http-80-Processor244" daemon [_thread_in_native, id=4396]
    0x3633a1f8 JavaThread "http-80-Processor240" daemon [_thread_blocked, id=4392]
    0x35a9ef28 JavaThread "http-80-Processor239" daemon [_thread_in_native, id=4391]
    0x35a52840 JavaThread "http-80-Processor238" daemon [_thread_blocked, id=4390]
    0x35a8e9e8 JavaThread "http-80-Processor236" daemon [_thread_blocked, id=4388]
    0x35a8de38 JavaThread "http-80-Processor235" daemon [_thread_in_native, id=4387]
    0x304703b8 JavaThread "http-80-Processor232" daemon [_thread_in_native, id=4384]
    0x36b32498 JavaThread "http-80-Processor231" daemon [_thread_blocked, id=4383]
    0x2e149a40 JavaThread "http-80-Processor230" daemon [_thread_blocked, id=4382]
    0x304731f8 JavaThread "http-80-Processor229" daemon [_thread_blocked, id=4381]
    0x2e186cd0 JavaThread "http-80-Processor228" daemon [_thread_in_native, id=4380]
    0x35a53c68 JavaThread "http-80-Processor227" daemon [_thread_blocked, id=4379]
    0x083a85d0 JavaThread "RMI TCP Connection(315)-192.168.100.62" daemon [_thread_blocked, id=4343]
    0x08cdd748 JavaThread "JMX server connection timeout 1017" daemon [_thread_blocked, id=3885]
    0x08df9fc0 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=3884]
    0x083c7f68 JavaThread "http-80-Processor225" daemon [_thread_blocked, id=3816]
    0x083c85b8 JavaThread "http-80-Processor223" daemon [_thread_blocked, id=3814]
    0x08df3be8 JavaThread "http-80-Processor222" daemon [_thread_in_native, id=3813]
    0x087a49b8 JavaThread "http-80-Processor221" daemon [_thread_in_native, id=3812]
    0x084c9db8 JavaThread "http-80-Processor220" daemon [_thread_in_native, id=3811]
    0x086203e0 JavaThread "http-80-Processor218" daemon [_thread_in_native, id=3809]
    0x088e2090 JavaThread "http-80-Processor216" daemon [_thread_in_native, id=3807]
    0x088bd2d0 JavaThread "http-80-Processor214" daemon [_thread_in_native, id=3805]
    0x08863490 JavaThread "http-80-Processor211" daemon [_thread_in_native, id=3802]
    0x08e9f4b8 JavaThread "http-80-Processor207" daemon [_thread_in_native, id=3798]
    0x08c9f748 JavaThread "http-80-Processor206" daemon [_thread_in_native, id=3797]
    0x0861fa00 JavaThread "http-80-Processor205" daemon [_thread_in_native, id=3796]
    0x08408ec8 JavaThread "http-80-Processor204" daemon [_thread_blocked, id=3795]
    0x0869bf28 JavaThread "http-80-Processor203" daemon [_thread_blocked, id=3794]
    0x08ba2648 JavaThread "http-80-Processor201" daemon [_thread_blocked, id=3792]
    0x08e70980 JavaThread "http-80-Processor200" daemon [_thread_blocked, id=3550]
    0x08e707e8 JavaThread "http-80-Processor199" daemon [_thread_blocked, id=3549]
    0x088e83b0 JavaThread "http-80-Processor196" daemon [_thread_blocked, id=3546]
    0x08634758 JavaThread "http-80-Processor195" daemon [_thread_blocked, id=3545]
    0x08198ea8 JavaThread "http-80-Processor194" daemon [_thread_blocked, id=3544]
    0x0831d5a8 JavaThread "http-80-Processor191" daemon [_thread_in_native, id=3541]
    0x088c6788 JavaThread "http-80-Processor189" daemon [_thread_in_native, id=3539]
    0x0835d868 JavaThread "http-80-Processor187" daemon [_thread_blocked, id=3537]
    0x08be2788 JavaThread "http-80-Processor186" daemon [_thread_in_native, id=3536]
    0x08d5b638 JavaThread "http-80-Processor182" daemon [_thread_blocked, id=3532]
    0x088c6488 JavaThread "http-80-Processor180" daemon [_thread_in_native, id=3530]
    0x08d83d70 JavaThread "http-80-Processor173" daemon [_thread_blocked, id=3158]
    0x088f3ca8 JavaThread "http-80-Processor171" daemon [_thread_blocked, id=3156]
    0x08862858 JavaThread "http-80-Processor168" daemon [_thread_blocked, id=3153]
    0x08629e38 JavaThread "http-80-Processor162" daemon [_thread_blocked, id=3147]
    0x086b9dd0 JavaThread "http-80-Processor159" daemon [_thread_in_native, id=3144]
    0x086e1c88 JavaThread "http-80-Processor153" daemon [_thread_in_native, id=3138]
    0x082fae10 JavaThread "http-80-Processor151" daemon [_thread_in_native, id=3136]
    0x084c7c40 JavaThread "http-80-Processor149" daemon [_thread_blocked, id=2489]
    0x087a5568 JavaThread "http-80-Processor147" daemon [_thread_in_native, id=2487]
    0x08c5f648 JavaThread "http-80-Processor146" daemon [_thread_blocked, id=2486]
    0x08c64090 JavaThread "http-80-Processor135" daemon [_thread_blocked, id=2475]
    0x08d60c68 JavaThread "http-80-Processor133" daemon [_thread_in_native, id=2473]
    0x08cdc058 JavaThread "http-80-Processor129" daemon [_thread_blocked, id=2469]
    0x0854a978 JavaThread "http-80-Processor128" daemon [_thread_blocked, id=2468]
    0x08d940c0 JavaThread "http-80-Processor126" daemon [_thread_in_native, id=2466]
    0x087c4998 JavaThread "http-80-Processor114" daemon [_thread_blocked, id=2186]
    0x0895ec90 JavaThread "http-80-Processor113" daemon [_thread_in_native, id=2185]
    0x0895e028 JavaThread "http-80-Processor112" daemon [_thread_blocked, id=2184]
    0x08e9bbb8 JavaThread "http-80-Processor82" daemon [_thread_in_native, id=2147]
    0x08634cf8 JavaThread "http-80-Processor80" daemon [_thread_in_native, id=2145]
    0x085d93c0 JavaThread "http-80-Processor68" daemon [_thread_blocked, id=2129]
    0x085d8658 JavaThread "http-80-Processor67" daemon [_thread_blocked, id=2128]
    0x085d7310 JavaThread "http-80-Processor66" daemon [_thread_in_native, id=2127]
    0x084c57e0 JavaThread "http-80-Processor60" daemon [_thread_blocked, id=2121]
    0x084c4a78 JavaThread "http-80-Processor59" daemon [_thread_blocked, id=2120]
    0x08588db8 JavaThread "http-80-Processor56" daemon [_thread_blocked, id=2117]
    0x086a2130 JavaThread "http-80-Processor54" daemon [_thread_in_native, id=2115]
    0x0878cfa8 JavaThread "http-80-Processor50" daemon [_thread_in_native, id=2108]
    0x087b9148 JavaThread "http-80-Processor39" daemon [_thread_blocked, id=2097]
    0x082f38c8 JavaThread "http-80-Processor29" daemon [_thread_blocked, id=2087]
    0x087a6a30 JavaThread "http-80-Processor28" daemon [_thread_in_native, id=2086]
    0x36b33540 JavaThread "http-80-Monitor" [_thread_blocked, id=1769]
    0x351178e0 JavaThread "http-80-Processor4" daemon [_thread_blocked, id=1747]
    0x35a72210 JavaThread "http-80-Processor1" daemon [_thread_blocked, id=1744]
    0x363ed3b0 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=1743]
    0x35a60238 JavaThread "Thread-4" [_thread_blocked, id=1742]
    =>0x36bc7068 JavaThread "SessionReaperDaemon[null, 2005-11-01 22:38:23.388]" daemon [_thread_in_Java, id=1739]
    0x363633c8 JavaThread "DistributedCache:DistributedSessions:EventDispatcher" daemon [_thread_blocked, id=1738]
    0x363771a0 JavaThread "DistributedCache:DistributedSessions" daemon [_thread_blocked, id=1737]
    0x36ba85f0 JavaThread "ReplicatedCache:ReplicatedSessionsMisc" daemon [_thread_blocked, id=1736]
    0x36bbb118 JavaThread "TcpRingListener" daemon [_thread_in_native, id=1735]
    0x36373478 JavaThread "Cluster" daemon [_thread_blocked, id=1733]
    0x36351268 JavaThread "PacketPublisher" daemon [_thread_blocked, id=1732]
    0x36350d60 JavaThread "PacketReceiver" daemon [_thread_blocked, id=1731]
    0x36ba8858 JavaThread "PacketListenerN" daemon [_thread_in_native, id=1730]
    0x36bb11e8 JavaThread "PacketListener1" daemon [_thread_in_native, id=1729]
    0x36b9f530 JavaThread "Logger@9508926 3.0/315" daemon [_thread_blocked, id=1728]
    0x081b0910 JavaThread "RMI TCP Accept-9000" daemon [_thread_in_native, id=1726]
    0x081b5c90 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=1725]
    0x081b57c0 JavaThread "Timer-0" daemon [_thread_blocked, id=1724]
    0x08157b60 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=1722]
    0x081566e8 JavaThread "CompilerThread1" daemon [_thread_blocked, id=1721]
    0x08155698 JavaThread "CompilerThread0" daemon [_thread_blocked, id=1720]
    0x08154578 JavaThread "AdapterThread" daemon [_thread_blocked, id=1719]
    0x08153618 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=1718]
    0x081528e8 JavaThread "Surrogate Locker Thread (CMS)" daemon [_thread_blocked, id=1717]
    0x08148480 JavaThread "Finalizer" daemon [_thread_blocked, id=1716]
    0x08148008 JavaThread "Reference Handler" daemon [_thread_blocked, id=1715]
    0x0805c598 JavaThread "main" [_thread_in_native, id=1705]
    Other Threads:
    0x08145bc8 VMThread [id=1714]
    0x082237b0 WatcherThread [id=1727]
    VM state:not at safepoint (normal execution)
    VM Mutex/Monitor currently owned by a thread: None
    Heap
    par new generation total 523840K, used 289536K [0x3d1c0000, 0x5d1c0000, 0x5d1c0000)
    eden space 523392K, 55% used [0x3d1c0000, 0x4ec800f0, 0x5d0e0000)
    from space 448K, 0% used [0x5d150000, 0x5d150000, 0x5d1c0000)
    to space 448K, 0% used [0x5d0e0000, 0x5d0e0000, 0x5d150000)
    concurrent mark-sweep generation total 1318912K, used 521347K [0x5d1c0000, 0xad9c0000, 0xad9c0000)
    concurrent-mark-sweep perm gen total 30720K, used 30499K [0xad9c0000, 0xaf7c0000, 0xb19c0000)
    Dynamic libraries:
    08048000-08056000 r-xp 00000000 08:02 180163 /usr/java/jdk1.5.0_05/bin/java
    08056000-08058000 rwxp 0000e000 08:02 180163 /usr/java/jdk1.5.0_05/bin/java
    08058000-0aea7000 rwxp 00000000 00:00 0
    2af40000-2b067000 rwxp 00001000 00:00 0
    2b067000-2b06a000 ---p 00000000 00:00 0
    2b06a000-2b0e8000 rwxp 00003000 00:00 0
    2b0e8000-2b0eb000 ---p 00081000 00:00 0
    2b0eb000-2b169000 rwxp 00084000 00:00 0
    2b169000-2b16c000 ---p 00102000 00:00 0
    2b16c000-2b1ea000 rwxp 00105000 00:00 0
    2b1ea000-2b1ed000 ---p 00081000 00:00 0
    2b1ed000-2b26b000 rwxp 00084000 00:00 0
    2b26b000-2b26e000 ---p 00081000 00:00 0
    2b26e000-2b2ec000 rwxp 00084000 00:00 0
    2b2ec000-2b367000 r-xs 00000000 08:02 1784003 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xsdlib.jar
    2b367000-2b382000 r-xs 00000000 08:02 1784002 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xmlrpc-1.2-b1.jar
    2b382000-2b39d000 r-xs 00000000 08:02 1784001 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xml-apis.jar
    2b39d000-2b476000 r-xs 00000000 08:02 1784000 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xercesImpl.jar
    2b476000-2b554000 r-xs 00000000 08:02 1783999 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/xalan.jar
    2b554000-2b557000 ---p 00000000 00:00 0
    2b557000-2b5d5000 rwxp 00003000 00:00 0
    2b5d5000-2b5d8000 ---p 00081000 00:00 0
    2b5d8000-2b656000 rwxp 00084000 00:00 0
    2b656000-2b659000 ---p 00081000 00:00 0
    2b659000-2b6d7000 rwxp 00084000 00:00 0
    2b6d7000-2b6da000 ---p 00102000 00:00 0
    2b6da000-2b758000 rwxp 00105000 00:00 0
    2b758000-2b75b000 ---p 00183000 00:00 0
    2b75b000-2b7d9000 rwxp 00186000 00:00 0
    2b7d9000-2b7dc000 rwxp 00000000 00:00 0
    2b7dc000-2b85a000 rwxp 00207000 00:00 0
    2b85a000-2b85d000 ---p 00285000 00:00 0
    2b85d000-2b8db000 rwxp 00288000 00:00 0
    2b8db000-2b8de000 ---p 00102000 00:00 0
    2b8de000-2b95c000 rwxp 00105000 00:00 0
    2b95c000-2b95f000 ---p 00183000 00:00 0
    2b95f000-2ba5d000 rwxp 00186000 00:00 0
    2ba5d000-2ba60000 ---p 00182000 00:00 0
    2ba60000-2bade000 rwxp 00185000 00:00 0
    2bade000-2bae1000 ---p 00203000 00:00 0
    2bae1000-2bb5f000 rwxp 00206000 00:00 0
    2bb5f000-2bb62000 ---p 00284000 00:00 0
    2bb62000-2bbe0000 rwxp 00287000 00:00 0
    2bbe0000-2bbe3000 ---p 00305000 00:00 0
    2bbe3000-2bc61000 rwxp 00308000 00:00 0
    2bc61000-2bc64000 ---p 00204000 00:00 0
    2bc64000-2bce2000 rwxp 00207000 00:00 0
    2bce2000-2bce5000 ---p 00285000 00:00 0
    2bce5000-2bd63000 rwxp 00288000 00:00 0
    2bd63000-2bd66000 rwxp 00000000 00:00 0
    2bd66000-2bde4000 rwxp 00186000 00:00 0
    2bde4000-2bde7000 ---p 00204000 00:00 0
    2bde7000-2be65000 rwxp 00207000 00:00 0
    2be65000-2be68000 rwxp 00000000 00:00 0
    2be68000-2bee6000 rwxp 00084000 00:00 0
    2bee6000-2bee9000 ---p 00102000 00:00 0
    2bee9000-2bf67000 rwxp 00105000 00:00 0
    2bf67000-2bf6a000 ---p 00183000 00:00 0
    2bf6a000-2bfe8000 rwxp 00186000 00:00 0
    2bfe8000-2bfeb000 ---p 00204000 00:00 0
    2bfeb000-2c069000 rwxp 00207000 00:00 0
    2c069000-2c06c000 ---p 00081000 00:00 0
    2c06c000-2c0ea000 rwxp 00084000 00:00 0
    2c0ea000-2c0ed000 ---p 00102000 00:00 0
    2c0ed000-2c16b000 rwxp 00105000 00:00 0
    2c16b000-2c16e000 ---p 00183000 00:00 0
    2c16e000-2c1ec000 rwxp 00186000 00:00 0
    2c1ec000-2c1ef000 rwxp 00000000 00:00 0
    2c1ef000-2c26d000 rwxp 00207000 00:00 0
    2c26d000-2c270000 ---p 00285000 00:00 0
    2c270000-2c2ee000 rwxp 00288000 00:00 0
    2c2ee000-2c2f1000 ---p 00306000 00:00 0
    2c2f1000-2c36f000 rwxp 00309000 00:00 0
    2c36f000-2c372000 ---p 00387000 00:00 0
    2c372000-2c3f0000 rwxp 0038a000 00:00 0
    2c3f0000-2c3f3000 ---p 00204000 00:00 0
    2c3f3000-2c471000 rwxp 00207000 00:00 0
    2c471000-2c474000 ---p 00285000 00:00 0
    2c474000-2c4f2000 rwxp 00288000 00:00 0
    2c4f2000-2c4f5000 ---p 00102000 00:00 0
    2c4f5000-2c573000 rwxp 00105000 00:00 0
    2c573000-2c576000 ---p 00183000 00:00 0
    2c576000-2c5f4000 rwxp 00186000 00:00 0
    2c5f4000-2c5f7000 ---p 00204000 00:00 0
    2c5f7000-2c675000 rwxp 00207000 00:00 0
    2c675000-2c678000 ---p 00285000 00:00 0
    2c678000-2c6f6000 rwxp 00288000 00:00 0
    2c6f6000-2c6f9000 ---p 00306000 00:00 0
    2c6f9000-2c777000 rwxp 00309000 00:00 0
    2c777000-2c77a000 ---p 00387000 00:00 0
    2c77a000-2c7f8000 rwxp 0038a000 00:00 0
    2c7f8000-2c7fb000 ---p 00081000 00:00 0
    2c7fb000-2c879000 rwxp 00084000 00:00 0
    2c879000-2c87c000 ---p 00102000 00:00 0
    2c87c000-2c8fa000 rwxp 00105000 00:00 0
    2c8fa000-2c8fd000 ---p 00183000 00:00 0
    2c8fd000-2c97b000 rwxp 00186000 00:00 0
    2c97b000-2c97e000 rwxp 00000000 00:00 0
    2c97e000-2c9fc000 rwxp 00207000 00:00 0
    2c9fc000-2c9ff000 ---p 00285000 00:00 0
    2c9ff000-2ca7d000 rwxp 00288000 00:00 0
    2ca7d000-2ca80000 ---p 00285000 00:00 0
    2ca80000-2cafe000 rwxp 00288000 00:00 0
    2cafe000-2cb01000 rwxp 00000000 00:00 0
    2cb01000-2cb7f000 rwxp 00309000 00:00 0
    2cb7f000-2cb82000 ---p 00387000 00:00 0
    2cb82000-2cc58000 rwxp 0038a000 00:00 0
    2cc58000-2cd00000 ---p 00029000 00:00 0
    2cd7f000-2cd82000 ---p 00000000 00:00 0
    2cd82000-2cefe000 rwxp 00003000 00:00 0
    2cefe000-2cf00000 ---p 00029000 00:00 0
    2cf00000-2d0fe000 rwxp 0002b000 00:00 0
    2d0fe000-2d100000 ---p 00038000 00:00 0
    2d17b000-2d17e000 ---p 00000000 00:00 0
    2d17e000-2d1fc000 rwxp 00003000 00:00 0
    2d1fc000-2d1ff000 ---p 00081000 00:00 0
    2d1ff000-2d27d000 rwxp 00084000 00:00 0
    2d27d000-2d280000 rwxp 00000000 00:00 0
    2d280000-2d2fe000 rwxp 00105000 00:00 0
    2d2fe000-2d301000 ---p 00183000 00:00 0
    2d301000-2d37f000 rwxp 00186000 00:00 0
    2d37f000-2d382000 ---p 00204000 00:00 0
    2d382000-2d600000 rwxp 00207000 00:00 0
    2d67f000-2d682000 ---p 00000000 00:00 0
    2d682000-2e1ff000 rwxp 00003000 00:00 0
    2e1ff000-2e200000 ---p 00029000 00:00 0
    2e200000-2e25d000 rwxp 0002a000 00:00 0
    2e25d000-2e300000 ---p 00059000 00:00 0
    2e300000-2e700000 rwxp 00000000 00:00 0
    2e77f000-2e782000 ---p 00000000 00:00 0
    2e782000-30500000 rwxp 00003000 00:00 0
    3057f000-30582000 rwxp 00000000 00:00 0
    30582000-30700000 rwxp 00003000 00:00 0
    3077d000-30780000 ---p 00000000 00:00 0
    30780000-307fe000 rwxp 00003000 00:00 0
    307fe000-30801000 ---p 00081000 00:00 0
    30801000-3087f000 rwxp 00084000 00:00 0
    3087f000-30882000 ---p 00102000 00:00 0
    30882000-30a00000 rwxp 00105000 00:00 0
    30a7f000-30a82000 ---p 00000000 00:00 0
    30a82000-30ffc000 rwxp 00003000 00:00 0
    30ffc000-31000000 ---p 00029000 00:00 0
    31000000-311fc000 rwxp 00095000 00:00 0
    311fc000-31200000 ---p 00029000 00:00 0
    31200000-313fc000 rwxp 0002d000 00:00 0
    313fc000-31400000 ---p 000fd000 00:00 0
    31416000-31434000 r-xs 00000000 08:02 1783998 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/wsdl4j.jar
    31434000-31442000 r-xs 00000000 08:02 1783997 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/wrapper.jar
    31442000-3147f000 r-xs 00000000 08:02 1783995 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/webInstaller.jar
    3147f000-31482000 ---p 00000000 00:00 0
    31482000-315ff000 rwxp 00003000 00:00 0
    315ff000-31600000 ---p 00000000 00:00 0
    31625000-3167f000 r-xs 00000000 08:02 1783994 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/velocity-1.4-rc1.jar
    3167f000-31682000 ---p 00000000 00:00 0
    31682000-31dfb000 rwxp 00003000 00:00 0
    31dfb000-31e00000 ---p 00000000 00:00 0
    31e14000-31e17000 ---p 00000000 00:00 0
    31e17000-31e95000 rwxp 00003000 00:00 0
    31e95000-31e98000 ---p 00081000 00:00 0
    31e98000-31f16000 rwxp 00084000 00:00 0
    31f16000-31f19000 ---p 00102000 00:00 0
    31f19000-31f97000 rwxp 00105000 00:00 0
    31f97000-31f9a000 ---p 00183000 00:00 0
    31f9a000-32018000 rwxp 00186000 00:00 0
    32018000-3201b000 ---p 00183000 00:00 0
    3201b000-32099000 rwxp 00186000 00:00 0
    32099000-3209c000 ---p 00204000 00:00 0
    3209c000-3211a000 rwxp 00207000 00:00 0
    3211a000-3211d000 ---p 00285000 00:00 0
    3211d000-3219b000 rwxp 00288000 00:00 0
    3219b000-3219e000 ---p 00102000 00:00 0
    3219e000-3221c000 rwxp 00105000 00:00 0
    3221c000-3221f000 ---p 00183000 00:00 0
    3221f000-3229d000 rwxp 00186000 00:00 0
    3229d000-322a0000 ---p 00204000 00:00 0
    322a0000-3231e000 rwxp 00207000 00:00 0
    3231e000-32321000 ---p 00285000 00:00 0
    32321000-3239f000 rwxp 00288000 00:00 0
    3239f000-323a2000 ---p 00306000 00:00 0
    323a2000-32420000 rwxp 00309000 00:00 0
    32420000-32423000 ---p 00387000 00:00 0
    32423000-324a1000 rwxp 0038a000 00:00 0
    324a1000-324a4000 ---p 00408000 00:00 0
    324a4000-32522000 rwxp 0040b000 00:00 0
    32522000-32525000 ---p 00285000 00:00 0
    32525000-325a3000 rwxp 00288000 00:00 0
    325a3000-325a6000 ---p 00102000 00:00 0
    325a6000-32624000 rwxp 00105000 00:00 0
    32624000-32627000 ---p 00183000 00:00 0
    32627000-326a5000 rwxp 00186000 00:00 0
    326a5000-326a8000 ---p 00204000 00:00 0
    326a8000-32726000 rwxp 00207000 00:00 0
    32726000-32729000 ---p 00285000 00:00 0
    32729000-327a7000 rwxp 00288000 00:00 0
    327a7000-327aa000 ---p 00102000 00:00 0
    327aa000-32828000 rwxp 00105000 00:00 0
    32828000-3282b000 rwxp 00000000 00:00 0
    3282b000-328a9000 rwxp 00186000 00:00 0
    328a9000-328ac000 ---p 00204000 00:00 0
    328ac000-3292a000 rwxp 00207000 00:00 0
    3292a000-3292d000 ---p 00285000 00:00 0
    3292d000-329ab000 rwxp 00288000 00:00 0
    329ab000-329ae000 rwxp 00000000 00:00 0
    329ae000-32a2c000 rwxp 00309000 00:00 0
    32a2c000-32a2f000 ---p 00183000 00:00 0
    32a2f000-32aad000 rwxp 00186000 00:00 0
    32aad000-32ab0000 rwxp 00000000 00:00 0
    32ab0000-32b2e000 rwxp 00207000 00:00 0
    32b2e000-32b31000 ---p 00000000 00:00 0
    32b31000-32baf000 rwxp 00003000 00:00 0
    32baf000-32bb2000 ---p 00081000 00:00 0
    32bb2000-32c30000 rwxp 00084000 00:00 0
    32c30000-32c33000 ---p 00102000 00:00 0
    32c33000-32cb1000 rwxp 00105000 00:00 0
    32cb1000-32cb4000 rwxp 00000000 00:00 0
    32cb4000-32d32000 rwxp 00186000 00:00 0
    32d32000-32d35000 rwxp 00000000 00:00 0
    32d35000-32db3000 rwxp 00084000 00:00 0
    32db3000-32db6000 ---p 00102000 00:00 0
    32db6000-32e34000 rwxp 00105000 00:00 0
    32e34000-32e37000 rwxp 00000000 00:00 0
    32e37000-32eb5000 rwxp 00186000 00:00 0
    32eb5000-32eb8000 ---p 00204000 00:00 0
    32eb8000-32f36000 rwxp 00207000 00:00 0
    32f36000-32f39000 rwxp 00000000 00:00 0
    32f39000-32fb7000 rwxp 00288000 00:00 0
    32fb7000-32fba000 ---p 00306000 00:00 0
    32fba000-33038000 rwxp 00309000 00:00 0
    33038000-3303b000 rwxp 00000000 00:00 0
    3303b000-330b9000 rwxp 00186000 00:00 0
    330b9000-330bc000 ---p 00204000 00:00 0
    330bc000-3313a000 rwxp 00207000 00:00 0
    3313a000-3313d000 ---p 00285000 00:00 0
    3313d000-331bb000 rwxp 00288000 00:00 0
    331bb000-331be000 ---p 00102000 00:00 0
    331be000-3323c000 rwxp 00105000 00:00 0
    3323c000-3323f000 ---p 00183000 00:00 0
    3323f000-332bd000 rwxp 00186000 00:00 0
    332bd000-332c0000 ---p 00204000 00:00 0
    332c0000-3333e000 rwxp 00207000 00:00 0
    3333e000-33341000 ---p 00285000 00:00 0
    33341000-333bf000 rwxp 00288000 00:00 0
    333bf000-333c2000 ---p 00306000 00:00 0
    333c2000-33440000 rwxp 00309000 00:00 0
    33440000-33443000 ---p 00183000 00:00 0
    33443000-334c1000 rwxp 00186000 00:00 0
    334e2000-33531000 r-xs 00000000 08:02 1783993 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/torque-3.0.2.jar
    33531000-33537000 r-xs 00000000 08:02 1783992 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/textile4j-1.20.jar
    33537000-336e9000 r-xs 00000000 08:02 1783991 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/tangosol.jar
    336e9000-33710000 r-xs 00000000 08:02 1783990 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/ss_css2.jar
    33710000-33716000 r-xs 00000000 08:02 1783989 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/smtp.jar
    33716000-3371b000 r-xs 00000000 08:02 1783987 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/saaj.jar
    3371b000-33720000 r-xs 00000000 08:02 1783986 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/relaxngDatatype.jar
    33720000-33726000 r-xs 00000000 08:02 1783985 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/pop3.jar
    33726000-3373e000 r-xs 00000000 08:02 1783984 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/p6spy.jar
    3373e000-3375b000 r-xs 00000000 08:02 1783983 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/oscache-2.1.1.jar
    3375b000-337ff000 r-xs 00000000 08:02 1783982 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/optional.jar
    337ff000-3396a000 r-xs 00000000 08:02 1783981 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/msv.jar
    3396a000-33979000 r-xs 00000000 08:02 1783980 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/msutil.jar
    33979000-3398a000 r-xs 00000000 08:02 1783979 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/mssqlserver.jar
    3398a000-339d1000 r-xs 00000000 08:02 1783978 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/msbase.jar
    339d1000-339e8000 r-xs 00000000 08:02 1783977 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/metadata-extractor-2.2.2.jar
    339e8000-33a15000 r-xs 00000000 08:02 1783976 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/mailapi.jar
    33a15000-33a6c000 r-xs 00000000 08:02 1783975 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/log4j-1.2.8.jar
    33a6c000-33a6e000 r-xs 00000000 08:02 1783974 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jdbc2_0-stdext.jar
    33a6e000-33ab6000 r-xs 00000000 08:02 1783973 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jcs.jar
    33ab6000-33ac2000 r-xs 00000000 08:02 1783972 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jazzy-core.jar
    33ac2000-33acb000 r-xs 00000000 08:02 1783971 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jaxrpc.jar
    33acb000-33b06000 r-xs 00000000 08:02 1783970 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jaxen-1.1-beta-4.jar
    33b06000-33b0e000 r-xs 00000000 08:02 1783969 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jakarta-regexp-1.2.jar
    33b0e000-33b1e000 r-xs 00000000 08:02 1783968 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jakarta-oro-2.0.6.jar
    33b1e000-33c9f000 r-xs 00000000 08:02 1783967 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jai_core.jar
    33c9f000-33cd3000 r-xs 00000000 08:02 1783966 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/jai_codec.jar
    33cd3000-33d03000 r-xs 00000000 08:02 1783965 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/isorelax.jar
    33d03000-33d25000 r-xs 00000000 08:02 1783964 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/imap.jar
    33d25000-33d54000 r-xs 00000000 08:02 1783963 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/hessian-3.0.13.jar
    33d54000-33d58000 r-xs 00000000 08:02 1783962 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/fast-md5-2.5.jar
    33d58000-33db8000 r-xs 00000000 08:02 1783961 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/dom4j-1.5-rc1.jar
    33db8000-33df5000 r-xs 00000000 08:02 1783960 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/dnsjava-1.6.6.jar
    33df5000-33ef6000 r-xs 00000000 08:02 1783958 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/db-ojb-1.0.1.jar
    33ef6000-33f0f000 r-xs 00000000 08:02 1783957 /usr/local/apache-tomcat-5.5.12/webapps/x/WEB-INF/lib/crossdb.jar
    33f0f000-33f1d000

    An aside: When I switch to ParallelGC, afterrunning
    for about 5-6 hours, GC times start doubling
    (approximately) in time, eventually moving upwardsof
    2 minutes per full GC.That sounds to me like you're swapping during full
    GCs. I wouldn't assume that 2 GB of physical RAM is
    sufficient to run an app with an 1800 MB heap. Have
    you done any heap profiling to determine the real
    working set of your application? When the GCs get
    this pathologically long, is there disk activity on
    the machine?Hmm.. So what should we size our heap to on a server with 2GB? The server is essentially only running the Java process. What would you consider "safe"?
    While heap profiling with jconsole, the application only utilizes 1.1GB of the heap at peaks. We want to expand that eventually as we size our caches larger.
    I don't believe there's disk activity with long GCs, but I can't confirm that 100% right now. The server is reading files from another machine, so the disks are more or less untouched while the app is running. There's heavy caching. The only reason disks would be hititng if your guess regarding the swapping turns out correct. After you suggest a safer way to calc a max heap size for our machine, I'll try again with ParallelGC and a smaller heap.
    Some points:
    - I tried increasing perm generation size. It'snot
    even close to filled (according to gc log).(As you mentioned, "old generation" instead of "perm
    generation".) What about when the full collection
    times are taking 2 minutes in duration? Is there any
    disk activity indicating swapping?Again, not positive on the disk situation -- should get an answer above to figure this out.
    - I have not tried the -client VM, will this break
    performance on a production application?The client VM does not generate as high quality
    machine code as the server VM but on the x86
    architecture many benchmark scores for the two
    compilers are comparable. I would recommend you try
    that option if only to narrow down the scope of the
    crash you're seeing.
    - I saw a bug related to a ConcMarkSweepGC crashon
    4-cpu machines opened on Oct 17th. I've testedthis
    on 4-cpu (2 proc with hyperthreading) and 2-cpu
    (hyperthreading off) -- both exhibit this issue.What bug ID is this?http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6337544
    - Are there any known issues with this collectorand
    Linux 2.4.21-37.ELsmp? Should we be using
    LD_ASSUME_KERNEL=2.2.5 or anything? For java to
    recognize this variable, do we just need itspecified
    anywhere in the environment at JVM start? How dowe
    test if it worked?No issues as far as I know, but I am not a Linux
    expert. I think in order to toggle which thread
    library is used you just need that variable exported
    in the environment when the JVM starts up. You can
    probably use pmap to see which thread library got
    loaded to verify the one you expect is present in the
    loaded objects.Trying various combinations of LD_ASSUME_KERNEL to switch threading versions has no real effect on stability there. We're seeing crashes repeatedly still.
    I'm going to attempt to deploy some machines with a new kernel as well and see if we can reproduce on those. I'll try ParallelGC again as soon as I get your recommendations on the configuration.

  • JVM Crashes with a VM state:not at safepoint (normal execution) error

    Hello.
    I have been battling with this error occasionally ocurring for months. There are many suggestions in various blogs and they all seem to think it's a JVM bug. I'm not so sure.
    I am running JBOSS 4.0.5 on SuSE Linux 10. JVM is Java HotSpot(TM) Server VM (1.5.0_21-b01 mixed mode). The code is a servlet-based non-J2EE expanded WAR file. When my app starts, it instantiates a static object called ProductCache. This object has an inner class that extends Thread called RefreshThread which runs continually, sleeping for 60 minutes and then refreshing a java.util.Map in ProductCache called cache. It does this by calling a synchronized method addItem in the parent (ProductCache).
    RefreshThread does this initial population of cache when it is instantiated and before start() is called by the instantiating class (ProductCache).
    When I occasionally get the aforementioned JVM crash, it is always when this RefreshThread wakes up for the first time (60 minutes after instantiation). I immediately restart the JBOSS instance again, and the crash doesnt't happen again - until I stop JBOSS and replace the WAR with a new version. Once I restart JBOSS, there is a risk I may get the crash again. If I do, restarting JBOSS fixes it again!
    I have tried stopping and starting JBOSS a second time immediately after updating the WAR file and this seems to mitigate the problem, but occasionally it still occurs. Restarting after the crash always stops the problem happening again even in this case.
    Is there something about multithreading I am doing wrong? Are there special rules about instantiating threads from static objects? What about calling synchronized methods from threads instantiated by the object containing the synchronized method? Why would a restart after the crash always fix it?
    Linux Info:
    OS:SUSE Linux Enterprise Server 10 (i586)
    VERSION = 10
    uname:Linux 2.6.16.21-0.8-bigsmp #1 SMP Mon Jul 3 18:25:39 UTC 2006 i686
    libc:glibc 2.4 NPTL 2.4
    rlimit: STACK 8192k, CORE 0k, NPROC 71680, NOFILE 1024, AS infinity
    load average:0.12 0.07 0.01
    CPU:total 4 (cores per cpu 2, threads per core 1) family 6 model 15 stepping 6, cmov, cx8, fxsr, mmx, sse, sse2
    Memory: 4k page, physical 8308300k(1178612k free), swap 2561k(2561k free)JVM command:
    jvm_args: -Dprogram.name=run.sh -Xms512m -Xmx2048m -XX:-UseOnStackReplacement -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.awt.headless=true -Duser.timezone=Pacific/Auckland -Djava.endorsed.dirs=/home/jboss/jboss-live-nz/lib/endorsed
    java_command: org.jboss.Main -b webapp1-2 -c default -Dlog4j.configuration=file:///home/jboss/jboss-live-nz/bin/log4j.properties
    Launcher Type: SUN_STANDARDRefreshThread code (partial):
         private class RefreshThread extends Thread implements RecordListener {
              private boolean die = false;
              private ProductCache parent;
              private DAOFactory factory;
              private CacheProductManager productManager;
              private AssortmentCache assortmentCache;
              private Map products;
              private RefreshThread( ProductCache caller ) throws Exception {
                  this.setName( "CellnetProductCacheRefresh" );
                  parent = caller;
                        factory = DAOFactory.getInstance( context );
                        productManager = (CacheProductManager)factory.createProductCacheLoader();
                        assortmentCache = AssortmentCache.getInstance( context );
                  loadFromDatabase( true );
                  loadV6Data();
              public void stopRefresh() {
                   this.interrupt();
              public void run() {
                   while( ! die ) {
                        try {
                             Thread.sleep( AppProperties.CACHE_PRODUCT_REFRESH_RATE * 60 * 1000 );
                             products = new HashMap();
                             productManager.loadAllItemsFromDatabase( this );
                             GregorianCalendar now = new GregorianCalendar();
                             if ( now.get( GregorianCalendar.HOUR_OF_DAY ) == 23 ) {
                                 update( true, products );
                             } else
                                 update( false, products );
                        } catch (CellnetWebException cwe) {
                            cwe.printStackTrace();
                        } catch (InterruptedException ie) {
                            die = true;
                        } catch (Exception e) {
                            e.printStackTrace();
             private void update( boolean fullReload, Map products ) throws Exception {
                   int addedCount = 0;
                   for( Iterator iter = products.keySet().iterator(); iter.hasNext(); ) {
                       ProductBean product = (ProductBean)products.get( iter.next() );
                       if ( fullReload || (! cache.containsKey( product.getId()) ) ) {
                           parent.setItem( product, null );
                           ++addedCount;
                           if ( ! fullReload ) {
                               try {
                                 List productAssortments = productManager.findAssortments( product.getId() );
                                 for( Iterator listIter = productAssortments.iterator(); listIter.hasNext(); ) {
                                     String assortmentId = (String)listIter.next();
                                     assortmentCache.addItem( assortmentId, product.getId() );
                             } catch (Exception e) {}
                   if ( ! fullReload ) {
                       int deletedCount = 0;
                        for( Iterator iter = cache.keySet().iterator(); iter.hasNext(); ) {
                            String id = (String)iter.next();
                            if ( ! products.containsKey( id ) ) {
                                iter.remove();
                                ++deletedCount;
                                assortmentCache.removeItem( id );
                   if ( fullReload ) {
                        assortmentCache.refresh();
             private void loadFromDatabase( boolean fullReload ) throws Exception {
                 if ( productManager == null ) {
                     DAOFactory factory = DAOFactory.getInstance( context );
                     productManager = (CacheProductManager)factory.createProductCacheLoader();
                 if ( fullReload ) {
                        System.out.println( "Full Product Cache upload commenced" );
                     cache = new HashMap();
                 products = new HashMap();
                   productManager.loadAllItemsFromDatabase( this );
                   System.out.println( products.size() + " Products Loaded from the Database" );
                   update( fullReload, products );
    ...

    What do you mean by JVM crash? A core dump? Your code, shouldn't be able to cause a core dump even if you had a bug in it.
    I did not read your code, and I don't know what you mean by static object, but you can start a thread from wherever you want, and where the thread was created doesn't matter. It should be able to invoke any methods. The only things that you have to think about is that you can get race conditions, deadlocks and all other issues that are related to concurrency.
    Kaj

  • Freqent JVM crash when using OCI

    I have been experiencing the following JVM crashes frequently. We are using OCI to access database because of failover ability, OS is Suse 9. Any help is appreciated. Here's the log file.
    Thank you.
    Anita
    ===============================
    # An unexpected error has been detected by HotSpot Virtual Machine:
    # SIGSEGV (0xb) at pc=0x00000000, pid=18784, tid=24601
    # Java VM: Java HotSpot(TM) Client VM (1.4.2_13-b06 mixed mode)
    # Problematic frame:
    # C 0x00000000
    --------------- T H R E A D ---------------
    Current thread (0x53588fd0): JavaThread "Thread-10" daemon [_thread_in_native, id=18809]
    siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x00000000
    Registers:
    EAX=0x0810619c, EBX=0x555cec38, ECX=0x5510192d, EDX=0x08107dac
    ESP=0x548350fc, EBP=0x54835958, ESI=0x0810619c, EDI=0x08107dac
    EIP=0x00000000, CR2=0x00000000, EFLAGS=0x00010283
    Top of Stack: (sp=0x548350fc)
    0x548350fc: 5510194b 0810619c 08107dac 00000000
    0x5483510c: 08379300 4d176b08 548351d8 00000000
    0x5483511c: 00000003 08382b7c 08382aa8 08125788
    0x5483512c: 00000000 083808e0 00000002 08363c00
    0x5483513c: 08164f48 08382abc 54835100 54f31700
    0x5483514c: 00000040 4d176b08 00000000 0810e650
    0x5483515c: 080b3720 08382b08 00000055 08382b74
    0x5483516c: 00000000 080b36f8 08363cd8 08382aa8
    Instructions: (pc=0x00000000)
    0xfffffff0:
    Stack: [0x547c9000,0x5483b000), sp=0x548350fc, free space=432k
    Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
    j oracle.jdbc.oci8.OCIDBAccess.do_execute(Loracle/jdbc/oci8/OCIDBStatement;I)I+0
    j oracle.jdbc.oci8.OCIDBAccess.executeFetch(Loracle/jdbc/dbaccess/DBStatement;BLoracle/jdbc/dbaccess/DBDataSet;ILoracle/jdbc/dbaccess/DBDataSet;I)I+1335
    j oracle.jdbc.driver.OracleStatement.doExecuteQuery()V+625
    j oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout()V+186
    j oracle.jdbc.driver.OraclePreparedStatement.executeUpdate()I+70
    j oracle.jdbc.driver.OraclePreparedStatement.executeQuery()Ljava/sql/ResultSet;+17
    j org.apache.catalina.realm.DualRealm.getDBRoles(Ljava/sql/Connection;Ljava/lang/String;)Ljava/util/List;+27
    j org.apache.catalina.realm.DualRealm.authorizeViaDB(Ljava/lang/String;)Ljava/util/List;+29
    j org.apache.catalina.realm.DualRealm.authenticate(Ljavax/naming/directory/DirContext;Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;)Ljava/security/Principal;+275
    j org.apache.catalina.realm.DualRealm.authenticateJNDI(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;)Ljava/security/Principal;+250
    j org.apache.catalina.realm.DualRealm.authenticate(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;)Ljava/security/Principal;+62
    j org.apache.catalina.authenticator.DualRealmFormAuthenticator.authenticate(Lorg/apache/catalina/HttpRequest;Lorg/apache/catalina/HttpResponse;Lorg/apache/catalina/deploy/LoginConfig;)Z+951
    j org.apache.catalina.authenticator.AuthenticatorBase.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;Lorg/apache/catalina/ValveContext;)V+322
    j org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+39
    j org.apache.catalina.core.StandardPipeline.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+10
    j org.apache.catalina.core.ContainerBase.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+6
    j org.apache.catalina.core.StandardContext.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+81
    j org.apache.catalina.core.StandardHostValve.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;Lorg/apache/catalina/ValveContext;)V+171
    j org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+79
    j org.apache.catalina.valves.ErrorDispatcherValve.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;Lorg/apache/catalina/ValveContext;)V+3
    j org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+39
    j org.apache.catalina.valves.ErrorReportValve.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;Lorg/apache/catalina/ValveContext;)V+3
    j org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+39
    j org.apache.catalina.core.StandardPipeline.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+10
    j org.apache.catalina.core.ContainerBase.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+6
    j org.apache.catalina.core.StandardEngineValve.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;Lorg/apache/catalina/ValveContext;)V+160
    j org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+79
    j org.apache.catalina.core.StandardPipeline.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+10
    j org.apache.catalina.core.ContainerBase.invoke(Lorg/apache/catalina/Request;Lorg/apache/catalina/Response;)V+6
    j org.apache.coyote.tomcat4.CoyoteAdapter.service(Lorg/apache/coyote/Request;Lorg/apache/coyote/Response;)V+101
    j org.apache.jk.server.JkCoyoteHandler.invoke(Lorg/apache/jk/core/Msg;Lorg/apache/jk/core/MsgContext;)I+165
    j org.apache.jk.common.HandlerRequest.invoke(Lorg/apache/jk/core/Msg;Lorg/apache/jk/core/MsgContext;)I+249
    j org.apache.jk.common.ChannelSocket.invoke(Lorg/apache/jk/core/Msg;Lorg/apache/jk/core/MsgContext;)I+59
    j org.apache.jk.common.ChannelSocket.processConnection(Lorg/apache/jk/core/MsgContext;)V+87
    j org.apache.jk.common.SocketConnection.runIt([Ljava/lang/Object;)V+8
    j org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run()V+152
    j java.lang.Thread.run()V+11
    v ~StubRoutines::call_stub
    --------------- P R O C E S S ---------------
    Java Threads: ( => current thread )
    0x080b2580 JavaThread "Thread-122" daemon [_thread_in_native, id=29611]
    0x535947a8 JavaThread "MonitorRunnable" daemon [_thread_blocked, id=18811]
    0x5358a128 JavaThread "Thread-11" daemon [_thread_in_native, id=18810]
    =>0x53588fd0 JavaThread "Thread-10" daemon [_thread_in_native, id=18809]
    0x535884b8 JavaThread "Thread-9" daemon [_thread_in_native, id=18808]
    0x535882c0 JavaThread "Thread-8" daemon [_thread_blocked, id=18807]
    0x5357f890 JavaThread "MonitorRunnable" daemon [_thread_blocked, id=18806]
    0x53594a58 JavaThread "Thread-6" daemon [_thread_in_native, id=18805]
    0x53581108 JavaThread "Thread-5" daemon [_thread_blocked, id=18804]
    0x5358d410 JavaThread "Thread-4" daemon [_thread_blocked, id=18803]
    0x535773a8 JavaThread "Thread-3" daemon [_thread_blocked, id=18802]
    0x53585508 JavaThread "HostConfig[localhost]" daemon [_thread_blocked, id=18801]
    0x535851a8 JavaThread "StandardManager[webdav]" daemon [_thread_blocked, id=18800]
    0x53595330 JavaThread "StandardManager[]" daemon [_thread_blocked, id=18799]
    0x53599cf0 JavaThread "StandardManager[manager]" daemon [_thread_blocked, id=18798]
    0x5357a450 JavaThread "StandardManager[compliance]" daemon [_thread_blocked, id=18797]
    0x53575340 JavaThread "WebappLoader[compliance]" daemon [_thread_blocked, id=18796]
    0x523f8f80 JavaThread "StandardManager[examples]" daemon [_thread_blocked, id=18795]
    0x523fcef8 JavaThread "WebappLoader[examples]" daemon [_thread_blocked, id=18794]
    0x51405480 JavaThread "CompilerThread0" daemon [_thread_blocked, id=18791]
    0x51404730 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=18790]
    0x514005f8 JavaThread "Finalizer" daemon [_thread_blocked, id=18788]
    0x080a5668 JavaThread "Reference Handler" daemon [_thread_blocked, id=18787]
    0x08057c98 JavaThread "main" [_thread_in_native, id=18784]
    Other Threads:
    0x080a24f0 VMThread [id=18786]
    0x51406f00 WatcherThread [id=18792]
    VM state:not at safepoint (normal execution)
    VM Mutex/Monitor currently owned by a thread: None
    Heap
    def new generation total 9088K, used 412K [0x45170000, 0x45b40000, 0x45b40000)
    eden space 8128K, 1% used [0x45170000, 0x45192400, 0x45960000)
    from space 960K, 28% used [0x45960000, 0x459a4d10, 0x45a50000)
    to space 960K, 0% used [0x45a50000, 0x45a50000, 0x45b40000)
    tenured generation total 121024K, used 15706K [0x45b40000, 0x4d170000, 0x4d170000)
    the space 121024K, 12% used [0x45b40000, 0x46a96b38, 0x46a96c00, 0x4d170000)
    compacting perm gen total 11264K, used 11218K [0x4d170000, 0x4dc70000, 0x51170000)
    the space 11264K, 99% used [0x4d170000, 0x4dc64880, 0x4dc64a00, 0x4dc70000)
    Dynamic libraries:
    08048000-08053000 r-xp 00000000 68:06 69898 /usr/java/j2sdk1.4.2_13/bin/java
    08053000-08055000 rw-p 0000a000 68:06 69898 /usr/java/j2sdk1.4.2_13/bin/java
    08055000-08446000 rwxp 00000000 00:00 0
    40000000-40013000 r-xp 00000000 68:05 11538 /lib/ld-2.2.5.so
    40013000-40014000 rw-p 00013000 68:05 11538 /lib/ld-2.2.5.so
    40014000-4001a000 r-xp 00000000 68:06 62540 /usr/java/j2sdk1.4.2_13/jre/lib/i386/native_threads/libhpi.so
    4001a000-4001c000 rw-p 00005000 68:06 62540 /usr/java/j2sdk1.4.2_13/jre/lib/i386/native_threads/libhpi.so
    4001c000-40020000 rw-s 00000000 68:07 110 /tmp/hsperfdata_tc_cmpdv/18784
    40021000-4002e000 r-xp 00000000 68:05 11466 /lib/i686/libpthread.so.0
    4002e000-40035000 rw-p 0000d000 68:05 11466 /lib/i686/libpthread.so.0
    40035000-40036000 rw-p 00000000 00:00 0
    40036000-40038000 r-xp 00000000 68:05 11500 /lib/libdl.so.2
    40038000-40039000 rw-p 00001000 68:05 11500 /lib/libdl.so.2
    40039000-4014d000 r-xp 00000000 68:05 11529 /lib/i686/libc.so.6
    4014d000-40153000 rw-p 00113000 68:05 11529 /lib/i686/libc.so.6
    40153000-40157000 rw-p 00000000 00:00 0
    40157000-40570000 r-xp 00000000 68:06 69111 /usr/java/j2sdk1.4.2_13/jre/lib/i386/client/libjvm.so
    40570000-4058c000 rw-p 00418000 68:06 69111 /usr/java/j2sdk1.4.2_13/jre/lib/i386/client/libjvm.so
    4058c000-405a1000 rw-p 00000000 00:00 0
    405a1000-405b3000 r-xp 00000000 68:05 11541 /lib/libnsl.so.1
    405b3000-405b4000 rw-p 00011000 68:05 11541 /lib/libnsl.so.1
    405b4000-405b6000 rw-p 00000000 00:00 0
    405b6000-405d8000 r-xp 00000000 68:05 11457 /lib/i686/libm.so.6
    405d8000-405d9000 rw-p 00021000 68:05 11457 /lib/i686/libm.so.6
    405d9000-405e6000 r-xp 00000000 68:06 69119 /usr/java/j2sdk1.4.2_13/jre/lib/i386/libverify.so
    405e6000-405e8000 rw-p 0000c000 68:06 69119 /usr/java/j2sdk1.4.2_13/jre/lib/i386/libverify.so
    405e8000-40604000 r-xp 00000000 68:06 69121 /usr/java/j2sdk1.4.2_13/jre/lib/i386/libjava.so
    40604000-40606000 rw-p 0001b000 68:06 69121 /usr/java/j2sdk1.4.2_13/jre/lib/i386/libjava.so
    40606000-40614000 r-xp 00000000 68:06 69123 /usr/java/j2sdk1.4.2_13/jre/lib/i386/libzip.so
    40614000-40616000 rw-p 0000d000 68:06 69123 /usr/java/j2sdk1.4.2_13/jre/lib/i386/libzip.so
    40616000-40619000 r--s 00000000 3a:00 460370 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/bin/tomcat-jni.jar
    40619000-4061c000 r--s 00000000 3a:00 460384 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/bin/commons-daemon.jar
    4061c000-40623000 r--s 00000000 3a:00 460393 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/bin/bootstrap.jar
    40623000-40633000 r--s 00000000 3a:00 369241 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/endorsed/dom.jar
    40633000-4064b000 r--s 00000000 3a:00 474022 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/endorsed/sax.jar
    4064b000-408fa000 r--s 00000000 3a:00 587835 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/endorsed/xercesImpl.jar
    408fa000-40fbf000 r--s 00000000 3a:00 479234 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/endorsed/xalan.jar
    40fbf000-40ff5000 r--s 00000000 3a:00 386319 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/endorsed/jaxp-api.jar
    40ff5000-429a3000 r--s 00000000 68:06 69889 /usr/java/j2sdk1.4.2_13/jre/lib/rt.jar
    429a3000-429ed000 rw-p 00000000 00:00 0
    429ed000-42a03000 r--s 00000000 68:06 69153 /usr/java/j2sdk1.4.2_13/jre/lib/sunrsasign.jar
    42a03000-42ae0000 r--s 00000000 68:06 69763 /usr/java/j2sdk1.4.2_13/jre/lib/jsse.jar
    42ae0000-42af2000 r--s 00000000 68:06 69154 /usr/java/j2sdk1.4.2_13/jre/lib/jce.jar
    42af2000-430c7000 r--s 00000000 68:06 69814 /usr/java/j2sdk1.4.2_13/jre/lib/charsets.jar
    430c7000-45147000 rwxp 00000000 00:00 0
    45147000-4516f000 rw-p 00000000 00:00 0
    45170000-5122e000 rwxp 00000000 00:00 0
    5122e000-5122f000 ---p 0c0be000 00:00 0
    5122f000-512af000 rwxp 0c0bf000 00:00 0
    512af000-512b0000 ---p 0c13f000 00:00 0
    512b0000-512be000 rwxp 0c140000 00:00 0
    512be000-512c1000 ---p 0c14e000 00:00 0
    512c1000-51330000 rwxp 0c151000 00:00 0
    51330000-51331000 ---p 0c1c0000 00:00 0
    51331000-5133f000 rwxp 0c1c1000 00:00 0
    5133f000-51342000 ---p 0c1cf000 00:00 0
    51342000-513b1000 rwxp 0c1d2000 00:00 0
    513b1000-513dc000 r--p 00000000 68:06 87085 /usr/lib/locale/en_GB/LC_CTYPE
    513dc000-513df000 r--s 00000000 68:06 69150 /usr/java/j2sdk1.4.2_13/jre/lib/ext/dnsns.jar
    513df000-513fb000 r--s 00000000 68:06 69149 /usr/java/j2sdk1.4.2_13/jre/lib/ext/sunjce_provider.jar
    513fb000-513fe000 r--s 00000000 3a:00 515615 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/jta.jar
    513fe000-51400000 r--s 00000000 3a:00 515649 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/servlets-common.jar
    51400000-514ff000 rw-p 00000000 00:00 0
    514ff000-51501000 ---p 000eb000 00:00 0
    51501000-51581000 rwxp 00000000 00:00 0
    51581000-51582000 ---p 00080000 00:00 0
    51582000-51590000 rwxp 00081000 00:00 0
    51590000-51593000 ---p 0008f000 00:00 0
    51593000-51602000 rwxp 00092000 00:00 0
    51602000-51603000 ---p 00101000 00:00 0
    51603000-51611000 rwxp 00102000 00:00 0
    51611000-51614000 ---p 00110000 00:00 0
    51614000-51683000 rwxp 00113000 00:00 0
    51683000-51684000 ---p 00182000 00:00 0
    51684000-51704000 rwxp 00183000 00:00 0
    51704000-51711000 r--s 00000000 68:06 69152 /usr/java/j2sdk1.4.2_13/jre/lib/ext/ldapsec.jar
    51711000-517cd000 r--s 00000000 68:06 69815 /usr/java/j2sdk1.4.2_13/jre/lib/ext/localedata.jar
    517cd000-51ca9000 r--s 00000000 68:06 10327 /usr/java/j2sdk1.4.2_13/lib/tools.jar
    51ca9000-51cb5000 r--s 00000000 3a:00 515616 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/activation.jar
    51cb5000-51ccc000 r--s 00000000 3a:00 515617 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/commons-collections.jar
    51ccc000-51ce0000 r--s 00000000 3a:00 515621 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/servlet.jar
    51ce0000-51cf5000 r--s 00000000 3a:00 515622 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/jdbc2_0-stdext.jar
    51cf5000-51d22000 r--s 00000000 3a:00 515623 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/jasper-compiler.jar
    51d22000-51d41000 r--s 00000000 3a:00 515624 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/Opta2000.jar
    51d41000-51d86000 r--s 00000000 3a:00 515625 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/mail.jar
    51d86000-51d9f000 r--s 00000000 3a:00 515626 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/jndi.jar
    51d9f000-51da4000 r--s 00000000 3a:00 515627 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/naming-factory.jar
    51da4000-51ec7000 r--s 00000000 3a:00 515619 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/ojdbc14.jar
    51ec7000-51ed8000 r--s 00000000 3a:00 515628 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/jasper-runtime.jar
    51ed8000-51ee2000 r--s 00000000 3a:00 515629 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/naming-resources.jar
    51ee2000-51f92000 r--s 00000000 3a:00 515630 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/ant.jar
    51f92000-51f97000 r--s 00000000 3a:00 515631 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/commons-logging-api.jar
    51f97000-51f9e000 r--s 00000000 3a:00 515632 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/naming-common.jar
    51f9e000-51fb7000 r--s 00000000 3a:00 515370 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/commons-dbcp-1.1.jar
    51fb7000-51fc1000 r--s 00000000 3a:00 515372 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/common/lib/commons-pool-1.1.jar
    51fc1000-51fc5000 r--s 00000000 3a:00 515641 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/catalina-ant.jar
    51fc5000-51fd9000 r--s 00000000 3a:00 515642 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/tomcat-jk2.jar
    51fd9000-51fff000 r--s 00000000 3a:00 515645 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/tomcat-util.jar
    52000000-520fd000 rw-p 00000000 00:00 0
    520fd000-52100000 ---p 0015f000 00:00 0
    52100000-52107000 r--s 00000000 3a:00 515654 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/commons-logging.jar
    52107000-52116000 r--s 00000000 3a:00 515643 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/tomcat-coyote.jar
    52116000-5211f000 r--s 00000000 3a:00 515646 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/tomcat-http11.jar
    5211f000-52139000 r--s 00000000 3a:00 515647 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/jaas.jar
    52139000-52140000 r--s 00000000 3a:00 515652 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/DualRealm.jar
    52140000-52142000 r--s 00000000 3a:00 515653 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/servlets-invoker.jar
    52142000-52187000 r--s 00000000 3a:00 515655 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/mx4j-jmx.jar
    52187000-5219e000 r--s 00000000 3a:00 515656 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/commons-digester.jar
    5219e000-52257000 r--s 00000000 3a:00 516898 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/catalina.jar
    52257000-5225c000 r--s 00000000 3a:00 515657 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/servlets-default.jar
    5225c000-52260000 r--s 00000000 3a:00 515658 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/servlets-manager.jar
    52260000-52268000 r--s 00000000 3a:00 515659 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/jakarta-regexp-1.2.jar
    52268000-5226e000 r--s 00000000 3a:00 515660 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/tomcat-warp.jar
    5226e000-52276000 r--s 00000000 3a:00 515661 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/commons-modeler.jar
    52276000-52286000 r--s 00000000 3a:00 515662 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/tomcat-jk.jar
    52286000-5229a000 r--s 00000000 3a:00 515663 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/commons-beanutils.jar
    5229a000-522a0000 r--s 00000000 3a:00 515664 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/server/lib/servlets-webdav.jar
    522a0000-522ae000 r-xp 00000000 68:06 69127 /usr/java/j2sdk1.4.2_13/jre/lib/i386/libnet.so
    522ae000-522af000 rw-p 0000d000 68:06 69127 /usr/java/j2sdk1.4.2_13/jre/lib/i386/libnet.so
    522af000-522b7000 r--s 00000000 3a:00 1757684 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/CompCommon.jar
    522b7000-522bc000 r--s 00000000 3a:00 1757686 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/CompDBUtil.jar
    522bc000-522c5000 r-xp 00000000 68:05 11512 /lib/libnss_files.so.2
    522c5000-522c6000 rw-p 00008000 68:05 11512 /lib/libnss_files.so.2
    522c6000-522c9000 r-xp 00000000 68:05 11511 /lib/libnss_dns.so.2
    522c9000-522ca000 rw-p 00003000 68:05 11511 /lib/libnss_dns.so.2
    522ca000-522d8000 r-xp 00000000 68:05 11515 /lib/libresolv.so.2
    522d8000-522d9000 rw-p 0000e000 68:05 11515 /lib/libresolv.so.2
    522d9000-522db000 rw-p 00000000 00:00 0
    522db000-522fa000 r--s 00000000 3a:00 1757687 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/CompPrivateXMLMessage.jar
    522fa000-52300000 r--s 00000000 3a:00 1757697 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/commons-fileupload.jar
    52300000-523ff000 rw-p 00000000 00:00 0
    523ff000-52400000 ---p 00000000 00:00 0
    52400000-52415000 r-xp 00000000 3a:00 80003 /local/oracle/apps/oracle/product/9ir2/lib/libocijdbc9.so
    52415000-52417000 rw-p 00014000 3a:00 80003 /local/oracle/apps/oracle/product/9ir2/lib/libocijdbc9.so
    52417000-52419000 r-xp 00000000 3a:00 79911 /local/oracle/apps/oracle/product/9ir2/lib/libwtc9.so
    52419000-5241a000 rw-p 00001000 3a:00 79911 /local/oracle/apps/oracle/product/9ir2/lib/libwtc9.so
    5241a000-52465000 rw-p 00000000 00:00 0
    52481000-5249d000 r--s 00000000 3a:00 1757688 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/CompSharedXMLMessage.jar
    5249d000-524a4000 r--s 00000000 3a:00 1757689 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/DualRealm.jar
    524a4000-524af000 r--s 00000000 3a:00 1757690 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/activation.jar
    524af000-524de000 r--s 00000000 3a:00 1757693 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/commons-beanutils.jar
    524de000-524f9000 r--s 00000000 3a:00 1757695 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/commons-dbcp-1.2.1.jar
    524f9000-524fb000 r--s 00000000 3a:00 1757704 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jax-qname.jar
    524fb000-524fd000 r--s 00000000 3a:00 1757711 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jdbc2_0-stdext.jar
    524fd000-524ff000 r--s 00000000 3a:00 1757717 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/namespace.jar
    52500000-52600000 rw-p 00000000 00:00 0
    52600000-52601000 ---p 000da000 00:00 0
    52601000-5260f000 rwxp 00000000 00:00 0
    5260f000-52612000 ---p 0000e000 00:00 0
    52612000-52681000 rwxp 00011000 00:00 0
    52681000-52682000 ---p 00080000 00:00 0
    52682000-52690000 rwxp 00081000 00:00 0
    52690000-52693000 ---p 0008f000 00:00 0
    52693000-52702000 rwxp 00092000 00:00 0
    52702000-5280a000 r--s 00000000 3a:00 1757685 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/CompDAO.jar
    5280a000-52862000 r--s 00000000 3a:00 1757691 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/antlr.jar
    52862000-5291b000 r--s 00000000 3a:00 1757692 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/catalina.jar
    5291b000-52946000 r--s 00000000 3a:00 1757694 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/commons-collections.jar
    52946000-52970000 r--s 00000000 3a:00 1757696 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/commons-digester.jar
    52970000-5297a000 r--s 00000000 3a:00 1757698 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/commons-logging.jar
    5297a000-5298f000 r--s 00000000 3a:00 1757699 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/commons-validator.jar
    5298f000-5299f000 r--s 00000000 3a:00 1757700 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/dom.jar
    5299f000-52a5b000 r--s 00000000 3a:00 1757701 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/iText.jar
    52a5b000-52a89000 r--s 00000000 3a:00 1757702 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jaas.jar
    52a89000-52a99000 r--s 00000000 3a:00 1757703 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jakarta-oro.jar
    52a99000-52aaf000 r--s 00000000 3a:00 1757705 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jaxb-api.jar
    52aaf000-52ade000 r--s 00000000 3a:00 1757709 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jaxen-full.jar
    52ade000-52ae4000 r--s 00000000 3a:00 1757713 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jstl.jar
    52ae4000-52ae9000 r--s 00000000 3a:00 1757714 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jta-spec1_0_1.jar
    52ae9000-52af1000 r--s 00000000 3a:00 1757719 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/relaxngDatatype.jar
    52af1000-52af7000 r--s 00000000 3a:00 1757721 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/saxpath.jar
    52af7000-52afb000 r--s 00000000 3a:00 1757724 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/td_ie_util.jar
    52b00000-52c00000 rw-p 00000000 00:00 0
    52c00000-52c54000 r--s 00000000 3a:00 1757706 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jaxb-impl.jar
    52c54000-52e0d000 r--s 00000000 3a:00 1757707 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jaxb-libs.jar
    52e0d000-53167000 r--s 00000000 3a:00 1757708 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jaxb-xjc.jar
    53167000-5319d000 r--s 00000000 3a:00 1757710 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jaxp-api.jar
    5319d000-53216000 r--s 00000000 3a:00 1757712 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/jfreechart-0.9.11.jar
    53216000-53273000 r--s 00000000 3a:00 1757715 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/log4j-1.2.4.jar
    53273000-532c3000 r--s 00000000 3a:00 1757716 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/mail.jar
    532c3000-53387000 r--s 00000000 3a:00 1757718 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/poi-2.5.1-final-20040804.jar
    53387000-5339f000 r--s 00000000 3a:00 1757720 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/sax.jar
    5339f000-5341c000 r--s 00000000 3a:00 1757722 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/standard.jar
    5341c000-534a3000 r--s 00000000 3a:00 1757723 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/struts.jar
    534a3000-534c2000 r--s 00000000 3a:00 1757727 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/xml-apis.jar
    53500000-535fc000 rw-p 00000000 00:00 0
    535fc000-53600000 ---p 000be000 00:00 0
    53600000-53cc5000 r--s 00000000 3a:00 1757725 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/xalan.jar
    53cc5000-53f74000 r--s 00000000 3a:00 1757726 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/xercesImpl.jar
    53f74000-54031000 r--s 00000000 3a:00 1757728 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/xmlsec.jar
    54031000-540a6000 r--s 00000000 3a:00 1757729 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/xsdlib.jar
    540a6000-540a7000 ---p 00000000 00:00 0
    540a7000-540b5000 rwxp 00001000 00:00 0
    540b5000-540b8000 ---p 0000f000 00:00 0
    540b8000-54127000 rwxp 00012000 00:00 0
    54127000-54128000 ---p 00081000 00:00 0
    54128000-54136000 rwxp 00082000 00:00 0
    54136000-54139000 ---p 00090000 00:00 0
    54139000-541a8000 rwxp 00093000 00:00 0
    541a8000-5422f000 r--s 00000000 3a:00 1757723 /local/home/tc_cmpdv/pkg/jakarta-tomcat-4.1.18/webapps/compliance/WEB-INF/lib/struts.jar
    5422f000-54230000 ---p 00000000 00:00 0
    54230000-5423e000 rwxp 00001000 00:00 0
    5423e000-54241000 ---p 0000f000 00:00 0
    54241000-542b0000 rwxp 00012000 00:00 0
    542b0000-542b1000 ---p 00081000 00:00 0
    542b1000-542bf000 rwxp 00082000 00:00 0
    542bf000-542c2000 ---p 00090000 00:00 0
    542c2000-54331000 rwxp 00093000 00:00 0
    54331000-54332000 ---p 00102000 00:00 0
    54332000-54340000 rwxp 00103000 00:00 0
    54340000-54343000 ---p 00111000 00:00 0
    54343000-543b2000 rwxp 00114000 00:00 0
    543b2000-543b3000 ---p 00183000 00:00 0
    543b3000-543c1000 rwxp 00184000 00:00 0
    543c1000-543c4000 ---p 00192000 00:00 0
    543c4000-54433000 rwxp 00195000 00:00 0
    54433000-54434000 ---p 00204000 00:00 0
    54434000-54442000 rwxp 00205000 00:00 0
    54442000-54445000 ---p 00213000 00:00 0
    54445000-544b4000 rwxp 00216000 00:00 0
    544b4000-544b5000 ---p 00285000 00:00 0
    544b5000-544c3000 rwxp 00286000 00:00 0
    544c3000-544c6000 ---p 00294000 00:00 0
    544c6000-54535000 rwxp 00297000 00:00 0
    54535000-54536000 ---p 00306000 00:00 0
    54536000-54544000 rwxp 00307000 00:00 0
    54544000-54547000 ---p 00315000 00:00 0
    54547000-545b6000 rwxp 00318000 00:00 0
    545b6000-545b7000 ---p 00387000 00:00 0
    545b7000-545c5000 rwxp 00388000 00:00 0
    545c5000-545c8000 ---p 00396000 00:00 0
    545c8000-54637000 rwxp 00399000 00:00 0
    54637000-54638000 ---p 00408000 00:00 0
    54638000-54646000 rwxp 00409000 00:00 0
    54646000-54649000 ---p 00417000 00:00 0
    54649000-546b8000 rwxp 0041a000 00:00 0
    546b8000-546b9000 ---p 00489000 00:00 0
    546b9000-546c7000 rwxp 0048a000 00:00 0
    546c7000-546ca000 ---p 00498000 00:00 0
    546ca000-54739000 rwxp 0049b000 00:00 0
    54739000-5473a000 ---p 0050a000 00:00 0
    5473a000-54748000 rwxp 0050b000 00:00 0
    54748000-5474b000 ---p 00519000 00:00 0
    5474b000-547ba000 rwxp 0051c000 00:00 0
    547ba000-547bb000 ---p 0058b000 00:00 0
    547bb000-547c9000 rwxp 0058c000 00:00 0
    547c9000-547cc000 ---p 0059a000 00:00 0
    547cc000-5483b000 rwxp 0059d000 00:00 0
    5483b000-5483c000 ---p 0060c000 00:00 0
    5483c000-5484a000 rwxp 0060d000 00:00 0
    5484a000-5484d000 ---p 0061b000 00:00 0
    5484d000-548bc000 rwxp 0061e000 00:00 0
    548bc000-548fd000 rw-p 00000000 00:00 0
    548fd000-548fe000 ---p 00000000 00:00 0
    548fe000-5490c000 rwxp 00001000 00:00 0
    5490c000-5490f000 ---p 0000f000 00:00 0
    5490f000-5497e000 rwxp 00012000 00:00 0
    54a00000-54a49000 rw-p 00000000 00:00 0
    54a49000-54b00000 ---p 000cb000 00:00 0
    54b9b000-54b9c000 ---p 00000000 00:00 0
    54b9c0

    Hello,
    Hi,
    My application server(apache-tomcat-5.5.27) is running on linux box with Jdk1.6_13,64 bit server, It's crashing frequently like every 12- 15 hrs once. I am using OCI dirver to connect to the oracle database, here with I have enclosed the dump file generated.
    Any one faced such issues or have workaround or help on this issue to resolve is highly appreciated...
    Please help me as soon as possible//
    # An unexpected error has been detected by Java Runtime Environment:
    # SIGSEGV (0xb) at pc=0x0000002c35f26e7e, pid=11354, tid=1074588000
    # Java VM: Java HotSpot(TM) 64-Bit Server VM (11.3-b02 mixed mode linux-amd64)
    # Problematic frame:
    # C [libclntsh.so.10.1+0x552e7e] gslcrqwWrite+0x40
    # If you would like to submit a bug report, please visit:
    # http://java.sun.com/webapps/bugreport/crash.jsp
    # The crash happened outside the Java Virtual Machine in native code.
    # See problematic frame for where to report the bug.
    --------------- T H R E A D ---------------
    Current thread (0x0000002c343ff000): JavaThread "DefaultQuartzScheduler_Worker-3" [_thread_in_native, id=11383, stack(0x00000000400ae000,0x00000000400cf000)]
    siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x000000000000019c
    Registers:
    RAX=0x0000002c34310f80, RBX=0x0000000000000000, RCX=0x0000002c33744d80, RDX=0x0000000000000000
    RSP=0x00000000400c4d60, RBP=0x00000000400c4da0, RSI=0x0000002c3355e5f0, RDI=0x0000000000000000
    R8 =0x0000000000000000, R9 =0x0000000000000000, R10=0x0000002c36cf00a0, R11=0x0000002c35f41800
    R12=0x0000000000000000, R13=0x0000000000000000, R14=0x0000002c3355e5f0, R15=0x0000000000000000
    RIP=0x0000002c35f26e7e, EFL=0x0000000000010202, CSGSFS=0x0000000000000000, ERR=0x0000000000000004
    TRAPNO=0x000000000000000e
    time: Mon Apr 20 05:16:14 2009
    elapsed time: 42930 seconds

  • How to determine the structure of parameter method in WebServiceDataControl

    Hi all ,
    I have a web Service Data Control ,this data control has web service method that take a parameter of type (java.lang.Object)
    how can I determine the structure of this object to send it to the web service method
    (how can create the object that satisfy the object parameter of web service data control)

    I can see the constructor of data control which contain (name,age)
    but I don't know how can I send these two parameter in one object that satisfy the type of object in the web service method
    "parameterObject" : contain (name and age) values . (I don't know the type of "parameterObject" in web service)
    Map params = operationBinding.getParamsMap();
    params.put("arg0", parameterObject);

  • What method does Audition use to determine the overal frequency?

    Hi,
    Does anyone know what method Audition uses to determine 'overall frequency' in the 'frequency analysis' section? I need to know how it is calculated?
    Many thanks!

    stephaniec9433324 wrote:
    Thank you for that! So am I right in thinking the 'overall frequency' is just the frequency point which contains the highest amount of energy in a given sound sample?
    I don't know why it's called the 'overall' frequency - seems a bit strange to me, although what else you could call it without it being a bit of a mouthful, I'm not sure. But strictly speaking, what it is is the frequency of the highest amplitude at that instant in the display. It's not really a signal you are measuring either; it's a single FFT 'slice', which begs even more questions, as the size of the slice determines the resolution, and therefore the accuracy of the result anyway.

  • Best method to determine the week number of a month - SQL Server 2012

    Hi,
    I'm searching the most valid and tested method to determine the week number respect to a month.
    Fe, the 1st January falls in the 1st week of January, the 1st February fall in the 1st week of February, and so on.
    I've found many solutions but I'd like to know possibly the best one.
    Thanks

    Hi Uri,
    SELECT DATEPART(week, '20150104')
         - DATEPART(week, CONVERT(CHAR(6), '20150104', 112)+'01')
         + 1
    returns 2 and not 1. It's a Sunday.
    Waiting to be spoonfed, eh?
    The one-off in my query would be very simple to figure out - I forgot to add the +1. Is too much to expect from you that you could figure it out yourself?
    And likewise, in my post I said that you should use "week" for weeks starting on Sunday, and "iso_week" if your week starts on Monday. Uri neglected to observe this, but you had the information to correct it. If you had been interested
    in doing some work yourself, that is.
    Nevertheless, there is an issue that I overlooked:
    DECLARE @day date = '20160105'
    SELECT datepart(iso_week, @day) -
           datepart(iso_week, convert(char(6), @day, 112) + '01') + 1
    This returns -51. This is because with ISO week numbering, Jan 1st falls into week 53 of the previous year, if it's on a Friday or later. Week 1 is always the week of Jan 4th. When you week this does not happen, as week 1 is always the week with Jan
    1st. (Dec 31st is always in week 53 or 54.)
    To correct for this, we need this query:
    SELECT DATEPART(iso_week, @day) -
           CASE WHEN DATEPART(iso_week, CONVERT(CHAR(6), @day, 112) + '01') < 50
                THEN DATEPART(iso_week, CONVERT(CHAR(6), @day, 112) + '01')
                ELSE 1
           END + 1
    Erland Sommarskog, SQL Server MVP, [email protected]

  • How do you determine the optimal size for Mozilla Firefox?

    How do you determine the optimal size for cache in Mozilla
    Firefox? I am using Firefox 7.0.1 on a 64-bit Windows 7 Ultimate operating system with 3GB RAM and 300 GB hard drive, but I have other computers running Windows XP. If the answer doesn't apply to all current versions of Firefox on all supported Windows operating systems, please explain the differences. Is there a formula for calculating the best cache size?

    I found that the best idea is to let Firefox decide that itself.

  • How to determine the size of the JVM process?

    Hi,
    How to determine the total process size of the JVM process (that includes Heap, Non Heap and Native memory)?
    Is there any command to obtain this value on Solaris (for Sun JVM)?
    I refer the process size to http://middlewaremagic.com/weblogic/wp-content/uploads/2010/11/Java_Heap_Diagram_12.jpg) here.
    Many thanks for your help in advance!

    Hi,
    Make sure that Total Heap + Native memory will be consider as total Memory.
    That means in 32 bit you will have only at most 4 GB for process + additional 2 GB for OS.
    So let assume if you have 4GM RAM then out of the 4GB you can allocate 2GB as Heap and 512m as Perm in case of Hot spot and remaining will be consider as Native memory.
    But in case of 64 bit will change you will have good amount of the memory so you can use plenty of Heap and Perm size.
    Still if you have query let me know.
    Regards,
    Kal

Maybe you are looking for