Hotspot JVM crash on Solaris 10: perm gen up to 99%
Hello all,
I got 4 JVM crashes with the same Internal Error (5349474E41545552450E43505000C0 01) reported in the Catalina output log. However I have only 1 hs_err_pid.log that is still available (the other 3 were deleted). I've noticed that the perm gen momory was up to 99% full but there was no OutOfMemory error exception. Please help. Thanks.
OS: Solaris 10
JVM: 1.4.2_10
==============================================
# An unexpected error has been detected by HotSpot Virtual Machine:
# Internal Error (5349474E41545552450E43505000C0 01), pid=244, tid=7735
# Java VM: Java HotSpot(TM) Client VM (1.4.2_10-b03 mixed mode)
T H R E A D
Current thread (0x01343e78): JavaThread "http-80-Processor15" daemon [_thread_in_vm, id=7735]
Stack: [0xa8000000,0xa8080000), sp=0xa807d518, free space=501k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x398e00]
V [libjvm.so+0x23a49c]
V [libjvm.so+0xcdd44]
V [libjvm.so+0x13fe08]
v ~RuntimeStub::interpreter_entries Runtime1 stub
J org.apache.xalan.xsltc.dom.CurrentNodeListIterator.next()I
J org.apache.xalan.xsltc.dom.StepIterator.next()I
J org.apache.xalan.xsltc.dom.DupFilterIterator.setStartNode(I)Lorg/apache/xml/dtm/DTMAxisIterator;
j GregorSamsa.hcsFmtMainSearchResults(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;I)V+1913
j GregorSamsa.StartUp(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;I)V+129
j GregorSamsa.template$dot$57(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;I)V+6
j GregorSamsa.applyTemplates(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;)V+494
j GregorSamsa.applyTemplates(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;)V+527
j GregorSamsa.transform(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;)V+58
j org.apache.xalan.xsltc.runtime.AbstractTranslet.transform(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/serializer/SerializationHandler;)V+9
j org.apache.xalan.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Lorg/apache/xml/serializer/SerializationHandler;Ljava/lang/String;)V+152
j org.apache.xalan.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Ljavax/xml/transform/Result;)V+119
j com.thc.ids.presentation.services.xslt.PF_XSLTService.transform(Ljava/lang/String;Lorg/apache/velocity/context/Context;Ljavax/xml/transform/Result;)V+84
j com.thc.ids.presentation.services.xslt.PF_XSLTService.transform(Ljava/lang/String;Lorg/apache/velocity/context/Context;)Ljava/lang/String;+34
j com.thc.ids.presentation.services.xslt.PF_XSLT.transform(Ljava/lang/String;Lorg/apache/velocity/context/Context;)Ljava/lang/String;+5
j com.thc.ids.presentation.modules.screens.VelocityXslScreen.buildTemplate(Lorg/apache/turbine/util/RunData;)Lorg/apache/ecs/ConcreteElement;+161
j org.apache.turbine.modules.screens.TemplateScreen.doBuild(Lorg/apache/turbine/util/RunData;)Lorg/apache/ecs/ConcreteElement;+9
j org.apache.turbine.modules.Screen.build(Lorg/apache/turbine/util/RunData;)Lorg/apache/ecs/ConcreteElement;+2
j org.apache.turbine.modules.ScreenLoader.eval(Lorg/apache/turbine/util/RunData;Ljava/lang/String;)Lorg/apache/ecs/ConcreteElement;+6
j org.apache.turbine.modules.layouts.VelocityECSLayout.doBuild(Lorg/apache/turbine/util/RunData;)V+18
j org.apache.turbine.modules.Layout.build(Lorg/apache/turbine/util/RunData;)V+2
j org.apache.turbine.modules.LayoutLoader.exec(Lorg/apache/turbine/util/RunData;Ljava/lang/String;)V+6
j com.thc.ids.presentation.modules.pages.PFPage.supersDoBuildWithChanges(Lorg/apache/turbine/util/RunData;)V+156
j com.thc.ids.presentation.modules.pages.PFPage.doBuild(Lorg/apache/turbine/util/RunData;)V+71
j org.apache.turbine.modules.Page.build(Lorg/apache/turbine/util/RunData;)V+2
j org.apache.turbine.modules.PageLoader.exec(Lorg/apache/turbine/util/RunData;Ljava/lang/String;)V+6
j com.thc.ids.presentation.WebAppController.handleRequest(Lcom/thc/ids/presentation/services/runData/PFRunData;)V+23
j com.thc.ids.presentation.BrowserClientAdapter.doGet(Lorg/apache/turbine/util/RunData;)V+30
j com.thc.ids.presentation.BrowserClientAdapter.doPost(Lorg/apache/turbine/util/RunData;)V+2
j com.thc.ids.presentation.PresentationFrameworkServlet.doPost(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+14
J javax.servlet.http.HttpServlet.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V
J javax.servlet.http.HttpServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
j com.thc.ids.presentation.PresentationFrameworkServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+32
J org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
J org.apache.catalina.core.ApplicationFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
j com.thc.ids.presentation.servlet.filter.padlock.PadlockFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+624
J org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
J org.apache.catalina.core.ApplicationFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
j com.thc.ids.presentation.servlet.filter.ThrottleFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+136
J org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
J org.apache.catalina.core.ApplicationFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
J org.apache.catalina.core.StandardWrapperValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.core.StandardContextValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.authenticator.AuthenticatorBase.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.core.StandardHostValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.valves.ErrorReportValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.core.StandardEngineValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.connector.CoyoteAdapter.service(Lorg/apache/coyote/Request;Lorg/apache/coyote/Response;)V
J org.apache.coyote.http11.Http11Processor.process(Ljava/io/InputStream;Ljava/io/OutputStream;)V
J org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V
J org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(Ljava/net/Socket;Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V
J org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt([Ljava/lang/Object;)V
j org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run()V+167
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
V [libjvm.so+0xc9ccc]
V [libjvm.so+0xd8668]
V [libjvm.so+0xd84f4]
V [libjvm.so+0xd847c]
V [libjvm.so+0xd82a8]
V [libjvm.so+0xc8560]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
v ~RuntimeStub::interpreter_entries Runtime1 stub
J org.apache.xalan.xsltc.dom.CurrentNodeListIterator.next()I
J org.apache.xalan.xsltc.dom.StepIterator.next()I
J org.apache.xalan.xsltc.dom.DupFilterIterator.setStartNode(I)Lorg/apache/xml/dtm/DTMAxisIterator;
j GregorSamsa.hcsFmtMainSearchResults(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;I)V+1913
j GregorSamsa.StartUp(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;I)V+129
j GregorSamsa.template$dot$57(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;I)V+6
j GregorSamsa.applyTemplates(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;)V+494
j GregorSamsa.applyTemplates(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;)V+527
j GregorSamsa.transform(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/dtm/DTMAxisIterator;Lorg/apache/xml/serializer/SerializationHandler;)V+58
j org.apache.xalan.xsltc.runtime.AbstractTranslet.transform(Lorg/apache/xalan/xsltc/DOM;Lorg/apache/xml/serializer/SerializationHandler;)V+9
j org.apache.xalan.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Lorg/apache/xml/serializer/SerializationHandler;Ljava/lang/String;)V+152
j org.apache.xalan.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Ljavax/xml/transform/Result;)V+119
j com.thc.ids.presentation.services.xslt.PF_XSLTService.transform(Ljava/lang/String;Lorg/apache/velocity/context/Context;Ljavax/xml/transform/Result;)V+84
j com.thc.ids.presentation.services.xslt.PF_XSLTService.transform(Ljava/lang/String;Lorg/apache/velocity/context/Context;)Ljava/lang/String;+34
j com.thc.ids.presentation.services.xslt.PF_XSLT.transform(Ljava/lang/String;Lorg/apache/velocity/context/Context;)Ljava/lang/String;+5
j com.thc.ids.presentation.modules.screens.VelocityXslScreen.buildTemplate(Lorg/apache/turbine/util/RunData;)Lorg/apache/ecs/ConcreteElement;+161
j org.apache.turbine.modules.screens.TemplateScreen.doBuild(Lorg/apache/turbine/util/RunData;)Lorg/apache/ecs/ConcreteElement;+9
j org.apache.turbine.modules.Screen.build(Lorg/apache/turbine/util/RunData;)Lorg/apache/ecs/ConcreteElement;+2
j org.apache.turbine.modules.ScreenLoader.eval(Lorg/apache/turbine/util/RunData;Ljava/lang/String;)Lorg/apache/ecs/ConcreteElement;+6
j org.apache.turbine.modules.layouts.VelocityECSLayout.doBuild(Lorg/apache/turbine/util/RunData;)V+18
j org.apache.turbine.modules.Layout.build(Lorg/apache/turbine/util/RunData;)V+2
j org.apache.turbine.modules.LayoutLoader.exec(Lorg/apache/turbine/util/RunData;Ljava/lang/String;)V+6
j com.thc.ids.presentation.modules.pages.PFPage.supersDoBuildWithChanges(Lorg/apache/turbine/util/RunData;)V+156
j com.thc.ids.presentation.modules.pages.PFPage.doBuild(Lorg/apache/turbine/util/RunData;)V+71
j org.apache.turbine.modules.Page.build(Lorg/apache/turbine/util/RunData;)V+2
j org.apache.turbine.modules.PageLoader.exec(Lorg/apache/turbine/util/RunData;Ljava/lang/String;)V+6
j com.thc.ids.presentation.WebAppController.handleRequest(Lcom/thc/ids/presentation/services/runData/PFRunData;)V+23
j com.thc.ids.presentation.BrowserClientAdapter.doGet(Lorg/apache/turbine/util/RunData;)V+30
j com.thc.ids.presentation.BrowserClientAdapter.doPost(Lorg/apache/turbine/util/RunData;)V+2
j com.thc.ids.presentation.PresentationFrameworkServlet.doPost(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+14
J javax.servlet.http.HttpServlet.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V
J javax.servlet.http.HttpServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
j com.thc.ids.presentation.PresentationFrameworkServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+32
J org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
J org.apache.catalina.core.ApplicationFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
j com.thc.ids.presentation.servlet.filter.padlock.PadlockFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+624
J org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
J org.apache.catalina.core.ApplicationFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
j com.thc.ids.presentation.servlet.filter.ThrottleFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+136
J org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
J org.apache.catalina.core.ApplicationFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
J org.apache.catalina.core.StandardWrapperValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.core.StandardContextValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.authenticator.AuthenticatorBase.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.core.StandardHostValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.valves.ErrorReportValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.core.StandardEngineValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V
J org.apache.catalina.connector.CoyoteAdapter.service(Lorg/apache/coyote/Request;Lorg/apache/coyote/Response;)V
J org.apache.coyote.http11.Http11Processor.process(Ljava/io/InputStream;Ljava/io/OutputStream;)V
J org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V
J org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(Ljava/net/Socket;Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V
J org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt([Ljava/lang/Object;)V
j org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run()V+167
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
P R O C E S S
Java Threads: ( => current thread )
0x00bb39d8 JavaThread "Worker for Socket[addr=/127.0.0.1,port=53366,localport=20046]" daemon [_thread_blocked, id=123794]
0x01362938 JavaThread "Thread-122036" daemon [_thread_blocked, id=123759]
0x00ef4678 JavaThread "process reaper" daemon [_thread_in_native, id=123758]
0x0137d288 JavaThread "Worker for Socket[addr=/127.0.0.1,port=53317,localport=20046]" daemon [_thread_blocked, id=123505]
0x01421618 JavaThread "Worker for Socket[addr=/127.0.0.1,port=53316,localport=20046]" daemon [_thread_blocked, id=123504]
0x0111b3d8 JavaThread "Worker for Socket[addr=/127.0.0.1,port=53301,localport=20046]" daemon [_thread_blocked, id=123443]
0x01362790 JavaThread "Thread-116982" daemon [_thread_blocked, id=118635]
0x01079478 JavaThread "process reaper" daemon [_thread_in_native, id=118634]
0x01383a78 JavaThread "Thread-116917" daemon [_thread_blocked, id=118569]
0x012f6980 JavaThread "process reaper" daemon [_thread_in_native, id=118568]
0x014291e8 JavaThread "Thread-103772" daemon [_thread_blocked, id=105258]
0x00ca9298 JavaThread "process reaper" daemon [_thread_in_native, id=105257]
0x01331bb0 JavaThread "Thread-97960" daemon [_thread_blocked, id=99370]
0x012c30a8 JavaThread "process reaper" daemon [_thread_in_native, id=99369]
0x011fe170 JavaThread "Thread-91419" daemon [_thread_blocked, id=92764]
0x012e9540 JavaThread "process reaper" daemon [_thread_in_native, id=92763]
0x00aadd30 JavaThread "Thread-91168" daemon [_thread_blocked, id=92510]
0x00f12418 JavaThread "process reaper" daemon [_thread_in_native, id=92509]
0x012f67a8 JavaThread "Thread-91167" daemon [_thread_blocked, id=92508]
0x010f3ef8 JavaThread "process reaper" daemon [_thread_in_native, id=92507]
0x013ccf38 JavaThread "Thread-91166" daemon [_thread_blocked, id=92506]
0x010fb880 JavaThread "process reaper" daemon [_thread_in_native, id=92505]
0x012f4b08 JavaThread "Thread-90582" daemon [_thread_blocked, id=91889]
0x00a94ad0 JavaThread "process reaper" daemon [_thread_in_native, id=91888]
0x01294f38 JavaThread "Java2D Disposer" daemon [_thread_blocked, id=74360]
=>0x01343e78 JavaThread "http-80-Processor15" daemon [_thread_in_vm, id=7735]
0x00eeb900 JavaThread "http-80-Processor14" daemon [_thread_blocked, id=7734]
0x00e0cee0 JavaThread "http-80-Processor13" daemon [_thread_in_Java, id=7733]
0x00b30c48 JavaThread "http-80-Processor12" daemon [_thread_blocked, id=3209]
0x00be4610 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=23085943" daemon [_thread_blocked, id=2991]
0x00be4468 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=6274237" daemon [_thread_blocked, id=2990]
0x00ab9aa8 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=9727105" daemon [_thread_blocked, id=2989]
0x00ae7698 JavaThread "http-80-Processor11" daemon [_thread_blocked, id=2181]
0x007bc060 JavaThread "http-80-Processor10" daemon [_thread_blocked, id=1686]
0x00dda5f8 JavaThread "http-80-Processor9" daemon [_thread_blocked, id=1570]
0x00bcaa68 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=11736269" daemon [_thread_blocked, id=311]
0x009a3240 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=9336125" daemon [_thread_blocked, id=310]
0x00bca8c0 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=6538948" daemon [_thread_blocked, id=309]
0x005527e0 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=1647407" daemon [_thread_blocked, id=236]
0x00f00f20 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=15839978" daemon [_thread_blocked, id=235]
0x00dbefc8 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=667758" daemon [_thread_blocked, id=234]
0x0099a878 JavaThread "http-80-Processor8" daemon [_thread_blocked, id=199]
0x00e83978 JavaThread "http-80-Processor7" daemon [_thread_blocked, id=190]
0x00e488c8 JavaThread "http-80-Processor6" daemon [_thread_blocked, id=167]
0x005515d0 JavaThread "http-80-Processor5" daemon [_thread_blocked, id=166]
0x00c0dbe0 JavaThread "http-80-Processor4" daemon [_thread_blocked, id=165]
0x00b4f6f8 JavaThread "http-80-Processor3" daemon [_thread_blocked, id=164]
0x00b4fcc0 JavaThread "http-80-Processor2" daemon [_thread_blocked, id=163]
0x003a6f68 JavaThread "http-80-Processor1" daemon [_thread_blocked, id=162]
0x00cfdcb0 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=161]
0x00bcf7f0 JavaThread "Scheduled task MonitorImportExportRequests" daemon [_thread_blocked, id=159]
0x00cf3258 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=12218723" [_thread_blocked, id=158]
0x00cf2770 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=839238" [_thread_blocked, id=157]
0x00bcf648 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=866511" [_thread_blocked, id=156]
0x00b585e8 JavaThread "Scheduled task AcsDBUpdateTicketTask" daemon [_thread_blocked, id=155]
0x00b5aca0 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=27588781" [_thread_blocked, id=154]
0x00d39ce8 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=5079868" [_thread_blocked, id=153]
0x00d39740 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=14277" [_thread_blocked, id=152]
0x00b58b10 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=22925302" [_thread_blocked, id=151]
0x00cfd0d0 JavaThread "com.thc.ids.inf.framework.scheduling.SchedulingService-ThreadHashCode=32631031" [_thread_blocked, id=150]
0x003bfb90 JavaThread "THIDS Period based regulator daemon com.thc.ids.inf.util.logging.DBLogger" daemon [_thread_blocked, id=149]
0x00d38ec0 JavaThread "Scheduled task Heap Size Monitor" daemon [_thread_blocked, id=146]
0x00d3a3e8 JavaThread "Scheduled task CacheManager" daemon [_thread_blocked, id=145]
0x00d38918 JavaThread "/228.1.2.1:7000" [_thread_blocked, id=144]
0x00bec108 JavaThread "Scheduled task AcsDBUpdateTicketTask" daemon [_thread_blocked, id=143]
0x00bec3d0 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=10049554" [_thread_blocked, id=142]
0x00b7ebe0 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=24083007" [_thread_blocked, id=141]
0x00b7ee28 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=19670515" [_thread_blocked, id=140]
0x00b9e6d0 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=32028313" [_thread_blocked, id=139]
0x00b4bf90 JavaThread "com.thc.ids.inf.framework.scheduling.SchedulingService-ThreadHashCode=6458123" [_thread_blocked, id=138]
0x00b80588 JavaThread "THIDS Period based regulator daemon com.thc.ids.inf.util.logging.DBLogger" daemon [_thread_blocked, id=137]
0x00b7e380 JavaThread "Scheduled task Heap Size Monitor" daemon [_thread_blocked, id=134]
0x00b7fb50 JavaThread "Scheduled task CacheManager" daemon [_thread_blocked, id=133]
0x00b7f9a8 JavaThread "/228.1.2.1:7000" [_thread_blocked, id=132]
0x008fca38 JavaThread "GC Daemon" daemon [_thread_blocked, id=131]
0x00571070 JavaThread "RMI Reaper" [_thread_blocked, id=130]
0x006278a0 JavaThread "Thread-69" daemon [_thread_blocked, id=129]
0x005721f8 JavaThread "RMI TCP Accept-0" daemon [_thread_blocked, id=128]
0x00c11f88 JavaThread "Accept" [_thread_blocked, id=127]
0x000c6338 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=27926127" [_thread_blocked, id=126]
0x00194a58 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=15631913" [_thread_blocked, id=125]
0x00590c40 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=17649599" [_thread_blocked, id=124]
0x00c12548 JavaThread "com.thc.ids.inf.framework.scheduling.SchedulingService-ThreadHashCode=28661005" [_thread_blocked, id=123]
0x00187f08 JavaThread "THIDS Period based regulator daemon com.thc.ids.inf.util.logging.DBLogger" daemon [_thread_blocked, id=122]
0x0089a570 JavaThread "Scheduled task Heap Size Monitor" daemon [_thread_blocked, id=119]
0x0089a750 JavaThread "Scheduled task CacheManager" daemon [_thread_blocked, id=118]
0x00c11bd8 JavaThread "/228.1.2.1:7000" [_thread_blocked, id=117]
0x009cd1b8 JavaThread "Scheduled task ACSDBDeleteTicket" daemon [_thread_blocked, id=116]
0x009cc490 JavaThread "Scheduled task AsyncProcessTriggerTask" daemon [_thread_blocked, id=115]
0x009641b0 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=6952180" [_thread_blocked, id=114]
0x003ad548 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=1958936" [_thread_blocked, id=113]
0x009cbae8 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=10749034" [_thread_blocked, id=112]
0x007d9828 JavaThread "Scheduled task CacheFlush" daemon [_thread_blocked, id=111]
0x007d9680 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=18084131" [_thread_blocked, id=110]
0x000f9be0 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=16952981" [_thread_blocked, id=109]
0x000f9a38 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=11987729" [_thread_blocked, id=108]
0x00188f18 JavaThread "Scheduled task AcsDBUpdateTicketTask" daemon [_thread_blocked, id=107]
0x007d5510 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=13834754" [_thread_blocked, id=106]
0x004ac898 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=11607308" [_thread_blocked, id=105]
0x0043e1f8 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=25463487" [_thread_blocked, id=104]
0x0043f608 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=25021098" [_thread_blocked, id=103]
0x00652f50 JavaThread "com.thc.ids.inf.framework.scheduling.SchedulingService-ThreadHashCode=1653717" [_thread_blocked, id=102]
0x0043e3a0 JavaThread "THIDS Period based regulator daemon com.thc.ids.inf.util.logging.DBLogger" daemon [_thread_blocked, id=101]
0x004aae90 JavaThread "Scheduled task Heap Size Monitor" daemon [_thread_blocked, id=98]
0x004aca50 JavaThread "Scheduled task CacheManager" daemon [_thread_blocked, id=97]
0x00647420 JavaThread "/228.1.2.1:7000" [_thread_blocked, id=96]
0x007b3be0 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=30465184" [_thread_blocked, id=95]
0x0064c368 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=27192531" [_thread_blocked, id=94]
0x00823268 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=22204202" [_thread_blocked, id=93]
0x008eec00 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=22277774" [_thread_blocked, id=92]
0x008a53d0 JavaThread "com.thc.ids.inf.framework.scheduling.SchedulingService-ThreadHashCode=10141170" [_thread_blocked, id=91]
0x008eea58 JavaThread "THIDS Period based regulator daemon com.thc.ids.inf.util.logging.DBLogger" daemon [_thread_blocked, id=90]
0x00823ab0 JavaThread "Scheduled task Heap Size Monitor" daemon [_thread_blocked, id=87]
0x00823c98 JavaThread "Scheduled task CacheManager" daemon [_thread_blocked, id=86]
0x00822030 JavaThread "/228.1.2.1:7000" [_thread_blocked, id=85]
0x0064abe0 JavaThread "Scheduled task AcsDBUpdateTicketTask" daemon [_thread_blocked, id=84]
0x0064b680 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=3231505" [_thread_blocked, id=83]
0x005e3ff0 JavaThread "Scheduled task LabNotes" daemon [_thread_blocked, id=82]
0x005f1588 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=3238086" [_thread_blocked, id=81]
0x00c13130 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=12430126" [_thread_blocked, id=80]
0x008859c8 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=3879853" [_thread_blocked, id=79]
0x00326fc0 JavaThread "com.thc.ids.inf.framework.scheduling.SchedulingService-ThreadHashCode=30823605" [_thread_blocked, id=78]
0x003255a0 JavaThread "THIDS Period based regulator daemon com.thc.ids.inf.util.logging.DBLogger" daemon [_thread_blocked, id=77]
0x0074e2f8 JavaThread "Scheduled task Heap Size Monitor" daemon [_thread_blocked, id=74]
0x00325f48 JavaThread "Scheduled task CacheManager" daemon [_thread_blocked, id=73]
0x00325da0 JavaThread "/228.1.2.1:7000" [_thread_blocked, id=72]
0x0046af10 JavaThread "Scheduled task AcsDBUpdateTicketTask" daemon [_thread_blocked, id=71]
0x00186b78 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=29383146" [_thread_blocked, id=70]
0x00897e60 JavaThread "Scheduled task LabNotes" daemon [_thread_blocked, id=69]
0x0044c688 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=5705081" [_thread_blocked, id=68]
0x0044c4e0 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=18214005" [_thread_blocked, id=67]
0x00c12f88 JavaThread "com.thc.ids.inf.framework.opf.rdbms.datastore.pooling.DynamicConnectionPoolMonitor-ThreadHashCode=15136214" [_thread_blocked, id=66]
0x004256f8 JavaThread "com.thc.ids.inf.framework.scheduling.SchedulingService-ThreadHashCode=18539794" [_thread_blocked, id=65]
0x0044b118 JavaThread "THIDS Period based regulator daemon com.thc.ids.inf.util.logging.DBLogger" daemon [_thread_blocked, id=64]
0x00834b48 JavaThread "Scheduled task Heap Size Monitor" daemon [_thread_blocked, id=61]
0x00425150 JavaThread "Scheduled task CacheManager" daemon [_thread_blocked, id=60]
0x00449be0 JavaThread "/228.1.2.1:7000" [_thread_blocked, id=59]
0x005ef030 JavaThread "com.thc.ids.inf.framework.scheduling.ScheduledTask-ThreadHashCode=21506365" [_thread_blocked, id=58]
0x0060c628 JavaThread "Scheduled task LabNotes" daemon [_thread_blocked, id=57]
0x00c1d490 JavaThread "com.thc.ids.inf.framework.opf.rdbms
soumikinthesun wrote:
Yes I am using OCI driver. But can you tell me where is the problem using OCI driver?Nope.
If you want to spend the time then you do the following.
1. Reduce the code to the point where you have a small example that fails
2. Make a bug report to Oracle.
If you want a solution, since waiting on a Oracle fix is unlikely to be something that you can do (unless you have a service contract and they state that they will fix it) then do one of the following.
1. Use the thin driver, not the OCI one.
2. Use a different version of the OCI driver
3. Determine exactly where the problem occurs and find a different way to structure the code (java and SQL) so the error does not occur.
I don't think my system is corrupted because the core is comming in customer machine as well as our test machine.
That doesn't completely eliminate the possibility but it does make it much less likely.
we are getting core from libjvm.so , so I think it is not the crash of oracle VM. It is the crash of SUN VM
what do you think?The Oracle and Sun VMs are completely different applications. They are your applications so I can't tell you what you are running. The Oracle VM would, normally, be used for embedded java procs in the database itself. And if you are using OCI in that code then you are doing it wrong.
Similar Messages
-
HOTSPOT JVM crash with EXCEPTION_ACCESS_VIOLATION
From a C++ application, I use Invocation APIs to create a JVM and call some Java methods using JNI
I get a crash in jvm.dll with EXCEPTION_ACCESS_VIOLATION
when I try to call "getFields" method of java.lang.Class in order to get the Fields of the java class
This method call, should return a java/lang/reflect/Fields[] on success
I am able to get the method ID of this method by using pEnv->GetMethodID(..)
However, when I call this method using CallObjectMethod(..), HotSpt JVM crashes with access violation with the dump given below.
Any clues on how to debug and find the problem?
Thanks in advance!
Sample code
jclass testerClass = pEnv->FindClass("com/test/Tester");
jmethodID cid = pEnv->GetMethodID(testerClass,"<init>","()V");
if(NULL == cid)
pEnv->ExceptionDescribe();
jobject testerObject = pEnv->NewObjectV(testerClass, mid);
jmethodID mid = pEnv->GetMethodID(testerClass, "getClass",
"()Ljava/lang/Class;");
jobject clsObj = (jobject)pEnv->CallObjectMethod(testerObject, mid);
pEnv->ExceptionDescribe();
jclass jCls = pEnv->GetObjectClass(clsObj);
jmethodID midGetFields = pEnv->GetMethodID(jCls, "getFields",
"()[Ljava/lang/reflect/Field;");
jobjectArray jobjArray = (jobjectArray)pEnv->CallObjectMethod(testerObject, midGetFields);
pEnv->ExceptionDescribe();
Crash dump
Unexpected Signal : EXCEPTION_ACCESS_VIOLATION (0xc0000005) occurred at PC=0x809E69F
Function=JVM_FindSignal+0x11505
Library=D:\Java\j2re1.4.2_03\bin\client\jvm.dll
Current Java thread:
at java.lang.Class.privateGetDeclaredFields(Unknown Source)
at java.lang.Class.privateGetPublicFields(Unknown Source)
at java.lang.Class.getFields(Unknown Source)
Dynamic libraries:
0x00400000 - 0x00419000 E:\SC\SC12.1\SCApplications\SNMP\Bin\JNITester.exe
0x77F50000 - 0x77FF7000 C:\WINDOWS\System32\ntdll.dll
0x77E60000 - 0x77F46000 C:\WINDOWS\system32\kernel32.dll
0x10000000 - 0x10023000 E:\SC\SC12.1\SCApplications\SNMP\Bin\JniUtils.dll
0x00320000 - 0x00332000 E:\SnmpIpmNativeTestDriver\MTFStubHelper.dll
0x00340000 - 0x0035B000 E:\SnmpIpmNativeTestDriver\MTFXMLFileAPI.dll
0x12000000 - 0x122B1000 e:\sc\sc12.1\bin\xerces-c_2_2_0D.dll
0x77DD0000 - 0x77E5D000 C:\WINDOWS\system32\ADVAPI32.dll
0x78000000 - 0x78086000 C:\WINDOWS\system32\RPCRT4.dll
0x10200000 - 0x1026C000 e:\sc\sc12.1\bin\MSVCRTD.dll
0x102A0000 - 0x102B7000 e:\sc\sc12.1\bin\MSVCIRTD.dll
0x5F800000 - 0x5F8E9000 e:\sc\sc12.1\bin\MFC42uD.DLL
0x77C70000 - 0x77CB0000 C:\WINDOWS\system32\GDI32.dll
0x77D40000 - 0x77DCC000 C:\WINDOWS\system32\USER32.dll
0x5F700000 - 0x5F746000 e:\sc\sc12.1\bin\MFCD42uD.DLL
0x5F500000 - 0x5F5C6000 e:\sc\sc12.1\bin\MFCO42uD.DLL
0x10480000 - 0x104FE000 e:\sc\sc12.1\bin\MSVCP60D.dll
0x15020000 - 0x15042000 e:\sc\sc12.1\bin\SCTraceLib.dll
0x6D510000 - 0x6D58D000 C:\WINDOWS\System32\dbghelp.dll
0x77C10000 - 0x77C63000 C:\WINDOWS\system32\msvcrt.dll
0x77C00000 - 0x77C07000 C:\WINDOWS\system32\VERSION.dll
0x00360000 - 0x0037D000 e:\sc\sc12.1\bin\SCFileManager.dll
0x76BF0000 - 0x76BFB000 C:\WINDOWS\System32\PSAPI.DLL
0x00420000 - 0x00580000 e:\sc\sc12.1\bin\BctCoreCL.dll
0x5D920000 - 0x5D929000 C:\WINDOWS\System32\RPCNS4.dll
0x71B20000 - 0x71B31000 C:\WINDOWS\system32\MPR.dll
0x71C20000 - 0x71C6E000 C:\WINDOWS\System32\NETAPI32.dll
0x71AB0000 - 0x71AC5000 C:\WINDOWS\System32\WS2_32.dll
0x71AA0000 - 0x71AA8000 C:\WINDOWS\System32\WS2HELP.dll
0x15000000 - 0x15012000 e:\sc\sc12.1\bin\CTEventLog.dll
0x773D0000 - 0x77BC2000 C:\WINDOWS\system32\SHELL32.dll
0x70A70000 - 0x70AD4000 C:\WINDOWS\system32\SHLWAPI.dll
0x771B0000 - 0x772D1000 C:\WINDOWS\system32\ole32.dll
0x77120000 - 0x771AB000 C:\WINDOWS\system32\OLEAUT32.dll
0x1F7A0000 - 0x1F7D6000 C:\WINDOWS\System32\ODBC32.dll
0x77340000 - 0x773CB000 C:\WINDOWS\system32\COMCTL32.dll
0x763B0000 - 0x763F5000 C:\WINDOWS\system32\comdlg32.dll
0x08000000 - 0x08138000 D:\Java\j2re1.4.2_03\bin\client\jvm.dll
0x76B40000 - 0x76B6C000 C:\WINDOWS\System32\WINMM.dll
0x5FD00000 - 0x5FD0D000 C:\WINDOWS\System32\MFC42LOC.DLL
0x71950000 - 0x71A34000 C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.10.0_x-ww_f7fb5805\comctl32.dll
0x1F840000 - 0x1F857000 C:\WINDOWS\System32\odbcint.dll
0x5DAC0000 - 0x5DAC7000 C:\WINDOWS\System32\rdpsnd.dll
0x00FE0000 - 0x00FE7000 D:\Java\j2re1.4.2_03\bin\hpi.dll
0x01000000 - 0x0100E000 D:\Java\j2re1.4.2_03\bin\verify.dll
0x01010000 - 0x01029000 D:\Java\j2re1.4.2_03\bin\java.dll
0x01030000 - 0x0103D000 D:\Java\j2re1.4.2_03\bin\zip.dll
0x76C90000 - 0x76CB2000 C:\WINDOWS\system32\imagehlp.dll
Heap at VM Abort:
Heap
def new generation total 576K, used 132K [0x15050000, 0x150f0000, 0x15530000)
eden space 512K, 25% used [0x15050000, 0x15071250, 0x150d0000)
from space 64K, 0% used [0x150d0000, 0x150d0000, 0x150e0000)
to space 64K, 0% used [0x150e0000, 0x150e0000, 0x150f0000)
tenured generation total 1408K, used 0K [0x15530000, 0x15690000, 0x19050000)
the space 1408K, 0% used [0x15530000, 0x15530000, 0x15530200, 0x15690000)
compacting perm gen total 4096K, used 964K [0x19050000, 0x19450000, 0x1d050000)
the space 4096K, 23% used [0x19050000, 0x191410e0, 0x19141200, 0x19450000)
Local Time = Wed Aug 25 21:06:44 2004
Elapsed Time = 0
# HotSpot Virtual Machine Error : EXCEPTION_ACCESS_VIOLATION
# Error ID : 4F530E43505002EF
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
# Java VM: Java HotSpot(TM) Client VM (1.4.2_03-b02 mixed mode)Hi
How about running it with -Xcheck:jni and -verbose:jni -
Hi All,
I have build an application that it is supposed to run for a long period (on a Solaris
2.8 machine). I'm using a JVM 1.3
Sometimes the application crashes after some hours and I've noticed that the
error message I got are basically these:
In one case I get this message
# HotSpot Virtual Machine Error, Unexpected Signal 11
# Error happened during: scavenge
in the second one
# HotSpot Virtual Machine Error, Unexpected Signal 11
# Error happened during: mark sweep
Can anyone help me to understand the meaning of these errors?
Thanks a lot,
*piero"scavenge", and "mark sweep" are both steps of garbage collection on the VM. The VM is cleaning up memory and something doesn't look right to it, and it just exits. I would report the bug, as any "Error" should be reported. Although these errors can be due to hardware malfunctions. Such as, bad memory reads and writes. Other then that, I don't know what to tell you.
-
java -version
java version "1.6.0_29"
Java(TM) SE Runtime Environment (build 1.6.0_29-b11)
Java HotSpot(TM) 64-Bit Server VM (build 20.4-b02, mixed mode)
uname -a :
SunOS test-app 5.10 Generic_147440-06 sun4v sparc SUNW,Sun-Fire-T200
hs_err_pid file shown below :-
Core dump 1:
========
# A fatal error has been detected by the Java Runtime Environment:
# SIGBUS (0xa) at pc=0xffffffff780fc4c0, pid=6201, tid=140
# JRE version: 6.0_29-b11
# Java VM: Java HotSpot(TM) 64-Bit Server VM (20.4-b02 mixed mode solaris-sparc compressed oops)
# Problematic frame:
# J java.util.HashMap.getForNullKey()Ljava/lang/Object;
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
--------------- T H R E A D ---------------
Current thread (0x0000000100a9e800): JavaThread "Thread-91" [_thread_in_Java, id=140, stack(0xffffffff2c100000,0xffffffff2c132000)]
siginfo:si_signo=SIGBUS: si_errno=0, si_code=1 (BUS_ADRALN), si_addr=0xffffffff2c13558f
Registers:
G1=0x0000000000000008 G2=0x0000000100a9e800 G3=0x0000000000005ffe G4=0xffffffff2c12ff10
G5=0xffffffff31109040 G6=0xffffffff303fe000 G7=0xffffffff2e20ea00 Y=0x0000000000000000
O0=0xffffffff356606c0 O1=0x00000000000000b7 O2=0x0000000000000000 O3=0xffffffff78018080
O4=0xffffffff600b2510 O5=0xffffffff2c12f781 O6=0xffffffff2c12f591 O7=0x0000000000000000
L0=0xffffffff356606c0 L1=0x000000000001854c L2=0xffffffff356606c0 L3=0x0000000000a4c4d8
L4=0x000000000001854c L5=0xffffffff2c12f661 L6=0x0000000000000000 L7=0x0000000100a9e800
I0=0xffffffff35423dc0 I1=0xffffffff35537950 I2=0x0000000000000000 I3=0xffffffff600b1e88
I4=0xffffffff311e54a8 I5=0xffffffff2c12f661 I6=0xffffffff2c12f661 I7=0xffffffff78005eac
PC=0xffffffff780fc4c0 nPC=0xffffffff780fc4c4
Top of Stack: (sp=0xffffffff2c12fd90)
0xffffffff2c12fd90: ffffffff356606c0 000000000001854c
0xffffffff2c12fda0: ffffffff356606c0 0000000000a4c4d8
0xffffffff2c12fdb0: 000000000001854c ffffffff2c12f661
0xffffffff2c12fdc0: 0000000000000000 0000000100a9e800
0xffffffff2c12fdd0: ffffffff35423dc0 ffffffff35537950
0xffffffff2c12fde0: 0000000000000000 ffffffff600b1e88
0xffffffff2c12fdf0: ffffffff311e54a8 ffffffff2c12f661
0xffffffff2c12fe00: ffffffff2c12f661 ffffffff78005eac
0xffffffff2c12fe10: 00000001600b1540 00000004600b1e88
0xffffffff2c12fe20: 0000000000000000 0000000000000000
0xffffffff2c12fe30: ffffffff3554fb48 ffffffff2c12f6c1
0xffffffff2c12fe40: ffffffff35537950 0000000135660480
0xffffffff2c12fe50: ffffffff2c12ff28 ffffffff31104b11
0xffffffff2c12fe60: ffffffff2c12ff10 ffffffff31104b57
0xffffffff2c12fe70: ffffffff31104d18 ffffffff2c130048
0xffffffff2c12fe80: ffffffff2c12ff40 ffffffff2c12f661
Instructions: (pc=0xffffffff780fc4c0)
0xffffffff780fc4a0: c6 02 20 08 87 28 f0 03 86 00 c0 06 80 a0 c0 05
0xffffffff780fc4b0: 93 d0 30 12 de 40 20 00 86 18 fc 00 86 00 e3 ff
0xffffffff780fc4c0: c0 23 80 03 9d e3 bf 70 e2 06 20 24 a1 2c 70 03
0xffffffff780fc4d0: a0 04 00 06 e4 04 20 0c 80 a4 a0 00 08 40 00 12
Register to memory mapping:
G1=0x0000000000000008 is an unknown value
G2=0x0000000100a9e800 is a thread
G3=0x0000000000005ffe is an unknown value
G4=0xffffffff2c12ff10 is pointing into the stack for thread: 0x0000000100a9e800
G5=0xffffffff31109040 is an oop
{method}
- klass: {other class}
G6=0xffffffff303fe000 is an unknown value
G7=0xffffffff2e20ea00 is an unknown value
O0=0xffffffff356606c0 is an oop
java.util.HashMap
- klass: 'java/util/HashMap'
O1=0x00000000000000b7 is an unknown value
O2=0x0000000000000000 is an unknown value
O3=0xffffffff78018080 is an Interpreter codelet
invokevirtual 182 invokevirtual [0xffffffff78018080, 0xffffffff780182e0] 608 bytes
O4=0xffffffff600b2510 is an unknown value
O5=0xffffffff2c12f781 is pointing into the stack for thread: 0x0000000100a9e800
O6=0xffffffff2c12f591 is pointing into the stack for thread: 0x0000000100a9e800
O7=0x0000000000000000 is an unknown value
L0=0xffffffff356606c0 is an oop
java.util.HashMap
- klass: 'java/util/HashMap'
L1=0x000000000001854c is an unknown value
L2=0xffffffff356606c0 is an oop
java.util.HashMap
- klass: 'java/util/HashMap'
L3=0x0000000000a4c4d8 is an unknown value
L4=0x000000000001854c is an unknown value
L5=0xffffffff2c12f661 is pointing into the stack for thread: 0x0000000100a9e800
L6=0x0000000000000000 is an unknown value
L7=0x0000000100a9e800 is a thread
I0=0xffffffff35423dc0 is an oop
org.apache.activemq.openwire.v7.ActiveMQBytesMessageMarshaller
- klass: 'org/apache/activemq/openwire/v7/ActiveMQBytesMessageMarshaller'
I1=0xffffffff35537950 is an oop
org.apache.activemq.openwire.OpenWireFormat
- klass: 'org/apache/activemq/openwire/OpenWireFormat'
I2=0x0000000000000000 is an unknown value
I3=0xffffffff600b1e88 is an oop
org.apache.activemq.openwire.BooleanStream
- klass: 'org/apache/activemq/openwire/BooleanStream'
I4=0xffffffff311e54a8 is an oop
{instance class}
- klass: {other class}
I5=0xffffffff2c12f661 is pointing into the stack for thread: 0x0000000100a9e800
I6=0xffffffff2c12f661 is pointing into the stack for thread: 0x0000000100a9e800
I7=0xffffffff78005eac is an Interpreter codelet
return entry points [0xffffffff78005580, 0xffffffff78006da0] 6176 bytes
Stack: [0xffffffff2c100000,0xffffffff2c132000], sp=0xffffffff2c12fd90, free space=191k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
J java.util.HashMap.getForNullKey()Ljava/lang/Object;
j org.apache.activemq.openwire.v7.MessageMarshaller.tightMarshal1(Lorg/apache/activemq/openwire/OpenWireFormat;Ljava/lang/Object;Lorg/apache/activemq/openwire/BooleanStream;)I+79
j org.apache.activemq.openwire.v7.ActiveMQMessageMarshaller.tightMarshal1(Lorg/apache/activemq/openwire/OpenWireFormat;Ljava/lang/Object;Lorg/apache/activemq/openwire/BooleanStream;)I+4
j org.apache.activemq.openwire.v7.ActiveMQBytesMessageMarshaller.tightMarshal1(Lorg/apache/activemq/openwire/OpenWireFormat;Ljava/lang/Object;Lorg/apache/activemq/openwire/BooleanStream;)I+4
j org.apache.activemq.openwire.OpenWireFormat.marshal(Ljava/lang/Object;Ljava/io/DataOutput;)V+102
j org.apache.activemq.transport.tcp.TcpTransport.oneway(Ljava/lang/Object;)V+13
j org.apache.activemq.transport.InactivityMonitor.oneway(Ljava/lang/Object;)V+103
j org.apache.activemq.transport.TransportFilter.oneway(Ljava/lang/Object;)V+5
j org.apache.activemq.transport.WireFormatNegotiator.oneway(Ljava/lang/Object;)V+47
j org.apache.activemq.transport.failover.FailoverTransport.oneway(Ljava/lang/Object;)V+529
j org.apache.activemq.transport.MutexTransport.oneway(Ljava/lang/Object;)V+12
j org.apache.activemq.transport.ResponseCorrelator.asyncRequest(Ljava/lang/Object;Lorg/apache/activemq/transport/ResponseCallback;)Lorg/apache/activemq/transport/FutureResponse;+123
j org.apache.activemq.transport.ResponseCorrelator.request(Ljava/lang/Object;)Ljava/lang/Object;+3
j org.apache.activemq.ActiveMQConnection.syncSendPacket(Lorg/apache/activemq/command/Command;)Lorg/apache/activemq/command/Response;+20
j org.apache.activemq.ActiveMQSession.send(Lorg/apache/activemq/ActiveMQMessageProducer;Lorg/apache/activemq/command/ActiveMQDestination;Ljavax/jms/Message;IIJLorg/apache/activemq/usage/MemoryUsage;I)V+437
j org.apache.activemq.ActiveMQMessageProducer.send(Ljavax/jms/Destination;Ljavax/jms/Message;IIJ)V+210
j org.apache.activemq.ActiveMQMessageProducerSupport.send(Ljavax/jms/Destination;Ljavax/jms/Message;)V+15
j com.ecs.middleware.channel.JMSProducer.send(Ljava/lang/String;Ljavax/jms/Message;)V+12
j com.ecs.middleware.component.proxy.command.CmdTpACall.execute()Lcom/ecs/middleware/component/proxy/command/Response;+148
j com.ecs.middleware.component.proxy.RequestHandler.start()V+249
j com.ecs.middleware.component.proxy.RequestHandler.run()V+1
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
V [libjvm.so+0x1d63a8] void JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*)+0x200
V [libjvm.so+0x1e0b9c] void JavaCalls::call(JavaValue*,methodHandle,JavaCallArguments*,Thread*)+0x3c
V [libjvm.so+0x5fc320] void JavaCalls::call_virtual(JavaValue*,KlassHandle,symbolHandle,symbolHandle,JavaCallArguments*,Thread*)+0x150
V [libjvm.so+0x26c21c] void JavaCalls::call_virtual(JavaValue*,Handle,KlassHandle,symbolHandle,symbolHandle,Thread*)+0x50
V [libjvm.so+0x280950] void thread_entry(JavaThread*,Thread*)+0x148
V [libjvm.so+0x955ddc] void JavaThread::thread_main_inner()+0x4c
V [libjvm.so+0x864eb4] java_start+0x184
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x000000010104b800 JavaThread "ActiveMQ Session Task-4" [_thread_in_native, id=2532, stack(0xffffffff2bf00000,0xffffffff2bf32000)]
0x0000000100f5e000 JavaThread "ActiveMQ Session Task-6" [_thread_blocked, id=2531, stack(0xffffffff2b800000,0xffffffff2b832000)]
0x0000000100aa0800 JavaThread "ActiveMQ Session Task-7" [_thread_blocked, id=2530, stack(0xffffffff2b900000,0xffffffff2b932000)]
0x0000000100af4800 JavaThread "Timer-5" [_thread_blocked, id=1110, stack(0xffffffff2bd00000,0xffffffff2bd32000)]
0x000000010100f800 JavaThread "Timer-4" [_thread_blocked, id=148, stack(0xffffffff2bc00000,0xffffffff2bc32000)]
0x000000010100b800 JavaThread "Thread-92" [_thread_in_native, id=141, stack(0xffffffff2c000000,0xffffffff2c032000)]
=>0x0000000100a9e800 JavaThread "Thread-91" [_thread_in_Java, id=140, stack(0xffffffff2c100000,0xffffffff2c132000)]
0x0000000100abb000 JavaThread "ActiveMQ Transport: tcp:///10.10.8.220:61616" [_thread_in_native, id=138, stack(0xffffffff2c200000,0xffffffff2c232000)]
0x0000000100aba000 JavaThread "ActiveMQConnection[ID:test-app-40386-1329820972144-0:9] Scheduler" daemon [_thread_blocked, id=137, stack(0xffffffff2c300000,0xffffffff2c332000)]
0x0000000100c40800 JavaThread "ActiveMQ Transport: tcp:///10.10.8.220:61616" [_thread_in_native, id=136, stack(0xffffffff2c400000,0xffffffff2c432000)]
0x00000001010ee000 JavaThread "ActiveMQConnection[ID:test-app-40386-1329820972144-0:8] Scheduler" daemon [_thread_blocked, id=135, stack(0xffffffff2c600000,0xffffffff2c632000)]
0x0000000100b23000 JavaThread "StopClock-TMGR_R" [_thread_blocked, id=134, stack(0xffffffff2c700000,0xffffffff2c732000)]
0x000000010108e000 JavaThread "Timer-3" [_thread_blocked, id=133, stack(0xffffffff2c500000,0xffffffff2c532000)]
0x0000000101074000 JavaThread "Thread-81" [_thread_in_native, id=126, stack(0xffffffff2c900000,0xffffffff2c932000)]
0x0000000101090800 JavaThread "Thread-80" [_thread_in_native, id=125, stack(0xffffffff2ca00000,0xffffffff2ca32000)]
0x0000000100b25000 JavaThread "ActiveMQ Transport: tcp:///10.10.8.220:61616" [_thread_in_native, id=123, stack(0xffffffff2cb00000,0xffffffff2cb32000)]
0x0000000100dea800 JavaThread "ActiveMQConnection[ID:test-app-40386-1329820972144-0:7] Scheduler" daemon [_thread_blocked, id=122, stack(0xffffffff2cc00000,0xffffffff2cc32000)]
0x0000000100ac3000 JavaThread "ActiveMQ Transport: tcp:///10.10.8.220:61616" [_thread_in_native, id=121, stack(0xffffffff2cd00000,0xffffffff2cd32000)]
0x0000000100ac2800 JavaThread "ActiveMQConnection[ID:test-app-40386-1329820972144-0:6] Scheduler" daemon [_thread_blocked, id=120, stack(0xffffffff2d000000,0xffffffff2d032000)]
0x0000000100ac1800 JavaThread "StopClock-TMGR" [_thread_blocked, id=119, stack(0xffffffff2ce00000,0xffffffff2ce32000)]
0x0000000100ac1000 JavaThread "Timer-2" [_thread_blocked, id=118, stack(0xffffffff2cf00000,0xffffffff2cf32000)]
0x0000000100def000 JavaThread "Thread-65" [_thread_in_native, id=106, stack(0xffffffff2d200000,0xffffffff2d232000)]
0x0000000100ad6000 JavaThread "Thread-64" [_thread_in_native, id=105, stack(0xffffffff2d300000,0xffffffff2d332000)]
0x0000000100ad4000 JavaThread "ActiveMQ Transport: tcp:///10.10.8.220:61616" [_thread_in_native, id=103, stack(0xffffffff2d400000,0xffffffff2d432000)]
0x0000000100e97000 JavaThread "ActiveMQConnection[ID:test-app-40386-1329820972144-0:5] Scheduler" daemon [_thread_blocked, id=102, stack(0xffffffff2d500000,0xffffffff2d532000)]
0x0000000100e96000 JavaThread "ActiveMQ Transport: tcp:///10.10.8.220:61616" [_thread_in_native, id=101, stack(0xffffffff2d600000,0xffffffff2d632000)]
0x0000000100ca6800 JavaThread "ActiveMQConnection[ID:test-app-40386-1329820972144-0:4] Scheduler" daemon [_thread_blocked, id=100, stack(0xffffffff2d700000,0xffffffff2d732000)]
0x0000000100ca6000 JavaThread "StopClock-HPDH" [_thread_blocked, id=99, stack(0xffffffff2d900000,0xffffffff2d932000)]
0x0000000100ac8800 JavaThread "Timer-1" [_thread_blocked, id=98, stack(0xffffffff2d800000,0xffffffff2d832000)]
0x0000000100ae7800 JavaThread "Thread-51" [_thread_in_native, id=88, stack(0xffffffff2db00000,0xffffffff2db32000)]
0x0000000100c16000 JavaThread "Thread-50" [_thread_in_native, id=87, stack(0xffffffff2e000000,0xffffffff2e032000)]
0x0000000100a71000 JavaThread "ActiveMQ Transport: tcp:///10.10.8.220:61616" [_thread_in_native, id=85, stack(0xffffffff2e100000,0xffffffff2e132000)]
0x0000000100a6e800 JavaThread "ActiveMQConnection[ID:test-app-40386-1329820972144-0:3] Scheduler" daemon [_thread_blocked, id=84, stack(0xffffffff2e300000,0xffffffff2e332000)]
0x0000000100b3c800 JavaThread "ActiveMQ Transport: tcp:///10.10.8.220:61616" [_thread_in_native, id=82, stack(0xffffffff2e500000,0xffffffff2e532000)]
0x0000000100b39000 JavaThread "ActiveMQConnection[ID:test-app-40386-1329820972144-0:2] Scheduler" daemon [_thread_blocked, id=80, stack(0xffffffff2e800000,0xffffffff2e832000)]
0x0000000100eb1800 JavaThread "StopClock-INET1" [_thread_blocked, id=79, stack(0xffffffff2ee00000,0xffffffff2ee32000)]
0x0000000100d8e800 JavaThread "Timer-0" [_thread_blocked, id=78, stack(0xffffffff2e700000,0xffffffff2e732000)]
0x0000000100e39000 JavaThread "GC Daemon" daemon [_thread_blocked, id=27, stack(0xffffffff2e900000,0xffffffff2e932000)]
0x0000000100e38000 JavaThread "RMI RenewClean-[10.10.8.220:39772]" daemon [_thread_blocked, id=26, stack(0xffffffff2ea00000,0xffffffff2ea32000)]
0x0000000100e2d800 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=25, stack(0xffffffff2eb00000,0xffffffff2eb32000)]
0x0000000100d67000 JavaThread "ActiveMQ Transport: tcp:///10.10.8.220:61616" [_thread_in_native, id=23, stack(0xffffffff2ef00000,0xffffffff2ef32000)]
0x0000000100d9c800 JavaThread "ActiveMQConnection[ID:test-app-40386-1329820972144-0:1] Scheduler" daemon [_thread_blocked, id=21, stack(0xffffffff2f300000,0xffffffff2f332000)]
0x0000000100db7000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=19, stack(0xffffffff2fa00000,0xffffffff2fa32000)]
0x0000000100c17000 JavaThread "RMI TCP Accept-7866" daemon [_thread_in_native, id=18, stack(0xffffffff2fb00000,0xffffffff2fb32000)]
0x0000000100d2c000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=17, stack(0xffffffff2fd00000,0xffffffff2fd32000)]
0x0000000100a09000 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=16, stack(0xffffffff76300000,0xffffffff76332000)]
0x0000000100a06000 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=15, stack(0xffffffff76400000,0xffffffff76500000)]
0x0000000100a03000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=14, stack(0xffffffff76600000,0xffffffff76700000)]
0x0000000100a01000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=13, stack(0xffffffff76800000,0xffffffff76832000)]
0x00000001009e1000 JavaThread "Finalizer" daemon [_thread_blocked, id=12, stack(0xffffffff76900000,0xffffffff76932000)]
0x00000001009da000 JavaThread "Reference Handler" daemon [_thread_blocked, id=11, stack(0xffffffff76a00000,0xffffffff76a32000)]
0x0000000100118000 JavaThread "main" [_thread_blocked, id=2, stack(0xffffffff7c800000,0xffffffff7c832000)]
Other Threads:
0x00000001009d3800 VMThread [stack: 0xffffffff76b00000,0xffffffff76c00000] [id=10]
0x0000000100db8800 WatcherThread [stack: 0xffffffff2f800000,0xffffffff2f900000] [id=20]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
PSYoungGen total 9920K, used 1096K [0xffffffff60000000, 0xffffffff61800000, 0xffffffff75800000)
eden space 9216K, 8% used [0xffffffff60000000,0xffffffff600bfa28,0xffffffff60900000)
from space 704K, 46% used [0xffffffff61750000,0xffffffff617a2948,0xffffffff61800000)
to space 704K, 0% used [0xffffffff616a0000,0xffffffff616a0000,0xffffffff61750000)
PSOldGen total 45056K, used 3460K [0xffffffff35400000, 0xffffffff38000000, 0xffffffff60000000)
object space 45056K, 7% used [0xffffffff35400000,0xffffffff35761258,0xffffffff38000000)
PSPermGen total 32768K, used 16733K [0xffffffff30400000, 0xffffffff32400000, 0xffffffff35400000)
object space 32768K, 51% used [0xffffffff30400000,0xffffffff31457470,0xffffffff32400000)
Code Cache [0xffffffff78000000, 0xffffffff78400000, 0xffffffff7b000000)
total_blobs=514 nmethods=216 adapters=254 free_code_cache=49284864 largest_free_block=26432
Dynamic libraries:
0x0000000100000000 /usr/jdk/instances/jdk1.6.0/jre/bin/sparcv9/java
0xffffffff7f000000 /usr/lib/64/[email protected]
0xffffffff7f200000 /lib/sparcv9/libthread.so.1
0xffffffff7ec00000 /usr/jdk/instances/jdk1.6.0/jre/bin/sparcv9/../../lib/sparcv9/jli/libjli.so
0xffffffff7ea00000 /lib/sparcv9/libdl.so.1
0xffffffff7e700000 /lib/sparcv9/libc.so.1
0xffffffff7e600000 /platform/SUNW,Sun-Fire-T200/lib/sparcv9/libc_psr.so.1
0xffffffff7d800000 /usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/server/libjvm.so
0xffffffff7d600000 /lib/sparcv9/libsocket.so.1
0xffffffff7e400000 /usr/lib/sparcv9/libsched.so.1
0xffffffff7d400000 /lib/sparcv9/libm.so.1
0xffffffff7d100000 /usr/lib/sparcv9/libCrun.so.1
0xffffffff7cf00000 /lib/sparcv9/libdoor.so.1
0xffffffff7cd00000 /usr/lib/sparcv9/libdemangle.so.1
0xffffffff7cb00000 /lib/sparcv9/libkstat.so.1
0xffffffff7c900000 /lib/sparcv9/libnsl.so.1
0xffffffff7c700000 /lib/sparcv9/libm.so.2
0xffffffff7c500000 /lib/sparcv9/libscf.so.1
0xffffffff7c300000 /lib/sparcv9/libuutil.so.1
0xffffffff7c100000 /lib/sparcv9/libgen.so.1
0xffffffff7bf00000 /lib/sparcv9/libmd.so.1
0xffffffff7bd00000 /platform/SUNW,Sun-Fire-T200/lib/sparcv9/libmd_psr.so.1
0xffffffff7bb00000 /lib/sparcv9/libmp.so.2
0xffffffff7b900000 /usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/libverify.so
0xffffffff7b700000 /usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/libjava.so
0xffffffff7b400000 /usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/libzip.so
0xffffffff76100000 /usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/libmanagement.so
0xffffffff75f00000 /usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/libnet.so
0xffffffff75d00000 /usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/libj2pkcs11.so
0xffffffff75b00000 /usr/lib/sparcv9/libpkcs11.so
0xffffffff75900000 /usr/lib/sparcv9/libcryptoutil.so.1
0xffffffff2fe00000 /usr/lib/security/64/pkcs11_kernel.so
0xffffffff2fc00000 /usr/lib/security/64/pkcs11_softtoken.so
0xffffffff2f600000 /usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/libnio.so
0xffffffff2f400000 /lib/sparcv9/librt.so.1
0xffffffff2f100000 /lib/sparcv9/libaio.so.1
0xffffffff2ec00000 /usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/librmi.so
0xffffffff2de00000 /export/home/amit/electra/eWIRE/Agent/lib/solaris/sparc/64/libjMQ.so
0xffffffff2dc00000 /usr/sfw/lib/64/libgcc_s.so.1
VM Arguments:
jvm_args: -Xss200k -DBYTEORDER=BE -DWORDSIZE=64 -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=7866 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false
java_command: com.ecs.middleware.Application Machine1 Agent1 /export/home/amit/electra/eWIRE/Agent/bin/middleware.config
Launcher Type: SUN_STANDARD
Environment Variables:
JAVA_HOME=/usr/jdk/instances/jdk1.6.0
CLASSPATH=/export/home/amit/electra/eWIRE/Agent/bin/.:/export/home/amit/electra/eWIRE/Agent/lib/commons-exec-1.1.jar:/export/home/amit/electra/eWIRE/Agent/lib/log4j-1.2.16.jar:/export/home/amit/electra/eWIRE/Agent/lib/gson-2.0.jar:/export/home/amit/electra/eWIRE/Agent/lib/netty-3.2.7.Final.jar:/export/home/amit/electra/eWIRE/Agent/lib/commons-lang-2.6.jar:/export/home/amit/electra/eWIRE/Agent/lib/ProducerAPI.jar:/export/home/amit/electra/eWIRE/Agent/lib/jMQ.jar:/export/home/amit/electra/eWIRE/Agent/lib/slf4j-api-1.5.11.jar:/export/home/amit/electra/eWIRE/Agent/lib/slf4j-log4j12-1.5.11.jar:/export/home/amit/electra/eWIRE/Agent/lib/ulframework.jar:/export/home/amit/electra/eWIRE/Agent/lib/activemq-all-5.5.0.jar:/export/home/amit/electra/eWIRE/Agent/lib/JMSActiveMQProvider.jar
PATH=/usr/jdk/instances/jdk1.6.0/bin/java:/usr/jdk/instances/jdk1.6.0/jre/bin/sparcv9:/usr/openwin/bin:/usr/local/bin:/usr/sfw/sparc-sun-solaris2.10/bin:/usr/ccs/bin/sparcv9:/opt/SUNWspro/bin:/usr/java/bin:/usr/ccs/bin:/usr/local/libexec/gcc/sparc-sun-solaris2.10/3.4.6:/usr/local/bin:/bin:.:/oracle/orasrv11/OraBase_2/OraHome_3/bin:/usr/ucblib:/export/home/amit/electra/eWIRE/Agent/bin:/export/home/amit/activeMQ/apache-activemq-5.5.0/bin:/usr/vacpp/bin:/usr/vac/bin:/usr/bin:/usr/local/bin:/usr/sfw/bin:/etc:/usr/sbin:/usr/ucb:/export/home/amit/bin:/usr/bin/X11:/sbin:/oracle/orasrv11/OraBase_2/OraHome_3/bin:/usr/local/bin:/bin:/usr/jdk/instances/jdk1.6.0:
LD_LIBRARY_PATH=/usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9/server:/usr/jdk/instances/jdk1.6.0/jre/lib/sparcv9:/usr/jdk/instances/jdk1.6.0/jre/../lib/sparcv9::/lib/sparcv9:/export/home/amit/electra/eWIRE/Agent/lib/solaris/sparc/64:/usr/ccs/lib:/usr/sfw/lib:/usr/lib/sparcv9:/opt/freeware/lib:/export/home/amit/electra/eWIRE/Agent/lib:/oracle/orasrv11/OraBase_2/OraHome_3/lib:/export/home/amit/electra/eWIRE/Agent/lib:/usr/vac/lib:/export/home/amit/lib-WIRE:/usr/jdk/instances/jdk1.6.0/bin/sparcv9/classic/:/usr/jdk/instances/jdk1.6.0/lib/sparcv9
SHELL=/usr/bin/ksh
Signal Handlers:
SIGSEGV: [libjvm.so+0x9b1230], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGBUS: [libjvm.so+0x9b1230], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGFPE: [libjvm.so+0x23f270], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGPIPE: [libjvm.so+0x23f270], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGXFSZ: [libjvm.so+0x23f270], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGILL: [libjvm.so+0x23f270], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: [libjvm.so+0x867928], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGTERM: [libjvm.so+0x867928], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIG39: [libjvm.so+0x86b0b8], sa_mask[0]=0x00000000, sa_flags=0x00000008
SIG40: [libjvm.so+0x23f270], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
--------------- S Y S T E M ---------------
OS: Oracle Solaris 10 9/10 s10s_u9wos_14a SPARC
Copyright (c) 2010, Oracle and/or its affiliates. All rights reserved.
Assembled 11 August 2010
uname:SunOS 5.10 Generic_147440-06 sun4v (T2 libthread)
rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity
load average:0.07 0.12 0.18
CPU:total 7 has_v8, has_v9, has_blk_init, is_sun4v, is_niagara
Memory: 8k page, physical 4194304k(2900008k free)
Warning: Address: 0x0, Size: 8K, Mapped file: None, Access:r--
vm_info: Java HotSpot(TM) 64-Bit Server VM (20.4-b02) for solaris-sparc JRE (1.6.0_29-b11), built on Oct 3 2011 01:43:34 by "" with Workshop 5.8
time: Tue Feb 21 16:47:00 2012
elapsed time: 2051 secondsCrazy thought here. I noticed in your stacktrace a call to Java_sun_awt_motif_MToolkit_run. Is your solaris server set up with a Motif/X-Windows server? Or is it a 'headless' installation? Many java AWT and Graphics libraries rely on an underlying native windowing system.
-
Hi,
We are seeing a pretty consistent crash thrown by our app when its been up for a while. I cant really see anything untoward in the dump files though, any ideas?
Thanks
Dave
# An unexpected error has been detected by HotSpot Virtual Machine:
# SIGSEGV (0xb) at pc=0xfe985380, pid=29468, tid=602
# Java VM: Java HotSpot(TM) Server VM (1.5.0_07-b03 mixed mode)
# Problematic frame:
# V [libjvm.so+0x185380]
--------------- T H R E A D ---------------
Current thread (0x007c6178): JavaThread "pool-1-thread-3" [_thread_in_vm, id=602]
siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x7fe8c2e0
Registers:
O0=0x000329a0 O1=0x007d8483 O2=0x007d8b32 O3=0x00008de8
O4=0xfefc4000 O5=0x007c6178 O6=0xb1a7f1c8 O7=0xfe98531c
G1=0x00036cb8 G2=0xff034fcc G3=0x00009160 G4=0x00009000
G5=0xb5c3e060 G6=0x00000000 G7=0xfb166400 Y=0x00000000
PC=0xfe985380 nPC=0xfe985340
Top of Stack: (sp=0xb1a7f1c8)
0xb1a7f1c8: 00000001 00000000 92026250 00000004
0xb1a7f1d8: ff01784c 0000635c 00006000 ff01784c
0xb1a7f1e8: 7fe8c2b0 b5c40528 00000008 0000635c
0xb1a7f1f8: fefc4000 00006000 b1a7f228 fe9a6b94
0xb1a7f208: 00000000 00000004 f9015d70 00000000
0xb1a7f218: 00000000 00fd35ec 00000000 b1a7f4d0
0xb1a7f228: 00fd35ec fefc4000 00000000 b1a7f320
0xb1a7f238: 00000006 00000008 b5c40528 0000000e
Instructions: (pc=0xfe985380)
0xfe985370: 81 e8 00 00 f0 06 20 38 80 a6 20 00 32 4f ff f1
0xfe985380: e4 06 20 30 7f fd da 9e 01 00 00 00 81 c7 e0 08
Stack: [0xb1a00000,0xb1a80000), sp=0xb1a7f1c8, free space=508k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x185380]
V [libjvm.so+0x1a6b9c]
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.addParameter(Ljava/lang/String;Ljava/lang/Object;Z)Ljava/lang/Object;+8
j GregorSamsa.topLevel(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTMAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+77
j GregorSamsa.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTMAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+35
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+9
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;Ljava/lang/String;)V+152
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Ljavax/xml/transform/Result;)V+119
j java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+44
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+28
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
V [libjvm.so+0x19addc]
V [libjvm.so+0x2c39d4]
V [libjvm.so+0x2e2f4c]
V [libjvm.so+0x2deae8]
V [libjvm.so+0x6691b0]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.addParameter(Ljava/lang/String;Ljava/lang/Object;Z)Ljava/lang/Object;+8
j GregorSamsa.topLevel(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTMAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+77
j GregorSamsa.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTMAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+35
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+9
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;Ljava/lang/String;)V+152
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Ljavax/xml/transform/Result;)V+119
j java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+44
j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+28
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x0078b018 JavaThread "pool-1-thread-20" [_thread_blocked, id=619]
0x0078aab0 JavaThread "pool-1-thread-19" [_thread_blocked, id=618]
0x0078c540 JavaThread "pool-1-thread-18" [_thread_blocked, id=617]
0x006c9018 JavaThread "pool-1-thread-17" [_thread_blocked, id=616]
0x008e51e8 JavaThread "pool-1-thread-16" [_thread_blocked, id=615]
0x00fd1358 JavaThread "pool-1-thread-15" [_thread_blocked, id=614]
0x00636118 JavaThread "pool-1-thread-14" [_thread_blocked, id=613]
0x006c9fa8 JavaThread "pool-1-thread-13" [_thread_blocked, id=612]
0x00da4640 JavaThread "pool-1-thread-12" [_thread_blocked, id=611]
0x009af680 JavaThread "pool-1-thread-11" [_thread_blocked, id=610]
0x009aecd0 JavaThread "pool-1-thread-10" [_thread_blocked, id=609]
0x00f8c778 JavaThread "pool-1-thread-9" [_thread_blocked, id=608]
0x010c94b8 JavaThread "pool-1-thread-8" [_thread_blocked, id=607]
0x00d128f0 JavaThread "pool-1-thread-7" [_thread_blocked, id=606]
0x005d9940 JavaThread "pool-1-thread-6" [_thread_blocked, id=605]
0x00f903d8 JavaThread "pool-1-thread-5" [_thread_blocked, id=604]
0x0076f718 JavaThread "pool-1-thread-4" [_thread_blocked, id=603]
=>0x007c6178 JavaThread "pool-1-thread-3" [_thread_in_vm, id=602]
0x00d48cf0 JavaThread "pool-1-thread-2" [_thread_blocked, id=601]
0x010fcd20 JavaThread "pool-1-thread-1" [_thread_blocked, id=599]
0x00f94500 JavaThread "TIBCO EMS Session Dispatcher (227027)" [_thread_blocked, id=40]
0x007d4a40 JavaThread "TIBCO EMS TCPLink Reader (83257)" daemon [_thread_in_native, id=38]
0x00fd4b60 JavaThread "TIBCO EMS Session Dispatcher (227020)" [_thread_blocked, id=36]
0x006cb670 JavaThread "TIBCO EMS TCPLink Reader (83250)" daemon [_thread_in_native, id=34]
0x0087fb08 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=30]
0x00f95f88 JavaThread "RMI RenewClean-[14.64.10.31:52656]" daemon [_thread_blocked, id=28]
0x00b95810 JavaThread "GC Daemon" daemon [_thread_blocked, id=26]
0x0098c1c8 JavaThread "RMI Reaper" [_thread_blocked, id=25]
0x00825420 JavaThread "RMI TCP Accept-14500" daemon [_thread_in_native, id=24]
0x00a3b980 JavaThread "TIBCO EMS TCPLink Reader (83233)" daemon [_thread_in_native, id=23]
0x00fcf670 JavaThread "TIBCO EMS TCPLink Reader (83228)" daemon [_thread_in_native, id=21]
0x00f922d0 JavaThread "TIBCO EMS Connections Pinger" daemon [_thread_blocked, id=19]
0x005a32f0 JavaThread "Thread-2" daemon [_thread_blocked, id=17]
0x005a85a0 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=15]
0x0076daf0 JavaThread "Timer-0" daemon [_thread_blocked, id=14]
0x0015c728 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=13]
0x0015add0 JavaThread "CompilerThread1" daemon [_thread_blocked, id=12]
0x0015a000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=11]
0x001590e8 JavaThread "AdapterThread" daemon [_thread_blocked, id=10]
0x00158410 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=9]
0x0014b880 JavaThread "Finalizer" daemon [_thread_blocked, id=8]
0x0014b3e0 JavaThread "Reference Handler" daemon [_thread_blocked, id=7]
0x00037b88 JavaThread "main" [_thread_blocked, id=1]
Other Threads:
0x00149300 VMThread [id=6]
0x005a8bb8 WatcherThread [id=16]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x000329a0/0x00036cb8] OsrList_lock - owner thread: 0x007c6178
Heap
PSYoungGen total 100352K, used 10009K [0xe3400000, 0xea000000, 0xf8c00000)
eden space 100160K, 9% used [0xe3400000,0xe3dc67b8,0xe95d0000)
from space 192K, 0% used [0xe9fd0000,0xe9fd0000,0xea000000)
to space 192K, 0% used [0xe9fa0000,0xe9fa0000,0xe9fd0000)
PSOldGen total 176128K, used 14703K [0xb8800000, 0xc3400000, 0xe3400000)
object space 176128K, 8% used [0xb8800000,0xb965bf20,0xc3400000)
PSPermGen total 24576K, used 21658K [0xb4800000, 0xb6000000, 0xb8800000)
object space 24576K, 88% used [0xb4800000,0xb5d26af0,0xb6000000)
Dynamic libraries:
0x00010000 /usr/jdk/instances/jdk1.5.0/bin/java
0xff3f8000 /lib/libthread.so.1
0xff3a0000 /lib/libdl.so.1
0xff280000 /lib/libc.so.1
0xff270000 /platform/FJSV,GPUZC-M/lib/libc_psr.so.1
0xfe800000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/server/libjvm.so
0xff230000 /lib/libsocket.so.1
0xff260000 /usr/lib/libsched.so.1
0xff1f0000 /usr/lib/libCrun.so.1
0xff1d0000 /lib/libm.so.1
0xff100000 /lib/libnsl.so.1
0xfe700000 /lib/libm.so.2
0xff0d0000 /lib/libscf.so.1
0xff0b0000 /lib/libdoor.so.1
0xff090000 /lib/libuutil.so.1
0xff070000 /lib/libmd5.so.1
0xff050000 /platform/FJSV,GPUZC-M/lib/libmd5_psr.so.1
0xfe7e0000 /lib/libmp.so.2
0xfe6d0000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/native_threads/libhpi.so
0xfe680000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libverify.so
0xfe640000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libjava.so
0xfe610000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libzip.so
0xfbec0000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libmanagement.so
0xfbe90000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libnet.so
0xb36d0000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/libj2pkcs11.so
0xb30c0000 /usr/lib/libpkcs11.so
0xb2f60000 /usr/lib/libcryptoutil.so.1
0xb2900000 /usr/lib/security/pkcs11_softtoken.so
0xb3890000 /usr/jdk/instances/jdk1.5.0/jre/lib/sparc/librmi.so
Environment Variables:
SHELL=/bin/bash
Signal Handlers:
SIGSEGV: [libjvm.so+0x6f60b8], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGBUS: [libjvm.so+0x6f60b8], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGFPE: [libjvm.so+0x276398], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGPIPE: [libjvm.so+0x276398], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGILL: [libjvm.so+0x276398], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGHUP: [libjvm.so+0x66a38c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGINT: [libjvm.so+0x66a38c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGQUIT: [libjvm.so+0x66a38c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGTERM: [libjvm.so+0x66a38c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
--------------- S Y S T E M ---------------
OS: Solaris 10 6/06 s10s_u2wos_09a SPARC
Copyright 2006 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 09 June 2006
uname:SunOS 5.10 Generic_118833-18 sun4us (T2 libthread)
rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity
load average:0.04 0.04 0.04
CPU:total 4 has_v8, has_v9, has_vis1, has_vis2, is_ultra3
Memory: 8k page, physical 16777216k(13884520k free)
vm_info: Java HotSpot(TM) Server VM (1.5.0_07-b03) for solaris-sparc, built on May 3 2006 01:22:35 by unknown with unknown Workshop:0x550I am running 1.5.0_12 and it looks like I am getting the same crash as the first poster. I am running on Linux 2.6.9-22.0.2.ELsmp.
# An unexpected error has been detected by HotSpot Virtual Machine:
# SIGSEGV (0xb) at pc=0x0000002a958bdbf1, pid=7355, tid=1109870944
# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.5.0_12-b04 mixed mode)
# Problematic frame:
# V [libjvm.so+0x358bf1]
--------------- T H R E A D ---------------
Current thread (0x0000002ac68e7d80): JavaThread "resin-tcp-connection-*:7701-79" daemon [_thread_in_vm, id=7471]
siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x0000017700000e51
Registers:
RAX=0x0000000000000000, RBX=0x0000017700000e11, RCX=0x0000000000000001, RDX=0x0000000042274960
RSP=0x0000000042272230, RBP=0x0000000042272250, RSI=0x0000000000001d2f, RDI=0x00000000401158b8
R8 =0x0000002ac5918c28, R9 =0x00000039bd410280, R10=0x0000000000000010, R11=0x0000000042272368
R12=0x0000002a9e3d56d0, R13=0x0000000000000008, R14=0x0000002ac5918c28, R15=0x00000000422722d0
RIP=0x0000002a958bdbf1, EFL=0x0000000000010206, CSGSFS=0x0000000000000000, ERR=0x0000000000000005
TRAPNO=0x000000000000000e
Top of Stack: (sp=0x0000000042272230)
0x0000000042272230: 0000002ac68e7d80 0000000000000008
0x0000000042272240: 0000002ac68e7d80 0000002a9e3d5696
0x0000000042272250: 0000000042272350 0000002a958d874a
0x0000000042272260: 0000000042272368 0000002a99404293
0x0000000042272270: 00000000422723a0 0000000000000000
0x0000000042272280: 0000000042272290 0000002a95b5f358
0x0000000042272290: 0000002ac5918c28 0000002a95843160
0x00000000422722a0: 00000000422722b0 6600002a9e57dd58
0x00000000422722b0: 0000000042272368 0000002a99404293
0x00000000422722c0: 00000000422723a0 0000002a00000001
0x00000000422722d0: 0000000042272368 0000002a99404293
0x00000000422722e0: 00000000422723a0 0000002a9e577220
0x00000000422722f0: 0000002ac68e7d80 0000002a00000000
0x0000000042272300: 0000002ac68e7d80 0000002a958d3f4d
0x0000000042272310: 0000002ac68e7d80 0000002a993fdf7d
0x0000000042272320: 0000000042272420 0000000000000000
0x0000000042272330: 000000000000000a 0000002a9e3d5650
0x0000000042272340: 00000000422723d8 0000002ac68e7d80
0x0000000042272350: 00000000422723a0 0000002a994042d8
0x0000000042272360: 0000002a99404293 0000000042272368
0x0000000042272370: 0000002a9e3d5650 00000000422723d8
0x0000000042272380: 0000002a9e3d7d70 0000002a9e4de9b0
0x0000000042272390: 0000002a9e3d56d0 00000000422723c0
0x00000000422723a0: 0000000042272420 0000002a993f2de1
0x00000000422723b0: 0000002abca88970 0000000000000001
0x00000000422723c0: 0000000000000001 0000002a9c585f10
0x00000000422723d0: 0000002a9d6912e0 0000002abca87188
0x00000000422723e0: 0000002abca87188 00000000422723e8
0x00000000422723f0: 0000002a9e57a453 0000000042272450
0x0000000042272400: 0000002a9e57dd58 0000000000000000
0x0000000042272410: 0000002a9e57a758 0000000042272438
0x0000000042272420: 0000000042272490 0000002a993f2efe
Instructions: (pc=0x0000002a958bdbf1)
0x0000002a958bdbe1: 1b 70 1f 00 48 8b 9b a8 01 00 00 48 85 db 74 0f
0x0000002a958bdbf1: 4c 39 63 40 74 29 48 8b 5b 50 48 85 db 75 f1 48
Stack: [0x0000000042174000,0x0000000042275000), sp=0x0000000042272230, free space=1016k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x358bf1]
V [libjvm.so+0x37374a]
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.addParameter(Ljava/lang/String;Ljava/lang/Object;Z)Ljava/l
ang/Object;+8
j acme_pageflakebeta_ad_api.topLevel(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTM
AxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+75
j acme_pageflakebeta_ad_api.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DT
MAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+24
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lco
m/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+9
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Lcom/sun/org/apache/xml/
internal/serializer/SerializationHandler;Ljava/lang/String;)V+152
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Ljavax/xml/transform/Res
ult;)V+119
j org.apache.taglibs.xtags.xslt.StyleTag.doEndTag()I+79
j jsp.wireframes._sdc._ads._controller__jsp._jspService(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServ
letResponse;)V+1086
j com.caucho.jsp.JavaPage.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+9
j com.caucho.jsp.Page.pageservice(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+268
j com.caucho.server.dispatch.PageFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+246
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.addParameter(Ljava/lang/String;Ljava/lang/Object;Z)Ljava/l
ang/Object;+8
j acme_pageflakebeta_ad_api.topLevel(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DTM
AxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+75
j acme_pageflakebeta_ad_api.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lcom/sun/org/apache/xml/internal/dtm/DT
MAxisIterator;Lcom/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+24
j com.sun.org.apache.xalan.internal.xsltc.runtime.AbstractTranslet.transform(Lcom/sun/org/apache/xalan/internal/xsltc/DOM;Lco
m/sun/org/apache/xml/internal/serializer/SerializationHandler;)V+9
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Lcom/sun/org/apache/xml/
internal/serializer/SerializationHandler;Ljava/lang/String;)V+152
j com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(Ljavax/xml/transform/Source;Ljavax/xml/transform/Res
ult;)V+119
j org.apache.taglibs.xtags.xslt.StyleTag.doEndTag()I+79
j jsp.wireframes._sdc._ads._controller__jsp._jspService(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServ
letResponse;)V+1086
j com.caucho.jsp.JavaPage.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+9
j com.caucho.jsp.Page.pageservice(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+268
j com.caucho.server.dispatch.PageFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+246
v ~C2IAdapter
J com.caucho.server.webapp.DispatchFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
v ~I2CAdapter
j com.caucho.server.dispatch.ServletInvocation.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+6
j com.caucho.server.webapp.RequestDispatcherImpl.forward(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServl
etResponse;Ljava/lang/String;Lcom/caucho/server/dispatch/Invocation;)V+697
j com.caucho.server.webapp.RequestDispatcherImpl.forward(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+14
j org.springframework.web.servlet.view.InternalResourceView.renderMergedOutputModel(Ljava/util/Map;Ljavax/servlet/http/HttpSe
rvletRequest;Ljavax/servlet/http/HttpServletResponse;)V+154
v ~C2IAdapter
J cnwk.maverick.mvc.CnetTilesView.renderMergedOutputModel(Ljava/util/Map;Ljavax/servlet/http/HttpServletRequest;Ljavax/servle
t/http/HttpServletResponse;)V
v ~I2CAdapter
j org.springframework.web.servlet.view.AbstractView.render(Ljava/util/Map;Ljavax/servlet/http/HttpServletRequest;Ljavax/servl
et/http/HttpServletResponse;)V+151
v ~C2IAdapter
J org.springframework.web.servlet.DispatcherServlet.render(Lorg/springframework/web/servlet/ModelAndView;Ljavax/servlet/http/
HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V
v ~I2CAdapter
j org.springframework.web.servlet.DispatcherServlet.doDispatch(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/Htt
pServletResponse;)V+344
v ~C2IAdapter
J cnwk.maverick.mvc.InstrumentedDispatcherServlet.doDispatch(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpS
ervletResponse;)V
v ~I2CAdapter
j org.springframework.web.servlet.DispatcherServlet.doService(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/Http
ServletResponse;)V+225
j org.springframework.web.servlet.FrameworkServlet.processRequest(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/
HttpServletResponse;)V+10
j org.springframework.web.servlet.FrameworkServlet.doGet(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServl
etResponse;)V+3
j javax.servlet.http.HttpServlet.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+62
j javax.servlet.http.HttpServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+15
j com.caucho.server.dispatch.ServletFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+40
v ~C2IAdapter
J cnwk.maverick.mvc.ResponseHeaderFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet
/FilterChain;)V
J com.opensymphony.module.sitemesh.filter.PageFilter.parsePage(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/Htt
pServletResponse;Ljavax/servlet/FilterChain;)Lcom/opensymphony/module/sitemesh/Page;
v ~I2CAdapter
j com.opensymphony.module.sitemesh.filter.PageFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Lj
avax/servlet/FilterChain;)V+84
j com.caucho.server.dispatch.FilterFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+10
j cnwk.maverick.mvc.AddOidFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterC
hain;)V+78
j com.caucho.server.dispatch.FilterFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+10
v ~C2IAdapter
J com.caucho.server.cache.CacheFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V
v ~I2CAdapter
j com.caucho.server.webapp.WebAppFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+147
j com.caucho.server.dispatch.ServletInvocation.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+6
j com.caucho.server.http.HttpRequest.handleRequest()Z+673
v ~C2IAdapter
J com.caucho.server.port.TcpConnection.run()V
J com.caucho.util.ThreadPool.runTasks()V
v ~I2CAdapter
j com.caucho.util.ThreadPool.run()V+85
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x0000002ac98b7b50 JavaThread "resin-1197" daemon [_thread_blocked, id=9216]
0x0000002acc127ca0 JavaThread "resin-tcp-connection-*:7701-25" daemon [_thread_in_native, id=9187]
0x0000002acfaed8e0 JavaThread "resin-1195" daemon [_thread_blocked, id=9186]
0x0000002ace06ff50 JavaThread "resin-1194" daemon [_thread_blocked, id=8210]
0x0000002ac9809b00 JavaThread "resin-tcp-connection-*:7701-15" daemon [_thread_in_native, id=8001]
0x0000002acf263c40 JavaThread "resin-1192" daemon [_thread_blocked, id=7689]
0x0000002ac5987670 JavaThread "resin-tcp-connection-*:7701-33" daemon [_thread_in_native, id=7688]
=>0x0000002ac68e7d80 JavaThread "resin-tcp-connection-*:7701-79" daemon [_thread_in_vm, id=7471]
0x0000002ac68e89d0 JavaThread "resin-1188" daemon [_thread_blocked, id=5355]
0x0000002ac5988120 JavaThread "resin-tcp-connection-*:7701-55" daemon [_thread_in_native, id=5244]
0x0000002ac5987190 JavaThread "resin-1186" daemon [_thread_blocked, id=5182]
0x0000002ac98c3830 JavaThread "resin-tcp-connection-*:7701-35" daemon [_thread_in_native, id=5181]
0x0000002ac59770c0 JavaThread "resin-1184" daemon [_thread_blocked, id=5061]
0x0000002aca416c60 JavaThread "resin-tcp-connection-*:7701-7" daemon [_thread_in_native, id=4082]
0x0000002aca427cd0 JavaThread "resin-1182" daemon [_thread_blocked, id=3983]
0x0000002ac599e3f0 JavaThread "resin-1179" daemon [_thread_blocked, id=2619]
0x0000002ace05fc70 JavaThread "resin-1178" daemon [_thread_blocked, id=2343]
0x0000002ac591aca0 JavaThread "resin-tcp-connection-*:7701-69" daemon [_thread_in_native, id=1370]
0x0000002acb415da0 JavaThread "resin-1175" daemon [_thread_blocked, id=1368]
0x0000002ac8b2b640 JavaThread "resin-tcp-connection-*:7701-65" daemon [_thread_in_native, id=32077]
0x0000002ac59a9610 JavaThread "resin-tcp-connection-*:7701-47" daemon [_thread_in_native, id=32015]
0x0000002ac5926190 JavaThread "resin-tcp-connection-*:7701-1" daemon [_thread_in_native, id=31537]
0x0000002ac5c6f9e0 JavaThread "MultiThreadedHttpConnectionManager cleanup" daemon [_thread_blocked, id=7661]
0x0000002ac5977600 JavaThread "resin-port-7701" daemon [_thread_blocked, id=7419]
0x0000002ac5907bd0 JavaThread "Thread-6" [_thread_blocked, id=7418]
0x0000002ac68e0a40 JavaThread "resin-select-manager" daemon [_thread_in_native, id=7381]
0x0000002ac6807630 JavaThread "resin-ping" daemon [_thread_blocked, id=7379]
0x0000002ac5b0d220 JavaThread "resin-thread-scheduler" daemon [_thread_blocked, id=7371]
0x0000002ac5b0c0c0 JavaThread "resin-thread-launcher" daemon [_thread_blocked, id=7370]
0x0000002ac59155b0 JavaThread "resin-alarm" daemon [_thread_blocked, id=7369]
0x0000002ac1b83b70 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=7367]
0x0000002ac1b81fd0 JavaThread "CompilerThread1" daemon [_thread_blocked, id=7366]
0x0000002ac1b80ab0 JavaThread "CompilerThread0" daemon [_thread_blocked, id=7365]
0x0000002ac1b7f3e0 JavaThread "AdapterThread" daemon [_thread_blocked, id=7364]
0x0000002ac1b7e110 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=7363]
0x0000002ac1b6a100 JavaThread "Finalizer" daemon [_thread_blocked, id=7362]
0x0000002ac1b69960 JavaThread "Reference Handler" daemon [_thread_blocked, id=7361]
0x0000000040117070 JavaThread "main" [_thread_in_native, id=7355]
Other Threads:
0x0000002ac1b65500 VMThread [id=7360]
0x000000004012b8c0 WatcherThread [id=7368]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x0000000040115860/0x0000000040115890] OsrList_lock - owner thread: 0x0000002ac68e7d80
Heap
PSYoungGen total 130368K, used 97228K [0x0000002ab6e10000, 0x0000002abf820000, 0x0000002ac18b0000)
eden space 127936K, 74% used [0x0000002ab6e10000,0x0000002abcaaaf98,0x0000002abeb00000)
from space 2432K, 98% used [0x0000002abee00000,0x0000002abf058358,0x0000002abf060000)
to space 5120K, 0% used [0x0000002abf320000,0x0000002abf320000,0x0000002abf820000)
PSOldGen total 349568K, used 209465K [0x0000002aa18b0000, 0x0000002ab6e10000, 0x0000002ab6e10000)
object space 349568K, 59% used [0x0000002aa18b0000,0x0000002aae53e6d8,0x0000002ab6e10000)
PSPermGen total 33792K, used 33596K [0x0000002a9c4b0000, 0x0000002a9e5b0000, 0x0000002aa18b0000)
object space 33792K, 99% used [0x0000002a9c4b0000,0x0000002a9e57f370,0x0000002a9e5b0000)
Signal Handlers:
SIGSEGV: [libjvm.so+0x661c00], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGBUS: [libjvm.so+0x661c00], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGFPE: [libjvm.so+0x568b50], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGPIPE: [libjvm.so+0x568b50], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGILL: [libjvm.so+0x568b50], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x56aa00], sa_mask[0]=0x00000000, sa_flags=0x14000004
SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGINT: [libjvm.so+0x56a4d0], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGQUIT: [libjvm.so+0x56a4d0], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
SIGTERM: [libjvm.so+0x56a4d0], sa_mask[0]=0x7ffbfeff, sa_flags=0x14000004
--------------- S Y S T E M ---------------
OS:Red Hat Enterprise Linux ES release 4 (Nahant)
uname:Linux 2.6.9-22.0.2.ELsmp #1 SMP Thu Jan 5 17:11:56 EST 2006 x86_64
libc:glibc 2.3.4 NPTL 2.3.4
rlimit: STACK 10240k, CORE infinity, NPROC 131071, NOFILE 8192, AS infinity
load average:0.22 0.28 0.21
CPU:total 2 amd64 3dnow
Memory: 4k page, physical 16254000k(14555776k free), swap 120k(120k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (1.5.0_12-b04) for linux-amd64, built on May 2 2007 01:49:59 by java_re with gcc 3
.2.2 (SuSE Linux) -
Hi,
Can anyone help me in debugging this pstack output?
What I am trying to do?
1) using a C code to start the JVM and execute a jar, as shown the trace below
but I get the following core file.
2) It seems like JVM is trying to access the memory provided by the OS and then throws the signal 11 ( SIGSEGV)
Other details:
OS: SunOS t5220x1081 5.10 Generic_127111-06 sun4v sparc SUNW,SPARC-Enterprise-T5220
Java version:java version "1.5.0_12"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_12-b04)
Java HotSpot(TM) Server VM (build 1.5.0_12-b04, mixed mode)
-Alphy
----------------- lwp# 6 / thread# 6 --------------------
fe9c599c lwpkill (6, 0, fe9f2cb8, fe9a89a8, ffffffff, 6) + 8
fe9410b8 abort (0, 1, 6d908c, ad354, fe9f1318, 0) + 110
00420528 __1cRSolarisThreadCoreNsignalHandler6FipnHsiginfo_pv_v_ (0, 73f328, 1, 6d9000, 6, 1) + 2e8
ff03eccc ???????? (b, 44173f0, fcdf6970, fcdf66b8, 44173e8, 12d2cc) + fec1ea8c
fee13ff0 JVM_handle_solaris_signal (b, fcdf6970, fcdf66b8, 1, ff185ff0, 441b4a0) + 96c
fe9c48d4 __sighndlr (b, fcdf6970, fcdf66b8, fee13664, 0, 1) + c
fe9b98ac call_user_handler (b, ffbffeff, c, ff37, fe2e2200, fcdf66b8) + 3b8
fe956110 realfree (4473200, 434b4c85, 9824c, 0, 0, 44731f0) + 68
fe955c80 mallocunlocked (4473128, 434b4d5c, 4473120, 4473128, fffffffc, 2) + 260
fe955a04 malloc (cc, 1, 98948, 0, fe9ee308, fe9f76f0) + 4c
fa0c2b20 C_GetMechanismList (fcdf6bac, 0, fcdf6c38, 6, 275ec, 7800) + 114
fa194c48 meta_mechManager_update_slot (1, 0, 2bb6ad4, 2bb6bac, 2bb6b68, 8) + 54
fa1948a8 meta_mechManager_get_mechs (0, fcdf6d64, 0, 21784, 2, fa1ed6f4) + 34
fa19b908 meta_GetMechanismList (2a, 0, fcdf6d64, 1a740, fa19f034, 7) + 50
fa1d7148 Java_sun_security_pkcs11_wrapper_PKCS11_C_1GetMechanismList (441b55c, fcdf6ed4, 0, 0, 6748, 6548) + 34
f740bc20 ???????? (441b4a0, fcdf6ed4, fcdf6e50, ffffff80, d28, ff16c000) + fffffffffd234b0c
f740bbc4 ???????? (cd1042a8, 0, 6548, c, ff185ff8, fcdf6e68) + fffffffffd234ab0
f7405874 * sun/security/pkcs11/SunPKCS11.initToken(Lsun/security/pkcs11/wrapper/CK_SLOT_INFO;)V+156 (line 572)
f7405764 ???????? (cd0bc548, 0, 6548, f74148e0, ff185ff8, fcdf6ff0) + fffffffffd22e650
f7405764 ???????? (c000, 2, 4c00, f74148e0, ff17fcb8, fcdf7070) + fffffffffd22e650
f7400218 * StubRoutines (1)
fecdd26c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 441b4a0, fcdf7300, fcdf7170, fcdf7304, 0) + 5b8
fed0db78 __1cKReflectionGinvoke6FnTinstanceKlassHandle_nMmethodHandle_nGHandle_inOobjArrayHandle_nJBasicType_4ipnGThread__pnHoopDesc__ (cd7c2d38, e, 4416ed0, 4, fcdf73f8, ff16c000) + 1520
fed0c49c __1cKReflectionSinvoke_constructor6FpnHoopDesc_nOobjArrayHandle_pnGThread__2_ (4416ec8, fcdf746c, 441b4a0, 4416ed0, 4416ecc, d123d040) + 348
fed0bf20 JVM_NewInstanceFromConstructor (441b55c, fcdf764c, fcdf7648, ff1869bc, 441b4a0, cd0b7e08) + 1e4
fd97d32c Java_sun_reflect_NativeConstructorAccessorImpl_newInstance0 (441b55c, fcdf75c8, fcdf764c, fcdf7648, ff1821b0, 0) + c
f740bc20 ???????? (349, fcdf764c, fcdf75c8, ffffff80, ff188960, 0) + fffffffff9a8e900
f740bbc4 ???????? (cd0b7e08, b8, fcdf76d0, 8, cd0bb490, fcdf75e0) + fffffffff9a8e8a4
f7405874 ???????? (cd0b7e18, b6, fcdf7758, f7414a20, f8, fcdf7670) + fffffffff9a88554
f7405874 ???????? (cd0b7e30, d581ad78, fcdf77e8, f7414760, 580c, fcdf76f0) + fffffffff9a88554
f7405d3c ???????? (cd0b7dc8, 0, 6548, f7414b40, ff185ff8, fcdf7780) + fffffffff9a88a1c
f7405874 ???????? (c000, 2, 4c00, f74147b0, ff17fcb8, fcdf7818) + fffffffff9a88554
f7400218 * StubRoutines (1)
fecdd26c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 441b4a0, fcdf7a0c, fcdf7910, fcdf7a10, 0) + 5b8
feced73c JVM_DoPrivileged (441b55c, 1, 4416ec0, 4, c, 4416ebc) + 560
fd979c24 Java_java_security_AccessController_doPrivileged__Ljava_security_PrivilegedAction_2 (441b55c, fcdf7d28, fcdf7da4, f7414a20, 580c, fcdf80a0) + 14
f740bc20 ???????? (439, fcdf7da4, fcdf7d28, ffffff80, ff185ff8, 0) + fffffffff9a92010
f740bbc4 ???????? (cd0362b0, b8, 0, 4, cd03c4d8, fcdf7d40) + fffffffff9a91fb4
f7405874 ???????? (cd7be278, b7, fcdf7e30, f74148e0, 0, fcdf7dc8) + fffffffff9a8bc64
f7405874 ???????? (cd7be278, b6, cd7a9bc0, f74148e0, 1, fcdf7e60) + fffffffff9a8bc64
f7405874 ???????? (cd7de650, b6, fcdf7fdc, f7414760, c, fcdf7ee8) + fffffffff9a8bc64
f7405874 ???????? (cd7de650, b6, fcdf807c, f74147a8, d5806fe8, fcdf7f78) + fffffffff9a8bc64
f7405874 ???????? (d5d2d430, b8, fcdf8104, f7414760, e0, fcdf8018) + fffffffff9a8bc64
f7405874 ???????? (0, b8, 8, f7414a20, 580c, fcdf80a0) + fffffffff9a8bc64
f7405874 ???????? (3ff86c8, 0, 6548, f7414a20, ff185ff8, fcdf8130) + fffffffff9a8bc64
f7405874 ???????? (3ff86c8, 0, 6548, f7414a70, ff185ff8, fcdf81f8) + fffffffff9a8bc64
f74058fc ???????? (3ff86c8, 0, 6548, f7414a20, ff185ff8, fcdf8278) + fffffffff9a8bcec
f74058fc ???????? (c000, 2, 4c00, f7414a70, ff17fcb8, fcdf8300) + fffffffff9a8bcec
f7400218 * StubRoutines (1)
fecdd26c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 441b4a0, fcdf84f4, fcdf83f8, fcdf84f8, 0) + 5b8
feced73c JVM_DoPrivileged (441b55c, 1, 4416eb8, 4, c, 4416eb4) + 560
fd979c24 Java_java_security_AccessController_doPrivileged__Ljava_security_PrivilegedAction_2 (441b55c, fcdf8810, fcdf8890, 2, 580c, 5800) + 14
f740bc20 ???????? (431, fcdf8890, fcdf8810, ffffff80, ff185ff8, 0) + fffffffff9a92010
f740bbc4 ???????? (cd031d38, b8, 6548, 4, ff185ff8, fcdf8828) + fffffffff9a91fb4
f7405874 ???????? (cd02b860, b6, 6548, f74148e0, ff185ff8, fcdf88b0) + fffffffff9a8bc64
f74058fc ???????? (cd02a890, 0, 6548, f74147b0, ff185ff8, fcdf8940) + fffffffff9a8bcec
f7405764 ???????? (cd023e38, b7, d526d298, f7414928, 40, fcdf89e8) + fffffffff9a8bb54
f7405874 ???????? (cd023e38, b7, 0, f7414928, cd02bc20, fcdf8a68) + fffffffff9a8bc64
f7405874 ???????? (cd023e38, b7, d526d298, f7414928, 40, fcdf8b10) + fffffffff9a8bc64
f7405874 ???????? (cd023e38, b7, 6548, f7414928, ff185ff8, fcdf8b90) + fffffffff9a8bc64
f7405874 ???????? (cd023e38, 0, 6548, f7414928, ff185ff8, fcdf8c38) + fffffffff9a8bc64
f7405874 ???????? (cd023e38, 0, 6548, f7414928, ff185ff8, fcdf8cb8) + fffffffff9a8bc64
f7405874 ???????? (cd023e38, 0, 6548, f7414928, ff185ff8, fcdf8d50) + fffffffff9a8bc64
f7405874 ???????? (cd023e38, 0, 6548, f7414928, ff185ff8, fcdf8de8) + fffffffff9a8bc64
f7405874 ???????? (cd023e38, 0, 6548, f7414928, ff185ff8, fcdf8e80) + fffffffff9a8bc64
f7405874 ???????? (cd1eab10, 0, 6548, f7414760, ff185ff8, fcdf8f10) + fffffffff9a8bc64
f7405874 ???????? (3ff86c8, 0, 6548, f74147b0, ff185ff8, fcdf8fc0) + fffffffff9a8bc64
f7405874 ???????? (cd1dfaa0, 0, 6548, f7414a68, ff185ff8, fcdf9038) + fffffffff9a8bc64
f7405874 ???????? (3ff86c8, 0, 6548, f74147a8, ff185ff8, fcdf90c0) + fffffffff9a8bc64
f7405874 ???????? (cd1c42e0, 0, 6548, f7414a68, ff185ff8, fcdf9148) + fffffffff9a8bc64
f7405874 ???????? (3ff86c8, 0, 6548, f74147a8, ff185ff8, fcdf91c8) + fffffffff9a8bc64
f7405874 ???????? (cd199b40, 0, 6548, f7414a70, ff185ff8, fcdf9248) + fffffffff9a8bc64
f7405764 ???????? (cd0e36b8, 0, 6548, f74147b0, ff185ff8, fcdf92e8) + fffffffff9a8bb54
f7405764 ???????? (cd0e36b8, 0, 6548, f74147b0, ff185ff8, fcdf9398) + fffffffff9a8bb54
f7405764 ???????? (cd0e36b8, 0, 6548, f7414760, ff185ff8, fcdf9440) + fffffffff9a8bb54
f7405764 ???????? (cd0e36b8, 0, 6548, f74148e0, ff185ff8, fcdf94d0) + fffffffff9a8bb54
f7405764 ???????? (cd068eb0, 0, 6548, f74148e0, ff185ff8, fcdf9568) + fffffffff9a8bb54
f7405874 ???????? (cd1f61d0, 0, 6548, f7414760, ff185ff8, fcdf9658) + fffffffff9a8bc64
f7405874 ???????? (cd1f6168, 0, 6548, f7414760, ff185ff8, fcdf96f0) + fffffffff9a8bc64
f7405874 * oracle/jdbc/pool/OracleConnectionPoolDataSource.getPhysicalConnection(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;)Ljava/sql/Connection;+8 (line 109)
f7405874 * oracle/jdbc/pool/OracleConnectionPoolDataSource.getPooledConnection(Ljava/lang/String;Ljava/lang/String;)Ljavax/sql/PooledConnection;+7 (line 77)
f7405874 * oracle/jdbc/pool/OracleImplicitConnectionCache.makeCacheConnection(Ljava/lang/String;Ljava/lang/String;)Ljavax/sql/PooledConnection;+35 (line 1212)
f7405874 * oracle/jdbc/pool/OracleImplicitConnectionCache.getCacheConnection(Ljava/lang/String;Ljava/lang/String;Ljava/util/Properties;)Ljavax/sql/PooledConnection;+27 (line 341)
f7405874 ???????? (cd1f5150, 0, 6548, f74148e0, ff185ff8, fcdf99b8) + fffffffff9a8bc64
f7405874 ???????? (cd1d1dc8, 0, 6548, f7414760, ff185ff8, fcdf9a48) + fffffffff9a8bc64
f7405874 ???????? (cd1d1dc8, 0, 6548, f7414760, ff185ff8, fcdf9ae0) + fffffffff9a8bc64
f7405874 ???????? (cd1d1dc8, 0, 6548, f74147b0, ff185ff8, fcdf9b68) + fffffffff9a8bc64
f7405874 * com/ericsson/dws/storage/ConnectionManager.getPooledConnectionInternal(Ljava/lang/String;)Ljava/sql/Connection;+187 (line 85)
f7405874 ???????? (3ff86c8, 0, 6548, f7414760, ff185ff8, fcdf9c80) + fffffffff9a8bc64
f7405874 ???????? (cd0ae508, 0, 6548, f7414a70, ff185ff8, fcdf9d58) + fffffffff9a8bc64
f7405764 ???????? (3ff86c8, 0, 6548, f7414930, ff185ff8, fcdf9de0) + fffffffff9a8bb54
f7405874 ???????? (c000, 2, 4c00, f7414a20, ff17fcb8, fcdf9e70) + fffffffff9a8bc64
f7400218 * StubRoutines (1)
fecdd26c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 441b4a0, fcdfa030, fcdf9f68, fcdfa034, 0) + 5b8
fecf839c __1cUjni_invoke_nonstatic6FpnHJNIEnv__pnJJavaValue_pnI_jobject_nLJNICallType_pnK_jmethodID_pnSJNI_ArgumentPusher_pnGThread__v_ (441b55c, fcdfa110, 4416ea8, ff18304c, 4491ac0, fcdfa0f4) + 4d4
fed262a8 jni_NewObjectV (441b55c, ff182ff0, 4492304, fcdfa1d0, ff1869bc, 2b33358) + 420
003f7de4 __1cHJNIEnv_JNewObject6MpnH_jclass_pnK_jmethodID_E_pnI_jobject__ (441b55c, 2b335b0, 4492304, 2aa8b50, ff182bf0, fed25e88) + 24
003f72d4 __1cRJavaActivityProxyKinitialize6MnJRWCString_pnPJavaActivityJVM__b_ (2b4a590, 2aa8b5c, 2aa8b5c, 441b55c, 4492304, ff182bf0) + 414
003f6ca4 __1cRJavaActivityProxy2t5B6MnJRWCString_pnPJavaActivityJVM__v_ (2b4a590, fcdfa358, 44593f0, 9, 7139f0, 713800) + 24
003f324c __1cQJavaActivityImpl2t6MrknIDataUnit__v_ (0, 2b86754, 2b23b60, 2b23bec, 2b23bdc, fcdfa3d0) + 100c
0012dea4 __1cQProcessorBuilderWbuildJavaActivityPoint6MrknIDataUnit__pnRIntermediatePoint__ (442d3fc, 2b86754, 0, 0, 0, 2b23b60) + 284
00115118 __1cQProcessorBuilderTbuildProcessingNode6MrnINodeInfo__pnIOutPoint__ (ce2700, 2b86748, 0, 1, 3443760, 2b86754) + f78
00115f84 __1cQProcessorBuilderRconnectSuccessors6MrnINodeInfo_pnHInPoint__v_ (ce2700, 2b86710, 3afaea0, 3371f28, 3cb8998, 7e04a0) + c4
00115650 __1cQProcessorBuilderTbuildProcessingNode6MrnINodeInfo__pnIOutPoint__ (ce2700, 2b86710, 3afaea0, 3afaec8, 1, 2b8671c) + 14b0
00115f84 __1cQProcessorBuilderRconnectSuccessors6MrnINodeInfo_pnHInPoint__v_ (ce2700, 43957f0, 4269c70, 419cb90, 3cb8988, 0) + c4
00115650 __1cQProcessorBuilderTbuildProcessingNode6MrnINodeInfo__pnIOutPoint__ (ce2700, 2b866a0, 4269c70, 4269c98, 2, 2b866ac) + 14b0
00115f84 __1cQProcessorBuilderRconnectSuccessors6MrnINodeInfo_pnHInPoint__v_ (ce2700, 2b86630, 4269ce0, 2c25f00, 3cb8968, 7e04a0) + c4
00115650 __1cQProcessorBuilderTbuildProcessingNode6MrnINodeInfo__pnIOutPoint__ (ce2700, 2b86630, 4269ce0, 4269d08, 1, 2b8663c) + 14b0
00115b88 __1cQProcessorBuilderRconnectSuccessors6MrnINodeInfo_pnHInPoint_rnURWTPtrHashDictionary4nJRWCString_nIOutPoint____v_ (ce2700, 6da800, 2bd45a0, fcdfb160, 3cb8958, 7e04a0) + 168
00111db4 __1cQProcessorBuilderKbuildChain6MrnLRWTPtrSlist4nINodeInfo___pnURWTPtrHashDictionary4nJRWCString_nJPointTree___pnLRWTPtrSlist4nFPoint___pnPProcessorThread_b_v_ (ce2728, ce2788, ce2748, 2bd45a0, fcdfb2f0, ce2768) + 414
00144e90 __1cPProcessorThreadKbuildChain6MrnLRWTPtrSlist4nINodeInfo___b_i_ (4070100, fcdfb2ec, 0, 0, 6f6400, 1) + 30
0031e00c __1cSComponentFrameworkKbuildChain6MrnLRWTPtrSlist4nINodeInfo___b_v_ (20446a0, fcdfb2ec, 2044724, 4070100, 0, 3cb8890) + 10c
0031d7dc __1cSComponentFrameworkOconfigurePaths6MrnIDataUnit_brnLRWTPtrSlist4nINodeInfo___4_v_ (fcdfbb70, 2b86668, 2b86658, fcdfb2ec, 3cb8a90, 20446a0) + 65c
0031f4f0 __1cSComponentFrameworkOprocessMessage6MrnIDataUnit__v_ (1, 2a50078, 20446a0, fcdfbb70, fcdfbb80, 2) + 11b0
0010eeec __1cSProcessorFrameworkOprocessMessage6MrnIDataUnit__v_ (4611e0, 2a50078, 20446a0, 0, 2bfde50, 2) + bec
0033e550 __1cIIfClientEmain6M_v_ (20446a0, 0, 2a50078, 33ef00, 20446b8, 20446c8) + 270
004225a4 __1cMActiveObjectLexecuteMain6Fp0pv_2_ (20446a0, 1c25248, 7154fc, 421560, 7154fc, 33e2e0) + 44
00420074 __1cRSolarisThreadCoreLstartThread6FpnNSolarisThread__pv_ (1c2bbc0, fcdfc000, 0, 0, 84e840, 73f400) + 34
fe9c47a8 lwpstart (0, 0, 0, 0, 0, 0)soumikinthesun wrote:
Yes I am using OCI driver. But can you tell me where is the problem using OCI driver?Nope.
If you want to spend the time then you do the following.
1. Reduce the code to the point where you have a small example that fails
2. Make a bug report to Oracle.
If you want a solution, since waiting on a Oracle fix is unlikely to be something that you can do (unless you have a service contract and they state that they will fix it) then do one of the following.
1. Use the thin driver, not the OCI one.
2. Use a different version of the OCI driver
3. Determine exactly where the problem occurs and find a different way to structure the code (java and SQL) so the error does not occur.
I don't think my system is corrupted because the core is comming in customer machine as well as our test machine.
That doesn't completely eliminate the possibility but it does make it much less likely.
we are getting core from libjvm.so , so I think it is not the crash of oracle VM. It is the crash of SUN VM
what do you think?The Oracle and Sun VMs are completely different applications. They are your applications so I can't tell you what you are running. The Oracle VM would, normally, be used for embedded java procs in the database itself. And if you are using OCI in that code then you are doing it wrong. -
JVM crashes on solaris while connecting to Oracle
I am using:
weblogic 5.1
Oracle 8.1.6
OCI driver
JDBC 2.0 (need to use BLOB type)
It is a simple test program that runs on the NT successfully.
When I run the same code on solaris, I got a core dump:
LD_LIBRARY_PATH=:/usr/local/weblogic/weblogic/lib/solaris:/usr/local/weblogic/weblogic/lib/solaris/oci816_8:/export/home/oracle8/lib:/export/home/oracle8/lib/libocijdbc8.so
I guess that this is core dump thrown by C code in either
of weblogic or orical client native code. The LD_LIBRARY_PATH
is set as above, did I miss anything there?
Is there anything else that I should set?
Thanks a lot for your advice,
Jian
-------------------------- core dump
SIGSEGV 11 segmentation violation
si_signo [11]: SEGV
si_errno [0]:
si_code [1]: SEGV_MAPERR [addr: 0x8]
stackpointer=FFBED1A0
Exiting Thread (sys_thread_t:0xff343db0) : no stack
"Finalizer" (TID:0x155e98, sys_thread_t:0x155dd0, state:CW, thread_t: t@6, threadID:0xfe3c1d78,
stack_bottom:0xfe3c2000, stack_size:0x20000) prio=8
[1] java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:146)
[2] java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:168)
[3] java.lang.ref.Finalizer$FinalizerWorker$FinalizerThread.run(Finalizer.java:124)
"Reference Handler" (TID:0x1506a0, sys_thread_t:0x1505d8, state:CW, thread_t:
t@5, threadID:0xfe3f1d78, stack_bottom:0xfe3f2000, stack_size:0x20000) prio=10
[1] java.lang.Object.wait(Object.java:424)
[2] java.lang.ref.Reference$ReferenceHandler.run(Reference.java:130)
"Signal dispatcher" (TID:0x13b658, sys_thread_t:0x13b590, state:MW, thread_t:
t@4, threadID:0xfec71d78, stack_bottom:0xfec72000, stack_size:0x20000) prio=10
"main" (TID:0x38c10, sys_thread_t:0x38b48, state:R, thread_t: t@1, threadID:0x25228,
stack_bottom:0xffbf0000, stack_size:0x800000) prio=5 current thread
[1] weblogic.db.oci.OciCursor.execAndFetch(Native Method)
[2] weblogic.db.oci.OciCursor.oci_execAndFetch(OciCursor.java:1843)
[3] weblogic.jdbcbase.oci.Statement.executeQuery(Statement.java:904)
[4] com.agf.profile.test.BlobTest.main(BlobTest.java:10)
Abort - core dumpedHi jian,
You have to have same client version , that will be the reason why you see
the crash. ( the oracle client version and the OCI###_8 should match )
sree
"jian zhang" <[email protected]> wrote in message
news:[email protected]...
Sree,
"Sree Bodapati" <[email protected]> wrote:
Hi jian
Will it be possible for you to post your test code here?I attached the source code to this email.
>
Also make sure the client libraries / oracle client installation on your
solaris machine is Oracle 8.1.6.It is a good point. Actually the client version
is 8.1.7. But it should be ok, right?
Thanks,
Jian
>
sree
"jian zhang" <[email protected]> wrote in message
news:[email protected]...
I am using:
weblogic 5.1
Oracle 8.1.6
OCI driver
JDBC 2.0 (need to use BLOB type)
It is a simple test program that runs on the NT successfully.
When I run the same code on solaris, I got a core dump:
LD_LIBRARY_PATH=:/usr/local/weblogic/weblogic/lib/solaris:/usr/local/weblogi
c/weblogic/lib/solaris/oci816_8:/export/home/oracle8/lib:/export/home/oracle
8/lib/libocijdbc8.so
I guess that this is core dump thrown by C code in either
of weblogic or orical client native code. The LD_LIBRARY_PATH
is set as above, did I miss anything there?
Is there anything else that I should set?
Thanks a lot for your advice,
Jian
-------------------------- core dump
SIGSEGV 11 segmentation violation
si_signo [11]: SEGV
si_errno [0]:
si_code [1]: SEGV_MAPERR [addr: 0x8]
stackpointer=FFBED1A0
Exiting Thread (sys_thread_t:0xff343db0) : no stack
"Finalizer" (TID:0x155e98, sys_thread_t:0x155dd0, state:CW, thread_t:
t@6,
threadID:0xfe3c1d78,
stack_bottom:0xfe3c2000, stack_size:0x20000) prio=8
[1] java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:146)
[2] java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:168)
[3]
java.lang.ref.Finalizer$FinalizerWorker$FinalizerThread.run(Finalizer.java:1
24)
"Reference Handler" (TID:0x1506a0, sys_thread_t:0x1505d8, state:CW,
thread_t:
t@5, threadID:0xfe3f1d78, stack_bottom:0xfe3f2000, stack_size:0x20000)
prio=10
[1] java.lang.Object.wait(Object.java:424)
[2] java.lang.ref.Reference$ReferenceHandler.run(Reference.java:130)
"Signal dispatcher" (TID:0x13b658, sys_thread_t:0x13b590, state:MW,
thread_t:
t@4, threadID:0xfec71d78, stack_bottom:0xfec72000, stack_size:0x20000)
prio=10
"main" (TID:0x38c10, sys_thread_t:0x38b48, state:R, thread_t: t@1,
threadID:0x25228,
stack_bottom:0xffbf0000, stack_size:0x800000) prio=5 current thread
[1] weblogic.db.oci.OciCursor.execAndFetch(Native Method)
[2] weblogic.db.oci.OciCursor.oci_execAndFetch(OciCursor.java:1843)
[3] weblogic.jdbcbase.oci.Statement.executeQuery(Statement.java:904)
[4] com.agf.profile.test.BlobTest.main(BlobTest.java:10)
Abort - core dumped -
Hello everyone,
I am seeing this error when running an app on Solaris.
HotSpot Virtual Machine Error, Internal Error
Please report this error at http://java.sun.com/cgi-bin/bugreport.cgi
Error ID: 53414645504F494E540E4350500366 01
Problematic Thread: prio=5 tid=0x30e320 nid=0x4 runnable
I am using this java version :
"1.3.1_04"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.3.1_04-b02)
Java HotSpot(TM) Client VM (build 1.3.1_04-b02, mixed mode)
Has anyone seen this error or has any info on this?
ThanksOn Solaris 8 using
java version "1.3.1_03"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.3.1_03-b03)
Java HotSpot(TM) Client VM (build 1.3.1_03-b03, mixed mode)
# HotSpot Virtual Machine Error, Internal Error
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
# Error ID: 53414645504F494E540E4350500366 01
# Problematic Thread: prio=5 tid=0xbb818 nid=0x4 runnable
I was testing to see if I had a bug in my application that causes too many file descriptors to be created. But this might as well have nothing to do with it... It never happened before when I ran out of file descriptors.
Kind regards,
/Sigiswald -
Hello,
The JVM crashed in one of our Solaris production environments. The cause of the crash appears to be the HotSpot compiler. It seems that the JVM was trying to compile frequently used code and then it crashed. I have checked the forums and I found one other message with the same Internal Error ID. However, in that message, it is suggested that the JVM itself is running out of C malloc space (http://forum.java.sun.com/thread.jspa?forumID=37&threadID=5127551).
I have verified that the JVM was not running out of memory when it crashed. There was over 9 GB of swap and physical memory available to the JVM when the crash happened.
Below are the contents of the hs_err_pid file.
# An unexpected error has been detected by HotSpot Virtual Machine:
# Internal Error (434F44452255464645520E4350500060 01), pid=2355, tid=13
# Java VM: Java HotSpot(TM) Server VM (1.5.0_07-b03 mixed mode)
--------------- T H R E A D ---------------
Current thread (0x0017fcb8): JavaThread "CompilerThread0" daemon [_thread_in_native, id=13]
Stack: [0xa2300000,0xa2380000), sp=0xa237e370, free space=504k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x6f5644]
V [libjvm.so+0x4369b0]
V [libjvm.so+0x1b5140]
V [libjvm.so+0x21b8b0]
V [libjvm.so+0x227b70]
V [libjvm.so+0x224ce4]
V [libjvm.so+0x21ab78]
V [libjvm.so+0x282d78]
V [libjvm.so+0x278d04]
V [libjvm.so+0x2799c0]
V [libjvm.so+0x336548]
V [libjvm.so+0x2deae8]
V [libjvm.so+0x6691b0]
Current CompileTask:
opto:4113 gov.nist.javax.sip.stack.SIPDialog.setLastResponse(Lgov/nist/javax/sip/stack/SIPTransaction;Lgov/nist/javax/sip/message/SIPResponse;)V (954 bytes)
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x01a70548 JavaThread "RMI ConnectionExpiration-[90.0.64.65:49888]" daemon [_thread_blocked, id=121153]
0x01d8a5e0 JavaThread "RMI RenewClean-[90.0.64.65:49888]" daemon [_thread_blocked, id=5835]
0x005433e0 JavaThread "Thread-29" [_thread_in_native, id=1227]
0x0110a820 JavaThread "Thread-30" [_thread_blocked, id=1226]
0x016d2ae8 JavaThread "RMI RenewClean-[90.0.64.64:32827]" daemon [_thread_blocked, id=167]
0x00d31a28 JavaThread "UDPMessageChannelThread" daemon [_thread_blocked, id=120]
0x0151a1a8 JavaThread "UDPMessageProcessorThread" daemon [_thread_in_native, id=119]
0x01519f38 JavaThread "MitelTCPServer" [_thread_in_native, id=118]
0x00f1ced8 JavaThread "MitelTCPHandler" [_thread_in_native, id=117]
0x00f1d478 JavaThread "MinetEncryptedServer" [_thread_blocked, id=116]
0x00f1afb8 JavaThread "JainMgcpStackImpl" [_thread_in_native, id=115]
0x0079baf0 JavaThread "Thread-24" daemon [_thread_blocked, id=113]
0x00d22018 JavaThread "Thread-20" daemon [_thread_blocked, id=111]
0x00d21e50 JavaThread "Thread-18" daemon [_thread_blocked, id=110]
0x008e4090 JavaThread "Thread-15" [_thread_in_native, id=73]
0x01069af8 JavaThread "Thread-16" [_thread_blocked, id=72]
0x010e5720 JavaThread "Thread-14" [_thread_blocked, id=69]
0x000388d8 JavaThread "DestroyJavaVM" [_thread_blocked, id=1]
0x01e6b3b0 JavaThread "RTSEngine Watchdog" [_thread_blocked, id=68]
0x007826e0 JavaThread "RTSEngine" [_thread_in_Java, id=67]
0x00be1cd8 JavaThread "DBEngine Watchdog" [_thread_blocked, id=66]
0x00bdde38 JavaThread "DBEngine" [_thread_blocked, id=65]
0x00fc8a08 JavaThread "DefaultDomain:class=SnmpV3AdaptorServer,protocol=snmp,port=8163" [_thread_in_native, id=63]
0x00605e60 JavaThread "DefaultDomain:class=HtmlAdaptorServer,protocol=html,port=9001" [_thread_in_native, id=62]
0x001f98a0 JavaThread "CDR Processor" [_thread_blocked, id=61]
0x00fcb680 JavaThread "Python Server" [_thread_in_native, id=60]
0x00a15bc0 JavaThread "CDR File Manager" [_thread_blocked, id=59]
0x00542bb0 JavaThread "MemoryLogger" [_thread_blocked, id=58]
0x00541d20 JavaThread "Globals Executioner" [_thread_blocked, id=57]
0x00a16068 JavaThread "Remote Command Executioner" [_thread_blocked, id=56]
0x0157ab78 JavaThread "CallpAuditor" [_thread_blocked, id=55]
0x00664068 JavaThread "VACommClient" [_thread_blocked, id=54]
0x003f34e0 JavaThread "Thread-11" [_thread_blocked, id=50]
0x005844a8 JavaThread "Thread-10" daemon [_thread_blocked, id=34]
0x00f95e60 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=32]
0x010821f0 JavaThread "GC Daemon" daemon [_thread_blocked, id=30]
0x00587928 JavaThread "RMI Reaper" [_thread_blocked, id=29]
0x015fd208 JavaThread "Timer-3" [_thread_blocked, id=28]
0x009b4200 JavaThread "EventScannerThread" [_thread_blocked, id=27]
0x006df418 JavaThread "Timer-2" [_thread_blocked, id=26]
0x0051d958 JavaThread "MemoryHandlerEx" [_thread_blocked, id=20]
0x0035cef8 JavaThread "RMI TCP Accept-4003" daemon [_thread_in_native, id=18]
0x00357d70 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=17]
0x003555c8 JavaThread "Timer-0" daemon [_thread_blocked, id=16]
0x00181d90 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=15]
0x00180c10 JavaThread "CompilerThread1" daemon [_thread_blocked, id=14]
=>0x0017fcb8 JavaThread "CompilerThread0" daemon [_thread_in_native, id=13]
0x0017e370 JavaThread "AdapterThread" daemon [_thread_blocked, id=12]
0x0017d1e8 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=11]
0x0017c118 JavaThread "JDWP Event Helper Thread" daemon [_thread_blocked, id=10]
0x00174030 JavaThread "JDWP Transport Listener: dt_socket" daemon [_thread_in_native, id=9]
0x00171420 JavaThread "Surrogate Locker Thread (CMS)" daemon [_thread_blocked, id=8]
0x00164aa8 JavaThread "Finalizer" daemon [_thread_blocked, id=7]
0x00164568 JavaThread "Reference Handler" daemon [_thread_blocked, id=6]
Other Threads:
0x00162488 VMThread [id=5]
0x003b28f0 WatcherThread [id=19]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
par new generation total 7424K, used 3798K [0xa5800000, 0xa6000000, 0xa6000000)
eden space 6656K, 45% used [0xa5800000, 0xa5af5b48, 0xa5e80000)
from space 768K, 100% used [0xa5e80000, 0xa5f40000, 0xa5f40000)
to space 768K, 0% used [0xa5f40000, 0xa5f40000, 0xa6000000)
concurrent mark-sweep generation total 1220608K, used 354273K [0xa6000000, 0xf0800000, 0xf0800000)
concurrent-mark-sweep perm gen total 46400K, used 27804K [0xf0800000, 0xf3550000, 0xf8800000)
Dynamic libraries:
0x00010000 /usr/jdk1.5.0_07/bin/java
0xff370000 /usr/lib/libthread.so.1
0xff3fa000 /usr/lib/libdl.so.1
0xff280000 /usr/lib/libc.so.1
0xff3a0000 /usr/platform/SUNW,Sun-Fire-V240/lib/libc_psr.so.1
0xfe800000 /usr/jdk1.5.0_07/jre/lib/sparc/server/libjvm.so
0xff240000 /usr/lib/libsocket.so.1
0xff220000 /usr/lib/libsched.so.1
0xff1f0000 /usr/lib/libCrun.so.1
0xff1a0000 /usr/lib/libm.so.1
0xff080000 /usr/lib/libnsl.so.1
0xff170000 /usr/lib/libmp.so.2
0xff050000 /usr/jdk1.5.0_07/jre/lib/sparc/native_threads/libhpi.so
0xfe7b0000 /usr/jdk1.5.0_07/jre/lib/sparc/libjdwp.so
0xfe770000 /usr/jdk1.5.0_07/jre/lib/sparc/libverify.so
0xfe720000 /usr/jdk1.5.0_07/jre/lib/sparc/libjava.so
0xfe700000 /usr/jdk1.5.0_07/jre/lib/sparc/libzip.so
0xfbfb0000 /usr/lib/locale/en_US.ISO8859-1/en_US.ISO8859-1.so.2
0xfbf90000 /usr/jdk1.5.0_07/jre/lib/sparc/libdt_socket.so
0xfbee0000 /usr/lib/nss_files.so.1
0xfbec0000 /usr/jdk1.5.0_07/jre/lib/sparc/libmanagement.so
0xfbdd0000 /usr/jdk1.5.0_07/jre/lib/sparc/libnet.so
0xf8ab0000 /usr/jdk1.5.0_07/jre/lib/sparc/libnio.so
0xf8a90000 /usr/lib/librt.so.1
0xf8860000 /usr/lib/libaio.so.1
0xf8840000 /usr/lib/libmd5.so.1
0xf8820000 /usr/lib/libsendfile.so.1
0xa57e0000 /usr/jdk1.5.0_07/jre/lib/sparc/librmi.so
0x9dc00000 /nci/vks.2.0.9.0.1/callp/libmgcpca.so.3.0.0.0.0
0xa5690000 /usr/local/lib/libstdc++.so.2.10.0
VM Arguments:
jvm_args: -XX:+UseISM -Xms1200m -Xmx1200m -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -XX:+CMSIncrementalPacing -XX:+CMSPermGenSweepingEnabled -XX:+CMSClassUnloadingEnabled -XX:+CMSParallelRemarkEnabled -XX:+DisableExplicitGC -XX:MaxPermSize=128m -XX:SurvivorRatio=8 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:-TraceClassUnloading -Xdebug -Xnoagent -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=4001 -Dcom.sun.management.jmxremote.port=4003 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.password.file=/nci/vks/callp/jmxremote.password -Dnci.callp.state=2
java_command: com.nci.callp.MainApplication
Launcher Type: SUN_STANDARD
Environment Variables:
JAVA_HOME=/usr/java
CLASSPATH=:/usr/java/lib/tools.jar:/usr/java/jre/lib/rt.jar:.:/nci/vks/lib/bitlib.jar:/nci/vks/lib/nist.jar:/nci/vks/lib/antlrall.jar:/nci/vks/lib/common.jar:/nci/vks/lib/jconn2.jar:/nci/vks/callp/callp.jar:/nci/vks/callp/lib/3comlib.jar:/nci/vks/callp/lib/jcert.jar:/nci/vks/callp/lib/jnet.jar:/nci/vks/callp/lib/jsse.jar:/nci/vks/callp/lib/mitellib.jar:/nci/vks/mediaserver/mediaserver.jar:/nci/vks/snmp/snmp.jar:/nci/vks/snmp/lib/solaris/jdmkrt.jar:/nci/vks/snmp/lib/solaris/jdmktk.jar:/nci/vks/snmp/lib/solaris/jsnmpapi.jar:/nci/vks/auditor/auditor.jar:.:/nci/vks/lib/bitlib.jar:/nci/vks/lib/nist.jar:/nci/vks/lib/antlrall.jar:/nci/vks/lib/common.jar:/nci/vks/lib/jconn2.jar:/vks_shared/callp/resources:/nci/vks/callp/callp.jar:/nci/vks/callp/lib/3comlib.jar:/nci/vks/callp/lib/jcert.jar:/nci/vks/callp/lib/jnet.jar:/nci/vks/callp/lib/jsse.jar:/nci/vks/callp/lib/mitellib.jar:/nci/vks/callp/lib/cpl.jar:/nci/vks/callp/lib/asbsdk.jar:/nci/vks/mediaserver/mediaserver.jar:/nci/vks/snmp/snmp.jar:/nci/vks/snmp/lib/solaris/jdmkrt.jar:/nci/vks/snmp/lib/solaris/jdmktk.jar:/nci/vks/snmp/lib/solaris/jsnmpapi.jar:/nci/vks/lib/commons-collections-3.0.jar:/nci/vks/lib/commons-lang-2.0.jar:/nci/vks/lib/jython.jar:/nci/vks/lib/castor-0.9.7.jar:/usr/java/lib/tools.jar:/nci/vks/lib/commons-logging-1.0.3.jar://nci/vks/lib/common.nist.jar://nci/vks/lib/concurrent.jar://nci/vks/lib/log4j-1.2.8.jar
PATH=/nci/sybase/SYBSsa9/bin32:/nci/sybase/shared9/sybcentral43:/usr/sbin:/usr/bin:/nci/sybase/SYBSsa9/bin:/usr/sbin:/opt/SUNWcgha/sbin:/nci/vks/bin:/usr/local/bin:/usr/ccs/bin:/opt/SUNWcgha/sbin:/nci/mysql/bin
LD_LIBRARY_PATH=/usr/jdk1.5.0_07/jre/lib/sparc/server:/usr/jdk1.5.0_07/jre/lib/sparc:/usr/jdk1.5.0_07/jre/../lib/sparc:/nci/sybase/SYBSsa9/lib32:/nci/sybase/SYBSsa9/lib64:/nci/sybase/SYBSsa9/jre142/lib/sparc/client:/nci/sybase/SYBSsa9/jre142/lib/sparc:/nci/sybase/SYBSsa9/jre142/lib/sparc/native_threads:/nci/sybase/SYBSsa9/drivers/lib::/usr/lib:/nci/sybase/SYBSsa9/lib:/usr/local/lib
SHELL=/usr/bin/bash
HOSTTYPE=sparc
OSTYPE=solaris2.9
MACHTYPE=sparc-sun-solaris2.9
Signal Handlers:
SIGSEGV: [libjvm.so+0x6f60b8], sa_mask[0]=0x7fbffeff, sa_flags=0x00000004
SIGBUS: [libjvm.so+0x6f60b8], sa_mask[0]=0x7fbffeff, sa_flags=0x00000004
SIGFPE: [libjvm.so+0x276398], sa_mask[0]=0x7fbffeff, sa_flags=0x0000000c
SIGPIPE: [libjvm.so+0x276398], sa_mask[0]=0x7fbffeff, sa_flags=0x0000000c
SIGILL: [libjvm.so+0x276398], sa_mask[0]=0x7fbffeff, sa_flags=0x0000000c
SIGUSR1: [libjvm.so+0x66b714], sa_mask[0]=0x00000000, sa_flags=0x00000008
SIGUSR2: [libjvm.so+0x276398], sa_mask[0]=0x7fbffeff, sa_flags=0x0000000c
SIGHUP: [libjvm.so+0x66a38c], sa_mask[0]=0x7fbffeff, sa_flags=0x00000004
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: [libjvm.so+0x66a38c], sa_mask[0]=0x7fbffeff, sa_flags=0x00000004
SIGTERM: [libjvm.so+0x66a38c], sa_mask[0]=0x7fbffeff, sa_flags=0x00000004
--------------- S Y S T E M ---------------
OS: Solaris 9 9/04 s9s_u7wos_09 SPARC
Copyright 2004 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 29 June 2004
uname:SunOS 5.9 Generic_118558-28 sun4u (T2 libthread)
rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity
load average:0.49 0.59 0.61
CPU:total 2 has_v8, has_v9, has_vis1, has_vis2, is_ultra3
Memory: 8k page, physical 4194304k(839536k free)
vm_info: Java HotSpot(TM) Server VM (1.5.0_07-b03) for solaris-sparc, built on May 3 2006 01:22:35 by unknown with unknown Workshop:0x5500x00181d90 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=15]
0x00180c10 JavaThread "CompilerThread1" daemon [_thread_blocked, id=14]
=>0x0017fcb8 JavaThread "CompilerThread0" daemon [_thread_in_native, id=13]
0x0017e370 JavaThread "AdapterThread" daemon [_thread_blocked, id=12]
0x0017d1e8 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=11]upgrade ur java to 1.5u11, this may solve the problem
the application is crashing in compiler thread.
the easiest workaround is to use -server or -client (vice versa) and check with which option your application doesn't crash. -
JVM crash for weblogic8.1 running on solaris and JDK1.4.2_05
Hi,
I am an administrator of weblogic8.1 server platfrom running solaris8.1 There are 2 managed server runs on 2 solaris unix box and admin server run on a third solaris unix box. Since last couple of days, weblogic server crashing everyday creating a core file and hs_err_pidxxxx.log, on each manage server.Below is the content of hs_err_pidxxxx.log.
Unexpected Signal : 11 occurred at PC=0xFE1CBCAC
Function=[Unknown. Nearest: JVM_FillInStackTrace+0x4CE4]
Library=/bea/jdk142_05/jre/lib/sparc/server/libjvm.so
Current Java thread:
Dynamic libraries:
0x10000 /bea/jdk142_05/bin/java
0xff360000 /usr/lib/libthread.so.1
0xff3a0000 /usr/lib/libdl.so.1
0xff200000 /usr/lib/libc.so.1
0xff340000 /usr/platform/SUNW,Sun-Fire-V240/lib/libc_psr.so.1
0xfe000000 /bea/jdk142_05/jre/lib/sparc/server/libjvm.so
0xff2e0000 /usr/lib/libCrun.so.1
0xff1e0000 /usr/lib/libsocket.so.1
0xff100000 /usr/lib/libnsl.so.1
0xff0d0000 /usr/lib/libm.so.1
0xff1c0000 /usr/lib/libsched.so.1
0xff310000 /usr/lib/libw.so.1
0xff0a0000 /usr/lib/libmp.so.2
0xff070000 /bea/jdk142_05/jre/lib/sparc/native_threads/libhpi.so
0xff050000 /usr/lib/nss_files.so.1
0xfe7d0000 /bea/jdk142_05/jre/lib/sparc/libverify.so
0xfe790000 /bea/jdk142_05/jre/lib/sparc/libjava.so
0xfe770000 /bea/jdk142_05/jre/lib/sparc/libzip.so
0xf94a0000 /osmf/i3/i3v7/products/j2ee/lib/libPreciseLog.so
0xf9480000 /usr/lib/libpthread.so.1
0xf9460000 /usr/lib/libkstat.so.1
0xa9050000 /bea/jdk142_05/jre/lib/sparc/libnet.so
0xa9290000 /usr/lib/nss_dns.so.1
0xa8db0000 /usr/lib/libresolv.so.2
0xa9030000 /bea/weblogic814/server/lib/solaris/libmuxer.so
0xa8b60000 /usr/ucblib/libucb.so.1
0xa8b20000 /usr/lib/libelf.so.1
0xa8d90000 /bea/jdk142_05/jre/lib/sparc/libnio.so
0xa8a60000 /usr/lib/librt.so.1
0xa8920000 /usr/lib/libaio.so.1
0xa8900000 /usr/lib/libsendfile.so.1
0xa83e0000 /bea/jdk142_05/jre/lib/sparc/libioser12.so
Heap at VM Abort:
Heap
def new generation total 339264K, used 293091K [0xa9400000, 0xbe950000, 0xbe950000)
eden space 329024K, 87% used [0xa9400000, 0xbac61f00, 0xbd550000)
from space 10240K, 58% used [0xbd550000, 0xbdb26ea0, 0xbdf50000)
to space 10240K, 0% used [0xbdf50000, 0xbdf50000, 0xbe950000)
tenured generation total 699072K, used 204153K [0xbe950000, 0xe9400000, 0xe9400000)
the space 699072K, 29% used [0xbe950000, 0xcb0ae7f8, 0xcb0ae800, 0xe9400000)
compacting perm gen total 65024K, used 64974K [0xe9400000, 0xed380000, 0xf9400000)
the space 65024K, 99% used [0xe9400000, 0xed373a30, 0xed373c00, 0xed380000)
Local Time = Mon Nov 20 13:17:55 2006
Elapsed Time = 150397
# HotSpot Virtual Machine Error : 11
# Error ID : 4F530E43505002EF 01
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
# Java VM: Java HotSpot(TM) Server VM (1.4.2_05-b04 mixed mode)
any idea?Hi Jitesh
JVM crash could be because of any code, it could be weblogic or your own application or a bug in JDK itself.
1) You can run tools like GDB on the core file which will indicate the source of the crash.
From the stack it looks like a Sun JDK bug
2) Search on sun for this error code shows some known bugs. Checkout http://onesearch.sun.com/search/onesearch/index.jsp?charset=utf-8&col=developer-debugging&qt=4F530E43505002EF+01&rt=true&cs=false
3) You can also upgrade the JVM to the latest version of 1.4.2. I believe you have 1.4.2_05
Vimala- -
Solaris 10, amd64, JVM crash at short time after startup
Hi All,
I have an application which allocate 10G of memory for his Heap, run on 4 dual core amd64 CPUs, 16G RAM machine and crash in 98% of the cases at short time after startup. This is a customer machine.
I have a similar machine for tests with only 2 dual core amd64 CPU and 12G RAM and I don't experience any crashes running application with similar configuration, similar version of JDK and similar input data.
I have tried with different GC algorithms, but we obtain crashes sonner or later. I rare cases when application manage to start seems that CMS offer the greatest performance.
There is a bug in JVM? Knows anybody an workaround for this?
# An unexpected error has been detected by Java Runtime Environment:
# SIGSEGV (0xb) at pc=0xfffffd7ffebbdb33, pid=21678, tid=5
# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.6.0_03-b05 mixed mode)
# Problematic frame:
# V [libjvm.so+0x5bdb33]
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
--------------- T H R E A D ---------------
Current thread (0x000000000042e000): GCTaskThread [id=5]
siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x00000000000000a8
Registers:
RAX=0x0000000000000000, RBX=0x0000000000000002, RCX=0x0000000000000000, RDX=0x0000000000000000
RSP=0xfffffd7ffad37800, RBP=0xfffffd7ffad37830, RSI=0x0000000000000000, RDI=0x00000000004e6790
, R8=0x0000000000000000, R9=0x0000000000000002, R10=0x0000000000000000, R11=0xfffffd7d7bddd058, R12=0x00000000004e6790, R13=0x0000000000000000, R14=0x0000000000000000, R15=0x0000000000429650
RIP=0xfffffd7ffebbdb33, RFLAGS=0x0000000000010246
Top of Stack: (sp=0xfffffd7ffad37800)
0xfffffd7ffad37800: fffffd7fff1051c8 000000000042a1f0
0xfffffd7ffad37810: fffffd7d72bd05a0 0000000000000000
0xfffffd7ffad37820: fffffd7d72bd05a0 0000000000000001
0xfffffd7ffad37830: fffffd7ffad37840 fffffd7ffebcfdd1
0xfffffd7ffad37840: fffffd7ffad37cc0 fffffd7ffee8953b
0xfffffd7ffad37850: fffffd7d72bd05a0 0000000000000001
0xfffffd7ffad37860: 000000000042a370 000000000042e000
0xfffffd7ffad37870: 0000000000000002 0000000000000000
0xfffffd7ffad37880: 0000000000000000 0000000000422e80
0xfffffd7ffad37890: 000000000042c120 000000000042e320
0xfffffd7ffad378a0: 000000000042e330 000000000042e708
0xfffffd7ffad378b0: 000000000042e000 0000000000424180
0xfffffd7ffad378c0: 000000000042e720 000000000042e730
0xfffffd7ffad378d0: 000000000042eb08 00000000004241c0
0xfffffd7ffad378e0: 00000000004224a0 0000000000000000
0xfffffd7ffad378f0: 0000000000000000 0000000000000000
0xfffffd7ffad37900: 0000000000000000 0000000000000400
0xfffffd7ffad37910: fffffd7d7a92c5f8 fffffd7d7a92c5f8
0xfffffd7ffad37920: fffffd7d7a92c5f8 fffffd7d7a92c5f8
0xfffffd7ffad37930: 0000000000000000 0000000000000000
0xfffffd7ffad37940: 0000000000000000 0000000000038800
0xfffffd7ffad37950: 0000000000000479 0000000000000000
0xfffffd7ffad37960: 0000000000000000 0000000000000000
0xfffffd7ffad37970: 0000000000000000 fffffd7ffad37b10
0xfffffd7ffad37980: fffffd7ffad37b58 fffffd7ffad37ba0
0xfffffd7ffad37990: fffffd7ffad37c30 0000000000430240
0xfffffd7ffad379a0: 0000000000429650 fffffd7d7a930000
0xfffffd7ffad379b0: 000000026ed7667f 0000000000000000
0xfffffd7ffad379c0: 000000000003a890 0000000000000000
0xfffffd7ffad379d0: 0000000000000000 0000000000000000
0xfffffd7ffad379e0: 0000000000000000 0000000000000000
0xfffffd7ffad379f0: 0000000000000000 0000000000000000
Instructions: (pc=0xfffffd7ffebbdb33)
0xfffffd7ffebbdb23: 24 20 4c 8b 44 24 20 4d 89 03 eb 18 4d 8b 43 08
0xfffffd7ffebbdb33: 4d 8b 80 a8 00 00 00 4c 89 44 24 28 4c 8b 44 24
Stack: [0x0000000000000000,0x0000000000000000), sp=0xfffffd7ffad37800, free space=1610527966k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x5bdb33]
V [libjvm.so+0x5cfdd1]
V [libjvm.so+0x88953b]
V [libjvm.so+0x98e8a6]
V [libjvm.so+0x98e799]
V [libjvm.so+0x87b18c]
C [libc.so.1+0xcb34b] thrslot_offset+0x31b
C [libc.so.1+0xcb580] thrslot_offset+0x550
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x0000000000a6b400 JavaThread "Timer-0" [_thread_blocked, id=19]
0x0000000000743400 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=17]
0x0000000000742000 JavaThread "CompilerThread1" daemon [_thread_blocked, id=16]
0x0000000000740c00 JavaThread "CompilerThread0" daemon [_thread_blocked, id=15]
0x000000000072c400 JavaThread "JDWP Event Helper Thread" daemon [_thread_blocked, id=14]
0x0000000000729800 JavaThread "JDWP Transport Listener: dt_socket" daemon [_thread_in_native, id=13]
0x000000000071c400 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=12]
0x000000000071b800 JavaThread "Surrogate Locker Thread (CMS)" daemon [_thread_blocked, id=11]
0x00000000006f3000 JavaThread "Finalizer" daemon [_thread_blocked, id=10]
0x00000000006f2800 JavaThread "Reference Handler" daemon [_thread_blocked, id=9]
0x0000000000428400 JavaThread "main" [_thread_blocked, id=2]
Other Threads:
0x00000000006ee400 VMThread [id=8]
0x0000000000744c00 WatcherThread [id=18]
VM state:at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x00000000004273a0/0x0000000000427400] Threads_lock - owner thread: 0x00000000006ee400
[0x0000000000423500/0x0000000000427b10] Heap_lock - owner thread: 0x0000000000428400
Heap
par new generation total 74560K, used 63936K [0xfffffd7d75600000, 0xfffffd7d7a930000, 0xfffffd7d7a930000)
eden space 63936K, 100% used [0xfffffd7d75600000, 0xfffffd7d79470000, 0xfffffd7d79470000)
from space 10624K, 0% used [0xfffffd7d79470000, 0xfffffd7d79470000, 0xfffffd7d79ed0000)
to space 10624K, 100% used [0xfffffd7d79ed0000, 0xfffffd7d7a930000, 0xfffffd7d7a930000)
concurrent mark-sweep generation total 10400576K, used 29146K [0xfffffd7d7a930000, 0xfffffd7ff5600000, 0xfffffd7ff5600000)
concurrent-mark-sweep perm gen total 21248K, used 6589K [0xfffffd7ff5600000, 0xfffffd7ff6ac0000, 0xfffffd7ffaa00000)
Dynamic libraries:
0x0000000000400000 /export/home/tg/jre1.6.0_03/bin/amd64/java
0xfffffd7fff380000 /lib/64/libthread.so.1
0xfffffd7fff360000 /export/home/tg/jre1.6.0_03/bin/amd64/../../lib/amd64/jli/libjli.so
0xfffffd7fff390000 /lib/64/libdl.so.1
0xfffffd7fff240000 /lib/64/libc.so.1
0xfffffd7ffe600000 /export/home/tg/jre1.6.0_03/lib/amd64/server/libjvm.so
0xfffffd7fff1e0000 /lib/64/libsocket.so.1
0xfffffd7fff340000 /usr/lib/64/libsched.so.1
0xfffffd7fff1a0000 /lib/64/libm.so.1
0xfffffd7fff170000 /usr/lib/64/libCrun.so.1
0xfffffd7fff140000 /lib/64/libdoor.so.1
0xfffffd7ffe530000 /lib/64/libnsl.so.1
0xfffffd7ffe4b0000 /lib/64/libm.so.2
0xfffffd7ffe470000 /lib/64/libscf.so.1
0xfffffd7ffe440000 /lib/64/libuutil.so.1
0xfffffd7ffe420000 /lib/64/libmd5.so.1
0xfffffd7ffe3f0000 /lib/64/libmp.so.2
0xfffffd7ffe270000 /export/home/tg/jre1.6.0_03/lib/amd64/native_threads/libhpi.so
0xfffffd7ffe210000 /export/home/tg/jre1.6.0_03/lib/amd64/libjdwp.so
0xfffffd7ffe1e0000 /export/home/tg/jre1.6.0_03/lib/amd64/libnpt.so
0xfffffd7ffe190000 /usr/lib/iconv/amd64/UTF-8%646.so
0xfffffd7ffe160000 /usr/lib/iconv/amd64/646%UTF-8.so
0xfffffd7ffe110000 /export/home/tg/jre1.6.0_03/lib/amd64/libverify.so
0xfffffd7ffe0c0000 /export/home/tg/jre1.6.0_03/lib/amd64/libjava.so
0xfffffd7ffe080000 /export/home/tg/jre1.6.0_03/lib/amd64/libzip.so
0xfffffd7ffe010000 /export/home/tg/jre1.6.0_03/lib/amd64/libdt_socket.so
0xfffffd7d75460000 /lib/64/nss_files.so.1
VM Arguments:
jvm_args: -XX:+UseConcMarkSweepGC -XX:ParallelGCThreads=4 -Dapp.dir=/opt/tg/cos-deploy-0.35/bin/.. -Dlog.dir=log -Dapp.name=process -Detc.dir=/opt/tg/cos-deploy-0.35/bin/../etc -Dconfig.file=/opt/tg/cos-deploy-0.35/bin/../etc/process.properties -Dlog4j.configuration=etc/log4j.xml -Xdebug -Xnoagent -Djava.compiler=NONE -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=5005 -Xms10G -Xmx10G
java_command: tg.cos.server.Main
Launcher Type: SUN_STANDARD
Environment Variables:
JAVA_HOME=/export/home/tg/jre1.6.0_03
PATH=/opt/tg/fcs-foundation/perl/bin:/opt/tg/fcs-foundation/perl/bin:/sbin:/usr/sbin:/usr/sfw/bin:/opt/sfw/bin:/usr/X/bin:/usr/ccs/bin:/usr/local/bin:/usr/bin:/usr/sbin:/export/home/oracle_install/product/client/10.2/bin:/opt/tg/POOL/bin:/opt/tg/MailSender/bin:/export/home/tg/bin:/usr/sbin:/export/home/oracle_install/product/client/10.2/bin:/opt/tg/POOL/bin:/opt/tg/MailSender/bin
LD_LIBRARY_PATH=/export/home/tg/jre1.6.0_03/lib/amd64/server:/export/home/tg/jre1.6.0_03/lib/amd64:/export/home/tg/jre1.6.0_03/../lib/amd64
SHELL=/bin/bash
Signal Handlers:
SIGSEGV: [libjvm.so+0x9883b0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGBUS: [libjvm.so+0x9883b0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGFPE: [libjvm.so+0x315b10], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGPIPE: [libjvm.so+0x315b10], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGILL: [libjvm.so+0x315b10], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGHUP: [libjvm.so+0x87ca80], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGINT: [libjvm.so+0x87ca80], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGQUIT: [libjvm.so+0x87ca80], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGTERM: [libjvm.so+0x87ca80], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGQUIT: [libjvm.so+0x87ca80], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGTERM: [libjvm.so+0x87ca80], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIG39: [libjvm.so+0x87f4d0], sa_mask[0]=0x00000000, sa_flags=0x00000008
SIG40: [libjvm.so+0x315b10], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
--------------- S Y S T E M ---------------
OS: Solaris 10 11/06 s10x_u3wos_10 X86
Copyright 2006 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 14 November 2006
uname:SunOS 5.10 Generic_118855-33 i86pc (T2 libthread)
rlimit: STACK 10240k, CORE infinity, NOFILE 65536, AS infinity
load average:3.72 3.68 3.23
CPU:total 8 (2 cores per cpu, 1 threads per core) family 15 model 65 stepping 2, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnow, 3dnowext
Memory: 4k page, physical 16775096k(1672236k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (1.6.0_03-b05) for solaris-amd64, built on Sep 24 2007 22:29:24 by "" with unknown Workshop:0x580
I created a small test which somehow emulate the real application and I obtain the same results: on test machine run without any issues on live machine it crashes all the time.
What can be the cause?
import java.util.*;
public class MemoryTest {
private List<Page> pages = new LinkedList<Page>();
public void initTest() {
int counter = 1;
while( canAddOneMorePage() ) {
Page page = new Page(counter, (byte)counter++);
pages.add(page);
private boolean canAddOneMorePage() {
boolean result = true;
long freeMem = Runtime.getRuntime().freeMemory() / (1024*1024) ;
if (freeMem < 512) {
result = false;
return result;
private boolean validatePages() {
boolean arePagesValid = true;
for(Page p : pages) {
boolean isPageValid = p.isValid();
if ( !isPageValid ) {
System.out.println("Page "+p.id+ " contains corrupted data");
arePagesValid = false;
return arePagesValid;
private void updatePages(byte value) {
for(Page p : pages) {
p.updateValues(value);
public void runTest() {
int TESTS_NUM = 100;
System.out.println("There are "+pages.size()+" pages.");
System.out.println("Currently the pages "+ (validatePages() ? "contain no errors" : "contain errors"));
for(int i=1; i<TESTS_NUM; i++) {
System.out.println("Test "+i+" of "+TESTS_NUM);
updatePages((byte)i);
validatePages();
public static void main(String[] args) {
MemoryTest main = new MemoryTest();
main.initTest();
main.runTest();
class Page {
public static final int LENGTH = 1024*1024;
List <byte[]> list;
public byte value = 0;
public int id;
public Page(int id, byte value) {
this.list = new LinkedList<byte[]>();
this.value = value;
this.id = id;
for(int i=0; i<LENGTH; i++) {
byte[] data = new byte [512];
for( int j=0; j<512; j++) {
data[j] = value;
list.add(data);
public void updateValues(byte value) {
this.value = value;
this.list = new LinkedList<byte[]>();
System.out.println("Updating page "+id);
for(int i=0; i<LENGTH; i++) {
byte[] data = new byte [512];
for( int j=0; j<512; j++) {
data[j] = value;
list.add(data);
public boolean isValid() {
boolean result = true;
for( byte[] data: list) {
for( byte b : data) {
if (value != b) {
result = false;
break;
if ( !result ) {
break;
return result;
}Edited by: blue67 on Dec 10, 2007 12:57 AMI've experienced the same crash problem for my application in a Sun Fire x4600 M2..
My application which allocates 50G of memory for his Heap, runs on 8 quad core amd64 CPUs, 64G RAM machine and crash in 98% of the cases at short time after startup.
If I run my application on a different machine, for example a Sun Fire 280R with 2 CPUs UltraSPARC-III+ 1.2Ghz 8MB, there are no crashes.
I think the problem is related to the AMD 64 bits CPU architecture.
I filed a bug to the Sun Bug DB with ID 1415527, but it hasn't been published yet.
I cannot understand why, since it seems to be a problem common also to other users.
Here's part of my last hs_err_pidXXX.log file:
# An unexpected error has been detected by Java Runtime Environment:
# SIGSEGV (0xb) at pc=0xfffffd7ffebbd0bd, pid=25799, tid=50
# Java VM: Java HotSpot(TM) 64-Bit Server VM (11.0-b16 mixed mode solaris-amd64)
# Problematic frame:
# V [libjvm.so+0x5bd0bd]
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
T H R E A D
Current thread (0x0000000000b21c00): GCTaskThread [stack: 0x0000000000000000,0x0000000000000000] [id=50]
siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0xfffffd7ffebbd0bd
Registers:
RAX=0x0000000000000000, RBX=0x0000000000000008, RCX=0x0000000000000002, RDX=0xfffffd73b56f1ce8
RSP=0xfffffd73b56f1cb0, RBP=0xfffffd73b56f1e00, RSI=0xfffffd7c55dd2f08, RDI=0xfffffd7c55dd2bb9
, R8=0xb000000000000000, R9=0x0000000000c38ff0, R10=0x00000000042d0e97, R11=0xfffffd7c55dd2d88, R12=0x0000000000b38f00, R13=0x000000000045d070, R14=0x000000000045d070, R15=0x0000000000003c4f
RIP=0xfffffd7ffebbd0bd, RFLAGS=0x0000000000010246
Top of Stack: (sp=0xfffffd73b56f1cb0)
0xfffffd73b56f1cb0: fffffd7fff0f15a8 0000000000000000
0xfffffd73b56f1cc0: fffffd73b56f1e48 fffffd73b45e0790
0xfffffd73b56f1cd0: 0000000000000008 fffffd7ffebbc239
0xfffffd73b56f1ce0: fffffd7fff0f15a8 fffffd7fff0ec260
0xfffffd73b56f1cf0: 0000000000000000 0000000000b0c5b0
0xfffffd73b56f1d00: fffffd73fbc00000 000000017fa80000
0xfffffd73b56f1d10: 0000000000b0c710 0000000000b0c850
0xfffffd73b56f1d20: 0000000000000000 000000000045d070
0xfffffd73b56f1d30: 0000000000000000 0000000000b0c850
0xfffffd73b56f1d40: fffffd73b45e07f8 0000000000b0c8d8
0xfffffd73b56f1d50: 0000000900b0c5b0 fffffd792b971d60
0xfffffd73b56f1d60: fffffd7fff103d04 0000441ef1e00000
0xfffffd73b56f1d70: fffffd7c55dd2f08 fffffd7f00003c4d
0xfffffd73b56f1d80: fffffd73b45e0790 441f3c4d00000000
0xfffffd73b56f1d90: 441f3c4d441f3c4d 441f3c4d441f3c4d
0xfffffd73b56f1da0: 441e3c4d441f3c4d 441f3c4d441e3c4d
0xfffffd73b56f1db0: 43c03c1e441e3c4d 441e3c4d441e3c4d
0xfffffd73b56f1dc0: 5e3634bf5e3634bf 10830ae010830ae0
0xfffffd73b56f1dd0: 036b3673036b3674 036b3673036b3673
0xfffffd73b56f1de0: 5e3634c05e3634c1 5e3634c05e3634c0
0xfffffd73b56f1df0: fffffd73b45e0790 00000054b45e0790
0xfffffd73b56f1e00: fffffd73b56f1eb0 fffffd7ffebbbd47
0xfffffd73b56f1e10: fffffd73b56f1ef8 0000000000b0ce20
0xfffffd73b56f1e20: 0000000000b21c00 fffffd7fff04a509
0xfffffd73b56f1e30: 0000000000000008 00000000ffffffff
0xfffffd73b56f1e40: fffffd73b56f1e70 0000000000000000
0xfffffd73b56f1e50: 000002185a539ab2 fffffd7fff103d01
0xfffffd73b56f1e60: 000000000042c560 0000000000b21e90
0xfffffd73b56f1e70: 0000000000b21ea0 0000000000b22278
0xfffffd73b56f1e80: 0000000000b21c00 000000000045a780
0xfffffd73b56f1e90: 0000000000b22290 0000000000b222a0
0xfffffd73b56f1ea0: 0000000000b22678 000000000045a7c0
Thanks -
JVM 1.5.0_12 SIGSEGV crash on Solaris Sparc
# An unexpected error has been detected by HotSpot Virtual Machine:
# SIGSEGV (0xb) at pc=0xff330f84, pid=17836, tid=12
# Java VM: Java HotSpot(TM) Server VM (1.5.0_12-b04 mixed mode)
# Problematic frame:
# C [libc_psr.so.1+0xf84] memcpy+0x994
--------------- T H R E A D ---------------
Current thread (0x0014c130): JavaThread "CompilerThread1" daemon [_thread_in_native, id=12]
siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x00000000
Registers:
O0=0xfe35259f O1=0x00000000 O2=0x0000966c O3=0x0014c130
O4=0x00000002 O5=0xfe3dc000 O6=0xf8380140 O7=0xff3307f0
G1=0x00066000 G2=0x00009400 G3=0xf8c3c7c0 G4=0xfe434fa8
G5=0x000077e4 G6=0xf8415d30 G7=0xf8381d70 Y=0x00000000
PC=0xff330f84 nPC=0xff330f88
Top of Stack: (sp=0xf8380140)
0xf8380140: fe3dc000 00000000 0000e840 00000004
0xf8380150: 00000010 1f186a74 00000004 f8c35440
0xf8380160: 00000000 f8c3c7b0 00000010 00007340
0xf8380170: 00000050 00000000 f83801a0 fde199c4
0xf8380180: 00000000 00000000 00000000 00000000
0xf8380190: f8c38fa0 1001ecc0 fe4344d0 000006bd
0xf83801a0: 00000000 00000000 f8c3e088 f8c3e488
0xf83801b0: 018df2f8 fe352588 00000400 00000000
Instructions: (pc=0xff330f84)
0xff330f74: b7 b4 89 14 bb b5 09 16 bf b5 89 18 c1 9d de 00
0xff330f84: e3 be 1e 00 ae 05 e0 40 b6 a6 e0 40 02 40 00 1f
Stack: [0xf8302000,0xf8381d70), sp=0xf8380140, free space=504k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libc_psr.so.1+0xf84] memcpy+0x994
V [libjvm.so+0x2199cc]
V [libjvm.so+0x2256cc]
V [libjvm.so+0x222dec]
V [libjvm.so+0x218ae8]
V [libjvm.so+0x280c74]
V [libjvm.so+0x276d18]
V [libjvm.so+0x2778c8]
V [libjvm.so+0x3344ec]
V [libjvm.so+0x2dcb54]
V [libjvm.so+0x67ce98]
Current CompileTask:
opto:1264 com.lowagie.text.pdf.Type1Font.process(Lcom/lowagie/text/pdf/RandomAccessFileOrArray;)V (1320 bytes)
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x0140cf90 JavaThread "Thread-37" daemon [_thread_blocked, id=138]
0x00240ab8 JavaThread "Store org.hibernate.cache.StandardQueryCache Expiry Thread" daemon [_thread_blocked, id=135]
0x002408f0 JavaThread "Store org.hibernate.cache.StandardQueryCache Spool Thread" daemon [_thread_blocked, id=134]
0x0063ec58 JavaThread "Store org.hibernate.cache.UpdateTimestampsCache Expiry Thread" daemon [_thread_blocked, id=133]
0x0063ea90 JavaThread "Store org.hibernate.cache.UpdateTimestampsCache Spool Thread" daemon [_thread_blocked, id=132]
0x01013f10 JavaThread "derby.rawStoreDaemon" daemon [_thread_blocked, id=131]
0x00e38700 JavaThread "Timer-3" daemon [_thread_blocked, id=130]
0x00a01048 JavaThread "derby.antiGC" daemon [_thread_blocked, id=129]
0x00b0ce48 JavaThread "Store org.hibernate.cache.StandardQueryCache Expiry Thread" daemon [_thread_blocked, id=128]
0x01392ae0 JavaThread "Store org.hibernate.cache.StandardQueryCache Spool Thread" daemon [_thread_blocked, id=127]
0x005baff8 JavaThread "Store org.hibernate.cache.UpdateTimestampsCache Expiry Thread" daemon [_thread_blocked, id=126]
0x004ba540 JavaThread "Store org.hibernate.cache.UpdateTimestampsCache Spool Thread" daemon [_thread_blocked, id=125]
0x02068310 JavaThread "JCA PoolFiller" daemon [_thread_blocked, id=124]
0x00171180 JavaThread "IdleRemover" daemon [_thread_blocked, id=123]
0x00a71250 JavaThread "http-0.0.0.0-7001-Monitor" [_thread_blocked, id=121]
0x00612058 JavaThread "http-0.0.0.0-7001-Processor25" daemon [_thread_blocked, id=120]
0x006112f8 JavaThread "http-0.0.0.0-7001-Processor24" daemon [_thread_blocked, id=119]
0x00610598 JavaThread "http-0.0.0.0-7001-Processor23" daemon [_thread_blocked, id=118]
0x00b65c98 JavaThread "http-0.0.0.0-7001-Processor22" daemon [_thread_blocked, id=117]
0x00b650b8 JavaThread "http-0.0.0.0-7001-Processor21" daemon [_thread_blocked, id=116]
0x01395f80 JavaThread "http-0.0.0.0-7001-Processor20" daemon [_thread_in_native, id=115]
0x00a4b298 JavaThread "http-0.0.0.0-7001-Processor19" daemon [_thread_blocked, id=114]
0x00a4a620 JavaThread "http-0.0.0.0-7001-Processor18" daemon [_thread_blocked, id=113]
0x01214330 JavaThread "http-0.0.0.0-7001-Processor17" daemon [_thread_blocked, id=112]
0x00fdadf0 JavaThread "http-0.0.0.0-7001-Processor16" daemon [_thread_blocked, id=111]
0x009fa520 JavaThread "http-0.0.0.0-7001-Processor15" daemon [_thread_blocked, id=110]
0x02210448 JavaThread "http-0.0.0.0-7001-Processor14" daemon [_thread_blocked, id=109]
0x00a1d6f8 JavaThread "http-0.0.0.0-7001-Processor13" daemon [_thread_blocked, id=108]
0x01676eb0 JavaThread "http-0.0.0.0-7001-Processor12" daemon [_thread_blocked, id=107]
0x00f513c0 JavaThread "http-0.0.0.0-7001-Processor11" daemon [_thread_blocked, id=106]
0x00773c30 JavaThread "http-0.0.0.0-7001-Processor10" daemon [_thread_blocked, id=105]
0x01b40428 JavaThread "http-0.0.0.0-7001-Processor9" daemon [_thread_blocked, id=104]
0x0101ecd8 JavaThread "http-0.0.0.0-7001-Processor8" daemon [_thread_blocked, id=103]
0x00b636e0 JavaThread "http-0.0.0.0-7001-Processor7" daemon [_thread_blocked, id=102]
0x010c6918 JavaThread "http-0.0.0.0-7001-Processor6" daemon [_thread_blocked, id=101]
0x00c74f70 JavaThread "http-0.0.0.0-7001-Processor5" daemon [_thread_blocked, id=100]
0x00c74988 JavaThread "http-0.0.0.0-7001-Processor4" daemon [_thread_blocked, id=99]
0x00348270 JavaThread "http-0.0.0.0-7001-Processor3" daemon [_thread_blocked, id=98]
0x00755e80 JavaThread "http-0.0.0.0-7001-Processor2" daemon [_thread_blocked, id=97]
0x006acfe8 JavaThread "http-0.0.0.0-7001-Processor1" daemon [_thread_blocked, id=96]
0x010c6350 JavaThread "JBossLifeThread" [_thread_blocked, id=95]
0x008b4af0 JavaThread "JspRuntimeContext[/tmp46779ppp.war]" daemon [_thread_blocked, id=94]
0x01080a00 JavaThread "JspRuntimeContext[/tmp46778yyy.war]" daemon [_thread_blocked, id=93]
0x01471db8 JavaThread "JspRuntimeContext[/tmp46777xxx.war]" daemon [_thread_blocked, id=92]
0x01411ef0 JavaThread "Thread-6" [_thread_blocked, id=91]
0x0107d448 JavaThread "Thread-5" [_thread_blocked, id=90]
0x014991d0 JavaThread "JspRuntimeContext[/web-console.war]" daemon [_thread_blocked, id=89]
0x01b126e0 JavaThread "JspRuntimeContext[/jmx-console.war]" daemon [_thread_blocked, id=88]
0x00618a10 JavaThread "Timer-2" daemon [_thread_blocked, id=87]
0x00f5bd48 JavaThread "JBoss JMX Attribute Monitor InUseConnectionCount Monitor" [_thread_blocked, id=86]
0x02211078 JavaThread "JBoss JMX Attribute Monitor InUseConnectionCount Monitor" [_thread_blocked, id=85]
0x00d11338 JavaThread "HSQLDB Timer @c26c8f" daemon [_thread_blocked, id=84]
0x00548360 JavaThread "JspRuntimeContext[/jboss.war]" daemon [_thread_blocked, id=83]
0x00548588 JavaThread "ContainerBackgroundProcessor[StandardEngine[jboss.web]]" daemon [_thread_blocked, id=82]
0x0108aa88 JavaThread "JspRuntimeContext[/editique]" daemon [_thread_blocked, id=81]
0x005e34a0 JavaThread "JspRuntimeContext[/image]" daemon [_thread_blocked, id=80]
0x00d11590 JavaThread "JspRuntimeContext[/encarts]" daemon [_thread_blocked, id=79]
0x004ac770 JavaThread "JspRuntimeContext[/upload]" daemon [_thread_blocked, id=78]
0x00468030 JavaThread "JBoss JMX Attribute Monitor ActiveThreadCount Monitor" [_thread_blocked, id=52]
0x013bf150 JavaThread "JBoss JMX Attribute Monitor FreeMemory Monitor" [_thread_blocked, id=51]
0x002e0d90 JavaThread "PooledInvokerAcceptor#0-7090" [_thread_in_native, id=48]
0x00db2bd8 JavaThread "RMI TCP Accept-7089" daemon [_thread_in_native, id=46]
0x00dee0c0 JavaThread "NamingBootstrap Pool(1)-1" daemon [_thread_in_native, id=45]
0x00e41df8 JavaThread "GC Daemon" daemon [_thread_blocked, id=44]
0x0067ccc0 JavaThread "RMI Reaper" [_thread_blocked, id=43]
0x0067c8b0 JavaThread "Timer-1" daemon [_thread_blocked, id=42]
0x0067c548 JavaThread "RMI TCP Accept-7098" daemon [_thread_in_native, id=41]
0x0085d308 JavaThread "SeedGenerator Thread" daemon [_thread_blocked, id=18]
0x006eb480 JavaThread "ScannerThread" daemon [_thread_blocked, id=17]
0x00cb59a8 JavaThread "Timer-0" daemon [_thread_blocked, id=16]
0x00038f98 JavaThread "DestroyJavaVM" [_thread_blocked, id=1]
0x0014d1e8 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=13]
=>0x0014c130 JavaThread "CompilerThread1" daemon [_thread_in_native, id=12]
0x0014b218 JavaThread "CompilerThread0" daemon [_thread_in_native, id=11]
0x0014a3a0 JavaThread "AdapterThread" daemon [_thread_blocked, id=10]
0x00149618 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=9]
0x0013eb80 JavaThread "Finalizer" daemon [_thread_blocked, id=8]
0x0013e640 JavaThread "Reference Handler" daemon [_thread_blocked, id=7]
Other Threads:
0x0013c560 VMThread [id=6]
0x000b2190 WatcherThread [id=14]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x00037508/0x00038938] Heap_lock - owner thread: 0x00e41df8
[0x00037608/0x00038cc8] MethodData_lock - owner thread: 0x00a4b298
Heap
PSYoungGen total 316032K, used 6348K [0xe2ab0000, 0xf7930000, 0xf8000000)
eden space 315968K, 2% used [0xe2ab0000,0xe30e3298,0xf5f40000)
from space 64K, 0% used [0xf7910000,0xf7910000,0xf7920000)
to space 64K, 0% used [0xf7920000,0xf7920000,0xf7930000)
PSOldGen total 185792K, used 185791K [0xb8000000, 0xc3570000, 0xe2ab0000)
object space 185792K, 99% used [0xb8000000,0xc356ffb8,0xc3570000)
PSPermGen total 34432K, used 34431K [0xb0000000, 0xb21a0000, 0xb8000000)
object space 34432K, 99% used [0xb0000000,0xb219fd30,0xb21a0000)
Dynamic libraries:
0x00010000 /products/java/jdk1.5.0_12/bin/java
0xff350000 /usr/lib/libthread.so.1
0xff390000 /usr/lib/libdl.so.1
0xff200000 /usr/lib/libc.so.1
0xff330000 /usr/platform/SUNW,Ultra-4/lib/libc_psr.so.1
0xfdc00000 /products/java/jdk1.5.0_12/jre/lib/sparc/server/libjvm.so
0xff2f0000 /usr/lib/libsocket.so.1
0xff1e0000 /usr/lib/libsched.so.1
0xff1b0000 /usr/lib/libCrun.so.1
0xff180000 /usr/lib/libm.so.1
0xff080000 /usr/lib/libnsl.so.1
0xff310000 /usr/lib/libw.so.1
0xff160000 /usr/lib/libmp.so.2
0xff050000 /products/java/jdk1.5.0_12/jre/lib/sparc/native_threads/libhpi.so
0xfe7d0000 /products/java/jdk1.5.0_12/jre/lib/sparc/libverify.so
0xfe790000 /products/java/jdk1.5.0_12/jre/lib/sparc/libjava.so
0xfe760000 /products/java/jdk1.5.0_12/jre/lib/sparc/libzip.so
0xfe610000 /usr/lib/locale/en_US.ISO8859-1/en_US.ISO8859-1.so.2
0xfa610000 /products/java/jdk1.5.0_12/jre/lib/sparc/libnet.so
0xabd60000 /products/java/jdk1.5.0_12/jre/lib/sparc/libnio.so
0xabb00000 /usr/lib/librt.so.1
0xab3e0000 /usr/lib/libaio.so.1
0xab3c0000 /usr/lib/libsendfile.so.1
0xaaa80000 /products/java/jdk1.5.0_12/jre/lib/sparc/libawt.so
0xaa900000 /products/java/jdk1.5.0_12/jre/lib/sparc/libmlib_image.so
0xac330000 /products/java/jdk1.5.0_12/jre/lib/sparc/headless/libmawt.so
VM Arguments:
jvm_args: -Xms128m -Xmx1024m -XX:MaxPermSize=128m -Xss128k -verbose:class -verbose:gc -Dderby.system.home=/home/xxx/databases -Djboss.home.dir=/home/xxx/products/jboss -Djboss.home.url=file:/home/xxx/products/jboss -Djboss.lib.url=file:/home/xxx/products/jboss/lib -Djboss.server.base.dir=/home/xxx/webapp -Djboss.server.base.url=file:/home/xxx/webapp -Djboss.server.home.dir=/home/xxx/webapp -Djboss.server.home.url=file:/home/xxx/webapp -Djboss.server.lib.url=file:/home/xxx/products/jboss-libs -Djboss.server.data.dir=/home/xxx/tmp/xxx -Djboss.server.config.url=file:/home/xxx/etc/config-jboss -Djboss.server.temp.dir=/home/xxx/tmp/xxx -Djboss.server.name=webapp
java_command: org.jboss.Main --classpath /home/xxx/etc
Launcher Type: SUN_STANDARD
Environment Variables:
PATH=/home/xxx/products/jdk/bin:/home/xxx/gnu/bin:/usr/bin:/usr/ucb:/etc
LD_LIBRARY_PATH=/products/java/jdk1.5.0_12/jre/lib/sparc/server:/products/java/jdk1.5.0_12/jre/lib/sparc:/products/java/jdk1.5.0_12/jre/../lib/sparc:/usr/local/openwin/lib:/usr/local/openwin/lib:/usr/lib
SHELL=/bin/ksh
Signal Handlers:
SIGSEGV: [libjvm.so+0x70cb50], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGBUS: [libjvm.so+0x70cb50], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGFPE: [libjvm.so+0x2743ac], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGPIPE: [libjvm.so+0x2743ac], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGILL: [libjvm.so+0x2743ac], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGUSR1: [libjvm.so+0x67f5f0], sa_mask[0]=0x00008000, sa_flags=0x00000008
SIGUSR2: [libjvm.so+0x2743ac], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGHUP: [libjvm.so+0x67e22c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: [libjvm.so+0x67e22c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGTERM: [libjvm.so+0x67e22c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
--------------- S Y S T E M ---------------
OS: Solaris 8 10/01 s28s_u6wos_08a SPARC
Copyright 2001 Sun Microsystems, Inc. All Rights Reserved.
Assembled 12 September 2001
uname:SunOS 5.8 Generic_108528-18 sun4u (T1 libthread)
rlimit: STACK 8192k, CORE infinity, NOFILE 1024, AS infinity
load average:1.44 0.66 0.46
CPU:total 2 has_v8, has_v9, has_vis1
Memory: 8k page, physical 2621440k(506320k free)
vm_info: Java HotSpot(TM) Server VM (1.5.0_12-b04) for solaris-sparc, built on May 2 2007 02:33:21 by unknown with unknown Workshop:0x550I've worked around it creating ".hotspot_compiler" with the following content to disable native compilation on problematic methods :
exclude com/lowagie/text/pdf/Type1Font processRegards,
Patrick.Hi, we've got a similar problem with JVM 1.5.0_06, although the SIGSEGV appeared not on a Compiler thread, but on a JavaThread:
# An unexpected error has been detected by HotSpot Virtual Machine:
# SIGSEGV (0xb) at pc=0xff390af8, pid=11726, tid=153
# Java VM: Java HotSpot(TM) Client VM (1.5.0_06-b05 mixed mode, sharing)
# Problematic frame:
# C [libc_psr.so.1+0xaf8] memset+0x78
--------------- T H R E A D ---------------
Current thread (0x00238508): JavaThread "JMSEventSession #2 on queue://TaskManagerQueue" [_thread_in_native, id=153]
siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x00000000
Registers:
O0=0x00000000 O1=0x00000000 O2=0x0000000c O3=0x00000000
O4=0xff368284 O5=0x00000008 O6=0xf177d730 O7=0xf7c5c410
G1=0x00060000 G2=0x15b7164c G3=0x000148a4 G4=0x00014868
G5=0xd1953220 G6=0x3793e37d G7=0xfe763c00 Y=0x00000000
PC=0xff390af8 nPC=0xff390aec
Top of Stack: (sp=0xf177d730)
0xf177d730: 00000000 0000000c 0000000c 0000000c
0xf177d740: 0001485c 0000000c 000148f4 00000008
0xf177d750: 00000000 0000000f 0000000a 0000003c
0xf177d760: 0000000a 0000003c f177d7d8 f7c5b544
0xf177d770: 00000001 00000001 00000000 f177d904
0xf177d780: 0000003e 00000000 0000000a 00000001
0xf177d790: f177d8f0 18185c90 00000000 f177d8e4
0xf177d7a0: 15744078 0000000a 14ecd530 00000003
Instructions: (pc=0xff390af8)
0xff390ae8: 96 0a a0 18 96 a2 e0 08 9a 03 60 08 3a 4f ff fe
0xff390af8: d2 73 7f f8 98 aa a0 1f 02 40 00 08 98 a3 20 20
Stack: [0xf1700000,0xf1780000), sp=0xf177d730, free space=501k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libc_psr.so.1+0xaf8] memset+0x78
C [libocijdbc10.so+0xb54c] Java_oracle_jdbc_driver_T2CStatement_t2cDefineFetch+0x2c
J oracle.jdbc.driver.T2CStatement.t2cDefineFetch(JI[S[BII[Loracle/jdbc/driver/Accessor;[BI[CI[SI[J)I
J oracle.jdbc.driver.T2CPreparedStatement.doDefineFetch()V
J oracle.jdbc.driver.T2CPreparedStatement.executeForRows(Z)V
J oracle.jdbc.driver.OracleStatement.executeMaybeDescribe()V
J oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout()V
J oracle.jdbc.driver.OraclePreparedStatement.executeInternal()I
J oracle.jdbc.driver.OraclePreparedStatement.execute()Z
J org.apache.commons.dbcp.DelegatingPreparedStatement.execute()Z
J org.apache.commons.dbcp.DelegatingPreparedStatement.execute()Z
J es.tid.planb.spci.task.actioncontext.DBHelper.query(Ljava/sql/Connection;Ljava/lang/String;[Ljava/lang/Object;)Ljava/sql/ResultSet;
J sun.reflect.GeneratedMethodAccessor6089.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J bsh.Reflect.invokeMethod(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J bsh.Reflect.invokeObjectMethod(Ljava/lang/Object;Ljava/lang/String;[Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.Name.invokeMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.BSHMethodInvocation.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(ZLbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHAssignment.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHBlock.evalBlock(Lbsh/CallStack;Lbsh/Interpreter;ZLbsh/BSHBlock$NodeFilter;)Ljava/lang/Object;
J bsh.BSHBlock.eval(Lbsh/CallStack;Lbsh/Interpreter;Z)Ljava/lang/Object;
J bsh.BshMethod.invokeImpl([Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;Z)Ljava/lang/Object;
J bsh.BshMethod.invoke([Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;Z)Ljava/lang/Object;
J bsh.Name.invokeLocalMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.Name.invokeMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.BSHMethodInvocation.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(ZLbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHBlock.evalBlock(Lbsh/CallStack;Lbsh/Interpreter;ZLbsh/BSHBlock$NodeFilter;)Ljava/lang/Object;
J bsh.BSHBlock.eval(Lbsh/CallStack;Lbsh/Interpreter;Z)Ljava/lang/Object;
J bsh.BshMethod.invokeImpl([Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;Z)Ljava/lang/Object;
J bsh.BshMethod.invoke([Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;Z)Ljava/lang/Object;
J bsh.Name.invokeLocalMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.Name.invokeMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.BSHMethodInvocation.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(ZLbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHBlock.evalBlock(Lbsh/CallStack;Lbsh/Interpreter;ZLbsh/BSHBlock$NodeFilter;)Ljava/lang/Object;
J bsh.BSHBlock.eval(Lbsh/CallStack;Lbsh/Interpreter;Z)Ljava/lang/Object;
J bsh.BSHTryStatement.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.Interpreter.eval(Ljava/io/Reader;Lbsh/NameSpace;Ljava/lang/String;)Ljava/lang/Object;
j bsh.Interpreter.source(Ljava/lang/String;Lbsh/NameSpace;)Ljava/lang/Object;+56
J es.tid.planb.spci.task.BshAction.action()V
J es.tid.planb.spci.task.TaskActionCommand.action()V
J es.tid.planb.spci.task.SPCITaskCtrlModel.update()Z
J es.tid.planb.workflow.TaskManager.updateTask(Les/tid/planb/workflow/TaskCtrlModel;Les/tid/planb/workflow/Event;)V
J es.tid.planb.workflow.TaskManager.onEvent(Les/tid/planb/workflow/Event;)V
J es.tid.planb.workflow.JMSEventSession.run()V
v ~OSRAdapter
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
V [libjvm.so+0xdc098]
V [libjvm.so+0xf38c8]
V [libjvm.so+0xf3724]
V [libjvm.so+0xf35a8]
V [libjvm.so+0x42af10]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
J oracle.jdbc.driver.T2CStatement.t2cDefineFetch(JI[S[BII[Loracle/jdbc/driver/Accessor;[BI[CI[SI[J)I
J oracle.jdbc.driver.T2CPreparedStatement.doDefineFetch()V
J oracle.jdbc.driver.T2CPreparedStatement.executeForRows(Z)V
J oracle.jdbc.driver.OracleStatement.executeMaybeDescribe()V
J oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout()V
J oracle.jdbc.driver.OraclePreparedStatement.executeInternal()I
J oracle.jdbc.driver.OraclePreparedStatement.execute()Z
J org.apache.commons.dbcp.DelegatingPreparedStatement.execute()Z
J org.apache.commons.dbcp.DelegatingPreparedStatement.execute()Z
J es.tid.planb.spci.task.actioncontext.DBHelper.query(Ljava/sql/Connection;Ljava/lang/String;[Ljava/lang/Object;)Ljava/sql/ResultSet;
J sun.reflect.GeneratedMethodAccessor6089.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J bsh.Reflect.invokeMethod(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
J bsh.Reflect.invokeObjectMethod(Ljava/lang/Object;Ljava/lang/String;[Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.Name.invokeMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.BSHMethodInvocation.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(ZLbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHAssignment.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHBlock.evalBlock(Lbsh/CallStack;Lbsh/Interpreter;ZLbsh/BSHBlock$NodeFilter;)Ljava/lang/Object;
J bsh.BSHBlock.eval(Lbsh/CallStack;Lbsh/Interpreter;Z)Ljava/lang/Object;
J bsh.BshMethod.invokeImpl([Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;Z)Ljava/lang/Object;
J bsh.BshMethod.invoke([Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;Z)Ljava/lang/Object;
J bsh.Name.invokeLocalMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.Name.invokeMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.BSHMethodInvocation.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(ZLbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHBlock.evalBlock(Lbsh/CallStack;Lbsh/Interpreter;ZLbsh/BSHBlock$NodeFilter;)Ljava/lang/Object;
J bsh.BSHBlock.eval(Lbsh/CallStack;Lbsh/Interpreter;Z)Ljava/lang/Object;
J bsh.BshMethod.invokeImpl([Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;Z)Ljava/lang/Object;
J bsh.BshMethod.invoke([Ljava/lang/Object;Lbsh/Interpreter;Lbsh/CallStack;Lbsh/SimpleNode;Z)Ljava/lang/Object;
J bsh.Name.invokeLocalMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.Name.invokeMethod(Lbsh/Interpreter;[Ljava/lang/Object;Lbsh/CallStack;Lbsh/SimpleNode;)Ljava/lang/Object;
J bsh.BSHMethodInvocation.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(ZLbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHPrimaryExpression.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.BSHBlock.evalBlock(Lbsh/CallStack;Lbsh/Interpreter;ZLbsh/BSHBlock$NodeFilter;)Ljava/lang/Object;
J bsh.BSHBlock.eval(Lbsh/CallStack;Lbsh/Interpreter;Z)Ljava/lang/Object;
J bsh.BSHTryStatement.eval(Lbsh/CallStack;Lbsh/Interpreter;)Ljava/lang/Object;
J bsh.Interpreter.eval(Ljava/io/Reader;Lbsh/NameSpace;Ljava/lang/String;)Ljava/lang/Object;
j bsh.Interpreter.source(Ljava/lang/String;Lbsh/NameSpace;)Ljava/lang/Object;+56
J es.tid.planb.spci.task.BshAction.action()V
J es.tid.planb.spci.task.TaskActionCommand.action()V
J es.tid.planb.spci.task.SPCITaskCtrlModel.update()Z
J es.tid.planb.workflow.TaskManager.updateTask(Les/tid/planb/workflow/TaskCtrlModel;Les/tid/planb/workflow/Event;)V
J es.tid.planb.workflow.TaskManager.onEvent(Les/tid/planb/workflow/Event;)V
J es.tid.planb.workflow.JMSEventSession.run()V
v ~OSRAdapter
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x12879558 JavaThread "Keep-Alive-Timer" daemon [_thread_blocked, id=285746]
0x0fe559b8 JavaThread "ActiveMQ Task" daemon [_thread_blocked, id=285639]
0x1477ff18 JavaThread "ActiveMQ Session Task" daemon [_thread_blocked, id=285638]
0x0f7dc470 JavaThread "ActiveMQ Session Task" daemon [_thread_blocked, id=283547]
0x134826d0 JavaThread "ActiveMQ Transport: tcp:///10.228.32.110:41159" daemon [_thread_in_native, id=277026]
0x11c7bf70 JavaThread "ActiveMQ Transport: tcp:///10.228.32.110:31040" daemon [_thread_in_native, id=267379]
0x05ff17d8 JavaThread "ActiveMQ Transport: tcp:///10.228.32.104:8951" daemon [_thread_in_native, id=233688]
0x083cb4b0 JavaThread "ActiveMQ Transport: tcp:///10.228.32.110:10863" daemon [_thread_in_native, id=139875]
0x052f5808 JavaThread "ActiveMQ Transport: tcp:///127.0.0.1:34505" daemon [_thread_in_native, id=17778]
0x07053e80 JavaThread "ActiveMQ Transport: tcp://localhost/127.0.0.1:61635" [_thread_in_native, id=17777]
0x00285b58 JavaThread "Thread-158" daemon [_thread_blocked, id=333]
0x00984be8 JavaThread "SMTPGate-Worker#4" [_thread_blocked, id=331]
0x009bbe70 JavaThread "SMTPGate-Worker#3" [_thread_blocked, id=330]
0x00983b50 JavaThread "SMTPGate-Worker#2" [_thread_blocked, id=329]
0x00958f10 JavaThread "SMTPGate-Worker#1" [_thread_blocked, id=328]
0x00988540 JavaThread "SMTPGate-Worker#0" [_thread_blocked, id=327]
0x009a6598 JavaThread "ServerSocket" [_thread_in_native, id=326]
0x009a63d0 JavaThread "JMSProvider [JMSTaskProvider] Consumer" [_thread_blocked, id=325]
0x009a7e80 JavaThread "FaxGate-Worker#4" [_thread_blocked, id=324]
0x009a82b0 JavaThread "FaxGate-Worker#3" [_thread_blocked, id=323]
0x009a7108 JavaThread "FaxGate-Worker#2" [_thread_blocked, id=322]
0x009a5d58 JavaThread "FaxGate-Worker#1" [_thread_blocked, id=321]
0x009a4fa8 JavaThread "FaxGate-Worker#0" [_thread_blocked, id=320]
0x009a22b0 JavaThread "EventGate-Worker#0" [_thread_blocked, id=319]
0x009a0978 JavaThread "LineCheckerGate-Worker#19" [_thread_blocked, id=318]
0x009a2550 JavaThread "LineCheckerGate-Worker#18" [_thread_blocked, id=317]
0x0099c610 JavaThread "LineCheckerGate-Worker#17" [_thread_blocked, id=316]
0x0099b978 JavaThread "LineCheckerGate-Worker#16" [_thread_blocked, id=315]
0x00998d70 JavaThread "LineCheckerGate-Worker#15" [_thread_blocked, id=314]
0x0099da60 JavaThread "LineCheckerGate-Worker#14" [_thread_blocked, id=313]
0x0099f700 JavaThread "LineCheckerGate-Worker#13" [_thread_blocked, id=312]
0x0099e898 JavaThread "LineCheckerGate-Worker#12" [_thread_blocked, id=311]
0x00997df8 JavaThread "LineCheckerGate-Worker#11" [_thread_blocked, id=310]
0x009a32f0 JavaThread "LineCheckerGate-Worker#10" [_thread_blocked, id=309]
0x0099fa48 JavaThread "LineCheckerGate-Worker#9" [_thread_blocked, id=308]
0x00999690 JavaThread "LineCheckerGate-Worker#8" [_thread_blocked, id=307]
0x0099a6e0 JavaThread "LineCheckerGate-Worker#7" [_thread_blocked, id=306]
0x00999978 JavaThread "LineCheckerGate-Worker#6" [_thread_blocked, id=305]
0x00997430 JavaThread "LineCheckerGate-Worker#5" [_thread_blocked, id=304]
0x00996338 JavaThread "LineCheckerGate-Worker#4" [_thread_blocked, id=303]
0x00956e98 JavaThread "LineCheckerGate-Worker#3" [_thread_blocked, id=302]
0x00964e00 JavaThread "LineCheckerGate-Worker#2" [_thread_blocked, id=301]
0x009558d8 JavaThread "LineCheckerGate-Worker#1" [_thread_blocked, id=300]
0x00977078 JavaThread "LineCheckerGate-Worker#0" [_thread_blocked, id=299]
0x00965438 JavaThread "GesADSLGate-Worker#4" [_thread_in_native, id=297]
0x00978390 JavaThread "GesADSLGate-Worker#3" [_thread_blocked, id=296]
0x00966028 JavaThread "GesADSLGate-Worker#2" [_thread_blocked, id=295]
0x0093e5b8 JavaThread "GesADSLGate-Worker#1" [_thread_blocked, id=294]
0x0093d8f0 JavaThread "GesADSLGate-Worker#0" [_thread_in_native, id=293]
0x00941058 JavaThread "GesADSLGate JMS Consumer" [_thread_blocked, id=292]
0x0093efd0 JavaThread "ActiveMQ Transport: tcp:///127.0.0.1:65371" daemon [_thread_in_native, id=289]
0x0093c2d0 JavaThread "ActiveMQ Transport: tcp://localhost/127.0.0.1:61635" [_thread_in_native, id=288]
0x00937678 JavaThread "JMSLLUGate-Worker#4" [_thread_blocked, id=286]
0x00936920 JavaThread "JMSLLUGate-Worker#3" [_thread_blocked, id=285]
0x00935c28 JavaThread "JMSLLUGate-Worker#2" [_thread_blocked, id=284]
0x00941ff8 JavaThread "JMSLLUGate-Worker#1" [_thread_blocked, id=283]
0x00941588 JavaThread "JMSLLUGate-Worker#0" [_thread_blocked, id=282]
0x008c56d8 JavaThread "HTTPGate-Worker#49" [_thread_blocked, id=281]
0x008c4980 JavaThread "HTTPGate-Worker#48" [_thread_blocked, id=280]
0x008c3420 JavaThread "HTTPGate-Worker#47" [_thread_blocked, id=279]
0x008c26c8 JavaThread "HTTPGate-Worker#46" [_thread_blocked, id=278]
0x008c1970 JavaThread "HTTPGate-Worker#45" [_thread_blocked, id=277]
0x008c0c18 JavaThread "HTTPGate-Worker#44" [_thread_blocked, id=276]
0x008bfec0 JavaThread "HTTPGate-Worker#43" [_thread_blocked, id=275]
0x008bf168 JavaThread "HTTPGate-Worker#42" [_thread_in_native, id=274]
0x008be410 JavaThread "HTTPGate-Worker#41" [_thread_blocked, id=273]
0x008bd6b8 JavaThread "HTTPGate-Worker#40" [_thread_blocked, id=272]
0x008bc960 JavaThread "HTTPGate-Worker#39" [_thread_blocked, id=271]
0x008bbc08 JavaThread "HTTPGate-Worker#38" [_thread_blocked, id=270]
0x008baeb0 JavaThread "HTTPGate-Worker#37" [_thread_blocked, id=269]
0x008ba158 JavaThread "HTTPGate-Worker#36" [_thread_in_native, id=268]
0x008b9400 JavaThread "HTTPGate-Worker#35" [_thread_blocked, id=267]
0x008b80a0 JavaThread "HTTPGate-Worker#34" [_thread_blocked, id=266]
0x008b7348 JavaThread "HTTPGate-Worker#33" [_thread_blocked, id=265]
0x008b65f0 JavaThread "HTTPGate-Worker#32" [_thread_blocked, id=264]
0x008b5898 JavaThread "HTTPGate-Worker#31" [_thread_blocked, id=263]
0x008b4b40 JavaThread "HTTPGate-Worker#30" [_thread_blocked, id=262]
0x0088b180 JavaThread "HTTPGate-Worker#29" [_thread_blocked, id=261]
0x0088a428 JavaThread "HTTPGate-Worker#28" [_thread_blocked, id=260]
0x008896d0 JavaThread "HTTPGate-Worker#27" [_thread_blocked, id=259]
0x00888978 JavaThread "HTTPGate-Worker#26" [_thread_blocked, id=258]
0x00887c20 JavaThread "HTTPGate-Worker#25" [_thread_blocked, id=257]
0x00886ec8 JavaThread "HTTPGate-Worker#24" [_thread_blocked, id=256]
0x00886170 JavaThread "HTTPGate-Worker#23" [_thread_in_native, id=255]
0x00885418 JavaThread "HTTPGate-Worker#22" [_thread_blocked, id=254]
0x008846c0 JavaThread "HTTPGate-Worker#21" [_thread_blocked, id=253]
0x00883968 JavaThread "HTTPGate-Worker#20" [_thread_blocked, id=252]
0x00882c10 JavaThread "HTTPGate-Worker#19" [_thread_blocked, id=251]
0x00881eb8 JavaThread "HTTPGate-Worker#18" [_thread_blocked, id=250]
0x00881160 JavaThread "HTTPGate-Worker#17" [_thread_blocked, id=249]
0x00880408 JavaThread "HTTPGate-Worker#16" [_thread_in_native, id=248]
0x0087eea8 JavaThread "HTTPGate-Worker#15" [_thread_blocked, id=247]
0x0087e150 JavaThread "HTTPGate-Worker#14" [_thread_blocked, id=246]
0x0087d3f8 JavaThread "HTTPGate-Worker#13" [_thread_in_native, id=245]
0x0087c6a0 JavaThread "HTTPGate-Worker#12" [_thread_blocked, id=244]
0x0087b948 JavaThread "HTTPGate-Worker#11" [_thread_blocked, id=243]
0x0087abf0 JavaThread "HTTPGate-Worker#10" [_thread_blocked, id=242]
0x0025f968 JavaThread "HTTPGate-Worker#9" [_thread_blocked, id=241]
0x0025ec10 JavaThread "HTTPGate-Worker#8" [_thread_blocked, id=240]
0x0025deb8 JavaThread "HTTPGate-Worker#7" [_thread_blocked, id=239]
0x0025d160 JavaThread "HTTPGate-Worker#6" [_thread_blocked, id=238]
0x0025c408 JavaThread "HTTPGate-Worker#5" [_thread_blocked, id=237]
0x0025b6b0 JavaThread "HTTPGate-Worker#4" [_thread_blocked, id=236]
0x0025a958 JavaThread "HTTPGate-Worker#3" [_thread_blocked, id=235]
0x002595f8 JavaThread "HTTPGate-Worker#2" [_thread_blocked, id=234]
0x002588a0 JavaThread "HTTPGate-Worker#1" [_thread_blocked, id=233]
0x00256a78 JavaThread "HTTPGate-Worker#0" [_thread_blocked, id=232]
0x00255d20 JavaThread "TaskSwapper" [_thread_blocked, id=231]
0x00254e88 JavaThread "TaskConsumer-Worker#49" [_thread_blocked, id=230]
0x00254130 JavaThread "TaskConsumer-Worker#48" [_thread_blocked, id=229]
0x002533d8 JavaThread "TaskConsumer-Worker#47" [_thread_blocked, id=228]
0x00252680 JavaThread "TaskConsumer-Worker#46" [_thread_blocked, id=227]
0x00251928 JavaThread "TaskConsumer-Worker#45" [_thread_blocked, id=226]
0x00250bd0 JavaThread "TaskConsumer-Worker#44" [_thread_blocked, id=225]
0x000f3ae8 JavaThread "TaskConsumer-Worker#43" [_thread_blocked, id=224]
0x000f2d90 JavaThread "TaskConsumer-Worker#42" [_thread_blocked, id=223]
0x000f2038 JavaThread "TaskConsumer-Worker#41" [_thread_blocked, id=222]
0x000f12e0 JavaThread "TaskConsumer-Worker#40" [_thread_blocked, id=221]
0x000f0588 JavaThread "TaskConsumer-Worker#39" [_thread_blocked, id=220]
0x000ef830 JavaThread "TaskConsumer-Worker#38" [_thread_blocked, id=219]
0x000eead8 JavaThread "TaskConsumer-Worker#37" [_thread_blocked, id=218]
0x000edd80 JavaThread "TaskConsumer-Worker#36" [_thread_blocked, id=217]
0x000ed058 JavaThread "TaskConsumer-Worker#35" [_thread_blocked, id=216]
0x0028ea88 JavaThread "TaskConsumer-Worker#34" [_thread_blocked, id=215]
0x0028dd30 JavaThread "TaskConsumer-Worker#33" [_thread_blocked, id=214]
0x0028cfd8 JavaThread "TaskConsumer-Worker#32" [_thread_blocked, id=213]
0x0028c280 JavaThread "TaskConsumer-Worker#31" [_thread_blocked, id=212]
0x0028b528 JavaThread "TaskConsumer-Worker#30" [_thread_blocked, id=211]
0x0028a7d0 JavaThread "TaskConsumer-Worker#29" [_thread_blocked, id=210]
0x00289a78 JavaThread "TaskConsumer-Worker#28" [_thread_blocked, id=209]
0x00288d20 JavaThread "TaskConsumer-Worker#27" [_thread_blocked, id=208]
0x00287fc8 JavaThread "TaskConsumer-Worker#26" [_thread_blocked, id=207]
0x00287270 JavaThread "TaskConsumer-Worker#25" [_thread_blocked, id=206]
0x003eddc0 JavaThread "TaskConsumer-Worker#24" [_thread_blocked, id=205]
0x003ed068 JavaThread "TaskConsumer-Worker#23" [_thread_blocked, id=204]
0x003ec310 JavaThread "TaskConsumer-Worker#22" [_thread_blocked, id=203]
0x003eafb0 JavaThread "TaskConsumer-Worker#21" [_thread_blocked, id=202]
0x003ea258 JavaThread "TaskConsumer-Worker#20" [_thread_blocked, id=201]
0x003e9500 JavaThread "TaskConsumer-Worker#19" [_thread_blocked, id=200]
0x003e87a8 JavaThread "TaskConsumer-Worker#18" [_thread_blocked, id=199]
0x003e7a50 JavaThread "TaskConsumer-Worker#17" [_thread_blocked, id=198]
0x003e6cf8 JavaThread "TaskConsumer-Worker#16" [_thread_blocked, id=197]
0x008f7750 JavaThread "TaskConsumer-Worker#15" [_thread_blocked, id=196]
0x008f69f8 JavaThread "TaskConsumer-Worker#14" [_thread_blocked, id=195]
0x008f5ca0 JavaThread "TaskConsumer-Worker#13" [_thread_blocked, id=194]
0x008f4f48 JavaThread "TaskConsumer-Worker#12" [_thread_blocked, id=193]
0x008f41f0 JavaThread "TaskConsumer-Worker#11" [_thread_blocked, id=192]
0x008f3498 JavaThread "TaskConsumer-Worker#10" [_thread_blocked, id=191]
0x008f2740 JavaThread "TaskConsumer-Worker#9" [_thread_blocked, id=190]
0x008f19e8 JavaThread "TaskConsumer-Worker#8" [_thread_blocked, id=189]
0x008f0c90 JavaThread "TaskConsumer-Worker#7" [_thread_blocked, id=188]
0x008f00b0 JavaThread "TaskConsumer-Worker#6" [_thread_blocked, id=187]
0x008a0ea0 JavaThread "TaskConsumer-Worker#5" [_thread_blocked, id=186]
0x008a0148 JavaThread "TaskConsumer-Worker#4" [_thread_blocked, id=185]
0x0089f3f0 JavaThread "TaskConsumer-Worker#3" [_thread_blocked, id=184]
0x0089ddf0 JavaThread "TaskConsumer-Worker#2" [_thread_blocked, id=183]
0x0089cff8 JavaThread "TaskConsumer-Worker#1" [_thread_in_Java, id=182]
0x0089c2a0 JavaThread "TaskConsumer-Worker#0" [_thread_blocked, id=181]
0x0024dab0 JavaThread "JMSEventSession #29 on queue://TaskManagerQueue" [_thread_in_Java, id=180]
0x0024cd58 JavaThread "JMSEventSession #28 on queue://TaskManagerQueue" [_thread_in_Java, id=179]
0x0024c000 JavaThread "JMSEventSession #27 on queue://TaskManagerQueue" [_thread_blocked, id=178]
0x0024b2a8 JavaThread "JMSEventSession #26 on queue://TaskManagerQueue" [_thread_blocked, id=177]
0x0024a550 JavaThread "JMSEventSession #25 on queue://TaskManagerQueue" [_thread_in_native, id=176]
0x00890d88 JavaThread "JMSEventSession #24 on queue://TaskManagerQueue" [_thread_blocked, id=175]
0x00890030 JavaThread "JMSEventSession #23 on queue://TaskManagerQueue" [_thread_in_native, id=174]
0x0088f2d8 JavaThread "JMSEventSession #22 on queue://TaskManagerQueue" [_thread_in_native, id=173]
0x0088e580 JavaThread "JMSEventSession #21 on queue://TaskManagerQueue" [_thread_in_native, id=172]
0x00427ec8 JavaThread "JMSEventSession #20 on queue://TaskManagerQueue" [_thread_blocked, id=171]
0x00426b68 JavaThread "JMSEventSession #19 on queue://TaskManagerQueue" [_thread_in_Java, id=170]
0x00425e98 JavaThread "JMSEventSession #18 on queue://TaskManagerQueue" [_thread_blocked, id=169]
0x008ff2d0 JavaThread "JMSEventSession #17 on queue://TaskManagerQueue" [_thread_in_native, id=168]
0x008fe578 JavaThread "JMSEventSession #16 on queue://TaskManagerQueue" [_thread_in_native, id=167]
0x008fd820 JavaThread "JMSEventSession #15 on queue://TaskManagerQueue" [_thread_blocked, id=166]
0x003b1278 JavaThread "JMSEventSession #14 on queue://TaskManagerQueue" [_thread_in_native, id=165]
0x003b0520 JavaThread "JMSEventSession #13 on queue://TaskManagerQueue" [_thread_in_native, id=164]
0x0090e100 JavaThread "JMSEventSession #12 on queue://TaskManagerQueue" [_thread_in_native, id=163]
0x0090d3a8 JavaThread "JMSEventSession #11 on queue://TaskManagerQueue" [_thread_blocked, id=162]
0x008ae9b8 JavaThread "JMSEventSession #10 on queue://TaskManagerQueue" [_thread_in_native, id=161]
0x008adc90 JavaThread "JMSEventSession #9 on queue://TaskManagerQueue" [_thread_in_native, id=160]
0x008acfc8 JavaThread "JMSEventSession #8 on queue://TaskManagerQueue" [_thread_in_native, id=159]
0x0088d4b8 JavaThread "JMSEventSession #7 on queue://TaskManagerQueue" [_thread_blocked, id=158]
0x0088c750 JavaThread "JMSEventSession #6 on queue://TaskManagerQueue" [_thread_in_Java, id=157]
0x00866700 JavaThread "JMSEventSession #5 on queue://TaskManagerQueue" [_thread_in_native, id=156]
0x008acbb8 JavaThread "JMSEventSession #4 on queue://TaskManagerQueue" [_thread_in_Java, id=155]
0x004ed128 JavaThread "JMSEventSession #3 on queue://TaskManagerQueue" [_thread_in_Java, id=154]
=>0x00238508 JavaThread "JMSEventSession #2 on queue://TaskManagerQueue" [_thread_in_native, id=153]
0x0090a098 JavaThread "JMSEventSession #1 on queue://TaskManagerQueue" [_thread_in_native, id=152]
0x008fbf78 JavaThread "JMSEventSession #0 on queue://TaskManagerQueue" [_thread_blocked, id=151]
0x002322f0 JavaThread "Thread-154" daemon [_thread_blocked, id=55]
0x0032cce8 JavaThread "ShellController Listener" [_thread_in_native, id=54]
0x001d9338 JavaThread "ActiveMQ Scheduler" daemon [_thread_blocked, id=45]
0x00320010 JavaThread "Timer-1" [_thread_blocked, id=42]
0x003863e8 JavaThread "LineCheckerGate Retry Timer" [_thread_blocked, id=41]
0x002cf740 JavaThread "imqConsumerReader-1-5718468198242245632-1" [_thread_blocked, id=40]
0x002ce8a8 JavaThread "iMQReadChannel-1" [_thread_in_native, id=39]
0x002ce5d8 JavaThread "imqConnectionFlowControl-1" [_thread_blocked, id=38]
0x002cbf90 JavaThread "imqConsumerReader-0-5718468198242219008-0" [_thread_blocked, id=37]
0x003ce5f0 JavaThread "iMQReadChannel-0" [_thread_in_native, id=36]
0x00177088 JavaThread "imqConnectionFlowControl-0" [_thread_blocked, id=35]
0x00177688 JavaThread "HTTPGate Retry Timer" [_thread_blocked, id=34]
0x0016e1a0 JavaThread "ActiveMQ Scheduler" daemon [_thread_blocked, id=33]
0x0016e598 JavaThread "ActiveMQ Scheduler" daemon [_thread_blocked, id=32]
0x001206f0 JavaThread "ActiveMQ Scheduler" daemon [_thread_blocked, id=31]
0x00120528 JavaThread "ActiveMQ Scheduler" daemon [_thread_blocked, id=30]
0x0012c5f8 JavaThread "ActiveMQ Transport: tcp:///127.0.0.1:65327" daemon [_thread_in_native, id=29]
0x000b4568 JavaThread "ActiveMQ Transport: tcp://localhost/127.0.0.1:61635" [_thread_in_native, id=28]
0x000eaf88 JavaThread "ActiveMQ Transport Status Monitor: stomp://localhost:65000" daemon [_thread_blocked, id=26]
0x000eacb8 JavaThread "ActiveMQ Transport Server: stomp://localhost:65000" daemon [_thread_in_native, id=25]
0x000eb160 JavaThread "ActiveMQ Transport Status Monitor: tcp://localhost:61635" daemon [_thread_blocked, id=24]
0x000e6438 JavaThread "ActiveMQ Transport Server: tcp://localhost:61635" daemon [_thread_in_native, id=23]
0x00823d10 JavaThread "ActiveMQ Cleanup Timer" daemon [_thread_blocked, id=22]
0x007fd8a8 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=19]
0x007edcb0 JavaThread "RMI RenewClean-[10.228.32.116:65320]" daemon [_thread_blocked, id=17]
0x00690458 JavaThread "GC Daemon" daemon [_thread_blocked, id=15]
0x0069d0d8 JavaThread "RMI Reaper" [_thread_blocked, id=14]
0x0068f6d0 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=13]
0x0068b550 JavaThread "RMI TCP Accept-1099" daemon [_thread_in_native, id=11]
0x0068c098 JavaThread "Timer-0" daemon [_thread_blocked, id=10]
0x005e9290 JavaThread "EventDispatcher (EventDispatcher) Dispatch Timer" [_thread_blocked, id=9]
0x000e1a48 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=7]
0x000e0998 JavaThread "CompilerThread0" daemon [_thread_blocked, id=6]
0x000df5c8 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=5]
0x000d6f90 JavaThread "Finalizer" daemon [_thread_blocked, id=4]
0x000d62d0 JavaThread "Reference Handler" daemon [_thread_blocked, id=3]
0x00032360 JavaThread "main" [_thread_in_native, id=1]
Other Threads:
0x000d3ac8 VMThread [id=2]
0x000fc558 WatcherThread [id=8]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
def new generation total 108224K, used 100879K [0x15c00000, 0x1c8e0000, 0x2a950000)
eden space 104960K, 94% used [0x15c00000, 0x1bd063e0, 0x1c280000)
from space 3264K, 99% used [0x1c280000, 0x1c5afff8, 0x1c5b0000)
to space 3264K, 0% used [0x1c5b0000, 0x1c5b0000, 0x1c8e0000)
tenured generation total 867144K, used 579220K [0x2a950000, 0x5f822000, 0xd1400000)
the space 867144K, 66% used [0x2a950000, 0x4def51e0, 0x4def5200, 0x5f822000)
compacting perm gen total 21248K, used 21066K [0xd1400000, 0xd28c0000, 0xd5400000)
the space 21248K, 99% used [0xd1400000, 0xd2892a08, 0xd2892c00, 0xd28c0000)
ro space 8192K, 60% used [0xd5400000, 0xd58d6ca8, 0xd58d6e00, 0xd5c00000)
rw space 12288K, 44% used [0xd5c00000, 0xd6159258, 0xd6159400, 0xd6800000)
Dynamic libraries:
0x00010000 /opt/planb/bin/jsvc
0xff3a0000 /lib/libdl.so.1
0xff398000 /lib/libthread.so.1
0xff280000 /lib/libc.so.1
0xff390000 /platform/SUNW,Sun-Fire-V890/lib/libc_psr.so.1
0xf -
64bit JVM Crash: interaction between Concurrent GC and HotSpot Compiler?
During a test of a standalone server application, the application experienced a JVM crash for with no readily identifiable cause. We would like to at least come up with a theory to explain the crash; right now we have no idea what happened. We haven't found anything similar on the web so I am posting this to see if anybody has come across a similar problem.
The OS was 64bit Windows Server 2003 family on an AMD machine with 8 hyperthreaded CPUs (4 dual-core, I believe). The JVM was a 1.5.0 Server VM. An excerpt of the crash log is below.
The closest report we can find is Bug ID 5048441 which identified intermittent crashes with the Concurrent MarkSweep GC enabled; somebody claimed to have seen the problem under 1.5 but didn't have much more to add.
We haven't started heavily testing under 64bit just yet but we will be moving soon, so we would really appreciate hearing about similar experiences.
# An unexpected error has been detected by HotSpot Virtual Machine:
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000000805dd33, pid=5100,
tid=5636
# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.5.0_04-b05 mixed mode)
# Problematic frame:
# V [jvm.dll+0x5dd33]
--------------- T H R E A D ---------------
Current thread (0x00000000004ab8e0): JavaThread "CompilerThread1" daemon
[_thread_in_native, id=5636]
siginfo: ExceptionCode=0xc0000005, reading address 0x0000000000000000
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
par new generation total 42496K, used 27395K [0x000000007fff0000,
0x0000000082980000, 0x0000000082980000)
eden space 42432K, 64% used [0x000000007fff0000, 0x0000000081ab0de8,
0x0000000082960000)
from space 64K, 0% used [0x0000000082960000, 0x0000000082960000,
0x0000000082970000)
to space 64K, 0% used [0x0000000082970000, 0x0000000082970000,
0x0000000082980000)
concurrent mark-sweep generation total 30677440K, used 4502193K
[0x0000000082980000, 0x00000007d2ff0000, 0x00000007d2ff0000)
concurrent-mark-sweep perm gen total 21248K, used 12956K [0x00000007d2ff0000,
0x00000007d44b0000, 0x00000007d6ff0000)
VM Arguments:
jvm_args: -Xms30000M -Xmx30000M -enableassertions -XX:+PrintGCDetails
-XX:MaxPermSize=64M -XX:+PrintGCTimeStamps -XX:+UseParNewGC
-XX:+UseConcMarkSweepGC -Xdebug
-Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=5432 -verbose:gc
--------------- S Y S T E M ---------------
OS: Windows Server 2003 family Build 3790 Service Pack 1
CPU:total 8 em64t ht
Memory: 4k page, physical 33549364k(27243692k free), swap 45158008k(12023400k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (1.5.0_04-b05) for windows-amd64,
built on Jun 3 2005 01:43:58 by "java_re" with unknown MS VC++:1400I had a very similar experience on yesterday. It accepted my username and password, went to the next screen and when I clicked on transaction management, the screen went back to my desktop and and a notebook appeared (hs_err_pid3960). This is what the top portion said:
An unexpected error has been detected by HotSpot Virtual Machine:
Exception_Access_Violation (0xc0000005) at pc=0x6d700e9d, pid=3960, tid=968
Java VM: Java HotSpot (TM) Client VM (1.5.0_04-b05 mixed mode, sharing)
Problematic frame:
V [jvm.dll=0xc0e9d]
THREAD
Current thread (0x029ec868): VMThread [id=968]
siginfo: ExceptionCode=0xc0000005, reading address
This report is 4 pages long but it includes info on Registers, Top of Stack (sp=0x066cfba0), Instructions (pc=0x6d700e9d), Stack [0x065d0000, 0x066d0000), sp=0x066cfbao, free space=1022k. There were several Java Threads listed but they all said "thread blocked" and then listed an id=------. VM state: at safepoint (normal execution). It had Libraries, VM Arguments -xbootclasspath/a:c:\, and a few others. Environmental variables Path=C:
Processor_Identifier=x86 Family 15 Model 4 Stepping 1, GenuineIntel
OS: Windows XP Build 2600 Service Pack 2
CPU: total 2 family 15
Memory: 4k page,
vm_info: Java HotSpot (TM) Client VM (1.5.0_04-b05) for windows-x86, built on June 3, 2005 by "java_re" with MS VC++ 6.0
Now that I have given this info to you, how do I eleviate the problem so that I will be able to do my job. Without this function, I cannot perform an important part of my job. I am hoping that this info will help you all find out the problem and prevent it from continuing to happen. -
Hi,
I have an application which works fine on Windows environment. If the ear prepared on Windows is deployed on Unix it works fine. But when the application is build in Unix, the application gets deployed but when accessing the application it crashes.
I have pasted the crash details below
0xf9540000 /anfield/opt/bea/wls/8.1sp3/jdk142_04/jre/lib/sparc/libioser12.so
0xdf650000 /anfield/mqseries1/opt/mqm/java/lib/libmqjbnd05.so
0xdf610000 /opt/mqm/lib/libmqm.so
0xdbf80000 /opt/mqm/lib/libmqz.so
0xdbe00000 /opt/mqm/lib/libmqmcs.so
0xdf560000 /opt/mqm/lib/libmqmzse.so
0xdf530000 /anfield/mqseries1/opt/mqm/java/lib/libmqjbdf02.so
0xdf510000 /anfield/mqseries1/opt/mqm/java/lib/libMQXAi02.so
Heap at VM Abort:
Heap
def new generation total 32768K, used 25924K [0xe4c00000, 0xe6cf0000, 0xe8ea0000)
eden space 31808K, 81% used [0xe4c00000, 0xe65510f0, 0xe6b10000)
from space 960K, 0% used [0xe6b10000, 0xe6b10000, 0xe6c00000)
to space 960K, 0% used [0xe6c00000, 0xe6c00000, 0xe6cf0000)
tenured generation total 67296K, used 40373K [0xe8ea0000, 0xed058000, 0xf1400000)
the space 67296K, 59% used [0xe8ea0000, 0xeb60d7c0, 0xeb60d800, 0xed058000)
compacting perm gen total 40960K, used 40910K [0xf1400000, 0xf3c00000, 0xf9400000)
the space 40960K, 99% used [0xf1400000, 0xf3bf3818, 0xf3bf3a00, 0xf3c00000)
Local Time = Tue Feb 21 06:58:18 2006
Elapsed Time = 207
# HotSpot Virtual Machine Error : 11
# Error ID : 4F530E43505002EF 01
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
# Java VM: Java HotSpot(TM) Server VM (1.4.2_04-b05 mixed mode)
# An error report file has been saved as hs_err_pid7291.log.
# Please refer to the file for further information.
I think I have localised the crash to a section of the code where there is character comparison done. If I comment out this section, it works fine. I ahve pasted below the section:
else if (getChar() == '\'' && getOffset() < getBuffer().length())
{ // Start of a Literal - so just copy until the end of the literal
do
sb.append(getChar());
setChar(getNextChar());
while (getChar() != '\'' && getOffset() < getBuffer().length());
sb.append(getChar()); // Append the final single quote
setChar(getNextChar());
After substituting " ' "for it integer value, I started getting a JVM crash with a different error id.; pasted it below
[Loaded javax.servlet.http.HttpServletResponseWrapper]
[Loaded weblogic.servlet.internal.RemoveWrapperOnForward]
[Loaded weblogic.servlet.jsp.NestedBodyResponse]
[Loaded weblogic.servlet.jsp.BodyOutputStream]
[Loaded java.io.CharArrayReader from /anfield/opt/bea/wls/8.1sp3/jdk142_04/jre/lib/rt.jar]
[Loaded weblogic.servlet.internal.CharChunkOutput]
[Loaded sun.io.ConversionBufferFullException from /anfield/opt/bea/wls/8.1sp3/jdk142_04/jre/lib/rt.jar]
[Loaded org.apache.struts.taglib.html.SubmitTag]
# HotSpot Virtual Machine Error, Internal Error
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
# Java VM: Java HotSpot(TM) Server VM (1.4.2_04-b05 mixed mode)
# Error ID: 4255494C442F4F502D41500E4350500107 01
# Problematic Thread: prio=5 tid=0x000ea6f0 nid=0xa runnable
Heap at VM Abort:
Heap
def new generation total 25088K, used 1933K [0xe4c00000, 0xe6530000, 0xe8ea0000)
eden space 24384K, 5% used [0xe4c00000, 0xe4d33408, 0xe63d0000)
from space 704K, 99% used [0xe6480000, 0xe652fff8, 0xe6530000)
to space 704K, 0% used [0xe63d0000, 0xe63d0000, 0xe6480000)
tenured generation total 51432K, used 43087K [0xe8ea0000, 0xec0da000, 0xf1400000)
the space 51432K, 83% used [0xe8ea0000, 0xeb8b3e90, 0xeb8b4000, 0xec0da000)
compacting perm gen total 40960K, used 40883K [0xf1400000, 0xf3c00000, 0xf9400000)
the space 40960K, 99% used [0xf1400000, 0xf3becc48, 0xf3bece00, 0xf3c00000)
Could you please help me to find out the cause? Also how do you make sense of the details(which I have pasted above) in the logs written at time of crash. Is there anyway to look at the core files other than dbx or gdb?
Thanks,
RageshHi,
I have an application which works fine on Windows environment. If the application prepared on Windows is deployed on Unix but when accessing it crashes.
here by i am pasting the error.
# An unexpected error has been detected by HotSpot Virtual Machine:
# SIGSEGV (0xb) at pc=0x2a6f5075, pid=5044, tid=8201
# Java VM: Java HotSpot(TM) Client VM (1.4.2_10-b03 mixed mode)
# Problematic frame:
# j e4p_DecisionMaker.makeDecision(Le4p_InitailArrayContainer;I)I+2668
--------------- T H R E A D ---------------
Current thread (0x082a3ed8): JavaThread "Thread-0" [_thread_in_Java, id=5330]
siginfo:si_signo=11, si_errno=-1071498229, si_code=12, si_addr=0x00000000
Registers:
EAX=0x04000000, EBX=0x30797160, ECX=0x00000000, EDX=0x0c800002
ESP=0xbe5ff960, EBP=0xbe5ff988, ESI=0x30ac7d44, EDI=0xbe5ff9b8
EIP=0x2a6f5075, CR2=0xc580a700, EFLAGS=0x00010206
Top of Stack: (sp=0xbe5ff960)
0xbe5ff960: 2a6e8d43 30ac8950 00000000 be5ff96c
0xbe5ff970: 30ac7d44 be5ff9b8 30ac80f0 00000000
0xbe5ff980: 30ac7290 be5ff9b0 be5ff9d8 2a6e8def
0xbe5ff990: 00000000 00000000 00000000 00000000
0xbe5ff9a0: 00000000 00000001 00000000 00000000
0xbe5ff9b0: 00000005 2cd46c58 2c798b58 be5ff9bc
0xbe5ff9c0: 30a772f7 be5ffa1c 30a81da8 00000000
0xbe5ff9d0: 30a771a0 be5ffa1c be5ffa3c 2a6e8e9b
Instructions: (pc=0x2a6f5075)
0x2a6f5065: 75 e8 8b c2 81 e0 00 00 00 04 0f 84 05 00 00 00
0x2a6f5075: 3b 01 ff 63 3c 8b 41 04 8b 9c 98 dc 00 00 00 8b
Stack: [0xbe40e000,0xbe600000), sp=0xbe5ff960, free space=1990k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
j e4p_DecisionMaker.makeDecision(Le4p_InitailArrayContainer;I)I+2668
j e4p_Schedular.scheduleCaller()V+271
j e4p_ModuleIterator.run()V+34
j java.util.TimerThread.mainLoop()V+221
j java.util.TimerThread.run()V+1
v ~StubRoutines::call_stub
V [libjvm.so+0x1a8aa4]
V [libjvm.so+0x25e605]
V [libjvm.so+0x1a8cf6]
V [libjvm.so+0x1a85c6]
V [libjvm.so+0x1a913f]
V [libjvm.so+0x203695]
V [libjvm.so+0x2aaa9a]
V [libjvm.so+0x2a5f57]
V [libjvm.so+0x260113]
C [libpthread.so.0+0x5b85] pthread_detach+0x515
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x082922e8 JavaThread "Thread-5" [_thread_blocked, id=5335]
0x0825a818 JavaThread "Thread-4" [_thread_blocked, id=5334]
0x0828e8a0 JavaThread "Thread-3" [_thread_in_native, id=5333]
0x082553d8 JavaThread "DestroyJavaVM" [_thread_blocked, id=5044]
0x082a3980 JavaThread "Thread-2" [_thread_blocked, id=5332]
0x082a3800 JavaThread "Thread-1" [_thread_blocked, id=5331]
=>0x082a3ed8 JavaThread "Thread-0" [_thread_in_Java, id=5330]
0x080995d0 JavaThread "CompilerThread0" daemon [_thread_blocked, id=5328]
0x080987f8 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=5327]
0x080954d8 JavaThread "Finalizer" daemon [_thread_blocked, id=5325]
0x080939f8 JavaThread "Reference Handler" daemon [_thread_blocked, id=5324]
Other Threads:
0x08090880 VMThread [id=5323]
0x080b45c8 WatcherThread [id=5329]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
def new generation total 576K, used 190K [0x2c790000, 0x2c830000, 0x2cc70000)
eden space 512K, 24% used [0x2c790000, 0x2c7afbd8, 0x2c810000)
from space 64K, 100% used [0x2c810000, 0x2c820000, 0x2c820000)
to space 64K, 0% used [0x2c820000, 0x2c820000, 0x2c830000)
tenured generation total 1408K, used 1105K [0x2cc70000, 0x2cdd0000, 0x30790000)
the space 1408K, 78% used [0x2cc70000, 0x2cd845a0, 0x2cd84600, 0x2cdd0000)
compacting perm gen total 4096K, used 3457K [0x30790000, 0x30b90000, 0x34790000)
the space 4096K, 84% used [0x30790000, 0x30af0400, 0x30af0400, 0x30b90000)
Dynamic libraries: -
Solaris 8 JVM crash 1.4.2_05 - Heap at VM abort
Hi,
In one of our applications, we are facing jvm crash after 9-10 hrs of server run. Following text is printed.
Any pointers to help resolve this wud be of gr8 help.
# HotSpot Virtual Machine Error, Internal Error
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
# Java VM: Java HotSpot(TM) Server VM (1.4.2_05-b04 mixed mode)
# Error ID: 434F44452255464645520E435050005E 01
# Problematic Thread: prio=5 tid=0x000f4ab0 nid=0xa runnable
Heap at VM Abort:
Heap
def new generation total 678464K, used 347018K [0x71400000, 0x9bea0000, 0x9bea0000)
eden space 657920K, 52% used [0x71400000, 0x866e2b50, 0x99680000)
from space 20544K, 0% used [0x99680000, 0x99680000, 0x9aa90000)
to space 20544K, 0% used [0x9aa90000, 0x9aa90000, 0x9bea0000)
tenured generation total 1398144K, used 50817K [0x9bea0000, 0xf1400000, 0xf1400000)
the space 1398144K, 3% used [0x9bea0000, 0x9f040780, 0x9f040800, 0xf1400000)
compacting perm gen total 46848K, used 46753K [0xf1400000, 0xf41c0000, 0xf9400000)
the space 46848K, 99% used [0xf1400000, 0xf41a8460, 0xf41a8600, 0xf41c0000)
thanks,
Nikhil.Hi
It seems that you are meeting the same problem with this.
http://forum.java.sun.com/thread.jsp?forum=37&thread=549523&tstart=0&trange=15
You cant find the signal? Can you show the thread at the very top?
Sometimes u do need to set -XX:MaxPermSize=256M, depending on how much memory you have allocated, requirements etc.
pstack only can shows the native stack. It will be good to know what was running when it failed.
Maybe you are looking for
-
Using Mail how do you get an attachment to post as an actual attachment rather than as an image in the mail. If I sign a document, then scan it, and attach the jpeg to an email it is incorporated into the mail as an image. Same thing happens if the
-
Low airport Missing printer, keychains after upgrade
Ok I installed leopard and then updated. I choose install with archiving the old system. Now I have: low airport Missing printer, keychains. Where are they? What did I do wrong here? Thanks' Theo
-
Cant get adobe lightroom 3 to run
Hello out there: I just instead the Lightroom3 no problems with installation or serial number. However I have windows 7 and when I click on the Icon to get the program up and running, I get a message saying: program shut down Windows will contact you
-
When shopping for music, is there a way to play the results like playlist?
This pertains to shopping for music on the Apple store. When I display all the songs by a particular artist, it becomes real OLD to click 100 songs. Is there a way to play them ALL in the same manner as a playlist? That is, when the 30-second sample
-
well heres my problem i want too make an program clien and server that can send commands and responses but these commands will have a string after it i need too know how too get that string into the method wich execues the command for exaple picture