Weblogic Server hanging at high load!!!!!!!!!!!
Folks,
We have a weblogic server 9.2 which is running fine but after quiet a while at high load we observe that the server goes down and following exception is displayed in the server logs:
####<Nov 13, 2009 2:42:48 AM EST> <Error> <WebLogicServer> <ibmrxcptpnp-wb1> <AdminServer> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1258098168215> <BEA-000337> <[STUCK] ExecuteThread: '9' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "617" seconds working on the request "weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl@1cec1cec", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
java.net.SocketOutputStream.socketWrite0(Native Method)
java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:105)
java.net.SocketOutputStream.write(SocketOutputStream.java:149)
oracle.net.ns.DataPacket.send(Unknown Source)
oracle.net.ns.NetOutputStream.flush(Unknown Source)
oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1099)
oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1070)
oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:478)
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216)
oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:955)
oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1060)
oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:839)
oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1132)
oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3316)
oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3422)
weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:718)
weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:460)
weblogic.common.resourcepool.ResourcePoolImpl.checkResource(ResourcePoolImpl.java:1455)
weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1372)
weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1362)
weblogic.common.resourcepool.ResourcePoolImpl.testUnusedResources(ResourcePoolImpl.java:1767)
weblogic.common.resourcepool.ResourcePoolImpl.access$700(ResourcePoolImpl.java:37)
weblogic.common.resourcepool.ResourcePoolImpl$ResourcePoolMaintanenceTask.timerExpired(ResourcePoolImpl.java:1935)
weblogic.timers.internal.TimerImpl.run(TimerImpl.java:265)
weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl.run(ServerWorkManagerImpl.java:518)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
>
Any answers?????
Hi,
I have a similar issue on ODSI 10gR3 (WLS 10.3). I am having stuck threads - but, in my case it is clear that the database is down (not at the startup)
Here is some more info:
1. Test Connections On Reserve - Enabled
2. Default values for other parameters
Using Oracle thin driver for the connection pool "MyPool" -
./wlserver_10.3/server/lib/ojdbc6.jar
My question is:
1. How do I avoid the stuck thread caused when the database is down? During peak load, the stuck threads are causing some service requests to fail.
I did my homework and the closest option I could find is set the statementTimeout (which is set currently to the default value of -1 i.e. never timeout). Oracle documentation (http://www.oracle.com/technology/software/tech/java/sqlj_jdbc/htdocs/111070_readme.html) says that the ojdbc6.jar supports setQueryTimeout() method.
Is there any better way to attack this problem?
<Dec 21, 2009 12:11:18 AM EST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "MyPool" failed with exception: "java.sql.SQLRecoverableException: Io exception: Read failed: Connection timed out".>
<Dec 21, 2009 12:14:27 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:18:38 AM EST> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "600" seconds working on the request "weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl@297ac2b", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-52 "[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, waiting, priority=1, DAEMON> {
-- Waiting for notification on: javax.management.remote.rmi.RMIConnector$RMINotifClient@271498f[fat lock]
java.lang.Object.wait(Object.java:485)
com.sun.jmx.remote.internal.ClientNotifForwarder.postReconnection(ClientNotifForwarder.java:304)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.reconnectNotificationListeners(RMIConnector.java:1488)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.doStart(RMIConnector.java:1568)
com.sun.jmx.remote.internal.ClientCommunicatorAdmin.restart(ClientCommunicatorAdmin.java:72)
com.sun.jmx.remote.internal.ClientCommunicatorAdmin.gotIOException(ClientCommunicatorAdmin.java:34)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.gotIOException(RMIConnector.java:1420)
javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getAttribute(RMIConnector.java:857)
weblogic.management.mbeanservers.domainruntime.internal.ManagedMBeanServerConnection.getAttribute(ManagedMBeanServerConnection.java:288)
javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:235)
weblogic.management.jmx.MBeanServerInvocationHandler.doInvoke(MBeanServerInvocationHandler.java:477)
weblogic.management.jmx.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:294)
$Proxy69.getServerRuntime(Unknown Source)
weblogic.management.mbeanservers.domainruntime.internal.DomainRuntimeServiceMBeanImpl.lookupServerRuntime(DomainRuntimeServiceMBeanImpl.java:242)
sun.reflect.GeneratedMethodAccessor1880.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
weblogic.management.jmx.modelmbean.WLSModelMBean.invoke(WLSModelMBean.java:355)
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:831)
com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
weblogic.management.mbeanservers.domainruntime.internal.FederatedMBeanServerInterceptor.invoke(FederatedMBeanServerInterceptor.java:255)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:447)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:441)
weblogic.management.mbeanservers.internal.SecurityMBeanMgmtOpsInterceptor.invoke(SecurityMBeanMgmtOpsInterceptor.java:55)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:447)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:441)
weblogic.management.mbeanservers.internal.SecurityInterceptor.invoke(SecurityInterceptor.java:437)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor$10$1.run(AuthenticatedSubjectInterceptor.java:582)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor$10.run(AuthenticatedSubjectInterceptor.java:576)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:350)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor.invoke(AuthenticatedSubjectInterceptor.java:570)
weblogic.management.jmx.mbeanserver.WLSMBeanServer.invoke(WLSMBeanServer.java:305)
javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1378)
javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1264)
javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1338)
javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:761)
javax.management.remote.rmi.RMIConnectionImpl_WLSkel.invoke(Unknown Source)
weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:136)
weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:211)
javax.management.remote.rmi.RMIConnectionImpl_1030_WLStub.invoke(Unknown Source)
javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:969)
com.bea.diagnostics.server.MBeanServerUtil.processRecordsFromArchive(MBeanServerUtil.java:177)
com.bea.diagnostics.server.MetricEarliestTimestampLocator$RecordProcessorDesc.identifyEarliestTimestamps(MetricEarliestTimestampLocator.java:261)
com.bea.diagnostics.server.MetricEarliestTimestampLocator.identifyEarliestTimestamps(MetricEarliestTimestampLocator.java:84)
com.bea.diagnostics.server.MetricEarliestTimestampLocator.timerExpired(MetricEarliestTimestampLocator.java:79)
weblogic.timers.internal.TimerImpl.run(TimerImpl.java:253)
weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:516)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:198)
weblogic.work.ExecuteThread.run(ExecuteThread.java:165)
<Dec 21, 2009 12:24:04 AM EST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "MyPool" failed with exception: "java.sql.SQLRecoverableException: Io exception: Connection reset".>
<Dec 21, 2009 12:24:04 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:04 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:05 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:07 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:12 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:17 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:22 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
Similar Messages
-
My WebLogic Server hang up sometime. The platform is IBM AIX, weblogic 8.1 with sp3
The following is the thread dump:
NULL ------------------------------------------------------------------------
0SECTION TITLE subcomponent dump routine
NULL ===============================
1TISIGINFO signal 3 received
1TIDATETIME Date: 2007/04/26 at 11:13:10
1TIFILENAME Javacore filename: /var/bea/domains/TazDomain/javacore524292.1177600390.txt
NULL ------------------------------------------------------------------------
0SECTION XHPI subcomponent dump routine
NULL ==============================
1XHTIME Thu Apr 26 11:13:10 2007
1XHSIGRECV SIGQUIT received at 0x0 in <unknown>.
1XHFULLVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
NULL
1XHCURRENTTHD Current Thread Details
NULL ----------------------
2XHCURRSYSTHD "Signal dispatcher" sys_thread_t:0x74427A28
3XHNATIVESTACK Native Stack
NULL ------------
3XHSTACKLINEERR unavailable - stack address not valid
1XHOPENV Operating Environment
NULL ---------------------
2XHHOSTNAME Host : rcirs050:10.1.93.20
2XHOSLEVEL OS Level : AIX 5.3.0.0
2XHCPUS Processors -
3XHCPUARCH Architecture : POWER_PC (impl: unknown, ver: unknown)
3XHNUMCPUS How Many : 2
3XHCPUSENABLED Enabled : 2
NULL
1XHUSERLIMITS User Limits (in bytes except for NOFILE and NPROC) -
NULL -----------
2XHUSERLIMIT RLIMIT_FSIZE : 1073741312
2XHUSERLIMIT RLIMIT_DATA : 2147483645
2XHUSERLIMIT RLIMIT_STACK : 33554432
2XHUSERLIMIT RLIMIT_CORE : 1073741312
2XHUSERLIMIT RLIMIT_NOFILE : 1024
2XHLIMIT NPROC(max) : 128
NULL
1XHPAGESPACES Page Space (in blocks) -
NULL ----------
2XHPAGESPACE /dev/hd6: size=262144, free=261912
2XHPAGESPACE /dev/paging03: size=507904, free=507672
2XHPAGESPACE /dev/paging00: size=262144, free=261917
2XHPAGESPACE /dev/paging01: size=262144, free=261903
2XHPAGESPACE /dev/paging02: size=262144, free=261901
2XHPAGESPACE /dev/paging04: size=262144, free=260986
2XHPAGESPACE /dev/paging07: size=262144, free=261911
2XHPAGESPACE /dev/paging06: size=262144, free=261913
2XHPAGESPACE /dev/paging05: size=262144, free=261913
NULL
1XHSIGHANDLERS JVM Signal Handlers
NULL -------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHSIGHANDLERS Chained Signal Handlers
NULL -----------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHENVVARS Environment Variables
NULL ---------------------
2XHENVVAR _=/usr/java14/bin/java
2XHENVVAR JAVA_VENDOR=IBM
2XHENVVAR LANG=C
2XHENVVAR PRODUCTION_MODE=
2XHENVVAR LOGIN=qatadm
2XHENVVAR CLASSPATHSEP=:
2XHENVVAR VISUAL=vi
2XHENVVAR POINTBASE_HOME=/opt/bea/weblogic81/common/eval/pointbase
2XHENVVAR PATH=/opt/bea/weblogic81/server/bin:/usr/java14/jre/bin:/usr/java14/bin:/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/qatadm/bin:/usr/bin/X11:/sbin:.:/usr/java14/bin
2XHENVVAR JAVA_VM=
2XHENVVAR LC__FASTMSG=true
2XHENVVAR POINTBASE_CLASSPATH=:/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar
2XHENVVAR CLASSPATH=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2XHENVVAR LOGNAME=qatadm
2XHENVVAR MAIL=/usr/spool/mail/qatadm
2XHENVVAR POINTBASE_TOOLS=/opt/bea/weblogic81/common/eval/pointbase/lib/pbtools44.jar
2XHENVVAR LOCPATH=/usr/lib/nls/loc
2XHENVVAR PS1=rcirs050:$PWD>
2XHENVVAR PATHSEP=:
2XHENVVAR USER=qatadm
2XHENVVAR AUTHSTATE=compat
2XHENVVAR BEA_HOME=/opt/bea
2XHENVVAR DCE_USE_WCHAR_NAMES=1
2XHENVVAR SHELL=/usr/bin/ksh
2XHENVVAR ODMDIR=/etc/objrepos
2XHENVVAR JAVA_HOME=/usr/java14
2XHENVVAR TIMEOUT=900
2XHENVVAR TMOUT=900
2XHENVVAR HOME=/home/qatadm
2XHENVVAR MEM_ARGS=-Xms512m -Xmx1024m
2XHENVVAR WEBLOGIC_CLASSPATH=/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar
2XHENVVAR TERM=dtterm
2XHENVVAR MAILMSG=[YOU HAVE NEW MAIL]
2XHENVVAR PWD=/var/bea/domains/TazDomain
2XHENVVAR TZ=EST5EDT
2XHENVVAR WL_HOME=/opt/bea/weblogic81
2XHENVVAR AIXTHREAD_SCOPE=S
2XHENVVAR A__z=! LOGNAME="*TMOUT
2XHENVVAR _IBM_JAVA_PIPE_524292=
2XHENVVAR IBM_JVM_LIBPATH_OLD_VALUE=/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_LIBPATH_NEW_VALUE=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_CHANGED_ENVVARS_524292=LIBPATH,LDR_CNTRL
2XHENVVAR IBM_JVM_LDR_CNTRL_NEW_VALUE=MAXDATA=0XA0000000@DSA
2XHENVVAR LDR_CNTRL=MAXDATA=0XA0000000@DSA
2XHENVVAR NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
2XHENVVAR LIBPATH=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR _IBM_ENV_INITIAL_524292=805345384
2XHENVVAR IBM_JAVA_COMMAND_LINE=/usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
NULL
1XHLOADEDLIBS Loaded Libraries (sizes in bytes)
NULL ---------------------------------
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libmuxer.so
3XHLIBSIZE filesize : 20757
3XHLIBSTART text start : 0xD0B88000
3XHLIBLDSIZE text size : 0x282E
3XHLIBLDORG data start : 0xF0617CF4
3XHLIBLDDATASZ data size : 0x2AC
2XHLIBNAME /usr/java14/jre/bin/libnio.a
3XHLIBSIZE filesize : 64305
3XHLIBSTART text start : 0xD11F5000
3XHLIBLDSIZE text size : 0x8EF0
3XHLIBLDORG data start : 0xF0615AE0
3XHLIBLDDATASZ data size : 0x594
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libweblogicunix1.so
3XHLIBSIZE filesize : 14536
3XHLIBSTART text start : 0xD0B86000
3XHLIBLDSIZE text size : 0x1B90
3XHLIBLDORG data start : 0xF0614484
3XHLIBLDDATASZ data size : 0xD8
2XHLIBNAME /usr/java14/jre/bin/libnet.a
3XHLIBSIZE filesize : 137885
3XHLIBSTART text start : 0xD15D7000
3XHLIBLDSIZE text size : 0x161FF
3XHLIBLDORG data start : 0xF05DE3D8
3XHLIBLDDATASZ data size : 0x968
2XHLIBNAME /usr/java14/jre/bin/libjitc.a
3XHLIBSIZE filesize : 2814544
3XHLIBSTART text start : 0xD252E000
3XHLIBLDSIZE text size : 0x23EE7B
3XHLIBLDORG data start : 0xF0962B68
3XHLIBLDDATASZ data size : 0x1A984
2XHLIBNAME /usr/lib/security/DCE
3XHLIBSIZE filesize : 27634
3XHLIBSTART text start : 0xD0B7A000
3XHLIBLDSIZE text size : 0x6BF2
3XHLIBLDORG data start : 0xF05CEA38
3XHLIBLDDATASZ data size : 0x2BA0
2XHLIBNAME /usr/java14/jre/bin/libzip.a
3XHLIBSIZE filesize : 109746
3XHLIBSTART text start : 0xD11E1000
3XHLIBLDSIZE text size : 0x135E2
3XHLIBLDORG data start : 0xF05DC468
3XHLIBLDDATASZ data size : 0x1918
2XHLIBNAME /usr/java14/jre/bin/classic/libcore.a
3XHLIBSIZE filesize : 136713
3XHLIBSTART text start : 0xD11CB000
3XHLIBLDSIZE text size : 0x15248
3XHLIBLDORG data start : 0xF05DA0E8
3XHLIBLDDATASZ data size : 0x1620
2XHLIBNAME /usr/java14/jre/bin/libjava.a
3XHLIBSIZE filesize : 221158
3XHLIBSTART text start : 0xD11AB000
3XHLIBLDSIZE text size : 0x1FEB2
3XHLIBLDORG data start : 0xF05D88F8
3XHLIBLDDATASZ data size : 0x16F8
2XHLIBNAME /usr/java14/jre/bin/libhpi.a
3XHLIBSIZE filesize : 205732
3XHLIBSTART text start : 0xD118C000
3XHLIBLDSIZE text size : 0x1EE0E
3XHLIBLDORG data start : 0xF06045A0
3XHLIBLDDATASZ data size : 0xF8D0
2XHLIBNAME /usr/java14/jre/bin/libxhpi.a
3XHLIBSIZE filesize : 14654
3XHLIBSTART text start : 0xD0B84000
3XHLIBLDSIZE text size : 0x1B52
3XHLIBLDORG data start : 0xF05D7290
3XHLIBLDDATASZ data size : 0x2C8
2XHLIBNAME /usr/java14/jre/bin/libdbgmalloc.a
3XHLIBSIZE filesize : 15267
3XHLIBSTART text start : 0xD0B81000
3XHLIBLDSIZE text size : 0x217C
3XHLIBLDORG data start : 0xF05D6988
3XHLIBLDDATASZ data size : 0x218
2XHLIBNAME /usr/java14/jre/bin/libjsig.a
3XHLIBSIZE filesize : 14412
3XHLIBSTART text start : 0xD07F8000
3XHLIBLDSIZE text size : 0x1B24
3XHLIBLDORG data start : 0xF05D54B0
3XHLIBLDDATASZ data size : 0x108
2XHLIBNAME /usr/java14/jre/bin/libute.a
3XHLIBSIZE filesize : 112768
3XHLIBSTART text start : 0xD1177000
3XHLIBLDSIZE text size : 0x14ED9
3XHLIBLDORG data start : 0xF05D43B0
3XHLIBLDDATASZ data size : 0x674
2XHLIBNAME /usr/lib/libdl.a
3XHLIBSIZE filesize : 5248
3XHLIBSTART text start : 0xD02E70F8
3XHLIBLDSIZE text size : 0x1E0
3XHLIBLDORG data start : 0xF03190F8
3XHLIBLDDATASZ data size : 0x0
2XHLIBNAME /usr/java14/jre/bin/sovvm/libjvm.a
3XHLIBSIZE filesize : 2857303
3XHLIBSTART text start : 0xD2335000
3XHLIBLDSIZE text size : 0x1F8E31
3XHLIBLDORG data start : 0xF0936290
3XHLIBLDDATASZ data size : 0x2AE10
2XHLIBNAME /usr/java14/jre/bin/classic/libjvm.a
3XHLIBSIZE filesize : 117748
3XHLIBSTART text start : 0xD1169000
3XHLIBLDSIZE text size : 0xD54B
3XHLIBLDORG data start : 0xF05D2A90
3XHLIBLDDATASZ data size : 0xF0C
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01E7540
3XHLIBLDSIZE text size : 0x20F6D
3XHLIBLDORG data start : 0xF0381340
3XHLIBLDDATASZ data size : 0x6780
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01CDBC0
3XHLIBLDSIZE text size : 0x186CC
3XHLIBLDORG data start : 0xF0377FC0
3XHLIBLDDATASZ data size : 0x84C9
2XHLIBNAME /usr/lib/libcrypt.a
3XHLIBSIZE filesize : 11019
3XHLIBSTART text start : 0xD01450F8
3XHLIBLDSIZE text size : 0x846
3XHLIBLDORG data start : 0xF0316508
3XHLIBLDDATASZ data size : 0x128
2XHLIBNAME /usr/lib/libiconv.a
3XHLIBSIZE filesize : 377727
3XHLIBSTART text start : 0xD05BF100
3XHLIBLDSIZE text size : 0x139C1
3XHLIBLDORG data start : 0xF0252C70
3XHLIBLDDATASZ data size : 0xA2E4
2XHLIBNAME /usr/lib/libbsd.a
3XHLIBSIZE filesize : 61862
3XHLIBSTART text start : 0xD02784C0
3XHLIBLDSIZE text size : 0x7D2F
3XHLIBLDORG data start : 0xF0213A30
3XHLIBLDDATASZ data size : 0x13D8
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010E000
3XHLIBLDSIZE text size : 0x365C4
3XHLIBLDORG data start : 0xF0370000
3XHLIBLDDATASZ data size : 0x4024
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010A000
3XHLIBLDSIZE text size : 0x3C52
3XHLIBLDORG data start : 0xF032D000
3XHLIBLDDATASZ data size : 0x424A8
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01AD100
3XHLIBLDSIZE text size : 0x1FED1
3XHLIBLDORG data start : 0xF0388D00
3XHLIBLDDATASZ data size : 0x30F9
2XHLIBNAME /usr/lib/libc.a
3XHLIBSIZE filesize : 8270989
3XHLIBSTART text start : 0xD02F2240
3XHLIBLDSIZE text size : 0x251155
3XHLIBLDORG data start : 0xF0278BC0
3XHLIBLDDATASZ data size : 0x9D340
NULL
NULL ------------------------------------------------------------------------
0SECTION CI subcomponent dump routine
NULL ============================
1CIJAVAVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
1CIRUNNINGAS Running as a standalone JVM
1CICMDLINE /usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
1CIJAVAHOMEDIR Java Home Dir: /usr/java14/jre
1CIJAVADLLDIR Java DLL Dir: /usr/java14/jre/bin
1CISYSCP Sys Classpath: /usr/java14/jre/lib/core.jar:/usr/java14/jre/lib/graphics.jar:/usr/java14/jre/lib/security.jar:/usr/java14/jre/lib/server.jar:/usr/java14/jre/lib/xml.jar:/usr/java14/jre/lib/charsets.jar:/usr/java14/jre/classes:/usr/java14/jre/lib/ibmcertpathprovider.jar:/usr/java14/jre/lib/ibmjaaslm.jar:/usr/java14/jre/lib/ibmjcefw.jar:/usr/java14/jre/lib/ibmjgssprovider.jar:/usr/java14/jre/lib/ibmjssefips.jar:/usr/java14/jre/lib/ibmjsseprovider.jar:/usr/java14/jre/lib/ibmorb.jar:/usr/java14/jre/lib/ibmorbapi.jar:/usr/java14/jre/lib/ibmpkcs.jar
1CIUSERARGS UserArgs:
2CIUSERARG vfprintf 0x30000D94
2CIUSERARG -Xms512m
2CIUSERARG -Xmx1024m
2CIUSERARG -Duser.timezone=America/New_York
2CIUSERARG -Dweblogic.Name=TazServer
2CIUSERARG -Dweblogic.ProductionModeEnabled=
2CIUSERARG -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy
2CIUSERARG -Dinvokedviajava
2CIUSERARG -Djava.class.path=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2CIUSERARG vfprintf
NULL
1CIJVMMI JVM Monitoring Interface (JVMMI)
NULL ------------------------
2CIJVMMIOFF No events are enabled.
NULL
NULL ------------------------------------------------------------------------
0SECTION DC subcomponent dump routine
NULL ============================
1DCHEADEREYE Header eye catcher DCST
1DCHEADERLEN Header length 24
1DCHEADERVER Header version 1
1DCHEADERMOD Header modification 0
1DCINTERFACE DC Interface at 0xF0947FDC with 15 entries
2DCINTERFACE 1 - dcCString2JavaString 0xF0944A90
2DCINTERFACE 2 - dcInt642CString 0xF0944A9C
2DCINTERFACE 3 - dcJavaString2NewCString 0xF0944AA8
2DCINTERFACE 4 - dcJavaString2CString 0xF0944AB4
2DCINTERFACE 5 - dcJavaString2NewPlatformString 0xF0944AC0
2DCINTERFACE 6 - dcJavaString2UTF 0xF0944ACC
2DCINTERFACE 7 - dcPlatformString2JavaString 0xF0944AE4
2DCINTERFACE 8 - dcUnicode2UTF 0xF0944AF0
2DCINTERFACE 9 - dcUnicode2UTFLength 0xF0944AFC
2DCINTERFACE 10 - dcUTF2JavaString 0xF0944B08
2DCINTERFACE 11 - dcUTFClassName2JavaString 0xF0944B14
2DCINTERFACE 12 - dcJavaString2ClassName 0xF0944AD8
2DCINTERFACE 13 - dcUTF2UnicodeNext 0xF0944B20
2DCINTERFACE 14 - dcVerifyUTF8 0xF0944B2C
2DCINTERFACE 15 - dcDumpRoutine 0xF0944B38
1DCARRAYINFO Array info at 0xF09384A0 with 16 entries
2DCARRAYINFO 1 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 2 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 3 - index 2 signature L name class[] factor 4
2DCARRAYINFO 4 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 5 - index 4 signature Z name bool[] factor 1
2DCARRAYINFO 6 - index 5 signature C name char[] factor 2
2DCARRAYINFO 7 - index 6 signature F name float[] factor 4
2DCARRAYINFO 8 - index 7 signature D name double[] factor 8
2DCARRAYINFO 9 - index 8 signature B name byte[] factor 1
2DCARRAYINFO 10 - index 9 signature S name short[] factor 2
2DCARRAYINFO 11 - index 10 signature I name int[] factor 4
2DCARRAYINFO 12 - index 11 signature J name long[] factor 8
2DCARRAYINFO 13 - index 0 signature 0 name uint[] factor 0
2DCARRAYINFO 14 - index 0 signature 0 name uint1[] factor 0
2DCARRAYINFO 15 - index 0 signature 0 name uint2[] factor 0
2DCARRAYINFO 16 - index 0 signature 0 name uint3[] factor 0
NULL ------------------------------------------------------------------------
0SECTION DG subcomponent dump routine
NULL ============================
1DGTRCENABLED Trace enabled: Yes
2DGTRCTYPE Trace: Internal
2DGTRCBUFFERS Buffer specification: 8k
2DGTRCBUFALLOC Buffers allocated: 0
2DGTRCBUFUSED Buffers in use: 0
1DGJDUMPBUFF Javadump buffer size (allocated): 2621440
NULL ------------------------------------------------------------------------
0SECTION ST subcomponent dump routine
NULL ============================
1STGCMODES Resettable GC: No
1STGCMODES Concurrent GC: No
1STCURHBASE Current Heap Base: 0x300601FC
1STCURHLIM Current Heap Limit: 0x5005FBFC
1STMWHBASE Middleware Heap Base: 0x300601FC
1STMWHLIM Middleware Heap Limit: 0x5005FBFC
1STGCHELPERS Number of GC Helper Threads: 1
1STJVMOPTS -Xconcurrentlevel: 0
1STJVMOPTS -Xconcurrentbackground: 0
1STGCCTR GC Counter: 42
1STAFCTR AF Counter: 42
1STHEAPFREE Bytes of Heap Space Free: 190d3b88
1STHEAPALLOC Bytes of Heap Space Allocated: 1ffffa00
1STSMBASE SM Base: 0x0
1STSMEND SM End: 0x0
1STPAMSTART PAM Start: 0x0
1STPAMEND PAM End: 0x0
1STCOMACTION Compact Action: 0
NULL ------------------------------------------------------------------------
0SECTION XE subcomponent dump routine
NULL ============================
1XETHRESHOLD MMI threshold for java methods is set to 1250
1XEJITINIT JIT is initialized
1XEJVMPIOFF JVMPI is not activated
1XEJNITHRESH MMI threshold for JNI methods is set to 0
1XETRCHIS Trace history length is set to 4
1XEJITDUMP JIT dump routine is not yet implemented.
NULL ------------------------------------------------------------------------
0SECTION LK subcomponent dump routine
NULL ============================
NULL
1LKPOOLINFO Monitor pool info:
2LKPOOLINIT Initial monitor count: 32
2LKPOOLEXPNUM Minimum number of free monitors before expansion: 5
2LKPOOLEXPBY Pool will next be expanded by: 81
2LKPOOLTOTAL Current total number of monitors: 162
2LKPOOLFREE Current number of free monitors: 42
NULL
1LKMONPOOLDUMP Monitor Pool Dump (flat & inflated object-monitors):
2LKMONINUSE sys_mon_t:0x3003EC78 infl_mon_t: 0x3003E6E8:
3LKMONOBJECT java.lang.ref.Reference$Lock@300E02B0/300E02B8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Reference Handler" (0x744B7D28)
2LKMONINUSE sys_mon_t:0x3003ED28 infl_mon_t: 0x3003E714:
3LKMONOBJECT java.lang.ref.ReferenceQueue$Lock@300DFFE8/300DFFF0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Finalizer" (0x745409A8)
2LKMONINUSE sys_mon_t:0x3003EDD8 infl_mon_t: 0x3003E740:
3LKMONOBJECT java.util.TaskQueue@311299D0/311299D8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-1" (0x75F054A8)
2LKMONINUSE sys_mon_t:0x3003EE88 infl_mon_t: 0x3003E76C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9A60/300C9A68: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" (0x765659A8)
2LKMONINUSE sys_mon_t:0x3003EF38 infl_mon_t: 0x3003E798:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C99C0/300C99C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" (0x765693A8)
2LKMONINUSE sys_mon_t:0x3003EFE8 infl_mon_t: 0x3003E7C4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9920/300C9928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" (0x76569928)
2LKMONINUSE sys_mon_t:0x3003F098 infl_mon_t: 0x3003E7F0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9880/300C9888: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" (0x76572BA8)
2LKMONINUSE sys_mon_t:0x3003F148 infl_mon_t: 0x3003E81C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C97E0/300C97E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" (0x767971A8)
2LKMONINUSE sys_mon_t:0x3003F1F8 infl_mon_t: 0x3003E848:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9740/300C9748: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" (0x7681EBA8)
2LKMONINUSE sys_mon_t:0x3003F2A8 infl_mon_t: 0x3003E874:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C96A0/300C96A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" (0x768A65A8)
2LKMONINUSE sys_mon_t:0x3003F358 infl_mon_t: 0x3003E8A0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9600/300C9608: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" (0x7692E028)
2LKMONINUSE sys_mon_t:0x3003F408 infl_mon_t: 0x3003E8CC:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9560/300C9568: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" (0x769B5A28)
2LKMONINUSE sys_mon_t:0x3003F4B8 infl_mon_t: 0x3003E8F8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C94C0/300C94C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" (0x76A3D4A8)
2LKMONINUSE sys_mon_t:0x3003F568 infl_mon_t: 0x3003E924:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9420/300C9428: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" (0x76AC4EA8)
2LKMONINUSE sys_mon_t:0x3003F618 infl_mon_t: 0x3003E950:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9380/300C9388: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" (0x76B4C8A8)
2LKMONINUSE sys_mon_t:0x3003F6C8 infl_mon_t: 0x3003E97C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C92E0/300C92E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" (0x76BD4328)
2LKMONINUSE sys_mon_t:0x3003F778 infl_mon_t: 0x3003E9A8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9240/300C9248: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" (0x76C5BD28)
2LKMONINUSE sys_mon_t:0x3003F828 infl_mon_t: 0x3003E9D4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C91A0/300C91A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" (0x76CE3728)
2LKMONINUSE sys_mon_t:0x3003F988 infl_mon_t: 0x3003EA2C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9060/300C9068: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" (0x76DF2BA8)
2LKMONINUSE sys_mon_t:0x3003FA38 infl_mon_t: 0x3003EA58:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8FC0/300C8FC8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" (0x76E7A628)
2LKMONINUSE sys_mon_t:0x3003FAE8 infl_mon_t: 0x3003EA84:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8F20/300C8F28: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" (0x76F02028)
2LKMONINUSE sys_mon_t:0x3003FB98 infl_mon_t: 0x3003EAB0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8E80/300C8E88: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" (0x76F89A28)
2LKMONINUSE sys_mon_t:0x3003FC48 infl_mon_t: 0x3003EADC:
3LKMONOBJECT weblogic.time.common.internal.TimeTable@32EB9198/32EB91A0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.time.TimeEventGenerator" (0x77013D28)
2LKMONINUSE sys_mon_t:0x3003FCF8 infl_mon_t: 0x3003EB08:
3LKMONOBJECT java.lang.Object@32F56538/32F56540: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.security.SpinnerRandomSource" (0x770CC3A8)
2LKMONINUSE sys_mon_t:0x3003FDA8 infl_mon_t: 0x3003EB34:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8CD0/300C8CD8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" (0x770E4428)
2LKMONINUSE sys_mon_t:0x3003FE58 infl_mon_t: 0x3003EB60:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8C30/300C8C38: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" (0x770E4A28)
2LKMONINUSE sys_mon_t:0x3003FF08 infl_mon_t: 0x3003EB8C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8B90/300C8B98: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" (0x770E5028)
2LKMONINUSE sys_mon_t:0x770E3D38 infl_mon_t: 0x770F13D8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8AF0/300C8AF8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" (0x770F1028)
2LKMONINUSE sys_mon_t:0x770E3DE8 infl_mon_t: 0x770F1404:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8A50/300C8A58: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" (0x770F84A8)
2LKMONINUSE sys_mon_t:0x770E3E98 infl_mon_t: 0x770F1430:
3LKMONOBJECT [email protected]0/300C8928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "VDE Transaction Processor Thread" (0x77531828)
2LKMONINUSE sys_mon_t:0x770F1758 infl_mon_t: 0x770F1488:
3LKMONOBJECT java.util.TaskQueue@30EECD38/30EECD40: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-5" (0x75CCD1A8)
2LKMONINUSE sys_mon_t:0x770F2F88 infl_mon_t: 0x770F1538:
3LKMONOBJECT weblogic.jms.backend.BETimerTree@33C6CFE0/33C6CFE8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" (0x7893DD28)
2LKMONINUSE sys_mon_t:0x770F3038 infl_mon_t: 0x770F1564:
3LKMONOBJECT java.util.TaskQueue@34F10870/34F10878: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-7" (0x78DE09A8)
2LKMONINUSE sys_mon_t:0x770F30E8 infl_mon_t: 0x770F1590:
3LKMONOBJECT java.util.TaskQueue@3C4CB120/3C4CB128: <unowned>
3LKNOTIFYQ Waiting to be notifieMy WebLogic Server hang up sometime. The platform is IBM AIX, weblogic 8.1 with sp3
The following is the thread dump:
NULL ------------------------------------------------------------------------
0SECTION TITLE subcomponent dump routine
NULL ===============================
1TISIGINFO signal 3 received
1TIDATETIME Date: 2007/04/26 at 11:13:10
1TIFILENAME Javacore filename: /var/bea/domains/TazDomain/javacore524292.1177600390.txt
NULL ------------------------------------------------------------------------
0SECTION XHPI subcomponent dump routine
NULL ==============================
1XHTIME Thu Apr 26 11:13:10 2007
1XHSIGRECV SIGQUIT received at 0x0 in <unknown>.
1XHFULLVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
NULL
1XHCURRENTTHD Current Thread Details
NULL ----------------------
2XHCURRSYSTHD "Signal dispatcher" sys_thread_t:0x74427A28
3XHNATIVESTACK Native Stack
NULL ------------
3XHSTACKLINEERR unavailable - stack address not valid
1XHOPENV Operating Environment
NULL ---------------------
2XHHOSTNAME Host : rcirs050:10.1.93.20
2XHOSLEVEL OS Level : AIX 5.3.0.0
2XHCPUS Processors -
3XHCPUARCH Architecture : POWER_PC (impl: unknown, ver: unknown)
3XHNUMCPUS How Many : 2
3XHCPUSENABLED Enabled : 2
NULL
1XHUSERLIMITS User Limits (in bytes except for NOFILE and NPROC) -
NULL -----------
2XHUSERLIMIT RLIMIT_FSIZE : 1073741312
2XHUSERLIMIT RLIMIT_DATA : 2147483645
2XHUSERLIMIT RLIMIT_STACK : 33554432
2XHUSERLIMIT RLIMIT_CORE : 1073741312
2XHUSERLIMIT RLIMIT_NOFILE : 1024
2XHLIMIT NPROC(max) : 128
NULL
1XHPAGESPACES Page Space (in blocks) -
NULL ----------
2XHPAGESPACE /dev/hd6: size=262144, free=261912
2XHPAGESPACE /dev/paging03: size=507904, free=507672
2XHPAGESPACE /dev/paging00: size=262144, free=261917
2XHPAGESPACE /dev/paging01: size=262144, free=261903
2XHPAGESPACE /dev/paging02: size=262144, free=261901
2XHPAGESPACE /dev/paging04: size=262144, free=260986
2XHPAGESPACE /dev/paging07: size=262144, free=261911
2XHPAGESPACE /dev/paging06: size=262144, free=261913
2XHPAGESPACE /dev/paging05: size=262144, free=261913
NULL
1XHSIGHANDLERS JVM Signal Handlers
NULL -------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHSIGHANDLERS Chained Signal Handlers
NULL -----------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHENVVARS Environment Variables
NULL ---------------------
2XHENVVAR _=/usr/java14/bin/java
2XHENVVAR JAVA_VENDOR=IBM
2XHENVVAR LANG=C
2XHENVVAR PRODUCTION_MODE=
2XHENVVAR LOGIN=qatadm
2XHENVVAR CLASSPATHSEP=:
2XHENVVAR VISUAL=vi
2XHENVVAR POINTBASE_HOME=/opt/bea/weblogic81/common/eval/pointbase
2XHENVVAR PATH=/opt/bea/weblogic81/server/bin:/usr/java14/jre/bin:/usr/java14/bin:/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/qatadm/bin:/usr/bin/X11:/sbin:.:/usr/java14/bin
2XHENVVAR JAVA_VM=
2XHENVVAR LC__FASTMSG=true
2XHENVVAR POINTBASE_CLASSPATH=:/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar
2XHENVVAR CLASSPATH=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2XHENVVAR LOGNAME=qatadm
2XHENVVAR MAIL=/usr/spool/mail/qatadm
2XHENVVAR POINTBASE_TOOLS=/opt/bea/weblogic81/common/eval/pointbase/lib/pbtools44.jar
2XHENVVAR LOCPATH=/usr/lib/nls/loc
2XHENVVAR PS1=rcirs050:$PWD>
2XHENVVAR PATHSEP=:
2XHENVVAR USER=qatadm
2XHENVVAR AUTHSTATE=compat
2XHENVVAR BEA_HOME=/opt/bea
2XHENVVAR DCE_USE_WCHAR_NAMES=1
2XHENVVAR SHELL=/usr/bin/ksh
2XHENVVAR ODMDIR=/etc/objrepos
2XHENVVAR JAVA_HOME=/usr/java14
2XHENVVAR TIMEOUT=900
2XHENVVAR TMOUT=900
2XHENVVAR HOME=/home/qatadm
2XHENVVAR MEM_ARGS=-Xms512m -Xmx1024m
2XHENVVAR WEBLOGIC_CLASSPATH=/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar
2XHENVVAR TERM=dtterm
2XHENVVAR MAILMSG=[YOU HAVE NEW MAIL]
2XHENVVAR PWD=/var/bea/domains/TazDomain
2XHENVVAR TZ=EST5EDT
2XHENVVAR WL_HOME=/opt/bea/weblogic81
2XHENVVAR AIXTHREAD_SCOPE=S
2XHENVVAR A__z=! LOGNAME="*TMOUT
2XHENVVAR _IBM_JAVA_PIPE_524292=
2XHENVVAR IBM_JVM_LIBPATH_OLD_VALUE=/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_LIBPATH_NEW_VALUE=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_CHANGED_ENVVARS_524292=LIBPATH,LDR_CNTRL
2XHENVVAR IBM_JVM_LDR_CNTRL_NEW_VALUE=MAXDATA=0XA0000000@DSA
2XHENVVAR LDR_CNTRL=MAXDATA=0XA0000000@DSA
2XHENVVAR NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
2XHENVVAR LIBPATH=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR _IBM_ENV_INITIAL_524292=805345384
2XHENVVAR IBM_JAVA_COMMAND_LINE=/usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
NULL
1XHLOADEDLIBS Loaded Libraries (sizes in bytes)
NULL ---------------------------------
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libmuxer.so
3XHLIBSIZE filesize : 20757
3XHLIBSTART text start : 0xD0B88000
3XHLIBLDSIZE text size : 0x282E
3XHLIBLDORG data start : 0xF0617CF4
3XHLIBLDDATASZ data size : 0x2AC
2XHLIBNAME /usr/java14/jre/bin/libnio.a
3XHLIBSIZE filesize : 64305
3XHLIBSTART text start : 0xD11F5000
3XHLIBLDSIZE text size : 0x8EF0
3XHLIBLDORG data start : 0xF0615AE0
3XHLIBLDDATASZ data size : 0x594
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libweblogicunix1.so
3XHLIBSIZE filesize : 14536
3XHLIBSTART text start : 0xD0B86000
3XHLIBLDSIZE text size : 0x1B90
3XHLIBLDORG data start : 0xF0614484
3XHLIBLDDATASZ data size : 0xD8
2XHLIBNAME /usr/java14/jre/bin/libnet.a
3XHLIBSIZE filesize : 137885
3XHLIBSTART text start : 0xD15D7000
3XHLIBLDSIZE text size : 0x161FF
3XHLIBLDORG data start : 0xF05DE3D8
3XHLIBLDDATASZ data size : 0x968
2XHLIBNAME /usr/java14/jre/bin/libjitc.a
3XHLIBSIZE filesize : 2814544
3XHLIBSTART text start : 0xD252E000
3XHLIBLDSIZE text size : 0x23EE7B
3XHLIBLDORG data start : 0xF0962B68
3XHLIBLDDATASZ data size : 0x1A984
2XHLIBNAME /usr/lib/security/DCE
3XHLIBSIZE filesize : 27634
3XHLIBSTART text start : 0xD0B7A000
3XHLIBLDSIZE text size : 0x6BF2
3XHLIBLDORG data start : 0xF05CEA38
3XHLIBLDDATASZ data size : 0x2BA0
2XHLIBNAME /usr/java14/jre/bin/libzip.a
3XHLIBSIZE filesize : 109746
3XHLIBSTART text start : 0xD11E1000
3XHLIBLDSIZE text size : 0x135E2
3XHLIBLDORG data start : 0xF05DC468
3XHLIBLDDATASZ data size : 0x1918
2XHLIBNAME /usr/java14/jre/bin/classic/libcore.a
3XHLIBSIZE filesize : 136713
3XHLIBSTART text start : 0xD11CB000
3XHLIBLDSIZE text size : 0x15248
3XHLIBLDORG data start : 0xF05DA0E8
3XHLIBLDDATASZ data size : 0x1620
2XHLIBNAME /usr/java14/jre/bin/libjava.a
3XHLIBSIZE filesize : 221158
3XHLIBSTART text start : 0xD11AB000
3XHLIBLDSIZE text size : 0x1FEB2
3XHLIBLDORG data start : 0xF05D88F8
3XHLIBLDDATASZ data size : 0x16F8
2XHLIBNAME /usr/java14/jre/bin/libhpi.a
3XHLIBSIZE filesize : 205732
3XHLIBSTART text start : 0xD118C000
3XHLIBLDSIZE text size : 0x1EE0E
3XHLIBLDORG data start : 0xF06045A0
3XHLIBLDDATASZ data size : 0xF8D0
2XHLIBNAME /usr/java14/jre/bin/libxhpi.a
3XHLIBSIZE filesize : 14654
3XHLIBSTART text start : 0xD0B84000
3XHLIBLDSIZE text size : 0x1B52
3XHLIBLDORG data start : 0xF05D7290
3XHLIBLDDATASZ data size : 0x2C8
2XHLIBNAME /usr/java14/jre/bin/libdbgmalloc.a
3XHLIBSIZE filesize : 15267
3XHLIBSTART text start : 0xD0B81000
3XHLIBLDSIZE text size : 0x217C
3XHLIBLDORG data start : 0xF05D6988
3XHLIBLDDATASZ data size : 0x218
2XHLIBNAME /usr/java14/jre/bin/libjsig.a
3XHLIBSIZE filesize : 14412
3XHLIBSTART text start : 0xD07F8000
3XHLIBLDSIZE text size : 0x1B24
3XHLIBLDORG data start : 0xF05D54B0
3XHLIBLDDATASZ data size : 0x108
2XHLIBNAME /usr/java14/jre/bin/libute.a
3XHLIBSIZE filesize : 112768
3XHLIBSTART text start : 0xD1177000
3XHLIBLDSIZE text size : 0x14ED9
3XHLIBLDORG data start : 0xF05D43B0
3XHLIBLDDATASZ data size : 0x674
2XHLIBNAME /usr/lib/libdl.a
3XHLIBSIZE filesize : 5248
3XHLIBSTART text start : 0xD02E70F8
3XHLIBLDSIZE text size : 0x1E0
3XHLIBLDORG data start : 0xF03190F8
3XHLIBLDDATASZ data size : 0x0
2XHLIBNAME /usr/java14/jre/bin/sovvm/libjvm.a
3XHLIBSIZE filesize : 2857303
3XHLIBSTART text start : 0xD2335000
3XHLIBLDSIZE text size : 0x1F8E31
3XHLIBLDORG data start : 0xF0936290
3XHLIBLDDATASZ data size : 0x2AE10
2XHLIBNAME /usr/java14/jre/bin/classic/libjvm.a
3XHLIBSIZE filesize : 117748
3XHLIBSTART text start : 0xD1169000
3XHLIBLDSIZE text size : 0xD54B
3XHLIBLDORG data start : 0xF05D2A90
3XHLIBLDDATASZ data size : 0xF0C
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01E7540
3XHLIBLDSIZE text size : 0x20F6D
3XHLIBLDORG data start : 0xF0381340
3XHLIBLDDATASZ data size : 0x6780
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01CDBC0
3XHLIBLDSIZE text size : 0x186CC
3XHLIBLDORG data start : 0xF0377FC0
3XHLIBLDDATASZ data size : 0x84C9
2XHLIBNAME /usr/lib/libcrypt.a
3XHLIBSIZE filesize : 11019
3XHLIBSTART text start : 0xD01450F8
3XHLIBLDSIZE text size : 0x846
3XHLIBLDORG data start : 0xF0316508
3XHLIBLDDATASZ data size : 0x128
2XHLIBNAME /usr/lib/libiconv.a
3XHLIBSIZE filesize : 377727
3XHLIBSTART text start : 0xD05BF100
3XHLIBLDSIZE text size : 0x139C1
3XHLIBLDORG data start : 0xF0252C70
3XHLIBLDDATASZ data size : 0xA2E4
2XHLIBNAME /usr/lib/libbsd.a
3XHLIBSIZE filesize : 61862
3XHLIBSTART text start : 0xD02784C0
3XHLIBLDSIZE text size : 0x7D2F
3XHLIBLDORG data start : 0xF0213A30
3XHLIBLDDATASZ data size : 0x13D8
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010E000
3XHLIBLDSIZE text size : 0x365C4
3XHLIBLDORG data start : 0xF0370000
3XHLIBLDDATASZ data size : 0x4024
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010A000
3XHLIBLDSIZE text size : 0x3C52
3XHLIBLDORG data start : 0xF032D000
3XHLIBLDDATASZ data size : 0x424A8
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01AD100
3XHLIBLDSIZE text size : 0x1FED1
3XHLIBLDORG data start : 0xF0388D00
3XHLIBLDDATASZ data size : 0x30F9
2XHLIBNAME /usr/lib/libc.a
3XHLIBSIZE filesize : 8270989
3XHLIBSTART text start : 0xD02F2240
3XHLIBLDSIZE text size : 0x251155
3XHLIBLDORG data start : 0xF0278BC0
3XHLIBLDDATASZ data size : 0x9D340
NULL
NULL ------------------------------------------------------------------------
0SECTION CI subcomponent dump routine
NULL ============================
1CIJAVAVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
1CIRUNNINGAS Running as a standalone JVM
1CICMDLINE /usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
1CIJAVAHOMEDIR Java Home Dir: /usr/java14/jre
1CIJAVADLLDIR Java DLL Dir: /usr/java14/jre/bin
1CISYSCP Sys Classpath: /usr/java14/jre/lib/core.jar:/usr/java14/jre/lib/graphics.jar:/usr/java14/jre/lib/security.jar:/usr/java14/jre/lib/server.jar:/usr/java14/jre/lib/xml.jar:/usr/java14/jre/lib/charsets.jar:/usr/java14/jre/classes:/usr/java14/jre/lib/ibmcertpathprovider.jar:/usr/java14/jre/lib/ibmjaaslm.jar:/usr/java14/jre/lib/ibmjcefw.jar:/usr/java14/jre/lib/ibmjgssprovider.jar:/usr/java14/jre/lib/ibmjssefips.jar:/usr/java14/jre/lib/ibmjsseprovider.jar:/usr/java14/jre/lib/ibmorb.jar:/usr/java14/jre/lib/ibmorbapi.jar:/usr/java14/jre/lib/ibmpkcs.jar
1CIUSERARGS UserArgs:
2CIUSERARG vfprintf 0x30000D94
2CIUSERARG -Xms512m
2CIUSERARG -Xmx1024m
2CIUSERARG -Duser.timezone=America/New_York
2CIUSERARG -Dweblogic.Name=TazServer
2CIUSERARG -Dweblogic.ProductionModeEnabled=
2CIUSERARG -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy
2CIUSERARG -Dinvokedviajava
2CIUSERARG -Djava.class.path=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2CIUSERARG vfprintf
NULL
1CIJVMMI JVM Monitoring Interface (JVMMI)
NULL ------------------------
2CIJVMMIOFF No events are enabled.
NULL
NULL ------------------------------------------------------------------------
0SECTION DC subcomponent dump routine
NULL ============================
1DCHEADEREYE Header eye catcher DCST
1DCHEADERLEN Header length 24
1DCHEADERVER Header version 1
1DCHEADERMOD Header modification 0
1DCINTERFACE DC Interface at 0xF0947FDC with 15 entries
2DCINTERFACE 1 - dcCString2JavaString 0xF0944A90
2DCINTERFACE 2 - dcInt642CString 0xF0944A9C
2DCINTERFACE 3 - dcJavaString2NewCString 0xF0944AA8
2DCINTERFACE 4 - dcJavaString2CString 0xF0944AB4
2DCINTERFACE 5 - dcJavaString2NewPlatformString 0xF0944AC0
2DCINTERFACE 6 - dcJavaString2UTF 0xF0944ACC
2DCINTERFACE 7 - dcPlatformString2JavaString 0xF0944AE4
2DCINTERFACE 8 - dcUnicode2UTF 0xF0944AF0
2DCINTERFACE 9 - dcUnicode2UTFLength 0xF0944AFC
2DCINTERFACE 10 - dcUTF2JavaString 0xF0944B08
2DCINTERFACE 11 - dcUTFClassName2JavaString 0xF0944B14
2DCINTERFACE 12 - dcJavaString2ClassName 0xF0944AD8
2DCINTERFACE 13 - dcUTF2UnicodeNext 0xF0944B20
2DCINTERFACE 14 - dcVerifyUTF8 0xF0944B2C
2DCINTERFACE 15 - dcDumpRoutine 0xF0944B38
1DCARRAYINFO Array info at 0xF09384A0 with 16 entries
2DCARRAYINFO 1 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 2 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 3 - index 2 signature L name class[] factor 4
2DCARRAYINFO 4 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 5 - index 4 signature Z name bool[] factor 1
2DCARRAYINFO 6 - index 5 signature C name char[] factor 2
2DCARRAYINFO 7 - index 6 signature F name float[] factor 4
2DCARRAYINFO 8 - index 7 signature D name double[] factor 8
2DCARRAYINFO 9 - index 8 signature B name byte[] factor 1
2DCARRAYINFO 10 - index 9 signature S name short[] factor 2
2DCARRAYINFO 11 - index 10 signature I name int[] factor 4
2DCARRAYINFO 12 - index 11 signature J name long[] factor 8
2DCARRAYINFO 13 - index 0 signature 0 name uint[] factor 0
2DCARRAYINFO 14 - index 0 signature 0 name uint1[] factor 0
2DCARRAYINFO 15 - index 0 signature 0 name uint2[] factor 0
2DCARRAYINFO 16 - index 0 signature 0 name uint3[] factor 0
NULL ------------------------------------------------------------------------
0SECTION DG subcomponent dump routine
NULL ============================
1DGTRCENABLED Trace enabled: Yes
2DGTRCTYPE Trace: Internal
2DGTRCBUFFERS Buffer specification: 8k
2DGTRCBUFALLOC Buffers allocated: 0
2DGTRCBUFUSED Buffers in use: 0
1DGJDUMPBUFF Javadump buffer size (allocated): 2621440
NULL ------------------------------------------------------------------------
0SECTION ST subcomponent dump routine
NULL ============================
1STGCMODES Resettable GC: No
1STGCMODES Concurrent GC: No
1STCURHBASE Current Heap Base: 0x300601FC
1STCURHLIM Current Heap Limit: 0x5005FBFC
1STMWHBASE Middleware Heap Base: 0x300601FC
1STMWHLIM Middleware Heap Limit: 0x5005FBFC
1STGCHELPERS Number of GC Helper Threads: 1
1STJVMOPTS -Xconcurrentlevel: 0
1STJVMOPTS -Xconcurrentbackground: 0
1STGCCTR GC Counter: 42
1STAFCTR AF Counter: 42
1STHEAPFREE Bytes of Heap Space Free: 190d3b88
1STHEAPALLOC Bytes of Heap Space Allocated: 1ffffa00
1STSMBASE SM Base: 0x0
1STSMEND SM End: 0x0
1STPAMSTART PAM Start: 0x0
1STPAMEND PAM End: 0x0
1STCOMACTION Compact Action: 0
NULL ------------------------------------------------------------------------
0SECTION XE subcomponent dump routine
NULL ============================
1XETHRESHOLD MMI threshold for java methods is set to 1250
1XEJITINIT JIT is initialized
1XEJVMPIOFF JVMPI is not activated
1XEJNITHRESH MMI threshold for JNI methods is set to 0
1XETRCHIS Trace history length is set to 4
1XEJITDUMP JIT dump routine is not yet implemented.
NULL ------------------------------------------------------------------------
0SECTION LK subcomponent dump routine
NULL ============================
NULL
1LKPOOLINFO Monitor pool info:
2LKPOOLINIT Initial monitor count: 32
2LKPOOLEXPNUM Minimum number of free monitors before expansion: 5
2LKPOOLEXPBY Pool will next be expanded by: 81
2LKPOOLTOTAL Current total number of monitors: 162
2LKPOOLFREE Current number of free monitors: 42
NULL
1LKMONPOOLDUMP Monitor Pool Dump (flat & inflated object-monitors):
2LKMONINUSE sys_mon_t:0x3003EC78 infl_mon_t: 0x3003E6E8:
3LKMONOBJECT java.lang.ref.Reference$Lock@300E02B0/300E02B8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Reference Handler" (0x744B7D28)
2LKMONINUSE sys_mon_t:0x3003ED28 infl_mon_t: 0x3003E714:
3LKMONOBJECT java.lang.ref.ReferenceQueue$Lock@300DFFE8/300DFFF0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Finalizer" (0x745409A8)
2LKMONINUSE sys_mon_t:0x3003EDD8 infl_mon_t: 0x3003E740:
3LKMONOBJECT java.util.TaskQueue@311299D0/311299D8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-1" (0x75F054A8)
2LKMONINUSE sys_mon_t:0x3003EE88 infl_mon_t: 0x3003E76C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9A60/300C9A68: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" (0x765659A8)
2LKMONINUSE sys_mon_t:0x3003EF38 infl_mon_t: 0x3003E798:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C99C0/300C99C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" (0x765693A8)
2LKMONINUSE sys_mon_t:0x3003EFE8 infl_mon_t: 0x3003E7C4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9920/300C9928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" (0x76569928)
2LKMONINUSE sys_mon_t:0x3003F098 infl_mon_t: 0x3003E7F0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9880/300C9888: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" (0x76572BA8)
2LKMONINUSE sys_mon_t:0x3003F148 infl_mon_t: 0x3003E81C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C97E0/300C97E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" (0x767971A8)
2LKMONINUSE sys_mon_t:0x3003F1F8 infl_mon_t: 0x3003E848:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9740/300C9748: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" (0x7681EBA8)
2LKMONINUSE sys_mon_t:0x3003F2A8 infl_mon_t: 0x3003E874:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C96A0/300C96A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" (0x768A65A8)
2LKMONINUSE sys_mon_t:0x3003F358 infl_mon_t: 0x3003E8A0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9600/300C9608: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" (0x7692E028)
2LKMONINUSE sys_mon_t:0x3003F408 infl_mon_t: 0x3003E8CC:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9560/300C9568: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" (0x769B5A28)
2LKMONINUSE sys_mon_t:0x3003F4B8 infl_mon_t: 0x3003E8F8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C94C0/300C94C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" (0x76A3D4A8)
2LKMONINUSE sys_mon_t:0x3003F568 infl_mon_t: 0x3003E924:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9420/300C9428: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" (0x76AC4EA8)
2LKMONINUSE sys_mon_t:0x3003F618 infl_mon_t: 0x3003E950:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9380/300C9388: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" (0x76B4C8A8)
2LKMONINUSE sys_mon_t:0x3003F6C8 infl_mon_t: 0x3003E97C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C92E0/300C92E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" (0x76BD4328)
2LKMONINUSE sys_mon_t:0x3003F778 infl_mon_t: 0x3003E9A8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9240/300C9248: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" (0x76C5BD28)
2LKMONINUSE sys_mon_t:0x3003F828 infl_mon_t: 0x3003E9D4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C91A0/300C91A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" (0x76CE3728)
2LKMONINUSE sys_mon_t:0x3003F988 infl_mon_t: 0x3003EA2C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9060/300C9068: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" (0x76DF2BA8)
2LKMONINUSE sys_mon_t:0x3003FA38 infl_mon_t: 0x3003EA58:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8FC0/300C8FC8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" (0x76E7A628)
2LKMONINUSE sys_mon_t:0x3003FAE8 infl_mon_t: 0x3003EA84:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8F20/300C8F28: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" (0x76F02028)
2LKMONINUSE sys_mon_t:0x3003FB98 infl_mon_t: 0x3003EAB0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8E80/300C8E88: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" (0x76F89A28)
2LKMONINUSE sys_mon_t:0x3003FC48 infl_mon_t: 0x3003EADC:
3LKMONOBJECT weblogic.time.common.internal.TimeTable@32EB9198/32EB91A0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.time.TimeEventGenerator" (0x77013D28)
2LKMONINUSE sys_mon_t:0x3003FCF8 infl_mon_t: 0x3003EB08:
3LKMONOBJECT java.lang.Object@32F56538/32F56540: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.security.SpinnerRandomSource" (0x770CC3A8)
2LKMONINUSE sys_mon_t:0x3003FDA8 infl_mon_t: 0x3003EB34:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8CD0/300C8CD8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" (0x770E4428)
2LKMONINUSE sys_mon_t:0x3003FE58 infl_mon_t: 0x3003EB60:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8C30/300C8C38: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" (0x770E4A28)
2LKMONINUSE sys_mon_t:0x3003FF08 infl_mon_t: 0x3003EB8C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8B90/300C8B98: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" (0x770E5028)
2LKMONINUSE sys_mon_t:0x770E3D38 infl_mon_t: 0x770F13D8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8AF0/300C8AF8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" (0x770F1028)
2LKMONINUSE sys_mon_t:0x770E3DE8 infl_mon_t: 0x770F1404:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8A50/300C8A58: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" (0x770F84A8)
2LKMONINUSE sys_mon_t:0x770E3E98 infl_mon_t: 0x770F1430:
3LKMONOBJECT [email protected]0/300C8928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "VDE Transaction Processor Thread" (0x77531828)
2LKMONINUSE sys_mon_t:0x770F1758 infl_mon_t: 0x770F1488:
3LKMONOBJECT java.util.TaskQueue@30EECD38/30EECD40: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-5" (0x75CCD1A8)
2LKMONINUSE sys_mon_t:0x770F2F88 infl_mon_t: 0x770F1538:
3LKMONOBJECT weblogic.jms.backend.BETimerTree@33C6CFE0/33C6CFE8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" (0x7893DD28)
2LKMONINUSE sys_mon_t:0x770F3038 infl_mon_t: 0x770F1564:
3LKMONOBJECT java.util.TaskQueue@34F10870/34F10878: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-7" (0x78DE09A8)
2LKMONINUSE sys_mon_t:0x770F30E8 infl_mon_t: 0x770F1590:
3LKMONOBJECT java.util.TaskQueue@3C4CB120/3C4CB128: <unowned>
3LKNOTIFYQ Waiting to be notifie -
Error upon starting Weblogic server : Exception thrown while loading uddi
Hi,
I am getting $Proxy41.getDefaultWebApp(Unknown Source) error while starting the weblogic. Any one has clue? Below is the stack from myserv.log file.
Environment:
OS : Windows 2000 server
WLS: Weblogic 7.0SP2
Oracle client : Oracle 9i RC2
IIS : IIS 5.0
<Exception thrown while loading uddi: java.lang.ClassCastException: weblogic.management.configuration.ApplicationManagerMBean_CachingStub>
java.lang.ClassCastException: weblogic.management.configuration.ApplicationManagerMBean_CachingStub
at $Proxy41.getDefaultWebApp(Unknown Source)
at weblogic.management.configuration.WebServerMBean_CachingStub.getDefaultWebApp(WebServerMBean_CachingStub.java:226)
at weblogic.servlet.internal.WebAppServletContext.initFromMBean(WebAppServletContext.java:1312)
at weblogic.servlet.internal.WebAppServletContext.init(WebAppServletContext.java:1054)
at weblogic.servlet.internal.WebAppServletContext.<init>(WebAppServletContext.java:1009)
at weblogic.servlet.internal.HttpServer.loadWebApp(HttpServer.java:502)
at weblogic.servlet.internal.WebAppModule.prepare(WebAppModule.java:371)
at weblogic.j2ee.J2EEApplicationContainer.prepareWebModule(J2EEApplicationContainer.java:1598)
at weblogic.j2ee.J2EEApplicationContainer.prepare(J2EEApplicationContainer.java:735)
at weblogic.j2ee.J2EEApplicationContainer.prepare(J2EEApplicationContainer.java:555)
at weblogic.j2ee.J2EEApplicationContainer.prepare(J2EEApplicationContainer.java:458)
at weblogic.management.deploy.slave.SlaveDeployer.prepareAllStagedApplications(SlaveDeployer.java:490)
at weblogic.management.deploy.slave.SlaveDeployer.initialize(SlaveDeployer.java:253)
at weblogic.management.deploy.DeploymentManagerServerLifeCycleImpl.initialize(DeploymentManagerServerLifeCycleImpl.java:150)
at weblogic.t3.srvr.ServerLifeCycleList.initialize(ServerLifeCycleList.java:54)
at weblogic.t3.srvr.T3Srvr.initialize1(T3Srvr.java:782)
at weblogic.t3.srvr.T3Srvr.initialize(T3Srvr.java:594)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:282)
at weblogic.Server.main(Server.java:32)
####<Dec 14, 2005 11:19:54 AM PST> <Error> <Deployer> <rsecav-webenam> <myserver> <main> <kernel identity> <> <149205> <The Slave Deployer failed to initialize the application uddi due to error weblogic.management.ApplicationException: Prepare failed. Task Id = null
Module Name: uddi, Error: Could not load uddi: java.lang.ClassCastException: weblogic.management.configuration.ApplicationManagerMBean_CachingStub
}.>
weblogic.management.ApplicationException: Prepare failed. Task Id = null
Module Name: uddi, Error: Could not load uddi: java.lang.ClassCastException: weblogic.management.configuration.ApplicationManagerMBean_CachingStub
at weblogic.j2ee.J2EEApplicationContainer.prepare(J2EEApplicationContainer.java:744)
at weblogic.j2ee.J2EEApplicationContainer.prepare(J2EEApplicationContainer.java:555)
at weblogic.j2ee.J2EEApplicationContainer.prepare(J2EEApplicationContainer.java:458)
at weblogic.management.deploy.slave.SlaveDeployer.prepareAllStagedApplications(SlaveDeployer.java:490)
at weblogic.management.deploy.slave.SlaveDeployer.initialize(SlaveDeployer.java:253)
at weblogic.management.deploy.DeploymentManagerServerLifeCycleImpl.initialize(DeploymentManagerServerLifeCycleImpl.java:150)
at weblogic.t3.srvr.ServerLifeCycleList.initialize(ServerLifeCycleList.java:54)
at weblogic.t3.srvr.T3Srvr.initialize1(T3Srvr.java:782)
at weblogic.t3.srvr.T3Srvr.initialize(T3Srvr.java:594)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:282)
at weblogic.Server.main(Server.java:32)
Thanks in advance,
ManuHi Manu,
can I know how you over come this problem? I am using Weblogic 7 with Service Pack 4. I will be thankful to u if you can mail ur response to me on my mail [email protected]
Thanks and Regards,
Suresh Vemulapalli -
WebLogic Server clusters not high available!!
I'm working with WebLogic Server 6.0.
I try to connect to cluster using explicit IP addresses.
For this case,first ,I cluster server A,B and C ,then client try to look up home
interface at server A.
After server A return home reference ,client creates EJB object and calls method
using that reference .
If server A fail, it still working with others server ,B and C.
But if new client try to find home reference at server A ,he can't.
This situation means that WebLogic Server cluster is not high availability or
I did something wrong with configuration?
And if I missed something ,how can I fix it?
Thanks for your attention.
Hi King,
If you look up at a non-existent IP/port, then it will not respond. That is
expected behavior.
You should not be using an explicit IP like that. At least use DNS round
robin.
Peace,
Cameron Purdy
Tangosol Inc.
Tangosol Coherence: Clustered Coherent Cache for J2EE
Information at http://www.tangosol.com/
"KING TEAM" <[email protected]> wrote in message
news:3c449200$[email protected]..
>
> I'm working with WebLogic Server 6.0.
> I try to connect to cluster using explicit IP addresses.
>
> For this case,first ,I cluster server A,B and C ,then client try to look
up home
> interface at server A.
>
> After server A return home reference ,client creates EJB object and calls
method
> using that reference .
>
> If server A fail, it still working with others server ,B and C.
>
> But if new client try to find home reference at server A ,he can't.
>
> This situation means that WebLogic Server cluster is not high availability
or
> I did something wrong with configuration?
>
> And if I missed something ,how can I fix it?
>
> Thanks for your attention.
>
>
-
Need help regarding Weblogic Server Hang up
We are facing a problem at the client’s place on the production environment.
The weblogic server is hanging up once every week. The application is running fine till then, but once the server is hung we need to restart the weblogic again.
Also after observing the behavior of the memory usage of the application in the weblogic admin console we came to know that the memory usage is gradually increasing day by day. We are not sure why this is happening.
We tested the application to check for any memory leaks using JProbe. We couldn’t find any memory leaks in the application. We even tested it onsite but couldn’t find any memory leaks.
I need some help on this issue as this is happening on the production environment and needs to be resolved as soon as possible.
The configuration we are having on the production environment is:
bea:8.1
JDK:1.41_021. You say its a hang, get multiple threadumps and see whats happening at the time of hang. this will give you a clue into the work thats going on and thats stuck.
2. are you seeing outofmemoryexception? If yes only then you will need to suspect the memory leak. First thing in such situation is try to increase the heap by about 1/3rd more (this is just a guestimate not a recommended practice) , that can potentially buy you time to analyze the problem.
3. you should also check if weblogic objects are leaking , check the jprobe snapshots if you have any to see if you find any weblogic object that are not getting garbage collected and growing continuously. there have been a few memory leak fixes since 8.1 release. if you find something contact support@bea and find out if any existing fix will help. -
Weblogic server hangs during stress-testing -- possibly EJB deadlocks
Hi
While running stress tests on our application, our WLS 4.5.1 hangs even at a
mere load of 20 users. We are running on a Solaris machine. Database: Oracle
8.1.5, running on the same machine. Using oracle.jdbc.driver.OracleDriver as
the JDBC driver, and using JTS as the transaction manager.
When we did a thread dump (complete lis at the end of this post) and
basically we are seeing a bunch of our entity beans in a "locked" state. A
common pattern we see in the thread dumps is that
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.organization.<Our Entiy Bean>EOImpl.<a get
method>(ERSSystemConfigurationBeanEOImpl.java:1539)
[6] com.nps.ers.ejb.awardnomination.<Our entity bean>.<some method>
After more thorough studying of EJB transactions, we changed the isolation
level of all our beans from TRANSACTION_SERIALIZED to
TRANSACTION_READ_COMMITTED and made sure all our beans say TX_REQUIRED for
their transactionAttribue. Still, this problem persists.
The basic scenario we are load testing is that of multiple users logging
into the system and trying to access a particular user's record, and right
now, this is causing deadlocks at 20 users.
What we fail to understand is that --
(a) even if a method is attempting a read-only access to the data, why would
it try to obtain a lock? or why would it matter that the data is locked?
Some of the locks we are seeing are actually on a bean that is used for
read-only purposes.
(b) if 2 or more processes are trying to access the same record, based on
whichever process got their first, shouldn't one succeed, and the other go
into a 'waiting' state?
We have also opened this issue with weblogic support, and the response so
far has been that there "may" be a bug in weblogic 4.5.1 itself that's
causing it, and they need to look into it further. Other similar posts in
the newsgroup haven't been resolved either -- hence this general plea for
help. Please advise if you've any suggestions. Thanks
Sandeep
---------------------------Complete Thread Dump Listing -------------------
"HighPriority TimeEventGenerator" (TID:0x1488278, sys_thread_t:0x14881b8,
state:CW, thread_t: t@46, threadID:0xd9271dc8, stack_bottom:0xd9272000,
stack_size:0x20000) prio=9
[1] weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:249)
[2]
weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
:143)
[3] java.lang.Thread.run(Thread.java:479)
"SSLListenThread" (TID:0x1588220, sys_thread_t:0x1588160, state:R, thread_t:
t@45, threadID:0xd9321dc8, stack_bottom:0xd9322000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:240)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5]
weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java
:121)
[6] weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:112)
[7] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ListenThread" (TID:0x15f7d48, sys_thread_t:0x15f7c88, state:R, thread_t:
t@44, threadID:0xd92a1dc8, stack_bottom:0xd92a2000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:238)
[4] java.net.ServerSocket.accept(ServerSocket.java:223)
[5] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ExecuteThread-29" (TID:0xad1c90, sys_thread_t:0xad1bd0, state:CW, thread_t:
t@40, threadID:0xd94e1dc8, stack_bottom:0xd94e2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-28" (TID:0xad1a78, sys_thread_t:0xad19b8, state:CW, thread_t:
t@39, threadID:0xd9511dc8, stack_bottom:0xd9512000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-27" (TID:0xad1678, sys_thread_t:0xad15b8, state:CW, thread_t:
t@38, threadID:0xd9541dc8, stack_bottom:0xd9542000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-26" (TID:0xac84e8, sys_thread_t:0xac8428, state:CW, thread_t:
t@37, threadID:0xd9571dc8, stack_bottom:0xd9572000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-25" (TID:0xab7d50, sys_thread_t:0xab7c90, state:CW, thread_t:
t@36, threadID:0xd95a1dc8, stack_bottom:0xd95a2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-24" (TID:0xab9b60, sys_thread_t:0xab9aa0, state:CW, thread_t:
t@35, threadID:0xd95d1dc8, stack_bottom:0xd95d2000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-23" (TID:0xab9948, sys_thread_t:0xab9888, state:CW, thread_t:
t@34, threadID:0xd9601dc8, stack_bottom:0xd9602000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[15]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[16]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[18]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[19] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[20] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-22" (TID:0xabcc20, sys_thread_t:0xabcb60, state:CW, thread_t:
t@33, threadID:0xd9631dc8, stack_bottom:0xd9632000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-21" (TID:0xa9ccf0, sys_thread_t:0xa9cc30, state:CW, thread_t:
t@32, threadID:0xd9661dc8, stack_bottom:0xd9662000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-20" (TID:0xab2550, sys_thread_t:0xab2490, state:R, thread_t:
t@31, threadID:0xd9691dc8, stack_bottom:0xd9692000, stack_size:0x20000)
prio=5
[1] java.net.SocketInputStream.socketRead(Native Method)
[2] java.net.SocketInputStream.read(SocketInputStream.java:85)
[3] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[4] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[5] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-19" (TID:0xa640c0, sys_thread_t:0xa64000, state:CW, thread_t:
t@30, threadID:0xd96c1dc8, stack_bottom:0xd96c2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-18" (TID:0xa502d8, sys_thread_t:0xa50218, state:CW, thread_t:
t@29, threadID:0xd96f1dc8, stack_bottom:0xd96f2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getCashWithinD
ays(ERSSystemConfigurationBeanEOImpl.java:1231)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.getAwardNominationNotifi
cationStates(AwardNominationBean.java:772)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.getAwardNomination
NotificationStates(AwardNominationBeanEOImpl.java:247)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.getAwa
rdNominationNotificationStates(AwardNominationBeanEOImpl_ServiceStub.java:41
5)
[9]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[10]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[11]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[12] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[13] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[16]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[19]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[20] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[21] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-17" (TID:0xa242d8, sys_thread_t:0xa24218, state:CW, thread_t:
t@28, threadID:0xd9721dc8, stack_bottom:0xd9722000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.user.UserBeanEOImpl.getUserStatusCode(UserBeanEOImpl.java:22
77)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.getApprovers(ApproverS
electionBean.java:352)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.getApprovers(App
roverSelectionBeanEOImpl.java:140)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.getA
pprovers(ApproverSelectionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.ApproverSelection.getApproverList(ApproverSelection.java
:81)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-16" (TID:0xaa0ed8, sys_thread_t:0xaa0e18, state:CW, thread_t:
t@27, threadID:0xd9751dc8, stack_bottom:0xd9752000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-15" (TID:0xad0220, sys_thread_t:0xad0160, state:CW, thread_t:
t@26, threadID:0xd9781dc8, stack_bottom:0xd9782000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[15]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[16]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[18]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[19] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[20] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-14" (TID:0xa8f4c0, sys_thread_t:0xa8f400, state:CW, thread_t:
t@25, threadID:0xd97b1dc8, stack_bottom:0xd97b2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getCashWithinD
ays(ERSSystemConfigurationBeanEOImpl.java:1231)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.getAwardNominationNotifi
cationStates(AwardNominationBean.java:772)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.getAwardNomination
NotificationStates(AwardNominationBeanEOImpl.java:247)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.getAwa
rdNominationNotificationStates(AwardNominationBeanEOImpl_ServiceStub.java:41
5)
[9]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[10]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[11]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[12] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[13] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[16]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[19]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[20] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[21] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-13" (TID:0xa194f0, sys_thread_t:0xa19430, state:CW, thread_t:
t@24, threadID:0xd97e1dc8, stack_bottom:0xd97e2000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ECan you post details on this instrumentation?
I know in the past when we ran into this type of problem, it took us a while
to think through and identify the problems.
Thanks,
Gary
Rob Woollen <[email protected]> wrote in message
news:[email protected]...
Generally this indicates a deadlock in the order that you access your
entity beans. Please follow-up with [email protected]. There is
some instrumentation that you can turn on to help spot why this is
occurring.
-- Rob
Sandeep Giri wrote:
Hi
While running stress tests on our application, our WLS 4.5.1 hangs even
at a
mere load of 20 users. We are running on a Solaris machine. Database:Oracle
8.1.5, running on the same machine. Usingoracle.jdbc.driver.OracleDriver as
the JDBC driver, and using JTS as the transaction manager.
When we did a thread dump (complete lis at the end of this post) and
basically we are seeing a bunch of our entity beans in a "locked" state.A
common pattern we see in the thread dumps is that
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.organization.<Our Entiy Bean>EOImpl.<a get
method>(ERSSystemConfigurationBeanEOImpl.java:1539)
[6] com.nps.ers.ejb.awardnomination.<Our entity bean>.<some method>
After more thorough studying of EJB transactions, we changed theisolation
level of all our beans from TRANSACTION_SERIALIZED to
TRANSACTION_READ_COMMITTED and made sure all our beans say TX_REQUIREDfor
their transactionAttribue. Still, this problem persists.
The basic scenario we are load testing is that of multiple users logging
into the system and trying to access a particular user's record, andright
now, this is causing deadlocks at 20 users.
What we fail to understand is that --
(a) even if a method is attempting a read-only access to the data, whywould
it try to obtain a lock? or why would it matter that the data is locked?
Some of the locks we are seeing are actually on a bean that is used for
read-only purposes.
(b) if 2 or more processes are trying to access the same record, basedon
whichever process got their first, shouldn't one succeed, and the othergo
into a 'waiting' state?
We have also opened this issue with weblogic support, and the responseso
far has been that there "may" be a bug in weblogic 4.5.1 itself that's
causing it, and they need to look into it further. Other similar postsin
the newsgroup haven't been resolved either -- hence this general pleafor
help. Please advise if you've any suggestions. Thanks
Sandeep
---------------------------Complete Thread DumpListing -------------------
>>
"HighPriority TimeEventGenerator" (TID:0x1488278,sys_thread_t:0x14881b8,
state:CW, thread_t: t@46, threadID:0xd9271dc8, stack_bottom:0xd9272000,
stack_size:0x20000) prio=9
[1] weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:249)
[2]
weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
:143)
[3] java.lang.Thread.run(Thread.java:479)
"SSLListenThread" (TID:0x1588220, sys_thread_t:0x1588160, state:R,thread_t:
t@45, threadID:0xd9321dc8, stack_bottom:0xd9322000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:240)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5]
weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java
:121)
[6]weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:112)
[7] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ListenThread" (TID:0x15f7d48, sys_thread_t:0x15f7c88, state:R,thread_t:
t@44, threadID:0xd92a1dc8, stack_bottom:0xd92a2000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:238)
[4] java.net.ServerSocket.accept(ServerSocket.java:223)
[5] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ExecuteThread-29" (TID:0xad1c90, sys_thread_t:0xad1bd0, state:CW,thread_t:
t@40, threadID:0xd94e1dc8, stack_bottom:0xd94e2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-28" (TID:0xad1a78, sys_thread_t:0xad19b8, state:CW,thread_t:
t@39, threadID:0xd9511dc8, stack_bottom:0xd9512000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-27" (TID:0xad1678, sys_thread_t:0xad15b8, state:CW,thread_t:
t@38, threadID:0xd9541dc8, stack_bottom:0xd9542000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-26" (TID:0xac84e8, sys_thread_t:0xac8428, state:CW,thread_t:
t@37, threadID:0xd9571dc8, stack_bottom:0xd9572000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-25" (TID:0xab7d50, sys_thread_t:0xab7c90, state:CW,thread_t:
t@36, threadID:0xd95a1dc8, stack_bottom:0xd95a2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-24" (TID:0xab9b60, sys_thread_t:0xab9aa0, state:CW,thread_t:
t@35, threadID:0xd95d1dc8, stack_bottom:0xd95d2000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-23" (TID:0xab9948, sys_thread_t:0xab9888, state:CW,thread_t:
t@34, threadID:0xd9601dc8, stack_bottom:0xd9602000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[15]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[16]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[18]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[19]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[20] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-22" (TID:0xabcc20, sys_thread_t:0xabcb60, state:CW,thread_t:
t@33, threadID:0xd9631dc8, stack_bottom:0xd9632000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-21" (TID:0xa9ccf0, sys_thread_t:0xa9cc30, state:CW,thread_t:
t@32, threadID:0xd9661dc8, stack_bottom:0xd9662000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-20" (TID:0xab2550, sys_thread_t:0xab2490, state:R,thread_t:
t@31, threadID:0xd9691dc8, stack_bottom:0xd9692000, stack_size:0x20000)
prio=5
[1] java.net.SocketInputStream.socketRead(Native Method)
[2] java.net.SocketInputStream.read(SocketInputStream.java:85)
[3]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[4]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[5] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-19" (TID:0xa640c0, sys_thread_t:0xa64000, state:CW,thread_t:
t@30, threadID:0xd96c1dc8, stack_bottom:0xd96c2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-18" (TID:0xa502d8, sys_thread_t:0xa50218, state:CW,thread_t:
t@29, threadID:0xd96f1dc8, stack_bottom:0xd96f2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getCashWithinD
ays(ERSSystemConfigurationBeanEOImpl.java:1231)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.getAwardNominationNotifi
cationStates(AwardNominationBean.java:772)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.getAwardNomination
NotificationStates(AwardNominationBeanEOImpl.java:247)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.getAwa
>>
rdNominationNotificationStates(AwardNominationBeanEOImpl_ServiceStub.java:41
5)
[9]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[10]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[11]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[12]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[13] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[16]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[19]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[20]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[21] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-17" (TID:0xa242d8, sys_thread_t:0xa24218, state:CW,thread_t:
t@28, threadID:0xd9721dc8, stack_bottom:0xd9722000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.user.UserBeanEOImpl.getUserStatusCode(UserBeanEOImpl.java:22
77)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.getApprovers(ApproverS
electionBean.java:352)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.getApprovers(App
roverSelectionBeanEOImpl.java:140)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.getA
pprovers(ApproverSelectionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.ApproverSelection.getApproverList(ApproverSelection.java
:81)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-16" (TID:0xaa0ed8, sys_thread_t:0xaa0e18, state:CW,thread_t:
t@27, threadID:0xd9751dc8, stack_bottom:0xd9752000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-15" (TID:0xad0220, sys_thread_t:0xad0160, state:CW,thread_t:
t@26, threadID:0xd9781dc8, stack_bottom:0xd9782000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14 -
Hi all,
we are using WLS 5.1 sp10 to deploy our RMI objects.
Inside our objects, we have a lot of database transactions.
After kicking off the server and running a lot of
database transactions, the server soon did not run
and just hanged in a certain database transactions.
But still, we can see the WLS doing its GC through the
AdminMain page, reclaiming the heap memory.
What would be the possible reason for that?
thanks!
cheers,
kenYou need to take a couple of thread dumps about 30 seconds or so apart
so that you can see exactly what the threads are doing. If you need
help interpreting these dumps, please post them here.
Kenneth Yue wrote:
Hi all,
we are using WLS 5.1 sp10 to deploy our RMI objects.
Inside our objects, we have a lot of database transactions.
After kicking off the server and running a lot of
database transactions, the server soon did not run
and just hanged in a certain database transactions.
But still, we can see the WLS doing its GC through the
AdminMain page, reclaiming the heap memory.
What would be the possible reason for that?
thanks!
cheers,
ken -
Weblogic 7.0 Server hangs on Sun Solaris 5.7
Hi,
We are facing a problem with weblogic server 7.0 SP2 running on jre 1.3.1_01
Hotspot Client VM. The operating system used is SunOS 5.7 .
Symptom : The weblogic server hangs after running for around 8 to 10 hours . the
log file contains messages which says 'Connection created for Oracle Pool'Hello,
Could you take a thread dump at that state?
kill -3 <pid of WLS>
Whats the state of the client application
- Exception (PeerGone, No Router)
- or just hangs
Also, you could run WLS using the JRE that ships with it. AFAIK, its v1.3.1_06.
rgds
MS -
OS: AIX 5.3
weblogic :10.3
jdk: ibm jdk1.6sr14
when this case was happened, I hava do patch CR370915 but this issue still exists.
I change weblogic version to 10.3 that this issue still exists.
i hava to see the havacore, as follows
Memory Segment Analysis
Memory Type
# of Segments
Used Memory(bytes)
Used Memory(%)
Free Memory(bytes)
Free Memory(%)
Total Memory(bytes)
Internal
160
0
0
11,287,080
100
11,287,080
Object(reserved)
1
3,221,225,472
100
0
0
3,221,225,472
Class
1,291
65,529,828
94.66
3,694,784
5.34
69,224,612
JIT Code Cache
1
5,319,648
63.42
3,068,960
36.58
8,388,608
JIT Data Cache
1
2,852,232
34
5,536,376
66
8,388,608
Overall
1,454
3,294,927,180
99.29
23,587,200
0.71
3,318,514,380
I want to know Object(reserved) =100%,how to fix itHi ,
In order to debug weblogic server hang issues, we need to gather atleast 4 to 5 thread dumps of the wls server that is hanging , exactly during the time of issue.
This will show us as to which thread is causing the issue and will help us to fix it.
WebLogic Server Support Pattern: Generic Server Hang (Doc ID 1264286.1)
Please go through the above document which helps you to do this.
Thanks,
Sharmela -
Hi,
I am using two cluster weblogic server(WLS 5.1,sp5,redhat 6.2),
when one weblogic server hang,the other one also hang,but when I restart one
server,the other one can work without restart.
And the two weblogic hang every day,who can help me?
Thanks.
Jason Shi([email protected])
Thread dump will help.
Jason wrote:
> Hi,
>
> I am using two cluster weblogic server(WLS 5.1,sp5,redhat 6.2),
> when one weblogic server hang,the other one also hang,but when I restart one
> server,the other one can work without restart.
> And the two weblogic hang every day,who can help me?
> Thanks.
>
> Jason Shi([email protected])
Cheers
- Prasad
-
Need to add a second weblogic server for high availability
I have a weblogic 10.3.3 server with forms and reports 11.1.1.3.
I have an adminServer, WLS_FORMS and WLS_REPORTS managed servers setup.
This was setup with the wizard, so the WLS_FORMS is in the cluster_forms cluster group and WLS_REPORTS in the cluster_reports group.
I now need to add a second server with forms and reports also to act as one big server and provide high availability and load balancing.
How do I achieve thsi, is there a wizard that will do this?
The two servers are setup in exactly the same way, with the same versions of Weblogic and Forms and Reports.
Thanks in advance.I do not know "reports 11.1.1.3" application, but from your description this application is already targeted on a clustered configuration.
So it should be sufficient to add 2 new instances in the WebLogic domain "WLS_FORMS_2", "WLS_REPORTS_2", include them into the existing clusters and add a load balancer (like apache + wleblogic-plugin) that will balance requests on instances.
I never heard of wizards to create such clustered environments. However it is not hard to do:
1- Install binaries on the new machine
2- Create the domain configuration directory on the new machine using config.sh wizard in the same way you have aleady done with the first machine.
In this step you can create a clone of the existing domain, but it is enough to create a domain with the same name and the same admin instance.
Instead of using config.sh, you can also copy the domain directory from the existing machine and change diretories in scripts if needed.
The domain configuration is needed only to find the binaries, the basic domain files common to all installations, and to allow startup scripts (see point 4-) to connect to the admin and download the domain/instance configuration.
3- Configure the new instances on the existing WebLogic console
4- Create startup scripts for "WLS_FORMS_2", "WLS_REPORTS_2" on the second machine
Bye
Mariano -
Hi,
we have a J2EE application using an Oracle 8.1.7
database, Oracle thin JDBC driver and WLS 5.1 running on
a Tru64 WLS cluster.
The entire Weblogic Server is hanging (!!!) after a database
reconnect.
The problem occurs when a EJB selects data from the database and
the database is going down and the application server is trying
to reconnect.
If there is no database activity in the moment of the database
reconnect, the application works fine
(the server is not hanging).
The application only reads (select) data from the database,
no inserts/updates/deletes.
We are using a database connect pool (initial 10, increment 10,
max 30 connections, testConnsOnReserve=true,
testConnsOnRelease=false, refreshTestMinutes=1).
The problem is independend from
a) The operating System
(We tested Tru64 UNIX V4.0e, V4.0f and W2K SP2.)
b) the java version
(We tested on Tru64 UNIX V1.2.2-6 with and without
Compaq fast VM V1.2.2-4, V1.3.1-1 and V1.3.1-2 with fast
VM, on W2K V1.2.2 and V1.3.1)
c) the Oracle thin driver
(We tested an older one and the current version
for Oracle V8.1.7 - downloaded last week from Oracle.
I dont know the detailled version.
All files are named
classes12.jar or classes12_01.jar)
d) the Oracle minor version
(We tested Oracle V8.1.7.0, V8.1.7.2 and V8.1.7.3)
e) WLS as a single server application or
and all combinations from a) b) c) d) and e)
(It was a lot of work to test it !!!)
But the problem depends on the Weblogic Server service pack.
a) With WLS SP7 we have no problem.
b) With WLS SP9 and SP11 the entire application server is
hanging.
But we need WLS SP9 or higher with the bugfixing for
CR 31604: Fixed a bug where EJBs with large Primary Keys
caused OutOfMemoryErrors.
Any Idea.
Thanks in Advance.
Regards
Uwe SeyfertHi. Are you sure you've editted the startWebLogic script
to add the latest oracle driver zip ahead of all the weblogic stuff
in the weblogic.classpath, not the java.classpath? Can we see
a thread dump of the server when it hangs?
thanks,
joe
Uwe Seyfert wrote:
Hi,
we have a J2EE application using an Oracle 8.1.7
database, Oracle thin JDBC driver and WLS 5.1 running on
a Tru64 WLS cluster.
The entire Weblogic Server is hanging (!!!) after a database
reconnect.
The problem occurs when a EJB selects data from the database and
the database is going down and the application server is trying
to reconnect.
If there is no database activity in the moment of the database
reconnect, the application works fine
(the server is not hanging).
The application only reads (select) data from the database,
no inserts/updates/deletes.
We are using a database connect pool (initial 10, increment 10,
max 30 connections, testConnsOnReserve=true,
testConnsOnRelease=false, refreshTestMinutes=1).
The problem is independend from
a) The operating System
(We tested Tru64 UNIX V4.0e, V4.0f and W2K SP2.)
b) the java version
(We tested on Tru64 UNIX V1.2.2-6 with and without
Compaq fast VM V1.2.2-4, V1.3.1-1 and V1.3.1-2 with fast
VM, on W2K V1.2.2 and V1.3.1)
c) the Oracle thin driver
(We tested an older one and the current version
for Oracle V8.1.7 - downloaded last week from Oracle.
I dont know the detailled version.
All files are named
classes12.jar or classes12_01.jar)
d) the Oracle minor version
(We tested Oracle V8.1.7.0, V8.1.7.2 and V8.1.7.3)
e) WLS as a single server application or
and all combinations from a) b) c) d) and e)
(It was a lot of work to test it !!!)
But the problem depends on the Weblogic Server service pack.
a) With WLS SP7 we have no problem.
b) With WLS SP9 and SP11 the entire application server is
hanging.
But we need WLS SP9 or higher with the bugfixing for
CR 31604: Fixed a bug where EJBs with large Primary Keys
caused OutOfMemoryErrors.
Any Idea.
Thanks in Advance.
Regards
Uwe Seyfert -
Weblogic 6.0 : Server hangs while reading a https request
Hi,
I'm running WLS6.0 on Win2000. The server hangs for some requests sent over https,
unless it times out. It seems that the server is not able to read the complete request
from the socket. It somehow thinks that there is more data available and keeps on
waiting. Is this a bug?
Also, it works fine if i change the url from a https to a http one. So, is this
related to SSL implementation of weblogic?
Has any of faced a similar problem? Thanks in advance for any ideas/thoughts on this
problem,
Thakur.
The stacktrace is as follows :
Full thread dump Classic VM (1.3.0-C, native threads):
"tavant.bus.PurgeStaleDataTask" (TID:0x10ce268, sys_thread_t:0x9e73fc0, state:CW,
native ID:0
x728) prio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"tavant.bus.MsgHistTask" (TID:0x10cd3a0, sys_thread_t:0x9e73de8, state:CW, native
ID:0x10c) p
rio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"tavant.bus.MsgNotificationTask" (TID:0x10cd158, sys_thread_t:0x9fbda70, state:CW,
native ID:
0x514) prio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"SSLListenThread" (TID:0xc68510, sys_thread_t:0x9dc3b20, state:R, native ID:0x408)
prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:276)
at java.net.ServerSocket.implAccept(ServerSocket.java:241)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:123)
at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:114)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:244)
"ListenThread" (TID:0xc65ce0, sys_thread_t:0x9dc3960, state:R, native ID:0x2d8)
prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:276)
at java.net.ServerSocket.implAccept(ServerSocket.java:241)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:244)
"Application Manager Thread" (TID:0xfaf738, sys_thread_t:0x9dd07a8, state:CW,
native ID:0x5a4
) prio=5
at java.lang.Thread.sleep(Native Method)
at weblogic.management.mbeans.custom.ApplicationManager$ApplicationPoller.run(Application
Manager.java:643)
"TimeEventGenerator" (TID:0xa68020, sys_thread_t:0x9070890, state:CW, native
ID:0x4e0) prio=5
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:259)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"TimeEventGenerator" (TID:0xa3e480, sys_thread_t:0x9071c10, state:CW, native
ID:0x138) prio=5
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:259)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"SpinnerRandomSource" (TID:0xa37340, sys_thread_t:0x9050ba0, state:CW, native
ID:0x594) prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:92)
at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:109)
"ExecuteThread-14" (TID:0xa316e0, sys_thread_t:0x90502f0, state:CW, native ID:0x658)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-13" (TID:0xa317c0, sys_thread_t:0x9050180, state:CW, native ID:0x564)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-12" (TID:0xa315f0, sys_thread_t:0x9050010, state:R, native ID:0x52c)
prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:42)
at java.net.SocketInputStream.read(SocketInputStream.java:59)
at weblogic.utils.io.ChunkedInputStream.read(ChunkedInputStream.java:130)
at weblogic.security.SSL.SSLSocket$WLPushbackInputStream.read(SSLSocket$WLPushbackInputStream.java:35)
at weblogic.security.Utils.inputByte(Utils.java:131)
at weblogic.security.SSL.ContentType.input(ContentType.java:50)
at weblogic.security.SSL.SSLCiphertext.input(SSLCiphertext.java:61)
at weblogic.security.SSL.SSLSocket.getRecord(SSLSocket.java:1002)
at weblogic.security.SSL.RecordInputStream.getData(RecordInputStream.java:109)
at weblogic.security.SSL.RecordInputStream.available(RecordInputStream.java:166)
at weblogic.servlet.internal.PostInputStream.available(PostInputStream.java:146)
at weblogic.servlet.internal.ServletInputStreamImpl.available(ServletInputStreamImpl.java:21)
at java.io.InputStreamReader.inReady(InputStreamReader.java:199)
at java.io.InputStreamReader.fill(InputStreamReader.java:171)
at java.io.InputStreamReader.read(InputStreamReader.java:249)
at java.io.BufferedReader.fill(BufferedReader.java:139)
at java.io.BufferedReader.read1(BufferedReader.java:187)
at java.io.BufferedReader.read(BufferedReader.java:261)
at weblogic.servlet.internal.ServletRequestImpl.mergePostParams(ServletRequestImpl.java:596)
at weblogic.servlet.internal.ServletRequestImpl.parseQueryParams(ServletRequestImpl.java:501)
at weblogic.servlet.internal.ServletRequestImpl.parseQueryParams(ServletRequestImpl.java:494)
at weblogic.servlet.internal.ServletRequestImpl.getParameterNames(ServletRequestImpl.java:649)
at tavant.web.URLGen.<init>(URLGen.java:51)
at tavant.web.MainServlet.processRequest(MainServlet.java:189)
at tavant.web.MainServlet.doPost(MainServlet.java:172)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:760)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:208)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:1127)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:1529)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-11" (TID:0xa31520, sys_thread_t:0x9060b48, state:CW, native ID:0x718)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-10" (TID:0xa31500, sys_thread_t:0x90609d8, state:CW, native ID:0x768)
prio=5
at java.lang.Object.wait(Native Method)
at weblogic.common.internal.DynaQueue.getW(DynaQueue.java:228)
at weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:246)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-9" (TID:0xa31330, sys_thread_t:0x9060868, state:CW, native ID:0x460)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-8" (TID:0xa31170, sys_thread_t:0x90606f8, state:CW, native ID:0x3a8)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-7" (TID:0xa31250, sys_thread_t:0x9060588, state:CW, native ID:0x754)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-6" (TID:0xa31080, sys_thread_t:0x90604a0, state:CW, native ID:0x600)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-5" (TID:0xa30eb0, sys_thread_t:0x8fd1638, state:CW, native ID:0x500)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-4" (TID:0xa30f98, sys_thread_t:0x8fd14c8, state:CW, native ID:0x5b8)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-3" (TID:0xa30dc8, sys_thread_t:0x8fd1358, state:CW, native ID:0x4b4)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-2" (TID:0xa30c00, sys_thread_t:0x901f8c8, state:CW, native ID:0x798)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-1" (TID:0xa30ce0, sys_thread_t:0x901f758, state:CW, native ID:0x88)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-0" (TID:0xa308d0, sys_thread_t:0x901f670, state:CW, native ID:0x3a0)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"Thread-0" (TID:0x85a238, sys_thread_t:0x8fb5088, state:CW, native ID:0x744)
prio=10
at java.lang.Thread.sleep(Native Method)
at weblogic.transaction.internal.TransactionManagerImpl$1.run(TransactionManagerImpl.java:737)
at java.lang.Thread.run(Thread.java:484)
"Finalizer" (TID:0x7b0528, sys_thread_t:0x89fa088, state:CW, native ID:0x5c4)
prio=8
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:108)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:123)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:162)
"Reference Handler" (TID:0x7b0300, sys_thread_t:0x89f6148, state:CW, native ID:0x690)
prio=10
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:110)
"Signal dispatcher" (TID:0x7b0330, sys_thread_t:0x89ef5f8, state:R, native ID:0x5ac)
prio=5
"main" (TID:0x7b01a0, sys_thread_t:0x235328, state:CW, native ID:0x788) prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:498)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:171)
at weblogic.Server.main(Server.java:35)
Monitor Cache Dump:
weblogic.kernel.ExecuteThread@A316E0/22C7E48: <unowned>
Waiting to be notified:
"ExecuteThread-14" (0x90502f0)
weblogic.kernel.ExecuteThread@A30CE0/22C5268: <unowned>
Waiting to be notified:
"ExecuteThread-1" (0x901f758)
weblogic.kernel.ExecuteThread@A308D0/22C4DD0: <unowned>
Waiting to be notified:
"ExecuteThread-0" (0x901f670)
weblogic.kernel.ExecuteThread@A30EB0/22C6028: <unowned>
Waiting to be notified:
"ExecuteThread-5" (0x8fd1638)
weblogic.kernel.ExecuteThread@A31080/22C6398: <unowned>
Waiting to be notified:
"ExecuteThread-6" (0x90604a0)
weblogic.kernel.ExecuteThread@A31250/22C6708: <unowned>
Waiting to be notified:
"ExecuteThread-7" (0x9060588)
java.io.InputStreamReader@FEAB90/3DD57C8: owner "ExecuteThread-12" (0x9050010)
1 entry
weblogic.kernel.ExecuteThread@A30C00/22C55D8: <unowned>
Waiting to be notified:
"ExecuteThread-2" (0x901f8c8)
java.net.PlainSocketImpl@FB1FE8/25A91C0: owner "SSLListenThread" (0x9dc3b20)
1 entry
weblogic.time.common.internal.TimeTable@A68270/22FF4B0: <unowned>
Waiting to be notified:
"TimeEventGenerator" (0x9070890)
weblogic.kernel.ExecuteThread@A317C0/22C7B38: <unowned>
Waiting to be notified:
"ExecuteThread-13" (0x9050180)
weblogic.time.common.internal.TimeTable@A3E730/22CDA60: <unowned>
Waiting to be notified:
"TimeEventGenerator" (0x9071c10)
java.net.PlainSocketImpl@FB1DD0/25A9110: owner "ListenThread" (0x9dc3960) 1 entry
weblogic.kernel.ExecuteThread@A30DC8/22C5948: <unowned>
Waiting to be notified:
"ExecuteThread-3" (0x8fd1358)
weblogic.kernel.ExecuteThread@A30F98/22C5CB8: <unowned>
Waiting to be notified:
"ExecuteThread-4" (0x8fd14c8)
weblogic.common.internal.DynaQueue@FB97F8/25AB878: <unowned>
Waiting to be notified:
"ExecuteThread-10" (0x90609d8)
weblogic.kernel.ExecuteThread@A31170/22C6A78: <unowned>
Waiting to be notified:
"ExecuteThread-8" (0x90606f8)
java.lang.ref.ReferenceQueue$Lock@7B0540/214CA40: <unowned>
Waiting to be notified:
"Finalizer" (0x89fa088)
weblogic.t3.srvr.T3Srvr@7C4C08/2185000: <unowned>
Waiting to be notified:
"main" (0x235328)
weblogic.kernel.ExecuteThread@A31520/22C74C8: <unowned>
Waiting to be notified:
"ExecuteThread-11" (0x9060b48)
weblogic.security.SpinnerThread@A37340/22CAB60: <unowned>
Waiting to be notified:
"SpinnerRandomSource" (0x9050ba0)
weblogic.servlet.internal.ServletInputStreamImpl@FEB090/3DD28C8: owner "ExecuteThread-12"
(0x9050010) 1 entry
weblogic.kernel.ExecuteThread@A31330/22C6DE8: <unowned>
Waiting to be notified:
"ExecuteThread-9" (0x9060868)
java.lang.ref.Reference$Lock@7B0310/214C560: <unowned>
Waiting to be notified:
"Reference Handler" (0x89f6148)
Registered Monitor Dump:
utf8 hash table: <unowned>
JNI pinning lock: <unowned>
JNI global reference lock: <unowned>
BinClass lock: <unowned>
Class linking lock: <unowned>
System class loader lock: <unowned>
Code rewrite lock: <unowned>
Heap lock: <unowned>
Monitor cache lock: owner "Signal dispatcher" (0x89ef5f8) 1 entry
Thread queue lock: owner "Signal dispatcher" (0x89ef5f8) 1 entry
Monitor registry: owner "Signal dispatcher" (0x89ef5f8) 1 entryHi,
I'm running WLS6.0 on Win2000. The server hangs for some requests sent over https,
unless it times out. It seems that the server is not able to read the complete request
from the socket. It somehow thinks that there is more data available and keeps on
waiting. Is this a bug?
Also, it works fine if i change the url from a https to a http one. So, is this
related to SSL implementation of weblogic?
Has any of faced a similar problem? Thanks in advance for any ideas/thoughts on this
problem,
Thakur.
The stacktrace is as follows :
Full thread dump Classic VM (1.3.0-C, native threads):
"tavant.bus.PurgeStaleDataTask" (TID:0x10ce268, sys_thread_t:0x9e73fc0, state:CW,
native ID:0
x728) prio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"tavant.bus.MsgHistTask" (TID:0x10cd3a0, sys_thread_t:0x9e73de8, state:CW, native
ID:0x10c) p
rio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"tavant.bus.MsgNotificationTask" (TID:0x10cd158, sys_thread_t:0x9fbda70, state:CW,
native ID:
0x514) prio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"SSLListenThread" (TID:0xc68510, sys_thread_t:0x9dc3b20, state:R, native ID:0x408)
prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:276)
at java.net.ServerSocket.implAccept(ServerSocket.java:241)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:123)
at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:114)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:244)
"ListenThread" (TID:0xc65ce0, sys_thread_t:0x9dc3960, state:R, native ID:0x2d8)
prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:276)
at java.net.ServerSocket.implAccept(ServerSocket.java:241)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:244)
"Application Manager Thread" (TID:0xfaf738, sys_thread_t:0x9dd07a8, state:CW,
native ID:0x5a4
) prio=5
at java.lang.Thread.sleep(Native Method)
at weblogic.management.mbeans.custom.ApplicationManager$ApplicationPoller.run(Application
Manager.java:643)
"TimeEventGenerator" (TID:0xa68020, sys_thread_t:0x9070890, state:CW, native
ID:0x4e0) prio=5
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:259)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"TimeEventGenerator" (TID:0xa3e480, sys_thread_t:0x9071c10, state:CW, native
ID:0x138) prio=5
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:259)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"SpinnerRandomSource" (TID:0xa37340, sys_thread_t:0x9050ba0, state:CW, native
ID:0x594) prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:92)
at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:109)
"ExecuteThread-14" (TID:0xa316e0, sys_thread_t:0x90502f0, state:CW, native ID:0x658)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-13" (TID:0xa317c0, sys_thread_t:0x9050180, state:CW, native ID:0x564)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-12" (TID:0xa315f0, sys_thread_t:0x9050010, state:R, native ID:0x52c)
prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:42)
at java.net.SocketInputStream.read(SocketInputStream.java:59)
at weblogic.utils.io.ChunkedInputStream.read(ChunkedInputStream.java:130)
at weblogic.security.SSL.SSLSocket$WLPushbackInputStream.read(SSLSocket$WLPushbackInputStream.java:35)
at weblogic.security.Utils.inputByte(Utils.java:131)
at weblogic.security.SSL.ContentType.input(ContentType.java:50)
at weblogic.security.SSL.SSLCiphertext.input(SSLCiphertext.java:61)
at weblogic.security.SSL.SSLSocket.getRecord(SSLSocket.java:1002)
at weblogic.security.SSL.RecordInputStream.getData(RecordInputStream.java:109)
at weblogic.security.SSL.RecordInputStream.available(RecordInputStream.java:166)
at weblogic.servlet.internal.PostInputStream.available(PostInputStream.java:146)
at weblogic.servlet.internal.ServletInputStreamImpl.available(ServletInputStreamImpl.java:21)
at java.io.InputStreamReader.inReady(InputStreamReader.java:199)
at java.io.InputStreamReader.fill(InputStreamReader.java:171)
at java.io.InputStreamReader.read(InputStreamReader.java:249)
at java.io.BufferedReader.fill(BufferedReader.java:139)
at java.io.BufferedReader.read1(BufferedReader.java:187)
at java.io.BufferedReader.read(BufferedReader.java:261)
at weblogic.servlet.internal.ServletRequestImpl.mergePostParams(ServletRequestImpl.java:596)
at weblogic.servlet.internal.ServletRequestImpl.parseQueryParams(ServletRequestImpl.java:501)
at weblogic.servlet.internal.ServletRequestImpl.parseQueryParams(ServletRequestImpl.java:494)
at weblogic.servlet.internal.ServletRequestImpl.getParameterNames(ServletRequestImpl.java:649)
at tavant.web.URLGen.<init>(URLGen.java:51)
at tavant.web.MainServlet.processRequest(MainServlet.java:189)
at tavant.web.MainServlet.doPost(MainServlet.java:172)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:760)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:208)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:1127)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:1529)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-11" (TID:0xa31520, sys_thread_t:0x9060b48, state:CW, native ID:0x718)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-10" (TID:0xa31500, sys_thread_t:0x90609d8, state:CW, native ID:0x768)
prio=5
at java.lang.Object.wait(Native Method)
at weblogic.common.internal.DynaQueue.getW(DynaQueue.java:228)
at weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:246)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-9" (TID:0xa31330, sys_thread_t:0x9060868, state:CW, native ID:0x460)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-8" (TID:0xa31170, sys_thread_t:0x90606f8, state:CW, native ID:0x3a8)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-7" (TID:0xa31250, sys_thread_t:0x9060588, state:CW, native ID:0x754)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-6" (TID:0xa31080, sys_thread_t:0x90604a0, state:CW, native ID:0x600)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-5" (TID:0xa30eb0, sys_thread_t:0x8fd1638, state:CW, native ID:0x500)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-4" (TID:0xa30f98, sys_thread_t:0x8fd14c8, state:CW, native ID:0x5b8)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-3" (TID:0xa30dc8, sys_thread_t:0x8fd1358, state:CW, native ID:0x4b4)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-2" (TID:0xa30c00, sys_thread_t:0x901f8c8, state:CW, native ID:0x798)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-1" (TID:0xa30ce0, sys_thread_t:0x901f758, state:CW, native ID:0x88)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-0" (TID:0xa308d0, sys_thread_t:0x901f670, state:CW, native ID:0x3a0)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"Thread-0" (TID:0x85a238, sys_thread_t:0x8fb5088, state:CW, native ID:0x744)
prio=10
at java.lang.Thread.sleep(Native Method)
at weblogic.transaction.internal.TransactionManagerImpl$1.run(TransactionManagerImpl.java:737)
at java.lang.Thread.run(Thread.java:484)
"Finalizer" (TID:0x7b0528, sys_thread_t:0x89fa088, state:CW, native ID:0x5c4)
prio=8
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:108)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:123)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:162)
"Reference Handler" (TID:0x7b0300, sys_thread_t:0x89f6148, state:CW, native ID:0x690)
prio=10
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:110)
"Signal dispatcher" (TID:0x7b0330, sys_thread_t:0x89ef5f8, state:R, native ID:0x5ac)
prio=5
"main" (TID:0x7b01a0, sys_thread_t:0x235328, state:CW, native ID:0x788) prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:498)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:171)
at weblogic.Server.main(Server.java:35)
Monitor Cache Dump:
weblogic.kernel.ExecuteThread@A316E0/22C7E48: <unowned>
Waiting to be notified:
"ExecuteThread-14" (0x90502f0)
weblogic.kernel.ExecuteThread@A30CE0/22C5268: <unowned>
Waiting to be notified:
"ExecuteThread-1" (0x901f758)
weblogic.kernel.ExecuteThread@A308D0/22C4DD0: <unowned>
Waiting to be notified:
"ExecuteThread-0" (0x901f670)
weblogic.kernel.ExecuteThread@A30EB0/22C6028: <unowned>
Waiting to be notified:
"ExecuteThread-5" (0x8fd1638)
weblogic.kernel.ExecuteThread@A31080/22C6398: <unowned>
Waiting to be notified:
"ExecuteThread-6" (0x90604a0)
weblogic.kernel.ExecuteThread@A31250/22C6708: <unowned>
Waiting to be notified:
"ExecuteThread-7" (0x9060588)
java.io.InputStreamReader@FEAB90/3DD57C8: owner "ExecuteThread-12" (0x9050010)
1 entry
weblogic.kernel.ExecuteThread@A30C00/22C55D8: <unowned>
Waiting to be notified:
"ExecuteThread-2" (0x901f8c8)
java.net.PlainSocketImpl@FB1FE8/25A91C0: owner "SSLListenThread" (0x9dc3b20)
1 entry
weblogic.time.common.internal.TimeTable@A68270/22FF4B0: <unowned>
Waiting to be notified:
"TimeEventGenerator" (0x9070890)
weblogic.kernel.ExecuteThread@A317C0/22C7B38: <unowned>
Waiting to be notified:
"ExecuteThread-13" (0x9050180)
weblogic.time.common.internal.TimeTable@A3E730/22CDA60: <unowned>
Waiting to be notified:
"TimeEventGenerator" (0x9071c10)
java.net.PlainSocketImpl@FB1DD0/25A9110: owner "ListenThread" (0x9dc3960) 1 entry
weblogic.kernel.ExecuteThread@A30DC8/22C5948: <unowned>
Waiting to be notified:
"ExecuteThread-3" (0x8fd1358)
weblogic.kernel.ExecuteThread@A30F98/22C5CB8: <unowned>
Waiting to be notified:
"ExecuteThread-4" (0x8fd14c8)
weblogic.common.internal.DynaQueue@FB97F8/25AB878: <unowned>
Waiting to be notified:
"ExecuteThread-10" (0x90609d8)
weblogic.kernel.ExecuteThread@A31170/22C6A78: <unowned>
Waiting to be notified:
"ExecuteThread-8" (0x90606f8)
java.lang.ref.ReferenceQueue$Lock@7B0540/214CA40: <unowned>
Waiting to be notified:
"Finalizer" (0x89fa088)
weblogic.t3.srvr.T3Srvr@7C4C08/2185000: <unowned>
Waiting to be notified:
"main" (0x235328)
weblogic.kernel.ExecuteThread@A31520/22C74C8: <unowned>
Waiting to be notified:
"ExecuteThread-11" (0x9060b48)
weblogic.security.SpinnerThread@A37340/22CAB60: <unowned>
Waiting to be notified:
"SpinnerRandomSource" (0x9050ba0)
weblogic.servlet.internal.ServletInputStreamImpl@FEB090/3DD28C8: owner "ExecuteThread-12"
(0x9050010) 1 entry
weblogic.kernel.ExecuteThread@A31330/22C6DE8: <unowned>
Waiting to be notified:
"ExecuteThread-9" (0x9060868)
java.lang.ref.Reference$Lock@7B0310/214C560: <unowned>
Waiting to be notified:
"Reference Handler" (0x89f6148)
Registered Monitor Dump:
utf8 hash table: <unowned>
JNI pinning lock: <unowned>
JNI global reference lock: <unowned>
BinClass lock: <unowned>
Class linking lock: <unowned>
System class loader lock: <unowned>
Code rewrite lock: <unowned>
Heap lock: <unowned>
Monitor cache lock: owner "Signal dispatcher" (0x89ef5f8) 1 entry
Thread queue lock: owner "Signal dispatcher" (0x89ef5f8) 1 entry
Monitor registry: owner "Signal dispatcher" (0x89ef5f8) 1 entry -
Weblogic Thread hogging at java.io.WinNTFileSystem.getBooleanAttributes at high loads
Hi,
At high loads, we are seeing that one WebLogic thread is active on a windows native call for quite some time.. I can see the following stack statements in thread dumps taken at 10 minutes interval. This has led to slow server performance.
This happens on WebLogic 10.3.2 that is hosted in Windows Server 64 bit 2008 Enterprise Edition SP1.
The JDK used is JRockit jdk1.6.0_20-R28.3.2 (64 Bit)
Also this happens at high user loads only and also irregularly.
Our eclipse link versions are (Implementation-Version: 1.0.1-20080905, Specification-Version: 1.0.1)
Any recommendation or pointer is appreciated.
Now the thread dump details
"[ACTIVE] ExecuteThread: '13' for queue: 'weblogic.kernel.Default (self-tuning)'" RUNNABLE
java.io.WinNTFileSystem.getBooleanAttributes(Native Method)
java.io.File.isDirectory(File.java:754)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive$1.accept(DirectoryArchive.java:91)
java.io.File.listFiles(File.java:1134)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.init(DirectoryArchive.java:89)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.init(DirectoryArchive.java:95)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.init(DirectoryArchive.java:95)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.init(DirectoryArchive.java:95)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.init(DirectoryArchive.java:95)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.init(DirectoryArchive.java:95)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.init(DirectoryArchive.java:95)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.init(DirectoryArchive.java:95)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.<init>(DirectoryArchive.java:73)
org.eclipse.persistence.internal.jpa.deployment.DirectoryArchive.<init>(DirectoryArchive.java:55)
org.eclipse.persistence.internal.jpa.deployment.ArchiveFactoryImpl.createArchive(ArchiveFactoryImpl.java:76)
org.eclipse.persistence.internal.jpa.deployment.PersistenceUnitProcessor.findPersistenceArchives(PersistenceUnitProcessor.java:184)
org.eclipse.persistence.internal.jpa.deployment.JPAInitializer.initialize(JPAInitializer.java:132)
org.eclipse.persistence.jpa.PersistenceProvider.createEntityManagerFactory(PersistenceProvider.java:104)
org.eclipse.persistence.jpa.PersistenceProvider.createEntityManagerFactory(PersistenceProvider.java:64)
javax.persistence.Persistence.createEntityManagerFactory(Persistence.java:78)
javax.persistence.Persistence.createEntityManagerFactory(Persistence.java:54)
-- Our internal class calls
org.jbpm.graph.def.Action.execute(Action.java:123)
org.jbpm.graph.def.GraphElement.executeAction(GraphElement.java:235)
org.jbpm.graph.def.GraphElement.executeActions(GraphElement.java:212)
org.jbpm.graph.def.GraphElement.fireAndPropagateEvent(GraphElement.java:182)
org.jbpm.graph.def.GraphElement.fireEvent(GraphElement.java:166)
org.jbpm.graph.exe.ProcessInstance.<init>(ProcessInstance.java:120)
org.jbpm.JbpmContext.newProcessInstance(JbpmContext.java:372)
-- Our internal class calls
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:597)
org.apache.myfaces.el.MethodBindingImpl.invoke(MethodBindingImpl.java:129)
org.apache.myfaces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:63)
javax.faces.component.UICommand.broadcast(UICommand.java:106)
org.ajax4jsf.framework.ajax.AjaxViewRoot.processEvents(AjaxViewRoot.java:180)
org.ajax4jsf.framework.ajax.AjaxViewRoot.broadcastEvents(AjaxViewRoot.java:158)
org.ajax4jsf.framework.ajax.AjaxViewRoot.processApplication(AjaxViewRoot.java:346)
org.apache.myfaces.lifecycle.LifecycleImpl.invokeApplication(LifecycleImpl.java:343)
org.apache.myfaces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:86)
-- Our internal class calls
javax.faces.webapp.FacesServlet.service(FacesServlet.java:137)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292)
weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
org.apache.myfaces.webapp.filter.ExtensionsFilter.doFilter(ExtensionsFilter.java:144)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
org.ajax4jsf.framework.ajax.xmlfilter.BaseXMLFilter.doXmlFilter(BaseXMLFilter.java:127)
org.ajax4jsf.framework.ajax.xmlfilter.BaseFilter.doFilter(BaseFilter.java:277)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
com.anychart.servlet.ResourceFilter.doFilter(ResourceFilter.java:53)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
-- Our internal class calls
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
-- Our internal class calls
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2202)
weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2108)
weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1432)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
weblogic.work.ExecuteThread.run(ExecuteThread.java:173)Hi,
Maybe this thread could help, if it addresses your problem correctly:
Performance issues with class loader on Windows server
Regards,
Mohab -
INSTALLATION ON HIGH AVAILABILITY USING WEBLOGIC SERVER
Hi All ,
IHAC where i am planning to propose the following architecture and I did not find much information on the OTN documentation
How to configure the BI Publisher for High Availability using Oracle Weblogic Server. I have gone thorugh the following document on OTN.
http://www.oracle.com/technology/products/xml-publisher/docs/BIP_HA.pdf
1) Can the BI Publisher be installed on a weblogic cluster having two nodes. I did not find any specific information on this in the BI publisher documents other than the link I mentioned above. Do we have any Enterprise Deployment guide for standalone BI Publisher ?
2) What is the best practice to implement the High Availability of BI Publisher on weblogic server.
Other info,
As mentioned in the above link I am planning to use the BIPublisher ultra scalable architecture.
Where the Load Balancer is HW load balancer and Internal load balancer is managed using the Apache configuration and Oracle XMLDB11.1.0.7 is used as the shared repository.
regards,
Pierre .Hi
You have to have a shared drive for CI,SCS abd DB on the shared drive something like SAN.
You will have HACMP the IBM Cluster SW shall be configured and installed properly.
You may need support from the AIX engineer to configure it.
DB and CI installation will be done by Basis normally.
Yes ,there is arequirement to install and db and OS Filesystems on shared drive.
For further information ,you can look for inst guide at service.sap.com/instguides
Hope it helps.
Maybe you are looking for
-
Black screen during windows 7 install on mac mini
I have a mac mini 2013. Trying to install windows 7 via usb iso file. downloaded iso file to mac mini desktop from windows supported site. This is a 30 trial that can be installed after 30 with a genuine key, which I plan on buying. 8 gb usb stic
-
Problem in web dynpro ABAP program
There are 2 input fields on first view carrid, connid and one "GO" Button 1) "FLIGHTINFO" is the node under context of first view 2) " FLIGHTTAB " is a node under context of component controller having cardinality " 0..n " ,Dictionary structure "SFL
-
HI, down payment request amount is should not more than PO value (base amounttaxfright charges) how to maintain in validation. could you please send me the steps and formulas. Plese help me any one. Thanks, Samudra.
-
CS5.5 Serial Number Problem for CS6 Upgrade
I purchased a legitimate copy of CS5,5 Design Premium in August and it installed perfectly with the Adobe Serial Number. However, I decided to upgrade to CS6 Design & Web Premium but the program installer is telling me that my Serial Number is invali
-
OpenGl Enabling problem. Help ASAP :(
Hi there. I need help. How can i enabe OpenGL in my Photoshop CS6. I have GTX 650 Video Card. Here is screen. http://s1055.beta.photobucket.com/user/dskdrago/media/Capture-3_zps0d25260b.png.html?sort= 3&o=0