WebLogic 11g - Stuck Thread issue observed during MS-ADS authentication

Hi
We have weblogic server 10.3.5 installed on RHEL 5.6. For our application authentication, we are getting user credentials authenticated for application login page using Microsoft Active Directory Service (MS-ADS) configured under WebLogic Security Realm. We are getting the below error message now due to STUCK Thread observed at JVM level.
Could you please help me to fix this issue and my thanks in advance.
]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-6424 "[STUCK] ExecuteThread: '11' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, suspended, waiting, priority=1, DAEMON> {
-- Waiting for notification on: netscape.ldap.LDAPResponseListener@3a8ecc70[fat lock]
java.lang.Object.wait(Object.java:???)
java.lang.Object.wait(Object.java:485)
netscape.ldap.LDAPMessageQueue.waitForMessage(LDAPMessageQueue.java:198)
netscape.ldap.LDAPMessageQueue.waitFirstMessage(LDAPMessageQueue.java:100)
netscape.ldap.LDAPConnection.sendRequest(LDAPConnection.java:1782)
^-- Holding lock: netscape.ldap.LDAPConnection@3a8ecc83[thin lock]
netscape.ldap.LDAPConnection.simpleBind(LDAPConnection.java:1752)
netscape.ldap.LDAPConnection.authenticate(LDAPConnection.java:1260)
netscape.ldap.LDAPConnection.authenticate(LDAPConnection.java:1273)
netscape.ldap.LDAPConnection.authenticate(LDAPConnection.java:1240)
netscape.ldap.LDAPConnection.referralRebind(LDAPConnection.java:4955)
netscape.ldap.LDAPConnection.performReferrals(LDAPConnection.java:5065)
netscape.ldap.LDAPConnection.checkSearchMsg(LDAPConnection.java:2632)
netscape.ldap.LDAPConnection.search(LDAPConnection.java:2500)
weblogic.security.providers.authentication.LDAPAtnDelegate.getDNForUser(LDAPAtnDelegate.java:3667)
weblogic.security.providers.authentication.LDAPAtnDelegate.authenticate(LDAPAtnDelegate.java:3513)
weblogic.security.providers.authentication.LDAPAtnLoginModuleImpl.login(LDAPAtnLoginModuleImpl.java:145)
com.bea.common.security.internal.service.LoginModuleWrapper$1.run(LoginModuleWrapper.java:110)
com.bea.common.security.internal.service.LoginModuleWrapper.login(LoginModuleWrapper.java:101)
sun.reflect.GeneratedMethodAccessor2808.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
javax.security.auth.login.LoginContext.invoke(LoginContext.java:720)
javax.security.auth.login.LoginContext.access$000(LoginContext.java:186)
javax.security.auth.login.LoginContext$4.run(LoginContext.java:683)
javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680)
javax.security.auth.login.LoginContext.login(LoginContext.java:566)
com.bea.common.security.internal.service.JAASLoginServiceImpl.login(JAASLoginServiceImpl.java:77)
sun.reflect.GeneratedMethodAccessor366.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
com.bea.common.security.internal.utils.Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
$Proxy28.login(Unknown Source)
weblogic.security.service.internal.WLSJAASLoginServiceImpl$ServiceImpl.login(WLSJAASLoginServiceImpl.java:81)
com.bea.common.security.internal.service.JAASAuthenticationServiceImpl.authenticate(JAASAuthenticationServiceImpl.java:74)
sun.reflect.GeneratedMethodAccessor364.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
com.bea.common.security.internal.utils.Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
$Proxy46.authenticate(Unknown Source)
weblogic.security.service.WLSJAASAuthenticationServiceWrapper.authenticate(WLSJAASAuthenticationServiceWrapper.java:29)
weblogic.security.service.PrincipalAuthenticator.authenticate(PrincipalAuthenticator.java:339)
weblogic.security.services.Authentication.doLogin(Authentication.java:127)
weblogic.security.services.Authentication.login(Authentication.java:69)
weblogic.security.services.Authentication.login(Authentication.java:51)
in.sis.ps.view.template.user.UserAdapter.doLogin(UserAdapter.java:681)
sun.reflect.GeneratedMethodAccessor2824.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
com.sun.el.parser.AstValue.invoke(Unknown Source)
com.sun.el.MethodExpressionImpl.invoke(Unknown Source)
org.apache.myfaces.trinidad.component.MethodExpressionMethodBinding.invoke(MethodExpressionMethodBinding.java:46)
com.sun.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:85)
org.apache.myfaces.trinidad.component.UIXCommand.broadcast(UIXCommand.java:171)
oracle.adf.view.rich.component.fragment.ContextSwitchingComponent$1.run(ContextSwitchingComponent.java:130)
oracle.adf.view.rich.component.fragment.ContextSwitchingComponent._processPhase(ContextSwitchingComponent.java:447)
oracle.adf.view.rich.component.fragment.ContextSwitchingComponent.broadcast(ContextSwitchingComponent.java:122)
oracle.adf.view.rich.component.fragment.UIXInclude.broadcast(UIXInclude.java:106)
oracle.adf.view.rich.component.fragment.ContextSwitchingComponent$1.run(ContextSwitchingComponent.java:130)
oracle.adf.view.rich.component.fragment.ContextSwitchingComponent._processPhase(ContextSwitchingComponent.java:447)
oracle.adf.view.rich.component.fragment.ContextSwitchingComponent.broadcast(ContextSwitchingComponent.java:122)
oracle.adf.view.rich.component.fragment.UIXInclude.broadcast(UIXInclude.java:106)
javax.faces.component.UIViewRoot.broadcastEvents(UIViewRoot.java:720)
javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:1247)
oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._invokeApplication(LifecycleImpl.java:964)
oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:259)
oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:181)
javax.faces.webapp.FacesServlet.service(FacesServlet.java:284)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:206)
weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:115)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:65)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:459)
oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:44)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:459)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:253)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:148)
org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:91)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:299)
oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:405)
oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:98)
oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:70)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:86)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:25)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3687)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:308)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:116)
weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2213)
weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2135)
weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1420)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:203)
weblogic.work.ExecuteThread.run(ExecuteThread.java:170)
}

Hi,
make sure to keep your Authentication provider in provider specific select group member search as limited where as default would be unlimited.
Once you made this changes then it will solve this issue.
Regards,
Kal

Similar Messages

Problem Deploying Composites to Oracle SOA 11.1.1.5 (STUCK Thread Issue)

Hi All,
I got stuck thread issues when deploying composites to Oracle SOA 11.1.1.5 running on Windows Server 2008 R2. Even the SimpleApproval composite which ships with the standard installation is having trouble deploying.
The composites are deploying fine in Oracle SOA 11.1.1.5 running on Windows XP.
I'm not so good with thread dumps, so I post it below for rescue.
Please advice,
Rommel
<Jul 18, 2011 10:15:25 AM AST> <Error> <WebLogicServer> <BEA-000337> <[STUCK] Ex
ecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)' has been bus
y for "605" seconds working on the request "weblogic.servlet.internal.ServletReq
uestImpl@32d047d4[
POST /soa-infra/deployer HTTP/1.1
Connection: TE
TE: trailers, deflate, gzip, compress
User-Agent: Oracle HTTPClient Version 10h
Accept-Encoding: gzip, x-gzip, compress, x-compress
ECID-Context:
Authorization: Basic bmFnaGl3ZWJsb2dpY3NvYTp3ZWJsb2dpY3NvYTEwIQ==
Content-type: application/octet-stream
Content-Length: 25876
]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds
. Stack trace:
Thread-55 "[STUCK] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-
tuning)'" <alive, in native, suspended, priority=1, DAEMON> {
jrockit.net.SocketNativeIO.readBytesPinned(SocketNativeIO.java:???)
jrockit.net.SocketNativeIO.socketRead(SocketNativeIO.java:24)
java.net.SocketInputStream.socketRead0(SocketInputStream.java:???)
java.net.SocketInputStream.read(SocketInputStream.java:107)
oracle.net.nt.MetricsEnabledInputStream.read(TcpNTAdapter.java:707)
oracle.net.ns.Packet.receive(Packet.java:243)
oracle.net.ns.DataPacket.receive(DataPacket.java:106)
oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:309)
oracle.net.ns.NetInputStream.read(NetInputStream.java:254)
oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrap
per.java:93)
oracle.jdbc.driver.T4CMAREngine.getNBytes(T4CMAREngine.java:1573)
oracle.jdbc.driver.T4C8TTILobd.unmarshalLobData(T4C8TTILobd.java:360)
oracle.jdbc.driver.T4C8TTILob.readLOBD(T4C8TTILob.java:787)
oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:303)
oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:181)
oracle.jdbc.driver.T4C8TTILob.read(T4C8TTILob.java:139)
oracle.jdbc.driver.T4CConnection.getBytes(T4CConnection.java:2690)
^-- Holding lock: oracle.jdbc.driver.T4CConnection@32386377[thin lock]
oracle.sql.BLOB.getBytes(BLOB.java:557)
oracle.jdbc.driver.OracleBlobInputStream.needBytes(OracleBlobInputStream.jav
a:188)
oracle.jdbc.driver.OracleBufferedStream.readInternal(OracleBufferedStream.ja
va:171)
oracle.jdbc.driver.OracleBufferedStream.read(OracleBufferedStream.java:151)
^-- Holding lock: oracle.jdbc.driver.OracleBlobInputStream@341d0b87[thin loc
k]
java.io.BufferedInputStream.fill(BufferedInputStream.java:189)
java.io.BufferedInputStream.read(BufferedInputStream.java:236)
^-- Holding lock: oracle.mds.internal.persistence.db.DBInputStream@341d0bb2[
thin lock]
oracle.xml.parser.v2.XMLReader.pushXMLReader(XMLReader.java:363)
oracle.xml.parser.v2.XMLReader.pushXMLReader(XMLReader.java:230)
oracle.xml.parser.v2.XMLParser.parse(XMLParser.java:217)
oracle.fabric.common.wsdl.SchemaBuilder.parseXMLSrc(SchemaBuilder.java:1016)
oracle.fabric.common.wsdl.SchemaBuilder.parseXSDSrc(SchemaBuilder.java:984)
oracle.fabric.common.wsdl.SchemaBuilder.processSchemaImportsAndInclude(Schem
aBuilder.java:755)
oracle.fabric.common.wsdl.SchemaBuilder.loadEmbeddedSchemas(SchemaBuilder.ja
va:474)
oracle.fabric.common.wsdl.SchemaBuilder.loadSchemasFromWSDL(SchemaBuilder.ja
va:423)
oracle.fabric.common.wsdl.SchemaBuilder.loadAllSchemas(SchemaBuilder.java:21
4)
oracle.fabric.common.wsdl.SchemaManager.loadAllXSD(SchemaManager.java:209)
^-- Holding lock: oracle.fabric.common.wsdl.SchemaManager@36279195[thin lock
oracle.fabric.common.wsdl.SchemaManager.getXSDEntityResolver(SchemaManager.j
ava:424)
oracle.fabric.composite.model.CompositeModel.loadImports(CompositeModel.java
:361)
oracle.fabric.composite.model.CompositeModel.getWSDLManager(CompositeModel.j
ava:196)
oracle.integration.platform.blocks.adapter.AbstractAdapterBindingComponent.g
etWSDLDefinition(AbstractAdapterBindingComponent.java:168)
oracle.integration.platform.blocks.adapter.AdapterReference.loadDefinition(A
dapterReference.java:543)
oracle.integration.platform.blocks.adapter.AdapterReference.load(AdapterRefe
rence.java:377)
oracle.integration.platform.blocks.adapter.AdapterReference.load(AdapterRefe
rence.java:73)
oracle.integration.platform.blocks.deploy.CompositeDeploymentConnection.depl
oyReferences(CompositeDeploymentConnection.java:177)
oracle.integration.platform.blocks.deploy.CompositeDeploymentConnection.depl
oy(CompositeDeploymentConnection.java:81)
oracle.integration.platform.blocks.deploy.CompositeDeploymentManagerImpl.ini
tDeployment(CompositeDeploymentManagerImpl.java:143)
oracle.integration.platform.blocks.deploy.CompositeDeploymentManagerImpl.loa
d(CompositeDeploymentManagerImpl.java:61)
sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:?
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:27
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopU
tils.java:306)
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint
(ReflectiveMethodInvocation.java:182)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflect
iveMethodInvocation.java:148)
oracle.integration.platform.blocks.deploy.DeploymentEventPublisher.invoke(De
ploymentEventPublisher.java:57)
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflect
iveMethodInvocation.java:148)
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopPro
xy.java:151)
$Proxy309.load(Unknown Source)
oracle.integration.platform.blocks.deploy.StandaloneCompositeDeploymentCoord
inatorImpl.coordinateCompositeDeployment(StandaloneCompositeDeploymentCoordinato
rImpl.java:54)
oracle.integration.platform.blocks.deploy.servlet.BaseDeployProcessor.deploy
NewComposite(BaseDeployProcessor.java:365)
oracle.integration.platform.blocks.deploy.servlet.BaseDeployProcessor.deploy
SARs(BaseDeployProcessor.java:123)
^-- Holding lock: java.lang.Object@3621c97c[thin lock]
oracle.integration.platform.blocks.deploy.servlet.DeployProcessor.doDeployWo
rk(DeployProcessor.java:122)
oracle.integration.platform.blocks.deploy.servlet.DeployProcessor.doDeployWo
rk(DeployProcessor.java:107)
oracle.integration.platform.blocks.deploy.servlet.DeployProcessor.doDeploy(D
eployProcessor.java:96)
oracle.integration.platform.blocks.deploy.servlet.DeployProcessor.process(De
ployProcessor.java:68)
oracle.integration.platform.blocks.deploy.servlet.CompositeDeployerServlet.d
oPostInsideLoggingSession(CompositeDeployerServlet.java:141)
oracle.integration.platform.blocks.deploy.servlet.CompositeDeployerServlet.d
oPost(CompositeDeployerServlet.java:119)
javax.servlet.http.HttpServlet.service(HttpServlet.java:700)
javax.servlet.http.HttpServlet.service(HttpServlet.java:815)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSe
curityHelper.java:224)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelpe
r.java:108)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:206)
weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:299)
oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java
:405)
oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:98)
oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:70)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:299)
oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java
:405)
oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:98)
oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:70)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:86)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapR
un(WebAppServletContext.java:3687)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(W
ebAppServletContext.java:3681)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubjec
t.java:308)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:116)
weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletC
ontext.java:2213)
weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.
java:2135)
weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:142
0)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:203)
weblogic.work.ExecuteThread.run(ExecuteThread.java:170)
>

I just noted that this is a database connectivity issue because when I point my soa related data sources (mds, soa_infra, etc...)to a local xe database, the deployment is doing fine.

Weblogic server + stuck threads

Hi All,
We have java application deployed on weblogic server 10.1.3.4 which is integrated with BPEL (SOA Oracle 11g). The application creates a task through BPEL. We have configured StuckThread Max Time to 600 secs. Now after certain time (5-7 days) the servers goes into warning state due to stuck threads and finally it gets crashed
We noticed the OOM error in jrockit dump, could any one help me here as how to avoid this? your help is very much appreciated, thanks

Regarding
Sample of your Weblogic logs showing the java.lang.OutOfMemoryError along with Stack Trace if available
Please find below
[ACTIVE] ExecuteThread: '20' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <532776f80ba738ab:-48a8d4c8:133068f0cee:-8000-00000000000001a5> <1322080967160> <BEA-080003> <RuntimeException thrown by rmi server: javax.management.remote.rmi.RMIConnectionImpl.invoke(Ljavax.management.ObjectName;Ljava.lang.String;Ljava.rmi.MarshalledObject;[Ljava.lang.String;Ljavax.security.auth.Subject;)
javax.management.RuntimeErrorException: java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 1335312.
javax.management.RuntimeErrorException: java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 1335312
        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.rethrow(DefaultMBeanServerInterceptor.java:858)
        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.rethrowMaybeMBeanException(DefaultMBeanServerInterceptor.java:869)
        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:838)
        at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:449)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:447)
        at weblogic.management.mbeanservers.internal.JMXContextInterceptor.invoke(JMXContextInterceptor.java:263)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:449)
        at weblogic.management.mbeanservers.internal.SecurityInterceptor.invoke(SecurityInterceptor.java:444)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServer.invoke(WLSMBeanServer.java:323)
        at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder$11.run(JMXConnectorSubjectForwarder.java:661)
        at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder.invoke(JMXConnectorSubjectForwarder.java:654)
        at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
        at javax.management.remote.rmi.RMIConnectionImpl_WLSkel.invoke(Unknown Source)
        at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:668)
        at weblogic.rmi.internal.wls.WLSExecuteRequest.run(WLSExecuteRequest.java:118)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:207)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:176)
Caused By: java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 1335312
        at java.util.Arrays.copyOf(Arrays.java:2786)
        at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
        at java.io.ObjectOutputStream$BlockDataOutputStream.drain(ObjectOutputStream.java:1847)
at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
        at java.io.ObjectOutputStream$BlockDataOutputStream.drain(ObjectOutputStream.java:1847)
        at java.io.ObjectOutputStream$BlockDataOutputStream.flush(ObjectOutputStream.java:1792)
        at java.io.ObjectOutputStream.flush(ObjectOutputStream.java:699)
        at java.io.ObjectOutputStream.close(ObjectOutputStream.java:720)
        at oracle.dms.jmx.app.ServerAggreMBeanImpl.getTableGroupInBytes(ServerAggreMBeanImpl.java:328)
        at oracle.dms.jmx.app.ServerAggreMBeanWrapper.invokeOperation(ServerAggreMBeanWrapper.java:71)
        at oracle.dms.jmx.app.AggreMBeanWrapper.invoke(AggreMBeanWrapper.java:167)
        at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836)
        at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:449)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:447)
        at weblogic.management.mbeanservers.internal.JMXContextInterceptor.invoke(JMXContextInterceptor.java:263)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:449)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:447)
        at weblogic.management.mbeanservers.internal.SecurityInterceptor.invoke(SecurityInterceptor.java:444)
        at weblogic.management.jmx.mbeanserver.WLSMBeanServer.invoke(WLSMBeanServer.java:323)
        at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder$11$1.run(JMXConnectorSubjectForwarder.java:663)
        at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder$11.run(JMXConnectorSubjectForwarder.java:661)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
        at weblogic.management.mbeanservers.internal.JMXConnectorSubjectForwarder.invoke(JMXConnectorSubjectForwarder.java:654)
        at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427)
        at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
        at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265)
        at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1367)
        at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788)
        at javax.management.remote.rmi.RMIConnectionImpl_WLSkel.invoke(Unknown Source)
        at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:667)
        at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:522)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:146)
        at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:518)
        at weblogic.rmi.internal.wls.WLSExecuteRequest.run(WLSExecuteRequest.java:118)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:207)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:176)

Weblogic 8.14: Stuck Threads during JMS - IO native write operations

G'day!
Hope somebody can advise a solution on the following...
Recently message loads have started to increase on our weblogic 8.14 cluster (3 servers) and we started to see an almost daily occurrence of Stuck Thread issues. From thread dumps we could see these were caused by jrockit/net/SocketNativeIO.write processes. We concluded we had reached the max performance limit for the file based JMS stores and so we moved these to database based JMS stores. This certainly seemed to improve matters - but we have recently seen the issue return. Which is puzzling, as technically we thought all messages would be persisted to the database, and any file IO on the application server would be eliminated. Our database resides on a separate dedicated oracle server. We tracked a recent cause to a large message (200K) which caused the Struck Thread - resulting in a build up of pending messages. After bouncing the server the message processed ok. Any thoughts on how to overcome these issues - greatly appreciated. Here's some detail on the stuck thread from the thread dump: (+Why does weblogic use IO when the JMS store is on a database?+). All messages are persistant.
"ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" prio=5 id=0xc00 pid=27544 active, daemon
at jrockit/net/SocketNativeIO.write(Native Method)@0xf3aeae10
at jrockit/net/SocketNativeIO.write(Unknown Source)@0xf3aeae9c
at jrockit/io/NativeIO.write(Unknown Source)@0xf3ae62c6
at java/net/AbstractSocketImpl$2.write(Unknown Source)@0xf3aeada4
at jrockit/io/NativeIOOutputStream.write(Unknown Source)@0xf3ae61ec
at jrockit/io/NativeIOOutputStream.write(Unknown Source)@0xf3ae618d
at java/io/DataOutputStream.write(Unknown Source)@0xf4e3ec25
^-- Holding lock: java/io/DataOutputStream@0x4309fc80[thin lock]
at com/ibm/mq/MQInternalCommunications.send(MQInternalCommunications.java:1022)@0xed34364a
^-- Holding lock: com/ibm/mq/MQInternalCommunications@0x4309f7e0[thin lock]
at com/ibm/mq/MQSESSIONClient.lowLevelComms(MQSESSIONClient.java:2832)@0xed342fbd
^-- Holding lock: java/lang/Integer@0x4309f8a0[thin lock]
at com/ibm/mq/MQSESSIONClient.MQPUT(MQSESSIONClient.java:3844)@0xed34271b
at com/ibm/mq/MQQueue.putMsg2(MQQueue.java:1486)@0xed342262
^-- Holding lock: com/ibm/mq/MQSPIQueue@0x4312ce80[thin lock]
at com/ibm/mq/jms/MQMessageProducer.sendInternal(MQMessageProducer.java:1569)@0xed33d1ab
at com/ibm/mq/jms/MQMessageProducer.send(MQMessageProducer.java:1012)@0xed860a49
at com/ibm/mq/jms/MQMessageProducer.send(MQMessageProducer.java:1046)@0xed8605f4
at weblogic/jms/adapter/JMSBaseConnection.sendInternal(JMSBaseConnection.java:667)@0xef7df0bf
^-- Holding lock: weblogic/jms/adapter/JMSBaseConnection@0x43093748[thin lock]
at weblogic/jms/adapter/JMSBaseConnection.access$200(JMSBaseConnection.java:80)@0xef7dee28
at weblogic/jms/adapter/JMSBaseConnection$6.run(JMSBaseConnection.java:647)@0xef7dee1d
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)@0xf2fcbb88
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:147)@0xf2fcbb0a
at weblogic/jms/adapter/JMSBaseConnection.send(JMSBaseConnection.java:644)@0xef7decf3
at weblogic/jms/adapter/JMSConnectionHandle.send(JMSConnectionHandle.java:144)@0xef7dec7c
at jrockit/reflect/NativeMethodInvoker.invoke0(Native Method)@0xf4f10d10
at jrockit/reflect/NativeMethodInvoker.invoke(Unknown Source)@0xf4f10e98
at jrockit/reflect/VirtualNativeMethodInvoker.invoke(Unknown Source)@0xf4e86d70
at java/lang/reflect/Method.invoke(Unknown Source)@0xf4f104c3
at weblogic/connector/common/internal/ConnectionWrapper.invoke(ConnectionWrapper.java:149)@0xed96a498
at $Proxy14.send(Unknown Source)@0xef7dec04
at weblogic/jms/bridge/internal/MessagingBridge.onMessageInternal(MessagingBridge.java:1258)@0xed857b25
at weblogic/jms/bridge/internal/MessagingBridge.onMessage(MessagingBridge.java:1181)@0xed857864
at weblogic/jms/adapter/JMSBaseConnection$27.run(JMSBaseConnection.java:1943)@0xef7de623
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)@0xf2fcbb88
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:147)@0xf2fcbb0a
at weblogic/jms/adapter/JMSBaseConnection.onMessage(JMSBaseConnection.java:1939)@0xef7de586
at weblogic/jms/client/JMSSession.onMessage(JMSSession.java:2678)@0xeee7e30c
at weblogic/jms/client/JMSSession.execute(JMSSession.java:2598)@0xeee7d25d
at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:219)@0xf4e14070
at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:178)@0xf4e1fddb
at java/lang/Thread.startThreadFromVM(Unknown Source)@0xf4f3c9f3
Thanks
C.

I'm not sure what operating system you're running, but I only have experience of WLS8.1 on Windows.
We did extensive load testing of JMS before we went live, and found JDBC file stores to be rubbish in comparison to file store. When a message is persisted, it has to be written to the database, then when it is consumed, it must be deleted from the table. This simply killed our system when we load tested it.
One thing we did do though, was use a second JMS server and second file store for one particularly heavy queue, where we did have IO issues. This was with a JMS distributed destination. We also use a synchronous write policy of cache-flush on the file store and we also have configured a paging store to page messages so the app server does not run out of memory.
200K isn't by any means a huge message though, and shouldn't be any problem at all, we have 1mb messages quite regularly.
I notice from the stack trace, that you have MQ series aswell. I'm not experienced with MQ, so can't give any information, but what I would try is the following.
Using a JMS server with JMS File storage, develop a small java client to write as many messages to the queue and effectively stress the JMS subsystem just to establish if the filestore is the problem. This should be done without a connection to MQ and also use large messages. if you don't get any issues and WebLogic JMS with file store looks ok, then attach a consumer to the queue, which should also be a simple java client. Then you have production and consumption going on, which will result in writes and read's/deletes from the jms file store.
Once you've stress tested JMS and you are satisfied that its ok or not, then add the MQseries connection and see how that affects things.
You may well have already done all this, so please feel free to ignore me! I did a load of this kind of stuff before we went live to try and bash JMS to bits, but I didn't manage it! The only thing we did was add a second file store and second JMS server.
I just looked back in my support cases, and found we'd had a similar issue - disk fragmentation seemed to be one of the factors here too. The JMS file store was heavily fragmented. That's windows for you though!!!
Hope that helps.
Pete

Stuck Thread

Hi All,
I am facing the below error . Can anyone help me in resolving this
Here are some more logs files related to stuck
Please let me know from which application is coming this error.
<Dec 17, 2011 4:12:55 AM CST> <Notice> <Stdout> <BEA-000000> <Inside flagshelf if condn.....>
<Dec 17, 2011 4:12:55 AM CST> <Notice> <Stdout> <BEA-000000> <<Dec 17, 2011 4:12:55 AM CST> <Error> <oracle.adf.controller.internal.binding.DCTaskFlowBinding> <BEA-000000> <oracle.adfinternal.view.faces.model.binding.FacesCtrlAttrsBinding>>
<Dec 17, 2011 4:12:55 AM CST> <Notice> <Stdout> <BEA-000000> <<Dec 17, 2011 4:12:55 AM CST> <Error> <oracle.adf.controller.internal.binding.DCTaskFlowBinding> <BEA-000000> <oracle.adfinternal.view.faces.model.binding.FacesCtrlAttrsBinding>>
<Dec 17, 2011 4:12:55 AM CST> <Notice> <Stdout> <BEA-000000> <Object Id :8d6c8f55-c841-4394-88a7-2b8a2118fe9c:DEVICE>
<Dec 17, 2011 4:12:55 AM CST> <Notice> <StdErr> <BEA-000000> <com.avocent.trellis.safetynet.TrellisException: Generic CDMR platform exception>
<Dec 17, 2011 4:12:55 AM CST> <Notice> <StdErr> <BEA-000000> <at com.avocent.trellis.apps.common.ejb.CapacityServiceEJBBean.getCapacityByTypeUOM(CapacityServiceEJBBean.java:490)>
<Dec 17, 2011 4:12:55 AM CST> <Notice> <StdErr> <BEA-000000> <at oracle.adf.model.binding.DCIteratorBinding.getCurrentRow(DCIteratorBinding.java:2201)>
<Dec 17, 2011 4:12:55 AM CST> <Notice> <StdErr> <BEA-000000> <at oracle.adf.model.binding.DCControlBinding.getCurrentRow(DCControlBinding.java:387)>
<Dec 17, 2011 4:13:03 AM CST> <Notice> <Stdout> <BEA-000000> <bye array image is :[B@1e802319>
<Dec 17, 2011 4:13:04 AM CST> <Warning> <Socket> <WL-000449> <Closing socket as no data read from it on 10.172.6.11:56,906 during the configured idle timeout of 5 secs>
<Dec 17, 2011 4:13:05 AM CST> <Notice> <Stdout> <BEA-000000> <Init method on shelf selected value from EJB -- null>
<Dec 17, 2011 4:13:05 AM CST> <Notice> <Stdout> <BEA-000000> <onShelfSelected false>
<Dec 17, 2011 4:13:05 AM CST> <Notice> <Stdout> <BEA-000000> <Inside flagshelf if condn.....>
<Dec 17, 2011 4:13:05 AM CST> <Notice> <Stdout> <BEA-000000> <Delete Device>
<Dec 17, 2011 4:13:05 AM CST> <Notice> <Stdout> <BEA-000000> <richPopup.getClientId(context)pt1:r3:0:pc1:p5>
<Dec 17, 2011 4:13:05 AM CST> <Notice> <Stdout> <BEA-000000> <deletion Completed in ManagedBean>
<Dec 17, 2011 4:13:06 AM CST> <Notice> <Stdout> <BEA-000000> <Node type:DEVICE>
<Dec 17, 2011 4:13:06 AM CST> <Notice> <Stdout> <BEA-000000> <Floor GridId:aab83e10-149f-4bc7-a578-075ac28cb255>
<Dec 17, 2011 4:13:06 AM CST> <Notice> <Stdout> <BEA-000000> <placement name is null>
<Dec 17, 2011 4:13:06 AM CST> <Notice> <Stdout> <BEA-000000> <Init method on shelf selected value from EJB -- null>
<Dec 17, 2011 4:13:06 AM CST> <Notice> <Stdout> <BEA-000000> <onShelfSelected false>
<Dec 17, 2011 4:13:06 AM CST> <Notice> <Stdout> <BEA-000000> <Inside flagshelf if condn.....>
<Dec 17, 2011 4:13:07 AM CST> <Notice> <Stdout> <BEA-000000> <Init method on shelf selected value from EJB -- null>
<Dec 17, 2011 4:13:07 AM CST> <Notice> <Stdout> <BEA-000000> <onShelfSelected false>
<Dec 17, 2011 4:13:07 AM CST> <Notice> <Stdout> <BEA-000000> <Inside flagshelf if condn.....>
<Dec 17, 2011 4:13:08 AM CST> <Error> <WebLogicServer> <WL-000337> <[STUCK] ExecuteThread: '12' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "709" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@1402a3c3[
POST /TrellisConsole-CpsConsole-context-root/faces/InventoryPortfolioTFT/InventoryPortfolio?_adf.ctrl-state=z1imd3ex8_12 HTTP/1.1
Connection: keep-alive
Content-Length: 12
Origin: http://10.207.120.120:7011
Adf-Page-Unregistered-Id: 2
Adf-Window-Unregistered: true
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.121 Safari/535.2
Content-Type: application/xml
Adf-Rich-Message: true
Adf-Window-Unregistered-Id: z1imd3ex8_1
Accept: */*
<Dec 17, 2011 4:12:08 AM CST> <Error> <WebLogicServer> <WL-000337> <[STUCK] ExecuteThread: '12' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "648" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@1402a3c3[
POST /TrellisConsole-CpsConsole-context-root/faces/InventoryPortfolioTFT/InventoryPortfolio?_adf.ctrl-state=z1imd3ex8_12 HTTP/1.1
Connection: keep-alive
Content-Length: 12
Origin: http://10.207.120.120:7011
Adf-Page-Unregistered-Id: 2
Adf-Window-Unregistered: true
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.121 Safari/535.2
Content-Type: application/xml
Adf-Rich-Message: true
Adf-Window-Unregistered-Id: z1imd3ex8_1
Accept: */*
Referer: http://10.207.120.120:7011/TrellisConsole-CpsConsole-context-root/faces/InventoryPortfolioTFT/InventoryPortfolio?_adf.ctrl-state=z1imd3ex8_12
Accept-Encoding: gzip,deflate,sdch
Accept-Language: en-US,en;q=0.8
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
Cookie: JSESSIONID=1Jr3TsypG1p8HXsQvZwM8vQwB8Td2Pv2D1sZg1zhr0vHfMbnvfLr!1713687512
]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-110 "[STUCK] ExecuteThread: '12' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, suspended, waiting, priority=1, DAEMON> {
-- Waiting for notification on: oracle.adfinternal.controller.util.RequestLock@1db2322d[fat lock]
java.lang.Object.wait(Object.java:???)
java.lang.Object.wait(Object.java:485)
oracle.adfinternal.controller.util.RequestLock.lock(RequestLock.java:36)
oracle.adfinternal.controller.state.RootViewPortContextImpl.lockViewPortRequestLock(RootViewPortContextImpl.java:589)
oracle.adfinternal.controller.state.ControllerState.initializeRequest(ControllerState.java:766)
oracle.adfinternal.controller.state.ControllerState.initializeRequest(ControllerState.java:754)
oracle.adfinternal.controller.application.AdfcConfigurator.beginRequest(AdfcConfigurator.java:38)
org.apache.myfaces.trinidadinternal.config.GlobalConfiguratorImpl._startConfiguratorServiceRequest(GlobalConfiguratorImpl.java:552)
org.apache.myfaces.trinidadinternal.config.GlobalConfiguratorImpl.beginRequest(GlobalConfiguratorImpl.java:185)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:133)
org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:91)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.adf.library.webapp.LibraryFilter.doFilter(LibraryFilter.java:163)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:299)
>
<Dec 17, 2011 4:12:08 AM CST> <Notice> <Diagnostics> <WL-320068> <Watch 'StuckThread' with severity 'Notice' on server 'adf_server1' has triggered at Dec 17, 2011 4:12:08 AM CST. Notification details:
WatchRuleType: Log
WatchRule: (SEVERITY = 'Error') AND ((MSGID = 'WL-000337') OR (MSGID = 'BEA-000337'))
WatchData: DATE = Dec 17, 2011 4:12:08 AM CST SERVER = adf_server1 MESSAGE = [STUCK] ExecuteThread: '12' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "648" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@1402a3c3[
POST /TrellisConsole-CpsConsole-context-root/faces/InventoryPortfolioTFT/InventoryPortfolio?_adf.ctrl-state=z1imd3ex8_12 HTTP/1.1
Connection: keep-alive
Content-Length: 12
Origin: http://10.207.120.120:7011
Adf-Page-Unregistered-Id: 2
Adf-Window-Unregistered: true
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.121 Safari/535.2
Content-Type: application/xml
Adf-Rich-Message: true
Adf-Window-Unregistered-Id: z1imd3ex8_1
Accept: */*
Referer: http://10.207.120.120:7011/TrellisConsole-CpsConsole-context-root/faces/InventoryPortfolioTFT/InventoryPortfolio?_adf.ctrl-state=z1imd3ex8_12
Accept-Encoding: gzip,deflate,sdch
Accept-Language: en-US,en;q=0.8
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3
Cookie: JSESSIONID=1Jr3TsypG1p8HXsQvZwM8vQwB8Td2Pv2D1sZg1zhr0vHfMbnvfLr!1713687512
]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-110 "[STUCK] ExecuteThread: '12' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, suspended, waiting, priority=1, DAEMON> {
-- Waiting for notification on: oracle.adfinternal.controller.util.RequestLock@1db2322d[fat lock]
java.lang.Object.wait(Object.java:???)

Thanks Rene...although I have some stuck thread issues occasionally this is the first one I have seen with this particular error. So I am going to treat it as a one off for now and if it pops up again then I will review these suggestions. Unfortunately I have not seen this error in my 2 test environments (they aren't hit nearly as hard as my prod environments which is normal I am sure).
My complaint on the WL stuck threads is that they never seem to clear the console unless you restart the managed server. I don't know if I should assume that whatever caused them is still an issue or if WL just does a poor job on updating the cleanup of the error. I have had no user complaints though....
Thanks for the assistance and direction!

Page stuck while load and leads to stuck thread

Hi
I am facing an issue from a long time.
When i run the page of my application, when it opens for first time it get stuck and get loading and take very much time and after that it leads to stuck thread issue. All the component of my page opens but there is a table which gets value from OIM APIs also loads for the fiirst time. As in coding i have done it will pass null value to the table and wont fetch data for the first time. it will only fetch when value will be passed in a text box and submit was hit.
So my page gets hanged or loading in the table section everytime when it loads. for that i have to login in weblogic server, run the workmanager, forcefully shut down the server instance and run the page again. But sometime that doesnt work too.
Please help its a bug trouble for me and creating a huge problem.
Thanks
Sudeep

I'm not sure I understand your issue - but if you want to delay the fetching of information into the table until you actually have a value to pass to it see:
http://blogs.oracle.com/shay/2010/08/delay_method_execution_when_us.html

Stuck Thread - JMS Business proxy Service (ALSB 2.5)

Hi All,
We are having a jms proxy service which uses a JMS Business Service to send messages to a jms queue on weblogic 8.1 sp6. The alsb domain runs on weblogic 9.2.The jms proxy service is made single threaded by configuring a suitable work manager.
Now and then, we get a stuck thread issue in production and the proxy service stops consuming the messaging off the jms queue in wls 9.2. These are the errors in the logs:
<[ACTIVE] ExecuteThread: '18' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1235437298516> <BEA-000337> <[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "695" seconds working on the request "weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl@5321caf", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-70 "[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, waiting, priority=1, DAEMON> {
-- Waiting for notification on: weblogic.rjvm.ResponseImpl@51961a5[fat lock]
jrockit.vm.Threads.waitForSignal(Native Method)
java.lang.Object.wait(Native Method)
java.lang.Object.wait(Native Method)
weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:73)
^-- Lock released while waiting: weblogic.rjvm.ResponseImpl@51961a5[fat lock]
weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:100)
weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.java:109)
weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:223)
weblogic.jms.dispatcher.DispatcherImpl_816_WLStub.dispatchSyncTranFuture(Unknown Source)
weblogic.jms.dispatcher.DispatcherInteropAdapter.dispatchSyncTranFuture(DispatcherInteropAdapter.java:80)
weblogic.messaging.dispatcher.DispatcherWrapperState.dispatchSyncTran(DispatcherWrapperState.java:230)
weblogic.jms.dispatcher.DispatcherAdapter.dispatchSyncTran(DispatcherAdapter.java:51)
weblogic.jms.client.JMSProducer.toFEProducer(JMSProducer.java:1047)
weblogic.jms.client.JMSProducer.deliveryInternal(JMSProducer.java:670)
weblogic.jms.client.JMSProducer.sendInternal(JMSProducer.java:455)
weblogic.jms.client.JMSProducer.send(JMSProducer.java:352)
weblogic.jms.client.WLProducerImpl.send(WLProducerImpl.java:1009)
weblogic.deployment.jms.WrappedMessageProducer.send(WrappedMessageProducer.java:157)
com.bea.wli.sb.transports.jms.JmsOutboundMessageContext$SendAction.run(JmsOutboundMessageContext.java:795)
com.bea.wli.sb.transports.jms.JmsOutboundMessageContext.send(JmsOutboundMessageContext.java:500)
com.bea.wli.sb.transports.jms.JmsTransportProvider.sendMessageAsync(JmsTransportProvider.java:612)
jrockit.reflect.CompiledMethodInvoker.invoke0(Unknown Source)
jrockit.reflect.CompiledMethodInvoker.invoke(Unknown Source)
java.lang.reflect.Method.invoke(Unknown Source)
com.bea.wli.sb.transports.Util$1.invoke(Util.java:241)
$Proxy39.sendMessageAsync(Unknown Source)
com.bea.wli.sb.transports.LoadBalanceFailoverListener.sendMessageAsync(LoadBalanceFailoverListener.java:137)
com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:437)
com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:328)
com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:503)
com.bea.wli.sb.pipeline.PipelineContextImpl.dispatch(PipelineContextImpl.java:415)
stages.publish.runtime.PublishRuntimeStep.processMessage(PublishRuntimeStep.java:106)
com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:327)
com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
com.bea.wli.sb.pipeline.PipelineStage.processMessage(PipelineStage.java:100)
com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:771)
com.bea.wli.sb.pipeline.Pipeline.processMessage(Pipeline.java:73)
com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:771)
com.bea.wli.sb.pipeline.PipelineNode.doRequest(PipelineNode.java:47)
com.bea.wli.sb.pipeline.Node.processMessage(Node.java:57)
com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:771)
com.bea.wli.sb.pipeline.Router.processMessage(Router.java:141)
com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:75)
com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:646)
com.bea.wli.sb.pipeline.RouterManager$1.run(RouterManager.java:645)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
com.bea.wli.sb.pipeline.RouterManager.processMessage(RouterManager.java:627)
com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:264)
com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:108)
weblogic.ejb.container.internal.MDListener.execute(MDListener.java:429)
weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:335)
weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:292)
weblogic.jms.client.JMSSession.onMessage(JMSSession.java:4060)
weblogic.jms.client.JMSSession.execute(JMSSession.java:4012)
weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:4467)
weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl.run(ServerWorkManagerImpl.java:518)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
jrockit.vm.RNI.c2java(Native Method)
Any one know the root cause of this issue or ways to prevent this?
Also Is there a way to make the proxy service to reconsume messages off the queue without a server restart?
Thanks,
Atheek

Hi atheek, did you find the solution??
I already got the same/identic issue, do you mind giving me an aid?
Really thanks
Regards,
Mr.K

WLS 10.3.4 STUCK THREAD in SPEC App

Hi Experts,
After our app started for a while, we got warnings in wls admin console, saying that there are stuck threads. And during the 2-hour spec run, this thread is the only stuck thread.
Attached is part of server log and thread dump related to this stuck thread. Any help would be really appreciated.
Thanks,
Candy
Server Log:
####<Jul 3, 2011 1:39:44 AM PDT> <Error> <WebLogicServer> <adcgdh03> <mt-1> <[ACTIVE] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'>
<<WLS Kernel>> <> <> <1309682384533> <BEA-000337> <[STUCK] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "600"
seconds working on the request "weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl@1459e0e5", which is more than the configured time
(StuckThreadMaxTime) of "600" seconds. Stack trace:
java.lang.Thread.sleep(Native Method)
weblogic.ejb.container.manager.TTLManager$EagerRefreshListener.run(TTLManager.java:738)
weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:207)
weblogic.work.ExecuteThread.run(ExecuteThread.java:176)
>
Thread Dump
"[STUCK] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" TIMED_WAITING
     java.lang.Thread.sleep(Native Method)
     weblogic.ejb.container.manager.TTLManager$EagerRefreshListener.run(TTLManager.java:738)
     weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
     weblogic.work.ExecuteThread.execute(ExecuteThread.java:207)
     weblogic.work.ExecuteThread.run(ExecuteThread.java:176)
"weblogic.timers.TimerThread" waiting for lock weblogic.timers.internal.TimerThread@b91db8 TIMED_WAITING
     java.lang.Object.wait(Native Method)
     weblogic.timers.internal.TimerThread$Thread.run(TimerThread.java:262)
"weblogic.time.TimeEventGenerator" waiting for lock weblogic.time.common.internal.TimeTable@794e1b66 TIMED_WAITING
     java.lang.Object.wait(Native Method)
     weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:286)
     weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:117)
     java.lang.Thread.run(Thread.java:636)
"[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" waiting for lock weblogic.work.ExecuteThread@76e903c1 WAITING
     java.lang.Object.wait(Native Method)
     java.lang.Object.wait(Object.java:502)
     weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:160)
     weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
"Timer-1" waiting for lock java.util.TaskQueue@3bf5b0e4 TIMED_WAITING
     java.lang.Object.wait(Native Method)
     java.util.TimerThread.mainLoop(Timer.java:531)
     java.util.TimerThread.run(Timer.java:484)
"Timer-0" waiting for lock java.util.TaskQueue@7f30677c WAITING
     java.lang.Object.wait(Native Method)
     java.lang.Object.wait(Object.java:502)
     java.util.TimerThread.mainLoop(Timer.java:505)
     java.util.TimerThread.run(Timer.java:484)
"Signal Dispatcher" RUNNABLE
null
"Finalizer" waiting for lock java.lang.ref.ReferenceQueue$Lock@42da3f20 WAITING
     java.lang.Object.wait(Native Method)
     java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:133)
     java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:149)
     java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:177)
"Reference Handler" waiting for lock java.lang.ref.Reference$Lock@666702a WAITING
     java.lang.Object.wait(Native Method)
     java.lang.Object.wait(Object.java:502)
     java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
"main" waiting for lock weblogic.t3.srvr.T3Srvr@2f4dd8ae WAITING
     java.lang.Object.wait(Native Method)
     java.lang.Object.wait(Object.java:502)
     weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:979)
     weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:488)
     weblogic.Server.main(Server.java:71)
Edited by: Candy.Liu on Jul 4, 2011 8:08 PM

Was their any changes in any of configuration files or something else. If not, then try bouncing the system once again and see if its working.

Getting Stuck threads ,application is going down

Hi All ,
Need your expertise on the below issue . from the past 2 days we are getting stuck thread issues . can you please provide insight into the below issue please ?
===== FULL THREAD DUMP ===============
Wed Jan 8 09:28:23 2014
Oracle JRockit(R) R28.2.3-13-149708-1.6.0_31-20120327-1523-linux-x86_64
"Main Thread" id=1 idx=0x4 tid=24390 prio=5 alive, waiting, native_blocked
-- Waiting for notification on: weblogic/t3/srvr/T3Srvr@0xf18da770[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/t3/srvr/T3Srvr.waitForDeath(T3Srvr.java:981)
^-- Lock released while waiting: weblogic/t3/srvr/T3Srvr@0xf18da770[fat lock]
at weblogic/t3/srvr/T3Srvr.run(T3Srvr.java:490)
at weblogic/Server.main(Server.java:71)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"(Signal Handler)" id=2 idx=0x8 tid=24391 prio=5 alive, native_blocked, daemon
"(OC Main Thread)" id=3 idx=0xc tid=24392 prio=5 alive, native_waiting, daemon
"(GC Worker Thread 1)" id=? idx=0x10 tid=24393 prio=5 alive, daemon
"(GC Worker Thread 2)" id=? idx=0x14 tid=24394 prio=5 alive, daemon
"(GC Worker Thread 3)" id=? idx=0x18 tid=24395 prio=5 alive, daemon
"(GC Worker Thread 4)" id=? idx=0x1c tid=24396 prio=5 alive, daemon
"(GC Worker Thread 5)" id=? idx=0x20 tid=24397 prio=5 alive, daemon
"(GC Worker Thread 6)" id=? idx=0x24 tid=24398 prio=5 alive, daemon
"(GC Worker Thread 7)" id=? idx=0x28 tid=24399 prio=5 alive, daemon
"(GC Worker Thread 8)" id=? idx=0x2c tid=24400 prio=5 alive, daemon
"(GC Worker Thread 9)" id=? idx=0x30 tid=24401 prio=5 alive, daemon
"(GC Worker Thread 10)" id=? idx=0x34 tid=24402 prio=5 alive, daemon
"(GC Worker Thread 11)" id=? idx=0x38 tid=24403 prio=5 alive, daemon
"(GC Worker Thread 12)" id=? idx=0x3c tid=24404 prio=5 alive, daemon
"(GC Worker Thread 13)" id=? idx=0x40 tid=24405 prio=5 alive, daemon
"(GC Worker Thread 14)" id=? idx=0x44 tid=24406 prio=5 alive, daemon
"(GC Worker Thread 15)" id=? idx=0x48 tid=24407 prio=5 alive, daemon
"(GC Worker Thread 16)" id=? idx=0x4c tid=24408 prio=5 alive, daemon
"(GC Worker Thread 17)" id=? idx=0x50 tid=24409 prio=5 alive, daemon
"(GC Worker Thread 18)" id=? idx=0x54 tid=24410 prio=5 alive, daemon
"(Code Generation Thread 1)" id=4 idx=0x58 tid=24411 prio=5 alive, native_waiting, daemon
"(Code Optimization Thread 1)" id=5 idx=0x5c tid=24412 prio=5 alive, native_waiting, daemon
"(VM Periodic Task)" id=6 idx=0x60 tid=24413 prio=10 alive, native_blocked, daemon
"Finalizer" id=7 idx=0x64 tid=24414 prio=8 alive, native_waiting, daemon
at jrockit/memory/Finalizer.waitForFinalizees(J[Ljava/lang/Object;)I(Native Method)
at jrockit/memory/Finalizer.access$700(Finalizer.java:12)
at jrockit/memory/Finalizer$4.run(Finalizer.java:189)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Reference Handler" id=8 idx=0x68 tid=24415 prio=10 alive, native_waiting, daemon
at java/lang/ref/Reference.waitForActivatedQueue(J)Ljava/lang/ref/Reference;(Native Method)
at java/lang/ref/Reference.access$100(Reference.java:11)
at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:82)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"(Sensor Event Thread)" id=9 idx=0x6c tid=24416 prio=5 alive, native_blocked, daemon
"VM JFR Buffer Thread" id=10 idx=0x70 tid=24417 prio=5 alive, in native, daemon
"Timer-0" id=13 idx=0x74 tid=24418 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xf190d120[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^-- Lock released while waiting: java/util/TaskQueue@0xf190d120[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Timer-1" id=14 idx=0x78 tid=24419 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xf190d188[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^-- Lock released while waiting: java/util/TaskQueue@0xf190d188[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[STUCK] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" id=15 idx=0x7c tid=24420 prio=1 alive, blocked, native_blocked, daemon
-- Blocked trying to get lock: oracle/jdbc/driver/T4CConnection@0xe4b45e08[thin lock]
at jrockit/vm/Threads.sleep(I)V(Native Method)
at jrockit/vm/Locks.waitForThinRelease(Locks.java:955)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1083)
at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)
at jrockit/vm/Locks.monitorEnter(Locks.java:2179)
at oracle/jdbc/driver/PhysicalConnection.rollback(PhysicalConnection.java:3896)
at weblogic/jdbc/wrapper/Connection.forcedCleanup(Connection.java:153)
at weblogic/common/resourcepool/ResourcePoolImpl.timeoutInactiveResources(ResourcePoolImpl.java:1953)
at weblogic/common/resourcepool/ResourcePoolImpl.access$1500(ResourcePoolImpl.java:41)
at weblogic/common/resourcepool/ResourcePoolImpl$ResourcePoolMaintanenceTask.timerExpired(ResourcePoolImpl.java:2675)
at weblogic/timers/internal/TimerImpl.run(TimerImpl.java:273)
at weblogic/work/SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:209)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:178)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"JFR request timer" id=16 idx=0x80 tid=24421 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xf190d208[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^-- Lock released while waiting: java/util/TaskQueue@0xf190d208[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"weblogic.time.TimeEventGenerator" id=18 idx=0x84 tid=24422 prio=9 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/time/common/internal/TimeTable@0xf190e690[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/time/common/internal/TimeTable.snooze(TimeTable.java:286)
^-- Lock released while waiting: weblogic/time/common/internal/TimeTable@0xf190e690[fat lock]
at weblogic/time/common/internal/TimeEventGenerator.run(TimeEventGenerator.java:117)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"JMAPI event thread" id=19 idx=0x88 tid=24423 prio=5 alive, in native, daemon
"weblogic.timers.TimerThread" id=20 idx=0x8c tid=24424 prio=9 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/timers/internal/TimerThread@0xf190d310[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/timers/internal/TimerThread$Thread.run(TimerThread.java:262)
^-- Lock released while waiting: weblogic/timers/internal/TimerThread@0xf190d310[fat lock]
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" id=21 idx=0x90 tid=24425 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xf190dfe8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xf190dfe8[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=24 idx=0x94 tid=24426 prio=5 alive, blocked, native_blocked, daemon
-- Blocked trying to get lock: java/lang/String@0xf18a6480[fat lock]
at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)[optimized]
at jrockit/vm/Locks.lockFat(Locks.java:1512)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=25 idx=0x98 tid=24427 prio=5 alive, in native, daemon
at jrockit/ext/epoll/EPoll.epollWait0(ILjava/nio/ByteBuffer;II)I(Native Method)
at jrockit/ext/epoll/EPoll.epollWait(EPoll.java:115)
at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:156)
^-- Holding lock: java/lang/String@0xf18a6480[fat lock]
at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=26 idx=0x9c tid=24428 prio=5 alive, blocked, native_blocked, daemon
-- Blocked trying to get lock: java/lang/String@0xf18a6480[fat lock]
at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)[optimized]
at jrockit/vm/Locks.lockFat(Locks.java:1512)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" id=27 idx=0xa0 tid=24429 prio=5 alive, blocked, native_blocked, daemon
-- Blocked trying to get lock: java/lang/String@0xf18a6480[fat lock]
at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)[optimized]
at jrockit/vm/Locks.lockFat(Locks.java:1512)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)[optimized]
at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"VDE Transaction Processor Thread" id=30 idx=0xa4 tid=24430 prio=2 alive, waiting, native_blocked, daemon
-- Waiting for notification on: com/octetstring/vde/backend/standard/TransactionProcessor@0xf190e0d0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at com/octetstring/vde/backend/standard/TransactionProcessor.waitChange(TransactionProcessor.java:367)
^-- Lock released while waiting: com/octetstring/vde/backend/standard/TransactionProcessor@0xf190e0d0[fat lock]
at com/octetstring/vde/backend/standard/TransactionProcessor.run(TransactionProcessor.java:212)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_78" id=248 idx=0xa8 tid=28978 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"DoSManager" id=33 idx=0xac tid=24432 prio=6 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/octetstring/vde/DoSManager.run(DoSManager.java:433)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Thread-12" id=34 idx=0xb0 tid=24433 prio=5 alive, parked, native_blocked
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xf48abb88
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at weblogic/utils/concurrent/JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic/store/internal/PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:672)
at weblogic/store/internal/PersistentStoreImpl.run(PersistentStoreImpl.java:721)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Timer-2" id=35 idx=0xb4 tid=24434 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xf5cf4fc0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^-- Lock released while waiting: java/util/TaskQueue@0xf5cf4fc0[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Timer-3" id=37 idx=0xb8 tid=24435 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xf5c14d00[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^-- Lock released while waiting: java/util/TaskQueue@0xf5c14d00[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"DBQueueList" id=36 idx=0xbc tid=24436 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/lang/Object@0xf5c24d00[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/demantra/applicationServer/metaDataObjects/dbQueue/DBQueueList.run(DBQueueList.java:256)
^-- Lock released while waiting: java/lang/Object@0xf5c24d00[fat lock]
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"DemantraWorkflowLogCleaner" id=38 idx=0xc0 tid=24437 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: com/demantra/workflow/util/WorkflowServer$LogCleaner@0xe4abf950[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at com/demantra/workflow/util/WorkflowServer$LogCleaner.run(WorkflowServer.java:1379)
^-- Lock released while waiting: com/demantra/workflow/util/WorkflowServer$LogCleaner@0xe4abf950[fat lock]
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"WFProcess_0" id=39 idx=0xc4 tid=24438 prio=5 alive, in native, daemon
at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)
at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:32)
at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)
at java/net/SocketInputStream.read(SocketInputStream.java:129)
at oracle/net/ns/Packet.receive(Packet.java:293)
at oracle/net/ns/DataPacket.receive(DataPacket.java:104)
at oracle/net/ns/NetInputStream.getNextPacket(NetInputStream.java:315)[optimized]
at oracle/net/ns/NetInputStream.read(NetInputStream.java:260)
at oracle/net/ns/NetInputStream.read(NetInputStream.java:185)
at oracle/net/ns/NetInputStream.read(NetInputStream.java:102)
at oracle/jdbc/driver/T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:124)
at oracle/jdbc/driver/T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:80)
at oracle/jdbc/driver/T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1136)
at oracle/jdbc/driver/T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1113)
at oracle/jdbc/driver/T4CTTIfun.receive(T4CTTIfun.java:288)
at oracle/jdbc/driver/T4CTTIfun.doRPC(T4CTTIfun.java:191)
at oracle/jdbc/driver/T4C8Oall.doOALL(T4C8Oall.java:523)
at oracle/jdbc/driver/T4CStatement.doOall8(T4CStatement.java:193)
at oracle/jdbc/driver/T4CStatement.executeForRows(T4CStatement.java:998)
at oracle/jdbc/driver/OracleStatement.doExecuteWithTimeout(OracleStatement.java:1315)
at oracle/jdbc/driver/OracleStatement.executeInternal(OracleStatement.java:1890)
at oracle/jdbc/driver/OracleStatement.execute(OracleStatement.java:1855)
^-- Holding lock: oracle/jdbc/driver/T4CConnection@0xe4b45e08[thin lock]
at oracle/jdbc/driver/OracleStatementWrapper.execute(OracleStatementWrapper.java:304)
at weblogic/jdbc/wrapper/Statement.execute(Statement.java:466)
at org/apache/commons/dbcp/DelegatingStatement.execute(DelegatingStatement.java:264)
at com/demantra/applicationServer/services/DBServicesCommon.executeSelect(DBServicesCommon.java:1464)
at com/demantra/applicationServer/services/DBServices.executeSelect(DBServices.java:663)
at com/demantra/applicationServer/services/DBServicesCommon.createMaterializedViewAs(DBServicesCommon.java:1143)
at com/demantra/applicationServer/services/DBServices.createMaterializedViewAs(DBServices.java:429)
at com/demantra/applicationServer/services/queryrun/ExportDataHandler.exportData(ExportDataHandler.java:53)
at com/demantra/applicationServer/services/queryrun/ExportRunner.exportData(ExportRunner.java:62)
at com/demantra/applicationServer/metaDataObjects/transfer/profiles/QueryProfile.exportProfile(QueryProfile.java:1002)
^-- Holding lock: com/demantra/applicationServer/metaDataObjects/transfer/profiles/QueryProfile@0xe4aa5cd8[biased lock]
at com/demantra/applicationServer/metaDataObjects/transfer/profiles/IntegrationProfile.exportData(IntegrationProfile.java:331)
at com/demantra/applicationServer/metaDataObjects/transfer/Transfer.exportData(Transfer.java:370)
at com/demantra/workflow/step/TransferStep.doExecute(TransferStep.java:266)
at com/demantra/workflow/step/LinkedStep.execute(LinkedStep.java:914)
at com/demantra/workflow/process/WFProcess.mainLoop(WFProcess.java:1259)
at com/demantra/workflow/process/WFProcess.run(WFProcess.java:654)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"WFProcess_1" id=40 idx=0xc8 tid=24439 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/demantra/workflow/process/WFProcess.checkStepEndConditions(WFProcess.java:1405)
at com/demantra/workflow/process/WFProcess.mainLoop(WFProcess.java:1284)
at com/demantra/workflow/process/WFProcess.run(WFProcess.java:654)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"WFProcess_2" id=41 idx=0xcc tid=24440 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/demantra/workflow/process/WFProcess.checkStepEndConditions(WFProcess.java:1405)
at com/demantra/workflow/process/WFProcess.mainLoop(WFProcess.java:1284)
at com/demantra/workflow/process/WFProcess.run(WFProcess.java:654)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"WFProcess_3" id=42 idx=0xd0 tid=24441 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/demantra/workflow/process/WFProcess.checkStepEndConditions(WFProcess.java:1405)
at com/demantra/workflow/process/WFProcess.mainLoop(WFProcess.java:1284)
at com/demantra/workflow/process/WFProcess.run(WFProcess.java:654)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"WFProcess_4" id=43 idx=0xd4 tid=24442 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/demantra/workflow/process/WFProcess.checkStepEndConditions(WFProcess.java:1405)
at com/demantra/workflow/process/WFProcess.mainLoop(WFProcess.java:1284)
at com/demantra/workflow/process/WFProcess.run(WFProcess.java:654)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"WFProcess_5" id=44 idx=0xd8 tid=24443 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/demantra/workflow/process/WFProcess.checkStepEndConditions(WFProcess.java:1405)
at com/demantra/workflow/process/WFProcess.mainLoop(WFProcess.java:1284)
at com/demantra/workflow/process/WFProcess.run(WFProcess.java:654)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"WFProcess_6" id=45 idx=0xdc tid=24444 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/demantra/workflow/process/WFProcess.checkStepEndConditions(WFProcess.java:1405)
at com/demantra/workflow/process/WFProcess.mainLoop(WFProcess.java:1284)
at com/demantra/workflow/process/WFProcess.run(WFProcess.java:654)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"WFProcess_7" id=46 idx=0xe0 tid=24445 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/demantra/workflow/process/WFProcess.checkStepEndConditions(WFProcess.java:1405)
at com/demantra/workflow/process/WFProcess.mainLoop(WFProcess.java:1284)
at com/demantra/workflow/process/WFProcess.run(WFProcess.java:654)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_86" id=256 idx=0xe4 tid=28986 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_80" id=250 idx=0xe8 tid=28980 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_85" id=255 idx=0xec tid=28985 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_84" id=254 idx=0xf0 tid=28984 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_87" id=257 idx=0xf4 tid=28987 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_81" id=251 idx=0xf8 tid=28981 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_83" id=253 idx=0xfc tid=28983 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"WFProcess_8" id=54 idx=0x100 tid=24453 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/demantra/workflow/process/WFProcess.checkStepEndConditions(WFProcess.java:1405)
at com/demantra/workflow/process/WFProcess.mainLoop(WFProcess.java:1284)
at com/demantra/workflow/process/WFProcess.run(WFProcess.java:654)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_82" id=252 idx=0x104 tid=28982 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_79" id=249 idx=0x108 tid=28979 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_92" id=262 idx=0x10c tid=28992 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Thread-17" id=58 idx=0x110 tid=24457 prio=5 alive, parked, native_blocked
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe4a33f00
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at weblogic/utils/concurrent/JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic/store/internal/PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:672)
at weblogic/store/internal/PersistentStoreImpl.run(PersistentStoreImpl.java:721)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"DynamicListenThread[Default]" id=60 idx=0x114 tid=24458 prio=9 alive, in native, daemon
at java/net/PlainSocketImpl.socketAccept(Ljava/net/SocketImpl;)V(Native Method)
at java/net/PlainSocketImpl.accept(PlainSocketImpl.java:408)
^-- Holding lock: java/net/SocksSocketImpl@0xe4aec048[biased lock]
at java/net/ServerSocket.implAccept(ServerSocket.java:462)
at java/net/ServerSocket.accept(ServerSocket.java:430)
at weblogic/socket/WeblogicServerSocket.accept(WeblogicServerSocket.java:38)
at weblogic/server/channels/DynamicListenThread$SocketAccepter.accept(DynamicListenThread.java:535)
at weblogic/server/channels/DynamicListenThread$SocketAccepter.access$200(DynamicListenThread.java:417)
at weblogic/server/channels/DynamicListenThread.run(DynamicListenThread.java:173)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[STANDBY] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'" id=61 idx=0x118 tid=24459 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe4a52f68[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe4a52f68[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'" id=62 idx=0x11c tid=24460 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe4afa538[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe4afa538[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'" id=63 idx=0x120 tid=24461 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe4a626a8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe4a626a8[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_90" id=260 idx=0x124 tid=28990 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_88" id=258 idx=0x128 tid=28988 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_89" id=259 idx=0x12c tid=28989 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_91" id=261 idx=0x130 tid=28991 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_260" id=585 idx=0x134 tid=29439 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Timer-6" id=69 idx=0x138 tid=26756 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xe17170f0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^-- Lock released while waiting: java/util/TaskQueue@0xe17170f0[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Event_Manager_67" id=923 idx=0x13c tid=29870 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xf4b91b40
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Task_Loader_Thread" id=71 idx=0x140 tid=27086 prio=5 alive, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at com/demantra/common/task/TaskLoader.run(TaskLoader.java:133)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Query_Execution_268" id=608 idx=0x144 tid=29473 prio=5 alive, parked, native_blocked, daemon
-- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xe2f645d8
at jrockit/vm/Locks.park0(J)V(Native Method)
at jrockit/vm/Locks.park(Locks.java:2230)
at sun/misc/Unsafe.park(ZJ)V(Native Method)
at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
at java/util/concurrent/ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'" id=73 idx=0x148 tid=28139 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe2ffb420[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe2ffb420[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)'" id=74 idx=0x14c tid=28140 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe2feb970[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe2feb970[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'" id=75 idx=0x150 tid=28141 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe300ab10[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe300ab10[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" id=76 idx=0x154 tid=28142 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe2f55dc0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe2f55dc0[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '9' for queue: 'weblogic.kernel.Default (self-tuning)'" id=77 idx=0x158 tid=28143 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe2f63970[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe2f63970[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '10' for queue: 'weblogic.kernel.Default (self-tuning)'" id=78 idx=0x15c tid=28144 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe2f73640[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe2f73640[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '11' for queue: 'weblogic.kernel.Default (self-tuning)'" id=79 idx=0x160 tid=28145 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe2fec498[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe2fec498[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '12' for queue: 'weblogic.kernel.Default (self-tuning)'" id=80 idx=0x164 tid=28146 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe2f82d20[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe2f82d20[fat lock]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:183)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '13' for queue: 'weblogic.kernel.Default (self-tuning)'" id=81 idx=0x168 tid=28147 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/work/ExecuteThread@0xe2fa0458[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:162)
^-- Lock released while waiting: weblogic/work/ExecuteThread@0xe2fa0458[fat lock]

Check -Xmx and -Xms start parameters for java in opmn.xml for the container you are workingk, as well in the Console you can change this in the Properties for the container.
Greetings

STUCK THREADS DURING OIM DURING TRUSTED RECON USING FLAT FILE

Hello All,
I need some help with resolving this issue where stuck threads/hogging threads are spawn after I run the Trusted Recon which reads a flat file and creates/updates users in OIM.
We have OIM 11.1.1.3 BP6
Weblogic 10.3.3.0
After the recon starts running for few hours I see ->.phd,.trc files created within the weblogic server path and server goes out of memory. eventually server goes down.
My issue is similar to: https://forums.oracle.com/forums/message.jspa?messageID=10187076#10187076
I have followed almost all of the performance tuning settings.
Pls. let me know if you have any ideas.
I have pasted below the heap dump.
Thanks.
~VSN
3XMTHREADINFO "[STUCK] ExecuteThread: '56' for queue: 'weblogic.kernel.Default (self-tuning)'" J9VMThread:0x000000013B49FC00, j9thread_t:0x00000001369D1760, java/lang/Thread:0x0700000062E79CB0, state:CW, prio=1
3XMTHREADINFO1 (native thread ID:0x3F000B1, native priority:0x1, native policy:UNKNOWN)
3XMTHREADINFO3 Java callstack:
4XESTACKTRACE at java/lang/Object.wait(Native Method)
4XESTACKTRACE at java/lang/Object.wait(Object.java:167(Compiled Code))
4XESTACKTRACE at java/io/ObjectStreamClass$EntryFuture.get(ObjectStreamClass.java:428(Compiled Code))
4XESTACKTRACE at java/io/ObjectStreamClass.lookup(ObjectStreamClass.java:314(Compiled Code))
4XESTACKTRACE at java/io/ObjectOutputStream.writeObject0(ObjectOutputStream.java:1115(Compiled Code))
4XESTACKTRACE at java/io/ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1518(Compiled Code))
4XESTACKTRACE at java/io/ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1483(Compiled Code))
4XESTACKTRACE at java/io/ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1401(Compiled Code))
4XESTACKTRACE at java/io/ObjectOutputStream.writeObject0(ObjectOutputStream.java:1159(Compiled Code))
4XESTACKTRACE at java/io/ObjectOutputStream.writeObject(ObjectOutputStream.java:332(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/mappings/converters/SerializedObjectConverter.convertObjectValueToDataValue(SerializedObjectConverter.java:85(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/mappings/foundation/AbstractDirectMapping.getFieldValue(AbstractDirectMapping.java:808(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/mappings/foundation/AbstractDirectMapping.buildCloneValue(AbstractDirectMapping.java:264(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/mappings/foundation/AbstractDirectMapping.buildCloneValue(AbstractDirectMapping.java:239(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/mappings/foundation/AbstractDirectMapping.buildClone(AbstractDirectMapping.java(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/descriptors/ObjectBuilder.populateAttributesForClone(ObjectBuilder.java:2698(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/UnitOfWorkImpl.populateAndRegisterObject(UnitOfWorkImpl.java:3682(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/UnitOfWorkImpl.cloneAndRegisterObject(UnitOfWorkImpl.java:996(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/UnitOfWorkImpl.cloneAndRegisterObject(UnitOfWorkImpl.java:905(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/UnitOfWorkIdentityMapAccessor.getAndCloneCacheKeyFromParent(UnitOfWorkIdentityMapAccessor.java:123(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/UnitOfWorkIdentityMapAccessor.getFromIdentityMap(UnitOfWorkIdentityMapAccessor.java:110(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/IdentityMapAccessor.getFromIdentityMap(IdentityMapAccessor.java(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/UnitOfWorkImpl.checkExistence(UnitOfWorkImpl.java:774(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/UnitOfWorkImpl.internalRegisterObject(UnitOfWorkImpl.java:2935(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/UnitOfWorkImpl.registerObject(UnitOfWorkImpl.java:4363(Compiled Code))
4XESTACKTRACE at org/eclipse/persistence/internal/sessions/UnitOfWorkImpl.registerObject(UnitOfWorkImpl.java:4321(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/dao/OrchestrationDao.setProcessSeq(OrchestrationDao.java:682(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.runActionEvents(OrchProcessData.java:1050(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.runEvents(OrchProcessData.java:644(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.executeEvents(OrchProcessData.java:227(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:668(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeChildProcess(OrchestrationEngineImpl.java:738(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:689(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.notifyParentProcess(OrchestrationEngineImpl.java:828(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.runEvents(OrchProcessData.java:771(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.executeEvents(OrchProcessData.java:227(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:668(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeChildProcess(OrchestrationEngineImpl.java:738(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:689(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.notifyParentProcess(OrchestrationEngineImpl.java:828(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.runEvents(OrchProcessData.java:771(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.executeEvents(OrchProcessData.java:227(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:668(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeChildProcess(OrchestrationEngineImpl.java:738(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:689(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.notifyParentProcess(OrchestrationEngineImpl.java:828(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.runEvents(OrchProcessData.java:771(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.executeEvents(OrchProcessData.java:227(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:668(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeChildProcess(OrchestrationEngineImpl.java:738(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:689(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.notifyParentProcess(OrchestrationEngineImpl.java:828(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.runEvents(OrchProcessData.java:771(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.executeEvents(OrchProcessData.java:227(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:668(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeChildProcess(OrchestrationEngineImpl.java:738(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:689(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.notifyParentProcess(OrchestrationEngineImpl.java:828(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.runEvents(OrchProcessData.java:771(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.executeEvents(OrchProcessData.java:227(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:668(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeChildProcess(OrchestrationEngineImpl.java:738(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:689(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.notifyParentProcess(OrchestrationEngineImpl.java:828(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.runEvents(OrchProcessData.java:771(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.executeEvents(OrchProcessData.java:227(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:668(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeChildProcess(OrchestrationEngineImpl.java:738(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.resumeProcess(OrchestrationEngineImpl.java:689(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchestrationEngineImpl.notifyParentProcess(OrchestrationEngineImpl.java:828(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.runEvents(OrchProcessData.java:771(Compiled Code))
4XESTACKTRACE at oracle/iam/platform/kernel/impl/OrchProcessData.executeEvents(OrchProcessData.java:227(Compiled Code))

Increase the memory your database is using. Using the Enterprise Manager of your database, watch the usage during the recon. If it is still maxing out on memory and using paging memory, then increase the memory some more. You can also increase the memory allocated to your application servers. Increase the number of available threads to your weblogic instance.
-Kevin

Stuck Threads on weblogic 10.3.2 Holding lock HttpURLConnection

We are having issue with STUCK THREADS on weblogic 10.3.2. Basically my application makes a lot of web service calls over HTTPS and once in a while I see few STUCK THREADS and most of the time they clear but sometimes I have to bounce my server to clean.
I have a thread dump, according to this its holding lock at weblogic.net.http.HttpURLConnection.getInputStream
Any help to resolve this problem is highly appreciated.
ThreadDump:
<May 24, 2011 9:59:08 AM EDT> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '11' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "604" seconds working on the request "weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl@b607d75", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-75 "[STUCK] ExecuteThread: '11' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, priority=1, DAEMON> {
jrockit.net.SocketNativeIO.readBytesPinned(SocketNativeIO.java:???)
jrockit.net.SocketNativeIO.socketRead(SocketNativeIO.java:31)
java.net.SocketInputStream.socketRead0(SocketInputStream.java:???)
java.net.SocketInputStream.read(SocketInputStream.java:107)
weblogic.utils.io.ChunkedInputStream.read(ChunkedInputStream.java:149)
java.io.InputStream.read(InputStream.java:85)
com.certicom.tls.record.ReadHandler.readFragment(Unknown Source)
com.certicom.tls.record.ReadHandler.readRecord(Unknown Source)
com.certicom.tls.record.ReadHandler.read(Unknown Source)
^-- Holding lock: com.certicom.tls.record.ReadHandler@bec563c[thin lock]
com.certicom.io.InputSSLIOStreamWrapper.read(Unknown Source)
java.io.BufferedInputStream.fill(BufferedInputStream.java:189)
java.io.BufferedInputStream.read(BufferedInputStream.java:236)
^-- Holding lock: java.io.BufferedInputStream@bec5d9f[thin lock]
weblogic.net.http.MessageHeader.isHTTP(MessageHeader.java:214)
weblogic.net.http.MessageHeader.parseHeader(MessageHeader.java:141)
weblogic.net.http.HttpClient.parseHTTP(HttpClient.java:452)
^-- Holding lock: weblogic.net.http.HttpsClient@bec5202[thin lock]
weblogic.net.http.HttpURLConnection.getInputStream(HttpURLConnection.java:328)
weblogic.net.http.SOAPHttpsURLConnection.getInputStream(SOAPHttpsURLConnection.java:37)
^-- Holding lock: weblogic.net.http.SOAPHttpsURLConnection@bd3b209[thin lock]
weblogic.net.http.HttpURLConnection.getResponseCode(HttpURLConnection.java:939)
com.sun.xml.ws.transport.http.client.HttpClientTransport.readResponseCodeAndMessage(HttpClientTransport.java:213)
com.sun.xml.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:116)
com.sun.xml.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:101)
com.sun.xml.ws.api.pipe.Fiber.__doRun(Fiber.java:580)
com.sun.xml.ws.api.pipe.Fiber._doRun(Fiber.java:553)
com.sun.xml.ws.api.pipe.Fiber.doRun(Fiber.java:535)
com.sun.xml.ws.api.pipe.Fiber.runSync(Fiber.java:433)
^-- Holding lock: com.sun.xml.ws.api.pipe.Fiber@bd3afa8[thin lock]
com.sun.xml.ws.client.Stub.process(Stub.java:238)
com.sun.xml.ws.client.sei.SEIStub.doProcess(SEIStub.java:135)
com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:102)
com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:89)
com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:116)
$Proxy107.jobSubmit(Unknown Source)
com.somejob.invokeService(JobOperation.java:53)
com.somejobws.operations.ticket.execute(ticket.java:30)
com.somejobutil.Somehelper.process(Somehelper.java:174)
com.somejobutil.Somehelper.processJob(Somehelper.java:147)
com.somejobutil.Somehelper.processMDB(Somehelper.java:91)
com.somejobejb.ProcessMDB.onMessage(ProcessMDB.java:28)
sun.reflect.GeneratedMethodAccessor109.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
com.bea.core.repackaged.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:148)
com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:102)
com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:148)
com.bea.core.repackaged.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:86)
com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:148)
com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
com.bea.core.repackaged.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:102)
com.bea.core.repackaged.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:148)
com.bea.core.repackaged.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:151)
$Proxy67.onMessage(Unknown Source)
weblogic.ejb.container.internal.MDListener.execute(MDListener.java:403)
weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:352)
weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:264)
weblogic.jms.client.JMSSession.onMessage(JMSSession.java:4564)
weblogic.jms.client.JMSSession.execute(JMSSession.java:4060)
weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:3746)
weblogic.jms.client.JMSSession.access$000(JMSSession.java:114)
weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5096)
weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:516)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:198)
weblogic.work.ExecuteThread.run(ExecuteThread.java:165)
}

Yes, we have the same problem, stuck thread on weblogic.net.http.HttpsURLConnection.getResponseCode() (actually implemented by weblogic.net.http.SOAPHttpsURLConnection which also appears to be deprecated ???)
When we use the class javax.net.ssl.HttpsURLConnection the getResponseCode() method works perfectly well, so it looks like the weblogic implementation is to blame.
This is becoming rather urgent now because we're looking to migrate from OC4J to Weblogic and this issue has therefore become a blocker.

Stuck thread in adf application with weblogic

hi every body
I am working in JDev 11.1.1.4 and weblogic 10.3.4
when I deploy my Application in my production weblogic
after some time (it does not constant it is variable) I got warnning on the server
when I check the server I got some stuck thread
any idea or notes how can I know what is the reason of these stuck threads?
is there any objects have thread unsafe issue, resource contention or race condition in ADF?
BR,
Alaa

actully I do that guys
but what I get does not have any related to my application
even those http request does not request the same page
this is the stuck thread when I dump
"[STUCK] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'" id=61 idx=0xe8 tid=13369 prio=1 alive, waiting, native_blocked, daemon
-- Waiting for notification on: oracle/adfinternal/controller/util/RequestLock@0x88e06b58[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
at java/lang/Object.wait(Object.java:485)[inlined]
at oracle/adfinternal/controller/util/RequestLock.lock(RequestLock.java:42)[inlined]
at oracle/adfinternal/controller/state/RootViewPortContextImpl.lockViewPortRequestLock(RootViewPortContextImpl.java:604)[optimized]
^-- Lock released while waiting: oracle/adfinternal/controller/util/RequestLock@0x88e06b58[fat lock]
at oracle/adfinternal/controller/state/ControllerState.initializeRequest(ControllerState.java:833)[inlined]
at oracle/adfinternal/controller/state/ControllerState.initializeRequest(ControllerState.java:754)[inlined]
at oracle/adfinternal/controller/application/AdfcConfigurator.beginRequest(AdfcConfigurator.java:50)[optimized]
at org/apache/myfaces/trinidadinternal/config/GlobalConfiguratorImpl._startConfiguratorServiceRequest(GlobalConfiguratorImpl.java:562)[inlined]
at org/apache/myfaces/trinidadinternal/config/GlobalConfiguratorImpl.beginRequest(GlobalConfiguratorImpl.java:212)[optimized]
at org/apache/myfaces/trinidadinternal/webapp/TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:155)[optimized]
at org/apache/myfaces/trinidad/webapp/TrinidadFilter.doFilter(TrinidadFilter.java:92)[optimized]
at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]
at oracle/adf/library/webapp/LibraryFilter.doFilter(LibraryFilter.java:175)[optimized]
at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]
at oracle/security/jps/ee/http/JpsAbsFilter$1.run(JpsAbsFilter.java:111)[optimized]
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)[inlined]
at oracle/security/jps/util/JpsSubject.doAsPrivileged(JpsSubject.java:313)[inlined]
at oracle/security/jps/ee/util/JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)[inlined]
at oracle/security/jps/ee/http/JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)[inlined]
at oracle/security/jps/ee/http/JpsAbsFilter.doFilter(JpsAbsFilter.java:161)[optimized]
at oracle/security/jps/ee/http/JpsFilter.doFilter(JpsFilter.java:71)[optimized]
at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]
at oracle/dms/servlet/DMSServletFilter.doFilter(DMSServletFilter.java:136)[optimized]
at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[optimized]
at weblogic/servlet/internal/RequestEventsFilter.doFilter(RequestEventsFilter.java:27)[optimized]
at weblogic/servlet/internal/FilterChainImpl.doFilter(FilterChainImpl.java:56)[inlined]
at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)[inlined]
at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)[optimized]
at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)[optimized]
at weblogic/security/service/SecurityManager.runAs(SecurityManager.java:120)[inlined]
at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2277)[inlined]
at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2183)[optimized]
at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1454)[optimized]
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:207)[optimized]
at weblogic/work/ExecuteThread.run(ExecuteThread.java:176)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
any another ideas?
BR,
Alaa

Weblogic.jms.frontend.FEConnectionFactory on Stuck Thread

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
          <HTML><HEAD>
          <META http-equiv=Content-Type content="text/html; charset=iso-8859-1">
          <META content="MSHTML 6.00.2900.2627" name=GENERATOR>
          <STYLE></STYLE>
          </HEAD>
          <BODY>
          <DIV><FONT face=Arial size=2>Hi,</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>I need help on this issue quite
          urgently.</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>Server Environment</FONT></DIV>
          <DIV><FONT face=Arial size=2>----------------------</FONT></DIV>
          <DIV>
          <DIV><FONT face=Arial size=2>Server: Weblogic 8.1 SP4</FONT></DIV>
          <DIV><FONT face=Arial size=2>Java version: 1.4.2_05</FONT></DIV></DIV>
          <DIV><FONT face=Arial size=2>I have 2 Sun Solaris Servers each having 4
          NICs with the following addresses:</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>SERVER A
          SERVER B</FONT></DIV>
          <DIV><FONT face=Arial size=2>-------------
                  -------------</FONT></DIV>
          <DIV><FONT face=Arial size=2>10.32.10.11
          10.32.10.13</FONT></DIV>
          <DIV><FONT face=Arial size=2>10.32.10.12
          10.32.10.14</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial
          size=2>10.31.10.131                       10.31.10.133</FONT></DIV>
          <DIV><FONT face=Arial size=2>10.31.10.132
          10.31.10.134</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV>
          <DIV>
          <DIV><FONT face=Arial size=2>10.32.10.11 / 10.32.10.12 / 10.32.10.13 /
          10.32.10.14 are all mapped onto a Virtual IP Address
          10.32.10.1</FONT></DIV><FONT face=Arial size=2>10.31.10.131 / 10.31.10.132 /
          10.31.10.133 / 10.31.10.134 are all mapped onto a Virtual IP Address
          10.31.10.1</FONT></DIV></DIV>
          <DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>And the subnet for the above NICs is all
          255.255.255.0.</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>The 2 Sun Servers are being clustered by Vertias
          Cluster Server and At any one time, only one server is in active
          state.</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV></DIV>
          <DIV><FONT face=Arial size=2>Scenario:</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>When a client (IP Address:
          10.32.10.101/255.255.255.0) tries to subscribe to the server's JMS Topic, the
          entire server hanged and no other client requests can be further
          processed.</FONT></DIV>
          <DIV><FONT face=Arial size=2>Health status checks on the server also did not get
          any response and the client also hanged.</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>A check on the Weblogic's Kernal threads shows that
          one of the thread is currently handling
          "weblogic.jms.frontend.FEConnectionFactory".</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>This hanged state will eventually timeout after
          600s and everything goes back to normal. </FONT></DIV>
          <DIV><FONT face=Arial size=2>The client will have exceptions saying No route to
          destination due to "Empty Reply".</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>I've also tried upgradng the Client's JDK to
          1.4.2_07 and the reslt is still the same.</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>For weblogic.jms.frontend.FEConnectionFactory, it
          seems that the Client is trying to establish a JMS connection with the server
          but somehow it got stuck in the process.</FONT></DIV>
          <DIV><FONT face=Arial size=2>Why is this so? Is this a SP4 bug?</FONT></DIV>
          <DIV><FONT face=Arial size=2></FONT> </DIV>
          <DIV><FONT face=Arial size=2>Regards</FONT></DIV>
          <DIV><FONT face=Arial size=2>Mike</FONT></DIV></BODY></HTML>

check whether the QCF is targetted and deployed on the Managed Server. I am assuming your war is deployed on the managed server.
cheers
dips

Stuck thread in Oracle Weblogic server

Dear All,
We have a stuck thread in Oracle WLS 10.3.3. We have deployed 7 ear files in 5th managed server(psMS5). We have stuck thread in one of the application (psinsurance). We have allocated 1GB heap space for the psMS5 managed server. We are using this in Development environment. Please check the below message from psMS5 managed server log file. Kindly provide reason for stuck thread and solution.
WatchTime: Sep 23, 2011 10:28:29 AM IST
WatchDomainName: dev_domain
WatchServerName: psMS5
WatchSeverityLevel: Warning
WatchName: MS5-Watch
WatchRuleType: Log
WatchRule: ((MESSAGE LIKE '%has been busy for "%') AND (MSGID = 'BEA-000337') AND (SERVER = 'psMS5'))
WatchData: DATE = Sep 23, 2011 10:28:28 AM IST SERVER = psMS5 MESSAGE = [STUCK] ExecuteThread: '22' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "629" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@1cac6525[
POST */psinsurance/app/lending/insurance/PS00738D.jspx*?_adf.ctrl-state=24f0li74e_4 HTTP/1.1
Accept: image/jpeg, application/x-ms-application, image/gif, application/xaml+xml, image/pjpeg, application/x-ms-xbap, */*
Referer: http://sis-prosun11/psinsurance/faces/PS00003?jsessionid=r2BrT8TpqZBsnLhCw2Y8KDpTV7hMpgnLDFW54P87ZpHwn8JMy88s%21168932459%211316753022074&_afrWindowMode=0&_afrLoop=244724092027000&_adf.ctrl-state=24f0li74e_4
Accept-Language: en-US
User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; Tablet PC 2.0)
Content-Type: application/x-www-form-urlencoded
Accept-Encoding: gzip, deflate
Content-Length: 554
Cache-Control: no-cache
Cookie: JSESSIONID=LkJcT8TfMT64SyQJT4Ls4sXhfDl0pTS7CXJVQ9KcryHGWJ1dhyfz!1373322659
Connection: Keep-Alive
Proxy-Client-IP: 192.168.9.179
X-Forwarded-For: 192.168.9.179
X-WebLogic-KeepAliveSecs: 30
X-WebLogic-Force-JVMID: 1373322659
]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-237 "[STUCK] ExecuteThread: '22' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, suspended, priority=1, DAEMON> {
java.io.UnixFileSystem.getBooleanAttributes0(UnixFileSystem.java:???)
java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:228)
java.io.File.exists(File.java:729)
weblogic.utils.classloaders.ClasspathClassFinder.getFileSource(ClasspathClassFinder.java:383)
weblogic.utils.classloaders.ClasspathClassFinder.getSourcesInternal(ClasspathClassFinder.java:333)
weblogic.utils.classloaders.ClasspathClassFinder.getSource(ClasspathClassFinder.java:316)
weblogic.utils.classloaders.JarClassFinder.getSource(JarClassFinder.java:58)
weblogic.utils.classloaders.AbstractClassFinder.getClassSource(AbstractClassFinder.java:22)
weblogic.utils.classloaders.MultiClassFinder.getClassSource(MultiClassFinder.java:56)
weblogic.utils.classloaders.CodeGenClassFinder.getClassSource(CodeGenClassFinder.java:26)
weblogic.utils.classloaders.GenericClassLoader.findLocalClass(GenericClassLoader.java:268)
*^-- Holding lock: weblogic.utils.classloaders.GenericClassLoader@1e3295a1[thin lock]*
weblogic.utils.classloaders.GenericClassLoader.findClass(GenericClassLoader.java:237)
java.lang.ClassLoader.loadClass(ClassLoader.java:292)
*^-- Holding lock: weblogic.utils.classloaders.GenericClassLoader@1e3295a1[thin lock]*
java.lang.ClassLoader.loadClass(ClassLoader.java:292)
java.lang.ClassLoader.loadClass(ClassLoader.java:248)
weblogic.utils.classloaders.GenericClassLoader.loadClass(GenericClassLoader.java:177)
weblogic.utils.classloaders.ChangeAwareClassLoader.loadClass(ChangeAwareClassLoader.java:37)
*^-- Holding lock: weblogic.utils.classloaders.ChangeAwareClassLoader@1e553474[thin lock]*
java.lang.Class.getDeclaredConstructors0(Class.java:???)
java.lang.Class.privateGetDeclaredConstructors(Class.java:2370)
java.lang.Class.getConstructor0(Class.java:2699)
java.lang.Class.newInstance0(Class.java:318)
java.lang.Class.newInstance(Class.java:305)
org.apache.myfaces.trinidadinternal.renderkit.ClassRendererInstantiator.instantiate(ClassRendererInstantiator.java:48)
org.apache.myfaces.trinidadinternal.renderkit.RenderKitBase.findRenderer(RenderKitBase.java:146)
org.apache.myfaces.trinidadinternal.renderkit.RenderKitDecorator.findRenderer(RenderKitDecorator.java:84)
oracle.adfinternal.view.faces.unified.renderkit.UnifiedRenderKit._getRenderer(UnifiedRenderKit.java:218)
oracle.adfinternal.view.faces.unified.renderkit.UnifiedRenderKit.findRenderer(UnifiedRenderKit.java:156)
org.apache.myfaces.trinidadinternal.renderkit.RenderKitBase.getRenderer(RenderKitBase.java:129)
org.apache.myfaces.trinidad.component.UIXComponentBase._getRendererImpl(UIXComponentBase.java:1143)
org.apache.myfaces.trinidad.component.UIXComponentBase.getRenderer(UIXComponentBase.java:1173)
org.apache.myfaces.trinidad.component.UIXComponentBase.getClientId(UIXComponentBase.java:316)
javax.faces.webapp.UIComponentClassicTagBase.doStartTag(UIComponentClassicTagBase.java:1095)
org.apache.myfaces.trinidad.webapp.UIXComponentELTag.doStartTag(UIXComponentELTag.java:70)
oracle.adfinternal.view.faces.unified.taglib.input.UnifiedSelectBooleanCheckboxTag.doStartTag(UnifiedSelectBooleanCheckboxTag.java:45)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspIterationTagNode.executeHandler(OracleJspIterationTagNode.java:41)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspIterationTagNode.executeHandler(OracleJspIterationTagNode.java:41)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
oracle.jsp.runtime.tree.OracleJspNode.execute(OracleJspNode.java:73)
oracle.jsp.runtimev2.ShortCutServlet._jspService(ShortCutServlet.java:57)
oracle.jsp.runtime.OracleJspBase.service(OracleJspBase.java:29)
oracle.jsp.runtimev2.JspPageTable.compileAndServe(JspPageTable.java:650)
oracle.jsp.runtimev2.JspPageTable.service(JspPageTable.java:330)
oracle.jsp.runtimev2.JspServlet.internalService(JspServlet.java:680)
oracle.jsp.runtimev2.JspServlet.service(JspServlet.java:653)
javax.servlet.http.HttpServlet.service(HttpServlet.java:815)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:206)
weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.adf.library.webapp.LibraryFilter.doFilter(LibraryFilter.java:147)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
weblogic.servlet.internal.RequestDispatcherImpl.invokeServlet(RequestDispatcherImpl.java:520)
weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:112)
com.sun.faces.context.ExternalContextImpl.dispatch(ExternalContextImpl.java:402)
org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
org.apache.myfaces.trinidadinternal.context.FacesContextFactoryImpl$OverrideDispatch.dispatch(FacesContextFactoryImpl.java:261)
com.sun.faces.application.ViewHandlerImpl.executePageToBuildView(ViewHandlerImpl.java:428)
com.sun.faces.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:132)
javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:189)
org.apache.myfaces.trinidadinternal.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:155)
oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._renderResponse(LifecycleImpl.java:706)
oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:244)
oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:199)
javax.faces.webapp.FacesServlet.service(FacesServlet.java:246)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:206)
weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:134)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:69)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:411)
oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:44)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:411)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:210)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:126)
org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:91)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:94)
oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:299)
oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:406)
oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:82)
oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:70)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.adf.library.webapp.LibraryFilter.doFilter(LibraryFilter.java:147)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:114)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:25)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.doIt(WebAppServletContext.java:3656)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3650)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:308)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:117)
weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2204)
weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2126)
weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1412)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:198)
weblogic.work.ExecuteThread.run(ExecuteThread.java:165)
SUBSYSTEM = WebLogicServer USERID = <WLS Kernel> SEVERITY = Error THREAD = [ACTIVE] ExecuteThread: '18' for queue: 'weblogic.kernel.Default (self-tuning)' MSGID = BEA-000337 MACHINE = sis-prosun11.sis.ad TXID = CONTEXTID = 11d1def534ea1be0:3bbe257e:13286031cbf:-7ffd-0000000000002fe7 TIMESTAMP = 1316753908672
WatchAlarmType: AutomaticReset
WatchAlarmResetPeriod: 60000
SMTPNotificationName: MS5-Health-Notification

I found something interesting to the question I posted from the below link:
http://www.mail-archive.com/[email protected]/msg03217.html

Weblogic 10.3.4 stuck thread after attempting to passify ApplicationModule

Using ADF 11.1.1.4
Is there any reason that Weblogic should ever end up with a stuck thread when attempting to passify an application module. See the stack trace below.
There is no indication of what business components if any were responsible. It goes right up to the panel stretch layout and jsp template.
]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
oracle.jbo.common.Base64$Base64OutputStream.getDeflatedBytes(Base64.java:135)
oracle.jbo.common.Base64$Base64OutputStream.toString(Base64.java:116)
oracle.jbo.common.VariableValueManagerImpl.writeVarsToXML(VariableValueManagerImpl.java:819)
oracle.jbo.server.ViewObjectImpl.doPassivateSettings(ViewObjectImpl.java:19100)
oracle.jbo.server.ApplicationModuleImpl.passivateVOs(ApplicationModuleImpl.java:7712)
oracle.jbo.server.ApplicationModuleImpl.doPassivateState(ApplicationModuleImpl.java:7522)
oracle.jbo.server.ApplicationModuleImpl.doPassivateAMState(ApplicationModuleImpl.java:7509)
oracle.jbo.server.Serializer.passivate(Serializer.java:213)
oracle.jbo.server.DBSerializer.passivateRootAM(DBSerializer.java:290)
oracle.jbo.server.DBSerializer.passivateRootAM(DBSerializer.java:267)
oracle.jbo.server.ApplicationModuleImpl.passivateStateInternal(ApplicationModuleImpl.java:5913)
oracle.jbo.server.ApplicationModuleImpl.passivateState(ApplicationModuleImpl.java:5783)
oracle.jbo.server.ApplicationPoolMessageHandler.doPoolMessage(ApplicationPoolMessageHandler.java:381)
oracle.jbo.server.ApplicationModuleImpl.doPoolMessage(ApplicationModuleImpl.java:8933)
oracle.jbo.common.ampool.ApplicationPoolImpl.sendPoolMessage(ApplicationPoolImpl.java:4496)
oracle.jbo.common.ampool.ApplicationPoolImpl.manageReferencingState(ApplicationPoolImpl.java:1445)
oracle.jbo.common.ampool.ApplicationPoolImpl.recycleReferencedInstance(ApplicationPoolImpl.java:2544)
oracle.jbo.common.ampool.ApplicationPoolImpl.prepareApplicationModule(ApplicationPoolImpl.java:2365)
oracle.jbo.common.ampool.ApplicationPoolImpl.doCheckout(ApplicationPoolImpl.java:2270)
oracle.jbo.common.ampool.ApplicationPoolImpl.useApplicationModule(ApplicationPoolImpl.java:3168)
oracle.jbo.common.ampool.SessionCookieImpl.useApplicationModule(SessionCookieImpl.java:460)
oracle.jbo.http.HttpSessionCookieImpl.useApplicationModule(HttpSessionCookieImpl.java:234)
oracle.jbo.common.ampool.SessionCookieImpl.useApplicationModule(SessionCookieImpl.java:431)
oracle.jbo.common.ampool.SessionCookieImpl.useApplicationModule(SessionCookieImpl.java:426)
oracle.adf.model.bc4j.DCJboDataControl.initializeApplicationModule(DCJboDataControl.java:516)
oracle.adf.model.bc4j.DCJboDataControl.getApplicationModule(DCJboDataControl.java:862)
oracle.adf.model.binding.DCDataControl.setErrorHandler(DCDataControl.java:483)
oracle.jbo.uicli.binding.JUApplication.setErrorHandler(JUApplication.java:261)
oracle.adf.model.BindingContext.put(BindingContext.java:1300)
oracle.adf.model.binding.DCDataControlReference.getDataControl(DCDataControlReference.java:174)
oracle.adf.model.BindingContext.instantiateDataControl(BindingContext.java:1024)
oracle.adf.model.dcframe.DataControlFrameImpl.doFindDataControl(DataControlFrameImpl.java:1282)
oracle.adf.model.dcframe.DataControlFrameImpl.internalFindDataControl(DataControlFrameImpl.java:1186)
oracle.adf.model.dcframe.DataControlFrameImpl.findDataControl(DataControlFrameImpl.java:1146)
oracle.adf.model.BindingContext.internalFindDataControl(BindingContext.java:1149)
oracle.adf.model.BindingContext.get(BindingContext.java:1102)
oracle.adf.model.binding.DCParameter.evaluateValue(DCParameter.java:82)
oracle.adf.model.binding.DCParameter.getValue(DCParameter.java:111)
oracle.adf.model.binding.DCBindingContainer.getChildByName(DCBindingContainer.java:2708)
oracle.adf.model.binding.DCBindingContainer.internalGet(DCBindingContainer.java:2756)
oracle.adf.model.binding.DCExecutableBinding.get(DCExecutableBinding.java:115)
oracle.adf.model.binding.DCUtil.findSpelObject(DCUtil.java:328)
oracle.adf.model.binding.DCBindingContainer.evaluateParameterWithElCheck(DCBindingContainer.java:1460)
oracle.adf.model.binding.DCBindingContainer.findDataControl(DCBindingContainer.java:1590)
oracle.adf.model.binding.DCIteratorBinding.initDataControl(DCIteratorBinding.java:2470)
oracle.adf.model.binding.DCIteratorBinding.getDataControl(DCIteratorBinding.java:2414)
oracle.adf.model.binding.DCIteratorBinding.refresh(DCIteratorBinding.java:4313)
oracle.adf.model.binding.DCExecutableBinding.refreshIfNeeded(DCExecutableBinding.java:341)
oracle.adf.model.binding.DCIteratorBinding.getAllRowsInRange(DCIteratorBinding.java:2337)
sun.reflect.GeneratedMethodAccessor437.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:597)
oracle.jbo.common.JboBeanUtils.getProperty(JboBeanUtils.java:113)
oracle.jbo.common.JboAbstractMap.internalGet(JboAbstractMap.java:97)
oracle.adf.model.binding.DCExecutableBinding.internalGet(DCExecutableBinding.java:169)
oracle.adf.model.binding.DCIteratorBinding.internalGet(DCIteratorBinding.java:4558)
oracle.adf.model.binding.DCExecutableBinding.get(DCExecutableBinding.java:115)
javax.el.MapELResolver.getValue(MapELResolver.java:164)
com.sun.faces.el.DemuxCompositeELResolver._getValue(DemuxCompositeELResolver.java:173)
com.sun.faces.el.DemuxCompositeELResolver.getValue(DemuxCompositeELResolver.java:200)
com.sun.el.parser.AstValue.getValue(Unknown Source)
com.sun.el.ValueExpressionImpl.getValue(Unknown Source)
org.apache.myfaces.trinidad.bean.FacesBeanImpl.getProperty(FacesBeanImpl.java:68)
org.apache.myfaces.trinidad.component.UIXComponentBase.getProperty(UIXComponentBase.java:1194)
org.apache.myfaces.trinidad.component.UIXIterator.getValue(UIXIterator.java:706)
org.apache.myfaces.trinidad.component.UIXCollection._flushCachedModel(UIXCollection.java:1386)
org.apache.myfaces.trinidad.component.UIXCollection.__processFlattenedChildrenBegin(UIXCollection.java:1369)
org.apache.myfaces.trinidad.component.UIXIterator.processFlattenedChildren(UIXIterator.java:156)
org.apache.myfaces.trinidad.component.UIXComponent.processFlattenedChildren(UIXComponent.java:160)
org.apache.myfaces.trinidad.component.UIXComponent.processFlattenedChildren(UIXComponent.java:290)
org.apache.myfaces.trinidad.component.UIXComponent.processFlattenedChildren(UIXComponent.java:213)
oracle.adfinternal.view.faces.renderkit.rich.PanelGroupLayoutRenderer.encodeAll(PanelGroupLayoutRenderer.java:315)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
oracle.adfinternal.view.faces.renderkit.rich.ShowDetailItemRenderer.access$500(ShowDetailItemRenderer.java:31)
oracle.adfinternal.view.faces.renderkit.rich.ShowDetailItemRenderer$ChildEncoderCallback.processComponent(ShowDetailItemRenderer.java:531)
oracle.adfinternal.view.faces.renderkit.rich.ShowDetailItemRenderer$ChildEncoderCallback.processComponent(ShowDetailItemRenderer.java:504)
org.apache.myfaces.trinidad.component.UIXComponent.processFlattenedChildren(UIXComponent.java:170)
org.apache.myfaces.trinidad.component.UIXComponent.processFlattenedChildren(UIXComponent.java:290)
org.apache.myfaces.trinidad.component.UIXComponent.encodeFlattenedChildren(UIXComponent.java:255)
oracle.adfinternal.view.faces.renderkit.rich.ShowDetailItemRenderer._encodeChildren(ShowDetailItemRenderer.java:446)
oracle.adfinternal.view.faces.renderkit.rich.ShowDetailItemRenderer.encodeAll(ShowDetailItemRenderer.java:115)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
oracle.adf.view.rich.render.RichRenderer.encodeStretchedChild(RichRenderer.java:2004)
oracle.adfinternal.view.faces.renderkit.rich.PanelAccordionRenderer._encodeNonScreenReaderDetailItem(PanelAccordionRenderer.java:1422)
oracle.adfinternal.view.faces.renderkit.rich.PanelAccordionRenderer._encodeDetailItem(PanelAccordionRenderer.java:1483)
oracle.adfinternal.view.faces.renderkit.rich.PanelAccordionRenderer.access$4800(PanelAccordionRenderer.java:52)
oracle.adfinternal.view.faces.renderkit.rich.PanelAccordionRenderer$PanelEncoderCallback.processComponent(PanelAccordionRenderer.java:2503)
oracle.adfinternal.view.faces.renderkit.rich.PanelAccordionRenderer$PanelEncoderCallback.processComponent(PanelAccordionRenderer.java:2447)
org.apache.myfaces.trinidad.component.UIXComponent.processFlattenedChildren(UIXComponent.java:170)
org.apache.myfaces.trinidad.component.UIXComponent.processFlattenedChildren(UIXComponent.java:290)
org.apache.myfaces.trinidad.component.UIXComponent.encodeFlattenedChildren(UIXComponent.java:255)
oracle.adfinternal.view.faces.renderkit.rich.PanelAccordionRenderer.encodeAll(PanelAccordionRenderer.java:456)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
oracle.adfinternal.view.faces.taglib.region.IncludeTag$FacetWrapper.encodeAll(IncludeTag.java:536)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer.encodeCenterFacet(PanelStretchLayoutRenderer.java:769)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer._encodeCenterPane(PanelStretchLayoutRenderer.java:1140)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer._encodeMiddlePanes(PanelStretchLayoutRenderer.java:348)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer.encodeAll(PanelStretchLayoutRenderer.java:313)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer.encodeStartFacet(PanelStretchLayoutRenderer.java:805)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer._encodeVerticalPane(PanelStretchLayoutRenderer.java:1369)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer._encodeMiddlePanes(PanelStretchLayoutRenderer.java:347)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer.encodeAll(PanelStretchLayoutRenderer.java:313)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer.encodeCenterFacet(PanelStretchLayoutRenderer.java:769)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer._encodeCenterPane(PanelStretchLayoutRenderer.java:1140)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer._encodeMiddlePanes(PanelStretchLayoutRenderer.java:348)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer.encodeAll(PanelStretchLayoutRenderer.java:313)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer.encodeCenterFacet(PanelStretchLayoutRenderer.java:769)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer._encodeCenterPane(PanelStretchLayoutRenderer.java:1140)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer._encodeMiddlePanes(PanelStretchLayoutRenderer.java:348)
oracle.adfinternal.view.faces.renderkit.rich.PanelStretchLayoutRenderer.encodeAll(PanelStretchLayoutRenderer.java:313)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
oracle.adf.view.rich.render.RichRenderer.encodeStretchedChild(RichRenderer.java:2004)
oracle.adfinternal.view.faces.renderkit.rich.PanelSplitterRenderer._renderPane(PanelSplitterRenderer.java:1353)
oracle.adfinternal.view.faces.renderkit.rich.PanelSplitterRenderer.encodeAll(PanelSplitterRenderer.java:259)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeAllChildren(CoreRenderer.java:415)
oracle.adfinternal.view.faces.renderkit.rich.PageTemplateRenderer.encodeAll(PageTemplateRenderer.java:69)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
oracle.adf.view.rich.component.fragment.ContextSwitchingComponent.encodeEnd(ContextSwitchingComponent.java:155)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeAllChildren(CoreRenderer.java:415)
oracle.adfinternal.view.faces.renderkit.rich.FormRenderer.encodeAll(FormRenderer.java:220)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeChild(CoreRenderer.java:399)
oracle.adf.view.rich.render.RichRenderer.encodeChild(RichRenderer.java:2633)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeAllChildren(CoreRenderer.java:415)
oracle.adfinternal.view.faces.renderkit.rich.DocumentRenderer.encodeAll(DocumentRenderer.java:1181)
oracle.adf.view.rich.render.RichRenderer.encodeAll(RichRenderer.java:1396)
org.apache.myfaces.trinidad.render.CoreRenderer.encodeEnd(CoreRenderer.java:335)
org.apache.myfaces.trinidad.component.UIXComponentBase.encodeEnd(UIXComponentBase.java:767)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:937)
javax.faces.component.UIComponent.encodeAll(UIComponent.java:933)
com.sun.faces.application.ViewHandlerImpl.doRenderView(ViewHandlerImpl.java:266)
com.sun.faces.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:197)
javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:189)
org.apache.myfaces.trinidadinternal.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:193)
oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._renderResponse(LifecycleImpl.java:777)
oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:293)
oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:213)
javax.faces.webapp.FacesServlet.service(FacesServlet.java:266)
weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:300)
weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:205)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:106)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:446)
oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:60)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:446)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:271)
org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:177)
org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:92)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
oracle.adf.library.webapp.LibraryFilter.doFilter(LibraryFilter.java:175)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:111)
java.security.AccessController.doPrivileged(Native Method)
oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:94)
oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:161)
oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:136)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)
weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2277)
weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2183)
weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1454)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:207)
weblogic.work.ExecuteThread.run(ExecuteThread.java:176)
SUBSYSTEM = WebLogicServer USERID = <WLS Kernel> SEVERITY = Error THREAD = [ACTIVE] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)' MSGID = BEA-000337 MACHINE = app-sahe.dmz TXID = CONTEXTID = ed3140ecffa37389:3c925abd:13f6031c9fe:-8000-0000000000015dff TIMESTAMP = 1371715760129
WatchAlarmType: AutomaticReset
WatchAlarmResetPeriod: 600000

Was their any changes in any of configuration files or something else. If not, then try bouncing the system once again and see if its working.

WebLogic 11g - Stuck Thread issue observed during MS-ADS authentication

Similar Messages

Maybe you are looking for