Jdbc dead lock thread dump

We have the following thread dump during jdbc dead lock, btw, we are using weblogic60sp2
and its bundled jdbc driver, I have a question, since I see many thread block
on jts.Connection.internalRollback, is it true that different theads can concurrently
access jts connection? If not, how could we explain the block on jts.Connection.internalRollback?
Thanks
Full thread dump:
"HttpPost: 1" prio=5 tid=0x2651ef8 nid=0x51 waiting on monitor [0x61a01000..0x61a01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"mail: 1" prio=5 tid=0x2276910 nid=0x50 waiting on monitor [0x61b01000..0x61b01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"HighPriority TimeEventGenerator" daemon prio=9 tid=0x206fb00 nid=0x4f waiting
on monitor [0x61c01000..0x61c01a28]
     at java.lang.Object.wait(Native Method)
     at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
     at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
     at java.lang.Thread.run(Thread.java:479)
"SSLListenThread" prio=5 tid=0x1d21de8 nid=0x4e runnable [0x64501000..0x64501a28]
     at java.net.PlainSocketImpl.socketAccept(Native Method)
     at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
     at java.net.ServerSocket.implAccept(ServerSocket.java:238)
     at java.net.ServerSocket.accept(ServerSocket.java:217)
     at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:126)
     at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:117)
     at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
"ListenThread" prio=5 tid=0x20a1ce8 nid=0x4d runnable [0x61d01000..0x61d01a28]
     at java.net.PlainSocketImpl.socketAccept(Native Method)
     at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
     at java.net.ServerSocket.implAccept(ServerSocket.java:238)
     at java.net.ServerSocket.accept(ServerSocket.java:217)
     at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
"Thread-4" daemon prio=5 tid=0x1d1fdb8 nid=0x4c waiting on monitor [0x61e01000..0x61e01a28]
     at java.lang.Thread.sleep(Native Method)
     at glog.webserver.xslcompiler.ObjectPool$PoolCleaner.run(ObjectPool.java:260)
     at java.lang.Thread.run(Thread.java:479)
"processSweeper: 1" prio=5 tid=0x1e591f0 nid=0x4b waiting on monitor [0x61f01000..0x61f01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"processCallback: 1" prio=5 tid=0x1e588b0 nid=0x4a waiting on monitor [0x62001000..0x62001a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"processLogging: 1" prio=5 tid=0x1e564c0 nid=0x49 waiting on monitor [0x62101000..0x62101a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"GLog Timer" daemon prio=5 tid=0x1b78888 nid=0x48 waiting on monitor [0x62201000..0x62201a28]
     at java.lang.Thread.sleep(Native Method)
     at glog.server.workflow.TimerThread.sleepSeconds(TimerThread.java:97)
     at glog.server.workflow.TimerThread.run(TimerThread.java:35)
"default: 1" prio=5 tid=0x1ed4748 nid=0x47 waiting on monitor [0x62301000..0x62301a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"totals: 1" prio=5 tid=0x1ed3c50 nid=0x46 waiting on monitor [0x62401000..0x62401a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"txComplete: 1" prio=5 tid=0x1ed3158 nid=0x45 waiting on monitor [0x62501000..0x62501a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"milestone: 1" prio=5 tid=0x1ed26d8 nid=0x44 waiting on monitor [0x62601000..0x62601a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"OMD: 2" prio=5 tid=0x12c9c08 nid=0x43 runnable [0x626ff000..0x62701a28]
     at java.net.SocketInputStream.socketRead(Native Method)
     at java.net.SocketInputStream.read(SocketInputStream.java:85)
     at oracle.net.ns.Packet.receive(Unknown Source)
     at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
     at oracle.net.ns.NetInputStream.read(Unknown Source)
     at oracle.net.ns.NetInputStream.read(Unknown Source)
     at oracle.net.ns.NetInputStream.read(Unknown Source)
     at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
     at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
     at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
     at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
     at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
     at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
     at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
     at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
     at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
     at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
     at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
     at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
     at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
     at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
     at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
     at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
     at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
     at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
     at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
     at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
     at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
     at java.lang.reflect.Method.invoke(Native Method)
     at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
     at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
     at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
     at java.lang.reflect.Method.invoke(Native Method)
     at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
     at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
     at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
     at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
     at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
     at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
     at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
     at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
     at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
     at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
     at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
     at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
     at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
     at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
     at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
     at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
     at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
     at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
     at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
     at glog.server.workflow.Trigger.trigger(Trigger.java:112)
     at glog.util.event.EventQueuer.run(EventQueuer.java:155)
     at java.lang.Thread.run(Thread.java:479)
"OMD: 1" prio=5 tid=0x12c8d08 nid=0x42 runnable [0x627ff000..0x62801a28]
     at java.net.SocketInputStream.socketRead(Native Method)
     at java.net.SocketInputStream.read(SocketInputStream.java:85)
     at oracle.net.ns.Packet.receive(Unknown Source)
     at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
     at oracle.net.ns.NetInputStream.read(Unknown Source)
     at oracle.net.ns.NetInputStream.read(Unknown Source)
     at oracle.net.ns.NetInputStream.read(Unknown Source)
     at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
     at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
     at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
     at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
     at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
     at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
     at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
     at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
     at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
     at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
     at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
     at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
     at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
     at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
     at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
     at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
     at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
     at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
     at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
     at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
     at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
     at java.lang.reflect.Method.invoke(Native Method)
     at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
     at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
     at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
     at java.lang.reflect.Method.invoke(Native Method)
     at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
     at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
     at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
     at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
     at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
     at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
     at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
     at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
     at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
     at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
     at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
     at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
     at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
     at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
     at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
     at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
     at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
     at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
     at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
     at glog.server.workflow.Trigger.trigger(Trigger.java:112)
     at glog.util.event.EventQueuer.run(EventQueuer.java:155)
     at java.lang.Thread.run(Thread.java:479)
"agentIntegration: 1" prio=5 tid=0x12c8288 nid=0x41 waiting on monitor [0x62901000..0x62901a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"agentPlanning: 3" prio=5 tid=0x1f0d0d8 nid=0x40 waiting on monitor [0x62a01000..0x62a01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"agentPlanning: 2" prio=5 tid=0x1f0c658 nid=0x3f waiting on monitor [0x62b01000..0x62b01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"agentPlanning: 1" prio=5 tid=0x1f0bbd8 nid=0x3e waiting on monitor [0x62c01000..0x62c01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"agentUtility: 4" prio=5 tid=0x1f0b158 nid=0x3d waiting on monitor [0x62d01000..0x62d01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"agentUtility: 3" prio=5 tid=0x1f0a6d8 nid=0x3c waiting on monitor [0x62e01000..0x62e01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"agentUtility: 2" prio=5 tid=0x1ce4838 nid=0x3b waiting on monitor [0x62f01000..0x62f01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"agentUtility: 1" prio=5 tid=0x1ce3db8 nid=0x3a waiting on monitor [0x63001000..0x63001a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"publishWait: 4" prio=5 tid=0x1ce2d30 nid=0x39 waiting on monitor [0x63100000..0x63101a28]
     at java.lang.Object.wait(Native Method)
     at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
     at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
     at glog.server.workflow.Topic.publishWait(Topic.java:135)
     at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
     at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
     at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
     at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
     at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
     at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
     at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
     at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
     at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
     at java.lang.reflect.Method.invoke(Native Method)
     at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
     at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
     at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
     at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
     at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
     at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
     at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
     at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
     at glog.server.workflow.Trigger.trigger(Trigger.java:112)
     at glog.util.event.EventQueuer.run(EventQueuer.java:155)
     at java.lang.Thread.run(Thread.java:479)
"publishWait: 3" prio=5 tid=0x210f240 nid=0x38 waiting on monitor [0x63200000..0x63201a28]
     at java.lang.Object.wait(Native Method)
     at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
     at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
     at glog.server.workflow.Topic.publishWait(Topic.java:135)
     at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
     at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
     at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
     at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
     at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
     at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
     at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
     at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
     at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
     at java.lang.reflect.Method.invoke(Native Method)
     at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
     at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
     at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
     at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
     at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
     at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
     at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
     at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
     at glog.server.workflow.Trigger.trigger(Trigger.java:112)
     at glog.util.event.EventQueuer.run(EventQueuer.java:155)
     at java.lang.Thread.run(Thread.java:479)
"publishWait: 2" prio=5 tid=0x210e7c0 nid=0x37 waiting on monitor [0x63300000..0x63301a28]
     at java.lang.Object.wait(Native Method)
     at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
     at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
     at glog.server.workflow.Topic.publishWait(Topic.java:135)
     at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
     at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
     at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
     at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
     at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
     at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
     at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
     at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
     at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
     at java.lang.reflect.Method.invoke(Native Method)
     at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
     at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
     at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
     at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
     at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
     at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
     at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
     at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
     at glog.server.workflow.Trigger.trigger(Trigger.java:112)
     at glog.util.event.EventQueuer.run(EventQueuer.java:155)
     at java.lang.Thread.run(Thread.java:479)
"publishWait: 1" prio=5 tid=0x210dd40 nid=0x36 waiting on monitor [0x63400000..0x63401a28]
     at java.lang.Object.wait(Native Method)
     at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
     at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
     at glog.server.workflow.Topic.publishWait(Topic.java:135)
     at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
     at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
     at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
     at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
     at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
     at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
     at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
     at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
     at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
     at java.lang.reflect.Method.invoke(Native Method)
     at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
     at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
     at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
     at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
     at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
     at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
     at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
     at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
     at glog.server.workflow.Trigger.trigger(Trigger.java:112)
     at glog.util.event.EventQueuer.run(EventQueuer.java:155)
     at java.lang.Thread.run(Thread.java:479)
"http: 4" prio=5 tid=0x210d2c0 nid=0x35 waiting on monitor [0x63501000..0x63501a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"http: 3" prio=5 tid=0x210c840 nid=0x34 waiting on monitor [0x63601000..0x63601a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"http: 2" prio=5 tid=0x20cdc20 nid=0x33 waiting on monitor [0x63701000..0x63701a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"http: 1" prio=5 tid=0x20cd1a0 nid=0x32 waiting on monitor [0x63801000..0x63801a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"lifetime: 1" prio=5 tid=0x20cc720 nid=0x31 waiting on monitor [0x63901000..0x63901a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"utility: 4" prio=5 tid=0x20cbd40 nid=0x30 waiting on monitor [0x63a01000..0x63a01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"utility: 3" prio=5 tid=0x20b84e8 nid=0x2f waiting on monitor [0x63b01000..0x63b01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"utility: 2" prio=5 tid=0x20b7a68 nid=0x2e waiting on monitor [0x63c01000..0x63c01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"utility: 1" prio=5 tid=0x1d97ae8 nid=0x2d waiting on monitor [0x63d01000..0x63d01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"shipmentEvents: 1" prio=5 tid=0x1d979a8 nid=0x2c waiting on monitor [0x63e01000..0x63e01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"execution: 2" prio=5 tid=0x1d97468 nid=0x2b waiting on monitor [0x63f01000..0x63f01a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"execution: 1" prio=5 tid=0x1f27670 nid=0x2a waiting on monitor [0x64001000..0x64001a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"integration: 1" prio=5 tid=0x1f27530 nid=0x29 waiting on monitor [0x64101000..0x64101a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"batch: 2" prio=5 tid=0x20621e8 nid=0x28 waiting on monitor [0x64201000..0x64201a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"batch: 1" prio=5 tid=0x1eb4160 nid=0x27 waiting on monitor [0x64301000..0x64301a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"EventDefault: 1" prio=5 tid=0x1fb0e38 nid=0x26 waiting on monitor [0x64401000..0x64401a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at glog.util.event.EventQueuer.run(EventQueuer.java:122)
     at java.lang.Thread.run(Thread.java:479)
"Application Manager Thread" prio=5 tid=0x1ce9b08 nid=0x24 waiting on monitor
[0x64601000..0x64601a28]
     at java.lang.Thread.sleep(Native Method)
     at weblogic.management.mbeans.custom.ApplicationManager$ApplicationPoller.run(ApplicationManager.java:644)
"ExecuteThread: '1' for queue: '__weblogic_admin_rmi_queue'" daemon prio=5 tid=0x66e198
nid=0x23 waiting on monitor [0x6d081000..0x6d081a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: '__weblogic_admin_rmi_queue'" daemon prio=5 tid=0x66d858
nid=0x22 waiting on monitor [0x6d181000..0x6d181a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '1' for queue: '__weblogic_admin_html_queue'" daemon prio=5 tid=0x66c910
nid=0x21 waiting on monitor [0x6d281000..0x6d281a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: '__weblogic_admin_html_queue'" daemon prio=5 tid=0x66c3d0
nid=0x20 waiting on monitor [0x6d381000..0x6d381a28]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.ja

Jinosng Hu wrote:
We have the following thread dump during jdbc dead lock, btw, we are using weblogic60sp2
and its bundled jdbc driver, I have a question, since I see many thread block
on jts.Connection.internalRollback, is it true that different theads can concurrently
access jts connection? If not, how could we explain the block on jts.Connection.internalRollback?
ThanksHi. What seems to be happening is that our transaction coordinator has found these transactions that have
exceeded their timeout limit, and is trying to roll back the transaction on the JDBC connection, but is
blocked by the synchronization of the driver until the user thread running the current JDBC statement
returns. Would you please try adding this patch to the beginning of the server classpath, and repeat?
This patch will have the transaction coordinator call Statement.cancel() on all the ongoing statements
in the transaction before trying to call rollback(). This may solve the problem. Let me know...
Joe
PS: Also, please go to the Oracle site and download their latest thin driver. It is more recent and
better than the version that was available when we packaged our server. Try putting it ahead of
all weblogic stuff in the server classpath too.
thanks
Joe
>
>
Full thread dump:
"HttpPost: 1" prio=5 tid=0x2651ef8 nid=0x51 waiting on monitor [0x61a01000..0x61a01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"mail: 1" prio=5 tid=0x2276910 nid=0x50 waiting on monitor [0x61b01000..0x61b01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"HighPriority TimeEventGenerator" daemon prio=9 tid=0x206fb00 nid=0x4f waiting
on monitor [0x61c01000..0x61c01a28]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:479)
"SSLListenThread" prio=5 tid=0x1d21de8 nid=0x4e runnable [0x64501000..0x64501a28]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
at java.net.ServerSocket.implAccept(ServerSocket.java:238)
at java.net.ServerSocket.accept(ServerSocket.java:217)
at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:126)
at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:117)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
"ListenThread" prio=5 tid=0x20a1ce8 nid=0x4d runnable [0x61d01000..0x61d01a28]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
at java.net.ServerSocket.implAccept(ServerSocket.java:238)
at java.net.ServerSocket.accept(ServerSocket.java:217)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
"Thread-4" daemon prio=5 tid=0x1d1fdb8 nid=0x4c waiting on monitor [0x61e01000..0x61e01a28]
at java.lang.Thread.sleep(Native Method)
at glog.webserver.xslcompiler.ObjectPool$PoolCleaner.run(ObjectPool.java:260)
at java.lang.Thread.run(Thread.java:479)
"processSweeper: 1" prio=5 tid=0x1e591f0 nid=0x4b waiting on monitor [0x61f01000..0x61f01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"processCallback: 1" prio=5 tid=0x1e588b0 nid=0x4a waiting on monitor [0x62001000..0x62001a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"processLogging: 1" prio=5 tid=0x1e564c0 nid=0x49 waiting on monitor [0x62101000..0x62101a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"GLog Timer" daemon prio=5 tid=0x1b78888 nid=0x48 waiting on monitor [0x62201000..0x62201a28]
at java.lang.Thread.sleep(Native Method)
at glog.server.workflow.TimerThread.sleepSeconds(TimerThread.java:97)
at glog.server.workflow.TimerThread.run(TimerThread.java:35)
"default: 1" prio=5 tid=0x1ed4748 nid=0x47 waiting on monitor [0x62301000..0x62301a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"totals: 1" prio=5 tid=0x1ed3c50 nid=0x46 waiting on monitor [0x62401000..0x62401a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"txComplete: 1" prio=5 tid=0x1ed3158 nid=0x45 waiting on monitor [0x62501000..0x62501a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"milestone: 1" prio=5 tid=0x1ed26d8 nid=0x44 waiting on monitor [0x62601000..0x62601a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"OMD: 2" prio=5 tid=0x12c9c08 nid=0x43 runnable [0x626ff000..0x62701a28]
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:85)
at oracle.net.ns.Packet.receive(Unknown Source)
at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
at java.lang.reflect.Method.invoke(Native Method)
at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
at java.lang.reflect.Method.invoke(Native Method)
at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
at glog.server.workflow.Trigger.trigger(Trigger.java:112)
at glog.util.event.EventQueuer.run(EventQueuer.java:155)
at java.lang.Thread.run(Thread.java:479)
"OMD: 1" prio=5 tid=0x12c8d08 nid=0x42 runnable [0x627ff000..0x62801a28]
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:85)
at oracle.net.ns.Packet.receive(Unknown Source)
at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
at java.lang.reflect.Method.invoke(Native Method)
at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
at java.lang.reflect.Method.invoke(Native Method)
at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
at glog.server.workflow.Trigger.trigger(Trigger.java:112)
at glog.util.event.EventQueuer.run(EventQueuer.java:155)
at java.lang.Thread.run(Thread.java:479)
"agentIntegration: 1" prio=5 tid=0x12c8288 nid=0x41 waiting on monitor [0x62901000..0x62901a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"agentPlanning: 3" prio=5 tid=0x1f0d0d8 nid=0x40 waiting on monitor [0x62a01000..0x62a01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"agentPlanning: 2" prio=5 tid=0x1f0c658 nid=0x3f waiting on monitor [0x62b01000..0x62b01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"agentPlanning: 1" prio=5 tid=0x1f0bbd8 nid=0x3e waiting on monitor [0x62c01000..0x62c01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"agentUtility: 4" prio=5 tid=0x1f0b158 nid=0x3d waiting on monitor [0x62d01000..0x62d01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"agentUtility: 3" prio=5 tid=0x1f0a6d8 nid=0x3c waiting on monitor [0x62e01000..0x62e01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"agentUtility: 2" prio=5 tid=0x1ce4838 nid=0x3b waiting on monitor [0x62f01000..0x62f01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"agentUtility: 1" prio=5 tid=0x1ce3db8 nid=0x3a waiting on monitor [0x63001000..0x63001a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"publishWait: 4" prio=5 tid=0x1ce2d30 nid=0x39 waiting on monitor [0x63100000..0x63101a28]
at java.lang.Object.wait(Native Method)
at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
at glog.server.workflow.Topic.publishWait(Topic.java:135)
at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
at java.lang.reflect.Method.invoke(Native Method)
at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
at glog.server.workflow.Trigger.trigger(Trigger.java:112)
at glog.util.event.EventQueuer.run(EventQueuer.java:155)
at java.lang.Thread.run(Thread.java:479)
"publishWait: 3" prio=5 tid=0x210f240 nid=0x38 waiting on monitor [0x63200000..0x63201a28]
at java.lang.Object.wait(Native Method)
at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
at glog.server.workflow.Topic.publishWait(Topic.java:135)
at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
at java.lang.reflect.Method.invoke(Native Method)
at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
at glog.server.workflow.Trigger.trigger(Trigger.java:112)
at glog.util.event.EventQueuer.run(EventQueuer.java:155)
at java.lang.Thread.run(Thread.java:479)
"publishWait: 2" prio=5 tid=0x210e7c0 nid=0x37 waiting on monitor [0x63300000..0x63301a28]
at java.lang.Object.wait(Native Method)
at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
at glog.server.workflow.Topic.publishWait(Topic.java:135)
at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
at java.lang.reflect.Method.invoke(Native Method)
at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
at glog.server.workflow.Trigger.trigger(Trigger.java:112)
at glog.util.event.EventQueuer.run(EventQueuer.java:155)
at java.lang.Thread.run(Thread.java:479)
"publishWait: 1" prio=5 tid=0x210dd40 nid=0x36 waiting on monitor [0x63400000..0x63401a28]
at java.lang.Object.wait(Native Method)
at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
at glog.server.workflow.Topic.publishWait(Topic.java:135)
at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
at java.lang.reflect.Method.invoke(Native Method)
at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
at glog.server.workflow.Trigger.trigger(Trigger.java:112)
at glog.util.event.EventQueuer.run(EventQueuer.java:155)
at java.lang.Thread.run(Thread.java:479)
"http: 4" prio=5 tid=0x210d2c0 nid=0x35 waiting on monitor [0x63501000..0x63501a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"http: 3" prio=5 tid=0x210c840 nid=0x34 waiting on monitor [0x63601000..0x63601a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"http: 2" prio=5 tid=0x20cdc20 nid=0x33 waiting on monitor [0x63701000..0x63701a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"http: 1" prio=5 tid=0x20cd1a0 nid=0x32 waiting on monitor [0x63801000..0x63801a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"lifetime: 1" prio=5 tid=0x20cc720 nid=0x31 waiting on monitor [0x63901000..0x63901a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"utility: 4" prio=5 tid=0x20cbd40 nid=0x30 waiting on monitor [0x63a01000..0x63a01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"utility: 3" prio=5 tid=0x20b84e8 nid=0x2f waiting on monitor [0x63b01000..0x63b01a28]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at glog.util.event.EventQueuer.run(EventQueuer.java:122)
at java.lang.Thread.run(Thread.java:479)
"utility: 2" prio=5 tid=0x20b7a68 nid=0x2e waiting on monitor [0x63c01000..0x63c01a28]
at java.lang.Object.

Similar Messages

  • JDBC dead lock

    Hi we got into this situation after running our application for a few
    hours and now the JDBC connection pool is completely dead locked.
    The thread dump looks approximately the same for the last two hours with
    a lot of thread trying to get monitor access in ResourceAllocator.
    Has anyone seen this or a way to work around it?
    The server is Weblogic 7.0 SP1 on Solaris 8.0.
    Thanks,
    Dejan
    Full thread dump:
    "RMI RenewClean-[192.168.111.47:3959]" daemon prio=5 tid=0x2be7048 nid=0x1e81 waiting on monitor [0xd1f81000..0xd1f819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
         at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
         at java.lang.Thread.run(Thread.java:479)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2c04f28 nid=0x1e80 waiting on monitor [0xd2081000..0xd20819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "JmsPublisher.kerneltest.COMPUTE1.1920392681264132352" daemon prio=5 tid=0x2b1ea08 nid=0x1e7f waiting on monitor [0xd2281000..0xd22819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread.runUnauthenticated(WakeUpThread.java:177)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:133)
    "RV Event Dispatch" daemon prio=5 tid=0x2b22668 nid=0x1e7e waiting on monitor [0xd2681000..0xd26819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at COM.TIBCO.rv.RvQ.waitEvent(RvQ.java:79)
         at COM.TIBCO.rv.RvDataDispatch.run(RvDataDispatch.java:36)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x21ffb18 nid=0x1e7d waiting on monitor [0xd3581000..0xd35819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2ac3778 nid=0x1e77 waiting on monitor [0xd2781000..0xd27819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2bec498 nid=0x1e76 waiting on monitor [0xd2c81000..0xd2c819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2200520 nid=0x1e75 waiting on monitor [0xd2e81000..0xd2e819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "JmsPublisher.kerneltest.COMPUTE1.6107795875676143616" daemon prio=5 tid=0xb87518 nid=0x1e74 waiting on monitor [0xd2f81000..0xd2f819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread.runUnauthenticated(WakeUpThread.java:177)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:133)
    "RV Event Dispatch" daemon prio=5 tid=0x2ab9b0 nid=0x1e73 waiting on monitor [0xd3181000..0xd31819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at COM.TIBCO.rv.RvQ.waitEvent(RvQ.java:79)
         at COM.TIBCO.rv.RvDataDispatch.run(RvDataDispatch.java:36)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x55e080 nid=0x1e72 waiting on monitor [0xd3381000..0xd33819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "RMI RenewClean-[192.168.111.54:2306]" daemon prio=5 tid=0x2ad62e0 nid=0x1e70 waiting on monitor [0xd3781000..0xd37819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
         at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
         at java.lang.Thread.run(Thread.java:479)
    "RMI RenewClean-[192.168.111.54:2308]" daemon prio=5 tid=0x2beefe8 nid=0x1e6e waiting on monitor [0xd3a81000..0xd3a819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
         at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
         at java.lang.Thread.run(Thread.java:479)
    "JRiskTimerCallbackThread" daemon prio=6 tid=0x21ae390 nid=0x1e3b waiting for monitor entry [0xd8500000..0xd85019e0]
         at weblogic.jdbc.common.internal.ResourceAllocator.markBorrowed(ResourceAllocator.java:575)
         at weblogic.jdbc.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:674)
         at weblogic.jdbc.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:655)
         at weblogic.jdbc.common.internal.ResourceAllocator.reserveWaitSecs(ResourceAllocator.java:645)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:163)
         at weblogic.jdbc.common.internal.ConnectionPool.reserveWaitSecs(ConnectionPool.java:118)
         at weblogic.jdbc.pool.Driver.connect(Driver.java:193)
         at weblogic.jdbc.jts.Driver.getNonTxConnection(Driver.java:374)
         at weblogic.jdbc.jts.Driver.connect(Driver.java:129)
         at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:265)
         at net.appl.jrisk.ejb.ejbDbConnectionHelper.getConnection(ejbDbConnectionHelper.java:167)
         at net.appl.jrisk.ejb.ejbDbConnectionHelper.getDbConnection(ejbDbConnectionHelper.java:137)
         at net.appl.jrisk.db.dbConnectionFactory.getDbConnection(dbConnectionFactory.java:82)
         at net.appl.jrisk.ejb.tx.RTEventCleaner$RTEventProcessor.checkAndSendEvents(RTEventCleaner.java:261)
         at net.appl.jrisk.ejb.tx.RTEventCleaner$RTEventProcessor.onTimer(RTEventCleaner.java:200)
         at net.appl.jrisk.time.SystemTimerCallbackThread$1.run(Timer.java:389)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:785)
         at weblogic.security.Security.runAs(Security.java:61)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedExceptionAction(WeblogicJRiskSecurityHelper.java:264)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedExceptionAction(DefaultJRiskSecurityHelper.java:271)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedExceptionAction(DefaultJRiskSecurityHelper.java:271)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedExceptionAction(JRiskSecurity.java:230)
         at net.appl.jrisk.time.SystemTimerCallbackThread.run(Timer.java:385)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21a2090 nid=0x1e39 waiting on monitor [0xd2981000..0xd29819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x21a5080 nid=0x1e38 waiting on monitor [0xd2b81000..0xd2b819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0xcaae58 nid=0x1e26 waiting on monitor [0xd3e81000..0xd3e819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21fab90 nid=0x1e1f waiting on monitor [0xd3481000..0xd34819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2ad99a0 nid=0x1e1e waiting on monitor [0xd3981000..0xd39819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2213560 nid=0x1a3b waiting on monitor [0xd4181000..0xd41819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21fece8 nid=0x1a38 waiting on monitor [0xd3f81000..0xd3f819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x22153f8 nid=0x1a37 waiting on monitor [0xd4581000..0xd45819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2ad3bd8 nid=0x1971 waiting on monitor [0xd4a81000..0xd4a819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21eaa50 nid=0x196d waiting on monitor [0xd4681000..0xd46819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21ac888 nid=0x1962 waiting on monitor [0xd2181000..0xd21819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21ac748 nid=0x1960 waiting on monitor [0xd2581000..0xd25819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2226bd8 nid=0x195e waiting on monitor [0xd2881000..0xd28819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0xc7f588 nid=0x195b waiting on monitor [0xd3081000..0xd30819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "RMI RenewClean-[192.168.111.49:4754]" daemon prio=5 tid=0x2226558 nid=0x1959 waiting on monitor [0xd3d81000..0xd3d819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
         at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
         at java.lang.Thread.run(Thread.java:479)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0xb85490 nid=0x1910 waiting on monitor [0xd4281000..0xd42819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2ae1240 nid=0x1905 waiting on monitor [0xd2381000..0xd23819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
         at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
         at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
         at weblogic.security.Security.runAs(Security.java:41)
         at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
         at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
         at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
         at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2b2a800 nid=0x1904 waiting on monitor [0xd2481000..0xd24819e0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at net.appl.jrisk.util.thread.WakeUpThread.doRun

    Hi Joe,
    With the patch you've sent me we haven't seen the issue so far and we've
    been running our servers for more than 12 hours now.
    But we don't want to disable the refresh since we don't like the
    performance hit associated with setting testConnectionOnReserve to
    'true' (we've measured it to be between 5 and 10 percent) so this is the
    only mechanism we rely on for refreshing the connections.
    Thanks for your help,
    Dejan
    Joseph Weinstein wrote:
    Joseph Weinstein wrote:
    "Deyan D. Bektchiev" wrote:
    Hi we got into this situation after running our application for a few
    hours and now the JDBC connection pool is completely dead locked.
    The thread dump looks approximately the same for the last two hours with
    a lot of thread trying to get monitor access in ResourceAllocator.
    Has anyone seen this or a way to work around it?
    The server is Weblogic 7.0 SP1 on Solaris 8.0.
    Thanks,
    Dejan
    Hi. I just analysed this thread dump. The key to the blockage (it's not
    a deadlock) is:
    Your pool is running refresh at this time. Unless you really need
    refresh, I recommend not using it. Refresh at this time has found a
    pool connection that did not pass the test (indicating an oracle problem),
    and is busy closing the bad connection. Part of this closing the connection
    is involving a call to the broken connection that is hanging. This hang is
    blocking all other access to the pool. I do see that refresh is making
    unnecessary JDBC calls to the failed connection, after we already know
    we're going to close it. How quickly duplicable is this failure case? Do you
    have any indication as to the state of the DBMS at this time?
    Please take the attached jar file and get it ahead of all standard weblogic stuff
    in the server's classpath, and let me know if this helps. It won't be able to change
    the DBMS state that hung the call, but it removes all the unnecessary DBMS
    calls that we were making, in the case when we know we're going to close a
    connection anyway...
    Joe
    Full thread dump:
    "RMI RenewClean-[192.168.111.47:3959]" daemon prio=5 tid=0x2be7048 nid=0x1e81 waiting on monitor [0xd1f81000..0xd1f819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
    at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
    at java.lang.Thread.run(Thread.java:479)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2c04f28 nid=0x1e80 waiting on monitor [0xd2081000..0xd20819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "JmsPublisher.kerneltest.COMPUTE1.1920392681264132352" daemon prio=5 tid=0x2b1ea08 nid=0x1e7f waiting on monitor [0xd2281000..0xd22819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread.runUnauthenticated(WakeUpThread.java:177)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:133)
    "RV Event Dispatch" daemon prio=5 tid=0x2b22668 nid=0x1e7e waiting on monitor [0xd2681000..0xd26819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at COM.TIBCO.rv.RvQ.waitEvent(RvQ.java:79)
    at COM.TIBCO.rv.RvDataDispatch.run(RvDataDispatch.java:36)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x21ffb18 nid=0x1e7d waiting on monitor [0xd3581000..0xd35819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2ac3778 nid=0x1e77 waiting on monitor [0xd2781000..0xd27819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2bec498 nid=0x1e76 waiting on monitor [0xd2c81000..0xd2c819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2200520 nid=0x1e75 waiting on monitor [0xd2e81000..0xd2e819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "JmsPublisher.kerneltest.COMPUTE1.6107795875676143616" daemon prio=5 tid=0xb87518 nid=0x1e74 waiting on monitor [0xd2f81000..0xd2f819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread.runUnauthenticated(WakeUpThread.java:177)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:133)
    "RV Event Dispatch" daemon prio=5 tid=0x2ab9b0 nid=0x1e73 waiting on monitor [0xd3181000..0xd31819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at COM.TIBCO.rv.RvQ.waitEvent(RvQ.java:79)
    at COM.TIBCO.rv.RvDataDispatch.run(RvDataDispatch.java:36)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x55e080 nid=0x1e72 waiting on monitor [0xd3381000..0xd33819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "RMI RenewClean-[192.168.111.54:2306]" daemon prio=5 tid=0x2ad62e0 nid=0x1e70 waiting on monitor [0xd3781000..0xd37819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
    at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
    at java.lang.Thread.run(Thread.java:479)
    "RMI RenewClean-[192.168.111.54:2308]" daemon prio=5 tid=0x2beefe8 nid=0x1e6e waiting on monitor [0xd3a81000..0xd3a819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
    at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
    at java.lang.Thread.run(Thread.java:479)
    "JRiskTimerCallbackThread" daemon prio=6 tid=0x21ae390 nid=0x1e3b waiting for monitor entry [0xd8500000..0xd85019e0]
    at weblogic.jdbc.common.internal.ResourceAllocator.markBorrowed(ResourceAllocator.java:575)
    at weblogic.jdbc.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:674)
    at weblogic.jdbc.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:655)
    at weblogic.jdbc.common.internal.ResourceAllocator.reserveWaitSecs(ResourceAllocator.java:645)
    at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:163)
    at weblogic.jdbc.common.internal.ConnectionPool.reserveWaitSecs(ConnectionPool.java:118)
    at weblogic.jdbc.pool.Driver.connect(Driver.java:193)
    at weblogic.jdbc.jts.Driver.getNonTxConnection(Driver.java:374)
    at weblogic.jdbc.jts.Driver.connect(Driver.java:129)
    at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:265)
    at net.appl.jrisk.ejb.ejbDbConnectionHelper.getConnection(ejbDbConnectionHelper.java:167)
    at net.appl.jrisk.ejb.ejbDbConnectionHelper.getDbConnection(ejbDbConnectionHelper.java:137)
    at net.appl.jrisk.db.dbConnectionFactory.getDbConnection(dbConnectionFactory.java:82)
    at net.appl.jrisk.ejb.tx.RTEventCleaner$RTEventProcessor.checkAndSendEvents(RTEventCleaner.java:261)
    at net.appl.jrisk.ejb.tx.RTEventCleaner$RTEventProcessor.onTimer(RTEventCleaner.java:200)
    at net.appl.jrisk.time.SystemTimerCallbackThread$1.run(Timer.java:389)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:785)
    at weblogic.security.Security.runAs(Security.java:61)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedExceptionAction(WeblogicJRiskSecurityHelper.java:264)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedExceptionAction(DefaultJRiskSecurityHelper.java:271)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedExceptionAction(DefaultJRiskSecurityHelper.java:271)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedExceptionAction(JRiskSecurity.java:230)
    at net.appl.jrisk.time.SystemTimerCallbackThread.run(Timer.java:385)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21a2090 nid=0x1e39 waiting on monitor [0xd2981000..0xd29819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x21a5080 nid=0x1e38 waiting on monitor [0xd2b81000..0xd2b819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0xcaae58 nid=0x1e26 waiting on monitor [0xd3e81000..0xd3e819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21fab90 nid=0x1e1f waiting on monitor [0xd3481000..0xd34819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2ad99a0 nid=0x1e1e waiting on monitor [0xd3981000..0xd39819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2213560 nid=0x1a3b waiting on monitor [0xd4181000..0xd41819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21fece8 nid=0x1a38 waiting on monitor [0xd3f81000..0xd3f819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x22153f8 nid=0x1a37 waiting on monitor [0xd4581000..0xd45819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2ad3bd8 nid=0x1971 waiting on monitor [0xd4a81000..0xd4a819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21eaa50 nid=0x196d waiting on monitor [0xd4681000..0xd46819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21ac888 nid=0x1962 waiting on monitor [0xd2181000..0xd21819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21ac748 nid=0x1960 waiting on monitor [0xd2581000..0xd25819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
    at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
    at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
    at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
    "InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2226bd8 nid=0x195e waiting on monitor [0xd2881000..0xd28819e0]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
    at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
    at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
    at weblogic.security.Security.runAs(Security.java:41)
    at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
    at net.appl.jrisk.security.Defa

  • HELP!!! Why do my thread dump have so many locked monitor

    In recent weeks, My customer's weblogic server become more busy.Each time I downloaded
    the thread dump when CPU is busy than 90%,I found a lot of lock in the thread
    dump! Especially the class named "weblogic.kernel.ExecuteThread" . It's the kernel
    class of weblogic, Why were most of them locked?
    Full thread dump:
    "process forker" daemon prio=1 tid=0x95b4c8e0 nid=0x3084 waiting on monitor [0x977ff000..0x977ff890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53d26420> (a java.lang.Object)
         at java.lang.UNIXProcessForker.run(Native Method)
         at java.lang.Thread.run(Thread.java:479)
    "process reaper" daemon prio=1 tid=0x95376758 nid=0x3083 runnable [0x96eff000..0x96eff890]
         at java.lang.UNIXProcessReaper.run(Native Method)
         at java.lang.Thread.run(Thread.java:479)
    "HighPriority TimeEventGenerator" daemon prio=1 tid=0x825bf18 nid=0x25a1 waiting
    on monitor [0x95dff000..0x95dff890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53a3bd10> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
         - locked <53a3bd10> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
         at java.lang.Thread.run(Thread.java:479)
    "ListenThread" prio=1 tid=0x94d00630 nid=0x25a0 runnable [0x95fff000..0x95fff890]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
         - locked <538fa238> (a java.net.PlainSocketImpl)
         at java.net.ServerSocket.implAccept(ServerSocket.java:238)
         at java.net.ServerSocket.accept(ServerSocket.java:217)
         at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
         at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
    "NBExecuteThread-1" daemon prio=1 tid=0x8c0dd1d0 nid=0x259c waiting on monitor
    [0x94521000..0x94521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a9650> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a9650> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "NBExecuteThread-0" daemon prio=1 tid=0x8c0dc7d0 nid=0x259b waiting on monitor
    [0x94321000..0x94321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a9060> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a9060> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    //"ExecuteThread-49" daemon prio=1 tid=0x8c034660 nid=0x259a runnable [0x94121000..0x94121890]
         at java.net.PlainDatagramSocketImpl.peek(Native Method)
         - locked <537acf60> (a java.net.PlainDatagramSocketImpl)
         at java.net.DatagramSocket.receive(DatagramSocket.java:349)
         - locked <486f9980> (a java.net.DatagramPacket)
         - locked <537acf40> (a java.net.MulticastSocket)
         at weblogic.cluster.TDMSocketIPM.receive(TDMSocketIPM.java:86)
         at weblogic.cluster.TMSocket.execute(TMSocket.java:249)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-48" daemon prio=1 tid=0x8c0c3d18 nid=0x2599 waiting for monitor
    entry [0x93f21000..0x93f21890]
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
         - waiting to lock <538fa5c8> (a java.lang.Object)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-47" daemon prio=1 tid=0x8c0c32d0 nid=0x2598 runnable [0x93d21000..0x93d21890]
         at weblogic.socket.PosixSocketMuxer.poll(Native Method)
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
         - locked <538fa5c8> (a java.lang.Object)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-46" daemon prio=1 tid=0x8c0bf410 nid=0x2597 waiting for monitor
    entry [0x93b21000..0x93b21890]
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
         - waiting to lock <538fa5c8> (a java.lang.Object)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-45" daemon prio=1 tid=0x8c0be9c8 nid=0x2596 waiting on monitor
    [0x93921000..0x93921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a6df8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a6df8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-44" daemon prio=1 tid=0x8c0bdab0 nid=0x2595 waiting on monitor
    [0x93721000..0x93721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a6828> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a6828> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-43" daemon prio=1 tid=0x8c0bd068 nid=0x2594 waiting on monitor
    [0x93521000..0x93521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a6258> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a6258> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-42" daemon prio=1 tid=0x8c0c0ce0 nid=0x2593 waiting on monitor
    [0x93321000..0x93321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a5c88> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a5c88> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-41" daemon prio=1 tid=0x8c0c0298 nid=0x2592 waiting on monitor
    [0x93121000..0x93121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a56b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a56b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-40" daemon prio=1 tid=0x8c0a21e0 nid=0x2591 waiting on monitor
    [0x92f21000..0x92f21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a50e8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a50e8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-39" daemon prio=1 tid=0x8c0d4520 nid=0x2590 waiting on monitor
    [0x92d21000..0x92d21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a4b18> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a4b18> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-38" daemon prio=1 tid=0x8c0d43d0 nid=0x258f waiting on monitor
    [0x92b21000..0x92b21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a4548> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a4548> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-37" daemon prio=1 tid=0x8c0d3988 nid=0x258e waiting on monitor
    [0x92921000..0x92921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a3f78> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a3f78> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-36" daemon prio=1 tid=0x8c0ded20 nid=0x258d waiting on monitor
    [0x92721000..0x92721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a39a8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a39a8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-35" daemon prio=1 tid=0x8c0de2d8 nid=0x258c waiting on monitor
    [0x92521000..0x92521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a33d8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a33d8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-34" daemon prio=1 tid=0x8c0cd528 nid=0x258b waiting on monitor
    [0x92321000..0x92321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a2e08> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a2e08> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-33" daemon prio=1 tid=0x8c0ccae0 nid=0x258a waiting on monitor
    [0x92121000..0x92121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a2838> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a2838> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-32" daemon prio=1 tid=0x8c075360 nid=0x2589 waiting on monitor
    [0x91f21000..0x91f21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a2268> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a2268> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-31" daemon prio=1 tid=0x8c0837d0 nid=0x2588 waiting on monitor
    [0x91d21000..0x91d21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a1c98> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a1c98> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-30" daemon prio=1 tid=0x8c0a5628 nid=0x2587 waiting on monitor
    [0x91b21000..0x91b21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a16c8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a16c8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-29" daemon prio=1 tid=0x8c07aaf8 nid=0x2586 waiting on monitor
    [0x91921000..0x91921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a10f8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a10f8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-28" daemon prio=1 tid=0x8c0c23d0 nid=0x2585 waiting on monitor
    [0x91721000..0x91721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a0b28> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a0b28> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-27" daemon prio=1 tid=0x8c0c1988 nid=0x2584 waiting on monitor
    [0x91521000..0x91521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a0558> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a0558> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-26" daemon prio=1 tid=0x8c07ca00 nid=0x2583 waiting on monitor
    [0x91321000..0x91321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379ff88> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379ff88> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-25" daemon prio=1 tid=0x8c079e70 nid=0x2582 waiting on monitor
    [0x91121000..0x91121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379f9b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379f9b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-24" daemon prio=1 tid=0x8c078038 nid=0x2581 waiting on monitor
    [0x90f21000..0x90f21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379f3e8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379f3e8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-23" daemon prio=1 tid=0x8c0a3298 nid=0x2580 waiting on monitor
    [0x90d21000..0x90d21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379ee18> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379ee18> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-22" daemon prio=1 tid=0x8c0e30d8 nid=0x257f waiting on monitor
    [0x90b21000..0x90b21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379e848> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379e848> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-21" daemon prio=1 tid=0x8c0c5948 nid=0x257e waiting on monitor
    [0x90921000..0x90921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379e278> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379e278> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-20" daemon prio=1 tid=0x8c0d0470 nid=0x257d waiting on monitor
    [0x90721000..0x90721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379dca8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379dca8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-19" daemon prio=1 tid=0x8c080798 nid=0x257c waiting on monitor
    [0x90521000..0x90521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379d6d8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379d6d8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-18" daemon prio=1 tid=0x8c080648 nid=0x257b waiting on monitor
    [0x90321000..0x90321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379d108> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379d108> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-17" daemon prio=1 tid=0x8c032380 nid=0x257a runnable [0x90121000..0x90121890]
         at java.lang.String.concat(String.java:1553)
         at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
         at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
         at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
         at com.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:122)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
         at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
         at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
         at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-16" daemon prio=1 tid=0x8c0df9a8 nid=0x2579 waiting on monitor
    [0x8ff21000..0x8ff21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379c568> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379c568> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-15" daemon prio=1 tid=0x8c0a6288 nid=0x2578 waiting on monitor
    [0x8fd21000..0x8fd21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379bf98> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379bf98> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-14" daemon prio=1 tid=0x8c0dbd60 nid=0x2577 waiting on monitor
    [0x8fb21000..0x8fb21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379b9c8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379b9c8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-13" daemon prio=1 tid=0x8c0c8498 nid=0x2576 waiting on monitor
    [0x8f921000..0x8f921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379b3f8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379b3f8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-12" daemon prio=1 tid=0x8c0a6a28 nid=0x2575 waiting on monitor
    [0x8f721000..0x8f721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379ae28> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379ae28> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-11" daemon prio=1 tid=0x8c07d348 nid=0x2574 runnable [0x8f521000..0x8f521890]
         at java.lang.System.arraycopy(Native Method)
         at java.lang.String.getChars(String.java:557)
         at java.lang.String.concat(String.java:1554)
         at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
         at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
         at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
         at com.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:251)
         at com.ebao.carcase.servlet.claim.ClaimServlet.doGet(ClaimServlet.java:77)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
         at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
         at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
         at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-10" daemon prio=1 tid=0x8c0369b0 nid=0x2571 waiting on monitor
    [0x8f321000..0x8f321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379a288> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379a288> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-9" daemon prio=1 tid=0x8c079898 nid=0x256f waiting on monitor [0x8f121000..0x8f121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53799cb8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53799cb8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-8" daemon prio=1 tid=0x8c035260 nid=0x256e waiting on monitor [0x8ef21000..0x8ef21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537996e8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537996e8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-7" daemon prio=1 tid=0x8c034510 nid=0x256d waiting on monitor [0x8ed21000..0x8ed21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53799118> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53799118> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-6" daemon prio=1 tid=0x8c081130 nid=0x256c waiting on monitor [0x8eb21000..0x8eb21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53798b48> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53798b48> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-5" daemon prio=1 tid=0x8c0c7108 nid=0x256b waiting on monitor [0x8e921000..0x8e921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53798578> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53798578> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-4" daemon prio=1 tid=0x8c0a4388 nid=0x256a waiting on monitor [0x8e721000..0x8e721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53797fa8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53797fa8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-3" daemon prio=1 tid=0x8c0367b8 nid=0x2569 waiting on monitor [0x8e521000..0x8e521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537979d8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537979d8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-2" daemon prio=1 tid=0x8c036290 nid=0x2568 waiting on monitor [0x8e321000..0x8e321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53797408> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53797408> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-1" daemon prio=1 tid=0x8c0a4ee0 nid=0x2567 waiting on monitor [0x8e121000..0x8e121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53796e38> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53796e38> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-0" daemon prio=1 tid=0x8c0a4550 nid=0x2566 runnable [0x8df21000..0x8df21890]
         at java.lang.String.concat(String.java:1553)
         at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
         at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
         at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
         at com.ebao.carcase.servlet.end.EndCaseServlet.service(EndCaseServlet.java:56)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
         at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
         at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
         at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "TimeEventGenerator" daemon prio=1 tid=0x8c076008 nid=0x2565 waiting on monitor
    [0x8dd21000..0x8dd21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53795330> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
         - locked <53795330> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
         at java.lang.Thread.run(Thread.java:479)
    "SpinnerRandomSource" daemon prio=1 tid=0x8c0b34a0 nid=0x2563 waiting on monitor
    [0x8db21000..0x8db21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53793040> (a weblogic.security.SpinnerThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:104)
         - locked <53793040> (a weblogic.security.SpinnerThread)
         at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
    "Signal Dispatcher" daemon prio=1 tid=0x8c0077e8 nid=0x2561 waiting on monitor
    [0..0]
    "Finalizer" daemon prio=1 tid=0x8c000540 nid=0x255e waiting on monitor [0x8c2ff000..0x8c2ff890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
         - locked <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
    "Reference Handler" daemon prio=1 tid=0x80851f0 nid=0x255d waiting on monitor
    [0x8bf8c000..0x8bf8c890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53720208> (a java.lang.ref.Reference$Lock)
         at java.lang.Object.wait(Object.java:415)
         at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:105)
         - locked <53720208> (a java.lang.ref.Reference$Lock)
    "main" prio=1 tid=0x804ead0 nid=0x2543 waiting on monitor [0xbfffc000..0xbfffd00c]
         at java.lang.Object.wait(Native Method)
         - waiting on <53743c20> (a weblogic.t3.srvr.T3Srvr)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1958)
         - locked <53743c20> (a weblogic.t3.srvr.T3Srvr)
         at java.lang.reflect.Method.invoke(Native Method)
         at weblogic.Server.startServerDynamically(Server.java:148)
         at weblogic.Server.main(Server.java:97)
         at weblogic.Server.main(Server.java:58)
    "VM Thread" prio=1 tid=0x8082110 nid=0x255c runnable
    "VM Periodic Task Thread" prio=1 tid=0x8c0064f8 nid=0x255f waiting on monitor
    "Suspend Checker Thread" prio=1 tid=0x8c006e30 nid=0x2560 runnable

    These are execute threads waiting for requests to come in.
    BTW, you probably want to look into using StringBuffer instead of
    strings concatenation in com.ebao.carcase.bean.query.Query.generatorXML.
    "min.lu" <[email protected]> wrote in message
    news:[email protected]...
    >
    In recent weeks, My customer's weblogic server become more busy.Each timeI downloaded
    the thread dump when CPU is busy than 90%,I found a lot of lock in thethread
    dump! Especially the class named "weblogic.kernel.ExecuteThread" . It'sthe kernel
    class of weblogic, Why were most of them locked?
    Full thread dump:
    "process forker" daemon prio=1 tid=0x95b4c8e0 nid=0x3084 waiting onmonitor [0x977ff000..0x977ff890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53d26420> (a java.lang.Object)
    at java.lang.UNIXProcessForker.run(Native Method)
    at java.lang.Thread.run(Thread.java:479)
    "process reaper" daemon prio=1 tid=0x95376758 nid=0x3083 runnable[0x96eff000..0x96eff890]
    at java.lang.UNIXProcessReaper.run(Native Method)
    at java.lang.Thread.run(Thread.java:479)
    "HighPriority TimeEventGenerator" daemon prio=1 tid=0x825bf18 nid=0x25a1waiting
    on monitor [0x95dff000..0x95dff890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53a3bd10> (a weblogic.time.common.internal.TimeTable)
    at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
    - locked <53a3bd10> (a weblogic.time.common.internal.TimeTable)
    atweblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
    :141)
    at java.lang.Thread.run(Thread.java:479)
    "ListenThread" prio=1 tid=0x94d00630 nid=0x25a0 runnable[0x95fff000..0x95fff890]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
    - locked <538fa238> (a java.net.PlainSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:238)
    at java.net.ServerSocket.accept(ServerSocket.java:217)
    atweblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
    at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
    "NBExecuteThread-1" daemon prio=1 tid=0x8c0dd1d0 nid=0x259c waiting onmonitor
    [0x94521000..0x94521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a9650> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a9650> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "NBExecuteThread-0" daemon prio=1 tid=0x8c0dc7d0 nid=0x259b waiting onmonitor
    [0x94321000..0x94321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a9060> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a9060> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    //"ExecuteThread-49" daemon prio=1 tid=0x8c034660 nid=0x259a runnable[0x94121000..0x94121890]
    at java.net.PlainDatagramSocketImpl.peek(Native Method)
    - locked <537acf60> (a java.net.PlainDatagramSocketImpl)
    at java.net.DatagramSocket.receive(DatagramSocket.java:349)
    - locked <486f9980> (a java.net.DatagramPacket)
    - locked <537acf40> (a java.net.MulticastSocket)
    at weblogic.cluster.TDMSocketIPM.receive(TDMSocketIPM.java:86)
    at weblogic.cluster.TMSocket.execute(TMSocket.java:249)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-48" daemon prio=1 tid=0x8c0c3d18 nid=0x2599 waiting formonitor
    entry [0x93f21000..0x93f21890]
    atweblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
    - waiting to lock <538fa5c8> (a java.lang.Object)
    atweblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-47" daemon prio=1 tid=0x8c0c32d0 nid=0x2598 runnable[0x93d21000..0x93d21890]
    at weblogic.socket.PosixSocketMuxer.poll(Native Method)
    atweblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
    - locked <538fa5c8> (a java.lang.Object)
    atweblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-46" daemon prio=1 tid=0x8c0bf410 nid=0x2597 waiting formonitor
    entry [0x93b21000..0x93b21890]
    atweblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
    - waiting to lock <538fa5c8> (a java.lang.Object)
    atweblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-45" daemon prio=1 tid=0x8c0be9c8 nid=0x2596 waiting onmonitor
    [0x93921000..0x93921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a6df8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a6df8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-44" daemon prio=1 tid=0x8c0bdab0 nid=0x2595 waiting onmonitor
    [0x93721000..0x93721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a6828> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a6828> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-43" daemon prio=1 tid=0x8c0bd068 nid=0x2594 waiting onmonitor
    [0x93521000..0x93521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a6258> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a6258> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-42" daemon prio=1 tid=0x8c0c0ce0 nid=0x2593 waiting onmonitor
    [0x93321000..0x93321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a5c88> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a5c88> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-41" daemon prio=1 tid=0x8c0c0298 nid=0x2592 waiting onmonitor
    [0x93121000..0x93121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a56b8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a56b8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-40" daemon prio=1 tid=0x8c0a21e0 nid=0x2591 waiting onmonitor
    [0x92f21000..0x92f21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a50e8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a50e8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-39" daemon prio=1 tid=0x8c0d4520 nid=0x2590 waiting onmonitor
    [0x92d21000..0x92d21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a4b18> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a4b18> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-38" daemon prio=1 tid=0x8c0d43d0 nid=0x258f waiting onmonitor
    [0x92b21000..0x92b21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a4548> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a4548> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-37" daemon prio=1 tid=0x8c0d3988 nid=0x258e waiting onmonitor
    [0x92921000..0x92921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a3f78> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a3f78> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-36" daemon prio=1 tid=0x8c0ded20 nid=0x258d waiting onmonitor
    [0x92721000..0x92721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a39a8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a39a8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-35" daemon prio=1 tid=0x8c0de2d8 nid=0x258c waiting onmonitor
    [0x92521000..0x92521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a33d8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a33d8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-34" daemon prio=1 tid=0x8c0cd528 nid=0x258b waiting onmonitor
    [0x92321000..0x92321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a2e08> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a2e08> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-33" daemon prio=1 tid=0x8c0ccae0 nid=0x258a waiting onmonitor
    [0x92121000..0x92121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a2838> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a2838> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-32" daemon prio=1 tid=0x8c075360 nid=0x2589 waiting onmonitor
    [0x91f21000..0x91f21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a2268> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a2268> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-31" daemon prio=1 tid=0x8c0837d0 nid=0x2588 waiting onmonitor
    [0x91d21000..0x91d21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a1c98> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a1c98> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-30" daemon prio=1 tid=0x8c0a5628 nid=0x2587 waiting onmonitor
    [0x91b21000..0x91b21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a16c8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a16c8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-29" daemon prio=1 tid=0x8c07aaf8 nid=0x2586 waiting onmonitor
    [0x91921000..0x91921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a10f8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a10f8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-28" daemon prio=1 tid=0x8c0c23d0 nid=0x2585 waiting onmonitor
    [0x91721000..0x91721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a0b28> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a0b28> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-27" daemon prio=1 tid=0x8c0c1988 nid=0x2584 waiting onmonitor
    [0x91521000..0x91521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a0558> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a0558> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-26" daemon prio=1 tid=0x8c07ca00 nid=0x2583 waiting onmonitor
    [0x91321000..0x91321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379ff88> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379ff88> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-25" daemon prio=1 tid=0x8c079e70 nid=0x2582 waiting onmonitor
    [0x91121000..0x91121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379f9b8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379f9b8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-24" daemon prio=1 tid=0x8c078038 nid=0x2581 waiting onmonitor
    [0x90f21000..0x90f21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379f3e8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379f3e8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-23" daemon prio=1 tid=0x8c0a3298 nid=0x2580 waiting onmonitor
    [0x90d21000..0x90d21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379ee18> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379ee18> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-22" daemon prio=1 tid=0x8c0e30d8 nid=0x257f waiting onmonitor
    [0x90b21000..0x90b21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379e848> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379e848> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-21" daemon prio=1 tid=0x8c0c5948 nid=0x257e waiting onmonitor
    [0x90921000..0x90921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379e278> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379e278> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-20" daemon prio=1 tid=0x8c0d0470 nid=0x257d waiting onmonitor
    [0x90721000..0x90721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379dca8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379dca8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-19" daemon prio=1 tid=0x8c080798 nid=0x257c waiting onmonitor
    [0x90521000..0x90521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379d6d8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379d6d8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-18" daemon prio=1 tid=0x8c080648 nid=0x257b waiting onmonitor
    [0x90321000..0x90321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379d108> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379d108> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-17" daemon prio=1 tid=0x8c032380 nid=0x257a runnable[0x90121000..0x90121890]
    at java.lang.String.concat(String.java:1553)
    at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
    at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
    at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
    atcom.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:122)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:945)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:909)
    atweblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContext
    Manager.java:269)
    atweblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
    at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-16" daemon prio=1 tid=0x8c0df9a8 nid=0x2579 waiting onmonitor
    [0x8ff21000..0x8ff21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379c568> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379c568> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-15" daemon prio=1 tid=0x8c0a6288 nid=0x2578 waiting onmonitor
    [0x8fd21000..0x8fd21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379bf98> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379bf98> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-14" daemon prio=1 tid=0x8c0dbd60 nid=0x2577 waiting onmonitor
    [0x8fb21000..0x8fb21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379b9c8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379b9c8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-13" daemon prio=1 tid=0x8c0c8498 nid=0x2576 waiting onmonitor
    [0x8f921000..0x8f921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379b3f8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379b3f8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-12" daemon prio=1 tid=0x8c0a6a28 nid=0x2575 waiting onmonitor
    [0x8f721000..0x8f721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379ae28> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379ae28> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-11" daemon prio=1 tid=0x8c07d348 nid=0x2574 runnable[0x8f521000..0x8f521890]
    at java.lang.System.arraycopy(Native Method)
    at java.lang.String.getChars(String.java:557)
    at java.lang.String.concat(String.java:1554)
    at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
    at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
    at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
    atcom.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:251)
    at com.ebao.carcase.servlet.claim.ClaimServlet.doGet(ClaimServlet.java:77)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:945)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:909)
    atweblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContext
    Manager.java:269)
    atweblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
    at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-10" daemon prio=1 tid=0x8c0369b0 nid=0x2571 waiting onmonitor
    [0x8f321000..0x8f321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379a288> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379a288> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-9" daemon prio=1 tid=0x8c079898 nid=0x256f waiting onmonitor [0x8f121000..0x8f121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53799cb8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53799cb8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-8" daemon prio=1 tid=0x8c035260 nid=0x256e waiting onmonitor [0x8ef21000..0x8ef21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537996e8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537996e8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-7" daemon prio=1 tid=0x8c034510 nid=0x256d waiting onmonitor [0x8ed21000..0x8ed21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53799118> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53799118> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-6" daemon prio=1 tid=0x8c081130 nid=0x256c waiting onmonitor [0x8eb21000..0x8eb21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53798b48> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53798b48> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-5" daemon prio=1 tid=0x8c0c7108 nid=0x256b waiting onmonitor [0x8e921000..0x8e921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53798578> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53798578> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-4" daemon prio=1 tid=0x8c0a4388 nid=0x256a waiting onmonitor [0x8e721000..0x8e721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53797fa8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53797fa8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-3" daemon prio=1 tid=0x8c0367b8 nid=0x2569 waiting onmonitor [0x8e521000..0x8e521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537979d8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537979d8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-2" daemon prio=1 tid=0x8c036290 nid=0x2568 waiting onmonitor [0x8e321000..0x8e321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53797408> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53797408> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-1" daemon prio=1 tid=0x8c0a4ee0 nid=0x2567 waiting onmonitor [0x8e121000..0x8e121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53796e38> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53796e38> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-0" daemon prio=1 tid=0x8c0a4550 nid=0x2566 runnable[0x8df21000..0x8df21890]
    at java.lang.String.concat(String.java:1553)
    at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
    at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
    at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
    atcom.ebao.carcase.servlet.end.EndCaseServlet.service(EndCaseServlet.java:56)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:945)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:909)
    atweblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContext
    Manager.java:269)
    atweblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
    at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "TimeEventGenerator" daemon prio=1 tid=0x8c076008 nid=0x2565 waiting onmonitor
    [0x8dd21000..0x8dd21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53795330> (a weblogic.time.common.internal.TimeTable)
    at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
    - locked <53795330> (a weblogic.time.common.internal.TimeTable)
    atweblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
    :141)
    at java.lang.Thread.run(Thread.java:479)
    "SpinnerRandomSource" daemon prio=1 tid=0x8c0b34a0 nid=0x2563 waiting onmonitor
    [0x8db21000..0x8db21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53793040> (a weblogic.security.SpinnerThread)
    at java.lang.Object.wait(Object.java:415)
    atweblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:10
    4)
    - locked <53793040> (a weblogic.security.SpinnerThread)
    at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
    "Signal Dispatcher" daemon prio=1 tid=0x8c0077e8 nid=0x2561 waiting onmonitor
    [0..0]
    "Finalizer" daemon prio=1 tid=0x8c000540 nid=0x255e waiting on monitor[0x8c2ff000..0x8c2ff890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
    - locked <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
    "Reference Handler" daemon prio=1 tid=0x80851f0 nid=0x255d waiting onmonitor
    [0x8bf8c000..0x8bf8c890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53720208> (a java.l

  • Large Memory Usage and Frozen [thread dump attached]

    Hi,
    SQL Developer (Version 2.1.1.64, WinXP Pro, Java 1.6, Oracle 10g R2) always uses at least 550MB of memory, if left open, for more than a day, it invariably goes up to 700-800MB.
    If I close all windows and connections, virtually no memory is reclaimed.
    I clicked + beside a view to see the columns, sqldeveloper froze for a few minutes, below is the thread dump.
    2010-05-21 11:31:58
    Full thread dump Java HotSpot(TM) Client VM (14.2-b01 mixed mode):
    "CONNECTION_ALIVE" prio=6 tid=0x3891c000 nid=0x1d58 waiting for monitor entry [0x3a55f000]
    java.lang.Thread.State: BLOCKED (on object monitor)
    at oracle.jdbc.driver.T4CConnection.doPingDatabase(T4CConnection.java:3398)
    - waiting to lock <0x09ad05f8> (a oracle.jdbc.driver.T4CConnection)
    at oracle.jdbc.driver.PhysicalConnection.pingDatabase(PhysicalConnection.java:7074)
    at oracle.javatools.db.ora.BaseOracleDatabase.isConnectionAlive(BaseOracleDatabase.java:165)
    at oracle.javatools.db.AbstractDatabase$1.run(AbstractDatabase.java:316)
    at java.lang.Thread.run(Thread.java:619)
    "Loading Children" prio=6 tid=0x3891bc00 nid=0x12c4 waiting on condition [0x39d5f000]
    java.lang.Thread.State: WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x03eab570> (a java.util.concurrent.FutureTask$Sync)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
    at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:218)
    at java.util.concurrent.FutureTask.get(FutureTask.java:83)
    at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$IdeTaskTracker.run(RaptorTaskManager.java:532)
    at java.lang.Thread.run(Thread.java:619)
    "pool-2-thread-57" prio=6 tid=0x3891b400 nid=0x2094 waiting on condition [0x35b5f000]
    java.lang.Thread.State: TIMED_WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x09b819f0> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
    at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:841)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1160)
    at java.util.concurrent.locks.ReentrantLock.tryLock(ReentrantLock.java:416)
    at oracle.dbtools.raptor.utils.Connections.lock(Connections.java:1334)
    at oracle.dbtools.raptor.utils.Connections.lock(Connections.java:1319)
    at oracle.dbtools.raptor.utils.Connections.lock(Connections.java:1306)
    at oracle.dbtools.raptor.navigator.xml.AbstractItemInstance.lockConnection(AbstractItemInstance.java:52)
    at oracle.dbtools.raptor.navigator.xml.XmlNodeInstance.listChildren(XmlNodeInstance.java:55)
    at oracle.dbtools.raptor.navigator.ObjectNodeFilter$ObjectNodeFilterLoadTask.doWorkImpl(ObjectNodeFilter.java:78)
    at oracle.dbtools.raptor.navigator.DeferredLoadingFilter$FilterLoadTask.doWork(DeferredLoadingFilter.java:124)
    at oracle.dbtools.raptor.navigator.DeferredLoadingFilter$FilterLoadTask.doWork(DeferredLoadingFilter.java:113)
    at oracle.dbtools.raptor.backgroundTask.RaptorTask.call(RaptorTask.java:193)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$RaptorFutureTask.run(RaptorTaskManager.java:492)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:619)
    "pool-2-thread-55" prio=6 tid=0x38d68400 nid=0xd74 runnable [0x3a15f000]
    java.lang.Thread.State: RUNNABLE
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at oracle.net.ns.Packet.receive(Packet.java:239)
    at oracle.net.ns.DataPacket.receive(DataPacket.java:92)
    at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:172)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:117)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:92)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:77)
    at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1023)
    at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:999)
    at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:584)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:194)
    at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:785)
    at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:860)
    at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1186)
    at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3381)
    at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3425)
    - locked <0x09ad05f8> (a oracle.jdbc.driver.T4CConnection)
    at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1490)
    at oracle.dbtools.raptor.controls.grid.ResultSetTableModel.openResultSet(ResultSetTableModel.java:412)
    at oracle.dbtools.raptor.controls.grid.ResultSetTableModel.fetchNext(ResultSetTableModel.java:169)
    at oracle.dbtools.raptor.controls.grid.ResultSetTableModel$4.doWork(ResultSetTableModel.java:556)
    at oracle.dbtools.raptor.controls.grid.ResultSetTableModel$4.doWork(ResultSetTableModel.java:540)
    at oracle.dbtools.raptor.backgroundTask.RaptorTask.call(RaptorTask.java:193)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$RaptorFutureTask.run(RaptorTaskManager.java:492)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:619)
    "AWT-EventQueue-0" prio=6 tid=0x354fac00 nid=0x18d4 waiting for monitor entry [0x3a45f000]
    java.lang.Thread.State: BLOCKED (on object monitor)
    at oracle.jdbc.driver.PhysicalConnection.getMetaData(PhysicalConnection.java:3891)
    - waiting to lock <0x09ad05f8> (a oracle.jdbc.driver.T4CConnection)
    at oracle.dbtools.raptor.plscope.Query.getToolTipText(Query.java:58)
    at oracle.dbtools.raptor.phighlight.TooltipPlugin$1.getToolTipText(TooltipPlugin.java:29)
    at oracle.ide.ceditor.CodeEditor.getToolTipText(CodeEditor.java:1734)
    - locked <0x17245f98> (a java.util.ArrayList)
    at oracle.javatools.editor.BasicEditorPane.getToolTipText(BasicEditorPane.java:1530)
    at javax.swing.ToolTipManager$insideTimerAction.actionPerformed(ToolTipManager.java:658)
    at javax.swing.Timer.fireActionPerformed(Timer.java:271)
    at javax.swing.Timer$DoPostEvent.run(Timer.java:201)
    at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:209)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:597)
    at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:269)
    at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:184)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:174)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:169)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:161)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)
    "Background Parser" prio=6 tid=0x38a43400 nid=0x23c4 waiting on condition [0x39c5f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "SwingWorker-pool-5-thread-1142" prio=6 tid=0x38868800 nid=0x1a7c waiting on condition [0x3820f000]
    java.lang.Thread.State: WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x0e77bc10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)
    "Background Parser" prio=6 tid=0x38a76c00 nid=0x1d18 waiting on condition [0x3a35f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "Background Parser" prio=6 tid=0x387e2800 nid=0xd00 waiting on condition [0x3a25f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "Background Parser" prio=6 tid=0x38752000 nid=0x2794 waiting on condition [0x39e5f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "Swing-Shell" daemon prio=6 tid=0x367f0000 nid=0xd7c waiting on condition [0x3a85f000]
    java.lang.Thread.State: WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x1069d0d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at sun.awt.shell.Win32ShellFolderManager2$ComInvoker$3.run(Win32ShellFolderManager2.java:458)
    at java.lang.Thread.run(Thread.java:619)
    "Persistence Auto Flusher" daemon prio=6 tid=0x388a5c00 nid=0x1950 in Object.wait() [0x37e0f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
    - locked <0x0e892d48> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "Thread-76" prio=6 tid=0x387aec00 nid=0x259c runnable [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "WeakDataReference polling" prio=2 tid=0x38752800 nid=0xe94 in Object.wait() [0x3a05f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    - locked <0x0b6ba260> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at oracle.ide.util.WeakDataReference$Cleaner.run(WeakDataReference.java:88)
    at java.lang.Thread.run(Thread.java:619)
    "Image Animator 3" daemon prio=4 tid=0x3861b400 nid=0x2330 waiting on condition [0x3978f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at sun.awt.image.GifFrame.dispose(GifImageDecoder.java:653)
    at sun.awt.image.GifImageDecoder.produceImage(GifImageDecoder.java:230)
    at sun.awt.image.InputStreamImageSource.doFetch(InputStreamImageSource.java:246)
    at sun.awt.image.ImageFetcher.fetchloop(ImageFetcher.java:172)
    at sun.awt.image.ImageFetcher.run(ImageFetcher.java:136)
    "Background Parser" prio=6 tid=0x38348800 nid=0x978 waiting on condition [0x3988f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "TextBufferScavenger" prio=6 tid=0x38324800 nid=0x1af0 in Object.wait() [0x3968f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    - locked <0x09bb9158> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at oracle.ide.model.TextNode$FacadeBufferReference$PollingThread.run(TextNode.java:1949)
    "pool-4-thread-1" prio=6 tid=0x36960400 nid=0x1a84 waiting on condition [0x35a5f000]
    java.lang.Thread.State: TIMED_WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x08150a78> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
    at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
    at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
    at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)
    "IconOverlayTracker Timer" prio=6 tid=0x38520c00 nid=0x1b48 in Object.wait() [0x3950f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
    - locked <0x0795f290> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "Timer queue for AWT thread" daemon prio=6 tid=0x369b4000 nid=0x1f20 in Object.wait() [0x3940f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    - waiting on <0x077e1358> (a java.lang.Object)
    at java.lang.Object.wait(Object.java:485)
    at ice.util.awt.TimedAWTExecutor.nextElem(TimedAWTExecutor.java:108)
    - locked <0x077e1358> (a java.lang.Object)
    at ice.util.awt.TimedAWTExecutor.runScheduler(TimedAWTExecutor.java:130)
    at ice.util.awt.TimedAWTExecutor$1.run(TimedAWTExecutor.java:19)
    "WaitCursor-Timer" prio=6 tid=0x367c3c00 nid=0x1010 in Object.wait() [0x37b0f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
    - locked <0x077e1400> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "Native Directory Watcher" prio=2 tid=0x368d4000 nid=0x2334 runnable [0x3830f000]
    java.lang.Thread.State: RUNNABLE
    at oracle.ide.natives.NativeHandler.enterWatcherThread(Native Method)
    at oracle.ide.natives.NativeHandler$2.run(NativeHandler.java:252)
    at java.lang.Thread.run(Thread.java:619)
    "BaseTreeExplorer.NodeOpeningExecutor" prio=6 tid=0x3684b000 nid=0x8b0 waiting on condition [0x3810f000]
    java.lang.Thread.State: WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x06950af0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)
    "Scheduler" daemon prio=6 tid=0x36846400 nid=0x14bc in Object.wait() [0x37f0f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at oracle.dbtools.raptor.backgroundTask.TaskLinkedList.takeNextTask(TaskLinkedList.java:47)
    - locked <0x06950c70> (a oracle.dbtools.raptor.backgroundTask.TaskLinkedList)
    at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$SchedulerThread.run(RaptorTaskManager.java:422)
    "TimerQueue" daemon prio=6 tid=0x36832800 nid=0x88c in Object.wait() [0x37d0f000]
    java.lang.Thread.State: TIMED_WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at javax.swing.TimerQueue.postExpiredTimers(TimerQueue.java:218)
    - locked <0x06950da8> (a javax.swing.TimerQueue)
    at javax.swing.TimerQueue.run(TimerQueue.java:234)
    - locked <0x06950da8> (a javax.swing.TimerQueue)
    at java.lang.Thread.run(Thread.java:619)
    "ChangeSetService" prio=2 tid=0x367fd400 nid=0x2754 in Object.wait() [0x37c0f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    - waiting on <0x06892cc0> (a oracle.jdevimpl.vcs.changeset.ChangeSetService)
    at java.lang.Object.wait(Object.java:485)
    at oracle.jdevimpl.vcs.changeset.ChangeSetService.awaitEvents(ChangeSetService.java:178)
    - locked <0x06892cc0> (a oracle.jdevimpl.vcs.changeset.ChangeSetService)
    at oracle.jdevimpl.vcs.changeset.ChangeSetService.eventLoop(ChangeSetService.java:199)
    at oracle.jdevimpl.vcs.changeset.ChangeSetService.access$200(ChangeSetService.java:56)
    at oracle.jdevimpl.vcs.changeset.ChangeSetService$2.run(ChangeSetService.java:138)
    at java.lang.Thread.run(Thread.java:619)
    "TimedCache-Timer" daemon prio=6 tid=0x35d52c00 nid=0x2448 in Object.wait() [0x3624f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
    - locked <0x062ab118> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "JarIndex Timer" daemon prio=6 tid=0x35556400 nid=0x2488 in Object.wait() [0x35d4f000]
    java.lang.Thread.State: TIMED_WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.util.TimerThread.mainLoop(Timer.java:509)
    - locked <0x062206e0> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "AWT-Windows" daemon prio=6 tid=0x354dd000 nid=0x1d0c runnable [0x3595f000]
    java.lang.Thread.State: RUNNABLE
    at sun.awt.windows.WToolkit.eventLoop(Native Method)
    at sun.awt.windows.WToolkit.run(WToolkit.java:291)
    at java.lang.Thread.run(Thread.java:619)
    "AWT-Shutdown" prio=6 tid=0x354a1800 nid=0x268c in Object.wait() [0x3585f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at sun.awt.AWTAutoShutdown.run(AWTAutoShutdown.java:259)
    - locked <0x062208d8> (a java.lang.Object)
    at java.lang.Thread.run(Thread.java:619)
    "Java2D Disposer" daemon prio=10 tid=0x354b7400 nid=0x5f4 in Object.wait() [0x3575f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    - locked <0x06220968> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at sun.java2d.Disposer.run(Disposer.java:125)
    at java.lang.Thread.run(Thread.java:619)
    "Low Memory Detector" daemon prio=6 tid=0x00ee1000 nid=0x2664 runnable [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "CompilerThread0" daemon prio=10 tid=0x00edc000 nid=0x1f6c waiting on condition [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "Attach Listener" daemon prio=10 tid=0x00eda800 nid=0x206c runnable [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "Signal Dispatcher" daemon prio=10 tid=0x00ed9400 nid=0xf64 waiting on condition [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "Finalizer" daemon prio=8 tid=0x00ec6c00 nid=0x2348 in Object.wait() [0x34e7f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    - locked <0x061b0298> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
    "Reference Handler" daemon prio=10 tid=0x00ec5800 nid=0x2484 in Object.wait() [0x34d7f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
    - locked <0x061b0320> (a java.lang.ref.Reference$Lock)
    "main" prio=6 tid=0x009f8000 nid=0x19e0 waiting on condition [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "VM Thread" prio=10 tid=0x00ec1800 nid=0x22e0 runnable
    "VM Periodic Task Thread" prio=10 tid=0x00eec000 nid=0x2604 waiting on condition
    JNI global references: 5312
    Heap
    def new generation total 45376K, used 28499K [0x03080000, 0x061b0000, 0x061b0000)
    eden space 40384K, 67% used [0x03080000, 0x04af44c0, 0x057f0000)
    from space 4992K, 28% used [0x05cd0000, 0x05e30850, 0x061b0000)
    to space 4992K, 0% used [0x057f0000, 0x057f0000, 0x05cd0000)
    tenured generation total 604992K, used 364537K [0x061b0000, 0x2b080000, 0x2b080000)
    the space 604992K, 60% used [0x061b0000, 0x1c5ae548, 0x1c5ae600, 0x2b080000)
    compacting perm gen total 57344K, used 57260K [0x2b080000, 0x2e880000, 0x33080000)
    the space 57344K, 99% used [0x2b080000, 0x2e86b348, 0x2e86b400, 0x2e880000)
    No shared spaces configured.
    Edited by: mdaly on May 21, 2010 11:42 AM

    The cause of hang could be figured out from the thread dump.
    I have fixed that in development code. It was happening from PL/SQL editor trying to create tooltip which locked up the connection.
    I am not sure what would lead to memory bloat even if the tool is not in use. There could be memory leak from some component. I am investigating that.
    Suggest you to keep ObjectViewers, reports & PL/SQL editor closed when not in use.
    Have Sql Array Fetch Size preference to 50 if it's higher.
    Do not have auto-refresh for Report editor.
    Keep Sql History, Find Db Object, Snippets collapsed.
    See if that helps.
    -Raghu

  • Dead Lock what made by another user!(patition table)

    I have a question about Dead-Lock!
    Our Situation is ..
    User "A" made a Patition Table, ACNT_WONJANG
    (without any Trigger,Function, Procedure)
    When "B" - another user - tried to drop its Partition,
    Dead-Lock invoked.
    but A droped it's Partition well.
    What can i Do?
    this is the trace file.
    /oracle/home/admin/ACNT/udump/ora_44478_acnt.trc
    Oracle8i Enterprise Edition Release 8.1.7.0.0 - Production
    With the Partitioning option
    JServer Release 8.1.7.0.0 - Production
    ORACLE_HOME = /oracle/home
    System name: AIX
    Node name: acnt
    Release: 3
    Version: 4
    Machine: 000C962D4C00
    Instance name: ACNT
    Redo thread mounted by this instance: 1
    Oracle process number: 15
    Unix process pid: 44478, image: oracle@acnt (TNS V1-V3)
    *** SESSION ID:(16.394) 2001-10-04 15:00:41.829
    A self-deadlock among DDL and parse locks
    is detected. In most cases, this self-deadlock
    is handled internally.
    This should be reported to Oracle Support
    ONLY IF an error is signalled back to the
    user on a command-line or screen.
    The following information may aid in finding
    user on a command-line or screen.
    The following information may aid in finding
    the problem.
    ORA-04020: deadlock detected while trying to lock object
    F03P.ACNT_WONJANG
    session: 440786b4 request: X
    LIBRARY OBJECT HANDLE: handle=43108348
    name=F03P.ACNT_WONJANG
    hash=76b93583 timestamp=NULL
    namespace=TABL/PRCD/TYPE flags=KGHP/TIM/SML/[02000000]
    kkkk-dddd-llll=0000-0001-0001 lock=S pin=S latch=0
    lwt=43108360[43108360,43108360] ltm=43108368[43108368,43108368]
    pwt=43108378[43108378,43108378] ptm=431083d0[431083d0,431083d0]
    ref=43108350[43108350,43108350] lnd=431083dc[4310824c,425b7ec4]
    LIBRARY OBJECT: object=431080d0
    flags=NEX[0002] pflags= [00] status=VALD load=0
    DATA BLOCKS:
    data# heap pointer status pins change
    0 431082d8 43108154 I/P/A 0 NONE
    HEAP DUMP OF DATA BLOCK 0:
    HEAP DUMP heap name="library cache" desc=0x431082d8
    HEAP DUMP heap name="library cache" desc=0x431082d8
    extent sz=0x224 alt=32767 het=8 rec=9 flg=2 opc=0
    parent=30000030 owner=431080d0 nex=0 xsz=0x0
    EXTENT 0
    Chunk 431080c0 sz= 196 perm "perm "
    alo=196
    431080C0 500000C5 00000000 00000000 000000C4 [P...............]
    431080D0 43108348 431080D4 431080D4 431080DC [C..HC...C...C...]
    431080E0 431080DC 00000000 00000000 00020100 [C...............]
    431080F0 00000000 00000000 00000000 00000000 [................]
    43108100 43108144 00000000 00000000 00000000 [C..D............]
    43108110 00000000 00000000 00000000 00000000 [................]
    Repeat 2 times
    43108140 00000000 431082D8 00000000 43108154 [....C.......C..T]
    43108150 00000000 00000000 00000000 00000000 [................]
    Repeat 1 times
    43108170 00000000 00000000 00000019 00000000 [................]
    43108180 00000000 [....]
    Total heap size = 196
    FREE LISTS:
    Bucket 0 size=0
    Total free space = 0
    UNPINNED RECREATABLE CHUNKS (lru first):
    Total free space = 0
    UNPINNED RECREATABLE CHUNKS (lru first):
    PERMANENT CHUNKS:
    Chunk 431080c0 sz= 196 perm "perm "
    alo=196
    Permanent space = 196

    carlyfromal wrote:
    Here's the thing I myself have an Ipad 3 that I got from Ebay that is activation locked and I have the same issue. Can't get the info. Well,since Apple conveniently decided to discontinue selling the Ipad 3 the only way I could get one was to buy a used one,so it looks to me like they could have some mercy and help a person unlock the thing. We're not dishonest people that go around stealing things,yet because of Apple's brilliant(I use that term sarcastically) idea to put this stupid new crap in place people like us who have to buy second-hand products have to suffer and get screwed out of money we had to save up to buy this stuff! And all anyone can come up with is "well boohoo" or "tough luck" or whatever! But,what about the rights of the rest of us?! Some of you may find this a tad rude, but oh well,tough luck!
    On the other hand, there are those of us that appreciate the theft protection provided by the latest IOS.
    There are certain things to watch out for when purchasing used devices of any sort, the first of which is to ensure that you're not buying stolen property.  Since you are unable to obtain cooperation from the seller, perhaps your device was stolen!

  • Restore using TSPITR Results  Dead lock error

    This is the step is followed but i am getting deadlock error .please give your valuable suggestion .
    Product Used:oracle 11g in linux environmnet
    1)Before taking backup get SCN number for restore.
    Command applied: Select current_scn from v$database;
    2)running Full backup of database
    Command applied:
    configure controlfile autobackup on;
    backup database;
    CROSSCHECK BACKUP;
    exit;
    3)Running level 0 incremental backup
    Command applied:
    BACKUP AS COMPRESSED BACKUPSET INCREMENTAL LEVEL 0 TAG ='WEEKLY' TABLESPACE TEST;
    exit;
    3) Running level 1 incremental backup
    Command applied:
    BACKUP AS COMPRESSED BACKUPSET INCREMENTAL LEVEL 1 TAG ='DAILY' TABLESPACE TEST;
    4)Before Restore(TSPITR) following procedure are applied under sysdba privilege
    Command applied:
    SQL 'exec dbms_backup_restore.manageauxinstance ('TSPITR',1)';
    5)TSPITR Restore command
    Command applied:
    run
    SQL 'ALTER TABLESPACE TEST OFFLINE'
    RECOVER TABLESPACE TEST UNTIL SCN 1791053 AUXILIARY DESTINATION '/opt/oracle/base/flash_recovery_area';
    SQL 'ALTER TABLESPACE TEST ONLINE';
    and i tried with this option also(the same error i was getting)
    Command applied:
    run
    SQL 'ALTER TABLESPACE TEST OFFLINE';
    SET UNTIL SCN 1912813;
    RESTORE TABLESPACE TEST ;
    RECOVER TABLESPACE TEST UNTIL SCN 1912813 AUXILIARY DESTINATION '/opt/oracle/base/flash_recovery_area';
    SQL 'ALTER TABLESPACE TEST ONLINE';
    The follwing error i get for above mentioned restore command
    Recovery Manager: Release 11.2.0.1.0 - Production on Tue Aug 17 18:11:18 2010
    Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
    connected to target database: NEW10 (DBID=2860680927)
    RMAN> run
    2> {
    3> SQL 'ALTER TABLESPACE TEST OFFLINE';
    4> RECOVER TABLESPACE TEST UNTIL SCN 1791053 AUXILIARY DESTINATION '/opt/oracle/base/flash_recovery_area';
    5> SQL 'ALTER TABLESPACE TEST ONLINE';
    6> }
    7>
    using target database control file instead of recovery catalog
    sql statement: ALTER TABLESPACE TEST OFFLINE
    Starting recover at 17-AUG-10
    allocated channel: ORA_DISK_1
    channel ORA_DISK_1: SID=404 device type=DISK
    RMAN-05026: WARNING: presuming following set of tablespaces applies to specified point-in-time
    List of tablespaces expected to have UNDO segments
    Tablespace SYSTEM
    Tablespace UNDOTBS1
    Creating automatic instance, with SID='BkAq'
    initialization parameters used for automatic instance:
    db_name=NEW10
    db_unique_name=BkAq_tspitr_NEW10
    compatible=11.2.0.0.0
    db_block_size=8192
    db_files=200
    sga_target=280M
    processes=50
    db_create_file_dest=/opt/oracle/base/flash_recovery_area
    log_archive_dest_1='location=/opt/oracle/base/flash_recovery_area'
    #No auxiliary parameter file used
    starting up automatic instance NEW10
    Oracle instance started
    Total System Global Area 292933632 bytes
    Fixed Size 1336092 bytes
    Variable Size 100666596 bytes
    Database Buffers 184549376 bytes
    Redo Buffers 6381568 bytes
    Automatic instance created
    Running TRANSPORT_SET_CHECK on recovery set tablespaces
    TRANSPORT_SET_CHECK completed successfully
    contents of Memory Script:
    # set requested point in time
    set until scn 1791053;
    # restore the controlfile
    restore clone controlfile;
    # mount the controlfile
    sql clone 'alter database mount clone database';
    # archive current online log
    sql 'alter system archive log current';
    # avoid unnecessary autobackups for structural changes during TSPITR
    sql 'begin dbms_backup_restore.AutoBackupFlag(FALSE); end;';
    executing Memory Script
    executing command: SET until clause
    Starting restore at 17-AUG-10
    allocated channel: ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: SID=59 device type=DISK
    channel ORA_AUX_DISK_1: starting datafile backup set restore
    channel ORA_AUX_DISK_1: restoring control file
    channel ORA_AUX_DISK_1: reading from backup piece /opt/oracle/base/flash_recovery_area/NEW10/autobackup/2010_08_17/o1_mf_s_727280767_66nmo8x7_.bkp
    channel ORA_AUX_DISK_1: piece handle=/opt/oracle/base/flash_recovery_area/NEW10/autobackup/2010_08_17/o1_mf_s_727280767_66nmo8x7_.bkp tag=TAG20100817T142607
    channel ORA_AUX_DISK_1: restored backup piece 1
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:00:01
    output file name=/opt/oracle/base/flash_recovery_area/NEW10/controlfile/o1_mf_66o0wsh8_.ctl
    Finished restore at 17-AUG-10
    sql statement: alter database mount clone database
    sql statement: alter system archive log current
    sql statement: begin dbms_backup_restore.AutoBackupFlag(FALSE); end;
    contents of Memory Script:
    # set requested point in time
    set until scn 1791053;
    # set destinations for recovery set and auxiliary set datafiles
    set newname for clone datafile 1 to new;
    set newname for clone datafile 8 to new;
    set newname for clone datafile 3 to new;
    set newname for clone datafile 2 to new;
    set newname for clone datafile 9 to new;
    set newname for clone tempfile 1 to new;
    set newname for datafile 7 to
    "/opt/oracle/base/oradata/NEW10/test01.dbf";
    # switch all tempfiles
    switch clone tempfile all;
    # restore the tablespaces in the recovery set and the auxiliary set
    restore clone datafile 1, 8, 3, 2, 9, 7;
    switch clone datafile all;
    executing Memory Script
    executing command: SET until clause
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    renamed tempfile 1 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_temp_%u_.tmp in control file
    Starting restore at 17-AUG-10
    using channel ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: starting datafile backup set restore
    channel ORA_AUX_DISK_1: specifying datafile(s) to restore from backup set
    channel ORA_AUX_DISK_1: restoring datafile 00001 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_%u_.dbf
    channel ORA_AUX_DISK_1: restoring datafile 00008 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_%u_.dbf
    channel ORA_AUX_DISK_1: restoring datafile 00003 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_undotbs1_%u_.dbf
    channel ORA_AUX_DISK_1: restoring datafile 00002 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_%u_.dbf
    channel ORA_AUX_DISK_1: restoring datafile 00009 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_%u_.dbf
    channel ORA_AUX_DISK_1: reading from backup piece /opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnndf_TAG20100817T140128_66nl7174_.bkp
    channel ORA_AUX_DISK_1: piece handle=/opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnndf_TAG20100817T140128_66nl7174_.bkp tag=TAG20100817T140128
    channel ORA_AUX_DISK_1: restored backup piece 1
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:02:45
    channel ORA_AUX_DISK_1: starting datafile backup set restore
    channel ORA_AUX_DISK_1: specifying datafile(s) to restore from backup set
    channel ORA_AUX_DISK_1: restoring datafile 00007 to /opt/oracle/base/oradata/NEW10/test01.dbf
    channel ORA_AUX_DISK_1: reading from backup piece /opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnnd0_WEEKLY_66nl9m8k_.bkp
    channel ORA_AUX_DISK_1: piece handle=/opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnnd0_WEEKLY_66nl9m8k_.bkp tag=WEEKLY
    channel ORA_AUX_DISK_1: restored backup piece 1
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:06:55
    Finished restore at 17-AUG-10
    datafile 1 switched to datafile copy
    input datafile copy RECID=6 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_66o0x1sf_.dbf
    datafile 8 switched to datafile copy
    input datafile copy RECID=7 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_66o0x1r9_.dbf
    datafile 3 switched to datafile copy
    input datafile copy RECID=8 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_undotbs1_66o0x1vr_.dbf
    datafile 2 switched to datafile copy
    input datafile copy RECID=9 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_66o0x1vj_.dbf
    datafile 9 switched to datafile copy
    input datafile copy RECID=10 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_66o0x1rs_.dbf
    contents of Memory Script:
    # set requested point in time
    set until scn 1791053;
    # online the datafiles restored or switched
    sql clone "alter database datafile 1 online";
    sql clone "alter database datafile 8 online";
    sql clone "alter database datafile 3 online";
    sql clone "alter database datafile 2 online";
    sql clone "alter database datafile 9 online";
    sql clone "alter database datafile 7 online";
    # recover and open resetlogs
    recover clone database tablespace "TEST", "SYSTEM", "UNDOTBS1", "SYSAUX" delete archivelog;
    alter clone database open resetlogs;
    executing Memory Script
    executing command: SET until clause
    sql statement: alter database datafile 1 online
    sql statement: alter database datafile 8 online
    sql statement: alter database datafile 3 online
    sql statement: alter database datafile 2 online
    sql statement: alter database datafile 9 online
    sql statement: alter database datafile 7 online
    Starting recover at 17-AUG-10
    using channel ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: starting incremental datafile backup set restore
    channel ORA_AUX_DISK_1: specifying datafile(s) to restore from backup set
    destination for restore of datafile 00007: /opt/oracle/base/oradata/NEW10/test01.dbf
    channel ORA_AUX_DISK_1: reading from backup piece /opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnnd1_DAILY_66nmf6qs_.bkp
    channel ORA_AUX_DISK_1: piece handle=/opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnnd1_DAILY_66nmf6qs_.bkp tag=DAILY
    channel ORA_AUX_DISK_1: restored backup piece 1
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:00:01
    starting media recovery
    archived log for thread 1 with sequence 39 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_39_66nmc1dg_.arc
    archived log for thread 1 with sequence 40 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_40_66nmcfw4_.arc
    archived log for thread 1 with sequence 41 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_41_66nmcwcf_.arc
    archived log for thread 1 with sequence 42 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_42_66nmddbw_.arc
    archived log for thread 1 with sequence 43 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_43_66o0wyys_.arc
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_39_66nmc1dg_.arc thread=1 sequence=39
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_40_66nmcfw4_.arc thread=1 sequence=40
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_41_66nmcwcf_.arc thread=1 sequence=41
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_42_66nmddbw_.arc thread=1 sequence=42
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_43_66o0wyys_.arc thread=1 sequence=43
    media recovery complete, elapsed time: 00:00:50
    Finished recover at 17-AUG-10
    database opened
    contents of Memory Script:
    # make read only the tablespace that will be exported
    sql clone 'alter tablespace TEST read only';
    # create directory for datapump import
    sql "create or replace directory TSPITR_DIROBJ_DPDIR as ''
    /opt/oracle/base/flash_recovery_area''";
    # create directory for datapump export
    sql clone "create or replace directory TSPITR_DIROBJ_DPDIR as ''
    /opt/oracle/base/flash_recovery_area''";
    executing Memory Script
    sql statement: alter tablespace TEST read only
    sql statement: create or replace directory TSPITR_DIROBJ_DPDIR as ''/opt/oracle/base/flash_recovery_area''
    sql statement: create or replace directory TSPITR_DIROBJ_DPDIR as ''/opt/oracle/base/flash_recovery_area''
    Performing export of metadata...
    EXPDP> Starting "SYS"."TSPITR_EXP_BkAq":
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/PLUGTS_BLK
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/TABLE
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/GRANT/OWNER_GRANT/OBJECT_GRANT
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/INDEX
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/CONSTRAINT/CONSTRAINT
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/INDEX_STATISTICS
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/TRIGGER
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/TABLE_STATISTICS
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/POST_INSTANCE/PLUGTS_BLK
    EXPDP> Master table "SYS"."TSPITR_EXP_BkAq" successfully loaded/unloaded
    EXPDP> ******************************************************************************
    EXPDP> Dump file set for SYS.TSPITR_EXP_BkAq is:
    EXPDP> /opt/oracle/base/flash_recovery_area/tspitr_BkAq_82690.dmp
    EXPDP> ******************************************************************************
    EXPDP> Datafiles required for transportable tablespace TEST:
    EXPDP> /opt/oracle/base/oradata/NEW10/test01.dbf
    EXPDP> Job "SYS"."TSPITR_EXP_BkAq" successfully completed at 18:25:02
    Export completed
    contents of Memory Script:
    # shutdown clone before import
    shutdown clone immediate
    # drop target tablespaces before importing them back
    sql 'drop tablespace TEST including contents keep datafiles';
    executing Memory Script
    database closed
    database dismounted
    Oracle instance shut down
    sql statement: drop tablespace TEST including contents keep datafiles
    Removing automatic instance
    shutting down automatic instance
    target database instance not started
    Automatic instance removed
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_temp_66o1k480_.tmp deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/onlinelog/o1_mf_3_66o1k0mg_.log deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/onlinelog/o1_mf_2_66o1jyt4_.log deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/onlinelog/o1_mf_1_66o1jx3w_.log deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_66o0x1rs_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_66o0x1vj_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_undotbs1_66o0x1vr_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_66o0x1r9_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_66o0x1sf_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/controlfile/o1_mf_66o0wsh8_.ctl deleted
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03002: failure of recover command at 08/17/2010 18:25:36
    RMAN-03015: error occurred in stored script Memory Script
    RMAN-03009: failure of sql command on default channel at 08/17/2010 18:25:25
    RMAN-11003: failure during parse/execution of SQL statement: drop tablespace TEST including contents keep datafiles
    ORA-00604: error occurred at recursive SQL level 1
    ORA-00060: deadlock detected while waiting for resource
    Recovery Manager complete.
    please give your valuable suggestion .It should be more helpful for us.
    Edited by: user10750009 on Aug 20, 2010 1:07 AM
    Edited by: user10750009 on Aug 20, 2010 1:15 AM

    I want TSPITR ,during this operation i faced this deadlock error.
    Before that we faced roll backsegment error for that we applied follwing workaround .
    If i applied follwing workaround before every backup and restore .i didn't get any error .all things went successful.
    spool /tmp/Createtest.log
    connect / as sysdba
    REM Perform startup in case we are still down
    ALTER SYSTEM SET PROCESSES=500 SCOPE=SPFILE;
    SHUT IMMEDIATE;
    STARTUP MOUNT EXCLUSIVE;
    ALTER DATABASE ARCHIVELOG;
    ARCHIVE LOG START;
    ALTER DATABASE OPEN;
    connECT / as sysdba;
    alter system set undo_management = MANUAL scope=spfile;
    shutdown immediate;
    startup;
    Connect / as sysdba;
    DROP TABLE TEST123;
    create table test123 (t1 number, t2 varchar2(10));
    begin
    for i in 1.. 300000 loop
    insert into test values (i,'AAAAAAAAAA');
    end loop;
    end;
    delete test123;
    commit;
    alter system set undo_management = auto scope=spfile;
    shutdown immediate ;
    startup ;
    The above workaround we applied before creating tablespace and datafile ,after that we face some dead lock error while restore TSPITR .Did you need any more information
    Edited by: user10750009 on Aug 20, 2010 1:12 AM

  • A StuckThreadMaxTime error; who can help me to analyse the thread dumps

    The StuckThreadMaxTime error freeze my system, no one can logged in.I have double checked the thread dumps, but get no help.
    The following is the thread dumps:
    <2004-12-7 ÉÏÎç05ʱ56·Ö47Ãë GMT+08:00> <Alert> <Log Management> <BEA-170017> <The log file ./myserver/myserver.log will be rotated. Reopen the log file if tailing has stopped. This can happen on some platforms like Windows.>
    <2004-12-7 ÉÏÎç05ʱ56·Ö47Ãë GMT+08:00> <Alert> <Log Management> <BEA-170018> <The log file has been rotated to myserver.log00035. Log messages will continue to be logged in ./myserver/myserver.log.>
    <2004-12-7 ÉÏÎç10ʱ09·Ö32Ãë GMT+08:00> <Warning> <WebLogicServer> <BEA-000337> <ExecuteThread: '10' for queue: 'weblogic.kernel.Default' has been busy for "646" seconds working on the request "com.huawei.oss.rms.resourceaccess.ResourceMgmtSession_1x9h7n_EOImpl", which is more than the configured time (StuckThreadMaxTime) of "600" seconds.>
    <2004-12-7 ÉÏÎç10ʱ09·Ö32Ãë GMT+08:00> <Warning> <WebLogicServer> <BEA-000337> <ExecuteThread: '13' for queue: 'weblogic.kernel.Default' has been busy for "651" seconds working on the request "com.huawei.oss.rms.resourceaccess.ResourceMgmtSession_1x9h7n_EOImpl", which is more than the configured time (StuckThreadMaxTime) of "600" seconds.>
    <2004-12-7 ÉÏÎç10ʱ09·Ö32Ãë GMT+08:00> <Warning> <WebLogicServer> <BEA-000337> <ExecuteThread: '14' for queue: 'weblogic.kernel.Default' has been busy for "650" seconds working on the request "com.huawei.oss.rms.resourceaccess.ResourceMgmtSession_1x9h7n_EOImpl", which is more than the configured time (StuckThreadMaxTime) of "600" seconds.>
    Full thread dump Java HotSpot(TM) VM (1.4.2 1.4.2.03-040401-18:59-PA_RISC2.0 PA2.0 (aCC_AP) mixed mode):
    "ExecuteThread: '14' for queue: 'JmsDispatcher'" daemon prio=5 tid=01c3f778 nid=71 lwp_id=39624 in Object.wait() [0x61abf000..0x61abf4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <6d1d24f8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <6d1d24f8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '13' for queue: 'JmsDispatcher'" daemon prio=5 tid=01c3f610 nid=70 lwp_id=39623 in Object.wait() [0x61b40000..0x61b404f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <6d1d2578> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <6d1d2578> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '12' for queue: 'JmsDispatcher'" daemon prio=5 tid=01c3f4a8 nid=69 lwp_id=39622 in Object.wait() [0x61bc1000..0x61bc14f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <6d1d25f8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <6d1d25f8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '11' for queue: 'JmsDispatcher'" daemon prio=5 tid=01c3f340 nid=68 lwp_id=39621 in Object.wait() [0x61c42000..0x61c424f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <6d1d2678> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.Eÿ

    "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=000883f8 nid=27 lwp_id=39205 runnable [0x630ec000..0x630eb4f0]
         at java.net.SocketInputStream.socketRead0(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:129)
         at oracle.net.ns.Packet.receive(Unknown Source)
         at oracle.net.ns.DataPacket.receive(Unknown Source)
         at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:971)
         at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:941)
         at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:432)
         at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:181)
         at oracle.jdbc.driver.T4CPreparedStatement.execute_for_rows(T4CPreparedStatement.java:543)
         at oracle.jdbc.driver.OracleStatement.execute_maybe_describe(OracleStatement.java:913)
         at oracle.jdbc.driver.T4CPreparedStatement.execute_maybe_describe(T4CPreparedStatement.java:452)
         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:984)
         at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:2885)
         at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:2926)
         - locked <762d0bd8> (a oracle.jdbc.driver.T4CPreparedStatement)
         - locked <6c837e90> (a oracle.jdbc.driver.T4CConnection)
         at weblogic.jdbc.wrapper.PreparedStatement.executeQuery(PreparedStatement.java:92)
         at com.huawei.oss.rms.persistence.ReadOperationPersistenceImpl.getAttributeValue(ReadOperationPersistenceImpl.java:2054)
         at com.huawei.oss.rms.persistence.PersistenceOperationImpl.getAttributeValue(PersistenceOperationImpl.java:516)
         at com.huawei.oss.services.common.Utility.getNameByID(Utility.java:78)
         at com.huawei.oss.services.port.common.RMSPortUtility.setExtraToVO(RMSPortUtility.java:45)
         at com.huawei.oss.services.port.server.PhyPortConnHelper.setExtraToVO(PhyPortConnHelper.java:2046)
         at com.huawei.oss.services.port.server.PhyPortConnHelper.afterGet(PhyPortConnHelper.java:719)
         at com.huawei.oss.services.common.AbstractResourceHelper.getResource(AbstractResourceHelper.java:293)
         at com.huawei.oss.services.port.server.PhyPortConnHelper.rmsGetByPort(PhyPortConnHelper.java:809)
         at com.huawei.oss.services.port.server.PhyPortConnHelper.rmsGetAllPhyConnOfBoard(PhyPortConnHelper.java:1144)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at com.huawei.oss.services.common.AbstractResourceHelper.directMethod(AbstractResourceHelper.java:489)
         at com.huawei.oss.services.common.AbstractResourceHelper.invokeMethod(AbstractResourceHelper.java:404)
         at com.huawei.oss.rms.resourceaccess.ResourceMgmtSessionEJB.invokeMethod(ResourceMgmtSessionEJB.java:263)
         at com.huawei.oss.rms.resourceaccess.ResourceMgmtSession_1x9h7n_EOImpl.invokeMethod(ResourceMgmtSession_1x9h7n_EOImpl.java:424)
         at com.huawei.oss.rms.resourceaccess.ResourceMgmtSession_1x9h7n_EOImpl_WLSkel.invoke(Unknown Source)
         at weblogic.rmi.internal.activation.ActivatableServerRef.invoke(ActivatableServerRef.java:90)
         at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:420)
         at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
         at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:144)
         at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:415)
         at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest.java:30)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=00088290 nid=26 lwp_id=39204 runnable [0x6316d000..0x6316c4f0]
         at java.net.SocketInputStream.socketRead0(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:129)
         at oracle.net.ns.Packet.receive(Unknown Source)
         at oracle.net.ns.DataPacket.receive(Unknown Source)
         at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:971)
         at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:941)
         at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:432)
         at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:112)
         at oracle.jdbc.driver.T4CStatement.execute_for_rows(T4CStatement.java:474)
         at oracle.jdbc.driver.OracleStatement.execute_maybe_describe(OracleStatement.java:913)
         at oracle.jdbc.driver.T4CStatement.execute_maybe_describe(T4CStatement.java:383)
         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:984)
         at oracle.jdbc.driver.OracleStatement.executeQuery(OracleStatement.java:1124)
         - locked <76c0d1f8> (a oracle.jdbc.driver.T4CStatement)
         - locked <6f1ab788> (a oracle.jdbc.driver.T4CConnection)
         at weblogic.jdbc.wrapper.Statement.executeQuery(Statement.java:345)
         at com.huawei.oss.rms.persistence.PersistenceOperationImpl.executeSQL(PersistenceOperationImpl.java:2884)
         at com.huawei.oss.rms.persistence.PersistenceOperationImpl.setVersionFlagNResourceName(PersistenceOperationImpl.java:3137)
         at com.huawei.oss.rms.persistence.PersistenceOperationImpl.makeAssociationValue(PersistenceOperationImpl.java:2600)
         at com.huawei.oss.rms.persistence.ReadOperationPersistenceImpl.getResourceAssociationSet(ReadOperationPersistenceImpl.java:2575)
         at com.huawei.oss.rms.persistence.PersistenceOperationImpl.getResourceAssociationSet(PersistenceOperationImpl.java:603)
         at com.huawei.oss.services.port.common.RMSPortUtility.getSlotByEquip(RMSPortUtility.jÿ

  • Thread dump data received from VMWare

    When Lots of trigger threads are waiting on monitor entry for the release of lock on SQLServer connection. I've pasted the snippet of the culprit
    thread:
    The thread dump is below:
    Lots of trigger threads are waiting on monitor entry for the release of
    lock on SQLServer connection. I've pasted the snippet of the culprit
    thread:
    "Thread-382" daemon prio=5 tid=0x00343e58 nid=0x1b2 runnable
    [2477f000..2477fc30]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at
    com.wm.dd.jdbc.sqlserver.SQLServerByteOrderedDataReader.readPacketIntoPr
    imaryBuffer(Unknown Source)
    at
    com.wm.dd.jdbc.sqlserver.SQLServerByteOrderedDataReader.receive(Unknown
    Source)
    at com.wm.dd.jdbc.sqlserver.tds.TDSRequest.receive(Unknown
    Source)
    at
    com.wm.dd.jdbc.sqlserver.tds.TDSExecuteRequest.submitRequest(Unknown
    Source)
    at
    com.wm.dd.jdbc.sqlserver.SQLServerImplConnection.rollbackTransaction(Unk
    nown Source)
    at com.wm.dd.jdbc.base.BaseConnection.rollback(Unknown Source)
    - locked <0x56a3ac88> (a
    com.wm.dd.jdbc.sqlserver.SQLServerConnection)
    at com.wm.dd.jdbc.base.BaseConnection.commonCloseReset(Unknown
    Source)
    at com.wm.dd.jdbc.base.BaseConnection.reset(Unknown Source)
    - locked <0x56a3ac88> (a
    com.wm.dd.jdbc.sqlserver.SQLServerConnection)
    at com.wm.dd.jdbcx.base.BasePooledConnection.reset(Unknown
    Source)
    - locked <0x56a3ac88> (a
    com.wm.dd.jdbc.sqlserver.SQLServerConnection)
    - locked <0x56a47e10> (a
    com.wm.dd.jdbcx.base.BasePooledConnection)
    at com.wm.dd.jdbcx.base.BaseConnectionWrapper.close(Unknown
    Source)
    - locked <0x56a47e78> (a
    com.wm.dd.jdbcx.base.BaseConnectionWrapper)
    at
    com.wm.adapter.wmjdbc.connection.JDBCConnection.destroyConnection(JDBCCo
    nnection.java:277)
    at
    com.wm.adk.connection.WmManagedConnection.destroy(WmManagedConnection.ja
    va:243)
    - locked <0x56a3aae0> (a
    com.wm.adapter.wmjdbc.connection.JDBCConnection)
    at
    com.wm.app.b2b.server.jca.WmConnectionPool$ConnectionTimeoutMgr.run(WmCo
    nnectionPool.java:1048)
    - locked <0x52ff1a68> (a java.util.Vector)
    This thread locked the resource and not releasing it. It's waiting on
    the connection from sql server. So, kindly check for any connectivity
    problems between the IS and sql server and rectify the problem.
    Let me know about the nohup_p2.out. Is this a clustered srever? Here
    also I can observe that there is a problem with database connectivity

    We are get this error while useing webmethod.

  • Dead lock handling

    Hi
    I am running a little test that runs two threads that update the same table. Each thread tries to update several documents in the within a single transaction. The update is done by retrieving the document, modifying it, adding the updated document and deleting the existing document.
    I have enable dead lock detection and when a dead lock exception is thrown I abort the current transaction.
    However after a few iteration, deleteDocument causes a core dump and DBXML prints to stderr : "Previous deadlock return not resolved".
    Is there anything else to resolve when a dead lock occurs other than abort the transaction?
    This is the relevant stack trace:
    #0 0x00421780 in Dbc::get () from /u/yoava/dbxml-2.2.13/install/lib/libdb_cxx-4.3.so
    (gdb) where
    #0 0x00421780 in Dbc::get () from /u/yoava/dbxml-2.2.13/install/lib/libdb_cxx-4.3.so
    #1 0x00934289 in DbXml::SyntaxDatabase::updateStatistics (this=0x2000001c,
    context=@0x8641c34, key=@0x8628070, statistics=@0x8628088) at Cursor.hpp:48
    #2 0x00901d10 in DbXml::StatisticsWriteCache::updateContainer (this=0x8641bcc,
    context=@0x8641c34, container=Internal: global symbol `Container' found in Container.cpp psymtab but not in symtab.
    Container may be an inlined function, or may be a template function
    (if a template, try specifying an instantiation: Container<type>).
    ) at /usr/include/c++/3.2.3/bits/stl_tree.h:202
    #3 0x0093bacf in DbXml::KeyStash::updateIndex (this=0x8634df8, context=@0x8641c34,
    container=0x8630e68) at KeyStash.cpp:210
    #4 0x008c72b7 in DbXml::Container::deleteDocument (this=0x8630e68, txn=0x86417f8,
    document=@0x8671f38, context=Internal: global symbol `UpdateContext' found in UpdateContext.cpp psymtab but not in symtab.
    UpdateContext may be an inlined function, or may be a template function
    (if a template, try specifying an instantiation: UpdateContext<type>).
    ) at Container.cpp:679
    #5 0x008d3475 in DeleteDocumentFunctor2::method (this=0x2000001c, container=@0x8630e68,
    txn=Internal: global symbol `Transaction' found in Transaction.cpp psymtab but not in symtab.
    Transaction may be an inlined function, or may be a template function
    (if a template, try specifying an instantiation: Transaction<type>).
    ) at TransactedContainer.cpp:121
    #6 0x008d3149 in DbXml::TransactedContainer::transactedMethod (this=0x8630e68,
    txn=0x3d71c8, flags=0, f=@0xb176b470) at TransactedContainer.cpp:217
    #7 0x008d2fe8 in DbXml::TransactedContainer::deleteDocument (this=0x8630e68,
    txn=0x86417f8, document=Internal: global symbol `Document' found in Document.cpp psymtab but not in symtab.
    Document may be an inlined function, or may be a template function
    (if a template, try specifying an instantiation: Document<type>).
    ) at TransactedContainer.cpp:26
    #8 0x00906940 in DbXml::XmlContainer::deleteDocument (this=0xbfff8c94, txn=@0xb176b5a0,
    document=Internal: global symbol `XmlDocument' found in XmlDocument.cpp psymtab but not in symtab.
    XmlDocument may be an inlined function, or may be a template function
    (if a template, try specifying an instantiation: XmlDocument<type>).
    ) at /u/yoava/dbxml-2.2.13/dbxml/include/dbxml/XmlDocument.hpp:72
    #9 0x0804a5c0 in DoUpdates (arg=0xbfff8c90) at dbxml_test_6.cpp:99
    #10 0x003dedec in start_thread () from /lib/tls/libpthread.so.0
    #11 0x0037ea2a in clone () from /lib/tls/libc.so.6
    thanks

    I have applied them. When applying patch 6 I got an error:
    compile3.server 46% patch < patch.2.2.13.6
    patch.2.2.13.6: No such file or directory.
    compile3.server 47% patch < patch.2.2.13.6
    (Stripping trailing CRs from patch.)
    can't find file to patch at input line 3
    Perhaps you should have used the -p or --strip option?
    The text leading up to this was:
    |*** NsEventGenerator.cpp.orig Thu Dec 8 14:50:50 2005
    |--- dbxml/src/dbxml/nodeStore/NsEventGenerator.cppThu Sep 28 17:24:57 2006
    File to patch: dbxml/src/dbxml/DbWrapper.hpp
    patching file dbxml/src/dbxml/DbWrapper.hpp
    Hunk #1 FAILED at 357.
    1 out of 1 hunk FAILED -- saving rejects to file dbxml/src/dbxml/DbWrapper.hpp.rej
    However this patch does not seem to be lock related.

  • Dead Lock occurred while accessing a Table

    Hi Experts,
    Yesterday i came across to an error Dead Lock occurred while accessing a Table and provides a dump message as"SQL error in the database when accessing a table" while monitoring process chains.I dis manual load it went fine.Can any one give the permanent fix about this issue.
    Thanks in advance,
    Mahesh

    Hi,
    You might need basis help. Just check following thread
    SQL Error in database when accessing a table
    sql error in the database when accessing a table in BW Extracts
    Thanks and regards

  • Thread Dump Question

    Hi,
    At times our users experience very slow response times. During one such incident I captured a few thread dumps ( 3-4 dumps at 5-10 second intervals). In all the thread dumps I find one thing in common, most of the threads look like they are busy writing to a socket...
    ===================================================
    "ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec85f8 nid=0x21 runnable [ce780000..ce7819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    =========================================================
    I have very limited knowledge about the app and I don't see any method calls in the thread dump to pinpoint the source of the bottleneck. Any ideas on how I should proceed and what information if any I can get from the above thread dump.
    Thank you so much..
    Wap

    Hi,
    I collected a few thread dumps when our servers were slow today and almost all the threads were in the same state as in the first post. I used the console to check what the threads were doing and it appeared that that they were fetching a .js (javascript) file. I consulted the developers and they say all the pages in the app have javascript embedded in them. I fail to understand how this could cause the problem. There were no JDBC connections that were being used actively. Is there any way I can drill down to the source of the problem ( Maybe a particular page is causing the problem). We don't have any performance/application analysis tools. Any pointers to information?
    Thank you so much..
    Wap
    Here is the thread dump...( in the console, I see this message.. HTTP Request: /target/source/JAVASCRIPT/SCRIPTS.JS)
    Full thread dump Java HotSpot(TM) Client VM (1.4.1_05-b01 mixed mode):
    "ExecuteThread: '2' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid=0x3c14b28 nid=0x48 in Object.wait() [ca881000..ca8819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <dbde7868> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '1' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid=0x3c13578 nid=0x47 in Object.wait() [ca981000..ca9819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <dbde7398> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '0' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid=0x3c13090 nid=0x46 in Object.wait() [caa81000..caa819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <dbde6ea8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ListenThread.Default" prio=5 tid=0x3ca4e10 nid=0x45 runnable [cab81000..cab819bc]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
    - locked <dbdac478> (a java.net.PlainSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:448)
    at java.net.ServerSocket.accept(ServerSocket.java:419)
    at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:24)
    at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:739)
    at weblogic.t3.srvr.ListenThread.run(ListenThread.java:292)
    "DefaultQuartzScheduler_QuartzSchedulerThread" prio=5 tid=0x4453f80 nid=0x44 waiting on condition [cb381000..cb3819bc]
    at java.lang.Thread.sleep(Native Method)
    at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:397)
    "DefaultQuartzScheduler_Worker-9" prio=5 tid=0x44532f8 nid=0x43 in Object.wait() [cb481000..cb4819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-8" prio=5 tid=0x4452748 nid=0x42 in Object.wait() [cb581000..cb5819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-7" prio=5 tid=0x4451b98 nid=0x41 in Object.wait() [cb681000..cb6819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-6" prio=5 tid=0x4451018 nid=0x40 in Object.wait() [cb781000..cb7819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-5" prio=5 tid=0x4461c70 nid=0x3f in Object.wait() [cb881000..cb8819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-4" prio=5 tid=0x4461200 nid=0x3e in Object.wait() [cb981000..cb9819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-3" prio=5 tid=0x4460188 nid=0x3d in Object.wait() [cba81000..cba819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-2" prio=5 tid=0x3e42230 nid=0x3c in Object.wait() [cbb81000..cbb819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-1" prio=5 tid=0x3e41bf0 nid=0x3b in Object.wait() [cbc81000..cbc819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-0" prio=5 tid=0x44505e0 nid=0x3a in Object.wait() [cbd81000..cbd819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "Thread-7" prio=5 tid=0x7f3588 nid=0x39 in Object.wait() [ccc81000..ccc819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <da41e0b0> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:429)
    - locked <da41e0b0> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "Thread-6" prio=5 tid=0x130f00 nid=0x38 in Object.wait() [ccd81000..ccd819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <da22c378> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:429)
    - locked <da22c378> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "Thread-5" daemon prio=5 tid=0x4dda20 nid=0x37 in Object.wait() [cd181000..cd1819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at java.util.TimerThread.mainLoop(Timer.java:403)
    - locked <da233248> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "weblogic.health.CoreHealthMonitor" daemon prio=5 tid=0x8e7078 nid=0x36 waiting on condition [cd381000..cd3819bc]
    at java.lang.Thread.sleep(Native Method)
    at weblogic.t3.srvr.CoreHealthMonitorThread.run(CoreHealthMonitorThread.java:127)
    "Thread-4" prio=5 tid=0x8b36e0 nid=0x35 in Object.wait() [cd481000..cd4819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <da01f1b0> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:429)
    - locked <da01f1b0> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "ExecuteThread: '0' for queue: 'Multicast'" daemon prio=5 tid=0x8b2760 nid=0x34 in Object.wait() [cd581000..cd5819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9fee6f8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "LDAPConnThread-0 ldap://10.63.7.20:7060" daemon prio=5 tid=0x7bd860 nid=0x33 runnable [cd681000..cd6819bc]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <d9f687d0> (a java.io.BufferedInputStream)
    at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
    at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
    at java.lang.Thread.run(Thread.java:536)
    "VDE Transaction Processor Thread" prio=2 tid=0xd22090 nid=0x31 in Object.wait() [cd781000..cd7819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <d9f48240> (a com.octetstring.vde.backend.standard.TransactionProcessor)
    at java.lang.Object.wait(Object.java:426)
    at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:356)
    - locked <d9f48240> (a com.octetstring.vde.backend.standard.TransactionProcessor)
    at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
    "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x85e788 nid=0x30 in Object.wait() [cd881000..cd8819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9eaf3c0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x85ddf0 nid=0x2f in Object.wait() [cd981000..cd9819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9eaeea0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x85dc58 nid=0x2e in Object.wait() [cda81000..cda819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <d9eae960> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9eae960> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0xe9b20 nid=0x2d runnable [cdb81000..cdb819bc]
    at weblogic.socket.PosixSocketMuxer.poll(Native Method)
    at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:100)
    - locked <d9c14f40> (a java.lang.String)
    at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0xe90b0 nid=0x2c waiting for monitor entry [cdc81000..cdc819bc]
    at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
    - waiting to lock <d9c14f40> (a java.lang.String)
    at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0xe8ee0 nid=0x2b waiting for monitor entry [cdd81000..cdd819bc]
    at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
    - waiting to lock <d9c14f40> (a java.lang.String)
    at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "weblogic.security.SpinnerRandomSource" daemon prio=5 tid=0xed7850 nid=0x2a in Object.wait() [cde81000..cde819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <d9c3aee8> (a java.lang.Object)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.security.SpinnerRandomBitsSource.run(SpinnerRandomBitsSource.java:60)
    - locked <d9c3aee8> (a java.lang.Object)
    at java.lang.Thread.run(Thread.java:536)
    "weblogic.time.TimeEventGenerator" daemon prio=9 tid=0xed27b0 nid=0x29 runnable [cdf81000..cdf819bc]
    at java.lang.Object.wait(Native Method)
    at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:271)
    - locked <d9c3af58> (a weblogic.time.common.internal.TimeTable)
    at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:118)
    at java.lang.Thread.run(Thread.java:536)
    "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xecd628 nid=0x28 in Object.wait() [ce081000..ce0819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3afd0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xecca78 nid=0x27 in Object.wait() [ce181000..ce1819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b050> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xecbec8 nid=0x26 in Object.wait() [ce281000..ce2819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b0d0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xecb318 nid=0x25 in Object.wait() [ce381000..ce3819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b150> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '0' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xeca768 nid=0x24 in Object.wait() [ce481000..ce4819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b1d0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '24' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec9bb8 nid=0x23 runnable [ce581000..ce5819bc]
    at java.net.PlainDatagramSocketImpl.receive(Native Method)
    - waiting to lock <da233350> (a java.net.PlainDatagramSocketImpl)
    at java.net.DatagramSocket.receive(DatagramSocket.java:680)
    - locked <d8851ca8> (a java.net.DatagramPacket)
    - locked <da233380> (a java.net.MulticastSocket)
    at weblogic.cluster.FragmentSocket.receive(FragmentSocket.java:169)
    at weblogic.cluster.MulticastManager.execute(MulticastManager.java:377)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '23' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec9008 nid=0x22 runnable [ce680000..ce6819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec8458 nid=0x21 runnable [ce780000..ce7819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '21' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec78a8 nid=0x20 runnable [ce880000..ce8819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '20' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec62e8 nid=0x1f runnable [ce980000..ce9819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '19' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec5b38 nid=0x1e in Object.wait() [cea81000..cea819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b4d0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '18' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec4f88 nid=0x1d runnable [ceb80000..ceb819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '17' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec43d8 nid=0x1c runnable [cec80000..cec819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.Chun

  • Help to anayse Thread Dump

    hi,
    My application uses RMI and some times the application hangs-up. The following is the thread dump i got. Please help me to find out the dead lock from this dump.
    =========================================================================
    Full thread dump Java HotSpot(TM) Server VM (1.4.1 1.4.1.02-030502-15:31-PA_RISC
    2.0 PA2.0 mixed mode):
    "RMI LeaseChecker" daemon prio=8 tid=0x006eac78 nid=20 lwp_id=280805 waiting on
    condition [0x6f042000..0x6f042530]
    at java.lang.Thread.sleep(Native Method)
    at sun.rmi.transport.DGCImpl$LeaseChecker.run(DGCImpl.java:307)
    at java.lang.Thread.run(Thread.java:536)
    "RMI TCP Connection(1)-192.168.174.45" daemon prio=10 tid=0x00b06570 nid=19 lwp_
    id=280803 runnable [0x6f0c3000..0x6f0c3530]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <0x73aea6d8> (a java.io.BufferedInputStream)
    at java.io.FilterInputStream.read(FilterInputStream.java:66)
    at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:4
    42)
    at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport
    .java:701)
    at java.lang.Thread.run(Thread.java:536)
    "MultiThreadedTimerMain" prio=10 tid=0x0004c660 nid=18 lwp_id=280759 in Object.w
    ait() [0x6f144000..0x6f144530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73adacb8> (a jp.co.nec.diosa.fw.util.timer.TaskQueue)
    at java.lang.Object.wait(Object.java:426)
    at jp.co.nec.diosa.fw.util.timer.MultiThreadedTimerThread.mainLoop(Multi
    ThreadedTimerThread.java:174)
    - locked <0x73adacb8> (a jp.co.nec.diosa.fw.util.timer.TaskQueue)
    at jp.co.nec.diosa.fw.util.timer.MultiThreadedTimerThread.run(MultiThrea
    dedTimerThread.java:115)
    "RMI RenewClean-[192.168.174.45:62731]" daemon prio=10 tid=0x0004c3a0 nid=16 lwp
    _id=280747 runnable [0x6f27b000..0x6f27b530]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <0x76400468> (a java.io.BufferedInputStream)
    at java.io.DataInputStream.readByte(DataInputStream.java:276)
    at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:215
    at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:171)
    at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:313)
    at sun.rmi.transport.DGCImpl_Stub.dirty(Unknown Source)
    at sun.rmi.transport.DGCClient$EndpointEntry.makeDirtyCall(DGCClient.jav
    a:328)
    at sun.rmi.transport.DGCClient$EndpointEntry.access$1600(DGCClient.java:
    144)
    at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCCli
    ent.java:539)
    at java.lang.Thread.run(Thread.java:536)
    "GC Daemon" daemon prio=10 tid=0x0004c0e0 nid=14 lwp_id=280709 in Object.wait()
    [0x6f37d000..0x6f37d530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73a00588> (a sun.misc.GC$LatencyLock)
    at sun.misc.GC$Daemon.run(GC.java:100)
    - locked <0x73a00588> (a sun.misc.GC$LatencyLock)
    "RMI Reaper" prio=10 tid=0x0004bf80 nid=13 lwp_id=280708 in Object.wait() [0x762
    fe000..0x762fe530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x739ffb88> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
    - locked <0x739ffb88> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
    at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:330)
    at java.lang.Thread.run(Thread.java:536)
    "Thread-1" daemon prio=10 tid=0x0004be20 nid=12 lwp_id=280707 in Object.wait() [
    0x7637f000..0x7637f530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x739ffe80> (a java.util.TaskQueue)
    at java.lang.Object.wait(Object.java:426)
    at java.util.TimerThread.mainLoop(Timer.java:403)
    - locked <0x739ffe80> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "RMI TCP Accept-0" daemon prio=10 tid=0x0004bcc0 nid=11 lwp_id=280706 runnable [
    0x7796b000..0x7796b530]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
    - locked <0x739ffbe0> (a java.net.PlainSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:439)
    at java.net.ServerSocket.accept(ServerSocket.java:410)
    at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
    at java.lang.Thread.run(Thread.java:536)
    "Signal Dispatcher" daemon prio=10 tid=0x0004b740 nid=8 lwp_id=280652 waiting on
    condition [0x00000000..0xffffffff]
    "Finalizer" daemon prio=10 tid=0x0004b5e0 nid=5 lwp_id=280644 in Object.wait() [
    0x77b7f000..0x77b7f530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73a03960> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
    - locked <0x73a03960> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
    "Reference Handler" daemon prio=10 tid=0x0004b480 nid=4 lwp_id=280643 in Object.
    wait() [0x79c08000..0x79c08530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73a039c8> (a java.lang.ref.Reference$Lock)
    at java.lang.Object.wait(Object.java:426)
    at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:113)
    - locked <0x73a039c8> (a java.lang.ref.Reference$Lock)
    "main" prio=10 tid=0x0004b320 nid=1 lwp_id=280621 runnable [0x79ff1000..0x79ff19
    50]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <0x73ac02f8> (a java.io.BufferedInputStream)
    at java.io.DataInputStream.readByte(DataInputStream.java:276)
    at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:
    189)
    at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:133)
    at jp.co.nec.diosa.fw.ms.service.Core_Stub.configure(Unknown Source)
    at jp.co.nec.diosa.utilapp.JUtilityApplication.<init>(JUtilityApplicatio
    n.java:1083)
    at jp.co.nec.diosa.utilapp.JUtilityAppServer.getUtilityAppReference(JUti
    lityAppServer.java:185)
    at jp.co.nec.diosa.utilapp.JUtilityAppServer.<init>(JUtilityAppServer.ja
    va:114)
    at jp.co.nec.diosa.utilapp.JUtilityAppServer.main(JUtilityAppServer.java
    :216)
    "VM Thread" prio=10 tid=0x0010daa8 nid=3 lwp_id=280642 runnable
    "VM Periodic Task Thread" prio=8 tid=0x0010db28 nid=6 lwp_id=280650 waiting on c
    ondition
    "Suspend Checker Thread" prio=10 tid=0x0010dba8 nid=7 lwp_id=280651 runnable
    Full thread dump Java HotSpot(TM) Server VM (1.4.1 1.4.1.02-030502-15:31-PA_RISC
    2.0 PA2.0 mixed mode):
    "Thread-2" prio=10 tid=0x0004d0c0 nid=23 lwp_id=280801 in Object.wait() [0x6eef4
    000..0x6eef4530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73acdfc8> (a jp.co.nec.diosa.joba.appl.GuiProcessingDaem
    on)
    at java.lang.Object.wait(Object.java:426)
    at jp.co.nec.diosa.joba.appl.GuiProcessingDaemon.process(GuiProcessingDa
    emon.java:257)
    - locked <0x73acdfc8> (a jp.co.nec.diosa.joba.appl.GuiProcessingDaemon)
    at jp.co.nec.diosa.joba.appl.GuiProcessingDaemon.run(GuiProcessingDaemon
    .java:196)
    at java.lang.Thread.run(Thread.java:536)
    "RMI LeaseChecker" daemon prio=8 tid=0x0004cca0 nid=19 lwp_id=280777 waiting on
    condition [0x6f0f8000..0x6f0f8530]
    at java.lang.Thread.sleep(Native Method)
    at sun.rmi.transport.DGCImpl$LeaseChecker.run(DGCImpl.java:307)
    at java.lang.Thread.run(Thread.java:536)
    "RMI TCP Connection(1)-192.168.174.45" daemon prio=10 tid=0x00235b30 nid=18 lwp_
    id=280768 runnable [0x6f179000..0x6f179530]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <0x73ace8c8> (a java.io.BufferedInputStream)
    at java.io.FilterInputStream.read(FilterInputStream.java:66)
    at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:4
    42)
    at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport
    .java:701)
    at java.lang.Thread.run(Thread.java:536)
    "RMI Reaper" prio=10 tid=0x0004cb40 nid=17 lwp_id=280758 in Object.wait() [0x6f1
    fa000..0x6f1fa530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73acea78> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
    - locked <0x73acea78> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
    at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:330)
    at java.lang.Thread.run(Thread.java:536)
    "RMI TCP Accept-0" daemon prio=10 tid=0x0004c9e0 nid=16 lwp_id=280757 runnable [
    0x6f27b000..0x6f27b530]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
    - locked <0x73aceaf8> (a java.net.PlainSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:439)
    at java.net.ServerSocket.accept(ServerSocket.java:410)
    at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
    at java.lang.Thread.run(Thread.java:536)
    "Thread-1" daemon prio=10 tid=0x0004c880 nid=15 lwp_id=280755 in Object.wait() [
    0x6f2fc000..0x6f2fc530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73acebb0> (a java.util.TaskQueue)
    at java.lang.Object.wait(Object.java:426)
    at java.util.TimerThread.mainLoop(Timer.java:403)
    - locked <0x73acebb0> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "GC Daemon" daemon prio=10 tid=0x0004c5c0 nid=13 lwp_id=280741 in Object.wait()
    [0x762fe000..0x762fe530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73a4d630> (a sun.misc.GC$LatencyLock)
    at sun.misc.GC$Daemon.run(GC.java:100)
    - locked <0x73a4d630> (a sun.misc.GC$LatencyLock)
    "RMI RenewClean-[192.168.174.45:62731]" daemon prio=10 tid=0x0004c460 nid=12 lwp
    _id=280740 runnable [0x7637f000..0x7637f530]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <0x76408468> (a java.io.BufferedInputStream)
    at java.io.DataInputStream.readByte(DataInputStream.java:276)
    at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:215
    at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:171)
    at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:313)
    at sun.rmi.transport.DGCImpl_Stub.dirty(Unknown Source)
    at sun.rmi.transport.DGCClient$EndpointEntry.makeDirtyCall(DGCClient.jav
    a:328)
    at sun.rmi.transport.DGCClient$EndpointEntry.access$1600(DGCClient.java:
    144)
    at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCCli
    ent.java:539)
    at java.lang.Thread.run(Thread.java:536)
    "Signal Dispatcher" daemon prio=10 tid=0x0004bd80 nid=8 lwp_id=280647 waiting on
    condition [0x00000000..0xffffffff]
    "Finalizer" daemon prio=10 tid=0x0004bc20 nid=5 lwp_id=280635 in Object.wait() [
    0x77b7f000..0x77b7f530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73a4da48> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
    - locked <0x73a4da48> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
    "Reference Handler" daemon prio=10 tid=0x0004bac0 nid=4 lwp_id=280634 in Object.
    wait() [0x79c08000..0x79c08530]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x73a4dab0> (a java.lang.ref.Reference$Lock)
    at java.lang.Object.wait(Object.java:426)
    at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:113)
    - locked <0x73a4dab0> (a java.lang.ref.Reference$Lock)
    "main" prio=10 tid=0x0004b960 nid=1 lwp_id=280616 runnable [0x79ff1000..0x79ff19
    50]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <0x73ae1260> (a java.io.BufferedInputStream)
    at java.io.DataInputStream.readByte(DataInputStream.java:276)
    at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:
    189)
    at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:133)
    at jp.co.nec.diosa.fw.ms.service.Core_Stub.filterFilesForCurrentHost(Unk
    nown Source)
    at jp.co.nec.diosa.joba.appl.JobGateway.filterFilesForIncomingHost(JobGa
    teway.java:342)
    at jp.co.nec.diosa.joba.event.coreevent.SGReadingEvent.run(SGReadingEven
    t.java:322)
    at jp.co.nec.diosa.joba.event.coreevent.StartupSGReadingEvent.run(Startu
    pSGReadingEvent.java:86)
    at jp.co.nec.diosa.joba.event.coreevent.StartupSGReadingEvent.process(St
    artupSGReadingEvent.java:75)
    at jp.co.nec.diosa.joba.appl.JobMain.readSGFile(JobMain.java:1401)
    at jp.co.nec.diosa.joba.appl.JobMain.init(JobMain.java:752)
    at jp.co.nec.diosa.joba.appl.JobMain.main(JobMain.java:1014)
    "VM Thread" prio=10 tid=0x0010daa8 nid=3 lwp_id=280626 runnable
    "VM Periodic Task Thread" prio=8 tid=0x0010db28 nid=6 lwp_id=280645 waiting on c
    ondition
    "Suspend Checker Thread" prio=10 tid=0x0010dba8 nid=7 lwp_id=280646 runnable
    =========================================================================

    Hi Owen,
    Thank u for ur immediate reply on my doubt, but still my doubt not got clear.
    If u look into the locked threads, the lock is happened in RMI layer. Concider following two threads:
    -----------------------------------thread 1
    "RMI TCP Connection(1)-192.168.174.45" daemon prio=10 tid=0x00b06570 nid=19 lwp_id=280803 runnable [0x6f0c3000..0x6f0c3530]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <0x73aea6d8> (a java.io.BufferedInputStream)
    at java.io.FilterInputStream.read(FilterInputStream.java:66)
    at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:442)
    at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:701)
    at java.lang.Thread.run(Thread.java:536)
    --------------------------------------- thread 2----------
    "main" prio=10 tid=0x0004b960 nid=1 lwp_id=280616 runnable [0x79ff1000..0x79ff1950]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <0x73ae1260> (a java.io.BufferedInputStream)
    at java.io.DataInputStream.readByte(DataInputStream.java:276)
    at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:189)
    at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:133)
    at jp.co.nec.diosa.fw.ms.service.Core_Stub.filterFilesForCurrentHost(Unknown Source)
    at jp.co.nec.diosa.joba.appl.JobGateway.filterFilesForIncomingHost(JobGateway.java:342)
    at jp.co.nec.diosa.joba.event.coreevent.SGReadingEvent.run(SGReadingEvent.java:322)
    at jp.co.nec.diosa.joba.event.coreevent.StartupSGReadingEvent.run(StartupSGReadingEvent.java:86)
    at jp.co.nec.diosa.joba.event.coreevent.StartupSGReadingEvent.process(StartupSGReadingEvent.java:75)
    at jp.co.nec.diosa.joba.appl.JobMain.readSGFile(JobMain.java:1401)
    at jp.co.nec.diosa.joba.appl.JobMain.init(JobMain.java:752)
    at jp.co.nec.diosa.joba.appl.JobMain.main(JobMain.java:1014)
    Both the threads get locked in getting BufferedInputStread in RMI. If u can suggest some more hints that will very much helpful for me.
    Thanks in advance,
    Suresh Kumar

  • How to get a thread dump, in case of an IDE freeze

    When you're working with the IDE and if it either freezes or becomes sluggish for no apparent reason, it's recommended to generate a thread dump, and report it to Studio feedback alias ([email protected]) with a description of what happened and attach the dump to it.
    A thread dump is an invaluable source of information to IDE developers when investigating deadlocks and some performance issues. It is a textual dump of all active threads and monitors of Java apps running in a Virtual Machine.
    The ways to generate a thread dump differ depending on the platform:
    * Windows systems
    Press Ctrl-Break in the command console you used to start the IDE.
    You won't be able to see the console in case you started the IDE using the default desktop icon created by the IDE installer. To be able to generate the thread dump, you must launch the IDE using a console window (invoke Command Prompt, go to {studio-install-dir}/bin and type runide.exe), or configure the desktop shortcut properties to launch the runide.exe program instead of the default runidew.exe.
    Note: You should increase the screen buffer size of the command prompt, so that it could retian the entire thread dump output. To do that, on the command prompt where IDE is running, open the properties dialog box by right clicking on the titlebar and selecting 'properties'. Then select the 'layout tab' and increase the 'screen buffer size' parameters to - width - 200, Height - 4000.
    * Unix systems
    Press Ctrl-\ in the terminal console you used to start the JSE.
    Alternatively, you can also generate a thread dump by sending the QUIT signal to the Java VM running the JSE
    kill -QUIT process_id
    where process_id is the process number of the respective java process.
    -------Here is a sample thread dump -------
    Full thread dump Java HotSpot(TM) Client VM (1.4.2_01-b06 mixed mode):
    "Text-Layout" daemon prio=2 tid=0x0886ebd8 nid=0x4e4 in Object.wait() [9e8f000..9e8fd94]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x11730910> (a org.netbeans.editor.view.spi.ViewLayoutQueue)
    at java.lang.Object.wait(Object.java:429)
    at org.netbeans.editor.view.spi.ViewLayoutQueue.waitForTask(ViewLayoutQueue.java:128)
    - locked <0x11730910> (a org.netbeans.editor.view.spi.ViewLayoutQueue)
    at org.netbeans.editor.view.spi.ViewLayoutQueue$LayoutThread.run(ViewLayoutQueue.java:182)
    "Compilation" daemon prio=2 tid=0x0883d878 nid=0xb1c in Object.wait() [9c8f000..9c8fd94]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x1143dde0> (a java.util.LinkedList)
    at java.lang.Object.wait(Object.java:429)
    at org.netbeans.core.compiler.CompilationEngineImpl$CompilerThread.nextJobAndTask(CompilationEngineImpl.java:162)
    - locked <0x1143dde0> (a java.util.LinkedList)
    at org.netbeans.core.compiler.CompilationEngineImpl$CompilerThread.run(CompilationEngineImpl.java:175)
    "TimerQueue" daemon prio=5 tid=0x03575478 nid=0xb18 in Object.wait() [988f000..988fd94]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x10d4af60> (a javax.swing.TimerQueue)
    at javax.swing.TimerQueue.run(TimerQueue.java:231)
    - locked <0x10d4af60> (a javax.swing.TimerQueue)
    at java.lang.Thread.run(Thread.java:534)
    "AWT-EventQueue-1" prio=7 tid=0x0344fae0 nid=0xb14 in Object.wait() [3caf000..3cafd94]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x10d4afe8> (a java.awt.EventQueue)
    at java.lang.Object.wait(Object.java:429)
    at java.awt.EventQueue.getNextEvent(EventQueue.java:339)
    - locked <0x10d4afe8> (a java.awt.EventQueue)
    at java.awt.EventDispatchThread.pumpOneEventForHierarchy(EventDispatchThread.java:162)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:151)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:145)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:137)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:100)

    You can get a thread dump (Windows only) whitout any preparation. Simply use the Stack Trace tool from this web site:
    http://tmitevski.users.mcs2.netarray.com
    It works on Windows services too.

  • What's a good way to do a thread dump into a separate file

    What is a good way to do a thread dump automatically into a separate file.
    Example. I run a script to do the thread dump, but unfortunetly, it goes into my stdout log file with the rest of my weblogic errors.
    Any ideas? I want it in a separate file when I run my script?

    Do a Google search on "Drobo S" "benchmark."  I don't have a Drobo S, only the regular Drobo.  But here's a guy who tested one on Windows:
    http://mansurovs.com/drobo-s-review-usb-3-0-2nd-generation
    This one has it a bit faster:
    http://the-gadgeteer.com/2011/12/31/drobo-s-storage-array-review/
    Do read up on a few reviews of it, and be absolutely clear that interface speed (i.e. eSATA versus Firewire versus Thunderbolt) is NOT the same as the performance of the system.  The Drobo cannot keep up with any interfaces... at least the Drobo and the Drobo S cannot.
    I am not using the FS model which is a NAS.  I am using the plain old "Drobo" which is slower than the Drobo S, but that's not to say that the Drobo S is fast, because it is not.
    The Drobo in theory is really attractive: Dead simple to manage, can mix and match drive sizes, offers you some data protection, etc.  However do note that protected storage is not, in and of itself, a backup.  You need other backups besides just the data on the Drobo.  And, because it's so slow, it's really not a great fit for photo storage.  See this review from a guy who used to think the Drobo was great for that and then appended his review:
    http://www.stuckincustoms.com/drobo-review/
    To be as clear as possible, IMO the BEST backup strategy with something like Aperture (so long as your managed Aperture library is of a manageable size, like < 800 GB), is to get a few small portable Firewire 800 drives and keep vaults on each one.  They are great because they are easy to use, to have with you, are bus powered, and you WILL offsite them.

  • Locked thread issue

    We encountered the following locked thread issue. Refer to the thread dump logs.
    Any idea on the root cause of the issue? It seens to us that it is the weblogic app server codes that are causing the locked threads.
    Will appreciate any advise.
    "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=22 idx=0x50 tid=329 prio=5 alive, in native, blocked, daemon
    -- Blocked trying to get lock: java/lang/String@0x9a73910[fat lock]
    at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
    at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1674)[optimized]
    at jrockit/vm/Locks.lockFat(Locks.java:1775)[optimized]
    at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1311)[optimized]
    at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1258)[optimized]
    at jrockit/vm/Locks.monitorEnter(Locks.java:2455)[optimized]
    at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
    at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
    at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
    at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
    at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=24 idx=0x58 tid=331 prio=5 alive, in native, blocked, daemon
    -- Blocked trying to get lock: java/lang/String@0x9a73910[fat lock]
    at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
    at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1674)[optimized]
    at jrockit/vm/Locks.lockFat(Locks.java:1775)[optimized]
    at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1311)[optimized]
    at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1258)[optimized]
    at jrockit/vm/Locks.monitorEnter(Locks.java:2455)[optimized]
    at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
    at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
    at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
    at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
    at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=23 idx=0x54 tid=330 prio=5 alive, in native, daemon
    at jrockit/ext/epoll/EPoll.epollWait0(IIII)I(Native Method)
    at jrockit/ext/epoll/EPoll.epollWait(EPoll.java:103)
    at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:156)
    ^-- Holding lock: java/lang/String@0x9a73910[fat lock]
    at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
    at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
    at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
    at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace

    This is standard behavior for the socket muxer threads. Only one of the epoll muxer threads is actually holding the lock at any one time. Here is the output of part of my thread dump on Linux with WLS 10.3.4 on JRockit on startup. The server is not hung up at all. Make a request on the server and take another thread dump and you'll see the lock change.
    1st dump with ExecuteThread 1 waiting to get the lock from ExecuteThread 2
    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=25 idx=0x58 tid=26836 prio=5 alive, blocked, native_blocked, daemon
        -- Blocked trying to get lock: java/lang/String@0xe82d6ec0[thin lock]
        at jrockit/vm/Threads.sleep(I)V(Native Method)
        at jrockit/vm/Locks.waitForThinRelease(Locks.java:955)
        at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1083)
        at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)
        at jrockit/vm/Locks.monitorEnter(Locks.java:2179)
        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=26 idx=0x5c tid=26837 prio=5 alive, in native, daemon
        at jrockit/ext/epoll/EPoll.epollWait0(ILjava/nio/ByteBuffer;II)I(Native Method)
        at jrockit/ext/epoll/EPoll.epollWait(EPoll.java:115)
        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:156)
        ^-- Holding lock: java/lang/String@0xe82d6ec0[thin lock]
        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
        -- end of trace2nd dump after the server servers a request with ExecuteThread 2 waiting to get the lock from ExecuteThread 1
    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=25 idx=0x58 tid=26836 prio=5 alive, in native, daemon
        at jrockit/ext/epoll/EPoll.epollWait0(ILjava/nio/ByteBuffer;II)I(Native Method)
        at jrockit/ext/epoll/EPoll.epollWait(EPoll.java:115)
        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:156)
        ^-- Holding lock: java/lang/String@0xe82d6ec0[fat lock]
        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=26 idx=0x5c tid=26837 prio=5 alive, blocked, native_blocked, daemon
        -- Blocked trying to get lock: java/lang/String@0xe82d6ec0[fat lock]
        at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
        at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)
        at jrockit/vm/Locks.lockFat(Locks.java:1512)
        at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)
        at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)
        at jrockit/vm/Locks.monitorEnter(Locks.java:2179)
        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
        -- end of traceHere is a blog on this topic: http://jojovedder.blogspot.com/2009/05/weblogic-socket-muxers-are-not-stuck.html

Maybe you are looking for

  • How can i change the colour of makeup in a photo?

    hi there i have a photo with red bluch on her checks and blue eye shadow. both colors are too strong and i would like to remove or at least reduce them please. also can you make cheek bones less prominant? in case you havn't figured it out, i am a ne

  • Removing drag functionality of column in OBIEE 11g

    Hi all, Can any one say me how to remove the draging functionality for the columns in OBIEE 11g ? It is creating an issue for me when i hide the columns in pivot and has only rows over there. It is creating one more layer on the top of the measures.

  • Once and For All, Can I Yank Out that SSD?

    I am looking at getting a new MacBook Pro Retina, and I can't tell if once I order that thing: Can I open it up, take out that SSD and put back in one of those Seagate Hybrid drives?  I am sure the SSD's are nice and all, but they are crazy expensive

  • My mini wont take my bluetooth 2 edr

    i purchesed a class 1 bluetooth 2 EDR dongle, (a belkin 1) i know the origional modle by belkin didnt work on macintosh, but the new one actually does, so when i purhesed it i asked the shop keep if i could return it if it didnt work because of prior

  • Oracle SQL Developer v 1.5.3 does not export

    I attempted to export query results using Oracle SQL Developer. I right-clicked on the result and attepted to export data - it failed without explanation - nothing happened. I'm a new user with this product - is this a known bug and if so - could you