JDBC dead lock

Hi we got into this situation after running our application for a few
hours and now the JDBC connection pool is completely dead locked.
The thread dump looks approximately the same for the last two hours with
a lot of thread trying to get monitor access in ResourceAllocator.
Has anyone seen this or a way to work around it?
The server is Weblogic 7.0 SP1 on Solaris 8.0.
Thanks,
Dejan
Full thread dump:
"RMI RenewClean-[192.168.111.47:3959]" daemon prio=5 tid=0x2be7048 nid=0x1e81 waiting on monitor [0xd1f81000..0xd1f819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
     at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
     at java.lang.Thread.run(Thread.java:479)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2c04f28 nid=0x1e80 waiting on monitor [0xd2081000..0xd20819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"JmsPublisher.kerneltest.COMPUTE1.1920392681264132352" daemon prio=5 tid=0x2b1ea08 nid=0x1e7f waiting on monitor [0xd2281000..0xd22819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread.runUnauthenticated(WakeUpThread.java:177)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:133)
"RV Event Dispatch" daemon prio=5 tid=0x2b22668 nid=0x1e7e waiting on monitor [0xd2681000..0xd26819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at COM.TIBCO.rv.RvQ.waitEvent(RvQ.java:79)
     at COM.TIBCO.rv.RvDataDispatch.run(RvDataDispatch.java:36)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x21ffb18 nid=0x1e7d waiting on monitor [0xd3581000..0xd35819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2ac3778 nid=0x1e77 waiting on monitor [0xd2781000..0xd27819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2bec498 nid=0x1e76 waiting on monitor [0xd2c81000..0xd2c819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2200520 nid=0x1e75 waiting on monitor [0xd2e81000..0xd2e819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"JmsPublisher.kerneltest.COMPUTE1.6107795875676143616" daemon prio=5 tid=0xb87518 nid=0x1e74 waiting on monitor [0xd2f81000..0xd2f819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread.runUnauthenticated(WakeUpThread.java:177)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:133)
"RV Event Dispatch" daemon prio=5 tid=0x2ab9b0 nid=0x1e73 waiting on monitor [0xd3181000..0xd31819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at COM.TIBCO.rv.RvQ.waitEvent(RvQ.java:79)
     at COM.TIBCO.rv.RvDataDispatch.run(RvDataDispatch.java:36)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x55e080 nid=0x1e72 waiting on monitor [0xd3381000..0xd33819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"RMI RenewClean-[192.168.111.54:2306]" daemon prio=5 tid=0x2ad62e0 nid=0x1e70 waiting on monitor [0xd3781000..0xd37819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
     at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
     at java.lang.Thread.run(Thread.java:479)
"RMI RenewClean-[192.168.111.54:2308]" daemon prio=5 tid=0x2beefe8 nid=0x1e6e waiting on monitor [0xd3a81000..0xd3a819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
     at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
     at java.lang.Thread.run(Thread.java:479)
"JRiskTimerCallbackThread" daemon prio=6 tid=0x21ae390 nid=0x1e3b waiting for monitor entry [0xd8500000..0xd85019e0]
     at weblogic.jdbc.common.internal.ResourceAllocator.markBorrowed(ResourceAllocator.java:575)
     at weblogic.jdbc.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:674)
     at weblogic.jdbc.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:655)
     at weblogic.jdbc.common.internal.ResourceAllocator.reserveWaitSecs(ResourceAllocator.java:645)
     at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:163)
     at weblogic.jdbc.common.internal.ConnectionPool.reserveWaitSecs(ConnectionPool.java:118)
     at weblogic.jdbc.pool.Driver.connect(Driver.java:193)
     at weblogic.jdbc.jts.Driver.getNonTxConnection(Driver.java:374)
     at weblogic.jdbc.jts.Driver.connect(Driver.java:129)
     at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:265)
     at net.appl.jrisk.ejb.ejbDbConnectionHelper.getConnection(ejbDbConnectionHelper.java:167)
     at net.appl.jrisk.ejb.ejbDbConnectionHelper.getDbConnection(ejbDbConnectionHelper.java:137)
     at net.appl.jrisk.db.dbConnectionFactory.getDbConnection(dbConnectionFactory.java:82)
     at net.appl.jrisk.ejb.tx.RTEventCleaner$RTEventProcessor.checkAndSendEvents(RTEventCleaner.java:261)
     at net.appl.jrisk.ejb.tx.RTEventCleaner$RTEventProcessor.onTimer(RTEventCleaner.java:200)
     at net.appl.jrisk.time.SystemTimerCallbackThread$1.run(Timer.java:389)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:785)
     at weblogic.security.Security.runAs(Security.java:61)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedExceptionAction(WeblogicJRiskSecurityHelper.java:264)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedExceptionAction(DefaultJRiskSecurityHelper.java:271)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedExceptionAction(DefaultJRiskSecurityHelper.java:271)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedExceptionAction(JRiskSecurity.java:230)
     at net.appl.jrisk.time.SystemTimerCallbackThread.run(Timer.java:385)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21a2090 nid=0x1e39 waiting on monitor [0xd2981000..0xd29819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x21a5080 nid=0x1e38 waiting on monitor [0xd2b81000..0xd2b819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0xcaae58 nid=0x1e26 waiting on monitor [0xd3e81000..0xd3e819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21fab90 nid=0x1e1f waiting on monitor [0xd3481000..0xd34819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2ad99a0 nid=0x1e1e waiting on monitor [0xd3981000..0xd39819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2213560 nid=0x1a3b waiting on monitor [0xd4181000..0xd41819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21fece8 nid=0x1a38 waiting on monitor [0xd3f81000..0xd3f819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x22153f8 nid=0x1a37 waiting on monitor [0xd4581000..0xd45819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2ad3bd8 nid=0x1971 waiting on monitor [0xd4a81000..0xd4a819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21eaa50 nid=0x196d waiting on monitor [0xd4681000..0xd46819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21ac888 nid=0x1962 waiting on monitor [0xd2181000..0xd21819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21ac748 nid=0x1960 waiting on monitor [0xd2581000..0xd25819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2226bd8 nid=0x195e waiting on monitor [0xd2881000..0xd28819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0xc7f588 nid=0x195b waiting on monitor [0xd3081000..0xd30819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"RMI RenewClean-[192.168.111.49:4754]" daemon prio=5 tid=0x2226558 nid=0x1959 waiting on monitor [0xd3d81000..0xd3d819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
     at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
     at java.lang.Thread.run(Thread.java:479)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0xb85490 nid=0x1910 waiting on monitor [0xd4281000..0xd42819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2ae1240 nid=0x1905 waiting on monitor [0xd2381000..0xd23819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
     at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
     at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
     at weblogic.security.Security.runAs(Security.java:41)
     at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
     at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
     at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
     at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2b2a800 nid=0x1904 waiting on monitor [0xd2481000..0xd24819e0]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:415)
     at net.appl.jrisk.util.thread.WakeUpThread.doRun

Hi Joe,
With the patch you've sent me we haven't seen the issue so far and we've
been running our servers for more than 12 hours now.
But we don't want to disable the refresh since we don't like the
performance hit associated with setting testConnectionOnReserve to
'true' (we've measured it to be between 5 and 10 percent) so this is the
only mechanism we rely on for refreshing the connections.
Thanks for your help,
Dejan
Joseph Weinstein wrote:
Joseph Weinstein wrote:
"Deyan D. Bektchiev" wrote:
Hi we got into this situation after running our application for a few
hours and now the JDBC connection pool is completely dead locked.
The thread dump looks approximately the same for the last two hours with
a lot of thread trying to get monitor access in ResourceAllocator.
Has anyone seen this or a way to work around it?
The server is Weblogic 7.0 SP1 on Solaris 8.0.
Thanks,
Dejan
Hi. I just analysed this thread dump. The key to the blockage (it's not
a deadlock) is:
Your pool is running refresh at this time. Unless you really need
refresh, I recommend not using it. Refresh at this time has found a
pool connection that did not pass the test (indicating an oracle problem),
and is busy closing the bad connection. Part of this closing the connection
is involving a call to the broken connection that is hanging. This hang is
blocking all other access to the pool. I do see that refresh is making
unnecessary JDBC calls to the failed connection, after we already know
we're going to close it. How quickly duplicable is this failure case? Do you
have any indication as to the state of the DBMS at this time?
Please take the attached jar file and get it ahead of all standard weblogic stuff
in the server's classpath, and let me know if this helps. It won't be able to change
the DBMS state that hung the call, but it removes all the unnecessary DBMS
calls that we were making, in the case when we know we're going to close a
connection anyway...
Joe
Full thread dump:
"RMI RenewClean-[192.168.111.47:3959]" daemon prio=5 tid=0x2be7048 nid=0x1e81 waiting on monitor [0xd1f81000..0xd1f819e0]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
at java.lang.Thread.run(Thread.java:479)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2c04f28 nid=0x1e80 waiting on monitor [0xd2081000..0xd20819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"JmsPublisher.kerneltest.COMPUTE1.1920392681264132352" daemon prio=5 tid=0x2b1ea08 nid=0x1e7f waiting on monitor [0xd2281000..0xd22819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread.runUnauthenticated(WakeUpThread.java:177)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:133)
"RV Event Dispatch" daemon prio=5 tid=0x2b22668 nid=0x1e7e waiting on monitor [0xd2681000..0xd26819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at COM.TIBCO.rv.RvQ.waitEvent(RvQ.java:79)
at COM.TIBCO.rv.RvDataDispatch.run(RvDataDispatch.java:36)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x21ffb18 nid=0x1e7d waiting on monitor [0xd3581000..0xd35819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2ac3778 nid=0x1e77 waiting on monitor [0xd2781000..0xd27819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2bec498 nid=0x1e76 waiting on monitor [0xd2c81000..0xd2c819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2200520 nid=0x1e75 waiting on monitor [0xd2e81000..0xd2e819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"JmsPublisher.kerneltest.COMPUTE1.6107795875676143616" daemon prio=5 tid=0xb87518 nid=0x1e74 waiting on monitor [0xd2f81000..0xd2f819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread.runUnauthenticated(WakeUpThread.java:177)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:133)
"RV Event Dispatch" daemon prio=5 tid=0x2ab9b0 nid=0x1e73 waiting on monitor [0xd3181000..0xd31819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at COM.TIBCO.rv.RvQ.waitEvent(RvQ.java:79)
at COM.TIBCO.rv.RvDataDispatch.run(RvDataDispatch.java:36)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x55e080 nid=0x1e72 waiting on monitor [0xd3381000..0xd33819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"RMI RenewClean-[192.168.111.54:2306]" daemon prio=5 tid=0x2ad62e0 nid=0x1e70 waiting on monitor [0xd3781000..0xd37819e0]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
at java.lang.Thread.run(Thread.java:479)
"RMI RenewClean-[192.168.111.54:2308]" daemon prio=5 tid=0x2beefe8 nid=0x1e6e waiting on monitor [0xd3a81000..0xd3a819e0]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:490)
at java.lang.Thread.run(Thread.java:479)
"JRiskTimerCallbackThread" daemon prio=6 tid=0x21ae390 nid=0x1e3b waiting for monitor entry [0xd8500000..0xd85019e0]
at weblogic.jdbc.common.internal.ResourceAllocator.markBorrowed(ResourceAllocator.java:575)
at weblogic.jdbc.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:674)
at weblogic.jdbc.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:655)
at weblogic.jdbc.common.internal.ResourceAllocator.reserveWaitSecs(ResourceAllocator.java:645)
at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:163)
at weblogic.jdbc.common.internal.ConnectionPool.reserveWaitSecs(ConnectionPool.java:118)
at weblogic.jdbc.pool.Driver.connect(Driver.java:193)
at weblogic.jdbc.jts.Driver.getNonTxConnection(Driver.java:374)
at weblogic.jdbc.jts.Driver.connect(Driver.java:129)
at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:265)
at net.appl.jrisk.ejb.ejbDbConnectionHelper.getConnection(ejbDbConnectionHelper.java:167)
at net.appl.jrisk.ejb.ejbDbConnectionHelper.getDbConnection(ejbDbConnectionHelper.java:137)
at net.appl.jrisk.db.dbConnectionFactory.getDbConnection(dbConnectionFactory.java:82)
at net.appl.jrisk.ejb.tx.RTEventCleaner$RTEventProcessor.checkAndSendEvents(RTEventCleaner.java:261)
at net.appl.jrisk.ejb.tx.RTEventCleaner$RTEventProcessor.onTimer(RTEventCleaner.java:200)
at net.appl.jrisk.time.SystemTimerCallbackThread$1.run(Timer.java:389)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:785)
at weblogic.security.Security.runAs(Security.java:61)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedExceptionAction(WeblogicJRiskSecurityHelper.java:264)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedExceptionAction(DefaultJRiskSecurityHelper.java:271)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedExceptionAction(DefaultJRiskSecurityHelper.java:271)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedExceptionAction(JRiskSecurity.java:230)
at net.appl.jrisk.time.SystemTimerCallbackThread.run(Timer.java:385)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21a2090 nid=0x1e39 waiting on monitor [0xd2981000..0xd29819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x21a5080 nid=0x1e38 waiting on monitor [0xd2b81000..0xd2b819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0xcaae58 nid=0x1e26 waiting on monitor [0xd3e81000..0xd3e819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21fab90 nid=0x1e1f waiting on monitor [0xd3481000..0xd34819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2ad99a0 nid=0x1e1e waiting on monitor [0xd3981000..0xd39819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2213560 nid=0x1a3b waiting on monitor [0xd4181000..0xd41819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21fece8 nid=0x1a38 waiting on monitor [0xd3f81000..0xd3f819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x22153f8 nid=0x1a37 waiting on monitor [0xd4581000..0xd45819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x2ad3bd8 nid=0x1971 waiting on monitor [0xd4a81000..0xd4a819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21eaa50 nid=0x196d waiting on monitor [0xd4681000..0xd46819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21ac888 nid=0x1962 waiting on monitor [0xd2181000..0xd21819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.MESSAGE.EjbEvent.General" daemon prio=5 tid=0x21ac748 nid=0x1960 waiting on monitor [0xd2581000..0xd25819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.DefaultJRiskSecurityHelper.doPrivilegedAction(DefaultJRiskSecurityHelper.java:262)
at net.appl.jrisk.security.JRiskSecurity.doPrivilegedAction(JRiskSecurity.java:193)
at net.appl.jrisk.util.thread.WakeUpThread.runAuthenticated(WakeUpThread.java:149)
at net.appl.jrisk.util.thread.WakeUpThread.run(WakeUpThread.java:137)
"InfobusConsumer.kerneltest.COMPUTE1.Admin.JobCancel" daemon prio=5 tid=0x2226bd8 nid=0x195e waiting on monitor [0xd2881000..0xd28819e0]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at net.appl.jrisk.util.thread.WakeUpThread.doRun(WakeUpThread.java:192)
at net.appl.jrisk.util.thread.WakeUpThread$1.run(WakeUpThread.java:153)
at weblogic.security.service.SecurityServiceManager.runAs(SecurityServiceManager.java:744)
at weblogic.security.Security.runAs(Security.java:41)
at net.appl.jrisk.security.ejb.weblogic.WeblogicJRiskSecurityHelper.doPrivilegedAction(WeblogicJRiskSecurityHelper.java:203)
at net.appl.jrisk.security.Defa

Similar Messages

  • Jdbc dead lock thread dump

    We have the following thread dump during jdbc dead lock, btw, we are using weblogic60sp2
    and its bundled jdbc driver, I have a question, since I see many thread block
    on jts.Connection.internalRollback, is it true that different theads can concurrently
    access jts connection? If not, how could we explain the block on jts.Connection.internalRollback?
    Thanks
    Full thread dump:
    "HttpPost: 1" prio=5 tid=0x2651ef8 nid=0x51 waiting on monitor [0x61a01000..0x61a01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "mail: 1" prio=5 tid=0x2276910 nid=0x50 waiting on monitor [0x61b01000..0x61b01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "HighPriority TimeEventGenerator" daemon prio=9 tid=0x206fb00 nid=0x4f waiting
    on monitor [0x61c01000..0x61c01a28]
         at java.lang.Object.wait(Native Method)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
         at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
         at java.lang.Thread.run(Thread.java:479)
    "SSLListenThread" prio=5 tid=0x1d21de8 nid=0x4e runnable [0x64501000..0x64501a28]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
         at java.net.ServerSocket.implAccept(ServerSocket.java:238)
         at java.net.ServerSocket.accept(ServerSocket.java:217)
         at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:126)
         at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:117)
         at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
    "ListenThread" prio=5 tid=0x20a1ce8 nid=0x4d runnable [0x61d01000..0x61d01a28]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
         at java.net.ServerSocket.implAccept(ServerSocket.java:238)
         at java.net.ServerSocket.accept(ServerSocket.java:217)
         at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
    "Thread-4" daemon prio=5 tid=0x1d1fdb8 nid=0x4c waiting on monitor [0x61e01000..0x61e01a28]
         at java.lang.Thread.sleep(Native Method)
         at glog.webserver.xslcompiler.ObjectPool$PoolCleaner.run(ObjectPool.java:260)
         at java.lang.Thread.run(Thread.java:479)
    "processSweeper: 1" prio=5 tid=0x1e591f0 nid=0x4b waiting on monitor [0x61f01000..0x61f01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "processCallback: 1" prio=5 tid=0x1e588b0 nid=0x4a waiting on monitor [0x62001000..0x62001a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "processLogging: 1" prio=5 tid=0x1e564c0 nid=0x49 waiting on monitor [0x62101000..0x62101a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "GLog Timer" daemon prio=5 tid=0x1b78888 nid=0x48 waiting on monitor [0x62201000..0x62201a28]
         at java.lang.Thread.sleep(Native Method)
         at glog.server.workflow.TimerThread.sleepSeconds(TimerThread.java:97)
         at glog.server.workflow.TimerThread.run(TimerThread.java:35)
    "default: 1" prio=5 tid=0x1ed4748 nid=0x47 waiting on monitor [0x62301000..0x62301a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "totals: 1" prio=5 tid=0x1ed3c50 nid=0x46 waiting on monitor [0x62401000..0x62401a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "txComplete: 1" prio=5 tid=0x1ed3158 nid=0x45 waiting on monitor [0x62501000..0x62501a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "milestone: 1" prio=5 tid=0x1ed26d8 nid=0x44 waiting on monitor [0x62601000..0x62601a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "OMD: 2" prio=5 tid=0x12c9c08 nid=0x43 runnable [0x626ff000..0x62701a28]
         at java.net.SocketInputStream.socketRead(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:85)
         at oracle.net.ns.Packet.receive(Unknown Source)
         at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
         at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
         at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
         at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
         at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
         at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
         at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
         at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
         at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
         at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
         at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
         at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
         at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
         at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
         at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
         at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
         at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
         at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
         at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
         at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
         at java.lang.reflect.Method.invoke(Native Method)
         at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
         at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
         at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
         at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
         at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
         at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
         at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
         at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
         at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
         at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
         at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
         at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
         at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
         at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
         at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
         at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
         at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "OMD: 1" prio=5 tid=0x12c8d08 nid=0x42 runnable [0x627ff000..0x62801a28]
         at java.net.SocketInputStream.socketRead(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:85)
         at oracle.net.ns.Packet.receive(Unknown Source)
         at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
         at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
         at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
         at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
         at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
         at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
         at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
         at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
         at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
         at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
         at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
         at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
         at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
         at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
         at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
         at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
         at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
         at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
         at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
         at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
         at java.lang.reflect.Method.invoke(Native Method)
         at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
         at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
         at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
         at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
         at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
         at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
         at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
         at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
         at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
         at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
         at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
         at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
         at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
         at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
         at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
         at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
         at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "agentIntegration: 1" prio=5 tid=0x12c8288 nid=0x41 waiting on monitor [0x62901000..0x62901a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 3" prio=5 tid=0x1f0d0d8 nid=0x40 waiting on monitor [0x62a01000..0x62a01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 2" prio=5 tid=0x1f0c658 nid=0x3f waiting on monitor [0x62b01000..0x62b01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 1" prio=5 tid=0x1f0bbd8 nid=0x3e waiting on monitor [0x62c01000..0x62c01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 4" prio=5 tid=0x1f0b158 nid=0x3d waiting on monitor [0x62d01000..0x62d01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 3" prio=5 tid=0x1f0a6d8 nid=0x3c waiting on monitor [0x62e01000..0x62e01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 2" prio=5 tid=0x1ce4838 nid=0x3b waiting on monitor [0x62f01000..0x62f01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 1" prio=5 tid=0x1ce3db8 nid=0x3a waiting on monitor [0x63001000..0x63001a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "publishWait: 4" prio=5 tid=0x1ce2d30 nid=0x39 waiting on monitor [0x63100000..0x63101a28]
         at java.lang.Object.wait(Native Method)
         at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
         at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
         at glog.server.workflow.Topic.publishWait(Topic.java:135)
         at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
         at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
         at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
         at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
         at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
         at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
         at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "publishWait: 3" prio=5 tid=0x210f240 nid=0x38 waiting on monitor [0x63200000..0x63201a28]
         at java.lang.Object.wait(Native Method)
         at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
         at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
         at glog.server.workflow.Topic.publishWait(Topic.java:135)
         at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
         at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
         at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
         at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
         at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
         at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
         at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "publishWait: 2" prio=5 tid=0x210e7c0 nid=0x37 waiting on monitor [0x63300000..0x63301a28]
         at java.lang.Object.wait(Native Method)
         at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
         at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
         at glog.server.workflow.Topic.publishWait(Topic.java:135)
         at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
         at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
         at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
         at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
         at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
         at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
         at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "publishWait: 1" prio=5 tid=0x210dd40 nid=0x36 waiting on monitor [0x63400000..0x63401a28]
         at java.lang.Object.wait(Native Method)
         at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
         at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
         at glog.server.workflow.Topic.publishWait(Topic.java:135)
         at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
         at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
         at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
         at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
         at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
         at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
         at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "http: 4" prio=5 tid=0x210d2c0 nid=0x35 waiting on monitor [0x63501000..0x63501a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "http: 3" prio=5 tid=0x210c840 nid=0x34 waiting on monitor [0x63601000..0x63601a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "http: 2" prio=5 tid=0x20cdc20 nid=0x33 waiting on monitor [0x63701000..0x63701a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "http: 1" prio=5 tid=0x20cd1a0 nid=0x32 waiting on monitor [0x63801000..0x63801a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "lifetime: 1" prio=5 tid=0x20cc720 nid=0x31 waiting on monitor [0x63901000..0x63901a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "utility: 4" prio=5 tid=0x20cbd40 nid=0x30 waiting on monitor [0x63a01000..0x63a01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "utility: 3" prio=5 tid=0x20b84e8 nid=0x2f waiting on monitor [0x63b01000..0x63b01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "utility: 2" prio=5 tid=0x20b7a68 nid=0x2e waiting on monitor [0x63c01000..0x63c01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "utility: 1" prio=5 tid=0x1d97ae8 nid=0x2d waiting on monitor [0x63d01000..0x63d01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "shipmentEvents: 1" prio=5 tid=0x1d979a8 nid=0x2c waiting on monitor [0x63e01000..0x63e01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "execution: 2" prio=5 tid=0x1d97468 nid=0x2b waiting on monitor [0x63f01000..0x63f01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "execution: 1" prio=5 tid=0x1f27670 nid=0x2a waiting on monitor [0x64001000..0x64001a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "integration: 1" prio=5 tid=0x1f27530 nid=0x29 waiting on monitor [0x64101000..0x64101a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "batch: 2" prio=5 tid=0x20621e8 nid=0x28 waiting on monitor [0x64201000..0x64201a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "batch: 1" prio=5 tid=0x1eb4160 nid=0x27 waiting on monitor [0x64301000..0x64301a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "EventDefault: 1" prio=5 tid=0x1fb0e38 nid=0x26 waiting on monitor [0x64401000..0x64401a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "Application Manager Thread" prio=5 tid=0x1ce9b08 nid=0x24 waiting on monitor
    [0x64601000..0x64601a28]
         at java.lang.Thread.sleep(Native Method)
         at weblogic.management.mbeans.custom.ApplicationManager$ApplicationPoller.run(ApplicationManager.java:644)
    "ExecuteThread: '1' for queue: '__weblogic_admin_rmi_queue'" daemon prio=5 tid=0x66e198
    nid=0x23 waiting on monitor [0x6d081000..0x6d081a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
    "ExecuteThread: '0' for queue: '__weblogic_admin_rmi_queue'" daemon prio=5 tid=0x66d858
    nid=0x22 waiting on monitor [0x6d181000..0x6d181a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
    "ExecuteThread: '1' for queue: '__weblogic_admin_html_queue'" daemon prio=5 tid=0x66c910
    nid=0x21 waiting on monitor [0x6d281000..0x6d281a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
    "ExecuteThread: '0' for queue: '__weblogic_admin_html_queue'" daemon prio=5 tid=0x66c3d0
    nid=0x20 waiting on monitor [0x6d381000..0x6d381a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.ja

    Jinosng Hu wrote:
    We have the following thread dump during jdbc dead lock, btw, we are using weblogic60sp2
    and its bundled jdbc driver, I have a question, since I see many thread block
    on jts.Connection.internalRollback, is it true that different theads can concurrently
    access jts connection? If not, how could we explain the block on jts.Connection.internalRollback?
    ThanksHi. What seems to be happening is that our transaction coordinator has found these transactions that have
    exceeded their timeout limit, and is trying to roll back the transaction on the JDBC connection, but is
    blocked by the synchronization of the driver until the user thread running the current JDBC statement
    returns. Would you please try adding this patch to the beginning of the server classpath, and repeat?
    This patch will have the transaction coordinator call Statement.cancel() on all the ongoing statements
    in the transaction before trying to call rollback(). This may solve the problem. Let me know...
    Joe
    PS: Also, please go to the Oracle site and download their latest thin driver. It is more recent and
    better than the version that was available when we packaged our server. Try putting it ahead of
    all weblogic stuff in the server classpath too.
    thanks
    Joe
    >
    >
    Full thread dump:
    "HttpPost: 1" prio=5 tid=0x2651ef8 nid=0x51 waiting on monitor [0x61a01000..0x61a01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "mail: 1" prio=5 tid=0x2276910 nid=0x50 waiting on monitor [0x61b01000..0x61b01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "HighPriority TimeEventGenerator" daemon prio=9 tid=0x206fb00 nid=0x4f waiting
    on monitor [0x61c01000..0x61c01a28]
    at java.lang.Object.wait(Native Method)
    at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
    at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
    at java.lang.Thread.run(Thread.java:479)
    "SSLListenThread" prio=5 tid=0x1d21de8 nid=0x4e runnable [0x64501000..0x64501a28]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
    at java.net.ServerSocket.implAccept(ServerSocket.java:238)
    at java.net.ServerSocket.accept(ServerSocket.java:217)
    at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:126)
    at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:117)
    at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
    "ListenThread" prio=5 tid=0x20a1ce8 nid=0x4d runnable [0x61d01000..0x61d01a28]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
    at java.net.ServerSocket.implAccept(ServerSocket.java:238)
    at java.net.ServerSocket.accept(ServerSocket.java:217)
    at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
    "Thread-4" daemon prio=5 tid=0x1d1fdb8 nid=0x4c waiting on monitor [0x61e01000..0x61e01a28]
    at java.lang.Thread.sleep(Native Method)
    at glog.webserver.xslcompiler.ObjectPool$PoolCleaner.run(ObjectPool.java:260)
    at java.lang.Thread.run(Thread.java:479)
    "processSweeper: 1" prio=5 tid=0x1e591f0 nid=0x4b waiting on monitor [0x61f01000..0x61f01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "processCallback: 1" prio=5 tid=0x1e588b0 nid=0x4a waiting on monitor [0x62001000..0x62001a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "processLogging: 1" prio=5 tid=0x1e564c0 nid=0x49 waiting on monitor [0x62101000..0x62101a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "GLog Timer" daemon prio=5 tid=0x1b78888 nid=0x48 waiting on monitor [0x62201000..0x62201a28]
    at java.lang.Thread.sleep(Native Method)
    at glog.server.workflow.TimerThread.sleepSeconds(TimerThread.java:97)
    at glog.server.workflow.TimerThread.run(TimerThread.java:35)
    "default: 1" prio=5 tid=0x1ed4748 nid=0x47 waiting on monitor [0x62301000..0x62301a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "totals: 1" prio=5 tid=0x1ed3c50 nid=0x46 waiting on monitor [0x62401000..0x62401a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "txComplete: 1" prio=5 tid=0x1ed3158 nid=0x45 waiting on monitor [0x62501000..0x62501a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "milestone: 1" prio=5 tid=0x1ed26d8 nid=0x44 waiting on monitor [0x62601000..0x62601a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "OMD: 2" prio=5 tid=0x12c9c08 nid=0x43 runnable [0x626ff000..0x62701a28]
    at java.net.SocketInputStream.socketRead(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:85)
    at oracle.net.ns.Packet.receive(Unknown Source)
    at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
    at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
    at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
    at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
    at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
    at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
    at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
    at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
    at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
    at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
    at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
    at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
    at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
    at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
    at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
    at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
    at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
    at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
    at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
    at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
    at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
    at java.lang.reflect.Method.invoke(Native Method)
    at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
    at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
    at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
    at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
    at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
    at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
    at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
    at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
    at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
    at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
    at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
    at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
    at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
    at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
    at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
    at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
    at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "OMD: 1" prio=5 tid=0x12c8d08 nid=0x42 runnable [0x627ff000..0x62801a28]
    at java.net.SocketInputStream.socketRead(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:85)
    at oracle.net.ns.Packet.receive(Unknown Source)
    at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
    at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
    at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
    at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
    at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
    at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
    at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
    at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
    at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
    at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
    at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
    at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
    at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
    at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
    at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
    at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
    at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
    at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
    at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
    at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
    at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
    at java.lang.reflect.Method.invoke(Native Method)
    at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
    at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
    at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
    at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
    at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
    at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
    at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
    at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
    at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
    at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
    at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
    at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
    at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
    at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
    at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
    at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
    at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "agentIntegration: 1" prio=5 tid=0x12c8288 nid=0x41 waiting on monitor [0x62901000..0x62901a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 3" prio=5 tid=0x1f0d0d8 nid=0x40 waiting on monitor [0x62a01000..0x62a01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 2" prio=5 tid=0x1f0c658 nid=0x3f waiting on monitor [0x62b01000..0x62b01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 1" prio=5 tid=0x1f0bbd8 nid=0x3e waiting on monitor [0x62c01000..0x62c01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 4" prio=5 tid=0x1f0b158 nid=0x3d waiting on monitor [0x62d01000..0x62d01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 3" prio=5 tid=0x1f0a6d8 nid=0x3c waiting on monitor [0x62e01000..0x62e01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 2" prio=5 tid=0x1ce4838 nid=0x3b waiting on monitor [0x62f01000..0x62f01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 1" prio=5 tid=0x1ce3db8 nid=0x3a waiting on monitor [0x63001000..0x63001a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "publishWait: 4" prio=5 tid=0x1ce2d30 nid=0x39 waiting on monitor [0x63100000..0x63101a28]
    at java.lang.Object.wait(Native Method)
    at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
    at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
    at glog.server.workflow.Topic.publishWait(Topic.java:135)
    at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
    at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
    at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
    at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
    at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
    at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
    at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "publishWait: 3" prio=5 tid=0x210f240 nid=0x38 waiting on monitor [0x63200000..0x63201a28]
    at java.lang.Object.wait(Native Method)
    at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
    at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
    at glog.server.workflow.Topic.publishWait(Topic.java:135)
    at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
    at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
    at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
    at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
    at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
    at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
    at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "publishWait: 2" prio=5 tid=0x210e7c0 nid=0x37 waiting on monitor [0x63300000..0x63301a28]
    at java.lang.Object.wait(Native Method)
    at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
    at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
    at glog.server.workflow.Topic.publishWait(Topic.java:135)
    at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
    at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
    at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
    at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
    at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
    at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
    at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "publishWait: 1" prio=5 tid=0x210dd40 nid=0x36 waiting on monitor [0x63400000..0x63401a28]
    at java.lang.Object.wait(Native Method)
    at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
    at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
    at glog.server.workflow.Topic.publishWait(Topic.java:135)
    at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
    at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
    at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
    at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
    at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
    at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
    at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "http: 4" prio=5 tid=0x210d2c0 nid=0x35 waiting on monitor [0x63501000..0x63501a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "http: 3" prio=5 tid=0x210c840 nid=0x34 waiting on monitor [0x63601000..0x63601a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "http: 2" prio=5 tid=0x20cdc20 nid=0x33 waiting on monitor [0x63701000..0x63701a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "http: 1" prio=5 tid=0x20cd1a0 nid=0x32 waiting on monitor [0x63801000..0x63801a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "lifetime: 1" prio=5 tid=0x20cc720 nid=0x31 waiting on monitor [0x63901000..0x63901a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "utility: 4" prio=5 tid=0x20cbd40 nid=0x30 waiting on monitor [0x63a01000..0x63a01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "utility: 3" prio=5 tid=0x20b84e8 nid=0x2f waiting on monitor [0x63b01000..0x63b01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "utility: 2" prio=5 tid=0x20b7a68 nid=0x2e waiting on monitor [0x63c01000..0x63c01a28]
    at java.lang.Object.

  • Dead lock problem occur in Ms-Sql Server

    Hi friends,
    I am using the 1,Tomcat server
    2, jdbc-odbc-bridge driver
    In my applicaiton .mutli user access time its throw -deadlock
    exception . How to solve the dead lock problem.. please help it.
    Can i modify the Db connection?
    please help me .... How solve the dead lock problem..
    please ............ its urgent

    I am using this stored procedure to occur dead lock condtion. Orderly insert table values ..
    Imm_tblGameTransactions- Primary Tables
    Imm_tblGameDetailsBJ - Secondary tables
    Please check it.....
    Please explain breifly..... ....
    please.........
    CREATE     procedure IMM_BJDeal 
         @plid int,
         @gameid int,
         @betamt money,
         @bal    money,
         @winamt money,
         @usercards nvarchar(500),
         @dealercards nvarchar(500),
         @useracecnt     int,
         @dealeracecnt   int,
         @dealerbj int,
         @userbj      int,
         @insurance   int,
         @split       int,
         @push        int,
         @sessionid   int, 
         @ltransid    int out
    as
        begin
         declare
                @transdate datetime,
                @linitbal  money,
                @lfinalbal money,
                @errormesg  varchar(50)
           select @linitbal=balance from Imm_players.dbo.Imm_tblPlayerbalance where playerid=@plid
           select @transdate=getdate()
              --set @ldealcards ='['+@dealercard1+','+@dealercard2+']'
              --print  @ldealcards
       if(@userbj=1)
           begin
                  select @lfinalbal= @bal
              begin transaction
                    insert into Imm_tblGameTransactions
                              (playerid,gameid,Initialbalance,transactiondate,betamount,winamount,currencycode,finalbalance,sessionid)
                                      values(@plid,@gameid,@linitbal,@transdate,@betamt,@winamt,'USD',@lfinalbal,@sessionid)
                             IF @@ERROR <> 0
                                  Begin
                                    -- There's an error b/c @ERROR is not 0, rollback
                                         ROLLBACK
                                       return
                                  End
                    select @ltransid=@@identity from Imm_tblGameTransactions
                   insert into Imm_tblGameDetailsBJ(transid,playercard,dealercard,typeid,result,statusid,split,insurance,playercardcount,dealercardcount,winvalue,betvalue)
                                         values(@ltransid,@usercards,@dealercards ,1,1,'PB',@split,@insurance,@useracecnt,@dealeracecnt,@winamt,@betamt)
                    IF @@ERROR <> 0
                   begin
                     -- There's an error b/c @ERROR is not 0, rollback
                          ROLLBACK
                        return
                   end
                   update Imm_players.dbo.Imm_tblPlayerbalance set balance=@lfinalbal where playerid=@plid
              IF @@ERROR <> 0
                   begin
                     -- There's an error b/c @ERROR is not 0, rollback
                          ROLLBACK
                        return     
                   end
                 commit transaction       
              return
           end
       else
           begin
              begin transaction
             insert into Imm_tblGameTransactions(playerid,gameid,Initialbalance,transactiondate,betamount,winamount,currencycode,finalbalance,sessionid)
                                        values(@plid,@gameid,@linitbal,@transdate,@betamt,@winamt,'USD',@bal,@sessionid)
         IF @@ERROR <> 0
              Begin
                -- There's an error b/c @ERROR is not 0, rollback
                     ROLLBACK
                   return
              End
              /*ELSE
                     COMMIT   -- Success!  Commit the transaction*/
             select @ltransid=@@identity from Imm_tblGameTransactions
             insert into Imm_tblGameDetailsBJ(transid,playercard,dealercard,typeid,result,split,insurance,playercardcount,dealercardcount,winvalue,betvalue,statusid)
                                        values(@ltransid,@usercards,@dealercards,1,3,@split,@insurance,@useracecnt,@dealeracecnt,@winamt,@betamt,'G')
         IF @@ERROR <> 0
              Begin
                -- There's an error b/c @ERROR is not 0, rollback
                     ROLLBACK
                   return
              End
              /*ELSE
                     COMMIT   -- Success!  Commit the transaction*/
              commit transaction 
              return           
             end
    end
    GO

  • Dead lock and Blocking Lock

    I would like to understand what is major difference between Dead Locks and Blocking Locks in Oracle. If someone could explain or point me to good web Link I would really appreciate
    Thanks.

    Tony's advise is very good.
    In simple terms a blocking lock is a lock being held by one session that is preventing another session from performing an DML operation on the same data until the holding session commits or rollbacks.
    A deadlock is a situation where two or more sessions lock data in such a manner as each session is waiting on a resource held by another session so that none of the session can complete their unit of work. That is session A locks row 1 then session B locks row 2 followed by session A attempts to lock row 2 while session B now attemps to lock row 1. Neither session A or B will ever be able to complete thier transaction releasing the locks and allowing waiting sessions to process since each session is waiting on a resource that the other session has while holding a resource the other session needs. In other words a deadlock. Oracle detects deadlocks and kills one of the sessions freeing resources.
    HTH -- Mark D Powell --

  • Dead Lock what made by another user!(patition table)

    I have a question about Dead-Lock!
    Our Situation is ..
    User "A" made a Patition Table, ACNT_WONJANG
    (without any Trigger,Function, Procedure)
    When "B" - another user - tried to drop its Partition,
    Dead-Lock invoked.
    but A droped it's Partition well.
    What can i Do?
    this is the trace file.
    /oracle/home/admin/ACNT/udump/ora_44478_acnt.trc
    Oracle8i Enterprise Edition Release 8.1.7.0.0 - Production
    With the Partitioning option
    JServer Release 8.1.7.0.0 - Production
    ORACLE_HOME = /oracle/home
    System name: AIX
    Node name: acnt
    Release: 3
    Version: 4
    Machine: 000C962D4C00
    Instance name: ACNT
    Redo thread mounted by this instance: 1
    Oracle process number: 15
    Unix process pid: 44478, image: oracle@acnt (TNS V1-V3)
    *** SESSION ID:(16.394) 2001-10-04 15:00:41.829
    A self-deadlock among DDL and parse locks
    is detected. In most cases, this self-deadlock
    is handled internally.
    This should be reported to Oracle Support
    ONLY IF an error is signalled back to the
    user on a command-line or screen.
    The following information may aid in finding
    user on a command-line or screen.
    The following information may aid in finding
    the problem.
    ORA-04020: deadlock detected while trying to lock object
    F03P.ACNT_WONJANG
    session: 440786b4 request: X
    LIBRARY OBJECT HANDLE: handle=43108348
    name=F03P.ACNT_WONJANG
    hash=76b93583 timestamp=NULL
    namespace=TABL/PRCD/TYPE flags=KGHP/TIM/SML/[02000000]
    kkkk-dddd-llll=0000-0001-0001 lock=S pin=S latch=0
    lwt=43108360[43108360,43108360] ltm=43108368[43108368,43108368]
    pwt=43108378[43108378,43108378] ptm=431083d0[431083d0,431083d0]
    ref=43108350[43108350,43108350] lnd=431083dc[4310824c,425b7ec4]
    LIBRARY OBJECT: object=431080d0
    flags=NEX[0002] pflags= [00] status=VALD load=0
    DATA BLOCKS:
    data# heap pointer status pins change
    0 431082d8 43108154 I/P/A 0 NONE
    HEAP DUMP OF DATA BLOCK 0:
    HEAP DUMP heap name="library cache" desc=0x431082d8
    HEAP DUMP heap name="library cache" desc=0x431082d8
    extent sz=0x224 alt=32767 het=8 rec=9 flg=2 opc=0
    parent=30000030 owner=431080d0 nex=0 xsz=0x0
    EXTENT 0
    Chunk 431080c0 sz= 196 perm "perm "
    alo=196
    431080C0 500000C5 00000000 00000000 000000C4 [P...............]
    431080D0 43108348 431080D4 431080D4 431080DC [C..HC...C...C...]
    431080E0 431080DC 00000000 00000000 00020100 [C...............]
    431080F0 00000000 00000000 00000000 00000000 [................]
    43108100 43108144 00000000 00000000 00000000 [C..D............]
    43108110 00000000 00000000 00000000 00000000 [................]
    Repeat 2 times
    43108140 00000000 431082D8 00000000 43108154 [....C.......C..T]
    43108150 00000000 00000000 00000000 00000000 [................]
    Repeat 1 times
    43108170 00000000 00000000 00000019 00000000 [................]
    43108180 00000000 [....]
    Total heap size = 196
    FREE LISTS:
    Bucket 0 size=0
    Total free space = 0
    UNPINNED RECREATABLE CHUNKS (lru first):
    Total free space = 0
    UNPINNED RECREATABLE CHUNKS (lru first):
    PERMANENT CHUNKS:
    Chunk 431080c0 sz= 196 perm "perm "
    alo=196
    Permanent space = 196

    carlyfromal wrote:
    Here's the thing I myself have an Ipad 3 that I got from Ebay that is activation locked and I have the same issue. Can't get the info. Well,since Apple conveniently decided to discontinue selling the Ipad 3 the only way I could get one was to buy a used one,so it looks to me like they could have some mercy and help a person unlock the thing. We're not dishonest people that go around stealing things,yet because of Apple's brilliant(I use that term sarcastically) idea to put this stupid new crap in place people like us who have to buy second-hand products have to suffer and get screwed out of money we had to save up to buy this stuff! And all anyone can come up with is "well boohoo" or "tough luck" or whatever! But,what about the rights of the rest of us?! Some of you may find this a tad rude, but oh well,tough luck!
    On the other hand, there are those of us that appreciate the theft protection provided by the latest IOS.
    There are certain things to watch out for when purchasing used devices of any sort, the first of which is to ensure that you're not buying stolen property.  Since you are unable to obtain cooperation from the seller, perhaps your device was stolen!

  • Frequenet dead locks in SQL Server 2008 R2 SP2

    Hi,
    We are experiencing frequent dead locks in our application. We are using MSSQL Server 2008 R2 SP2 version. When our application is configured for 5-6 app servers, this issue is occurring frequently.
    But, when the same application is used with the MSSQL Server 2008 R2 or SQL Server 2012, we don't see the dead lock issue. From the error lock and sql trace, the error message is thrown for the database table JobLock. We have a stored procedure to insert/update
    for the above table when the job moves from one service to other. The same procedure works fine when used with the 2008 R2 and SQL Server 2012 Version.
    Is the above issue related to the hotfix from the below url?
    http://support.microsoft.com/kb/2703275
    Following error message is seen frequently in the log file.
    INFO : 03/24/2014 10:26:30:290 PM: [00007900:00005932] [Xerox.ISP.Workflow.ManagedActivity.PersistInTransaction] System.Data.SqlClient.SqlException (0x80131904): Transaction (Process ID 62) was deadlocked on lock resources with another process and has been
    chosen as the deadlock victim. Rerun the transaction.
       at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
       at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
       at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
       at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
       at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)
       at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async, Int32 timeout, Task& task, Boolean asyncWrite, SqlDataReader ds)
       at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, TaskCompletionSource`1 completion, Int32 timeout, Task& task, Boolean asyncWrite)
       at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(TaskCompletionSource`1 completion, String methodName, Boolean sendToPipe, Int32 timeout, Boolean asyncWrite)
       at System.Data.SqlClient.SqlCommand.ExecuteNonQuery()
       at Microsoft.Practices.EnterpriseLibrary.Data.Database.DoExecuteNonQuery(DbCommand command)
       at Microsoft.Practices.EnterpriseLibrary.Data.Database.ExecuteNonQuery(DbCommand command, DbTransaction transaction)
       at Xerox.ISP.DataAccess.Data.Utility.ExecuteNonQuery(TransactionManager transactionManager, DbCommand dbCommand)
       at Xerox.ISP.DataAccess.Data.SqlClient.SqlActivityProviderBase.ActivityReady(TransactionManager transactionManager, Int32 start, Int32 pageLength, Nullable`1 ActivityID, Nullable`1 JobId, String ContentUrl, Nullable`1 PrevWorkStep, Nullable`1
    CurrentWorkStep, String Principal, Nullable`1 Status, Nullable`1 ServerID, String HostName, Nullable`1 LockUserID, Nullable`1& ErrorCode, Byte[]& Activity_TS)
       at Xerox.ISP.DataAccess.Domain.ActivityBase.ActivityReady(Nullable`1 ActivityID, Nullable`1 JobId, String ContentUrl, Nullable`1 PrevWorkStep, Nullable`1 CurrentWorkStep, String Principal, Nullable`1 Status, Nullable`1 ServerID, String HostName,
    Nullable`1 LockUserID, Nullable`1& ErrorCode, Byte[]& Activity_TS, Int32 start, Int32 pageLength)
       at Xerox.ISP.DataAccess.Domain.ActivityBase.ActivityReady(Nullable`1 ActivityID, Nullable`1 JobId, String ContentUrl, Nullable`1 PrevWorkStep, Nullable`1 CurrentWorkStep, String Principal, Nullable`1 Status, Nullable`1 ServerID, String HostName,
    Nullable`1 LockUserID, Nullable`1& ErrorCode, Byte[]& Activity_TS)
       at Xerox.ISP.Workflow.ManagedActivity.<>c__DisplayClass2f.<ActivityReady>b__2d()
       at Xerox.ISP.Workflow.ManagedActivity.PersistInTransaction(Boolean createNew, PersistMethod persist)
    ClientConnectionId:9e44a64f-5014-4634-9cee-4581e1b9c299
    I look forward to the suggestions to get the issue resolved. Your input is much appreciated.
    Thanks,
    Keshava.

    If you are having deadlock trouble in your SQL Server instance, this recipe demonstrates how to make sure deadlocks are logged to the SQL ServerManagement Studio SQL log appropriately using
    the DBCC TRACEON, DBCC TRACEOFF, and DBCC TRACESTATUS commands. These functions enable, disable, and check the status of trace flags.
    To determine the cause of a deadlock, we need to know
    the resources involved and the types of locks acquired and requested. For this kind of information, SQL Server provides
    Trace Flag 1222 (this flag supersedes 1204, which was frequently used in earlier versions of SQL Server.)
    DBCCTRACEON(1222,
    -1);
    GO
    With this flag enabled, SQL Server will provide output in the form of a deadlock graph, showing the executing statements
    for each session, at the time of the deadlock; these are the statements that were blocked and so formed the conflict or cycle that led to the deadlock.
    Be aware that it is rarely possible to guarantee that deadlocks will never occur. Tuning for deadlocks
    primarily involves minimizing the likelihood of their occurrence. Most of the techniques for minimizing the occurrence of deadlocks are similar to the general techniques for minimizing blocking problems.

  • Dead lock error while updating data into cube

    We have a scenario of daily truncate and upload of data into cube and volumes arrive @ 2 million per day.We have Parallel process setting (psa and data targets in parallel) in infopackage setting to speed up the data load process.This entire process runs thru process chain.
    We are facing dead lock issue everyday.How to avoid this ?
    In general dead lock occurs because of degenerated indexes if the volumes are very high. so my question is does deletion of Indexes of the cube everyday along with 'deletion of data target content' process help to avoiding dead lock ?
    Also observed is updation of values into one infoobject is taking longer time approx 3 mins for each data packet.That infoobject is placed in dimension and defined it as line item as the volumes are very high for that specific object.
    so this is over all scenario !!
    two things :
    1) will deletion of indexes and recreation help to avoid dead lock ?
    2) any idea why the insertion into the infoobject is taking longer time (there is a direct read on sid table of that object while observed in sql statement).
    Regards.

    hello,
    1) will deletion of indexes and recreation help to avoid dead lock ?
    Ans:
    To avoid this problem, we need to drop the indexes of the cube before uploading the data.and rebuild the indexes...
    Also,
    just find out in SM12 which is the process which is causing lock.... Delete that.
    find out the process in SM66 which is running for a very long time.Stop  this process.
    Check the transaction SM50 for the number of processes available in the system. If they are not adequate, you have to increase them with the help of basis team
    2) any idea why the insertion into the infoobject is taking longer time (there is a direct read on sid table of that object while observed in sql statement).
    Ans:
    Lie item dimension is one of the ways to improve data load as well as query performance by eliminationg the need for dimensin table. So while loading/reading, one less table to deal with..
    Check in the transformation mapping of that chs, it any rouitne/formula  is written.If so, this can lead to more time for processing that IO.
    Storing mass data in InfoCubes at document level is generally not recommended because when data is loaded, a huge SID table is created for the document number line-item dimension.
    check if your IO is similar to doc no...
    Regards,
    Dhanya

  • Restore using TSPITR Results  Dead lock error

    This is the step is followed but i am getting deadlock error .please give your valuable suggestion .
    Product Used:oracle 11g in linux environmnet
    1)Before taking backup get SCN number for restore.
    Command applied: Select current_scn from v$database;
    2)running Full backup of database
    Command applied:
    configure controlfile autobackup on;
    backup database;
    CROSSCHECK BACKUP;
    exit;
    3)Running level 0 incremental backup
    Command applied:
    BACKUP AS COMPRESSED BACKUPSET INCREMENTAL LEVEL 0 TAG ='WEEKLY' TABLESPACE TEST;
    exit;
    3) Running level 1 incremental backup
    Command applied:
    BACKUP AS COMPRESSED BACKUPSET INCREMENTAL LEVEL 1 TAG ='DAILY' TABLESPACE TEST;
    4)Before Restore(TSPITR) following procedure are applied under sysdba privilege
    Command applied:
    SQL 'exec dbms_backup_restore.manageauxinstance ('TSPITR',1)';
    5)TSPITR Restore command
    Command applied:
    run
    SQL 'ALTER TABLESPACE TEST OFFLINE'
    RECOVER TABLESPACE TEST UNTIL SCN 1791053 AUXILIARY DESTINATION '/opt/oracle/base/flash_recovery_area';
    SQL 'ALTER TABLESPACE TEST ONLINE';
    and i tried with this option also(the same error i was getting)
    Command applied:
    run
    SQL 'ALTER TABLESPACE TEST OFFLINE';
    SET UNTIL SCN 1912813;
    RESTORE TABLESPACE TEST ;
    RECOVER TABLESPACE TEST UNTIL SCN 1912813 AUXILIARY DESTINATION '/opt/oracle/base/flash_recovery_area';
    SQL 'ALTER TABLESPACE TEST ONLINE';
    The follwing error i get for above mentioned restore command
    Recovery Manager: Release 11.2.0.1.0 - Production on Tue Aug 17 18:11:18 2010
    Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
    connected to target database: NEW10 (DBID=2860680927)
    RMAN> run
    2> {
    3> SQL 'ALTER TABLESPACE TEST OFFLINE';
    4> RECOVER TABLESPACE TEST UNTIL SCN 1791053 AUXILIARY DESTINATION '/opt/oracle/base/flash_recovery_area';
    5> SQL 'ALTER TABLESPACE TEST ONLINE';
    6> }
    7>
    using target database control file instead of recovery catalog
    sql statement: ALTER TABLESPACE TEST OFFLINE
    Starting recover at 17-AUG-10
    allocated channel: ORA_DISK_1
    channel ORA_DISK_1: SID=404 device type=DISK
    RMAN-05026: WARNING: presuming following set of tablespaces applies to specified point-in-time
    List of tablespaces expected to have UNDO segments
    Tablespace SYSTEM
    Tablespace UNDOTBS1
    Creating automatic instance, with SID='BkAq'
    initialization parameters used for automatic instance:
    db_name=NEW10
    db_unique_name=BkAq_tspitr_NEW10
    compatible=11.2.0.0.0
    db_block_size=8192
    db_files=200
    sga_target=280M
    processes=50
    db_create_file_dest=/opt/oracle/base/flash_recovery_area
    log_archive_dest_1='location=/opt/oracle/base/flash_recovery_area'
    #No auxiliary parameter file used
    starting up automatic instance NEW10
    Oracle instance started
    Total System Global Area 292933632 bytes
    Fixed Size 1336092 bytes
    Variable Size 100666596 bytes
    Database Buffers 184549376 bytes
    Redo Buffers 6381568 bytes
    Automatic instance created
    Running TRANSPORT_SET_CHECK on recovery set tablespaces
    TRANSPORT_SET_CHECK completed successfully
    contents of Memory Script:
    # set requested point in time
    set until scn 1791053;
    # restore the controlfile
    restore clone controlfile;
    # mount the controlfile
    sql clone 'alter database mount clone database';
    # archive current online log
    sql 'alter system archive log current';
    # avoid unnecessary autobackups for structural changes during TSPITR
    sql 'begin dbms_backup_restore.AutoBackupFlag(FALSE); end;';
    executing Memory Script
    executing command: SET until clause
    Starting restore at 17-AUG-10
    allocated channel: ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: SID=59 device type=DISK
    channel ORA_AUX_DISK_1: starting datafile backup set restore
    channel ORA_AUX_DISK_1: restoring control file
    channel ORA_AUX_DISK_1: reading from backup piece /opt/oracle/base/flash_recovery_area/NEW10/autobackup/2010_08_17/o1_mf_s_727280767_66nmo8x7_.bkp
    channel ORA_AUX_DISK_1: piece handle=/opt/oracle/base/flash_recovery_area/NEW10/autobackup/2010_08_17/o1_mf_s_727280767_66nmo8x7_.bkp tag=TAG20100817T142607
    channel ORA_AUX_DISK_1: restored backup piece 1
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:00:01
    output file name=/opt/oracle/base/flash_recovery_area/NEW10/controlfile/o1_mf_66o0wsh8_.ctl
    Finished restore at 17-AUG-10
    sql statement: alter database mount clone database
    sql statement: alter system archive log current
    sql statement: begin dbms_backup_restore.AutoBackupFlag(FALSE); end;
    contents of Memory Script:
    # set requested point in time
    set until scn 1791053;
    # set destinations for recovery set and auxiliary set datafiles
    set newname for clone datafile 1 to new;
    set newname for clone datafile 8 to new;
    set newname for clone datafile 3 to new;
    set newname for clone datafile 2 to new;
    set newname for clone datafile 9 to new;
    set newname for clone tempfile 1 to new;
    set newname for datafile 7 to
    "/opt/oracle/base/oradata/NEW10/test01.dbf";
    # switch all tempfiles
    switch clone tempfile all;
    # restore the tablespaces in the recovery set and the auxiliary set
    restore clone datafile 1, 8, 3, 2, 9, 7;
    switch clone datafile all;
    executing Memory Script
    executing command: SET until clause
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    executing command: SET NEWNAME
    renamed tempfile 1 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_temp_%u_.tmp in control file
    Starting restore at 17-AUG-10
    using channel ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: starting datafile backup set restore
    channel ORA_AUX_DISK_1: specifying datafile(s) to restore from backup set
    channel ORA_AUX_DISK_1: restoring datafile 00001 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_%u_.dbf
    channel ORA_AUX_DISK_1: restoring datafile 00008 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_%u_.dbf
    channel ORA_AUX_DISK_1: restoring datafile 00003 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_undotbs1_%u_.dbf
    channel ORA_AUX_DISK_1: restoring datafile 00002 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_%u_.dbf
    channel ORA_AUX_DISK_1: restoring datafile 00009 to /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_%u_.dbf
    channel ORA_AUX_DISK_1: reading from backup piece /opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnndf_TAG20100817T140128_66nl7174_.bkp
    channel ORA_AUX_DISK_1: piece handle=/opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnndf_TAG20100817T140128_66nl7174_.bkp tag=TAG20100817T140128
    channel ORA_AUX_DISK_1: restored backup piece 1
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:02:45
    channel ORA_AUX_DISK_1: starting datafile backup set restore
    channel ORA_AUX_DISK_1: specifying datafile(s) to restore from backup set
    channel ORA_AUX_DISK_1: restoring datafile 00007 to /opt/oracle/base/oradata/NEW10/test01.dbf
    channel ORA_AUX_DISK_1: reading from backup piece /opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnnd0_WEEKLY_66nl9m8k_.bkp
    channel ORA_AUX_DISK_1: piece handle=/opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnnd0_WEEKLY_66nl9m8k_.bkp tag=WEEKLY
    channel ORA_AUX_DISK_1: restored backup piece 1
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:06:55
    Finished restore at 17-AUG-10
    datafile 1 switched to datafile copy
    input datafile copy RECID=6 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_66o0x1sf_.dbf
    datafile 8 switched to datafile copy
    input datafile copy RECID=7 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_66o0x1r9_.dbf
    datafile 3 switched to datafile copy
    input datafile copy RECID=8 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_undotbs1_66o0x1vr_.dbf
    datafile 2 switched to datafile copy
    input datafile copy RECID=9 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_66o0x1vj_.dbf
    datafile 9 switched to datafile copy
    input datafile copy RECID=10 STAMP=727294911 file name=/opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_66o0x1rs_.dbf
    contents of Memory Script:
    # set requested point in time
    set until scn 1791053;
    # online the datafiles restored or switched
    sql clone "alter database datafile 1 online";
    sql clone "alter database datafile 8 online";
    sql clone "alter database datafile 3 online";
    sql clone "alter database datafile 2 online";
    sql clone "alter database datafile 9 online";
    sql clone "alter database datafile 7 online";
    # recover and open resetlogs
    recover clone database tablespace "TEST", "SYSTEM", "UNDOTBS1", "SYSAUX" delete archivelog;
    alter clone database open resetlogs;
    executing Memory Script
    executing command: SET until clause
    sql statement: alter database datafile 1 online
    sql statement: alter database datafile 8 online
    sql statement: alter database datafile 3 online
    sql statement: alter database datafile 2 online
    sql statement: alter database datafile 9 online
    sql statement: alter database datafile 7 online
    Starting recover at 17-AUG-10
    using channel ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: starting incremental datafile backup set restore
    channel ORA_AUX_DISK_1: specifying datafile(s) to restore from backup set
    destination for restore of datafile 00007: /opt/oracle/base/oradata/NEW10/test01.dbf
    channel ORA_AUX_DISK_1: reading from backup piece /opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnnd1_DAILY_66nmf6qs_.bkp
    channel ORA_AUX_DISK_1: piece handle=/opt/oracle/base/flash_recovery_area/NEW10/backupset/2010_08_17/o1_mf_nnnd1_DAILY_66nmf6qs_.bkp tag=DAILY
    channel ORA_AUX_DISK_1: restored backup piece 1
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:00:01
    starting media recovery
    archived log for thread 1 with sequence 39 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_39_66nmc1dg_.arc
    archived log for thread 1 with sequence 40 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_40_66nmcfw4_.arc
    archived log for thread 1 with sequence 41 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_41_66nmcwcf_.arc
    archived log for thread 1 with sequence 42 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_42_66nmddbw_.arc
    archived log for thread 1 with sequence 43 is already on disk as file /opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_43_66o0wyys_.arc
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_39_66nmc1dg_.arc thread=1 sequence=39
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_40_66nmcfw4_.arc thread=1 sequence=40
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_41_66nmcwcf_.arc thread=1 sequence=41
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_42_66nmddbw_.arc thread=1 sequence=42
    archived log file name=/opt/oracle/base/flash_recovery_area/NEW10/archivelog/2010_08_17/o1_mf_1_43_66o0wyys_.arc thread=1 sequence=43
    media recovery complete, elapsed time: 00:00:50
    Finished recover at 17-AUG-10
    database opened
    contents of Memory Script:
    # make read only the tablespace that will be exported
    sql clone 'alter tablespace TEST read only';
    # create directory for datapump import
    sql "create or replace directory TSPITR_DIROBJ_DPDIR as ''
    /opt/oracle/base/flash_recovery_area''";
    # create directory for datapump export
    sql clone "create or replace directory TSPITR_DIROBJ_DPDIR as ''
    /opt/oracle/base/flash_recovery_area''";
    executing Memory Script
    sql statement: alter tablespace TEST read only
    sql statement: create or replace directory TSPITR_DIROBJ_DPDIR as ''/opt/oracle/base/flash_recovery_area''
    sql statement: create or replace directory TSPITR_DIROBJ_DPDIR as ''/opt/oracle/base/flash_recovery_area''
    Performing export of metadata...
    EXPDP> Starting "SYS"."TSPITR_EXP_BkAq":
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/PLUGTS_BLK
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/TABLE
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/GRANT/OWNER_GRANT/OBJECT_GRANT
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/INDEX
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/CONSTRAINT/CONSTRAINT
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/INDEX_STATISTICS
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/TRIGGER
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/TABLE_STATISTICS
    EXPDP> Processing object type TRANSPORTABLE_EXPORT/POST_INSTANCE/PLUGTS_BLK
    EXPDP> Master table "SYS"."TSPITR_EXP_BkAq" successfully loaded/unloaded
    EXPDP> ******************************************************************************
    EXPDP> Dump file set for SYS.TSPITR_EXP_BkAq is:
    EXPDP> /opt/oracle/base/flash_recovery_area/tspitr_BkAq_82690.dmp
    EXPDP> ******************************************************************************
    EXPDP> Datafiles required for transportable tablespace TEST:
    EXPDP> /opt/oracle/base/oradata/NEW10/test01.dbf
    EXPDP> Job "SYS"."TSPITR_EXP_BkAq" successfully completed at 18:25:02
    Export completed
    contents of Memory Script:
    # shutdown clone before import
    shutdown clone immediate
    # drop target tablespaces before importing them back
    sql 'drop tablespace TEST including contents keep datafiles';
    executing Memory Script
    database closed
    database dismounted
    Oracle instance shut down
    sql statement: drop tablespace TEST including contents keep datafiles
    Removing automatic instance
    shutting down automatic instance
    target database instance not started
    Automatic instance removed
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_temp_66o1k480_.tmp deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/onlinelog/o1_mf_3_66o1k0mg_.log deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/onlinelog/o1_mf_2_66o1jyt4_.log deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/onlinelog/o1_mf_1_66o1jx3w_.log deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_66o0x1rs_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_sysaux_66o0x1vj_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_undotbs1_66o0x1vr_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_66o0x1r9_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/datafile/o1_mf_system_66o0x1sf_.dbf deleted
    auxiliary instance file /opt/oracle/base/flash_recovery_area/NEW10/controlfile/o1_mf_66o0wsh8_.ctl deleted
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03002: failure of recover command at 08/17/2010 18:25:36
    RMAN-03015: error occurred in stored script Memory Script
    RMAN-03009: failure of sql command on default channel at 08/17/2010 18:25:25
    RMAN-11003: failure during parse/execution of SQL statement: drop tablespace TEST including contents keep datafiles
    ORA-00604: error occurred at recursive SQL level 1
    ORA-00060: deadlock detected while waiting for resource
    Recovery Manager complete.
    please give your valuable suggestion .It should be more helpful for us.
    Edited by: user10750009 on Aug 20, 2010 1:07 AM
    Edited by: user10750009 on Aug 20, 2010 1:15 AM

    I want TSPITR ,during this operation i faced this deadlock error.
    Before that we faced roll backsegment error for that we applied follwing workaround .
    If i applied follwing workaround before every backup and restore .i didn't get any error .all things went successful.
    spool /tmp/Createtest.log
    connect / as sysdba
    REM Perform startup in case we are still down
    ALTER SYSTEM SET PROCESSES=500 SCOPE=SPFILE;
    SHUT IMMEDIATE;
    STARTUP MOUNT EXCLUSIVE;
    ALTER DATABASE ARCHIVELOG;
    ARCHIVE LOG START;
    ALTER DATABASE OPEN;
    connECT / as sysdba;
    alter system set undo_management = MANUAL scope=spfile;
    shutdown immediate;
    startup;
    Connect / as sysdba;
    DROP TABLE TEST123;
    create table test123 (t1 number, t2 varchar2(10));
    begin
    for i in 1.. 300000 loop
    insert into test values (i,'AAAAAAAAAA');
    end loop;
    end;
    delete test123;
    commit;
    alter system set undo_management = auto scope=spfile;
    shutdown immediate ;
    startup ;
    The above workaround we applied before creating tablespace and datafile ,after that we face some dead lock error while restore TSPITR .Did you need any more information
    Edited by: user10750009 on Aug 20, 2010 1:12 AM

  • Does dropping bitmap index and creation of b- index cause any dead locks

    Does dropping a bitmap index on table which is being used continuously for DML operations and creation of b- index cause any dead locks on a table
    in oracle 10g database
    ( 10.1.0.4.0 - 64bi).
    we have seen alert log file which has dead lock occurrence.. would index change/re-creation resulted dead lock or some other reason?
    Could you please give us info or help us on this.. thanks in advance..

    Bitmap indexes can be the cause of deadlocks on busy systems.
    Dropping indexes may cause some locking.
    Creating indexes may cause some locking.
    You haven't given any traces or scripts or lock information, so difficult to say which one (if any) was the cause of your deadlocks.
    It would be better to do this activity when the system is not busy.

  • FOR UPDATE cursor is causing Blocking/ Dead Locking issues

    Hi,
    I am facing one of the complex issues regarding blocking / dead locking issues. Please find below the details and help / suggest me the best approach to ahead with that.
    Its core Investment Banking Domain, in Our Day to day Business we are using many transaction table for processing trades and placing the order. In specific there are two main transaction table
    1)     Transaction table 1
    2)     Transaction table 2
    These both the tables are having huge amount of data. In one of our application to maintain data integrity (During this process we do not want other users to change these rows), we have placed SELECT …………….. FOR UPDATE CURSOR on these two table and we have locked all the rows during the process. And we have batch jobs (shell scripts ) , calling this procedure , we will be running 9 times per day 1 hrs each start at 7:15AM in the morn finish it up in the eve 5PM . Let’s say. The reason we run the same procedure multiple times is, our business wants to know the voucher before its finalized. Because there is a possibility that order can be placed and will be updated/cancelled several times in a single day. So at the end of the day , we will be sending the finalized update to our client.
    20 07 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 08 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 09 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 10 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 11 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 12 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 13 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 14 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 15 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 16 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    20 17 * * 1-5 home/bin/app_process_prc.sh >> home/bin/app1/process.out
    Current Program will look like:
    App_Prc_1
    BEGIN
    /***** taking the order details (source) and will be populate into the table ****/
    CURSOR Cursor_Upload IS
    SELECT col1, col2 … FROM Transaction table1 t 1, Source table 1 s
    WHERE t1.id_no = t2.id_no
    AND t1.id_flag = ‘N’
    FOR UPDATE OF t1.id_flag;
    /************* used for inserting the another entry , if theres any updates happened on the source table , for the records inserted using 1st cursor. **************/
    CURSOR cursor_update IS
    SELECT col1, col2 … FROM transaction table2 t2 , transaction table t1
    WHERE t1.id_no = t2.id_no
    AND t1.id_flag = ‘Y’
    AND t1.DML_ACTION = ‘U’,’D’ -- will retrieve the records which are updated and deleted recently for the inserted records in transaction table 1 for that particular INSERT..
    FOR UPDATE OF t1.id_no,t1.id_flag;
    BLOCK 1
    BEGIN
    FOR v_upload IN Cursor_Upload;
    LOOP
    INSERT INTO transaction table2 ( id_no , dml_action , …. ) VALUES (v_upload.id_no , ‘I’ , … ) RETURNING v_upload.id_no INTO v_no -- I specify for INSERT
    /********* Updating the Flag in the source table after the population ( N into Y ) N  order is not placed yet , Y  order is processed first time )
    UPDATE transaction table1
    SET id_FLAG = ‘Y’
    WHERE id_no = v_no;
    END LOOP;
    EXCEPTION WHEN OTHER THEN
    DBMS_OUTPUT.PUT_LINE( );
    END ;
    BLOCK 2
    BEGIN -- block 2 starts
    FOR v_update IN Cursor_Update;
    LOOP;
    INSERT INTO transaction table2 ( id_no ,id_prev_no, dml_action , …. ) VALUES (v_id_seq_no, v_upload.id_no ,, … ) RETURNING v_upload.id_no INTO v_no
    UPDATE transaction table1
    SET id_FLAG = ‘Y’
    WHERE id_no = v_no;
    END LOOP;
    EXCEPTION WHEN OTHER THEN
    DBMS_OUTPUT.PUT_LINE( );
    END; -- block2 end
    END app_proc; -- Main block end
    Sample output in Transaction table1 :
    Id_no | Tax_amt | re_emburse_amt | Activ_DT | Id_Flag | DML_ACTION
    01 1,835 4300 12/JUN/2009 N I ( these DML Action will be triggered when ever if theres in any DML operation occurs in this table )
    02 1,675 3300 12/JUN/2009 Y U
    03 4475 6500 12/JUN/2009 N D
    Sample output in Transaction table2 :
    Id_no | Prev_id_no Tax_amt | re_emburse_amt | Activ_DT
    001 01 1,835 4300 12/JUN/2009 11:34 AM ( 2nd cursor will populate this value , bcoz there s an update happened for the below records , this is 2nd voucher
    01 0 1,235 6300 12/JUN/2009 09:15 AM ( 1st cursor will populate this record when job run first time )
    02 0 1,675 3300 12/JUN/2009 8:15AM
    003 03 4475 6500 12/JUN/2009 11:30 AM
    03 0 1,235 4300 12/JUN/2009 10:30 AM
    Now the issues is :
    When these Process runs, our other application jobs failing, because it also uses these main 2 tranaction table. So dead lock is detecting in these applications.
    Solutin Needed :
    Can anyone suggest me , like how can rectify this blocking /Locking / Dead lock issues. I wants my other application also will use this tables during these process.
    Regards,
    Maran

    hmmm.... this leads to a warning:
    SQL> ALTER SESSION SET PLSQL_WARNINGS='ENABLE:ALL';
    Session altered.
    CREATE OR REPLACE PROCEDURE MYPROCEDURE
    AS
       MYCOL VARCHAR(10);
    BEGIN
       SELECT col2
       INTO MYCOL
       FROM MYTABLE
       WHERE col1 = 'ORACLE';
    EXCEPTION
       WHEN PIERRE THEN
          NULL;
    END;
    SP2-0804: Procedure created with compilation warnings
    SQL> show errors
    Errors for PROCEDURE MYPROCEDURE:
    LINE/COL                                                                          ERROR
         12/9        PLW-06009: procedure “MYPROCEDURE” PIERRE handler does not end in RAISE or RAISE_APPLICATION_ERROR
         :)

  • Dead Locks

    Gurus,
    Please clarify me the three questions which I am posting below
    1) What's the deadlock situation ? How oracle treats the dead lock situation
    2) Disadvantages of having index
    3) I have two tables A and B .. In table A, I have two columns (say col1, col2) .. Col1 is a primary key column .. In table B, I have two columns (say col3, col4) .. Col3 is a primary key column .. Col2 of A has a referrential integrity to Col3 of B ..And Col4 of B has a referrential integrity to col2 of A .. Now if I am inserting a values in table A ...it is showing error "parent value doesnt exist" .. like wise, if I am inserting values in table B, the above mentioned error is comming ..
    How to overcome this error
    Please advice
    Regards

    Hi.
    1) A dead lock is a situation where two or more sessions acquire locks which then prevent each other from moving on. ie session one updates a row aaa in a table and session two updates row bbb (no commits). Session one then attempts to update row bbb and session two attempts to update row aaa and both wait for the locks to clear (default behaviour). Oracle monitors for these situations and will automatically kill one of the sessions and allow the other to complete.
    2) Indexes are used to speed up access to data in the database and if associated with a Primary or Unique Key, enforce uniqueness. They have the disadvantages of taking up space and slowing down updates and inserts.
    3) This is not a deadlock. It is a circular reference. You cannot insert into one table because the other table is expected to have a parent value and vice versa. From a data modelling point of view a circular reference is unsupportable and meaningless. Like trying to be your father's son and your father's father at the same time.
    Regards
    Andre

  • Dead Lock occured while Sync index in oracle text

    Hi All,
    We are facing dead lock issue which syncing the oracle text index . The index is built on the local partitioned table and the sync index has the parameters below,
    parallel - 4
    memory - 20M
    the error message is,
    System error: Plsql job execution is failed with
    error code -20000 and error message ORA-20000: Oracle Text error: DRG-50610:
    internal error: drvdml.ParallelDML DRG-50857: oracle error in
    drvdml.ParallelDML ORA-12801: error signaled in parallel query server P003,
    instance xxxx.enterprisenet.org:xxxx (1) ORA-20000: Oracle Text error:
    DRG-50857: oracle error in drepdump_dollarp_insert ORA-00060: deadlock detected
    while waiting for resource ORA-06512: at "CTXSYS.DRUE", line 160
    ORA-06512: at "CTXSYS.DRVPARX",
    Thanks in advance.

    How many occurrences of XYZ are there per XML document ?
    If there are more than one, then obviously you cannot create such an index on it.
    In this case, you'll need an XMLIndex, unstructured or structured, depending on the type of queries you want to run.
    If there's only one occurrence, could you post a sample document and your db version?
    Thanks.

  • Sessions were still active eventhough Dead lock detected

    Hi all,
    Yesterday I saw very odd oracle behaviour.When oracle finds Dead lock it should kill those sessions automatically.In my case those two sessions were still trying to run the same update command and were casuing dead locks again and again for 1 Hour.I had to kill those sessions manually to avoid these dea lock.
    How can those sessions were still trying eventhough dead lock detected and causing deadlocks.My logfile filled with this dead lock error.When I killed those sesions it end up with snap shot too old error.
    Please suggest me
    Thanks

    hi
    just ROLLBACK or COMMIT any one session. you will out of dead lock.
    and one more thing is in dead lock situation the sessions were not terminated
    and session wating for releasing locks aquire by another session
    try this one if not work plz reply
    have a nice time
    best luck

  • Ho do i check bcz of which query's the dead locks happend in 11g

    Hi,
    I am working on 11g database and recently dead locks happend and it's released it's fine. But i need to know becz of which query's the dead locks happend and who fired those query's.
    i hope we can get these info from trace file i opend trace file but am fully confusing how do i know all these details. Can any one help me on this...
    Thanks in advance
    Regards

    Check
    How to find where is deadlock?

  • What are dead locks in BW

    hI,
       What are dead locks in BW

    Hi ,
    The concept of dead lock is as similar as in Oracle. If Process P1 is using resource A (locked by P1)) and waiting for B and Process P2is using resouce B(locked by P2) and waiting for resouceA. This creates dead lock as both can not proceed further.
    In BW deadlock usually occur in delta load. As, far as my observance deadlock usually occurs during processing of update rules. This may be because more than one package will be processing same record as in delta load, data moves from changelog of below level to next level.
    Regards
    Sushma

Maybe you are looking for

  • VOIP over VPN dropp RTP protocol

    We are installing a new 2911 ISR in our office and connecting with a Linksys (CISCO) RV016 VPN router.  These are two small doctors offices that need to have computer, and Voip traffic over a VPN. Currently we connect an older RV082 and the RV016 tog

  • Creating a dimension

    I'm making a dimension through OMB. But when i validate my dimension i get errors and warnings. Error: Level attribute x is not bound to a column in a table or updateable view. How can i solve this?

  • Installing a Network Printer

    I am attempting to install a printer that is installed on the network. This is on a Sun-Fire 280R running Solaris 8. I am using lpadmin. lpadmin -p [printername] -v /dev/null lpadmin -p [printername] -m /usr/lib/lp/model/netstandard UX:lpadmin: ERROR

  • New iphone system won't talk to old macbook

    Just got the new software on my iphone 4Gs, but My black macbook (purchased fall 2008) needs a more recent software for the newest itunes required to work with my iphone now.  What can i do?..

  • NLA Disabled. Still can't RDP; "requires Network Level Authentication"

    Had a server I could RDP onto without any issue running Hyper V. I removed the Hyper V role. I then rebooted and attempted to RDP onto the server and can't: The remote computer that you are trying to connect to requires Network Level Authentication (