WL 7.0 thread dump question

Hi,
I am using weblogic 7.0 windows 2000. I have seen unique behaviour with this,
if the server is not accessed for prolonged time, say overnight and in the morning
if I want to take thread dump(by hitting Ctrl+break) it will not work. I need
to restart server to get thread dump, any idea about this?
Yogesh

Ctrl+break is a JVM interrupt command, not WLS.
Is the server accessible? I mean does it respond for PING
BTW, what JDk you are using?
Kumar
Yogesh wrote:
Hi,
I am using weblogic 7.0 windows 2000. I have seen unique behaviour with this,
if the server is not accessed for prolonged time, say overnight and in the morning
if I want to take thread dump(by hitting Ctrl+break) it will not work. I need
to restart server to get thread dump, any idea about this?
Yogesh

Similar Messages

  • Thread Dump Question

    Hi,
    At times our users experience very slow response times. During one such incident I captured a few thread dumps ( 3-4 dumps at 5-10 second intervals). In all the thread dumps I find one thing in common, most of the threads look like they are busy writing to a socket...
    ===================================================
    "ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec85f8 nid=0x21 runnable [ce780000..ce7819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    =========================================================
    I have very limited knowledge about the app and I don't see any method calls in the thread dump to pinpoint the source of the bottleneck. Any ideas on how I should proceed and what information if any I can get from the above thread dump.
    Thank you so much..
    Wap

    Hi,
    I collected a few thread dumps when our servers were slow today and almost all the threads were in the same state as in the first post. I used the console to check what the threads were doing and it appeared that that they were fetching a .js (javascript) file. I consulted the developers and they say all the pages in the app have javascript embedded in them. I fail to understand how this could cause the problem. There were no JDBC connections that were being used actively. Is there any way I can drill down to the source of the problem ( Maybe a particular page is causing the problem). We don't have any performance/application analysis tools. Any pointers to information?
    Thank you so much..
    Wap
    Here is the thread dump...( in the console, I see this message.. HTTP Request: /target/source/JAVASCRIPT/SCRIPTS.JS)
    Full thread dump Java HotSpot(TM) Client VM (1.4.1_05-b01 mixed mode):
    "ExecuteThread: '2' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid=0x3c14b28 nid=0x48 in Object.wait() [ca881000..ca8819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <dbde7868> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '1' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid=0x3c13578 nid=0x47 in Object.wait() [ca981000..ca9819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <dbde7398> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '0' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid=0x3c13090 nid=0x46 in Object.wait() [caa81000..caa819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <dbde6ea8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ListenThread.Default" prio=5 tid=0x3ca4e10 nid=0x45 runnable [cab81000..cab819bc]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
    - locked <dbdac478> (a java.net.PlainSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:448)
    at java.net.ServerSocket.accept(ServerSocket.java:419)
    at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:24)
    at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:739)
    at weblogic.t3.srvr.ListenThread.run(ListenThread.java:292)
    "DefaultQuartzScheduler_QuartzSchedulerThread" prio=5 tid=0x4453f80 nid=0x44 waiting on condition [cb381000..cb3819bc]
    at java.lang.Thread.sleep(Native Method)
    at org.quartz.core.QuartzSchedulerThread.run(QuartzSchedulerThread.java:397)
    "DefaultQuartzScheduler_Worker-9" prio=5 tid=0x44532f8 nid=0x43 in Object.wait() [cb481000..cb4819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-8" prio=5 tid=0x4452748 nid=0x42 in Object.wait() [cb581000..cb5819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-7" prio=5 tid=0x4451b98 nid=0x41 in Object.wait() [cb681000..cb6819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-6" prio=5 tid=0x4451018 nid=0x40 in Object.wait() [cb781000..cb7819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-5" prio=5 tid=0x4461c70 nid=0x3f in Object.wait() [cb881000..cb8819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-4" prio=5 tid=0x4461200 nid=0x3e in Object.wait() [cb981000..cb9819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-3" prio=5 tid=0x4460188 nid=0x3d in Object.wait() [cba81000..cba819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-2" prio=5 tid=0x3e42230 nid=0x3c in Object.wait() [cbb81000..cbb819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-1" prio=5 tid=0x3e41bf0 nid=0x3b in Object.wait() [cbc81000..cbc819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "DefaultQuartzScheduler_Worker-0" prio=5 tid=0x44505e0 nid=0x3a in Object.wait() [cbd81000..cbd819bc]
    at java.lang.Object.wait(Native Method)
    at org.quartz.simpl.SimpleThreadPool.getNextRunnable(SimpleThreadPool.java:418)
    - locked <dbe72108> (a java.lang.Object)
    at org.quartz.simpl.SimpleThreadPool.access$000(SimpleThreadPool.java:53)
    at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:509)
    "Thread-7" prio=5 tid=0x7f3588 nid=0x39 in Object.wait() [ccc81000..ccc819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <da41e0b0> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:429)
    - locked <da41e0b0> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "Thread-6" prio=5 tid=0x130f00 nid=0x38 in Object.wait() [ccd81000..ccd819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <da22c378> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:429)
    - locked <da22c378> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "Thread-5" daemon prio=5 tid=0x4dda20 nid=0x37 in Object.wait() [cd181000..cd1819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at java.util.TimerThread.mainLoop(Timer.java:403)
    - locked <da233248> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "weblogic.health.CoreHealthMonitor" daemon prio=5 tid=0x8e7078 nid=0x36 waiting on condition [cd381000..cd3819bc]
    at java.lang.Thread.sleep(Native Method)
    at weblogic.t3.srvr.CoreHealthMonitorThread.run(CoreHealthMonitorThread.java:127)
    "Thread-4" prio=5 tid=0x8b36e0 nid=0x35 in Object.wait() [cd481000..cd4819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <da01f1b0> (a java.util.TaskQueue)
    at java.util.TimerThread.mainLoop(Timer.java:429)
    - locked <da01f1b0> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:382)
    "ExecuteThread: '0' for queue: 'Multicast'" daemon prio=5 tid=0x8b2760 nid=0x34 in Object.wait() [cd581000..cd5819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9fee6f8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "LDAPConnThread-0 ldap://10.63.7.20:7060" daemon prio=5 tid=0x7bd860 nid=0x33 runnable [cd681000..cd6819bc]
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
    at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
    - locked <d9f687d0> (a java.io.BufferedInputStream)
    at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
    at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
    at java.lang.Thread.run(Thread.java:536)
    "VDE Transaction Processor Thread" prio=2 tid=0xd22090 nid=0x31 in Object.wait() [cd781000..cd7819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <d9f48240> (a com.octetstring.vde.backend.standard.TransactionProcessor)
    at java.lang.Object.wait(Object.java:426)
    at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:356)
    - locked <d9f48240> (a com.octetstring.vde.backend.standard.TransactionProcessor)
    at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
    "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x85e788 nid=0x30 in Object.wait() [cd881000..cd8819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9eaf3c0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x85ddf0 nid=0x2f in Object.wait() [cd981000..cd9819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9eaeea0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x85dc58 nid=0x2e in Object.wait() [cda81000..cda819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <d9eae960> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9eae960> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0xe9b20 nid=0x2d runnable [cdb81000..cdb819bc]
    at weblogic.socket.PosixSocketMuxer.poll(Native Method)
    at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:100)
    - locked <d9c14f40> (a java.lang.String)
    at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0xe90b0 nid=0x2c waiting for monitor entry [cdc81000..cdc819bc]
    at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
    - waiting to lock <d9c14f40> (a java.lang.String)
    at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0xe8ee0 nid=0x2b waiting for monitor entry [cdd81000..cdd819bc]
    at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
    - waiting to lock <d9c14f40> (a java.lang.String)
    at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "weblogic.security.SpinnerRandomSource" daemon prio=5 tid=0xed7850 nid=0x2a in Object.wait() [cde81000..cde819bc]
    at java.lang.Object.wait(Native Method)
    - waiting on <d9c3aee8> (a java.lang.Object)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.security.SpinnerRandomBitsSource.run(SpinnerRandomBitsSource.java:60)
    - locked <d9c3aee8> (a java.lang.Object)
    at java.lang.Thread.run(Thread.java:536)
    "weblogic.time.TimeEventGenerator" daemon prio=9 tid=0xed27b0 nid=0x29 runnable [cdf81000..cdf819bc]
    at java.lang.Object.wait(Native Method)
    at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:271)
    - locked <d9c3af58> (a weblogic.time.common.internal.TimeTable)
    at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:118)
    at java.lang.Thread.run(Thread.java:536)
    "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xecd628 nid=0x28 in Object.wait() [ce081000..ce0819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3afd0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xecca78 nid=0x27 in Object.wait() [ce181000..ce1819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b050> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xecbec8 nid=0x26 in Object.wait() [ce281000..ce2819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b0d0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xecb318 nid=0x25 in Object.wait() [ce381000..ce3819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b150> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '0' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0xeca768 nid=0x24 in Object.wait() [ce481000..ce4819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b1d0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '24' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec9bb8 nid=0x23 runnable [ce581000..ce5819bc]
    at java.net.PlainDatagramSocketImpl.receive(Native Method)
    - waiting to lock <da233350> (a java.net.PlainDatagramSocketImpl)
    at java.net.DatagramSocket.receive(DatagramSocket.java:680)
    - locked <d8851ca8> (a java.net.DatagramPacket)
    - locked <da233380> (a java.net.MulticastSocket)
    at weblogic.cluster.FragmentSocket.receive(FragmentSocket.java:169)
    at weblogic.cluster.MulticastManager.execute(MulticastManager.java:377)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '23' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec9008 nid=0x22 runnable [ce680000..ce6819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec8458 nid=0x21 runnable [ce780000..ce7819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '21' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec78a8 nid=0x20 runnable [ce880000..ce8819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '20' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec62e8 nid=0x1f runnable [ce980000..ce9819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '19' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec5b38 nid=0x1e in Object.wait() [cea81000..cea819bc]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:426)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
    - locked <d9c3b4d0> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)
    "ExecuteThread: '18' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec4f88 nid=0x1d runnable [ceb80000..ceb819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.ChunkOutput.checkForFlush(ChunkOutput.java:371)
    at weblogic.servlet.internal.ChunkOutput.writeStream(ChunkOutput.java:326)
    at weblogic.servlet.internal.ChunkOutputWrapper.writeStream(ChunkOutputWrapper.java:154)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:584)
    at weblogic.servlet.internal.ServletOutputStreamImpl.writeStream(ServletOutputStreamImpl.java:573)
    at weblogic.servlet.FileServlet.sendFile(FileServlet.java:571)
    at weblogic.servlet.FileServlet.service(FileServlet.java:208)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
    at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:971)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:402)
    at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:305)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6350)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:317)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:118)
    at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3635)
    at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2585)
    at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)
    "ExecuteThread: '17' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0xec43d8 nid=0x1c runnable [cec80000..cec819bc]
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at weblogic.servlet.internal.ChunkUtils.writeChunkNoTransfer(ChunkUtils.java:260)
    at weblogic.servlet.internal.ChunkUtils.writeChunks(ChunkUtils.java:225)
    at weblogic.servlet.internal.ChunkOutput.flush(ChunkOutput.java:296)
    at weblogic.servlet.internal.Chun

  • 100% CPU load but no clue in thread dump, EP. Win a bottle of champagne...

    Hi,
    We are suddenly facing 100% CPU load in our EP cluster (5 x 8-way Xeon multiprocessor machines). We have a serious performance problem that is burning a lot of our time and causes a lot of stress for over 3 weeks now.
    We have taken tens of thread dumps from Application Nodes.
    - In none of the thread dumps we see the Finalizer thread
    running.
    - From the garbage collector log we see that full garbage
    collection runs occur very rarily (once an hour).
    - We use the compacting garbage collector.
    - In a lot of thread dumps we do not even see our own portal code in the stack traces of the threads!
    - In Windows Task Manager we see the jlaunch.exe processes
    consume all available CPU time.
    - Portal users see a blank portal page when the CPU load hits 100%. When the load goes down again, things return to normal.
    - There are no errors logged in any of the log files of the portal. We checked all of them. We expected a log full of errors somewhere but nothing even remotely interesting was found. Windows Event Viewer shows nothing either.
    - The amount of sockets in CLOSE_WAIT status is < 10 on every machine in the cluster.
    This forces me to conclude that something in the jlaunch.exe executable consumes the CPU time. This raises the following 3 questions:
    - What does the mystifying jlaunch.exe do besides executing java.exe ?
    - Why is the Java virtual machine launched by a custom executable like jlaunch (What is it that cannot be program med in Java) ? Can it be GZip compression ?
    - If the problem is not caused by jlaunch.exe, then it must be caused by the JVM. What activity, invisible in thread dumps, is performed by the JVM that can cause the high CPU load ?
    Our development- and support teams are desperate. All suggestions are welcome. The person that comes up with
    the solution to our problem gets a nice bottle of champagne.
    Regards,
    Chris Twigt

    Hi,
    - What does the mystifying jlaunch.exe do besides executing java.exe ?
    This is so that the startupframework can connect more easily and take control of the JVM in some situations
    - Why is the Java virtual machine launched by a custom executable like jlaunch (What is it that cannot be program med in Java) ?
    I assume when SAP release their JVM (in the next major release), that will be called directly.
    - If the problem is not caused by jlaunch.exe, then it must be caused by the JVM. What activity, invisible in thread dumps, is performed by the JVM that can cause the high CPU load ?
    Loads of thing, but there should be clues in the thread dumps.  (the reason why your code is not in those thread dumps is that your code is only active during the processing of a particular request, unless you have a service, afterwards there are no trace of it as the thread which does the processing goes back to sleep)
    I've experienced a similar situation with a an 6.40 portal, and it was then caused by the following:
    1. User A comes logs in and sees that some cache timeout has occured , therefore it issues a SQL query which does a full table scan on a table of approx. 1 GB (on of the UME tables)
    2. User B comes in just afterwards and also sees that the cache timeout has occured, and issues the same SQL query as User A
    3. User C .... and so on untill the query from User A eventually finishes
    So
    1. Check database. Any big queries running ?
    2. Check file activity, are there a lot of writing ?
    3. Check network activity, especially to the state controller which is the weakest link
    4. What about portal logs ? Any activity during the hang ?
    Also, please provide one of the thread dumps for further analysis..
    cheers
    Dagfinn

  • Waiting for monitor enty messages in thread dump

    Hi,
    I've a thread dump of a container in a Oracle Application Server 9.0.4.1 (running 1.4.2_07) right before restart because off low memory and a lot of threads in this dump are in this state:
    "AJPRequestHandler-ApplicationServerThread-1588" prio=1 tid=0x37634bf8 nid=0x1982 waiting for monitor entry [43f22000..43f2386c]
    can anyone tell me what this means? Google didn't reveal anything useful.
    Another thing I don't understand although it seems it doesn't do any harm:
    "AJPRequestHandler-ApplicationServerThread-1630" prio=1 tid=0x09011a68 nid=0x1982 in Object.wait() [40276000..4027686c]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x6624e628> (a java.util.HashMap)
    at java.lang.Object.wait(Object.java:429)
    at java.net.InetAddress.checkLookupTable(InetAddress.java:1109)
    - locked <0x6624e628> (a java.util.HashMap)
    at java.net.InetAddress.getAddressFromNameService(InetAddress.java:1048)
    at java.net.InetAddress.getLocalHost(InetAddress.java:1188)
    at com.evermind.server.http.EvermindHttpSession.encodeSession(EvermindHttpSession.java:414)
    at com.evermind.server.http.HttpApplication.createSession(HttpApplication.java:1599)
    why is this thread waiting for a lock itself has?
    Thanx for any help and hints in advance.
    Regards,
    Ingo

    Hi,
    I've a follow-up question, I have the following thread in several thread dumps:
    "AJPRequestHandler-ApplicationServerThread-717" prio=1 tid=0x4046b988 nid=0x3dd3 waiting for monitor entry [3845e000..3845e86c]
         at java.net.Inet4Address.getAddress(Inet4Address.java:287)
         at com.evermind.server.http.StandardRequestLogger.appendIP(StandardRequestLogger.java:187)
         at com.evermind.server.http.StandardRequestLogger.log(StandardRequestLogger.java:45)
         - locked <0x663b2088> (a com.evermind.server.http.StandardRequestLogger)
         at com.evermind.server.http.HttpRequestHandler.processRequest(HttpRequestHandler.java:906)
         at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:208)
         at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:125)
         at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:192)
         at java.lang.Thread.run(Thread.java:534)
    What is the monitor this thread is waiting for? According to the source in Inet4Address at line 287 the method tries to create a new byte array... is there some system monitor which can't be seen in the thread dump?
    This thread holds a lock (0x663b2088) 46 other threads are waiting for...
    Thanx in advance for any hints.
    Regards,
    Ingo

  • States in the thread dump "Waiting on monitor"

     

    that is normal, it is all the execute threads waiting for requests
    Rob Baldassano wrote:
    Hi.
    I am trying to do some troubleshooting of the weblogic server,
    Currently we are using WebLogic 6.1 SP 2.
    In the thread dump we are seeing a lot of "waiting on monitor" messages for the
    individual threads.
    The application that we are running uses native threads to run the processes that
    it needs to.
    My question is this.
    Is this "Waiting for monitor" message normal?
    What could cause these messages?
    is there a way to get around them, besides recoding the application?

  • Thread Dump vs Heap Dump

    Hi,
    The below question are related to J2EE 7.00.
    - What is the difference between Thred dump and Heap dump?
    - When I go to Config tool then I go to Instance ID.
    There are two nodes under the Instance ID, DIspatcher and Server (could be multiple).
    I see different tabs on Instance ID and they are Message Server and BootStrap, Server General. There are lots of setting under Server General tab.
    My question is that what is the usage of the "Server General" tab?
    Please let me know.
    I will appreciate your reply.
    Regards.
    Sume

    A java engine runs all its work in 'threads' much like WP's in SM50 but unfortunately not so stand alone in 7.0.
    A thread dump is a bit like taking a photo of SM50, that is why you will be asked to take 2 or 3 so as to see what sticks in threads for a while.
    A java engine uses memory to store all its objects. Most memory is a single area called heap. A heap dump lists all objects in memory at the time.
    Thread dump = activities working/waiting
    Heap Dump = objects used
    As for the configtool, I do not have one in front of me to double check but I believe you are looking at the general settings as opposed to local instance settings. So you can set parameters at a local level using an instance number or for all instances by setting it as a general setting. Quite a few settings that are set at the local level are set globally anyway so be aware that that may be the case.

  • Jdbc dead lock thread dump

    We have the following thread dump during jdbc dead lock, btw, we are using weblogic60sp2
    and its bundled jdbc driver, I have a question, since I see many thread block
    on jts.Connection.internalRollback, is it true that different theads can concurrently
    access jts connection? If not, how could we explain the block on jts.Connection.internalRollback?
    Thanks
    Full thread dump:
    "HttpPost: 1" prio=5 tid=0x2651ef8 nid=0x51 waiting on monitor [0x61a01000..0x61a01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "mail: 1" prio=5 tid=0x2276910 nid=0x50 waiting on monitor [0x61b01000..0x61b01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "HighPriority TimeEventGenerator" daemon prio=9 tid=0x206fb00 nid=0x4f waiting
    on monitor [0x61c01000..0x61c01a28]
         at java.lang.Object.wait(Native Method)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
         at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
         at java.lang.Thread.run(Thread.java:479)
    "SSLListenThread" prio=5 tid=0x1d21de8 nid=0x4e runnable [0x64501000..0x64501a28]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
         at java.net.ServerSocket.implAccept(ServerSocket.java:238)
         at java.net.ServerSocket.accept(ServerSocket.java:217)
         at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:126)
         at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:117)
         at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
    "ListenThread" prio=5 tid=0x20a1ce8 nid=0x4d runnable [0x61d01000..0x61d01a28]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
         at java.net.ServerSocket.implAccept(ServerSocket.java:238)
         at java.net.ServerSocket.accept(ServerSocket.java:217)
         at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
    "Thread-4" daemon prio=5 tid=0x1d1fdb8 nid=0x4c waiting on monitor [0x61e01000..0x61e01a28]
         at java.lang.Thread.sleep(Native Method)
         at glog.webserver.xslcompiler.ObjectPool$PoolCleaner.run(ObjectPool.java:260)
         at java.lang.Thread.run(Thread.java:479)
    "processSweeper: 1" prio=5 tid=0x1e591f0 nid=0x4b waiting on monitor [0x61f01000..0x61f01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "processCallback: 1" prio=5 tid=0x1e588b0 nid=0x4a waiting on monitor [0x62001000..0x62001a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "processLogging: 1" prio=5 tid=0x1e564c0 nid=0x49 waiting on monitor [0x62101000..0x62101a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "GLog Timer" daemon prio=5 tid=0x1b78888 nid=0x48 waiting on monitor [0x62201000..0x62201a28]
         at java.lang.Thread.sleep(Native Method)
         at glog.server.workflow.TimerThread.sleepSeconds(TimerThread.java:97)
         at glog.server.workflow.TimerThread.run(TimerThread.java:35)
    "default: 1" prio=5 tid=0x1ed4748 nid=0x47 waiting on monitor [0x62301000..0x62301a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "totals: 1" prio=5 tid=0x1ed3c50 nid=0x46 waiting on monitor [0x62401000..0x62401a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "txComplete: 1" prio=5 tid=0x1ed3158 nid=0x45 waiting on monitor [0x62501000..0x62501a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "milestone: 1" prio=5 tid=0x1ed26d8 nid=0x44 waiting on monitor [0x62601000..0x62601a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "OMD: 2" prio=5 tid=0x12c9c08 nid=0x43 runnable [0x626ff000..0x62701a28]
         at java.net.SocketInputStream.socketRead(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:85)
         at oracle.net.ns.Packet.receive(Unknown Source)
         at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
         at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
         at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
         at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
         at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
         at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
         at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
         at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
         at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
         at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
         at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
         at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
         at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
         at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
         at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
         at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
         at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
         at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
         at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
         at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
         at java.lang.reflect.Method.invoke(Native Method)
         at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
         at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
         at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
         at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
         at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
         at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
         at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
         at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
         at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
         at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
         at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
         at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
         at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
         at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
         at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
         at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
         at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "OMD: 1" prio=5 tid=0x12c8d08 nid=0x42 runnable [0x627ff000..0x62801a28]
         at java.net.SocketInputStream.socketRead(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:85)
         at oracle.net.ns.Packet.receive(Unknown Source)
         at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.net.ns.NetInputStream.read(Unknown Source)
         at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
         at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
         at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
         at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
         at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
         at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
         at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
         at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
         at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
         at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
         at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
         at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
         at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
         at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
         at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
         at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
         at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
         at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
         at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
         at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
         at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
         at java.lang.reflect.Method.invoke(Native Method)
         at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
         at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
         at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
         at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
         at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
         at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
         at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
         at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
         at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
         at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
         at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
         at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
         at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
         at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
         at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
         at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
         at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "agentIntegration: 1" prio=5 tid=0x12c8288 nid=0x41 waiting on monitor [0x62901000..0x62901a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 3" prio=5 tid=0x1f0d0d8 nid=0x40 waiting on monitor [0x62a01000..0x62a01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 2" prio=5 tid=0x1f0c658 nid=0x3f waiting on monitor [0x62b01000..0x62b01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 1" prio=5 tid=0x1f0bbd8 nid=0x3e waiting on monitor [0x62c01000..0x62c01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 4" prio=5 tid=0x1f0b158 nid=0x3d waiting on monitor [0x62d01000..0x62d01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 3" prio=5 tid=0x1f0a6d8 nid=0x3c waiting on monitor [0x62e01000..0x62e01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 2" prio=5 tid=0x1ce4838 nid=0x3b waiting on monitor [0x62f01000..0x62f01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 1" prio=5 tid=0x1ce3db8 nid=0x3a waiting on monitor [0x63001000..0x63001a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "publishWait: 4" prio=5 tid=0x1ce2d30 nid=0x39 waiting on monitor [0x63100000..0x63101a28]
         at java.lang.Object.wait(Native Method)
         at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
         at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
         at glog.server.workflow.Topic.publishWait(Topic.java:135)
         at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
         at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
         at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
         at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
         at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
         at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
         at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "publishWait: 3" prio=5 tid=0x210f240 nid=0x38 waiting on monitor [0x63200000..0x63201a28]
         at java.lang.Object.wait(Native Method)
         at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
         at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
         at glog.server.workflow.Topic.publishWait(Topic.java:135)
         at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
         at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
         at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
         at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
         at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
         at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
         at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "publishWait: 2" prio=5 tid=0x210e7c0 nid=0x37 waiting on monitor [0x63300000..0x63301a28]
         at java.lang.Object.wait(Native Method)
         at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
         at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
         at glog.server.workflow.Topic.publishWait(Topic.java:135)
         at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
         at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
         at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
         at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
         at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
         at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
         at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "publishWait: 1" prio=5 tid=0x210dd40 nid=0x36 waiting on monitor [0x63400000..0x63401a28]
         at java.lang.Object.wait(Native Method)
         at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
         at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
         at glog.server.workflow.Topic.publishWait(Topic.java:135)
         at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
         at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
         at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
         at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
         at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
         at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
         at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
         at java.lang.reflect.Method.invoke(Native Method)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
         at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
         at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
         at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
         at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
         at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
         at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
         at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
         at glog.server.workflow.Trigger.trigger(Trigger.java:112)
         at glog.util.event.EventQueuer.run(EventQueuer.java:155)
         at java.lang.Thread.run(Thread.java:479)
    "http: 4" prio=5 tid=0x210d2c0 nid=0x35 waiting on monitor [0x63501000..0x63501a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "http: 3" prio=5 tid=0x210c840 nid=0x34 waiting on monitor [0x63601000..0x63601a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "http: 2" prio=5 tid=0x20cdc20 nid=0x33 waiting on monitor [0x63701000..0x63701a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "http: 1" prio=5 tid=0x20cd1a0 nid=0x32 waiting on monitor [0x63801000..0x63801a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "lifetime: 1" prio=5 tid=0x20cc720 nid=0x31 waiting on monitor [0x63901000..0x63901a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "utility: 4" prio=5 tid=0x20cbd40 nid=0x30 waiting on monitor [0x63a01000..0x63a01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "utility: 3" prio=5 tid=0x20b84e8 nid=0x2f waiting on monitor [0x63b01000..0x63b01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "utility: 2" prio=5 tid=0x20b7a68 nid=0x2e waiting on monitor [0x63c01000..0x63c01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "utility: 1" prio=5 tid=0x1d97ae8 nid=0x2d waiting on monitor [0x63d01000..0x63d01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "shipmentEvents: 1" prio=5 tid=0x1d979a8 nid=0x2c waiting on monitor [0x63e01000..0x63e01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "execution: 2" prio=5 tid=0x1d97468 nid=0x2b waiting on monitor [0x63f01000..0x63f01a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "execution: 1" prio=5 tid=0x1f27670 nid=0x2a waiting on monitor [0x64001000..0x64001a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "integration: 1" prio=5 tid=0x1f27530 nid=0x29 waiting on monitor [0x64101000..0x64101a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "batch: 2" prio=5 tid=0x20621e8 nid=0x28 waiting on monitor [0x64201000..0x64201a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "batch: 1" prio=5 tid=0x1eb4160 nid=0x27 waiting on monitor [0x64301000..0x64301a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "EventDefault: 1" prio=5 tid=0x1fb0e38 nid=0x26 waiting on monitor [0x64401000..0x64401a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at glog.util.event.EventQueuer.run(EventQueuer.java:122)
         at java.lang.Thread.run(Thread.java:479)
    "Application Manager Thread" prio=5 tid=0x1ce9b08 nid=0x24 waiting on monitor
    [0x64601000..0x64601a28]
         at java.lang.Thread.sleep(Native Method)
         at weblogic.management.mbeans.custom.ApplicationManager$ApplicationPoller.run(ApplicationManager.java:644)
    "ExecuteThread: '1' for queue: '__weblogic_admin_rmi_queue'" daemon prio=5 tid=0x66e198
    nid=0x23 waiting on monitor [0x6d081000..0x6d081a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
    "ExecuteThread: '0' for queue: '__weblogic_admin_rmi_queue'" daemon prio=5 tid=0x66d858
    nid=0x22 waiting on monitor [0x6d181000..0x6d181a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
    "ExecuteThread: '1' for queue: '__weblogic_admin_html_queue'" daemon prio=5 tid=0x66c910
    nid=0x21 waiting on monitor [0x6d281000..0x6d281a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
    "ExecuteThread: '0' for queue: '__weblogic_admin_html_queue'" daemon prio=5 tid=0x66c3d0
    nid=0x20 waiting on monitor [0x6d381000..0x6d381a28]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.ja

    Jinosng Hu wrote:
    We have the following thread dump during jdbc dead lock, btw, we are using weblogic60sp2
    and its bundled jdbc driver, I have a question, since I see many thread block
    on jts.Connection.internalRollback, is it true that different theads can concurrently
    access jts connection? If not, how could we explain the block on jts.Connection.internalRollback?
    ThanksHi. What seems to be happening is that our transaction coordinator has found these transactions that have
    exceeded their timeout limit, and is trying to roll back the transaction on the JDBC connection, but is
    blocked by the synchronization of the driver until the user thread running the current JDBC statement
    returns. Would you please try adding this patch to the beginning of the server classpath, and repeat?
    This patch will have the transaction coordinator call Statement.cancel() on all the ongoing statements
    in the transaction before trying to call rollback(). This may solve the problem. Let me know...
    Joe
    PS: Also, please go to the Oracle site and download their latest thin driver. It is more recent and
    better than the version that was available when we packaged our server. Try putting it ahead of
    all weblogic stuff in the server classpath too.
    thanks
    Joe
    >
    >
    Full thread dump:
    "HttpPost: 1" prio=5 tid=0x2651ef8 nid=0x51 waiting on monitor [0x61a01000..0x61a01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "mail: 1" prio=5 tid=0x2276910 nid=0x50 waiting on monitor [0x61b01000..0x61b01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "HighPriority TimeEventGenerator" daemon prio=9 tid=0x206fb00 nid=0x4f waiting
    on monitor [0x61c01000..0x61c01a28]
    at java.lang.Object.wait(Native Method)
    at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
    at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
    at java.lang.Thread.run(Thread.java:479)
    "SSLListenThread" prio=5 tid=0x1d21de8 nid=0x4e runnable [0x64501000..0x64501a28]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
    at java.net.ServerSocket.implAccept(ServerSocket.java:238)
    at java.net.ServerSocket.accept(ServerSocket.java:217)
    at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:126)
    at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:117)
    at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
    "ListenThread" prio=5 tid=0x20a1ce8 nid=0x4d runnable [0x61d01000..0x61d01a28]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
    at java.net.ServerSocket.implAccept(ServerSocket.java:238)
    at java.net.ServerSocket.accept(ServerSocket.java:217)
    at weblogic.t3.srvr.ListenThread.run(ListenThread.java:247)
    "Thread-4" daemon prio=5 tid=0x1d1fdb8 nid=0x4c waiting on monitor [0x61e01000..0x61e01a28]
    at java.lang.Thread.sleep(Native Method)
    at glog.webserver.xslcompiler.ObjectPool$PoolCleaner.run(ObjectPool.java:260)
    at java.lang.Thread.run(Thread.java:479)
    "processSweeper: 1" prio=5 tid=0x1e591f0 nid=0x4b waiting on monitor [0x61f01000..0x61f01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "processCallback: 1" prio=5 tid=0x1e588b0 nid=0x4a waiting on monitor [0x62001000..0x62001a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "processLogging: 1" prio=5 tid=0x1e564c0 nid=0x49 waiting on monitor [0x62101000..0x62101a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "GLog Timer" daemon prio=5 tid=0x1b78888 nid=0x48 waiting on monitor [0x62201000..0x62201a28]
    at java.lang.Thread.sleep(Native Method)
    at glog.server.workflow.TimerThread.sleepSeconds(TimerThread.java:97)
    at glog.server.workflow.TimerThread.run(TimerThread.java:35)
    "default: 1" prio=5 tid=0x1ed4748 nid=0x47 waiting on monitor [0x62301000..0x62301a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "totals: 1" prio=5 tid=0x1ed3c50 nid=0x46 waiting on monitor [0x62401000..0x62401a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "txComplete: 1" prio=5 tid=0x1ed3158 nid=0x45 waiting on monitor [0x62501000..0x62501a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "milestone: 1" prio=5 tid=0x1ed26d8 nid=0x44 waiting on monitor [0x62601000..0x62601a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "OMD: 2" prio=5 tid=0x12c9c08 nid=0x43 runnable [0x626ff000..0x62701a28]
    at java.net.SocketInputStream.socketRead(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:85)
    at oracle.net.ns.Packet.receive(Unknown Source)
    at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
    at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
    at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
    at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
    at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
    at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
    at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
    at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
    at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
    at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
    at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
    at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
    at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
    at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
    at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
    at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
    at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
    at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
    at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
    at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
    at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
    at java.lang.reflect.Method.invoke(Native Method)
    at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
    at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
    at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
    at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
    at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
    at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
    at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
    at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
    at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
    at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
    at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
    at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
    at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
    at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
    at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
    at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
    at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "OMD: 1" prio=5 tid=0x12c8d08 nid=0x42 runnable [0x627ff000..0x62801a28]
    at java.net.SocketInputStream.socketRead(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:85)
    at oracle.net.ns.Packet.receive(Unknown Source)
    at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.net.ns.NetInputStream.read(Unknown Source)
    at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:726)
    at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:698)
    at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
    at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1405)
    at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(TTC7Protocol.java:822)
    at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1602)
    at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1527)
    at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2045)
    at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:395)
    at weblogic.jdbcbase.jts.Statement.executeUpdate(Statement.java:345)
    at glog.util.jdbc.SqlUpdate.resetArguments(SqlUpdate.java:85)
    at glog.util.jdbc.SqlUpdate.execute(SqlUpdate.java:51)
    at glog.util.remote.BeanManagedEntityBean.executeUpdate(BeanManagedEntityBean.java:536)
    at glog.util.remote.BeanManagedEntityBean$1.execute(BeanManagedEntityBean.java:162)
    at glog.util.remote.BeanManagedEntityBean.dbModify(BeanManagedEntityBean.java:792)
    at glog.util.remote.BeanManagedEntityBean.doCreate(BeanManagedEntityBean.java:159)
    at glog.util.remote.BaseEntityBean$1.doIt(BaseEntityBean.java:376)
    at glog.util.remote.BaseEntityBean.ejb(BaseEntityBean.java:651)
    at glog.util.remote.BaseEntityBean.ejbCreator(BaseEntityBean.java:374)
    at glog.ejb.orderbase.db.ObOrderBaseBeanDB.ejbCreate(ObOrderBaseBeanDB.java:86)
    at glog.ejb.orderbase.ObOrderBaseBeanImpl.ejbCreate(ObOrderBaseBeanImpl.java:1973)
    at java.lang.reflect.Method.invoke(Native Method)
    at weblogic.ejb20.manager.ExclusiveEntityManager.create(ExclusiveEntityManager.java:446)
    at weblogic.ejb20.internal.EntityEJBHome.create(EntityEJBHome.java:353)
    at glog.ejb.orderbase.ObOrderBaseBeanHomeImpl.create(ObOrderBaseBeanHomeImpl.java:167)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.util.remote.BeanBaseInvoker.invoke(BeanBaseInvoker.java:24)
    at glog.util.remote.EntityBeanHomeInvoker.create(EntityBeanHomeInvoker.java:49)
    at glog.util.persistence.PersistenceListener.insertUpdatePerformed(PersistenceListener.java:127)
    at glog.util.persistence.PersistenceListener.persistencePerformed(PersistenceListener.java:90)
    at glog.util.persistence.InsertUpdate.doPersist(InsertUpdate.java:71)
    at glog.util.persistence.InsertUpdate.persist(InsertUpdate.java:59)
    at glog.util.persistence.PersistenceManager.execute(PersistenceManager.java:95)
    at glog.server.agent.business.orderbase.ObProcessor.persist(ObProcessor.java:477)
    at glog.server.agent.business.orderbase.ObProcessorSessionBean.persistForInsert(ObProcessorSessionBean.java:54)
    at glog.server.agent.business.orderbase.ObProcessorSessionBeanImpl.persistForInsert(ObProcessorSessionBeanImpl.java:190)
    at glog.server.agent.business.orderbase.ObProcessorSessionBeanEOImpl.persistForInsert(ObProcessorSessionBeanEOImpl.java:200)
    at glog.server.agent.business.orderbase.ObAdd.process(ObAdd.java:57)
    at glog.server.agent.business.orderbase.ObActionTopic.persist(ObActionTopic.java:44)
    at glog.server.agent.PersistActionTopic.execute(PersistActionTopic.java:31)
    at glog.server.agent.ActionWorkflow.execute(ActionWorkflow.java:28)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "agentIntegration: 1" prio=5 tid=0x12c8288 nid=0x41 waiting on monitor [0x62901000..0x62901a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 3" prio=5 tid=0x1f0d0d8 nid=0x40 waiting on monitor [0x62a01000..0x62a01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 2" prio=5 tid=0x1f0c658 nid=0x3f waiting on monitor [0x62b01000..0x62b01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentPlanning: 1" prio=5 tid=0x1f0bbd8 nid=0x3e waiting on monitor [0x62c01000..0x62c01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 4" prio=5 tid=0x1f0b158 nid=0x3d waiting on monitor [0x62d01000..0x62d01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 3" prio=5 tid=0x1f0a6d8 nid=0x3c waiting on monitor [0x62e01000..0x62e01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 2" prio=5 tid=0x1ce4838 nid=0x3b waiting on monitor [0x62f01000..0x62f01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "agentUtility: 1" prio=5 tid=0x1ce3db8 nid=0x3a waiting on monitor [0x63001000..0x63001a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "publishWait: 4" prio=5 tid=0x1ce2d30 nid=0x39 waiting on monitor [0x63100000..0x63101a28]
    at java.lang.Object.wait(Native Method)
    at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
    at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
    at glog.server.workflow.Topic.publishWait(Topic.java:135)
    at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
    at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
    at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
    at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
    at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
    at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
    at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "publishWait: 3" prio=5 tid=0x210f240 nid=0x38 waiting on monitor [0x63200000..0x63201a28]
    at java.lang.Object.wait(Native Method)
    at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
    at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
    at glog.server.workflow.Topic.publishWait(Topic.java:135)
    at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
    at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
    at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
    at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
    at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
    at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
    at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "publishWait: 2" prio=5 tid=0x210e7c0 nid=0x37 waiting on monitor [0x63300000..0x63301a28]
    at java.lang.Object.wait(Native Method)
    at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
    at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
    at glog.server.workflow.Topic.publishWait(Topic.java:135)
    at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
    at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
    at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
    at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
    at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
    at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
    at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "publishWait: 1" prio=5 tid=0x210dd40 nid=0x36 waiting on monitor [0x63400000..0x63401a28]
    at java.lang.Object.wait(Native Method)
    at glog.server.workflow.TopicManager.publishWait(TopicManager.java:151)
    at glog.server.workflow.ServerPublisher.publishWait(ServerPublisher.java:115)
    at glog.server.workflow.Topic.publishWait(Topic.java:135)
    at glog.server.compareengine.TopicPublisher.publishPreEvents(TopicPublisher.java:91)
    at glog.server.compareengine.TopicPublisher.publish(TopicPublisher.java:47)
    at glog.server.compareengine.CompareEngine.compare(CompareEngine.java:134)
    at glog.util.genericcontainer.GenericContainerUtilSessionBean.compareAndStore(GenericContainerUtilSessionBean.java:59)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanImpl.compareAndStore(GenericContainerUtilSessionBeanImpl.java:149)
    at glog.util.genericcontainer.GenericContainerUtilSessionBeanEOImpl.compareAndStore(GenericContainerUtilSessionBeanEOImpl.java:52)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persist(XmlBaseWrapper.java:214)
    at glog.integration.xmlbasewrapper.XmlBaseWrapper.persistViaContainer(XmlBaseWrapper.java:282)
    at glog.integration.application.order.OrderInterface.persistXML(OrderInterface.java:74)
    at java.lang.reflect.Method.invoke(Native Method)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:170)
    at glog.integration.application.TransactionProcessor.processTransaction(TransactionProcessor.java:228)
    at glog.server.workflow.transproc.TransProc.execute(TransProc.java:84)
    at glog.server.workflow.SimpleWorkflow.execute(SimpleWorkflow.java:25)
    at glog.server.workflow.WorkflowSessionBean.execute(WorkflowSessionBean.java:57)
    at glog.server.workflow.WorkflowSessionNonTransBeanImpl.execute(WorkflowSessionNonTransBeanImpl.java:189)
    at glog.server.workflow.WorkflowSessionNonTransBeanEOImpl.execute(WorkflowSessionNonTransBeanEOImpl.java:126)
    at glog.server.workflow.WorkflowManager.execute(WorkflowManager.java:234)
    at glog.server.workflow.Trigger.trigger(Trigger.java:112)
    at glog.util.event.EventQueuer.run(EventQueuer.java:155)
    at java.lang.Thread.run(Thread.java:479)
    "http: 4" prio=5 tid=0x210d2c0 nid=0x35 waiting on monitor [0x63501000..0x63501a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "http: 3" prio=5 tid=0x210c840 nid=0x34 waiting on monitor [0x63601000..0x63601a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "http: 2" prio=5 tid=0x20cdc20 nid=0x33 waiting on monitor [0x63701000..0x63701a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "http: 1" prio=5 tid=0x20cd1a0 nid=0x32 waiting on monitor [0x63801000..0x63801a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "lifetime: 1" prio=5 tid=0x20cc720 nid=0x31 waiting on monitor [0x63901000..0x63901a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "utility: 4" prio=5 tid=0x20cbd40 nid=0x30 waiting on monitor [0x63a01000..0x63a01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "utility: 3" prio=5 tid=0x20b84e8 nid=0x2f waiting on monitor [0x63b01000..0x63b01a28]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:415)
    at glog.util.event.EventQueuer.run(EventQueuer.java:122)
    at java.lang.Thread.run(Thread.java:479)
    "utility: 2" prio=5 tid=0x20b7a68 nid=0x2e waiting on monitor [0x63c01000..0x63c01a28]
    at java.lang.Object.

  • Strange thread dump on deadlock

    We've been experiencing a strange deadlock during the startup of our java application. When I run jstack on the application to investigate, I see that the AWT-EventQueue is in Object.wait(), but the thread is still marked as RUNNABLE. I've included the relevent parts of the thread dump, and I'm hoping that someone can shed some light on this issue.
    "AWT-EventQueue-0" prio=6 tid=0x5f0a2400 nid=0x19e4 in Object.wait() [0x6007e000]
           java.lang.Thread.State: RUNNABLE
            at com.ge.med.platinum.work.isu.ExamTransaction.getEAOTableLite(ExamTransaction.java:1514)
              - locked <0x1fc87448> (a java.awt.Component$AWTTreeLock)
    "Thread-63-Pool-9" prio=6 tid=0x5f1a2800 nid=0x1f54 waiting for monitor entry [0x61a9f000]
       java.lang.Thread.State: BLOCKED (on object monitor)
        at java.awt.Component.setFont(Component.java:1777)
        - waiting to lock <0x1fc87448> (a java.awt.Component$AWTTreeLock)
    "Thread-289-Pool-3" prio=6 tid=0x60afe800 nid=0x12b8 waiting for monitor entry [0x623fe000]
       java.lang.Thread.State: BLOCKED (on object monitor)
        at java.awt.Component.setFont(Component.java:1777)
        - waiting to lock <0x1fc87448> (a java.awt.Component$AWTTreeLock)
          ... In my search for the solution, I've noticed [this thread|http://stackoverflow.com/questions/64989/jvm-thread-dumps-containing-monitors-without-locking-threads], which mentions that accessing a static variable may be involved. This is also the case in our application. The line in getEAOTableLite in question references a static method.

    Thank you for the quick reply. I'm not sure how I missed it, but if I had read down the stack trace a little better I would have found that the issue was that the class loader for the EaoAlertManager never completed because it was blocked by the illegal call to setFont. This would cause the AWT-EventQueue thread to go into an infinite wait call on the ClassLoader.
    "Thread-289-Pool-3" prio=6 tid=0x60afe800 nid=0x12b8 waiting for monitor entry [0x623fe000]
       java.lang.Thread.State: BLOCKED (on object monitor)
         at java.awt.Component.setFont(Component.java:1777)
         - waiting to lock <0x1fc87448> (a java.awt.Component$AWTTreeLock)
         at java.awt.Container.setFont(Container.java:1554)
         at javax.swing.JComponent.setFont(JComponent.java:2723)
         at javax.swing.LookAndFeel.installColorsAndFont(LookAndFeel.java:191)
         at javax.swing.plaf.basic.BasicPanelUI.installDefaults(BasicPanelUI.java:49)
         at javax.swing.plaf.basic.BasicPanelUI.installUI(BasicPanelUI.java:39)
         at com.ge.med.ptk.laf.CuiPanelUI.installUI(CuiPanelUI.java:53)
         at javax.swing.JComponent.setUI(JComponent.java:662)
         at javax.swing.JPanel.setUI(JPanel.java:136)
         at javax.swing.JPanel.updateUI(JPanel.java:109)
         at javax.swing.JPanel.<init>(JPanel.java:69)
         at javax.swing.JPanel.<init>(JPanel.java:92)
         at javax.swing.JPanel.<init>(JPanel.java:100)
         at javax.swing.JRootPane.createGlassPane(JRootPane.java:528)
         at javax.swing.JRootPane.<init>(JRootPane.java:348)
         at javax.swing.JDialog.createRootPane(JDialog.java:611)
         at javax.swing.JDialog.dialogInit(JDialog.java:593)
         at com.ge.med.plaf.wrapper.WJDialog.dialogInit(WJDialog.java:42)
         at javax.swing.JDialog.<init>(JDialog.java:545)
         at javax.swing.JDialog.<init>(JDialog.java:515)
         at com.ge.med.plaf.wrapper.WJDialog.<init>(WJDialog.java:424)
         at com.ge.med.platinum.gui.util.PlatinumDialog.<init>(PlatinumDialog.java:138)
         at com.ge.med.platinum.gui.util.EAOAlertManager$EAOAlertDialog.<init>(EAOAlertManager.java:450)
         at com.ge.med.platinum.gui.util.EAOAlertManager.<clinit>(EAOAlertManager.java:77)
         at com.ge.med.platinum.work.isu.ExamTransaction.getEAOTableLite(ExamTransaction.java:1514)

  • Remote Thread Dumping via MBeans

    I am relatively new to JMX and to weblogic intricacies, so please bear with my possibly newbish question. I am trying to replicate the thread dump data that you can get via the kill -3 signal, via remotely connecting to the server and querying data via MBeans for the ExecuteQueueRuntimes. Is this even possible as it appears that the attribute "ExecuteThread", which is an array of weblogic.management.runtime.ExecuteThread, has an accessor called getExecuteThread(), which returns a java.lang.Thread, but this data is always null. My guess as to why it is null is because the thread in question would be running on the remote server and is not Serializable, the data wouldn't be marshalled for the return.
    So, if this is the case, is it even possible to get the the kill -3 type data at all via simple MBeans?
    Again, I apologize if this is either in the wrong forum or is something that someone more experienced would simply know.

    HI,
    Is your code similar the the Code mentioned in the following link: http://jaysensharma.wordpress.com/2010/01/29/execute-thread-details-using-jmx/
    I am not getting NULL...Please correct if my understanding is wrong about the issue.
    Thanks
    Jay SenSharma

  • Large Memory Usage and Frozen [thread dump attached]

    Hi,
    SQL Developer (Version 2.1.1.64, WinXP Pro, Java 1.6, Oracle 10g R2) always uses at least 550MB of memory, if left open, for more than a day, it invariably goes up to 700-800MB.
    If I close all windows and connections, virtually no memory is reclaimed.
    I clicked + beside a view to see the columns, sqldeveloper froze for a few minutes, below is the thread dump.
    2010-05-21 11:31:58
    Full thread dump Java HotSpot(TM) Client VM (14.2-b01 mixed mode):
    "CONNECTION_ALIVE" prio=6 tid=0x3891c000 nid=0x1d58 waiting for monitor entry [0x3a55f000]
    java.lang.Thread.State: BLOCKED (on object monitor)
    at oracle.jdbc.driver.T4CConnection.doPingDatabase(T4CConnection.java:3398)
    - waiting to lock <0x09ad05f8> (a oracle.jdbc.driver.T4CConnection)
    at oracle.jdbc.driver.PhysicalConnection.pingDatabase(PhysicalConnection.java:7074)
    at oracle.javatools.db.ora.BaseOracleDatabase.isConnectionAlive(BaseOracleDatabase.java:165)
    at oracle.javatools.db.AbstractDatabase$1.run(AbstractDatabase.java:316)
    at java.lang.Thread.run(Thread.java:619)
    "Loading Children" prio=6 tid=0x3891bc00 nid=0x12c4 waiting on condition [0x39d5f000]
    java.lang.Thread.State: WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x03eab570> (a java.util.concurrent.FutureTask$Sync)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
    at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:218)
    at java.util.concurrent.FutureTask.get(FutureTask.java:83)
    at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$IdeTaskTracker.run(RaptorTaskManager.java:532)
    at java.lang.Thread.run(Thread.java:619)
    "pool-2-thread-57" prio=6 tid=0x3891b400 nid=0x2094 waiting on condition [0x35b5f000]
    java.lang.Thread.State: TIMED_WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x09b819f0> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
    at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:841)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1160)
    at java.util.concurrent.locks.ReentrantLock.tryLock(ReentrantLock.java:416)
    at oracle.dbtools.raptor.utils.Connections.lock(Connections.java:1334)
    at oracle.dbtools.raptor.utils.Connections.lock(Connections.java:1319)
    at oracle.dbtools.raptor.utils.Connections.lock(Connections.java:1306)
    at oracle.dbtools.raptor.navigator.xml.AbstractItemInstance.lockConnection(AbstractItemInstance.java:52)
    at oracle.dbtools.raptor.navigator.xml.XmlNodeInstance.listChildren(XmlNodeInstance.java:55)
    at oracle.dbtools.raptor.navigator.ObjectNodeFilter$ObjectNodeFilterLoadTask.doWorkImpl(ObjectNodeFilter.java:78)
    at oracle.dbtools.raptor.navigator.DeferredLoadingFilter$FilterLoadTask.doWork(DeferredLoadingFilter.java:124)
    at oracle.dbtools.raptor.navigator.DeferredLoadingFilter$FilterLoadTask.doWork(DeferredLoadingFilter.java:113)
    at oracle.dbtools.raptor.backgroundTask.RaptorTask.call(RaptorTask.java:193)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$RaptorFutureTask.run(RaptorTaskManager.java:492)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:619)
    "pool-2-thread-55" prio=6 tid=0x38d68400 nid=0xd74 runnable [0x3a15f000]
    java.lang.Thread.State: RUNNABLE
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:129)
    at oracle.net.ns.Packet.receive(Packet.java:239)
    at oracle.net.ns.DataPacket.receive(DataPacket.java:92)
    at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:172)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:117)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:92)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:77)
    at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1023)
    at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:999)
    at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:584)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:194)
    at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:785)
    at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:860)
    at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1186)
    at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3381)
    at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3425)
    - locked <0x09ad05f8> (a oracle.jdbc.driver.T4CConnection)
    at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1490)
    at oracle.dbtools.raptor.controls.grid.ResultSetTableModel.openResultSet(ResultSetTableModel.java:412)
    at oracle.dbtools.raptor.controls.grid.ResultSetTableModel.fetchNext(ResultSetTableModel.java:169)
    at oracle.dbtools.raptor.controls.grid.ResultSetTableModel$4.doWork(ResultSetTableModel.java:556)
    at oracle.dbtools.raptor.controls.grid.ResultSetTableModel$4.doWork(ResultSetTableModel.java:540)
    at oracle.dbtools.raptor.backgroundTask.RaptorTask.call(RaptorTask.java:193)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$RaptorFutureTask.run(RaptorTaskManager.java:492)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:619)
    "AWT-EventQueue-0" prio=6 tid=0x354fac00 nid=0x18d4 waiting for monitor entry [0x3a45f000]
    java.lang.Thread.State: BLOCKED (on object monitor)
    at oracle.jdbc.driver.PhysicalConnection.getMetaData(PhysicalConnection.java:3891)
    - waiting to lock <0x09ad05f8> (a oracle.jdbc.driver.T4CConnection)
    at oracle.dbtools.raptor.plscope.Query.getToolTipText(Query.java:58)
    at oracle.dbtools.raptor.phighlight.TooltipPlugin$1.getToolTipText(TooltipPlugin.java:29)
    at oracle.ide.ceditor.CodeEditor.getToolTipText(CodeEditor.java:1734)
    - locked <0x17245f98> (a java.util.ArrayList)
    at oracle.javatools.editor.BasicEditorPane.getToolTipText(BasicEditorPane.java:1530)
    at javax.swing.ToolTipManager$insideTimerAction.actionPerformed(ToolTipManager.java:658)
    at javax.swing.Timer.fireActionPerformed(Timer.java:271)
    at javax.swing.Timer$DoPostEvent.run(Timer.java:201)
    at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:209)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:597)
    at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:269)
    at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:184)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:174)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:169)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:161)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)
    "Background Parser" prio=6 tid=0x38a43400 nid=0x23c4 waiting on condition [0x39c5f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "SwingWorker-pool-5-thread-1142" prio=6 tid=0x38868800 nid=0x1a7c waiting on condition [0x3820f000]
    java.lang.Thread.State: WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x0e77bc10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)
    "Background Parser" prio=6 tid=0x38a76c00 nid=0x1d18 waiting on condition [0x3a35f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "Background Parser" prio=6 tid=0x387e2800 nid=0xd00 waiting on condition [0x3a25f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "Background Parser" prio=6 tid=0x38752000 nid=0x2794 waiting on condition [0x39e5f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "Swing-Shell" daemon prio=6 tid=0x367f0000 nid=0xd7c waiting on condition [0x3a85f000]
    java.lang.Thread.State: WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x1069d0d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at sun.awt.shell.Win32ShellFolderManager2$ComInvoker$3.run(Win32ShellFolderManager2.java:458)
    at java.lang.Thread.run(Thread.java:619)
    "Persistence Auto Flusher" daemon prio=6 tid=0x388a5c00 nid=0x1950 in Object.wait() [0x37e0f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
    - locked <0x0e892d48> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "Thread-76" prio=6 tid=0x387aec00 nid=0x259c runnable [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "WeakDataReference polling" prio=2 tid=0x38752800 nid=0xe94 in Object.wait() [0x3a05f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    - locked <0x0b6ba260> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at oracle.ide.util.WeakDataReference$Cleaner.run(WeakDataReference.java:88)
    at java.lang.Thread.run(Thread.java:619)
    "Image Animator 3" daemon prio=4 tid=0x3861b400 nid=0x2330 waiting on condition [0x3978f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at sun.awt.image.GifFrame.dispose(GifImageDecoder.java:653)
    at sun.awt.image.GifImageDecoder.produceImage(GifImageDecoder.java:230)
    at sun.awt.image.InputStreamImageSource.doFetch(InputStreamImageSource.java:246)
    at sun.awt.image.ImageFetcher.fetchloop(ImageFetcher.java:172)
    at sun.awt.image.ImageFetcher.run(ImageFetcher.java:136)
    "Background Parser" prio=6 tid=0x38348800 nid=0x978 waiting on condition [0x3988f000]
    java.lang.Thread.State: TIMED_WAITING (sleeping)
    at java.lang.Thread.sleep(Native Method)
    at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
    at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
    at java.lang.Thread.run(Thread.java:619)
    "TextBufferScavenger" prio=6 tid=0x38324800 nid=0x1af0 in Object.wait() [0x3968f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    - locked <0x09bb9158> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at oracle.ide.model.TextNode$FacadeBufferReference$PollingThread.run(TextNode.java:1949)
    "pool-4-thread-1" prio=6 tid=0x36960400 nid=0x1a84 waiting on condition [0x35a5f000]
    java.lang.Thread.State: TIMED_WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x08150a78> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
    at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
    at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
    at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)
    "IconOverlayTracker Timer" prio=6 tid=0x38520c00 nid=0x1b48 in Object.wait() [0x3950f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
    - locked <0x0795f290> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "Timer queue for AWT thread" daemon prio=6 tid=0x369b4000 nid=0x1f20 in Object.wait() [0x3940f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    - waiting on <0x077e1358> (a java.lang.Object)
    at java.lang.Object.wait(Object.java:485)
    at ice.util.awt.TimedAWTExecutor.nextElem(TimedAWTExecutor.java:108)
    - locked <0x077e1358> (a java.lang.Object)
    at ice.util.awt.TimedAWTExecutor.runScheduler(TimedAWTExecutor.java:130)
    at ice.util.awt.TimedAWTExecutor$1.run(TimedAWTExecutor.java:19)
    "WaitCursor-Timer" prio=6 tid=0x367c3c00 nid=0x1010 in Object.wait() [0x37b0f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
    - locked <0x077e1400> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "Native Directory Watcher" prio=2 tid=0x368d4000 nid=0x2334 runnable [0x3830f000]
    java.lang.Thread.State: RUNNABLE
    at oracle.ide.natives.NativeHandler.enterWatcherThread(Native Method)
    at oracle.ide.natives.NativeHandler$2.run(NativeHandler.java:252)
    at java.lang.Thread.run(Thread.java:619)
    "BaseTreeExplorer.NodeOpeningExecutor" prio=6 tid=0x3684b000 nid=0x8b0 waiting on condition [0x3810f000]
    java.lang.Thread.State: WAITING (parking)
    at sun.misc.Unsafe.park(Native Method)
    - parking to wait for <0x06950af0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
    at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
    at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
    at java.lang.Thread.run(Thread.java:619)
    "Scheduler" daemon prio=6 tid=0x36846400 nid=0x14bc in Object.wait() [0x37f0f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at oracle.dbtools.raptor.backgroundTask.TaskLinkedList.takeNextTask(TaskLinkedList.java:47)
    - locked <0x06950c70> (a oracle.dbtools.raptor.backgroundTask.TaskLinkedList)
    at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$SchedulerThread.run(RaptorTaskManager.java:422)
    "TimerQueue" daemon prio=6 tid=0x36832800 nid=0x88c in Object.wait() [0x37d0f000]
    java.lang.Thread.State: TIMED_WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at javax.swing.TimerQueue.postExpiredTimers(TimerQueue.java:218)
    - locked <0x06950da8> (a javax.swing.TimerQueue)
    at javax.swing.TimerQueue.run(TimerQueue.java:234)
    - locked <0x06950da8> (a javax.swing.TimerQueue)
    at java.lang.Thread.run(Thread.java:619)
    "ChangeSetService" prio=2 tid=0x367fd400 nid=0x2754 in Object.wait() [0x37c0f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    - waiting on <0x06892cc0> (a oracle.jdevimpl.vcs.changeset.ChangeSetService)
    at java.lang.Object.wait(Object.java:485)
    at oracle.jdevimpl.vcs.changeset.ChangeSetService.awaitEvents(ChangeSetService.java:178)
    - locked <0x06892cc0> (a oracle.jdevimpl.vcs.changeset.ChangeSetService)
    at oracle.jdevimpl.vcs.changeset.ChangeSetService.eventLoop(ChangeSetService.java:199)
    at oracle.jdevimpl.vcs.changeset.ChangeSetService.access$200(ChangeSetService.java:56)
    at oracle.jdevimpl.vcs.changeset.ChangeSetService$2.run(ChangeSetService.java:138)
    at java.lang.Thread.run(Thread.java:619)
    "TimedCache-Timer" daemon prio=6 tid=0x35d52c00 nid=0x2448 in Object.wait() [0x3624f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.util.TimerThread.mainLoop(Timer.java:483)
    - locked <0x062ab118> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "JarIndex Timer" daemon prio=6 tid=0x35556400 nid=0x2488 in Object.wait() [0x35d4f000]
    java.lang.Thread.State: TIMED_WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.util.TimerThread.mainLoop(Timer.java:509)
    - locked <0x062206e0> (a java.util.TaskQueue)
    at java.util.TimerThread.run(Timer.java:462)
    "AWT-Windows" daemon prio=6 tid=0x354dd000 nid=0x1d0c runnable [0x3595f000]
    java.lang.Thread.State: RUNNABLE
    at sun.awt.windows.WToolkit.eventLoop(Native Method)
    at sun.awt.windows.WToolkit.run(WToolkit.java:291)
    at java.lang.Thread.run(Thread.java:619)
    "AWT-Shutdown" prio=6 tid=0x354a1800 nid=0x268c in Object.wait() [0x3585f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at sun.awt.AWTAutoShutdown.run(AWTAutoShutdown.java:259)
    - locked <0x062208d8> (a java.lang.Object)
    at java.lang.Thread.run(Thread.java:619)
    "Java2D Disposer" daemon prio=10 tid=0x354b7400 nid=0x5f4 in Object.wait() [0x3575f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    - locked <0x06220968> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at sun.java2d.Disposer.run(Disposer.java:125)
    at java.lang.Thread.run(Thread.java:619)
    "Low Memory Detector" daemon prio=6 tid=0x00ee1000 nid=0x2664 runnable [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "CompilerThread0" daemon prio=10 tid=0x00edc000 nid=0x1f6c waiting on condition [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "Attach Listener" daemon prio=10 tid=0x00eda800 nid=0x206c runnable [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "Signal Dispatcher" daemon prio=10 tid=0x00ed9400 nid=0xf64 waiting on condition [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "Finalizer" daemon prio=8 tid=0x00ec6c00 nid=0x2348 in Object.wait() [0x34e7f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    - locked <0x061b0298> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
    "Reference Handler" daemon prio=10 tid=0x00ec5800 nid=0x2484 in Object.wait() [0x34d7f000]
    java.lang.Thread.State: WAITING (on object monitor)
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:485)
    at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
    - locked <0x061b0320> (a java.lang.ref.Reference$Lock)
    "main" prio=6 tid=0x009f8000 nid=0x19e0 waiting on condition [0x00000000]
    java.lang.Thread.State: RUNNABLE
    "VM Thread" prio=10 tid=0x00ec1800 nid=0x22e0 runnable
    "VM Periodic Task Thread" prio=10 tid=0x00eec000 nid=0x2604 waiting on condition
    JNI global references: 5312
    Heap
    def new generation total 45376K, used 28499K [0x03080000, 0x061b0000, 0x061b0000)
    eden space 40384K, 67% used [0x03080000, 0x04af44c0, 0x057f0000)
    from space 4992K, 28% used [0x05cd0000, 0x05e30850, 0x061b0000)
    to space 4992K, 0% used [0x057f0000, 0x057f0000, 0x05cd0000)
    tenured generation total 604992K, used 364537K [0x061b0000, 0x2b080000, 0x2b080000)
    the space 604992K, 60% used [0x061b0000, 0x1c5ae548, 0x1c5ae600, 0x2b080000)
    compacting perm gen total 57344K, used 57260K [0x2b080000, 0x2e880000, 0x33080000)
    the space 57344K, 99% used [0x2b080000, 0x2e86b348, 0x2e86b400, 0x2e880000)
    No shared spaces configured.
    Edited by: mdaly on May 21, 2010 11:42 AM

    The cause of hang could be figured out from the thread dump.
    I have fixed that in development code. It was happening from PL/SQL editor trying to create tooltip which locked up the connection.
    I am not sure what would lead to memory bloat even if the tool is not in use. There could be memory leak from some component. I am investigating that.
    Suggest you to keep ObjectViewers, reports & PL/SQL editor closed when not in use.
    Have Sql Array Fetch Size preference to 50 if it's higher.
    Do not have auto-refresh for Report editor.
    Keep Sql History, Find Db Object, Snippets collapsed.
    See if that helps.
    -Raghu

  • How to get a thread dump, in case of an IDE freeze

    When you're working with the IDE and if it either freezes or becomes sluggish for no apparent reason, it's recommended to generate a thread dump, and report it to Studio feedback alias ([email protected]) with a description of what happened and attach the dump to it.
    A thread dump is an invaluable source of information to IDE developers when investigating deadlocks and some performance issues. It is a textual dump of all active threads and monitors of Java apps running in a Virtual Machine.
    The ways to generate a thread dump differ depending on the platform:
    * Windows systems
    Press Ctrl-Break in the command console you used to start the IDE.
    You won't be able to see the console in case you started the IDE using the default desktop icon created by the IDE installer. To be able to generate the thread dump, you must launch the IDE using a console window (invoke Command Prompt, go to {studio-install-dir}/bin and type runide.exe), or configure the desktop shortcut properties to launch the runide.exe program instead of the default runidew.exe.
    Note: You should increase the screen buffer size of the command prompt, so that it could retian the entire thread dump output. To do that, on the command prompt where IDE is running, open the properties dialog box by right clicking on the titlebar and selecting 'properties'. Then select the 'layout tab' and increase the 'screen buffer size' parameters to - width - 200, Height - 4000.
    * Unix systems
    Press Ctrl-\ in the terminal console you used to start the JSE.
    Alternatively, you can also generate a thread dump by sending the QUIT signal to the Java VM running the JSE
    kill -QUIT process_id
    where process_id is the process number of the respective java process.
    -------Here is a sample thread dump -------
    Full thread dump Java HotSpot(TM) Client VM (1.4.2_01-b06 mixed mode):
    "Text-Layout" daemon prio=2 tid=0x0886ebd8 nid=0x4e4 in Object.wait() [9e8f000..9e8fd94]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x11730910> (a org.netbeans.editor.view.spi.ViewLayoutQueue)
    at java.lang.Object.wait(Object.java:429)
    at org.netbeans.editor.view.spi.ViewLayoutQueue.waitForTask(ViewLayoutQueue.java:128)
    - locked <0x11730910> (a org.netbeans.editor.view.spi.ViewLayoutQueue)
    at org.netbeans.editor.view.spi.ViewLayoutQueue$LayoutThread.run(ViewLayoutQueue.java:182)
    "Compilation" daemon prio=2 tid=0x0883d878 nid=0xb1c in Object.wait() [9c8f000..9c8fd94]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x1143dde0> (a java.util.LinkedList)
    at java.lang.Object.wait(Object.java:429)
    at org.netbeans.core.compiler.CompilationEngineImpl$CompilerThread.nextJobAndTask(CompilationEngineImpl.java:162)
    - locked <0x1143dde0> (a java.util.LinkedList)
    at org.netbeans.core.compiler.CompilationEngineImpl$CompilerThread.run(CompilationEngineImpl.java:175)
    "TimerQueue" daemon prio=5 tid=0x03575478 nid=0xb18 in Object.wait() [988f000..988fd94]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x10d4af60> (a javax.swing.TimerQueue)
    at javax.swing.TimerQueue.run(TimerQueue.java:231)
    - locked <0x10d4af60> (a javax.swing.TimerQueue)
    at java.lang.Thread.run(Thread.java:534)
    "AWT-EventQueue-1" prio=7 tid=0x0344fae0 nid=0xb14 in Object.wait() [3caf000..3cafd94]
    at java.lang.Object.wait(Native Method)
    - waiting on <0x10d4afe8> (a java.awt.EventQueue)
    at java.lang.Object.wait(Object.java:429)
    at java.awt.EventQueue.getNextEvent(EventQueue.java:339)
    - locked <0x10d4afe8> (a java.awt.EventQueue)
    at java.awt.EventDispatchThread.pumpOneEventForHierarchy(EventDispatchThread.java:162)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:151)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:145)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:137)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:100)

    You can get a thread dump (Windows only) whitout any preparation. Simply use the Stack Trace tool from this web site:
    http://tmitevski.users.mcs2.netarray.com
    It works on Windows services too.

  • I don't understand the thing you call live bookmarks never used it, and most forums I have used notify VIA E-mail not giving out my E-mail address information when a reply has been made to the thread in question.

    So how do I get notified of updates in this forum? As I said: I don't understand the thing you call LIVE BOOKMARKS I have never used them, and most forums I have used notify VIA E-mail not giving out my E-mail address, or other private information when a reply has been made to the thread in question, so how do I get notified of updates in this forum? I have seen no normal options for setting my viewing preferences used for this forum. Thank You.

    Thanks for your reply via email/msg. He wrote:
    If you are interested in the actual design data for the Xeon processor, go to the Intel site and the actual CPU part numbers are:
    Xeon 4 core - E5.1620v2
    Xeon 6 core - E5.1650v2
    Xeon 8 core - E5.1680v2
    Xeon 12 core - E5.2697v2
    I read that the CPU is easy to swap out but am sure something goes wrong at a certain point - even if solderedon they make material to absorb the solder, making your work area VERY clean.
    My Question now is this, get an 8 core, then replace with 2 3.7 QUAD CHIPS, what would happen?
    I also noticed that the 8 core Mac Pro is 3.0 when in fact they do have a 3.4 8 core chip, so 2 =16? Or if correct, wouldn't you be able to replace a QUAD CHIP WITH THAT?  I;M SURE THEY ARE UO TO SOMETHING AS 1) WE HAVE SEEN NO AUDIO FPU OR PERHAPS I SHOULD CHECK OUT PC MAKERS WINDOWS machines for Sisoft Sandra "B-E-N-C-H-M-A-R-K-S" -
    SOMETHINGS UP AND AM SURE WE'LL ALL BE PLEASED, AS the mac pro      was announced Last year, barely made the December mark, then pushed to January, then February and now April.
    Would rather wait and have it done correct than released to early only to have it benchmarked in audio and found to be slower in a few areas- - - the logical part of my brain is wondering what else I would have to swap out as I am sure it would run, and fine for a while, then, poof....
    PEACE===AM SURE APPLE WILL BLOW US AWAY - they have to figure out how to increase the power for 150 watts or make the GPU work which in regard to FPU, I thought was NVIDIA?

  • What's a good way to do a thread dump into a separate file

    What is a good way to do a thread dump automatically into a separate file.
    Example. I run a script to do the thread dump, but unfortunetly, it goes into my stdout log file with the rest of my weblogic errors.
    Any ideas? I want it in a separate file when I run my script?

    Do a Google search on "Drobo S" "benchmark."  I don't have a Drobo S, only the regular Drobo.  But here's a guy who tested one on Windows:
    http://mansurovs.com/drobo-s-review-usb-3-0-2nd-generation
    This one has it a bit faster:
    http://the-gadgeteer.com/2011/12/31/drobo-s-storage-array-review/
    Do read up on a few reviews of it, and be absolutely clear that interface speed (i.e. eSATA versus Firewire versus Thunderbolt) is NOT the same as the performance of the system.  The Drobo cannot keep up with any interfaces... at least the Drobo and the Drobo S cannot.
    I am not using the FS model which is a NAS.  I am using the plain old "Drobo" which is slower than the Drobo S, but that's not to say that the Drobo S is fast, because it is not.
    The Drobo in theory is really attractive: Dead simple to manage, can mix and match drive sizes, offers you some data protection, etc.  However do note that protected storage is not, in and of itself, a backup.  You need other backups besides just the data on the Drobo.  And, because it's so slow, it's really not a great fit for photo storage.  See this review from a guy who used to think the Drobo was great for that and then appended his review:
    http://www.stuckincustoms.com/drobo-review/
    To be as clear as possible, IMO the BEST backup strategy with something like Aperture (so long as your managed Aperture library is of a manageable size, like < 800 GB), is to get a few small portable Firewire 800 drives and keep vaults on each one.  They are great because they are easy to use, to have with you, are bus powered, and you WILL offsite them.

  • HELP!!! Why do my thread dump have so many locked monitor

    In recent weeks, My customer's weblogic server become more busy.Each time I downloaded
    the thread dump when CPU is busy than 90%,I found a lot of lock in the thread
    dump! Especially the class named "weblogic.kernel.ExecuteThread" . It's the kernel
    class of weblogic, Why were most of them locked?
    Full thread dump:
    "process forker" daemon prio=1 tid=0x95b4c8e0 nid=0x3084 waiting on monitor [0x977ff000..0x977ff890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53d26420> (a java.lang.Object)
         at java.lang.UNIXProcessForker.run(Native Method)
         at java.lang.Thread.run(Thread.java:479)
    "process reaper" daemon prio=1 tid=0x95376758 nid=0x3083 runnable [0x96eff000..0x96eff890]
         at java.lang.UNIXProcessReaper.run(Native Method)
         at java.lang.Thread.run(Thread.java:479)
    "HighPriority TimeEventGenerator" daemon prio=1 tid=0x825bf18 nid=0x25a1 waiting
    on monitor [0x95dff000..0x95dff890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53a3bd10> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
         - locked <53a3bd10> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
         at java.lang.Thread.run(Thread.java:479)
    "ListenThread" prio=1 tid=0x94d00630 nid=0x25a0 runnable [0x95fff000..0x95fff890]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
         - locked <538fa238> (a java.net.PlainSocketImpl)
         at java.net.ServerSocket.implAccept(ServerSocket.java:238)
         at java.net.ServerSocket.accept(ServerSocket.java:217)
         at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
         at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
    "NBExecuteThread-1" daemon prio=1 tid=0x8c0dd1d0 nid=0x259c waiting on monitor
    [0x94521000..0x94521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a9650> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a9650> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "NBExecuteThread-0" daemon prio=1 tid=0x8c0dc7d0 nid=0x259b waiting on monitor
    [0x94321000..0x94321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a9060> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a9060> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    //"ExecuteThread-49" daemon prio=1 tid=0x8c034660 nid=0x259a runnable [0x94121000..0x94121890]
         at java.net.PlainDatagramSocketImpl.peek(Native Method)
         - locked <537acf60> (a java.net.PlainDatagramSocketImpl)
         at java.net.DatagramSocket.receive(DatagramSocket.java:349)
         - locked <486f9980> (a java.net.DatagramPacket)
         - locked <537acf40> (a java.net.MulticastSocket)
         at weblogic.cluster.TDMSocketIPM.receive(TDMSocketIPM.java:86)
         at weblogic.cluster.TMSocket.execute(TMSocket.java:249)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-48" daemon prio=1 tid=0x8c0c3d18 nid=0x2599 waiting for monitor
    entry [0x93f21000..0x93f21890]
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
         - waiting to lock <538fa5c8> (a java.lang.Object)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-47" daemon prio=1 tid=0x8c0c32d0 nid=0x2598 runnable [0x93d21000..0x93d21890]
         at weblogic.socket.PosixSocketMuxer.poll(Native Method)
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
         - locked <538fa5c8> (a java.lang.Object)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-46" daemon prio=1 tid=0x8c0bf410 nid=0x2597 waiting for monitor
    entry [0x93b21000..0x93b21890]
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
         - waiting to lock <538fa5c8> (a java.lang.Object)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-45" daemon prio=1 tid=0x8c0be9c8 nid=0x2596 waiting on monitor
    [0x93921000..0x93921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a6df8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a6df8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-44" daemon prio=1 tid=0x8c0bdab0 nid=0x2595 waiting on monitor
    [0x93721000..0x93721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a6828> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a6828> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-43" daemon prio=1 tid=0x8c0bd068 nid=0x2594 waiting on monitor
    [0x93521000..0x93521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a6258> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a6258> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-42" daemon prio=1 tid=0x8c0c0ce0 nid=0x2593 waiting on monitor
    [0x93321000..0x93321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a5c88> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a5c88> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-41" daemon prio=1 tid=0x8c0c0298 nid=0x2592 waiting on monitor
    [0x93121000..0x93121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a56b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a56b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-40" daemon prio=1 tid=0x8c0a21e0 nid=0x2591 waiting on monitor
    [0x92f21000..0x92f21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a50e8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a50e8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-39" daemon prio=1 tid=0x8c0d4520 nid=0x2590 waiting on monitor
    [0x92d21000..0x92d21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a4b18> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a4b18> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-38" daemon prio=1 tid=0x8c0d43d0 nid=0x258f waiting on monitor
    [0x92b21000..0x92b21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a4548> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a4548> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-37" daemon prio=1 tid=0x8c0d3988 nid=0x258e waiting on monitor
    [0x92921000..0x92921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a3f78> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a3f78> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-36" daemon prio=1 tid=0x8c0ded20 nid=0x258d waiting on monitor
    [0x92721000..0x92721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a39a8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a39a8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-35" daemon prio=1 tid=0x8c0de2d8 nid=0x258c waiting on monitor
    [0x92521000..0x92521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a33d8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a33d8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-34" daemon prio=1 tid=0x8c0cd528 nid=0x258b waiting on monitor
    [0x92321000..0x92321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a2e08> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a2e08> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-33" daemon prio=1 tid=0x8c0ccae0 nid=0x258a waiting on monitor
    [0x92121000..0x92121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a2838> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a2838> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-32" daemon prio=1 tid=0x8c075360 nid=0x2589 waiting on monitor
    [0x91f21000..0x91f21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a2268> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a2268> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-31" daemon prio=1 tid=0x8c0837d0 nid=0x2588 waiting on monitor
    [0x91d21000..0x91d21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a1c98> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a1c98> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-30" daemon prio=1 tid=0x8c0a5628 nid=0x2587 waiting on monitor
    [0x91b21000..0x91b21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a16c8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a16c8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-29" daemon prio=1 tid=0x8c07aaf8 nid=0x2586 waiting on monitor
    [0x91921000..0x91921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a10f8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a10f8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-28" daemon prio=1 tid=0x8c0c23d0 nid=0x2585 waiting on monitor
    [0x91721000..0x91721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a0b28> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a0b28> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-27" daemon prio=1 tid=0x8c0c1988 nid=0x2584 waiting on monitor
    [0x91521000..0x91521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537a0558> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537a0558> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-26" daemon prio=1 tid=0x8c07ca00 nid=0x2583 waiting on monitor
    [0x91321000..0x91321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379ff88> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379ff88> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-25" daemon prio=1 tid=0x8c079e70 nid=0x2582 waiting on monitor
    [0x91121000..0x91121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379f9b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379f9b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-24" daemon prio=1 tid=0x8c078038 nid=0x2581 waiting on monitor
    [0x90f21000..0x90f21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379f3e8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379f3e8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-23" daemon prio=1 tid=0x8c0a3298 nid=0x2580 waiting on monitor
    [0x90d21000..0x90d21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379ee18> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379ee18> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-22" daemon prio=1 tid=0x8c0e30d8 nid=0x257f waiting on monitor
    [0x90b21000..0x90b21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379e848> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379e848> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-21" daemon prio=1 tid=0x8c0c5948 nid=0x257e waiting on monitor
    [0x90921000..0x90921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379e278> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379e278> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-20" daemon prio=1 tid=0x8c0d0470 nid=0x257d waiting on monitor
    [0x90721000..0x90721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379dca8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379dca8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-19" daemon prio=1 tid=0x8c080798 nid=0x257c waiting on monitor
    [0x90521000..0x90521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379d6d8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379d6d8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-18" daemon prio=1 tid=0x8c080648 nid=0x257b waiting on monitor
    [0x90321000..0x90321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379d108> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379d108> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-17" daemon prio=1 tid=0x8c032380 nid=0x257a runnable [0x90121000..0x90121890]
         at java.lang.String.concat(String.java:1553)
         at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
         at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
         at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
         at com.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:122)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
         at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
         at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
         at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-16" daemon prio=1 tid=0x8c0df9a8 nid=0x2579 waiting on monitor
    [0x8ff21000..0x8ff21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379c568> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379c568> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-15" daemon prio=1 tid=0x8c0a6288 nid=0x2578 waiting on monitor
    [0x8fd21000..0x8fd21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379bf98> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379bf98> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-14" daemon prio=1 tid=0x8c0dbd60 nid=0x2577 waiting on monitor
    [0x8fb21000..0x8fb21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379b9c8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379b9c8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-13" daemon prio=1 tid=0x8c0c8498 nid=0x2576 waiting on monitor
    [0x8f921000..0x8f921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379b3f8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379b3f8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-12" daemon prio=1 tid=0x8c0a6a28 nid=0x2575 waiting on monitor
    [0x8f721000..0x8f721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379ae28> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379ae28> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-11" daemon prio=1 tid=0x8c07d348 nid=0x2574 runnable [0x8f521000..0x8f521890]
         at java.lang.System.arraycopy(Native Method)
         at java.lang.String.getChars(String.java:557)
         at java.lang.String.concat(String.java:1554)
         at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
         at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
         at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
         at com.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:251)
         at com.ebao.carcase.servlet.claim.ClaimServlet.doGet(ClaimServlet.java:77)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
         at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
         at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
         at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-10" daemon prio=1 tid=0x8c0369b0 nid=0x2571 waiting on monitor
    [0x8f321000..0x8f321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <5379a288> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <5379a288> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-9" daemon prio=1 tid=0x8c079898 nid=0x256f waiting on monitor [0x8f121000..0x8f121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53799cb8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53799cb8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-8" daemon prio=1 tid=0x8c035260 nid=0x256e waiting on monitor [0x8ef21000..0x8ef21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537996e8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537996e8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-7" daemon prio=1 tid=0x8c034510 nid=0x256d waiting on monitor [0x8ed21000..0x8ed21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53799118> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53799118> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-6" daemon prio=1 tid=0x8c081130 nid=0x256c waiting on monitor [0x8eb21000..0x8eb21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53798b48> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53798b48> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-5" daemon prio=1 tid=0x8c0c7108 nid=0x256b waiting on monitor [0x8e921000..0x8e921890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53798578> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53798578> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-4" daemon prio=1 tid=0x8c0a4388 nid=0x256a waiting on monitor [0x8e721000..0x8e721890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53797fa8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53797fa8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-3" daemon prio=1 tid=0x8c0367b8 nid=0x2569 waiting on monitor [0x8e521000..0x8e521890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537979d8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <537979d8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-2" daemon prio=1 tid=0x8c036290 nid=0x2568 waiting on monitor [0x8e321000..0x8e321890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53797408> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53797408> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-1" daemon prio=1 tid=0x8c0a4ee0 nid=0x2567 waiting on monitor [0x8e121000..0x8e121890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53796e38> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
         - locked <53796e38> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-0" daemon prio=1 tid=0x8c0a4550 nid=0x2566 runnable [0x8df21000..0x8df21890]
         at java.lang.String.concat(String.java:1553)
         at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
         at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
         at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
         at com.ebao.carcase.servlet.end.EndCaseServlet.service(EndCaseServlet.java:56)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
         at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
         at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
         at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
         at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "TimeEventGenerator" daemon prio=1 tid=0x8c076008 nid=0x2565 waiting on monitor
    [0x8dd21000..0x8dd21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53795330> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
         - locked <53795330> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
         at java.lang.Thread.run(Thread.java:479)
    "SpinnerRandomSource" daemon prio=1 tid=0x8c0b34a0 nid=0x2563 waiting on monitor
    [0x8db21000..0x8db21890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53793040> (a weblogic.security.SpinnerThread)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:104)
         - locked <53793040> (a weblogic.security.SpinnerThread)
         at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
    "Signal Dispatcher" daemon prio=1 tid=0x8c0077e8 nid=0x2561 waiting on monitor
    [0..0]
    "Finalizer" daemon prio=1 tid=0x8c000540 nid=0x255e waiting on monitor [0x8c2ff000..0x8c2ff890]
         at java.lang.Object.wait(Native Method)
         - waiting on <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
         - locked <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
    "Reference Handler" daemon prio=1 tid=0x80851f0 nid=0x255d waiting on monitor
    [0x8bf8c000..0x8bf8c890]
         at java.lang.Object.wait(Native Method)
         - waiting on <53720208> (a java.lang.ref.Reference$Lock)
         at java.lang.Object.wait(Object.java:415)
         at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:105)
         - locked <53720208> (a java.lang.ref.Reference$Lock)
    "main" prio=1 tid=0x804ead0 nid=0x2543 waiting on monitor [0xbfffc000..0xbfffd00c]
         at java.lang.Object.wait(Native Method)
         - waiting on <53743c20> (a weblogic.t3.srvr.T3Srvr)
         at java.lang.Object.wait(Object.java:415)
         at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1958)
         - locked <53743c20> (a weblogic.t3.srvr.T3Srvr)
         at java.lang.reflect.Method.invoke(Native Method)
         at weblogic.Server.startServerDynamically(Server.java:148)
         at weblogic.Server.main(Server.java:97)
         at weblogic.Server.main(Server.java:58)
    "VM Thread" prio=1 tid=0x8082110 nid=0x255c runnable
    "VM Periodic Task Thread" prio=1 tid=0x8c0064f8 nid=0x255f waiting on monitor
    "Suspend Checker Thread" prio=1 tid=0x8c006e30 nid=0x2560 runnable

    These are execute threads waiting for requests to come in.
    BTW, you probably want to look into using StringBuffer instead of
    strings concatenation in com.ebao.carcase.bean.query.Query.generatorXML.
    "min.lu" <[email protected]> wrote in message
    news:[email protected]...
    >
    In recent weeks, My customer's weblogic server become more busy.Each timeI downloaded
    the thread dump when CPU is busy than 90%,I found a lot of lock in thethread
    dump! Especially the class named "weblogic.kernel.ExecuteThread" . It'sthe kernel
    class of weblogic, Why were most of them locked?
    Full thread dump:
    "process forker" daemon prio=1 tid=0x95b4c8e0 nid=0x3084 waiting onmonitor [0x977ff000..0x977ff890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53d26420> (a java.lang.Object)
    at java.lang.UNIXProcessForker.run(Native Method)
    at java.lang.Thread.run(Thread.java:479)
    "process reaper" daemon prio=1 tid=0x95376758 nid=0x3083 runnable[0x96eff000..0x96eff890]
    at java.lang.UNIXProcessReaper.run(Native Method)
    at java.lang.Thread.run(Thread.java:479)
    "HighPriority TimeEventGenerator" daemon prio=1 tid=0x825bf18 nid=0x25a1waiting
    on monitor [0x95dff000..0x95dff890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53a3bd10> (a weblogic.time.common.internal.TimeTable)
    at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
    - locked <53a3bd10> (a weblogic.time.common.internal.TimeTable)
    atweblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
    :141)
    at java.lang.Thread.run(Thread.java:479)
    "ListenThread" prio=1 tid=0x94d00630 nid=0x25a0 runnable[0x95fff000..0x95fff890]
    at java.net.PlainSocketImpl.socketAccept(Native Method)
    at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
    - locked <538fa238> (a java.net.PlainSocketImpl)
    at java.net.ServerSocket.implAccept(ServerSocket.java:238)
    at java.net.ServerSocket.accept(ServerSocket.java:217)
    atweblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
    at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
    "NBExecuteThread-1" daemon prio=1 tid=0x8c0dd1d0 nid=0x259c waiting onmonitor
    [0x94521000..0x94521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a9650> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a9650> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "NBExecuteThread-0" daemon prio=1 tid=0x8c0dc7d0 nid=0x259b waiting onmonitor
    [0x94321000..0x94321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a9060> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a9060> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    //"ExecuteThread-49" daemon prio=1 tid=0x8c034660 nid=0x259a runnable[0x94121000..0x94121890]
    at java.net.PlainDatagramSocketImpl.peek(Native Method)
    - locked <537acf60> (a java.net.PlainDatagramSocketImpl)
    at java.net.DatagramSocket.receive(DatagramSocket.java:349)
    - locked <486f9980> (a java.net.DatagramPacket)
    - locked <537acf40> (a java.net.MulticastSocket)
    at weblogic.cluster.TDMSocketIPM.receive(TDMSocketIPM.java:86)
    at weblogic.cluster.TMSocket.execute(TMSocket.java:249)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-48" daemon prio=1 tid=0x8c0c3d18 nid=0x2599 waiting formonitor
    entry [0x93f21000..0x93f21890]
    atweblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
    - waiting to lock <538fa5c8> (a java.lang.Object)
    atweblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-47" daemon prio=1 tid=0x8c0c32d0 nid=0x2598 runnable[0x93d21000..0x93d21890]
    at weblogic.socket.PosixSocketMuxer.poll(Native Method)
    atweblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
    - locked <538fa5c8> (a java.lang.Object)
    atweblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-46" daemon prio=1 tid=0x8c0bf410 nid=0x2597 waiting formonitor
    entry [0x93b21000..0x93b21890]
    atweblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
    - waiting to lock <538fa5c8> (a java.lang.Object)
    atweblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-45" daemon prio=1 tid=0x8c0be9c8 nid=0x2596 waiting onmonitor
    [0x93921000..0x93921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a6df8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a6df8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-44" daemon prio=1 tid=0x8c0bdab0 nid=0x2595 waiting onmonitor
    [0x93721000..0x93721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a6828> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a6828> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-43" daemon prio=1 tid=0x8c0bd068 nid=0x2594 waiting onmonitor
    [0x93521000..0x93521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a6258> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a6258> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-42" daemon prio=1 tid=0x8c0c0ce0 nid=0x2593 waiting onmonitor
    [0x93321000..0x93321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a5c88> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a5c88> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-41" daemon prio=1 tid=0x8c0c0298 nid=0x2592 waiting onmonitor
    [0x93121000..0x93121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a56b8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a56b8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-40" daemon prio=1 tid=0x8c0a21e0 nid=0x2591 waiting onmonitor
    [0x92f21000..0x92f21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a50e8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a50e8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-39" daemon prio=1 tid=0x8c0d4520 nid=0x2590 waiting onmonitor
    [0x92d21000..0x92d21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a4b18> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a4b18> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-38" daemon prio=1 tid=0x8c0d43d0 nid=0x258f waiting onmonitor
    [0x92b21000..0x92b21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a4548> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a4548> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-37" daemon prio=1 tid=0x8c0d3988 nid=0x258e waiting onmonitor
    [0x92921000..0x92921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a3f78> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a3f78> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-36" daemon prio=1 tid=0x8c0ded20 nid=0x258d waiting onmonitor
    [0x92721000..0x92721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a39a8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a39a8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-35" daemon prio=1 tid=0x8c0de2d8 nid=0x258c waiting onmonitor
    [0x92521000..0x92521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a33d8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a33d8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-34" daemon prio=1 tid=0x8c0cd528 nid=0x258b waiting onmonitor
    [0x92321000..0x92321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a2e08> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a2e08> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-33" daemon prio=1 tid=0x8c0ccae0 nid=0x258a waiting onmonitor
    [0x92121000..0x92121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a2838> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a2838> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-32" daemon prio=1 tid=0x8c075360 nid=0x2589 waiting onmonitor
    [0x91f21000..0x91f21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a2268> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a2268> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-31" daemon prio=1 tid=0x8c0837d0 nid=0x2588 waiting onmonitor
    [0x91d21000..0x91d21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a1c98> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a1c98> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-30" daemon prio=1 tid=0x8c0a5628 nid=0x2587 waiting onmonitor
    [0x91b21000..0x91b21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a16c8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a16c8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-29" daemon prio=1 tid=0x8c07aaf8 nid=0x2586 waiting onmonitor
    [0x91921000..0x91921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a10f8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a10f8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-28" daemon prio=1 tid=0x8c0c23d0 nid=0x2585 waiting onmonitor
    [0x91721000..0x91721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a0b28> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a0b28> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-27" daemon prio=1 tid=0x8c0c1988 nid=0x2584 waiting onmonitor
    [0x91521000..0x91521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537a0558> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537a0558> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-26" daemon prio=1 tid=0x8c07ca00 nid=0x2583 waiting onmonitor
    [0x91321000..0x91321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379ff88> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379ff88> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-25" daemon prio=1 tid=0x8c079e70 nid=0x2582 waiting onmonitor
    [0x91121000..0x91121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379f9b8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379f9b8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-24" daemon prio=1 tid=0x8c078038 nid=0x2581 waiting onmonitor
    [0x90f21000..0x90f21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379f3e8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379f3e8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-23" daemon prio=1 tid=0x8c0a3298 nid=0x2580 waiting onmonitor
    [0x90d21000..0x90d21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379ee18> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379ee18> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-22" daemon prio=1 tid=0x8c0e30d8 nid=0x257f waiting onmonitor
    [0x90b21000..0x90b21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379e848> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379e848> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-21" daemon prio=1 tid=0x8c0c5948 nid=0x257e waiting onmonitor
    [0x90921000..0x90921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379e278> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379e278> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-20" daemon prio=1 tid=0x8c0d0470 nid=0x257d waiting onmonitor
    [0x90721000..0x90721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379dca8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379dca8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-19" daemon prio=1 tid=0x8c080798 nid=0x257c waiting onmonitor
    [0x90521000..0x90521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379d6d8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379d6d8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-18" daemon prio=1 tid=0x8c080648 nid=0x257b waiting onmonitor
    [0x90321000..0x90321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379d108> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379d108> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-17" daemon prio=1 tid=0x8c032380 nid=0x257a runnable[0x90121000..0x90121890]
    at java.lang.String.concat(String.java:1553)
    at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
    at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
    at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
    atcom.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:122)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:945)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:909)
    atweblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContext
    Manager.java:269)
    atweblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
    at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-16" daemon prio=1 tid=0x8c0df9a8 nid=0x2579 waiting onmonitor
    [0x8ff21000..0x8ff21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379c568> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379c568> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-15" daemon prio=1 tid=0x8c0a6288 nid=0x2578 waiting onmonitor
    [0x8fd21000..0x8fd21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379bf98> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379bf98> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-14" daemon prio=1 tid=0x8c0dbd60 nid=0x2577 waiting onmonitor
    [0x8fb21000..0x8fb21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379b9c8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379b9c8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-13" daemon prio=1 tid=0x8c0c8498 nid=0x2576 waiting onmonitor
    [0x8f921000..0x8f921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379b3f8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379b3f8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-12" daemon prio=1 tid=0x8c0a6a28 nid=0x2575 waiting onmonitor
    [0x8f721000..0x8f721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379ae28> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379ae28> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-11" daemon prio=1 tid=0x8c07d348 nid=0x2574 runnable[0x8f521000..0x8f521890]
    at java.lang.System.arraycopy(Native Method)
    at java.lang.String.getChars(String.java:557)
    at java.lang.String.concat(String.java:1554)
    at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
    at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
    at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
    atcom.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:251)
    at com.ebao.carcase.servlet.claim.ClaimServlet.doGet(ClaimServlet.java:77)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:945)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:909)
    atweblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContext
    Manager.java:269)
    atweblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
    at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "ExecuteThread-10" daemon prio=1 tid=0x8c0369b0 nid=0x2571 waiting onmonitor
    [0x8f321000..0x8f321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <5379a288> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <5379a288> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-9" daemon prio=1 tid=0x8c079898 nid=0x256f waiting onmonitor [0x8f121000..0x8f121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53799cb8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53799cb8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-8" daemon prio=1 tid=0x8c035260 nid=0x256e waiting onmonitor [0x8ef21000..0x8ef21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537996e8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537996e8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-7" daemon prio=1 tid=0x8c034510 nid=0x256d waiting onmonitor [0x8ed21000..0x8ed21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53799118> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53799118> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-6" daemon prio=1 tid=0x8c081130 nid=0x256c waiting onmonitor [0x8eb21000..0x8eb21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53798b48> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53798b48> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-5" daemon prio=1 tid=0x8c0c7108 nid=0x256b waiting onmonitor [0x8e921000..0x8e921890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53798578> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53798578> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-4" daemon prio=1 tid=0x8c0a4388 nid=0x256a waiting onmonitor [0x8e721000..0x8e721890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53797fa8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53797fa8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-3" daemon prio=1 tid=0x8c0367b8 nid=0x2569 waiting onmonitor [0x8e521000..0x8e521890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537979d8> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <537979d8> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-2" daemon prio=1 tid=0x8c036290 nid=0x2568 waiting onmonitor [0x8e321000..0x8e321890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53797408> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53797408> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-1" daemon prio=1 tid=0x8c0a4ee0 nid=0x2567 waiting onmonitor [0x8e121000..0x8e121890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53796e38> (a weblogic.kernel.ExecuteThread)
    at java.lang.Object.wait(Object.java:415)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
    - locked <53796e38> (a weblogic.kernel.ExecuteThread)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
    "ExecuteThread-0" daemon prio=1 tid=0x8c0a4550 nid=0x2566 runnable[0x8df21000..0x8df21890]
    at java.lang.String.concat(String.java:1553)
    at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
    at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
    at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
    atcom.ebao.carcase.servlet.end.EndCaseServlet.service(EndCaseServlet.java:56)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
    atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
    :120)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:945)
    atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
    l.java:909)
    atweblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContext
    Manager.java:269)
    atweblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
    at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
    "TimeEventGenerator" daemon prio=1 tid=0x8c076008 nid=0x2565 waiting onmonitor
    [0x8dd21000..0x8dd21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53795330> (a weblogic.time.common.internal.TimeTable)
    at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
    - locked <53795330> (a weblogic.time.common.internal.TimeTable)
    atweblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
    :141)
    at java.lang.Thread.run(Thread.java:479)
    "SpinnerRandomSource" daemon prio=1 tid=0x8c0b34a0 nid=0x2563 waiting onmonitor
    [0x8db21000..0x8db21890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53793040> (a weblogic.security.SpinnerThread)
    at java.lang.Object.wait(Object.java:415)
    atweblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:10
    4)
    - locked <53793040> (a weblogic.security.SpinnerThread)
    at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
    "Signal Dispatcher" daemon prio=1 tid=0x8c0077e8 nid=0x2561 waiting onmonitor
    [0..0]
    "Finalizer" daemon prio=1 tid=0x8c000540 nid=0x255e waiting on monitor[0x8c2ff000..0x8c2ff890]
    at java.lang.Object.wait(Native Method)
    - waiting on <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
    - locked <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
    at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
    at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
    "Reference Handler" daemon prio=1 tid=0x80851f0 nid=0x255d waiting onmonitor
    [0x8bf8c000..0x8bf8c890]
    at java.lang.Object.wait(Native Method)
    - waiting on <53720208> (a java.l

  • How to get a thread dump from Weblogic 9.1

    Hi All,
    Can someone please walk me through how to configure a WLS9.1 server to generate thread dumps. Ideally I'd like to do this via the admin console. I read about the MagicThreadDumpFile property, but can't see where/how to set it.
    Many Thanks
    Stuart

    I only know how to do this in WLS 8.1, but it will likely work in 9.1. On UNIX, you can send a kill -QUIT to the pid and it will dump threads to standard output for the server. You can also use weblogic.Admin THREAD_DUMP (http://e-docs.bea.com/wls/docs92/admin_ref/cli.html#wp1197887) or whatever is the equivalent in WLST now that weblogic.Admin is deprecated in 9.x. I'm guessing it is the threadDump() method documented at http://e-docs.bea.com/wls/docs92/config_scripting/reference.html#wp1104314.
    I know of no way to do this through the console, unfortunately.

Maybe you are looking for