Thread Dump

Hi,
We encounter a out of memory issue on weblogic 8.1 and the server crashed in 1-2 days.
Below is the Thread dump, could somebody analysis what is the root cause the issue?
you can get the file at:http://www.4shared.com/document/DzjOwH9m/threaddump-1604.html
Thanks,
Full thread dump Java HotSpot(TM) Server VM (1.4.2_16-b05 mixed mode):
"J-Integra internal timer thread for Jintegra RemOXIDResolver for: Net={{ 0x7, AJEP-EPARTAPP1}, { 0x7, 10.126.64.18}} Sec={{ 0x9, 0xffff, }, { 0x10, 0xffff, }, { 0xa, 0xffff, }, { 0xe, 0xffff, }, { 0x16, 0xffff, }}" daemon prio=5 tid=0x01ac5668 nid=0x2d3 waiting on condition [0x241bf000..0x241bfc28]
 at java.lang.Thread.sleep(Native Method)
 at com.linar.jintegra.ci.run(Unknown Source)
"J-Integra internal timer thread for Jintegra RemOXIDResolver for: Net={{ 0x7, 10.78.124.166[135]}} Sec={}" daemon prio=5 tid=0x02897db0 nid=0x2d1 waiting on condition [0x241ef000..0x241efc28]
 at java.lang.Thread.sleep(Native Method)
 at com.linar.jintegra.ci.run(Unknown Source)
"ExecuteThread: '2' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid=0x0233afe0 nid=0x122 in Object.wait() [0x2424f000..0x2424fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x5d611de8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '1' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid=0x016c0818 nid=0x121 in Object.wait() [0x242df000..0x242dfc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x5d4481e8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '0' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid=0x022b7e28 nid=0x120 in Object.wait() [0x2427f000..0x2427fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x5d956708> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"Thread-26" prio=5 tid=0x0289c838 nid=0x64 waiting on condition [0x242af000..0x242afc28]
 at java.lang.Thread.sleep(Native Method)
 at com.bluemartini.htmlapp.HTMLSaveRequestsDB.run(HTMLSaveRequestsDB.java:75)
"SSLListenThread.Default" prio=5 tid=0x01a08b48 nid=0x61 runnable [0x2430f000..0x2430fc28]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x57a633f8> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at javax.net.ssl.impl.SSLServerSocketImpl.accept(Unknown Source)
 at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:735)
 at weblogic.t3.srvr.ListenThread.run(ListenThread.java:301)
"ListenThread.Default" prio=5 tid=0x0073c870 nid=0x60 runnable [0x2433f000..0x2433fc28]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x574cb118> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
 at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:735)
 at weblogic.t3.srvr.ListenThread.run(ListenThread.java:301)
"Thread-25" prio=5 tid=0x001c2de0 nid=0x5f in Object.wait() [0x2436f000..0x2436fc28]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x57501260> (a java.util.TaskQueue)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x57501260> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"CacheExpiryHelper" prio=5 tid=0x00ea99a0 nid=0x5e in Object.wait() [0x2439f000..0x2439fc28]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x574c5748> (a java.lang.Object)
 at com.bluemartini.cache.ExpiryHelper.run(ExpiryHelper.java:96)
 - locked <0x574c5748> (a java.lang.Object)
"Thread-23" prio=5 tid=0x00a878e0 nid=0x5c waiting on condition [0x24d6f000..0x24d6fc28]
 at java.lang.Thread.sleep(Native Method)
 at com.bluemartini.htmlapp.HTMLSaveTracking.runDBThreads(HTMLSaveTracking.java:585)
 at com.bluemartini.htmlapp.HTMLSaveTracking.run(HTMLSaveTracking.java:436)
"AssocRecomLoader" prio=5 tid=0x01e2c818 nid=0x5b in Object.wait() [0x2675f000..0x2675fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at com.bluemartini.thirdparty.rules.AssocRecomLoader.run(AssociationRecommender.java:984)
 - locked <0x55806088> (a java.util.LinkedList)
 at java.lang.Thread.run(Thread.java:534)
"Thread-22" prio=5 tid=0x00d41ec0 nid=0x5a waiting on condition [0x267bf000..0x267bfc28]
 at java.lang.Thread.sleep(Native Method)
 at com.bluemartini.server.BMServerThread.run(BMServerThread.java:48)
"Thread-21" daemon prio=5 tid=0x00ae6730 nid=0x58 in Object.wait() [0x24d9f000..0x24d9fc28]
 at java.lang.Object.wait(Native Method)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x55806508> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-20" daemon prio=5 tid=0x01040288 nid=0x57 in Object.wait() [0x24dcf000..0x24dcfc28]
 at java.lang.Object.wait(Native Method)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x55800010> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-19" daemon prio=5 tid=0x01494ab0 nid=0x56 in Object.wait() [0x24dff000..0x24dffc28]
 at java.lang.Object.wait(Native Method)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x55803840> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-18" daemon prio=5 tid=0x017068f8 nid=0x55 in Object.wait() [0x24e2f000..0x24e2fc28]
 at java.lang.Object.wait(Native Method)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x55800030> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-17" daemon prio=5 tid=0x01e2d290 nid=0x54 in Object.wait() [0x24e5f000..0x24e5fc28]
 at java.lang.Object.wait(Native Method)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x55803860> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-16" daemon prio=5 tid=0x0223d830 nid=0x53 in Object.wait() [0x24e8f000..0x24e8fc28]
 at java.lang.Object.wait(Native Method)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x55800050> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"BMLogThread" prio=5 tid=0x01c95348 nid=0x52 waiting on condition [0x24ebf000..0x24ebfc28]
 at java.lang.Thread.sleep(Native Method)
 at com.bluemartini.dna.BMLogThread.run(BMLogThread.java:140)
"Thread-12" prio=5 tid=0x00f963e8 nid=0x4f in Object.wait() [0x24eef000..0x24eefc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at java.util.TimerThread.mainLoop(Timer.java:403)
 - locked <0x55800070> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-11" prio=5 tid=0x00ced720 nid=0x4e in Object.wait() [0x24f1f000..0x24f1fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at java.util.TimerThread.mainLoop(Timer.java:403)
 - locked <0x55806528> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-10" prio=5 tid=0x00bf40c8 nid=0x4d in Object.wait() [0x24f4f000..0x24f4fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at java.util.TimerThread.mainLoop(Timer.java:403)
 - locked <0x55800080> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-9" prio=5 tid=0x004d3410 nid=0x4c in Object.wait() [0x24f7f000..0x24f7fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at java.util.TimerThread.mainLoop(Timer.java:403)
 - locked <0x55800090> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-8" prio=5 tid=0x01712088 nid=0x4b in Object.wait() [0x25f9f000..0x25f9fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at java.util.TimerThread.mainLoop(Timer.java:403)
 - locked <0x55803880> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-7" prio=5 tid=0x018f5758 nid=0x4a in Object.wait() [0x263ef000..0x263efc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at java.util.TimerThread.mainLoop(Timer.java:403)
 - locked <0x55808408> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"ExecuteThread: '0' for queue: 'weblogic.cluster.MulticastManager'" daemon prio=5 tid=0x013c7608 nid=0x49 runnable [0x265ff000..0x265ffc28]
 at java.net.PlainDatagramSocketImpl.receive(Native Method)
 at java.net.DatagramSocket.receive(DatagramSocket.java:711)
 - locked <0x3c819820> (a java.net.DatagramPacket)
 - locked <0x55818bc8> (a java.net.MulticastSocket)
 at weblogic.cluster.FragmentSocket.receive(FragmentSocket.java:180)
 at weblogic.cluster.MulticastManager.execute(MulticastManager.java:399)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)
"weblogic.health.CoreHealthMonitor" daemon prio=5 tid=0x017f7408 nid=0x48 waiting on condition [0x2664f000..0x2664fc28]
 at java.lang.Thread.sleep(Native Method)
 at weblogic.t3.srvr.CoreHealthMonitorThread.run(CoreHealthMonitorThread.java:163)
"Thread-6" prio=5 tid=0x00499a78 nid=0x47 in Object.wait() [0x2669f000..0x2669fc28]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x55803890> (a java.util.TaskQueue)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x55803890> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"ExecuteThread: '0' for queue: 'Multicast'" daemon prio=5 tid=0x01a6ccf0 nid=0x46 in Object.wait() [0x266cf000..0x266cfc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x55813bb8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"NodeManagerAgent" prio=5 tid=0x01704848 nid=0x45 runnable [0x266ff000..0x266ffc28]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at weblogic.utils.io.ChunkedInputStream.read(ChunkedInputStream.java:140)
 at java.io.InputStream.read(InputStream.java:89)
 at com.certicom.tls.record.ReadHandler.readFragment(Unknown Source)
 at com.certicom.tls.record.ReadHandler.readRecord(Unknown Source)
 at com.certicom.tls.record.ReadHandler.read(Unknown Source)
 - locked <0x55819d30> (a com.certicom.tls.record.ReadHandler)
 at com.certicom.io.InputSSLIOStreamWrapper.read(Unknown Source)
 at sun.nio.cs.StreamDecoder$CharsetSD.readBytes(StreamDecoder.java:408)
 at sun.nio.cs.StreamDecoder$CharsetSD.implRead(StreamDecoder.java:450)
 at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:182)
 - locked <0x4d802868> (a java.io.InputStreamReader)
 at java.io.InputStreamReader.read(InputStreamReader.java:167)
 at java.io.BufferedReader.fill(BufferedReader.java:136)
 at java.io.BufferedReader.readLine(BufferedReader.java:299)
 - locked <0x4d802868> (a java.io.InputStreamReader)
 at java.io.BufferedReader.readLine(BufferedReader.java:362)
 at weblogic.nodemanager.internal.NMMessage.receive(NMMessage.java:109)
 at weblogic.nodemanager.wlscontrol.NodeManagerCommandListener.readInputCommand(NodeManagerCommandListener.java:136)
 at weblogic.nodemanager.wlscontrol.NodeManagerCommandListener.run(NodeManagerCommandListener.java:60)
"Thread-5" prio=5 tid=0x015514d8 nid=0x44 in Object.wait() [0x2672f000..0x2672fc28]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x558000a0> (a java.util.TaskQueue)
 at java.lang.Object.wait(Object.java:429)
 at java.util.TimerThread.mainLoop(Timer.java:403)
 - locked <0x558000a0> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"LDAPConnThread-2 ldap://32.69.253.106:7300" daemon prio=5 tid=0x01883940 nid=0x42 runnable [0x2678f000..0x2678fc28]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
 - locked <0x558185d8> (a java.io.BufferedInputStream)
 at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
 at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
 at java.lang.Thread.run(Thread.java:534)
"LDAPConnThread-1 ldap://32.69.253.106:7300" daemon prio=5 tid=0x018835f0 nid=0x40 runnable [0x267ef000..0x267efc28]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
 - locked <0x5581a4f8> (a java.io.BufferedInputStream)
 at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
 at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
 at java.lang.Thread.run(Thread.java:534)
"LDAPConnThread-0 ldap://32.69.253.106:7300" daemon prio=5 tid=0x0154d6e0 nid=0x3f runnable [0x2681f000..0x2681fc28]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
 - locked <0x55818618> (a java.io.BufferedInputStream)
 at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
 at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
 at java.lang.Thread.run(Thread.java:534)
"VDE Transaction Processor Thread" prio=2 tid=0x014a1aa0 nid=0x3d in Object.wait() [0x2684f000..0x2684fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:365)
 - locked <0x55820d28> (a com.octetstring.vde.backend.standard.TransactionProcessor)
 at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
"ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x013109a0 nid=0x3c in Object.wait() [0x2690f000..0x2690fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x55813c38> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x014da920 nid=0x3b in Object.wait() [0x2693f000..0x2693fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x55813cb8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x014a38a8 nid=0x3a in Object.wait() [0x2696f000..0x2696fc28]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x55816388> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0x00cca560 nid=0x39 runnable [0x26a1f000..0x26a1fc28]
 at weblogic.socket.PosixSocketMuxer.poll(Native Method)
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:100)
 - locked <0x5582c110> (a java.lang.String)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)
"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0x012ba460 nid=0x38 waiting for monitor entry [0x26a4f000..0x26a4fc28]
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
 - waiting to lock <0x5582c110> (a java.lang.String)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)
"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0x00c78408 nid=0x37 waiting for monitor entry [0x26a7f000..0x26a7fc28]
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
 - waiting to lock <0x5582c110> (a java.lang.String)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)

Similar Messages

Large Memory Usage and Frozen [thread dump attached]

Hi,
SQL Developer (Version 2.1.1.64, WinXP Pro, Java 1.6, Oracle 10g R2) always uses at least 550MB of memory, if left open, for more than a day, it invariably goes up to 700-800MB.
If I close all windows and connections, virtually no memory is reclaimed.
I clicked + beside a view to see the columns, sqldeveloper froze for a few minutes, below is the thread dump.
2010-05-21 11:31:58
Full thread dump Java HotSpot(TM) Client VM (14.2-b01 mixed mode):
"CONNECTION_ALIVE" prio=6 tid=0x3891c000 nid=0x1d58 waiting for monitor entry [0x3a55f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at oracle.jdbc.driver.T4CConnection.doPingDatabase(T4CConnection.java:3398)
- waiting to lock <0x09ad05f8> (a oracle.jdbc.driver.T4CConnection)
at oracle.jdbc.driver.PhysicalConnection.pingDatabase(PhysicalConnection.java:7074)
at oracle.javatools.db.ora.BaseOracleDatabase.isConnectionAlive(BaseOracleDatabase.java:165)
at oracle.javatools.db.AbstractDatabase$1.run(AbstractDatabase.java:316)
at java.lang.Thread.run(Thread.java:619)
"Loading Children" prio=6 tid=0x3891bc00 nid=0x12c4 waiting on condition [0x39d5f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x03eab570> (a java.util.concurrent.FutureTask$Sync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:218)
at java.util.concurrent.FutureTask.get(FutureTask.java:83)
at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$IdeTaskTracker.run(RaptorTaskManager.java:532)
at java.lang.Thread.run(Thread.java:619)
"pool-2-thread-57" prio=6 tid=0x3891b400 nid=0x2094 waiting on condition [0x35b5f000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x09b819f0> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:841)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1160)
at java.util.concurrent.locks.ReentrantLock.tryLock(ReentrantLock.java:416)
at oracle.dbtools.raptor.utils.Connections.lock(Connections.java:1334)
at oracle.dbtools.raptor.utils.Connections.lock(Connections.java:1319)
at oracle.dbtools.raptor.utils.Connections.lock(Connections.java:1306)
at oracle.dbtools.raptor.navigator.xml.AbstractItemInstance.lockConnection(AbstractItemInstance.java:52)
at oracle.dbtools.raptor.navigator.xml.XmlNodeInstance.listChildren(XmlNodeInstance.java:55)
at oracle.dbtools.raptor.navigator.ObjectNodeFilter$ObjectNodeFilterLoadTask.doWorkImpl(ObjectNodeFilter.java:78)
at oracle.dbtools.raptor.navigator.DeferredLoadingFilter$FilterLoadTask.doWork(DeferredLoadingFilter.java:124)
at oracle.dbtools.raptor.navigator.DeferredLoadingFilter$FilterLoadTask.doWork(DeferredLoadingFilter.java:113)
at oracle.dbtools.raptor.backgroundTask.RaptorTask.call(RaptorTask.java:193)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$RaptorFutureTask.run(RaptorTaskManager.java:492)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
"pool-2-thread-55" prio=6 tid=0x38d68400 nid=0xd74 runnable [0x3a15f000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at oracle.net.ns.Packet.receive(Packet.java:239)
at oracle.net.ns.DataPacket.receive(DataPacket.java:92)
at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:172)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:117)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:92)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:77)
at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1023)
at oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:999)
at oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:584)
at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:194)
at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:785)
at oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:860)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1186)
at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3381)
at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3425)
- locked <0x09ad05f8> (a oracle.jdbc.driver.T4CConnection)
at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1490)
at oracle.dbtools.raptor.controls.grid.ResultSetTableModel.openResultSet(ResultSetTableModel.java:412)
at oracle.dbtools.raptor.controls.grid.ResultSetTableModel.fetchNext(ResultSetTableModel.java:169)
at oracle.dbtools.raptor.controls.grid.ResultSetTableModel$4.doWork(ResultSetTableModel.java:556)
at oracle.dbtools.raptor.controls.grid.ResultSetTableModel$4.doWork(ResultSetTableModel.java:540)
at oracle.dbtools.raptor.backgroundTask.RaptorTask.call(RaptorTask.java:193)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$RaptorFutureTask.run(RaptorTaskManager.java:492)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
"AWT-EventQueue-0" prio=6 tid=0x354fac00 nid=0x18d4 waiting for monitor entry [0x3a45f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at oracle.jdbc.driver.PhysicalConnection.getMetaData(PhysicalConnection.java:3891)
- waiting to lock <0x09ad05f8> (a oracle.jdbc.driver.T4CConnection)
at oracle.dbtools.raptor.plscope.Query.getToolTipText(Query.java:58)
at oracle.dbtools.raptor.phighlight.TooltipPlugin$1.getToolTipText(TooltipPlugin.java:29)
at oracle.ide.ceditor.CodeEditor.getToolTipText(CodeEditor.java:1734)
- locked <0x17245f98> (a java.util.ArrayList)
at oracle.javatools.editor.BasicEditorPane.getToolTipText(BasicEditorPane.java:1530)
at javax.swing.ToolTipManager$insideTimerAction.actionPerformed(ToolTipManager.java:658)
at javax.swing.Timer.fireActionPerformed(Timer.java:271)
at javax.swing.Timer$DoPostEvent.run(Timer.java:201)
at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:209)
at java.awt.EventQueue.dispatchEvent(EventQueue.java:597)
at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:269)
at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:184)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:174)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:169)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:161)
at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)
"Background Parser" prio=6 tid=0x38a43400 nid=0x23c4 waiting on condition [0x39c5f000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
at java.lang.Thread.run(Thread.java:619)
"SwingWorker-pool-5-thread-1142" prio=6 tid=0x38868800 nid=0x1a7c waiting on condition [0x3820f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x0e77bc10> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
"Background Parser" prio=6 tid=0x38a76c00 nid=0x1d18 waiting on condition [0x3a35f000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
at java.lang.Thread.run(Thread.java:619)
"Background Parser" prio=6 tid=0x387e2800 nid=0xd00 waiting on condition [0x3a25f000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
at java.lang.Thread.run(Thread.java:619)
"Background Parser" prio=6 tid=0x38752000 nid=0x2794 waiting on condition [0x39e5f000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
at java.lang.Thread.run(Thread.java:619)
"Swing-Shell" daemon prio=6 tid=0x367f0000 nid=0xd7c waiting on condition [0x3a85f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x1069d0d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at sun.awt.shell.Win32ShellFolderManager2$ComInvoker$3.run(Win32ShellFolderManager2.java:458)
at java.lang.Thread.run(Thread.java:619)
"Persistence Auto Flusher" daemon prio=6 tid=0x388a5c00 nid=0x1950 in Object.wait() [0x37e0f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at java.util.TimerThread.mainLoop(Timer.java:483)
- locked <0x0e892d48> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Thread-76" prio=6 tid=0x387aec00 nid=0x259c runnable [0x00000000]
java.lang.Thread.State: RUNNABLE
"WeakDataReference polling" prio=2 tid=0x38752800 nid=0xe94 in Object.wait() [0x3a05f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x0b6ba260> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at oracle.ide.util.WeakDataReference$Cleaner.run(WeakDataReference.java:88)
at java.lang.Thread.run(Thread.java:619)
"Image Animator 3" daemon prio=4 tid=0x3861b400 nid=0x2330 waiting on condition [0x3978f000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at sun.awt.image.GifFrame.dispose(GifImageDecoder.java:653)
at sun.awt.image.GifImageDecoder.produceImage(GifImageDecoder.java:230)
at sun.awt.image.InputStreamImageSource.doFetch(InputStreamImageSource.java:246)
at sun.awt.image.ImageFetcher.fetchloop(ImageFetcher.java:172)
at sun.awt.image.ImageFetcher.run(ImageFetcher.java:136)
"Background Parser" prio=6 tid=0x38348800 nid=0x978 waiting on condition [0x3988f000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at oracle.dbtools.raptor.plsql.BackgroundParser$1.construct(BackgroundParser.java:112)
at oracle.dbtools.raptor.utils.NamedSwingWorker$2.run(NamedSwingWorker.java:115)
at java.lang.Thread.run(Thread.java:619)
"TextBufferScavenger" prio=6 tid=0x38324800 nid=0x1af0 in Object.wait() [0x3968f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x09bb9158> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at oracle.ide.model.TextNode$FacadeBufferReference$PollingThread.run(TextNode.java:1949)
"pool-4-thread-1" prio=6 tid=0x36960400 nid=0x1a84 waiting on condition [0x35a5f000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x08150a78> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
"IconOverlayTracker Timer" prio=6 tid=0x38520c00 nid=0x1b48 in Object.wait() [0x3950f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at java.util.TimerThread.mainLoop(Timer.java:483)
- locked <0x0795f290> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Timer queue for AWT thread" daemon prio=6 tid=0x369b4000 nid=0x1f20 in Object.wait() [0x3940f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x077e1358> (a java.lang.Object)
at java.lang.Object.wait(Object.java:485)
at ice.util.awt.TimedAWTExecutor.nextElem(TimedAWTExecutor.java:108)
- locked <0x077e1358> (a java.lang.Object)
at ice.util.awt.TimedAWTExecutor.runScheduler(TimedAWTExecutor.java:130)
at ice.util.awt.TimedAWTExecutor$1.run(TimedAWTExecutor.java:19)
"WaitCursor-Timer" prio=6 tid=0x367c3c00 nid=0x1010 in Object.wait() [0x37b0f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at java.util.TimerThread.mainLoop(Timer.java:483)
- locked <0x077e1400> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Native Directory Watcher" prio=2 tid=0x368d4000 nid=0x2334 runnable [0x3830f000]
java.lang.Thread.State: RUNNABLE
at oracle.ide.natives.NativeHandler.enterWatcherThread(Native Method)
at oracle.ide.natives.NativeHandler$2.run(NativeHandler.java:252)
at java.lang.Thread.run(Thread.java:619)
"BaseTreeExplorer.NodeOpeningExecutor" prio=6 tid=0x3684b000 nid=0x8b0 waiting on condition [0x3810f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x06950af0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
"Scheduler" daemon prio=6 tid=0x36846400 nid=0x14bc in Object.wait() [0x37f0f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at oracle.dbtools.raptor.backgroundTask.TaskLinkedList.takeNextTask(TaskLinkedList.java:47)
- locked <0x06950c70> (a oracle.dbtools.raptor.backgroundTask.TaskLinkedList)
at oracle.dbtools.raptor.backgroundTask.RaptorTaskManager$SchedulerThread.run(RaptorTaskManager.java:422)
"TimerQueue" daemon prio=6 tid=0x36832800 nid=0x88c in Object.wait() [0x37d0f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at javax.swing.TimerQueue.postExpiredTimers(TimerQueue.java:218)
- locked <0x06950da8> (a javax.swing.TimerQueue)
at javax.swing.TimerQueue.run(TimerQueue.java:234)
- locked <0x06950da8> (a javax.swing.TimerQueue)
at java.lang.Thread.run(Thread.java:619)
"ChangeSetService" prio=2 tid=0x367fd400 nid=0x2754 in Object.wait() [0x37c0f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x06892cc0> (a oracle.jdevimpl.vcs.changeset.ChangeSetService)
at java.lang.Object.wait(Object.java:485)
at oracle.jdevimpl.vcs.changeset.ChangeSetService.awaitEvents(ChangeSetService.java:178)
- locked <0x06892cc0> (a oracle.jdevimpl.vcs.changeset.ChangeSetService)
at oracle.jdevimpl.vcs.changeset.ChangeSetService.eventLoop(ChangeSetService.java:199)
at oracle.jdevimpl.vcs.changeset.ChangeSetService.access$200(ChangeSetService.java:56)
at oracle.jdevimpl.vcs.changeset.ChangeSetService$2.run(ChangeSetService.java:138)
at java.lang.Thread.run(Thread.java:619)
"TimedCache-Timer" daemon prio=6 tid=0x35d52c00 nid=0x2448 in Object.wait() [0x3624f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at java.util.TimerThread.mainLoop(Timer.java:483)
- locked <0x062ab118> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"JarIndex Timer" daemon prio=6 tid=0x35556400 nid=0x2488 in Object.wait() [0x35d4f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x062206e0> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"AWT-Windows" daemon prio=6 tid=0x354dd000 nid=0x1d0c runnable [0x3595f000]
java.lang.Thread.State: RUNNABLE
at sun.awt.windows.WToolkit.eventLoop(Native Method)
at sun.awt.windows.WToolkit.run(WToolkit.java:291)
at java.lang.Thread.run(Thread.java:619)
"AWT-Shutdown" prio=6 tid=0x354a1800 nid=0x268c in Object.wait() [0x3585f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at sun.awt.AWTAutoShutdown.run(AWTAutoShutdown.java:259)
- locked <0x062208d8> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:619)
"Java2D Disposer" daemon prio=10 tid=0x354b7400 nid=0x5f4 in Object.wait() [0x3575f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x06220968> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at sun.java2d.Disposer.run(Disposer.java:125)
at java.lang.Thread.run(Thread.java:619)
"Low Memory Detector" daemon prio=6 tid=0x00ee1000 nid=0x2664 runnable [0x00000000]
java.lang.Thread.State: RUNNABLE
"CompilerThread0" daemon prio=10 tid=0x00edc000 nid=0x1f6c waiting on condition [0x00000000]
java.lang.Thread.State: RUNNABLE
"Attach Listener" daemon prio=10 tid=0x00eda800 nid=0x206c runnable [0x00000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x00ed9400 nid=0xf64 waiting on condition [0x00000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=8 tid=0x00ec6c00 nid=0x2348 in Object.wait() [0x34e7f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x061b0298> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x00ec5800 nid=0x2484 in Object.wait() [0x34d7f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x061b0320> (a java.lang.ref.Reference$Lock)
"main" prio=6 tid=0x009f8000 nid=0x19e0 waiting on condition [0x00000000]
java.lang.Thread.State: RUNNABLE
"VM Thread" prio=10 tid=0x00ec1800 nid=0x22e0 runnable
"VM Periodic Task Thread" prio=10 tid=0x00eec000 nid=0x2604 waiting on condition
JNI global references: 5312
Heap
def new generation total 45376K, used 28499K [0x03080000, 0x061b0000, 0x061b0000)
eden space 40384K, 67% used [0x03080000, 0x04af44c0, 0x057f0000)
from space 4992K, 28% used [0x05cd0000, 0x05e30850, 0x061b0000)
to space 4992K, 0% used [0x057f0000, 0x057f0000, 0x05cd0000)
tenured generation total 604992K, used 364537K [0x061b0000, 0x2b080000, 0x2b080000)
the space 604992K, 60% used [0x061b0000, 0x1c5ae548, 0x1c5ae600, 0x2b080000)
compacting perm gen total 57344K, used 57260K [0x2b080000, 0x2e880000, 0x33080000)
the space 57344K, 99% used [0x2b080000, 0x2e86b348, 0x2e86b400, 0x2e880000)
No shared spaces configured.
Edited by: mdaly on May 21, 2010 11:42 AM

The cause of hang could be figured out from the thread dump.
I have fixed that in development code. It was happening from PL/SQL editor trying to create tooltip which locked up the connection.
I am not sure what would lead to memory bloat even if the tool is not in use. There could be memory leak from some component. I am investigating that.
Suggest you to keep ObjectViewers, reports & PL/SQL editor closed when not in use.
Have Sql Array Fetch Size preference to 50 if it's higher.
Do not have auto-refresh for Report editor.
Keep Sql History, Find Db Object, Snippets collapsed.
See if that helps.
-Raghu

How to get a thread dump, in case of an IDE freeze

When you're working with the IDE and if it either freezes or becomes sluggish for no apparent reason, it's recommended to generate a thread dump, and report it to Studio feedback alias ([email protected]) with a description of what happened and attach the dump to it.
A thread dump is an invaluable source of information to IDE developers when investigating deadlocks and some performance issues. It is a textual dump of all active threads and monitors of Java apps running in a Virtual Machine.
The ways to generate a thread dump differ depending on the platform:
* Windows systems
Press Ctrl-Break in the command console you used to start the IDE.
You won't be able to see the console in case you started the IDE using the default desktop icon created by the IDE installer. To be able to generate the thread dump, you must launch the IDE using a console window (invoke Command Prompt, go to {studio-install-dir}/bin and type runide.exe), or configure the desktop shortcut properties to launch the runide.exe program instead of the default runidew.exe.
Note: You should increase the screen buffer size of the command prompt, so that it could retian the entire thread dump output. To do that, on the command prompt where IDE is running, open the properties dialog box by right clicking on the titlebar and selecting 'properties'. Then select the 'layout tab' and increase the 'screen buffer size' parameters to - width - 200, Height - 4000.
* Unix systems
Press Ctrl-\ in the terminal console you used to start the JSE.
Alternatively, you can also generate a thread dump by sending the QUIT signal to the Java VM running the JSE
kill -QUIT process_id
where process_id is the process number of the respective java process.
-------Here is a sample thread dump -------
Full thread dump Java HotSpot(TM) Client VM (1.4.2_01-b06 mixed mode):
"Text-Layout" daemon prio=2 tid=0x0886ebd8 nid=0x4e4 in Object.wait() [9e8f000..9e8fd94]
at java.lang.Object.wait(Native Method)
- waiting on <0x11730910> (a org.netbeans.editor.view.spi.ViewLayoutQueue)
at java.lang.Object.wait(Object.java:429)
at org.netbeans.editor.view.spi.ViewLayoutQueue.waitForTask(ViewLayoutQueue.java:128)
- locked <0x11730910> (a org.netbeans.editor.view.spi.ViewLayoutQueue)
at org.netbeans.editor.view.spi.ViewLayoutQueue$LayoutThread.run(ViewLayoutQueue.java:182)
"Compilation" daemon prio=2 tid=0x0883d878 nid=0xb1c in Object.wait() [9c8f000..9c8fd94]
at java.lang.Object.wait(Native Method)
- waiting on <0x1143dde0> (a java.util.LinkedList)
at java.lang.Object.wait(Object.java:429)
at org.netbeans.core.compiler.CompilationEngineImpl$CompilerThread.nextJobAndTask(CompilationEngineImpl.java:162)
- locked <0x1143dde0> (a java.util.LinkedList)
at org.netbeans.core.compiler.CompilationEngineImpl$CompilerThread.run(CompilationEngineImpl.java:175)
"TimerQueue" daemon prio=5 tid=0x03575478 nid=0xb18 in Object.wait() [988f000..988fd94]
at java.lang.Object.wait(Native Method)
- waiting on <0x10d4af60> (a javax.swing.TimerQueue)
at javax.swing.TimerQueue.run(TimerQueue.java:231)
- locked <0x10d4af60> (a javax.swing.TimerQueue)
at java.lang.Thread.run(Thread.java:534)
"AWT-EventQueue-1" prio=7 tid=0x0344fae0 nid=0xb14 in Object.wait() [3caf000..3cafd94]
at java.lang.Object.wait(Native Method)
- waiting on <0x10d4afe8> (a java.awt.EventQueue)
at java.lang.Object.wait(Object.java:429)
at java.awt.EventQueue.getNextEvent(EventQueue.java:339)
- locked <0x10d4afe8> (a java.awt.EventQueue)
at java.awt.EventDispatchThread.pumpOneEventForHierarchy(EventDispatchThread.java:162)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:151)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:145)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:137)
at java.awt.EventDispatchThread.run(EventDispatchThread.java:100)

You can get a thread dump (Windows only) whitout any preparation. Simply use the Stack Trace tool from this web site:
http://tmitevski.users.mcs2.netarray.com
It works on Windows services too.

What's a good way to do a thread dump into a separate file

What is a good way to do a thread dump automatically into a separate file.
Example. I run a script to do the thread dump, but unfortunetly, it goes into my stdout log file with the rest of my weblogic errors.
Any ideas? I want it in a separate file when I run my script?

Do a Google search on "Drobo S" "benchmark." I don't have a Drobo S, only the regular Drobo. But here's a guy who tested one on Windows:
http://mansurovs.com/drobo-s-review-usb-3-0-2nd-generation
This one has it a bit faster:
http://the-gadgeteer.com/2011/12/31/drobo-s-storage-array-review/
Do read up on a few reviews of it, and be absolutely clear that interface speed (i.e. eSATA versus Firewire versus Thunderbolt) is NOT the same as the performance of the system. The Drobo cannot keep up with any interfaces... at least the Drobo and the Drobo S cannot.
I am not using the FS model which is a NAS. I am using the plain old "Drobo" which is slower than the Drobo S, but that's not to say that the Drobo S is fast, because it is not.
The Drobo in theory is really attractive: Dead simple to manage, can mix and match drive sizes, offers you some data protection, etc. However do note that protected storage is not, in and of itself, a backup. You need other backups besides just the data on the Drobo. And, because it's so slow, it's really not a great fit for photo storage. See this review from a guy who used to think the Drobo was great for that and then appended his review:
http://www.stuckincustoms.com/drobo-review/
To be as clear as possible, IMO the BEST backup strategy with something like Aperture (so long as your managed Aperture library is of a manageable size, like < 800 GB), is to get a few small portable Firewire 800 drives and keep vaults on each one. They are great because they are easy to use, to have with you, are bus powered, and you WILL offsite them.

HELP!!! Why do my thread dump have so many locked monitor

In recent weeks, My customer's weblogic server become more busy.Each time I downloaded
the thread dump when CPU is busy than 90%,I found a lot of lock in the thread
dump! Especially the class named "weblogic.kernel.ExecuteThread" . It's the kernel
class of weblogic, Why were most of them locked?
Full thread dump:
"process forker" daemon prio=1 tid=0x95b4c8e0 nid=0x3084 waiting on monitor [0x977ff000..0x977ff890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53d26420> (a java.lang.Object)
 at java.lang.UNIXProcessForker.run(Native Method)
 at java.lang.Thread.run(Thread.java:479)
"process reaper" daemon prio=1 tid=0x95376758 nid=0x3083 runnable [0x96eff000..0x96eff890]
 at java.lang.UNIXProcessReaper.run(Native Method)
 at java.lang.Thread.run(Thread.java:479)
"HighPriority TimeEventGenerator" daemon prio=1 tid=0x825bf18 nid=0x25a1 waiting
on monitor [0x95dff000..0x95dff890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53a3bd10> (a weblogic.time.common.internal.TimeTable)
 at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
 - locked <53a3bd10> (a weblogic.time.common.internal.TimeTable)
 at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
 at java.lang.Thread.run(Thread.java:479)
"ListenThread" prio=1 tid=0x94d00630 nid=0x25a0 runnable [0x95fff000..0x95fff890]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
 - locked <538fa238> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:238)
 at java.net.ServerSocket.accept(ServerSocket.java:217)
 at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
 at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
"NBExecuteThread-1" daemon prio=1 tid=0x8c0dd1d0 nid=0x259c waiting on monitor
[0x94521000..0x94521890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a9650> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a9650> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"NBExecuteThread-0" daemon prio=1 tid=0x8c0dc7d0 nid=0x259b waiting on monitor
[0x94321000..0x94321890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a9060> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a9060> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
//"ExecuteThread-49" daemon prio=1 tid=0x8c034660 nid=0x259a runnable [0x94121000..0x94121890]
 at java.net.PlainDatagramSocketImpl.peek(Native Method)
 - locked <537acf60> (a java.net.PlainDatagramSocketImpl)
 at java.net.DatagramSocket.receive(DatagramSocket.java:349)
 - locked <486f9980> (a java.net.DatagramPacket)
 - locked <537acf40> (a java.net.MulticastSocket)
 at weblogic.cluster.TDMSocketIPM.receive(TDMSocketIPM.java:86)
 at weblogic.cluster.TMSocket.execute(TMSocket.java:249)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-48" daemon prio=1 tid=0x8c0c3d18 nid=0x2599 waiting for monitor
entry [0x93f21000..0x93f21890]
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
 - waiting to lock <538fa5c8> (a java.lang.Object)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-47" daemon prio=1 tid=0x8c0c32d0 nid=0x2598 runnable [0x93d21000..0x93d21890]
 at weblogic.socket.PosixSocketMuxer.poll(Native Method)
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
 - locked <538fa5c8> (a java.lang.Object)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-46" daemon prio=1 tid=0x8c0bf410 nid=0x2597 waiting for monitor
entry [0x93b21000..0x93b21890]
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
 - waiting to lock <538fa5c8> (a java.lang.Object)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-45" daemon prio=1 tid=0x8c0be9c8 nid=0x2596 waiting on monitor
[0x93921000..0x93921890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a6df8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a6df8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-44" daemon prio=1 tid=0x8c0bdab0 nid=0x2595 waiting on monitor
[0x93721000..0x93721890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a6828> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a6828> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-43" daemon prio=1 tid=0x8c0bd068 nid=0x2594 waiting on monitor
[0x93521000..0x93521890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a6258> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a6258> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-42" daemon prio=1 tid=0x8c0c0ce0 nid=0x2593 waiting on monitor
[0x93321000..0x93321890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a5c88> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a5c88> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-41" daemon prio=1 tid=0x8c0c0298 nid=0x2592 waiting on monitor
[0x93121000..0x93121890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a56b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a56b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-40" daemon prio=1 tid=0x8c0a21e0 nid=0x2591 waiting on monitor
[0x92f21000..0x92f21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a50e8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a50e8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-39" daemon prio=1 tid=0x8c0d4520 nid=0x2590 waiting on monitor
[0x92d21000..0x92d21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a4b18> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a4b18> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-38" daemon prio=1 tid=0x8c0d43d0 nid=0x258f waiting on monitor
[0x92b21000..0x92b21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a4548> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a4548> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-37" daemon prio=1 tid=0x8c0d3988 nid=0x258e waiting on monitor
[0x92921000..0x92921890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a3f78> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a3f78> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-36" daemon prio=1 tid=0x8c0ded20 nid=0x258d waiting on monitor
[0x92721000..0x92721890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a39a8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a39a8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-35" daemon prio=1 tid=0x8c0de2d8 nid=0x258c waiting on monitor
[0x92521000..0x92521890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a33d8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a33d8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-34" daemon prio=1 tid=0x8c0cd528 nid=0x258b waiting on monitor
[0x92321000..0x92321890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a2e08> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a2e08> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-33" daemon prio=1 tid=0x8c0ccae0 nid=0x258a waiting on monitor
[0x92121000..0x92121890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a2838> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a2838> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-32" daemon prio=1 tid=0x8c075360 nid=0x2589 waiting on monitor
[0x91f21000..0x91f21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a2268> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a2268> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-31" daemon prio=1 tid=0x8c0837d0 nid=0x2588 waiting on monitor
[0x91d21000..0x91d21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a1c98> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a1c98> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-30" daemon prio=1 tid=0x8c0a5628 nid=0x2587 waiting on monitor
[0x91b21000..0x91b21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a16c8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a16c8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-29" daemon prio=1 tid=0x8c07aaf8 nid=0x2586 waiting on monitor
[0x91921000..0x91921890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a10f8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a10f8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-28" daemon prio=1 tid=0x8c0c23d0 nid=0x2585 waiting on monitor
[0x91721000..0x91721890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a0b28> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a0b28> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-27" daemon prio=1 tid=0x8c0c1988 nid=0x2584 waiting on monitor
[0x91521000..0x91521890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537a0558> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537a0558> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-26" daemon prio=1 tid=0x8c07ca00 nid=0x2583 waiting on monitor
[0x91321000..0x91321890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379ff88> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379ff88> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-25" daemon prio=1 tid=0x8c079e70 nid=0x2582 waiting on monitor
[0x91121000..0x91121890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379f9b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379f9b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-24" daemon prio=1 tid=0x8c078038 nid=0x2581 waiting on monitor
[0x90f21000..0x90f21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379f3e8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379f3e8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-23" daemon prio=1 tid=0x8c0a3298 nid=0x2580 waiting on monitor
[0x90d21000..0x90d21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379ee18> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379ee18> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-22" daemon prio=1 tid=0x8c0e30d8 nid=0x257f waiting on monitor
[0x90b21000..0x90b21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379e848> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379e848> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-21" daemon prio=1 tid=0x8c0c5948 nid=0x257e waiting on monitor
[0x90921000..0x90921890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379e278> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379e278> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-20" daemon prio=1 tid=0x8c0d0470 nid=0x257d waiting on monitor
[0x90721000..0x90721890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379dca8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379dca8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-19" daemon prio=1 tid=0x8c080798 nid=0x257c waiting on monitor
[0x90521000..0x90521890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379d6d8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379d6d8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-18" daemon prio=1 tid=0x8c080648 nid=0x257b waiting on monitor
[0x90321000..0x90321890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379d108> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379d108> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-17" daemon prio=1 tid=0x8c032380 nid=0x257a runnable [0x90121000..0x90121890]
 at java.lang.String.concat(String.java:1553)
 at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
 at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
 at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
 at com.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:122)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
 at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
 at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
 at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
 at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
 at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
 at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
 at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
 at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-16" daemon prio=1 tid=0x8c0df9a8 nid=0x2579 waiting on monitor
[0x8ff21000..0x8ff21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379c568> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379c568> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-15" daemon prio=1 tid=0x8c0a6288 nid=0x2578 waiting on monitor
[0x8fd21000..0x8fd21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379bf98> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379bf98> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-14" daemon prio=1 tid=0x8c0dbd60 nid=0x2577 waiting on monitor
[0x8fb21000..0x8fb21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379b9c8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379b9c8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-13" daemon prio=1 tid=0x8c0c8498 nid=0x2576 waiting on monitor
[0x8f921000..0x8f921890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379b3f8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379b3f8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-12" daemon prio=1 tid=0x8c0a6a28 nid=0x2575 waiting on monitor
[0x8f721000..0x8f721890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379ae28> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379ae28> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-11" daemon prio=1 tid=0x8c07d348 nid=0x2574 runnable [0x8f521000..0x8f521890]
 at java.lang.System.arraycopy(Native Method)
 at java.lang.String.getChars(String.java:557)
 at java.lang.String.concat(String.java:1554)
 at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
 at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
 at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
 at com.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:251)
 at com.ebao.carcase.servlet.claim.ClaimServlet.doGet(ClaimServlet.java:77)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
 at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
 at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
 at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
 at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
 at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
 at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
 at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
 at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-10" daemon prio=1 tid=0x8c0369b0 nid=0x2571 waiting on monitor
[0x8f321000..0x8f321890]
 at java.lang.Object.wait(Native Method)
 - waiting on <5379a288> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <5379a288> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-9" daemon prio=1 tid=0x8c079898 nid=0x256f waiting on monitor [0x8f121000..0x8f121890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53799cb8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <53799cb8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-8" daemon prio=1 tid=0x8c035260 nid=0x256e waiting on monitor [0x8ef21000..0x8ef21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537996e8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537996e8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-7" daemon prio=1 tid=0x8c034510 nid=0x256d waiting on monitor [0x8ed21000..0x8ed21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53799118> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <53799118> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-6" daemon prio=1 tid=0x8c081130 nid=0x256c waiting on monitor [0x8eb21000..0x8eb21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53798b48> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <53798b48> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-5" daemon prio=1 tid=0x8c0c7108 nid=0x256b waiting on monitor [0x8e921000..0x8e921890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53798578> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <53798578> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-4" daemon prio=1 tid=0x8c0a4388 nid=0x256a waiting on monitor [0x8e721000..0x8e721890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53797fa8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <53797fa8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-3" daemon prio=1 tid=0x8c0367b8 nid=0x2569 waiting on monitor [0x8e521000..0x8e521890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537979d8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <537979d8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-2" daemon prio=1 tid=0x8c036290 nid=0x2568 waiting on monitor [0x8e321000..0x8e321890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53797408> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <53797408> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-1" daemon prio=1 tid=0x8c0a4ee0 nid=0x2567 waiting on monitor [0x8e121000..0x8e121890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53796e38> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
 - locked <53796e38> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-0" daemon prio=1 tid=0x8c0a4550 nid=0x2566 runnable [0x8df21000..0x8df21890]
 at java.lang.String.concat(String.java:1553)
 at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
 at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
 at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
 at com.ebao.carcase.servlet.end.EndCaseServlet.service(EndCaseServlet.java:56)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
 at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
 at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
 at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
 at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
 at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
 at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
 at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
 at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"TimeEventGenerator" daemon prio=1 tid=0x8c076008 nid=0x2565 waiting on monitor
[0x8dd21000..0x8dd21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53795330> (a weblogic.time.common.internal.TimeTable)
 at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
 - locked <53795330> (a weblogic.time.common.internal.TimeTable)
 at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
 at java.lang.Thread.run(Thread.java:479)
"SpinnerRandomSource" daemon prio=1 tid=0x8c0b34a0 nid=0x2563 waiting on monitor
[0x8db21000..0x8db21890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53793040> (a weblogic.security.SpinnerThread)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:104)
 - locked <53793040> (a weblogic.security.SpinnerThread)
 at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
"Signal Dispatcher" daemon prio=1 tid=0x8c0077e8 nid=0x2561 waiting on monitor
[0..0]
"Finalizer" daemon prio=1 tid=0x8c000540 nid=0x255e waiting on monitor [0x8c2ff000..0x8c2ff890]
 at java.lang.Object.wait(Native Method)
 - waiting on <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
 - locked <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
 at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
"Reference Handler" daemon prio=1 tid=0x80851f0 nid=0x255d waiting on monitor
[0x8bf8c000..0x8bf8c890]
 at java.lang.Object.wait(Native Method)
 - waiting on <53720208> (a java.lang.ref.Reference$Lock)
 at java.lang.Object.wait(Object.java:415)
 at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:105)
 - locked <53720208> (a java.lang.ref.Reference$Lock)
"main" prio=1 tid=0x804ead0 nid=0x2543 waiting on monitor [0xbfffc000..0xbfffd00c]
 at java.lang.Object.wait(Native Method)
 - waiting on <53743c20> (a weblogic.t3.srvr.T3Srvr)
 at java.lang.Object.wait(Object.java:415)
 at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1958)
 - locked <53743c20> (a weblogic.t3.srvr.T3Srvr)
 at java.lang.reflect.Method.invoke(Native Method)
 at weblogic.Server.startServerDynamically(Server.java:148)
 at weblogic.Server.main(Server.java:97)
 at weblogic.Server.main(Server.java:58)
"VM Thread" prio=1 tid=0x8082110 nid=0x255c runnable
"VM Periodic Task Thread" prio=1 tid=0x8c0064f8 nid=0x255f waiting on monitor
"Suspend Checker Thread" prio=1 tid=0x8c006e30 nid=0x2560 runnable

These are execute threads waiting for requests to come in.
BTW, you probably want to look into using StringBuffer instead of
strings concatenation in com.ebao.carcase.bean.query.Query.generatorXML.
"min.lu" <[email protected]> wrote in message
news:[email protected]...
>
In recent weeks, My customer's weblogic server become more busy.Each timeI downloaded
the thread dump when CPU is busy than 90%,I found a lot of lock in thethread
dump! Especially the class named "weblogic.kernel.ExecuteThread" . It'sthe kernel
class of weblogic, Why were most of them locked?
Full thread dump:
"process forker" daemon prio=1 tid=0x95b4c8e0 nid=0x3084 waiting onmonitor [0x977ff000..0x977ff890]
at java.lang.Object.wait(Native Method)
- waiting on <53d26420> (a java.lang.Object)
at java.lang.UNIXProcessForker.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"process reaper" daemon prio=1 tid=0x95376758 nid=0x3083 runnable[0x96eff000..0x96eff890]
at java.lang.UNIXProcessReaper.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"HighPriority TimeEventGenerator" daemon prio=1 tid=0x825bf18 nid=0x25a1waiting
on monitor [0x95dff000..0x95dff890]
at java.lang.Object.wait(Native Method)
- waiting on <53a3bd10> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
- locked <53a3bd10> (a weblogic.time.common.internal.TimeTable)
atweblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
:141)
at java.lang.Thread.run(Thread.java:479)
"ListenThread" prio=1 tid=0x94d00630 nid=0x25a0 runnable[0x95fff000..0x95fff890]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:463)
- locked <538fa238> (a java.net.PlainSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:238)
at java.net.ServerSocket.accept(ServerSocket.java:217)
atweblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
"NBExecuteThread-1" daemon prio=1 tid=0x8c0dd1d0 nid=0x259c waiting onmonitor
[0x94521000..0x94521890]
at java.lang.Object.wait(Native Method)
- waiting on <537a9650> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a9650> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"NBExecuteThread-0" daemon prio=1 tid=0x8c0dc7d0 nid=0x259b waiting onmonitor
[0x94321000..0x94321890]
at java.lang.Object.wait(Native Method)
- waiting on <537a9060> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a9060> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
//"ExecuteThread-49" daemon prio=1 tid=0x8c034660 nid=0x259a runnable[0x94121000..0x94121890]
at java.net.PlainDatagramSocketImpl.peek(Native Method)
- locked <537acf60> (a java.net.PlainDatagramSocketImpl)
at java.net.DatagramSocket.receive(DatagramSocket.java:349)
- locked <486f9980> (a java.net.DatagramPacket)
- locked <537acf40> (a java.net.MulticastSocket)
at weblogic.cluster.TDMSocketIPM.receive(TDMSocketIPM.java:86)
at weblogic.cluster.TMSocket.execute(TMSocket.java:249)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-48" daemon prio=1 tid=0x8c0c3d18 nid=0x2599 waiting formonitor
entry [0x93f21000..0x93f21890]
atweblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
- waiting to lock <538fa5c8> (a java.lang.Object)
atweblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-47" daemon prio=1 tid=0x8c0c32d0 nid=0x2598 runnable[0x93d21000..0x93d21890]
at weblogic.socket.PosixSocketMuxer.poll(Native Method)
atweblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
- locked <538fa5c8> (a java.lang.Object)
atweblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-46" daemon prio=1 tid=0x8c0bf410 nid=0x2597 waiting formonitor
entry [0x93b21000..0x93b21890]
atweblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:290)
- waiting to lock <538fa5c8> (a java.lang.Object)
atweblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-45" daemon prio=1 tid=0x8c0be9c8 nid=0x2596 waiting onmonitor
[0x93921000..0x93921890]
at java.lang.Object.wait(Native Method)
- waiting on <537a6df8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a6df8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-44" daemon prio=1 tid=0x8c0bdab0 nid=0x2595 waiting onmonitor
[0x93721000..0x93721890]
at java.lang.Object.wait(Native Method)
- waiting on <537a6828> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a6828> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-43" daemon prio=1 tid=0x8c0bd068 nid=0x2594 waiting onmonitor
[0x93521000..0x93521890]
at java.lang.Object.wait(Native Method)
- waiting on <537a6258> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a6258> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-42" daemon prio=1 tid=0x8c0c0ce0 nid=0x2593 waiting onmonitor
[0x93321000..0x93321890]
at java.lang.Object.wait(Native Method)
- waiting on <537a5c88> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a5c88> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-41" daemon prio=1 tid=0x8c0c0298 nid=0x2592 waiting onmonitor
[0x93121000..0x93121890]
at java.lang.Object.wait(Native Method)
- waiting on <537a56b8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a56b8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-40" daemon prio=1 tid=0x8c0a21e0 nid=0x2591 waiting onmonitor
[0x92f21000..0x92f21890]
at java.lang.Object.wait(Native Method)
- waiting on <537a50e8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a50e8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-39" daemon prio=1 tid=0x8c0d4520 nid=0x2590 waiting onmonitor
[0x92d21000..0x92d21890]
at java.lang.Object.wait(Native Method)
- waiting on <537a4b18> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a4b18> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-38" daemon prio=1 tid=0x8c0d43d0 nid=0x258f waiting onmonitor
[0x92b21000..0x92b21890]
at java.lang.Object.wait(Native Method)
- waiting on <537a4548> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a4548> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-37" daemon prio=1 tid=0x8c0d3988 nid=0x258e waiting onmonitor
[0x92921000..0x92921890]
at java.lang.Object.wait(Native Method)
- waiting on <537a3f78> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a3f78> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-36" daemon prio=1 tid=0x8c0ded20 nid=0x258d waiting onmonitor
[0x92721000..0x92721890]
at java.lang.Object.wait(Native Method)
- waiting on <537a39a8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a39a8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-35" daemon prio=1 tid=0x8c0de2d8 nid=0x258c waiting onmonitor
[0x92521000..0x92521890]
at java.lang.Object.wait(Native Method)
- waiting on <537a33d8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a33d8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-34" daemon prio=1 tid=0x8c0cd528 nid=0x258b waiting onmonitor
[0x92321000..0x92321890]
at java.lang.Object.wait(Native Method)
- waiting on <537a2e08> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a2e08> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-33" daemon prio=1 tid=0x8c0ccae0 nid=0x258a waiting onmonitor
[0x92121000..0x92121890]
at java.lang.Object.wait(Native Method)
- waiting on <537a2838> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a2838> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-32" daemon prio=1 tid=0x8c075360 nid=0x2589 waiting onmonitor
[0x91f21000..0x91f21890]
at java.lang.Object.wait(Native Method)
- waiting on <537a2268> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a2268> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-31" daemon prio=1 tid=0x8c0837d0 nid=0x2588 waiting onmonitor
[0x91d21000..0x91d21890]
at java.lang.Object.wait(Native Method)
- waiting on <537a1c98> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a1c98> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-30" daemon prio=1 tid=0x8c0a5628 nid=0x2587 waiting onmonitor
[0x91b21000..0x91b21890]
at java.lang.Object.wait(Native Method)
- waiting on <537a16c8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a16c8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-29" daemon prio=1 tid=0x8c07aaf8 nid=0x2586 waiting onmonitor
[0x91921000..0x91921890]
at java.lang.Object.wait(Native Method)
- waiting on <537a10f8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a10f8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-28" daemon prio=1 tid=0x8c0c23d0 nid=0x2585 waiting onmonitor
[0x91721000..0x91721890]
at java.lang.Object.wait(Native Method)
- waiting on <537a0b28> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a0b28> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-27" daemon prio=1 tid=0x8c0c1988 nid=0x2584 waiting onmonitor
[0x91521000..0x91521890]
at java.lang.Object.wait(Native Method)
- waiting on <537a0558> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537a0558> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-26" daemon prio=1 tid=0x8c07ca00 nid=0x2583 waiting onmonitor
[0x91321000..0x91321890]
at java.lang.Object.wait(Native Method)
- waiting on <5379ff88> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379ff88> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-25" daemon prio=1 tid=0x8c079e70 nid=0x2582 waiting onmonitor
[0x91121000..0x91121890]
at java.lang.Object.wait(Native Method)
- waiting on <5379f9b8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379f9b8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-24" daemon prio=1 tid=0x8c078038 nid=0x2581 waiting onmonitor
[0x90f21000..0x90f21890]
at java.lang.Object.wait(Native Method)
- waiting on <5379f3e8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379f3e8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-23" daemon prio=1 tid=0x8c0a3298 nid=0x2580 waiting onmonitor
[0x90d21000..0x90d21890]
at java.lang.Object.wait(Native Method)
- waiting on <5379ee18> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379ee18> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-22" daemon prio=1 tid=0x8c0e30d8 nid=0x257f waiting onmonitor
[0x90b21000..0x90b21890]
at java.lang.Object.wait(Native Method)
- waiting on <5379e848> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379e848> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-21" daemon prio=1 tid=0x8c0c5948 nid=0x257e waiting onmonitor
[0x90921000..0x90921890]
at java.lang.Object.wait(Native Method)
- waiting on <5379e278> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379e278> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-20" daemon prio=1 tid=0x8c0d0470 nid=0x257d waiting onmonitor
[0x90721000..0x90721890]
at java.lang.Object.wait(Native Method)
- waiting on <5379dca8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379dca8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-19" daemon prio=1 tid=0x8c080798 nid=0x257c waiting onmonitor
[0x90521000..0x90521890]
at java.lang.Object.wait(Native Method)
- waiting on <5379d6d8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379d6d8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-18" daemon prio=1 tid=0x8c080648 nid=0x257b waiting onmonitor
[0x90321000..0x90321890]
at java.lang.Object.wait(Native Method)
- waiting on <5379d108> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379d108> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-17" daemon prio=1 tid=0x8c032380 nid=0x257a runnable[0x90121000..0x90121890]
at java.lang.String.concat(String.java:1553)
at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
atcom.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:122)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:120)
at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:120)
atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:945)
atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:909)
atweblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContext
Manager.java:269)
atweblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-16" daemon prio=1 tid=0x8c0df9a8 nid=0x2579 waiting onmonitor
[0x8ff21000..0x8ff21890]
at java.lang.Object.wait(Native Method)
- waiting on <5379c568> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379c568> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-15" daemon prio=1 tid=0x8c0a6288 nid=0x2578 waiting onmonitor
[0x8fd21000..0x8fd21890]
at java.lang.Object.wait(Native Method)
- waiting on <5379bf98> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379bf98> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-14" daemon prio=1 tid=0x8c0dbd60 nid=0x2577 waiting onmonitor
[0x8fb21000..0x8fb21890]
at java.lang.Object.wait(Native Method)
- waiting on <5379b9c8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379b9c8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-13" daemon prio=1 tid=0x8c0c8498 nid=0x2576 waiting onmonitor
[0x8f921000..0x8f921890]
at java.lang.Object.wait(Native Method)
- waiting on <5379b3f8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379b3f8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-12" daemon prio=1 tid=0x8c0a6a28 nid=0x2575 waiting onmonitor
[0x8f721000..0x8f721890]
at java.lang.Object.wait(Native Method)
- waiting on <5379ae28> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379ae28> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-11" daemon prio=1 tid=0x8c07d348 nid=0x2574 runnable[0x8f521000..0x8f521890]
at java.lang.System.arraycopy(Native Method)
at java.lang.String.getChars(String.java:557)
at java.lang.String.concat(String.java:1554)
at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
atcom.ebao.carcase.servlet.claim.ClaimServlet.doPost(ClaimServlet.java:251)
at com.ebao.carcase.servlet.claim.ClaimServlet.doGet(ClaimServlet.java:77)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:120)
at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:120)
atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:945)
atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:909)
atweblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContext
Manager.java:269)
atweblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-10" daemon prio=1 tid=0x8c0369b0 nid=0x2571 waiting onmonitor
[0x8f321000..0x8f321890]
at java.lang.Object.wait(Native Method)
- waiting on <5379a288> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <5379a288> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-9" daemon prio=1 tid=0x8c079898 nid=0x256f waiting onmonitor [0x8f121000..0x8f121890]
at java.lang.Object.wait(Native Method)
- waiting on <53799cb8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <53799cb8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-8" daemon prio=1 tid=0x8c035260 nid=0x256e waiting onmonitor [0x8ef21000..0x8ef21890]
at java.lang.Object.wait(Native Method)
- waiting on <537996e8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537996e8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-7" daemon prio=1 tid=0x8c034510 nid=0x256d waiting onmonitor [0x8ed21000..0x8ed21890]
at java.lang.Object.wait(Native Method)
- waiting on <53799118> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <53799118> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-6" daemon prio=1 tid=0x8c081130 nid=0x256c waiting onmonitor [0x8eb21000..0x8eb21890]
at java.lang.Object.wait(Native Method)
- waiting on <53798b48> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <53798b48> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-5" daemon prio=1 tid=0x8c0c7108 nid=0x256b waiting onmonitor [0x8e921000..0x8e921890]
at java.lang.Object.wait(Native Method)
- waiting on <53798578> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <53798578> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-4" daemon prio=1 tid=0x8c0a4388 nid=0x256a waiting onmonitor [0x8e721000..0x8e721890]
at java.lang.Object.wait(Native Method)
- waiting on <53797fa8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <53797fa8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-3" daemon prio=1 tid=0x8c0367b8 nid=0x2569 waiting onmonitor [0x8e521000..0x8e521890]
at java.lang.Object.wait(Native Method)
- waiting on <537979d8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <537979d8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-2" daemon prio=1 tid=0x8c036290 nid=0x2568 waiting onmonitor [0x8e321000..0x8e321890]
at java.lang.Object.wait(Native Method)
- waiting on <53797408> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <53797408> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-1" daemon prio=1 tid=0x8c0a4ee0 nid=0x2567 waiting onmonitor [0x8e121000..0x8e121890]
at java.lang.Object.wait(Native Method)
- waiting on <53796e38> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
- locked <53796e38> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-0" daemon prio=1 tid=0x8c0a4550 nid=0x2566 runnable[0x8df21000..0x8df21890]
at java.lang.String.concat(String.java:1553)
at com.ebao.carcase.bean.query.Query.generatorXML(Query.java:239)
at com.ebao.carcase.bean.query.Query.generatorXMLByList(Query.java:158)
at com.ebao.carcase.servlet.common.CommonBean.query(CommonBean.java:652)
atcom.ebao.carcase.servlet.end.EndCaseServlet.service(EndCaseServlet.java:56)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:120)
at weblogic.servlet.ServletServlet.service(ServletServlet.java:46)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
atweblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:120)
atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:945)
atweblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:909)
atweblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContext
Manager.java:269)
atweblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"TimeEventGenerator" daemon prio=1 tid=0x8c076008 nid=0x2565 waiting onmonitor
[0x8dd21000..0x8dd21890]
at java.lang.Object.wait(Native Method)
- waiting on <53795330> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
- locked <53795330> (a weblogic.time.common.internal.TimeTable)
atweblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
:141)
at java.lang.Thread.run(Thread.java:479)
"SpinnerRandomSource" daemon prio=1 tid=0x8c0b34a0 nid=0x2563 waiting onmonitor
[0x8db21000..0x8db21890]
at java.lang.Object.wait(Native Method)
- waiting on <53793040> (a weblogic.security.SpinnerThread)
at java.lang.Object.wait(Object.java:415)
atweblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:10
4)
- locked <53793040> (a weblogic.security.SpinnerThread)
at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
"Signal Dispatcher" daemon prio=1 tid=0x8c0077e8 nid=0x2561 waiting onmonitor
[0..0]
"Finalizer" daemon prio=1 tid=0x8c000540 nid=0x255e waiting on monitor[0x8c2ff000..0x8c2ff890]
at java.lang.Object.wait(Native Method)
- waiting on <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
- locked <537202f8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
"Reference Handler" daemon prio=1 tid=0x80851f0 nid=0x255d waiting onmonitor
[0x8bf8c000..0x8bf8c890]
at java.lang.Object.wait(Native Method)
- waiting on <53720208> (a java.l

How to get a thread dump from Weblogic 9.1

Hi All,
Can someone please walk me through how to configure a WLS9.1 server to generate thread dumps. Ideally I'd like to do this via the admin console. I read about the MagicThreadDumpFile property, but can't see where/how to set it.
Many Thanks
Stuart

I only know how to do this in WLS 8.1, but it will likely work in 9.1. On UNIX, you can send a kill -QUIT to the pid and it will dump threads to standard output for the server. You can also use weblogic.Admin THREAD_DUMP (http://e-docs.bea.com/wls/docs92/admin_ref/cli.html#wp1197887) or whatever is the equivalent in WLST now that weblogic.Admin is deprecated in 9.x. I'm guessing it is the threadDump() method documented at http://e-docs.bea.com/wls/docs92/config_scripting/reference.html#wp1104314.
I know of no way to do this through the console, unfortunately.

Thread Dump issue with LD_ASSUME_KERNEL=2.4.1

Hi ,
When I take Thread Dump using 'jstack <PID>' in JDK 1.5 it givss me "sun.jvm.hotspot.debugger.DebuggerException" in the dump nothing more
I set LD_ASSUME_KERNEL=2.4.1 in my server to avaoid some other issue ( JVM crash some times)
Surprisingly, I can not stop my server ( my java process ) after that using our Shutdow scripts , Ctrl C or even "kill -9 <PID>",
I have to restart the machine or manually release uncleaned resources that my server occupied and restart the server
This happens Redhar 9 as well as in Linux ES.
Anybody faced similar problem?
Any help or information regarding this is highly apprecialted
Vasu
Thread Dump Output:
Caused by: sun.jvm.hotspot.debugger.DebuggerException: get_thread_regs failed for a lwp
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.getThreadIntegerRegisterSet0(Native Meth
od)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.access$800(LinuxDebuggerLocal.java:34)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal$1GetThreadIntegerRegisterSetTask.doit(Li
nuxDebuggerLocal.java:431)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal$LinuxDebuggerLocalWorkerThread.run(Linux
DebuggerLocal.java:109)
sun.jvm.hotspot.debugger.DebuggerException: sun.jvm.hotspot.debugger.DebuggerException: get_thread_re
gs failed for a lwp
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal$LinuxDebuggerLocalWorkerThread.execute(L
inuxDebuggerLocal.java:134)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.getThreadIntegerRegisterSet(LinuxDebugge
rLocal.java:437)
at sun.jvm.hotspot.debugger.linux.LinuxThread.getContext(LinuxThread.java:48)
at sun.jvm.hotspot.runtime.linux_x86.LinuxX86JavaThreadPDAccess.getCurrentFrameGuess(LinuxX86
JavaThreadPDAccess.java:75)
at sun.jvm.hotspot.runtime.JavaThread.getCurrentFrameGuess(JavaThread.java:252)
at sun.jvm.hotspot.runtime.JavaThread.getLastJavaVFrameDbg(JavaThread.java:211)
at sun.jvm.hotspot.tools.StackTrace.run(StackTrace.java:42)
at sun.jvm.hotspot.tools.JStack.run(JStack.java:41)
at sun.jvm.hotspot.tools.Tool.start(Tool.java:204)
at sun.jvm.hotspot.tools.JStack.main(JStack.java:58)
Caused by: sun.jvm.hotspot.debugger.DebuggerException: get_thread_regs failed for a lwp
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.getThreadIntegerRegisterSet0(Native Meth
od)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.access$800(LinuxDebuggerLocal.java:34)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal$1GetThreadIntegerRegisterSetTask.doit(Li
nuxDebuggerLocal.java:431)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal$LinuxDebuggerLocalWorkerThread.run(Linux
DebuggerLocal.java:109)
sun.jvm.hotspot.debugger.DebuggerException: sun.jvm.hotspot.debugger.DebuggerException: get_thread_re
gs failed for a lwp
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal$LinuxDebuggerLocalWorkerThread.execute(L
inuxDebuggerLocal.java:134)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.getThreadIntegerRegisterSet(LinuxDebugge
rLocal.java:437)

@brain0
I've downloaded the glic-2.3.6 sources from gnu, so I could build it from those. I'm however reluctant to do this because I really don't want to break my install.
I do agree with you on the NPTL statement, but pvs relies on allegro, which relies on LinuxThreads. Allegro is not being ported to new versions of glibc, so that approach is unfortunately not viable.
@iphitus
I wasn't very specific - it's allegro as in a lisp environment.
I think I'll try and install an old version of arch on wmware instead. Is there anywhere you can check out glibc version numbering on old arch install isos (ie. do I need arch-0.[1-9].iso)? And anywhere you can download the old isos (tried filewatcher, but a lot of the older sites seem broken)?
Thanks for the replies,
Mads
PS. I noticed that you recommended slackware for old kernels in another thread. I'm however in a bit different situation as I need old versions of glibc. Furthermore I would prefer sticking to arch, but was wondering whether there were any specific reasons for not doing that.

JNI - getting a thread dump

Hi !
I'm using JNI to create a JVM inside of my C daemon, and it's working OK except that the JVM is hanging sometimes (rarely), and I would like to get the thread dump, like when you send SIGQUIT to the java process. But it doesn't work with my program. Why?
Thanks
- Rustam -

Do you have any signal handlers installed in your native code? If so, you may have to remove them - they can interfere with the JVM's use of signals, prior to Java 1.4.
Java 1.4 introduces a "signal chaining" facility whereby you may use your own signal handlers in native code that will be chained after the JVM's own signal handlers are called. This version of JVM includes a library for determining whether a signal is intended for the JVM or for native code in the same process.

Weblogic sp4 on linux out of memory expections - Thread dump

Any body has idea why out of memory expections?
Here is the thread dump.
Full thread dump Java HotSpot(TM) Server VM (1.4.2_05-b04 mixed mode):
"Thread-33" daemon prio=1 tid=0x086175f0 nid=0x4f8e runnable [c8d57000..c8d5723c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0xd48f7820> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.apache.axis.monitor.SOAPMonitorService$ServerSocketThread.run(SOAPMonitorService.java:189)
 at java.lang.Thread.run(Thread.java:534)
"CustomerClientDispatcherThread" daemon prio=1 tid=0x08877100 nid=0x4f8e in Object.wait() [c77ff000..c77ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd45b7330> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
 at java.lang.Object.wait(Object.java:429)
 at com.amgen.ea.orx.queue.impl.PersistenceQueue.peek(PersistenceQueue.java:58)
 - locked <0xd45b7330> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
 at com.amgen.ea.orx.custclient.impl.CustomerClientDispatcher.run(CustomerClientDispatcher.java:50)
 at java.lang.Thread.run(Thread.java:534)
"CustomerClientDispatcherThread" daemon prio=1 tid=0xcb625c28 nid=0x4f8e in Object.wait() [c7b8c000..c7b8c23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3ce7958> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
 at java.lang.Object.wait(Object.java:429)
 at com.amgen.ea.orx.queue.impl.PersistenceQueue.peek(PersistenceQueue.java:58)
 - locked <0xd3ce7958> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
 at com.amgen.ea.orx.custclient.impl.CustomerClientDispatcher.run(CustomerClientDispatcher.java:52)
 at java.lang.Thread.run(Thread.java:534)
"Thread-8" daemon prio=1 tid=0x08710e80 nid=0x4f8e in Object.wait() [c7cc4000..c7cc423c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd38b44c8> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
 at java.lang.Object.wait(Object.java:429)
 at com.amgen.ea.orx.queue.impl.PersistenceQueue.peek(PersistenceQueue.java:58)
 - locked <0xd38b44c8> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
 at com.amgen.ea.orx.custclient.impl.CustomerClientDispatcher.run(CustomerClientDispatcher.java:52)
 at java.lang.Thread.run(Thread.java:534)
"ListenThread.Default" prio=1 tid=0xcc21b658 nid=0x4f8e runnable [c7c0c000..c7c0c23c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0xd3811cf8> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
 at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:735)
 at weblogic.t3.srvr.ListenThread.run(ListenThread.java:301)
"Thread-6" prio=1 tid=0xcb3ef610 nid=0x4f8e in Object.wait() [c92a0000..c92a023c]
 at java.lang.Object.wait(Native Method)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0xd348db48> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Thread-5" prio=1 tid=0x08c46fd8 nid=0x4f8e in Object.wait() [c9500000..c950023c]
 at java.lang.Object.wait(Native Method)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0xd34901c8> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"LDAPConnThread-0 ldap://0.0.0.0:7013" daemon prio=1 tid=0xcb67b150 nid=0x4f8e runnable [c9580000..c958023c]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
 - locked <0xd3490a98> (a java.io.BufferedInputStream)
 at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
 at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
 at java.lang.Thread.run(Thread.java:534)
"VDE Transaction Processor Thread" prio=1 tid=0xcb2fe110 nid=0x4f8e in Object.wait() [c9600000..c960023c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3490b30> (a com.octetstring.vde.backend.standard.TransactionProcessor)
 at java.lang.Object.wait(Object.java:429)
 at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:365)
 - locked <0xd3490b30> (a com.octetstring.vde.backend.standard.TransactionProcessor)
 at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
"ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon prio=1 tid=0x08665ba8 nid=0x4f8e in Object.wait() [c9680000..c968023c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3490ba8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon prio=1 tid=0x0830a7e0 nid=0x4f8e in Object.wait() [c9700000..c970023c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3490c28> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon prio=1 tid=0x080a0c00 nid=0x4f8e in Object.wait() [c9780000..c978023c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3490ca8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=1 tid=0xcafb3be8 nid=0x4f8e runnable [c98ff000..c98ff23c]
 at weblogic.socket.PosixSocketMuxer.poll(Native Method)
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:100)
 - locked <0xd31100e0> (a java.lang.String)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=1 tid=0xcaf65228 nid=0x4f8e waiting for monitor entry [c997f000..c997f23c]
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
 - waiting to lock <0xd31100e0> (a java.lang.String)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=1 tid=0xcafb0c20 nid=0x4f8e waiting for monitor entry [c99ff000..c99ff23c]
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
 - waiting to lock <0xd31100e0> (a java.lang.String)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
"weblogic.security.SpinnerRandomSource" daemon prio=1 tid=0xcaf64f98 nid=0x4f8e in Object.wait() [c9a7f000..c9a7f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31182d8> (a java.lang.Object)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.security.SpinnerRandomBitsSource.run(SpinnerRandomBitsSource.java:60)
 - locked <0xd31182d8> (a java.lang.Object)
 at java.lang.Thread.run(Thread.java:534)
"weblogic.time.TimeEventGenerator" daemon prio=1 tid=0xcb3e1400 nid=0x4f8e in Object.wait() [c9aff000..c9aff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118348> (a weblogic.time.common.internal.TimeTable)
 at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:272)
 - locked <0xd3118348> (a weblogic.time.common.internal.TimeTable)
 at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:118)
 at java.lang.Thread.run(Thread.java:534)
"ExecuteThread: '4' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb3df3a8 nid=0x4f8e in Object.wait() [c9b7f000..c9b7f23c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31183b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '3' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb3de7a0 nid=0x4f8e in Object.wait() [c9bff000..c9bff23c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118438> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '2' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb3ddcc0 nid=0x4f8e in Object.wait() [c9c7f000..c9c7f23c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31184b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '1' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb1c66f0 nid=0x4f8e in Object.wait() [c9cff000..c9cff23c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118538> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '0' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb1c5b58 nid=0x4f8e in Object.wait() [c9d7f000..c9d7f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31185b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31185b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '39' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb1c4f50 nid=0x4f8e in Object.wait() [c9dff000..c9dff23c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118638> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '38' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb1c4348 nid=0x4f8e in Object.wait() [c9e7f000..c9e7f23c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31186b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '37' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb1c3740 nid=0x4f8e in Object.wait() [c9eff000..c9eff23c]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118738> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '36' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb1c2ba8 nid=0x4f8e in Object.wait() [c9f7f000..c9f7f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31187b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31187b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '35' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb674078 nid=0x4f8e in Object.wait() [c9fff000..c9fff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118838> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118838> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '34' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb673470 nid=0x4f8e in Object.wait() [ca07f000..ca07f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31188b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31188b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '33' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb6728d8 nid=0x4f8e in Object.wait() [ca0ff000..ca0ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118938> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118938> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '32' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb671cd0 nid=0x4f8e in Object.wait() [ca17f000..ca17f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31189b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31189b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '31' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb6710e0 nid=0x4f8e in Object.wait() [ca1ff000..ca1ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118a38> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118a38> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '30' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfdb548 nid=0x4f8e in Object.wait() [ca27f000..ca27f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118ab8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118ab8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '29' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfda940 nid=0x4f8e in Object.wait() [ca2ff000..ca2ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118b38> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118b38> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '28' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfd9d58 nid=0x4f8e in Object.wait() [ca37f000..ca37f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118bb8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118bb8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '27' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfd91c0 nid=0x4f8e in Object.wait() [ca3ff000..ca3ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118c38> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118c38> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '26' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb119a40 nid=0x4f8e in Object.wait() [ca47f000..ca47f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118cb8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118cb8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '25' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb118e38 nid=0x4f8e in Object.wait() [ca4ff000..ca4ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118d38> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118d38> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '24' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb118230 nid=0x4f8e in Object.wait() [ca57f000..ca57f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118db8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118db8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '23' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcc207638 nid=0x4f8e in Object.wait() [ca5ff000..ca5ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118e38> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118e38> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcc206a30 nid=0x4f8e in Object.wait() [ca67f000..ca67f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118eb8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118eb8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '21' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcc205e28 nid=0x4f8e in Object.wait() [ca6ff000..ca6ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118f38> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118f38> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '20' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfbf1e0 nid=0x4f8e in Object.wait() [ca77f000..ca77f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3118fb8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3118fb8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '19' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfbe648 nid=0x4f8e in Object.wait() [ca7ff000..ca7ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119038> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119038> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '18' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfbda40 nid=0x4f8e in Object.wait() [ca87f000..ca87f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31190b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31190b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '17' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb62c500 nid=0x4f8e in Object.wait() [ca8ff000..ca8ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119138> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119138> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '16' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb62b8f8 nid=0x4f8e in Object.wait() [ca97f000..ca97f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31191b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31191b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '15' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb62acf0 nid=0x4f8e in Object.wait() [ca9ff000..ca9ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119238> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119238> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb61f5a8 nid=0x4f8e in Object.wait() [caa7f000..caa7f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31192b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31192b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb61e9e0 nid=0x4f8e in Object.wait() [caaff000..caaff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119338> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119338> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf13af0 nid=0x4f8e in Object.wait() [cab7f000..cab7f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31193b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31193b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf12ee8 nid=0x4f8e in Object.wait() [cabff000..cabff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119438> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119438> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf12350 nid=0x4f8e in Object.wait() [cac7f000..cac7f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31194b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31194b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb309598 nid=0x4f8e in Object.wait() [cacff000..cacff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119538> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119538> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb3089c8 nid=0x4f8e in Object.wait() [cad7f000..cad7f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31195b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31195b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf56250 nid=0x4f8e in Object.wait() [cadff000..cadff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119638> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119638> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf55cb0 nid=0x4f8e in Object.wait() [cae7f000..cae7f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31196b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31196b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf55918 nid=0x4f8e in Object.wait() [caeff000..caeff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119738> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119738> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf55510 nid=0x4f8e in Object.wait() [cb47f000..cb47f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31197b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31197b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf55150 nid=0x4f8e in Object.wait() [cb4ff000..cb4ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119838> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119838> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfc7bd8 nid=0x4f8e in Object.wait() [cb57f000..cb57f23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31198b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31198b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb3cd250 nid=0x4f8e in Object.wait() [cb5ff000..cb5ff23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119938> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd3119938> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb3cd0b8 nid=0x4f8e in Object.wait() [cc1fe000..cc1fe23c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd31199b8> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
 - locked <0xd31199b8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
"Thread-1" daemon prio=1 tid=0x086d6478 nid=0x4f8e in Object.wait() [cc3e1000..cc3e123c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0xd3119a88> (a java.util.TaskQueue)
 at java.lang.Object.wait(Object.java:429)
 at java.util.TimerThread.mainLoop(Timer.java:403)
 - locked <0xd3119a88> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"Signal Dispatcher" daemon prio=1 tid=0x080c4170 nid=0x4f8e waiting on condition [0..0]
"Finalizer" daemon prio=1 tid=0x080bfac0 nid=0x4f8e in Object.wait() [cf509000..cf50923c]
 at java.lang.Object.wait(Native Method)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
 - locked <0xd3129c78> (a java.lang.ref.ReferenceQueue$Lock)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
 at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Refe

Can you post the stack trace. I assume these thread dumps were taken after the error occured. Can you take a few dumps just before you run out of memory.

Hussein Badakhchani

Full thread dump Java HotSpot(TM) Server VM (1.4.2_05-b04 mixed mode):

Hi All,
I am getting below error message when i am starting JBoss
Anyone has any idea, why it is happening?
Full thread dump Java HotSpot(TM) Server VM (1.4.2_05-b04 mixed mode):
"RMI ConnectionExpiration-[127.0.0.1:33030]" daemon prio=1 tid=0x2a375e90 nid=0xcf9 waiting on condition [2820d000..2820d86c]
 at java.lang.Thread.sleep(Native Method)
 at sun.rmi.transport.tcp.TCPChannel$Reaper.run(TCPChannel.java:447)
 at java.lang.Thread.run(Thread.java:534)
"RMI TCP Connection(1681)-127.0.0.1" daemon prio=1 tid=0x2cc3e008 nid=0xcf9 runnable [27b7b000..27b7b86c]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
 - locked <0x2ed63640> (a java.io.BufferedInputStream)
 at java.io.FilterInputStream.read(FilterInputStream.java:66)
 at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:442)
 at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:701)
 at java.lang.Thread.run(Thread.java:534)
"RMI RenewClean-[127.0.0.1:33030]" daemon prio=1 tid=0x2ca76ad0 nid=0xcf9 in Object.wait() [29dcd000..29dcd86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x2ed61c50> (a java.lang.ref.ReferenceQueue$Lock)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
 - locked <0x2ed61c50> (a java.lang.ref.ReferenceQueue$Lock)
 at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:500)
 at java.lang.Thread.run(Thread.java:534)
"JNP Server" prio=1 tid=0x082dd9c0 nid=0xcf9 runnable [27afa000..27afa86c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d145770> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.jnp.server.Main.run(Main.java:257)
 at java.lang.Thread.run(Thread.java:534)
"RMI TCP Connection(1680)-127.0.0.1" daemon prio=1 tid=0x2ca55d80 nid=0xcf9 runnable [27f88000..27f8886c]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
 - locked <0x2ecd1e40> (a java.io.BufferedInputStream)
 at java.io.FilterInputStream.read(FilterInputStream.java:66)
 at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:442)
 at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:701)
 at java.lang.Thread.run(Thread.java:534)
"RMI ConnectionExpiration-[127.0.0.1:33030]" daemon prio=1 tid=0x2df71458 nid=0xcf9 waiting on condition [29e4e000..29e4e86c]
 at java.lang.Thread.sleep(Native Method)
 at sun.rmi.transport.tcp.TCPChannel$Reaper.run(TCPChannel.java:447)
 at java.lang.Thread.run(Thread.java:534)
"Thread-36" daemon prio=1 tid=0x08541f10 nid=0xcf9 runnable [279f8000..279f886c]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
 at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
 - locked <0x3d8dbc38> (a java.io.BufferedInputStream)
 at com.sun.jndi.ldap.Connection.run(Connection.java:780)
 at java.lang.Thread.run(Thread.java:534)
"Thread-35" daemon prio=1 tid=0x0811fd00 nid=0xcf9 runnable [27a79000..27a7986c]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
 at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
 - locked <0x3d8d7d50> (a java.io.BufferedInputStream)
 at com.sun.jndi.ldap.Connection.run(Connection.java:780)
 at java.lang.Thread.run(Thread.java:534)
"Thread-34" daemon prio=1 tid=0x08bc3588 nid=0xcf9 in Object.wait() [27e86000..27e8686c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d8d6050> (a org.jboss.mx.util.ThreadPool$Worker)
 at java.lang.Object.wait(Object.java:429)
 at org.jboss.mx.util.ThreadPool$Worker.run(ThreadPool.java:243)
 - locked <0x3d8d6050> (a org.jboss.mx.util.ThreadPool$Worker)
"Thread-33" daemon prio=1 tid=0x08bc47b8 nid=0xcf9 in Object.wait() [27f07000..27f0786c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d8d4780> (a org.jboss.mx.util.ThreadPool$Worker)
 at java.lang.Object.wait(Object.java:429)
 at org.jboss.mx.util.ThreadPool$Worker.run(ThreadPool.java:243)
 - locked <0x3d8d4780> (a org.jboss.mx.util.ThreadPool$Worker)
"Thread-32" daemon prio=1 tid=0x08407010 nid=0xcf9 in Object.wait() [2d2af000..2d2af86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d895fa8> (a org.jboss.mx.util.ThreadPool$Worker)
 at java.lang.Object.wait(Object.java:429)
 at org.jboss.mx.util.ThreadPool$Worker.run(ThreadPool.java:243)
 - locked <0x3d895fa8> (a org.jboss.mx.util.ThreadPool$Worker)
"Thread-31" prio=1 tid=0x084065d0 nid=0xcf9 in Object.wait() [27bfc000..27bfc86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d895bd8> (a java.lang.Object)
 at java.lang.Object.wait(Object.java:429)
 at org.jboss.system.server.ServerImpl$LifeThread.run(ServerImpl.java:731)
 - locked <0x3d895bd8> (a java.lang.Object)
"Thread-30" prio=1 tid=0x082ef440 nid=0xcf9 in Object.wait() [27c7d000..27c7d86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d852290> (a org.jboss.mx.util.RunnableScheduler)
 at org.jboss.mx.util.RunnableScheduler.waitOutstanding(RunnableScheduler.java:188)
 - locked <0x3d852290> (a org.jboss.mx.util.RunnableScheduler)
 at org.jboss.mx.util.RunnableScheduler.run(RunnableScheduler.java:93)
 at java.lang.Thread.run(Thread.java:534)
"Thread-29" prio=1 tid=0x085357c0 nid=0xcf9 in Object.wait() [27cfe000..27cfe86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d8502e8> (a org.jboss.mx.util.RunnableScheduler)
 at org.jboss.mx.util.RunnableScheduler.waitOutstanding(RunnableScheduler.java:188)
 - locked <0x3d8502e8> (a org.jboss.mx.util.RunnableScheduler)
 at org.jboss.mx.util.RunnableScheduler.run(RunnableScheduler.java:93)
 at java.lang.Thread.run(Thread.java:534)
"Thread-28" prio=1 tid=0x08fc8d58 nid=0xcf9 in Object.wait() [27d7f000..27d7f86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d84d6b0> (a org.jboss.mx.util.RunnableScheduler)
 at org.jboss.mx.util.RunnableScheduler.waitOutstanding(RunnableScheduler.java:188)
 - locked <0x3d84d6b0> (a org.jboss.mx.util.RunnableScheduler)
 at org.jboss.mx.util.RunnableScheduler.run(RunnableScheduler.java:93)
 at java.lang.Thread.run(Thread.java:534)
"Thread-27" daemon prio=1 tid=0x08a3c5f0 nid=0xcf9 runnable [27e05000..27e0586c]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
 at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
 - locked <0x3d8494b8> (a java.io.BufferedInputStream)
 at com.sun.jndi.ldap.Connection.run(Connection.java:780)
 at java.lang.Thread.run(Thread.java:534)
"Thread-26" daemon prio=1 tid=0x08829d80 nid=0xcf9 in Object.wait() [2bf3a000..2bf3a86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d83f190> (a java.util.TaskQueue)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x3d83f190> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"RMI LeaseChecker" daemon prio=1 tid=0x08d475b0 nid=0xcf9 waiting on condition [29bff000..29bff86c]
 at java.lang.Thread.sleep(Native Method)
 at sun.rmi.transport.DGCImpl$LeaseChecker.run(DGCImpl.java:307)
 at java.lang.Thread.run(Thread.java:534)
"SessionScavenger" daemon prio=1 tid=0x08b8c420 nid=0xcf9 waiting on condition [2a1ff000..2a1ff86c]
 at java.lang.Thread.sleep(Native Method)
 at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:428)
"SessionScavenger" daemon prio=1 tid=0x082f2760 nid=0xcf9 waiting on condition [2ab72000..2ab7286c]
 at java.lang.Thread.sleep(Native Method)
 at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:428)
"UILServerILService Accept Thread" prio=1 tid=0x2cc3e9c0 nid=0xcf9 runnable [2abfb000..2abfb86c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d63d830> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.jboss.mq.il.uil2.UILServerILService.run(UILServerILService.java:118)
 at java.lang.Thread.run(Thread.java:534)
"OIL2 Worker Server" prio=1 tid=0x2dfe0df0 nid=0xcf9 runnable [2ac7c000..2ac7c86c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d63d958> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.jboss.mq.il.oil2.OIL2ServerILService.run(OIL2ServerILService.java:366)
 at java.lang.Thread.run(Thread.java:534)
"UIL Worker" prio=1 tid=0x2ccfca90 nid=0xcf9 runnable [2acfd000..2acfd86c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d63da18> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.jboss.mq.il.uil.UILServerILService.run(UILServerILService.java:184)
 at java.lang.Thread.run(Thread.java:534)
"OIL Worker Server" prio=1 tid=0x2bab0a70 nid=0xcf9 runnable [2ad7e000..2ad7e86c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d63dad8> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.jboss.mq.il.oil.OILServerILService.run(OILServerILService.java:471)
 at java.lang.Thread.run(Thread.java:534)
"Thread-25" prio=1 tid=0x2cc9ef88 nid=0xcf9 in Object.wait() [2adff000..2adff86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d63db88> (a java.util.LinkedList)
 at java.lang.Object.wait(Object.java:429)
 at org.jboss.resource.connectionmanager.PoolFiller$1.run(PoolFiller.java:75)
 - locked <0x3d63db88> (a java.util.LinkedList)
 at java.lang.Thread.run(Thread.java:534)
"Thread-24" prio=1 tid=0x2dfe0268 nid=0xcf9 in Object.wait() [2afc4000..2afc486c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d52f320> (a java.util.ArrayList)
 at org.jboss.resource.connectionmanager.IdleRemover$1.run(IdleRemover.java:66)
 - locked <0x3d52f320> (a java.util.ArrayList)
 at java.lang.Thread.run(Thread.java:534)
"Thread-23" daemon prio=1 tid=0x2dfce680 nid=0xcf9 in Object.wait() [2b045000..2b04586c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d52f390> (a org.jboss.util.timeout.TimeoutFactory)
 at org.jboss.util.timeout.TimeoutFactory.doWork(TimeoutFactory.java:503)
 - locked <0x3d52f390> (a org.jboss.util.timeout.TimeoutFactory)
 at org.jboss.util.timeout.TimeoutFactory.access$300(TimeoutFactory.java:27)
 at org.jboss.util.timeout.TimeoutFactory$1.run(TimeoutFactory.java:542)
"Thread-22" prio=1 tid=0x2ccef150 nid=0xcf9 runnable [2b0c6000..2b0c686c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d52f400> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.jboss.invocation.pooled.server.PooledInvoker.run(PooledInvoker.java:216)
 at java.lang.Thread.run(Thread.java:534)
"JBossMQ Cache Reference Softner" daemon prio=1 tid=0x2dfe1a28 nid=0xcf9 in Object.wait() [2b147000..2b14786c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d411a00> (a java.lang.ref.ReferenceQueue$Lock)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
 - locked <0x3d411a00> (a java.lang.ref.ReferenceQueue$Lock)
 at org.jboss.mq.server.MessageCache.run(MessageCache.java:233)
 at java.lang.Thread.run(Thread.java:534)
"RMI TCP Accept-0" daemon prio=1 tid=0x2c388ff0 nid=0xcf9 runnable [2b1ef000..2b1ef86c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d2c0f90> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
 at java.lang.Thread.run(Thread.java:534)
"SessionScavenger" daemon prio=1 tid=0x2c3864e0 nid=0xcf9 waiting on condition [2b270000..2b27086c]
 at java.lang.Thread.sleep(Native Method)
 at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:428)
"PoolThread-4" prio=1 tid=0x2c384e10 nid=0xcf9 in Object.wait() [2b2f1000..2b2f186c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c10c8> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c10c8> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-3" prio=1 tid=0x2ba1d4b0 nid=0xcf9 in Object.wait() [2b372000..2b37286c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c1120> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c1120> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-2" prio=1 tid=0x2ba1c960 nid=0xcf9 in Object.wait() [2b3f3000..2b3f386c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c1178> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c1178> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-1" prio=1 tid=0x2ba1be10 nid=0xcf9 in Object.wait() [2b474000..2b47486c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c11d0> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c11d0> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-0" prio=1 tid=0x2ba1b2c0 nid=0xcf9 in Object.wait() [2b4f5000..2b4f586c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c1228> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c1228> (a org.mortbay.util.ThreadPool$PoolThread)
"Acceptor ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8009]" prio=1 tid=0x2ba1af70 nid=0xcf9 runnable [2b576000..2b57686c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d2c12d8> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.mortbay.util.ThreadedServer.acceptSocket(ThreadedServer.java:346)
 at org.mortbay.util.ThreadedServer$Acceptor.run(ThreadedServer.java:507)
"PoolThread-9" prio=1 tid=0x2ba1a420 nid=0xcf9 in Object.wait() [2b5f7000..2b5f786c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c13a8> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c13a8> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-8" prio=1 tid=0x2ba198d0 nid=0xcf9 in Object.wait() [2b678000..2b67886c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c1400> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c1400> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-7" prio=1 tid=0x2c3a4ad8 nid=0xcf9 in Object.wait() [2b6f9000..2b6f986c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c1458> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c1458> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-6" prio=1 tid=0x2c3a4788 nid=0xcf9 in Object.wait() [2b77a000..2b77a86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c14b0> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c14b0> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-5" prio=1 tid=0x2c3a3c58 nid=0xcf9 in Object.wait() [2b7fb000..2b7fb86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c1508> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c1508> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-4" prio=1 tid=0x2ba8bfe8 nid=0xcf9 in Object.wait() [2b87c000..2b87c86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c1560> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c1560> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-3" prio=1 tid=0x2ba78040 nid=0xcf9 in Object.wait() [2b8fd000..2b8fd86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c15b8> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c15b8> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-2" prio=1 tid=0x2ba69c18 nid=0xcf9 in Object.wait() [2b97e000..2b97e86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c1610> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c1610> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-1" prio=1 tid=0x2ba69a08 nid=0xcf9 in Object.wait() [2b9ff000..2b9ff86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c1668> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c1668> (a org.mortbay.util.ThreadPool$PoolThread)
"PoolThread-0" prio=1 tid=0x2ba7ebc8 nid=0xcf9 in Object.wait() [2bb8e000..2bb8e86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d2c16c0> (a org.mortbay.util.ThreadPool$PoolThread)
 at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:450)
 - locked <0x3d2c16c0> (a org.mortbay.util.ThreadPool$PoolThread)
"Acceptor ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8020]" prio=1 tid=0x2ba7ea18 nid=0xcf9 runnable [2bc0f000..2bc0f86c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d2c1770> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.mortbay.util.ThreadedServer.acceptSocket(ThreadedServer.java:346)
 at org.mortbay.util.ThreadedServer$Acceptor.run(ThreadedServer.java:507)
"SessionScavenger" daemon prio=1 tid=0x2ba8bb18 nid=0xcf9 waiting on condition [2bd90000..2bd9086c]
 at java.lang.Thread.sleep(Native Method)
 at org.mortbay.jetty.servlet.AbstractSessionManager$SessionScavenger.run(AbstractSessionManager.java:428)
"Thread-4" daemon prio=1 tid=0x2ba8c6f0 nid=0xcf9 in Object.wait() [2beb9000..2beb986c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d23d438> (a java.util.TaskQueue)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x3d23d438> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"GC Daemon" daemon prio=1 tid=0x2c32cd20 nid=0xcf9 in Object.wait() [2bfbb000..2bfbb86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d0b4b28> (a sun.misc.GC$LatencyLock)
 at sun.misc.GC$Daemon.run(GC.java:100)
 - locked <0x3d0b4b28> (a sun.misc.GC$LatencyLock)
"RMI Reaper" prio=1 tid=0x2c325c88 nid=0xcf9 in Object.wait() [2c03c000..2c03c86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d0b4078> (a java.lang.ref.ReferenceQueue$Lock)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
 - locked <0x3d0b4078> (a java.lang.ref.ReferenceQueue$Lock)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
 at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:330)
 at java.lang.Thread.run(Thread.java:534)
"Thread-3" daemon prio=1 tid=0x2c33be48 nid=0xcf9 in Object.wait() [2c0bd000..2c0bd86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d0b4378> (a java.util.TaskQueue)
 at java.lang.Object.wait(Object.java:429)
 at java.util.TimerThread.mainLoop(Timer.java:403)
 - locked <0x3d0b4378> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"RMI TCP Accept-0" daemon prio=1 tid=0x2c33b8e0 nid=0xcf9 runnable [2c13e000..2c13e86c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d0b40d8> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
 at java.lang.Thread.run(Thread.java:534)
"Thread-2" daemon prio=1 tid=0x2c340060 nid=0xcf9 runnable [2c1bf000..2c1bf86c]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x3d0b1730> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at org.jboss.web.WebServer.run(WebServer.java:258)
 at org.jboss.web.ThreadPool$Worker.run(ThreadPool.java:163)
"ScannerThread" daemon prio=1 tid=0x2c3403d8 nid=0xcf9 waiting on condition [2cdc7000..2cdc786c]
 at java.lang.Thread.sleep(Native Method)
 at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.loop(AbstractDeploymentScanner.java:217)
 at org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.run(AbstractDeploymentScanner.java:190)
"Thread-0" daemon prio=1 tid=0x2c327b00 nid=0xcf9 in Object.wait() [2c240000..2c24086c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d05d2d0> (a java.util.TaskQueue)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x3d05d2d0> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"DestroyJavaVM" prio=1 tid=0x2df28218 nid=0xcf9 waiting on condition [0..bfffccc4]
"Signal Dispatcher" daemon prio=1 tid=0x080c33f8 nid=0xcf9 waiting on condition [0..0]
"Finalizer" daemon prio=1 tid=0x080bed60 nid=0xcf9 in Object.wait() [2e3fc000..2e3fc86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d0b5930> (a java.lang.ref.ReferenceQueue$Lock)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
 - locked <0x3d0b5930> (a java.lang.ref.ReferenceQueue$Lock)
 at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
 at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=1 tid=0x080be9d0 nid=0xcf9 in Object.wait() [2e47d000..2e47d86c]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x3d0b52f8> (a java.lang.ref.Reference$Lock)
 at java.lang.Object.wait(Object.java:429)
 at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
 - locked <0x3d0b52f8> (a java.lang.ref.Reference$Lock)

have you checked bugs.sun.com to see if this has been reported?
And if not, file one and attach your dump for them to look into it.

What is the problem in my Thread Dump's output?

Dear all,
Below is my Thread Dump output. I can not figure out what and where is the problem of this Thread Dump's output. Could some one please give me some hints?
Thanks alot
Tu
----------------Thread Dump's Output-----------------
Full thread dump Java HotSpot(TM) Client VM (1.5.0_07-b03 mixed mode, sharing):
"TP-Monitor" daemon prio=1 tid=0xb0b14490 nid=0xfaa in Object.wait()
[0xb08fe000..0xb08fee40]
at java.lang.Object.wait(Native Method)
- waiting on <0x89433f70> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:559)
- locked <0x89433f70> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at java.lang.Thread.run(Thread.java:595)
"TP-Processor4" daemon prio=1 tid=0xb0b13730 nid=0xfa9 runnable
[0xb097e000..0xb097efc0]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0x89438110> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:450)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at org.apache.jk.common.ChannelSocket.accept(ChannelSocket.java:293)
at org.apache.jk.common.ChannelSocket.acceptConnections(ChannelSocket.java:647)
at org.apache.jk.common.ChannelSocket$SocketAcceptor.runIt(ChannelSocket.java:857)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)
"TP-Processor3" daemon prio=1 tid=0xb0b0f6b8 nid=0xfa8 in
Object.wait() [0xb09fe000..0xb09fef40]
at java.lang.Object.wait(Native Method)
- waiting on <0x89434250> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89434250> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"TP-Processor2" daemon prio=1 tid=0xb0b0fec8 nid=0xfa7 in
Object.wait() [0xb0a7e000..0xb0a7f0c0]
at java.lang.Object.wait(Native Method)
- waiting on <0x894342e8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x894342e8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"TP-Processor1" daemon prio=1 tid=0xb0b14978 nid=0xfa6 in
Object.wait() [0xb0afe000..0xb0aff040]
at java.lang.Object.wait(Native Method)
- waiting on <0x89434380> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89434380> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Monitor" prio=1 tid=0x08609b18 nid=0xfa5 in Object.wait()
[0xb0cc9000..0xb0cc91c0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378950> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:559)
- locked <0x89378950> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor25" daemon prio=1 tid=0x08608ce0 nid=0xfa4
runnable [0xb0d48000..0xb0d49140]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0x89010c58> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:450)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
at org.apache.tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java:407)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:70)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor24" daemon prio=1 tid=0x086085f8 nid=0xfa3 in
Object.wait() [0xb0dc8000..0xb0dc8ec0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378ab8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89378ab8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor23" daemon prio=1 tid=0x08606dd0 nid=0xfa2 in
Object.wait() [0xb0e48000..0xb0e48e40]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378b50> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89378b50> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor22" daemon prio=1 tid=0x08605ed0 nid=0xfa1 in
Object.wait() [0xb0ec8000..0xb0ec8fc0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378be8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89378be8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor21" daemon prio=1 tid=0x08604fd0 nid=0xfa0 in
Object.wait() [0xb0f48000..0xb0f48f40]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378c80> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89378c80> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor20" daemon prio=1 tid=0x086040f0 nid=0xf9f in
Object.wait() [0xb0fc8000..0xb0fc90c0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378d18> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89378d18> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor19" daemon prio=1 tid=0x08432538 nid=0xf9e in
Object.wait() [0xb1048000..0xb1049040]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378db0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89378db0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor18" daemon prio=1 tid=0x08431638 nid=0xf9d in
Object.wait() [0xb10c9000..0xb10c91c0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378e48> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89378e48> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor17" daemon prio=1 tid=0x08430738 nid=0xf9c in
Object.wait() [0xb1148000..0xb1149140]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378ee0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89378ee0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor16" daemon prio=1 tid=0x0842f838 nid=0xf9b in
Object.wait() [0xb11c8000..0xb11c8ec0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89378f78> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89378f78> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor15" daemon prio=1 tid=0x0842e938 nid=0xf9a in
Object.wait() [0xb1248000..0xb1248e40]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379010> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379010> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor14" daemon prio=1 tid=0x0842da38 nid=0xf99 in
Object.wait() [0xb12c8000..0xb12c8fc0]
at java.lang.Object.wait(Native Method)
- waiting on <0x893790a8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x893790a8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor13" daemon prio=1 tid=0x0842cb38 nid=0xf98 in
Object.wait() [0xb1348000..0xb1348f40]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379140> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379140> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor12" daemon prio=1 tid=0x0842bc50 nid=0xf97 in
Object.wait() [0xb13c8000..0xb13c90c0]
at java.lang.Object.wait(Native Method)
- waiting on <0x893791d8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x893791d8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor11" daemon prio=1 tid=0x084f75d0 nid=0xf96 in
Object.wait() [0xb1448000..0xb1449040]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379270> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379270> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor10" daemon prio=1 tid=0x084f66d0 nid=0xf95 in
Object.wait() [0xb14c9000..0xb14c91c0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379308> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379308> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor9" daemon prio=1 tid=0x084f57d0 nid=0xf94 in
Object.wait() [0xb1548000..0xb1549140]
at java.lang.Object.wait(Native Method)
- waiting on <0x893793a0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x893793a0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor8" daemon prio=1 tid=0x08488970 nid=0xf93 in
Object.wait() [0xb15c8000..0xb15c8ec0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379438> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379438> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor7" daemon prio=1 tid=0x08487a70 nid=0xf92 in
Object.wait() [0xb1648000..0xb1648e40]
at java.lang.Object.wait(Native Method)
- waiting on <0x893794d0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x893794d0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor6" daemon prio=1 tid=0x08486b90 nid=0xf91 in
Object.wait() [0xb16c8000..0xb16c8fc0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379568> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379568> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor5" daemon prio=1 tid=0x084e3e30 nid=0xf90 in
Object.wait() [0xb1748000..0xb1748f40]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379600> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379600> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor4" daemon prio=1 tid=0x084e2f90 nid=0xf8f in
Object.wait() [0xb17c8000..0xb17c90c0]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379698> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379698> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor3" daemon prio=1 tid=0x084e2158 nid=0xf8e in
Object.wait() [0xb1848000..0xb1849040]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379730> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379730> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor2" daemon prio=1 tid=0x085e74d0 nid=0xf8d in
Object.wait() [0xb18c9000..0xb18c91c0]
at java.lang.Object.wait(Native Method)
- waiting on <0x893797c8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x893797c8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"http-8080-Processor1" daemon prio=1 tid=0x085e6638 nid=0xf8c in
Object.wait() [0xb1948000..0xb1949140]
at java.lang.Object.wait(Native Method)
- waiting on <0x89379860> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:474)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x89379860> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:595)
"ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=1
tid=0x083719f8 nid=0xf8b waiting on condition [0xb1a85000..0xb1a85ec0]
at java.lang.Thread.sleep(Native Method)
at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1547)
at java.lang.Thread.run(Thread.java:595)
"Low Memory Detector" daemon prio=1 tid=0x080a44f8 nid=0xf7f runnable
[0x00000000..0x00000000]
"CompilerThread0" daemon prio=1 tid=0x080a2f98 nid=0xf7e waiting on
condition [0x00000000..0xb21b2928]
"Signal Dispatcher" daemon prio=1 tid=0x080a2068 nid=0xf7d waiting on
condition [0x00000000..0x00000000]
"Finalizer" daemon prio=1 tid=0x0809c540 nid=0xf7c in Object.wait()
[0xb24b2000..0xb24b3040]
at java.lang.Object.wait(Native Method)
- waiting on <0x88f01de0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
- locked <0x88f01de0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=1 tid=0x0809a6b0 nid=0xf7b in
Object.wait() [0xb2533000..0xb25331c0]
at java.lang.Object.wait(Native Method)
- waiting on <0x88f01e60> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:474)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x88f01e60> (a java.lang.ref.Reference$Lock)
"main" prio=1 tid=0x0805d1c8 nid=0xf79 runnable [0xbfbd9000..0xbfbda4f8]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0x8946f690> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:450)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at org.apache.catalina.core.StandardServer.await(StandardServer.java:388)
at org.apache.catalina.startup.Catalina.await(Catalina.java:615)
at org.apache.catalina.startup.Catalina.start(Catalina.java:575)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:432)
"VM Thread" prio=1 tid=0x08097b58 nid=0xf7a runnable
"VM Periodic Task Thread" prio=1 tid=0x080a5998 nid=0xf80 waiting on condition

Thanks alot for your reply. It is a web application
using java and tomcat server. And the problem is that
sometime when I click on a button or a link than the
CPU goes to 100% and it hangs but normally it works
smoothly without any problem.This often indicates a busy retry loop somewhere. You need to acquire the thread dump when the problem occurs, but be warned that depending on the problem it may not be possible to obtain a Java-level thread dump. In that case you need to try and take an OS level thread dump - eg using pstack on solaris/linux (and there's some win32 tool as well if I recall correctly).

WL 7.0 thread dump question

Hi,
I am using weblogic 7.0 windows 2000. I have seen unique behaviour with this,
if the server is not accessed for prolonged time, say overnight and in the morning
if I want to take thread dump(by hitting Ctrl+break) it will not work. I need
to restart server to get thread dump, any idea about this?
Yogesh

Ctrl+break is a JVM interrupt command, not WLS.
Is the server accessible? I mean does it respond for PING
BTW, what JDk you are using?
Kumar
Yogesh wrote:
Hi,
I am using weblogic 7.0 windows 2000. I have seen unique behaviour with this,
if the server is not accessed for prolonged time, say overnight and in the morning
if I want to take thread dump(by hitting Ctrl+break) it will not work. I need
to restart server to get thread dump, any idea about this?
Yogesh

SIGQUIT ignored / no thread dump in 1.5/5.0 ?

Trying out 1.5 on a dual-xeon, Linux 2.4.27 machine. - 'java -version' returns:
java version "1.5.0"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0-b64)
Java HotSpot(TM) Client VM (build 1.5.0-b64, mixed mode, sharing)
Java process seems to ignore 'kill -SIGQUIT' -- nothing to stderr/stdout, nothing to working directory. A thread dump would be really handy. No special options were used to launch JVM.
Any ideas?

I'm having a problem with the same symptom: SIGQUIT is ignored. So I ran jstack and got this:
Error occurred during stack walking:
sun.jvm.hotspot.debugger.DebuggerException: sun.jvm.hotspot.debugger.DebuggerException: get_thread_regs failed for a lwp
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal$LinuxDebuggerLocalWorkerThread.execute(LinuxDebuggerLocal.java:134)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.getThreadIntegerRegisterSet(LinuxDebuggerLocal.java:437)
at sun.jvm.hotspot.debugger.linux.LinuxThread.getContext(LinuxThread.java:48)
at sun.jvm.hotspot.runtime.linux_x86.LinuxX86JavaThreadPDAccess.getCurrentFrameGuess(LinuxX86JavaThreadPDAccess.java:75)
at sun.jvm.hotspot.runtime.JavaThread.getCurrentFrameGuess(JavaThread.java:252)
at sun.jvm.hotspot.runtime.JavaThread.getLastJavaVFrameDbg(JavaThread.java:211)
at sun.jvm.hotspot.tools.StackTrace.run(StackTrace.java:42)
at sun.jvm.hotspot.tools.JStack.run(JStack.java:41)
at sun.jvm.hotspot.tools.Tool.start(Tool.java:204)
at sun.jvm.hotspot.tools.JStack.main(JStack.java:58)
Caused by: sun.jvm.hotspot.debugger.DebuggerException: get_thread_regs failed for a lwp
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.getThreadIntegerRegisterSet0(Native Method)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.access$800(LinuxDebuggerLocal.java:34)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal$1GetThreadIntegerRegisterSetTask.doit(LinuxDebuggerLocal.java:431)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal$LinuxDebuggerLocalWorkerThread.run(LinuxDebuggerLocal.java:109)
Any ideas/suggestions? Anyone seen this before?

100% CPU load but no clue in thread dump, EP. Win a bottle of champagne...

Hi,
We are suddenly facing 100% CPU load in our EP cluster (5 x 8-way Xeon multiprocessor machines). We have a serious performance problem that is burning a lot of our time and causes a lot of stress for over 3 weeks now.
We have taken tens of thread dumps from Application Nodes.
- In none of the thread dumps we see the Finalizer thread
running.
- From the garbage collector log we see that full garbage
collection runs occur very rarily (once an hour).
- We use the compacting garbage collector.
- In a lot of thread dumps we do not even see our own portal code in the stack traces of the threads!
- In Windows Task Manager we see the jlaunch.exe processes
consume all available CPU time.
- Portal users see a blank portal page when the CPU load hits 100%. When the load goes down again, things return to normal.
- There are no errors logged in any of the log files of the portal. We checked all of them. We expected a log full of errors somewhere but nothing even remotely interesting was found. Windows Event Viewer shows nothing either.
- The amount of sockets in CLOSE_WAIT status is < 10 on every machine in the cluster.
This forces me to conclude that something in the jlaunch.exe executable consumes the CPU time. This raises the following 3 questions:
- What does the mystifying jlaunch.exe do besides executing java.exe ?
- Why is the Java virtual machine launched by a custom executable like jlaunch (What is it that cannot be program med in Java) ? Can it be GZip compression ?
- If the problem is not caused by jlaunch.exe, then it must be caused by the JVM. What activity, invisible in thread dumps, is performed by the JVM that can cause the high CPU load ?
Our development- and support teams are desperate. All suggestions are welcome. The person that comes up with
the solution to our problem gets a nice bottle of champagne.
Regards,
Chris Twigt

Hi,
- What does the mystifying jlaunch.exe do besides executing java.exe ?
This is so that the startupframework can connect more easily and take control of the JVM in some situations
- Why is the Java virtual machine launched by a custom executable like jlaunch (What is it that cannot be program med in Java) ?
I assume when SAP release their JVM (in the next major release), that will be called directly.
- If the problem is not caused by jlaunch.exe, then it must be caused by the JVM. What activity, invisible in thread dumps, is performed by the JVM that can cause the high CPU load ?
Loads of thing, but there should be clues in the thread dumps. (the reason why your code is not in those thread dumps is that your code is only active during the processing of a particular request, unless you have a service, afterwards there are no trace of it as the thread which does the processing goes back to sleep)
I've experienced a similar situation with a an 6.40 portal, and it was then caused by the following:
1. User A comes logs in and sees that some cache timeout has occured , therefore it issues a SQL query which does a full table scan on a table of approx. 1 GB (on of the UME tables)
2. User B comes in just afterwards and also sees that the cache timeout has occured, and issues the same SQL query as User A
3. User C .... and so on untill the query from User A eventually finishes
So
1. Check database. Any big queries running ?
2. Check file activity, are there a lot of writing ?
3. Check network activity, especially to the state controller which is the weakest link
4. What about portal logs ? Any activity during the hang ?
Also, please provide one of the thread dumps for further analysis..
cheers
Dagfinn

Waiting for monitor enty messages in thread dump

Hi,
I've a thread dump of a container in a Oracle Application Server 9.0.4.1 (running 1.4.2_07) right before restart because off low memory and a lot of threads in this dump are in this state:
"AJPRequestHandler-ApplicationServerThread-1588" prio=1 tid=0x37634bf8 nid=0x1982 waiting for monitor entry [43f22000..43f2386c]
can anyone tell me what this means? Google didn't reveal anything useful.
Another thing I don't understand although it seems it doesn't do any harm:
"AJPRequestHandler-ApplicationServerThread-1630" prio=1 tid=0x09011a68 nid=0x1982 in Object.wait() [40276000..4027686c]
at java.lang.Object.wait(Native Method)
- waiting on <0x6624e628> (a java.util.HashMap)
at java.lang.Object.wait(Object.java:429)
at java.net.InetAddress.checkLookupTable(InetAddress.java:1109)
- locked <0x6624e628> (a java.util.HashMap)
at java.net.InetAddress.getAddressFromNameService(InetAddress.java:1048)
at java.net.InetAddress.getLocalHost(InetAddress.java:1188)
at com.evermind.server.http.EvermindHttpSession.encodeSession(EvermindHttpSession.java:414)
at com.evermind.server.http.HttpApplication.createSession(HttpApplication.java:1599)
why is this thread waiting for a lock itself has?
Thanx for any help and hints in advance.
Regards,
Ingo

Hi,
I've a follow-up question, I have the following thread in several thread dumps:
"AJPRequestHandler-ApplicationServerThread-717" prio=1 tid=0x4046b988 nid=0x3dd3 waiting for monitor entry [3845e000..3845e86c]
 at java.net.Inet4Address.getAddress(Inet4Address.java:287)
 at com.evermind.server.http.StandardRequestLogger.appendIP(StandardRequestLogger.java:187)
 at com.evermind.server.http.StandardRequestLogger.log(StandardRequestLogger.java:45)
 - locked <0x663b2088> (a com.evermind.server.http.StandardRequestLogger)
 at com.evermind.server.http.HttpRequestHandler.processRequest(HttpRequestHandler.java:906)
 at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:208)
 at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:125)
 at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:192)
 at java.lang.Thread.run(Thread.java:534)
What is the monitor this thread is waiting for? According to the source in Inet4Address at line 287 the method tries to create a new byte array... is there some system monitor which can't be seen in the thread dump?
This thread holds a lock (0x663b2088) 46 other threads are waiting for...
Thanx in advance for any hints.
Regards,
Ingo

States in the thread dump "Waiting on monitor"

that is normal, it is all the execute threads waiting for requests
Rob Baldassano wrote:
Hi.
I am trying to do some troubleshooting of the weblogic server,
Currently we are using WebLogic 6.1 SP 2.
In the thread dump we are seeing a lot of "waiting on monitor" messages for the
individual threads.
The application that we are running uses native threads to run the processes that
it needs to.
My question is this.
Is this "Waiting for monitor" message normal?
What could cause these messages?
is there a way to get around them, besides recoding the application?

Thread Dump

Similar Messages

Maybe you are looking for