Weblogic server 5.1 goes to hang within an hour
I have the problem with weblogic server 5.1 that it goes to hang within around
an hour. There is no obvious error or exceptions shown in the weblogic log.
But at the time the weblogic server is hanging, I just observed from the weblogic
console GUI that once a user logon to the web application (the web server is iPlanet
6.0), the number of bean in cache of the corresponding stateful session bean increases
one but does not drop. Every single logon makes an increment 1 to the # of the
bean in cache of the corresponding session bean but no dropping.
What the session bean does is actually obtain a connection from the weblogic server
and get data from database. I went down to the database (Sybase ASE 11.9) at
the hanging time but did not see any long-running process nor table blocking that
may hinder the database response time. I do not understand what the session bean
was waiting for.
The only hints that I have is the below error message which was found in the iPlanet
web server log. Anyone please help to tell me what the problem can be?
Error found in iPlanet web server
============================
[03/Jun/2003:02:51:26] failure ( 381): Error receiving connection (No process
is on the other end of the pipe.)
Thanks, Rob.
I will try and see if it helps. Thanks again.
Rob Woollen <[email protected]> wrote:
Thanks for the thread dump.
Yes, DriverManager is the problem. Unfortunately this class is
well-known for causing deadlocks.
You really do not ever want to use DriverManager.getConnection from
code that runs in the server. Instead, you should define a TxDataSource
for your connection pool and use DataSource.getConnection.
I would recommend you lookup the DataSource in your stateless session
bean's ejbCreate method and store the DataSource in a member variable.
Your methods can call DataSource.getConnection when they need a JDBC
connection.
-- Rob
Carol wrote:
Rob,
I got the same symptom with weblogic server 6.1 today and I got thethread dump
for it this time. I read through the log and I wonder if the methodcall from
"java.sql.DriverManager.println" led to the hanging problem.
I attach the thread dump for your reference.
Do you have any advice? Thanks in advance.
"Carol" <[email protected]> wrote:
Rob,
Thanks for your advice firstly.
I am not able to reproduce the problem at this moment so I do not have
the thread
dump for review. But I did take a look at the Queue Length in the
WL
console
GUI at the time hanging and I found it kept to be 0 or 1. Also, the
heap size
was just about 60%.
But I have missed out one thing in my previous post. Besides the stateful
session
bean, another stateless session bean was used at the time user logon.
And the
stateless session bean just behaved the same as what the stateful one
did at the
time the WL was hanging, i.e. its "bean in cache" increased one when
a user tried
to logon.
What else shall I look into in order to find out the root cause?
Rob Woollen <[email protected]> wrote:
Take a thread dump (or several) when the server is hung. If you can't
figure out the problem from that, post the thread dump here, and we'll
have a look.
-- Rob
Carol wrote:
I have the problem with weblogic server 5.1 that it goes to hang
within
around
an hour. There is no obvious error or exceptions shown in the weblogiclog.
But at the time the weblogic server is hanging, I just observed fromthe weblogic
console GUI that once a user logon to the web application (the webserver is iPlanet
6.0), the number of bean in cache of the corresponding stateful sessionbean increases
one but does not drop. Every single logon makes an increment 1 tothe # of the
bean in cache of the corresponding session bean but no dropping.
What the session bean does is actually obtain a connection from theweblogic server
and get data from database. I went down to the database (Sybase
ASE
11.9) at
the hanging time but did not see any long-running process nor tableblocking that
may hinder the database response time. I do not understand what
the
session bean
was waiting for.
The only hints that I have is the below error message which was foundin the iPlanet
web server log. Anyone please help to tell me what the problem canbe?
Error found in iPlanet web server
============================
[03/Jun/2003:02:51:26] failure ( 381): Error receiving connection(No process
is on the other end of the pipe.)
Full thread dump:
"HighPriority TimeEventGenerator" daemon prio=9 tid=0x6ef920 nid=0x77waiting on monitor [0xaf681000..0xaf6819d8]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"SSLListenThread" prio=5 tid=0x88e860 nid=0x76 runnable [0xafd81000..0xafd819d8]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:468)
at java.net.ServerSocket.implAccept(ServerSocket.java:243)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:126)
at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:117)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:255)
"ListenThread" prio=5 tid=0x88e110 nid=0x75 runnable [0xaf781000..0xaf7819d8]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:468)
at java.net.ServerSocket.implAccept(ServerSocket.java:243)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:255)
"GC Daemon" daemon prio=2 tid=0x724590 nid=0x72 waiting on monitor[0xaff81000..0xaff819d8]
at java.lang.Object.wait(Native Method)
at sun.misc.GC$Daemon.run(GC.java:103)
"RMI RenewClean-[127.0.0.1:55045]" daemon prio=5 tid=0x724460 nid=0x71waiting on monitor [0xb0581000..0xb05819d8]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:108)
at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:495)
at java.lang.Thread.run(Thread.java:484)
"ExecuteThread: '14' for queue: 'JmsDispatcher'" daemon prio=5 tid=0xe9160nid=0x6e waiting on monitor [0xb0781000..0xb07819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '13' for queue: 'JmsDispatcher'" daemon prio=5 tid=0xe8678nid=0x6d waiting on monitor [0xb0881000..0xb08819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '12' for queue: 'JmsDispatcher'" daemon prio=5 tid=0xe7ca8nid=0x6c waiting on monitor [0xb0981000..0xb09819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '11' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b6498nid=0x6b waiting on monitor [0xb0a81000..0xb0a819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '10' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b59b0nid=0x6a waiting on monitor [0xb0b81000..0xb0b819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '9' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b4ec8nid=0x69 waiting on monitor [0xb0c81000..0xb0c819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '8' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b43e0nid=0x68 waiting on monitor [0xb0d81000..0xb0d819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '7' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b38f8nid=0x67 waiting on monitor [0xb0e81000..0xb0e819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '6' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b2e10nid=0x66 waiting on monitor [0xb0f81000..0xb0f819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '5' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b10d8nid=0x65 waiting on monitor [0xb1081000..0xb10819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '4' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b05f0nid=0x64 waiting on monitor [0xb1181000..0xb11819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '3' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b1c50nid=0x63 waiting on monitor [0xb1281000..0xb12819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '2' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b1aa8nid=0x62 waiting on monitor [0xb1381000..0xb13819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '1' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b1900nid=0x61 waiting on monitor [0xb1481000..0xb14819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b13d0nid=0x60 waiting on monitor [0xb1581000..0xb15819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '2' for queue: 'weblogic.transaction.AsyncQueue'" daemonprio=5 tid=0x2e9e18 nid=0x5f waiting on monitor [0xb1681000..0xb16819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '1' for queue: 'weblogic.transaction.AsyncQueue'" daemonprio=5 tid=0x2e8160 nid=0x5e waiting on monitor [0xb1781000..0xb17819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: 'weblogic.transaction.AsyncQueue'" daemonprio=5 tid=0x2e98e8 nid=0x5d waiting on monitor [0xb1881000..0xb18819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '9' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x553848 nid=0x5c waiting on monitor [0xb1981000..0xb19819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '8' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x552d60 nid=0x5b waiting on monitor [0xb1a81000..0xb1a819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '7' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x5522f0 nid=0x5a waiting on monitor [0xb1b81000..0xb1b819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '6' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x4f0150 nid=0x59 waiting on monitor [0xb1c81000..0xb1c819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '5' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x4f0f18 nid=0x58 waiting on monitor [0xb1d81000..0xb1d819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '4' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x4f0d48 nid=0x57 waiting on monitor [0xb1e81000..0xb1e819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '3' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x541870 nid=0x56 waiting on monitor [0xb1f81000..0xb1f819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '2' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x548ac8 nid=0x55 waiting on monitor [0xb2081000..0xb20819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '1' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x547390 nid=0x54 waiting on monitor [0xb2181000..0xb21819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x5414c8 nid=0x53 waiting on monitor [0xb2281000..0xb22819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '1' for queue: '__weblogic_admin_html_queue'" daemonprio=5 tid=0x4f3d60 nid=0x52 waiting on monitor [0xb2381000..0xb23819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: '__weblogic_admin_html_queue'" daemonprio=5 tid=0x5469c0 nid=0x51 waiting on monitor [0xb2481000..0xb24819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"TimeEventGenerator" daemon prio=5 tid=0x4f0378 nid=0x50 waiting onmonitor [0xb2581000..0xb25819d8]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"TimeEventGenerator" daemon prio=5 tid=0x542270 nid=0x4f waiting onmonitor [0xb2681000..0xb26819d8]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"SpinnerRandomSource" daemon prio=5 tid=0x4f2ba0 nid=0x4e waiting onmonitor [0xb2781000..0xb27819d8]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.security.SpinnerRandomBitsSource.run(SpinnerRandomBitsSource.java:57)
at java.lang.Thread.run(Thread.java:484)
"ExecuteThread: '64' for queue: 'default'" daemon prio=5 tid=0x4ee2c8nid=0x4d waiting for monitor entry [0xb2881000..0xb28819d8]
at weblogic.jdbc.jts.Connection.internalRollback(Connection.java:673)
at weblogic.jdbc.jts.Connection.rollback(Connection.java:431)
at weblogic.transaction.internal.ServerResourceInfo.rollback(ServerResourceInfo.java:1226)
at weblogic.transaction.internal.ServerResourceInfo.rollback(ServerResourceInfo.java:545)
at weblogic.transaction.internal.ServerSCInfo.startRollback(ServerSCInfo.java:372)
at weblogic.transaction.internal.ServerTransactionImpl.localRollback(ServerTransactionImpl.java:1419)
at weblogic.transaction.internal.ServerTransactionImpl.globalRollback(ServerTransactionImpl.java:2012)
at weblogic.transaction.internal.TransactionImpl$1.execute(TransactionImpl.java:1559)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '63' for queue: 'default'" daemon prio=5 tid=0x4ed7e0nid=0x4c waiting for monitor entry [0xb2981000..0xb29819d8]
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:371)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:24)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '62' for queue: 'default'" daemon prio=5 tid=0x4eccf8nid=0x4b waiting for monitor entry [0xb2a80000..0xb2a819d8]
at java.sql.DriverManager.getConnection(DriverManager.java:144)
at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:79)
at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:96)
at com.xxxxx.infra.ffff.agent.ppppoo.ppppooBean.init(ppppooBean.java:141)
at com.xxxxx.infra.ffff.agent.ppppoo.ppppooBean.ejbCreate(ppppooBean.java:121)
at com.xxxxx.infra.ffff.agent.ppppoo.ppppooBean_9cncmc_Impl.ejbCreate(ppppooBean_9cncmc_Impl.java:112)
at java.lang.reflect.Method.invoke(Native Method)
at weblogic.ejb20.pool.StatelessSessionPool.createBean(StatelessSessionPool.java:148)
at weblogic.ejb20.pool.StatelessSessionPool.getBean(StatelessSessionPool.java:112)
at weblogic.ejb20.manager.StatelessManager.preInvoke(StatelessManager.java:160)
at weblogic.ejb20.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:117)
at weblogic.ejb20.internal.StatelessEJBObject.preInvoke(StatelessEJBObject.java:63)
at com.xxxxx.infra.ffff.agent.ppppoo.ppppooBean_9cncmc_EOImpl.startRequest(ppppooBean_9cncmc_EOImpl.java:26)
at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean.executeRequest(ffffShellRequestBean.java:326)
at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean.startRequest(ffffShellRequestBean.java:104)
at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean_7gya1w_EOImpl.startRequest(ffffShellRequestBean_7gya1w_EOImpl.java:37)
at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean_7gya1w_EOImpl_WLSkel.invoke(UnknownSource)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
at weblogic.rmi.cluster.ReplicaAwareServerRef.invoke(ReplicaAwareServerRef.java:93)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest.java:22)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '61' for queue: 'default'" daemon prio=5 tid=0x4eb3f8nid=0x4a runnable [0xb2b81000..0xb2b819d8]
at weblogic.socket.PosixSocketMuxer.poll(Native Method)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:371)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:24)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '60' for queue: 'default'" daemon prio=5 tid=0x4ea910nid=0x49 waiting for monitor entry [0xb2c81000..0xb2c819d8]
at weblogic.jdbc.jts.Connection.internalRollback(Connection.java:673)
at weblogic.jdbc.jts.Connection.rollback(Connection.java:431)
at weblogic.transaction.internal.ServerResourceInfo.rollback(ServerResourceInfo.java:1226)
at weblogic.transaction.internal.ServerResourceInfo.rollback(ServerResourceInfo.java:545)
at weblogic.transaction.internal.ServerSCInfo.startRollback(ServerSCInfo.java:372)
at weblogic.transaction.internal.ServerTransactionImpl.localRollback(ServerTransactionImpl.java:1419)
at weblogic.transaction.internal.ServerTransactionImpl.globalRetryRollback(ServerTransactionImpl.java:2152)
at weblogic.transaction.internal.ServerTransactionImpl.access$3(ServerTransactionImpl.java:2123)
at weblogic.transaction.internal.ServerTransactionImpl$1.execute(ServerTransactionImpl.java:2291)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '59' for queue: 'default'" daemon prio=5 tid=0x4e9e28nid=0x48 waiting for monitor entry [0xb2d81000..0xb2d819d8]
at java.sql.DriverManager.getConnection(DriverManager.java:144)
at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:79)
at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:96)
at com.xxxxx.apps.aaaa.ejb.uuuii.loaduuuii(uuuii.java:73)
at com.xxxxx.apps.aaaa.ejb.uuuii.<init>(uuuii.java:63)
at com.xxxxx.apps.aaaa.ejb.eeeeessBean.enInit(eeeeessBean.java:30)
at com.xxxxx.apps.aaaa.ejb.eeeeessBean_2i6_EOImpl.enInit(eeeeessBean_2i6_EOImpl.java:221)
at com.xxxxx.apps.aaaa.ejb.eeeeessBean_2i6_EOImpl_WLSkel.invoke(UnknownSource)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest.java:22)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '58' for queue: 'default'" daemon prio=5 tid=0x4e9340nid=0x47 waiting for monitor entry [0xb2e81000..0xb2e819d8]
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:371)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:24)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '57' for queue: 'default'" daemon prio=5 tid=0x4e8858nid=0x46 waiting for monitor entry [0xb2f81000..0xb2f819d8]
at java.sql.DriverManager.getConnection(DriverManager.java:144)
at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:79)
at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:96)
at com.xxxxx.apps.aaaa.ejb.uuuii.loaduuuii(uuuii.java:73)
at com.xxxxx.apps.aaaa.ejb.uuuii.<init>(uuuii.java:63)
at com.xxxxx.apps.aaaa.ejb.eeeeessBean.enInit(eeeeessBean.java:30)
at com.xxxxx.apps.aaaa.ejb.eeeeessBean_2i6_EOImpl.enInit(eeeeessBean_2i6_EOImpl.java:221)
at com.xxxxx.apps.aaaa.ejb.eeeeessBean_2i6_EOImpl_WLSkel.invoke(UnknownSource)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest.java:22)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '56' for queue: 'default'" daemon prio=5 tid=0x4e7d70nid=0x45 waiting for monitor entry [0xb3080000..0xb30819d8]
at java.sql.DriverManager.getConnection(DriverManager.java:144)
at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:79)
at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:96)
at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean.init(ppppooBean.java:164)
at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean.ejbCreate(ppppooBean.java:142)
at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean_sl938_Impl.ejbCreate(ppppooBean_sl938_Impl.java:112)
at java.lang.reflect.Method.invoke(Native Method)
at weblogic.ejb20.pool.StatelessSessionPool.createBean(StatelessSessionPool.java:148)
at weblogic.ejb20.pool.StatelessSessionPool.getBean(StatelessSessionPool.java:112)
at weblogic.ejb20.manager.StatelessManager.preInvoke(StatelessManager.java:160)
at weblogic.ejb20.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:117)
at weblogic.ejb20.internal.StatelessEJBObject.preInvoke(StatelessEJBObject.java:63)
at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean_sl938_EOImpl.startRequest(ppppooBean_sl938_EOImpl.java:26)
at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean_sl938_EOImpl_WLSkel.invoke(UnknownSource)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
at weblogic.rmi.cluster.ReplicaAwareServerRef.invoke(ReplicaAwareServerRef.java:93)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
at weblogic.rmi.internal.BasicServerRef.dispatch(BasicServerRef.java:158)
at weblogic.rmi.internal.ServerRequest.sendOneWayRaw(ServerRequest.java:92)
at weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:112)
at weblogic.rmi.cluster.ReplicaAwareRemoteRef.invoke(ReplicaAwareRemoteRef.java:253)
at weblogic.rmi.cluster.ReplicaAwareRemoteRef.invoke(ReplicaAwareRemoteRef.java:220)
at weblogic.rmi.internal.ProxyStub.invoke(ProxyStub.java:35)
at $Proxy222.startRequest(Unknown Source)
at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean.executeRequest(ffffShellRequestBean.java:326)
at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean.startRequest(ffffShellRequestBean.java:104)
at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean_7gya1w_EOImpl.startRequest(ffffShellRequestBean_7gya1w_EOImpl.java:37)
at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean_7gya1w_EOImpl_WLSkel.invoke(UnknownSource)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
at weblogic.rmi.cluster.ReplicaAwareServerRef.invoke(ReplicaAwareServerRef.java:93)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest.java:22)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '55' for queue: 'default'" daemon prio=5 tid=0x4e7280nid=0x44 waiting for monitor entry [0xb3180000..0xb31819d8]
at weblogic.common.internal.ResourceAllocator.markBorrowed(ResourceAllocator.java:332)
at weblogic.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:446)
at weblogic.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:400)
at weblogic.common.internal.ResourceAllocator.reserveNoWait(ResourceAllocator.java:368)
at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:166)
at weblogic.jdbc.common.internal.ConnectionPool.reserveNoWait(ConnectionPool.java:127)
at weblogic.jdbc.common.internal.RmiDataSource.getPoolConnection(RmiDataSource.java:194)
at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:219)
at weblogic.jdbc.common.internal.RmiDataSource_WLSkel.invoke(UnknownSource)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
at weblogic.rmi.cluster.ReplicaAwareServerRef.invoke(ReplicaAwareServerRef.java:93)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
at weblogic.rmi.internal.BasicE
Similar Messages
-
Weblogic Server 9.2 MP2 - Console hangs on activating changes
Hi,
I have migrated the adminserver to a different server.
After the migration, when we make changes in the weblogic console and try to activate the changes, the console hangs.
The threads are waiting at:
weblogic.management.provider.internal.ActivateTaskImpl
I have tried a few things which include using “Perform Asynchronous Activation”.
But they have not helped.
Environment Details
==============
Operating System : HP-UX Itanium
JDK Version : 1.5
Database Version : Oracle 10g
Any pointers will be highly appreciated.facing the same problem of console hung
for weblogic 10.3 on Red hat Linux ES 4,
for every change console hangs and restart list shows all managed severs irrespective of changes.
I will appriciate any help to solve this. -
Error when starting Weblogic server
Wizards,
I installed the OPA Siebel connector. I had it working just fine for a while. I even added a new rulebase into the war and it was fine. As part of the implementation I am trying to add a new plugin to automatically save data at the end of the interview. I looked at the documentation and found we have to implement a specific event handler. After I added my jar into the plugins directory in the WAR, I am getting the following error, which seems to have nothing to do with my plugin. Can someone please tell me why this is occurring and how I can get the Weblogic server to recognize the plugins directory within the WAR?
0 [[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'] WARN com.oracle.determinations.web.platform.servlet.WebDeterminationsServletContext - Plugin directory could not be initialised. No plugins will be loaded
java.lang.IllegalArgumentException: can not resolve path: plugins
at com.oracle.util.plugins.PluginRegistry.addPluginsFromDir(PluginRegistry.java:118)
at com.oracle.determinations.web.platform.servlet.WebDeterminationsServletContext.init(WebDeterminationsServletContext.java:159)
at com.oracle.determinations.web.platform.servlet.WebDeterminationsServletContext.<init>(WebDeterminationsServletContext.java:116)
at com.oracle.determinations.web.platform.servlet.WebDeterminationsServlet.init(WebDeterminationsServlet.java:73)
at weblogic.servlet.internal.StubSecurityHelper$ServletInitAction.run(StubSecurityHelper.java:283)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
at weblogic.servlet.internal.StubSecurityHelper.createServlet(StubSecurityHelper.java:64)
at weblogic.servlet.internal.StubLifecycleHelper.createOneInstance(StubLifecycleHelper.java:58)
at weblogic.servlet.internal.StubLifecycleHelper.<init>(StubLifecycleHelper.java:48)
at weblogic.servlet.internal.ServletStubImpl.prepareServlet(ServletStubImpl.java:539)
at weblogic.servlet.internal.WebAppServletContext.preloadServlet(WebAppServletContext.java:1981)
at weblogic.servlet.internal.WebAppServletContext.loadServletsOnStartup(WebAppServletContext.java:1955)
at weblogic.servlet.internal.WebAppServletContext.preloadResources(WebAppServletContext.java:1874)
at weblogic.servlet.internal.WebAppServletContext.start(WebAppServletContext.java:3154)
at weblogic.servlet.internal.WebAppModule.startContexts(WebAppModule.java:1518)
at weblogic.servlet.internal.WebAppModule.start(WebAppModule.java:484)
at weblogic.application.internal.flow.ModuleStateDriver$3.next(ModuleStateDriver.java:425)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
at weblogic.application.internal.flow.ModuleStateDriver.start(ModuleStateDriver.java:119)
at weblogic.application.internal.flow.ScopedModuleDriver.start(ScopedModuleDriver.java:200)
at weblogic.application.internal.flow.ModuleListenerInvoker.start(ModuleListenerInvoker.java:247)
at weblogic.application.internal.flow.ModuleStateDriver$3.next(ModuleStateDriver.java:425)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
at weblogic.application.internal.flow.ModuleStateDriver.start(ModuleStateDriver.java:119)
at weblogic.application.internal.flow.StartModulesFlow.activate(StartModulesFlow.java:27)
at weblogic.application.internal.BaseDeployment$2.next(BaseDeployment.java:671)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
at weblogic.application.internal.BaseDeployment.activate(BaseDeployment.java:212)
at weblogic.application.internal.SingleModuleDeployment.activate(SingleModuleDeployment.java:44)
at weblogic.application.internal.DeploymentStateChecker.activate(DeploymentStateChecker.java:161)
at weblogic.deploy.internal.targetserver.AppContainerInvoker.activate(AppContainerInvoker.java:79)
at weblogic.deploy.internal.targetserver.BasicDeployment.activate(BasicDeployment.java:184)
at weblogic.deploy.internal.targetserver.BasicDeployment.activateFromServerLifecycle(BasicDeployment.java:361)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doActivate(DeploymentAdapter.java:51)
at weblogic.management.deploy.internal.DeploymentAdapter.activate(DeploymentAdapter.java:200)
at weblogic.management.deploy.internal.AppTransition$2.transitionApp(AppTransition.java:30)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:240)
at weblogic.management.deploy.internal.ConfiguredDeployments.activate(ConfiguredDeployments.java:169)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:123)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:180)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:96)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)Ian,
Thanks for your response. I have the following in my application.properties file:
plugin.libraries=com.oracle.determinations.web.siebel.SiebelDataAdapter;com.oracle.determinations.web.siebel.PreseedOnSessionCreatedHandler;com.sample.userplugins.automation.SessionSubmitTrigger
Additionally, I have placed the SessionSubmitTrigger class within a JAR in the plugins directory within the war. I am using Oracle WebLogic 10.3 as the app server to deploy the war within the AdminServer. And I am using OPA 10.4.3.
I should mention that the first two entries in the plugin.libraries property were there already as part of the Siebel Connector install. I just added the third one for OnInvestigationEndedEventHandler implementation.
I don't understand why Weblogic complains about not finding the Plugins directory. it is in my war. And despite the warning, I can access and navigate through my rulebase. It just doesn't seem to handle the OnInvestigationEndedEvent.
Thanks.
Sam -
OAM 11G Weblogic Server Not listening
I have installed few things including OAM, OAAM, entitlement server etc using the 11G installation suite. (on windows 2003 server)
Also I have installed the weblogic server (forget the version, should 11 something).
I have created the weblogic domains for OAM
I have done RCU with no error message, tables created.
There seems to be no error during the installation. I ironed the steps that there are no more warning and error message.
I started weblogic server. It goes to the point to a "STARTED" state. not in RUNNING STATE. ANd the windows console stay still.
When I try to access admin console 7001 weblogic. Seems that the server is not listening, I cannot access to the user interface.
Meanwhile there are no error messages or exceptions I can trace while the weblogic server is not working.
Personally I do not feel the weblogic server is not listening because of the memory leak.
When I observe the windows task manager, I saw memory leak, the memory of the server increase steadily even the weblogic is not working. After half an hour, it throw out of memory exception. I tried to play with the heap size of java to 1024G, but no help. Problem is it is leaking no matter how much memory allocate there will be problem.
Can anyone tell me is there some steps I am missing? or is there known bugs? Or what else I can do to troubleshoot this?
I can provide you all the version of the software I am using. AFter two weeks.... since the lab would be down for renovation purposes.
Thanks
EricEric,
try to install JRockit Mission control to grab more details of what is going wrong there.
link:
http://docs.oracle.com/cd/E13150_01/jrockit_jvm/jrockit/releases/R27/install/install.html
and
http://www.oracle.com/technetwork/middleware/jrockit/downloads/index.html
I hope this helps,
Thiago Leoncio. -
Hi,
we have a J2EE application using an Oracle 8.1.7
database, Oracle thin JDBC driver and WLS 5.1 running on
a Tru64 WLS cluster.
The entire Weblogic Server is hanging (!!!) after a database
reconnect.
The problem occurs when a EJB selects data from the database and
the database is going down and the application server is trying
to reconnect.
If there is no database activity in the moment of the database
reconnect, the application works fine
(the server is not hanging).
The application only reads (select) data from the database,
no inserts/updates/deletes.
We are using a database connect pool (initial 10, increment 10,
max 30 connections, testConnsOnReserve=true,
testConnsOnRelease=false, refreshTestMinutes=1).
The problem is independend from
a) The operating System
(We tested Tru64 UNIX V4.0e, V4.0f and W2K SP2.)
b) the java version
(We tested on Tru64 UNIX V1.2.2-6 with and without
Compaq fast VM V1.2.2-4, V1.3.1-1 and V1.3.1-2 with fast
VM, on W2K V1.2.2 and V1.3.1)
c) the Oracle thin driver
(We tested an older one and the current version
for Oracle V8.1.7 - downloaded last week from Oracle.
I dont know the detailled version.
All files are named
classes12.jar or classes12_01.jar)
d) the Oracle minor version
(We tested Oracle V8.1.7.0, V8.1.7.2 and V8.1.7.3)
e) WLS as a single server application or
and all combinations from a) b) c) d) and e)
(It was a lot of work to test it !!!)
But the problem depends on the Weblogic Server service pack.
a) With WLS SP7 we have no problem.
b) With WLS SP9 and SP11 the entire application server is
hanging.
But we need WLS SP9 or higher with the bugfixing for
CR 31604: Fixed a bug where EJBs with large Primary Keys
caused OutOfMemoryErrors.
Any Idea.
Thanks in Advance.
Regards
Uwe SeyfertHi. Are you sure you've editted the startWebLogic script
to add the latest oracle driver zip ahead of all the weblogic stuff
in the weblogic.classpath, not the java.classpath? Can we see
a thread dump of the server when it hangs?
thanks,
joe
Uwe Seyfert wrote:
Hi,
we have a J2EE application using an Oracle 8.1.7
database, Oracle thin JDBC driver and WLS 5.1 running on
a Tru64 WLS cluster.
The entire Weblogic Server is hanging (!!!) after a database
reconnect.
The problem occurs when a EJB selects data from the database and
the database is going down and the application server is trying
to reconnect.
If there is no database activity in the moment of the database
reconnect, the application works fine
(the server is not hanging).
The application only reads (select) data from the database,
no inserts/updates/deletes.
We are using a database connect pool (initial 10, increment 10,
max 30 connections, testConnsOnReserve=true,
testConnsOnRelease=false, refreshTestMinutes=1).
The problem is independend from
a) The operating System
(We tested Tru64 UNIX V4.0e, V4.0f and W2K SP2.)
b) the java version
(We tested on Tru64 UNIX V1.2.2-6 with and without
Compaq fast VM V1.2.2-4, V1.3.1-1 and V1.3.1-2 with fast
VM, on W2K V1.2.2 and V1.3.1)
c) the Oracle thin driver
(We tested an older one and the current version
for Oracle V8.1.7 - downloaded last week from Oracle.
I dont know the detailled version.
All files are named
classes12.jar or classes12_01.jar)
d) the Oracle minor version
(We tested Oracle V8.1.7.0, V8.1.7.2 and V8.1.7.3)
e) WLS as a single server application or
and all combinations from a) b) c) d) and e)
(It was a lot of work to test it !!!)
But the problem depends on the Weblogic Server service pack.
a) With WLS SP7 we have no problem.
b) With WLS SP9 and SP11 the entire application server is
hanging.
But we need WLS SP9 or higher with the bugfixing for
CR 31604: Fixed a bug where EJBs with large Primary Keys
caused OutOfMemoryErrors.
Any Idea.
Thanks in Advance.
Regards
Uwe Seyfert -
Need help regarding Weblogic Server Hang up
We are facing a problem at the client’s place on the production environment.
The weblogic server is hanging up once every week. The application is running fine till then, but once the server is hung we need to restart the weblogic again.
Also after observing the behavior of the memory usage of the application in the weblogic admin console we came to know that the memory usage is gradually increasing day by day. We are not sure why this is happening.
We tested the application to check for any memory leaks using JProbe. We couldn’t find any memory leaks in the application. We even tested it onsite but couldn’t find any memory leaks.
I need some help on this issue as this is happening on the production environment and needs to be resolved as soon as possible.
The configuration we are having on the production environment is:
bea:8.1
JDK:1.41_021. You say its a hang, get multiple threadumps and see whats happening at the time of hang. this will give you a clue into the work thats going on and thats stuck.
2. are you seeing outofmemoryexception? If yes only then you will need to suspect the memory leak. First thing in such situation is try to increase the heap by about 1/3rd more (this is just a guestimate not a recommended practice) , that can potentially buy you time to analyze the problem.
3. you should also check if weblogic objects are leaking , check the jprobe snapshots if you have any to see if you find any weblogic object that are not getting garbage collected and growing continuously. there have been a few memory leak fixes since 8.1 release. if you find something contact support@bea and find out if any existing fix will help. -
Thread are gettin stuck causing the WebLogic server to hang
We are developing an application for an US client which inclueds the following technology.
- WebLogic 9.2 JMS (Foreign Server, Queue, Connection Factor, persistent Store)
- Oracle 10g & Oracle 9i
- J2EE (MDB)
Different application uses different databases.
After the server run for a few day it is getting a stuck thread and reported the same as a Hogging Thread in server -> monitoring -> thread. At this point the server hangs and stopped working with the status in 'warning' state (in the same page itself).
The problem remains until the managed server is restarted.
We have taken thread dump of different times and one of the error that we have got is attached below:
"[STUCK] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" waiting for lock weblogic.rjvm.ResponseImpl@1279315 WAITING
java.lang.Object.wait(Native Method)
weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:82)
weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:109)
weblogic.messaging.dispatcher.DispatcherProxy.unmarshalResponse(DispatcherProxy.java:238)
weblogic.messaging.dispatcher.DispatcherProxy.dispatchSyncTranFuture(DispatcherProxy.java:131)
weblogic.messaging.dispatcher.DispatcherWrapperState.dispatchSyncTran(DispatcherWrapperState.java:241)
weblogic.messaging.dispatcher.DispatcherWrapperState.dispatchSyncNoTran(DispatcherWrapperState.java:266)
weblogic.jms.dispatcher.DispatcherAdapter.dispatchSyncNoTran(DispatcherAdapter.java:59)
weblogic.jms.client.JMSProducer.toFEProducer(JMSProducer.java:1061)
weblogic.jms.client.JMSProducer.deliveryInternal(JMSProducer.java:670)
weblogic.jms.client.JMSProducer.sendInternal(JMSProducer.java:455)
weblogic.jms.client.JMSProducer.send(JMSProducer.java:337)
weblogic.jms.client.WLProducerImpl.send(WLProducerImpl.java:966)
com.ctb.dex.messagehost.InputMessageListener.onMessage(Unknown Source)
weblogic.ejb.container.internal.MDListener.execute(MDListener.java:429)
weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:335)
weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:291)
weblogic.jms.client.JMSSession.onMessage(JMSSession.java:4072)
weblogic.jms.client.JMSSession.execute(JMSSession.java:3962)
weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:4490)
weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl.run(ServerWorkManagerImpl.java:518)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
Any body has any idea why this is happening? Please let me know in case you need to know more about the problem. Mail me at [email protected].Tom, we are experiencing the similar stuck thread max time out errors on our weblogic server(weblogic 8.1 sp5). Below is the thread dump:
Blocked lock chains
===================
Chain 4:
"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=101 idx=0xca tid=19298 waiting for java/lang/String@0x9c1fb10 held by:
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=102 idx=0xcc tid=19299 in chain 3
Open lock chains
================
Chain 1:
"ExecuteThread: '33' for queue: 'weblogic.kernel.Default'" id=62 idx=0x80 tid=19223 waiting for java/lang/String@0xbd00b10 held by:
"ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" id=32 idx=0x44 tid=19192 (waiting on notification)
Chain 2:
"ExecuteThread: '45' for queue: 'weblogic.kernel.Default'" id=74 idx=0x98 tid=19235 waiting for java/lang/String@0x1d1083a8 held by:
"ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" id=40 idx=0x54 tid=19200 (waiting on notification)
Chain 3:
"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=100 idx=0xc8 tid=19297 waiting for java/lang/String@0x9c1fb10 held by:
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=102 idx=0xcc tid=19299 (active)
Can you help us in resolving the issue? This causes the weblogic server to hung and eventually non responsive.
Below are our java version details:
java version "1.4.2_13"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_13-b06)
Java HotSpot(TM) Client VM (build 1.4.2_13-b06, mixed mode)
Can you let me know how to proceed and what can be done to avoid this issue?
Thanks a bunch Tom.
Regards
RV -
My WebLogic Server hang up sometime. The platform is IBM AIX, weblogic 8.1 with sp3
The following is the thread dump:
NULL ------------------------------------------------------------------------
0SECTION TITLE subcomponent dump routine
NULL ===============================
1TISIGINFO signal 3 received
1TIDATETIME Date: 2007/04/26 at 11:13:10
1TIFILENAME Javacore filename: /var/bea/domains/TazDomain/javacore524292.1177600390.txt
NULL ------------------------------------------------------------------------
0SECTION XHPI subcomponent dump routine
NULL ==============================
1XHTIME Thu Apr 26 11:13:10 2007
1XHSIGRECV SIGQUIT received at 0x0 in <unknown>.
1XHFULLVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
NULL
1XHCURRENTTHD Current Thread Details
NULL ----------------------
2XHCURRSYSTHD "Signal dispatcher" sys_thread_t:0x74427A28
3XHNATIVESTACK Native Stack
NULL ------------
3XHSTACKLINEERR unavailable - stack address not valid
1XHOPENV Operating Environment
NULL ---------------------
2XHHOSTNAME Host : rcirs050:10.1.93.20
2XHOSLEVEL OS Level : AIX 5.3.0.0
2XHCPUS Processors -
3XHCPUARCH Architecture : POWER_PC (impl: unknown, ver: unknown)
3XHNUMCPUS How Many : 2
3XHCPUSENABLED Enabled : 2
NULL
1XHUSERLIMITS User Limits (in bytes except for NOFILE and NPROC) -
NULL -----------
2XHUSERLIMIT RLIMIT_FSIZE : 1073741312
2XHUSERLIMIT RLIMIT_DATA : 2147483645
2XHUSERLIMIT RLIMIT_STACK : 33554432
2XHUSERLIMIT RLIMIT_CORE : 1073741312
2XHUSERLIMIT RLIMIT_NOFILE : 1024
2XHLIMIT NPROC(max) : 128
NULL
1XHPAGESPACES Page Space (in blocks) -
NULL ----------
2XHPAGESPACE /dev/hd6: size=262144, free=261912
2XHPAGESPACE /dev/paging03: size=507904, free=507672
2XHPAGESPACE /dev/paging00: size=262144, free=261917
2XHPAGESPACE /dev/paging01: size=262144, free=261903
2XHPAGESPACE /dev/paging02: size=262144, free=261901
2XHPAGESPACE /dev/paging04: size=262144, free=260986
2XHPAGESPACE /dev/paging07: size=262144, free=261911
2XHPAGESPACE /dev/paging06: size=262144, free=261913
2XHPAGESPACE /dev/paging05: size=262144, free=261913
NULL
1XHSIGHANDLERS JVM Signal Handlers
NULL -------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHSIGHANDLERS Chained Signal Handlers
NULL -----------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHENVVARS Environment Variables
NULL ---------------------
2XHENVVAR _=/usr/java14/bin/java
2XHENVVAR JAVA_VENDOR=IBM
2XHENVVAR LANG=C
2XHENVVAR PRODUCTION_MODE=
2XHENVVAR LOGIN=qatadm
2XHENVVAR CLASSPATHSEP=:
2XHENVVAR VISUAL=vi
2XHENVVAR POINTBASE_HOME=/opt/bea/weblogic81/common/eval/pointbase
2XHENVVAR PATH=/opt/bea/weblogic81/server/bin:/usr/java14/jre/bin:/usr/java14/bin:/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/qatadm/bin:/usr/bin/X11:/sbin:.:/usr/java14/bin
2XHENVVAR JAVA_VM=
2XHENVVAR LC__FASTMSG=true
2XHENVVAR POINTBASE_CLASSPATH=:/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar
2XHENVVAR CLASSPATH=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2XHENVVAR LOGNAME=qatadm
2XHENVVAR MAIL=/usr/spool/mail/qatadm
2XHENVVAR POINTBASE_TOOLS=/opt/bea/weblogic81/common/eval/pointbase/lib/pbtools44.jar
2XHENVVAR LOCPATH=/usr/lib/nls/loc
2XHENVVAR PS1=rcirs050:$PWD>
2XHENVVAR PATHSEP=:
2XHENVVAR USER=qatadm
2XHENVVAR AUTHSTATE=compat
2XHENVVAR BEA_HOME=/opt/bea
2XHENVVAR DCE_USE_WCHAR_NAMES=1
2XHENVVAR SHELL=/usr/bin/ksh
2XHENVVAR ODMDIR=/etc/objrepos
2XHENVVAR JAVA_HOME=/usr/java14
2XHENVVAR TIMEOUT=900
2XHENVVAR TMOUT=900
2XHENVVAR HOME=/home/qatadm
2XHENVVAR MEM_ARGS=-Xms512m -Xmx1024m
2XHENVVAR WEBLOGIC_CLASSPATH=/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar
2XHENVVAR TERM=dtterm
2XHENVVAR MAILMSG=[YOU HAVE NEW MAIL]
2XHENVVAR PWD=/var/bea/domains/TazDomain
2XHENVVAR TZ=EST5EDT
2XHENVVAR WL_HOME=/opt/bea/weblogic81
2XHENVVAR AIXTHREAD_SCOPE=S
2XHENVVAR A__z=! LOGNAME="*TMOUT
2XHENVVAR _IBM_JAVA_PIPE_524292=
2XHENVVAR IBM_JVM_LIBPATH_OLD_VALUE=/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_LIBPATH_NEW_VALUE=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_CHANGED_ENVVARS_524292=LIBPATH,LDR_CNTRL
2XHENVVAR IBM_JVM_LDR_CNTRL_NEW_VALUE=MAXDATA=0XA0000000@DSA
2XHENVVAR LDR_CNTRL=MAXDATA=0XA0000000@DSA
2XHENVVAR NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
2XHENVVAR LIBPATH=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR _IBM_ENV_INITIAL_524292=805345384
2XHENVVAR IBM_JAVA_COMMAND_LINE=/usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
NULL
1XHLOADEDLIBS Loaded Libraries (sizes in bytes)
NULL ---------------------------------
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libmuxer.so
3XHLIBSIZE filesize : 20757
3XHLIBSTART text start : 0xD0B88000
3XHLIBLDSIZE text size : 0x282E
3XHLIBLDORG data start : 0xF0617CF4
3XHLIBLDDATASZ data size : 0x2AC
2XHLIBNAME /usr/java14/jre/bin/libnio.a
3XHLIBSIZE filesize : 64305
3XHLIBSTART text start : 0xD11F5000
3XHLIBLDSIZE text size : 0x8EF0
3XHLIBLDORG data start : 0xF0615AE0
3XHLIBLDDATASZ data size : 0x594
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libweblogicunix1.so
3XHLIBSIZE filesize : 14536
3XHLIBSTART text start : 0xD0B86000
3XHLIBLDSIZE text size : 0x1B90
3XHLIBLDORG data start : 0xF0614484
3XHLIBLDDATASZ data size : 0xD8
2XHLIBNAME /usr/java14/jre/bin/libnet.a
3XHLIBSIZE filesize : 137885
3XHLIBSTART text start : 0xD15D7000
3XHLIBLDSIZE text size : 0x161FF
3XHLIBLDORG data start : 0xF05DE3D8
3XHLIBLDDATASZ data size : 0x968
2XHLIBNAME /usr/java14/jre/bin/libjitc.a
3XHLIBSIZE filesize : 2814544
3XHLIBSTART text start : 0xD252E000
3XHLIBLDSIZE text size : 0x23EE7B
3XHLIBLDORG data start : 0xF0962B68
3XHLIBLDDATASZ data size : 0x1A984
2XHLIBNAME /usr/lib/security/DCE
3XHLIBSIZE filesize : 27634
3XHLIBSTART text start : 0xD0B7A000
3XHLIBLDSIZE text size : 0x6BF2
3XHLIBLDORG data start : 0xF05CEA38
3XHLIBLDDATASZ data size : 0x2BA0
2XHLIBNAME /usr/java14/jre/bin/libzip.a
3XHLIBSIZE filesize : 109746
3XHLIBSTART text start : 0xD11E1000
3XHLIBLDSIZE text size : 0x135E2
3XHLIBLDORG data start : 0xF05DC468
3XHLIBLDDATASZ data size : 0x1918
2XHLIBNAME /usr/java14/jre/bin/classic/libcore.a
3XHLIBSIZE filesize : 136713
3XHLIBSTART text start : 0xD11CB000
3XHLIBLDSIZE text size : 0x15248
3XHLIBLDORG data start : 0xF05DA0E8
3XHLIBLDDATASZ data size : 0x1620
2XHLIBNAME /usr/java14/jre/bin/libjava.a
3XHLIBSIZE filesize : 221158
3XHLIBSTART text start : 0xD11AB000
3XHLIBLDSIZE text size : 0x1FEB2
3XHLIBLDORG data start : 0xF05D88F8
3XHLIBLDDATASZ data size : 0x16F8
2XHLIBNAME /usr/java14/jre/bin/libhpi.a
3XHLIBSIZE filesize : 205732
3XHLIBSTART text start : 0xD118C000
3XHLIBLDSIZE text size : 0x1EE0E
3XHLIBLDORG data start : 0xF06045A0
3XHLIBLDDATASZ data size : 0xF8D0
2XHLIBNAME /usr/java14/jre/bin/libxhpi.a
3XHLIBSIZE filesize : 14654
3XHLIBSTART text start : 0xD0B84000
3XHLIBLDSIZE text size : 0x1B52
3XHLIBLDORG data start : 0xF05D7290
3XHLIBLDDATASZ data size : 0x2C8
2XHLIBNAME /usr/java14/jre/bin/libdbgmalloc.a
3XHLIBSIZE filesize : 15267
3XHLIBSTART text start : 0xD0B81000
3XHLIBLDSIZE text size : 0x217C
3XHLIBLDORG data start : 0xF05D6988
3XHLIBLDDATASZ data size : 0x218
2XHLIBNAME /usr/java14/jre/bin/libjsig.a
3XHLIBSIZE filesize : 14412
3XHLIBSTART text start : 0xD07F8000
3XHLIBLDSIZE text size : 0x1B24
3XHLIBLDORG data start : 0xF05D54B0
3XHLIBLDDATASZ data size : 0x108
2XHLIBNAME /usr/java14/jre/bin/libute.a
3XHLIBSIZE filesize : 112768
3XHLIBSTART text start : 0xD1177000
3XHLIBLDSIZE text size : 0x14ED9
3XHLIBLDORG data start : 0xF05D43B0
3XHLIBLDDATASZ data size : 0x674
2XHLIBNAME /usr/lib/libdl.a
3XHLIBSIZE filesize : 5248
3XHLIBSTART text start : 0xD02E70F8
3XHLIBLDSIZE text size : 0x1E0
3XHLIBLDORG data start : 0xF03190F8
3XHLIBLDDATASZ data size : 0x0
2XHLIBNAME /usr/java14/jre/bin/sovvm/libjvm.a
3XHLIBSIZE filesize : 2857303
3XHLIBSTART text start : 0xD2335000
3XHLIBLDSIZE text size : 0x1F8E31
3XHLIBLDORG data start : 0xF0936290
3XHLIBLDDATASZ data size : 0x2AE10
2XHLIBNAME /usr/java14/jre/bin/classic/libjvm.a
3XHLIBSIZE filesize : 117748
3XHLIBSTART text start : 0xD1169000
3XHLIBLDSIZE text size : 0xD54B
3XHLIBLDORG data start : 0xF05D2A90
3XHLIBLDDATASZ data size : 0xF0C
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01E7540
3XHLIBLDSIZE text size : 0x20F6D
3XHLIBLDORG data start : 0xF0381340
3XHLIBLDDATASZ data size : 0x6780
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01CDBC0
3XHLIBLDSIZE text size : 0x186CC
3XHLIBLDORG data start : 0xF0377FC0
3XHLIBLDDATASZ data size : 0x84C9
2XHLIBNAME /usr/lib/libcrypt.a
3XHLIBSIZE filesize : 11019
3XHLIBSTART text start : 0xD01450F8
3XHLIBLDSIZE text size : 0x846
3XHLIBLDORG data start : 0xF0316508
3XHLIBLDDATASZ data size : 0x128
2XHLIBNAME /usr/lib/libiconv.a
3XHLIBSIZE filesize : 377727
3XHLIBSTART text start : 0xD05BF100
3XHLIBLDSIZE text size : 0x139C1
3XHLIBLDORG data start : 0xF0252C70
3XHLIBLDDATASZ data size : 0xA2E4
2XHLIBNAME /usr/lib/libbsd.a
3XHLIBSIZE filesize : 61862
3XHLIBSTART text start : 0xD02784C0
3XHLIBLDSIZE text size : 0x7D2F
3XHLIBLDORG data start : 0xF0213A30
3XHLIBLDDATASZ data size : 0x13D8
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010E000
3XHLIBLDSIZE text size : 0x365C4
3XHLIBLDORG data start : 0xF0370000
3XHLIBLDDATASZ data size : 0x4024
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010A000
3XHLIBLDSIZE text size : 0x3C52
3XHLIBLDORG data start : 0xF032D000
3XHLIBLDDATASZ data size : 0x424A8
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01AD100
3XHLIBLDSIZE text size : 0x1FED1
3XHLIBLDORG data start : 0xF0388D00
3XHLIBLDDATASZ data size : 0x30F9
2XHLIBNAME /usr/lib/libc.a
3XHLIBSIZE filesize : 8270989
3XHLIBSTART text start : 0xD02F2240
3XHLIBLDSIZE text size : 0x251155
3XHLIBLDORG data start : 0xF0278BC0
3XHLIBLDDATASZ data size : 0x9D340
NULL
NULL ------------------------------------------------------------------------
0SECTION CI subcomponent dump routine
NULL ============================
1CIJAVAVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
1CIRUNNINGAS Running as a standalone JVM
1CICMDLINE /usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
1CIJAVAHOMEDIR Java Home Dir: /usr/java14/jre
1CIJAVADLLDIR Java DLL Dir: /usr/java14/jre/bin
1CISYSCP Sys Classpath: /usr/java14/jre/lib/core.jar:/usr/java14/jre/lib/graphics.jar:/usr/java14/jre/lib/security.jar:/usr/java14/jre/lib/server.jar:/usr/java14/jre/lib/xml.jar:/usr/java14/jre/lib/charsets.jar:/usr/java14/jre/classes:/usr/java14/jre/lib/ibmcertpathprovider.jar:/usr/java14/jre/lib/ibmjaaslm.jar:/usr/java14/jre/lib/ibmjcefw.jar:/usr/java14/jre/lib/ibmjgssprovider.jar:/usr/java14/jre/lib/ibmjssefips.jar:/usr/java14/jre/lib/ibmjsseprovider.jar:/usr/java14/jre/lib/ibmorb.jar:/usr/java14/jre/lib/ibmorbapi.jar:/usr/java14/jre/lib/ibmpkcs.jar
1CIUSERARGS UserArgs:
2CIUSERARG vfprintf 0x30000D94
2CIUSERARG -Xms512m
2CIUSERARG -Xmx1024m
2CIUSERARG -Duser.timezone=America/New_York
2CIUSERARG -Dweblogic.Name=TazServer
2CIUSERARG -Dweblogic.ProductionModeEnabled=
2CIUSERARG -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy
2CIUSERARG -Dinvokedviajava
2CIUSERARG -Djava.class.path=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2CIUSERARG vfprintf
NULL
1CIJVMMI JVM Monitoring Interface (JVMMI)
NULL ------------------------
2CIJVMMIOFF No events are enabled.
NULL
NULL ------------------------------------------------------------------------
0SECTION DC subcomponent dump routine
NULL ============================
1DCHEADEREYE Header eye catcher DCST
1DCHEADERLEN Header length 24
1DCHEADERVER Header version 1
1DCHEADERMOD Header modification 0
1DCINTERFACE DC Interface at 0xF0947FDC with 15 entries
2DCINTERFACE 1 - dcCString2JavaString 0xF0944A90
2DCINTERFACE 2 - dcInt642CString 0xF0944A9C
2DCINTERFACE 3 - dcJavaString2NewCString 0xF0944AA8
2DCINTERFACE 4 - dcJavaString2CString 0xF0944AB4
2DCINTERFACE 5 - dcJavaString2NewPlatformString 0xF0944AC0
2DCINTERFACE 6 - dcJavaString2UTF 0xF0944ACC
2DCINTERFACE 7 - dcPlatformString2JavaString 0xF0944AE4
2DCINTERFACE 8 - dcUnicode2UTF 0xF0944AF0
2DCINTERFACE 9 - dcUnicode2UTFLength 0xF0944AFC
2DCINTERFACE 10 - dcUTF2JavaString 0xF0944B08
2DCINTERFACE 11 - dcUTFClassName2JavaString 0xF0944B14
2DCINTERFACE 12 - dcJavaString2ClassName 0xF0944AD8
2DCINTERFACE 13 - dcUTF2UnicodeNext 0xF0944B20
2DCINTERFACE 14 - dcVerifyUTF8 0xF0944B2C
2DCINTERFACE 15 - dcDumpRoutine 0xF0944B38
1DCARRAYINFO Array info at 0xF09384A0 with 16 entries
2DCARRAYINFO 1 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 2 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 3 - index 2 signature L name class[] factor 4
2DCARRAYINFO 4 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 5 - index 4 signature Z name bool[] factor 1
2DCARRAYINFO 6 - index 5 signature C name char[] factor 2
2DCARRAYINFO 7 - index 6 signature F name float[] factor 4
2DCARRAYINFO 8 - index 7 signature D name double[] factor 8
2DCARRAYINFO 9 - index 8 signature B name byte[] factor 1
2DCARRAYINFO 10 - index 9 signature S name short[] factor 2
2DCARRAYINFO 11 - index 10 signature I name int[] factor 4
2DCARRAYINFO 12 - index 11 signature J name long[] factor 8
2DCARRAYINFO 13 - index 0 signature 0 name uint[] factor 0
2DCARRAYINFO 14 - index 0 signature 0 name uint1[] factor 0
2DCARRAYINFO 15 - index 0 signature 0 name uint2[] factor 0
2DCARRAYINFO 16 - index 0 signature 0 name uint3[] factor 0
NULL ------------------------------------------------------------------------
0SECTION DG subcomponent dump routine
NULL ============================
1DGTRCENABLED Trace enabled: Yes
2DGTRCTYPE Trace: Internal
2DGTRCBUFFERS Buffer specification: 8k
2DGTRCBUFALLOC Buffers allocated: 0
2DGTRCBUFUSED Buffers in use: 0
1DGJDUMPBUFF Javadump buffer size (allocated): 2621440
NULL ------------------------------------------------------------------------
0SECTION ST subcomponent dump routine
NULL ============================
1STGCMODES Resettable GC: No
1STGCMODES Concurrent GC: No
1STCURHBASE Current Heap Base: 0x300601FC
1STCURHLIM Current Heap Limit: 0x5005FBFC
1STMWHBASE Middleware Heap Base: 0x300601FC
1STMWHLIM Middleware Heap Limit: 0x5005FBFC
1STGCHELPERS Number of GC Helper Threads: 1
1STJVMOPTS -Xconcurrentlevel: 0
1STJVMOPTS -Xconcurrentbackground: 0
1STGCCTR GC Counter: 42
1STAFCTR AF Counter: 42
1STHEAPFREE Bytes of Heap Space Free: 190d3b88
1STHEAPALLOC Bytes of Heap Space Allocated: 1ffffa00
1STSMBASE SM Base: 0x0
1STSMEND SM End: 0x0
1STPAMSTART PAM Start: 0x0
1STPAMEND PAM End: 0x0
1STCOMACTION Compact Action: 0
NULL ------------------------------------------------------------------------
0SECTION XE subcomponent dump routine
NULL ============================
1XETHRESHOLD MMI threshold for java methods is set to 1250
1XEJITINIT JIT is initialized
1XEJVMPIOFF JVMPI is not activated
1XEJNITHRESH MMI threshold for JNI methods is set to 0
1XETRCHIS Trace history length is set to 4
1XEJITDUMP JIT dump routine is not yet implemented.
NULL ------------------------------------------------------------------------
0SECTION LK subcomponent dump routine
NULL ============================
NULL
1LKPOOLINFO Monitor pool info:
2LKPOOLINIT Initial monitor count: 32
2LKPOOLEXPNUM Minimum number of free monitors before expansion: 5
2LKPOOLEXPBY Pool will next be expanded by: 81
2LKPOOLTOTAL Current total number of monitors: 162
2LKPOOLFREE Current number of free monitors: 42
NULL
1LKMONPOOLDUMP Monitor Pool Dump (flat & inflated object-monitors):
2LKMONINUSE sys_mon_t:0x3003EC78 infl_mon_t: 0x3003E6E8:
3LKMONOBJECT java.lang.ref.Reference$Lock@300E02B0/300E02B8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Reference Handler" (0x744B7D28)
2LKMONINUSE sys_mon_t:0x3003ED28 infl_mon_t: 0x3003E714:
3LKMONOBJECT java.lang.ref.ReferenceQueue$Lock@300DFFE8/300DFFF0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Finalizer" (0x745409A8)
2LKMONINUSE sys_mon_t:0x3003EDD8 infl_mon_t: 0x3003E740:
3LKMONOBJECT java.util.TaskQueue@311299D0/311299D8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-1" (0x75F054A8)
2LKMONINUSE sys_mon_t:0x3003EE88 infl_mon_t: 0x3003E76C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9A60/300C9A68: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" (0x765659A8)
2LKMONINUSE sys_mon_t:0x3003EF38 infl_mon_t: 0x3003E798:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C99C0/300C99C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" (0x765693A8)
2LKMONINUSE sys_mon_t:0x3003EFE8 infl_mon_t: 0x3003E7C4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9920/300C9928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" (0x76569928)
2LKMONINUSE sys_mon_t:0x3003F098 infl_mon_t: 0x3003E7F0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9880/300C9888: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" (0x76572BA8)
2LKMONINUSE sys_mon_t:0x3003F148 infl_mon_t: 0x3003E81C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C97E0/300C97E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" (0x767971A8)
2LKMONINUSE sys_mon_t:0x3003F1F8 infl_mon_t: 0x3003E848:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9740/300C9748: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" (0x7681EBA8)
2LKMONINUSE sys_mon_t:0x3003F2A8 infl_mon_t: 0x3003E874:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C96A0/300C96A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" (0x768A65A8)
2LKMONINUSE sys_mon_t:0x3003F358 infl_mon_t: 0x3003E8A0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9600/300C9608: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" (0x7692E028)
2LKMONINUSE sys_mon_t:0x3003F408 infl_mon_t: 0x3003E8CC:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9560/300C9568: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" (0x769B5A28)
2LKMONINUSE sys_mon_t:0x3003F4B8 infl_mon_t: 0x3003E8F8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C94C0/300C94C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" (0x76A3D4A8)
2LKMONINUSE sys_mon_t:0x3003F568 infl_mon_t: 0x3003E924:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9420/300C9428: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" (0x76AC4EA8)
2LKMONINUSE sys_mon_t:0x3003F618 infl_mon_t: 0x3003E950:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9380/300C9388: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" (0x76B4C8A8)
2LKMONINUSE sys_mon_t:0x3003F6C8 infl_mon_t: 0x3003E97C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C92E0/300C92E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" (0x76BD4328)
2LKMONINUSE sys_mon_t:0x3003F778 infl_mon_t: 0x3003E9A8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9240/300C9248: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" (0x76C5BD28)
2LKMONINUSE sys_mon_t:0x3003F828 infl_mon_t: 0x3003E9D4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C91A0/300C91A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" (0x76CE3728)
2LKMONINUSE sys_mon_t:0x3003F988 infl_mon_t: 0x3003EA2C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9060/300C9068: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" (0x76DF2BA8)
2LKMONINUSE sys_mon_t:0x3003FA38 infl_mon_t: 0x3003EA58:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8FC0/300C8FC8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" (0x76E7A628)
2LKMONINUSE sys_mon_t:0x3003FAE8 infl_mon_t: 0x3003EA84:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8F20/300C8F28: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" (0x76F02028)
2LKMONINUSE sys_mon_t:0x3003FB98 infl_mon_t: 0x3003EAB0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8E80/300C8E88: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" (0x76F89A28)
2LKMONINUSE sys_mon_t:0x3003FC48 infl_mon_t: 0x3003EADC:
3LKMONOBJECT weblogic.time.common.internal.TimeTable@32EB9198/32EB91A0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.time.TimeEventGenerator" (0x77013D28)
2LKMONINUSE sys_mon_t:0x3003FCF8 infl_mon_t: 0x3003EB08:
3LKMONOBJECT java.lang.Object@32F56538/32F56540: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.security.SpinnerRandomSource" (0x770CC3A8)
2LKMONINUSE sys_mon_t:0x3003FDA8 infl_mon_t: 0x3003EB34:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8CD0/300C8CD8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" (0x770E4428)
2LKMONINUSE sys_mon_t:0x3003FE58 infl_mon_t: 0x3003EB60:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8C30/300C8C38: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" (0x770E4A28)
2LKMONINUSE sys_mon_t:0x3003FF08 infl_mon_t: 0x3003EB8C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8B90/300C8B98: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" (0x770E5028)
2LKMONINUSE sys_mon_t:0x770E3D38 infl_mon_t: 0x770F13D8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8AF0/300C8AF8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" (0x770F1028)
2LKMONINUSE sys_mon_t:0x770E3DE8 infl_mon_t: 0x770F1404:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8A50/300C8A58: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" (0x770F84A8)
2LKMONINUSE sys_mon_t:0x770E3E98 infl_mon_t: 0x770F1430:
3LKMONOBJECT [email protected]0/300C8928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "VDE Transaction Processor Thread" (0x77531828)
2LKMONINUSE sys_mon_t:0x770F1758 infl_mon_t: 0x770F1488:
3LKMONOBJECT java.util.TaskQueue@30EECD38/30EECD40: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-5" (0x75CCD1A8)
2LKMONINUSE sys_mon_t:0x770F2F88 infl_mon_t: 0x770F1538:
3LKMONOBJECT weblogic.jms.backend.BETimerTree@33C6CFE0/33C6CFE8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" (0x7893DD28)
2LKMONINUSE sys_mon_t:0x770F3038 infl_mon_t: 0x770F1564:
3LKMONOBJECT java.util.TaskQueue@34F10870/34F10878: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-7" (0x78DE09A8)
2LKMONINUSE sys_mon_t:0x770F30E8 infl_mon_t: 0x770F1590:
3LKMONOBJECT java.util.TaskQueue@3C4CB120/3C4CB128: <unowned>
3LKNOTIFYQ Waiting to be notifieMy WebLogic Server hang up sometime. The platform is IBM AIX, weblogic 8.1 with sp3
The following is the thread dump:
NULL ------------------------------------------------------------------------
0SECTION TITLE subcomponent dump routine
NULL ===============================
1TISIGINFO signal 3 received
1TIDATETIME Date: 2007/04/26 at 11:13:10
1TIFILENAME Javacore filename: /var/bea/domains/TazDomain/javacore524292.1177600390.txt
NULL ------------------------------------------------------------------------
0SECTION XHPI subcomponent dump routine
NULL ==============================
1XHTIME Thu Apr 26 11:13:10 2007
1XHSIGRECV SIGQUIT received at 0x0 in <unknown>.
1XHFULLVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
NULL
1XHCURRENTTHD Current Thread Details
NULL ----------------------
2XHCURRSYSTHD "Signal dispatcher" sys_thread_t:0x74427A28
3XHNATIVESTACK Native Stack
NULL ------------
3XHSTACKLINEERR unavailable - stack address not valid
1XHOPENV Operating Environment
NULL ---------------------
2XHHOSTNAME Host : rcirs050:10.1.93.20
2XHOSLEVEL OS Level : AIX 5.3.0.0
2XHCPUS Processors -
3XHCPUARCH Architecture : POWER_PC (impl: unknown, ver: unknown)
3XHNUMCPUS How Many : 2
3XHCPUSENABLED Enabled : 2
NULL
1XHUSERLIMITS User Limits (in bytes except for NOFILE and NPROC) -
NULL -----------
2XHUSERLIMIT RLIMIT_FSIZE : 1073741312
2XHUSERLIMIT RLIMIT_DATA : 2147483645
2XHUSERLIMIT RLIMIT_STACK : 33554432
2XHUSERLIMIT RLIMIT_CORE : 1073741312
2XHUSERLIMIT RLIMIT_NOFILE : 1024
2XHLIMIT NPROC(max) : 128
NULL
1XHPAGESPACES Page Space (in blocks) -
NULL ----------
2XHPAGESPACE /dev/hd6: size=262144, free=261912
2XHPAGESPACE /dev/paging03: size=507904, free=507672
2XHPAGESPACE /dev/paging00: size=262144, free=261917
2XHPAGESPACE /dev/paging01: size=262144, free=261903
2XHPAGESPACE /dev/paging02: size=262144, free=261901
2XHPAGESPACE /dev/paging04: size=262144, free=260986
2XHPAGESPACE /dev/paging07: size=262144, free=261911
2XHPAGESPACE /dev/paging06: size=262144, free=261913
2XHPAGESPACE /dev/paging05: size=262144, free=261913
NULL
1XHSIGHANDLERS JVM Signal Handlers
NULL -------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHSIGHANDLERS Chained Signal Handlers
NULL -----------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHENVVARS Environment Variables
NULL ---------------------
2XHENVVAR _=/usr/java14/bin/java
2XHENVVAR JAVA_VENDOR=IBM
2XHENVVAR LANG=C
2XHENVVAR PRODUCTION_MODE=
2XHENVVAR LOGIN=qatadm
2XHENVVAR CLASSPATHSEP=:
2XHENVVAR VISUAL=vi
2XHENVVAR POINTBASE_HOME=/opt/bea/weblogic81/common/eval/pointbase
2XHENVVAR PATH=/opt/bea/weblogic81/server/bin:/usr/java14/jre/bin:/usr/java14/bin:/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/qatadm/bin:/usr/bin/X11:/sbin:.:/usr/java14/bin
2XHENVVAR JAVA_VM=
2XHENVVAR LC__FASTMSG=true
2XHENVVAR POINTBASE_CLASSPATH=:/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar
2XHENVVAR CLASSPATH=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2XHENVVAR LOGNAME=qatadm
2XHENVVAR MAIL=/usr/spool/mail/qatadm
2XHENVVAR POINTBASE_TOOLS=/opt/bea/weblogic81/common/eval/pointbase/lib/pbtools44.jar
2XHENVVAR LOCPATH=/usr/lib/nls/loc
2XHENVVAR PS1=rcirs050:$PWD>
2XHENVVAR PATHSEP=:
2XHENVVAR USER=qatadm
2XHENVVAR AUTHSTATE=compat
2XHENVVAR BEA_HOME=/opt/bea
2XHENVVAR DCE_USE_WCHAR_NAMES=1
2XHENVVAR SHELL=/usr/bin/ksh
2XHENVVAR ODMDIR=/etc/objrepos
2XHENVVAR JAVA_HOME=/usr/java14
2XHENVVAR TIMEOUT=900
2XHENVVAR TMOUT=900
2XHENVVAR HOME=/home/qatadm
2XHENVVAR MEM_ARGS=-Xms512m -Xmx1024m
2XHENVVAR WEBLOGIC_CLASSPATH=/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar
2XHENVVAR TERM=dtterm
2XHENVVAR MAILMSG=[YOU HAVE NEW MAIL]
2XHENVVAR PWD=/var/bea/domains/TazDomain
2XHENVVAR TZ=EST5EDT
2XHENVVAR WL_HOME=/opt/bea/weblogic81
2XHENVVAR AIXTHREAD_SCOPE=S
2XHENVVAR A__z=! LOGNAME="*TMOUT
2XHENVVAR _IBM_JAVA_PIPE_524292=
2XHENVVAR IBM_JVM_LIBPATH_OLD_VALUE=/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_LIBPATH_NEW_VALUE=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_CHANGED_ENVVARS_524292=LIBPATH,LDR_CNTRL
2XHENVVAR IBM_JVM_LDR_CNTRL_NEW_VALUE=MAXDATA=0XA0000000@DSA
2XHENVVAR LDR_CNTRL=MAXDATA=0XA0000000@DSA
2XHENVVAR NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
2XHENVVAR LIBPATH=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR _IBM_ENV_INITIAL_524292=805345384
2XHENVVAR IBM_JAVA_COMMAND_LINE=/usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
NULL
1XHLOADEDLIBS Loaded Libraries (sizes in bytes)
NULL ---------------------------------
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libmuxer.so
3XHLIBSIZE filesize : 20757
3XHLIBSTART text start : 0xD0B88000
3XHLIBLDSIZE text size : 0x282E
3XHLIBLDORG data start : 0xF0617CF4
3XHLIBLDDATASZ data size : 0x2AC
2XHLIBNAME /usr/java14/jre/bin/libnio.a
3XHLIBSIZE filesize : 64305
3XHLIBSTART text start : 0xD11F5000
3XHLIBLDSIZE text size : 0x8EF0
3XHLIBLDORG data start : 0xF0615AE0
3XHLIBLDDATASZ data size : 0x594
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libweblogicunix1.so
3XHLIBSIZE filesize : 14536
3XHLIBSTART text start : 0xD0B86000
3XHLIBLDSIZE text size : 0x1B90
3XHLIBLDORG data start : 0xF0614484
3XHLIBLDDATASZ data size : 0xD8
2XHLIBNAME /usr/java14/jre/bin/libnet.a
3XHLIBSIZE filesize : 137885
3XHLIBSTART text start : 0xD15D7000
3XHLIBLDSIZE text size : 0x161FF
3XHLIBLDORG data start : 0xF05DE3D8
3XHLIBLDDATASZ data size : 0x968
2XHLIBNAME /usr/java14/jre/bin/libjitc.a
3XHLIBSIZE filesize : 2814544
3XHLIBSTART text start : 0xD252E000
3XHLIBLDSIZE text size : 0x23EE7B
3XHLIBLDORG data start : 0xF0962B68
3XHLIBLDDATASZ data size : 0x1A984
2XHLIBNAME /usr/lib/security/DCE
3XHLIBSIZE filesize : 27634
3XHLIBSTART text start : 0xD0B7A000
3XHLIBLDSIZE text size : 0x6BF2
3XHLIBLDORG data start : 0xF05CEA38
3XHLIBLDDATASZ data size : 0x2BA0
2XHLIBNAME /usr/java14/jre/bin/libzip.a
3XHLIBSIZE filesize : 109746
3XHLIBSTART text start : 0xD11E1000
3XHLIBLDSIZE text size : 0x135E2
3XHLIBLDORG data start : 0xF05DC468
3XHLIBLDDATASZ data size : 0x1918
2XHLIBNAME /usr/java14/jre/bin/classic/libcore.a
3XHLIBSIZE filesize : 136713
3XHLIBSTART text start : 0xD11CB000
3XHLIBLDSIZE text size : 0x15248
3XHLIBLDORG data start : 0xF05DA0E8
3XHLIBLDDATASZ data size : 0x1620
2XHLIBNAME /usr/java14/jre/bin/libjava.a
3XHLIBSIZE filesize : 221158
3XHLIBSTART text start : 0xD11AB000
3XHLIBLDSIZE text size : 0x1FEB2
3XHLIBLDORG data start : 0xF05D88F8
3XHLIBLDDATASZ data size : 0x16F8
2XHLIBNAME /usr/java14/jre/bin/libhpi.a
3XHLIBSIZE filesize : 205732
3XHLIBSTART text start : 0xD118C000
3XHLIBLDSIZE text size : 0x1EE0E
3XHLIBLDORG data start : 0xF06045A0
3XHLIBLDDATASZ data size : 0xF8D0
2XHLIBNAME /usr/java14/jre/bin/libxhpi.a
3XHLIBSIZE filesize : 14654
3XHLIBSTART text start : 0xD0B84000
3XHLIBLDSIZE text size : 0x1B52
3XHLIBLDORG data start : 0xF05D7290
3XHLIBLDDATASZ data size : 0x2C8
2XHLIBNAME /usr/java14/jre/bin/libdbgmalloc.a
3XHLIBSIZE filesize : 15267
3XHLIBSTART text start : 0xD0B81000
3XHLIBLDSIZE text size : 0x217C
3XHLIBLDORG data start : 0xF05D6988
3XHLIBLDDATASZ data size : 0x218
2XHLIBNAME /usr/java14/jre/bin/libjsig.a
3XHLIBSIZE filesize : 14412
3XHLIBSTART text start : 0xD07F8000
3XHLIBLDSIZE text size : 0x1B24
3XHLIBLDORG data start : 0xF05D54B0
3XHLIBLDDATASZ data size : 0x108
2XHLIBNAME /usr/java14/jre/bin/libute.a
3XHLIBSIZE filesize : 112768
3XHLIBSTART text start : 0xD1177000
3XHLIBLDSIZE text size : 0x14ED9
3XHLIBLDORG data start : 0xF05D43B0
3XHLIBLDDATASZ data size : 0x674
2XHLIBNAME /usr/lib/libdl.a
3XHLIBSIZE filesize : 5248
3XHLIBSTART text start : 0xD02E70F8
3XHLIBLDSIZE text size : 0x1E0
3XHLIBLDORG data start : 0xF03190F8
3XHLIBLDDATASZ data size : 0x0
2XHLIBNAME /usr/java14/jre/bin/sovvm/libjvm.a
3XHLIBSIZE filesize : 2857303
3XHLIBSTART text start : 0xD2335000
3XHLIBLDSIZE text size : 0x1F8E31
3XHLIBLDORG data start : 0xF0936290
3XHLIBLDDATASZ data size : 0x2AE10
2XHLIBNAME /usr/java14/jre/bin/classic/libjvm.a
3XHLIBSIZE filesize : 117748
3XHLIBSTART text start : 0xD1169000
3XHLIBLDSIZE text size : 0xD54B
3XHLIBLDORG data start : 0xF05D2A90
3XHLIBLDDATASZ data size : 0xF0C
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01E7540
3XHLIBLDSIZE text size : 0x20F6D
3XHLIBLDORG data start : 0xF0381340
3XHLIBLDDATASZ data size : 0x6780
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01CDBC0
3XHLIBLDSIZE text size : 0x186CC
3XHLIBLDORG data start : 0xF0377FC0
3XHLIBLDDATASZ data size : 0x84C9
2XHLIBNAME /usr/lib/libcrypt.a
3XHLIBSIZE filesize : 11019
3XHLIBSTART text start : 0xD01450F8
3XHLIBLDSIZE text size : 0x846
3XHLIBLDORG data start : 0xF0316508
3XHLIBLDDATASZ data size : 0x128
2XHLIBNAME /usr/lib/libiconv.a
3XHLIBSIZE filesize : 377727
3XHLIBSTART text start : 0xD05BF100
3XHLIBLDSIZE text size : 0x139C1
3XHLIBLDORG data start : 0xF0252C70
3XHLIBLDDATASZ data size : 0xA2E4
2XHLIBNAME /usr/lib/libbsd.a
3XHLIBSIZE filesize : 61862
3XHLIBSTART text start : 0xD02784C0
3XHLIBLDSIZE text size : 0x7D2F
3XHLIBLDORG data start : 0xF0213A30
3XHLIBLDDATASZ data size : 0x13D8
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010E000
3XHLIBLDSIZE text size : 0x365C4
3XHLIBLDORG data start : 0xF0370000
3XHLIBLDDATASZ data size : 0x4024
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010A000
3XHLIBLDSIZE text size : 0x3C52
3XHLIBLDORG data start : 0xF032D000
3XHLIBLDDATASZ data size : 0x424A8
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01AD100
3XHLIBLDSIZE text size : 0x1FED1
3XHLIBLDORG data start : 0xF0388D00
3XHLIBLDDATASZ data size : 0x30F9
2XHLIBNAME /usr/lib/libc.a
3XHLIBSIZE filesize : 8270989
3XHLIBSTART text start : 0xD02F2240
3XHLIBLDSIZE text size : 0x251155
3XHLIBLDORG data start : 0xF0278BC0
3XHLIBLDDATASZ data size : 0x9D340
NULL
NULL ------------------------------------------------------------------------
0SECTION CI subcomponent dump routine
NULL ============================
1CIJAVAVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
1CIRUNNINGAS Running as a standalone JVM
1CICMDLINE /usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
1CIJAVAHOMEDIR Java Home Dir: /usr/java14/jre
1CIJAVADLLDIR Java DLL Dir: /usr/java14/jre/bin
1CISYSCP Sys Classpath: /usr/java14/jre/lib/core.jar:/usr/java14/jre/lib/graphics.jar:/usr/java14/jre/lib/security.jar:/usr/java14/jre/lib/server.jar:/usr/java14/jre/lib/xml.jar:/usr/java14/jre/lib/charsets.jar:/usr/java14/jre/classes:/usr/java14/jre/lib/ibmcertpathprovider.jar:/usr/java14/jre/lib/ibmjaaslm.jar:/usr/java14/jre/lib/ibmjcefw.jar:/usr/java14/jre/lib/ibmjgssprovider.jar:/usr/java14/jre/lib/ibmjssefips.jar:/usr/java14/jre/lib/ibmjsseprovider.jar:/usr/java14/jre/lib/ibmorb.jar:/usr/java14/jre/lib/ibmorbapi.jar:/usr/java14/jre/lib/ibmpkcs.jar
1CIUSERARGS UserArgs:
2CIUSERARG vfprintf 0x30000D94
2CIUSERARG -Xms512m
2CIUSERARG -Xmx1024m
2CIUSERARG -Duser.timezone=America/New_York
2CIUSERARG -Dweblogic.Name=TazServer
2CIUSERARG -Dweblogic.ProductionModeEnabled=
2CIUSERARG -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy
2CIUSERARG -Dinvokedviajava
2CIUSERARG -Djava.class.path=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2CIUSERARG vfprintf
NULL
1CIJVMMI JVM Monitoring Interface (JVMMI)
NULL ------------------------
2CIJVMMIOFF No events are enabled.
NULL
NULL ------------------------------------------------------------------------
0SECTION DC subcomponent dump routine
NULL ============================
1DCHEADEREYE Header eye catcher DCST
1DCHEADERLEN Header length 24
1DCHEADERVER Header version 1
1DCHEADERMOD Header modification 0
1DCINTERFACE DC Interface at 0xF0947FDC with 15 entries
2DCINTERFACE 1 - dcCString2JavaString 0xF0944A90
2DCINTERFACE 2 - dcInt642CString 0xF0944A9C
2DCINTERFACE 3 - dcJavaString2NewCString 0xF0944AA8
2DCINTERFACE 4 - dcJavaString2CString 0xF0944AB4
2DCINTERFACE 5 - dcJavaString2NewPlatformString 0xF0944AC0
2DCINTERFACE 6 - dcJavaString2UTF 0xF0944ACC
2DCINTERFACE 7 - dcPlatformString2JavaString 0xF0944AE4
2DCINTERFACE 8 - dcUnicode2UTF 0xF0944AF0
2DCINTERFACE 9 - dcUnicode2UTFLength 0xF0944AFC
2DCINTERFACE 10 - dcUTF2JavaString 0xF0944B08
2DCINTERFACE 11 - dcUTFClassName2JavaString 0xF0944B14
2DCINTERFACE 12 - dcJavaString2ClassName 0xF0944AD8
2DCINTERFACE 13 - dcUTF2UnicodeNext 0xF0944B20
2DCINTERFACE 14 - dcVerifyUTF8 0xF0944B2C
2DCINTERFACE 15 - dcDumpRoutine 0xF0944B38
1DCARRAYINFO Array info at 0xF09384A0 with 16 entries
2DCARRAYINFO 1 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 2 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 3 - index 2 signature L name class[] factor 4
2DCARRAYINFO 4 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 5 - index 4 signature Z name bool[] factor 1
2DCARRAYINFO 6 - index 5 signature C name char[] factor 2
2DCARRAYINFO 7 - index 6 signature F name float[] factor 4
2DCARRAYINFO 8 - index 7 signature D name double[] factor 8
2DCARRAYINFO 9 - index 8 signature B name byte[] factor 1
2DCARRAYINFO 10 - index 9 signature S name short[] factor 2
2DCARRAYINFO 11 - index 10 signature I name int[] factor 4
2DCARRAYINFO 12 - index 11 signature J name long[] factor 8
2DCARRAYINFO 13 - index 0 signature 0 name uint[] factor 0
2DCARRAYINFO 14 - index 0 signature 0 name uint1[] factor 0
2DCARRAYINFO 15 - index 0 signature 0 name uint2[] factor 0
2DCARRAYINFO 16 - index 0 signature 0 name uint3[] factor 0
NULL ------------------------------------------------------------------------
0SECTION DG subcomponent dump routine
NULL ============================
1DGTRCENABLED Trace enabled: Yes
2DGTRCTYPE Trace: Internal
2DGTRCBUFFERS Buffer specification: 8k
2DGTRCBUFALLOC Buffers allocated: 0
2DGTRCBUFUSED Buffers in use: 0
1DGJDUMPBUFF Javadump buffer size (allocated): 2621440
NULL ------------------------------------------------------------------------
0SECTION ST subcomponent dump routine
NULL ============================
1STGCMODES Resettable GC: No
1STGCMODES Concurrent GC: No
1STCURHBASE Current Heap Base: 0x300601FC
1STCURHLIM Current Heap Limit: 0x5005FBFC
1STMWHBASE Middleware Heap Base: 0x300601FC
1STMWHLIM Middleware Heap Limit: 0x5005FBFC
1STGCHELPERS Number of GC Helper Threads: 1
1STJVMOPTS -Xconcurrentlevel: 0
1STJVMOPTS -Xconcurrentbackground: 0
1STGCCTR GC Counter: 42
1STAFCTR AF Counter: 42
1STHEAPFREE Bytes of Heap Space Free: 190d3b88
1STHEAPALLOC Bytes of Heap Space Allocated: 1ffffa00
1STSMBASE SM Base: 0x0
1STSMEND SM End: 0x0
1STPAMSTART PAM Start: 0x0
1STPAMEND PAM End: 0x0
1STCOMACTION Compact Action: 0
NULL ------------------------------------------------------------------------
0SECTION XE subcomponent dump routine
NULL ============================
1XETHRESHOLD MMI threshold for java methods is set to 1250
1XEJITINIT JIT is initialized
1XEJVMPIOFF JVMPI is not activated
1XEJNITHRESH MMI threshold for JNI methods is set to 0
1XETRCHIS Trace history length is set to 4
1XEJITDUMP JIT dump routine is not yet implemented.
NULL ------------------------------------------------------------------------
0SECTION LK subcomponent dump routine
NULL ============================
NULL
1LKPOOLINFO Monitor pool info:
2LKPOOLINIT Initial monitor count: 32
2LKPOOLEXPNUM Minimum number of free monitors before expansion: 5
2LKPOOLEXPBY Pool will next be expanded by: 81
2LKPOOLTOTAL Current total number of monitors: 162
2LKPOOLFREE Current number of free monitors: 42
NULL
1LKMONPOOLDUMP Monitor Pool Dump (flat & inflated object-monitors):
2LKMONINUSE sys_mon_t:0x3003EC78 infl_mon_t: 0x3003E6E8:
3LKMONOBJECT java.lang.ref.Reference$Lock@300E02B0/300E02B8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Reference Handler" (0x744B7D28)
2LKMONINUSE sys_mon_t:0x3003ED28 infl_mon_t: 0x3003E714:
3LKMONOBJECT java.lang.ref.ReferenceQueue$Lock@300DFFE8/300DFFF0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Finalizer" (0x745409A8)
2LKMONINUSE sys_mon_t:0x3003EDD8 infl_mon_t: 0x3003E740:
3LKMONOBJECT java.util.TaskQueue@311299D0/311299D8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-1" (0x75F054A8)
2LKMONINUSE sys_mon_t:0x3003EE88 infl_mon_t: 0x3003E76C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9A60/300C9A68: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" (0x765659A8)
2LKMONINUSE sys_mon_t:0x3003EF38 infl_mon_t: 0x3003E798:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C99C0/300C99C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" (0x765693A8)
2LKMONINUSE sys_mon_t:0x3003EFE8 infl_mon_t: 0x3003E7C4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9920/300C9928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" (0x76569928)
2LKMONINUSE sys_mon_t:0x3003F098 infl_mon_t: 0x3003E7F0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9880/300C9888: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" (0x76572BA8)
2LKMONINUSE sys_mon_t:0x3003F148 infl_mon_t: 0x3003E81C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C97E0/300C97E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" (0x767971A8)
2LKMONINUSE sys_mon_t:0x3003F1F8 infl_mon_t: 0x3003E848:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9740/300C9748: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" (0x7681EBA8)
2LKMONINUSE sys_mon_t:0x3003F2A8 infl_mon_t: 0x3003E874:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C96A0/300C96A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" (0x768A65A8)
2LKMONINUSE sys_mon_t:0x3003F358 infl_mon_t: 0x3003E8A0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9600/300C9608: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" (0x7692E028)
2LKMONINUSE sys_mon_t:0x3003F408 infl_mon_t: 0x3003E8CC:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9560/300C9568: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" (0x769B5A28)
2LKMONINUSE sys_mon_t:0x3003F4B8 infl_mon_t: 0x3003E8F8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C94C0/300C94C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" (0x76A3D4A8)
2LKMONINUSE sys_mon_t:0x3003F568 infl_mon_t: 0x3003E924:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9420/300C9428: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" (0x76AC4EA8)
2LKMONINUSE sys_mon_t:0x3003F618 infl_mon_t: 0x3003E950:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9380/300C9388: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" (0x76B4C8A8)
2LKMONINUSE sys_mon_t:0x3003F6C8 infl_mon_t: 0x3003E97C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C92E0/300C92E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" (0x76BD4328)
2LKMONINUSE sys_mon_t:0x3003F778 infl_mon_t: 0x3003E9A8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9240/300C9248: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" (0x76C5BD28)
2LKMONINUSE sys_mon_t:0x3003F828 infl_mon_t: 0x3003E9D4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C91A0/300C91A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" (0x76CE3728)
2LKMONINUSE sys_mon_t:0x3003F988 infl_mon_t: 0x3003EA2C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9060/300C9068: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" (0x76DF2BA8)
2LKMONINUSE sys_mon_t:0x3003FA38 infl_mon_t: 0x3003EA58:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8FC0/300C8FC8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" (0x76E7A628)
2LKMONINUSE sys_mon_t:0x3003FAE8 infl_mon_t: 0x3003EA84:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8F20/300C8F28: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" (0x76F02028)
2LKMONINUSE sys_mon_t:0x3003FB98 infl_mon_t: 0x3003EAB0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8E80/300C8E88: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" (0x76F89A28)
2LKMONINUSE sys_mon_t:0x3003FC48 infl_mon_t: 0x3003EADC:
3LKMONOBJECT weblogic.time.common.internal.TimeTable@32EB9198/32EB91A0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.time.TimeEventGenerator" (0x77013D28)
2LKMONINUSE sys_mon_t:0x3003FCF8 infl_mon_t: 0x3003EB08:
3LKMONOBJECT java.lang.Object@32F56538/32F56540: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.security.SpinnerRandomSource" (0x770CC3A8)
2LKMONINUSE sys_mon_t:0x3003FDA8 infl_mon_t: 0x3003EB34:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8CD0/300C8CD8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" (0x770E4428)
2LKMONINUSE sys_mon_t:0x3003FE58 infl_mon_t: 0x3003EB60:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8C30/300C8C38: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" (0x770E4A28)
2LKMONINUSE sys_mon_t:0x3003FF08 infl_mon_t: 0x3003EB8C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8B90/300C8B98: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" (0x770E5028)
2LKMONINUSE sys_mon_t:0x770E3D38 infl_mon_t: 0x770F13D8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8AF0/300C8AF8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" (0x770F1028)
2LKMONINUSE sys_mon_t:0x770E3DE8 infl_mon_t: 0x770F1404:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8A50/300C8A58: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" (0x770F84A8)
2LKMONINUSE sys_mon_t:0x770E3E98 infl_mon_t: 0x770F1430:
3LKMONOBJECT [email protected]0/300C8928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "VDE Transaction Processor Thread" (0x77531828)
2LKMONINUSE sys_mon_t:0x770F1758 infl_mon_t: 0x770F1488:
3LKMONOBJECT java.util.TaskQueue@30EECD38/30EECD40: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-5" (0x75CCD1A8)
2LKMONINUSE sys_mon_t:0x770F2F88 infl_mon_t: 0x770F1538:
3LKMONOBJECT weblogic.jms.backend.BETimerTree@33C6CFE0/33C6CFE8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" (0x7893DD28)
2LKMONINUSE sys_mon_t:0x770F3038 infl_mon_t: 0x770F1564:
3LKMONOBJECT java.util.TaskQueue@34F10870/34F10878: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-7" (0x78DE09A8)
2LKMONINUSE sys_mon_t:0x770F30E8 infl_mon_t: 0x770F1590:
3LKMONOBJECT java.util.TaskQueue@3C4CB120/3C4CB128: <unowned>
3LKNOTIFYQ Waiting to be notifie -
Weblogic Server hanging at high load!!!!!!!!!!!
Folks,
We have a weblogic server 9.2 which is running fine but after quiet a while at high load we observe that the server goes down and following exception is displayed in the server logs:
####<Nov 13, 2009 2:42:48 AM EST> <Error> <WebLogicServer> <ibmrxcptpnp-wb1> <AdminServer> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1258098168215> <BEA-000337> <[STUCK] ExecuteThread: '9' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "617" seconds working on the request "weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl@1cec1cec", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
java.net.SocketOutputStream.socketWrite0(Native Method)
java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:105)
java.net.SocketOutputStream.write(SocketOutputStream.java:149)
oracle.net.ns.DataPacket.send(Unknown Source)
oracle.net.ns.NetOutputStream.flush(Unknown Source)
oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1099)
oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1070)
oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:478)
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216)
oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:955)
oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1060)
oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:839)
oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1132)
oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3316)
oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3422)
weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:718)
weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:460)
weblogic.common.resourcepool.ResourcePoolImpl.checkResource(ResourcePoolImpl.java:1455)
weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1372)
weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1362)
weblogic.common.resourcepool.ResourcePoolImpl.testUnusedResources(ResourcePoolImpl.java:1767)
weblogic.common.resourcepool.ResourcePoolImpl.access$700(ResourcePoolImpl.java:37)
weblogic.common.resourcepool.ResourcePoolImpl$ResourcePoolMaintanenceTask.timerExpired(ResourcePoolImpl.java:1935)
weblogic.timers.internal.TimerImpl.run(TimerImpl.java:265)
weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl.run(ServerWorkManagerImpl.java:518)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
>
Any answers?????Hi,
I have a similar issue on ODSI 10gR3 (WLS 10.3). I am having stuck threads - but, in my case it is clear that the database is down (not at the startup)
Here is some more info:
1. Test Connections On Reserve - Enabled
2. Default values for other parameters
Using Oracle thin driver for the connection pool "MyPool" -
./wlserver_10.3/server/lib/ojdbc6.jar
My question is:
1. How do I avoid the stuck thread caused when the database is down? During peak load, the stuck threads are causing some service requests to fail.
I did my homework and the closest option I could find is set the statementTimeout (which is set currently to the default value of -1 i.e. never timeout). Oracle documentation (http://www.oracle.com/technology/software/tech/java/sqlj_jdbc/htdocs/111070_readme.html) says that the ojdbc6.jar supports setQueryTimeout() method.
Is there any better way to attack this problem?
<Dec 21, 2009 12:11:18 AM EST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "MyPool" failed with exception: "java.sql.SQLRecoverableException: Io exception: Read failed: Connection timed out".>
<Dec 21, 2009 12:14:27 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:18:38 AM EST> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "600" seconds working on the request "weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl@297ac2b", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-52 "[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, waiting, priority=1, DAEMON> {
-- Waiting for notification on: javax.management.remote.rmi.RMIConnector$RMINotifClient@271498f[fat lock]
java.lang.Object.wait(Object.java:485)
com.sun.jmx.remote.internal.ClientNotifForwarder.postReconnection(ClientNotifForwarder.java:304)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.reconnectNotificationListeners(RMIConnector.java:1488)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.doStart(RMIConnector.java:1568)
com.sun.jmx.remote.internal.ClientCommunicatorAdmin.restart(ClientCommunicatorAdmin.java:72)
com.sun.jmx.remote.internal.ClientCommunicatorAdmin.gotIOException(ClientCommunicatorAdmin.java:34)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.gotIOException(RMIConnector.java:1420)
javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getAttribute(RMIConnector.java:857)
weblogic.management.mbeanservers.domainruntime.internal.ManagedMBeanServerConnection.getAttribute(ManagedMBeanServerConnection.java:288)
javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:235)
weblogic.management.jmx.MBeanServerInvocationHandler.doInvoke(MBeanServerInvocationHandler.java:477)
weblogic.management.jmx.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:294)
$Proxy69.getServerRuntime(Unknown Source)
weblogic.management.mbeanservers.domainruntime.internal.DomainRuntimeServiceMBeanImpl.lookupServerRuntime(DomainRuntimeServiceMBeanImpl.java:242)
sun.reflect.GeneratedMethodAccessor1880.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
weblogic.management.jmx.modelmbean.WLSModelMBean.invoke(WLSModelMBean.java:355)
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:831)
com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
weblogic.management.mbeanservers.domainruntime.internal.FederatedMBeanServerInterceptor.invoke(FederatedMBeanServerInterceptor.java:255)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:447)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:441)
weblogic.management.mbeanservers.internal.SecurityMBeanMgmtOpsInterceptor.invoke(SecurityMBeanMgmtOpsInterceptor.java:55)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:447)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:441)
weblogic.management.mbeanservers.internal.SecurityInterceptor.invoke(SecurityInterceptor.java:437)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor$10$1.run(AuthenticatedSubjectInterceptor.java:582)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor$10.run(AuthenticatedSubjectInterceptor.java:576)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:350)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor.invoke(AuthenticatedSubjectInterceptor.java:570)
weblogic.management.jmx.mbeanserver.WLSMBeanServer.invoke(WLSMBeanServer.java:305)
javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1378)
javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1264)
javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1338)
javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:761)
javax.management.remote.rmi.RMIConnectionImpl_WLSkel.invoke(Unknown Source)
weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:136)
weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:211)
javax.management.remote.rmi.RMIConnectionImpl_1030_WLStub.invoke(Unknown Source)
javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:969)
com.bea.diagnostics.server.MBeanServerUtil.processRecordsFromArchive(MBeanServerUtil.java:177)
com.bea.diagnostics.server.MetricEarliestTimestampLocator$RecordProcessorDesc.identifyEarliestTimestamps(MetricEarliestTimestampLocator.java:261)
com.bea.diagnostics.server.MetricEarliestTimestampLocator.identifyEarliestTimestamps(MetricEarliestTimestampLocator.java:84)
com.bea.diagnostics.server.MetricEarliestTimestampLocator.timerExpired(MetricEarliestTimestampLocator.java:79)
weblogic.timers.internal.TimerImpl.run(TimerImpl.java:253)
weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:516)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:198)
weblogic.work.ExecuteThread.run(ExecuteThread.java:165)
<Dec 21, 2009 12:24:04 AM EST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "MyPool" failed with exception: "java.sql.SQLRecoverableException: Io exception: Connection reset".>
<Dec 21, 2009 12:24:04 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:04 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:05 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:07 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:12 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:17 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:22 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection> -
Weblogic Server 5.1 Hangs. Any Ideas?
I realize this must seem a tedious and out-of-date topic but we are still on 5.1 so...
We have a large application that will be going along fine for several hours or even days and then mysteriously just lock up. It can usually be resuscitated using kill -3. I have pasted in the thread dump below, and I can supply numerous more thread dumps if you are interested. Here are the particulars, first:
Weblogic Server 5.1 running SP 12
Running Java 1.3.1_10
Running on Dell Xeon servers (1650/2650) with a lot of RAM and running RedHat Linux (v. 9)
Talking to Oracle 9i database (9.2.0.4) using both the latest (9.2.0.5) and older (9.0.x) Oracle JDBC driver
We have examined every option we could find based on earlier postings, including adjusting the weblogic.system.executeThreadCount to match the # of JDBC connections (saw that somehwere) and also increasing the # in weblogic.system.jmsThreadCount above the default of zero.
It doesn't crash all the time, but just eliminating these once in a blue moon situations would be desirable.
27 Sep 2004 15:00:20,594 | DEBUG | log | AtmQueueAction | doGetData | [ExecuteThread-23] | no page in req params
Full thread dump:
"process forker" daemon prio=1 tid=0x8566ed8 nid=0x32c1 waiting on monitor [0xa4f7f000..0xa4f7fd3c]
at java.lang.Object.wait(Native Method)
at java.lang.UNIXProcessForker.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"process reaper" daemon prio=1 tid=0x826f610 nid=0x32c1 runnable [0xa477f000..0xa477fdbc]
at java.lang.UNIXProcessReaper.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"HighPriority TimeEventGenerator" daemon prio=1 tid=0x8283270 nid=0x32c1 waiting on monitor [0xa25fe000..0xa25feebc]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
at java.lang.Thread.run(Thread.java:479)
"ListenThread" prio=1 tid=0xa2ba2108 nid=0x32c1 waiting for monitor entry [0xa3f7f000..0xa3f7fe3c]
at java.net.InetAddress.getHostAddress(InetAddress.java:217)
at java.net.ServerSocket.implAccept(ServerSocket.java:242)
at java.net.ServerSocket.accept(ServerSocket.java:217)
at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
"NBExecuteThread-1" daemon prio=1 tid=0x8e516c80 nid=0x32c1 waiting on monitor [0xa1dfe000..0xa1dfef3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"NBExecuteThread-0" daemon prio=1 tid=0x8e5169f0 nid=0x32c1 waiting on monitor [0xa15fe000..0xa15fefbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-34" daemon prio=1 tid=0x8e515f60 nid=0x32c1 waiting for monitor entry [0xa0dfe000..0xa0dff03c]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-33" daemon prio=1 tid=0x8e5154d0 nid=0x32c1 waiting for monitor entry [0xa05fe000..0xa05ff0bc]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-32" daemon prio=1 tid=0x8e514a40 nid=0x32c1 waiting for monitor entry [0x9fdfe000..0x9fdff13c]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-31" daemon prio=1 tid=0x8e513fb0 nid=0x32c1 waiting on monitor [0x9f5ff000..0x9f5ff1bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-30" daemon prio=1 tid=0x8e513520 nid=0x32c1 waiting on monitor [0x9edff000..0x9edff23c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-29" daemon prio=1 tid=0x8e512a90 nid=0x32c1 waiting for monitor entry [0x9e5ff000..0x9e5ff2bc]
at weblogic.rmi.internal.DGCClientHelper.getHeartBeats(DGCClientHelper.java:39)
at weblogic.rmi.internal.DGCClientImpl.mark(DGCClientImpl.java:159)
at weblogic.rmi.internal.DGCClientImpl.trigger(DGCClientImpl.java:145)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-28" daemon prio=1 tid=0x8e512000 nid=0x32c1 waiting on monitor [0x9ddff000..0x9ddff33c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-27" daemon prio=1 tid=0x8e511570 nid=0x32c1 waiting on monitor [0x9d5ff000..0x9d5ff3bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-26" daemon prio=1 tid=0x8e510ae0 nid=0x32c1 waiting for monitor entry [0x9cdff000..0x9cdff43c]
at weblogic.jms.server.JDBCStore.getConnectionNoTx(JDBCStore.java:1381)
at weblogic.jms.server.JDBCStore.purgeMessages(JDBCStore.java:1248)
at weblogic.jms.server.JDBCStore.trigger(JDBCStore.java:975)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-25" daemon prio=1 tid=0x8e510050 nid=0x32c1 waiting for monitor entry [0x9c5fe000..0x9c5ff4bc]
at oracle.net.ns.Packet.createBuffer(Unknown Source)
at oracle.net.ns.Packet.receive(Unknown Source)
at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:733)
at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:705)
at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1477)
at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteDescribe(TTC7Protocol.java:677)
at oracle.jdbc.driver.OracleStatement.doExecuteQuery(OracleStatement.java:2311)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2554)
at oracle.jdbc.driver.OraclePreparedStatement.doScrollPstmtExecuteUpdate(OraclePreparedStatement.java:3815)
at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:486)
at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:382)
at weblogic.jdbc20.pool.PreparedStatement.executeQuery(PreparedStatement.java:35)
at weblogic.jdbc20.rmi.internal.PreparedStatementImpl.executeQuery(PreparedStatementImpl.java:46)
at weblogic.jdbc20.rmi.SerialPreparedStatement.executeQuery(SerialPreparedStatement.java:40)
at com.solbright.ui.XsuQueueAccessor.createOracleXMLQuery(XsuQueueAccessor.java:35)
at com.solbright.ui.XsuQueueAccessor.<init>(XsuQueueAccessor.java:25)
at com.solbright.adtraffic.AtmPersistentQueueAccessor.<init>(AtmPersistentQueueAccessor.java:65)
at com.solbright.adtraffic.servlet.AtmQueueFrame.createNewQueueAccessor(AtmQueueFrame.java:113)
at com.solbright.adtraffic.servlet.AtmQueueFrame.doGetData(AtmQueueFrame.java:27)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:294)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-24" daemon prio=1 tid=0x8e50f5c0 nid=0x32c1 waiting on monitor [0x9bdff000..0x9bdff53c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-23" daemon prio=1 tid=0x8e50eb30 nid=0x32c1 waiting for monitor entry [0x9b5fe000..0x9b5ff5bc]
at java.lang.StringBuffer.expandCapacity(StringBuffer.java:197)
at java.lang.StringBuffer.append(StringBuffer.java:396)
at java.io.StringWriter.write(StringWriter.java:89)
at java.io.PrintWriter.newLine(PrintWriter.java:231)
at java.io.PrintWriter.println(PrintWriter.java:382)
at java.io.PrintWriter.println(PrintWriter.java:479)
at java.lang.Throwable.printStackTrace0(Native Method)
at java.lang.Throwable.printStackTrace(Throwable.java:204)
at org.log4j.LoggingEvent$LocationInfo.<init>(LoggingEvent.java:193)
at org.log4j.LoggingEvent.setLocationInformation(LoggingEvent.java:125)
at org.log4j.helpers.PatternParser$ClassNamePatternConverter.getFullyQualifiedName(PatternParser.java:474)
at org.log4j.helpers.PatternParser$NamedPatternConverter.convert(PatternParser.java:447)
at org.log4j.helpers.PatternConverter.format(PatternConverter.java:48)
at org.log4j.PatternLayout.format(PatternLayout.java:430)
at org.log4j.FileAppender.doAppend(FileAppender.java:202)
at org.log4j.Category.callAppenders(Category.java:147)
at org.log4j.Category.debug(Category.java:194)
at com.solbright.adtraffic.servlet.AtmQueueAction.doGetData(AtmQueueAction.java:36)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:294)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-22" daemon prio=1 tid=0x8e50e0a0 nid=0x32c1 waiting on monitor [0x9adff000..0x9adff63c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-21" daemon prio=1 tid=0x8e50d610 nid=0x32c1 waiting for monitor entry [0x9a5ff000..0x9a5ff6bc]
at java.lang.Object.clone(Native Method)
at java.util.Hashtable.clone(Hashtable.java:471)
at weblogic.t3.srvr.Scavenger.trigger(Scavenger.java:83)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-20" daemon prio=1 tid=0x8e50cb80 nid=0x32c1 waiting for monitor entry [0x99dfe000..0x99dfe73c]
at java.lang.Object.clone(Native Method)
at weblogic.utils.collections.NumericHashtable.clone(NumericHashtable.java:267)
at weblogic.socket.PosixSocketMuxer.trigger(PosixSocketMuxer.java:153)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-19" daemon prio=1 tid=0x8e50c0f0 nid=0x32c1 waiting on monitor [0x995fe000..0x995fe7bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-18" daemon prio=1 tid=0x8e50b660 nid=0x32c1 waiting on monitor [0x98dfe000..0x98dfe83c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-17" daemon prio=1 tid=0x8e50abd0 nid=0x32c1 waiting on monitor [0x985fe000..0x985fe8bc]
at java.util.HashMap.put(HashMap.java:351)
at org.jdom.transform.JDOMSource$DocumentReader.<init>(JDOMSource.java:436)
at org.jdom.transform.JDOMSource.getXMLReader(JDOMSource.java:224)
at org.apache.xalan.transformer.TransformerImpl.transform(TransformerImpl.java:531)
at org.apache.xalan.transformer.TransformerImpl.transform(TransformerImpl.java:1174)
at com.solbright.ui.UiXslTransformer.transform(UiXslTransformer.java:39)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doShowViewImpl(AdSuiteMediatorServlet.java:419)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doShowView(AdSuiteMediatorServlet.java:394)
at com.solbright.adtraffic.servlet.AdTrafficMediatorServlet.doShowView(AdTrafficMediatorServlet.java:80)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:307)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-16" daemon prio=1 tid=0x8e50a140 nid=0x32c1 waiting on monitor [0x97dfe000..0x97dfe93c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-15" daemon prio=1 tid=0x8e5096b0 nid=0x32c1 waiting on monitor [0x975fe000..0x975fe9bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-14" daemon prio=1 tid=0x8e508c20 nid=0x32c1 waiting on monitor [0x96dfe000..0x96dfea3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-13" daemon prio=1 tid=0x8e508190 nid=0x32c1 waiting on monitor [0x965fe000..0x965feabc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-12" daemon prio=1 tid=0x8e507700 nid=0x32c1 waiting for monitor entry [0x95dfe000..0x95dfeb3c]
at weblogic.utils.KeyTable.elements(KeyTable.java:79)
at weblogic.utils.SyncKeyTable.elements(SyncKeyTable.java:25)
at weblogic.rmi.internal.OIDManager.sweep(OIDManager.java:334)
at weblogic.rmi.internal.DGCServerImpl.trigger(DGCServerImpl.java:131)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-11" daemon prio=1 tid=0x8e506c70 nid=0x32c1 waiting on monitor [0x955fe000..0x955febbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-10" daemon prio=1 tid=0x8e506218 nid=0x32c1 waiting for monitor entry [0x94dfe000..0x94dfec3c]
at java.util.Hashtable.getEnumeration(Hashtable.java:520)
at java.util.Hashtable.keys(Hashtable.java:215)
at weblogic.servlet.internal.session.MemorySessionContextImpl.getIds(MemorySessionContextImpl.java:21)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.invalidateSessions(SessionContext.java:508)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.trigger(SessionContext.java:491)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-9" daemon prio=1 tid=0x8e503b10 nid=0x32c1 waiting for monitor entry [0x945fe000..0x945fecbc]
at java.lang.Class.newInstance0(Native Method)
at java.lang.Class.newInstance(Class.java:232)
at sun.io.Converters.newConverter(Converters.java:115)
at sun.io.Converters.newDefaultConverter(Converters.java:206)
at sun.io.CharToByteConverter.getDefault(CharToByteConverter.java:50)
at java.lang.String.getBytes(String.java:751)
at java.io.UnixFileSystem.list(Native Method)
at java.io.File.list(File.java:769)
at weblogic.ejb.internal.StatefulSessionSweeper.trigger(StatefulSessionSweeper.java:65)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-8" daemon prio=1 tid=0x8e503178 nid=0x32c1 waiting on monitor [0x93dfe000..0x93dfed3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-7" daemon prio=1 tid=0x8e500ed8 nid=0x32c1 waiting on monitor [0x935fe000..0x935fedbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-6" daemon prio=1 tid=0x8e505330 nid=0x32c1 waiting on monitor [0x92dfe000..0x92dfee3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-5" daemon prio=1 tid=0x8e504dc0 nid=0x32c1 waiting on monitor [0x925fe000..0x925feebc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-4" daemon prio=1 tid=0x8e504b98 nid=0x32c1 waiting on monitor [0x91dfe000..0x91dfef3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-3" daemon prio=1 tid=0x8e5049a0 nid=0x32c1 waiting on monitor [0x915fe000..0x915fefbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-2" daemon prio=1 tid=0x8e5016e0 nid=0x32c1 waiting on monitor [0x90dfe000..0x90dff03c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-1" daemon prio=1 tid=0x8e502358 nid=0x32c1 waiting on monitor [0x905fe000..0x905ff0bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-0" daemon prio=1 tid=0x8e502190 nid=0x32c1 waiting on monitor [0x8fdff000..0x8fdff13c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"TimeEventGenerator" daemon prio=1 tid=0x8e5057a8 nid=0x32c1 waiting on monitor [0x8f5ff000..0x8f5ff1bc]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
at java.lang.Thread.run(Thread.java:479)
"SpinnerRandomSource" daemon prio=1 tid=0x8e501f48 nid=0x32c1 waiting on monitor [0x8edff000..0x8edff23c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:104)
at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
"Signal Dispatcher" daemon prio=1 tid=0x80bb128 nid=0x32c1 waiting on monitor [0..0]
"Finalizer" daemon prio=1 tid=0x80b42c0 nid=0x32c1 waiting on monitor [0x8993f000..0x8993f53c]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
"Reference Handler" daemon prio=1 tid=0x80b3f98 nid=0x32c1 waiting on monitor [0x8913f000..0x8913f5bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:105)
"main" prio=1 tid=0x804eab0 nid=0x32c1 waiting on monitor [0xbfffb000..0xbfffbb04]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1958)
at java.lang.reflect.Method.invoke(Native Method)
at weblogic.Server.startServerDynamically(Server.java:148)
at weblogic.Server.main(Server.java:97)
at weblogic.Server.main(Server.java:58)
"VM Thread" prio=1 tid=0x80b3710 nid=0x32c1 runnable
"VM Periodic Task Thread" prio=1 tid=0x80b9e10 nid=0x32c1 waiting on monitor
"Suspend Checker Thread" prio=1 tid=0x80ba728 nid=0x32c1 runnableWarren,
If your server process exceeds maximum allowed number of open file handles,
you may see something like that. Try to run netstat/lsof to check if there are
runaway filehandles. If it's the case, set ulimit - n 4096 from your weblogic
startup script.
Regards,
Slava Imeshev
"Warren L. Habib" <[email protected]> wrote in message news:11980943.1096314065390.JavaMail.root@jserv5...
I realize this must seem a tedious and out-of-date topic but we are still on 5.1 so...
We have a large application that will be going along fine for several hours or even days and then mysteriously just lock up. Itcan usually be resuscitated using kill -3. I have pasted in the thread dump below, and I can supply numerous more thread dumps if
you are interested. Here are the particulars, first:
>
Weblogic Server 5.1 running SP 12
Running Java 1.3.1_10
Running on Dell Xeon servers (1650/2650) with a lot of RAM and running RedHat Linux (v. 9)
Talking to Oracle 9i database (9.2.0.4) using both the latest (9.2.0.5) and older (9.0.x) Oracle JDBC driver
We have examined every option we could find based on earlier postings, including adjusting the weblogic.system.executeThreadCountto match the # of JDBC connections (saw that somehwere) and also increasing the # in weblogic.system.jmsThreadCount above the
default of zero.
>
It doesn't crash all the time, but just eliminating these once in a blue moon situations would be desirable.
27 Sep 2004 15:00:20,594 | DEBUG | log | AtmQueueAction | doGetData | [ExecuteThread-23] | no page in req params
Full thread dump:
"process forker" daemon prio=1 tid=0x8566ed8 nid=0x32c1 waiting on monitor [0xa4f7f000..0xa4f7fd3c]
at java.lang.Object.wait(Native Method)
at java.lang.UNIXProcessForker.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"process reaper" daemon prio=1 tid=0x826f610 nid=0x32c1 runnable [0xa477f000..0xa477fdbc]
at java.lang.UNIXProcessReaper.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"HighPriority TimeEventGenerator" daemon prio=1 tid=0x8283270 nid=0x32c1 waiting on monitor [0xa25fe000..0xa25feebc]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
at java.lang.Thread.run(Thread.java:479)
"ListenThread" prio=1 tid=0xa2ba2108 nid=0x32c1 waiting for monitor entry [0xa3f7f000..0xa3f7fe3c]
at java.net.InetAddress.getHostAddress(InetAddress.java:217)
at java.net.ServerSocket.implAccept(ServerSocket.java:242)
at java.net.ServerSocket.accept(ServerSocket.java:217)
at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
"NBExecuteThread-1" daemon prio=1 tid=0x8e516c80 nid=0x32c1 waiting on monitor [0xa1dfe000..0xa1dfef3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"NBExecuteThread-0" daemon prio=1 tid=0x8e5169f0 nid=0x32c1 waiting on monitor [0xa15fe000..0xa15fefbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-34" daemon prio=1 tid=0x8e515f60 nid=0x32c1 waiting for monitor entry [0xa0dfe000..0xa0dff03c]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-33" daemon prio=1 tid=0x8e5154d0 nid=0x32c1 waiting for monitor entry [0xa05fe000..0xa05ff0bc]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-32" daemon prio=1 tid=0x8e514a40 nid=0x32c1 waiting for monitor entry [0x9fdfe000..0x9fdff13c]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-31" daemon prio=1 tid=0x8e513fb0 nid=0x32c1 waiting on monitor [0x9f5ff000..0x9f5ff1bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-30" daemon prio=1 tid=0x8e513520 nid=0x32c1 waiting on monitor [0x9edff000..0x9edff23c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-29" daemon prio=1 tid=0x8e512a90 nid=0x32c1 waiting for monitor entry [0x9e5ff000..0x9e5ff2bc]
at weblogic.rmi.internal.DGCClientHelper.getHeartBeats(DGCClientHelper.java:39)
at weblogic.rmi.internal.DGCClientImpl.mark(DGCClientImpl.java:159)
at weblogic.rmi.internal.DGCClientImpl.trigger(DGCClientImpl.java:145)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-28" daemon prio=1 tid=0x8e512000 nid=0x32c1 waiting on monitor [0x9ddff000..0x9ddff33c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-27" daemon prio=1 tid=0x8e511570 nid=0x32c1 waiting on monitor [0x9d5ff000..0x9d5ff3bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-26" daemon prio=1 tid=0x8e510ae0 nid=0x32c1 waiting for monitor entry [0x9cdff000..0x9cdff43c]
at weblogic.jms.server.JDBCStore.getConnectionNoTx(JDBCStore.java:1381)
at weblogic.jms.server.JDBCStore.purgeMessages(JDBCStore.java:1248)
at weblogic.jms.server.JDBCStore.trigger(JDBCStore.java:975)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-25" daemon prio=1 tid=0x8e510050 nid=0x32c1 waiting for monitor entry [0x9c5fe000..0x9c5ff4bc]
at oracle.net.ns.Packet.createBuffer(Unknown Source)
at oracle.net.ns.Packet.receive(Unknown Source)
at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:733)
at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:705)
at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1477)
at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteDescribe(TTC7Protocol.java:677)
at oracle.jdbc.driver.OracleStatement.doExecuteQuery(OracleStatement.java:2311)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2554)
at oracle.jdbc.driver.OraclePreparedStatement.doScrollPstmtExecuteUpdate(OraclePreparedStatement.java:3815)
at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:486)
at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:382)
at weblogic.jdbc20.pool.PreparedStatement.executeQuery(PreparedStatement.java:35)
at weblogic.jdbc20.rmi.internal.PreparedStatementImpl.executeQuery(PreparedStatementImpl.java:46)
at weblogic.jdbc20.rmi.SerialPreparedStatement.executeQuery(SerialPreparedStatement.java:40)
at com.solbright.ui.XsuQueueAccessor.createOracleXMLQuery(XsuQueueAccessor.java:35)
at com.solbright.ui.XsuQueueAccessor.<init>(XsuQueueAccessor.java:25)
at com.solbright.adtraffic.AtmPersistentQueueAccessor.<init>(AtmPersistentQueueAccessor.java:65)
at com.solbright.adtraffic.servlet.AtmQueueFrame.createNewQueueAccessor(AtmQueueFrame.java:113)
at com.solbright.adtraffic.servlet.AtmQueueFrame.doGetData(AtmQueueFrame.java:27)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:294)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-24" daemon prio=1 tid=0x8e50f5c0 nid=0x32c1 waiting on monitor [0x9bdff000..0x9bdff53c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-23" daemon prio=1 tid=0x8e50eb30 nid=0x32c1 waiting for monitor entry [0x9b5fe000..0x9b5ff5bc]
at java.lang.StringBuffer.expandCapacity(StringBuffer.java:197)
at java.lang.StringBuffer.append(StringBuffer.java:396)
at java.io.StringWriter.write(StringWriter.java:89)
at java.io.PrintWriter.newLine(PrintWriter.java:231)
at java.io.PrintWriter.println(PrintWriter.java:382)
at java.io.PrintWriter.println(PrintWriter.java:479)
at java.lang.Throwable.printStackTrace0(Native Method)
at java.lang.Throwable.printStackTrace(Throwable.java:204)
at org.log4j.LoggingEvent$LocationInfo.<init>(LoggingEvent.java:193)
at org.log4j.LoggingEvent.setLocationInformation(LoggingEvent.java:125)
at org.log4j.helpers.PatternParser$ClassNamePatternConverter.getFullyQualifiedName(PatternParser.java:474)
at org.log4j.helpers.PatternParser$NamedPatternConverter.convert(PatternParser.java:447)
at org.log4j.helpers.PatternConverter.format(PatternConverter.java:48)
at org.log4j.PatternLayout.format(PatternLayout.java:430)
at org.log4j.FileAppender.doAppend(FileAppender.java:202)
at org.log4j.Category.callAppenders(Category.java:147)
at org.log4j.Category.debug(Category.java:194)
at com.solbright.adtraffic.servlet.AtmQueueAction.doGetData(AtmQueueAction.java:36)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:294)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-22" daemon prio=1 tid=0x8e50e0a0 nid=0x32c1 waiting on monitor [0x9adff000..0x9adff63c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-21" daemon prio=1 tid=0x8e50d610 nid=0x32c1 waiting for monitor entry [0x9a5ff000..0x9a5ff6bc]
at java.lang.Object.clone(Native Method)
at java.util.Hashtable.clone(Hashtable.java:471)
at weblogic.t3.srvr.Scavenger.trigger(Scavenger.java:83)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-20" daemon prio=1 tid=0x8e50cb80 nid=0x32c1 waiting for monitor entry [0x99dfe000..0x99dfe73c]
at java.lang.Object.clone(Native Method)
at weblogic.utils.collections.NumericHashtable.clone(NumericHashtable.java:267)
at weblogic.socket.PosixSocketMuxer.trigger(PosixSocketMuxer.java:153)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-19" daemon prio=1 tid=0x8e50c0f0 nid=0x32c1 waiting on monitor [0x995fe000..0x995fe7bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-18" daemon prio=1 tid=0x8e50b660 nid=0x32c1 waiting on monitor [0x98dfe000..0x98dfe83c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-17" daemon prio=1 tid=0x8e50abd0 nid=0x32c1 waiting on monitor [0x985fe000..0x985fe8bc]
at java.util.HashMap.put(HashMap.java:351)
at org.jdom.transform.JDOMSource$DocumentReader.<init>(JDOMSource.java:436)
at org.jdom.transform.JDOMSource.getXMLReader(JDOMSource.java:224)
at org.apache.xalan.transformer.TransformerImpl.transform(TransformerImpl.java:531)
at org.apache.xalan.transformer.TransformerImpl.transform(TransformerImpl.java:1174)
at com.solbright.ui.UiXslTransformer.transform(UiXslTransformer.java:39)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doShowViewImpl(AdSuiteMediatorServlet.java:419)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doShowView(AdSuiteMediatorServlet.java:394)
at com.solbright.adtraffic.servlet.AdTrafficMediatorServlet.doShowView(AdTrafficMediatorServlet.java:80)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:307)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-16" daemon prio=1 tid=0x8e50a140 nid=0x32c1 waiting on monitor [0x97dfe000..0x97dfe93c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-15" daemon prio=1 tid=0x8e5096b0 nid=0x32c1 waiting on monitor [0x975fe000..0x975fe9bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-14" daemon prio=1 tid=0x8e508c20 nid=0x32c1 waiting on monitor [0x96dfe000..0x96dfea3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-13" daemon prio=1 tid=0x8e508190 nid=0x32c1 waiting on monitor [0x965fe000..0x965feabc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-12" daemon prio=1 tid=0x8e507700 nid=0x32c1 waiting for monitor entry [0x95dfe000..0x95dfeb3c]
at weblogic.utils.KeyTable.elements(KeyTable.java:79)
at weblogic.utils.SyncKeyTable.elements(SyncKeyTable.java:25)
at weblogic.rmi.internal.OIDManager.sweep(OIDManager.java:334)
at weblogic.rmi.internal.DGCServerImpl.trigger(DGCServerImpl.java:131)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-11" daemon prio=1 tid=0x8e506c70 nid=0x32c1 waiting on monitor [0x955fe000..0x955febbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-10" daemon prio=1 tid=0x8e506218 nid=0x32c1 waiting for monitor entry [0x94dfe000..0x94dfec3c]
at java.util.Hashtable.getEnumeration(Hashtable.java:520)
at java.util.Hashtable.keys(Hashtable.java:215)
at weblogic.servlet.internal.session.MemorySessionContextImpl.getIds(MemorySessionContextImpl.java:21)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.invalidateSessions(SessionContext.java:508)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.trigger(SessionContext.java:491)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-9" daemon prio=1 tid=0x8e503b10 nid=0x32c1 waiting for monitor entry [0x945fe000..0x945fecbc]
at java.lang.Class.newInstance0(Native Method)
at java.lang.Class.newInstance(Class.java:232)
at sun.io.Converters.newConverter(Converters.java:115)
at sun.io.Converters.newDefaultConverter(Converters.java:206)
at sun.io.CharToByteConverter.getDefault(CharToByteConverter.java:50)
at java.lang.String.getBytes(String.java:751)
at java.io.UnixFileSystem.list(Native Method)
at java.io.File.list(File.java:769)
at weblogic.ejb.internal.StatefulSessionSweeper.trigger(StatefulSessionSweeper.java:65)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-8" daemon prio=1 tid=0x8e503178 nid=0x32c1 waiting on monitor [0x93dfe000..0x93dfed3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-7" daemon prio=1 tid=0x8e500ed8 nid=0x32c1 waiting on monitor [0x935fe000..0x935fedbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-6" daemon prio=1 tid=0x8e505330 nid=0x32c1 waiting on monitor [0x92dfe000..0x92dfee3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-5" daemon prio=1 tid=0x8e504dc0 nid=0x32c1 waiting on monitor [0x925fe000..0x925feebc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-4" daemon prio=1 tid=0x8e504b98 nid=0x32c1 waiting on monitor [0x91dfe000..0x91dfef3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-3" daemon prio=1 tid=0x8e5049a0 nid=0x32c1 waiting on monitor [0x915fe000..0x915fefbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-2" daemon prio=1 tid=0x8e5016e0 nid=0x32c1 waiting on monitor [0x90dfe000..0x90dff03c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-1" daemon prio=1 tid=0x8e502358 nid=0x32c1 waiting on monitor [0x905fe000..0x905ff0bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-0" daemon prio=1 tid=0x8e502190 nid=0x32c1 waiting on monitor [0x8fdff000..0x8fdff13c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"TimeEventGenerator" daemon prio=1 tid=0x8e5057a8 nid=0x32c1 waiting on monitor [0x8f5ff000..0x8f5ff1bc]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
at java.lang.Thread.run(Thread.java:479)
"SpinnerRandomSource" daemon prio=1 tid=0x8e501f48 nid=0x32c1 waiting on monitor [0x8edff000..0x8edff23c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:104)
at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
"Signal Dispatcher" daemon prio=1 tid=0x80bb128 nid=0x32c1 waiting on monitor [0..0]
"Finalizer" daemon prio=1 tid=0x80b42c0 nid=0x32c1 waiting on monitor [0x8993f000..0x8993f53c]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
"Reference Handler" daemon prio=1 tid=0x80b3f98 nid=0x32c1 waiting on monitor [0x8913f000..0x8913f5bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:105)
"main" prio=1 tid=0x804eab0 nid=0x32c1 waiting on monitor [0xbfffb000..0xbfffbb04]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1958)
at java.lang.reflect.Method.invoke(Native Method)
at weblogic.Server.startServerDynamically(Server.java:148)
at weblogic.Server.main(Server.java:97)
at weblogic.Server.main(Server.java:58)
"VM Thread" prio=1 tid=0x80b3710 nid=0x32c1 runnable
"VM Periodic Task Thread" prio=1 tid=0x80b9e10 nid=0x32c1 waiting on monitor
"Suspend Checker Thread" prio=1 tid=0x80ba728 nid=0x32c1 runnable -
Start weblogic server within java code
From edoc.bea.com, I got:
====
The following sections describe alternate ways to start an Administration Server:
Starting an Administration Server from the Windows Start Menu
Starting an Administration Server When the Host Computer Boots
Starting an Administration Server With the java weblogic.Server Command
====
Could we start weblogic server within java code?
(like ServerLoader provided by JBoss?)
Thanks in advance.
-KevinThe follwoing code:
//====
import weblogic.*;
public class MyTest
public static void main(String[] args)
String[] myArgs = new String[6];
myArgs[0] = "-Dweblogic.home=C:\\bea";
myArgs[1] = "-Dweblogic.RootDirectory=C:\\bea\\weblogic81\\samples\\domains\\examples";
myArgs[2] = "-Dweblogic.ConfigFile=C:\\bea\\weblogic81\\samples\\domains\\examples\\config.xml";
myArgs[3] = "-Dweblogic.Name=examplesServer";
myArgs[4] = "-Dweblogic.management.username=weblogic";
myArgs[5] = "-Dweblogic.management.password=weblogic";
Server.main( myArgs );
//====
Seems that did not feed the arguments in:
C:\myTest>java -cp .;%CLASSPATH% MyTest
<Sep 22, 2005 6:08:40 PM EDT> <Info> <Security> <BEA-090065> <Getting boot ident
ity from user.>
Enter username to boot WebLogic server: -
OS: AIX 5.3
weblogic :10.3
jdk: ibm jdk1.6sr14
when this case was happened, I hava do patch CR370915 but this issue still exists.
I change weblogic version to 10.3 that this issue still exists.
i hava to see the havacore, as follows
Memory Segment Analysis
Memory Type
# of Segments
Used Memory(bytes)
Used Memory(%)
Free Memory(bytes)
Free Memory(%)
Total Memory(bytes)
Internal
160
0
0
11,287,080
100
11,287,080
Object(reserved)
1
3,221,225,472
100
0
0
3,221,225,472
Class
1,291
65,529,828
94.66
3,694,784
5.34
69,224,612
JIT Code Cache
1
5,319,648
63.42
3,068,960
36.58
8,388,608
JIT Data Cache
1
2,852,232
34
5,536,376
66
8,388,608
Overall
1,454
3,294,927,180
99.29
23,587,200
0.71
3,318,514,380
I want to know Object(reserved) =100%,how to fix itHi ,
In order to debug weblogic server hang issues, we need to gather atleast 4 to 5 thread dumps of the wls server that is hanging , exactly during the time of issue.
This will show us as to which thread is causing the issue and will help us to fix it.
WebLogic Server Support Pattern: Generic Server Hang (Doc ID 1264286.1)
Please go through the above document which helps you to do this.
Thanks,
Sharmela -
Weblogic Server 9.2 - JMS File Store not working as expected.
Hi,
I am facing a problem at the server startup possibly due to huge size of the JMS File Store created.
My question is that our application receives messages via MDB (container managed),
Even after successfully processing the message, the message which is logged in the File Store is not deleted.
How can i make sure that a message which is successfully processed is not logged in the file store?
(considering container managed transactions do not require acknowledgement-mode set in the descriptor, altough i have it specified)
Find the the stack trace on the server log below:
####<Dec 10, 2008 11:45:30 AM CST> <Error> <JMS> <xlqwls01> <ACSServer1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tu
ning)'> <<WLS Kernel>> <> <> <1228931130485> <BEA-040123> <Failed to start JMS Server "SDBJMSServer1" due to weblogic.jms.common.JMSException: web
logic.messaging.kernel.KernelException: Unexpected store exception in messaging kernel recovery.
weblogic.jms.common.JMSException: weblogic.messaging.kernel.KernelException: Unexpected store exception in messaging kernel recovery
at weblogic.jms.backend.BackEnd.open(BackEnd.java:963)
at weblogic.jms.deployer.BEAdminHandler.activate(BEAdminHandler.java:180)
at weblogic.management.utils.GenericManagedService.activateDeployment(GenericManagedService.java:237)
at weblogic.management.utils.GenericServiceManager.activateDeployment(GenericServiceManager.java:131)
at weblogic.management.internal.DeploymentHandlerHome.invokeHandlers(DeploymentHandlerHome.java:589)
at weblogic.management.internal.DeploymentHandlerHome.activateInitialDeployments(DeploymentHandlerHome.java:450)
at weblogic.management.internal.DeploymentHandlerHome.activateInitialDeployments(DeploymentHandlerHome.java:430)
at weblogic.management.deploy.internal.DeploymentAdapter$2.doPrepare(DeploymentAdapter.java:100)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:177)
at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:21)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:233)
at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:165)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:173)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:89)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
weblogic.messaging.kernel.KernelException: Unexpected store exception in messaging kernel recovery
at weblogic.messaging.kernel.internal.PersistenceImpl.recover(PersistenceImpl.java:839)
at weblogic.messaging.kernel.internal.KernelImpl.open(KernelImpl.java:235)
at weblogic.jms.backend.BackEnd.open(BackEnd.java:961)
at weblogic.jms.deployer.BEAdminHandler.activate(BEAdminHandler.java:180)
at weblogic.management.utils.GenericManagedService.activateDeployment(GenericManagedService.java:237)
at weblogic.management.utils.GenericServiceManager.activateDeployment(GenericServiceManager.java:131)
at weblogic.management.internal.DeploymentHandlerHome.invokeHandlers(DeploymentHandlerHome.java:589)
at weblogic.management.internal.DeploymentHandlerHome.activateInitialDeployments(DeploymentHandlerHome.java:450)
at weblogic.management.internal.DeploymentHandlerHome.activateInitialDeployments(DeploymentHandlerHome.java:430)
at weblogic.management.deploy.internal.DeploymentAdapter$2.doPrepare(DeploymentAdapter.java:100)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:177)
at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:21)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:233)
at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:165)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:173)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:89)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
weblogic.store.PersistentStoreException: [Store:280020]There was an error while reading from the log file
at weblogic.store.io.file.Heap.read(Heap.java:648)
at weblogic.store.io.file.FileStoreIO.readInternal(FileStoreIO.java:224)
at weblogic.store.io.file.FileStoreIO.access$000(FileStoreIO.java:31)
at weblogic.store.io.file.FileStoreIO$Cursor.nextInternal(FileStoreIO.java:573)
at weblogic.store.io.file.FileStoreIO$Cursor.next(FileStoreIO.java:547)
at weblogic.store.internal.PersistentStoreConnectionImpl$CursorImpl.next(PersistentStoreConnectionImpl.java:266)
at weblogic.messaging.kernel.internal.PersistenceImpl.recoverHeaders(PersistenceImpl.java:1148)
at weblogic.messaging.kernel.internal.PersistenceImpl.recover(PersistenceImpl.java:814)
at weblogic.messaging.kernel.internal.KernelImpl.open(KernelImpl.java:235)
at weblogic.jms.backend.BackEnd.open(BackEnd.java:961)
at weblogic.jms.deployer.BEAdminHandler.activate(BEAdminHandler.java:180)
at weblogic.management.utils.GenericManagedService.activateDeployment(GenericManagedService.java:237)
at weblogic.management.utils.GenericServiceManager.activateDeployment(GenericServiceManager.java:131)
at weblogic.management.internal.DeploymentHandlerHome.invokeHandlers(DeploymentHandlerHome.java:589)
at weblogic.management.internal.DeploymentHandlerHome.activateInitialDeployments(DeploymentHandlerHome.java:450)
at weblogic.management.internal.DeploymentHandlerHome.activateInitialDeployments(DeploymentHandlerHome.java:430)
at weblogic.management.deploy.internal.DeploymentAdapter$2.doPrepare(DeploymentAdapter.java:100)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:177)
at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:21)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:233)
at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:165)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:173)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:89)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
java.io.IOException: Error reading from file, No such file or directory, errno=2
at weblogic.store.io.file.direct.DirectIONative.read(Native Method)
at weblogic.store.io.file.direct.DirectFileChannel.read(DirectFileChannel.java:133)
at weblogic.store.io.file.StoreFile.read(StoreFile.java:281)
at weblogic.store.io.file.Heap.read(Heap.java:646)
at weblogic.store.io.file.FileStoreIO.readInternal(FileStoreIO.java:224)
at weblogic.store.io.file.FileStoreIO.access$000(FileStoreIO.java:31)
at weblogic.store.io.file.FileStoreIO$Cursor.nextInternal(FileStoreIO.java:573)
at weblogic.store.io.file.FileStoreIO$Cursor.next(FileStoreIO.java:547)
at weblogic.store.internal.PersistentStoreConnectionImpl$CursorImpl.next(PersistentStoreConnectionImpl.java:266)
at weblogic.messaging.kernel.internal.PersistenceImpl.recoverHeaders(PersistenceImpl.java:1148)
at weblogic.messaging.kernel.internal.PersistenceImpl.recover(PersistenceImpl.java:814)
at weblogic.messaging.kernel.internal.KernelImpl.open(KernelImpl.java:235)
at weblogic.jms.backend.BackEnd.open(BackEnd.java:961)
at weblogic.jms.deployer.BEAdminHandler.activate(BEAdminHandler.java:180)
at weblogic.management.utils.GenericManagedService.activateDeployment(GenericManagedService.java:237)
at weblogic.management.utils.GenericServiceManager.activateDeployment(GenericServiceManager.java:131)
at weblogic.management.internal.DeploymentHandlerHome.invokeHandlers(DeploymentHandlerHome.java:589)
at weblogic.management.internal.DeploymentHandlerHome.activateInitialDeployments(DeploymentHandlerHome.java:450)
at weblogic.management.internal.DeploymentHandlerHome.activateInitialDeployments(DeploymentHandlerHome.java:430)
at weblogic.management.deploy.internal.DeploymentAdapter$2.doPrepare(DeploymentAdapter.java:100)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:177)
at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:21)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:233)
at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:165)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:173)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:89)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
Edited by: user5823244 on Dec 14, 2008 2:59 AMHi,
It seems there are two problems going on here:
(1) Forceful shutdowns should not (must not) normally corrupt the file store. There may be a bug in WL, or it may be the admin is arbitrarily deleting some file store files while leaving others in place (not supported).
(2) "Even after successfully processing the message, the message which is logged in the File Store is not deleted."
This is a strong indicator that there's an application error and the message is not actually getting deleted. The file store size is proportional to the number of current messages (successfully processing/acknowledging/committing a received message frees space for new messages), and is not proportional to the number of successfully processed messages.
I think it's likely that the application isn't actually successfully processing the message but is instead receiving a message somehow and is either:
(A) throwing an exception from within an XA-or-non-XA-MDB or auto-ack-onMessage() and somehow forcing the message into a state where its not being redelivered for reprocessing
(B) specifying a transacted session and failing to call session.commit()
(C) specifying an XA transaction capable receive and failing to call commit
(D) specifying a "client acknowledge" mode and failing to call acknowledge .
For evidence, check the console statistics for the destination after "successfully processing" all sent messages: the value of "current" + "pending" should be zero once all processing completes, the value of "received (aka total)" should match the sent message count. If the "current" + "pending" value is non-zero, then this is an indication there are messages that were not successfully processed.
Tom Barnes
WebLogic Server Messaging Developer Team -
Problem in developing jasper report in BEA workspace studio version 1.1 with weblogic server 10.0
Hi! all,
Myself developing a jasperReport in BEA workspace studio 1.1 and always getting the below mentioned exception, though i have run the same code in NetBeans successfully with the same jar file.
Even i have added weblogic.jar, wllog4j.jar, classes12.jar, commons-beanutils-1.8.0.jar, commons-collections-2.1.1.jar, commons-digester-1.7.jar, commons-javaflow-20060411.jar, commons-logging-1.0.4.jar, iText-2.1.7.jar, jasperreports-3.7.1.jar, jasperreports.jar, jasper-jdt-6.0.13.jar, jasper-compiler-jdt.jar, jasper-compiler.jar, jasper-runtime.jar, jasperreports-3.5.1.jar, jasperreports-2.0.5.jar in the WEB-INF/lib directory as well as build path. please help me.Thanks in advance.
==============================================================
Exception in thread "Main Thread" java.lang.NoClassDefFoundError: weblogic/logging/WLLogRecord : weblogic/logging/LogEntry
at java.lang.ClassLoader.findBootstrapClass(Native Method)
at java.lang.ClassLoader.findBootstrapClass0(ClassLoader.java:891)
at java.lang.ClassLoader.loadClass(ClassLoader.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:299)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at weblogic.logging.commons.LogFactoryImpl.getInstance(LogFactoryImpl.java:21)
at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:370)
at org.apache.commons.digester.Digester.<init>(Digester.java:304)
at net.sf.jasperreports.engine.xml.JRXmlDigester.<init>(JRXmlDigester.java:62)
at net.sf.jasperreports.engine.xml.JRXmlDigesterFactory.createDigester(JRXmlDigesterFactory.java:980)
at net.sf.jasperreports.engine.xml.JRXmlLoader.load(JRXmlLoader.java:203)
at net.sf.jasperreports.engine.xml.JRXmlLoader.load(JRXmlLoader.java:168)
at net.sf.jasperreports.engine.xml.JRXmlLoader.load(JRXmlLoader.java:152)
at net.sf.jasperreports.engine.JasperCompileManager.compileReport(JasperCompileManager.java:150)
at com.generateJasperReport.test.GasperReportNew.main(GasperReportNew.java:38)
==============================================================================
My Code is..........................
============================
package com.generateJasperReport.test;
import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.ResultSet;
import java.util.HashMap;
import java.util.Map;
//import weblogic.logging.LogEntry;
import net.sf.jasperreports.engine.JRException;
import net.sf.jasperreports.engine.JRResultSetDataSource;
import net.sf.jasperreports.engine.JasperCompileManager;
import net.sf.jasperreports.engine.JasperExportManager;
import net.sf.jasperreports.engine.JasperFillManager;
import net.sf.jasperreports.engine.JasperPrint;
import net.sf.jasperreports.engine.JasperReport;
import net.sf.jasperreports.view.JasperViewer;
public class GenerateJasperReport {
static JRResultSetDataSource jrds = null;
static ResultSet rs = null;
public static Connection connectDB() {
Connection jdbcConnection = null;
try {
Class.forName("oracle.jdbc.driver.OracleDriver");
jdbcConnection = DriverManager.getConnection(
"jdbc:oracle:thin:@192.161.5.35:1521:abc",
"xyz", "pqr");
} catch (Exception ex) {
String connectMsg = "Could not connect to the database: "
+ ex.getMessage() + " " + ex.getLocalizedMessage();
System.out.println(connectMsg);
return jdbcConnection;
public static void main(String[] args) throws JRException {
Connection con = connectDB();
JasperReport jasperReport=null;
System.out.println("666666666666666666");
String reportSource = "E:\\Pintu\\Project\\Bea Project\\workspace\\GenerateJasperReport\\src\\com\\generateJasperReport\\jrxmlFile\\JasperReportGeneration.jrxml";
String reportDest = "E:\\Pintu\\Project\\Bea Project\\workspace\\GenerateJasperReport\\src\\com\\generateJasperReport\\output\\JasperReportGeneration.pdf";
System.out.println("555555555555555");
Map <String,String>parammap = new HashMap<String,String>();
parammap.put("ReportTitle", "PDF JasperReport");
System.out.println("444444444444444");
try {
try{
jasperReport = JasperCompileManager
.compileReport(reportSource);
}catch(JRException e){e.printStackTrace();}
System.out.println("ssssssssssssss");
JasperPrint jasperPrint = JasperFillManager.fillReport(
jasperReport, parammap, con);
System.out.println("vvvvvvvvvvvvvvv");
JasperExportManager.exportReportToPdfFile(jasperPrint, reportDest);
System.out.println("kkkkkkkkkkkkkkkkkkk");
JasperViewer.viewReport(jasperPrint);
System.out.println("gfrfrrrertfewrw");
} catch (Exception ex) {
ex.printStackTrace();
===========================================================Thanks for the information. It makes so much more sense to do the configuration from within PFR instead of WLS but the engineer insisted I could just do everything from within the WLS config wizard. I'm very relieved that someone has had success with this.
Am I supposed to do the configuration wizard in WLS before doing the Configure Classic Interface from PFR?
Since we're only going to be using the PC for the developer, I wasn't sure how much of the Web Logic Server needed to be configured.
The Oracle engineer said to choose 'Oracle Ent. Mgr' and 'Oracle Classic 11g' from the WLS Config Wizard which I did - but now I have a choice on the 'Optional Configuration' page to choose 'Administration Server', 'Managed Servers', 'Deployments and Services' and 'RDMBS Security Store'. I'm not sure if I'm supposed to choose any of these. I want to be able to talk to the Solaris server that is going to be my application server via WLS and I'm not sure if I need any of these.
In your environment, are you developing 11g forms on a PC but hosting on another platform? I have a Windows 7 64 bit machine but was told I had to set up a 32bit XP VM on my Win7 machine to use Forms and Reports for development. -
Oracle Weblogic Server 10.3 startup stuck at 84% in Eclipse
Hi,
I am trying to start my Oracle Weblogic Server 10.3 in the Eclipse environment and the status bar freezes after progressing upto 84%.
Although the server is the RUNNING mode and I can login to the Admin console, I cannot auto-deploy or debug my apps in Eclipse because
it is waiting for the startup task to finish (or reach 100%).
I get following message after it times out.
"Server Oracle WebLogic Server v10.3 at localhost was unable to start within 480 seconds. If the server requires more time, try increasing the timeout in the server editor."
Any help to fix this issue will be very much appreciated.
Regards,
Amitoj.
Edited by: Amitoj on Apr 16, 2009 5:03 AMHi Ram,
I have checked everything.
There is nothing else in the progress view
Only the following message in the .log file over and over again
!ENTRY oracle.eclipse.tools.weblogic 4 4000 2009-04-16 14:11:12.452
!MESSAGE The server cannot be launched within timeout.
!ENTRY org.eclipse.wst.server.core 4 0 2009-04-16 14:11:13.872
!MESSAGE Server Oracle WebLogic Server v10.3 at localhost was unable to start within 480 seconds. If the server requires more time, try increasing the timeout in the server editor.
!ENTRY oracle.eclipse.tools.weblogic 4 4000 2009-04-16 16:10:02.827
!MESSAGE The user action is cancelled when the server is starting. The server cannot be stopped now. Please wait until the server is started and then stop it.
Tried restarting the eclipse and the machine. Killed all eclipse and jave processes in the task manager.
Downloaded a new copy eclipse, installed Weblogic server from scratch and created a brand new workspace.
Still I get the same problem.
I have exhausted every other option and now I am going to the extreme of rebuilding my whole PC again.
Regards,
Amitoj.
Maybe you are looking for
-
Can I migrate rules from one account in Mail to another?
In mail I have 90 rules, many multi line criteria. I have just created a new imap account linked to fastmail. My rules wont run because they seem to be linked to my first account, not imap. I tried just duplicating them and re-mapping to the new "mo
-
Program cutting off 1st character in file
Hi I have this weird problem. My problem takes a file read it and places in into a JTable. It seems that during the read, the 1st character gets chopped off. public class Main { //Variable declarations private JFrame f; private JPanel p;
-
Problem with getLastChild() and xsl:comment / nodes
Hi list, the problem I'm facing at the moment is as follows (using org.w3c.dom.*): in my DOM I have fragments of the following: <a accesskey="2" class="namedanchor" name="content"> <!----> <span
-
Fork() failure [Resource temporarily unavailable]
Occasionally our webserver will fail to start a CGI with this error message "fork() failure [Resource temporarily unavailable]". I think this is caused by lack of RAM. Is this correct? Can we configure the Solaris 10 OS to use disk space when there i
-
Same infoprovider, different results
Hello together, here it is my problem: I have one infoprovider and two queries based on it. In both queries I have one identical formula, but the result is different .. Could you please help me? Where could be the problem? Thank you, Iuliana