Weblogic server hangs during stress-testing -- possibly EJB deadlocks
Hi
While running stress tests on our application, our WLS 4.5.1 hangs even at a
mere load of 20 users. We are running on a Solaris machine. Database: Oracle
8.1.5, running on the same machine. Using oracle.jdbc.driver.OracleDriver as
the JDBC driver, and using JTS as the transaction manager.
When we did a thread dump (complete lis at the end of this post) and
basically we are seeing a bunch of our entity beans in a "locked" state. A
common pattern we see in the thread dumps is that
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.organization.<Our Entiy Bean>EOImpl.<a get
method>(ERSSystemConfigurationBeanEOImpl.java:1539)
[6] com.nps.ers.ejb.awardnomination.<Our entity bean>.<some method>
After more thorough studying of EJB transactions, we changed the isolation
level of all our beans from TRANSACTION_SERIALIZED to
TRANSACTION_READ_COMMITTED and made sure all our beans say TX_REQUIRED for
their transactionAttribue. Still, this problem persists.
The basic scenario we are load testing is that of multiple users logging
into the system and trying to access a particular user's record, and right
now, this is causing deadlocks at 20 users.
What we fail to understand is that --
(a) even if a method is attempting a read-only access to the data, why would
it try to obtain a lock? or why would it matter that the data is locked?
Some of the locks we are seeing are actually on a bean that is used for
read-only purposes.
(b) if 2 or more processes are trying to access the same record, based on
whichever process got their first, shouldn't one succeed, and the other go
into a 'waiting' state?
We have also opened this issue with weblogic support, and the response so
far has been that there "may" be a bug in weblogic 4.5.1 itself that's
causing it, and they need to look into it further. Other similar posts in
the newsgroup haven't been resolved either -- hence this general plea for
help. Please advise if you've any suggestions. Thanks
Sandeep
---------------------------Complete Thread Dump Listing -------------------
"HighPriority TimeEventGenerator" (TID:0x1488278, sys_thread_t:0x14881b8,
state:CW, thread_t: t@46, threadID:0xd9271dc8, stack_bottom:0xd9272000,
stack_size:0x20000) prio=9
[1] weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:249)
[2]
weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
:143)
[3] java.lang.Thread.run(Thread.java:479)
"SSLListenThread" (TID:0x1588220, sys_thread_t:0x1588160, state:R, thread_t:
t@45, threadID:0xd9321dc8, stack_bottom:0xd9322000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:240)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5]
weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java
:121)
[6] weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:112)
[7] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ListenThread" (TID:0x15f7d48, sys_thread_t:0x15f7c88, state:R, thread_t:
t@44, threadID:0xd92a1dc8, stack_bottom:0xd92a2000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:238)
[4] java.net.ServerSocket.accept(ServerSocket.java:223)
[5] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ExecuteThread-29" (TID:0xad1c90, sys_thread_t:0xad1bd0, state:CW, thread_t:
t@40, threadID:0xd94e1dc8, stack_bottom:0xd94e2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-28" (TID:0xad1a78, sys_thread_t:0xad19b8, state:CW, thread_t:
t@39, threadID:0xd9511dc8, stack_bottom:0xd9512000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-27" (TID:0xad1678, sys_thread_t:0xad15b8, state:CW, thread_t:
t@38, threadID:0xd9541dc8, stack_bottom:0xd9542000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-26" (TID:0xac84e8, sys_thread_t:0xac8428, state:CW, thread_t:
t@37, threadID:0xd9571dc8, stack_bottom:0xd9572000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-25" (TID:0xab7d50, sys_thread_t:0xab7c90, state:CW, thread_t:
t@36, threadID:0xd95a1dc8, stack_bottom:0xd95a2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-24" (TID:0xab9b60, sys_thread_t:0xab9aa0, state:CW, thread_t:
t@35, threadID:0xd95d1dc8, stack_bottom:0xd95d2000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-23" (TID:0xab9948, sys_thread_t:0xab9888, state:CW, thread_t:
t@34, threadID:0xd9601dc8, stack_bottom:0xd9602000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[15]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[16]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[18]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[19] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[20] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-22" (TID:0xabcc20, sys_thread_t:0xabcb60, state:CW, thread_t:
t@33, threadID:0xd9631dc8, stack_bottom:0xd9632000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-21" (TID:0xa9ccf0, sys_thread_t:0xa9cc30, state:CW, thread_t:
t@32, threadID:0xd9661dc8, stack_bottom:0xd9662000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-20" (TID:0xab2550, sys_thread_t:0xab2490, state:R, thread_t:
t@31, threadID:0xd9691dc8, stack_bottom:0xd9692000, stack_size:0x20000)
prio=5
[1] java.net.SocketInputStream.socketRead(Native Method)
[2] java.net.SocketInputStream.read(SocketInputStream.java:85)
[3] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[4] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[5] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-19" (TID:0xa640c0, sys_thread_t:0xa64000, state:CW, thread_t:
t@30, threadID:0xd96c1dc8, stack_bottom:0xd96c2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-18" (TID:0xa502d8, sys_thread_t:0xa50218, state:CW, thread_t:
t@29, threadID:0xd96f1dc8, stack_bottom:0xd96f2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getCashWithinD
ays(ERSSystemConfigurationBeanEOImpl.java:1231)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.getAwardNominationNotifi
cationStates(AwardNominationBean.java:772)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.getAwardNomination
NotificationStates(AwardNominationBeanEOImpl.java:247)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.getAwa
rdNominationNotificationStates(AwardNominationBeanEOImpl_ServiceStub.java:41
5)
[9]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[10]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[11]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[12] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[13] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[16]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[19]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[20] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[21] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-17" (TID:0xa242d8, sys_thread_t:0xa24218, state:CW, thread_t:
t@28, threadID:0xd9721dc8, stack_bottom:0xd9722000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.user.UserBeanEOImpl.getUserStatusCode(UserBeanEOImpl.java:22
77)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.getApprovers(ApproverS
electionBean.java:352)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.getApprovers(App
roverSelectionBeanEOImpl.java:140)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.getA
pprovers(ApproverSelectionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.ApproverSelection.getApproverList(ApproverSelection.java
:81)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-16" (TID:0xaa0ed8, sys_thread_t:0xaa0e18, state:CW, thread_t:
t@27, threadID:0xd9751dc8, stack_bottom:0xd9752000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-15" (TID:0xad0220, sys_thread_t:0xad0160, state:CW, thread_t:
t@26, threadID:0xd9781dc8, stack_bottom:0xd9782000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[15]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[16]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[18]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[19] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[20] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-14" (TID:0xa8f4c0, sys_thread_t:0xa8f400, state:CW, thread_t:
t@25, threadID:0xd97b1dc8, stack_bottom:0xd97b2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getCashWithinD
ays(ERSSystemConfigurationBeanEOImpl.java:1231)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.getAwardNominationNotifi
cationStates(AwardNominationBean.java:772)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.getAwardNomination
NotificationStates(AwardNominationBeanEOImpl.java:247)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.getAwa
rdNominationNotificationStates(AwardNominationBeanEOImpl_ServiceStub.java:41
5)
[9]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[10]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[11]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[12] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[13] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[16]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[19]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[20] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[21] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-13" (TID:0xa194f0, sys_thread_t:0xa19430, state:CW, thread_t:
t@24, threadID:0xd97e1dc8, stack_bottom:0xd97e2000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.E
Can you post details on this instrumentation?
I know in the past when we ran into this type of problem, it took us a while
to think through and identify the problems.
Thanks,
Gary
Rob Woollen <[email protected]> wrote in message
news:[email protected]...
Generally this indicates a deadlock in the order that you access your
entity beans. Please follow-up with [email protected]. There is
some instrumentation that you can turn on to help spot why this is
occurring.
-- Rob
Sandeep Giri wrote:
Hi
While running stress tests on our application, our WLS 4.5.1 hangs even
at a
mere load of 20 users. We are running on a Solaris machine. Database:Oracle
8.1.5, running on the same machine. Usingoracle.jdbc.driver.OracleDriver as
the JDBC driver, and using JTS as the transaction manager.
When we did a thread dump (complete lis at the end of this post) and
basically we are seeing a bunch of our entity beans in a "locked" state.A
common pattern we see in the thread dumps is that
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.organization.<Our Entiy Bean>EOImpl.<a get
method>(ERSSystemConfigurationBeanEOImpl.java:1539)
[6] com.nps.ers.ejb.awardnomination.<Our entity bean>.<some method>
After more thorough studying of EJB transactions, we changed theisolation
level of all our beans from TRANSACTION_SERIALIZED to
TRANSACTION_READ_COMMITTED and made sure all our beans say TX_REQUIREDfor
their transactionAttribue. Still, this problem persists.
The basic scenario we are load testing is that of multiple users logging
into the system and trying to access a particular user's record, andright
now, this is causing deadlocks at 20 users.
What we fail to understand is that --
(a) even if a method is attempting a read-only access to the data, whywould
it try to obtain a lock? or why would it matter that the data is locked?
Some of the locks we are seeing are actually on a bean that is used for
read-only purposes.
(b) if 2 or more processes are trying to access the same record, basedon
whichever process got their first, shouldn't one succeed, and the othergo
into a 'waiting' state?
We have also opened this issue with weblogic support, and the responseso
far has been that there "may" be a bug in weblogic 4.5.1 itself that's
causing it, and they need to look into it further. Other similar postsin
the newsgroup haven't been resolved either -- hence this general pleafor
help. Please advise if you've any suggestions. Thanks
Sandeep
---------------------------Complete Thread DumpListing -------------------
>>
"HighPriority TimeEventGenerator" (TID:0x1488278,sys_thread_t:0x14881b8,
state:CW, thread_t: t@46, threadID:0xd9271dc8, stack_bottom:0xd9272000,
stack_size:0x20000) prio=9
[1] weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:249)
[2]
weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
:143)
[3] java.lang.Thread.run(Thread.java:479)
"SSLListenThread" (TID:0x1588220, sys_thread_t:0x1588160, state:R,thread_t:
t@45, threadID:0xd9321dc8, stack_bottom:0xd9322000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:240)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5]
weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java
:121)
[6]weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:112)
[7] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ListenThread" (TID:0x15f7d48, sys_thread_t:0x15f7c88, state:R,thread_t:
t@44, threadID:0xd92a1dc8, stack_bottom:0xd92a2000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:238)
[4] java.net.ServerSocket.accept(ServerSocket.java:223)
[5] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ExecuteThread-29" (TID:0xad1c90, sys_thread_t:0xad1bd0, state:CW,thread_t:
t@40, threadID:0xd94e1dc8, stack_bottom:0xd94e2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-28" (TID:0xad1a78, sys_thread_t:0xad19b8, state:CW,thread_t:
t@39, threadID:0xd9511dc8, stack_bottom:0xd9512000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-27" (TID:0xad1678, sys_thread_t:0xad15b8, state:CW,thread_t:
t@38, threadID:0xd9541dc8, stack_bottom:0xd9542000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-26" (TID:0xac84e8, sys_thread_t:0xac8428, state:CW,thread_t:
t@37, threadID:0xd9571dc8, stack_bottom:0xd9572000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-25" (TID:0xab7d50, sys_thread_t:0xab7c90, state:CW,thread_t:
t@36, threadID:0xd95a1dc8, stack_bottom:0xd95a2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-24" (TID:0xab9b60, sys_thread_t:0xab9aa0, state:CW,thread_t:
t@35, threadID:0xd95d1dc8, stack_bottom:0xd95d2000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-23" (TID:0xab9948, sys_thread_t:0xab9888, state:CW,thread_t:
t@34, threadID:0xd9601dc8, stack_bottom:0xd9602000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[15]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[16]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[18]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[19]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[20] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-22" (TID:0xabcc20, sys_thread_t:0xabcb60, state:CW,thread_t:
t@33, threadID:0xd9631dc8, stack_bottom:0xd9632000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-21" (TID:0xa9ccf0, sys_thread_t:0xa9cc30, state:CW,thread_t:
t@32, threadID:0xd9661dc8, stack_bottom:0xd9662000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-20" (TID:0xab2550, sys_thread_t:0xab2490, state:R,thread_t:
t@31, threadID:0xd9691dc8, stack_bottom:0xd9692000, stack_size:0x20000)
prio=5
[1] java.net.SocketInputStream.socketRead(Native Method)
[2] java.net.SocketInputStream.read(SocketInputStream.java:85)
[3]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[4]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[5] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-19" (TID:0xa640c0, sys_thread_t:0xa64000, state:CW,thread_t:
t@30, threadID:0xd96c1dc8, stack_bottom:0xd96c2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-18" (TID:0xa502d8, sys_thread_t:0xa50218, state:CW,thread_t:
t@29, threadID:0xd96f1dc8, stack_bottom:0xd96f2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getCashWithinD
ays(ERSSystemConfigurationBeanEOImpl.java:1231)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.getAwardNominationNotifi
cationStates(AwardNominationBean.java:772)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.getAwardNomination
NotificationStates(AwardNominationBeanEOImpl.java:247)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.getAwa
>>
rdNominationNotificationStates(AwardNominationBeanEOImpl_ServiceStub.java:41
5)
[9]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[10]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[11]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[12]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[13] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[16]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[19]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[20]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[21] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-17" (TID:0xa242d8, sys_thread_t:0xa24218, state:CW,thread_t:
t@28, threadID:0xd9721dc8, stack_bottom:0xd9722000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.user.UserBeanEOImpl.getUserStatusCode(UserBeanEOImpl.java:22
77)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.getApprovers(ApproverS
electionBean.java:352)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.getApprovers(App
roverSelectionBeanEOImpl.java:140)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.getA
pprovers(ApproverSelectionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.ApproverSelection.getApproverList(ApproverSelection.java
:81)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-16" (TID:0xaa0ed8, sys_thread_t:0xaa0e18, state:CW,thread_t:
t@27, threadID:0xd9751dc8, stack_bottom:0xd9752000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-15" (TID:0xad0220, sys_thread_t:0xad0160, state:CW,thread_t:
t@26, threadID:0xd9781dc8, stack_bottom:0xd9782000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14
Similar Messages
-
Reloading Plug-In Page causes browser to hang during stress test on IE & NS
When an applet page is in the process of being loaded using the Java Plug-In and a second request is made to reload that applet or a new applet several times in succession, the browser hangs. Is there a work around for the Java Plug-In version 1.3.1.
Hi,
You can see fixed bugs in 1.3.1_01 version at
http://java.sun.com/j2se/1.3.1/ReleaseNotes.html
This is one of them:
http://developer.java.sun.com/developer/bugParade/bugs/4477187.html
Description: Loading applets, using IExplorer 5.0/5.5, sometimes caused a system hang.
Hopefully this bug fix relates to your problem. -
Toplink problem during stress tests
Hello
I have created simple Three tier application, where SLSBs connects using Toplink to Oracle database. During stress tests I'm having very offen following exception:
Wyj¦tek [TOPLINK-4002] (OracleAS TopLink - 10g (9.0.4.5) (Build 040930)): oracle.toplink.exceptions.DatabaseException
Opis wyj¦tku: java.sql.SQLException: Wyj?tek we-wy: The Network Adapter could not establish the connection
Wyj¦tek wewnÅtrzny: java.sql.SQLException: Wyj?tek we-wy: The Network Adapter could not establish the connection
Error code: 17002
at oracle.toplink.exceptions.DatabaseException.sqlException(DatabaseException.java:221)
at oracle.toplink.jndi.JNDIConnector.connect(JNDIConnector.java:105)
at oracle.toplink.sessions.DatabaseLogin.connect(DatabaseLogin.java:218)
at oracle.toplink.internal.databaseaccess.DatabaseAccessor.reconnect(DatabaseAccessor.java:1323)
at oracle.toplink.internal.databaseaccess.DatabaseAccessor.incrementCallCount(DatabaseAccessor.java:1198)
at oracle.toplink.internal.databaseaccess.DatabaseAccessor.executeCall(DatabaseAccessor.java:633)
at oracle.toplink.threetier.ServerSession.executeCall(ServerSession.java:506)
at oracle.toplink.internal.queryframework.CallQueryMechanism.executeCall(CallQueryMechanism.java:131)
at oracle.toplink.internal.queryframework.CallQueryMechanism.executeCall(CallQueryMechanism.java:115)
at oracle.toplink.internal.queryframework.CallQueryMechanism.executeSelectCall(CallQueryMechanism.java:194)
at oracle.toplink.internal.queryframework.CallQueryMechanism.selectAllRows(CallQueryMechanism.java:565)
at oracle.toplink.internal.queryframework.ExpressionQueryMechanism.selectAllRowsFromTable(ExpressionQueryMechanism.java:733)
at oracle.toplink.internal.queryframework.ExpressionQueryMechanism.selectAllRows(ExpressionQueryMechanism.java:708)
at oracle.toplink.queryframework.ReadAllQuery.execute(ReadAllQuery.java:447)
at oracle.toplink.queryframework.DatabaseQuery.execute(DatabaseQuery.java:493)
at oracle.toplink.queryframework.ReadQuery.execute(ReadQuery.java:125)
at oracle.toplink.publicinterface.Session.internalExecuteQuery(Session.java:1958)
at oracle.toplink.threetier.ServerSession.internalExecuteQuery(ServerSession.java:629)
at oracle.toplink.threetier.ClientSession.internalExecuteQuery(ClientSession.java:392)
at oracle.toplink.publicinterface.Session.executeQuery(Session.java:1086)
at oracle.toplink.publicinterface.Session.executeQuery(Session.java:1038)
at petstore.ejb.OrderFacadeBean.getUserOrders(OrderFacadeBean.java:190)
at OrderFacadeLocal_StatelessSessionBeanWrapper8.getUserOrders(OrderFacadeLocal_StatelessSessionBeanWrapper8.java:615)
at petstore.wmodule.OrderFacadeBusinessDelegate.getUserOrders(OrderFacadeBusinessDelegate.java:50)
at petstore.wmodule.struts.OrderListAction.execute(OrderListAction.java:57)
at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:484)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:274)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1482)
at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:507)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
at com.evermind.server.http.ResourceFilterChain.doFilter(ResourceFilterChain.java:65)
at petstore.wmodule.servlet.EncodingFilter.doFilter(EncodingFilter.java:32)
at com.evermind.server.http.EvermindFilterChain.doFilter(EvermindFilterChain.java:16)
at petstore.wmodule.servlet.SecurityFilter.doFilter(SecurityFilter.java:43)
at com.evermind.server.http.ServletRequestDispatcher.invoke(ServletRequestDispatcher.java:600)
at com.evermind.server.http.ServletRequestDispatcher.forwardInternal(ServletRequestDispatcher.java:317)
at com.evermind.server.http.HttpRequestHandler.processRequest(HttpRequestHandler.java:793)
at com.evermind.server.http.HttpRequestHandler.run(HttpRequestHandler.java:270)
at com.evermind.server.http.HttpRequestHandler.run(HttpRequestHandler.java:112)
at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run(ReleasableResourcePooledExecutor.java:192)
at java.lang.Thread.run(Thread.java:534)
Caused by: java.sql.SQLException: Wyj?tek we-wy: The Network Adapter could not establish the connection
at oracle.jdbc.dbaccess.DBError.throwSqlException(DBError.java:189)
at oracle.jdbc.dbaccess.DBError.throwSqlException(DBError.java:231)
at oracle.jdbc.dbaccess.DBError.throwSqlException(DBError.java:345)
at oracle.jdbc.driver.OracleConnection.<init>(OracleConnection.java:431)
at oracle.jdbc.driver.OracleDriver.getConnectionInstance(OracleDriver.java:515)
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:345)
at com.evermind.sql.DriverManagerDataSource.getConnection(DriverManagerDataSource.java:116)
at oracle.toplink.jndi.JNDIConnector.connect(JNDIConnector.java:102)
... 40 more
Toplink session is configured to use external transaction controller and data source. Application run on OC4J 9.0.4.1. Using jdbc debug options I wasn't able to find any causes. Has anyone faced this problem before?
Regards
JarekHi Jarek,
TopLink uses the datasource similar to any other java application would, so there are no additional restrictions. From the error, you can see that the datasource is attempting to create a new connection and that is what is causing the exception. All TopLink did was call getConnection on the datasource ( DriverManagerDataSource.getConnection ).
This could be a problem/glitch with the network or that the listener when down temporarily. Things to check would be:
-how frequently this occurs
-if it occurs for all connections after this point
-the state of the database listener (can other applications connect to it, is it up, etc)
-how many connections to the DB are active at this point
-how many connections/sessions are active from this application
-the OC4J and JDBC versions. Latest patches are better with regards to connection pools.
What is strange though is that you have the min=max, so it should never create new connections after the first time the pool is accessed. Each connection should already have been created, which is why I suggest that you contact OC4J/JDBC support.
Best Regards,
Chris -
My WebLogic Server hang up sometime. The platform is IBM AIX, weblogic 8.1 with sp3
The following is the thread dump:
NULL ------------------------------------------------------------------------
0SECTION TITLE subcomponent dump routine
NULL ===============================
1TISIGINFO signal 3 received
1TIDATETIME Date: 2007/04/26 at 11:13:10
1TIFILENAME Javacore filename: /var/bea/domains/TazDomain/javacore524292.1177600390.txt
NULL ------------------------------------------------------------------------
0SECTION XHPI subcomponent dump routine
NULL ==============================
1XHTIME Thu Apr 26 11:13:10 2007
1XHSIGRECV SIGQUIT received at 0x0 in <unknown>.
1XHFULLVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
NULL
1XHCURRENTTHD Current Thread Details
NULL ----------------------
2XHCURRSYSTHD "Signal dispatcher" sys_thread_t:0x74427A28
3XHNATIVESTACK Native Stack
NULL ------------
3XHSTACKLINEERR unavailable - stack address not valid
1XHOPENV Operating Environment
NULL ---------------------
2XHHOSTNAME Host : rcirs050:10.1.93.20
2XHOSLEVEL OS Level : AIX 5.3.0.0
2XHCPUS Processors -
3XHCPUARCH Architecture : POWER_PC (impl: unknown, ver: unknown)
3XHNUMCPUS How Many : 2
3XHCPUSENABLED Enabled : 2
NULL
1XHUSERLIMITS User Limits (in bytes except for NOFILE and NPROC) -
NULL -----------
2XHUSERLIMIT RLIMIT_FSIZE : 1073741312
2XHUSERLIMIT RLIMIT_DATA : 2147483645
2XHUSERLIMIT RLIMIT_STACK : 33554432
2XHUSERLIMIT RLIMIT_CORE : 1073741312
2XHUSERLIMIT RLIMIT_NOFILE : 1024
2XHLIMIT NPROC(max) : 128
NULL
1XHPAGESPACES Page Space (in blocks) -
NULL ----------
2XHPAGESPACE /dev/hd6: size=262144, free=261912
2XHPAGESPACE /dev/paging03: size=507904, free=507672
2XHPAGESPACE /dev/paging00: size=262144, free=261917
2XHPAGESPACE /dev/paging01: size=262144, free=261903
2XHPAGESPACE /dev/paging02: size=262144, free=261901
2XHPAGESPACE /dev/paging04: size=262144, free=260986
2XHPAGESPACE /dev/paging07: size=262144, free=261911
2XHPAGESPACE /dev/paging06: size=262144, free=261913
2XHPAGESPACE /dev/paging05: size=262144, free=261913
NULL
1XHSIGHANDLERS JVM Signal Handlers
NULL -------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHSIGHANDLERS Chained Signal Handlers
NULL -----------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHENVVARS Environment Variables
NULL ---------------------
2XHENVVAR _=/usr/java14/bin/java
2XHENVVAR JAVA_VENDOR=IBM
2XHENVVAR LANG=C
2XHENVVAR PRODUCTION_MODE=
2XHENVVAR LOGIN=qatadm
2XHENVVAR CLASSPATHSEP=:
2XHENVVAR VISUAL=vi
2XHENVVAR POINTBASE_HOME=/opt/bea/weblogic81/common/eval/pointbase
2XHENVVAR PATH=/opt/bea/weblogic81/server/bin:/usr/java14/jre/bin:/usr/java14/bin:/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/qatadm/bin:/usr/bin/X11:/sbin:.:/usr/java14/bin
2XHENVVAR JAVA_VM=
2XHENVVAR LC__FASTMSG=true
2XHENVVAR POINTBASE_CLASSPATH=:/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar
2XHENVVAR CLASSPATH=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2XHENVVAR LOGNAME=qatadm
2XHENVVAR MAIL=/usr/spool/mail/qatadm
2XHENVVAR POINTBASE_TOOLS=/opt/bea/weblogic81/common/eval/pointbase/lib/pbtools44.jar
2XHENVVAR LOCPATH=/usr/lib/nls/loc
2XHENVVAR PS1=rcirs050:$PWD>
2XHENVVAR PATHSEP=:
2XHENVVAR USER=qatadm
2XHENVVAR AUTHSTATE=compat
2XHENVVAR BEA_HOME=/opt/bea
2XHENVVAR DCE_USE_WCHAR_NAMES=1
2XHENVVAR SHELL=/usr/bin/ksh
2XHENVVAR ODMDIR=/etc/objrepos
2XHENVVAR JAVA_HOME=/usr/java14
2XHENVVAR TIMEOUT=900
2XHENVVAR TMOUT=900
2XHENVVAR HOME=/home/qatadm
2XHENVVAR MEM_ARGS=-Xms512m -Xmx1024m
2XHENVVAR WEBLOGIC_CLASSPATH=/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar
2XHENVVAR TERM=dtterm
2XHENVVAR MAILMSG=[YOU HAVE NEW MAIL]
2XHENVVAR PWD=/var/bea/domains/TazDomain
2XHENVVAR TZ=EST5EDT
2XHENVVAR WL_HOME=/opt/bea/weblogic81
2XHENVVAR AIXTHREAD_SCOPE=S
2XHENVVAR A__z=! LOGNAME="*TMOUT
2XHENVVAR _IBM_JAVA_PIPE_524292=
2XHENVVAR IBM_JVM_LIBPATH_OLD_VALUE=/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_LIBPATH_NEW_VALUE=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_CHANGED_ENVVARS_524292=LIBPATH,LDR_CNTRL
2XHENVVAR IBM_JVM_LDR_CNTRL_NEW_VALUE=MAXDATA=0XA0000000@DSA
2XHENVVAR LDR_CNTRL=MAXDATA=0XA0000000@DSA
2XHENVVAR NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
2XHENVVAR LIBPATH=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR _IBM_ENV_INITIAL_524292=805345384
2XHENVVAR IBM_JAVA_COMMAND_LINE=/usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
NULL
1XHLOADEDLIBS Loaded Libraries (sizes in bytes)
NULL ---------------------------------
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libmuxer.so
3XHLIBSIZE filesize : 20757
3XHLIBSTART text start : 0xD0B88000
3XHLIBLDSIZE text size : 0x282E
3XHLIBLDORG data start : 0xF0617CF4
3XHLIBLDDATASZ data size : 0x2AC
2XHLIBNAME /usr/java14/jre/bin/libnio.a
3XHLIBSIZE filesize : 64305
3XHLIBSTART text start : 0xD11F5000
3XHLIBLDSIZE text size : 0x8EF0
3XHLIBLDORG data start : 0xF0615AE0
3XHLIBLDDATASZ data size : 0x594
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libweblogicunix1.so
3XHLIBSIZE filesize : 14536
3XHLIBSTART text start : 0xD0B86000
3XHLIBLDSIZE text size : 0x1B90
3XHLIBLDORG data start : 0xF0614484
3XHLIBLDDATASZ data size : 0xD8
2XHLIBNAME /usr/java14/jre/bin/libnet.a
3XHLIBSIZE filesize : 137885
3XHLIBSTART text start : 0xD15D7000
3XHLIBLDSIZE text size : 0x161FF
3XHLIBLDORG data start : 0xF05DE3D8
3XHLIBLDDATASZ data size : 0x968
2XHLIBNAME /usr/java14/jre/bin/libjitc.a
3XHLIBSIZE filesize : 2814544
3XHLIBSTART text start : 0xD252E000
3XHLIBLDSIZE text size : 0x23EE7B
3XHLIBLDORG data start : 0xF0962B68
3XHLIBLDDATASZ data size : 0x1A984
2XHLIBNAME /usr/lib/security/DCE
3XHLIBSIZE filesize : 27634
3XHLIBSTART text start : 0xD0B7A000
3XHLIBLDSIZE text size : 0x6BF2
3XHLIBLDORG data start : 0xF05CEA38
3XHLIBLDDATASZ data size : 0x2BA0
2XHLIBNAME /usr/java14/jre/bin/libzip.a
3XHLIBSIZE filesize : 109746
3XHLIBSTART text start : 0xD11E1000
3XHLIBLDSIZE text size : 0x135E2
3XHLIBLDORG data start : 0xF05DC468
3XHLIBLDDATASZ data size : 0x1918
2XHLIBNAME /usr/java14/jre/bin/classic/libcore.a
3XHLIBSIZE filesize : 136713
3XHLIBSTART text start : 0xD11CB000
3XHLIBLDSIZE text size : 0x15248
3XHLIBLDORG data start : 0xF05DA0E8
3XHLIBLDDATASZ data size : 0x1620
2XHLIBNAME /usr/java14/jre/bin/libjava.a
3XHLIBSIZE filesize : 221158
3XHLIBSTART text start : 0xD11AB000
3XHLIBLDSIZE text size : 0x1FEB2
3XHLIBLDORG data start : 0xF05D88F8
3XHLIBLDDATASZ data size : 0x16F8
2XHLIBNAME /usr/java14/jre/bin/libhpi.a
3XHLIBSIZE filesize : 205732
3XHLIBSTART text start : 0xD118C000
3XHLIBLDSIZE text size : 0x1EE0E
3XHLIBLDORG data start : 0xF06045A0
3XHLIBLDDATASZ data size : 0xF8D0
2XHLIBNAME /usr/java14/jre/bin/libxhpi.a
3XHLIBSIZE filesize : 14654
3XHLIBSTART text start : 0xD0B84000
3XHLIBLDSIZE text size : 0x1B52
3XHLIBLDORG data start : 0xF05D7290
3XHLIBLDDATASZ data size : 0x2C8
2XHLIBNAME /usr/java14/jre/bin/libdbgmalloc.a
3XHLIBSIZE filesize : 15267
3XHLIBSTART text start : 0xD0B81000
3XHLIBLDSIZE text size : 0x217C
3XHLIBLDORG data start : 0xF05D6988
3XHLIBLDDATASZ data size : 0x218
2XHLIBNAME /usr/java14/jre/bin/libjsig.a
3XHLIBSIZE filesize : 14412
3XHLIBSTART text start : 0xD07F8000
3XHLIBLDSIZE text size : 0x1B24
3XHLIBLDORG data start : 0xF05D54B0
3XHLIBLDDATASZ data size : 0x108
2XHLIBNAME /usr/java14/jre/bin/libute.a
3XHLIBSIZE filesize : 112768
3XHLIBSTART text start : 0xD1177000
3XHLIBLDSIZE text size : 0x14ED9
3XHLIBLDORG data start : 0xF05D43B0
3XHLIBLDDATASZ data size : 0x674
2XHLIBNAME /usr/lib/libdl.a
3XHLIBSIZE filesize : 5248
3XHLIBSTART text start : 0xD02E70F8
3XHLIBLDSIZE text size : 0x1E0
3XHLIBLDORG data start : 0xF03190F8
3XHLIBLDDATASZ data size : 0x0
2XHLIBNAME /usr/java14/jre/bin/sovvm/libjvm.a
3XHLIBSIZE filesize : 2857303
3XHLIBSTART text start : 0xD2335000
3XHLIBLDSIZE text size : 0x1F8E31
3XHLIBLDORG data start : 0xF0936290
3XHLIBLDDATASZ data size : 0x2AE10
2XHLIBNAME /usr/java14/jre/bin/classic/libjvm.a
3XHLIBSIZE filesize : 117748
3XHLIBSTART text start : 0xD1169000
3XHLIBLDSIZE text size : 0xD54B
3XHLIBLDORG data start : 0xF05D2A90
3XHLIBLDDATASZ data size : 0xF0C
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01E7540
3XHLIBLDSIZE text size : 0x20F6D
3XHLIBLDORG data start : 0xF0381340
3XHLIBLDDATASZ data size : 0x6780
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01CDBC0
3XHLIBLDSIZE text size : 0x186CC
3XHLIBLDORG data start : 0xF0377FC0
3XHLIBLDDATASZ data size : 0x84C9
2XHLIBNAME /usr/lib/libcrypt.a
3XHLIBSIZE filesize : 11019
3XHLIBSTART text start : 0xD01450F8
3XHLIBLDSIZE text size : 0x846
3XHLIBLDORG data start : 0xF0316508
3XHLIBLDDATASZ data size : 0x128
2XHLIBNAME /usr/lib/libiconv.a
3XHLIBSIZE filesize : 377727
3XHLIBSTART text start : 0xD05BF100
3XHLIBLDSIZE text size : 0x139C1
3XHLIBLDORG data start : 0xF0252C70
3XHLIBLDDATASZ data size : 0xA2E4
2XHLIBNAME /usr/lib/libbsd.a
3XHLIBSIZE filesize : 61862
3XHLIBSTART text start : 0xD02784C0
3XHLIBLDSIZE text size : 0x7D2F
3XHLIBLDORG data start : 0xF0213A30
3XHLIBLDDATASZ data size : 0x13D8
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010E000
3XHLIBLDSIZE text size : 0x365C4
3XHLIBLDORG data start : 0xF0370000
3XHLIBLDDATASZ data size : 0x4024
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010A000
3XHLIBLDSIZE text size : 0x3C52
3XHLIBLDORG data start : 0xF032D000
3XHLIBLDDATASZ data size : 0x424A8
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01AD100
3XHLIBLDSIZE text size : 0x1FED1
3XHLIBLDORG data start : 0xF0388D00
3XHLIBLDDATASZ data size : 0x30F9
2XHLIBNAME /usr/lib/libc.a
3XHLIBSIZE filesize : 8270989
3XHLIBSTART text start : 0xD02F2240
3XHLIBLDSIZE text size : 0x251155
3XHLIBLDORG data start : 0xF0278BC0
3XHLIBLDDATASZ data size : 0x9D340
NULL
NULL ------------------------------------------------------------------------
0SECTION CI subcomponent dump routine
NULL ============================
1CIJAVAVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
1CIRUNNINGAS Running as a standalone JVM
1CICMDLINE /usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
1CIJAVAHOMEDIR Java Home Dir: /usr/java14/jre
1CIJAVADLLDIR Java DLL Dir: /usr/java14/jre/bin
1CISYSCP Sys Classpath: /usr/java14/jre/lib/core.jar:/usr/java14/jre/lib/graphics.jar:/usr/java14/jre/lib/security.jar:/usr/java14/jre/lib/server.jar:/usr/java14/jre/lib/xml.jar:/usr/java14/jre/lib/charsets.jar:/usr/java14/jre/classes:/usr/java14/jre/lib/ibmcertpathprovider.jar:/usr/java14/jre/lib/ibmjaaslm.jar:/usr/java14/jre/lib/ibmjcefw.jar:/usr/java14/jre/lib/ibmjgssprovider.jar:/usr/java14/jre/lib/ibmjssefips.jar:/usr/java14/jre/lib/ibmjsseprovider.jar:/usr/java14/jre/lib/ibmorb.jar:/usr/java14/jre/lib/ibmorbapi.jar:/usr/java14/jre/lib/ibmpkcs.jar
1CIUSERARGS UserArgs:
2CIUSERARG vfprintf 0x30000D94
2CIUSERARG -Xms512m
2CIUSERARG -Xmx1024m
2CIUSERARG -Duser.timezone=America/New_York
2CIUSERARG -Dweblogic.Name=TazServer
2CIUSERARG -Dweblogic.ProductionModeEnabled=
2CIUSERARG -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy
2CIUSERARG -Dinvokedviajava
2CIUSERARG -Djava.class.path=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2CIUSERARG vfprintf
NULL
1CIJVMMI JVM Monitoring Interface (JVMMI)
NULL ------------------------
2CIJVMMIOFF No events are enabled.
NULL
NULL ------------------------------------------------------------------------
0SECTION DC subcomponent dump routine
NULL ============================
1DCHEADEREYE Header eye catcher DCST
1DCHEADERLEN Header length 24
1DCHEADERVER Header version 1
1DCHEADERMOD Header modification 0
1DCINTERFACE DC Interface at 0xF0947FDC with 15 entries
2DCINTERFACE 1 - dcCString2JavaString 0xF0944A90
2DCINTERFACE 2 - dcInt642CString 0xF0944A9C
2DCINTERFACE 3 - dcJavaString2NewCString 0xF0944AA8
2DCINTERFACE 4 - dcJavaString2CString 0xF0944AB4
2DCINTERFACE 5 - dcJavaString2NewPlatformString 0xF0944AC0
2DCINTERFACE 6 - dcJavaString2UTF 0xF0944ACC
2DCINTERFACE 7 - dcPlatformString2JavaString 0xF0944AE4
2DCINTERFACE 8 - dcUnicode2UTF 0xF0944AF0
2DCINTERFACE 9 - dcUnicode2UTFLength 0xF0944AFC
2DCINTERFACE 10 - dcUTF2JavaString 0xF0944B08
2DCINTERFACE 11 - dcUTFClassName2JavaString 0xF0944B14
2DCINTERFACE 12 - dcJavaString2ClassName 0xF0944AD8
2DCINTERFACE 13 - dcUTF2UnicodeNext 0xF0944B20
2DCINTERFACE 14 - dcVerifyUTF8 0xF0944B2C
2DCINTERFACE 15 - dcDumpRoutine 0xF0944B38
1DCARRAYINFO Array info at 0xF09384A0 with 16 entries
2DCARRAYINFO 1 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 2 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 3 - index 2 signature L name class[] factor 4
2DCARRAYINFO 4 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 5 - index 4 signature Z name bool[] factor 1
2DCARRAYINFO 6 - index 5 signature C name char[] factor 2
2DCARRAYINFO 7 - index 6 signature F name float[] factor 4
2DCARRAYINFO 8 - index 7 signature D name double[] factor 8
2DCARRAYINFO 9 - index 8 signature B name byte[] factor 1
2DCARRAYINFO 10 - index 9 signature S name short[] factor 2
2DCARRAYINFO 11 - index 10 signature I name int[] factor 4
2DCARRAYINFO 12 - index 11 signature J name long[] factor 8
2DCARRAYINFO 13 - index 0 signature 0 name uint[] factor 0
2DCARRAYINFO 14 - index 0 signature 0 name uint1[] factor 0
2DCARRAYINFO 15 - index 0 signature 0 name uint2[] factor 0
2DCARRAYINFO 16 - index 0 signature 0 name uint3[] factor 0
NULL ------------------------------------------------------------------------
0SECTION DG subcomponent dump routine
NULL ============================
1DGTRCENABLED Trace enabled: Yes
2DGTRCTYPE Trace: Internal
2DGTRCBUFFERS Buffer specification: 8k
2DGTRCBUFALLOC Buffers allocated: 0
2DGTRCBUFUSED Buffers in use: 0
1DGJDUMPBUFF Javadump buffer size (allocated): 2621440
NULL ------------------------------------------------------------------------
0SECTION ST subcomponent dump routine
NULL ============================
1STGCMODES Resettable GC: No
1STGCMODES Concurrent GC: No
1STCURHBASE Current Heap Base: 0x300601FC
1STCURHLIM Current Heap Limit: 0x5005FBFC
1STMWHBASE Middleware Heap Base: 0x300601FC
1STMWHLIM Middleware Heap Limit: 0x5005FBFC
1STGCHELPERS Number of GC Helper Threads: 1
1STJVMOPTS -Xconcurrentlevel: 0
1STJVMOPTS -Xconcurrentbackground: 0
1STGCCTR GC Counter: 42
1STAFCTR AF Counter: 42
1STHEAPFREE Bytes of Heap Space Free: 190d3b88
1STHEAPALLOC Bytes of Heap Space Allocated: 1ffffa00
1STSMBASE SM Base: 0x0
1STSMEND SM End: 0x0
1STPAMSTART PAM Start: 0x0
1STPAMEND PAM End: 0x0
1STCOMACTION Compact Action: 0
NULL ------------------------------------------------------------------------
0SECTION XE subcomponent dump routine
NULL ============================
1XETHRESHOLD MMI threshold for java methods is set to 1250
1XEJITINIT JIT is initialized
1XEJVMPIOFF JVMPI is not activated
1XEJNITHRESH MMI threshold for JNI methods is set to 0
1XETRCHIS Trace history length is set to 4
1XEJITDUMP JIT dump routine is not yet implemented.
NULL ------------------------------------------------------------------------
0SECTION LK subcomponent dump routine
NULL ============================
NULL
1LKPOOLINFO Monitor pool info:
2LKPOOLINIT Initial monitor count: 32
2LKPOOLEXPNUM Minimum number of free monitors before expansion: 5
2LKPOOLEXPBY Pool will next be expanded by: 81
2LKPOOLTOTAL Current total number of monitors: 162
2LKPOOLFREE Current number of free monitors: 42
NULL
1LKMONPOOLDUMP Monitor Pool Dump (flat & inflated object-monitors):
2LKMONINUSE sys_mon_t:0x3003EC78 infl_mon_t: 0x3003E6E8:
3LKMONOBJECT java.lang.ref.Reference$Lock@300E02B0/300E02B8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Reference Handler" (0x744B7D28)
2LKMONINUSE sys_mon_t:0x3003ED28 infl_mon_t: 0x3003E714:
3LKMONOBJECT java.lang.ref.ReferenceQueue$Lock@300DFFE8/300DFFF0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Finalizer" (0x745409A8)
2LKMONINUSE sys_mon_t:0x3003EDD8 infl_mon_t: 0x3003E740:
3LKMONOBJECT java.util.TaskQueue@311299D0/311299D8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-1" (0x75F054A8)
2LKMONINUSE sys_mon_t:0x3003EE88 infl_mon_t: 0x3003E76C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9A60/300C9A68: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" (0x765659A8)
2LKMONINUSE sys_mon_t:0x3003EF38 infl_mon_t: 0x3003E798:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C99C0/300C99C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" (0x765693A8)
2LKMONINUSE sys_mon_t:0x3003EFE8 infl_mon_t: 0x3003E7C4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9920/300C9928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" (0x76569928)
2LKMONINUSE sys_mon_t:0x3003F098 infl_mon_t: 0x3003E7F0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9880/300C9888: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" (0x76572BA8)
2LKMONINUSE sys_mon_t:0x3003F148 infl_mon_t: 0x3003E81C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C97E0/300C97E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" (0x767971A8)
2LKMONINUSE sys_mon_t:0x3003F1F8 infl_mon_t: 0x3003E848:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9740/300C9748: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" (0x7681EBA8)
2LKMONINUSE sys_mon_t:0x3003F2A8 infl_mon_t: 0x3003E874:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C96A0/300C96A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" (0x768A65A8)
2LKMONINUSE sys_mon_t:0x3003F358 infl_mon_t: 0x3003E8A0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9600/300C9608: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" (0x7692E028)
2LKMONINUSE sys_mon_t:0x3003F408 infl_mon_t: 0x3003E8CC:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9560/300C9568: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" (0x769B5A28)
2LKMONINUSE sys_mon_t:0x3003F4B8 infl_mon_t: 0x3003E8F8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C94C0/300C94C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" (0x76A3D4A8)
2LKMONINUSE sys_mon_t:0x3003F568 infl_mon_t: 0x3003E924:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9420/300C9428: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" (0x76AC4EA8)
2LKMONINUSE sys_mon_t:0x3003F618 infl_mon_t: 0x3003E950:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9380/300C9388: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" (0x76B4C8A8)
2LKMONINUSE sys_mon_t:0x3003F6C8 infl_mon_t: 0x3003E97C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C92E0/300C92E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" (0x76BD4328)
2LKMONINUSE sys_mon_t:0x3003F778 infl_mon_t: 0x3003E9A8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9240/300C9248: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" (0x76C5BD28)
2LKMONINUSE sys_mon_t:0x3003F828 infl_mon_t: 0x3003E9D4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C91A0/300C91A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" (0x76CE3728)
2LKMONINUSE sys_mon_t:0x3003F988 infl_mon_t: 0x3003EA2C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9060/300C9068: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" (0x76DF2BA8)
2LKMONINUSE sys_mon_t:0x3003FA38 infl_mon_t: 0x3003EA58:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8FC0/300C8FC8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" (0x76E7A628)
2LKMONINUSE sys_mon_t:0x3003FAE8 infl_mon_t: 0x3003EA84:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8F20/300C8F28: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" (0x76F02028)
2LKMONINUSE sys_mon_t:0x3003FB98 infl_mon_t: 0x3003EAB0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8E80/300C8E88: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" (0x76F89A28)
2LKMONINUSE sys_mon_t:0x3003FC48 infl_mon_t: 0x3003EADC:
3LKMONOBJECT weblogic.time.common.internal.TimeTable@32EB9198/32EB91A0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.time.TimeEventGenerator" (0x77013D28)
2LKMONINUSE sys_mon_t:0x3003FCF8 infl_mon_t: 0x3003EB08:
3LKMONOBJECT java.lang.Object@32F56538/32F56540: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.security.SpinnerRandomSource" (0x770CC3A8)
2LKMONINUSE sys_mon_t:0x3003FDA8 infl_mon_t: 0x3003EB34:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8CD0/300C8CD8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" (0x770E4428)
2LKMONINUSE sys_mon_t:0x3003FE58 infl_mon_t: 0x3003EB60:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8C30/300C8C38: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" (0x770E4A28)
2LKMONINUSE sys_mon_t:0x3003FF08 infl_mon_t: 0x3003EB8C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8B90/300C8B98: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" (0x770E5028)
2LKMONINUSE sys_mon_t:0x770E3D38 infl_mon_t: 0x770F13D8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8AF0/300C8AF8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" (0x770F1028)
2LKMONINUSE sys_mon_t:0x770E3DE8 infl_mon_t: 0x770F1404:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8A50/300C8A58: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" (0x770F84A8)
2LKMONINUSE sys_mon_t:0x770E3E98 infl_mon_t: 0x770F1430:
3LKMONOBJECT [email protected]0/300C8928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "VDE Transaction Processor Thread" (0x77531828)
2LKMONINUSE sys_mon_t:0x770F1758 infl_mon_t: 0x770F1488:
3LKMONOBJECT java.util.TaskQueue@30EECD38/30EECD40: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-5" (0x75CCD1A8)
2LKMONINUSE sys_mon_t:0x770F2F88 infl_mon_t: 0x770F1538:
3LKMONOBJECT weblogic.jms.backend.BETimerTree@33C6CFE0/33C6CFE8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" (0x7893DD28)
2LKMONINUSE sys_mon_t:0x770F3038 infl_mon_t: 0x770F1564:
3LKMONOBJECT java.util.TaskQueue@34F10870/34F10878: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-7" (0x78DE09A8)
2LKMONINUSE sys_mon_t:0x770F30E8 infl_mon_t: 0x770F1590:
3LKMONOBJECT java.util.TaskQueue@3C4CB120/3C4CB128: <unowned>
3LKNOTIFYQ Waiting to be notifieMy WebLogic Server hang up sometime. The platform is IBM AIX, weblogic 8.1 with sp3
The following is the thread dump:
NULL ------------------------------------------------------------------------
0SECTION TITLE subcomponent dump routine
NULL ===============================
1TISIGINFO signal 3 received
1TIDATETIME Date: 2007/04/26 at 11:13:10
1TIFILENAME Javacore filename: /var/bea/domains/TazDomain/javacore524292.1177600390.txt
NULL ------------------------------------------------------------------------
0SECTION XHPI subcomponent dump routine
NULL ==============================
1XHTIME Thu Apr 26 11:13:10 2007
1XHSIGRECV SIGQUIT received at 0x0 in <unknown>.
1XHFULLVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
NULL
1XHCURRENTTHD Current Thread Details
NULL ----------------------
2XHCURRSYSTHD "Signal dispatcher" sys_thread_t:0x74427A28
3XHNATIVESTACK Native Stack
NULL ------------
3XHSTACKLINEERR unavailable - stack address not valid
1XHOPENV Operating Environment
NULL ---------------------
2XHHOSTNAME Host : rcirs050:10.1.93.20
2XHOSLEVEL OS Level : AIX 5.3.0.0
2XHCPUS Processors -
3XHCPUARCH Architecture : POWER_PC (impl: unknown, ver: unknown)
3XHNUMCPUS How Many : 2
3XHCPUSENABLED Enabled : 2
NULL
1XHUSERLIMITS User Limits (in bytes except for NOFILE and NPROC) -
NULL -----------
2XHUSERLIMIT RLIMIT_FSIZE : 1073741312
2XHUSERLIMIT RLIMIT_DATA : 2147483645
2XHUSERLIMIT RLIMIT_STACK : 33554432
2XHUSERLIMIT RLIMIT_CORE : 1073741312
2XHUSERLIMIT RLIMIT_NOFILE : 1024
2XHLIMIT NPROC(max) : 128
NULL
1XHPAGESPACES Page Space (in blocks) -
NULL ----------
2XHPAGESPACE /dev/hd6: size=262144, free=261912
2XHPAGESPACE /dev/paging03: size=507904, free=507672
2XHPAGESPACE /dev/paging00: size=262144, free=261917
2XHPAGESPACE /dev/paging01: size=262144, free=261903
2XHPAGESPACE /dev/paging02: size=262144, free=261901
2XHPAGESPACE /dev/paging04: size=262144, free=260986
2XHPAGESPACE /dev/paging07: size=262144, free=261911
2XHPAGESPACE /dev/paging06: size=262144, free=261913
2XHPAGESPACE /dev/paging05: size=262144, free=261913
NULL
1XHSIGHANDLERS JVM Signal Handlers
NULL -------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHSIGHANDLERS Chained Signal Handlers
NULL -----------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHENVVARS Environment Variables
NULL ---------------------
2XHENVVAR _=/usr/java14/bin/java
2XHENVVAR JAVA_VENDOR=IBM
2XHENVVAR LANG=C
2XHENVVAR PRODUCTION_MODE=
2XHENVVAR LOGIN=qatadm
2XHENVVAR CLASSPATHSEP=:
2XHENVVAR VISUAL=vi
2XHENVVAR POINTBASE_HOME=/opt/bea/weblogic81/common/eval/pointbase
2XHENVVAR PATH=/opt/bea/weblogic81/server/bin:/usr/java14/jre/bin:/usr/java14/bin:/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/qatadm/bin:/usr/bin/X11:/sbin:.:/usr/java14/bin
2XHENVVAR JAVA_VM=
2XHENVVAR LC__FASTMSG=true
2XHENVVAR POINTBASE_CLASSPATH=:/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar
2XHENVVAR CLASSPATH=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2XHENVVAR LOGNAME=qatadm
2XHENVVAR MAIL=/usr/spool/mail/qatadm
2XHENVVAR POINTBASE_TOOLS=/opt/bea/weblogic81/common/eval/pointbase/lib/pbtools44.jar
2XHENVVAR LOCPATH=/usr/lib/nls/loc
2XHENVVAR PS1=rcirs050:$PWD>
2XHENVVAR PATHSEP=:
2XHENVVAR USER=qatadm
2XHENVVAR AUTHSTATE=compat
2XHENVVAR BEA_HOME=/opt/bea
2XHENVVAR DCE_USE_WCHAR_NAMES=1
2XHENVVAR SHELL=/usr/bin/ksh
2XHENVVAR ODMDIR=/etc/objrepos
2XHENVVAR JAVA_HOME=/usr/java14
2XHENVVAR TIMEOUT=900
2XHENVVAR TMOUT=900
2XHENVVAR HOME=/home/qatadm
2XHENVVAR MEM_ARGS=-Xms512m -Xmx1024m
2XHENVVAR WEBLOGIC_CLASSPATH=/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar
2XHENVVAR TERM=dtterm
2XHENVVAR MAILMSG=[YOU HAVE NEW MAIL]
2XHENVVAR PWD=/var/bea/domains/TazDomain
2XHENVVAR TZ=EST5EDT
2XHENVVAR WL_HOME=/opt/bea/weblogic81
2XHENVVAR AIXTHREAD_SCOPE=S
2XHENVVAR A__z=! LOGNAME="*TMOUT
2XHENVVAR _IBM_JAVA_PIPE_524292=
2XHENVVAR IBM_JVM_LIBPATH_OLD_VALUE=/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_LIBPATH_NEW_VALUE=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_CHANGED_ENVVARS_524292=LIBPATH,LDR_CNTRL
2XHENVVAR IBM_JVM_LDR_CNTRL_NEW_VALUE=MAXDATA=0XA0000000@DSA
2XHENVVAR LDR_CNTRL=MAXDATA=0XA0000000@DSA
2XHENVVAR NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
2XHENVVAR LIBPATH=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR _IBM_ENV_INITIAL_524292=805345384
2XHENVVAR IBM_JAVA_COMMAND_LINE=/usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
NULL
1XHLOADEDLIBS Loaded Libraries (sizes in bytes)
NULL ---------------------------------
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libmuxer.so
3XHLIBSIZE filesize : 20757
3XHLIBSTART text start : 0xD0B88000
3XHLIBLDSIZE text size : 0x282E
3XHLIBLDORG data start : 0xF0617CF4
3XHLIBLDDATASZ data size : 0x2AC
2XHLIBNAME /usr/java14/jre/bin/libnio.a
3XHLIBSIZE filesize : 64305
3XHLIBSTART text start : 0xD11F5000
3XHLIBLDSIZE text size : 0x8EF0
3XHLIBLDORG data start : 0xF0615AE0
3XHLIBLDDATASZ data size : 0x594
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libweblogicunix1.so
3XHLIBSIZE filesize : 14536
3XHLIBSTART text start : 0xD0B86000
3XHLIBLDSIZE text size : 0x1B90
3XHLIBLDORG data start : 0xF0614484
3XHLIBLDDATASZ data size : 0xD8
2XHLIBNAME /usr/java14/jre/bin/libnet.a
3XHLIBSIZE filesize : 137885
3XHLIBSTART text start : 0xD15D7000
3XHLIBLDSIZE text size : 0x161FF
3XHLIBLDORG data start : 0xF05DE3D8
3XHLIBLDDATASZ data size : 0x968
2XHLIBNAME /usr/java14/jre/bin/libjitc.a
3XHLIBSIZE filesize : 2814544
3XHLIBSTART text start : 0xD252E000
3XHLIBLDSIZE text size : 0x23EE7B
3XHLIBLDORG data start : 0xF0962B68
3XHLIBLDDATASZ data size : 0x1A984
2XHLIBNAME /usr/lib/security/DCE
3XHLIBSIZE filesize : 27634
3XHLIBSTART text start : 0xD0B7A000
3XHLIBLDSIZE text size : 0x6BF2
3XHLIBLDORG data start : 0xF05CEA38
3XHLIBLDDATASZ data size : 0x2BA0
2XHLIBNAME /usr/java14/jre/bin/libzip.a
3XHLIBSIZE filesize : 109746
3XHLIBSTART text start : 0xD11E1000
3XHLIBLDSIZE text size : 0x135E2
3XHLIBLDORG data start : 0xF05DC468
3XHLIBLDDATASZ data size : 0x1918
2XHLIBNAME /usr/java14/jre/bin/classic/libcore.a
3XHLIBSIZE filesize : 136713
3XHLIBSTART text start : 0xD11CB000
3XHLIBLDSIZE text size : 0x15248
3XHLIBLDORG data start : 0xF05DA0E8
3XHLIBLDDATASZ data size : 0x1620
2XHLIBNAME /usr/java14/jre/bin/libjava.a
3XHLIBSIZE filesize : 221158
3XHLIBSTART text start : 0xD11AB000
3XHLIBLDSIZE text size : 0x1FEB2
3XHLIBLDORG data start : 0xF05D88F8
3XHLIBLDDATASZ data size : 0x16F8
2XHLIBNAME /usr/java14/jre/bin/libhpi.a
3XHLIBSIZE filesize : 205732
3XHLIBSTART text start : 0xD118C000
3XHLIBLDSIZE text size : 0x1EE0E
3XHLIBLDORG data start : 0xF06045A0
3XHLIBLDDATASZ data size : 0xF8D0
2XHLIBNAME /usr/java14/jre/bin/libxhpi.a
3XHLIBSIZE filesize : 14654
3XHLIBSTART text start : 0xD0B84000
3XHLIBLDSIZE text size : 0x1B52
3XHLIBLDORG data start : 0xF05D7290
3XHLIBLDDATASZ data size : 0x2C8
2XHLIBNAME /usr/java14/jre/bin/libdbgmalloc.a
3XHLIBSIZE filesize : 15267
3XHLIBSTART text start : 0xD0B81000
3XHLIBLDSIZE text size : 0x217C
3XHLIBLDORG data start : 0xF05D6988
3XHLIBLDDATASZ data size : 0x218
2XHLIBNAME /usr/java14/jre/bin/libjsig.a
3XHLIBSIZE filesize : 14412
3XHLIBSTART text start : 0xD07F8000
3XHLIBLDSIZE text size : 0x1B24
3XHLIBLDORG data start : 0xF05D54B0
3XHLIBLDDATASZ data size : 0x108
2XHLIBNAME /usr/java14/jre/bin/libute.a
3XHLIBSIZE filesize : 112768
3XHLIBSTART text start : 0xD1177000
3XHLIBLDSIZE text size : 0x14ED9
3XHLIBLDORG data start : 0xF05D43B0
3XHLIBLDDATASZ data size : 0x674
2XHLIBNAME /usr/lib/libdl.a
3XHLIBSIZE filesize : 5248
3XHLIBSTART text start : 0xD02E70F8
3XHLIBLDSIZE text size : 0x1E0
3XHLIBLDORG data start : 0xF03190F8
3XHLIBLDDATASZ data size : 0x0
2XHLIBNAME /usr/java14/jre/bin/sovvm/libjvm.a
3XHLIBSIZE filesize : 2857303
3XHLIBSTART text start : 0xD2335000
3XHLIBLDSIZE text size : 0x1F8E31
3XHLIBLDORG data start : 0xF0936290
3XHLIBLDDATASZ data size : 0x2AE10
2XHLIBNAME /usr/java14/jre/bin/classic/libjvm.a
3XHLIBSIZE filesize : 117748
3XHLIBSTART text start : 0xD1169000
3XHLIBLDSIZE text size : 0xD54B
3XHLIBLDORG data start : 0xF05D2A90
3XHLIBLDDATASZ data size : 0xF0C
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01E7540
3XHLIBLDSIZE text size : 0x20F6D
3XHLIBLDORG data start : 0xF0381340
3XHLIBLDDATASZ data size : 0x6780
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01CDBC0
3XHLIBLDSIZE text size : 0x186CC
3XHLIBLDORG data start : 0xF0377FC0
3XHLIBLDDATASZ data size : 0x84C9
2XHLIBNAME /usr/lib/libcrypt.a
3XHLIBSIZE filesize : 11019
3XHLIBSTART text start : 0xD01450F8
3XHLIBLDSIZE text size : 0x846
3XHLIBLDORG data start : 0xF0316508
3XHLIBLDDATASZ data size : 0x128
2XHLIBNAME /usr/lib/libiconv.a
3XHLIBSIZE filesize : 377727
3XHLIBSTART text start : 0xD05BF100
3XHLIBLDSIZE text size : 0x139C1
3XHLIBLDORG data start : 0xF0252C70
3XHLIBLDDATASZ data size : 0xA2E4
2XHLIBNAME /usr/lib/libbsd.a
3XHLIBSIZE filesize : 61862
3XHLIBSTART text start : 0xD02784C0
3XHLIBLDSIZE text size : 0x7D2F
3XHLIBLDORG data start : 0xF0213A30
3XHLIBLDDATASZ data size : 0x13D8
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010E000
3XHLIBLDSIZE text size : 0x365C4
3XHLIBLDORG data start : 0xF0370000
3XHLIBLDDATASZ data size : 0x4024
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010A000
3XHLIBLDSIZE text size : 0x3C52
3XHLIBLDORG data start : 0xF032D000
3XHLIBLDDATASZ data size : 0x424A8
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01AD100
3XHLIBLDSIZE text size : 0x1FED1
3XHLIBLDORG data start : 0xF0388D00
3XHLIBLDDATASZ data size : 0x30F9
2XHLIBNAME /usr/lib/libc.a
3XHLIBSIZE filesize : 8270989
3XHLIBSTART text start : 0xD02F2240
3XHLIBLDSIZE text size : 0x251155
3XHLIBLDORG data start : 0xF0278BC0
3XHLIBLDDATASZ data size : 0x9D340
NULL
NULL ------------------------------------------------------------------------
0SECTION CI subcomponent dump routine
NULL ============================
1CIJAVAVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
1CIRUNNINGAS Running as a standalone JVM
1CICMDLINE /usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
1CIJAVAHOMEDIR Java Home Dir: /usr/java14/jre
1CIJAVADLLDIR Java DLL Dir: /usr/java14/jre/bin
1CISYSCP Sys Classpath: /usr/java14/jre/lib/core.jar:/usr/java14/jre/lib/graphics.jar:/usr/java14/jre/lib/security.jar:/usr/java14/jre/lib/server.jar:/usr/java14/jre/lib/xml.jar:/usr/java14/jre/lib/charsets.jar:/usr/java14/jre/classes:/usr/java14/jre/lib/ibmcertpathprovider.jar:/usr/java14/jre/lib/ibmjaaslm.jar:/usr/java14/jre/lib/ibmjcefw.jar:/usr/java14/jre/lib/ibmjgssprovider.jar:/usr/java14/jre/lib/ibmjssefips.jar:/usr/java14/jre/lib/ibmjsseprovider.jar:/usr/java14/jre/lib/ibmorb.jar:/usr/java14/jre/lib/ibmorbapi.jar:/usr/java14/jre/lib/ibmpkcs.jar
1CIUSERARGS UserArgs:
2CIUSERARG vfprintf 0x30000D94
2CIUSERARG -Xms512m
2CIUSERARG -Xmx1024m
2CIUSERARG -Duser.timezone=America/New_York
2CIUSERARG -Dweblogic.Name=TazServer
2CIUSERARG -Dweblogic.ProductionModeEnabled=
2CIUSERARG -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy
2CIUSERARG -Dinvokedviajava
2CIUSERARG -Djava.class.path=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2CIUSERARG vfprintf
NULL
1CIJVMMI JVM Monitoring Interface (JVMMI)
NULL ------------------------
2CIJVMMIOFF No events are enabled.
NULL
NULL ------------------------------------------------------------------------
0SECTION DC subcomponent dump routine
NULL ============================
1DCHEADEREYE Header eye catcher DCST
1DCHEADERLEN Header length 24
1DCHEADERVER Header version 1
1DCHEADERMOD Header modification 0
1DCINTERFACE DC Interface at 0xF0947FDC with 15 entries
2DCINTERFACE 1 - dcCString2JavaString 0xF0944A90
2DCINTERFACE 2 - dcInt642CString 0xF0944A9C
2DCINTERFACE 3 - dcJavaString2NewCString 0xF0944AA8
2DCINTERFACE 4 - dcJavaString2CString 0xF0944AB4
2DCINTERFACE 5 - dcJavaString2NewPlatformString 0xF0944AC0
2DCINTERFACE 6 - dcJavaString2UTF 0xF0944ACC
2DCINTERFACE 7 - dcPlatformString2JavaString 0xF0944AE4
2DCINTERFACE 8 - dcUnicode2UTF 0xF0944AF0
2DCINTERFACE 9 - dcUnicode2UTFLength 0xF0944AFC
2DCINTERFACE 10 - dcUTF2JavaString 0xF0944B08
2DCINTERFACE 11 - dcUTFClassName2JavaString 0xF0944B14
2DCINTERFACE 12 - dcJavaString2ClassName 0xF0944AD8
2DCINTERFACE 13 - dcUTF2UnicodeNext 0xF0944B20
2DCINTERFACE 14 - dcVerifyUTF8 0xF0944B2C
2DCINTERFACE 15 - dcDumpRoutine 0xF0944B38
1DCARRAYINFO Array info at 0xF09384A0 with 16 entries
2DCARRAYINFO 1 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 2 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 3 - index 2 signature L name class[] factor 4
2DCARRAYINFO 4 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 5 - index 4 signature Z name bool[] factor 1
2DCARRAYINFO 6 - index 5 signature C name char[] factor 2
2DCARRAYINFO 7 - index 6 signature F name float[] factor 4
2DCARRAYINFO 8 - index 7 signature D name double[] factor 8
2DCARRAYINFO 9 - index 8 signature B name byte[] factor 1
2DCARRAYINFO 10 - index 9 signature S name short[] factor 2
2DCARRAYINFO 11 - index 10 signature I name int[] factor 4
2DCARRAYINFO 12 - index 11 signature J name long[] factor 8
2DCARRAYINFO 13 - index 0 signature 0 name uint[] factor 0
2DCARRAYINFO 14 - index 0 signature 0 name uint1[] factor 0
2DCARRAYINFO 15 - index 0 signature 0 name uint2[] factor 0
2DCARRAYINFO 16 - index 0 signature 0 name uint3[] factor 0
NULL ------------------------------------------------------------------------
0SECTION DG subcomponent dump routine
NULL ============================
1DGTRCENABLED Trace enabled: Yes
2DGTRCTYPE Trace: Internal
2DGTRCBUFFERS Buffer specification: 8k
2DGTRCBUFALLOC Buffers allocated: 0
2DGTRCBUFUSED Buffers in use: 0
1DGJDUMPBUFF Javadump buffer size (allocated): 2621440
NULL ------------------------------------------------------------------------
0SECTION ST subcomponent dump routine
NULL ============================
1STGCMODES Resettable GC: No
1STGCMODES Concurrent GC: No
1STCURHBASE Current Heap Base: 0x300601FC
1STCURHLIM Current Heap Limit: 0x5005FBFC
1STMWHBASE Middleware Heap Base: 0x300601FC
1STMWHLIM Middleware Heap Limit: 0x5005FBFC
1STGCHELPERS Number of GC Helper Threads: 1
1STJVMOPTS -Xconcurrentlevel: 0
1STJVMOPTS -Xconcurrentbackground: 0
1STGCCTR GC Counter: 42
1STAFCTR AF Counter: 42
1STHEAPFREE Bytes of Heap Space Free: 190d3b88
1STHEAPALLOC Bytes of Heap Space Allocated: 1ffffa00
1STSMBASE SM Base: 0x0
1STSMEND SM End: 0x0
1STPAMSTART PAM Start: 0x0
1STPAMEND PAM End: 0x0
1STCOMACTION Compact Action: 0
NULL ------------------------------------------------------------------------
0SECTION XE subcomponent dump routine
NULL ============================
1XETHRESHOLD MMI threshold for java methods is set to 1250
1XEJITINIT JIT is initialized
1XEJVMPIOFF JVMPI is not activated
1XEJNITHRESH MMI threshold for JNI methods is set to 0
1XETRCHIS Trace history length is set to 4
1XEJITDUMP JIT dump routine is not yet implemented.
NULL ------------------------------------------------------------------------
0SECTION LK subcomponent dump routine
NULL ============================
NULL
1LKPOOLINFO Monitor pool info:
2LKPOOLINIT Initial monitor count: 32
2LKPOOLEXPNUM Minimum number of free monitors before expansion: 5
2LKPOOLEXPBY Pool will next be expanded by: 81
2LKPOOLTOTAL Current total number of monitors: 162
2LKPOOLFREE Current number of free monitors: 42
NULL
1LKMONPOOLDUMP Monitor Pool Dump (flat & inflated object-monitors):
2LKMONINUSE sys_mon_t:0x3003EC78 infl_mon_t: 0x3003E6E8:
3LKMONOBJECT java.lang.ref.Reference$Lock@300E02B0/300E02B8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Reference Handler" (0x744B7D28)
2LKMONINUSE sys_mon_t:0x3003ED28 infl_mon_t: 0x3003E714:
3LKMONOBJECT java.lang.ref.ReferenceQueue$Lock@300DFFE8/300DFFF0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Finalizer" (0x745409A8)
2LKMONINUSE sys_mon_t:0x3003EDD8 infl_mon_t: 0x3003E740:
3LKMONOBJECT java.util.TaskQueue@311299D0/311299D8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-1" (0x75F054A8)
2LKMONINUSE sys_mon_t:0x3003EE88 infl_mon_t: 0x3003E76C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9A60/300C9A68: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" (0x765659A8)
2LKMONINUSE sys_mon_t:0x3003EF38 infl_mon_t: 0x3003E798:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C99C0/300C99C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" (0x765693A8)
2LKMONINUSE sys_mon_t:0x3003EFE8 infl_mon_t: 0x3003E7C4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9920/300C9928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" (0x76569928)
2LKMONINUSE sys_mon_t:0x3003F098 infl_mon_t: 0x3003E7F0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9880/300C9888: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" (0x76572BA8)
2LKMONINUSE sys_mon_t:0x3003F148 infl_mon_t: 0x3003E81C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C97E0/300C97E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" (0x767971A8)
2LKMONINUSE sys_mon_t:0x3003F1F8 infl_mon_t: 0x3003E848:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9740/300C9748: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" (0x7681EBA8)
2LKMONINUSE sys_mon_t:0x3003F2A8 infl_mon_t: 0x3003E874:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C96A0/300C96A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" (0x768A65A8)
2LKMONINUSE sys_mon_t:0x3003F358 infl_mon_t: 0x3003E8A0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9600/300C9608: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" (0x7692E028)
2LKMONINUSE sys_mon_t:0x3003F408 infl_mon_t: 0x3003E8CC:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9560/300C9568: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" (0x769B5A28)
2LKMONINUSE sys_mon_t:0x3003F4B8 infl_mon_t: 0x3003E8F8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C94C0/300C94C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" (0x76A3D4A8)
2LKMONINUSE sys_mon_t:0x3003F568 infl_mon_t: 0x3003E924:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9420/300C9428: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" (0x76AC4EA8)
2LKMONINUSE sys_mon_t:0x3003F618 infl_mon_t: 0x3003E950:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9380/300C9388: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" (0x76B4C8A8)
2LKMONINUSE sys_mon_t:0x3003F6C8 infl_mon_t: 0x3003E97C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C92E0/300C92E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" (0x76BD4328)
2LKMONINUSE sys_mon_t:0x3003F778 infl_mon_t: 0x3003E9A8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9240/300C9248: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" (0x76C5BD28)
2LKMONINUSE sys_mon_t:0x3003F828 infl_mon_t: 0x3003E9D4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C91A0/300C91A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" (0x76CE3728)
2LKMONINUSE sys_mon_t:0x3003F988 infl_mon_t: 0x3003EA2C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9060/300C9068: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" (0x76DF2BA8)
2LKMONINUSE sys_mon_t:0x3003FA38 infl_mon_t: 0x3003EA58:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8FC0/300C8FC8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" (0x76E7A628)
2LKMONINUSE sys_mon_t:0x3003FAE8 infl_mon_t: 0x3003EA84:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8F20/300C8F28: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" (0x76F02028)
2LKMONINUSE sys_mon_t:0x3003FB98 infl_mon_t: 0x3003EAB0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8E80/300C8E88: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" (0x76F89A28)
2LKMONINUSE sys_mon_t:0x3003FC48 infl_mon_t: 0x3003EADC:
3LKMONOBJECT weblogic.time.common.internal.TimeTable@32EB9198/32EB91A0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.time.TimeEventGenerator" (0x77013D28)
2LKMONINUSE sys_mon_t:0x3003FCF8 infl_mon_t: 0x3003EB08:
3LKMONOBJECT java.lang.Object@32F56538/32F56540: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.security.SpinnerRandomSource" (0x770CC3A8)
2LKMONINUSE sys_mon_t:0x3003FDA8 infl_mon_t: 0x3003EB34:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8CD0/300C8CD8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" (0x770E4428)
2LKMONINUSE sys_mon_t:0x3003FE58 infl_mon_t: 0x3003EB60:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8C30/300C8C38: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" (0x770E4A28)
2LKMONINUSE sys_mon_t:0x3003FF08 infl_mon_t: 0x3003EB8C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8B90/300C8B98: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" (0x770E5028)
2LKMONINUSE sys_mon_t:0x770E3D38 infl_mon_t: 0x770F13D8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8AF0/300C8AF8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" (0x770F1028)
2LKMONINUSE sys_mon_t:0x770E3DE8 infl_mon_t: 0x770F1404:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8A50/300C8A58: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" (0x770F84A8)
2LKMONINUSE sys_mon_t:0x770E3E98 infl_mon_t: 0x770F1430:
3LKMONOBJECT [email protected]0/300C8928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "VDE Transaction Processor Thread" (0x77531828)
2LKMONINUSE sys_mon_t:0x770F1758 infl_mon_t: 0x770F1488:
3LKMONOBJECT java.util.TaskQueue@30EECD38/30EECD40: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-5" (0x75CCD1A8)
2LKMONINUSE sys_mon_t:0x770F2F88 infl_mon_t: 0x770F1538:
3LKMONOBJECT weblogic.jms.backend.BETimerTree@33C6CFE0/33C6CFE8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" (0x7893DD28)
2LKMONINUSE sys_mon_t:0x770F3038 infl_mon_t: 0x770F1564:
3LKMONOBJECT java.util.TaskQueue@34F10870/34F10878: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-7" (0x78DE09A8)
2LKMONINUSE sys_mon_t:0x770F30E8 infl_mon_t: 0x770F1590:
3LKMONOBJECT java.util.TaskQueue@3C4CB120/3C4CB128: <unowned>
3LKNOTIFYQ Waiting to be notifie -
Weblogic 5.1 SP4 Hangs in stress test
Hi,
I am trying to stress test my application. I am using
Weblogic 5.1 SP4 JDK 1.2.2 on Windows NT.
The stress test client creates 20 threads and makes
simultaneous requests to the Weblogic Server. This hangs the
server completely. I am not able to ping the server, attach to it
via Weblogic console or anything else.
The relevant parameters are
weblogic.system.executeThreadCount=15
weblogic.system.nativeIO.enable=true
The thread dump shows all the threads trying in read (socket).
I have attached the thread dump. I would really appreciate if
someone can explain WHY Weblogic is hanging and how do I fix
this problem.
Thanks,
Mihir
Full thread dump Classic VM (JDK-1.2.2-W, native threads):
"ListenThread" (TID:0xdfe7a0, sys_thread_t:0xafbe70, state:R, native
ID:0x13
0) prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
at java.net.ServerSocket.implAccept(ServerSocket.java:240)
at java.net.ServerSocket.accept(ServerSocket.java:224)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:277)
"ExecuteThread-14" (TID:0xdeff90, sys_thread_t:0x9e0de0, state:R, native
ID:
0x142) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-13" (TID:0xdefe10, sys_thread_t:0x9e0c80, state:R, native
ID:
0x106) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-12" (TID:0xdefcb8, sys_thread_t:0x9e0b20, state:R, native
ID:
0xac) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-11" (TID:0xdefb80, sys_thread_t:0x9e09c0, state:R, native
ID:
0x49) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-10" (TID:0xdefa00, sys_thread_t:0x9e0860, state:R, native
ID:
0x139) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-9" (TID:0xdef8a8, sys_thread_t:0x9e0700, state:R, native
ID:0
x12c) prio=5
at weblogic.socket.NTSocketMuxer.getNextSocket(Native Method)
at
weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:326)
at
weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:
23)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-8" (TID:0xdef770, sys_thread_t:0x9e05a0, state:R, native
ID:0
x11f) prio=5
at weblogic.socket.NTSocketMuxer.getNextSocket(Native Method)
at
weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:326)
at
weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:
23)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-7" (TID:0xdef5f8, sys_thread_t:0x9e0440, state:R, native
ID:0
x160) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-6" (TID:0xdef4a0, sys_thread_t:0x9e02e0, state:R, native
ID:0
x13e) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-5" (TID:0xdef340, sys_thread_t:0x9e0180, state:R, native
ID:0
x15b) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-4" (TID:0xdef1f0, sys_thread_t:0x9dfa30, state:R, native
ID:0
x155) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-3" (TID:0xdef098, sys_thread_t:0x9df530, state:R, native
ID:0
x16c) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:90)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:190)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:229)
at java.io.BufferedInputStream.read(BufferedInputStream.java:285)
at java.io.FilterInputStream.read(FilterInputStream.java:118)
at java.io.PushbackInputStream.read(PushbackInputStream.java:168)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
at org.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
at com.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:772)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-2" (TID:0xdeef50, sys_thread_t:0x9df200, state:R, native
ID:0
x16b) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInpHi Sam,
I've experienced deadlocking socket problems from my entity beans before,
except in my app I created my own HttpConnections. And like you said,
increasing the threads only temporarily solves the problem until the
requests scale up again... However, your solution, reading file from the
file system, doesn't seem much safer either, for according to ejb specs one
should not use java.io!
If I were to grab my connections from a Connection Factory registered in
weblogic.properties, will this alleviate the deadlocks? Is there a Weblogic
implementation for File ResourceBundle?
Gene Chuang
Teach the world. Join Kiko!
http://www.kiko.com/profile/join.jsp?refcode=TAF-gchuang
"WebLogic" <[email protected]> wrote in message
news:[email protected]...
Since Xerces is trying to open connections back to the server you are
running xerces in you are seeing
a classic deadlock condition. All of the execute threads are being usedup
by xereces waiting to read
a file that requires an execute thread to be available. You can try
increasing the number of threads, however,
it is difficult to avoid this problem when you are making loopback
connections. I suggest that you write
an entity resolver that does not make http connections back to the same
server, instead it would read the
file from the file system so that you cannot get in this deadlocksituation.
>
Sam
"Mihir Mehta" <[email protected]> wrote in message
news:[email protected]...
It does not look like a Xerces problem as all the threads that are
reading
the posted data are runnable.
Mihir
"Gene Chuang" <[email protected]> wrote in message
news:[email protected]...
Possibly a Xerces problem? Which version are u using?
Gene Chuang
Teach the world. Join Kiko!
http://www.kiko.com/profile/join.jsp?refcode=TAF-gchuang
"Mihir Mehta" <[email protected]> wrote in message
news:[email protected]...
Hi,
I am trying to stress test my application. I am using
Weblogic 5.1 SP4 JDK 1.2.2 on Windows NT.
The stress test client creates 20 threads and makes
simultaneous requests to the Weblogic Server. This hangs the
server completely. I am not able to ping the server, attach to it
via Weblogic console or anything else.
The relevant parameters are
weblogic.system.executeThreadCount=15
weblogic.system.nativeIO.enable=true
The thread dump shows all the threads trying in read (socket).
I have attached the thread dump. I would really appreciate if
someone can explain WHY Weblogic is hanging and how do I fix
this problem.
Thanks,
Mihir
Full thread dump Classic VM (JDK-1.2.2-W, native threads):
"ListenThread" (TID:0xdfe7a0, sys_thread_t:0xafbe70, state:R,
native
ID:0x13
0) prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
at java.net.ServerSocket.implAccept(ServerSocket.java:240)
at java.net.ServerSocket.accept(ServerSocket.java:224)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:277)
"ExecuteThread-14" (TID:0xdeff90, sys_thread_t:0x9e0de0,
state:R,
native
ID:
0x142) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at
java.net.SocketInputStream.read(SocketInputStream.java:90)
atjava.io.BufferedInputStream.fill(BufferedInputStream.java:190)
atjava.io.BufferedInputStream.read1(BufferedInputStream.java:229)
atjava.io.BufferedInputStream.read(BufferedInputStream.java:285)
at
java.io.FilterInputStream.read(FilterInputStream.java:118)
atjava.io.PushbackInputStream.read(PushbackInputStream.java:168)
at
sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
atorg.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
>>>>
atcom.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:772)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
>>>>
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-13" (TID:0xdefe10, sys_thread_t:0x9e0c80,state:R,
native
ID:
0x106) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at
java.net.SocketInputStream.read(SocketInputStream.java:90)
atjava.io.BufferedInputStream.fill(BufferedInputStream.java:190)
atjava.io.BufferedInputStream.read1(BufferedInputStream.java:229)
atjava.io.BufferedInputStream.read(BufferedInputStream.java:285)
at
java.io.FilterInputStream.read(FilterInputStream.java:118)
atjava.io.PushbackInputStream.read(PushbackInputStream.java:168)
at
sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
atorg.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
>>>>
atcom.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:772)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
>>>>
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-12" (TID:0xdefcb8, sys_thread_t:0x9e0b20,state:R,
native
ID:
0xac) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at
java.net.SocketInputStream.read(SocketInputStream.java:90)
atjava.io.BufferedInputStream.fill(BufferedInputStream.java:190)
atjava.io.BufferedInputStream.read1(BufferedInputStream.java:229)
atjava.io.BufferedInputStream.read(BufferedInputStream.java:285)
at
java.io.FilterInputStream.read(FilterInputStream.java:118)
atjava.io.PushbackInputStream.read(PushbackInputStream.java:168)
at
sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
atorg.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
>>>>
atcom.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:772)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
>>>>
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-11" (TID:0xdefb80, sys_thread_t:0x9e09c0,state:R,
native
ID:
0x49) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at
java.net.SocketInputStream.read(SocketInputStream.java:90)
atjava.io.BufferedInputStream.fill(BufferedInputStream.java:190)
atjava.io.BufferedInputStream.read1(BufferedInputStream.java:229)
atjava.io.BufferedInputStream.read(BufferedInputStream.java:285)
at
java.io.FilterInputStream.read(FilterInputStream.java:118)
atjava.io.PushbackInputStream.read(PushbackInputStream.java:168)
at
sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
atorg.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
>>>>
atcom.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:772)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
>>>>
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-10" (TID:0xdefa00, sys_thread_t:0x9e0860,state:R,
native
ID:
0x139) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at
java.net.SocketInputStream.read(SocketInputStream.java:90)
atjava.io.BufferedInputStream.fill(BufferedInputStream.java:190)
atjava.io.BufferedInputStream.read1(BufferedInputStream.java:229)
atjava.io.BufferedInputStream.read(BufferedInputStream.java:285)
at
java.io.FilterInputStream.read(FilterInputStream.java:118)
atjava.io.PushbackInputStream.read(PushbackInputStream.java:168)
at
sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
atorg.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
>>>>
atcom.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:772)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
>>>>
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-9" (TID:0xdef8a8, sys_thread_t:0x9e0700, state:R,native
ID:0
x12c) prio=5
at weblogic.socket.NTSocketMuxer.getNextSocket(Native
Method)
at
weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:326)
at
weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:
23)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-8" (TID:0xdef770, sys_thread_t:0x9e05a0, state:R,native
ID:0
x11f) prio=5
at weblogic.socket.NTSocketMuxer.getNextSocket(Native
Method)
at
weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:326)
at
weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:
23)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-7" (TID:0xdef5f8, sys_thread_t:0x9e0440, state:R,native
ID:0
x160) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at
java.net.SocketInputStream.read(SocketInputStream.java:90)
atjava.io.BufferedInputStream.fill(BufferedInputStream.java:190)
atjava.io.BufferedInputStream.read1(BufferedInputStream.java:229)
atjava.io.BufferedInputStream.read(BufferedInputStream.java:285)
at
java.io.FilterInputStream.read(FilterInputStream.java:118)
atjava.io.PushbackInputStream.read(PushbackInputStream.java:168)
at
sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
atorg.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
>>>>
atcom.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:772)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
>>>>
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-6" (TID:0xdef4a0, sys_thread_t:0x9e02e0, state:R,native
ID:0
x13e) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at
java.net.SocketInputStream.read(SocketInputStream.java:90)
atjava.io.BufferedInputStream.fill(BufferedInputStream.java:190)
atjava.io.BufferedInputStream.read1(BufferedInputStream.java:229)
atjava.io.BufferedInputStream.read(BufferedInputStream.java:285)
at
java.io.FilterInputStream.read(FilterInputStream.java:118)
atjava.io.PushbackInputStream.read(PushbackInputStream.java:168)
at
sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framework.XMLDocumentScanner.parseSome(XMLDocumentS
canner.java:380)
atorg.apache.xerces.framework.XMLParser.parse(XMLParser.java:861)
at
com.mycompanyxml.MyXMLDocument.createDocument(MyXMLDocument.java:125)
>>>>
atcom.mycompanyxml.MyXMLDocument.<init>(MyXMLDocument.java:86)
at
com.mycompanyintegration.servlet.MyCompanyXMLCmdServlet.doPost(MyCompanyXMLC
m
dServlet.java:65)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:772)
atjavax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubIm
pl.java:124)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:744)
at
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletCon
textImpl.java:692)
at
weblogic.servlet.internal.ServletContextManager.invokeServlet(Servlet
ContextManager.java:251)
at
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.jav
a:363)
at
weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:263)
>>>>
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-5" (TID:0xdef340, sys_thread_t:0x9e0180, state:R,native
ID:0
x15b) prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at
java.net.SocketInputStream.read(SocketInputStream.java:90)
atjava.io.BufferedInputStream.fill(BufferedInputStream.java:190)
atjava.io.BufferedInputStream.read1(BufferedInputStream.java:229)
atjava.io.BufferedInputStream.read(BufferedInputStream.java:285)
at
java.io.FilterInputStream.read(FilterInputStream.java:118)
atjava.io.PushbackInputStream.read(PushbackInputStream.java:168)
at
sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:516)
at
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLCon
nection.java:466)
at java.net.URL.openStream(URL.java:818)
at
org.apache.xerces.readers.DefaultReaderFactory.createReader(DefaultRe
aderFactory.java:149)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alEntity(DefaultEntityHandler.java:747)
at
org.apache.xerces.readers.DefaultEntityHandler.startReadingFromExtern
alSubset(DefaultEntityHandler.java:566)
at
org.apache.xerces.framework.XMLDTDScanner.scanDoctypeDecl(XMLDTDScann
er.java:1131)
at
org.apache.xerces.framework.XMLDocumentScanner.scanDoctypeDecl(XMLDoc
umentScanner.java:2177)
at
org.apache.xerces.framework.XMLDocumentScanner.access$0(XMLDocumentSc
anner.java:2133)
at
org.apache.xerces.framework.XMLDocumentScanner$PrologDispatcher.dispa
tch(XMLDocumentScanner.java:882)
at
org.apache.xerces.framewor -
Need help regarding Weblogic Server Hang up
We are facing a problem at the client’s place on the production environment.
The weblogic server is hanging up once every week. The application is running fine till then, but once the server is hung we need to restart the weblogic again.
Also after observing the behavior of the memory usage of the application in the weblogic admin console we came to know that the memory usage is gradually increasing day by day. We are not sure why this is happening.
We tested the application to check for any memory leaks using JProbe. We couldn’t find any memory leaks in the application. We even tested it onsite but couldn’t find any memory leaks.
I need some help on this issue as this is happening on the production environment and needs to be resolved as soon as possible.
The configuration we are having on the production environment is:
bea:8.1
JDK:1.41_021. You say its a hang, get multiple threadumps and see whats happening at the time of hang. this will give you a clue into the work thats going on and thats stuck.
2. are you seeing outofmemoryexception? If yes only then you will need to suspect the memory leak. First thing in such situation is try to increase the heap by about 1/3rd more (this is just a guestimate not a recommended practice) , that can potentially buy you time to analyze the problem.
3. you should also check if weblogic objects are leaking , check the jprobe snapshots if you have any to see if you find any weblogic object that are not getting garbage collected and growing continuously. there have been a few memory leak fixes since 8.1 release. if you find something contact support@bea and find out if any existing fix will help. -
Server hang for waitting test sql response
hi all
I have deploy ear to weblogic and use jndi to lookup weblogic datasource pool.
sometimes the server will hang about 10 miniute.
the thread dump show that a thread wait weblogic test sql to response.
I had ever try to change jdbc driver ,but the problem is still exist.
any suggestion?
===weblogic datasource config===
url : jdbc:jtds:sybase://192.168.1.1:5100/NIAIMM2
driver : net.sourceforge.jtds.jdbc.Driver
Initial Capacity: 5
Maximum Capacity: 150
Capacity Increment: 1
Test Connections On Reserve : unchecked
Test Frequency:120
Test Table Name:SQL SELECT 1
Seconds to Trust an Idle Pool Connection:10
Shrink Frequency:900
Init SQL:
Connection Creation Retry Frequency:60
Login Delay:0
Inactive Connection Timeout:0
Maximum Waiting for Connection:2147483647
Connection Reserve Timeout:10
Statement Timeout:3
Ignore In-Use Connections:checked
Pinned-To-Thread:unchecked
Remove Infected Connections Enabled:checked
===environment===
Weblogic 10.3.3
Sybase ASE 15.5
Linux ubuntu
===thread dump===
"[STUCK] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=10 tid=0x0000000042b7d000 nid=0x9a2 runnable [0x00007ff979c16000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.DataInputStream.readFully(DataInputStream.java:178)
at java.io.DataInputStream.readFully(DataInputStream.java:152)
at net.sourceforge.jtds.jdbc.SharedSocket.readPacket(SharedSocket.java:846)
at net.sourceforge.jtds.jdbc.SharedSocket.getNetPacket(SharedSocket.java:727)
- locked <0x00007ffa0732c2a0> (a java.util.ArrayList)
at net.sourceforge.jtds.jdbc.ResponseStream.getPacket(ResponseStream.java:466)
at net.sourceforge.jtds.jdbc.ResponseStream.read(ResponseStream.java:103)
at net.sourceforge.jtds.jdbc.ResponseStream.peek(ResponseStream.java:88)
at net.sourceforge.jtds.jdbc.TdsCore.wait(TdsCore.java:3932)
at net.sourceforge.jtds.jdbc.TdsCore.executeSQL(TdsCore.java:1046)
- locked <0x00007ffa07337830> (a net.sourceforge.jtds.jdbc.TdsCore)
at net.sourceforge.jtds.jdbc.JtdsStatement.executeSQL(JtdsStatement.java:537)
at net.sourceforge.jtds.jdbc.JtdsPreparedStatement.execute(JtdsPreparedStatement.java:558)
- locked <0x00007ffa0732bb90> (a net.sourceforge.jtds.jdbc.ConnectionJDBC3)
at weblogic.jdbc.common.internal.ConnectionEnv.testInternal(ConnectionEnv.java:821)
at weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:756)
at weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:495)
at weblogic.common.resourcepool.ResourcePoolImpl.testResource(ResourcePoolImpl.java:2345)
at weblogic.common.resourcepool.ResourcePoolImpl.checkResource(ResourcePoolImpl.java:1657)
at weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1564)
at weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1553)
at weblogic.common.resourcepool.ResourcePoolImpl.testUnusedResources(ResourcePoolImpl.java:2001)
at weblogic.common.resourcepool.ResourcePoolImpl.access$900(ResourcePoolImpl.java:40)
at weblogic.common.resourcepool.ResourcePoolImpl$ResourcePoolMaintanenceTask.timerExpired(ResourcePoolImpl.java:2433)
at weblogic.timers.internal.TimerImpl.run(TimerImpl.java:273)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
Edited by: 860320 on May 20, 2011 3:56 AMhi all
I have encounter the problem again at 09:26 AM
and the DBA give me the log as follow:
does anyone know what RepAgent(6) is?
is it "ct_results()" cause the db to wait sql response.
01:09:00000:01089:2011/05/25 08:37:31.08 server A client process exited abnormally, or a network error was enco
untered. Unless other errors occurred, continue processing normally.
01:09:00000:01089:2011/05/25 08:37:31.08 kernel extended error information: hostname: login: utfadm
01:12:00000:00000:2011/05/25 08:40:18.16 kernel nrpacket: recv, Connection timed out, spid: 2457, suid: 3
01:12:00000:00000:2011/05/25 08:40:18.16 kernel extended error information: hostname: n-chk-app5 login: utfadm
01:05:00000:00000:2011/05/25 08:40:18.77 kernel nrpacket: recv, Connection timed out, spid: 2593, suid: 3
01:05:00000:00000:2011/05/25 08:40:18.77 kernel extended error information: hostname: n-chk-app5 login: utfadm
01:09:00000:02329:2011/05/25 09:13:31.38 kernel Cannot send, host process disconnected: 0000016a suid: 3
01:09:00000:02329:2011/05/25 09:13:31.38 server Error: 1608, Severity: 18, State: 3
01:09:00000:02329:2011/05/25 09:13:31.38 server A client process exited abnormally, or a network error was enco
untered. Unless other errors occurred, continue processing normally.
01:09:00000:02329:2011/05/25 09:13:31.38 kernel extended error information: hostname: login: utfadm
01:00:00000:02161:2011/05/25 09:29:19.80 server RepAgent(6): Received the following communications error messag
e: Msg 05030506: ct_results(): network packet layer: internal net library error: Net-Lib protocol driver call to
read data failed.
01:08:00000:00369:2011/05/25 09:44:10.01 kernel Cannot send, host process disconnected: 0000016a suid: 3
01:08:00000:00369:2011/05/25 09:44:10.01 server Error: 1608, Severity: 18, State: 3
01:08:00000:00369:2011/05/25 09:44:10.01 server A client process exited abnormally, or a network error was enco
untered. Unless other errors occurred, continue processing normally.
01:08:00000:00369:2011/05/25 09:44:10.01 kernel extended error information: hostname: login: utfadm -
Weblogic Server hanging at high load!!!!!!!!!!!
Folks,
We have a weblogic server 9.2 which is running fine but after quiet a while at high load we observe that the server goes down and following exception is displayed in the server logs:
####<Nov 13, 2009 2:42:48 AM EST> <Error> <WebLogicServer> <ibmrxcptpnp-wb1> <AdminServer> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1258098168215> <BEA-000337> <[STUCK] ExecuteThread: '9' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "617" seconds working on the request "weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl@1cec1cec", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
java.net.SocketOutputStream.socketWrite0(Native Method)
java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:105)
java.net.SocketOutputStream.write(SocketOutputStream.java:149)
oracle.net.ns.DataPacket.send(Unknown Source)
oracle.net.ns.NetOutputStream.flush(Unknown Source)
oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.net.ns.NetInputStream.read(Unknown Source)
oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1099)
oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1070)
oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:478)
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216)
oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:955)
oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1060)
oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:839)
oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1132)
oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3316)
oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3422)
weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:718)
weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:460)
weblogic.common.resourcepool.ResourcePoolImpl.checkResource(ResourcePoolImpl.java:1455)
weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1372)
weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1362)
weblogic.common.resourcepool.ResourcePoolImpl.testUnusedResources(ResourcePoolImpl.java:1767)
weblogic.common.resourcepool.ResourcePoolImpl.access$700(ResourcePoolImpl.java:37)
weblogic.common.resourcepool.ResourcePoolImpl$ResourcePoolMaintanenceTask.timerExpired(ResourcePoolImpl.java:1935)
weblogic.timers.internal.TimerImpl.run(TimerImpl.java:265)
weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl.run(ServerWorkManagerImpl.java:518)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
>
Any answers?????Hi,
I have a similar issue on ODSI 10gR3 (WLS 10.3). I am having stuck threads - but, in my case it is clear that the database is down (not at the startup)
Here is some more info:
1. Test Connections On Reserve - Enabled
2. Default values for other parameters
Using Oracle thin driver for the connection pool "MyPool" -
./wlserver_10.3/server/lib/ojdbc6.jar
My question is:
1. How do I avoid the stuck thread caused when the database is down? During peak load, the stuck threads are causing some service requests to fail.
I did my homework and the closest option I could find is set the statementTimeout (which is set currently to the default value of -1 i.e. never timeout). Oracle documentation (http://www.oracle.com/technology/software/tech/java/sqlj_jdbc/htdocs/111070_readme.html) says that the ojdbc6.jar supports setQueryTimeout() method.
Is there any better way to attack this problem?
<Dec 21, 2009 12:11:18 AM EST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "MyPool" failed with exception: "java.sql.SQLRecoverableException: Io exception: Read failed: Connection timed out".>
<Dec 21, 2009 12:14:27 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:18:38 AM EST> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "600" seconds working on the request "weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl@297ac2b", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-52 "[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, waiting, priority=1, DAEMON> {
-- Waiting for notification on: javax.management.remote.rmi.RMIConnector$RMINotifClient@271498f[fat lock]
java.lang.Object.wait(Object.java:485)
com.sun.jmx.remote.internal.ClientNotifForwarder.postReconnection(ClientNotifForwarder.java:304)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.reconnectNotificationListeners(RMIConnector.java:1488)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.doStart(RMIConnector.java:1568)
com.sun.jmx.remote.internal.ClientCommunicatorAdmin.restart(ClientCommunicatorAdmin.java:72)
com.sun.jmx.remote.internal.ClientCommunicatorAdmin.gotIOException(ClientCommunicatorAdmin.java:34)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.gotIOException(RMIConnector.java:1420)
javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getAttribute(RMIConnector.java:857)
weblogic.management.mbeanservers.domainruntime.internal.ManagedMBeanServerConnection.getAttribute(ManagedMBeanServerConnection.java:288)
javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:235)
weblogic.management.jmx.MBeanServerInvocationHandler.doInvoke(MBeanServerInvocationHandler.java:477)
weblogic.management.jmx.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:294)
$Proxy69.getServerRuntime(Unknown Source)
weblogic.management.mbeanservers.domainruntime.internal.DomainRuntimeServiceMBeanImpl.lookupServerRuntime(DomainRuntimeServiceMBeanImpl.java:242)
sun.reflect.GeneratedMethodAccessor1880.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
weblogic.management.jmx.modelmbean.WLSModelMBean.invoke(WLSModelMBean.java:355)
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:831)
com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
weblogic.management.mbeanservers.domainruntime.internal.FederatedMBeanServerInterceptor.invoke(FederatedMBeanServerInterceptor.java:255)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:447)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:441)
weblogic.management.mbeanservers.internal.SecurityMBeanMgmtOpsInterceptor.invoke(SecurityMBeanMgmtOpsInterceptor.java:55)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:447)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:441)
weblogic.management.mbeanservers.internal.SecurityInterceptor.invoke(SecurityInterceptor.java:437)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor$10$1.run(AuthenticatedSubjectInterceptor.java:582)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor$10.run(AuthenticatedSubjectInterceptor.java:576)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:350)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor.invoke(AuthenticatedSubjectInterceptor.java:570)
weblogic.management.jmx.mbeanserver.WLSMBeanServer.invoke(WLSMBeanServer.java:305)
javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1378)
javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1264)
javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1338)
javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:761)
javax.management.remote.rmi.RMIConnectionImpl_WLSkel.invoke(Unknown Source)
weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:136)
weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:211)
javax.management.remote.rmi.RMIConnectionImpl_1030_WLStub.invoke(Unknown Source)
javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:969)
com.bea.diagnostics.server.MBeanServerUtil.processRecordsFromArchive(MBeanServerUtil.java:177)
com.bea.diagnostics.server.MetricEarliestTimestampLocator$RecordProcessorDesc.identifyEarliestTimestamps(MetricEarliestTimestampLocator.java:261)
com.bea.diagnostics.server.MetricEarliestTimestampLocator.identifyEarliestTimestamps(MetricEarliestTimestampLocator.java:84)
com.bea.diagnostics.server.MetricEarliestTimestampLocator.timerExpired(MetricEarliestTimestampLocator.java:79)
weblogic.timers.internal.TimerImpl.run(TimerImpl.java:253)
weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:516)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:198)
weblogic.work.ExecuteThread.run(ExecuteThread.java:165)
<Dec 21, 2009 12:24:04 AM EST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "MyPool" failed with exception: "java.sql.SQLRecoverableException: Io exception: Connection reset".>
<Dec 21, 2009 12:24:04 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:04 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:05 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:07 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:12 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:17 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:22 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection> -
WLS dies during stress testing
We're using JMeter to send continuous requests to the server. It creates
1500 threads and each requests Hello.jsp (see below) 500 times.
The server runs fine for about 6.5 minutes (serviced ~120000 requests)
before locking up. We let it sit for a while and about 4 minutes later, it
starts spewing out the following (bottom part of weblogic.log)
Fri May 19 10:48:37 GMT-04:00 2000:<I> <WebLogicServer> WebLogic Server
started
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp: init
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp: param
verbose initialized to: true
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp: param
packagePrefix initialized to: jsp_servlet
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp: param
compileCommand initialized to: /opt/Solaris_JDK_1.2.2_05a/bin/javac
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp: param
srcCompiler initialized to weblogic.jspc
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp: param
superclass initialized to null
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp: param
workingDir initialized to: /opt/ejbserver/weblogic/myserver/classfiles
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp: param
pageCheckSeconds initialized to: 1
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:
initialization complete
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> Generated
java file:
/opt/ejbserver/weblogic/myserver/classfiles/jsp_servlet/testpages/hello.java
Fri May 19 10:51:10 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=15123,localport=7111]''
Fri May 19 10:51:10 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=15172,localport=7111]''
Fri May 19 10:51:10 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=11312,localport=7111]''
Fri May 19 10:51:20 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=14368,localport=7111]''
Fri May 19 10:51:20 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=14385,localport=7111]''
Fri May 19 10:51:24 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=15294,localport=7111]''
Fri May 19 10:51:27 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=15291,localport=7111]''
Fri May 19 10:51:55 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=28068,localport=7111]''
Fri May 19 10:51:56 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=28385,localport=7111]''
Fri May 19 10:52:00 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=28421,localport=7111]''
Fri May 19 10:53:45 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=63711,localport=7111]''
Fri May 19 10:53:45 GMT-04:00 2000:<W> <ListenThread> Connection rejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=63709,localport=7111]''
Fri May 19 10:58:26 GMT-04:00 2000:<E> <WebLogicServer> Exception invoking
weblogic.time.server.ScheduledTrigger@d2573f
java.lang.RuntimeException: <UTIL> UnsyncCircularQueue was full!
at java.lang.Throwable.fillInStackTrace(Native Method)
at java.lang.Throwable.fillInStackTrace(Compiled Code)
at java.lang.Throwable.<init>(Compiled Code)
at java.lang.Exception.<init>(Compiled Code)
at java.lang.RuntimeException.<init>(Compiled Code)
at weblogic.utils.UnsyncCircularQueue.expandQueue(Compiled Code)
at weblogic.utils.UnsyncCircularQueue.put(Compiled Code)
at weblogic.kernel.ExecuteThreadManager.execute(Compiled Code)
at weblogic.kernel.Kernel.execute(Compiled Code)
at weblogic.time.common.internal.ScheduledTrigger.private_execute(Compiled
Code)
at weblogic.time.server.ScheduledTrigger.private_execute(Compiled Code)
at weblogic.time.common.internal.TimeTable.execute(Compiled Code)
at weblogic.time.common.internal.TimeEventGenerator.run(Compiled Code)
at java.lang.Thread.run(Thread.java:479)
We get a steady stream of this exact same RuntimeException for about 20
minutes before the whole thing dies.
Any ideas would be great!
Jason
The setup is the following:
Sun E250 with 1 CPU at 400MHz, 512 MB
Solaris 2.6
WLS 5.1 with SP3
Solaris Performance Pack is used
Sun JDK 1.2.2
min heap size is 128MB and max as 128MB with options
"-native -verbosegc"
other changed to the OS:
rlim_fd_max=4096
rlim_fd_cur=4096
tcp_close_wait_interval=10000
tcp_flush_fin_wait_2=10000
No paging/swapping takes place during the test.
Hello.jsp is as follows:
<html>
<head>
<title>A simple JSP file</title>
</head>
<body>
<%
out.print("<p><b>Hello World!</b>");
%>
</body>
</html>Comments inline.
Cheers - Wei
Jason <[email protected]> wrote in message
news:[email protected]...
Thanks, that definitely sheds some light on the problem.
We monitored the server and came up with the following. The queue isindeed
growing and probably accounts for the eventual failure (does anyone know
what the limit is?). The throughput is constant but just can't keep upwith
the requests. Another thing is that the heap slowly increases along with
the queue and it took a while for it to hit 100% and have GC occur.I am not sure about the limit. Either 32K or 64K, I guess. If you monitor
your queue lenght frequently, you might have a chance to spot that limit.
Every request need memory to hold. So the heap slowly increases along with
the queue.
>
Now, we duplicated the test but accessed a Servlet directly instead of a
JSP. This servlet simply did some out.print(...) statements to displaythe
same page as Hello.jsp. This ran without a hitch. We had about 5 times
more throughput and the queue wasn't growing out of control. Also, theheap
would reach 100% much quicker and GC occured more frequently. I can't see
how handling a JSP request is that much more resource intensive than a
Servlet request...
We then tried the original test again (accessing JSP) but this timeremoved
Service pack 3. We were running straight WLS 5.1 (no service packs).
Everything behaved nicely (just like the Servlet test did). Could it then
be that SP3 introduced a bug relating to how JSP requests are handled?Well, if this was the case, you might need to address this with support.
>
Finally, all the tests ran without changing the default number of execute
threads (15). I don't think increasing the number will help seeing how
short-lived these requests are. I think more execute threads would just
increase the context-switching.I agree. I've seen 15 to 60 threads in production. Might be worth a try to
use larger number of threads in your test to see if it alleviated the
problem.
>
Thanks again,My pleasure.
Jason
Wei Guan <[email protected]> wrote in message
news:[email protected]...
WebLogic has its interal request queue to enqueue all requests. Therequest
refers to an unit of work for weblogic to process, such as a triggeredtime
service, http request, etc. The finite number of worker threads defined
in
your weblogic.properties file will dequeue the requests inside therequest
queue and process the work.
There is an upper limit on the size of this queue. The message you gotmeans
that your test hit that limit. In practice, if there were lots of
requests
inside that queue, every request need to wait for lots of time beforebeing
processed (the queue is FIFO I believed). Open your WebLogic Console and
monitor the size of the queue, in your test or in your production, if
you
see the size of the queue increases constantly, there is somethingwrong.
You might need to increase the number of threads to handle the load. If
tuning up the number of threads doesn't help, you might need useweblogic
clustering (or add more servers in your clustering) to share the load.
WebLogic engineers might be able to lift up the upper limit of the sizeof
the queue. However, the larger upper limit on the queue might not helpyou
in practice. Tuning your configuration and making sure the number of
requests inside the queue do not increase constantly might be a good
practice to follow.
My 2 cents.
Cheers - Wei
Jason <[email protected]> wrote in message
news:[email protected]...
We're using JMeter to send continuous requests to the server. It
creates
1500 threads and each requests Hello.jsp (see below) 500 times.
The server runs fine for about 6.5 minutes (serviced ~120000 requests)
before locking up. We let it sit for a while and about 4 minutes
later,
it
starts spewing out the following (bottom part of weblogic.log)
Fri May 19 10:48:37 GMT-04:00 2000:<I> <WebLogicServer> WebLogic
Server
started
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:init
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:param
verbose initialized to: true
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:param
packagePrefix initialized to: jsp_servlet
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:param
compileCommand initialized to: /opt/Solaris_JDK_1.2.2_05a/bin/javac
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:param
srcCompiler initialized to weblogic.jspc
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:param
superclass initialized to null
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:param
workingDir initialized to: /opt/ejbserver/weblogic/myserver/classfiles
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:param
pageCheckSeconds initialized to: 1
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General> *.jsp:
initialization complete
Fri May 19 10:48:47 GMT-04:00 2000:<I> <ServletContext-General>
Generated
java file:
/opt/ejbserver/weblogic/myserver/classfiles/jsp_servlet/testpages/hello.java
Fri May 19 10:51:10 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=15123,localport=7111]''
Fri May 19 10:51:10 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=15172,localport=7111]''
Fri May 19 10:51:10 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=11312,localport=7111]''
Fri May 19 10:51:20 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=14368,localport=7111]''
Fri May 19 10:51:20 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=14385,localport=7111]''
Fri May 19 10:51:24 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=15294,localport=7111]''
Fri May 19 10:51:27 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=15291,localport=7111]''
Fri May 19 10:51:55 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=28068,localport=7111]''
Fri May 19 10:51:56 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=28385,localport=7111]''
Fri May 19 10:52:00 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=28421,localport=7111]''
Fri May 19 10:53:45 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=63711,localport=7111]''
Fri May 19 10:53:45 GMT-04:00 2000:<W> <ListenThread> Connectionrejected:
'Login timed out after: '5000' ms on socket:
'Socket[addr=47.187.230.161/47.187.230.161,port=63709,localport=7111]''
Fri May 19 10:58:26 GMT-04:00 2000:<E> <WebLogicServer> Exceptioninvoking
weblogic.time.server.ScheduledTrigger@d2573f
java.lang.RuntimeException: <UTIL> UnsyncCircularQueue was full!
at java.lang.Throwable.fillInStackTrace(Native Method)
at java.lang.Throwable.fillInStackTrace(Compiled Code)
at java.lang.Throwable.<init>(Compiled Code)
at java.lang.Exception.<init>(Compiled Code)
at java.lang.RuntimeException.<init>(Compiled Code)
at weblogic.utils.UnsyncCircularQueue.expandQueue(Compiled Code)
at weblogic.utils.UnsyncCircularQueue.put(Compiled Code)
at weblogic.kernel.ExecuteThreadManager.execute(Compiled Code)
at weblogic.kernel.Kernel.execute(Compiled Code)
atweblogic.time.common.internal.ScheduledTrigger.private_execute(Compiled
Code)
at weblogic.time.server.ScheduledTrigger.private_execute(Compiled
Code)
at weblogic.time.common.internal.TimeTable.execute(Compiled Code)
at weblogic.time.common.internal.TimeEventGenerator.run(CompiledCode)
at java.lang.Thread.run(Thread.java:479)
We get a steady stream of this exact same RuntimeException for about20
minutes before the whole thing dies.
Any ideas would be great!
Jason
The setup is the following:
Sun E250 with 1 CPU at 400MHz, 512 MB
Solaris 2.6
WLS 5.1 with SP3
Solaris Performance Pack is used
Sun JDK 1.2.2
min heap size is 128MB and max as 128MB with options
"-native -verbosegc"
other changed to the OS:
rlim_fd_max=4096
rlim_fd_cur=4096
tcp_close_wait_interval=10000
tcp_flush_fin_wait_2=10000
No paging/swapping takes place during the test.
Hello.jsp is as follows:
<html>
<head>
<title>A simple JSP file</title>
</head>
<body>
<%
out.print("<p><b>Hello World!</b>");
%>
</body>
</html> -
Exception only occuring during stress test
We are trying to get ready to release a beta version of the software I'm working on.. so part of getting ready for that was to try set up some stress tests and hit the server with multiple requests for the same page....
Not sure exactly how many it is taking but we are getting the following exception.
2005-06-10 13:20:23 StandardWrapperValve[action]: Servlet.service() for servlet action threw exception
java.lang.NumberFormatException: For input string: "200044.E2000444E"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1207)
at java.lang.Double.parseDouble(Double.java:220)
at java.text.DigitList.getDouble(DigitList.java:127)
at java.text.DecimalFormat.parse(DecimalFormat.java:1070)
at java.text.SimpleDateFormat.subParse(SimpleDateFormat.java:1386)
at java.text.SimpleDateFormat.parse(SimpleDateFormat.java:1156)
at java.text.DateFormat.parse(DateFormat.java:333)
at com.xxxxx.xxxxx.struts.adapter.BrowseBaseAdapter.formatYyyyMMddToLocaleStr(BrowseBaseAdapter.java:194)I can only assume that something was not thread safe and somehow something is getting confused....
this is the method that produced the error and the code that it runs.
I know absolutely nothing about making something thread safe.... can anyone give me good link to refer to or point something out in the below code that might be a no no.
private static final SimpleDateFormat xxxxxxxxDateFormat =
new SimpleDateFormat("yyyyMMdd");
protected String formatYyyyMMddToLocaleStr(
String xxxxxxxxDt,
Locale locale) {
String result = "";
if ( xxxxxxxxDt != null && xxxxxxxxDt.length() == 8) {
try {
Date tempDate = xxxxxxxxDateFormat.parse( xxxxxxxxDt);
result = javaDataTypeToString(tempDate, locale);
} catch (ParseException ex) {
return result;
public String javaDataTypeToString(Object data, Locale locale) {
String returnType = data.getClass().getName();
String result = null;
if (returnType.equals("java.lang.String")) {
result = (String) data;
} else if (returnType.equals("java.lang.Float")) {
NumberFormat formatter = NumberFormat.getNumberInstance(locale);
formatter.setMaximumFractionDigits(6);
formatter.setGroupingUsed(false);
result = formatter.format((Float) data);
} else if (returnType.equals("java.lang.Double")
|| returnType.equals("java.math.BigDecimal")) {
NumberFormat formatter = NumberFormat.getNumberInstance(locale);
formatter.setMaximumFractionDigits(13);
formatter.setGroupingUsed(false);
StringBuffer buffer = new StringBuffer();
result = formatter.format(data, buffer, new FieldPosition(0))
.toString();
} else if (returnType.equals("java.lang.Integer")) {
Integer inte = (Integer) data;
int intVal = inte.intValue();
if (intVal != 0)
result = String.valueOf(intVal);
else
result = "";
} else if (returnType.equals("java.util.Date")) {
java.util.Date date = (java.util.Date) data;
SimpleDateFormat dateFormatter = getDatePattern(locale);
result = dateFormatter.format(date);
} else if (returnType.equals("com.sungard.stnweb.utility.Time")) {
Time time = (Time) data;
result = time.asString();
} else if (returnType.equals("java.lang.Boolean")) {
Boolean dataBool = (Boolean) data;
if (dataBool.booleanValue())
result = "1";
else
result = "";
return result;From the API on java.text.SimpleDateFormat
Synchronization
Date formats are not synchronized. It is recommended to create separate
format instances for each thread. If multiple threads access a format
concurrently, it must be synchronized externally. Being static, your date format object will be accessed by multiple threads.
Solution: Don't make the date format object static.
I would suggest like this:
private static final String dfString ="yyyyMMdd";
protected String formatYyyyMMddToLocaleStr(String xxxxxxxxDt, Locale locale) {
String result = "";
SimpleDateFormat xxxxxxxxDateFormat = new SimpleDateFormat(dfString );
if ( xxxxxxxxDt != null && xxxxxxxxDt.length() == 8) {
try {
Date tempDate = xxxxxxxxDateFormat.parse( xxxxxxxxDt);
result = javaDataTypeToString(tempDate, locale);
catch (ParseException ex) {}
return result;
Ok, so it is constructing a DateFormatting object for each method call, but I don't see it as that big a deal. Its not a huge hit. You might get away with making it an instance variable - I don't know how you use the enclosing class. Start with this, and see if it works.
Cheers,
evnafets -
ApplicationException during Stress Testing
Hi All,
I have a PAR file(dynpage application) which is deployed in QA portal. The client did stress testing i.e multiple users are trying to access the application at the same time, clicking on various buttons. Sometimes they are getting
'com.sap.xxx.xxx.ApplicationException.'
I did complete testing at my end. The same application is working fine in DEV portal. I do not have access to QA portal. Also, I could not perform stress testing in DEV portal.
But I understand that the problem is not with the coding.
What could be the issue? Please suggest. Hope I am clear. If not, please let me know.
Thanks.Hi,
Please find the latest log file. Please suggest.
#1.5 #00145E0B8976007500000007000015B4000463672289F723#1235194519179#com.sap.engine.services.rfcengine##com.sap.engine.services.rfcengine.handleThrowable(Throwable t)####n/a##6ced9ac3ffd911ddc9db00145e0b8976#Thread[JCO.ServerThread-5,5,SAPEngine_System_Thread[impl:5]_Group]##0#0#Error#1#/System/Server#Java###Error in Server "SAP.CCMS.J2EE.QP1" :
#1#SAP.CCMS.J2EE.QP1#
#1.5 #00145E0B8976007500000008000015B4000463672289F8AE#1235194519179#com.sap.engine.services.rfcengine##com.sap.engine.services.rfcengine.handleThrowable(Throwable t)####n/a##6ced9ac3ffd911ddc9db00145e0b8976#Thread[JCO.ServerThread-5,5,SAPEngine_System_Thread[impl:5]_Group]##0#0#Error##Plain###
RfcException:
message: CPIC-CALL: SAP_CMACCPTP on convId: 00000000
ERROR gateway shutdown
TIME Fri Feb 20 21:35:18 2009
RELEASE 640
COMPONENT CPIC (TCP/IP)
VERSION 3
RC 731
MODULE r3cpic.c
LINE 9279
COUNTER 1
Return code: RFC_FAILURE(1)
error group: 102
key: RFC_ERROR_COMMUNICATION#
#1.5 #00145E0B8976007500000009000015B4000463672289F91E#1235194519179#com.sap.engine.services.rfcengine##com.sap.engine.services.rfcengine.handleThrowable(Throwable t)####n/a##6ced9ac3ffd911ddc9db00145e0b8976#Thread[JCO.ServerThread-5,5,SAPEngine_System_Thread[impl:5]_Group]##0#0#Error##Plain###
RfcException:
message: CPIC-CALL: SAP_CMACCPTP on convId: 00000000
ERROR gateway shutdown
TIME Fri Feb 20 21:35:18 2009
RELEASE 640
COMPONENT CPIC (TCP/IP)
VERSION 3
RC 731
MODULE r3cpic.c
LINE 9279
COUNTER 1
Return code: RFC_FAILURE(1)
error group: 102
key: RFC_ERROR_COMMUNICATION
at com.sap.mw.rfc.api.RfcApi.rfcAbort(RfcApi.java:873)
at com.sap.mw.rfc.api.RfcApi.RfcAbort(RfcApi.java:911)
at com.sap.mw.jco.MiddlewareJRfc.abort(MiddlewareJRfc.java:449)
at com.sap.mw.jco.MiddlewareJRfc$Server.abort(MiddlewareJRfc.java:1715)
at com.sap.mw.jco.JCO$Server.abort(JCO.java:7004)
at com.sap.mw.jco.JCO$Server.listen(JCO.java:7344)
at com.sap.mw.jco.JCO$Server.run(JCO.java:7162)
at java.lang.Thread.run(Thread.java:534)
#1.5 #00145E0B8976007400000006000015B400046367228A2DF0#1235194519195#System.err##System.err####n/a##6ced9ac2ffd911dda72600145e0b8976#Thread[JCO.ServerThread-1,5,SAPEngine_System_Thread[impl:5]_Group]##0#0#Error##Plain###Feb 20, 2009 9:35:19 PM ...fcengine.handleThrowable(Throwable t) [Thread[JCO.ServerThread-1,5,SAPEngine_System_Thread[impl:5]_Group]] Error: Error in Server "SAP.CCMS.J2EE.QP1" :
Edited by: Subashini on Feb 25, 2009 8:29 AM -
Hi,
I'm using an ejb in a loop with some 1000 calls. It's possible to do this a second
client, but the third hangs.
It's also not possible to start a simple jsp or servlet on this server during
this time.I've seen cases of a server (WLS 6.0, Hotspot 1.3) hanging where the
process does not respond to the thread dump command (CTRL-BREAK), so it
was not possible to get the dump. Has anyone come across this before,
and is there a workaround?
Donald.
Srikant Subramaniam wrote:
>
what version of wls/jdk?
have you tried getting a thread dump?
Srikant, [email protected], http://weblogic.bea.com/, etc.
Andreas Albrecht wrote:
Hi,
I'm using an ejb in a loop with some 1000 calls. It's possible to do this a second
client, but the third hangs.
It's also not possible to start a simple jsp or servlet on this server during
this time. -
Mac Mini server hangs during periods of heavy outbound traffic
I first noticed this last night, when trying to set up Time Machine backups.
The backups will run for around 30 minutes on average, and then the Mini will go into a state where the mouse still works and most commands work, but no network-related things will work: the machine won't respond to pings; Networks preferences will hang when you try to open it; Server Manager will hang when you open it, and so forth.
This occurs regardless of whether I am using gigabit ethernet or wireless ethernet.
I swore it was Time Machine's fault, so last night I made sure it was turned off, and the machine was completely stable again in the morning so I thought things were okay.
But just now, I was watching a video over the network from a shared directory on the Mini, and it acted up in exactly the same way as before, and this happened twice in a row when watching two separate videos.
Interestingly, it seems to be okay to copy large amounts of data to the Mini, as over the past week I have copied around 1.5TB of data to the Drobo attached to it with no problems at all. It just seems like copying any amount of data away from the system dooms it to have a crash.
But there was a 10.6.2 update at some point during all of this, and I'm not confident that it wasn't the update which caused the problem.
Is anyone familiar with these symptoms? What can be done?It's running Server (I cross-posted to the server forum after being advised to.) There is a gigabit switch on the way to a Billionton 7504VGO router/modem. The problem itself is separate from Internet connectivity though, as the computer becomes inaccessible from the local network when it occurs.
I think I am narrowing in on the problem though, as it seems to reproducibly occur on some files and not others. On the Time Machine side of things, if I exclude my home directory then it seems to work even for the initial backup which takes ages. On the sharing side of things, there are video files which crash it reliably and then others which don't. Interestingly it seems to be the newer files which work more reliably, which makes me think it's something about the files which were transferred to the Mac when the data was first brought over from the previous machine I was using. -
Hi all,
we are using WLS 5.1 sp10 to deploy our RMI objects.
Inside our objects, we have a lot of database transactions.
After kicking off the server and running a lot of
database transactions, the server soon did not run
and just hanged in a certain database transactions.
But still, we can see the WLS doing its GC through the
AdminMain page, reclaiming the heap memory.
What would be the possible reason for that?
thanks!
cheers,
kenYou need to take a couple of thread dumps about 30 seconds or so apart
so that you can see exactly what the threads are doing. If you need
help interpreting these dumps, please post them here.
Kenneth Yue wrote:
Hi all,
we are using WLS 5.1 sp10 to deploy our RMI objects.
Inside our objects, we have a lot of database transactions.
After kicking off the server and running a lot of
database transactions, the server soon did not run
and just hanged in a certain database transactions.
But still, we can see the WLS doing its GC through the
AdminMain page, reclaiming the heap memory.
What would be the possible reason for that?
thanks!
cheers,
ken -
Help needed: Lion Server hangs during reboot (Symbol not found: _kCUIMaskOnlyKey)
Hi,
I not sure if this is the right forum but hopefully someone might be able to help.
Yesterday I was configuring my local mail system. (Local IMAP server and I checked the access from WLAN and Internet. Everything seems to
work fine until I noticed, that mails from my inbox would disappear automatically after a couple of seconds. I switched all mail clients (iPhone, ...) of,
sent a test mail - but the problem stays. I had no idea what was going on. So I decided to reboot the system. The system came up again and I logged in.
It looked like a fresh desktop was created and Safari wanted to make changes to the system. I decided to roll back the system and reinstalled it from
a backup before I made all the changes. After restoring the system hangs with the gray screen. I tried a reboot in save mode - same result. Then
I rebooted in single user mode. The file system looked OK, but I found many crashes in the system logs. Continuing to multi user mode did not succeed.
I received all the crash logs on the console.
Next I removed the disk and connected it to my laptop. I have extracted the last couple of line from the system log file:
Feb 26 00:58:44 localhost ReportCrash[55]: Removing excessive log: file://localhost/Library/Logs/DiagnosticReports/xpchelper_2012-02-26-005835-1_l ocalhost.crash
Feb 26 00:58:44 localhost com.apple.xpchelper.00000000-0000-0000-0000-000000000000[721]: dyld: Symbol not found: _kCUIMaskOnlyKey
Feb 26 00:58:44 localhost com.apple.xpchelper.00000000-0000-0000-0000-000000000000[721]: Referenced from: /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
Feb 26 00:58:44 localhost com.apple.xpchelper.00000000-0000-0000-0000-000000000000[721]: Expected in: /System/Library/PrivateFrameworks/CoreUI.framework/Versions/A/CoreUI
Feb 26 00:58:44 localhost com.apple.xpchelper.00000000-0000-0000-0000-000000000000[721]: in /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
Feb 26 00:58:44 localhost com.apple.launchd[1] (com.apple.applepushserviced[697]): Job appears to have crashed: Trace/BPT trap: 5
Feb 26 00:58:44 localhost com.apple.launchd[1] (com.apple.applepushserviced): Throttling respawn: Will start in 9 seconds
Feb 26 00:58:44 localhost ReportCrash[55]: Saved crash report for applepushserviced[697] version ??? (???) to /Library/Logs/DiagnosticReports/applepushserviced_2012-02-26-005844_localhost.c rash
Feb 26 00:58:44 localhost ReportCrash[55]: Removing excessive log: file://localhost/Library/Logs/DiagnosticReports/applepushserviced_2012-02-26-00 3929_localhost.crash
Feb 26 00:58:45 localhost com.apple.launchd[1] (com.apple.PasswordService[699]): Job appears to have crashed: Trace/BPT trap: 5
Feb 26 00:58:45 localhost com.apple.launchd[1] (com.apple.PasswordService): Throttling respawn: Will start in 9 seconds
Feb 26 00:58:45 localhost ReportCrash[55]: Saved crash report for PasswordService[699] version ??? (???) to /Library/Logs/DiagnosticReports/PasswordService_2012-02-26-005845_localhost.cra sh
Feb 26 00:58:45 localhost com.apple.launchd[1] (com.apple.softwareupdatecheck.initial[700]): Job appears to have crashed: Trace/BPT trap: 5
Feb 26 00:58:45 localhost com.apple.launchd[1] (com.apple.softwareupdatecheck.initial): Throttling respawn: Will start in 9 seconds
Feb 26 00:58:45 localhost ReportCrash[55]: Removing excessive log: file://localhost/Library/Logs/DiagnosticReports/PasswordService_2012-02-26-0035 06_localhost.crash
Feb 26 00:58:45 localhost ReportCrash[55]: Saved crash report for SoftwareUpdateCheck[700] version ??? (???) to /Library/Logs/DiagnosticReports/SoftwareUpdateCheck_2012-02-26-005845_localhost .crash
Feb 26 00:58:45 localhost ReportCrash[55]: Removing excessive log: file://localhost/Library/Logs/DiagnosticReports/SoftwareUpdateCheck_2012-02-26- 003020_localhost.crash
Feb 26 00:58:45 localhost com.apple.launchd[1] (com.apple.xpchelper.59000000-0000-0000-0000-000000000000[714]): Job appears to have crashed: Trace/BPT trap: 5
Feb 26 00:58:45 localhost com.apple.xpchelper.59000000-0000-0000-0000-000000000000[722]: dyld: Symbol not found: _kCUIMaskOnlyKey
Feb 26 00:58:45 localhost com.apple.xpchelper.59000000-0000-0000-0000-000000000000[722]: Referenced from: /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
Feb 26 00:58:45 localhost com.apple.xpchelper.59000000-0000-0000-0000-000000000000[722]: Expected in: /System/Library/PrivateFrameworks/CoreUI.framework/Versions/A/CoreUI
Feb 26 00:58:45 localhost com.apple.xpchelper.59000000-0000-0000-0000-000000000000[722]: in /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
Feb 26 00:58:45 localhost ReportCrash[55]: Saved crash report for xpchelper[714] version ??? (???) to /Library/Logs/DiagnosticReports/xpchelper_2012-02-26-005845_localhost.crash
Feb 26 00:58:45 localhost ReportCrash[55]: Removing excessive log: file://localhost/Library/Logs/DiagnosticReports/xpchelper_2012-02-26-005835-2_l ocalhost.crash
Feb 26 00:58:45 localhost com.apple.launchd[1] (com.apple.xpchelper.00000000-0000-0000-0000-000000000000[721]): Job appears to have crashed: Trace/BPT trap: 5
Feb 26 00:58:45 localhost com.apple.xpchelper.00000000-0000-0000-0000-000000000000[723]: dyld: Symbol not found: _kCUIMaskOnlyKey
Feb 26 00:58:45 localhost com.apple.xpchelper.00000000-0000-0000-0000-000000000000[723]: Referenced from: /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
Feb 26 00:58:45 localhost com.apple.xpchelper.00000000-0000-0000-0000-000000000000[723]: Expected in: /System/Library/PrivateFrameworks/CoreUI.framework/Versions/A/CoreUI
Feb 26 00:58:45 localhost com.apple.xpchelper.00000000-0000-0000-0000-000000000000[723]: in /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
Feb 26 00:58:45 localhost ReportCrash[55]: Saved crash report for xpchelper[721] version ??? (???) to /Library/Logs/DiagnosticReports/xpchelper_2012-02-26-005845-1_localhost.crash
Feb 26 00:58:45 localhost ReportCrash[55]: Removing excessive log: file://localhost/Library/Logs/DiagnosticReports/xpchelper_2012-02-26-005835_loc alhost.crash
Feb 26 00:58:46 localhost com.apple.launchd[1] (com.apple.xpchelper.59000000-0000-0000-0000-000000000000[722]): Job appears to have crashed: Trace/BPT trap: 5
Feb 26 00:58:46 localhost com.apple.xpchelper.59000000-0000-0000-0000-000000000000[724]: dyld: Symbol not found: _kCUIMaskOnlyKey
Feb 26 00:58:46 localhost com.apple.xpchelper.59000000-0000-0000-0000-000000000000[724]: Referenced from: /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
Feb 26 00:58:46 localhost com.apple.xpchelper.59000000-0000-0000-0000-000000000000[724]: Expected in: /System/Library/PrivateFrameworks/CoreUI.framework/Versions/A/CoreUI
Feb 26 00:58:46 localhost com.apple.xpchelper.59000000-0000-0000-0000-000000000000[724]: in /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
Feb 26 00:58:46 localhost ReportCrash[55]: Saved crash report for xpchelper[722] version ??? (???) to /Library/Logs/DiagnosticReports/xpchelper_2012-02-26-005846_localhost.crash
Feb 26 00:58:46 localhost ReportCrash[55]: Removing excessive log: file://localhost/Library/Logs/DiagnosticReports/xpchelper_2012-02-26-005836-1_l ocalhost.crashHad the exact same problem yesterday on my mid-2010 Mac Pro with OS X 10.7.3 Server. Formatted my SSD boot drive and restored via time machine and I had the exact same error.
Here is how to solve it. Download from the apple site the OSX10.7.3ServerComboUpdate.dmg. I downloaded using my laptop. Extract the dmg and get the pkg file inside. Put it on a usb drive. Boot your broken OS X system in recovery mode(option key as you boot up, choose Recovery HD). Open the Terminal(don't use the single user mode,the following command did not work from there). If your OS X installation is Macintosh HD type the following(assuimg your USB disk is called USB,otherwise change it):
# cd /Volumes/Macintosh\ HD\
# mkdir update
# cd update
# cp /Volumes/USBDrive/*.pkg .
# installer --verbose -pkg MacOSX10.7.3ServerComboUpdate.pkg -target "/Volumes/Macintosh\ HD"/
When it finishes reboot and your OS X will boot normally.
Hope that helped.
Maybe you are looking for
-
How to use a value taken in a variable as a table name in a query?
I am fetching a value in a variable as: <select application_short_name into l_appl_nm from fnd_application where application_id=:p_appl_id> Now I need to use the value fetched in variable "l_appl_nm" as a table partition name in next query. Can anyon
-
In the case of a fixed vendor, please enter info record
Hello Experts When I make a Purchase Requisition allocated to a fixed asset and I also indicate the fixed vendor, the following error appears: "In the case of a fixed vendor, please enter info record" We are not maintaining info records. For material
-
How to use/access my previous itunes library in itunes.
I accidently deleted all my songs then emptied trash (i am on a mac, and i sick of window users solving their problems) and now i have 1/90th of my songs (i have around 2,500 songs. I still have my video, but i want my songs back. There is the previo
-
My Facebook app will force close when I open it
I click on the app and it will open for a few seconds then it will force close on me. I have restarted my iphone 5 several times deleted the app several times as well and the app still close FYI this is the only app that does it.
-
Found an ipad, how do I find owner?
A customer left their Ipad in my restaurant but never returned for it. Would like to find the owner but it is locked. Is there a way to track them down?