Thread manipulation in weblogic 7.0

Hello,
We are user of weblogic 7.0 on Windows 2000. We have couple of
web applications running on weblogic 7.0 server with
Sun's 1.3.1_06 JVM. I have a start up
servlet(load-on-startup) in my web app which starts 3
threads during web application loading process. For
some reason one of my theread is dead(stopped). Is
there any way, to start that thread manually without
restarting server/redeploying web app(I mean through
console or something like that)? Since this has
happened in our production environment, any urgent
help on this would be greatly appreciated.
Regards,
Yogesh

"Yogesh Kumar" <[email protected]> wrote in message news:3fd0f468$[email protected]..
We are user of weblogic 7.0 on Windows 2000. We have couple of
web applications running on weblogic 7.0 server with
Sun's 1.3.1_06 JVM. I have a start up
servlet(load-on-startup) in my web app which starts 3
threads during web application loading process. For
some reason one of my theread is dead(stopped). Is
there any way, to start that thread manually without
restarting server/redeploying web app(I mean through
console or something like that)? Since this has
happened in our production environment, any urgent
help on this would be greatly appreciated.Java doesn't allow "restarting" threads. So redeploying the
web app is the only way.
In future you will need to make sure that your always running
threads don't die. Usually it happens because a RuntimeException
is thrown and it manages to leave boundaries of run() method.
óÌÁ×Á

Similar Messages

  • How do you modify the default Execute thread count in Weblogic Server 9.2?

    How do you modify the default Execute thread count in Weblogic Server 9.2?
    How can you tune the starting number of weblogic.ExecuteThread on server startup and/or set minimum number?
    Is there an option from the console?
    Please let me know.
    Thanks

    Self tuning will automatically manage the threads but however you can still control the min and max by adding the min and max values for each instance either directly adding in config.xml or through JVM settings
    1) Modifying the config.xml
    Just add the following line(s) to each server definition :
    <server>
    <name>AdminServer</name>
    <self-tuning-thread-pool-size-min>100</self-tuning-thread-pool-size-min>
    <self-tuning-thread-pool-size-max>200</self-tuning-thread-pool-size-max>
    </server>
    2) Adding some JVM parameters
    It's safer the following way :
    add the following option in your command line : -Dweblogic.threadpool.MinPoolSize=100
    Regards
    RR

  • Changing thread count in WebLogic 10.3

    Hi
    We have migrated from WebLogic 8.1 to 10.3.
    how do i change the thread count in weblogic 10.3? i saw options in weblogic 8.1 and 9.2 but not in 10.3.
    Can anybody throw some light on this.

    From WL9.0 onwards, the Weblogic thread management mechanism is changed.Now no need to set the thread count. WLS itself is intelligent enough to do the self tuning of the thread pool.
    To prioritize and schedule your application requests,you can create work managers and can associate request classes/constraints.You can refer the below article to understand the workload management using work managers.
    http://www.oracle.com/technology/pub/articles/dev2arch/2006/01/workload-management.html
    Inigo Prince

  • Struck thread issue with weblogic 9.2

    Hi,
    could you please help me find out the reason why lots of thread in my weblogic application are stuck. My application is a jsp based web application which is using accenture grnds framework and i can see lots of threads stuck at EDU.oswego.cs.dl.util.concurrent.Semaphore.acquire. Blow is the thread dump from my application.
    "[STUCK] ExecuteThread: '15' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=1 tid=0x03564170 nid=0x42 in Object.wait() [0xb047e000..0xb047f9f0]
    at java.lang.Object.wait(Native Method)
    - waiting on <0xce4d2500> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at java.lang.Object.wait(Object.java:474)
    at EDU.oswego.cs.dl.util.concurrent.Semaphore.acquire(Semaphore.java:108)
    - locked <0xce4d2500> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.acquireSemaphore(SiiamSinglePointOfEntry.java:283)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.doGet(SiiamSinglePointOfEntry.java:147)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:743)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
    at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
    at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3245)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    "[STUCK] ExecuteThread: '14' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=1 tid=0x03ee3420 nid=0x41 in Object.wait() [0xb057e000..0xb057fb70]
    at java.lang.Object.wait(Native Method)
    - waiting on <0xce6ca288> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at java.lang.Object.wait(Object.java:474)
    at EDU.oswego.cs.dl.util.concurrent.Semaphore.acquire(Semaphore.java:108)
    - locked <0xce6ca288> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.acquireSemaphore(SiiamSinglePointOfEntry.java:283)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.doGet(SiiamSinglePointOfEntry.java:147)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:743)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
    at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
    at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3245)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    "[STUCK] ExecuteThread: '13' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=1 tid=0x03ee3258 nid=0x40 in Object.wait() [0xb067e000..0xb067faf0]
    at java.lang.Object.wait(Native Method)
    - waiting on <0xcd98b768> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at java.lang.Object.wait(Object.java:474)
    at EDU.oswego.cs.dl.util.concurrent.Semaphore.acquire(Semaphore.java:108)
    - locked <0xcd98b768> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.acquireSemaphore(SiiamSinglePointOfEntry.java:283)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.doGet(SiiamSinglePointOfEntry.java:147)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:743)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
    at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
    at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3245)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    "[STUCK] ExecuteThread: '12' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=1 tid=0x00581f28 nid=0x3f in Object.wait() [0xb077f000..0xb077fc70]
    at java.lang.Object.wait(Native Method)
    - waiting on <0xcdd7ad30> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at java.lang.Object.wait(Object.java:474)
    at EDU.oswego.cs.dl.util.concurrent.Semaphore.acquire(Semaphore.java:108)
    - locked <0xcdd7ad30> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.acquireSemaphore(SiiamSinglePointOfEntry.java:283)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.doGet(SiiamSinglePointOfEntry.java:147)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:743)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
    at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
    at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3245)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    "[STUCK] ExecuteThread: '11' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=1 tid=0x0229a610 nid=0x3e in Object.wait() [0xb087e000..0xb087fbf0]
    at java.lang.Object.wait(Native Method)
    - waiting on <0xce6ca288> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at java.lang.Object.wait(Object.java:474)
    at EDU.oswego.cs.dl.util.concurrent.Semaphore.acquire(Semaphore.java:108)
    - locked <0xce6ca288> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.acquireSemaphore(SiiamSinglePointOfEntry.java:283)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.doGet(SiiamSinglePointOfEntry.java:147)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:743)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
    at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
    at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3245)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    "[STUCK] ExecuteThread: '10' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=1 tid=0x01cad6a0 nid=0x3d in Object.wait() [0xb097e000..0xb097f970]
    at java.lang.Object.wait(Native Method)
    - waiting on <0xce4d2500> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at java.lang.Object.wait(Object.java:474)
    at EDU.oswego.cs.dl.util.concurrent.Semaphore.acquire(Semaphore.java:108)
    - locked <0xce4d2500> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.acquireSemaphore(SiiamSinglePointOfEntry.java:283)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.doGet(SiiamSinglePointOfEntry.java:147)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:743)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
    at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
    at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3245)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    "[STUCK] ExecuteThread: '9' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=1 tid=0x02389c58 nid=0x3c in Object.wait() [0xb0a7e000..0xb0a7f8f0]
    at java.lang.Object.wait(Native Method)
    - waiting on <0xcd98b768> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at java.lang.Object.wait(Object.java:474)
    at EDU.oswego.cs.dl.util.concurrent.Semaphore.acquire(Semaphore.java:108)
    - locked <0xcd98b768> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.acquireSemaphore(SiiamSinglePointOfEntry.java:283)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.doGet(SiiamSinglePointOfEntry.java:147)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:743)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
    at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
    at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3245)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    "[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=1 tid=0x012ba168 nid=0x3b in Object.wait() [0xb0b7e000..0xb0b7fa70]
    at java.lang.Object.wait(Native Method)
    - waiting on <0xcdd7ad30> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at java.lang.Object.wait(Object.java:474)
    at EDU.oswego.cs.dl.util.concurrent.Semaphore.acquire(Semaphore.java:108)
    - locked <0xcdd7ad30> (a EDU.oswego.cs.dl.util.concurrent.Semaphore)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.acquireSemaphore(SiiamSinglePointOfEntry.java:283)
    at com.telstra.siiam.web.arch.screensflow.SiiamSinglePointOfEntry.doGet(SiiamSinglePointOfEntry.java:147)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:743)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
    at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:223)
    at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:283)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3245)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2003)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:1909)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1359)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    Please help me.

    Thanks for reply Jay. I check my code but didn't understand where is the problem here is the code snap could you please check and pin point me where is things wrong.
    package com.telstra.siiam.web.arch.screensflow;
    import java.io.IOException;
    import java.util.ArrayList;
    import java.util.Collection;
    import java.util.Enumeration;
    import java.util.HashMap;
    import java.util.Iterator;
    import java.util.Map;
    import javax.management.MBeanServer;
    import javax.management.MBeanServerFactory;
    import javax.servlet.ServletException;
    import javax.servlet.http.HttpServletRequest;
    import javax.servlet.http.HttpServletResponse;
    import javax.servlet.http.HttpSession;
    import mx4j.util.StandardMBeanProxy;
    import org.apache.commons.logging.Log;
    import org.apache.commons.logging.LogFactory;
    import org.grnds.structural.web.GrndsExchangeContext;
    import org.grnds.structural.web.GrndsHttpServlet;
    import EDU.oswego.cs.dl.util.concurrent.Semaphore;
    import com.telstra.siiam.web.app.common.JspKeys;
    import com.telstra.siiam.web.app.common.SessionKeys;
    import com.telstra.siiam.web.arch.stats.ServletStats;
    import com.telstra.siiam.web.arch.stats.StatisticsHolder;
    import com.telstra.siiam.web.arch.stats.StatisticsHolderMBean;
    import com.telstra.siiam.web.arch.businessobjectdata.CaseDO;
    * Single point of entry (Controller) of the web-application.
    * <P>
    * The intent of this class is to add pre/post processings (logging/security
    * check etc) on top of the basic GRNDS controller.
    * <P>
    * The current implementation checks that the incoming request it not
    * out-of-context.
    public class SiiamSinglePointOfEntry extends GrndsHttpServlet {
    // Constants -----------------------------------------------------
    private static final Log _statsLogger = LogFactory.getLog("ServletStats");
    private static final Log _log =
    LogFactory.getLog(SiiamSinglePointOfEntry.class);
    private static final String REQUEST_SEMAPHORE = "ReqSemaphore";
         * Name of the request attribute added to incoming requests in order to
         * detect re-entrant calls.
    private static final String SEMAPHORE_OWNER = "Owner";
    // Attributes ----------------------------------------------------
    private MBeanServer _server;
    private StatisticsHolderMBean _holder;
    // Static --------------------------------------------------------
    // Constructors --------------------------------------------------
    // Public --------------------------------------------------------
    // Z implementation ----------------------------------------------
    // GrndsHttpServlet overrides
    public void init() throws ServletException {
    // System.out.println("[<SiiamSinglePointOfEntry> <init>] - calling init method of GrndsHttpServlet super class");
    super.init();
    // System.out.println("[<SiiamSinglePointOfEntry> <init>] - Called init method of GrndsHttpServlet super class");
    Iterator servers = MBeanServerFactory.findMBeanServer(null).iterator();
    if (!servers.hasNext()) {
    throw new IllegalStateException("No MBeanServer registered.");
    _server = (MBeanServer) servers.next();
    // System.out.println("[<SiiamSinglePointOfEntry> <init>] - server: " _server);
    _holder =
    (StatisticsHolderMBean) StandardMBeanProxy.create(
    StatisticsHolderMBean.class,
    _server,
    StatisticsHolder.NAME);
    // System.out.println("[<SiiamSinglePointOfEntry> <init>] - holder: " _holder.toString());
    protected void doPost(HttpServletRequest arg0, HttpServletResponse arg1)
    throws ServletException, IOException {
    // System.out.println("[<SiiamSinglePointOfEntry> <doPost>] - In doPost");
    /* capture user input in http request This code is written to only for debuging purpose */
         //########################Start####################################
              Enumeration params = arg0.getParameterNames();
              String paramName = null;
              String[] paramValues = null;
              //System.out.println("[<SiiamSinglePointOfEntry> <doPost>] - user input name value pair");
              while (params.hasMoreElements()) {
                   paramName = (String) params.nextElement();
                   paramValues = arg0.getParameterValues(paramName);
                   //System.out.println("\nParameter name is " + paramName);
                   for (int i = 0; i < paramValues.length; i++) {
                        //System.out.println(", value " + i + " is " +paramValues.toString());
    //########################End######################################
    long start = System.currentTimeMillis();
    try {
    acquireSemaphore(arg0);
    } catch (InterruptedException e) {
    throw new ServletException("Can not serialize requests.");
    try {
    if (checkFlow(arg0, arg1)) {
    // System.out.println("[<SiiamSinglePointOfEntry> <doPost>] - after checkflow arg1 " + arg1);
    super.doPost(arg0, arg1);
    } finally {
    releaseSemaphore(arg0);
    protected void doGet(HttpServletRequest arg0, HttpServletResponse arg1)
    throws ServletException, IOException {
    // System.out.println("[<SiiamSinglePointOfEntry> <doGet>] - In doGet");
    /* capture user input in http request This code is written to only for debuging purpose */
         //########################Start####################################
              Enumeration params = arg0.getParameterNames();
              String paramName = null;
              String[] paramValues = null;
              //System.out.println("[<SiiamSinglePointOfEntry> <doGet>] - user input name value pair");
              while (params.hasMoreElements()) {
                   paramName = (String) params.nextElement();
                   paramValues = arg0.getParameterValues(paramName);
              //     System.out.println("\nParameter name is " + paramName);
                   for (int i = 0; i < paramValues.length; i++) {
                        //System.out.println(", value " + i + " is " +paramValues[i].toString());
    //########################End######################################
    long start = System.currentTimeMillis();
    try {
    acquireSemaphore(arg0);
    } catch (InterruptedException e) {
    throw new ServletException("Can not serialize requests.");
    try {
    if (checkFlow(arg0, arg1)) {
                   //System.out.println("[<SiiamSinglePointOfEntry> <doGet>] - after checkflow arg1 " + arg1);
    super.doGet(arg0, arg1);
    } finally {
    releaseSemaphore(arg0);
    // Protected -----------------------------------------------------
    protected boolean doPreExchange(GrndsExchangeContext ctx_)
    throws ServletException, IOException {
    // Dump the session attributes
    HttpSession session = ctx_.getSession();
    Enumeration enumVar = session.getAttributeNames();
    Collection <Object> sessionKeys = new ArrayList<Object>();
    while (enumVar.hasMoreElements()) {
    sessionKeys.add(enumVar.nextElement());
    if ( _log.isDebugEnabled() ) {
    _log.debug("Session attributes {" + sessionKeys + "}");
    super.doPreExchange(ctx_);
    Integer servletDepth =
    (Integer) ctx_.getSession().getAttribute("perf.count");
    if (null == servletDepth || servletDepth.intValue() == 0) {
    ctx_.getSession().setAttribute(
    "perf.start",
    new Long(System.currentTimeMillis()));
    ctx_.getSession().setAttribute("perf.count", new Integer(1));
    } else {
    ctx_.getSession().setAttribute(
    "perf.count",
    new Integer(servletDepth.intValue() + 1));
    return true;
    protected void doPostExchange(GrndsExchangeContext ctx_)
    throws ServletException, IOException {
    super.doPostExchange(ctx_);
    String escid = (String) ctx_.getSession().getAttribute(SessionKeys.ECSID);
    String caseObjid = "";
    CaseDO caseDO =
    (CaseDO) ctx_.getSession().getAttribute(SessionKeys.CASE_DETAILS);
    if (caseDO != null && caseDO._objid != null) {
    caseObjid = caseDO._objid;
    _log.info("{" + escid + "},{" + caseObjid + "}");
    Integer servletDepth =
    (Integer) ctx_.getSession().getAttribute("perf.count");
    if (servletDepth != null) {
    servletDepth = new Integer(servletDepth.intValue() - 1);
    ctx_.getSession().setAttribute("perf.count", servletDepth);
    if (servletDepth.intValue() == 0) {
    Long startTime =
    (Long) ctx_.getSession().getAttribute("perf.start");
    long duration = System.currentTimeMillis() - startTime.longValue();
    String statisticName =
    doGetConversationName(ctx_.getRequest())
    + "/"
    + doGetCommand(ctx_.getRequest())
    + "/"
    + (String) ctx_.getRequest().getAttribute(
    "grnds_web.command.branch");
    ServletStats servletStats = _holder.findServletStats(statisticName);
    servletStats.getServiceTime().addDuration(duration);
    if (_statsLogger.isDebugEnabled()) {
    StringBuffer servletStatsString = new StringBuffer();
    servletStatsString.append("<ServletStats>");
    servletStatsString.append("{" + statisticName + "},");
    servletStatsString.append(
    "{" + servletStats.getServiceTime().getCount() + "},");
    servletStatsString.append("{" + duration + "},");
    servletStatsString.append(
    + servletStats.getServiceTime().getAvgResponseTime()
    + "}");
    _statsLogger.debug(servletStatsString);
    } else {
    throw new IllegalStateException("Servlet Depth is null in doPostExchange");
    // Private -------------------------------------------------------
    private void acquireSemaphore(HttpServletRequest arg0)
    throws InterruptedException {
    // If the incoming request defines this attribute, then this request
    // has been forwarded by another servlet. In this case, one does not
    // need to acquire the semaphore as the thread is already the owner.
    Integer deepth = (Integer) arg0.getAttribute(SEMAPHORE_OWNER);
    // System.out.println("[<SiiamSinglePointOfEntry> <acquireSemaphore>] - deepth :" +deepth);
    if (null != deepth) {
    deepth = new Integer(deepth.intValue() + 1);
    arg0.setAttribute(SEMAPHORE_OWNER, deepth);
    return;
    //System.out.println("[<SiiamSinglePointOfEntry> <acquireSemaphore>] - trying to get semaphore value from request");
    HttpSession session = arg0.getSession();
    // One serializes the requests.
    Semaphore semaphore;
    // System.out.println("[<SiiamSinglePointOfEntry> <acquireSemaphore>] - http session value : " +session);
    synchronized (session) {
    semaphore = (Semaphore) session.getAttribute(REQUEST_SEMAPHORE);
    //System.out.println("[<SiiamSinglePointOfEntry> <acquireSemaphore>] - semaphore value from session : " +semaphore);
    if (null == semaphore) {
    semaphore = new Semaphore(1);
    session.setAttribute(REQUEST_SEMAPHORE, semaphore);
    semaphore.acquire();
    arg0.setAttribute(SEMAPHORE_OWNER, new Integer(1));
    private void releaseSemaphore(HttpServletRequest arg0) {
    // See acquireSemaphore for more details.
    Integer deepth = (Integer) arg0.getAttribute(SEMAPHORE_OWNER);
    int curDeepth = deepth.intValue();
    if (1 < curDeepth) {
    deepth = new Integer(curDeepth - 1);
    arg0.setAttribute(SEMAPHORE_OWNER, deepth);
    return;
    HttpSession session = arg0.getSession();
    // One serializes the requests.
    Semaphore semaphore;
    synchronized (session) {
    semaphore = (Semaphore) session.getAttribute(REQUEST_SEMAPHORE);
    semaphore.release();
    arg0.removeAttribute(SEMAPHORE_OWNER);
         * Check that the incoming request is valid, i.e. not out-of-context.
         * <P>
         * One uses the ScreenFlow object stored in session
         * (SessionKeys.SCREENS_FLOW) in order to perform this validation.
         * <P>
         * If the request is out-of-context, then one forwards the process to the
         * last screen defined by the ScreenFlow object.
         * @return true if the incoming request is valid and false otherwise.
    private boolean checkFlow(HttpServletRequest arg0, HttpServletResponse arg1)
    throws ServletException, IOException {
         // System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] - in checkFlow");
    HttpSession session = arg0.getSession();
    // System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] -session " + session);
    ScreenFlow screenFlow =
    (ScreenFlow) session.getAttribute(SessionKeys.SCREENS_FLOW);
    //System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] -screenFlow " + screenFlow);
    if (null == screenFlow) {
    screenFlow = new ScreenFlow();
    session.setAttribute(SessionKeys.SCREENS_FLOW, screenFlow);
    return true;
    String nextScreen = arg0.getServletPath() + arg0.getPathInfo();
    // System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] -nextScreen " + nextScreen);
    // The ScreenFlow object records the URI + the query string.
    // System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] - arg0.getQueryString() " + arg0.getQueryString());
    if (null != arg0.getQueryString()) {
              //System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] - in querystring null");
    nextScreen += "?" + arg0.getQueryString();
    // System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] -nextScreen " + nextScreen);
    if (!screenFlow.isInContext(nextScreen)) {
              // System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] - in not isInContext");
    screenFlow.setSnapshotContext(arg0);
    // Add an error message corresponding to the out-of-context
    // navigation.
    Map errorMap = (Map) arg0.getAttribute(JspKeys.ERRORS_REQUEST_KEY);
    // System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] -errorMap " + errorMap);
    if (null == errorMap) {
    errorMap = new HashMap();
    System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] -errorMap in null" + errorMap);
    arg0.setAttribute(JspKeys.ERRORS_REQUEST_KEY, errorMap);
    errorMap.put("OCM", screenFlow.getOutOfContextErrorMessage());
    // dispatch to the previous screen defined by screenFlow.
    arg0.getRequestDispatcher(screenFlow.getLastURI()).forward(arg0, arg1);
    // System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] - before return false");
    return false;
    //System.out.println("[<SiiamSinglePointOfEntry> <checkFlow>] - before return true");
    return true;
    // Inner classes -------------------------------------------------

  • Stuck thread in Oracle Weblogic server

    Dear All,
    We have a stuck thread in Oracle WLS 10.3.3. We have deployed 7 ear files in 5th managed server(psMS5). We have stuck thread in one of the application (psinsurance). We have allocated 1GB heap space for the psMS5 managed server. We are using this in Development environment. Please check the below message from psMS5 managed server log file. Kindly provide reason for stuck thread and solution.
    WatchTime: Sep 23, 2011 10:28:29 AM IST
    WatchDomainName: dev_domain
    WatchServerName: psMS5
    WatchSeverityLevel: Warning
    WatchName: MS5-Watch
    WatchRuleType: Log
    WatchRule: ((MESSAGE LIKE '%has been busy for "%') AND (MSGID = 'BEA-000337') AND (SERVER = 'psMS5'))
    WatchData: DATE = Sep 23, 2011 10:28:28 AM IST SERVER = psMS5 MESSAGE = [STUCK] ExecuteThread: '22' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "629" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@1cac6525[
    POST */psinsurance/app/lending/insurance/PS00738D.jspx*?_adf.ctrl-state=24f0li74e_4 HTTP/1.1
    Accept: image/jpeg, application/x-ms-application, image/gif, application/xaml+xml, image/pjpeg, application/x-ms-xbap, */*
    Referer: http://sis-prosun11/psinsurance/faces/PS00003?jsessionid=r2BrT8TpqZBsnLhCw2Y8KDpTV7hMpgnLDFW54P87ZpHwn8JMy88s%21168932459%211316753022074&_afrWindowMode=0&_afrLoop=244724092027000&_adf.ctrl-state=24f0li74e_4
    Accept-Language: en-US
    User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; Tablet PC 2.0)
    Content-Type: application/x-www-form-urlencoded
    Accept-Encoding: gzip, deflate
    Content-Length: 554
    Cache-Control: no-cache
    Cookie: JSESSIONID=LkJcT8TfMT64SyQJT4Ls4sXhfDl0pTS7CXJVQ9KcryHGWJ1dhyfz!1373322659
    Connection: Keep-Alive
    Proxy-Client-IP: 192.168.9.179
    X-Forwarded-For: 192.168.9.179
    X-WebLogic-KeepAliveSecs: 30
    X-WebLogic-Force-JVMID: 1373322659
    ]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
    Thread-237 "[STUCK] ExecuteThread: '22' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, suspended, priority=1, DAEMON> {
    java.io.UnixFileSystem.getBooleanAttributes0(UnixFileSystem.java:???)
    java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:228)
    java.io.File.exists(File.java:729)
    weblogic.utils.classloaders.ClasspathClassFinder.getFileSource(ClasspathClassFinder.java:383)
    weblogic.utils.classloaders.ClasspathClassFinder.getSourcesInternal(ClasspathClassFinder.java:333)
    weblogic.utils.classloaders.ClasspathClassFinder.getSource(ClasspathClassFinder.java:316)
    weblogic.utils.classloaders.JarClassFinder.getSource(JarClassFinder.java:58)
    weblogic.utils.classloaders.AbstractClassFinder.getClassSource(AbstractClassFinder.java:22)
    weblogic.utils.classloaders.MultiClassFinder.getClassSource(MultiClassFinder.java:56)
    weblogic.utils.classloaders.CodeGenClassFinder.getClassSource(CodeGenClassFinder.java:26)
    weblogic.utils.classloaders.GenericClassLoader.findLocalClass(GenericClassLoader.java:268)
    *^-- Holding lock: weblogic.utils.classloaders.GenericClassLoader@1e3295a1[thin lock]*
    weblogic.utils.classloaders.GenericClassLoader.findClass(GenericClassLoader.java:237)
    java.lang.ClassLoader.loadClass(ClassLoader.java:292)
    *^-- Holding lock: weblogic.utils.classloaders.GenericClassLoader@1e3295a1[thin lock]*
    java.lang.ClassLoader.loadClass(ClassLoader.java:292)
    java.lang.ClassLoader.loadClass(ClassLoader.java:248)
    weblogic.utils.classloaders.GenericClassLoader.loadClass(GenericClassLoader.java:177)
    weblogic.utils.classloaders.ChangeAwareClassLoader.loadClass(ChangeAwareClassLoader.java:37)
    *^-- Holding lock: weblogic.utils.classloaders.ChangeAwareClassLoader@1e553474[thin lock]*
    java.lang.Class.getDeclaredConstructors0(Class.java:???)
    java.lang.Class.privateGetDeclaredConstructors(Class.java:2370)
    java.lang.Class.getConstructor0(Class.java:2699)
    java.lang.Class.newInstance0(Class.java:318)
    java.lang.Class.newInstance(Class.java:305)
    org.apache.myfaces.trinidadinternal.renderkit.ClassRendererInstantiator.instantiate(ClassRendererInstantiator.java:48)
    org.apache.myfaces.trinidadinternal.renderkit.RenderKitBase.findRenderer(RenderKitBase.java:146)
    org.apache.myfaces.trinidadinternal.renderkit.RenderKitDecorator.findRenderer(RenderKitDecorator.java:84)
    oracle.adfinternal.view.faces.unified.renderkit.UnifiedRenderKit._getRenderer(UnifiedRenderKit.java:218)
    oracle.adfinternal.view.faces.unified.renderkit.UnifiedRenderKit.findRenderer(UnifiedRenderKit.java:156)
    org.apache.myfaces.trinidadinternal.renderkit.RenderKitBase.getRenderer(RenderKitBase.java:129)
    org.apache.myfaces.trinidad.component.UIXComponentBase._getRendererImpl(UIXComponentBase.java:1143)
    org.apache.myfaces.trinidad.component.UIXComponentBase.getRenderer(UIXComponentBase.java:1173)
    org.apache.myfaces.trinidad.component.UIXComponentBase.getClientId(UIXComponentBase.java:316)
    javax.faces.webapp.UIComponentClassicTagBase.doStartTag(UIComponentClassicTagBase.java:1095)
    org.apache.myfaces.trinidad.webapp.UIXComponentELTag.doStartTag(UIXComponentELTag.java:70)
    oracle.adfinternal.view.faces.unified.taglib.input.UnifiedSelectBooleanCheckboxTag.doStartTag(UnifiedSelectBooleanCheckboxTag.java:45)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspIterationTagNode.executeHandler(OracleJspIterationTagNode.java:41)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspIterationTagNode.executeHandler(OracleJspIterationTagNode.java:41)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspClassicTagNode.evalBody(OracleJspClassicTagNode.java:83)
    oracle.jsp.runtime.tree.OracleJspBodyTagNode.executeHandler(OracleJspBodyTagNode.java:42)
    oracle.jsp.runtime.tree.OracleJspCustomTagNode.execute(OracleJspCustomTagNode.java:243)
    oracle.jsp.runtime.tree.OracleJspNode.execute(OracleJspNode.java:73)
    oracle.jsp.runtimev2.ShortCutServlet._jspService(ShortCutServlet.java:57)
    oracle.jsp.runtime.OracleJspBase.service(OracleJspBase.java:29)
    oracle.jsp.runtimev2.JspPageTable.compileAndServe(JspPageTable.java:650)
    oracle.jsp.runtimev2.JspPageTable.service(JspPageTable.java:330)
    oracle.jsp.runtimev2.JspServlet.internalService(JspServlet.java:680)
    oracle.jsp.runtimev2.JspServlet.service(JspServlet.java:653)
    javax.servlet.http.HttpServlet.service(HttpServlet.java:815)
    weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
    weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
    weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:206)
    weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
    oracle.adf.library.webapp.LibraryFilter.doFilter(LibraryFilter.java:147)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
    weblogic.servlet.internal.RequestDispatcherImpl.invokeServlet(RequestDispatcherImpl.java:520)
    weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:112)
    com.sun.faces.context.ExternalContextImpl.dispatch(ExternalContextImpl.java:402)
    org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
    org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
    org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
    org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
    org.apache.myfaces.trinidadinternal.context.FacesContextFactoryImpl$OverrideDispatch.dispatch(FacesContextFactoryImpl.java:261)
    com.sun.faces.application.ViewHandlerImpl.executePageToBuildView(ViewHandlerImpl.java:428)
    com.sun.faces.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:132)
    javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:189)
    org.apache.myfaces.trinidadinternal.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:155)
    oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._renderResponse(LifecycleImpl.java:706)
    oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:244)
    oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:199)
    javax.faces.webapp.FacesServlet.service(FacesServlet.java:246)
    weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
    weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
    weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:206)
    weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
    oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:134)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
    oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:69)
    org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:411)
    oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:44)
    org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:411)
    org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:210)
    org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:126)
    org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:91)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
    oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:94)
    oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:299)
    oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:406)
    oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:82)
    oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:70)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
    oracle.adf.library.webapp.LibraryFilter.doFilter(LibraryFilter.java:147)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
    oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:114)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
    weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:25)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:55)
    weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.doIt(WebAppServletContext.java:3656)
    weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3650)
    weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:308)
    weblogic.security.service.SecurityManager.runAs(SecurityManager.java:117)
    weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2204)
    weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2126)
    weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1412)
    weblogic.work.ExecuteThread.execute(ExecuteThread.java:198)
    weblogic.work.ExecuteThread.run(ExecuteThread.java:165)
    SUBSYSTEM = WebLogicServer USERID = <WLS Kernel> SEVERITY = Error THREAD = [ACTIVE] ExecuteThread: '18' for queue: 'weblogic.kernel.Default (self-tuning)' MSGID = BEA-000337 MACHINE = sis-prosun11.sis.ad TXID = CONTEXTID = 11d1def534ea1be0:3bbe257e:13286031cbf:-7ffd-0000000000002fe7 TIMESTAMP = 1316753908672
    WatchAlarmType: AutomaticReset
    WatchAlarmResetPeriod: 60000
    SMTPNotificationName: MS5-Health-Notification

    I found something interesting to the question I posted from the below link:
    http://www.mail-archive.com/[email protected]/msg03217.html

  • How to monitor/examine threads usage in WebLogic Server?

    Hi,
    I need to monitor andd examine the usage of the threads (execute, non-blocking
    execute, etc.) in my WebLogic Server (WLS) instance (5.1 SP10 on Solaris 2.6)
    so that I can check that multi-threading is being used by WLS when executing methods
    on some objects.
    I have looked at the WLS Console but it does not seem to give any useful info
    on this. I have used OptimizeIt during the development on NT and know that it
    gives some info on threads usage but am not sure if it will do the job on a Solaris
    box with 1000's of requests hitting WLS.
    Has anybody done something similar and/or recommend any tips/tool?
    Many thanks in advance.

    On solaris, do
    kill -3 <weblogic_process_id>
    You will get a thread dump to standard error of the WebLogic process. Usually
    this is all you need to know.
    Mike
    "Michel Dinh" <[email protected]> wrote:
    >
    Hi,
    I need to monitor andd examine the usage of the threads (execute, non-blocking
    execute, etc.) in my WebLogic Server (WLS) instance (5.1 SP10 on Solaris
    2.6)
    so that I can check that multi-threading is being used by WLS when executing
    methods
    on some objects.
    I have looked at the WLS Console but it does not seem to give any useful
    info
    on this. I have used OptimizeIt during the development on NT and know
    that it
    gives some info on threads usage but am not sure if it will do the job
    on a Solaris
    box with 1000's of requests hitting WLS.
    Has anybody done something similar and/or recommend any tips/tool?
    Many thanks in advance.

  • How to get a thread dump from Weblogic 9.1

    Hi All,
    Can someone please walk me through how to configure a WLS9.1 server to generate thread dumps. Ideally I'd like to do this via the admin console. I read about the MagicThreadDumpFile property, but can't see where/how to set it.
    Many Thanks
    Stuart

    I only know how to do this in WLS 8.1, but it will likely work in 9.1. On UNIX, you can send a kill -QUIT to the pid and it will dump threads to standard output for the server. You can also use weblogic.Admin THREAD_DUMP (http://e-docs.bea.com/wls/docs92/admin_ref/cli.html#wp1197887) or whatever is the equivalent in WLST now that weblogic.Admin is deprecated in 9.x. I'm guessing it is the threadDump() method documented at http://e-docs.bea.com/wls/docs92/config_scripting/reference.html#wp1104314.
    I know of no way to do this through the console, unfortunately.

  • Weblogic sp4 on linux out of memory expections - Thread dump

    Any body has idea why out of memory expections?
    Here is the thread dump.
    Full thread dump Java HotSpot(TM) Server VM (1.4.2_05-b04 mixed mode):
    "Thread-33" daemon prio=1 tid=0x086175f0 nid=0x4f8e runnable [c8d57000..c8d5723c]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
         - locked <0xd48f7820> (a java.net.PlainSocketImpl)
         at java.net.ServerSocket.implAccept(ServerSocket.java:448)
         at java.net.ServerSocket.accept(ServerSocket.java:419)
         at org.apache.axis.monitor.SOAPMonitorService$ServerSocketThread.run(SOAPMonitorService.java:189)
         at java.lang.Thread.run(Thread.java:534)
    "CustomerClientDispatcherThread" daemon prio=1 tid=0x08877100 nid=0x4f8e in Object.wait() [c77ff000..c77ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd45b7330> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.amgen.ea.orx.queue.impl.PersistenceQueue.peek(PersistenceQueue.java:58)
         - locked <0xd45b7330> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
         at com.amgen.ea.orx.custclient.impl.CustomerClientDispatcher.run(CustomerClientDispatcher.java:50)
         at java.lang.Thread.run(Thread.java:534)
    "CustomerClientDispatcherThread" daemon prio=1 tid=0xcb625c28 nid=0x4f8e in Object.wait() [c7b8c000..c7b8c23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3ce7958> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.amgen.ea.orx.queue.impl.PersistenceQueue.peek(PersistenceQueue.java:58)
         - locked <0xd3ce7958> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
         at com.amgen.ea.orx.custclient.impl.CustomerClientDispatcher.run(CustomerClientDispatcher.java:52)
         at java.lang.Thread.run(Thread.java:534)
    "Thread-8" daemon prio=1 tid=0x08710e80 nid=0x4f8e in Object.wait() [c7cc4000..c7cc423c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd38b44c8> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.amgen.ea.orx.queue.impl.PersistenceQueue.peek(PersistenceQueue.java:58)
         - locked <0xd38b44c8> (a com.amgen.ea.orx.queue.impl.PersistenceQueue)
         at com.amgen.ea.orx.custclient.impl.CustomerClientDispatcher.run(CustomerClientDispatcher.java:52)
         at java.lang.Thread.run(Thread.java:534)
    "ListenThread.Default" prio=1 tid=0xcc21b658 nid=0x4f8e runnable [c7c0c000..c7c0c23c]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
         - locked <0xd3811cf8> (a java.net.PlainSocketImpl)
         at java.net.ServerSocket.implAccept(ServerSocket.java:448)
         at java.net.ServerSocket.accept(ServerSocket.java:419)
         at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
         at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:735)
         at weblogic.t3.srvr.ListenThread.run(ListenThread.java:301)
    "Thread-6" prio=1 tid=0xcb3ef610 nid=0x4f8e in Object.wait() [c92a0000..c92a023c]
         at java.lang.Object.wait(Native Method)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <0xd348db48> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-5" prio=1 tid=0x08c46fd8 nid=0x4f8e in Object.wait() [c9500000..c950023c]
         at java.lang.Object.wait(Native Method)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <0xd34901c8> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "LDAPConnThread-0 ldap://0.0.0.0:7013" daemon prio=1 tid=0xcb67b150 nid=0x4f8e runnable [c9580000..c958023c]
         at java.net.SocketInputStream.socketRead0(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:129)
         at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
         at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
         - locked <0xd3490a98> (a java.io.BufferedInputStream)
         at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
         at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
         at java.lang.Thread.run(Thread.java:534)
    "VDE Transaction Processor Thread" prio=1 tid=0xcb2fe110 nid=0x4f8e in Object.wait() [c9600000..c960023c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3490b30> (a com.octetstring.vde.backend.standard.TransactionProcessor)
         at java.lang.Object.wait(Object.java:429)
         at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:365)
         - locked <0xd3490b30> (a com.octetstring.vde.backend.standard.TransactionProcessor)
         at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
    "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon prio=1 tid=0x08665ba8 nid=0x4f8e in Object.wait() [c9680000..c968023c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3490ba8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon prio=1 tid=0x0830a7e0 nid=0x4f8e in Object.wait() [c9700000..c970023c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3490c28> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon prio=1 tid=0x080a0c00 nid=0x4f8e in Object.wait() [c9780000..c978023c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3490ca8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=1 tid=0xcafb3be8 nid=0x4f8e runnable [c98ff000..c98ff23c]
         at weblogic.socket.PosixSocketMuxer.poll(Native Method)
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:100)
         - locked <0xd31100e0> (a java.lang.String)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=1 tid=0xcaf65228 nid=0x4f8e waiting for monitor entry [c997f000..c997f23c]
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
         - waiting to lock <0xd31100e0> (a java.lang.String)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=1 tid=0xcafb0c20 nid=0x4f8e waiting for monitor entry [c99ff000..c99ff23c]
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
         - waiting to lock <0xd31100e0> (a java.lang.String)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "weblogic.security.SpinnerRandomSource" daemon prio=1 tid=0xcaf64f98 nid=0x4f8e in Object.wait() [c9a7f000..c9a7f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31182d8> (a java.lang.Object)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.security.SpinnerRandomBitsSource.run(SpinnerRandomBitsSource.java:60)
         - locked <0xd31182d8> (a java.lang.Object)
         at java.lang.Thread.run(Thread.java:534)
    "weblogic.time.TimeEventGenerator" daemon prio=1 tid=0xcb3e1400 nid=0x4f8e in Object.wait() [c9aff000..c9aff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118348> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:272)
         - locked <0xd3118348> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:118)
         at java.lang.Thread.run(Thread.java:534)
    "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb3df3a8 nid=0x4f8e in Object.wait() [c9b7f000..c9b7f23c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31183b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb3de7a0 nid=0x4f8e in Object.wait() [c9bff000..c9bff23c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118438> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb3ddcc0 nid=0x4f8e in Object.wait() [c9c7f000..c9c7f23c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31184b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb1c66f0 nid=0x4f8e in Object.wait() [c9cff000..c9cff23c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118538> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0xcb1c5b58 nid=0x4f8e in Object.wait() [c9d7f000..c9d7f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31185b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31185b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '39' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb1c4f50 nid=0x4f8e in Object.wait() [c9dff000..c9dff23c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118638> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '38' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb1c4348 nid=0x4f8e in Object.wait() [c9e7f000..c9e7f23c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31186b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '37' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb1c3740 nid=0x4f8e in Object.wait() [c9eff000..c9eff23c]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118738> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '36' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb1c2ba8 nid=0x4f8e in Object.wait() [c9f7f000..c9f7f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31187b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31187b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '35' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb674078 nid=0x4f8e in Object.wait() [c9fff000..c9fff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118838> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118838> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '34' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb673470 nid=0x4f8e in Object.wait() [ca07f000..ca07f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31188b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31188b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '33' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb6728d8 nid=0x4f8e in Object.wait() [ca0ff000..ca0ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118938> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118938> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '32' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb671cd0 nid=0x4f8e in Object.wait() [ca17f000..ca17f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31189b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31189b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '31' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb6710e0 nid=0x4f8e in Object.wait() [ca1ff000..ca1ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118a38> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118a38> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '30' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfdb548 nid=0x4f8e in Object.wait() [ca27f000..ca27f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118ab8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118ab8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '29' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfda940 nid=0x4f8e in Object.wait() [ca2ff000..ca2ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118b38> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118b38> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '28' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfd9d58 nid=0x4f8e in Object.wait() [ca37f000..ca37f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118bb8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118bb8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '27' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfd91c0 nid=0x4f8e in Object.wait() [ca3ff000..ca3ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118c38> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118c38> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '26' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb119a40 nid=0x4f8e in Object.wait() [ca47f000..ca47f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118cb8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118cb8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '25' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb118e38 nid=0x4f8e in Object.wait() [ca4ff000..ca4ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118d38> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118d38> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '24' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb118230 nid=0x4f8e in Object.wait() [ca57f000..ca57f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118db8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118db8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '23' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcc207638 nid=0x4f8e in Object.wait() [ca5ff000..ca5ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118e38> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118e38> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcc206a30 nid=0x4f8e in Object.wait() [ca67f000..ca67f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118eb8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118eb8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '21' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcc205e28 nid=0x4f8e in Object.wait() [ca6ff000..ca6ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118f38> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118f38> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '20' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfbf1e0 nid=0x4f8e in Object.wait() [ca77f000..ca77f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3118fb8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3118fb8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '19' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfbe648 nid=0x4f8e in Object.wait() [ca7ff000..ca7ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119038> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119038> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '18' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfbda40 nid=0x4f8e in Object.wait() [ca87f000..ca87f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31190b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31190b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '17' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb62c500 nid=0x4f8e in Object.wait() [ca8ff000..ca8ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119138> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119138> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '16' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb62b8f8 nid=0x4f8e in Object.wait() [ca97f000..ca97f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31191b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31191b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '15' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb62acf0 nid=0x4f8e in Object.wait() [ca9ff000..ca9ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119238> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119238> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb61f5a8 nid=0x4f8e in Object.wait() [caa7f000..caa7f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31192b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31192b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb61e9e0 nid=0x4f8e in Object.wait() [caaff000..caaff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119338> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119338> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf13af0 nid=0x4f8e in Object.wait() [cab7f000..cab7f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31193b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31193b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf12ee8 nid=0x4f8e in Object.wait() [cabff000..cabff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119438> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119438> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf12350 nid=0x4f8e in Object.wait() [cac7f000..cac7f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31194b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31194b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb309598 nid=0x4f8e in Object.wait() [cacff000..cacff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119538> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119538> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb3089c8 nid=0x4f8e in Object.wait() [cad7f000..cad7f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31195b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31195b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf56250 nid=0x4f8e in Object.wait() [cadff000..cadff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119638> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119638> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf55cb0 nid=0x4f8e in Object.wait() [cae7f000..cae7f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31196b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31196b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf55918 nid=0x4f8e in Object.wait() [caeff000..caeff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119738> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119738> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf55510 nid=0x4f8e in Object.wait() [cb47f000..cb47f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31197b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31197b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcaf55150 nid=0x4f8e in Object.wait() [cb4ff000..cb4ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119838> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119838> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcbfc7bd8 nid=0x4f8e in Object.wait() [cb57f000..cb57f23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31198b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31198b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb3cd250 nid=0x4f8e in Object.wait() [cb5ff000..cb5ff23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119938> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd3119938> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0xcb3cd0b8 nid=0x4f8e in Object.wait() [cc1fe000..cc1fe23c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd31199b8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xd31199b8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "Thread-1" daemon prio=1 tid=0x086d6478 nid=0x4f8e in Object.wait() [cc3e1000..cc3e123c]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xd3119a88> (a java.util.TaskQueue)
         at java.lang.Object.wait(Object.java:429)
         at java.util.TimerThread.mainLoop(Timer.java:403)
         - locked <0xd3119a88> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Signal Dispatcher" daemon prio=1 tid=0x080c4170 nid=0x4f8e waiting on condition [0..0]
    "Finalizer" daemon prio=1 tid=0x080bfac0 nid=0x4f8e in Object.wait() [cf509000..cf50923c]
         at java.lang.Object.wait(Native Method)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
         - locked <0xd3129c78> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
    "Refe

    <p>Can you post the stack trace. I assume these thread dumps were taken after the error occured. Can you take a few dumps just before you run out of memory.</p>
    <p>
    Hussein Badakhchani</br>
    </p>

  • Weblogic.kernel.Default not using all threads

    We are running weblogic 8.1 sp4 on HP Tru64 5.1.
    We have an admin server and 3 managed servers in a cluster.
    When monitoring the weblogic.kernal.Default execute threads through the weblogic console, threads 0 to 15 have zero total requests, and the user is marked '<WLS Kernal>'. Threads 16 to 24 share the entire workload with thousands of requests shared between them, and have user marked as 'n/a' (when idle).
    I have done a thread dump, and threads 0 to 15 just seem to be idle.
    This is the case for the admin server, server 1 and server 3. But server 2 actually shows all threads 0 to 24 as sharing the workload, and the user is 'n/a' for all threads.
    Is there a reason for this?
    Below is a snippet of the thread dump showing a thread that is has user '<WLS Kernel>':
    **** ExecuteThread: '3' for queue: 'weblogic.kernel.Default' thread 0x207d8e80 Stack trace:
    pc 0x03ff805c2cc8 sp 0x200026ecc00 __hstTransferRegisters (line -1)
    pc 0x03ff805b2384 sp 0x200026ecc00 __osTransferContext (line -1)
    pc 0x03ff805a3d20 sp 0x200026ecd90 __dspDispatch (line -1)
    pc 0x03ff805a309c sp 0x200026ecde0 __cvWaitPrim (line -1)
    pc 0x03ff805a0518 sp 0x200026ece80 __pthread_cond_wait (line -1)
    pc 0x03ffbff31558 sp 0x200026ecea0 monitor_wait (line 625)
    pc 0x03ffbff5ea48 sp 0x200026ecf10 JVM_MonitorWait (line 1037)
    pc 0x00003001304c sp 0x200026ecf20 -1: java/lang/Object.wait(J)V
    pc 0x0000302047dc sp 0x200026ecfd0 2: java/lang/Object.wait()V
    pc 0x000030204784 sp 0x200026ecfe0 8: weblogic/kernel/ExecuteThread.waitForRequest()V
    pc 0x0000302044ec sp 0x200026ed000 43: weblogic/kernel/ExecuteThread.run()V
    pc 0x03ffbff91b28 sp 0x200026ed030 unpack_and_call (line 100)
    pc 0x03ffbff89ca4 sp 0x200026ed040 make_native_call (line 331)
    pc 0x03ffbff27bb0 sp 0x200026ed0f0 interpret (line 368)
    pc 0x03ffbff36bf0 sp 0x200026ed9d0 jni_call (line 583)
    pc 0x03ffbff378d8 sp 0x200026eda60 jni_CallVoidMethodA (line 70)
    pc 0x03ffbff37980 sp 0x200026eda90 jni_CallVoidMethod (line 88)
    pc 0x03ffbff2ecf4 sp 0x200026edb10 java_thread_start (line 592)
    pc 0x03ffbff2e720 sp 0x200026edb30 thread_body (line 460)
    pc 0x03ff805cf278 sp 0x200026edc00 __thdBase (line -1)

    Grand central dispatch - infancy, not really doing its job, and I don't think apps have to be specifically written for HT, but they do have to not do things that they use to - prevent threads from going to sleep! or be parked.
    high usage is not necessarily high efficiency. often the opposite.
    Windows 7 seems to be optimized for multi-core thanks to a lot of reworking. Intel wants and knows it isn't possible to hand code, that the hardware has to be smarter, too. But the OS has a job, and right now I don't think it does it properly. Or handle memory.
    Gulftown's 12MB cache will help, and over all should be 20% more efficient doing its work.
    With dual processors, and it doesn't look like there are two quick path bridges, data shuffling has led to memory thrashing. Use to be page thrashing with not enough memory. Then core thrashing but having the cores, but not integrated (2008 is often touted as being greatest design so far, but it was FOUR dual-cores, 2009 was the first with a processor that really was new design and (native) 4-core.
    One core should be owned by the OS so it is always available for its own work and housekeeping.
    The iTunes audio bug last year showed how damaging and not to implement code and how a thread could usurp processing and add a high cpu temperature while basically doing nothing, sort of a denial of service attack on the processor - those 80*C temps people had.
    All those new technology features under development and not like OpenCL, GCD and even OpenGL are tested, mature but rather 1.0 foundation for the future. A year ahead of readiness.

  • Weblogic 8.1 sp4 on Slowwaris 2.7 - Thread dump included

    Dear experts,
    We have a time response problem within our production environment, following is our configuration :
    Oracle 8.1.7.4
    Weblogic 8.1 sp4
    Solaris Sparc 2.7
    JSP is pre-compiled, though the time response behaviour is rather weird, sometime quick and most of the time very slow, that we can not stand with ie. 5 minutes for displaying the mainpage, worse is client IE browser should be shut and restart. Below is the thread dump of our server, we will appreciate if someone can interpret it and possibly lead us to pointers how to solve our problem.
    Full thread dump Java HotSpot(TM) Client VM (1.4.2_05-b04 mixed mode):
    "ExecuteThread: '3' for queue: 'JMS.TimerClientPool'" daemon prio=5 tid=0x005e1848 nid=0x34 in Object.wait() [ddf81000..ddf819f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe4d0e170> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe4d0e170> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '2' for queue: 'JMS.TimerClientPool'" daemon prio=5 tid=0x005e0b38 nid=0x33 in Object.wait() [de081000..de0819f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe4d0d9d0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe4d0d9d0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'JMS.TimerClientPool'" daemon prio=5 tid=0x005e08f0 nid=0x32 in Object.wait() [de181000..de1819f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe4d0d230> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe4d0d230> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'JMS.TimerClientPool'" daemon prio=5 tid=0x00359820 nid=0x31 in Object.wait() [de281000..de2819f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe4d0ca70> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe4d0ca70> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0x0060d850 nid=0x30 waiting for monitor entry [de381000..de3819f0]
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:93)
         - waiting to lock <0xe4c822d0> (a java.lang.String)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0x0060d0c8 nid=0x2f waiting for monitor entry [dea01000..dea019f0]
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:93)
         - waiting to lock <0xe4c822d0> (a java.lang.String)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0x0060cb28 nid=0x2e runnable [deb01000..deb019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe4cac810> (a [Lweblogic.socket.PosixSocketInfo$FdStruct;)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
         - locked <0xe4cac810> (a [Lweblogic.socket.PosixSocketInfo$FdStruct;)
         - locked <0xe4c822d0> (a java.lang.String)
         at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "ListenThread.Default" prio=5 tid=0x00609978 nid=0x2d runnable [dec01000..dec019f0]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
         - locked <0xe4cb5d80> (a java.net.PlainSocketImpl)
         at java.net.ServerSocket.implAccept(ServerSocket.java:448)
         at java.net.ServerSocket.accept(ServerSocket.java:419)
         at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
         at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:735)
         at weblogic.t3.srvr.ListenThread.run(ListenThread.java:301)
    "Thread-6" daemon prio=5 tid=0x001d2ab8 nid=0x2c in Object.wait() [df701000..df7019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe6a78a80> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <0xe6a78a80> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" daemon prio=5 tid=0x001d3b08 nid=0x2b in Object.wait() [dfe01000..dfe019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe6a32e48> (a weblogic.jms.backend.BETimerTree)
         at weblogic.jms.backend.BETimerTree.execute(BETimerTree.java:146)
         - locked <0xe6a32e48> (a weblogic.jms.backend.BETimerTree)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "weblogic.health.CoreHealthMonitor" daemon prio=5 tid=0x004ccf08 nid=0x2a waiting on condition [e0101000..e01019f0]
         at java.lang.Thread.sleep(Native Method)
         at weblogic.t3.srvr.CoreHealthMonitorThread.run(CoreHealthMonitorThread.java:128)
    "Thread-5" prio=5 tid=0x00387728 nid=0x29 in Object.wait() [e0201000..e02019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe66a3f78> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <0xe66a3f78> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "VDE Transaction Processor Thread" prio=2 tid=0x004a1138 nid=0x27 in Object.wait() [e0301000..e03019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe65b97d8> (a com.octetstring.vde.backend.standard.TransactionProcessor)
         at java.lang.Object.wait(Object.java:429)
         at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:365)
         - locked <0xe65b97d8> (a com.octetstring.vde.backend.standard.TransactionProcessor)
         at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
    "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x003cb6b0 nid=0x26 in Object.wait() [e0401000..e04019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe65b9858> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe65b9858> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x003caac0 nid=0x25 in Object.wait() [e0501000..e05019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe65b98d8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe65b98d8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x003ca010 nid=0x24 in Object.wait() [e0601000..e06019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe65b9958> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe65b9958> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" daemon prio=5 tid=0x003c9560 nid=0x23 in Object.wait() [e0701000..e07019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe65b99d8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe65b99d8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" daemon prio=5 tid=0x003c9318 nid=0x22 in Object.wait() [e0801000..e08019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe65b9a58> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe65b9a58> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "weblogic.security.SpinnerRandomSource" daemon prio=5 tid=0x003c6900 nid=0x21 in Object.wait() [e0901000..e09019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651be08> (a java.lang.Object)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.security.SpinnerRandomBitsSource.run(SpinnerRandomBitsSource.java:60)
         - locked <0xe651be08> (a java.lang.Object)
         at java.lang.Thread.run(Thread.java:534)
    "weblogic.time.TimeEventGenerator" daemon prio=9 tid=0x003c5958 nid=0x20 runnable [e0a01000..e0a019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651be78> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:272)
         - locked <0xe651be78> (a weblogic.time.common.internal.TimeTable)
         at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:118)
         at java.lang.Thread.run(Thread.java:534)
    "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x003c3988 nid=0x1f in Object.wait() [e0b01000..e0b019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651bef0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651bef0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x001fb810 nid=0x1e in Object.wait() [e0c01000..e0c019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651bf70> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651bf70> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x001fac20 nid=0x1d waiting on condition [e0d01000..e0d019f0]
         at weblogic.platform.SunVM.threadDump0(Native Method)
         - waiting to lock <0xe4c7cdd0> (a weblogic.platform.SunVM)
         at weblogic.platform.SunVM.threadDump(SunVM.java:106)
         at weblogic.t3.srvr.T3Srvr.getThreadDump(T3Srvr.java:1184)
         at weblogic.common.internal.AdminProxy.execute(AdminProxy.java:220)
         at weblogic.t3.srvr.ClientRequest$1.run(ClientContext.java:700)
         at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
         at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
         at weblogic.t3.srvr.ClientRequest.execute(ClientContext.java:697)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x001fa030 nid=0x1c in Object.wait() [e0e01000..e0e019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c070> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c070> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x001f9440 nid=0x1b in Object.wait() [e0f01000..e0f019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c0f0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c0f0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x001f8850 nid=0x1a in Object.wait() [e1001000..e10019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c170> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c170> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x001f7c60 nid=0x19 in Object.wait() [e1101000..e11019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c1f0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c1f0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x001f7070 nid=0x18 in Object.wait() [e1201000..e12019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c270> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c270> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x001f6480 nid=0x17 in Object.wait() [e1301000..e13019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c2f0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c2f0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x001f5890 nid=0x16 in Object.wait() [e1401000..e14019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c370> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c370> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x004d67b8 nid=0x15 in Object.wait() [e1501000..e15019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c3f0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c3f0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x004d5bc8 nid=0x14 in Object.wait() [e1601000..e16019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c470> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c470> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x004d4fd8 nid=0x13 in Object.wait() [e1701000..e17019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c4f0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c4f0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x004d43e8 nid=0x12 in Object.wait() [e1801000..e18019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c570> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c570> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x003b6d70 nid=0x11 in Object.wait() [e1901000..e19019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c5f0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c5f0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x003b61e8 nid=0x10 in Object.wait() [e1a01000..e1a019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c670> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c670> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x003b57a8 nid=0xf in Object.wait() [e1b01000..e1b019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c6f0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c6f0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x003b4e08 nid=0xe in Object.wait() [e1c01000..e1c019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c770> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c770> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x005e9030 nid=0xd in Object.wait() [e1d01000..e1d019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c7f0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c7f0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x005e8e90 nid=0xc in Object.wait() [e1e01000..e1e019f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe651c870> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <0xe651c870> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "Thread-1" daemon prio=5 tid=0x00201230 nid=0xb in Object.wait() [e4981000..e49819f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe637e1d0> (a java.util.TaskQueue)
         at java.lang.Object.wait(Object.java:429)
         at java.util.TimerThread.mainLoop(Timer.java:403)
         - locked <0xe637e1d0> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Signal Dispatcher" daemon prio=10 tid=0x000cdbc8 nid=0x8 runnable [0..0]
    "Finalizer" daemon prio=8 tid=0x000ca7b0 nid=0x6 in Object.wait() [fc381000..fc3819f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe6278d78> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
         - locked <0xe6278d78> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
    "Reference Handler" daemon prio=10 tid=0x000c8e50 nid=0x5 in Object.wait() [fde81000..fde819f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe6278de0> (a java.lang.ref.Reference$Lock)
         at java.lang.Object.wait(Object.java:429)
         at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
         - locked <0xe6278de0> (a java.lang.ref.Reference$Lock)
    "main" prio=5 tid=0x00038510 nid=0x1 in Object.wait() [ffbed000..ffbed7dc]
         at java.lang.Object.wait(Native Method)
         - waiting on <0xe62eeff0> (a weblogic.t3.srvr.T3Srvr)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1208)
         - locked <0xe62eeff0> (a weblogic.t3.srvr.T3Srvr)
         at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:390)
         at weblogic.Server.main(Server.java:32)
    "VM Thread" prio=5 tid=0x000c8008 nid=0x4 runnable
    "VM Periodic Task Thread" prio=10 tid=0x000d0a28 nid=0xa waiting on condition
    "Suspend Checker Thread" prio=10 tid=0x000cd260 nid=0x7 runnable
    Thanks in advance,
    saiful-france

    Hi All,
    It looks like I have the similar problem: I am using Weblogic 8.1 Sp3 platform. please help.
    Full thread dump Java HotSpot(TM) Server VM (1.4.2 1.4.2.03-040401-18:59-PA_RISC2.0 PA2.0 (aCC_AP) mixed mode):
    "Login" daemon prio=10 tid=01a0a0b0 nid=17817 lwp_id=1133989 in Object.wait() [0x2da54000..0x2da544f0]
         at java.lang.Object.wait(Native Method)
         at com.inprise.vbroker.ds.DSUser.doInvoke(DSUser.java:455)
         - locked <92588248> (a com.inprise.vbroker.ds.DSUser$1$DSAMessageHandler)
         at com.inprise.vbroker.ds.DSUser.invoke(DSUser.java:506)
         at com.inprise.vbroker.ds.DSUser$2.run(DSUser.java:712)
         at java.lang.Thread.run(Thread.java:534)
    "Login" daemon prio=10 tid=01a09f48 nid=17816 lwp_id=1133988 in Object.wait() [0x2d90f000..0x2d90f4f0]
         at java.lang.Object.wait(Native Method)
         at com.inprise.vbroker.ds.DSUser.doInvoke(DSUser.java:455)
         - locked <92580248> (a com.inprise.vbroker.ds.DSUser$1$DSAMessageHandler)
         at com.inprise.vbroker.ds.DSUser.invoke(DSUser.java:506)
         at com.inprise.vbroker.ds.DSUser$2.run(DSUser.java:712)
         at java.lang.Thread.run(Thread.java:534)
    "Login" daemon prio=10 tid=00c40450 nid=17815 lwp_id=1133969 in Object.wait() [0x2ed85000..0x2ed854f0]
         at java.lang.Object.wait(Native Method)
         at com.inprise.vbroker.ds.DSUser.doInvoke(DSUser.java:455)
         - locked <92446368> (a com.inprise.vbroker.ds.DSUser$1$DSAMessageHandler)
         at com.inprise.vbroker.ds.DSUser.invoke(DSUser.java:506)
         at com.inprise.vbroker.ds.DSUser$2.run(DSUser.java:712)
         at java.lang.Thread.run(Thread.java:534)
    "Login" daemon prio=10 tid=00c402e8 nid=17814 lwp_id=1133967 in Object.wait() [0x2db17000..0x2db174f0]
         at java.lang.Object.wait(Native Method)
         at com.inprise.vbroker.ds.DSUser.doInvoke(DSUser.java:455)
         - locked <9242e368> (a com.inprise.vbroker.ds.DSUser$1$DSAMessageHandler)
         at com.inprise.vbroker.ds.DSUser.invoke(DSUser.java:506)
         at com.inprise.vbroker.ds.DSUser$2.run(DSUser.java:712)
         at java.lang.Thread.run(Thread.java:534)
    "AreYouAlive" daemon prio=10 tid=077ca9b0 nid=11502 lwp_id=1080790 in Object.wait() [0x2d950000..0x2d9504f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3fcb3390> (a com.inprise.vbroker.ds.DSUser$AreYouAlive)
         at com.inprise.vbroker.ds.DSUser$AreYouAlive.run(DSUser.java:115)
         - locked <3fcb3390> (a com.inprise.vbroker.ds.DSUser$AreYouAlive)
    "DatagramThread" daemon prio=10 tid=077ca848 nid=11501 lwp_id=1080789 runnable [0x2d991000..0x2d9914f0]
         at java.net.PlainDatagramSocketImpl.receive(Native Method)
         - waiting to lock <3fcb5458> (a java.net.PlainDatagramSocketImpl)
         at java.net.DatagramSocket.receive(DatagramSocket.java:728)
         - locked <3fcb5488> (a java.net.DatagramPacket)
         - locked <3fcb54b0> (a java.net.DatagramSocket)
         at com.inprise.vbroker.ds.DSUser$DatagramThread.run(DSUser.java:169)
    "GarbageCollector" daemon prio=10 tid=077ca6e0 nid=11500 lwp_id=1080788 in Object.wait() [0x2d9d2000..0x2d9d24f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3fcb54d0> (a com.inprise.vbroker.orb.GarbageCollector)
         at com.inprise.vbroker.orb.GarbageCollector.run(GarbageCollector.java:62)
         - locked <3fcb54d0> (a com.inprise.vbroker.orb.GarbageCollector)
    "AreYouAlive" daemon prio=10 tid=030802e8 nid=11340 lwp_id=1078923 in Object.wait() [0x2da95000..0x2da954f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3fc90508> (a com.inprise.vbroker.ds.DSUser$AreYouAlive)
         at com.inprise.vbroker.ds.DSUser$AreYouAlive.run(DSUser.java:115)
         - locked <3fc90508> (a com.inprise.vbroker.ds.DSUser$AreYouAlive)
    "DatagramThread" daemon prio=10 tid=03080180 nid=11339 lwp_id=1078922 runnable [0x2dad6000..0x2dad64f0]
         at java.net.PlainDatagramSocketImpl.receive(Native Method)
         - waiting to lock <3fc925d0> (a java.net.PlainDatagramSocketImpl)
         at java.net.DatagramSocket.receive(DatagramSocket.java:728)
         - locked <3fc92600> (a java.net.DatagramPacket)
         - locked <3fc92628> (a java.net.DatagramSocket)
         at com.inprise.vbroker.ds.DSUser$DatagramThread.run(DSUser.java:169)
    "GarbageCollector" daemon prio=10 tid=03080018 nid=11338 lwp_id=1078921 in Object.wait() [0x2db58000..0x2db584f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3fc92648> (a com.inprise.vbroker.orb.GarbageCollector)
         at com.inprise.vbroker.orb.GarbageCollector.run(GarbageCollector.java:62)
         - locked <3fc92648> (a com.inprise.vbroker.orb.GarbageCollector)
    "AreYouAlive" daemon prio=10 tid=08005a10 nid=3830 lwp_id=947497 in Object.wait() [0x2db99000..0x2db994f0]
         at java.lang.Object.wait(Native Method)
         at com.inprise.vbroker.ds.DSUser.login(DSUser.java:736)
         - locked <3d4b1aa0> (a java.lang.Object)
         at com.inprise.vbroker.ds.DSUser.reconnect(DSUser.java:544)
         - locked <3d4b19b8> (a com.inprise.vbroker.ds.DSUser)
         at com.inprise.vbroker.ds.DSUser.invoke(DSUser.java:513)
         at com.inprise.vbroker.ds.DSUser$AreYouAlive.fire(DSUser.java:95)
         at com.inprise.vbroker.ds.DSUser$AreYouAlive.run(DSUser.java:117)
    "DatagramThread" daemon prio=10 tid=080058a8 nid=3829 lwp_id=947496 runnable [0x2dc1b000..0x2dc1b4f0]
         at java.net.PlainDatagramSocketImpl.receive(Native Method)
         - waiting to lock <3d4b3b20> (a java.net.PlainDatagramSocketImpl)
         at java.net.DatagramSocket.receive(DatagramSocket.java:728)
         - locked <3d4b3b50> (a java.net.DatagramPacket)
         - locked <3d4b3b78> (a java.net.DatagramSocket)
         at com.inprise.vbroker.ds.DSUser$DatagramThread.run(DSUser.java:169)
    "GarbageCollector" daemon prio=10 tid=08005740 nid=3828 lwp_id=947495 in Object.wait() [0x2dbda000..0x2dbda4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3d4b3b98> (a com.inprise.vbroker.orb.GarbageCollector)
         at com.inprise.vbroker.orb.GarbageCollector.run(GarbageCollector.java:62)
         - locked <3d4b3b98> (a com.inprise.vbroker.orb.GarbageCollector)
    "ExecuteThread: '14' for queue: 'JmsDispatcher'" daemon prio=10 tid=030424a8 nid=142 lwp_id=679935 in Object.wait() [0x2dc5c000..0x2dc5c4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b088> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b088> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '13' for queue: 'JmsDispatcher'" daemon prio=10 tid=03042340 nid=141 lwp_id=679934 in Object.wait() [0x2dc9d000..0x2dc9d4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b108> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b108> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '12' for queue: 'JmsDispatcher'" daemon prio=10 tid=030421d8 nid=140 lwp_id=679933 in Object.wait() [0x2dcde000..0x2dcde4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b188> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b188> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '11' for queue: 'JmsDispatcher'" daemon prio=10 tid=03042070 nid=139 lwp_id=679932 in Object.wait() [0x2dd1f000..0x2dd1f4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b208> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b208> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '10' for queue: 'JmsDispatcher'" daemon prio=10 tid=03041f08 nid=138 lwp_id=679931 in Object.wait() [0x2dd60000..0x2dd604f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b288> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b288> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '9' for queue: 'JmsDispatcher'" daemon prio=10 tid=03041da0 nid=137 lwp_id=679930 in Object.wait() [0x2dda1000..0x2dda14f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b308> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b308> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '8' for queue: 'JmsDispatcher'" daemon prio=10 tid=03041c38 nid=136 lwp_id=679929 in Object.wait() [0x2dde2000..0x2dde24f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b388> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b388> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '7' for queue: 'JmsDispatcher'" daemon prio=10 tid=03041ad0 nid=135 lwp_id=679928 in Object.wait() [0x2de23000..0x2de234f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b408> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b408> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '6' for queue: 'JmsDispatcher'" daemon prio=10 tid=03041968 nid=134 lwp_id=679927 in Object.wait() [0x2de64000..0x2de644f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b488> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b488> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '5' for queue: 'JmsDispatcher'" daemon prio=10 tid=03041800 nid=133 lwp_id=679926 in Object.wait() [0x2dea5000..0x2dea54f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b508> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b508> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '4' for queue: 'JmsDispatcher'" daemon prio=10 tid=03041698 nid=132 lwp_id=679925 in Object.wait() [0x2dee6000..0x2dee64f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b588> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b588> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '3' for queue: 'JmsDispatcher'" daemon prio=10 tid=03041530 nid=131 lwp_id=679924 in Object.wait() [0x2df27000..0x2df274f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b608> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b608> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '2' for queue: 'JmsDispatcher'" daemon prio=10 tid=030413c8 nid=130 lwp_id=679923 in Object.wait() [0x2df68000..0x2df684f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b688> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b688> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'JmsDispatcher'" daemon prio=10 tid=03041260 nid=129 lwp_id=679922 in Object.wait() [0x2dfa9000..0x2dfa94f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b708> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b708> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'JmsDispatcher'" daemon prio=10 tid=030410f8 nid=128 lwp_id=679921 in Object.wait() [0x2dfea000..0x2dfea4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b7a8> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3b81b7a8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ListenThread.Default" prio=10 tid=02953558 nid=127 lwp_id=679919 runnable [0x2e02b000..0x2e02b4f0]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
         - locked <3b81b8c0> (a java.net.PlainSocketImpl)
         at java.net.ServerSocket.implAccept(ServerSocket.java:454)
         at java.net.ServerSocket.accept(ServerSocket.java:425)
         at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
         at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:735)
         at weblogic.t3.srvr.ListenThread.run(ListenThread.java:301)
    "Adapter Suspend/Resume Task Handler" daemon prio=10 tid=029533f0 nid=126 lwp_id=679918 in Object.wait() [0x2e06c000..0x2e06c4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81b9a0> (a java.lang.String)
         at java.lang.Object.wait(Object.java:429)
         at com.bea.wlai.TaskHandler.run(TaskHandler.java:60)
         - locked <3b81b9a0> (a java.lang.String)
    "Adapter instance Auto-resume TaskHandler" daemon prio=10 tid=02953288 nid=125 lwp_id=679917 in Object.wait() [0x2e0ad000..0x2e0ad4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b81ba18> (a java.lang.String)
         at com.bea.wlai.TaskHandler.run(TaskHandler.java:55)
         - locked <3b81ba18> (a java.lang.String)
    "ApplicationView Auto-resume TaskHandler" daemon prio=10 tid=000b6360 nid=124 lwp_id=679915 in Object.wait() [0x2e0ee000..0x2e0ee4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b74b988> (a java.lang.String)
         at com.bea.wlai.TaskHandler.run(TaskHandler.java:55)
         - locked <3b74b988> (a java.lang.String)
    "ApplicationView Deployment TaskHandler" daemon prio=10 tid=000b61f8 nid=123 lwp_id=679914 in Object.wait() [0x2e12f000..0x2e12f4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b74b648> (a java.lang.String)
         at java.lang.Object.wait(Object.java:429)
         at com.bea.wlai.TaskHandler.run(TaskHandler.java:60)
         - locked <3b74b648> (a java.lang.String)
    "AreYouAlive" daemon prio=10 tid=000b6090 nid=122 lwp_id=679910 in Object.wait() [0x2e170000..0x2e1704f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Thread.join(Thread.java:1001)
         - locked <8e395cc8> (a java.lang.Thread)
         at java.lang.Thread.join(Thread.java:1054)
         at com.inprise.vbroker.ds.DSUser.login(DSUser.java:752)
         at com.inprise.vbroker.ds.DSUser.reconnect(DSUser.java:544)
         - locked <3b6e4558> (a com.inprise.vbroker.ds.DSUser)
         at com.inprise.vbroker.ds.DSUser.invoke(DSUser.java:513)
         at com.inprise.vbroker.ds.DSUser$AreYouAlive.fire(DSUser.java:95)
         at com.inprise.vbroker.ds.DSUser$AreYouAlive.run(DSUser.java:117)
    "DatagramThread" daemon prio=10 tid=000b5f28 nid=121 lwp_id=679909 runnable [0x2e1b1000..0x2e1b14f0]
         at java.net.PlainDatagramSocketImpl.receive(Native Method)
         - waiting to lock <3b6e6a18> (a java.net.PlainDatagramSocketImpl)
         at java.net.DatagramSocket.receive(DatagramSocket.java:728)
         - locked <3b6e9020> (a java.net.DatagramPacket)
         - locked <3b6e69f0> (a java.net.DatagramSocket)
         at com.inprise.vbroker.ds.DSUser$DatagramThread.run(DSUser.java:169)
    "GarbageCollector" daemon prio=10 tid=000b5dc0 nid=120 lwp_id=679908 in Object.wait() [0x2e1f2000..0x2e1f24f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3b6e3338> (a com.inprise.vbroker.orb.GarbageCollector)
         at com.inprise.vbroker.orb.GarbageCollector.run(GarbageCollector.java:62)
         - locked <3b6e3338> (a com.inprise.vbroker.orb.GarbageCollector)
    "Timer" daemon prio=10 tid=000b5af0 nid=119 lwp_id=679906 in Object.wait() [0x2e233000..0x2e2334f0]
         at java.lang.Object.wait(Native Method)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:272)
         - locked <3b65ee40> (a weblogic.time.common.internal.TimeTable)
         at weblogic.management.timer.Timer.run(Timer.java:495)
         at java.lang.Thread.run(Thread.java:534)
    "Timer" daemon prio=10 tid=000b5c58 nid=118 lwp_id=679905 in Object.wait() [0x2e274000..0x2e2744f0]
         at java.lang.Object.wait(Native Method)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:272)
         - locked <3b642528> (a weblogic.time.common.internal.TimeTable)
         at weblogic.management.timer.Timer.run(Timer.java:495)
         at java.lang.Thread.run(Thread.java:534)
    "Timer" daemon prio=10 tid=000b5820 nid=117 lwp_id=679904 in Object.wait() [0x2e2b5000..0x2e2b54f0]
         at java.lang.Object.wait(Native Method)
         at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:272)
         - locked <3b639540> (a weblogic.time.common.internal.TimeTable)
         at weblogic.management.timer.Timer.run(Timer.java:495)
         at java.lang.Thread.run(Thread.java:534)
    "ExecuteThread: '2' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=10 tid=077ca578 nid=116 lwp_id=679896 in Object.wait() [0x2e2f6000..0x2e2f64f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3ad75800> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=10 tid=077ca410 nid=115 lwp_id=679895 in Object.wait() [0x2e337000..0x2e3374f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3ad75328> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3ad75328> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=10 tid=077ca2a8 nid=114 lwp_id=679894 in Object.wait() [0x2e378000..0x2e3784f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3ad74e30> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3ad74e30> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'JMSStore<cgJMSStore_auto_1>.ioThreadPool'" daemon prio=10 tid=000b5988 nid=113 lwp_id=679892 in Object.wait() [0x2e3b9000..0x2e3b94f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <3af7c258> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "Thread-20" prio=10 tid=000b56b8 nid=112 lwp_id=679851 in Object.wait() [0x2e3fa000..0x2e3fa4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3a9b0250> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3a9b0250> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-19" prio=10 tid=000b5550 nid=111 lwp_id=679850 in Object.wait() [0x2e43b000..0x2e43b4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3a9b02f0> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3a9b02f0> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-18" daemon prio=10 tid=01a09c78 nid=110 lwp_id=679822 in Object.wait() [0x2e47c000..0x2e47c4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <39f1b930> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <39f1b930> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "ExecuteThread: '11' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=03040f90 nid=109 lwp_id=679809 in Object.wait() [0x2e4bd000..0x2e4bd4f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e53ac0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '10' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=03040e28 nid=108 lwp_id=679808 in Object.wait() [0x2e4fe000..0x2e4fe4f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e535a8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '9' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=03040cc0 nid=107 lwp_id=679807 in Object.wait() [0x2e53f000..0x2e53f4f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e53090> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '8' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=03040b58 nid=106 lwp_id=679806 in Object.wait() [0x2e580000..0x2e5804f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e52b28> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '7' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=030409f0 nid=105 lwp_id=679805 in Object.wait() [0x2e5c1000..0x2e5c14f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e52610> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '6' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=03040888 nid=104 lwp_id=679804 in Object.wait() [0x2e602000..0x2e6024f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e520f8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '5' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=03040720 nid=103 lwp_id=679803 in Object.wait() [0x2e643000..0x2e6434f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e51be0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '4' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=030405b8 nid=102 lwp_id=679802 in Object.wait() [0x2e684000..0x2e6844f0]
         at java.lang.Object.wait(Native Method)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e516c8> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '3' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=03040450 nid=101 lwp_id=679801 in Object.wait() [0x2e6c5000..0x2e6c54f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <39e511b0> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e511b0> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '2' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=030402e8 nid=100 lwp_id=679800 in Object.wait() [0x2e706000..0x2e7064f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <39e50c98> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e50c98> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '1' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=03040180 nid=99 lwp_id=679799 in Object.wait() [0x2e747000..0x2e7474f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <39e50780> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e50780> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "ExecuteThread: '0' for queue: 'JMS.TimerClientPool'" daemon prio=10 tid=03040018 nid=98 lwp_id=679798 in Object.wait() [0x2e788000..0x2e7884f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <39e50268> (a weblogic.kernel.ExecuteThread)
         at java.lang.Object.wait(Object.java:429)
         at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:153)
         - locked <39e50268> (a weblogic.kernel.ExecuteThread)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:172)
    "SeedGenerator Thread" daemon prio=10 tid=000b53e8 nid=97 lwp_id=679782 in Object.wait() [0x2e7c9000..0x2e7c94f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <39db8938> (a sun.security.provider.SeedGenerator$ThreadedSeedGenerator)
         at java.lang.Object.wait(Object.java:429)
         at sun.security.provider.SeedGenerator$ThreadedSeedGenerator.run(SeedGenerator.java:334)
         - locked <39db8938> (a sun.security.provider.SeedGenerator$ThreadedSeedGenerator)
         at java.lang.Thread.run(Thread.java:534)
    "Noisy Thread" daemon prio=10 tid=000b5280 nid=96 lwp_id=679781 in Object.wait() [0x2e80a000..0x2e80a4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <39db89a0> (a sun.security.provider.SeedGenerator$ThreadedSeedGenerator$BogusThread)
         at java.lang.Object.wait(Object.java:429)
         at sun.security.provider.SeedGenerator$ThreadedSeedGenerator$BogusThread.run(SeedGenerator.java:452)
         - locked <39db89a0> (a sun.security.provider.SeedGenerator$ThreadedSeedGenerator$BogusThread)
    "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" daemon prio=10 tid=000b5118 nid=95 lwp_id=679741 in Object.wait() [0x2e84b000..0x2e84b4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <395c5970> (a weblogic.jms.backend.BETimerTree)
         at weblogic.jms.backend.BETimerTree.execute(BETimerTree.java:146)
         - locked <395c5970> (a weblogic.jms.backend.BETimerTree)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    "Thread-17" prio=10 tid=000b4fb0 nid=94 lwp_id=679731 in Object.wait() [0x2e88c000..0x2e88c4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3971e8a0> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3971e8a0> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-16" prio=10 tid=000b4e48 nid=93 lwp_id=679728 in Object.wait() [0x2e8cd000..0x2e8cd4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3971e940> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3971e940> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-15" prio=10 tid=000b4ce0 nid=92 lwp_id=679727 in Object.wait() [0x2e90e000..0x2e90e4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3971e9e0> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3971e9e0> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-14" prio=10 tid=000b4b78 nid=91 lwp_id=679726 in Object.wait() [0x2e94f000..0x2e94f4f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3971ea80> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3971ea80> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-13" prio=10 tid=000b4a10 nid=90 lwp_id=679724 in Object.wait() [0x2e990000..0x2e9904f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3971eb20> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3971eb20> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-12" prio=10 tid=000b48a8 nid=89 lwp_id=679720 in Object.wait() [0x2e9d1000..0x2e9d14f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3971ebc0> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3971ebc0> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-11" prio=10 tid=000b4740 nid=88 lwp_id=679719 in Object.wait() [0x2ea12000..0x2ea124f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3971ec60> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3971ec60> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-10" prio=10 tid=000b45d8 nid=87 lwp_id=679718 in Object.wait() [0x2ea53000..0x2ea534f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3971ed00> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3971ed00> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-9" prio=10 tid=000b4470 nid=86 lwp_id=679717 in Object.wait() [0x2ea94000..0x2ea944f0]
         at java.lang.Object.wait(Native Method)
         - waiting on <3971eda0> (a java.util.TaskQueue)
         at java.util.TimerThread.mainLoop(Timer.java:429)
         - locked <3971eda0> (a java.util.TaskQueue)
         at java.util.TimerThread.run(Timer.java:382)
    "Thread-8" prio=10 tid=000b4308 nid=85 lwp_id=679715 i

  • WebLogic 8.1 SP4 on Linux - thread dump does not work

    I have setup WebLogic 8.1 SP4 on RedHat Linux AS 3.3 with Sun JVM (142_05). When I try to perform a thread dump using weblogic.Admin, I receive the following error in the stderr file. I have also tried the kill -3 but still no thread dump. Is there some trick to this ?
    cannot load libary 'stackdump': java.lang.UnsatisfiedLinkError: no stackdump in java.library.path

    I am getting the same error as well
    cannot load libary 'stackdump': java.lang.UnsatisfiedLinkError: no stackdump in java.library.path
    I am creating a simple domain using the domain config wizard and I hope all the PATH and LD_LIBRARY_PATH are set by the default scripts. But I am still getting this error.
    But Kill -3 <PID> works though!
    Is is a know problem OR am I missing something?!
    Bala

  • Weblogic Server Shutting down execute threads

    Weblogic 5.1 SP9 on Solaris.
    After upgrading to SP9 from SP8 we are observing a new message in our log during
    the START UP PROCESS. It seems that after performing a GC and during the creation
    of the connection pools we are receiving a message "Shutting down execute threads".
    Though Weblogic starts up ok after this and performs ok we are still concerned
    on what execute threads are shutting down?
    Any help in an explanation would be appreciated.
    <I> <GC> GC: After free/total=505281560/531955712 (94%)
    GC: After free/total=505281560/531955712 (94%)Wed Aug 08 18:08:33 EDT 2001:<I> <WebLogicServer> Shutting down execute threads
    Wed Aug 08 18:08:33 EDT 2001:<I> <WebLogicServer> Shutdown completed
    Wed Aug 08 18:08:33 EDT 2001:<I> <WebLogicServer> Shutdown completed

    could you post complete the log file
    right from the server startup to until WLS
    listens on http & SSL ports?
    Kumar
    Andy wrote:
    Weblogic 5.1 SP9 on Solaris.
    After upgrading to SP9 from SP8 we are observing a new message in our log during
    the START UP PROCESS. It seems that after performing a GC and during the creation
    of the connection pools we are receiving a message "Shutting down execute threads".
    Though Weblogic starts up ok after this and performs ok we are still concerned
    on what execute threads are shutting down?
    Any help in an explanation would be appreciated.
    <I> <GC> GC: After free/total=505281560/531955712 (94%)
    GC: After free/total=505281560/531955712 (94%)Wed Aug 08 18:08:33 EDT 2001:<I> <WebLogicServer> Shutting down execute threads
    Wed Aug 08 18:08:33 EDT 2001:<I> <WebLogicServer> Shutdown completed
    Wed Aug 08 18:08:33 EDT 2001:<I> <WebLogicServer> Shutdown completed

  • About weblogic.transaction.AsyncQueue thread

    I've got a Solaris 8 prstat CPU usage dump for a Weblogic 6.1 process running EJB's
    Evertime I have correlated this prstat dump with the 'Full thread dump' (with the hex 'nid' number), it seems like one thread of the 'weblogic.transaction.AsyncQueue' thread group is using too much cpu power.
    "ExecuteThread: '0' for queue: 'weblogic.transaction.AsyncQueue'" daemon prio=5 tid=0x464818 nid=0x24 waiting on monitor [0xe4601000
    ..0xe46019d8]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:420)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
    Does anybody know what purpose has 'weblogic.transaction.AsyncQueue' thread exactly?
    Is there any parameter to tune the operation of this queue?

    That thread is idle so I doubt it's your problem. I believe the
    AsyncQueue handles some internal transaction manager work.
    I'm suspicious you're being lead to the wrong thread. I'd suggest
    trying one of the Java CPU profilers and seeing what they say.
    -- Rob
    Daniel Parra wrote:
    I've got a Solaris 8 prstat CPU usage dump for a Weblogic 6.1 process running EJB's
    Evertime I have correlated this prstat dump with the 'Full thread dump' (with the hex 'nid' number), it seems like one thread of the 'weblogic.transaction.AsyncQueue' thread group is using too much cpu power.
    "ExecuteThread: '0' for queue: 'weblogic.transaction.AsyncQueue'" daemon prio=5 tid=0x464818 nid=0x24 waiting on monitor [0xe4601000
    ..0xe46019d8]
    at java.lang.Object.wait(Native Method)
    at java.lang.Object.wait(Object.java:420)
    at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
    at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
    Does anybody know what purpose has 'weblogic.transaction.AsyncQueue' thread exactly?
    Is there any parameter to tune the operation of this queue?

  • Stuck thread in weblogic

    Hello All,
    We are getting stuck thread in weblogic under high load.
    following is the thread dump from weblogic 10
    "[STANDBY] ExecuteThread: '13' for queue: 'weblogic.kernel.Default (self-tuning)'" id=83 idx=0x134 tid=5376 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: weblogic/work/ExecuteThread@0x06DEC880[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:156)
    ^-- Lock released while waiting: weblogic/work/ExecuteThread@0x06DEC880[fat lock]
    at weblogic/work/ExecuteThread.run(ExecuteThread.java:177)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "[STANDBY] ExecuteThread: '14' for queue: 'weblogic.kernel.Default (self-tuning)'" id=84 idx=0x138 tid=1688 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: weblogic/work/ExecuteThread@0x06E50070[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:156)
    ^-- Lock released while waiting: weblogic/work/ExecuteThread@0x06E50070[fat lock]
    at weblogic/work/ExecuteThread.run(ExecuteThread.java:177)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "[STUCK] ExecuteThread: '15' for queue: 'weblogic.kernel.Default (self-tuning)'" id=85 idx=0x13c tid=3984 prio=1 alive, daemon
    at jrockit/vm/Allocator.allocArray(Allocator.java:392)
    at java/lang/AbstractStringBuilder.<init>(AbstractStringBuilder.java:44)
    at java/lang/StringBuffer.<init>(StringBuffer.java:80)
    at com/vignette/exolab/castor/jdo/oql/ParseTreeWalker.addWhereClause(ParseTreeWalker.java:994)
    at com/vignette/exolab/castor/jdo/oql/ParseTreeWalker.createQueryExpression(ParseTreeWalker.java:816)
    at com/vignette/exolab/castor/jdo/oql/ParseTreeWalker.<init>(ParseTreeWalker.java:139)
    at com/vignette/exolab/castor/jdo/engine/OQLQueryImpl.create(OQLQueryImpl.java:274)
    at com/vignette/exolab/castor/jdo/engine/DatabaseImpl.getOQLQuery(DatabaseImpl.java:502)
    at com/vignette/as/server/persist/dao/JDODAOPersistor.findByQuery(JDODAOPersistor.java:395)
    at com/vignette/as/server/persist/dao/JDODAOPersistor.findByIds(JDODAOPersistor.java:360)
    at com/vignette/as/server/persist/ExtensibleApplicationObjectPersistor.findByIdsHelper(ExtensibleApplicationObjectPersistor.java:159)
    at com/vignette/as/server/persist/ExtensibleApplicationObjectPersistor.findByIds(ExtensibleApplicationObjectPersistor.java:90)
    at com/vignette/as/server/logic/channel/ChannelOpsLogic.findById(ChannelOpsLogic.java:194)
    at com/vignette/as/server/logic/channel/ChannelOpsLogicGen.findById(ChannelOpsLogicGen.java:1553)
    at com/vignette/as/client/javabean/Channel.findById(Channel.java:247)
    at com/vignette/as/server/logic/channel/ChannelOpsLogic.getSubchannels(ChannelOpsLogic.java:563)
    at com/vignette/as/server/logic/channel/ChannelOpsLogicGen.getSubchannels(ChannelOpsLogicGen.java:3237)
    at com/vignette/as/client/javabean/ChannelBase.getSubchannels(ChannelBase.java:480)
    at com/vignette/as/client/javabean/ChannelBase.getAllSubchannels(ChannelBase.java:375)
    at com/astrazeneca/portal/dpm/ChannelWrapper.getSubchannels(ChannelWrapper.java:203)
    at jsp_servlet/_jsp/_grid/__xmlgeneration.subChannelRec(__xmlgeneration.java:97)
    at jsp_servlet/_jsp/_grid/__xmlgeneration.subChannelRec(__xmlgeneration.java:146)
    at jsp_servlet/_jsp/_grid/__xmlgeneration._jspService(__xmlgeneration.java:430)
    at weblogic/servlet/jsp/JspBase.service(JspBase.java:34)
    at weblogic/servlet/internal/StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:226)
    at weblogic/servlet/internal/StubSecurityHelper.invokeServlet(StubSecurityHelper.java:124)
    at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:283)
    at weblogic/servlet/internal/ServletStubImpl.execute(ServletStubImpl.java:175)
    at weblogic/servlet/internal/WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3395)
    at weblogic/security/acl/internal/AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic/security/service/SecurityManager.runAs(Lweblogic/security/acl/internal/AuthenticatedSubject;Lweblogic/security/acl/internal/AuthenticatedSubject;Ljava/security/PrivilegedAction;)Ljava/lang/Object;(Unknown Source)
    at weblogic/servlet/internal/WebAppServletContext.securedExecute(WebAppServletContext.java:2140)
    at weblogic/servlet/internal/WebAppServletContext.execute(WebAppServletContext.java:2046)
    at weblogic/servlet/internal/ServletRequestImpl.run(ServletRequestImpl.java:1366)
    at weblogic/work/ExecuteThread.execute(ExecuteThread.java:200)
    at weblogic/work/ExecuteThread.run(ExecuteThread.java:172)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "[STANDBY] ExecuteThread: '16' for queue: 'weblogic.kernel.Default (self-tuning)'" id=86 idx=0x140 tid=1192 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: weblogic/work/ExecuteThread@0x06E50AF0[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at weblogic/work/ExecuteThread.waitForRequest(ExecuteThread.java:156)
    ^-- Lock released while waiting: weblogic/work/ExecuteThread@0x06E50AF0[fat lock]
    at weblogic/work/ExecuteThread.run(ExecuteThread.java:177)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "VAP Topic Consumer Thread - 0" id=87 idx=0x144 tid=6040 prio=5 alive, in native, parked, daemon
    at jrockit/vm/Locks.park0(J)V(Native Method)
    at jrockit/vm/Locks.park(Locks.java:2416)
    at sun/misc/Unsafe.park(ZJ)V(Native Method)
    at java/util/concurrent/locks/LockSupport.park(LockSupport.java:118)
    at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1767)
    at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
    at com/epicentric/topic/internal/MessageQueue.remove(MessageQueue.java:67)
    at com/epicentric/topic/internal/Consumer.run(Consumer.java:72)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "VAP Topic Consumer Thread - 1" id=88 idx=0x148 tid=4752 prio=5 alive, in native, parked, daemon
    at jrockit/vm/Locks.park0(J)V(Native Method)
    at jrockit/vm/Locks.park(Locks.java:2416)
    at sun/misc/Unsafe.park(ZJ)V(Native Method)
    at java/util/concurrent/locks/LockSupport.park(LockSupport.java:118)
    at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1767)
    at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
    at com/epicentric/topic/internal/MessageQueue.remove(MessageQueue.java:67)
    at com/epicentric/topic/internal/Consumer.run(Consumer.java:72)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "VAP Topic Consumer Thread - 2" id=89 idx=0x14c tid=4504 prio=5 alive, in native, parked, daemon
    at jrockit/vm/Locks.park0(J)V(Native Method)
    at jrockit/vm/Locks.park(Locks.java:2416)
    at sun/misc/Unsafe.park(ZJ)V(Native Method)
    at java/util/concurrent/locks/LockSupport.park(LockSupport.java:118)
    at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1767)
    at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
    at com/epicentric/topic/internal/MessageQueue.remove(MessageQueue.java:67)
    at com/epicentric/topic/internal/Consumer.run(Consumer.java:72)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "VAP Topic Consumer Thread - 3" id=90 idx=0x150 tid=5572 prio=5 alive, in native, parked, daemon
    at jrockit/vm/Locks.park0(J)V(Native Method)
    at jrockit/vm/Locks.park(Locks.java:2416)
    at sun/misc/Unsafe.park(ZJ)V(Native Method)
    at java/util/concurrent/locks/LockSupport.park(LockSupport.java:118)
    at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1767)
    at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
    at com/epicentric/topic/internal/MessageQueue.remove(MessageQueue.java:67)
    at com/epicentric/topic/internal/Consumer.run(Consumer.java:72)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "VAP Topic Consumer Thread - 4" id=91 idx=0x154 tid=4340 prio=5 alive, in native, parked, daemon
    at jrockit/vm/Locks.park0(J)V(Native Method)
    at jrockit/vm/Locks.park(Locks.java:2416)
    at sun/misc/Unsafe.park(ZJ)V(Native Method)
    at java/util/concurrent/locks/LockSupport.park(LockSupport.java:118)
    at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1767)
    at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
    at com/epicentric/topic/internal/MessageQueue.remove(MessageQueue.java:67)
    at com/epicentric/topic/internal/Consumer.run(Consumer.java:72)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "CS_Local_Monitor_0" id=92 idx=0x158 tid=3864 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/vignette/config/client/cachefile/ConfigSpaceLocal$Monitor.run(ConfigSpaceLocal.java:1364)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-41" id=93 idx=0x15c tid=4884 prio=1 alive, in native, waiting, daemon
    -- Waiting for notification on: java/util/ArrayList@0x0A899918[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at com/vignette/logging/LocaleAppender$Dispatcher.run(LocaleAppender.java:393)
    ^-- Lock released while waiting: java/util/ArrayList@0x0A899918[fat lock]
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-42" id=94 idx=0x160 tid=4968 prio=1 alive, in native, waiting, daemon
    -- Waiting for notification on: java/util/ArrayList@0x06BE2238[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at com/vignette/logging/LocaleAppender$Dispatcher.run(LocaleAppender.java:393)
    ^-- Lock released while waiting: java/util/ArrayList@0x06BE2238[fat lock]
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "TaskScheduler thread" id=98 idx=0x164 tid=1580 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/epicentric/task/TaskScheduler.sleepUntilRuntime(TaskScheduler.java:226)
    at com/epicentric/task/TaskScheduler.run(TaskScheduler.java:83)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "TaskQueue Lease Manager" id=100 idx=0x168 tid=3908 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/epicentric/task/internal/LeaseManager.waitForNextExecutionTime(LeaseManager.java:69)
    at com/epicentric/task/internal/LeaseManager.run(LeaseManager.java:52)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread System Expiration and Ostracizing Thread" id=101 idx=0x16c tid=4200 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/epicentric/threadpool/standard/StandardThreadPool$ExpirationThread.run(StandardThreadPool.java:238)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Task Executor" id=102 idx=0x170 tid=3592 prio=1 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/epicentric/task/internal/TaskExecutor.waitForNextExecutionTime(TaskExecutor.java:205)
    at com/epicentric/task/internal/TaskExecutor.run(TaskExecutor.java:186)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Task Metric Gatherer" id=103 idx=0x174 tid=5988 prio=1 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/epicentric/task/internal/TaskExecutor$1.run(TaskExecutor.java:142)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "CS_Local_Monitor_0" id=142 idx=0x178 tid=5196 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/vignette/config/client/cachefile/ConfigSpaceLocal$Monitor.run(ConfigSpaceLocal.java:1364)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-54" id=130 idx=0x17c tid=648 prio=1 alive, in native, waiting, daemon
    -- Waiting for notification on: java/util/ArrayList@0x0AD3C798[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at com/vignette/logging/LocaleAppender$Dispatcher.run(LocaleAppender.java:393)
    ^-- Lock released while waiting: java/util/ArrayList@0x0AD3C798[fat lock]
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Timer-10" id=113 idx=0x180 tid=1092 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: java/util/TaskQueue@0x00B22F40[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/util/TimerThread.mainLoop(Timer.java:509)
    ^-- Lock released while waiting: java/util/TaskQueue@0x00B22F40[fat lock]
    at java/util/TimerThread.run(Timer.java:462)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "JNDI Monitor" id=116 idx=0x184 tid=1856 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: com/epicentric/jndi/Monitor@0x00B12D60[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at com/epicentric/jndi/Monitor.run(Monitor.java:100)
    ^-- Lock released while waiting: com/epicentric/jndi/Monitor@0x00B12D60[fat lock]
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-47" id=117 idx=0x188 tid=816 prio=5 alive, in native, daemon
    at jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native Method)
                    at jrockit/net/SocketNativeIO.socketRead(SocketNativeIO.java:31)
                    at java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.java)
                    at java/net/SocketInputStream.read(SocketInputStream.java:129)
                    at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)
                    at java/io/BufferedInputStream.read1(BufferedInputStream.java:256)
                    at java/io/BufferedInputStream.read(BufferedInputStream.java:313)
                    ^-- Holding lock: java/io/BufferedInputStream@0x00B3EA48[thin lock]
    at com/sun/jndi/ldap/Connection.run(Connection.java:784)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "TaskScheduler thread" id=119 idx=0x18c tid=4520 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/epicentric/task/TaskScheduler.run(TaskScheduler.java:94)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "OracleTimeoutPollingThread" id=124 idx=0x190 tid=2628 prio=10 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at oracle/jdbc/driver/OracleTimeoutPollingThread.run(OracleTimeoutPollingThread.java:158)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-55" id=131 idx=0x194 tid=5700 prio=1 alive, in native, waiting, daemon
    -- Waiting for notification on: java/util/ArrayList@0x0973F378[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at com/vignette/logging/LocaleAppender$Dispatcher.run(LocaleAppender.java:393)
    ^-- Lock released while waiting: java/util/ArrayList@0x0973F378[fat lock]
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-56" id=132 idx=0x198 tid=5596 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at org/apache/commons/pool/impl/GenericObjectPool$Evictor.run(GenericObjectPool.java:1122)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "CacheSyncThread" id=133 idx=0x19c tid=708 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/vignette/as/server/caching/CacheSynchronization.run(CacheSynchronization.java:135)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-58" id=135 idx=0x1a0 tid=5652 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at org/apache/commons/pool/impl/GenericObjectPool$Evictor.run(GenericObjectPool.java:1122)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-61" id=143 idx=0x1a4 tid=4196 prio=1 alive, in native, waiting, daemon
    -- Waiting for notification on: java/util/ArrayList@0x0BEF1160[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at com/vignette/logging/LocaleAppender$Dispatcher.run(LocaleAppender.java:393)
    ^-- Lock released while waiting: java/util/ArrayList@0x0BEF1160[fat lock]
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-62" id=144 idx=0x1a8 tid=5456 prio=1 alive, in native, waiting, daemon
    -- Waiting for notification on: java/util/ArrayList@0x0D650770[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at com/vignette/logging/LocaleAppender$Dispatcher.run(LocaleAppender.java:393)
    ^-- Lock released while waiting: java/util/ArrayList@0x0D650770[fat lock]
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-63" id=145 idx=0x1ac tid=1056 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at org/apache/commons/pool/impl/GenericObjectPool$Evictor.run(GenericObjectPool.java:1122)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "CacheSyncThread" id=146 idx=0x1b0 tid=3496 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/vignette/as/server/caching/CacheSynchronization.run(CacheSynchronization.java:135)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-64" id=147 idx=0x1b4 tid=4132 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at org/apache/commons/pool/impl/GenericObjectPool$Evictor.run(GenericObjectPool.java:1122)
    at java/lang/Thread.run(Thread.java:595)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "CS_Local_Monitor_0" id=221 idx=0x1b8 tid=6104 prio=5 alive, in native, sleeping, native_waiting, daemon
    at java/lang/Thread.sleep(J)V(Native Method)
    at com/vignette/config/client/cachefile/ConfigSpaceLocal$Monitor.run(ConfigSpaceLocal.java:1364)
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-84" id=222 idx=0x1bc tid=3500 prio=1 alive, in native, waiting, daemon
    -- Waiting for notification on: java/util/ArrayList@0x1673EAD8[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at com/vignette/logging/LocaleAppender$Dispatcher.run(LocaleAppender.java:393)
    ^-- Lock released while waiting: java/util/ArrayList@0x1673EAD8[fat lock]
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "Thread-85" id=223 idx=0x1c0 tid=5492 prio=1 alive, in native, waiting, daemon
    -- Waiting for notification on: java/util/ArrayList@0x1932F128[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)
    at java/lang/Object.wait(Object.java:474)
    at com/vignette/logging/LocaleAppender$Dispatcher.run(LocaleAppender.java:393)
    ^-- Lock released while waiting: java/util/ArrayList@0x1932F128[fat lock]
    at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
    -- end of trace
    "[STANDBY] ExecuteThread: '17' for queue

    Hi,
    We are facing a similar stuck thread problem with the following stack trace...
    Any help on this is much appreciated.
    Thanks,
    Sen
    Thread-86 "[STUCK] ExecuteThread: '10' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, waiting, priority=1, DAEMON> {
    -- Waiting for notification on: netscape.ldap.LDAPSearchListener@2accce6[fat lock]
    java.lang.Object.wait(Object.java:???)
    java.lang.Object.wait(Object.java:485)
    netscape.ldap.LDAPMessageQueue.waitForMessage(LDAPMessageQueue.java:198)
    netscape.ldap.LDAPMessageQueue.waitFirstMessage(LDAPMessageQueue.java:100)
    netscape.ldap.LDAPConnection.sendRequest(LDAPConnection.java:1782)
    ^-- Holding lock: netscape.ldap.LDAPConnection@138555c[thin lock]
    netscape.ldap.LDAPConnection.search(LDAPConnection.java:2500)
    weblogic.security.providers.authentication.LDAPAtnDelegate.getDNForUser(LDAPAtnDelegate.java:3317)
    weblogic.security.providers.authentication.LDAPAtnDelegate.listMemberGroups(LDAPAtnDelegate.java:2091)
    weblogic.security.providers.authentication.LDAPAtnLoginModuleImpl.addAllGroups(LDAPAtnLoginModuleImpl.java:419)
    weblogic.security.providers.authentication.LDAPAtnLoginModuleImpl.addGroups(LDAPAtnLoginModuleImpl.java:411)
    weblogic.security.providers.authentication.LDAPAtnLoginModuleImpl.login(LDAPAtnLoginModuleImpl.java:136)
    com.bea.common.security.internal.service.LoginModuleWrapper$1.run(LoginModuleWrapper.java:110)
    com.bea.common.security.internal.service.LoginModuleWrapper.login(LoginModuleWrapper.java:101)
    sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:???)
    sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:27)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:575)
    javax.security.auth.login.LoginContext.invoke(LoginContext.java:720)
    javax.security.auth.login.LoginContext.access$000(LoginContext.java:186)
    javax.security.auth.login.LoginContext$4.run(LoginContext.java:683)
    javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680)
    javax.security.auth.login.LoginContext.login(LoginContext.java:566)
    com.bea.common.security.internal.service.JAASLoginServiceImpl.login(JAASLoginServiceImpl.java:77)
    sun.reflect.GeneratedMethodAccessor2726.invoke(Unknown Source)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:575)
    com.bea.common.security.internal.utils.Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
    $Proxy17.login(Unknown Source)
    weblogic.security.service.internal.WLSJAASLoginServiceImpl$ServiceImpl.login(Unknown Source)
    com.bea.common.security.internal.service.JAASAuthenticationServiceImpl.authenticate(JAASAuthenticationServiceImpl.java:74)
    sun.reflect.GeneratedMethodAccessor2727.invoke(Unknown Source)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:575)
    com.bea.common.security.internal.utils.Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
    $Proxy37.authenticate(Unknown Source)
    weblogic.security.service.WLSJAASAuthenticationServiceWrapper.authenticate(Unknown Source)
    weblogic.security.service.PrincipalAuthenticator.authenticate(Unknown Source)
    weblogic.servlet.security.internal.SecurityModule.checkAuthenticate(SecurityModule.java:213)
    weblogic.servlet.security.ServletAuthentication.login(ServletAuthentication.java:391)
    weblogic.servlet.security.ServletAuthentication.weak(ServletAuthentication.java:371)
    com.bea.p13n.security.Authentication.login(Authentication.java:118)
    com.ppluk.moneyout.portal.auth.LoginServlet.doGet(LoginServlet.java:40)
    javax.servlet.http.HttpServlet.service(HttpServlet.java:700)
    javax.servlet.http.HttpServlet.service(HttpServlet.java:815)
    weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:224)
    weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:108)
    weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:198)
    weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41)
    com.bea.portal.tools.servlet.http.HttpContextFilter.doFilter(HttpContextFilter.java:50)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41)
    com.bea.p13n.servlets.PortalServletFilter.doFilter(PortalServletFilter.java:241)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41)
    com.bea.jsptools.servlet.PagedResultServiceFilter.doFilter(PagedResultServiceFilter.java:61)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41)
    weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:25)
    weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:41)
    weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3468)
    weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:308)
    weblogic.security.service.SecurityManager.runAs(Unknown Source)
    weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2116)
    weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2038)
    weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1372)
    weblogic.work.ExecuteThread.execute(ExecuteThread.java:198)
    weblogic.work.ExecuteThread.run(ExecuteThread.java:165)
    }

  • Weblogic Kernel Thread Queue - Count

    Kernel thread count is configurable, the kernel thread queue can be configured
    to grow.
    The socket reader threads are a %age of the kernel thread queue. Does it mean
    that the number of socket reader threads (allocated as %age of the kernel threads)
    change as the kernel thread count changes dynamically ?
    thanks,
    Parag

    A [STUCK] thread is a WebLogic managed thread that WebLogic has decided has been busy for too long.  This might be quite normal for a background process or batch process.  It does not necessarily indicate a real problem.  The object allocation and subsequent GC is also normal behaviour.
    So is your thread really stuck or is it just running for longer than WebLogic is configured to expect?  You can use WebLogic thread pool configurations and the CommonJ API to avoid threads being marked as [STUCK] by declaring that they are long running (and assuming you're using a new enough version of WebLogic that honours this - it used to still mark them as [STUCK]).
    If your thread is truly stuck it is more likely to be to do with your code than an object allocation / GC issue.

Maybe you are looking for