CPU utilisation is at 100% on SQL Server

Currently the CPU utilisation is at 100 % on the SQL Server and sql server.exe is utilising 98% in the task manager.Is this because of the query running for long time?
however I dont see any process in running state.
Thanks

Hi check WITH DB_CPU_Stats
AS
(SELECT DatabaseID, DB_Name(DatabaseID) AS [DatabaseName], SUM(total_worker_time) AS [CPU_Time_Ms]
 FROM sys.dm_exec_query_stats AS qs
 CROSS APPLY (SELECT CONVERT(int, value) AS [DatabaseID] 
              FROM sys.dm_exec_plan_attributes(qs.plan_handle)
              WHERE attribute = N'dbid')
AS F_DB
 GROUP BY DatabaseID)
SELECT ROW_NUMBER() OVER(ORDER BY [CPU_Time_Ms] DESC) AS [row_num],
       DatabaseName, [CPU_Time_Ms], 
       CAST([CPU_Time_Ms] * 1.0 / SUM([CPU_Time_Ms]) OVER() * 100.0 AS DECIMAL(5,
2)) AS [CPUPercent]
FROM DB_CPU_Stats
WHERE DatabaseID > 4 -- system databases
AND DatabaseID <> 32767 -- ResourceDB
ORDER BY row_num OPTION (RECOMPILE);
check error log and trun on traceflag 1222,1204 and see errorlog.
check missing index.
update statistics.

Similar Messages

  • Taking snapshot of oracle tables to sql server using transactional replication is taking a long time

    Hi All,
    I am trying to replicate around 200 oracle tables onto sql server using transaction replication and it taking a long time i.e the initial snapshot is taking more than 24 hrs and it still going on.
    Is there any way to replicate those these tables faster?
    Kindly help me out..
    Thanks

    Hi,
    According to the description, I know the replication is working fine. But it is very slow. 
    1. Check the CPU usage on Oracle publisher and SQL Server. This issue may due to slow client processing (Oracle performance) or Network performance issues.
    2. Based on SQL Server 2008 Books Online ‘Performance Tuning for Oracle Publishers’ (http://msdn.microsoft.com/en-us/library/ms151179(SQL.100).aspx). You can enable the transaction
    job set and follow the instructions based on
    http://msdn.microsoft.com/en-us/library/ms147884(v=sql.100).aspx.
    2. You can enable replication agent logging to check the replication behavior. You may follow these steps to collect them:
    To enable Distribution Agent verbose logging. Please follow these steps:
    a. Open SQL Server Agent on the distribution server.
    b. Under Jobs folder, find out the Distribution Agent.
    c. Right click the job and choose Properties.
    d. Select Steps tap, it should be like this:
    e. Click Run agent and click Edit button, add following scripts by the end of scripts in the command box:
            -Output C:\Temp\OUTPUTFILE.txt -Outputverboselevel 2
    f. Exit the dialogs
     For more information about the steps, please refer to:
    http://support.microsoft.com/kb/312292
    Hope the information helps.
    Tracy Cai
    TechNet Community Support

  • SQL Server 2014 Standard, but only 2 GB RAM used

    Hello,
    I just installed MS SQL Server 2014 Standard Single x64 on a Windows 8 PC. It was bought to replace the Server Express because the RAM limitation of Express.
    I set min server memory to 500 MB and max server memory to 28672 MB. PC has 32 GB Ram.
    Now I start a very crazy procedure/query that is running for hours.
    The problem is now that task manager shows:
    - SQL Server Management Studio (32 Bit): 0% CPU and 135,4 MB RAM
    - SQL Server Windows NT - 64 Bit: 60% CPU and 2.032,6 MB RAM
    If I use: SELECT * FROM sys.dm_os_process_memory  I get:
    physical_memory_in_use_kb : 2124632
    memory_utilization_percentage : 100
    So why is there Management Studio 32 Bit if I installed it through MS SQL Server 2014 Standard Single x64 installation?
    And much more important: Why is only 2 GB RAM used if 32 GB are there and 28 GB should be used?
    kind regards
    Peter

    Hello,
    Could you try to enable Lock Pages in Memory option for the SQL Server service account?
    http://www.sqlcoffee.com/Tuning05.htm
    Hope this helps.
    Regards,
    Alberto Morillo
    SQLCoffee.com

  • Windows 7 Gadgets slow to respond, 50% CPU utilisation with gadgets that "move"

    I have a fresh installation of Windows 7 RC and everything was fine. I have no idea what may have caused this, but on day 2 of using Windows 7 RC, any desktop gadgets that move (like the CPU meter or the clock with its second hand enabled) cause the sidebar.exe process to go to 50% CPU utilisation (which is 100% of one core on my dual core CPU).
    These gadgets then just become unresponsive and I have to close them. I can only keep the Weather gadget on because it doesn't have any animations. I have all Windows updates and the latest NVIDIA driver from Windows Update and even their own website doesn't help. There is something wrong with my gadgets. I have never installed any extra gadgets.
    What could it be?

    Same issue, but after Vista x64 Home Prem upgrade to Win7 Home Prem x64.  ATI Radeon HD 4850 graphics card, Quad Core & can't even change the settings of the Clock if I set the seconds hand.  The clock takes up a continuous full core (25% of overall CPU) while the seconds hand is running; if the seconds hand is off then CPU utilization is 0% between minute updates.  Other gadgets are similar, but many such as Calendar, Weather, and some non-MS gadgets work perfectly fine.  Must be some kind of javascript issue.  I have Avira Antivir before & after upgrade to Win7, so AVG isn't the issue for me - I even tried with Antivir and Comodo Firewall turned off. UAC on. 
    This machine is FAST & it can't handle a little gadget.  (7.2/7.3 Windows Experience subscores on all but hard disk, which is 5.9)  Didn't have this issue in Vista x64 Home Prem.
    edit:
    Checked the Win7 Resource Monitor CPU tab:
    sidebar.exe - While not under heavy CPU load, "Analyze Wait Chain..." from context menu continually shows "One or more threads of sidebar.exe are waiting to finish network I/O", and indicates thread 4140 which is WinInet.dll (Internet Extensions for Win32 application extension.)  Under heavy CPU load, several other threads starting from sidebar.exe were indicated from the same message from "Analyze Wait Chain..." as well.
    All other non-sidebar processes indicate "running normally" from "Analyze Wait Chain..."
    Another clue:  If I login using the "Administrator" account, there is *** no performance problem ***!  The sidebar.exe shows as "running normally" from "Analyze Wait Chain..." 
    So I also tried:
    - w/UAC turned off on the normal user (administrator rights) account (no fix)
    - tried creating a *new* normal user (administrator rights) account; still sloooowwww (also try this one w/o UAC, still bad)
    -Problem Status:  normal User Accounts have the sidebar performance problem, Administrator account runs fine.
    Edit: 12/31/09
    SOLVED!!!!
    After digging into the sidebar.exe output from Sysinternals Process Monitor, I noticed a peculiar difference between the output for the properly functioning Administrator account & my User accounts.  The admin acct showed the monitor profile for a good number of operations, while the User accts showed the wsRGB.cdmp value for the same operations, which was peculiar because I had my User accounts configured to use the system defaults, the same way I had the admin acct configured.
    Going into the Windows Color Management, Advanced tab, I found that if I chose either of the "virtual device model profile" choices for the "Device Profile" setting, the performance hit was instant.  If I used any of the "normal" icm profiles, performance was good.  So I changed my system default Device Profile from "sRGB virtual device model profile" to the std sRGB.icm profile & everything is working great!
    Note: In addition to the Gadgets, this also impacted the Windows Media Center Internet TV listings performance, which was also back to good performance after this WCM setting change.  I'd expect there are numerous other apps that could be affected by the "virtual device model profile" handling.  Googling "virtual device model profile" seems to bear that out, as I see others who ran into app problems when using that in the WCM applet.

  • Issue while accessing a SQL Server table over OTG

    Hi,
    I have been learning oracle for about 1.5 years and am just starting to learn some OTG pieces. I am wondering about an issue. The issue is:
    "We need help with an issue we are having while accessing a SQL Server table over OTG. We are getting the following error message in Oracle :
    ORA-28500: connection from ORACLE to a non-Oracle system returned this message:
    [Oracle][ODBC SQL Server Driver]Unicode conversion failed {HY000}
    The column it is failing on is "-----------" in the view --------------- in the SQL Server database pointed to by the Oracle DB Link ------------------- thats created in the Oracle instances ---- and -----.
    This was working before, but is now failing, we suspect its due to new multi-byte data being added to the base table in the above column."
    I took out the details and added ---- instead. I am wondering your guys thoughts on fixing this issue and helping me learn along the way. Thanks

    Hi Mike,
    Thanks for the response, here are the details:
    1. What is the character set of the Oracle RDBMS being used. What is returned by -
    select * from nls_database_parameters;
    NLS_CHARACTERSET
    AL32UTF8
    NLS_NCHAR_CHARACTERSET
    UTF8
    We get SQL_Latin1_General_CP1_C1_AS and 1252 as Collation Property and Code Page
    The datatype of the column in question in SQL Server is nvarchar(100).
    When I do a describe on the SQL Server view ( desc CK_DATA_FOR_OPL@------- ), I get the error below;
    ERROR: object CK_DATA_FOR_OPL does not exist
    Select * from CK_DATA_FOR_OPL@------ where rownum =1 does get me a row.
    create table tmp_tab as
    Select * from CK_DATA_FOR_OPL@----- where rownum =1;
    desc tmp_tab shows the datatype of the said column in the table created in Oracle as NVARCHAR2(150).
    Not sure why a column defined with size 100 in SQL Server should come across as 150 when seen over OTG. We see something similar in DB2 tables we access over OTG as well.
    Edited by: 993950 on Mar 15, 2013 8:49 AM

  • Automating Data Migration from SQL Server 2005

    Hi All,
    I need to migrate data from SQL Server 2005 to Oracle DB ( Datawarehouse). The data migration involves updating Dimensions and Fact table. I have got painful job of switching topology to point to over 100 different weekly SQL DBs ( in sequence) and pull the data into DW. How can I automate my ODI process to switch from one after the other.
    Any Ideas?
    KS

    ODI Variables are there to help you with this. Please go through this post at [http://blogs.oracle.com/dataintegration/2009/05/using_odi_variables_in_topolog.html] .
    This will show you how to use a variable Oracle data server.
    On similar lines you should be able to switch to any of your 100 weekly SQL server DBs.
    And loop in a sequence to load data from all of them.
    Hope that helps

  • High cpu utilisation while generating HUM reports

    Hi
    i am facing the issue that while generating the HUM reports the CPU utilisation going to 100%. i am using HUM 300 + LMS 100. right now i am using 2GB RAM

    you're right. i forgot that i made some changes to my igoogle page. the chat function is the culprit. adding it causes the spike. i've reported the problem. thanks for the help!

  • SQL query against ConfigMgr DB causing 100% cpu usage on SQL server throughout day

    Hi, I am hoping someone here may have an idea of what I can do to resolve this as I am not much of a SQL guy. Here is what I know. Throughout the day, monday-friday, my ConfigMgr SQL server sits at 98-100% processor usage.
    Using the following query I have narrowed down the culprit of the high cpu usage throughout the day:
    SELECT p.spid, p.status, p.hostname, p.loginame, p.cpu, r.start_time, r.command,
    p.program_name, text
    FROM sys.dm_exec_requests AS r,
    master.dbo.sysprocesses AS p
    CROSS APPLY sys.dm_exec_sql_text(p.sql_handle)
    WHERE p.status NOT IN ('sleeping', 'background')
    AND r.session_id = p.spid
    Even though my knowledge of SQL is light, I believe the following output clearly defines the thread responsible for the high cpu usage. This "program_name" is present throughout the day and as long as its there, cpu usage remains at or near 100%:
    The text output of the above culprit is as follows (sorry this is long):
    -- Name : spDrsSummarizeSendHistory
    -- Definition : SqlObjs
    -- Scope : CAS_OR_PRIMARY_OR_SECONDARY
    -- Object : P
    -- Dependencies : <Detect>
    -- Description : Summarize DrsSendHistory information into DrsSendHistorySummary
    CREATE PROCEDURE spDrsSummarizeSendHistory
    AS
    BEGIN
    SET NOCOUNT ON;
    DECLARE @CurrentTime DateTime;
    DECLARE @SiteCode nvarchar(3);
    DECLARE @LastSummarizationTime DateTime;
    DECLARE @NextSummarizationTime DateTime;
    DECLARE @Interval INT; -- summarize interval in minutes
    DECLARE @ReplicationID INT
    DECLARE @iMaxID INT
    DECLARE @iCurrentID INT
    DECLARE @iBatchSize INT = 50
    DECLARE @ReplicationPattern NVARCHAR(255)
    DECLARE @TargetSite NVARCHAR(3);
    DECLARE @TimeTable TABLE (TargetSite NVARCHAR(3), StartTime DATETIME, EndTime DATETIME, PRIMARY KEY (TargetSite, StartTime, EndTime))
    DECLARE @TargetSites TABLE (SiteCode NVARCHAR(3) PRIMARY KEY)
    DECLARE @ChildTargetSites TABLE (TargetSite NVARCHAR(3), LastSummarizationTime DATETIME, [Interval] INT, PRIMARY KEY (TargetSite))
    DECLARE @ReplicationGroup TABLE (ID INT, ReplicationPattern NVARCHAR(255))
    IF OBJECT_ID(N'TempDB..#DrsSendHistorySummary') IS NOT NULL
    DROP TABLE #DrsSendHistorySummary
    CREATE TABLE #DrsSendHistorySummary (ID BIGINT IDENTITY(1, 1) NOT NULL, SourceSite NVARCHAR(3), TargetSite NVARCHAR(3), ReplicationGroupID INT, SyncDataSize BIGINT, CompressedSize BIGINT, UnCompressedSize BIGINT, MessageCount INT, ChangeCount INT, SummarizationTime DATETIME, PRIMARY KEY (ID))
    SET @CurrentTime = GETUTCDATE();
    SET @SiteCode = dbo.fnGetSiteCode();
    INSERT INTO @ReplicationGroup (ID, ReplicationPattern)
    SELECT RD.ID, RD.ReplicationPattern
    FROM ReplicationData RD
    WHILE EXISTS (SELECT * FROM @ReplicationGroup)
    BEGIN
    SELECT TOP (1) @ReplicationID = ID, @ReplicationPattern = ReplicationPattern FROM @ReplicationGroup
    TRUNCATE TABLE #DrsSendHistorySummary
    IF (((@ReplicationPattern = N'global' OR @ReplicationPattern=N'site') AND dbo.fnIsPrimary() = 1)
    OR (@ReplicationPattern = N'global_proxy' AND dbo.fnIsSecondary() = 1))
    BEGIN -- when current site is child
    SET @LastSummarizationTime = ISNULL(( SELECT MAX(SummarizationTime) FROM DrsSendHistorySummary WHERE SourceSite = @SiteCode AND ReplicationGroupID = @ReplicationID),
    (SELECT MIN(EndTime) FROM DrsSendHistory WHERE ReplicationGroupID = @ReplicationID) );
    SET @Interval = ISNULL((SELECT VALUE FROM RCMSQLCONTROLPROPERTY SCP, RCMSQLCONTROL SC
    WHERE SCP.ControlID = SC.ID AND SCP.Name = N'Send History Summarize Interval' AND SC.TypeID = 3 and SC.SiteNumber = dbo.fnGetSiteNumber()), 15); -- default 15 minutes
    DELETE @TargetSites
    INSERT INTO @TargetSites (SiteCode)
    SELECT DISTINCT SiteCode FROM DRS_MessageActivity_Send WHERE ReplicationID = @ReplicationID
    IF @LastSummarizationTime IS NOT NULL AND EXISTS (SELECT * FROM @TargetSites)
    BEGIN
    SET @NextSummarizationTime = DATEADD( minute, DATEDIFF(minute, 0, @LastSummarizationTime)/@Interval *@Interval + @Interval, 0);
    -- Summarized according to interval
    DELETE @TimeTable
    WHILE (@CurrentTime >= @NextSummarizationTime )
    BEGIN
    INSERT INTO @TimeTable (TargetSite, StartTime, EndTime)
    SELECT SiteCode, @LastSummarizationTime, @NextSummarizationTime FROM @TargetSites
    SET @LastSummarizationTime = @NextSummarizationTime;
    SET @NextSummarizationTime = DATEADD(mi, @Interval, @NextSummarizationTime );
    END
    INSERT INTO #DrsSendHistorySummary (SourceSite, TargetSite, ReplicationGroupID, SyncDataSize, CompressedSize, UnCompressedSize, MessageCount, ChangeCount, SummarizationTime)
    SELECT @SiteCode, T.TargetSite, @ReplicationID, SUM(ISNULL(D.SyncDataSize, 0)), SUM(ISNULL(D.CompressedSize, 0)), SUM(ISNULL(D.UnCompressedSize, 0)), SUM(ISNULL(D.MessageCount, 0)), SUM(ISNULL(ChangeCount, 0)), T.EndTime
    FROM DrsSendHistory D RIGHT JOIN @TimeTable T ON D.EndTime >= T.StartTime AND D.EndTime < T.EndTime AND ReplicationGroupID = @ReplicationID AND T.TargetSite = D.TargetSite
    GROUP BY T.TargetSite, T.StartTime, T.EndTime;
    END
    END
    ELSE IF ((@ReplicationPattern = N'global' AND dbo.fnIsCAS() = 1)
    OR (@ReplicationPattern = N'global_proxy' AND dbo.fnIsPrimary() = 1))
    BEGIN -- when current site is parent
    DELETE @ChildTargetSites
    INSERT INTO @ChildTargetSites(TargetSite, LastSummarizationTime, [Interval])
    SELECT DISTINCT(DSH.SiteCode),
    ISNULL(( SELECT MAX(SummarizationTime) FROM DrsSendHistorySummary WHERE SourceSite = @SiteCode AND ReplicationGroupID = @ReplicationID AND TargetSite=DSH.SiteCode),
    (SELECT MIN(EndTime) FROM DrsSendHistory WHERE ReplicationGroupID = @ReplicationID) ) AS LastSummarizeTime,
    ISNULL((SELECT VALUE FROM RCMSQLCONTROLPROPERTY SCP, RCMSQLCONTROL SC WHERE SCP.ControlID = SC.ID AND SCP.Name = N'Send History Summarize Interval' AND SC.TypeID = 3 and SC.SiteNumber = dbo.fnGetSiteNumberBySiteCode(DSH.SiteCode)), 15) AS Interval
    FROM DRS_MessageActivity_Send DSH WHERE DSH.ReplicationID = @ReplicationID
    GROUP BY DSH.SiteCode;
    DELETE @TimeTable
    WHILE EXISTS (SELECT * FROM @ChildTargetSites)
    BEGIN
    SELECT TOP (1) @TargetSite = TargetSite, @LastSummarizationTime = LastSummarizationTime, @Interval = Interval FROM @ChildTargetSites
    SET @NextSummarizationTime = DATEADD( minute, DATEDIFF(minute, 0, @LastSummarizationTime)/@Interval *@Interval + @Interval, 0);
    -- Summarized according to interval
    WHILE (@CurrentTime >= @NextSummarizationTime )
    BEGIN
    INSERT INTO @TimeTable (TargetSite, StartTime, EndTime)
    SELECT @TargetSite, @LastSummarizationTime, @NextSummarizationTime
    SET @LastSummarizationTime = @NextSummarizationTime;
    SET @NextSummarizationTime = DATEADD(mi, @Interval, @NextSummarizationTime );
    END
    DELETE @ChildTargetSites WHERE TargetSite = @TargetSite
    END;
    INSERT INTO #DrsSendHistorySummary (SourceSite, TargetSite, ReplicationGroupID, SyncDataSize, CompressedSize, UnCompressedSize, MessageCount, ChangeCount, SummarizationTime)
    SELECT @SiteCode, T.TargetSite, @ReplicationID, SUM(ISNULL(D.SyncDataSize, 0)), SUM(ISNULL(D.CompressedSize, 0)), SUM(ISNULL(D.UnCompressedSize, 0)), SUM(ISNULL(D.MessageCount, 0)), SUM(ISNULL(D.ChangeCount, 0)), @NextSummarizationTime
    FROM DrsSendHistory D RIGHT JOIN @TimeTable T ON D.EndTime >= T.StartTime AND D.EndTime < T.EndTime AND ReplicationGroupID = @ReplicationID AND T.TargetSite = D.TargetSite
    GROUP BY T.TargetSite, T.StartTime, T.EndTime;
    END;
    SELECT @iMaxID = MAX(ID), @iCurrentID = 0 FROM #DrsSendHistorySummary
    -- BATCH INSERT TO REAL TABLE
    WHILE (@iCurrentID < @iMaxID)
    BEGIN
    INSERT INTO DrsSendHistorySummary (SourceSite, TargetSite, ReplicationGroupID, SyncDataSize, MessageCount, ChangeCount, SummarizationTime)
    SELECT SourceSite, TargetSite, ReplicationGroupID, SyncDataSize, MessageCount, ChangeCount, SummarizationTime
    FROM #DrsSendHistorySummary WHERE ID > @iCurrentID AND ID <= (@iCurrentID + @iBatchSize)
    SET @iCurrentID = @iCurrentID + @iBatchSize
    END
    TRUNCATE TABLE #DrsSendHistorySummary
    DELETE @ReplicationGroup WHERE ID = @ReplicationID
    END
    END
    If anyone has any experience with this issue or anything similar and might be able to point me in the right direction, any responses would be greatly appreciated. Thanks for reading!

    Normally, this summary job every few mins which only summarize last few mins sending history. If the job was not running for long time, the first time, this sproc will summarize a lot more data than normal. So it could fail which will make things worse and
    worse over time.
    If sending summary data is not a big concern here, you can manually insert a dummy row with most recent time as Summarizationtime, so that, when summary job kicks in next time, it will only summary short interval data.
    DrsSendHistory is that the table records every sending on every group. This table is one of the key of replication logic. For your environment, on primary site, it could have up to 24(hrs) * 60 (mins) / 2 (sync interval) * 36(secondary sites) records per
    day for Secondary_Site_Replication_Configuration group and 24 * 60 / 5 * 22 records for Secondary Site Data.
    Umair Khan | http://blogs.technet.com/umairkhan
    Hi Umair,
    Thank you for the reply. My plan was to go ahead with your suggestions but what I tried first was to get my VM guy to give the SQL server access to more CPU resources. We had already configured it with what would have seemed to be plenty, as per Microsoft's
    sizing requirements, but I figured it couldn't hurt to rule out - he gave the SQL server access to a huge portion of the host processing power and since then CPU usage on the server has NOT been an issue.
    It would appear that the large amounts of secondary sites we have just simply put a lot of stress on the SQL server with out of the box replication settings. Since the entire VM host is for System Center only, and our other System Center servers are using
    very little resources, this solution has ended up being valid.
    Thanks again for everyone's help with this.

  • 100% cpu utilisation SQL Dev 1.5 on XP

    Using SQL Dev 1.5 prod version on XP on a P4 3ghz with 2gb of ram, SQL Dev executable regularly uses 100% cpu utilisation as reported by task manager.
    Also frequently stops responding - no screen redraw and I have to end task.
    Until recently I only had 512Mb of ram so put this down to that fact, but with 2gb still getting long 'satellite' delays - particularly with code/param insight.
    Anybody else getting this?
    ta

    I know I was vahue - apologies, but it's most of the time - literally 99 to 100% cpu utilisation.
    e.g.
    restart pc, login, give it a couple of mins to settle down. (p4 3ghz, 3gb ram, xp pro, sp1)
    start 1.5 sqldev - wait, see the splash screen, look at task manager - memory starts going up, cpu rises rapidly to 99 - 100%
    once fully loaded, open 1 connection, open one package body, split screen vertically, so I have sql worksheet and my package body open and visible.
    Now sit back and enjoy the vibration coming thru the desktop - the real wooden one - as the pc's fan struggles to cope.
    If I leave it for maybe 5 to 10 mins - not doing anything on the pc at all, cpu utilisation will drop significantly.
    then do something reckless like edit my package body (not that big ~1500 lines) and hold on to the desk again as we start shaking once more.
    great for my typing skills too, as there is no point in looking at the screen to see if I am making mistakes, as it frequently won't display anything until 3 to 5 seconds after I have finished typing
    mem usage is up to 250 mb - I have not touched my pc for nearly 10 mins since doing the last edit - still at 99%

  • How to point out high CPU Utilization in sql server 2008

    Hi,
    I am using sql server 2008 , where in i have 10 instances in the physical box of all sql server 2008 versions.
    I can see , the CPU (12 CPUS) that is allocated to the physical box is consuming around 90% of utilization, I need your help to point out the exact sql instance that is using more CPU, Please give me the mathods , since i understand that there is no fixed
    rule to derive the solution.
    Thank you
    hemadri

    This first thing to check if CPU is at 100% is to look for parallel queries:
    -- Tasks running in parallel (filtering out MARS requests below):
    select * from sys.dm_os_tasks as t
     where t.session_id in (
       select t1.session_id
        from sys.dm_os_tasks as t1
       group by t1.session_id
      having count(*) > 1
      and min(t1.request_id) = max(t1.request_id));
    -- Requests running in parallel:
     select *
       from sys.dm_exec_requests as r
       join (
               select t1.session_id, min(t1.request_id)
              from sys.dm_os_tasks as t1
             group by t1.session_id
            having count(*) > 1
               and min(t1.request_id) = max(t1.request_id)
          ) as t(session_id, request_id)
         on r.session_id = t.session_id
        and r.request_id = t.request_id;
    Best Regards,Uri Dimant SQL Server MVP,
    http://sqlblog.com/blogs/uri_dimant/
    MS SQL optimization: MS SQL Development and Optimization
    MS SQL Consulting:
    Large scale of database and data cleansing
    Remote DBA Services:
    Improves MS SQL Database Performance
    SQL Server Integration Services:
    Business Intelligence

  • Weblogic reaches 100% CPU utilisation

    I am using WebLogic Server Version 10.3.1.0. I got an application deployed in this server, which is developed with java1.6, ejb, hibernate. I start the server with 8GB of RAM assigned to it and after a day or two the weblogic server causes the use of the CPU to reach to 100% and as a result the server sort of doesn't response anymore. I will be creating 30-40 thread per managed server and one server has two managed server.  The volume will be around 30k per day. I dont know which is causing the 100% cpu utilisation and here below are the thread dumps which have taken at the time of high cpu in a server.  Please let me know where is the exact issue and where is the stuck thread (if any)? In which part the issue is occuring?
    10774:
    ===== FULL THREAD DUMP ===============
    Thu Jun 19 16:57:39 2014
    Oracle JRockit(R) R28.2.8-10-156881-1.6.0_51-20130611-1146-linux-x86_64
    "Main Thread" id=1 idx=0x4 tid=10776 prio=5 alive, waiting, native_blocked
        -- Waiting for notification on: weblogic/t3/srvr/T3Srvr@0xa4db4c58[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/t3/srvr/T3Srvr.waitForDeath(T3Srvr.java:981)
        ^-- Lock released while waiting: weblogic/t3/srvr/T3Srvr@0xa4db4c58[fat lock]
        at weblogic/t3/srvr/T3Srvr.run(T3Srvr.java:490)
        at weblogic/Server.main(Server.java:71)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "(Signal Handler)" id=2 idx=0x8 tid=10777 prio=5 alive, native_blocked, daemon
    "(OC Main Thread)" id=3 idx=0xc tid=10778 prio=5 alive, native_waiting, daemon
    "(GC Worker Thread 1)" id=? idx=0x10 tid=10779 prio=5 alive, daemon
    "(GC Worker Thread 2)" id=? idx=0x14 tid=10780 prio=5 alive, daemon
    "(GC Worker Thread 3)" id=? idx=0x18 tid=10781 prio=5 alive, daemon
    "(GC Worker Thread 4)" id=? idx=0x1c tid=10782 prio=5 alive, daemon
    "(Code Generation Thread 1)" id=4 idx=0x20 tid=10783 prio=5 alive, native_waiting, daemon
    "(Code Optimization Thread 1)" id=5 idx=0x24 tid=10784 prio=5 alive, native_waiting, daemon
    "(VM Periodic Task)" id=6 idx=0x28 tid=10785 prio=10 alive, native_waiting, daemon
    "Finalizer" id=7 idx=0x2c tid=10786 prio=8 alive, native_waiting, daemon
        at jrockit/memory/Finalizer.waitForFinalizees(J[Ljava/lang/Object;)I(Native Method)
        at jrockit/memory/Finalizer.access$700(Finalizer.java:12)
        at jrockit/memory/Finalizer$4.run(Finalizer.java:201)
        at java/lang/Thread.run(Thread.java:662)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "Reference Handler" id=8 idx=0x30 tid=10787 prio=10 alive, native_waiting, daemon
        at java/lang/ref/Reference.waitForActivatedQueue(J)Ljava/lang/ref/Reference;(Native Method)
        at java/lang/ref/Reference.access$100(Reference.java:11)
        at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:82)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "(Sensor Event Thread)" id=9 idx=0x34 tid=10788 prio=5 alive, native_blocked, daemon
    "VM JFR Buffer Thread" id=10 idx=0x38 tid=10789 prio=5 alive, in native, daemon
    "Timer-0" id=13 idx=0x3c tid=10793 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: java/util/TaskQueue@0xa4d5d260[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[optimized]
        at java/util/TimerThread.mainLoop(Timer.java:483)
        ^-- Lock released while waiting: java/util/TaskQueue@0xa4d5d260[fat lock]
        at java/util/TimerThread.run(Timer.java:462)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'default'" id=14 idx=0x40 tid=10839 prio=5 alive, native_blocked, daemon
        at java/util/HashMap.get(HashMap.java:385)[optimized]
        at com/appl/vsms/pi/outbound/ControllerCache.getEntry(ControllerCache.java:48)[inlined]
        at com/appl/vsms/bean/pi/MessageStatusConsumer.onMessage(MessageStatusConsumer.java:90)[optimized]
        at weblogic/ejb/container/internal/MDListener.execute(MDListener.java:574)[inlined]
        at weblogic/ejb/container/internal/MDListener.run(MDListener.java:893)[optimized]
        at weblogic/work/ExecuteRequestAdapter.execute(ExecuteRequestAdapter.java:21)[optimized]
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)[optimized]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'default'" id=15 idx=0x44 tid=10840 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: java/util/LinkedList@0xa8cbed08[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/ejb/container/internal/MDListener.getListener(MDListener.java:240)[optimized]
        ^-- Lock released while waiting: java/util/LinkedList@0xa8cbed08[fat lock]
        at weblogic/ejb/container/internal/MDListener.transactionalOnMessage(MDListener.java:480)[inlined]
        at weblogic/ejb/container/internal/MDListener.onMessage(MDListener.java:379)[optimized]
        at weblogic/jms/client/JMSSession.onMessage(JMSSession.java:4659)[optimized]
        at weblogic/jms/client/JMSSession.execute(JMSSession.java:4345)[optimized]
        at weblogic/jms/client/JMSSession.executeMessage(JMSSession.java:3821)[optimized]
        at weblogic/jms/client/JMSSession.access$000(JMSSession.java:115)
        at weblogic/jms/client/JMSSession$UseForRunnable.run(JMSSession.java:5170)
        at weblogic/work/ExecuteRequestAdapter.execute(ExecuteRequestAdapter.java:21)[optimized]
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)[optimized]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'default'" id=16 idx=0x48 tid=10841 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d5f0d0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d5f0d0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '3' for queue: 'default'" id=17 idx=0x4c tid=10842 prio=5 alive, native_blocked, daemon
        at java/util/HashMap.get(HashMap.java:385)[optimized]
        at com/appl/vsms/pi/outbound/ControllerCache.getEntry(ControllerCache.java:48)[inlined]
        at com/appl/vsms/bean/pi/MessageStatusConsumer.onMessage(MessageStatusConsumer.java:90)[optimized]
        at weblogic/ejb/container/internal/MDListener.execute(MDListener.java:574)[inlined]
        at weblogic/ejb/container/internal/MDListener.run(MDListener.java:893)[optimized]
        at weblogic/work/ExecuteRequestAdapter.execute(ExecuteRequestAdapter.java:21)[optimized]
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)[optimized]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '4' for queue: 'default'" id=18 idx=0x50 tid=10843 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d5fe50[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d5fe50[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '5' for queue: 'default'" id=19 idx=0x54 tid=10844 prio=5 alive, native_blocked, daemon
        at java/util/HashMap.get(HashMap.java:385)[optimized]
        at com/appl/vsms/pi/outbound/ControllerCache.getEntry(ControllerCache.java:48)[inlined]
        at com/appl/vsms/bean/pi/MessageStatusConsumer.onMessage(MessageStatusConsumer.java:90)[optimized]
        at weblogic/ejb/container/internal/MDListener.execute(MDListener.java:574)[inlined]
        at weblogic/ejb/container/internal/MDListener.run(MDListener.java:893)[optimized]
        at weblogic/work/ExecuteRequestAdapter.execute(ExecuteRequestAdapter.java:21)[optimized]
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)[optimized]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '6' for queue: 'default'" id=20 idx=0x58 tid=10845 prio=5 alive, native_blocked, daemon
        at java/util/HashMap.get(HashMap.java:385)[optimized]
        at com/appl/vsms/pi/outbound/ControllerCache.getEntry(ControllerCache.java:48)[inlined]
        at com/appl/vsms/bean/pi/MessageStatusConsumer.onMessage(MessageStatusConsumer.java:90)[optimized]
        at weblogic/ejb/container/internal/MDListener.execute(MDListener.java:574)[inlined]
        at weblogic/ejb/container/internal/MDListener.run(MDListener.java:893)[optimized]
        at weblogic/work/ExecuteRequestAdapter.execute(ExecuteRequestAdapter.java:21)[optimized]
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)[optimized]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '7' for queue: 'default'" id=21 idx=0x5c tid=10846 prio=5 alive, native_blocked, daemon
        at java/util/HashMap.get(HashMap.java:385)[optimized]
        at com/appl/vsms/pi/outbound/ControllerCache.getEntry(ControllerCache.java:48)[inlined]
        at com/appl/vsms/bean/pi/MessageStatusConsumer.onMessage(MessageStatusConsumer.java:90)[optimized]
        at weblogic/ejb/container/internal/MDListener.execute(MDListener.java:574)[inlined]
        at weblogic/ejb/container/internal/MDListener.run(MDListener.java:893)[optimized]
        at weblogic/work/ExecuteRequestAdapter.execute(ExecuteRequestAdapter.java:21)[optimized]
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)[optimized]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '8' for queue: 'default'" id=22 idx=0x60 tid=10847 prio=5 alive, native_blocked, daemon
        at java/util/HashMap.get(HashMap.java:385)[optimized]
        at com/appl/vsms/pi/outbound/ControllerCache.getEntry(ControllerCache.java:48)[inlined]
        at com/appl/vsms/bean/pi/MessageStatusConsumer.onMessage(MessageStatusConsumer.java:90)[optimized]
        at weblogic/ejb/container/internal/MDListener.execute(MDListener.java:574)[inlined]
        at weblogic/ejb/container/internal/MDListener.run(MDListener.java:893)[optimized]
        at weblogic/work/ExecuteRequestAdapter.execute(ExecuteRequestAdapter.java:21)[optimized]
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)[optimized]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '9' for queue: 'default'" id=23 idx=0x64 tid=10848 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d62010[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d62010[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '10' for queue: 'default'" id=24 idx=0x68 tid=10849 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d626d0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d626d0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '11' for queue: 'default'" id=25 idx=0x6c tid=10850 prio=5 alive, native_blocked, daemon
        at java/util/HashMap.get(HashMap.java:385)[optimized]
        at com/appl/vsms/pi/outbound/ControllerCache.getEntry(ControllerCache.java:48)[inlined]
        at com/appl/vsms/bean/pi/MessageStatusConsumer.onMessage(MessageStatusConsumer.java:90)[optimized]
        at weblogic/ejb/container/internal/MDListener.execute(MDListener.java:574)[inlined]
        at weblogic/ejb/container/internal/MDListener.run(MDListener.java:893)[optimized]
        at weblogic/work/ExecuteRequestAdapter.execute(ExecuteRequestAdapter.java:21)[optimized]
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)[optimized]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '12' for queue: 'default'" id=26 idx=0x70 tid=10851 prio=5 alive, native_blocked, daemon
        at java/util/HashMap.get(HashMap.java:385)[optimized]
        at com/appl/vsms/pi/outbound/ControllerCache.getEntry(ControllerCache.java:48)[inlined]
        at com/appl/vsms/bean/pi/MessageStatusConsumer.onMessage(MessageStatusConsumer.java:90)[optimized]
        at weblogic/ejb/container/internal/MDListener.execute(MDListener.java:574)[inlined]
        at weblogic/ejb/container/internal/MDListener.run(MDListener.java:893)[optimized]
        at weblogic/work/ExecuteRequestAdapter.execute(ExecuteRequestAdapter.java:21)[optimized]
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)[optimized]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '13' for queue: 'default'" id=27 idx=0x74 tid=10852 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d648e8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d648e8[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '14' for queue: 'default'" id=28 idx=0x78 tid=10853 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d65568[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d65568[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'weblogic.kernel.Non-Blocking'" id=29 idx=0x7c tid=10854 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d65cc0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d65cc0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'weblogic.kernel.Non-Blocking'" id=30 idx=0x80 tid=10855 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d663c0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d663c0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'weblogic.kernel.Non-Blocking'" id=31 idx=0x84 tid=10856 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d66ac0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d66ac0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'weblogic.kernel.System'" id=32 idx=0x88 tid=10857 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d671c0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d671c0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" id=33 idx=0x8c tid=10858 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d67f48[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d67f48[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" id=34 idx=0x90 tid=10859 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d68cc0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d68cc0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" id=35 idx=0x94 tid=10860 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d69a38[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d69a38[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" id=36 idx=0x98 tid=10861 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d977b8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d977b8[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'weblogic.Rejector'" id=37 idx=0x9c tid=10862 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4d99570[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4d99570[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'weblogic.Rejector'" id=38 idx=0xa0 tid=10863 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf2e38[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf2e38[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "weblogic.time.TimeEventGenerator" id=39 idx=0xa4 tid=10864 prio=9 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/time/common/internal/TimeTable@0xa4dbed18[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at weblogic/time/common/internal/TimeTable.snooze(TimeTable.java:286)
        ^-- Lock released while waiting: weblogic/time/common/internal/TimeTable@0xa4dbed18[fat lock]
        at weblogic/time/common/internal/TimeEventGenerator.run(TimeEventGenerator.java:117)
        at java/lang/Thread.run(Thread.java:662)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "JMAPI event thread" id=40 idx=0xa8 tid=10865 prio=5 alive, in native, daemon
    "weblogic.timers.TimerThread" id=41 idx=0xac tid=10866 prio=9 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/timers/internal/TimerThread@0xa4dc3f70[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at weblogic/timers/internal/TimerThread$Thread.run(TimerThread.java:262)
        ^-- Lock released while waiting: weblogic/timers/internal/TimerThread@0xa4dc3f70[fat lock]
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" id=42 idx=0xb0 tid=10867 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf3528[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf3528[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" id=43 idx=0xb4 tid=10868 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf35f0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf35f0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" id=44 idx=0xb8 tid=10869 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf36b8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf36b8[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '3' for queue: 'weblogic.admin.RMI'" id=45 idx=0xbc tid=10870 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf3780[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf3780[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '4' for queue: 'weblogic.admin.RMI'" id=46 idx=0xc0 tid=10871 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf3848[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf3848[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'ImageWorkManager'" id=47 idx=0xc4 tid=10896 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf57e0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf57e0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'ImageWorkManager'" id=48 idx=0xc8 tid=10899 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf58a8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf58a8[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "JFR request timer" id=49 idx=0xcc tid=10900 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: java/util/TaskQueue@0xa4dc69d8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at java/util/TimerThread.mainLoop(Timer.java:483)
        ^-- Lock released while waiting: java/util/TaskQueue@0xa4dc69d8[fat lock]
        at java/util/TimerThread.run(Timer.java:462)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'weblogic.logging.DomainLogBroadcasterClient'" id=53 idx=0xd0 tid=10902 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf6550[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf6550[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'weblogic.logging.LogBroadcaster'" id=54 idx=0xd4 tid=10903 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf6d50[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf6d50[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=55 idx=0xd8 tid=10904 prio=5 alive, blocked, native_blocked, daemon
        -- Blocked trying to get lock: java/lang/String@0xa4cf78f8[fat lock]
        at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
        at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)[optimized]
        at jrockit/vm/Locks.lockFat(Locks.java:1512)[optimized]
        at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)[optimized]
        at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
        at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=56 idx=0xdc tid=10905 prio=5 alive, blocked, native_blocked, daemon
        -- Blocked trying to get lock: java/lang/String@0xa4cf78f8[fat lock]
        at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
        at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)[optimized]
        at jrockit/vm/Locks.lockFat(Locks.java:1512)[optimized]
        at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)[optimized]
        at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
        at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=57 idx=0xe0 tid=10906 prio=5 alive, blocked, native_blocked, daemon
        -- Blocked trying to get lock: java/lang/String@0xa4cf78f8[fat lock]
        at jrockit/vm/Threads.waitForUnblockSignal()V(Native Method)
        at jrockit/vm/Locks.fatLockBlockOrSpin(Locks.java:1411)[inlined]
        at jrockit/vm/Locks.fatLockReacquire(Locks.java:1649)[optimized]
        at jrockit/vm/Locks.lockFat(Locks.java:1517)[optimized]
        at jrockit/vm/Locks.monitorEnterSecondStageHard(Locks.java:1054)[optimized]
        at jrockit/vm/Locks.monitorEnterSecondStage(Locks.java:1005)[optimized]
        at jrockit/vm/Locks.monitorEnter(Locks.java:2179)[optimized]
        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:153)
        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" id=58 idx=0xe4 tid=10907 prio=5 alive, in native, daemon
        at jrockit/ext/epoll/EPoll.epollWait0(ILjava/nio/ByteBuffer;II)I(Native Method)
        at jrockit/ext/epoll/EPoll.epollWait(EPoll.java:123)
        at weblogic/socket/EPollSocketMuxer.processSockets(EPollSocketMuxer.java:156)
        ^-- Holding lock: java/lang/String@0xa4cf78f8[fat lock]
        at weblogic/socket/SocketReaderRequest.run(SocketReaderRequest.java:29)
        at weblogic/socket/SocketReaderRequest.execute(SocketReaderRequest.java:42)
        at weblogic/kernel/ExecuteThread.execute(ExecuteThread.java:145)
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:117)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "VDE Transaction Processor Thread" id=61 idx=0xe8 tid=10909 prio=2 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: com/octetstring/vde/backend/standard/TransactionProcessor@0xa46c3738[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at com/octetstring/vde/backend/standard/TransactionProcessor.waitChange(TransactionProcessor.java:367)
        ^-- Lock released while waiting: com/octetstring/vde/backend/standard/TransactionProcessor@0xa46c3738[fat lock]
        at com/octetstring/vde/backend/standard/TransactionProcessor.run(TransactionProcessor.java:212)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "DoSManager" id=64 idx=0xf0 tid=10911 prio=6 alive, sleeping, native_waiting, daemon
        at java/lang/Thread.sleep(J)V(Native Method)
        at com/octetstring/vde/DoSManager.run(DoSManager.java:433)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'UserLockout'" id=65 idx=0xf4 tid=10920 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf93c8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf93c8[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'UserLockout'" id=66 idx=0xf8 tid=10921 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf9490[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf9490[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'UserLockout'" id=67 idx=0xfc tid=10922 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf9558[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf9558[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '3' for queue: 'UserLockout'" id=68 idx=0x100 tid=10923 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf9620[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf9620[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '4' for queue: 'UserLockout'" id=69 idx=0x104 tid=10924 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cf96e8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cf96e8[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'weblogic.unicast.DispatchWorkManager'" id=70 idx=0x108 tid=10958 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cfbbb0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cfbbb0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'weblogic.unicast.DispatchWorkManager'" id=71 idx=0x10c tid=10959 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cfbc78[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cfbc78[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'weblogic.unicast.DispatchWorkManager'" id=72 idx=0x110 tid=10960 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cfbd40[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cfbd40[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '3' for queue: 'weblogic.unicast.DispatchWorkManager'" id=73 idx=0x114 tid=10961 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cfbe08[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cfbe08[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '4' for queue: 'weblogic.unicast.DispatchWorkManager'" id=74 idx=0x118 tid=10962 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4cfbed0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4cfbed0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'weblogic.unicast.ForwardingWorkManager'" id=75 idx=0x11c tid=10963 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c66f40[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c66f40[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'weblogic.unicast.ForwardingWorkManager'" id=76 idx=0x120 tid=10964 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c67008[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c67008[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'weblogic.unicast.ForwardingWorkManager'" id=77 idx=0x124 tid=10965 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c670d0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c670d0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '3' for queue: 'weblogic.unicast.ForwardingWorkManager'" id=78 idx=0x128 tid=10966 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c67198[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c67198[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '4' for queue: 'weblogic.unicast.ForwardingWorkManager'" id=79 idx=0x12c tid=10967 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c67260[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c67260[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'ClusterMessaging'" id=81 idx=0x134 tid=10969 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c692e0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c692e0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'wl_oldBootStrap'" id=82 idx=0x138 tid=10972 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c69a90[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c69a90[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'wl_oldBootStrap'" id=83 idx=0x13c tid=10973 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c69b58[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c69b58[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'wl_oldBootStrap'" id=84 idx=0x140 tid=10974 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c69c20[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c69c20[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '3' for queue: 'wl_oldBootStrap'" id=85 idx=0x144 tid=10975 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c69ce8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c69ce8[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '4' for queue: 'wl_oldBootStrap'" id=86 idx=0x148 tid=10980 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c69db0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c69db0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '5' for queue: 'wl_oldBootStrap'" id=87 idx=0x14c tid=10984 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c69e78[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c69e78[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '6' for queue: 'wl_oldBootStrap'" id=88 idx=0x150 tid=10987 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c69f40[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c69f40[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '7' for queue: 'wl_oldBootStrap'" id=89 idx=0x154 tid=10988 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c6a008[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c6a008[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "Thread-12" id=90 idx=0x158 tid=10989 prio=5 alive, parked, native_blocked
        -- Parking to wait for: java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject@0xa4c66b48
        at jrockit/vm/Locks.park0(J)V(Native Method)
        at jrockit/vm/Locks.park(Locks.java:2230)
        at sun/misc/Unsafe.park(ZJ)V(Native Method)
        at java/util/concurrent/locks/LockSupport.park(LockSupport.java:156)
        at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
        at java/util/concurrent/LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
        at weblogic/utils/concurrent/JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
        at weblogic/store/internal/PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:672)
        at weblogic/store/internal/PersistentStoreImpl.run(PersistentStoreImpl.java:721)
        at java/lang/Thread.run(Thread.java:662)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'JTACoordinatorWM'" id=91 idx=0x15c tid=10990 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c6d128[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c6d128[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'JTACoordinatorWM'" id=92 idx=0x160 tid=10991 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c6d1f0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c6d1f0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'JTACoordinatorWM'" id=93 idx=0x164 tid=10992 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c6d2b8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at jrockit/vm/Locks.wait(Locks.java:1973)[inlined]
        at java/lang/Object.wait(Object.java:485)[inlined]
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)[optimized]
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c6d2b8[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '0' for queue: 'JmsDispatcher'" id=94 idx=0x168 tid=10995 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c6e688[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c6e688[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '1' for queue: 'JmsDispatcher'" id=95 idx=0x16c tid=10996 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c6e750[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c6e750[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '2' for queue: 'JmsDispatcher'" id=96 idx=0x170 tid=10997 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c6e818[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c6e818[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '3' for queue: 'JmsDispatcher'" id=97 idx=0x174 tid=10998 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c6e8e0[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
        at java/lang/Object.wait(J)V(Native Method)
        at java/lang/Object.wait(Object.java:485)
        at weblogic/kernel/ExecuteThread.waitForRequest(ExecuteThread.java:91)
        ^-- Lock released while waiting: weblogic/kernel/ServerExecuteThread@0xa4c6e8e0[fat lock]
        at weblogic/kernel/ExecuteThread.run(ExecuteThread.java:115)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "ExecuteThread: '4' for queue: 'JmsDispatcher'" id=98 idx=0x178 tid=10999 prio=5 alive, waiting, native_blocked, daemon
        -- Waiting for notification on: weblogic/kernel/ServerExecuteThread@0xa4c6e9a8[fat lock]
        at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
       

    Hi,
    Based on the below doc , you can narrow down the actual Thread that is causing this high CPU.
    Unexpected High CPU Usage with WebLogic Server (WLS) Support Pattern (Doc ID 779349.1)
    Thanks,
    Sharmela

  • SQL Server 2012 - RESOURCE MONITOR / PREEMPTIVE_XE_CALLBACKEXECUTE high CPU usage

    Hello, 
      We are currently in the process of migrating an existing clustered SQL Server 2008 R2 instance over to a clustered SQL Server 2012 instance as we phase out the Windows Server 2008 with SQL Server 2008 R2.
      The setup is identical for the SQL Server 2012 instance as it is on the SQL Server 2008 R2 instance.  (meaning the RAM and CPU are both the same or better on the SQL Server 2012 instance)
      The process in which we are migrating is that we're moving a few databases over to the new SQL Server 2012 instance each night.  What we've noticed is that the CPU usage is much higher on the SQL Server 2012 instance than on the previous
    SQL Server 2008 R2 instance even though the there is only 1/2 of the databases migrated to the 2012 instance. 
      Running the following script:
    ;with cte ([totalCPU]) as (select sum(cpu) from master.dbo.sysprocesses)
    select
    tblSysprocess.spid
    , tblSysprocess.cpu
    , CONVERT(BIGINT,(tblSysprocess.cpu * CONVERT(BIGINT,100))) / CONVERT(BIGINT, cte.totalCPU) as [percentileCPU]
    , tblSysprocess.physical_io
    , tblSysprocess.memusage
    , tblSysprocess.cmd
    , tblSysProcess.lastwaittype
    from master.dbo.sysprocesses tblSysprocess
    cross apply cte
    order by tblSysprocess.cpu desc
    Produces the following results:
    In a clustered environment, is this normal and if not, does anyone know what this means or how to reduce the CPU usage?
    Thanks.

    Hello,
    The following query may help us identify extended events or audit configurations running on that SQL Server server that are producing that high CPU usage scenario.
    SELECT
    s.name
    AS 'Sessions'
    FROM
    sys.server_event_sessions
    AS s
    WHERE
    s.name
    <> 'system_health'
    and s.name
    <> 'AlwaysOn_health';
    Hope this helps.
    Regards,
    Alberto Morillo
    SQLCoffee.com

  • 100% CPU Utilisation while reading from socket

    I have writted a ServerSocket program to read data from ethernet client bridge. client-bridge is a system which converts serial data to TCP packet and vice versa. I can read from the client bridge only through creating a server socket and waiting for the client bridge to make a client socket connection (ServerSocket.accept() method.
    The problem that I m facing is that, the client bridge is creating connection only once. I have created an infinite loop which keeps on reading from the socket. The performance of the application goes down drastically (100% CPU utilisation through task manager) when this application is run. Is there a better way of reading data from the client bridge. The client bridge is not in our control and the server can only wait for the client to make connection.
    Please help. Thanking you all in anticipation.
    Regards,
    Amitabha

    If I close the client socket will the client create a new socket to
    transmit data or it depends on the client application.
    I have also tried creating a new socket connection for
    reading each frame of the protocol. but the client
    creates only one socket. What might be the problem?I bet it depends on the client app because your server app only waits for a connection from the client. So it's the client that initiates the connection. When you disconnect the client socket then you will have to wait for another client request. what you can do is to stay connected (unless of course client disconnects itself) and just keep on reading from the client socket.

  • Lookout SQL Server Running at 100%

    Hi there,
    We have a system that is logging alarms for several sewage pumpstations.  We recently had a problem with the HMI machine where the Microsoft SQL Server was running at close to 100%.  I was unsure what SQL server was doing, so I disabled it in the services manager.
    However, after doing this I found that I could not search the database for alarms (which makes sense).  I then restarted the SQL Server, but once again found that it pushed the computer CPU close to 100%.
    Is there any reason for this?  How could this be fixed?
    -andrew

    Check this previous post.
    http://forums.ni.com/ni/board/message?board.id=190​&message.id=3160

  • Measuring the cpu and ram consumption of a given query in sql server

    hello there how you doing and am new to this sql server forum and i suddenly popped to ask questions related to sql server
    and my question goes like this
    in sql server i have table called testt and it have more thna10000000 records
    and i have written a query select * from testt limit 9000000; and what i want is to measure the
    CPU consumption of this given query=???????????????
    and
    RAM consumption of this given query=???????????????
    Time consumption of this given query=?????????????? this i will get it from the result bar but i don't know whether it is correct or not
    any help on this it may be query, tool or configurations all are acceptable and appreciated
    10Q for letting me ask questions and feeling freely.

    Please check these queries and this may helps you to get whats happening on with CPU currently..
    SELECT getdate() as "RunTime", st.text, qp.query_plan, a.* FROM sys.dm_exec_requests a CROSS APPLY sys.dm_exec_sql_text(a.sql_handle) as st CROSS APPLY sys.dm_exec_query_plan(a.plan_handle) as qp order by CPU_time desc
    Top 50 CPU usage :
    SELECT TOP 50 st.text
                   ,st.dbid
                   ,st.objectid
                   ,qs.total_worker_time
                   ,qs.last_worker_time
                   ,qp.query_plan
    FROM sys.dm_exec_query_stats qs
    CROSS APPLY sys.dm_exec_sql_text(qs.sql_handle) st
    CROSS APPLY sys.dm_exec_query_plan(qs.plan_handle) qp
    ORDER BY qs.total_worker_time DESC
    SP_Whoisactive --- download from : http://www.brentozar.com/responder/log-sp_whoisactive-to-a-table/
    Activity Monitor and sp_who2 active also will give some idea...
    Reference links...
    http://channel9.msdn.com/posts/SQL-server-High-CPU--Part-1
    http://channel9.msdn.com/posts/Troubleshooting-SQL-server-High-CPU--Part-2
    http://jeffstevenson.karamazovgroup.com/2008/09/identifying-high-cpu-sql-processes.html
    http://searchsqlserver.techtarget.com/tutorial/Step-1-CPU-usage
    ================
    Execute this script and and start doing your analysis in your server so that you will get more idea how its working and all the details...
    Sample CPU Test : Dont try this in production and try this in your test or Dev server..
    -- Query to Keep CPU Busy for 2 0 Seconds
    DECLARE    @T DATETIME, @F BIGINT;
    SET @T = GETDATE();
    WHILE DATEADD(SECOND,20,@T)>GETDATE()
    SET    @F=POWER(2,30);
    You can easily change the parameter in the DATEADD and can make it run for 50 seconds.
    -- Query to Keep CPU Busy for 50 Seconds
    DECLARE    @T DATETIME, @F BIGINT;
    SET @T = GETDATE();
    WHILE DATEADD(SECOND,50,@T)>GETDATE()
    SET    @F=POWER(2,30);
    Raju Rasagounder MSSQL DBA

Maybe you are looking for

  • Memory Upgrade Did Not Seem To Help Much

    I just upgraded the memory on my Power Mac G4 with a System 512 MB 168 DiMM 64MX64 SDRAM PC133 CL @ UNBUFF card that was the largest recommended for my machine by Crucial. This put the memory at 896 MB. The machine seems to be running a little better

  • Name of user instead of username

    I want to change username in the header of the page to name of user, while using HTML DB authentification. may be someone have any ideas, how to replce variable &user to something like 'select first_name||' '||last_name as name from wwv_flow_users wh

  • ReportCrash constantly going and X-Rite

    I keep having the reoccuring problem with reportcrash constantly going and sucking up half a proccesor. The only way I can stop it is to reboot. I went to my log folder and it seems there are about 15 log files that are constantly updating all which

  • Retrieving Job Status from the AS/400 using JTOpen

    Hi , I am using a program to retrieve job status (i.e. whether a job is in delay wait or message wait using the if (job.getStatus.equalsIgnoreCase(job.ACTIVE_JOB_STATUS_WAIT_DELAY) But however , even when the Job is in DLYW (Delay Wait) status on the

  • Black dots on camera?

    There are small black dots all over all of my pictures on my iphone 4. They're very noticeable and I have no idea what it is. I've tried to clean my camera multiple times. The dots showed up two weeks ago, and have gotten much worse.