High cpu usage for garbage collection (uptime vs total gc time)

Hi Team,
We have a very high cpu usage issue in the production.
When we restart the server, the cpu idle time would be around 95% and it comes down as days goes by. Today idle cpu is 30% and it is just 6th day after the server restart.
Environemnt details:
Jrockit version:
Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_05-b04)
BEA WebLogic JRockit(TM) 1.4.2_05 JVM R24.4.0-1 (build ari-38120-20041118-1131-linux-ia32, Native Threads, GC strategy: parallel)
Gc Algorithm: JRockit Garbage Collection System currently running strategy: Single generational, parallel mark, parallel sweep
Number Of Processors: 4
Max Heap Size: 1073741824
Total Garbage Collection Time: 21:43:56.5
Uptime: 114:33:4.1
Total Garbage Collection Count: 420872
Total Number Of Threads: 198
Number Of Daemon Threads: 191
Can you guys please tell me what would be problem in the server which causing the high cpu usage?
One more thing I would like to know is that why the total number of threads is 198 when we specified the Executor pool size as 25? I agree that weblogic would create some threads for its maintenance but around 160 threads!!! something is wrong I guess.
Santhosh.
[email protected]

Hi,
I'm having a similar problem, but haven't been able to resolve it yet. Troubleshooting is made even harder by the fact that this is only happening on our production server, and I've been unable to reproduce it in the lab.
I'll post whatever findings I have and hopefully we'll be able to find a solution with the help of BEA engineers.
In my case, I have a stand-alone Tomcat server that runs fine for about 1-2 days, and then the JVM suddenly starts using more CPU, and as a result, the server load shoots up (normal CPU utilization is ~5% but eventually goes up to ~95%; load goes from 0.1 to 4+).
What I have found so far is that this corresponds to increased GC activity.
Let me list my environment specs before I proceed, though:
CPU: Dual Xeon 3.06GHz
RAM: 2GB
OS: RHEL4.4 (2.6.9-42.0.2.ELsmp)
JVM build 1.5.0_03-b07 (BEA JRockit(R) (build dra-45238-20050523-2008-linux-ia32, R25.2.0-28))
Tomcat version 5.5.12
JAVA_OPTS="-Xms768m -Xmx768m -XXtlasize16k -XXlargeobjectlimit16k -Xverbose:memory,cpuinfo -Xverboselog:/var/log/tomcat5/jvm.log -Xverbosetimestamp"
Here are excerpts from my verbose log (I'm getting some HT warning, not sure if that's a problem):
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Detected SMP with 2 CPUs that support HT.
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Trying to determine if HT is enabled.
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Trying to read from /dev/cpu/0/cpuid
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Warning: Failed to read from /dev/cpu/0/cpuid
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Trying to read from /dev/cpu/1/cpuid
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Warning: Failed to read from /dev/cpu/1/cpuid
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] HT is: supported by the CPU, not enabled by the OS, enabled in JRockit.
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Warning: HT enabled even though OS does not seem to support it.
[Fri Oct 20 15:54:55 2006][22855][memory ] GC strategy: System optimized over throughput (initial strategy singleparpar)
[Fri Oct 20 15:54:55 2006][22855][memory ] heap size: 786432K, maximal heap size: 786432K
[Fri Oct 20 16:07:30 2006][22855][memory ] Changing GC strategy to generational, parallel mark and parallel sweep
[Fri Oct 20 16:07:30 2006][22855][memory ] 791.642-791.874: GC 786432K->266892K (786432K), 232.000 ms
[Fri Oct 20 16:08:02 2006][22855][memory ] 824.122: nursery GC 291998K->274164K (786432K), 175.873 ms
[Fri Oct 20 16:09:51 2006][22855][memory ] 932.526: nursery GC 299321K->281775K (786432K), 110.879 ms
[Fri Oct 20 16:10:24 2006][22855][memory ] 965.844: nursery GC 308151K->292222K (786432K), 174.609 ms
[Fri Oct 20 16:11:54 2006][22855][memory ] 1056.368: nursery GC 314718K->300068K (786432K), 66.032 ms
[Sat Oct 21 23:21:09 2006][22855][memory ] 113210.427: nursery GC 734274K->676137K (786432K), 188.985 ms
[Sat Oct 21 23:30:41 2006][22855][memory ] 113783.140: nursery GC 766601K->708592K (786432K), 96.007 ms
[Sat Oct 21 23:36:15 2006][22855][memory ] 114116.332-114116.576: GC 756832K->86835K (786432K), 243.333 ms
[Sat Oct 21 23:48:20 2006][22855][memory ] 114841.653: nursery GC 182299K->122396K (786432K), 175.252 ms
[Sat Oct 21 23:48:52 2006][22855][memory ] 114873.851: nursery GC 195060K->130483K (786432K), 142.122 ms
[Sun Oct 22 00:01:31 2006][22855][memory ] 115632.706: nursery GC 224096K->166618K (786432K), 327.264 ms
[Sun Oct 22 00:16:37 2006][22855][memory ] 116539.368: nursery GC 246564K->186328K (786432K), 173.888 ms
[Sun Oct 22 00:26:21 2006][22855][memory ] 117122.577: nursery GC 279056K->221543K (786432K), 170.367 ms
[Sun Oct 22 00:26:21 2006][22855][memory ] 117123.041: nursery GC 290439K->225833K (786432K), 69.170 ms
[Sun Oct 22 00:29:10 2006][22855][memory ] 117291.795: nursery GC 298947K->238083K (786432K), 207.200 ms
[Sun Oct 22 00:39:05 2006][22855][memory ] 117886.478: nursery GC 326956K->263441K (786432K), 87.009 ms
[Sun Oct 22 00:55:22 2006][22855][memory ] 118863.947: nursery GC 357229K->298971K (786432K), 246.643 ms
[Sun Oct 22 01:08:17 2006][22855][memory ] 119638.750: nursery GC 381744K->322332K (786432K), 147.996 ms
[Sun Oct 22 01:11:22 2006][22855][memory ] 119824.249: nursery GC 398678K->336478K (786432K), 93.046 ms
[Sun Oct 22 01:21:35 2006][22855][memory ] 120436.740: nursery GC 409150K->345186K (786432K), 81.304 ms
[Sun Oct 22 01:21:38 2006][22855][memory ] 120439.582: nursery GC 409986K->345832K (786432K), 153.534 ms
[Sun Oct 22 01:21:42 2006][22855][memory ] 120443.544: nursery GC 410632K->346473K (786432K), 121.371 ms
[Sun Oct 22 01:21:44 2006][22855][memory ] 120445.508: nursery GC 411273K->347591K (786432K), 60.688 ms
[Sun Oct 22 01:21:44 2006][22855][memory ] 120445.623: nursery GC 412391K->347785K (786432K), 68.935 ms
[Sun Oct 22 01:21:45 2006][22855][memory ] 120446.576: nursery GC 412585K->348897K (786432K), 152.333 ms
[Sun Oct 22 01:21:45 2006][22855][memory ] 120446.783: nursery GC 413697K->349080K (786432K), 70.456 ms
[Sun Oct 22 01:34:16 2006][22855][memory ] 121197.612: nursery GC 437378K->383392K (786432K), 165.771 ms
[Sun Oct 22 01:37:37 2006][22855][memory ] 121398.496: nursery GC 469709K->409076K (786432K), 78.257 ms
[Sun Oct 22 01:37:37 2006][22855][memory ] 121398.730: nursery GC 502490K->437713K (786432K), 65.747 ms
[Sun Oct 22 01:44:03 2006][22855][memory ] 121785.259: nursery GC 536605K->478156K (786432K), 132.293 ms
[Sun Oct 22 01:44:04 2006][22855][memory ] 121785.603: nursery GC 568408K->503635K (786432K), 71.751 ms
[Sun Oct 22 01:50:39 2006][22855][memory ] 122180.985: nursery GC 591332K->530811K (786432K), 131.831 ms
[Sun Oct 22 02:13:52 2006][22855][memory ] 123573.719: nursery GC 655566K->595257K (786432K), 117.311 ms
[Sun Oct 22 02:36:04 2006][22855][memory ] 124905.507: nursery GC 688896K->632129K (786432K), 346.990 ms
[Sun Oct 22 02:50:24 2006][22855][memory ] 125765.715-125765.904: GC 786032K->143954K (786432K), 189.000 ms
[Sun Oct 22 02:50:26 2006][22855][memory ] 125767.535-125767.761: GC 723232K->70948K (786432K), 225.000 ms
vvvvv
[Sun Oct 22 02:50:27 2006][22855][memory ] 125768.751-125768.817: GC 712032K->71390K (786432K), 64.919 ms
[Sun Oct 22 02:50:28 2006][22855][memory ] 125769.516-125769.698: GC 711632K->61175K (786432K), 182.000 ms
[Sun Oct 22 02:50:29 2006][22855][memory ] 125770.753-125770.880: GC 709632K->81558K (786432K), 126.000 ms
[Sun Oct 22 02:50:30 2006][22855][memory ] 125771.699-125771.878: GC 708432K->61368K (786432K), 179.000 ms
So, I'm running with the default GC strategy which lets the GC pick the most suitable approach (single space or generational). It seems to switch to generational almost immediately and runs well - most GC runs are in the nursery, and only once in a while it goes through the older space.
Now, if you look at [Sun Oct 22 02:50:27 2006], that's when everything changes. GC starts running every second (later on it's running 3 times a second) doing huge sweeps. It never goes through the nursery again, although the strategy is still generational.
It's all downhill from this point on, and it's a matter of hours (maybe a day) before we restart the server.
I guess my only question is: What would cause such GC behavior?
I would appreciate your ideas/comments!
Thanks,
Tenyo

Similar Messages

  • High CPU usage for webservd

    we are seeing a very high CPU usage for webservd. looking at the java stack it seems to be threads communicating to sun one LDAP server.
    Anyone experienced this? is there a know issue in Java LDAP SDK?
    Sun ONE Web Server 6.1SP4 B12/16/2004
    17393 root 3741M 1655M cpu0 10 0 59:30:33 8.8% webservd/6235
    17393 root 3741M 1655M cpu16 10 0 223:58:38 8.7% webservd/5043
    17393 root 3741M 1655M cpu17 10 0 545:54:49 8.7% webservd/2902
    17393 root 3741M 1655M run 10 0 379:07:26 8.3% webservd/3996
    17393 root 3741M 1655M cpu1 30 0 213:54:52 8.3% webservd/5115
    17393 root 3741M 1655M run 20 0 56:03:44 8.2% webservd/6265
    17393 root 3741M 1655M cpu18 30 0 556:18:29 8.2% webservd/2830
    17393 root 3741M 1655M cpu3 30 0 548:09:11 8.2% webservd/2890
    17393 root 3741M 1655M run 20 0 328:18:42 8.1% webservd/4359
    17393 root 3741M 1655M cpu2 30 0 5:11:16 8.1% webservd/6722
    17393 root 3741M 1655M run 20 0 181:49:48 8.1% webservd/5322
    17393 root 3741M 1655M run 20 0 251:44:35 7.8% webservd/4857
    [02/Aug/2006:15:06:16] warning (17393): CORE3283: stderr: "BlockedThread" daemon prio=1
    0 tid=0x01110650 nid=0xb56 runnable [0x1714f000..0x1714fc10]
    [02/Aug/2006:15:06:16] warning (17393): CORE3283: stderr: at netscape.ldap.LDAPSe
    archListener.nextMessage(LDAPSearchListener.java:86)
    [02/Aug/2006:15:06:16] warning (17393): CORE3283: stderr: at netscape.ldap.LDAPSe
    archListener.getResponse(LDAPSearchListener.java:77)
    [02/Aug/2006:15:06:16] warning (17393): CORE3283: stderr: at com.iplanet.services
    .ldap.event.BlockedThread.run(BlockedThread.java:121)
    [02/Aug/2006:15:06:16] warning (17393): CORE3283: stderr: at java.lang.Thread.run
    (Thread.java:595)

    forgot to mention: OS is solaris 9

  • High CPU usage for SERVER0 process in XI

    Hi,
    SERVER0 process is taking high CPU usage, previously it happen once its due to communication channel error, So we deativated some unwanted communication channels in Alert config and the CPU usage is reduced.
    After some weeks its again CPU usage is increasing for SERVER0 process in some time.
    Can anyone help in this case.
    Thank you,
    gopi.

    Hi Gopi,
    Check out Tim's reply and check for ur Java stack settings,
    Extended Memory parameters
    <i>The bottom line for J stacks is to keep everything in memory and out of swap. </i>
    Other tips:
    - u may try clearing folder usr\sap\<SID>\DVEBMGS00\j2ee\cluster\server0\apps
    - try increasing virtual memory
    - increase heap size
    <i>[Reward if helpful]</i>
    Regards,
    Prateek

  • Satellite T130-10T: High CPU usage for non apparent reason

    I have a brand new Satelitte T130.
    From unboxing, I remarked that CPU usage is most of the time very high, even when doing nothing (no applications are running).
    It sometimes hits 100% and stays ther for a few minutes.
    I installed the newest BIOST I could find on the Toshiba site, but nothing changes.
    Any ideas?
    I don't like this just-out-the-box-unit already causes troubles!

    Hi mate
    There are a lot of applications which are running in the background.
    Most of them are installed by Toshiba and such tools controls the notebook features like FN buttons, multi control buttons, eco button, etc
    You can see the ruing applications in task manager. There you can also see what background process needs the CPU usage.
    Greets

  • High CPU usage for tcc.exe on Windows XP

    We have the following setup which hosts a JAVA client application:
    A Netra T12 which is used as a GUI server + SGD server.
    A 490 acting as another GUI server.
    Internet Explorer 6 on Windows XP SP1 for the SGD client sessions.
    When we run clients via this setup, we run into an issue where tcc suddenly starts eating up 50 - 99% cpu causing the clients to slow down.
    Has anyone else experienced this issue? I can share configuration info but any help would be appreciated.

    High CPU utilization is mostly due to queries or the background activity performed by Oracle.
    Submit your statsapck report to www.statspackanalyzer.com and get the report in understandable format. Then you know where to look into.

  • High CPU usage for simple tasks?

    Hello,
    In iTunes, various tasks take 3-4 seconds to happen/start  (rating a song, scrolling up and down within a list of songs, etc.), and I get either rainbow wheel or lag/nothing happening (or both) in the meantime. I did not notice this problem before the new (11) version of iTunes, and no other apps/programs are having issues of any kind. I checked CPU usage while changing the rating of a song and it went to about 55% for 5 seconds or so. That can't be right... it just can't. Is this some kind of bug in iTunes or is there something (simple!) I can do to fix it?
    I'm pretty sure I have Genius turned off, but I've never used it so I really don't even know much about it.
    iMac 24" w/3.06 GHz processor, 4GB memory, the computer's about 4 or 5 years old but still runs very well everywhere else. Currently  running 10.6.8 and my external backup died on me a few months ago, so  updating the OS, if there's ANY chance of losing anything, isn't an option right now.
    I use iTunes a lot so this is driving me insane. Please help!
    Message was edited by: earthimmigrant (clarifying the issue a bit better)

    forgot to mention: OS is solaris 9

  • High CPU usage for no reason

    Recently, my MBP becomes hot and its battery life becomes shorter, so I checked the Activity Monitor. The CPU is reported as ~37% User and ~22% System when it's idle. But I am not running anything besides Activity Monitor and all processes show normal CPU usage in Activity Monitor.
    I also heard the harddisk keeping reading/writing. The Disk Activity persistently reported 0 Reads in/sec and ~30 Writes out/sec when the computer is idle.
    I have repaired permissions, and reset the PRAM, but nothing changed.
    Any help would be appreciated!

    Workaround and Solution!
    In a nutshell: The long and short of it is that many websites today are very resource intensive. The workaround is to share the load among two to four different browsers. This workaround works every time. The browser-builders will have to make the final fixes.
    I urge all of you to duplicate my results!
    I've been troubleshooting this with Apple for well over 2 weeks and just discovered the root cause and workaround a couple of hours ago. Here's what I sent to Apple:
    Subject:
    Root Cause Identified for Case 20244XXXX!
    Body:
    Insufficient Stress Testing and No Load Shedding!
    Hello Annette, Jim and Steve,
    Please see the attached screenshots.
    Engineering, especially test engineering, needs to look at this! When this is resolved Steve can go on stage and show another Safari feature that is superior to Camino, Chrome and Firefox, etc. (I was able to replicate part of this using several boxes at a local Apple Store about a week ago!)
    Here’s the deal:
    I was blaming Safari because I rarely use other browsers.
    1. Open Activity Monitor to All Processes and order by %CPU descending.
    2. Launch a browser and go to http://streamingradioguide.com/streaming-radio.php?format=1&radio-format=News/Ta lk&includeAM=on&includeFM=on&includeHD=&includeLPFM=
    or http://radiotime.com/channel/c_57922/News.aspx, open a few streams and watch the %CPU skyrocket. (I often channel-flip between several streams.)
    3. Document the results.
    4. Repeat steps 2 and 3 for a second, third and fourth browser.
    5. Repeat steps as needed on other test boxes. Repeat everything as needed.
    6. Send the documentation of these tests to engineering.
    7. Engineering: Replicate results and review all documentation.
    8. Make Safari much more resource efficient than any other browser.
    Steve can then demo this to the world and everyone will have another insanely great day!
    Thanks for another great demo today Steve.
    John
    The long and short of it is that many websites today are very resource intensive. The workaround is to share the load among two to four different browsers. This workaround works every time. The browser-builders will have to make the final fixes.
    Thanks,
    John

  • High CPU usages for CCM 5.1

    Hii all,
    I am using 4 nos. of CCM5.1( 2 nos.of
    CCM7835 & 2 nos. of CCM7815). Now only total 50 nos. of IP Phones connected with those server. but In NMS Spectrum, showing more than 95% CPU Useges and indicating Critical Error for all 4 nos. of CCM Server.
    What can I do for it.plzzz..help me as soon as possible..

    hii jsivulka,
    thanks for reply...may I know about CSA ....
    may I disable it for decrease the CPU Usages..
    plzzz help me
    Thanks and regards
    Madhab

  • High CPU usage for bpel

    Hi all,
    We successfully deployed sample application FusionOrderDemo_R1PS2 to weblogic server,but it consumed much CPU.
    Then we did a jprofile, found a thread of com.collaxa.cube.engine.dispatch.Sweeper.run is CPU killer.
    Is any developer here? Can you tell me what this thread work for and how to avoid this?
    Thanks.

    Better you raise an SR with Oracle Support. they should be able to help you understand what is going on with CPU usage.
    .collaxa.cube.engine.dispatch package -> The dispatcher layer is at the core of the bpel engine, and every request (e.g. to activate a scope, or start a process runs through the dispatch layer, by calling endrequest in the cube engine). If you need a detailed view of messages that are sent around (e.g. to expire or callback an activity), this is the place to go. [http://prsync.com/oracle/helping-oracle-support-to-help-you-5693/]

  • High CPU usage for BEASVC OATS

    We are experience high cpu utilization after a few days of restarting the service. OATS is currently being used to track issues.   Eventually the service needs to be stopped and restarted as the system will be unusable. Attached is the image from resource manager.

    forgot to mention: OS is solaris 9

  • HIGH CPU Usage for No Reason! HELPP

    ok on my 13inch White Macbook my cpu system usage is VERY high for no apparent reason. My activity monitor shows nothing going on but safari (which is really my only use on the computer) . so does ANYONE have any idea what could cause my system usage to be so high .???? its causing my safari to run slow at times, and its makes my fan run alot bc i think my computer is working so hard.

    i changed it to "All Processes" and what i see is it switches out from Safari being the highest at like 3 something, then Activity monitor around the same, then Window Server around the same as well. But my System Usage down at the bottom is still 50+ and User Usage is about 5.

  • High CPU Usage for Google Drive...Any Known Fix?

    I posted this over in the Google support forums, but I figured I'd throw it over here to see if anyone had any thoughts on it.
    In the past couple of days, I noticed that my CPU temperature had been much higher than normal...cracking 70º C when idle and, of course, getting warmer when doing other things.  As a result, fan speeds ramp up and battery life lessons (I monitor all this with the iStat Pro dashboard widget).  I considered doing an SMC reset (and still kept it in my back pocket if the problem persisted).  The first thing I did was see what, if anything, was taxing the CPU.  I opened Activity Monitor and noted, to my surprise, that Google Drive (running the newest build, 1.19.8406.6504) was using 100% of my CPU!  And doing so just sitting in my menubar doing nothing.  I quit drive and, within, minutes, my CPU temperature dropped almost 30º.  The temperature has, since, been staying put in the 40º-50º C range and the fans speeds around 2000 RPM...both considered "normal" ranges for near-idle behavior on my MacBook.  Resetting the SMC has remained unnecessary.
    Any other Google Drive users out there who have seen this problem?  Anyone found a fix?  Thanks.

    Yep, me too.
    early 2011 macbook pro 15inch, yosemite 10.2.2
    Model Name:    MacBook Pro
      Model Identifier:    MacBookPro8,2
      Processor Name:    Intel Core i7
      Processor Speed:    2.2 GHz
      Number of Processors:    1
      Total Number of Cores:    4
      L2 Cache (per Core):    256 KB
      L3 Cache:    6 MB
      Memory:    8 GB

  • High CPU usage for Mail/Address Book with Exchange/GMail

    I reinstalled 10.6 on my MacBook Pro because it since the upgrade from 10.5 performance has been generally lousy and I wanted to make a fresh start. I am finding that my performance problems with Mail (which connects to both Gmail and Exchange) is still poor At all times, even when Mail is not processing any connections to either mail server, it consumes about 25% CPU just being idle. Oddly, Address Book uses 25% minimum CPU at all times. Also, in Address Book, I see the contact list for my Exchange account has the progress meter spinning at all times, even after a full reboot of the computer. My Mail and Contact lists are fully synced up at this point so I am not sure what all the overhead is for. It really drags down general performance of the machine, especially when I attempt to load any complex pages in Safari where I constantly see the pinwheel. This is all pretty troubling since this is a fresh install of the OS and I actually have same problems as I had with Mail before plus I now have new problems with Address Book that I DIDN'T have before. I haven't even turned on Time Machine because after the way it affected performance on my previous install for 15 minutes out of every hour it will surely render my machine useless.
    In a word, "Help".

    My problem doesn't align exactly with yours, but I'd suggest you try this anyway (especially if you aren't using RSS within Mail - this is sure to blow away any Mail.app RSS feeds):
    +So, if you see the Mail application growing in size until it aborts, it appears that the most direct fix is to quit Mail and delete the ~/Library/Mail/AvailableFeeds and ~/Library/Mail/AvailableFeeds-journal files. No reboots or other actions are required.+
    Details? See: http://discussions.apple.com/thread.jspa?messageID=10976938&#10976938

  • High CPU usage for clementine or amarok with btrfs

    Googled but no joy so far. If I run either clementine or amarok for whatever length of time (even a day or so) they take up at least one CPU flat scanning the btrfs library. No such thing with ntfs (for those windows users...) and I cannot make out why.

    My problem doesn't align exactly with yours, but I'd suggest you try this anyway (especially if you aren't using RSS within Mail - this is sure to blow away any Mail.app RSS feeds):
    +So, if you see the Mail application growing in size until it aborts, it appears that the most direct fix is to quit Mail and delete the ~/Library/Mail/AvailableFeeds and ~/Library/Mail/AvailableFeeds-journal files. No reboots or other actions are required.+
    Details? See: http://discussions.apple.com/thread.jspa?messageID=10976938&#10976938

  • High CPU usage for AppleVNCServer (Screen Sharing) on Mac Mini (mid 2010)

    Steadily around 90-100% (on a dual-core), no browser opened, just iTunes, VLC and a couple of low-impact servers.
    I wasn't worried about this since my Mini (no monitor, all Screen Sharing) has always done that but I just realized that Screen Sharing into my iMac or my MBP 13in (mid 2010, same CPU as Mini) does not make them go nearly as high (5-15%).
    As a result, it runs pretty hot when I VNC into it.
    Any suggestion?

    The screensharing CPU issue is still there in Mac OS 10.8.2 :-(
    (i have the problem on my mid-2011 mac-mini server)
    top sorted by CPU shows clearly two "screensharing"/"Screensharing" processes eating each about 45% CPU

Maybe you are looking for