Constant SBBOD with high cpu usage

Hi
since a couple of days ago I constantly get the SBBOD (spinning beach ball of death) on a Mac mini 2011 with Lion 10.7.3.
The system hangs up completely and the only this I can do is click around  and move the windows but the clicks don't do anything and at some point after that everything just stops responding.
At this point I'm forced to do a hard reboot (power switch).
After that the system works for a while and then gets the SBBOD again.
During the SBBOD I can see syslog hogging all my cpu usage in activity monitor, but when I try to kill it or click into activity monitor the programm doesn't respond.
I guessed that something else was spaming syslogd with messages but after the hard reboot I don't see anything in console.
Since then I tried almost everything.
- hardware test, the short and long one -> nothing found
- repairing hard drive and permissions -> didn't help
- S.M.A.R.T says  verified
- PRAM and NVRAM reset
- logged into guest account and started nothing -> SSBOD after ~hour
- started into save mode and left the comp running -> SSBOD after ~hour
- reformated(not zeroed) and reinstalled Lion(not from a backup) -> SSBOD after ~hour
Currently I'm trying to disable syslogd to see if some other process hogs all my cpu load instead of it.
I really hope one of you can help me, this thing is driving me nuts :/

Repairing the permissions of a home folder in Lion is a complicated procedure. I don’t know of a simpler one that always works.
Launch the Terminal application in any of the following ways:
☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
☞ Open LaunchPad. Click Utilities, then Terminal in the page that opens.
Drag or copy – do not type – the following line into the Terminal window, then press return:
chmod -R -N ~
The command will take a noticeable amount of time to run. When a new line ending in a dollar sign ($) appears below what you entered, it’s done. You may see a few error messages about an “invalid argument” while the command is running. You can ignore those. If you get an error message with the words “Permission denied,” enter this:
sudo !!
You'll be prompted for your login password, which won't be displayed when you type it. You may get a one-time warning not to screw up.
Next, boot from your recovery partition by holding down the key combination command-R at startup. Release the keys when you see a gray screen with a spinning dial.
When the recovery desktop appears, select Utilities ▹ Terminal from the menu bar.
In the Terminal window, enter “resetpassword” (without the quotes) and press return. A Reset Password window opens.
Select your boot volume if not already selected.
Select your username from the menu labeled Select the user account if not already selected.
Under Reset Home Directory Permissions and ACLs, click the Reset button.
Select  ▹ Restart from the menu bar.

Similar Messages

  • Since 10.4.6 Update: "ATSServer" with high CPU-usage when opening PDFs

    Since I've updated to 10.4.6 my system is very slow when I open PDFs (in "Preview" or "Acrobat").
    This is caused by the process "ATSServer" which goes through every file in "~/Library/Fonts" (I have over 4.800 files there - but just a view are activated by "FontBook") and so it takes very high CPU-usage.
    I didn't have this problem bevore the update and I didn't make any changes on my font settings.
    I've cleaned the font cache, but it doesn't help.
    Any ideas?
    Ciao
    Mephizo
    PS: Excuse my poor English.
    PowerBook G4 17'' 1.67 GHz   Mac OS X (10.4.6)  
    PowerBook G4 17'' 1.67 GHz   Mac OS X (10.4.6)  

    I haven't noticed any change myself, Dan, but I have the 2 GHz model.
    One thing I HAVE noticed though after OS updates is that they can often result in a fair amount of file and free space fragmentation immediately after installation. OSX's routines will deal with fragmentation of small files , but not of large ones (over 20 Meg), and it won't deal very effectively with free space fragmentation. If your HD is getting full this can cause significant slowdowns, especially where video is involved.
    You should also run DiskUtility and check for any directory and permissions issues.
    Cheers
    Rod

  • Having Issues with High CPU Usage with fluxbox & pekwm

    Greetings,
    I have searched for this issue and it seems that something similar has happened in the past with an old xorg, and it seems that someone is having a similar issue that they can point to kde as being the culrpit. However in my case, this is a fresh install and is not using any kde libs. Please allow me to explain the issue.
    The power supply on my main computer finally gave out, and being incredibly poor at the moment I can not yet replace it. So, I pull out an older computer that I had once set up for my kids, but took it away from them when they were abusing it. I always make backup dvds and such monthly so I didn't have to worry about any lose of data, however I desired to keep my larger hard drives from my main computer. After testing to ensure that the hard drives were fine, I did some minor surgery, and did a fresh install of arch linux onto my back up computer. Since I prefer pekwm, I installed pekwm as my wm of choice, and outfitted it quickly with mpd+sonata, firefox, pcmanfm, and tint2. Then I rebooted into my pekwm 'desktop'.
    It was running sluggish. Firefox was easily maxing the cpu up and beyond 100% and it felt ten times worse than any heavy DE I used in the past. I checked to make sure I had the right video driver installed. As this computer runs a 64MB nVidia GeForce2 MX with TV out video card, I searched nvidia's page and the arch wiki, noting that the driver needed is nvidia-96xx. Well I had already suspected that during install, and thus had installed such driver. I double checked my xorg.config and it has the right driver listed.
    So I checked out some lighter browsers. I tried both Midori and Iron (which is similar to Chrome but without google spyware or whatever). Well both run better than firefox, Midori being the lightest one, but Iron quickly being my favorite. Still, the problem remained. Moving windows caused cpu spikes, opening more than one tab, or more than one program caused cpu spikes and the computer to slow down and sputter, freezing at times.
    So I tried out another wm, fluxbos, which is another of my favorites. Seemed somewhat better but only fractionally, which I consider odd because pekwm has always seemed snappier than fluxbox to me in the past. Running lxtask (still mouse dependent, sorry lol), I was able to take note of the following...
    FLUXBOX
    lxtask 6% CPU usage average
    PCManFM 5% CPU Average
    Fluxbox 1% to 2% cpu usage
    gksu 3% cpu usage
    pidgin 3% to 7% cpu usage
    firefox up to 62% cpu usage
    midori up to 38% cpu usage
    iron up to 50% cpu usage
    mpd 11% cpu uage
    Xorg (with no window movement) 2% cpu usage
    Xorg (moving windows around) up to 80% cpu usage
    PEKWM
    lxtask 6% CPU
    pidgin 7% cpu
    tint2 1% cpu
    pekwm 1% to 5% cpu
    pcmanfm 7% cpu
    firefox up to 85% cpu
    python 1% cpu
    midori up to 38% cpu
    iron up to 25% cpu (odd...)
    Xorg (with no window movement) 1% cpu
    Xorg (when moving windows around) up to 80% cpu
    Both were using around 118 MB RAm and weren't yet touching swap. As I see it I am  thinking xorg  or video driver related, yet I already made sure that I had the correct video driver. Here's my Xorg.conf
    # nvidia-xconfig: X configuration file generated by nvidia-xconfig
    # nvidia-xconfig: version 1.0 (buildmeister@builder63) Thu Jun 25 18:57:07 PDT 2009
    Section "ServerLayout"
    Identifier "Layout0"
    Screen 0 "Screen0" 0 0
    InputDevice "Keyboard0" "CoreKeyboard"
    InputDevice "Mouse0" "CorePointer"
    EndSection
    Section "Files"
    EndSection
    Section "InputDevice"
    # generated from default
    Identifier "Mouse0"
    Driver "mouse"
    Option "Protocol" "auto"
    Option "Device" "/dev/psaux"
    Option "Emulate3Buttons" "no"
    Option "ZAxisMapping" "4 5"
    EndSection
    Section "InputDevice"
    # generated from default
    Identifier "Keyboard0"
    Driver "kbd"
    EndSection
    Section "Monitor"
    Identifier "Monitor0"
    VendorName "Unknown"
    ModelName "Unknown"
    HorizSync 30.0 - 110.0
    VertRefresh 50.0 - 150.0
    Option "DPMS"
    EndSection
    Section "Device"
    Identifier "Device0"
    Driver "nvidia"
    VendorName "NVIDIA Corporation"
    EndSection
    Section "Screen"
    Identifier "Screen0"
    Device "Device0"
    Monitor "Monitor0"
    DefaultDepth 24
    SubSection "Display"
    Depth 24
    Modes "1600x900" "1024x768" "800x600" "640x480"
    EndSubSection
    EndSection
    Here's some specs on this computer, including video cards and such...
    Computer
    Summary
    Computer
    Processor Intel(R) Pentium(R) 4 CPU 1.60GHz
    Memory 1034MB (239MB used)
    Operating System Arch Linux
    User Name mythus (Travis K. Randall)
    Date/Time Thu 08 Oct 2009 05:24:52 PM CDT
    Display
    Resolution 1600x900 pixels
    OpenGL Renderer GeForce2 MX/AGP/SSE2
    X11 Vendor The X.Org Foundation
    Multimedia
    Audio Adapter ICH - Intel 82801BA-ICH2
    Input Devices
    Macintosh mouse button emulation
    AT Translated Set 2 keyboard
    Power Button
    Power Button
    PC Speaker
    Logitech USB Optical Mouse
    Printers
    No printers found
    SCSI Disks
    ATA ST3160212A
    ATA IC35L090AVV207-0
    LITE-ON LTR-16102B
    TSSTcorp CD/DVDW TS-H552D
    Operating System
    Version
    Kernel Linux 2.6.30-ARCH (i686)
    Compiled #1 SMP PREEMPT Wed Sep 9 12:37:32 UTC 2009
    C Library GNU C Library version 2.10.1 (stable)
    Default C Compiler GNU C Compiler version 4.4.1 (GCC)
    Distribution Arch Linux
    Current Session
    Computer Name norova
    User Name mythus (Travis K. Randall)
    Home Directory /home/mythus
    Desktop Environment Unknown (Window Manager: Fluxbox)
    Misc
    Uptime 11 hours, 38 minutes
    Load Average 0.20, 0.38, 0.34
    Kernel Modules
    Loaded Modules
    ipv6 IPv6 protocol stack for Linux
    reiserfs ReiserFS journaled filesystem
    usbhid USB HID core driver
    hid
    arc4 ARC4 Cipher Algorithm
    ecb ECB block cipher algorithm
    snd_seq_dummy ALSA sequencer MIDI-through client
    rt2500pci Ralink RT2500 PCI & PCMCIA Wireless LAN driver.
    snd_seq_oss OSS-compatible sequencer module
    rt2x00pci rt2x00 pci library
    snd_seq_midi_event MIDI byte <-> sequencer event coder
    rt2x00lib rt2x00 library
    snd_seq Advanced Linux Sound Architecture sequencer.
    led_class LED Class Interface
    snd_seq_device ALSA sequencer device management
    input_polldev Generic implementation of a polled input device
    mac80211 IEEE 802.11 subsystem
    snd_intel8x0 Intel 82801AA,82901AB,i810,i820,i830,i840,i845,MX440; SiS 7012; Ali 5455
    uhci_hcd USB Universal Host Controller Interface driver
    snd_pcm_oss PCM OSS emulation for ALSA.
    fan ACPI Fan Driver
    cfg80211 wireless configuration support
    ppdev
    ehci_hcd USB 2.0 'Enhanced' Host Controller (EHCI) Driver
    snd_mixer_oss Mixer OSS emulation for ALSA.
    snd_ac97_codec Universal interface for Audio Codec '97
    nvidia
    lp
    eeprom_93cx6 EEPROM 93cx6 chip driver
    parport_pc PC-style parallel port driver
    ohci1394 Driver for PCI OHCI IEEE-1394 controllers
    parport
    psmouse PS/2 mouse driver
    ac97_bus
    ieee1394
    serio_raw Raw serio driver
    8139too RealTek RTL-8139 Fast Ethernet driver
    e100 Intel(R) PRO/100 Network Driver
    snd_pcm Midlevel PCM code for ALSA.
    pcspkr PC Speaker beeper driver
    battery ACPI Battery Driver
    8139cp RealTek RTL-8139C+ series 10/100 PCI Ethernet driver
    snd_timer ALSA timer interface
    i2c_core I2C-Bus main module
    iTCO_wdt Intel TCO WatchDog Timer Driver
    mii MII hardware support library
    evdev Input driver event char devices
    snd Advanced Linux Sound Architecture driver for soundcards.
    ac ACPI AC Adapter Driver
    iTCO_vendor_support Intel TCO Vendor Specific WatchDog Timer Driver Support
    usbcore
    soundcore Core sound module
    sg SCSI generic (sg) driver
    shpchp Standard Hot Plug PCI Controller Driver
    snd_page_alloc Memory allocator for ALSA system.
    processor ACPI Processor Driver
    thermal ACPI Thermal Zone Driver
    pci_hotplug PCI Hot Plug PCI Core
    intel_agp
    button ACPI Button Driver
    agpgart AGP GART driver
    rtc_cmos Driver for PC-style 'CMOS' RTCs
    rtc_core RTC class support
    rtc_lib
    ext4 Fourth Extended Filesystem
    mbcache Meta block cache (for extended attributes)
    jbd2
    crc16 CRC16 calculations
    sr_mod SCSI cdrom (sr) driver
    cdrom
    sd_mod SCSI disk (sd) driver
    ata_piix SCSI low-level driver for Intel PIIX/ICH ATA controllers
    ata_generic low-level driver for generic ATA
    pata_acpi SCSI low-level driver for ATA in ACPI mode
    libata Library module for ATA devices
    floppy
    scsi_mod SCSI core
    Display
    Display
    Display
    Resolution 1600x900 pixels
    Vendor The X.Org Foundation
    Version 1.6.3.901
    Monitors
    Monitor 0 1600x900 pixels
    Extensions
    BIG-REQUESTS
    Composite
    DAMAGE
    DOUBLE-BUFFER
    DPMS
    DRI2
    GLX
    Generic Event Extension
    MIT-SCREEN-SAVER
    MIT-SHM
    NV-CONTROL
    NV-GLX
    RANDR
    RECORD
    RENDER
    SECURITY
    SHAPE
    SYNC
    X-Resource
    XC-MISC
    XFIXES
    XFree86-DGA
    XFree86-VidModeExtension
    XINERAMA
    XInputExtension
    XKEYBOARD
    XTEST
    XVideo
    OpenGL
    Vendor NVIDIA Corporation
    Renderer GeForce2 MX/AGP/SSE2
    Version 1.5.8 NVIDIA 96.43.13
    Direct Rendering Yes
    Processor
    Processor
    Processor
    Name Intel(R) Pentium(R) 4 CPU 1.60GHz
    Family, model, stepping 15, 1, 2 (Pentium 4)
    Vendor Intel
    Configuration
    Cache Size 256kb
    Frequency 1594.77MHz
    BogoMIPS 3190.44
    Byte Order Little Endian
    Features
    FDIV Bug no
    HLT Bug no
    F00F Bug no
    Coma Bug no
    Has FPU yes
    Cache
    Cache information not available
    Capabilities
    fpu Floating Point Unit
    vme Virtual 86 Mode Extension
    de Debug Extensions - I/O breakpoints
    pse Page Size Extensions (4MB pages)
    tsc Time Stamp Counter and RDTSC instruction
    msr Model Specific Registers
    pae Physical Address Extensions
    mce Machine Check Architeture
    cx8 CMPXCHG8 instruction
    apic Advanced Programmable Interrupt Controller
    sep Fast System Call (SYSENTER/SYSEXIT)
    mtrr Memory Type Range Registers
    pge Page Global Enable
    mca Machine Check Architecture
    cmov Conditional Move instruction
    pat Page Attribute Table
    pse36 36bit Page Size Extensions
    clflush Cache Line Flush instruction
    dts Debug Store
    acpi Thermal Monitor and Software Controlled Clock
    mmx MMX technology
    fxsr FXSAVE and FXRSTOR instructions
    sse SSE instructions
    sse2 SSE2 (WNI) instructions
    ss Self Snoop
    ht HyperThreading
    tm Thermal Monitor
    up smp kernel running on up
    pebs Precise-Event Based Sampling
    bts Branch Trace Store
    Memory
    Memory
    Total Memory 1034084 kB
    Free Memory 94276 kB
    Buffers 40536 kB
    Cached 700112 kB
    Cached Swap 0 kB
    Active 170788 kB
    Inactive 726844 kB
    Active(anon) 74112 kB
    Inactive(anon) 88348 kB
    Active(file) 96676 kB
    Inactive(file) 638496 kB
    Unevictable 12 kB
    Mlocked 12 kB
    High Memory 139144 kB
    Free High Memory 252 kB
    Low Memory 894940 kB
    Free Low Memory 94024 kB
    Virtual Memory 2931852 kB
    Free Virtual Memory 2931852 kB
    Dirty 12 kB
    Writeback 0 kB
    AnonPages 156996 kB
    Mapped 57392 kB
    Slab 24260 kB
    SReclaimable 18864 kB
    SUnreclaim 5396 kB
    PageTables 1376 kB
    NFS_Unstable 0 kB
    Bounce 0 kB
    WritebackTmp 0 kB
    CommitLimit 3448892 kB
    Committed_AS 404212 kB
    VmallocTotal 122880 kB
    VmallocUsed 27648 kB
    VmallocChunk 52368 kB
    DirectMap4k 32760 kB
    DirectMap4M 876544 kB
    Benchmarks
    CPU Blowfish
    CPU Blowfish
    This Machine 1595 MHz 50.176
    Intel(R) Celeron(R) M processor 1.50GHz (null) 26.1876862
    PowerPC 740/750 (280.00MHz) (null) 172.816713
    CPU CryptoHash
    CPU CryptoHash
    This Machine 1595 MHz 11.071
    CPU Fibonacci
    CPU Fibonacci
    This Machine 1595 MHz 74.202
    Intel(R) Celeron(R) M processor 1.50GHz (null) 8.1375674
    PowerPC 740/750 (280.00MHz) (null) 58.07682
    CPU N-Queens
    CPU N-Queens
    This Machine 1595 MHz 132.704
    FPU FFT
    FPU FFT
    This Machine 1595 MHz 104.630
    FPU Raytracing
    FPU Raytracing
    This Machine 1595 MHz 212.639
    Intel(R) Celeron(R) M processor 1.50GHz (null) 40.8816714
    PowerPC 740/750 (280.00MHz) (null) 161.312647
    So what I am wanting help with is finding the solution to the cpu usage so that I can use this computer at least until I can afford a new power supply or whatever. I am open to any good suggestions, though I must state I am not really interested in tiling wm's at the moment. I am just not a true minimalist.
    Thanks in advance for any and all help. I understand that there is a lot of info in this post, but it is my hope that with this info the problem can be solved. If there is info I didn't provide that is needed, please let me know.

    also check that you have
    session.screen0.opaqueMove false
    in your .fluxbox/init  this will probably help a bit if it is currently true,
    Last edited by Cyrusm (2009-01-26 13:52:13)

  • Java thread with high CPU usage

    Hi,
    Running prstat -L -p pid on Solaris produces a list of lwp threads running in that process that are consuming the most CPU. Out of about 7 threads that were associated with kernel threads in pstack output, only 5 of them were mapped to a JVM thread dump. How is it possible to have a Java thread consuming CPU that doesn't show up in a thread dump?
    Thanks,
    J.S.

    And, any idea what this thread is doing?
    Here's pstack output for this missing thread 12:
    ----------------- lwp# 18 / thread# 12 --------------------
    fe0e48b4 __1cHCompileSflatten_alias_type6kMpknHTypePtr__3_ (b6001780, 100360, fe4c8000, b6001780, 100360, 0) + 4d8
    fe0f42ac __1cHCompilePget_alias_index6kMpknHTypePtr__I_ (b6001780, 100360, b6001264, 7e2bb8, 41f4, 7e2bb8) + 8
    fe11131c __1cJStoreNodeFIdeal6MpnIPhaseGVN_pnLPhaseDefUse__pnENode__ (0, 7dd5b4, 5035ec, 7e2bb8, b6001144, b6001264) + 128
    fe0c1224 __1cMPhaseIterGVNNtransform_old6MpnENode__2_ (0, b6001144, 7e2bb8, b6001264, 7e2bb8, b600116c) + 47c
    fe17349c __1cMPhaseIterGVNIoptimize6M_v_ (24, 0, a37700, b6001110, b6001100, 3442f0) + b4
    fe1943b0 __1cOPhaseIdealLoop2t6MrnMPhaseIterGVN_pk0_v_ (b6000ee8, a3772c, 1, 4ff37c, 2000, 269568) + 7cc
    fe1cc89c __1cHCompileIOptimize6M_v_ (b6001780, b60015b8, b6001780, b60015dc, 0, b60013dc) + a0
    fe1cb69c __1cHCompile2t6MpnFciEnv_pnHciScope_pnIciMethod_ill_v_ (91f504, b6001800, db8a24, fe5296b4, b60018a0, b60018b0) + 7bc
    fe1c73f8 __1cKC2CompilerOcompile_method6MpnFciEnv_pnHciScope_pnIciMethod_il_v_ (27b18, b6001af8, db8a24, db8938, ffffffff, 1) + 70
    fe1c79fc __1cNCompileBrokerZinvoke_compiler_on_method6FpnLCompileTask__v_ (db8938, db8a24, fe4eacec, 0, 0, 8d9) + 40c
    fe280964 __1cNCompileBrokerUcompiler_thread_loop6F_v_ (28758, 13a570, fe4c8000, b6001d10, fe4c8000, ffffffff) + 168
    fe216200 __1cKJavaThreadDrun6M_v_ (b5e02000, fe4d3e34, fe4c8000, 1ffd70, 13a570, 1ffd70) + 3d8
    fe213ec8 _start   (fe4c8000, ff325d10, 0, 5, 1, fe401000) + 20
    ff36b734 threadstart (13a570, 0, 0, 0, 0, 0) + 40

  • High CPU Usage on Terminalserver (Win2k3)

    Hi,
    at the moment we are running an Exchange 2010 SP3 in combination with Outlook 2010 (Ver. 14.0.6123.5001 32bit).
    Outlook is installed on Windows 7 fat clients, but most users access their mailbox with Outlook running on a Win2k3 Terminalserver (extended support till 2016).
    While the users on the fat clients don't have any problems, the thin client users experience problems with high cpu usage.
    Following example:
    Terminalserver, 12 users, 6 running Outlook, 2 users splitting almost the whole cpu between them (usage around 90-100%).
    This makes working on that terminalserver nearly impossible.
    I tried safe mode, I tried disabling their add-ins, I tried deleting their terminalserver profile to no avail.
    How can I figure out what's causing this?

    Hi,
    Anti Virus email scanners are known to cause similar behavior, please first check if you have any Anti Virus scanner integrated with Outlook. Try to disable it, and check result.
    A corrupted data file might also cause this kind of issue, try to repair your data file with Scanpst.exe tool.
    Please refer to this article on how to use scanpst.exe:
    http://office.microsoft.com/en-us/outlook-help/repair-outlook-data-files-pst-and-ost-HA102749454.aspx
    Please also have a look at this thread, try the workarounds in it and see if issue persists:
    http://answers.microsoft.com/en-us/office/forum/officeversion_other-outlook/constant-high-cpu-usage-when-outlook-open/b9a66791-ab73-4ecd-a73d-edf27102aa4e
    Hope this helps.
    Thanks,
    Ethan Hua CHN
    TechNet Community Support

  • High cpu usage after a while

    Sometimes, after a while, firefox (36.0.4) uses up 1 core of my CPU (is a quad core due to hypertreading). The way it happens is really strange. Many tabs without a problem until suddenly ff decides to floor it. This is alway in the run, not on startup or close. All add-ons need to ask my permissions to be activated, this includes flash.
    On close, I ordered ff to clear all history and cookies.
    Notes that could be important (The behavior encountered while using it. This varies from time to time):
    opening new tabs (a lot or a few) => "heavy" load during site loading, then idling
    ==> The above makes sense
    - same as above but load continues to be heavy. => could be some badly written javascript on the site, however, sometimes this occurs with sites I know have no stressful javascript
    ==> The above seems odd
    - Browser is idle in the background (not actively using it). Then all of the sudden "lets floor it until closed".
    ==> The above seems pretty odd
    - When confronted with high CPU usage, closing ff doesn't close it (the ff process remains active. Not a ff process, THE ff process). => High CPU usage remains
    ==> The above looks like that there is definitely something wrong here
    This last one has some other things to keep in mind
    - When it happens and I close ff, upon restarting it it will ALWAYS ask to close ff. After confirming to close it, it will start and behave normally.
    - When killing ff via the task-manager, or other means like powershell commands, restarting it will result in an idle ff even after every tab is loaded again.
    I hope this isn't a heisenbug and there is a solution to this, a reboot ff button would be a nice workaround though. I personally think that it must be some routine in the code that decides to go nuts for no reason.
    If you need further details, feel free to ask.
    Thanks in advance

    Tried those before and tried them again. Unfortunately, the problem keeps repeating itself at random times. As said, sometimes it doesn't occur and sometimes suddenly it does. Keep the following things in mind about this, what seems like a heisenbug, behavior.
    - opening new tabs (a lot or a few) => "heavy" load during site loading, then idling
    ==> The above makes sense
    - same as above but load continues to be heavy. => could be some badly written javascript on the site, however, sometimes this occurs with sites I know have no stressful javascript
    ==> The above seems odd
    - Browser is idle in the background (not actively using it). Then all of the sudden "lets floor it until closed".
    ==> The above seems pretty odd
    - When confronted with high CPU usage, closing ff doesn't close it (the ff process remains active. Not a ff process, THE ff process). => High CPU usage remains
    ==> The above looks like that there is definitely something wrong here
    As stated, a reboot ff button would be a nice workaround. I personally think that something like a tread must get stuck in some sort of infinite loop. Browsing in ff works just fine though. I just don't like the fact that I turns into a "gasoline guzzler".
    Again, thanks in advance

  • High CPU Usage on C6509

    Good day, can someone analyze this for me, in regards with high cpu usage.
    2222222222222222222222222222222222333332222244444222222222
         8888555559999955555777773333344444000007777711111555559999
    100                                                           
    90                                                           
    80                                                           
    70                                                           
    60                                                           
    50                                                           
    40                                              *****        
    30  ************************          ************************
    20  **********************************************************
    10  **********************************************************
        0....5....1....1....2....2....3....3....4....4....5....5....
                  0    5    0    5    0    5    0    5    0    5   
                   CPU% per second (last 60 seconds)
         4443333334443433334333333333333333333333343333333333333333
         1006530591135079734601132535328062177773414263667168577916
    100                                                           
    90                                                           
    80                                                           
    70                                                           
    60                                                           
    50                                                           
    40  *****  ********** **     * *  * *  ****  *  * *** ****** *
    30  #############**##*####*#*##*###*#*#########*##*****###****
    20  ##########################################################
    10  ##########################################################
        0....5....1....1....2....2....3....3....4....4....5....5....
                  0    5    0    5    0    5    0    5    0    5   
                   CPU% per minute (last 60 minutes)
                  * = maximum CPU%   # = average CPU%
         4744444545444444444444444444333344444444444444444434444444433344344444
         4547425182436632379924402500899822115303104140406471591734499730802883
    100                                                                       
    90                                                                       
    80   *                                                                   
    70   *                                                                   
    60   *                                                                   
    50   * *  ****  **   ***     *          *           *   ** *           **
    40  **********************************************************************
    30  #*******###**********##**********#********************************####
    20  ######################################################################
    10  ######################################################################
        0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
                  0    5    0    5    0    5    0    5    0    5    0    5    0
                       CPU% per hour (last 72 hours)
                      * = maximum CPU%   # = average CPU%
    Local_Backbone#sh proc cpu sorted 5sec
    CPU utilization for five seconds: 24%/16%; one minute: 27%; five minutes: 27%
    PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
    123  1380698152 938782622       1470  6.07%  6.66%  6.52%   0 IP Input        
       9    71590456 190912340        374  0.39%  0.48%  0.47%   0 ARP Input       
    213    53552228 246488976        217  0.23%  0.42%  0.48%   0 SNMP ENGINE     
    176     2804332  35409778         79  0.15%  0.02%  0.00%   0 OSPF Hello      
    319      918144  11719407         78  0.15%  0.01%  0.00%   0 OSPF Router 100 
       4         236       195       1210  0.07%  0.00%  0.00%   1 Virtual Exec    
    169     2374788   2035919       1166  0.07%  0.03%  0.00%   0 Adj Manager     
    118     5885520  15709517        374  0.07%  0.07%  0.07%   0 CDP Protocol    
      36       69788   9934569          7  0.07%  0.00%  0.00%   0 TTY Background  
    179    30669516 309965501         98  0.07%  0.23%  0.24%   0 IP SNMP
    need a quick opinion as i have another backbone abroad that uses only 5-10% of cpu usage.
    - same config
    - same setup (2BB for Sec/firewall, 2BB for Integration, 6Distro SW)
    - different number of users
    thank you and god bless.

    I also agree with Stephan that this is not a concern that the cpu you are seeing it sohuld reduce down.
    If in case still want to do the troubleshooting here is the procedure:
    Here are some of the commands you can refer while you see the high cpu:
    •1-  Show proc cpu sorted | ex 0.00%  >> First check whether CPU is due to Interrupt or due to Process Switching.
    Eg: CPU utilization for five seconds: 6%/2%; one minute: 2%; five minutes: 2%
    6% is total CPU utilization and 2 % is due to Interrupt. You would see this on a higher bit when you have the high cpu. Total-interrupt will give you the value of Process.
    More info: http://www.cisco.com/en/US/products/hw/switches/ps708/products_tech_note09186a00804916e0.shtml
    b) Show proc cpu history :---Check since how long is the CPU been affected.
    2- Check if there is any interface drops are been seen:
    show interface | include line|drops   ( Check if any vlan/interface are having input drops)
    3- check if there are any STP issue:
    show spanning tree detail
    show spann det | in ieee|from|occur|is exec
    show spann det | in executing | changes
    show interface | include line|drops
    show cef drop
    show ip traffic   >> Check the traffic utilization.
    4- There are some internal debugging which would help to find out which packets ( from Src,dst) is hitting the CPU:
    debug netdr capture rx  <<<<( DEBUG OF NETDR IS VERY USEFULL TO CHECK WHAT PACKETSS ARE COMING TO CPU)
    show netdr capture-packet  >> This will give you the captured outputs were you can see the Src and dst . Then you can take the action with those src ip address guys to check why they are punting the traffic.
    HTH
    Regards
    Inayath
    ***Plz rate if this info is helpfull.

  • DNS server process, high CPU usage

    Hello,
    I am having a problem with high CPU usage on DNS process. We have 1921 setup in network of about 100 workstations that use it as DNS server. It also performs split view functionality for couple of domains in order to avoid hairpin NAT. I know that a router is not fit for heavy server duty but such setup was unfortunately necessary.
    In peak work hours we oftenly have CPU hitting 100%  with DNS server process being the root cause,and on several occasions we had DNS process stuck in such state for prolonged periods of time during which other router functions were affected (t's a default gateway, IPsec concentrator etc.). Sometimes shutting the process and restarting it would solve the problem, but once it required a full reload in order to restore functionality (such was the description that engineer on duty reported to me).
    Forwarder queue statistics:
    Current size = 0
    Maximum size = 86
    Drops        = 0
    IOS upgrade did not help, we are currently running 15.2(2)T.
    The question is ... is such behaviour (CPU load) to be expected on LAN with 100 workstations due to slow CPU on router or we have bugged IOS DNS server (requiring a TAC case)?
    The previous solution seem to do this functionality quite nicely (even though it was also a router), so I am not inclined to think that we are dealing with someone DoS-ing the DNS (WAN access to DNS is of course forbidden)
    P.S.
    Since we moved servers off the routers DNS, we do not receive complaints, but we had a couple of unresolved messages a day while mail server was using router for DNS. I am suspecting that an old bug where IOS DNS servers occasionaly sends clients back empty DNS replies (properly formatted message but without A record) could be still around?

    hi,
    i have the same problem on UC540 and 2911 on IOS 15.0.1. CPU high, router crashed. Reboot helps but until CPU usage spikes again. the only fix is to remove "ip dns server" from config and use a different DNS server
                        111                       1111    1111111111
              999999999900077777777799999777778888000099990000000000
        322222111119999900077776666622222111119999000088880000000000
    100            ********                       ******************
     90       *************         *****     **********************
     80       ***************************     **********************
     70       ******************************************************
     60       ******************************************************
     50       ******************************************************
     40       ******************************************************
     30       ******************************************************
     20       ******************************************************
     10       ******************************************************
       0....5....1....1....2....2....3....3....4....4....5....5....6
                 0    5    0    5    0    5    0    5    0    5    0
                   CPU% per second (last 60 seconds)
    after removed IP dns server
                                           111                      
                                 99999999990007777777779999977777888
                  33333333332222211111999990007777666662222211111999
    100                               ********                      
     90                          *************         *****     ***
     80                          ***************************     ***
     70                          ***********************************
     60                          ***********************************
     50                          ***********************************
     40                          ***********************************
     30                          ***********************************
     20                          ***********************************
     10                          ***********************************
       0....5....1....1....2....2....3....3....4....4....5....5....6
                 0    5    0    5    0    5    0    5    0    5    0
                   CPU% per second (last 60 seconds)

  • SCCM 2012 R2 Linux\Unix Client High CPU Usage

    Hello,
    We have recently implemented SCCM 2012 R2 in a mixed Windows \ Solaris \ RHEL environment. The Unix\Linux client are at the SCCM 2012 R2 CU2 - Version
    5.00.7958.1024.
    A small number of system outages have occured recently on the Linux & Solaris systems. SCCM is one of several candidate causes.
    One issue we have seen on these systems is high CPU usage by ccmexed.bin
    The TOP command shows the process regulalry using more than 100% of a single CPU core.
    The PRSTAT command shows a more resonable CPU usage accross all cores.
    However, in both cases the process is using significantly more CPU resource than other systems processes - including SAP and Oracle.
    Are there any known issues\reported bugs with high CPU usage on RHEL 5 & 6 and Solaris 10 x86?
    I know CU3 for Unix\Linux has just been released and I will certainly be looking at applying that in the environment - more
    expeditiously
    if this is a recognised issue and fixed in CU3
    Regards, Chris

    Hi Chris,
    Yes, the latest Clients Clients Clients including bug fixes and added support for RHEL 7, CentOS 7, and Oracle Linux 7
    Please apply the fix and see how it goes.
    http://www.microsoft.com/en-us/download/details.aspx?id=39360
    Thanks.
    Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread.

  • Continuous Audio, Jerky Video, High CPU Usage

    Hello,
    I've been browsing the forum for a while and tried a few searches. I found some problems similar to mine, but nothing with a solution that worked. Here is my situation. I was running Windows XP Home SP3 with the latest IE, Firefox and Chrome browsers. I updated my flash player (to 10) and I hulu didn't work any more. The audio would play but the video would freeze and change to a different frame every now and then, usually a couple minutes behind the audio. I had already decided that I wanted to switch over to Ubuntu 10 so I just did a fresh install. I updated everything over night and then I tried to watch hulu using the latest firefox. I had the same problem. The audio will play, but the video freezes. I downloaded the latest Chrome. Same problem, both with high cpu usage. I am using a Dell Inspirion 2200 with 1.5 ghz cpu and 512 mb ram with integrated graphics. So far the only thing I've tried is disabling hardware acceleration. My internet connection is 1.5 mb. I would really appreciate any help.
    Thanks,
    ralphcholo

    I noticed it's the "audiodg.exe" program that is acting weird with high cpu usage.  Some tutorials say to disable 'audio enhancements' but I can't find that option available in windows 10. In device manager, I notice 2 separate audio drivers.  The Acer download page only has 1 realtek audio driver.  I'm wondering if there is supposed to be another driver to update?  My audio seems to be working fine without this problem coming back.   I've attached a screenshot showing the 2 different audio fields in device manager.  The bottom one is the driver listed on the Acer driver page, I'm not sure where the other upper audio driver is to download.

  • High cpu usage when the system is idle

    I do have a high cpu usage problem when the system is idle. I bought the laptop (lenovo x230 tablet) with windows 7 installed in it. Then upgraded to windows 8. But ever since I have problems with high cpu usage by the system even when the computer is idle.
    Only the system by itself uses around 30% of the cpu all the time. I ran xperf, and here is the result of it:
    http://sdrv.ms/Kj6CFN
    I appreciate any help you can provide.
    Thanks,

    Hi,
    I'm sorry for that the log you provide can't be opened on my computer. While according to your description, it should had a special process that consume CPU usage when system idle Iguess, isn't it?
    You can use
    Process Explorer to monitor the process activity, may be we can find the reason of this problem.
    Note: We can use Process Explorer to check the Stack of every process then analyize the problem in deep.
    To gave a better insight about this problem, you can take a ScreenShot for this problem and provide the picture here.
    Roger Lu
    TechNet Community Support

  • Opera and high cpu usage

    Hello all!
    I have this annoying problem with opera.
    After 1-2 hours of running opera cpu usage jumps to about 60-80%. To stop this I have to close opera and restart it.
    I mostly have about 30+ tabs opened, but this shouldn't affect the cpu usage. It didn't in the past. I used the opera-devel-qt4 (10.20_4744-1) package from AUR and now I switched back to the "default" opera (10.10-2) package.
    This started some days ago, and i cannot find out what causes this.
    Any suggestions?
    Vlad
    Last edited by DonVla (2010-01-07 22:37:58)

    I have no plugins running and killed the wrapper.
    However it worked fine for the most time. I noticed opera has a higher usage than firefox. But now it's barely usable. Every 3-5 hours I have to stop and then restart opera. With the bundled version it's a little better. But it still freezes for some seconds with high cpu usage.

  • Kswapd0 almost constant high CPU usage

    Hello,
    On my Eagle M2, I see kswapd0 using almost constant 50% CPU usage with the latest AOSP.
    Can this be related to the big battery drain I'm having? An older AOSP build (end of march with another 3.10 kernel branch) does not have this kswapd0 issue and has a far better battery life.
    PID PR CPU% S #THR VSS RSS PCY UID Name
    79 1 50% R 1 0K 0K fg root kswapd0
    This post reports similar issues but is of an older kernel (so probably not related): http://forum.xda-developers.com/general/rooting-roms/fix-kswapd0-cpu-usage-problem-t2845239 Is there a parameter somewhere not set right?I even tried compiling a kernel with CONFIG_SWAP=n but kswapd0 is still there :-(
    br

    Hello, it seems reverting https://github.com/sonyxperiadev/device-sony-eagle/commit/07b30b728766c248c1d5555417d5e92271781f88 "solves" the kswapd high CPU usage! (I removed "BOARD_KERNEL_CMDLINE += mem=883M" from BoardConfig.mk) The battery life seems better now, but still not as good when comparing with the march build. best regards

  • Config Manager Agent - after Hardware Inventory High CPU Usage with WMIPRSVE and very fast empty Battery

    Hi there,
    since a few days there is on some machines (40-60) a high cpu usage on one core (quad core cpu machines) with the WMIPRSVE.EXE if the HARDWARE INVENTORY CYCLE started.
    i try out some tests, read some forum articles and troubleshooting the WMI management but a real problem i doesn´t see.
    in some articles i read that hardware inventory runs about minutes up to more hours but some machines runs longer, someone more as 1 day.
    here an example of mine PC:
    at 8:07 i started Hardware Inventory Cycle, in the InventoryAgent.log i can see that some Collection Namespace are captured.
    after a few minutes there stopped and does nothing round about 5.9 hours or better, after 21436.097 Seconds.
    For any hints i am grateful. :)
    Inventory: *********************** Start of message processing. ***********************
    InventoryAgent 18.03.2015 08:09:56
    11088 (0x2B50)
    Inventory: Message type is InventoryAction InventoryAgent
    18.03.2015 08:09:56 11088 (0x2B50)
    Inventory: Temp directory = C:\WINDOWS\CCM\Inventory\Temp\
    InventoryAgent 18.03.2015 08:09:56
    11088 (0x2B50)
    Inventory: Clearing old collected files. InventoryAgent
    18.03.2015 08:09:56 11088 (0x2B50)
    Inventory: Opening store for action {00000000-0000-0000-0000-000000000001} ...
    InventoryAgent 18.03.2015 08:09:56
    11088 (0x2B50)
    CInvState::VerifyInventoryVersionNumber: Mismatch found for '{00000000-0000-0000-0000-000000000001}': 4.2 vs. 0.0
    InventoryAgent 18.03.2015 08:09:56
    11088 (0x2B50)
    Inventory: Version number mismatch; will do a Full report.
    InventoryAgent 18.03.2015 08:09:56
    11088 (0x2B50)
    Inventory: Action=Hardware, ReportType=ReSync, MajorVersion=5, MinorVersion=0
    InventoryAgent 18.03.2015 08:09:56
    11088 (0x2B50)
    Inventory: Initialization completed in 0.141 seconds
    InventoryAgent 18.03.2015 08:09:56
    11088 (0x2B50)
    Collection: Namespace = \\localhost\root\Microsoft\appvirt\client; Query = SELECT __CLASS, __PATH, __RELPATH, CachedLaunchSize, CachedPercentage, CachedSize, LaunchSize, Name, PackageGUID, TotalSize, Version, VersionGUID FROM Package; Timeout = 600 secs.
    InventoryAgent 18.03.2015 08:09:56
    7836 (0x1E9C)
    Failed to get IWbemService Ptr for \\localhost\root\vm\VirtualServer Namespace: 8004100E
    InventoryAgent 18.03.2015 08:10:02
    7836 (0x1E9C)
    Failed to enumerate instances of VirtualMachine: 8004100E
    InventoryAgent 18.03.2015 08:10:02
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\cimv2\sms; Query = SELECT __CLASS, __PATH, __RELPATH, AddressWidth, BrandID, CPUHash, CPUKey, DataWidth, DeviceID, Family, Is64Bit, IsHyperthreadCapable, IsMobile, IsTrustedExecutionCapable, IsVitualizationCapable, Manufacturer,
    MaxClockSpeed, Name, NormSpeed, NumberOfCores, NumberOfLogicalProcessors, PCache, ProcessorId, ProcessorType, Revision, SocketDesignation, Status, SystemName, Version FROM SMS_Processor; Timeout = 600 secs.
    InventoryAgent 18.03.2015 08:10:02
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\CCM\powermanagementagent; Query = SELECT __CLASS, __PATH, __RELPATH, Requester, RequesterInfo, RequesterType, RequestType, Time, UnknownRequester FROM CCM_PwrMgmtLastSuspendError; Timeout = 600 secs.
    InventoryAgent 18.03.2015 08:10:03
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, Availability, Description, DeviceID, Manufacturer, Name, Status FROM Win32_IDEController; Timeout = 600 secs.
    InventoryAgent 18.03.2015 08:10:03
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\cimv2\sms; Query = SELECT __CLASS, __PATH, __RELPATH, BinFileVersion, BinProductVersion, Description, ExecutableName, FilePropertiesHash, FilePropertiesHashEx, FileSize, FileVersion, HasPatchAdded, InstalledFilePath, IsSystemFile,
    IsVitalFile, Language, Product, ProductCode, ProductVersion, Publisher FROM SMS_InstalledExecutable; Timeout = 600 secs.
    InventoryAgent 18.03.2015 08:10:03
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, DefaultIPGateway, DHCPEnabled, DHCPServer, DNSDomain, DNSHostName, Index, IPAddress, IPEnabled, IPSubnet, MACAddress, ServiceName FROM Win32_NetworkAdapterConfiguration; Timeout
    = 600 secs. InventoryAgent
    18.03.2015 14:06:43 7836 (0x1E9C)
    Collection: Namespace = \\.\root\Nap; Query = SELECT __CLASS, __PATH, __RELPATH, description, fixupState, friendlyName, id, infoClsid, isBound, percentage, registrationDate, vendorName, version FROM NAP_SystemHealthAgent; Timeout = 600 secs.
    InventoryAgent 18.03.2015 14:06:43
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\cimv2\sms; Query = SELECT __CLASS, __PATH, __RELPATH, AdditionalProductCodes, CompanyName, ExplorerFileName, FileDescription, FilePropertiesHash, FileSize, FileVersion, FolderPath, LastUsedTime, LastUserName, msiDisplayName,
    msiPublisher, msiVersion, OriginalFileName, ProductCode, ProductLanguage, ProductName, ProductVersion, SoftwarePropertiesHash FROM CCM_RecentlyUsedApps; Timeout = 600 secs.
    InventoryAgent 18.03.2015 14:06:43
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, BankLabel, Capacity, Caption, CreationClassName, DataWidth, Description, DeviceLocator, FormFactor, HotSwappable, InstallDate, InterleaveDataDepth, InterleavePosition, Manufacturer,
    MemoryType, Model, Name, OtherIdentifyingInfo, PartNumber, PositionInRow, PoweredOn, Removable, Replaceable, SerialNumber, SKU, Speed, Status, Tag, TotalWidth, TypeDetail, Version FROM Win32_PhysicalMemory; Timeout = 600 secs.
    InventoryAgent 18.03.2015 14:07:02
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, Availability, Description, DeviceID, InstallDate, Manufacturer, Name, PNPDeviceID, ProductName, Status FROM Win32_SoundDevice; Timeout = 600 secs.
    InventoryAgent 18.03.2015 14:07:02
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, Caption, ClassGuid, ConfigManagerErrorCode, ConfigManagerUserConfig, CreationClassName, Description, DeviceID, Manufacturer, Name, PNPDeviceID, Service, Status, SystemCreationClassName,
    SystemName FROM Win32_USBDevice; Timeout = 600 secs.
    InventoryAgent 18.03.2015 14:07:12
    7836 (0x1E9C)
    Collection: 62/74 inventory data items successfully inventoried.
    InventoryAgent 18.03.2015 14:07:12
    7836 (0x1E9C)
    Inventory: Collection Task completed in 21436.097 seconds
    InventoryAgent 18.03.2015 14:07:12
    7836 (0x1E9C)
    Inventory: 12 Collection Task(s) failed. InventoryAgent
    18.03.2015 14:07:12 7836 (0x1E9C)
    Inventory: Temp report = C:\WINDOWS\CCM\Inventory\Temp\25bf01b2-12fc-4eea-8e97-a51b3c75ba50.xml
    InventoryAgent 18.03.2015 14:07:12
    7836 (0x1E9C)
    Inventory: Starting reporting task. InventoryAgent
    18.03.2015 14:07:12 7552 (0x1D80)
    Reporting: 4381 report entries created. InventoryAgent
    18.03.2015 14:07:13 7552 (0x1D80)
    Inventory: Reporting Task completed in 1.030 seconds
    InventoryAgent 18.03.2015 14:07:13
    7552 (0x1D80)
    Inventory: Successfully sent report. Destination:mp:MP_HinvEndpoint, ID: {5541A94A-BED9-4132-AE54-110CB6896F02}, Timeout: 80640 minutes MsgMode: Signed, Not Encrypted
    InventoryAgent 18.03.2015 14:07:13
    7552 (0x1D80)
    Inventory: Cycle completed in 21453.570 seconds
    InventoryAgent 18.03.2015 14:07:30
    7552 (0x1D80)
    Inventory: Action completed. InventoryAgent
    18.03.2015 14:07:30 7552 (0x1D80)
    Inventory: ************************ End of message processing. ************************
    InventoryAgent 18.03.2015 14:07:30
    7552 (0x1D80)
    Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, Caption, ClassGuid, ConfigManagerErrorCode, ConfigManagerUserConfig, CreationClassName, Description, DeviceID, Manufacturer, Name, PNPDeviceID, Service, Status, SystemCreationClassName,
    SystemName FROM Win32_USBDevice; Timeout = 600 secs.
    InventoryAgent 18.03.2015 14:07:12
    7836 (0x1E9C)
    Collection: 62/74 inventory data items successfully inventoried.
    InventoryAgent 18.03.2015 14:07:12
    7836 (0x1E9C)
    Inventory: Collection Task completed in 21436.097 seconds
    InventoryAgent 18.03.2015 14:07:12
    7836 (0x1E9C)
    Inventory: 12 Collection Task(s) failed. InventoryAgent
    18.03.2015 14:07:12 7836 (0x1E9C)
    Inventory: Temp report = C:\WINDOWS\CCM\Inventory\Temp\25bf01b2-12fc-4eea-8e97-a51b3c75ba50.xml
    InventoryAgent 18.03.2015 14:07:12
    7836 (0x1E9C)
    Inventory: Starting reporting task. InventoryAgent
    18.03.2015 14:07:12 7552 (0x1D80)
    Reporting: 4381 report entries created. InventoryAgent
    18.03.2015 14:07:13 7552 (0x1D80)
    Inventory: Reporting Task completed in 1.030 seconds
    InventoryAgent 18.03.2015 14:07:13
    7552 (0x1D80)
    Inventory: Successfully sent report. Destination:mp:MP_HinvEndpoint, ID: {5541A94A-BED9-4132-AE54-110CB6896F02}, Timeout: 80640 minutes MsgMode: Signed, Not Encrypted
    InventoryAgent 18.03.2015 14:07:13
    7552 (0x1D80)
    Inventory: Cycle completed in 21453.570 seconds
    InventoryAgent 18.03.2015 14:07:30
    7552 (0x1D80)
    Inventory: Action completed. InventoryAgent
    18.03.2015 14:07:30 7552 (0x1D80)
    Inventory: ************************ End of message processing. ************************
    InventoryAgent 18.03.2015 14:07:30
    7552 (0x1D80)

    InventoryAgent 18.03.2015 08:10:03
    7836 (0x1E9C)
    Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, DefaultIPGateway, DHCPEnabled, DHCPServer, DNSDomain, DNSHostName, Index, IPAddress, IPEnabled, IPSubnet, MACAddress, ServiceName FROM Win32_NetworkAdapterConfiguration; Timeout
    = 600 secs. InventoryAgent
    18.03.2015 14:06:43 7836 (0x1E9C)
    Collection: Namespace = \\.\root\Nap; Query = SELECT __CLASS, __PATH, __RELPATH, description, fixupState, friendlyName, id, infoClsid, isBound, percentage, registrationDate, vendorName, version FROM NAP_SystemHealthAgent; Timeout = 600 secs.
    InventoryAgent 18.03.2015 14:06:43
    7836 (0x1E9C)
    Looks like something in one or both of those wmi queries.  it goes from 8:10:03 to 14:06:43 right around there.  6 hours to do that... 
    try running those queries from wbemtest manually; and see which one just never finishes.
    Standardize. Simplify. Automate.

  • High CPU usage with Coherence 3.5.0 cluster node

    We're noticing sustained high CPU usage on one of our Coherence nodes - this happens after running a job that pretty intensively interacts with the cache. The jobs complete, however we still see the Coherence process using approximately the equivalent of one core's worth of CPU. I took a couple of thread dumps about fifteen minutes apart, and the only noticeable differences are within the PacketListener1 and PacketListenerN threads - they're holding locks on different DatagramPacket instances, which suggests to be that this may be the piece of code that is looping.
    There are two other cache nodes in this particular cluster - both of them on a different machine - and neither of them are exhibiting the same CPU utilization.
    Environment:
    Coherence 3.5.0
    Java - BEA JRockit(R) (build R27.6.3-40_o-112056-1.6.0_11-20090318-2103-linux-x86_64, compiled mode)
    Has anyone encountered this scenario before?
    Here's a copy of the two thread dumps:
    Thread Dump 1 -
    ===== FULL THREAD DUMP ===============
    Thu Feb 24 21:45:00 2011
    BEA JRockit(R) R27.6.3-40_o-112056-1.6.0_11-20090318-2103-linux-x86_64
    "Main Thread" id=1 idx=0x4 tid=18143 prio=5 alive, in native, waiting
    -- Waiting for notification on: java/lang/Class@0x43587b58[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/net/DefaultCacheServer.main(DefaultCacheServer.java:80)
    ^-- Lock released while waiting: java/lang/Class@0x43587b58[fat lock]
    at com/zzzz/carbon/cacheserver/ZzzzCoherenceServerStartup.doWork(ZzzzCoherenceServerStartup.java:29)
    at com/zzzz/util/runner/ZzzzRunnerBase.run(ZzzzRunnerBase.java:23)
    at com/zzzz/carbon/cacheserver/ZzzzCoherenceServerStartup.main(ZzzzCoherenceServerStartup.java:16)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "(Signal Handler)" id=2 idx=0x8 tid=18144 prio=5 alive, in native, daemon
    "(GC Main Thread)" id=3 idx=0xc tid=18145 prio=5 alive, in native, daemon
    "(GC Worker Thread 1)" id=? idx=0x10 tid=18146 prio=5 alive, in native, daemon
    "(GC Worker Thread 2)" id=? idx=0x14 tid=18147 prio=5 alive, in native, daemon
    "(GC Worker Thread 3)" id=? idx=0x18 tid=18148 prio=5 alive, in native, daemon
    "(GC Worker Thread 4)" id=? idx=0x1c tid=18149 prio=5 alive, in native, daemon
    "(Code Generation Thread 1)" id=4 idx=0x20 tid=18150 prio=5 alive, in native, native_waiting, daemon
    "(Code Optimization Thread 1)" id=5 idx=0x24 tid=18151 prio=5 alive, in native, native_waiting, daemon
    "(VM Periodic Task)" id=6 idx=0x28 tid=18152 prio=10 alive, in native, daemon
    "Finalizer" id=7 idx=0x2c tid=18153 prio=8 alive, in native, native_waiting, daemon
    at jrockit/memory/Finalizer.waitForFinalizees([Ljava/lang/Object;)I(Native Method)
        at jrockit/memory/Finalizer.access$500(Finalizer.java:12)
        at jrockit/memory/Finalizer$4.run(Finalizer.java:159)
        at java/lang/Thread.run(Thread.java:619)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "Reference Handler" id=8 idx=0x30 tid=18154 prio=10 alive, in native, native_waiting, daemon
        at java/lang/ref/Reference.waitForActivatedQueue()Ljava/lang/ref/Reference;(Native Method)
        at java/lang/ref/Reference.access$100(Reference.java:11)
        at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:79)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "(Sensor Event Thread)" id=9 idx=0x34 tid=18155 prio=5 alive, in native, daemon
    "Logger@9217551 3.5/459" id=12 idx=0x38 tid=18158 prio=3 alive, in native, waiting, daemon
        -- Waiting for notification on: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x4e1faef8[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x4e1faef8[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketListener1" id=14 idx=0x3c tid=18159 prio=8 alive, in native, daemon
    at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
    ^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb21360[recursive]
    at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)[inlined]
    at java/net/DatagramSocket.receive(DatagramSocket.java:712)[optimized]
    ^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb21360[thin lock]
    ^-- Holding lock: java/net/DatagramPacket@0x73aa4e80[thin lock]
    ^-- Holding lock: java/net/DatagramSocket@0x4cb21338[thin lock]
    at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:20)[optimized]
    at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:4)[optimized]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:19)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketReceiver" id=15 idx=0x40 tid=18160 prio=7 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x4cf60d58[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketReceiver.onWait(PacketReceiver.CDB:2)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x4cf60d58[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketPublisher" id=16 idx=0x44 tid=18161 prio=6 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketPublisher.onWait(PacketPublisher.CDB:2)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
    ^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketSpeaker" id=17 idx=0x48 tid=18162 prio=8 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x4cabe9d8[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/queue/ConcurrentQueue.waitForEntry(ConcurrentQueue.CDB:16)
    ^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x4cabe9d8[fat lock]
    at com/tangosol/coherence/component/util/queue/ConcurrentQueue.remove(ConcurrentQueue.CDB:7)
    at com/tangosol/coherence/component/util/Queue.remove(Queue.CDB:1)
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketSpeaker.onNotify(PacketSpeaker.CDB:62)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketListenerN" id=18 idx=0x4c tid=18163 prio=8 alive, in native, daemon
    at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
    ^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb221b0[recursive]
    at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)[inlined]
    at java/net/DatagramSocket.receive(DatagramSocket.java:712)[optimized]
    ^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb221b0[thin lock]
    ^-- Holding lock: java/net/DatagramPacket@0x73e59890[thin lock]
    ^-- Holding lock: java/net/MulticastSocket@0x4cb22178[thin lock]
    at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:20)[optimized]
    at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:4)[optimized]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:19)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "Cluster|Member(Id=2, Timestamp=2011-02-23 16:25:36.488, Address=10.10.100.77:8095, MachineId=25677, Location=site:emtzzzz.com,machine:njdev04,process:18142,member:cldev201~carboncachelauncher~181)" id=19 idx=0x50 tid=18164 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4cac64d8[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4cac64d8[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "TcpRingListener" id=20 idx=0x54 tid=18165 prio=6 alive, in native, daemon
    at java/net/PlainSocketImpl.socketAccept(Ljava/net/SocketImpl;)V(Native Method)
    at java/net/PlainSocketImpl.accept(PlainSocketImpl.java:384)
    ^-- Holding lock: java/net/SocksSocketImpl@0x4cb227d8[thin lock]
    at java/net/ServerSocket.implAccept(ServerSocket.java:453)
    at java/net/ServerSocket.accept(ServerSocket.java:421)
    at com/tangosol/coherence/component/net/socket/TcpSocketAccepter.accept(TcpSocketAccepter.CDB:18)
    at com/tangosol/coherence/component/util/daemon/TcpRingListener.acceptConnection(TcpRingListener.CDB:10)
    at com/tangosol/coherence/component/util/daemon/TcpRingListener.onNotify(TcpRingListener.CDB:9)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "Invocation:Management:EventDispatcher" id=22 idx=0x58 tid=18166 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x4ab76140[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x4ab76140[fat lock]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher.onWait(Service.CDB:7)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "Invocation:Management" id=23 idx=0x5c tid=18167 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4ab75508[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4ab75508[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "DistributedCache" id=25 idx=0x60 tid=18168 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4a3869b0[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4a3869b0[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    ===== END OF THREAD DUMP ===============
    Thread Dump 2 -
    ===== FULL THREAD DUMP ===============
    Thu Feb 24 21:27:53 2011
    BEA JRockit(R) R27.6.3-40_o-112056-1.6.0_11-20090318-2103-linux-x86_64
    "Main Thread" id=1 idx=0x4 tid=18143 prio=5 alive, in native, waiting
    -- Waiting for notification on: java/lang/Class@0x43587b58[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/net/DefaultCacheServer.main(DefaultCacheServer.java:80)
    ^-- Lock released while waiting: java/lang/Class@0x43587b58[fat lock]
    at com/zzzz/carbon/cacheserver/ZzzzCoherenceServerStartup.doWork(ZzzzCoherenceServerStartup.java:29)
    at com/zzzz/util/runner/ZzzzRunnerBase.run(ZzzzRunnerBase.java:23)
    at com/zzzz/carbon/cacheserver/ZzzzCoherenceServerStartup.main(ZzzzCoherenceServerStartup.java:16)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "(Signal Handler)" id=2 idx=0x8 tid=18144 prio=5 alive, in native, daemon
    "(GC Main Thread)" id=3 idx=0xc tid=18145 prio=5 alive, in native, native_waiting, daemon
    "(GC Worker Thread 1)" id=? idx=0x10 tid=18146 prio=5 alive, in native, daemon
    "(GC Worker Thread 2)" id=? idx=0x14 tid=18147 prio=5 alive, in native, daemon
    "(GC Worker Thread 3)" id=? idx=0x18 tid=18148 prio=5 alive, in native, daemon
    "(GC Worker Thread 4)" id=? idx=0x1c tid=18149 prio=5 alive, in native, daemon
    "(Code Generation Thread 1)" id=4 idx=0x20 tid=18150 prio=5 alive, in native, native_waiting, daemon
    "(Code Optimization Thread 1)" id=5 idx=0x24 tid=18151 prio=5 alive, in native, native_waiting, daemon
    "(VM Periodic Task)" id=6 idx=0x28 tid=18152 prio=10 alive, in native, daemon
    "Finalizer" id=7 idx=0x2c tid=18153 prio=8 alive, in native, native_waiting, daemon
    at jrockit/memory/Finalizer.waitForFinalizees([Ljava/lang/Object;)I(Native Method)
        at jrockit/memory/Finalizer.access$500(Finalizer.java:12)
        at jrockit/memory/Finalizer$4.run(Finalizer.java:159)
        at java/lang/Thread.run(Thread.java:619)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "Reference Handler" id=8 idx=0x30 tid=18154 prio=10 alive, in native, native_waiting, daemon
        at java/lang/ref/Reference.waitForActivatedQueue()Ljava/lang/ref/Reference;(Native Method)
        at java/lang/ref/Reference.access$100(Reference.java:11)
        at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:79)
        at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
        -- end of trace
    "(Sensor Event Thread)" id=9 idx=0x34 tid=18155 prio=5 alive, in native, daemon
    "Logger@9217551 3.5/459" id=12 idx=0x38 tid=18158 prio=3 alive, in native, waiting, daemon
        -- Waiting for notification on: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x4e1faef8[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x4e1faef8[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketListener1" id=14 idx=0x3c tid=18159 prio=8 alive, in native, daemon
    at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
    ^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb21360[recursive]
    at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)[inlined]
    at java/net/DatagramSocket.receive(DatagramSocket.java:712)[optimized]
    ^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb21360[thin lock]
    ^-- Holding lock: java/net/DatagramPacket@0x73a80930[thin lock]
    ^-- Holding lock: java/net/DatagramSocket@0x4cb21338[thin lock]
    at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:20)[optimized]
    at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:4)[optimized]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:19)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketReceiver" id=15 idx=0x40 tid=18160 prio=7 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x4cf60d58[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketReceiver.onWait(PacketReceiver.CDB:2)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x4cf60d58[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketPublisher" id=16 idx=0x44 tid=18161 prio=6 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketPublisher.onWait(PacketPublisher.CDB:2)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
    ^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketSpeaker" id=17 idx=0x48 tid=18162 prio=8 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x4cabe9d8[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/queue/ConcurrentQueue.waitForEntry(ConcurrentQueue.CDB:16)
    ^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x4cabe9d8[fat lock]
    at com/tangosol/coherence/component/util/queue/ConcurrentQueue.remove(ConcurrentQueue.CDB:7)
    at com/tangosol/coherence/component/util/Queue.remove(Queue.CDB:1)
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketSpeaker.onNotify(PacketSpeaker.CDB:62)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "PacketListenerN" id=18 idx=0x4c tid=18163 prio=8 alive, in native, daemon
    at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
    ^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb221b0[recursive]
    at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)[inlined]
    at java/net/DatagramSocket.receive(DatagramSocket.java:712)[optimized]
    ^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb221b0[thin lock]
    ^-- Holding lock: java/net/DatagramPacket@0x5e55a240[thin lock]
    ^-- Holding lock: java/net/MulticastSocket@0x4cb22178[thin lock]
    at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:20)[optimized]
    at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:4)[optimized]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:19)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "Cluster|Member(Id=2, Timestamp=2011-02-23 16:25:36.488, Address=10.10.100.77:8095, MachineId=25677, Location=site:emtzzzz.com,machine:njdev04,process:18142,member:cldev201~carboncachelauncher~181)" id=19 idx=0x50 tid=18164 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4cac64d8[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4cac64d8[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "TcpRingListener" id=20 idx=0x54 tid=18165 prio=6 alive, in native, daemon
    at java/net/PlainSocketImpl.socketAccept(Ljava/net/SocketImpl;)V(Native Method)
    at java/net/PlainSocketImpl.accept(PlainSocketImpl.java:384)
    ^-- Holding lock: java/net/SocksSocketImpl@0x4cb227d8[thin lock]
    at java/net/ServerSocket.implAccept(ServerSocket.java:453)
    at java/net/ServerSocket.accept(ServerSocket.java:421)
    at com/tangosol/coherence/component/net/socket/TcpSocketAccepter.accept(TcpSocketAccepter.CDB:18)
    at com/tangosol/coherence/component/util/daemon/TcpRingListener.acceptConnection(TcpRingListener.CDB:10)
    at com/tangosol/coherence/component/util/daemon/TcpRingListener.onNotify(TcpRingListener.CDB:9)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "Invocation:Management:EventDispatcher" id=22 idx=0x58 tid=18166 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x4ab76140[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x4ab76140[fat lock]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher.onWait(Service.CDB:7)
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "Invocation:Management" id=23 idx=0x5c tid=18167 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4ab75508[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4ab75508[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    "DistributedCache" id=25 idx=0x60 tid=18168 prio=5 alive, in native, waiting, daemon
    -- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4a3869b0[fat lock]
    at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
    at java/lang/Object.wait(J)V(Native Method)[optimized]
    at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
    at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
    ^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4a3869b0[fat lock]
    at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
    at java/lang/Thread.run(Thread.java:619)
    at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
    -- end of trace
    ===== END OF THREAD DUMP ===============

    Charlie, Cameron,
    Thanks for following up. To answer Cameron's question - yes, running top shows that it is this process using a significant amount of the CPU. I captured a JRA this morning setting nativesamples=true.
    I see the following when I look at the Hot Methods - let me know if there is something else that would shed some more light on this issue.
    Method     Percent(%)     #Samples     Optimized     Native     Method Id.
    libjvm.so#mmDetGcFollowReferencesWorkers     28.575     2,062     0     1     0x2AE6B82EC2C1
    libpthread.so.0#__recvfrom_nocancel     26.012     1,877     0     1     0x3CC1A0D689
    libpthread.so.0#__accept_nocancel     26.012     1,877     0     1     0x3CC1A0D4A9
    libjvm.so#mmBalanceGetReference     4.975     359     0     1     0x2AE6B817A65B
    libjvm.so#objIterStepFieldFromBitmaskWord     4.753     343     0     1     0x2AE6B82A6B34
    libjvm.so#objIterStep     3.88     280     0     1     0x2AE6B82A6F8D
    libjvm.so#objIterInitInner     2.744     198     0     1     0x2AE6B82A71B7
    libjvm.so#mmBalanceStoreReference     1.414     102     0     1     0x2AE6B817A781
    libjvm.so#objIterSetupFields     0.637     46     0     1     0x2AE6B82A6B08
    libjvm.so#nativeInnerLockNotLinked     0.236     17     0     1     0x2AE6B829DE76
    libjvm.so#mmWorkPacketPoolGet     0.125     9     0     1     0x2AE6B817A4F5
    libjvm.so#qBitSetIsBitSetInWord     0.069     5     0     1     0x2AE6B82C8AA6
    libjvm.so#nativeInnerUnlockNotLinked     0.069     5     0     1     0x2AE6B829E028
    libjvm.so#mmWorkPacketPoolAdd     0.042     3     0     1     0x2AE6B817A48E
    libjvm.so#objPoolMarkAllHard     0.042     3     0     1     0x2AE6B82A4923
    libjvm.so#objIterSetupArray     0.028     2     0     1     0x2AE6B82A6BDB
    libjvm.so#markAcquired     0.028     2     0     1     0x2AE6B829DBD3
    libjvm.so#mmPointerMatrixTryInsertAtIndex     0.028     2     0     1     0x2AE6B82BEFEB
    libjvm.so#mmPointerMatrixClear     0.028     2     0     1     0x2AE6B82BF61C
    libjvm.so#objPoolMarkWeakConcurrently     0.028     2     0     1     0x2AE6B82A5358
    libjvm.so#qBitSetFindFirstNonClearedWord     0.014     1     0     1     0x2AE6B82C888E
    libjvm.so#utilCounterToNanos     0.014     1     0     1     0x2AE6B8313B53
    libjvm.so#waitForLockIfNeededAndMarkAcquired     0.014     1     0     1     0x2AE6B829DC30
    libjvm.so#vmtLinkData     0.014     1     0     1     0x2AE6B8325B2E
    libjvm.so#mmBitsIsObjectMarkedGrey     0.014     1     0     1     0x2AE6B82ED7E9
    libjvm.so#qBitSetFindLastSetBitInWord     0.014     1     0     1     0x2AE6B82C8854
    libjvm.so#mark_writebarriers     0.014     1     0     1     0x2AE6B8250EEA
    libjvm.so#signalNextInLockQueueIfNeeded     0.014     1     0     1     0x2AE6B829DF52
    libjvm.so#mmGetUsingMatrixes     0.014     1     0     1     0x2AE6B819F33C
    libjvm.so#ptGetThreadId     0.014     1     0     1     0x2AE6B82BD9ED
    libc.so.6#memset     0.014     1     0     1     0x3CC0A7A000
    libjvm.so#setupNodeForSelf     0.014     1     0     1     0x2AE6B829DD87
    libc.so.6#_int_free     0.014     1     0     1     0x3CC0A714E0
    libjvm.so#mmAddChunkToList     0.014     1     0     1     0x2AE6B830977C
    libjvm.so#vmtiUnlinkData     0.014     1     0     1     0x2AE6B8325B4A
    libjvm.so#nativeLockInSuspendCritical     0.014     1     0     1     0x2AE6B829E0E3
    libjvm.so#mmSweepHeapPart     0.014     1     0     1     0x2AE6B830989A
    libjvm.so#mmBalanceWorkSetSwapPackets     0.014     1     0     1     0x2AE6B817A647
    libc.so.6#_int_malloc     0.014     1     0     1     0x3CC0A71E80
    libjvm.so#charToJlcType     0.014     1     0     1     0x2AE6B8253633
    unknown#unknown functions     0     0     0     1     0x2AE6B8597090
    Running with nativemethods=false, I see the following under hot methods
    Method     Percent(%)     #Samples     Optimized     Native     Method Id.
    jrockit.vm.Locks.monitorExitSecondStage(Object)     50     1     1     0     0x161D30D0
    com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.ClusterService.onNotify()     50     1     1     0     0x169D2C70
    com.tangosol.coherence.component.util.daemon.queueProcessor.packetProcessor.PacketReceiver.onNotify()     0     0     1     0     0x1551C050
    com.tangosol.coherence.component.util.queue.ConcurrentQueue.checkFlush(int)     0     0     1     0     0x151C2180
    java.lang.Thread.run()     0     0     0     0     0x14E98EB0
    jrockit.vm.RNI.c2java(long, long, long, long, long)     0     0     0     0     0x14C07830
    unknown#unknown functions     0     0     0     1     0x2AE6B8597090
    com.tangosol.coherence.component.util.Daemon.run()     0     0     0     0     0x15CFEBC0
    com.tangosol.coherence.component.util.queue.ConcurrentQueue.add(Object)     0     0     1     0     0x15ED6B00
    com.tangosol.coherence.component.util.queue.ConcurrentQueue.onAddElement()     0     0     1     0     0x151C9C20
    com.tangosol.coherence.component.util.queue.ConcurrentQueue.flush(boolean)     0     0     1     0     0x1618CAD0
    Thanks,
    Jason

Maybe you are looking for

  • Touchpad hot-keys don't work after installing Wii XP on Satellite A200-1HV

    Synaptics hot-keys after installing WinXp doesn't work. http://i043.radikal.ru/0805/c5/09a7324bc1d2.jpg On Vista i touch "Two arrows" touchpad lite up blue colour but now this does not happen. I installed driver from Toshiba web-site for Win XP. How

  • Is  there any parameter in the XI messgae in the IE that remains constant

    i m trying to trace an error in the sxmb_moni, for a JDBC-XI-Proxy scenario, in the XI message that i can see in the SXMB_moni of XI, is there any parameter that reamins constant or that i can relate with the message when the message reaches receiver

  • Help Required in full outer Join

    I feel the below query can be changed to full outer join. But, I've not been able to do so. I require your help in changing it to full outer join. My current query is SELECT CLAIMNO,'1' INDX FROM D_CLAIM@CMS2PROD WHERE clntsys=76500 and facility=7650

  • Reading attachments from adobe interactive form

    Hi, My requirement is- vendor should fill all the detail in an offline interactive form and attach necessary documents in the form itself. How can i read the attachments from the form inside my program and how can i store it in SAP. I am using FM ' S

  • Crisis of developer 2000

    I have a database designed for Oracle 8.0.3 using OO methodology. Which means i have used nested table / varrays extensively. now that i'm ready with database i can't use forms 5.0 / reports 3.0 to build application as its not recognised. How do i pr