Constant SBBOD with high cpu usage
Hi
since a couple of days ago I constantly get the SBBOD (spinning beach ball of death) on a Mac mini 2011 with Lion 10.7.3.
The system hangs up completely and the only this I can do is click around and move the windows but the clicks don't do anything and at some point after that everything just stops responding.
At this point I'm forced to do a hard reboot (power switch).
After that the system works for a while and then gets the SBBOD again.
During the SBBOD I can see syslog hogging all my cpu usage in activity monitor, but when I try to kill it or click into activity monitor the programm doesn't respond.
I guessed that something else was spaming syslogd with messages but after the hard reboot I don't see anything in console.
Since then I tried almost everything.
- hardware test, the short and long one -> nothing found
- repairing hard drive and permissions -> didn't help
- S.M.A.R.T says verified
- PRAM and NVRAM reset
- logged into guest account and started nothing -> SSBOD after ~hour
- started into save mode and left the comp running -> SSBOD after ~hour
- reformated(not zeroed) and reinstalled Lion(not from a backup) -> SSBOD after ~hour
Currently I'm trying to disable syslogd to see if some other process hogs all my cpu load instead of it.
I really hope one of you can help me, this thing is driving me nuts :/
Repairing the permissions of a home folder in Lion is a complicated procedure. I don’t know of a simpler one that always works.
Launch the Terminal application in any of the following ways:
☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
☞ Open LaunchPad. Click Utilities, then Terminal in the page that opens.
Drag or copy – do not type – the following line into the Terminal window, then press return:
chmod -R -N ~
The command will take a noticeable amount of time to run. When a new line ending in a dollar sign ($) appears below what you entered, it’s done. You may see a few error messages about an “invalid argument” while the command is running. You can ignore those. If you get an error message with the words “Permission denied,” enter this:
sudo !!
You'll be prompted for your login password, which won't be displayed when you type it. You may get a one-time warning not to screw up.
Next, boot from your recovery partition by holding down the key combination command-R at startup. Release the keys when you see a gray screen with a spinning dial.
When the recovery desktop appears, select Utilities ▹ Terminal from the menu bar.
In the Terminal window, enter “resetpassword” (without the quotes) and press return. A Reset Password window opens.
Select your boot volume if not already selected.
Select your username from the menu labeled Select the user account if not already selected.
Under Reset Home Directory Permissions and ACLs, click the Reset button.
Select ▹ Restart from the menu bar.
Similar Messages
-
Since 10.4.6 Update: "ATSServer" with high CPU-usage when opening PDFs
Since I've updated to 10.4.6 my system is very slow when I open PDFs (in "Preview" or "Acrobat").
This is caused by the process "ATSServer" which goes through every file in "~/Library/Fonts" (I have over 4.800 files there - but just a view are activated by "FontBook") and so it takes very high CPU-usage.
I didn't have this problem bevore the update and I didn't make any changes on my font settings.
I've cleaned the font cache, but it doesn't help.
Any ideas?
Ciao
Mephizo
PS: Excuse my poor English.
PowerBook G4 17'' 1.67 GHz Mac OS X (10.4.6)
PowerBook G4 17'' 1.67 GHz Mac OS X (10.4.6)I haven't noticed any change myself, Dan, but I have the 2 GHz model.
One thing I HAVE noticed though after OS updates is that they can often result in a fair amount of file and free space fragmentation immediately after installation. OSX's routines will deal with fragmentation of small files , but not of large ones (over 20 Meg), and it won't deal very effectively with free space fragmentation. If your HD is getting full this can cause significant slowdowns, especially where video is involved.
You should also run DiskUtility and check for any directory and permissions issues.
Cheers
Rod -
Having Issues with High CPU Usage with fluxbox & pekwm
Greetings,
I have searched for this issue and it seems that something similar has happened in the past with an old xorg, and it seems that someone is having a similar issue that they can point to kde as being the culrpit. However in my case, this is a fresh install and is not using any kde libs. Please allow me to explain the issue.
The power supply on my main computer finally gave out, and being incredibly poor at the moment I can not yet replace it. So, I pull out an older computer that I had once set up for my kids, but took it away from them when they were abusing it. I always make backup dvds and such monthly so I didn't have to worry about any lose of data, however I desired to keep my larger hard drives from my main computer. After testing to ensure that the hard drives were fine, I did some minor surgery, and did a fresh install of arch linux onto my back up computer. Since I prefer pekwm, I installed pekwm as my wm of choice, and outfitted it quickly with mpd+sonata, firefox, pcmanfm, and tint2. Then I rebooted into my pekwm 'desktop'.
It was running sluggish. Firefox was easily maxing the cpu up and beyond 100% and it felt ten times worse than any heavy DE I used in the past. I checked to make sure I had the right video driver installed. As this computer runs a 64MB nVidia GeForce2 MX with TV out video card, I searched nvidia's page and the arch wiki, noting that the driver needed is nvidia-96xx. Well I had already suspected that during install, and thus had installed such driver. I double checked my xorg.config and it has the right driver listed.
So I checked out some lighter browsers. I tried both Midori and Iron (which is similar to Chrome but without google spyware or whatever). Well both run better than firefox, Midori being the lightest one, but Iron quickly being my favorite. Still, the problem remained. Moving windows caused cpu spikes, opening more than one tab, or more than one program caused cpu spikes and the computer to slow down and sputter, freezing at times.
So I tried out another wm, fluxbos, which is another of my favorites. Seemed somewhat better but only fractionally, which I consider odd because pekwm has always seemed snappier than fluxbox to me in the past. Running lxtask (still mouse dependent, sorry lol), I was able to take note of the following...
FLUXBOX
lxtask 6% CPU usage average
PCManFM 5% CPU Average
Fluxbox 1% to 2% cpu usage
gksu 3% cpu usage
pidgin 3% to 7% cpu usage
firefox up to 62% cpu usage
midori up to 38% cpu usage
iron up to 50% cpu usage
mpd 11% cpu uage
Xorg (with no window movement) 2% cpu usage
Xorg (moving windows around) up to 80% cpu usage
PEKWM
lxtask 6% CPU
pidgin 7% cpu
tint2 1% cpu
pekwm 1% to 5% cpu
pcmanfm 7% cpu
firefox up to 85% cpu
python 1% cpu
midori up to 38% cpu
iron up to 25% cpu (odd...)
Xorg (with no window movement) 1% cpu
Xorg (when moving windows around) up to 80% cpu
Both were using around 118 MB RAm and weren't yet touching swap. As I see it I am thinking xorg or video driver related, yet I already made sure that I had the correct video driver. Here's my Xorg.conf
# nvidia-xconfig: X configuration file generated by nvidia-xconfig
# nvidia-xconfig: version 1.0 (buildmeister@builder63) Thu Jun 25 18:57:07 PDT 2009
Section "ServerLayout"
Identifier "Layout0"
Screen 0 "Screen0" 0 0
InputDevice "Keyboard0" "CoreKeyboard"
InputDevice "Mouse0" "CorePointer"
EndSection
Section "Files"
EndSection
Section "InputDevice"
# generated from default
Identifier "Mouse0"
Driver "mouse"
Option "Protocol" "auto"
Option "Device" "/dev/psaux"
Option "Emulate3Buttons" "no"
Option "ZAxisMapping" "4 5"
EndSection
Section "InputDevice"
# generated from default
Identifier "Keyboard0"
Driver "kbd"
EndSection
Section "Monitor"
Identifier "Monitor0"
VendorName "Unknown"
ModelName "Unknown"
HorizSync 30.0 - 110.0
VertRefresh 50.0 - 150.0
Option "DPMS"
EndSection
Section "Device"
Identifier "Device0"
Driver "nvidia"
VendorName "NVIDIA Corporation"
EndSection
Section "Screen"
Identifier "Screen0"
Device "Device0"
Monitor "Monitor0"
DefaultDepth 24
SubSection "Display"
Depth 24
Modes "1600x900" "1024x768" "800x600" "640x480"
EndSubSection
EndSection
Here's some specs on this computer, including video cards and such...
Computer
Summary
Computer
Processor Intel(R) Pentium(R) 4 CPU 1.60GHz
Memory 1034MB (239MB used)
Operating System Arch Linux
User Name mythus (Travis K. Randall)
Date/Time Thu 08 Oct 2009 05:24:52 PM CDT
Display
Resolution 1600x900 pixels
OpenGL Renderer GeForce2 MX/AGP/SSE2
X11 Vendor The X.Org Foundation
Multimedia
Audio Adapter ICH - Intel 82801BA-ICH2
Input Devices
Macintosh mouse button emulation
AT Translated Set 2 keyboard
Power Button
Power Button
PC Speaker
Logitech USB Optical Mouse
Printers
No printers found
SCSI Disks
ATA ST3160212A
ATA IC35L090AVV207-0
LITE-ON LTR-16102B
TSSTcorp CD/DVDW TS-H552D
Operating System
Version
Kernel Linux 2.6.30-ARCH (i686)
Compiled #1 SMP PREEMPT Wed Sep 9 12:37:32 UTC 2009
C Library GNU C Library version 2.10.1 (stable)
Default C Compiler GNU C Compiler version 4.4.1 (GCC)
Distribution Arch Linux
Current Session
Computer Name norova
User Name mythus (Travis K. Randall)
Home Directory /home/mythus
Desktop Environment Unknown (Window Manager: Fluxbox)
Misc
Uptime 11 hours, 38 minutes
Load Average 0.20, 0.38, 0.34
Kernel Modules
Loaded Modules
ipv6 IPv6 protocol stack for Linux
reiserfs ReiserFS journaled filesystem
usbhid USB HID core driver
hid
arc4 ARC4 Cipher Algorithm
ecb ECB block cipher algorithm
snd_seq_dummy ALSA sequencer MIDI-through client
rt2500pci Ralink RT2500 PCI & PCMCIA Wireless LAN driver.
snd_seq_oss OSS-compatible sequencer module
rt2x00pci rt2x00 pci library
snd_seq_midi_event MIDI byte <-> sequencer event coder
rt2x00lib rt2x00 library
snd_seq Advanced Linux Sound Architecture sequencer.
led_class LED Class Interface
snd_seq_device ALSA sequencer device management
input_polldev Generic implementation of a polled input device
mac80211 IEEE 802.11 subsystem
snd_intel8x0 Intel 82801AA,82901AB,i810,i820,i830,i840,i845,MX440; SiS 7012; Ali 5455
uhci_hcd USB Universal Host Controller Interface driver
snd_pcm_oss PCM OSS emulation for ALSA.
fan ACPI Fan Driver
cfg80211 wireless configuration support
ppdev
ehci_hcd USB 2.0 'Enhanced' Host Controller (EHCI) Driver
snd_mixer_oss Mixer OSS emulation for ALSA.
snd_ac97_codec Universal interface for Audio Codec '97
nvidia
lp
eeprom_93cx6 EEPROM 93cx6 chip driver
parport_pc PC-style parallel port driver
ohci1394 Driver for PCI OHCI IEEE-1394 controllers
parport
psmouse PS/2 mouse driver
ac97_bus
ieee1394
serio_raw Raw serio driver
8139too RealTek RTL-8139 Fast Ethernet driver
e100 Intel(R) PRO/100 Network Driver
snd_pcm Midlevel PCM code for ALSA.
pcspkr PC Speaker beeper driver
battery ACPI Battery Driver
8139cp RealTek RTL-8139C+ series 10/100 PCI Ethernet driver
snd_timer ALSA timer interface
i2c_core I2C-Bus main module
iTCO_wdt Intel TCO WatchDog Timer Driver
mii MII hardware support library
evdev Input driver event char devices
snd Advanced Linux Sound Architecture driver for soundcards.
ac ACPI AC Adapter Driver
iTCO_vendor_support Intel TCO Vendor Specific WatchDog Timer Driver Support
usbcore
soundcore Core sound module
sg SCSI generic (sg) driver
shpchp Standard Hot Plug PCI Controller Driver
snd_page_alloc Memory allocator for ALSA system.
processor ACPI Processor Driver
thermal ACPI Thermal Zone Driver
pci_hotplug PCI Hot Plug PCI Core
intel_agp
button ACPI Button Driver
agpgart AGP GART driver
rtc_cmos Driver for PC-style 'CMOS' RTCs
rtc_core RTC class support
rtc_lib
ext4 Fourth Extended Filesystem
mbcache Meta block cache (for extended attributes)
jbd2
crc16 CRC16 calculations
sr_mod SCSI cdrom (sr) driver
cdrom
sd_mod SCSI disk (sd) driver
ata_piix SCSI low-level driver for Intel PIIX/ICH ATA controllers
ata_generic low-level driver for generic ATA
pata_acpi SCSI low-level driver for ATA in ACPI mode
libata Library module for ATA devices
floppy
scsi_mod SCSI core
Display
Display
Display
Resolution 1600x900 pixels
Vendor The X.Org Foundation
Version 1.6.3.901
Monitors
Monitor 0 1600x900 pixels
Extensions
BIG-REQUESTS
Composite
DAMAGE
DOUBLE-BUFFER
DPMS
DRI2
GLX
Generic Event Extension
MIT-SCREEN-SAVER
MIT-SHM
NV-CONTROL
NV-GLX
RANDR
RECORD
RENDER
SECURITY
SHAPE
SYNC
X-Resource
XC-MISC
XFIXES
XFree86-DGA
XFree86-VidModeExtension
XINERAMA
XInputExtension
XKEYBOARD
XTEST
XVideo
OpenGL
Vendor NVIDIA Corporation
Renderer GeForce2 MX/AGP/SSE2
Version 1.5.8 NVIDIA 96.43.13
Direct Rendering Yes
Processor
Processor
Processor
Name Intel(R) Pentium(R) 4 CPU 1.60GHz
Family, model, stepping 15, 1, 2 (Pentium 4)
Vendor Intel
Configuration
Cache Size 256kb
Frequency 1594.77MHz
BogoMIPS 3190.44
Byte Order Little Endian
Features
FDIV Bug no
HLT Bug no
F00F Bug no
Coma Bug no
Has FPU yes
Cache
Cache information not available
Capabilities
fpu Floating Point Unit
vme Virtual 86 Mode Extension
de Debug Extensions - I/O breakpoints
pse Page Size Extensions (4MB pages)
tsc Time Stamp Counter and RDTSC instruction
msr Model Specific Registers
pae Physical Address Extensions
mce Machine Check Architeture
cx8 CMPXCHG8 instruction
apic Advanced Programmable Interrupt Controller
sep Fast System Call (SYSENTER/SYSEXIT)
mtrr Memory Type Range Registers
pge Page Global Enable
mca Machine Check Architecture
cmov Conditional Move instruction
pat Page Attribute Table
pse36 36bit Page Size Extensions
clflush Cache Line Flush instruction
dts Debug Store
acpi Thermal Monitor and Software Controlled Clock
mmx MMX technology
fxsr FXSAVE and FXRSTOR instructions
sse SSE instructions
sse2 SSE2 (WNI) instructions
ss Self Snoop
ht HyperThreading
tm Thermal Monitor
up smp kernel running on up
pebs Precise-Event Based Sampling
bts Branch Trace Store
Memory
Memory
Total Memory 1034084 kB
Free Memory 94276 kB
Buffers 40536 kB
Cached 700112 kB
Cached Swap 0 kB
Active 170788 kB
Inactive 726844 kB
Active(anon) 74112 kB
Inactive(anon) 88348 kB
Active(file) 96676 kB
Inactive(file) 638496 kB
Unevictable 12 kB
Mlocked 12 kB
High Memory 139144 kB
Free High Memory 252 kB
Low Memory 894940 kB
Free Low Memory 94024 kB
Virtual Memory 2931852 kB
Free Virtual Memory 2931852 kB
Dirty 12 kB
Writeback 0 kB
AnonPages 156996 kB
Mapped 57392 kB
Slab 24260 kB
SReclaimable 18864 kB
SUnreclaim 5396 kB
PageTables 1376 kB
NFS_Unstable 0 kB
Bounce 0 kB
WritebackTmp 0 kB
CommitLimit 3448892 kB
Committed_AS 404212 kB
VmallocTotal 122880 kB
VmallocUsed 27648 kB
VmallocChunk 52368 kB
DirectMap4k 32760 kB
DirectMap4M 876544 kB
Benchmarks
CPU Blowfish
CPU Blowfish
This Machine 1595 MHz 50.176
Intel(R) Celeron(R) M processor 1.50GHz (null) 26.1876862
PowerPC 740/750 (280.00MHz) (null) 172.816713
CPU CryptoHash
CPU CryptoHash
This Machine 1595 MHz 11.071
CPU Fibonacci
CPU Fibonacci
This Machine 1595 MHz 74.202
Intel(R) Celeron(R) M processor 1.50GHz (null) 8.1375674
PowerPC 740/750 (280.00MHz) (null) 58.07682
CPU N-Queens
CPU N-Queens
This Machine 1595 MHz 132.704
FPU FFT
FPU FFT
This Machine 1595 MHz 104.630
FPU Raytracing
FPU Raytracing
This Machine 1595 MHz 212.639
Intel(R) Celeron(R) M processor 1.50GHz (null) 40.8816714
PowerPC 740/750 (280.00MHz) (null) 161.312647
So what I am wanting help with is finding the solution to the cpu usage so that I can use this computer at least until I can afford a new power supply or whatever. I am open to any good suggestions, though I must state I am not really interested in tiling wm's at the moment. I am just not a true minimalist.
Thanks in advance for any and all help. I understand that there is a lot of info in this post, but it is my hope that with this info the problem can be solved. If there is info I didn't provide that is needed, please let me know.also check that you have
session.screen0.opaqueMove false
in your .fluxbox/init this will probably help a bit if it is currently true,
Last edited by Cyrusm (2009-01-26 13:52:13) -
Java thread with high CPU usage
Hi,
Running prstat -L -p pid on Solaris produces a list of lwp threads running in that process that are consuming the most CPU. Out of about 7 threads that were associated with kernel threads in pstack output, only 5 of them were mapped to a JVM thread dump. How is it possible to have a Java thread consuming CPU that doesn't show up in a thread dump?
Thanks,
J.S.And, any idea what this thread is doing?
Here's pstack output for this missing thread 12:
----------------- lwp# 18 / thread# 12 --------------------
fe0e48b4 __1cHCompileSflatten_alias_type6kMpknHTypePtr__3_ (b6001780, 100360, fe4c8000, b6001780, 100360, 0) + 4d8
fe0f42ac __1cHCompilePget_alias_index6kMpknHTypePtr__I_ (b6001780, 100360, b6001264, 7e2bb8, 41f4, 7e2bb8) + 8
fe11131c __1cJStoreNodeFIdeal6MpnIPhaseGVN_pnLPhaseDefUse__pnENode__ (0, 7dd5b4, 5035ec, 7e2bb8, b6001144, b6001264) + 128
fe0c1224 __1cMPhaseIterGVNNtransform_old6MpnENode__2_ (0, b6001144, 7e2bb8, b6001264, 7e2bb8, b600116c) + 47c
fe17349c __1cMPhaseIterGVNIoptimize6M_v_ (24, 0, a37700, b6001110, b6001100, 3442f0) + b4
fe1943b0 __1cOPhaseIdealLoop2t6MrnMPhaseIterGVN_pk0_v_ (b6000ee8, a3772c, 1, 4ff37c, 2000, 269568) + 7cc
fe1cc89c __1cHCompileIOptimize6M_v_ (b6001780, b60015b8, b6001780, b60015dc, 0, b60013dc) + a0
fe1cb69c __1cHCompile2t6MpnFciEnv_pnHciScope_pnIciMethod_ill_v_ (91f504, b6001800, db8a24, fe5296b4, b60018a0, b60018b0) + 7bc
fe1c73f8 __1cKC2CompilerOcompile_method6MpnFciEnv_pnHciScope_pnIciMethod_il_v_ (27b18, b6001af8, db8a24, db8938, ffffffff, 1) + 70
fe1c79fc __1cNCompileBrokerZinvoke_compiler_on_method6FpnLCompileTask__v_ (db8938, db8a24, fe4eacec, 0, 0, 8d9) + 40c
fe280964 __1cNCompileBrokerUcompiler_thread_loop6F_v_ (28758, 13a570, fe4c8000, b6001d10, fe4c8000, ffffffff) + 168
fe216200 __1cKJavaThreadDrun6M_v_ (b5e02000, fe4d3e34, fe4c8000, 1ffd70, 13a570, 1ffd70) + 3d8
fe213ec8 _start (fe4c8000, ff325d10, 0, 5, 1, fe401000) + 20
ff36b734 threadstart (13a570, 0, 0, 0, 0, 0) + 40 -
High CPU Usage on Terminalserver (Win2k3)
Hi,
at the moment we are running an Exchange 2010 SP3 in combination with Outlook 2010 (Ver. 14.0.6123.5001 32bit).
Outlook is installed on Windows 7 fat clients, but most users access their mailbox with Outlook running on a Win2k3 Terminalserver (extended support till 2016).
While the users on the fat clients don't have any problems, the thin client users experience problems with high cpu usage.
Following example:
Terminalserver, 12 users, 6 running Outlook, 2 users splitting almost the whole cpu between them (usage around 90-100%).
This makes working on that terminalserver nearly impossible.
I tried safe mode, I tried disabling their add-ins, I tried deleting their terminalserver profile to no avail.
How can I figure out what's causing this?Hi,
Anti Virus email scanners are known to cause similar behavior, please first check if you have any Anti Virus scanner integrated with Outlook. Try to disable it, and check result.
A corrupted data file might also cause this kind of issue, try to repair your data file with Scanpst.exe tool.
Please refer to this article on how to use scanpst.exe:
http://office.microsoft.com/en-us/outlook-help/repair-outlook-data-files-pst-and-ost-HA102749454.aspx
Please also have a look at this thread, try the workarounds in it and see if issue persists:
http://answers.microsoft.com/en-us/office/forum/officeversion_other-outlook/constant-high-cpu-usage-when-outlook-open/b9a66791-ab73-4ecd-a73d-edf27102aa4e
Hope this helps.
Thanks,
Ethan Hua CHN
TechNet Community Support -
Sometimes, after a while, firefox (36.0.4) uses up 1 core of my CPU (is a quad core due to hypertreading). The way it happens is really strange. Many tabs without a problem until suddenly ff decides to floor it. This is alway in the run, not on startup or close. All add-ons need to ask my permissions to be activated, this includes flash.
On close, I ordered ff to clear all history and cookies.
Notes that could be important (The behavior encountered while using it. This varies from time to time):
opening new tabs (a lot or a few) => "heavy" load during site loading, then idling
==> The above makes sense
- same as above but load continues to be heavy. => could be some badly written javascript on the site, however, sometimes this occurs with sites I know have no stressful javascript
==> The above seems odd
- Browser is idle in the background (not actively using it). Then all of the sudden "lets floor it until closed".
==> The above seems pretty odd
- When confronted with high CPU usage, closing ff doesn't close it (the ff process remains active. Not a ff process, THE ff process). => High CPU usage remains
==> The above looks like that there is definitely something wrong here
This last one has some other things to keep in mind
- When it happens and I close ff, upon restarting it it will ALWAYS ask to close ff. After confirming to close it, it will start and behave normally.
- When killing ff via the task-manager, or other means like powershell commands, restarting it will result in an idle ff even after every tab is loaded again.
I hope this isn't a heisenbug and there is a solution to this, a reboot ff button would be a nice workaround though. I personally think that it must be some routine in the code that decides to go nuts for no reason.
If you need further details, feel free to ask.
Thanks in advanceTried those before and tried them again. Unfortunately, the problem keeps repeating itself at random times. As said, sometimes it doesn't occur and sometimes suddenly it does. Keep the following things in mind about this, what seems like a heisenbug, behavior.
- opening new tabs (a lot or a few) => "heavy" load during site loading, then idling
==> The above makes sense
- same as above but load continues to be heavy. => could be some badly written javascript on the site, however, sometimes this occurs with sites I know have no stressful javascript
==> The above seems odd
- Browser is idle in the background (not actively using it). Then all of the sudden "lets floor it until closed".
==> The above seems pretty odd
- When confronted with high CPU usage, closing ff doesn't close it (the ff process remains active. Not a ff process, THE ff process). => High CPU usage remains
==> The above looks like that there is definitely something wrong here
As stated, a reboot ff button would be a nice workaround. I personally think that something like a tread must get stuck in some sort of infinite loop. Browsing in ff works just fine though. I just don't like the fact that I turns into a "gasoline guzzler".
Again, thanks in advance -
Good day, can someone analyze this for me, in regards with high cpu usage.
2222222222222222222222222222222222333332222244444222222222
8888555559999955555777773333344444000007777711111555559999
100
90
80
70
60
50
40 *****
30 ************************ ************************
20 **********************************************************
10 **********************************************************
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per second (last 60 seconds)
4443333334443433334333333333333333333333343333333333333333
1006530591135079734601132535328062177773414263667168577916
100
90
80
70
60
50
40 ***** ********** ** * * * * **** * * *** ****** *
30 #############**##*####*#*##*###*#*#########*##*****###****
20 ##########################################################
10 ##########################################################
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
4744444545444444444444444444333344444444444444444434444444433344344444
4547425182436632379924402500899822115303104140406471591734499730802883
100
90
80 *
70 *
60 *
50 * * **** ** *** * * * ** * **
40 **********************************************************************
30 #*******###**********##**********#********************************####
20 ######################################################################
10 ######################################################################
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
Local_Backbone#sh proc cpu sorted 5sec
CPU utilization for five seconds: 24%/16%; one minute: 27%; five minutes: 27%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
123 1380698152 938782622 1470 6.07% 6.66% 6.52% 0 IP Input
9 71590456 190912340 374 0.39% 0.48% 0.47% 0 ARP Input
213 53552228 246488976 217 0.23% 0.42% 0.48% 0 SNMP ENGINE
176 2804332 35409778 79 0.15% 0.02% 0.00% 0 OSPF Hello
319 918144 11719407 78 0.15% 0.01% 0.00% 0 OSPF Router 100
4 236 195 1210 0.07% 0.00% 0.00% 1 Virtual Exec
169 2374788 2035919 1166 0.07% 0.03% 0.00% 0 Adj Manager
118 5885520 15709517 374 0.07% 0.07% 0.07% 0 CDP Protocol
36 69788 9934569 7 0.07% 0.00% 0.00% 0 TTY Background
179 30669516 309965501 98 0.07% 0.23% 0.24% 0 IP SNMP
need a quick opinion as i have another backbone abroad that uses only 5-10% of cpu usage.
- same config
- same setup (2BB for Sec/firewall, 2BB for Integration, 6Distro SW)
- different number of users
thank you and god bless.I also agree with Stephan that this is not a concern that the cpu you are seeing it sohuld reduce down.
If in case still want to do the troubleshooting here is the procedure:
Here are some of the commands you can refer while you see the high cpu:
•1- Show proc cpu sorted | ex 0.00% >> First check whether CPU is due to Interrupt or due to Process Switching.
Eg: CPU utilization for five seconds: 6%/2%; one minute: 2%; five minutes: 2%
6% is total CPU utilization and 2 % is due to Interrupt. You would see this on a higher bit when you have the high cpu. Total-interrupt will give you the value of Process.
More info: http://www.cisco.com/en/US/products/hw/switches/ps708/products_tech_note09186a00804916e0.shtml
b) Show proc cpu history :---Check since how long is the CPU been affected.
2- Check if there is any interface drops are been seen:
show interface | include line|drops ( Check if any vlan/interface are having input drops)
3- check if there are any STP issue:
show spanning tree detail
show spann det | in ieee|from|occur|is exec
show spann det | in executing | changes
show interface | include line|drops
show cef drop
show ip traffic >> Check the traffic utilization.
4- There are some internal debugging which would help to find out which packets ( from Src,dst) is hitting the CPU:
debug netdr capture rx <<<<( DEBUG OF NETDR IS VERY USEFULL TO CHECK WHAT PACKETSS ARE COMING TO CPU)
show netdr capture-packet >> This will give you the captured outputs were you can see the Src and dst . Then you can take the action with those src ip address guys to check why they are punting the traffic.
HTH
Regards
Inayath
***Plz rate if this info is helpfull. -
DNS server process, high CPU usage
Hello,
I am having a problem with high CPU usage on DNS process. We have 1921 setup in network of about 100 workstations that use it as DNS server. It also performs split view functionality for couple of domains in order to avoid hairpin NAT. I know that a router is not fit for heavy server duty but such setup was unfortunately necessary.
In peak work hours we oftenly have CPU hitting 100% with DNS server process being the root cause,and on several occasions we had DNS process stuck in such state for prolonged periods of time during which other router functions were affected (t's a default gateway, IPsec concentrator etc.). Sometimes shutting the process and restarting it would solve the problem, but once it required a full reload in order to restore functionality (such was the description that engineer on duty reported to me).
Forwarder queue statistics:
Current size = 0
Maximum size = 86
Drops = 0
IOS upgrade did not help, we are currently running 15.2(2)T.
The question is ... is such behaviour (CPU load) to be expected on LAN with 100 workstations due to slow CPU on router or we have bugged IOS DNS server (requiring a TAC case)?
The previous solution seem to do this functionality quite nicely (even though it was also a router), so I am not inclined to think that we are dealing with someone DoS-ing the DNS (WAN access to DNS is of course forbidden)
P.S.
Since we moved servers off the routers DNS, we do not receive complaints, but we had a couple of unresolved messages a day while mail server was using router for DNS. I am suspecting that an old bug where IOS DNS servers occasionaly sends clients back empty DNS replies (properly formatted message but without A record) could be still around?hi,
i have the same problem on UC540 and 2911 on IOS 15.0.1. CPU high, router crashed. Reboot helps but until CPU usage spikes again. the only fix is to remove "ip dns server" from config and use a different DNS server
111 1111 1111111111
999999999900077777777799999777778888000099990000000000
322222111119999900077776666622222111119999000088880000000000
100 ******** ******************
90 ************* ***** **********************
80 *************************** **********************
70 ******************************************************
60 ******************************************************
50 ******************************************************
40 ******************************************************
30 ******************************************************
20 ******************************************************
10 ******************************************************
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per second (last 60 seconds)
after removed IP dns server
111
99999999990007777777779999977777888
33333333332222211111999990007777666662222211111999
100 ********
90 ************* ***** ***
80 *************************** ***
70 ***********************************
60 ***********************************
50 ***********************************
40 ***********************************
30 ***********************************
20 ***********************************
10 ***********************************
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per second (last 60 seconds) -
SCCM 2012 R2 Linux\Unix Client High CPU Usage
Hello,
We have recently implemented SCCM 2012 R2 in a mixed Windows \ Solaris \ RHEL environment. The Unix\Linux client are at the SCCM 2012 R2 CU2 - Version
5.00.7958.1024.
A small number of system outages have occured recently on the Linux & Solaris systems. SCCM is one of several candidate causes.
One issue we have seen on these systems is high CPU usage by ccmexed.bin
The TOP command shows the process regulalry using more than 100% of a single CPU core.
The PRSTAT command shows a more resonable CPU usage accross all cores.
However, in both cases the process is using significantly more CPU resource than other systems processes - including SAP and Oracle.
Are there any known issues\reported bugs with high CPU usage on RHEL 5 & 6 and Solaris 10 x86?
I know CU3 for Unix\Linux has just been released and I will certainly be looking at applying that in the environment - more
expeditiously
if this is a recognised issue and fixed in CU3
Regards, ChrisHi Chris,
Yes, the latest Clients Clients Clients including bug fixes and added support for RHEL 7, CentOS 7, and Oracle Linux 7
Please apply the fix and see how it goes.
http://www.microsoft.com/en-us/download/details.aspx?id=39360
Thanks.
Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. -
Continuous Audio, Jerky Video, High CPU Usage
Hello,
I've been browsing the forum for a while and tried a few searches. I found some problems similar to mine, but nothing with a solution that worked. Here is my situation. I was running Windows XP Home SP3 with the latest IE, Firefox and Chrome browsers. I updated my flash player (to 10) and I hulu didn't work any more. The audio would play but the video would freeze and change to a different frame every now and then, usually a couple minutes behind the audio. I had already decided that I wanted to switch over to Ubuntu 10 so I just did a fresh install. I updated everything over night and then I tried to watch hulu using the latest firefox. I had the same problem. The audio will play, but the video freezes. I downloaded the latest Chrome. Same problem, both with high cpu usage. I am using a Dell Inspirion 2200 with 1.5 ghz cpu and 512 mb ram with integrated graphics. So far the only thing I've tried is disabling hardware acceleration. My internet connection is 1.5 mb. I would really appreciate any help.
Thanks,
ralphcholoI noticed it's the "audiodg.exe" program that is acting weird with high cpu usage. Some tutorials say to disable 'audio enhancements' but I can't find that option available in windows 10. In device manager, I notice 2 separate audio drivers. The Acer download page only has 1 realtek audio driver. I'm wondering if there is supposed to be another driver to update? My audio seems to be working fine without this problem coming back. I've attached a screenshot showing the 2 different audio fields in device manager. The bottom one is the driver listed on the Acer driver page, I'm not sure where the other upper audio driver is to download.
-
High cpu usage when the system is idle
I do have a high cpu usage problem when the system is idle. I bought the laptop (lenovo x230 tablet) with windows 7 installed in it. Then upgraded to windows 8. But ever since I have problems with high cpu usage by the system even when the computer is idle.
Only the system by itself uses around 30% of the cpu all the time. I ran xperf, and here is the result of it:
http://sdrv.ms/Kj6CFN
I appreciate any help you can provide.
Thanks,Hi,
I'm sorry for that the log you provide can't be opened on my computer. While according to your description, it should had a special process that consume CPU usage when system idle Iguess, isn't it?
You can use
Process Explorer to monitor the process activity, may be we can find the reason of this problem.
Note: We can use Process Explorer to check the Stack of every process then analyize the problem in deep.
To gave a better insight about this problem, you can take a ScreenShot for this problem and provide the picture here.
Roger Lu
TechNet Community Support -
Hello all!
I have this annoying problem with opera.
After 1-2 hours of running opera cpu usage jumps to about 60-80%. To stop this I have to close opera and restart it.
I mostly have about 30+ tabs opened, but this shouldn't affect the cpu usage. It didn't in the past. I used the opera-devel-qt4 (10.20_4744-1) package from AUR and now I switched back to the "default" opera (10.10-2) package.
This started some days ago, and i cannot find out what causes this.
Any suggestions?
Vlad
Last edited by DonVla (2010-01-07 22:37:58)I have no plugins running and killed the wrapper.
However it worked fine for the most time. I noticed opera has a higher usage than firefox. But now it's barely usable. Every 3-5 hours I have to stop and then restart opera. With the bundled version it's a little better. But it still freezes for some seconds with high cpu usage. -
Kswapd0 almost constant high CPU usage
Hello,
On my Eagle M2, I see kswapd0 using almost constant 50% CPU usage with the latest AOSP.
Can this be related to the big battery drain I'm having? An older AOSP build (end of march with another 3.10 kernel branch) does not have this kswapd0 issue and has a far better battery life.
PID PR CPU% S #THR VSS RSS PCY UID Name
79 1 50% R 1 0K 0K fg root kswapd0
This post reports similar issues but is of an older kernel (so probably not related): http://forum.xda-developers.com/general/rooting-roms/fix-kswapd0-cpu-usage-problem-t2845239 Is there a parameter somewhere not set right?I even tried compiling a kernel with CONFIG_SWAP=n but kswapd0 is still there :-(
brHello, it seems reverting https://github.com/sonyxperiadev/device-sony-eagle/commit/07b30b728766c248c1d5555417d5e92271781f88 "solves" the kswapd high CPU usage! (I removed "BOARD_KERNEL_CMDLINE += mem=883M" from BoardConfig.mk) The battery life seems better now, but still not as good when comparing with the march build. best regards
-
Hi there,
since a few days there is on some machines (40-60) a high cpu usage on one core (quad core cpu machines) with the WMIPRSVE.EXE if the HARDWARE INVENTORY CYCLE started.
i try out some tests, read some forum articles and troubleshooting the WMI management but a real problem i doesn´t see.
in some articles i read that hardware inventory runs about minutes up to more hours but some machines runs longer, someone more as 1 day.
here an example of mine PC:
at 8:07 i started Hardware Inventory Cycle, in the InventoryAgent.log i can see that some Collection Namespace are captured.
after a few minutes there stopped and does nothing round about 5.9 hours or better, after 21436.097 Seconds.
For any hints i am grateful. :)
Inventory: *********************** Start of message processing. ***********************
InventoryAgent 18.03.2015 08:09:56
11088 (0x2B50)
Inventory: Message type is InventoryAction InventoryAgent
18.03.2015 08:09:56 11088 (0x2B50)
Inventory: Temp directory = C:\WINDOWS\CCM\Inventory\Temp\
InventoryAgent 18.03.2015 08:09:56
11088 (0x2B50)
Inventory: Clearing old collected files. InventoryAgent
18.03.2015 08:09:56 11088 (0x2B50)
Inventory: Opening store for action {00000000-0000-0000-0000-000000000001} ...
InventoryAgent 18.03.2015 08:09:56
11088 (0x2B50)
CInvState::VerifyInventoryVersionNumber: Mismatch found for '{00000000-0000-0000-0000-000000000001}': 4.2 vs. 0.0
InventoryAgent 18.03.2015 08:09:56
11088 (0x2B50)
Inventory: Version number mismatch; will do a Full report.
InventoryAgent 18.03.2015 08:09:56
11088 (0x2B50)
Inventory: Action=Hardware, ReportType=ReSync, MajorVersion=5, MinorVersion=0
InventoryAgent 18.03.2015 08:09:56
11088 (0x2B50)
Inventory: Initialization completed in 0.141 seconds
InventoryAgent 18.03.2015 08:09:56
11088 (0x2B50)
Collection: Namespace = \\localhost\root\Microsoft\appvirt\client; Query = SELECT __CLASS, __PATH, __RELPATH, CachedLaunchSize, CachedPercentage, CachedSize, LaunchSize, Name, PackageGUID, TotalSize, Version, VersionGUID FROM Package; Timeout = 600 secs.
InventoryAgent 18.03.2015 08:09:56
7836 (0x1E9C)
Failed to get IWbemService Ptr for \\localhost\root\vm\VirtualServer Namespace: 8004100E
InventoryAgent 18.03.2015 08:10:02
7836 (0x1E9C)
Failed to enumerate instances of VirtualMachine: 8004100E
InventoryAgent 18.03.2015 08:10:02
7836 (0x1E9C)
Collection: Namespace = \\.\root\cimv2\sms; Query = SELECT __CLASS, __PATH, __RELPATH, AddressWidth, BrandID, CPUHash, CPUKey, DataWidth, DeviceID, Family, Is64Bit, IsHyperthreadCapable, IsMobile, IsTrustedExecutionCapable, IsVitualizationCapable, Manufacturer,
MaxClockSpeed, Name, NormSpeed, NumberOfCores, NumberOfLogicalProcessors, PCache, ProcessorId, ProcessorType, Revision, SocketDesignation, Status, SystemName, Version FROM SMS_Processor; Timeout = 600 secs.
InventoryAgent 18.03.2015 08:10:02
7836 (0x1E9C)
Collection: Namespace = \\.\root\CCM\powermanagementagent; Query = SELECT __CLASS, __PATH, __RELPATH, Requester, RequesterInfo, RequesterType, RequestType, Time, UnknownRequester FROM CCM_PwrMgmtLastSuspendError; Timeout = 600 secs.
InventoryAgent 18.03.2015 08:10:03
7836 (0x1E9C)
Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, Availability, Description, DeviceID, Manufacturer, Name, Status FROM Win32_IDEController; Timeout = 600 secs.
InventoryAgent 18.03.2015 08:10:03
7836 (0x1E9C)
Collection: Namespace = \\.\root\cimv2\sms; Query = SELECT __CLASS, __PATH, __RELPATH, BinFileVersion, BinProductVersion, Description, ExecutableName, FilePropertiesHash, FilePropertiesHashEx, FileSize, FileVersion, HasPatchAdded, InstalledFilePath, IsSystemFile,
IsVitalFile, Language, Product, ProductCode, ProductVersion, Publisher FROM SMS_InstalledExecutable; Timeout = 600 secs.
InventoryAgent 18.03.2015 08:10:03
7836 (0x1E9C)
Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, DefaultIPGateway, DHCPEnabled, DHCPServer, DNSDomain, DNSHostName, Index, IPAddress, IPEnabled, IPSubnet, MACAddress, ServiceName FROM Win32_NetworkAdapterConfiguration; Timeout
= 600 secs. InventoryAgent
18.03.2015 14:06:43 7836 (0x1E9C)
Collection: Namespace = \\.\root\Nap; Query = SELECT __CLASS, __PATH, __RELPATH, description, fixupState, friendlyName, id, infoClsid, isBound, percentage, registrationDate, vendorName, version FROM NAP_SystemHealthAgent; Timeout = 600 secs.
InventoryAgent 18.03.2015 14:06:43
7836 (0x1E9C)
Collection: Namespace = \\.\root\cimv2\sms; Query = SELECT __CLASS, __PATH, __RELPATH, AdditionalProductCodes, CompanyName, ExplorerFileName, FileDescription, FilePropertiesHash, FileSize, FileVersion, FolderPath, LastUsedTime, LastUserName, msiDisplayName,
msiPublisher, msiVersion, OriginalFileName, ProductCode, ProductLanguage, ProductName, ProductVersion, SoftwarePropertiesHash FROM CCM_RecentlyUsedApps; Timeout = 600 secs.
InventoryAgent 18.03.2015 14:06:43
7836 (0x1E9C)
Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, BankLabel, Capacity, Caption, CreationClassName, DataWidth, Description, DeviceLocator, FormFactor, HotSwappable, InstallDate, InterleaveDataDepth, InterleavePosition, Manufacturer,
MemoryType, Model, Name, OtherIdentifyingInfo, PartNumber, PositionInRow, PoweredOn, Removable, Replaceable, SerialNumber, SKU, Speed, Status, Tag, TotalWidth, TypeDetail, Version FROM Win32_PhysicalMemory; Timeout = 600 secs.
InventoryAgent 18.03.2015 14:07:02
7836 (0x1E9C)
Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, Availability, Description, DeviceID, InstallDate, Manufacturer, Name, PNPDeviceID, ProductName, Status FROM Win32_SoundDevice; Timeout = 600 secs.
InventoryAgent 18.03.2015 14:07:02
7836 (0x1E9C)
Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, Caption, ClassGuid, ConfigManagerErrorCode, ConfigManagerUserConfig, CreationClassName, Description, DeviceID, Manufacturer, Name, PNPDeviceID, Service, Status, SystemCreationClassName,
SystemName FROM Win32_USBDevice; Timeout = 600 secs.
InventoryAgent 18.03.2015 14:07:12
7836 (0x1E9C)
Collection: 62/74 inventory data items successfully inventoried.
InventoryAgent 18.03.2015 14:07:12
7836 (0x1E9C)
Inventory: Collection Task completed in 21436.097 seconds
InventoryAgent 18.03.2015 14:07:12
7836 (0x1E9C)
Inventory: 12 Collection Task(s) failed. InventoryAgent
18.03.2015 14:07:12 7836 (0x1E9C)
Inventory: Temp report = C:\WINDOWS\CCM\Inventory\Temp\25bf01b2-12fc-4eea-8e97-a51b3c75ba50.xml
InventoryAgent 18.03.2015 14:07:12
7836 (0x1E9C)
Inventory: Starting reporting task. InventoryAgent
18.03.2015 14:07:12 7552 (0x1D80)
Reporting: 4381 report entries created. InventoryAgent
18.03.2015 14:07:13 7552 (0x1D80)
Inventory: Reporting Task completed in 1.030 seconds
InventoryAgent 18.03.2015 14:07:13
7552 (0x1D80)
Inventory: Successfully sent report. Destination:mp:MP_HinvEndpoint, ID: {5541A94A-BED9-4132-AE54-110CB6896F02}, Timeout: 80640 minutes MsgMode: Signed, Not Encrypted
InventoryAgent 18.03.2015 14:07:13
7552 (0x1D80)
Inventory: Cycle completed in 21453.570 seconds
InventoryAgent 18.03.2015 14:07:30
7552 (0x1D80)
Inventory: Action completed. InventoryAgent
18.03.2015 14:07:30 7552 (0x1D80)
Inventory: ************************ End of message processing. ************************
InventoryAgent 18.03.2015 14:07:30
7552 (0x1D80)
Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, Caption, ClassGuid, ConfigManagerErrorCode, ConfigManagerUserConfig, CreationClassName, Description, DeviceID, Manufacturer, Name, PNPDeviceID, Service, Status, SystemCreationClassName,
SystemName FROM Win32_USBDevice; Timeout = 600 secs.
InventoryAgent 18.03.2015 14:07:12
7836 (0x1E9C)
Collection: 62/74 inventory data items successfully inventoried.
InventoryAgent 18.03.2015 14:07:12
7836 (0x1E9C)
Inventory: Collection Task completed in 21436.097 seconds
InventoryAgent 18.03.2015 14:07:12
7836 (0x1E9C)
Inventory: 12 Collection Task(s) failed. InventoryAgent
18.03.2015 14:07:12 7836 (0x1E9C)
Inventory: Temp report = C:\WINDOWS\CCM\Inventory\Temp\25bf01b2-12fc-4eea-8e97-a51b3c75ba50.xml
InventoryAgent 18.03.2015 14:07:12
7836 (0x1E9C)
Inventory: Starting reporting task. InventoryAgent
18.03.2015 14:07:12 7552 (0x1D80)
Reporting: 4381 report entries created. InventoryAgent
18.03.2015 14:07:13 7552 (0x1D80)
Inventory: Reporting Task completed in 1.030 seconds
InventoryAgent 18.03.2015 14:07:13
7552 (0x1D80)
Inventory: Successfully sent report. Destination:mp:MP_HinvEndpoint, ID: {5541A94A-BED9-4132-AE54-110CB6896F02}, Timeout: 80640 minutes MsgMode: Signed, Not Encrypted
InventoryAgent 18.03.2015 14:07:13
7552 (0x1D80)
Inventory: Cycle completed in 21453.570 seconds
InventoryAgent 18.03.2015 14:07:30
7552 (0x1D80)
Inventory: Action completed. InventoryAgent
18.03.2015 14:07:30 7552 (0x1D80)
Inventory: ************************ End of message processing. ************************
InventoryAgent 18.03.2015 14:07:30
7552 (0x1D80)InventoryAgent 18.03.2015 08:10:03
7836 (0x1E9C)
Collection: Namespace = \\.\root\cimv2; Query = SELECT __CLASS, __PATH, __RELPATH, DefaultIPGateway, DHCPEnabled, DHCPServer, DNSDomain, DNSHostName, Index, IPAddress, IPEnabled, IPSubnet, MACAddress, ServiceName FROM Win32_NetworkAdapterConfiguration; Timeout
= 600 secs. InventoryAgent
18.03.2015 14:06:43 7836 (0x1E9C)
Collection: Namespace = \\.\root\Nap; Query = SELECT __CLASS, __PATH, __RELPATH, description, fixupState, friendlyName, id, infoClsid, isBound, percentage, registrationDate, vendorName, version FROM NAP_SystemHealthAgent; Timeout = 600 secs.
InventoryAgent 18.03.2015 14:06:43
7836 (0x1E9C)
Looks like something in one or both of those wmi queries. it goes from 8:10:03 to 14:06:43 right around there. 6 hours to do that...
try running those queries from wbemtest manually; and see which one just never finishes.
Standardize. Simplify. Automate. -
High CPU usage with Coherence 3.5.0 cluster node
We're noticing sustained high CPU usage on one of our Coherence nodes - this happens after running a job that pretty intensively interacts with the cache. The jobs complete, however we still see the Coherence process using approximately the equivalent of one core's worth of CPU. I took a couple of thread dumps about fifteen minutes apart, and the only noticeable differences are within the PacketListener1 and PacketListenerN threads - they're holding locks on different DatagramPacket instances, which suggests to be that this may be the piece of code that is looping.
There are two other cache nodes in this particular cluster - both of them on a different machine - and neither of them are exhibiting the same CPU utilization.
Environment:
Coherence 3.5.0
Java - BEA JRockit(R) (build R27.6.3-40_o-112056-1.6.0_11-20090318-2103-linux-x86_64, compiled mode)
Has anyone encountered this scenario before?
Here's a copy of the two thread dumps:
Thread Dump 1 -
===== FULL THREAD DUMP ===============
Thu Feb 24 21:45:00 2011
BEA JRockit(R) R27.6.3-40_o-112056-1.6.0_11-20090318-2103-linux-x86_64
"Main Thread" id=1 idx=0x4 tid=18143 prio=5 alive, in native, waiting
-- Waiting for notification on: java/lang/Class@0x43587b58[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/net/DefaultCacheServer.main(DefaultCacheServer.java:80)
^-- Lock released while waiting: java/lang/Class@0x43587b58[fat lock]
at com/zzzz/carbon/cacheserver/ZzzzCoherenceServerStartup.doWork(ZzzzCoherenceServerStartup.java:29)
at com/zzzz/util/runner/ZzzzRunnerBase.run(ZzzzRunnerBase.java:23)
at com/zzzz/carbon/cacheserver/ZzzzCoherenceServerStartup.main(ZzzzCoherenceServerStartup.java:16)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"(Signal Handler)" id=2 idx=0x8 tid=18144 prio=5 alive, in native, daemon
"(GC Main Thread)" id=3 idx=0xc tid=18145 prio=5 alive, in native, daemon
"(GC Worker Thread 1)" id=? idx=0x10 tid=18146 prio=5 alive, in native, daemon
"(GC Worker Thread 2)" id=? idx=0x14 tid=18147 prio=5 alive, in native, daemon
"(GC Worker Thread 3)" id=? idx=0x18 tid=18148 prio=5 alive, in native, daemon
"(GC Worker Thread 4)" id=? idx=0x1c tid=18149 prio=5 alive, in native, daemon
"(Code Generation Thread 1)" id=4 idx=0x20 tid=18150 prio=5 alive, in native, native_waiting, daemon
"(Code Optimization Thread 1)" id=5 idx=0x24 tid=18151 prio=5 alive, in native, native_waiting, daemon
"(VM Periodic Task)" id=6 idx=0x28 tid=18152 prio=10 alive, in native, daemon
"Finalizer" id=7 idx=0x2c tid=18153 prio=8 alive, in native, native_waiting, daemon
at jrockit/memory/Finalizer.waitForFinalizees([Ljava/lang/Object;)I(Native Method)
at jrockit/memory/Finalizer.access$500(Finalizer.java:12)
at jrockit/memory/Finalizer$4.run(Finalizer.java:159)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Reference Handler" id=8 idx=0x30 tid=18154 prio=10 alive, in native, native_waiting, daemon
at java/lang/ref/Reference.waitForActivatedQueue()Ljava/lang/ref/Reference;(Native Method)
at java/lang/ref/Reference.access$100(Reference.java:11)
at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:79)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"(Sensor Event Thread)" id=9 idx=0x34 tid=18155 prio=5 alive, in native, daemon
"Logger@9217551 3.5/459" id=12 idx=0x38 tid=18158 prio=3 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x4e1faef8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x4e1faef8[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketListener1" id=14 idx=0x3c tid=18159 prio=8 alive, in native, daemon
at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb21360[recursive]
at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)[inlined]
at java/net/DatagramSocket.receive(DatagramSocket.java:712)[optimized]
^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb21360[thin lock]
^-- Holding lock: java/net/DatagramPacket@0x73aa4e80[thin lock]
^-- Holding lock: java/net/DatagramSocket@0x4cb21338[thin lock]
at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:20)[optimized]
at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:4)[optimized]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:19)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketReceiver" id=15 idx=0x40 tid=18160 prio=7 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x4cf60d58[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketReceiver.onWait(PacketReceiver.CDB:2)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x4cf60d58[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketPublisher" id=16 idx=0x44 tid=18161 prio=6 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketPublisher.onWait(PacketPublisher.CDB:2)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketSpeaker" id=17 idx=0x48 tid=18162 prio=8 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x4cabe9d8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/queue/ConcurrentQueue.waitForEntry(ConcurrentQueue.CDB:16)
^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x4cabe9d8[fat lock]
at com/tangosol/coherence/component/util/queue/ConcurrentQueue.remove(ConcurrentQueue.CDB:7)
at com/tangosol/coherence/component/util/Queue.remove(Queue.CDB:1)
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketSpeaker.onNotify(PacketSpeaker.CDB:62)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketListenerN" id=18 idx=0x4c tid=18163 prio=8 alive, in native, daemon
at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb221b0[recursive]
at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)[inlined]
at java/net/DatagramSocket.receive(DatagramSocket.java:712)[optimized]
^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb221b0[thin lock]
^-- Holding lock: java/net/DatagramPacket@0x73e59890[thin lock]
^-- Holding lock: java/net/MulticastSocket@0x4cb22178[thin lock]
at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:20)[optimized]
at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:4)[optimized]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:19)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Cluster|Member(Id=2, Timestamp=2011-02-23 16:25:36.488, Address=10.10.100.77:8095, MachineId=25677, Location=site:emtzzzz.com,machine:njdev04,process:18142,member:cldev201~carboncachelauncher~181)" id=19 idx=0x50 tid=18164 prio=5 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4cac64d8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4cac64d8[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"TcpRingListener" id=20 idx=0x54 tid=18165 prio=6 alive, in native, daemon
at java/net/PlainSocketImpl.socketAccept(Ljava/net/SocketImpl;)V(Native Method)
at java/net/PlainSocketImpl.accept(PlainSocketImpl.java:384)
^-- Holding lock: java/net/SocksSocketImpl@0x4cb227d8[thin lock]
at java/net/ServerSocket.implAccept(ServerSocket.java:453)
at java/net/ServerSocket.accept(ServerSocket.java:421)
at com/tangosol/coherence/component/net/socket/TcpSocketAccepter.accept(TcpSocketAccepter.CDB:18)
at com/tangosol/coherence/component/util/daemon/TcpRingListener.acceptConnection(TcpRingListener.CDB:10)
at com/tangosol/coherence/component/util/daemon/TcpRingListener.onNotify(TcpRingListener.CDB:9)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Invocation:Management:EventDispatcher" id=22 idx=0x58 tid=18166 prio=5 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x4ab76140[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x4ab76140[fat lock]
at com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher.onWait(Service.CDB:7)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Invocation:Management" id=23 idx=0x5c tid=18167 prio=5 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4ab75508[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4ab75508[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"DistributedCache" id=25 idx=0x60 tid=18168 prio=5 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4a3869b0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4a3869b0[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
===== END OF THREAD DUMP ===============
Thread Dump 2 -
===== FULL THREAD DUMP ===============
Thu Feb 24 21:27:53 2011
BEA JRockit(R) R27.6.3-40_o-112056-1.6.0_11-20090318-2103-linux-x86_64
"Main Thread" id=1 idx=0x4 tid=18143 prio=5 alive, in native, waiting
-- Waiting for notification on: java/lang/Class@0x43587b58[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/net/DefaultCacheServer.main(DefaultCacheServer.java:80)
^-- Lock released while waiting: java/lang/Class@0x43587b58[fat lock]
at com/zzzz/carbon/cacheserver/ZzzzCoherenceServerStartup.doWork(ZzzzCoherenceServerStartup.java:29)
at com/zzzz/util/runner/ZzzzRunnerBase.run(ZzzzRunnerBase.java:23)
at com/zzzz/carbon/cacheserver/ZzzzCoherenceServerStartup.main(ZzzzCoherenceServerStartup.java:16)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"(Signal Handler)" id=2 idx=0x8 tid=18144 prio=5 alive, in native, daemon
"(GC Main Thread)" id=3 idx=0xc tid=18145 prio=5 alive, in native, native_waiting, daemon
"(GC Worker Thread 1)" id=? idx=0x10 tid=18146 prio=5 alive, in native, daemon
"(GC Worker Thread 2)" id=? idx=0x14 tid=18147 prio=5 alive, in native, daemon
"(GC Worker Thread 3)" id=? idx=0x18 tid=18148 prio=5 alive, in native, daemon
"(GC Worker Thread 4)" id=? idx=0x1c tid=18149 prio=5 alive, in native, daemon
"(Code Generation Thread 1)" id=4 idx=0x20 tid=18150 prio=5 alive, in native, native_waiting, daemon
"(Code Optimization Thread 1)" id=5 idx=0x24 tid=18151 prio=5 alive, in native, native_waiting, daemon
"(VM Periodic Task)" id=6 idx=0x28 tid=18152 prio=10 alive, in native, daemon
"Finalizer" id=7 idx=0x2c tid=18153 prio=8 alive, in native, native_waiting, daemon
at jrockit/memory/Finalizer.waitForFinalizees([Ljava/lang/Object;)I(Native Method)
at jrockit/memory/Finalizer.access$500(Finalizer.java:12)
at jrockit/memory/Finalizer$4.run(Finalizer.java:159)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Reference Handler" id=8 idx=0x30 tid=18154 prio=10 alive, in native, native_waiting, daemon
at java/lang/ref/Reference.waitForActivatedQueue()Ljava/lang/ref/Reference;(Native Method)
at java/lang/ref/Reference.access$100(Reference.java:11)
at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:79)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"(Sensor Event Thread)" id=9 idx=0x34 tid=18155 prio=5 alive, in native, daemon
"Logger@9217551 3.5/459" id=12 idx=0x38 tid=18158 prio=3 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x4e1faef8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/application/console/Coherence$Logger$Queue@0x4e1faef8[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketListener1" id=14 idx=0x3c tid=18159 prio=8 alive, in native, daemon
at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb21360[recursive]
at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)[inlined]
at java/net/DatagramSocket.receive(DatagramSocket.java:712)[optimized]
^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb21360[thin lock]
^-- Holding lock: java/net/DatagramPacket@0x73a80930[thin lock]
^-- Holding lock: java/net/DatagramSocket@0x4cb21338[thin lock]
at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:20)[optimized]
at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:4)[optimized]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:19)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketReceiver" id=15 idx=0x40 tid=18160 prio=7 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x4cf60d58[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketReceiver.onWait(PacketReceiver.CDB:2)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketReceiver$InQueue@0x4cf60d58[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketPublisher" id=16 idx=0x44 tid=18161 prio=6 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketPublisher.onWait(PacketPublisher.CDB:2)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketPublisher$InQueue@0x4ca053a8[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketSpeaker" id=17 idx=0x48 tid=18162 prio=8 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x4cabe9d8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/queue/ConcurrentQueue.waitForEntry(ConcurrentQueue.CDB:16)
^-- Lock released while waiting: com/tangosol/coherence/component/net/Cluster$PacketSpeaker$BundlingQueue@0x4cabe9d8[fat lock]
at com/tangosol/coherence/component/util/queue/ConcurrentQueue.remove(ConcurrentQueue.CDB:7)
at com/tangosol/coherence/component/util/Queue.remove(Queue.CDB:1)
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketSpeaker.onNotify(PacketSpeaker.CDB:62)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"PacketListenerN" id=18 idx=0x4c tid=18163 prio=8 alive, in native, daemon
at java/net/PlainDatagramSocketImpl.receive0(Ljava/net/DatagramPacket;)V(Native Method)
^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb221b0[recursive]
at java/net/PlainDatagramSocketImpl.receive(PlainDatagramSocketImpl.java:136)[inlined]
at java/net/DatagramSocket.receive(DatagramSocket.java:712)[optimized]
^-- Holding lock: java/net/PlainDatagramSocketImpl@0x4cb221b0[thin lock]
^-- Holding lock: java/net/DatagramPacket@0x5e55a240[thin lock]
^-- Holding lock: java/net/MulticastSocket@0x4cb22178[thin lock]
at com/tangosol/coherence/component/net/socket/UdpSocket.receive(UdpSocket.CDB:20)[optimized]
at com/tangosol/coherence/component/net/UdpPacket.receive(UdpPacket.CDB:4)[optimized]
at com/tangosol/coherence/component/util/daemon/queueProcessor/packetProcessor/PacketListener.onNotify(PacketListener.CDB:19)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Cluster|Member(Id=2, Timestamp=2011-02-23 16:25:36.488, Address=10.10.100.77:8095, MachineId=25677, Location=site:emtzzzz.com,machine:njdev04,process:18142,member:cldev201~carboncachelauncher~181)" id=19 idx=0x50 tid=18164 prio=5 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4cac64d8[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4cac64d8[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"TcpRingListener" id=20 idx=0x54 tid=18165 prio=6 alive, in native, daemon
at java/net/PlainSocketImpl.socketAccept(Ljava/net/SocketImpl;)V(Native Method)
at java/net/PlainSocketImpl.accept(PlainSocketImpl.java:384)
^-- Holding lock: java/net/SocksSocketImpl@0x4cb227d8[thin lock]
at java/net/ServerSocket.implAccept(ServerSocket.java:453)
at java/net/ServerSocket.accept(ServerSocket.java:421)
at com/tangosol/coherence/component/net/socket/TcpSocketAccepter.accept(TcpSocketAccepter.CDB:18)
at com/tangosol/coherence/component/util/daemon/TcpRingListener.acceptConnection(TcpRingListener.CDB:10)
at com/tangosol/coherence/component/util/daemon/TcpRingListener.onNotify(TcpRingListener.CDB:9)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:37)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Invocation:Management:EventDispatcher" id=22 idx=0x58 tid=18166 prio=5 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x4ab76140[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher$Queue@0x4ab76140[fat lock]
at com/tangosol/coherence/component/util/daemon/queueProcessor/Service$EventDispatcher.onWait(Service.CDB:7)
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"Invocation:Management" id=23 idx=0x5c tid=18167 prio=5 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4ab75508[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4ab75508[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
"DistributedCache" id=25 idx=0x60 tid=18168 prio=5 alive, in native, waiting, daemon
-- Waiting for notification on: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4a3869b0[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)[optimized]
at com/tangosol/coherence/component/util/Daemon.onWait(Daemon.CDB:18)[inlined]
at com/tangosol/coherence/component/util/daemon/queueProcessor/service/Grid.onWait(Grid.CDB:9)[optimized]
^-- Lock released while waiting: com/tangosol/coherence/component/util/queue/concurrentQueue/DualQueue@0x4a3869b0[fat lock]
at com/tangosol/coherence/component/util/Daemon.run(Daemon.CDB:34)
at java/lang/Thread.run(Thread.java:619)
at jrockit/vm/RNI.c2java(JJJJJ)V(Native Method)
-- end of trace
===== END OF THREAD DUMP ===============Charlie, Cameron,
Thanks for following up. To answer Cameron's question - yes, running top shows that it is this process using a significant amount of the CPU. I captured a JRA this morning setting nativesamples=true.
I see the following when I look at the Hot Methods - let me know if there is something else that would shed some more light on this issue.
Method Percent(%) #Samples Optimized Native Method Id.
libjvm.so#mmDetGcFollowReferencesWorkers 28.575 2,062 0 1 0x2AE6B82EC2C1
libpthread.so.0#__recvfrom_nocancel 26.012 1,877 0 1 0x3CC1A0D689
libpthread.so.0#__accept_nocancel 26.012 1,877 0 1 0x3CC1A0D4A9
libjvm.so#mmBalanceGetReference 4.975 359 0 1 0x2AE6B817A65B
libjvm.so#objIterStepFieldFromBitmaskWord 4.753 343 0 1 0x2AE6B82A6B34
libjvm.so#objIterStep 3.88 280 0 1 0x2AE6B82A6F8D
libjvm.so#objIterInitInner 2.744 198 0 1 0x2AE6B82A71B7
libjvm.so#mmBalanceStoreReference 1.414 102 0 1 0x2AE6B817A781
libjvm.so#objIterSetupFields 0.637 46 0 1 0x2AE6B82A6B08
libjvm.so#nativeInnerLockNotLinked 0.236 17 0 1 0x2AE6B829DE76
libjvm.so#mmWorkPacketPoolGet 0.125 9 0 1 0x2AE6B817A4F5
libjvm.so#qBitSetIsBitSetInWord 0.069 5 0 1 0x2AE6B82C8AA6
libjvm.so#nativeInnerUnlockNotLinked 0.069 5 0 1 0x2AE6B829E028
libjvm.so#mmWorkPacketPoolAdd 0.042 3 0 1 0x2AE6B817A48E
libjvm.so#objPoolMarkAllHard 0.042 3 0 1 0x2AE6B82A4923
libjvm.so#objIterSetupArray 0.028 2 0 1 0x2AE6B82A6BDB
libjvm.so#markAcquired 0.028 2 0 1 0x2AE6B829DBD3
libjvm.so#mmPointerMatrixTryInsertAtIndex 0.028 2 0 1 0x2AE6B82BEFEB
libjvm.so#mmPointerMatrixClear 0.028 2 0 1 0x2AE6B82BF61C
libjvm.so#objPoolMarkWeakConcurrently 0.028 2 0 1 0x2AE6B82A5358
libjvm.so#qBitSetFindFirstNonClearedWord 0.014 1 0 1 0x2AE6B82C888E
libjvm.so#utilCounterToNanos 0.014 1 0 1 0x2AE6B8313B53
libjvm.so#waitForLockIfNeededAndMarkAcquired 0.014 1 0 1 0x2AE6B829DC30
libjvm.so#vmtLinkData 0.014 1 0 1 0x2AE6B8325B2E
libjvm.so#mmBitsIsObjectMarkedGrey 0.014 1 0 1 0x2AE6B82ED7E9
libjvm.so#qBitSetFindLastSetBitInWord 0.014 1 0 1 0x2AE6B82C8854
libjvm.so#mark_writebarriers 0.014 1 0 1 0x2AE6B8250EEA
libjvm.so#signalNextInLockQueueIfNeeded 0.014 1 0 1 0x2AE6B829DF52
libjvm.so#mmGetUsingMatrixes 0.014 1 0 1 0x2AE6B819F33C
libjvm.so#ptGetThreadId 0.014 1 0 1 0x2AE6B82BD9ED
libc.so.6#memset 0.014 1 0 1 0x3CC0A7A000
libjvm.so#setupNodeForSelf 0.014 1 0 1 0x2AE6B829DD87
libc.so.6#_int_free 0.014 1 0 1 0x3CC0A714E0
libjvm.so#mmAddChunkToList 0.014 1 0 1 0x2AE6B830977C
libjvm.so#vmtiUnlinkData 0.014 1 0 1 0x2AE6B8325B4A
libjvm.so#nativeLockInSuspendCritical 0.014 1 0 1 0x2AE6B829E0E3
libjvm.so#mmSweepHeapPart 0.014 1 0 1 0x2AE6B830989A
libjvm.so#mmBalanceWorkSetSwapPackets 0.014 1 0 1 0x2AE6B817A647
libc.so.6#_int_malloc 0.014 1 0 1 0x3CC0A71E80
libjvm.so#charToJlcType 0.014 1 0 1 0x2AE6B8253633
unknown#unknown functions 0 0 0 1 0x2AE6B8597090
Running with nativemethods=false, I see the following under hot methods
Method Percent(%) #Samples Optimized Native Method Id.
jrockit.vm.Locks.monitorExitSecondStage(Object) 50 1 1 0 0x161D30D0
com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.ClusterService.onNotify() 50 1 1 0 0x169D2C70
com.tangosol.coherence.component.util.daemon.queueProcessor.packetProcessor.PacketReceiver.onNotify() 0 0 1 0 0x1551C050
com.tangosol.coherence.component.util.queue.ConcurrentQueue.checkFlush(int) 0 0 1 0 0x151C2180
java.lang.Thread.run() 0 0 0 0 0x14E98EB0
jrockit.vm.RNI.c2java(long, long, long, long, long) 0 0 0 0 0x14C07830
unknown#unknown functions 0 0 0 1 0x2AE6B8597090
com.tangosol.coherence.component.util.Daemon.run() 0 0 0 0 0x15CFEBC0
com.tangosol.coherence.component.util.queue.ConcurrentQueue.add(Object) 0 0 1 0 0x15ED6B00
com.tangosol.coherence.component.util.queue.ConcurrentQueue.onAddElement() 0 0 1 0 0x151C9C20
com.tangosol.coherence.component.util.queue.ConcurrentQueue.flush(boolean) 0 0 1 0 0x1618CAD0
Thanks,
Jason
Maybe you are looking for
-
Touchpad hot-keys don't work after installing Wii XP on Satellite A200-1HV
Synaptics hot-keys after installing WinXp doesn't work. http://i043.radikal.ru/0805/c5/09a7324bc1d2.jpg On Vista i touch "Two arrows" touchpad lite up blue colour but now this does not happen. I installed driver from Toshiba web-site for Win XP. How
-
Is there any parameter in the XI messgae in the IE that remains constant
i m trying to trace an error in the sxmb_moni, for a JDBC-XI-Proxy scenario, in the XI message that i can see in the SXMB_moni of XI, is there any parameter that reamins constant or that i can relate with the message when the message reaches receiver
-
Help Required in full outer Join
I feel the below query can be changed to full outer join. But, I've not been able to do so. I require your help in changing it to full outer join. My current query is SELECT CLAIMNO,'1' INDX FROM D_CLAIM@CMS2PROD WHERE clntsys=76500 and facility=7650
-
Reading attachments from adobe interactive form
Hi, My requirement is- vendor should fill all the detail in an offline interactive form and attach necessary documents in the form itself. How can i read the attachments from the form inside my program and how can i store it in SAP. I am using FM ' S
-
I have a database designed for Oracle 8.0.3 using OO methodology. Which means i have used nested table / varrays extensively. now that i'm ready with database i can't use forms 5.0 / reports 3.0 to build application as its not recognised. How do i pr