6500 - HIGH CPU UTILIZAITON

Hello,
I'm having almost 60-70% CPU utilization on a 6500 core for almost a day now. However cant seem to figure out what is overwhelming the CPU utlization. show cpu process sorted does not provide much information with top two processes being 'slcp process' - about 2-3% & spanning tree process which goes between 1-2%. The major change in the network was introduction of Nexus 2232 (10G) switches in the DC which are connected to 5K with 20 Gb uplinks to the 6500. Now almost 20 servers are connected to this switch, but none of them are going beyond 1.5 Gb/s.
Any help would be much appreciated.
Thank you.

Hi,
Connecting 5ks to 6500 should not cause high CPU. Usually, when 6500s are configured in VSS mode, the CPU runs higher. Also if you are running a modular code, the CPU usually runs higher. Note that most newer IOS verions are not modular more .
Also, have a look at this doc for tips on troubleshooting high CPU.
http://www.cisco.com/c/en/us/support/docs/switches/catalyst-6500-series-switches/63992-6k-high-cpu.html
HTH

Similar Messages

6500 HIGH CPU, Standby HSRP state changes continuously

Hi All,
We are using two 6500 User distribution connected with port channel also WLC is connected on Dist-2 now, these two 6500 are connected with backend core 7609 running ospf in between. Spanning-tree root and Standby Active on Dist-1
Suddenly we are facing High CPU utilization on switches, couldn't able to ping nor login. However I could observe to the following through console.
Switch1 is stable, all the vlans are active, but on standby all the vlans are getting state changes, suspecting there are not getting hello's on time due to which it is going to active and standby.
%HSRP-5-STATECHANGE: Vlan208 Grp 208 state Standby -> Active
%HSRP-5-STATECHANGE: Vlan160 Grp 160 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan115 Grp 115 state Standby -> Active
%HSRP-5-STATECHANGE: Vlan156 Grp 156 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan208 Grp 208 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan209 Grp 209 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan196 Grp 196 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan112 Grp 112 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan196 Grp 196 state Standby -> Active
Configuration of Wireless VLAN
on both switch
interface Vlan198
ip address 10.X.X.X
ip helper-address
standby 198 ip 10.X.X.X
standby 198 timers 250 msec 750
standby 198 priority 90
standby 198 preempt
end
All the vlans having same timers and preempt on both switches,
we are not tracking any interface, can I remove preempt on secondary switch?
I have captured packets through netdr
Dist-2
interface Vl198, routine mistral_process_rx_packet_inlin, timestamp 23:53:02.823
dbus info: src_vlan 0xC6(198), src_indx 0x2(2), len 0x40(64)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x40C6(16582)
F8020400 00C60000 00020000 40080168
S000 E0000560 8E0FFFF8 00000008 40C60000
mistral hdr: req_token 0x0(0), src_index 0x2(2), rx_offset 0x76(118)
requeue 0, obl_pkt 0, vlan 0xC6(198)
destmac FF.FF.FF.FF.FF.FF, srcmac 00.00.0C.07.AC.C6, protocol 0806
layer 3 data: 00010800 06040002 00000C07 ACC60A19 C601FFFF FFFFFFFF
              0A19C601 00000000 00000000 00000000 00000000 0000C601
              8300A369 00000000 0000FFFF
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 48, identifier 0
df 0, mf 0, fo 0, ttl 1, src 10.X.X.X, dst 224.0.0.2
    udp src 1985, dst 1985 len 28 checksum 0x53BE
Dist -1
interface Vl198, routine mistral_process_rx_packet_inlin, timestamp 23:48:26.830
dbus info: src_vlan 0xC6(198), src_indx 0x341(833), len 0x42(66)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x40C6(16582)
60020401 00C60400 03410400 42080000 00110448 0E087C7C 00000008 40C60000
mistral hdr: req_token 0x0(0), src_index 0x341(833), rx_offset 0x76(118)
requeue 0, obl_pkt 0, vlan 0xC6(198)
destmac 01.00.5E.00.00.02, srcmac 00.00.0C.07.AC.C6, protocol 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 48, identifier 0
df 0, mf 0, fo 0, ttl 1, src 10.X.X.X, dst 224.0.0.2
    udp src 1985, dst 1985 len 28 checksum 0x53BF
This issue is not continuous, its triggering intermittently sometime with in couple of hours or days

After digging I could able to find out
VLAN0195 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 165 last change occurred 00:31:14 ago
          from GigabitEthernet6/14
VLAN0196 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 122 last change occurred 00:31:14 ago
          from GigabitEthernet6/14
VLAN0197 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 291 last change occurred 00:31:14 ago
          from GigabitEthernet6/14
VLAN0198 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 961 last change occurred 00:31:14 ago
          from GigabitEthernet6/14
VLAN0199 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 1165 last change occurred 00:31:25 ago
          from GigabitEthernet6/14
VLAN0200 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 888 last change occurred 00:31:25 ago
          from GigabitEthernet6/14
Port g 6/14 config
interface GigabitEthernet6/14
switchport
switchport trunk encapsulation dot1q
switchport trunk native vlan 200
switchport trunk allowed vlan 195-200
switchport mode trunk
connected to Dist2- WLC
195 Wireless-Voice                   active
196 GTC-VIDEO                        active
197 IP_Camera                        active
198 Wireless-client                        active
199 Cisco-AP-MGMT                    active
200 NW-MGMT                          active
Rest of all vlans
VLAN0110 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 824 last change occurred 00:51:49 ago
          from TenGigabitEthernet1/3
VLAN0111 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 680 last change occurred 00:51:49 ago
          from TenGigabitEthernet1/3
Also some ports I can root inconsistent on secondary switch configured as root secondary
Ten gig1/3 is connected to floor switch
VLAN0110 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 297 last change occurred 00:37:47 ago
          from StackPort1
VLAN0111 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 164 last change occurred 00:37:47 ago
          from StackPort1

High CPU on 6500 VSS

I am also Observing the Same problem of High CPU on 6500.
Please suggest some Investigations
When i ran Debug as defiend by u . i found two problems
•-           Many configured ACEs have the “log” command. This means that a copy of the packets will also be sent to the CPU. As you can see below:
ip access-list extended watch110_in
permit ip any host 172.27.192.10 log
permit ip host 172.27.206.2 any log
permit ip host 172.27.206.10 any log
permit ip host 172.27.206.126 any log
•-          In the netdr capture that I performed, I could see packets with a source IP of any of the above was also sent to the CPU.
2/ Redirects
•-          There are a number of packets which also have the destination index of 0x7F07
Please suggest

Hello Leo
We have the same issue but our VSS is already upgraded to SXJ6.
Do you think that it could do any difference to upload the right MIBs to LMS?
We are using 4.2.2.
Best regards
Isaac

High CPU utilization on 6500

Hi,
Well, I have this strange problem with 6500 and 4215. Everything works just fine, sensor is blocking and no real problem with that.
But, I get high cpu usage on my 6500 device whenever IDS is accessing it for ACL configuration.
I tried to sniff on this and I get this strange output from 6500 device whenever ssh session is established: 6500 is responsing one letter at a time (I mean one letter per packet), so it takes a lot of packets in order to this session to get accomplished.
Here is a log from 4215 :
"evError: eventId=1114377191440638275 severity=error
originator:
hostId: xxx
appName: nac
appInstanceId: 1162
time: 2005/08/17 14:40:14 2005/08/17 16:40:14 Summer
errorMessage: name=errSystemError ERROR: Syntax error from invalid input at device [Cisco] IP [x.x.x.x] state [Active]Text from device:
^
% Invalid input detected at '^' marker.
sw-01(config-if)# "
Anyone seen this before.
Just to mention, regular telnet/ssh sessions are not cpu intensive.
Thanks,
Sasa

This could be due to very large ACLs and ACEs that you might be having. I wonder if there is a turbo acl ( as in pix) is there in IDS. If so, this will reduce the consumption of resources to a large extent.

High CPU caused by Multicast on 6500

Hello - could anyone please assist?
I'm see constant(often daily) alerts that indicate high CPU on one of our Cisco Cat 6500 core switches.
The PIDs refered to are:
276 - IP Input
560 - PIM Process
Combined, these 2 processes take the CPU over 85%, most often hitting 99%.
The core switch is also the Rendevous Point for the LAN.
Many thanks
Lee

Hi Lee,
You say this is a core router, but as people use this terms to mean different things, are there any directly connected hosts? If there are one thing to check for is hosts sending multicast traffic with TTL=1. If you run the command show ip traffic | in bad hop and look at the rate the "bad hop count" is increasing. If I had a £ for every time I've seen that problem.... I couldn't retire just yet, but at least I could go buy myself a beer or two.
If you're seeing the hop count increasing at a rapid rate there are a couple of options:
Take a read of Troubleshooting high CPU on a 6500 with sup720 starting from the section Tools used to determine the source of the traffic and identify the hosts sending multicast with TTL=1.
If the Catalyst 6500 use PFC 3B add the command mls rate-limit all ttl-failure 100 10 to drop the multicast traffic in hardware.
The first option will take you longer, but at least you identify the cause and can advise the application owner why they should change their applications behaviour.
Regards

High cpu - Rate-limit cisco 6500

Hello,
my device is cisco 6509.
Explanation of the case:
Received to interface vlan (L3) 600M traffic (configured with Rate limit - 50 M).
Result :
1. 100 % cpu
2. the traffic was limited to 50M
How can I prevent High Cpu in this situation ?
Thanks.

I would suggest opening a case, or asking in a different forum. This form is for discussion about existing bugs for which a bugid has been identified.

Troubleshooting high cpu on ciso 7200 for ADSL L2tp

hi all ,
i have cisco 7200 as LNS router for ADSL.
now there is cpu 10 % differ between hardware & software !!
in rush hour the differ is 20 % and cpu is 95 % !!!!
here i want to ask ,
does a high value if (IP INPUT)
i have the cpu as :
Bras2#sh processes cpu sorted
CPU utilization for five seconds: 46%/36%; one minute: 48%; five minutes: 47%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
87 17598348 81792634 215 3.75% 3.82% 3.85% 0 IP Input
122 6780696 68885502 98 1.43% 1.49% 1.51% 0 L2X Data Daemon
267 652328 3839852 169 0.87% 0.83% 0.80% 0 PPP Events
261 837328 436010 1920 0.55% 0.44% 0.35% 0 L2TP mgmt daemon
275 1665220 1634254 1018 0.55% 0.57% 0.55% 0 SNMP ENGINE
262 574524 378112 1519 0.39% 0.29% 0.24% 0 L2TUN Applicatio
52 1019288 22961 44392 0.39% 0.39% 0.39% 0 Compute load avg
112 951036 174201 5459 0.31% 0.31% 0.31% 0 CEF: IPv4 proces
142 59512 26465240 2 0.15% 0.19% 0.18% 0 HQF Shaper Backg
256 89812 1276789 70 0.15% 0.15% 0.15% 0 IPHC Admin
102 182336 433843 420 0.15% 0.10% 0.08% 0 SSM connection m
97 150508 128933 1167 0.15% 0.09% 0.08% 0 SSS Manager
258 486356 1268702 383 0.15% 0.18% 0.16% 0 RADIUS
78 83244 300654 276 0.15% 0.15% 0.14% 0 ACCT Periodic Pr
56 225176 23195 9707 0.15% 0.08% 0.05% 0 HC Counter Timer
273 623508 3248144 191 0.15% 0.20% 0.21% 0 IP SNMP
16 780412 2008294 388 0.07% 0.55% 0.46% 0 EnvMon
291 176 380 463 0.07% 0.01% 0.00% 2 SSH Process
289 3296 447173 7 0.07% 0.00% 0.00% 0 MLD
20 992 117612 8 0.07% 0.00% 0.00% 0 ARP Background
80 41692 18825 2214 0.07% 0.02% 0.00% 0 CDP Protocol
266 30024 3564894 8 0.07% 0.05% 0.07% 0 PPP manager
274 323728 1633937 198 0.07% 0.11% 0.13% 0 PDU DISPATCHER
139 35600 64784 549 0.07% 0.01% 0.00% 0 PPP Bind
25 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager
26 636 16121 39 0.00% 0.00% 0.00% 0 DDR Timers
24 0 8 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
28 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun
29 0 1 0 0.00% 0.00% 0.00% 0 RO Notify Timers
27 0 5 0 0.00% 0.00% 0.00% 0 Entity MIB API
30 0 1 0 0.00% 0.00% 0.00% 0 RMI RM Notify Wa
32 0 2 0 0.00% 0.00% 0.00% 0 SMART
33 576 112990 5 0.00% 0.00% 0.00% 0 GraphIt
34 0 2 0 0.00% 0.00% 0.00% 0 Dialer event
35 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect
36 0 2 0 0.00% 0.00% 0.00% 0 XML Proxy Client
31 12 220 54 0.00% 0.00% 0.00% 0 EEM ED Syslog
23 166932 860 194106 0.00% 0.02% 0.01% 0 AAA high-capacit
39 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
40 33388 90640 368 0.00% 0.05% 0.01% 0 Net Background
41 0 4 0 0.00% 0.00% 0.00% 0 IDB Work
42 16 412 38 0.00% 0.00% 0.00% 0 Logger
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
43 852 112782 7 0.00% 0.00% 0.00% 0 TTY Background
44 2484 112998 21 0.00% 0.00% 0.00% 0 Per-Second Jobs
45 8444 30499 276 0.00% 0.00% 0.00% 0 IF-MGR control p
46 612 33340 18 0.00% 0.00% 0.00% 0 IF-MGR event pro
47 0 1 0 0.00% 0.00% 0.00% 0 Inode Table Dest
48 0 1 0 0.00% 0.00% 0.00% 0 IKE HA Mgr
49 0 1 0 0.00% 0.00% 0.00% 0 IPSEC HA Mgr
50 0 4 0 0.00% 0.00% 0.00% 0 rf task
37 0 2 0 0.00% 0.00% 0.00% 0 VSA background
38 0 1 0 0.00% 0.00% 0.00% 0 VSA Cleanup Proc
22 0 1 0 0.00% 0.00% 0.00% 0 CEF MIB API
54 0 1 0 0.00% 0.00% 0.00% 0 Token Daemon
55 8 1553 5 0.00% 0.00% 0.00% 0 Transport Port A
17 0 1 0 0.00% 0.00% 0.00% 0 OIR Handler
57 0 1 0 0.00% 0.00% 0.00% 0 Coproc Event Pro
58 0 1 0 0.00% 0.00% 0.00% 0 POS APS Event Pr
59 0 1 0 0.00% 0.00% 0.00% 0 SONET alarm time
60 0 1 0 0.00% 0.00% 0.00% 0 CSP Timer
61 204 4 51000 0.00% 0.00% 0.00% 0 USB Startup
62 0 2 0 0.00% 0.00% 0.00% 0 FPD Management P
63 0 1 0 0.00% 0.00% 0.00% 0 FPD Action Proce
64 0 2 0 0.00% 0.00% 0.00% 0 VNM DSPRM MAIN
65 0 1 0 0.00% 0.00% 0.00% 0 RF_INTERDEV_DELA
66 0 1 0 0.00% 0.00% 0.00% 0 RF_INTERDEV_SCTP
67 312 112992 2 0.00% 0.00% 0.00% 0 ISA Common Helpe
68 0 2 0 0.00% 0.00% 0.00% 0 Flash MIB Update
69 0 137 0 0.00% 0.00% 0.00% 0 Flash Card Oir
70 0 1 0 0.00% 0.00% 0.00% 0 CES Line Conditi
71 0 1 0 0.00% 0.00% 0.00% 0 CF_INTERDEV_SCTP
72 608 13885 43 0.00% 0.00% 0.00% 0 Collection proce
73 0 2 0 0.00% 0.00% 0.00% 0 Ethernet CFM
74 420 110120 3 0.00% 0.00% 0.00% 0 Ethernet Timer C
75 0 1 0 0.00% 0.00% 0.00% 0 delayed evt hand
76 14204 76635 185 0.00% 0.01% 0.00% 0 AAA Server
77 152732 330843 461 0.00% 0.07% 0.07% 0 AAA ACCT Proc
15 0 1 0 0.00% 0.00% 0.00% 0 IPC BackPressure
79 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R
51 1360 34703 39 0.00% 0.00% 0.00% 0 Net Input
18 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
82 0 2 0 0.00% 0.00% 0.00% 0 Ethernet LMI
53 27432 2073 13232 0.00% 0.01% 0.00% 0 Per-minute Jobs
21 0 2 0 0.00% 0.00% 0.00% 0 ATM Idle Timer
85 4 14 285 0.00% 0.00% 0.00% 0 IP ARP Adjacency
86 0 1 0 0.00% 0.00% 0.00% 0 IP ARP Retry Age
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
14 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Manager
88 340 22531 15 0.00% 0.00% 0.00% 0 ICMP event handl
89 0 5 0 0.00% 0.00% 0.00% 0 TurboACL
90 0 2 0 0.00% 0.00% 0.00% 0 TurboACL chunk
91 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Echo event
92 52 191 272 0.00% 0.00% 0.00% 0 MOP Protocols
93 0 1 0 0.00% 0.00% 0.00% 0 LSP Tunnel FRR
94 0 1 0 0.00% 0.00% 0.00% 0 MPLS Auto-Tunnel
95 7280 94698 76 0.00% 0.00% 0.00% 0 PPP Hooks
96 3312 186 17806 0.00% 0.21% 0.05% 0 AAA aux
13 300 110122 2 0.00% 0.00% 0.00% 0 IPC Deferred Por
98 0 1 0 0.00% 0.00% 0.00% 0 SSS Feature Mana
99 0 1 0 0.00% 0.00% 0.00% 0 SSS Feature Time
100 0 2 0 0.00% 0.00% 0.00% 0 Spanning Tree
101 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps Mana
12 420 110123 3 0.00% 0.00% 0.00% 0 IPC Periodic Tim
103 0 1 0 0.00% 0.00% 0.00% 0 AC Switch
104 4 377 10 0.00% 0.00% 0.00% 0 Authentication P
105 0 1 0 0.00% 0.00% 0.00% 0 Auth-proxy AAA B
106 0 2 0 0.00% 0.00% 0.00% 0 EAPoUDP Process
107 0 2 0 0.00% 0.00% 0.00% 0 IP Host Track Pr
108 0 2 0 0.00% 0.00% 0.00% 0 KRB5 AAA
109 10700 103089 103 0.00% 0.00% 0.00% 0 IP Background
110 20472 32419 631 0.00% 0.01% 0.00% 0 IP RIB Update
111 28 2276 12 0.00% 0.00% 0.00% 0 CEF background p
11 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager
113 2984 18512 161 0.00% 0.00% 0.00% 0 ADJ background
114 38364 30893 1241 0.00% 0.02% 0.00% 0 PPP IP Route
115 16196 84753 191 0.00% 0.00% 0.00% 0 PPP IPCP
116 0 1 0 0.00% 0.00% 0.00% 0 IP Traceroute
117 296 3464 85 0.00% 0.00% 0.00% 0 TCP Timer
118 252 1714 147 0.00% 0.00% 0.00% 0 TCP Protocols
119 0 1 0 0.00% 0.00% 0.00% 0 Socket Timers
120 0 377 0 0.00% 0.00% 0.00% 0 HTTP CORE
121 0 2 0 0.00% 0.00% 0.00% 0 RLM groups Proce
10 0 1884 0 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
123 0 1 0 0.00% 0.00% 0.00% 0 ac_atm_state_eve
124 0 2 0 0.00% 0.00% 0.00% 0 SNMP Timers
125 876 112720 7 0.00% 0.00% 0.00% 0 RUDPV1 Main Proc
126 0 1 0 0.00% 0.00% 0.00% 0 bsm_timers
127 416 112720 3 0.00% 0.00% 0.00% 0 bsm_xmt_proc
128 0 1 0 0.00% 0.00% 0.00% 0 COPS
129 0 2 0 0.00% 0.00% 0.00% 0 Dialer Forwarder
130 0 3 0 0.00% 0.00% 0.00% 0 Flow Exporter Ti
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
131 0 2 0 0.00% 0.00% 0.00% 0 ATM OAM Input
132 0 2 0 0.00% 0.00% 0.00% 0 ATM OAM TIMER
133 0 1 0 0.00% 0.00% 0.00% 0 RARP Input
134 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Inspect Tim
135 0 1 0 0.00% 0.00% 0.00% 0 LAPB Process
136 0 2 0 0.00% 0.00% 0.00% 0 LFDp Input Proc
137 0 1 0 0.00% 0.00% 0.00% 0 PAD InCall
9 0 2 0 0.00% 0.00% 0.00% 0 ATM VC Auto Crea
81 0 2 0 0.00% 0.00% 0.00% 0 Ethernet OAM Pro
140 0 2 0 0.00% 0.00% 0.00% 0 PPP SSS
141 0 1 0 0.00% 0.00% 0.00% 0 MQC Flow Event B
83 0 2 0 0.00% 0.00% 0.00% 0 CEF switching ba
143 4904 1113579 4 0.00% 0.00% 0.00% 0 RBSCP Background
144 0 2 0 0.00% 0.00% 0.00% 0 SCTP Main Proces
7 0 2 0 0.00% 0.00% 0.00% 0 Timers
84 4388 11191 392 0.00% 0.00% 0.00% 0 ADJ resolve proc
8 0 2 0 0.00% 0.00% 0.00% 0 ATM AutoVC Perio
148 0 1 0 0.00% 0.00% 0.00% 0 IPS Process
149 0 2 0 0.00% 0.00% 0.00% 0 IPS Auto Update
150 0 2 0 0.00% 0.00% 0.00% 0 SDEE Management
151 620 219806 2 0.00% 0.00% 0.00% 0 Inspect process
152 0 1 0 0.00% 0.00% 0.00% 0 xcpa-driver
153 60 9030 6 0.00% 0.00% 0.00% 0 FW DP Inspect pr
154 640 219803 2 0.00% 0.00% 0.00% 0 CCE DP URLF cach
155 0 2 0 0.00% 0.00% 0.00% 0 URL filter proc
156 0 1 0 0.00% 0.00% 0.00% 0 XSM_EVENT_ENGINE
157 284 11275 25 0.00% 0.00% 0.00% 0 XSM_ENQUEUER
158 196 11275 17 0.00% 0.00% 0.00% 0 XSM Historian
159 0 1 0 0.00% 0.00% 0.00% 0 Select Timers
160 0 2 0 0.00% 0.00% 0.00% 0 HTTP Process
161 0 2 0 0.00% 0.00% 0.00% 0 CIFS API Process
162 0 2 0 0.00% 0.00% 0.00% 0 CIFS Proxy Proce
163 0 1 0 0.00% 0.00% 0.00% 0 Crypto HW Proc
164 24 7532 3 0.00% 0.00% 0.00% 0 ACE policy loade
165 60 4521 13 0.00% 0.00% 0.00% 0 CRM_CALL_UPDATE_
166 0 2 0 0.00% 0.00% 0.00% 0 cpf_process_msg_
167 0 2 0 0.00% 0.00% 0.00% 0 AAA Cached Serve
168 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA
169 0 1 0 0.00% 0.00% 0.00% 0 EM Background Pr
170 0 1 0 0.00% 0.00% 0.00% 0 Key chain liveke
171 0 2 0 0.00% 0.00% 0.00% 0 LINE AAA
172 28872 54359 531 0.00% 0.00% 0.00% 0 LOCAL AAA
173 0 6 0 0.00% 0.00% 0.00% 0 MPLS Auto Mesh P
174 0 2 0 0.00% 0.00% 0.00% 0 TPLUS
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
175 0 2 0 0.00% 0.00% 0.00% 0 VSP_MGR
176 0 1 0 0.00% 0.00% 0.00% 0 FW_TEST_TRP
177 0 1 0 0.00% 0.00% 0.00% 0 EPM MAIN PROCESS
178 4 3 1333 0.00% 0.00% 0.00% 0 Crypto WUI
179 0 2 0 0.00% 0.00% 0.00% 0 Crypto Support
180 0 1 0 0.00% 0.00% 0.00% 0 IPSECv6 PS Proc
181 4 1 4000 0.00% 0.00% 0.00% 0 CCVPM_HTSP
182 0 1 0 0.00% 0.00% 0.00% 0 CCVPM_R2
183 0 1 0 0.00% 0.00% 0.00% 0 EPHONE MWI Refre
184 0 126 0 0.00% 0.00% 0.00% 0 FB/KS Log HouseK
185 0 2 0 0.00% 0.00% 0.00% 0 EPHONE MWI BG Pr
186 0 1 0 0.00% 0.00% 0.00% 0 Skinny HW confer
187 0 1 0 0.00% 0.00% 0.00% 0 CCSWVOICE
188 0 1 0 0.00% 0.00% 0.00% 0 cpf_process_tpQ
189 0 1 0 0.00% 0.00% 0.00% 0 http client proc
190 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
191 0 1 0 0.00% 0.00% 0.00% 0 QOS_MODULE_MAIN
192 0 1 0 0.00% 0.00% 0.00% 0 RPMS_PROC_MAIN
193 0 1 0 0.00% 0.00% 0.00% 0 VoIP AAA
194 0 2 0 0.00% 0.00% 0.00% 0 Dialog Manager
195 36 9 4000 0.00% 0.00% 0.00% 0 crypto engine pr
196 0 4 0 0.00% 0.00% 0.00% 0 Crypto CA
197 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-CRL
198 0 1 0 0.00% 0.00% 0.00% 0 encrypt proc
199 18492 1442 12823 0.00% 0.00% 0.00% 0 crypto sw pk pro
200 0 1 0 0.00% 0.00% 0.00% 0 Crypto INT
201 0 3 0 0.00% 0.00% 0.00% 0 Crypto IKE Dispa
202 0 3 0 0.00% 0.00% 0.00% 0 Crypto IKMP
203 0 1 0 0.00% 0.00% 0.00% 0 IPSEC manual key
204 56 5652 9 0.00% 0.00% 0.00% 0 IPSEC key engine
205 0 1 0 0.00% 0.00% 0.00% 0 CRYPTO QoS proce
206 4 8 500 0.00% 0.00% 0.00% 0 Crypto ACL
207 0 1 0 0.00% 0.00% 0.00% 0 Crypto PAS Proc
208 0 1 0 0.00% 0.00% 0.00% 0 GDOI GM Process
209 0 1 0 0.00% 0.00% 0.00% 0 UNICAST REKEY
210 0 1 0 0.00% 0.00% 0.00% 0 UNICAST REKEY AC
211 0 1 0 0.00% 0.00% 0.00% 0 MV64 TDR Process
212 0 1 0 0.00% 0.00% 0.00% 0 IMA Traps
213 0 1 0 0.00% 0.00% 0.00% 0 SYSMGT Events
214 0 2 0 0.00% 0.00% 0.00% 0 Control-plane ho
215 0 1 0 0.00% 0.00% 0.00% 0 DATA Transfer Pr
216 0 1 0 0.00% 0.00% 0.00% 0 DATA Collector
217 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
218 22396 77367 289 0.00% 0.00% 0.00% 0 AAA SEND STOP EV
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
219 24 11298 2 0.00% 0.00% 0.00% 0 RMON Recycle Pro
220 0 2 0 0.00% 0.00% 0.00% 0 RMON Deferred Se
221 0 1 0 0.00% 0.00% 0.00% 0 Syslog Traps
222 0 2 0 0.00% 0.00% 0.00% 0 EEM ED Resource
223 0 2 0 0.00% 0.00% 0.00% 0 EEM ED Routing
224 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Track
225 20 3531 5 0.00% 0.00% 0.00% 0 Crypto cTCP proc
226 0 1 0 0.00% 0.00% 0.00% 0 IP SLAs Ethernet
227 0 1 0 0.00% 0.00% 0.00% 0 RMON Packets
228 780 112376 6 0.00% 0.00% 0.00% 0 trunk conditioni
229 0 1 0 0.00% 0.00% 0.00% 0 trunk conditioni
230 0 157 0 0.00% 0.00% 0.00% 0 EEM Server
231 4 2 2000 0.00% 0.00% 0.00% 0 Call Home proces
232 48 213 225 0.00% 0.00% 0.00% 0 Syslog
233 0 1 0 0.00% 0.00% 0.00% 0 VPDN Test
234 0 2 0 0.00% 0.00% 0.00% 0 EEM Policy Direc
235 0 2 0 0.00% 0.00% 0.00% 0 EEM ED CLI
236 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Counter
237 0 3 0 0.00% 0.00% 0.00% 0 EM ED GOLD
238 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Interface
239 0 3 0 0.00% 0.00% 0.00% 0 EEM ED IOSWD
240 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Ipsla
241 0 3 0 0.00% 0.00% 0.00% 0 EEM ED None
242 0 2 0 0.00% 0.00% 0.00% 0 EEM ED Nf
243 0 3 0 0.00% 0.00% 0.00% 0 EEM ED OIR
244 0 3 0 0.00% 0.00% 0.00% 0 EEM ED RF
245 0 3 0 0.00% 0.00% 0.00% 0 EEM ED SNMP
246 0 2 0 0.00% 0.00% 0.00% 0 EEM ED SNMP Noti
247 12 2881 4 0.00% 0.00% 0.00% 0 EEM ED Timer
248 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Test
249 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Config
250 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Env
251 0 3 0 0.00% 0.00% 0.00% 0 EEM ED RPC
252 0 1 0 0.00% 0.00% 0.00% 0 L2X Socket proce
253 0 1 0 0.00% 0.00% 0.00% 0 Key Proc
254 4 1884 2 0.00% 0.00% 0.00% 0 Call Home Timer
255 0 1 0 0.00% 0.00% 0.00% 0 tHUB
6 3008 10386 289 0.00% 0.00% 0.00% 0 Pool Manager
257 16 65 246 0.00% 0.00% 0.00% 0 SSH Event handle
5 541952 28222 19203 0.00% 0.12% 0.15% 0 Check heaps
259 0 3 0 0.00% 0.00% 0.00% 0 WCCP V2 Protocol
260 8 1887 4 0.00% 0.00% 0.00% 0 Secure Login
4 0 1 0 0.00% 0.00% 0.00% 0 EDDRI_MAIN
3 0 1 0 0.00% 0.00% 0.00% 0 chkpt message ha
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
263 11512 129066 89 0.00% 0.00% 0.00% 0 VPDN failure man
264 1044 22558 46 0.00% 0.00% 0.00% 0 Track
265 0 1 0 0.00% 0.00% 0.00% 0 IP VFR proc
19 14880 59648 249 0.00% 0.00% 0.00% 0 ARP Input
2 2376 22599 105 0.00% 0.01% 0.00% 0 Load Meter
268 316 112815 2 0.00% 0.00% 0.00% 0 Multilink PPP
269 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
270 736 219805 3 0.00% 0.00% 0.00% 0 IP NAT Ager
271 0 1 0 0.00% 0.00% 0.00% 0 IP NAT WLAN
272 620 24477 25 0.00% 0.00% 0.00% 0 IP SLAs Event Pr
138 0 2 0 0.00% 0.00% 0.00% 0 X.25 Background
147 0 1 0 0.00% 0.00% 0.00% 0 CHKPT DevTest
145 0 1 0 0.00% 0.00% 0.00% 0 VPDN call manage
276 0 2 0 0.00% 0.00% 0.00% 0 IP SNMPV6
277 0 1 0 0.00% 0.00% 0.00% 0 SNMP ConfCopyPro
278 0 1 0 0.00% 0.00% 0.00% 0 SNMP Traps
279 360116 45545 7906 0.00% 0.22% 0.11% 0 VTEMPLATE Backgr
280 0 4 0 0.00% 0.00% 0.00% 0 IP-EIGRP Router
281 40020 226871 176 0.00% 0.03% 0.00% 0 IP-EIGRP: PDM
282 10660 92668 115 0.00% 0.00% 0.00% 0 IP-EIGRP: HELLO
283 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
284 20 1869 10 0.00% 0.00% 0.00% 0 DFS flush period
285 1764 61146 28 0.00% 0.00% 0.00% 0 IPv6 IDB
286 8 1870 4 0.00% 0.00% 0.00% 0 IPv6 Input
287 0 1 0 0.00% 0.00% 0.00% 0 IPv6 ND
288 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Address
1 156 2155 72 0.00% 0.00% 0.00% 0 Chunk Manager
290 0 3 0 0.00% 0.00% 0.00% 0 IPv6 RIB Event H
146 0 1 0 0.00% 0.00% 0.00% 0 CHKPT EXAMPLE

In an Adaptive Session Redundancy (ASR) environment, if you run traffic to a configuration that contains discrepancies between the redundant indexes on the two CSSs, the CPU utilization for each processor on the CSS may climb to an abnormal level (at 2000 flows/second, approximately 50 percent utilization for each processor).
If you set the logging level to notice-5 or higher, the SCM utilization may peak at approximately 90 percent because each connection generates a redundant index mismatch log entry. For example:
AUG 7 14:12:15 3/1 1124272 SLR-5: Rejected. Redundant global rule index (7) not found.
This might probably the reason for the High CPU utilization.
The CSS 11800 with CSS8-SCM Redundant System Control Module (SCM) is designated for end of sales.
The recommended replacements for the Cisco CSS 11800 include the Cisco CSS 11500 Series Content Services Switch or the Content Switching Module (CSM)an integrated services module for the Cisco Catalyst. 6500 Series Switch and the Cisco 7600 Internet Router.

High cpu when change "mls cef maximum-route ip" to more than 512K

Dear All
From cisco document 6500-sup720 and 7600-rsp720 are support IPv4 unicast and MPLS—512,000 routes by default. On my network we have route more than 400K which nearly reach to the limit then I tried to change from 512K to 1007K as below.
Router#sh mls cef maximum-routes
FIB TCAM maximum routes :
=======================
Current :-
IPv4                - 1007k
MPLS                - 1k
IPv6 + IP Multicast - 8k (default)
After rebooted I got high cpu issue on both 6500-sup720 and 7600-rsp720 then I tried to tuning to other value such as 600K , 700K and so on but doesn't help.
Summary
   - I have no cpu issue with default value for mls cef maximum-route
   - I have cpu issue when tuning to other value such as 600K , 700K
Please advise.
Pichet

Dear All
From cisco document 6500-sup720 and 7600-rsp720 are support IPv4 unicast and MPLS—512,000 routes by default. On my network we have route more than 400K which nearly reach to the limit then I tried to change from 512K to 1007K as below.
Router#sh mls cef maximum-routes
FIB TCAM maximum routes :
=======================
Current :-
IPv4                - 1007k
MPLS                - 1k
IPv6 + IP Multicast - 8k (default)
After rebooted I got high cpu issue on both 6500-sup720 and 7600-rsp720 then I tried to tuning to other value such as 600K , 700K and so on but doesn't help.
Summary
   - I have no cpu issue with default value for mls cef maximum-route
   - I have cpu issue when tuning to other value such as 600K , 700K
Please advise.
Pichet

How do I write a eem script to catch high cpu on cat6k?

Hi,
I have a high cpu condition I am trying to catch in a 6509 with a WS-SUP720-3B
running s72033-advipservicesk9_wan-mz.122-33.SXI2a code.
I configured this eem script but even when this message is printed in the log, it doesn't execute.
*Jun 9 19:15:48.822: %HA_EM-6-LOG: cpu_stats: ------HIGH CPU DETECTED----, CPU: 92%
Am I missing a parameter on my trigger?
event manager applet cpu_stats
event syslog pattern "%HA_EM-6-LOG: cpu_stats: ------HIGH CPU DETECTED----" maxrun 120
action 1.02 cli command "enable"
action 1.03 cli command "show clock | append disk0:cpu_stats"
action 1.04 cli command "show proc cpu sort | append disk0:cpu_stats"
action 1.05 cli command "Show proc cpu history | append disk0:cpu_stats"
action 1.06 cli command "debug netdr cap rx"
action 1.07 cli command "show tcp brief | append disk0:cpu_stats"
action 1.08 cli command "show ibc | append disk0:cpu_stats"
action 1.09 cli command "show platform hardware capacity ibc | append disk0:cpu_stats"
action 1.15 cli command "show netdr cap | append disk0:cpu_stats"
action 1.16 cli command "undebug all"
This is from the show logg:
*Jun 9 19:15:48.822: %HA_EM-6-LOG: cpu_stats: ------HIGH CPU DETECTED----, CPU: 92%
*Jun 9 19:23:44.066: %HA_EM-6-LOG: cpu_stats: ------HIGH CPU DETECTED----, CPU: 91%
*Jun 9 19:44:18.862: %SYS-5-CONFIG_I: Configured from console by console
*Jun 9 19:49:34.718: %HA_EM-6-LOG: cpu_stats: ------HIGH CPU DETECTED----, CPU: 91%
*Jun 9 19:50:58.962: %SYS-5-CONFIG_I: Configured from console by console
But the disk0:cpu_stats file never gets data appended to it.
Thank you in advance for any assistance,
Chris

Hi Joseph,
I have a continuous ping from a 4500 to this 6500.
I enabled the debug event manager action cli but got limited output.
So enabled debug event manager all.
Here is the output:
*Jun 10 15:30:20.673: cli_history_entry_add: free_hist_list size=0, hist_list size=7
*Jun 10 15:30:20.673: check_eem_cli_policy_handler: num_matches = 0, response_code = 1d
c6500#
*Jun 10 15:30:22.417: cli_history_entry_add: free_hist_list size=0, hist_list size=7
*Jun 10 15:30:22.417: check_eem_cli_policy_handler: command_string=end
*Jun 10 15:30:22.417: check_eem_cli_policy_handler: num_matches = 0, response_code = 1
*Jun 10 15:30:22.417: fh_fd_config_event_match: num_matches = 0
*Jun 10 15:30:22.417: fh_fd_config_event_notify:
*Jun 10 15:30:22.429: fh_fd_syslog_event_match: num_matches = 0
*Jun 10 15:30:22.429: fh_fd_data_syslog: num_matches = 0
*Jun 10 15:31:00.001: fh_fd_timer_process_async
*Jun 10 15:31:00.001: cron_tick: num_matches 0
*Jun 10 15:32:00.005: fh_fd_timer_process_async
*Jun 10 15:32:00.005: cron_tick: num_matches 0
*Jun 10 15:33:00.001: fh_fd_timer_process_async
*Jun 10 15:33:00.001: cron_tick: num_matches 0
c6500#debu event mana
*Jun 10 15:34:00.001: fh_fd_timer_process_async
*Jun 10 15:34:00.001: cron_tick: num_matches 0ger action cli
Debug EEM action cli debugging is on
c6500#
*Jun 10 15:34:08.181: cli_history_entry_add: free_hist_list size=0, hist_list size=7
*Jun 10 15:34:08.181: check_eem_cli_policy_handler: command_string=debug event manager action cli
*Jun 10 15:34:08.181: check_eem_cli_policy_handler: num_matches = 0, response_code = 1
*Jun 10 15:35:00.001: fh_fd_timer_process_async
*Jun 10 15:35:00.001: cron_tick: num_matches 0
*Jun 10 15:36:00.009: fh_fd_timer_process_async
*Jun 10 15:36:00.009: cron_tick: num_matches 0
*Jun 10 15:37:00.001: fh_fd_timer_process_async
*Jun 10 15:37:00.001: cron_tick: num_matches 0
*Jun 10 15:38:00.001: fh_fd_timer_process_async
*Jun 10 15:38:00.001: cron_tick: num_matches 0
C6500# sh proc cpu
CPU utilization for five seconds: 93%/11%; one minute: 91%; five minutes: 90%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
Thank you for your help,
Chris

High load and high CPU caused by perl process

Using: Oracle 10.2.0.1.0
OS: Red Hat ES 4
Since this morning I have high load on one of my prod database server, this server has 3 databases of similar size.
High load is caused by perl process, one process has been running for over 75 min’s. process info
14302 ?        R     74:50 /opt/oracle/product/10.2.0/perl/bin/perl /opt/oracle/product/10.2.0/sysman/admin/scripts/segAdv.pl
26530 ?        R     23:36 /opt/oracle/product/10.2.0/perl/bin/perl /opt/oracle/product/10.2.0/sysman/admin/scripts/segAdv.pl
31152 ?        R      7:58 /opt/oracle/product/10.2.0/perl/bin/perl /opt/oracle/product/10.2.0/sysman/admin/scripts/segAdv.plSearching segAdv.pl on google, Metalink and this forum gives me ZERO results.
Any idea why this is running and cuasing this issue now (for last 8 months, I had not simlar perl issue), can I stop it without kill –9, maybe with emctl stop dbconsole.
Thanks in advance for any help.

Hi Lee,
You say this is a core router, but as people use this terms to mean different things, are there any directly connected hosts? If there are one thing to check for is hosts sending multicast traffic with TTL=1. If you run the command show ip traffic | in bad hop and look at the rate the "bad hop count" is increasing. If I had a £ for every time I've seen that problem.... I couldn't retire just yet, but at least I could go buy myself a beer or two.
If you're seeing the hop count increasing at a rapid rate there are a couple of options:
Take a read of Troubleshooting high CPU on a 6500 with sup720 starting from the section Tools used to determine the source of the traffic and identify the hosts sending multicast with TTL=1.
If the Catalyst 6500 use PFC 3B add the command mls rate-limit all ttl-failure 100 10 to drop the multicast traffic in hardware.
The first option will take you longer, but at least you identify the cause and can advise the application owner why they should change their applications behaviour.
Regards

High CPU Utilization in 7603 router with RSP720-10GE

Hi everyone
We have a 7603 router with "RSP720-10GE" and we have high cpu utilization due to high amount of interrupts.
The output of “show cef drop” and “show ip cef switching statistics” commands show lots of packets that have been dropped by CEF.
But CEF is enabled on every physical interfaces and on every GRE tunnel that we have on this router.
As I understand the output of “show ip cef switching statistics” command shows some of the reasons for CEF dropping packets like “Routed to Null0” but I don’t know how to solve them. For example I can’t delete routes to Null0 because it’s going to cause routing loops in our network. Could you please help me

Hey,
The output shows high interrupt to CPU, So collect the last output multiple times to see if the DROP values are incrementing. Also configure NetDr captures to see what packets are punted to CPU. I am adding a link for same:
http://www.cisco.com/c/en/us/support/docs/switches/catalyst-6500-series-switches/116475-technote-product-00.html
HTH.
Regards,
RS

Attn: ALL APPLE PORTABLE OWNERS -Macbook Pro, MacBook Air Apple portable slowdown / kernel high CPU solution

Attn: ALL APPLE PORTABLE OWNERS -MacBook Pro, MacBook Air, Mac mini slowdown kernel / high CPU use problem and solution.
YOU COULD FRY YOUR COMPUTER IF YOU DO NOT FIX THIS PROBLEM SO PLEASE READ THIS ENTIRE MESSAGE!
YOUR MAC WILL THANK YOU
Hey all.
Like many of you I've got a newer Apple portable which slows down to an unusable level for an unknown reason. In my case a 13" mid 2009 Intel MacBook Pro Core 2 duo laptop. After many failed attempts to figure out what this nutty problem is I have discovered the problem, the solution and I have solved this for my own MacBook Pro. Since this fix it has been working immediately and consistently -without issue
I am sharing this with you in hopes that you to can fix your Apple portable yourself or so you know what to tell the Apple techs so they can quickly fix your Mac from this wacky and unfortunate kernel CPU hogging problem.
User Software Symptoms :
Your Apple portable computer periodically for an unknown reason slows down making everything frustratingly slow. This happens even when running previous apps that were never a problem; things that your Mac should be able to handle easily but for some reason now it can't.
Slowdown most often happens during high CPU use such as gaming, video playback/editing, etc. or when running multiple apps (even non CPU intensive apps) at the same time.
Possible Hardware Symptoms:
Your computer is making more noise than it did previously.
Your computer occasionally makes more noise but then gets quieter.
Your computer is always extremely quiet (too quiet) even during high CPU apps -worst case scenario.
It feels hotter than it normally does. Test: After several minutes of the slowness/high kernel CPU touch the computer to feel if it's hotter than normal.
Looking at Activity Monitor (in the Utilities folder) shows the kernel_task is going bonkers eating up CPU but you have no idea why.
After trying many different things to solve this problem such as :
PR ram reset, SMC reset, fresh OS install of 10.5 and 10.6 on external hard-drives, calling and speaking to various Apple tech people who had no ideas/solutions, etc. I had no luck.
Btw, if you're having the symptoms I've decscribed above I would not run the Apple Hardware check (read below as to why). You could fry your Mac!
After much testing I found the problem :
It is my belief that "recent" Apple portable computers are using low quality internal fans which soon stop working!
Fail time period seems to be about 1.0 years to 2.5 years of use but this fail rate could vary depending on use.
First noticeable symptoms (depending on what you notice) could be computer slowdown or your fan is making more noise than it normally does. This is your fan's lubrication slowly eroding making your fan spin slower and less smooth resulting in the louder noise and slower rpm spin speed. The slower fan spin speed means less cooling is happening for your computer. The effect on your computer is that the CPU and other chips are heating up! Overheating to be more specific. When your computer's chips overheat they get wonky and screw things up. Most often this seems to have the effect of making the kernel hog CPU resulting in a frustratingly slow user experience! Heat kills computer chips and it is extremely bad for them. Extreme overheat or repeated overheating has been said to shorten the life of computer chips or in extreme cases even fry them completely!
The longer this goes on without being fixed your fan loses more lubrication and spins slower and slower cooling lesser and lesser resulting in your CPU heating up more and more possibly shortening the life of your Mac! Eventually your fan will stop completely and you could fry your chips! My fan stopped completely and my MBP was running very quietly, too quietly. Luckily I did not fry my chips because I was avoiding using high CPU apps because I knew something was wrong due to the massive slow down and wonkiness when I'd run them.
Side Note:I'm a bit concerned about all those Mac mini servers which may be using the same defective low quality fans which cannot be easily serviced by their owners as they are co-located in some server facility. One positive thing is those facilities are usually well airconditioned keeping temps low.
I suggest you do not run the Apple hardware test if you suspect your computer is overheating because the hardware test can seriously heat up your Mac! I tried running this test and my Mac got so hot I had to shut it down forcefully and I was concerned I damaged the chips. If you want to run the Apple hardware check make sure your CPU temperature is ok and that your fan works well before you run the test.
IF YOU DON'T FIX THIS PROBLEM YOU COULD FRY YOUR COMPUTER DUE TO HEAT DAMAGE!
DO NOT IGNORE THIS PROBLEM YOUR MACS LIFE MAY DEPEND ON IT!
First you need to properly diagnose this problem and see if your CPU is getting to hot and you need to see if your fans are spinning at high rpms giving proper cooling, or if they are spinning at low rpms when running high intensive apps as your CPU temp increases.
TEST IF YOUR FAN(s) IS WORKING CORRECTLY :
Unfortunately Apple does not include CPU temperature reading software nor fan rpm speed software that I am aware of.
However, There are two free ways that I know of to check your CPU tempurature and your fan speed :
One app shows fan speed, and CPU heat, etc.
One app shows fan speed, CPU heat and allows you to adjust your fan speed settings.
One app is a dashboard widget, the other is a system preference.
I suggest you download both of these to check your computer statistics.
http://www.eidac.de/?p=134
http://www.islayer.com/apps/istatpro/
http://fan-control.en.softonic.com/mac
I am not exactly sure what proper CPU temperatures are for the different Apple computers and this will change given different CPU loads.
My MBP doesn't seem to function properly with anything around 90 degrees or higher (celcius).
It seems when the fan is operating normally the CPU temp should not stay above 78 degrees even under heavy load, at least with the apps I'm running in the room temperature I'm in.
I can post back later with more specific temps under longer load, etc. but I wanted to get this post up for people to read as soon as possible so they don't fry their Macs.
If a bad fan is your problem :
THERE ARE ONLY TWO SOLUTIONS FOR THIS PROBLEM :
Fix or replace your fan so it cools the CPU and other chips properly.
I fixed my fan myself and I didn't need to buy a new one. Total cost was about $8.00 because I had to buy a #00 sized screwdriver and had it shipped to me. Price includes shipping.
On my mid 2009 model MacBook Pro fixing the fan was incredibly easy :
Before I started doing this I wasn't 100% this was the problem so I decided to try to fix my fan instead of ordering a new one and replacing it. As it turns out I didn't need a new fan, I only needed to clean the existing fan and relube it's axl so it could spin easier like when it was new. It also didn't make sense to buy a brand new fan from an Apple authorized parts reseller selling me the same low quality fan for $49.00 which would probably fail in 2 years again. Prices for new comparable fans from different manufactures range from about $15.00 USD + shipping to around $49.00 USD + shipping depending on where you order them from and what brand you get.
How to fix / replace your internal fan on a mid 2009 MacBook Pro :
Please note : I am not a hardware technician, nor expert. If you decide to fix your Mac yourself you do so at your own risk through no fault of my own. Prior to opening up your Mac you should google around and learn how to do it correctly and safely so you won't damage your Mac. For example, it is possible for you to damage your Mac by static electricity from your body. To avoid this I believe proper procedure is that you wear a 'ground strap' (around your wrist) which you clip to your Mac's metal body so your body will not excude a charge into your Mac. I believe the idea here is to keep your body's charge level and your Mac's similar. Since I do not have a ground strap and fixing/replacing the fan doesn't require touching any chips I did not wear a ground strap during my fan fix. What I did was periodically repeatedly touch the metal case of my MBP hoping that would be enough and it was. Avoid unecessary actions that can build up a static charge in you. Once I started the repair I did not walk around the room building up an electrical charge in my body. Walking on carpet can often build up a large charge in us so it is better to be avoided while working on your Mac. Certain clothing can build up static charges. Combing hair, etc. If you need to get up from your repair when you come back make sure you first touch the Mac's metal case and not anything inside.
Now that we're done with the scary paranoia, below you will find some instructions on how I fixed my MBP's internal fan
Before you begin:
Check out someone's video (not mine) on how to remove / replace the fan (but not take it apart and repair it):
http://www.youtube.com/watch?v=AghE9newvbs
Check out someone's web page (not mine) on how to replace the fan in a mid 2009 MacBook Pro:
http://www.ifixit.com/Guide/Installing-MacBook-Pro-13-Inch-Unibody-Mid-2009-Fan/ 1338/1
How to repair your mid 2009 MacBook Pro fan:
Make sure you are in a 'secure' environment. No pets, no kids running around, no drinks near the Mac, etc.
Make sure your computer is unplugged from it's power supply and turned off. NOT slept. Totally off / powered down.
1. Get a size #00 phillips screwdriver (Hobby store, Radioshack, Amazon).
2. Open up your MBP by unscrewing the bottom (yes flip it over so it's resting upsidedown). Note where each screw goes because some are different lengths. I placed each one around my MBP where they go, insuring I know their order (don't jumble them up). Note which direction your MBP is facing when it's upside down so if you spin it around while working on it you still know where the screws go.
2b. Some recommend removing the MBP's battery but I didn't do this step. You probably should, just to be safe. Follow the online instructions from the web page I listed about disconnecting the battery.
3. Unscrew the fan's 3 holding screws.
4. Unplug the fan's electrical connection (lift it straight up off the board). If you need to you can try to pry it up while you lift with a non metal/non electrical conductive object like a spudger if you have one or -perhaps a pen cap. Before you remove it, look closely at how it's attached so when you put it back on you won't wonder if you're doing it correctly. There's only one way it can go because it cannot fit 'the wrong way' but looking at it closely will make you feel more confident popping it back on when the time comes.
5. Remove the fan - it easily lifts out.
6. Take the fan apart by unscrewing it's one screw then unlatching the plastic clips which hold it together.
7. Seperate the fan blades from the housing. Lift the fan blades off of the fan housing by pulling it straight out away from the housing.
8. Clean off the dust that's gathered. A can of compressed air helps here (I didn't have one). I used a little brush from my electric shaver kit which worked well. Once you've removed all the dust from the fan and surrounding areas proceed to the next step.
9. Reapply new lubrication. You need less than 1 drop. Be sure it covers the entire fan blade axl as this is what needs to be well lubricated. Make sure there isn't excess oil that will fly around when the axl/fan spins at high rpms. I used the only oil I had which was olive oil (for cooking!) but I do not suggest this. At the time I was doing this I didn't know my fan was the problem so I wasn't even sure I was going to relube it. You should probably use something more appropriate perhaps like 3 in 1 oil. A good idea would be to call the manufatures of these little fans and ask them. Maybe a hobby store knows of good lubricants for these purposes?
DO NOT use things like WD 40 as it's not a long term lubricant or so I've read.
10. Once your fan is now clean and oiled (make sure there isn't too much oil) reassmble the fan.
Push the fan blades/axl back into the housing shaft. Give it a few spins with your finger.
Screw together the fan housing then reclip the clips.
11. Place the now reassembled fan back into your Mac and screw it in place (3 screws).
12. Reattach the fan's electrical wiring by gently pushing it into place. Make sure you've got the right end facing down before you push it in place.
13. Once your Mac's internals are clean and reassembled, place the rear cover back on your Mac and screw it in place.
14. Double check you didn't forget anything like screws, tools, etc.
15. Boot up your Mac and monitor the temperature and fan speed using those programs.
Compare the previous temps/fan speed to the current temp/fan speed.
Run a high CPU intensive app where your computer has been slowing down.
You should now have a happy Mac
If you have this problem and this solution fixed it for you please post in this thread letting me and everyone else know!
Hope that helps.

Thanks for your lengthy reminder dude, I have a similar Mac with yours. I suspect its a software fault because it happens after I upgraded to Lion, 10.7.2.

Tecra M2 - hard shutdown on high CPU (turns off with no BSOD)

Have been experiencing consistent shutdowns when CPU runs at full for a little while.
- by "shutdowns" I mean complete power cut with no blue screen of death where all is lost and the computer has to be manually restarted.
- by "high CPU" I mean when the processor locks at full usage such as when you insert a column into a large Excel sheet with errors or when you are RARing a large number of files and you open a video from the network or when you run a virus scan and registry scan at the same time.
The problem has been occurring regularly for a couple of months and I can now manufacture an occurrence with high predictability. Using the hardware monitor suite 'Everest', it seems the problem happens when the CPU temperature sits at 99 for more than a minute or so.
It happen with some but never when running from batteries - during attempts to force the error, it will not shutdown if the power cable is pulled out just before the crash point.
In many instances of the problem, there seems to be a small error message which pops up only a fraction of a second before the computer dies.
Every forum and help reference I read would suggest the problem is hardware related and that the chip or motherboard is overheating and in need of replacement. While the laptop is nearly 18 months old, I bought a new "everything but the screen and HDD" early this year and was not prepared to accept the explanation without more testing.
Kantonix Linux works fine and the boot from CD seems to tax the processor as much as the same events that are killing it for me under XP.
A few weeks back, I installed the WinXP on a second HDD in the hotswappable bay and noted the installation seems to run the computer pretty hot and it did not die during the process. No problems were experienced for while but, a few days after moving the reinstalled HDD into the primary position and having reinstalled many many applications, the error started happening again.
Last night I caught it just fractions of a second before death, pulling the power and stopping the process and allowing me to see the error message (as referred above) properly:
- first message was from "TOSHIBA Power Saver" saying "A fatal errorn has occurred x06" (not sure on the last bit)
- second message was from "THotkey.exe" saying "Cannot load powrprof.dll"
- many hundreds of instances of the second message followed.
Due to error messages, I wasn't able to get a screen print.
Any solutions or even ideas about such would be very much appreciated!
Message was edited by: DC-Financial

Hello Markus, thank you for your suggestion and apologies for the lateness of this reply (thought I was supposed to receive email notification (?!?)).
I agree with your initial assessment "sounds like software related issue" and I would hate to think it is hardware - am die hard Toshiba man! (onto my 5th in as many years) .
Anywho, I have been through all the power saver options, as well as the CPU options under the Toshiba HWSetup: the system crashes under all situations if properly encouraged.
NB: Per my understanding, one shouldn't be able to crash a Pentium M, operating within the acceptable environmental conditions and I am working in a room between 16 & 20 degrees.
It is much more difficult to crash when it has been off for a while (ie. when it is cooler) and is more difficult to crash when on batteries as opposed to AC. Tried switching the RAM during the week and after mistakenly thinking it was all fixed, the problem resurfaced again. While I had the keyboard off, I had a look at the fan and there is a bit of dust on it but not very much. I have a Tecra M3 also, which is only half the age and, compared the fans, the M2 is about twice as dusty [if it were on your dinner table you'd wipe it down but there is not so much that you would imagine it to be a problem].
I mentioned previously that I was using Everest to monitor outputs from the temperature sensors and that crashes occur when the CPU temperature sits at 99 degrees for a while. Sometimes after turning it on after a crash, Everest is not able to display the CPU temperature. Am very reluctant to believe that the heat sensor on the chip has malfunctioned as all the internals were replaced in January (as was stolen and recovered somewhat worse for the adventure).
I have had to bite the bullet and move all my work to the Tecra M3 but am not very happy with this (the M3 I have is 1.86Ghz w/ 512MB vs 2.03Ghz w/ 1536MB RAM in the M2). As I'm sure you will appreciate, the cost of the M2 has now already been spent many times over in lost work time but one needs to know if they have an error related to software or if it is hardware, so as not to live in fear of a recurrance.
I will reinstall the M2 OS as soon as the work lag is caught up again (probably later this week) but really don't know what to try other than crash testing after each piece of software is reinistalled. Note, have already run the Toshiba Hardware Diagnosis console with no errors identified.
If you have any suggestions or thoughts on what I should try they are greatly appreciated!

High CPU usage after 10g to 11g Migration

Hello,
I have migrated some database instances via import/export from 10g 10.0.3.0 to 11g 11.2.0.2
I found that below SQL Statements mainly cause the high CPU load
select * from (select null table_qualifier, o1.owner table_owner, o1.object_name table_name, decode(o1.owner, :"SYS_B_00", decode(o1.object_type, :"SYS_B_01", :"SYS_B_02", :"SYS_B_03", :"SYS_B_04", o1.object_type), :"SYS_B_05", decode(o1.object_type, :"SYS_B_06", :"SYS_B_07", :"SYS_B_08", :"SYS_B_09 ", o1.object_type), o1.object_type) table_type, null remarks from all_objects o1 where o1.object_type in (:"SYS_B_10", :"SYS_B_11") union select null table_qualifier, s.owner table_owner, s.synonym_name table_name, :"SYS_B_12" table_type, null remarks from all_objects o3, all_synonyms s where o3.object_type in (:"SYS_B_13", :"SYS_B_14") and s.table_owner= o3.owner and s.table_name = o3.object_name union select null table_qualifier, s1.owner table_owner, s1.synonym_name table_name, :"SYS_B_15" table_type, null remarks from all_synonyms s1 where s1.db_link is not null ) tables WHERE :"SYS_B_16"=:"SYS_B_17" AND TABLE_NAME=:"SYS_B_18" ORDER BY :"SYS_B_19", :"SYS_B_20", :"SYS_B_21"
(SELECT :"SYS_B_00", T.owner, T.table_name, TO_NUMBER(NULL), :"SYS_B_01", :"SYS_B_02", :"SYS_B_03", TO_NUMBER(NULL), :"SYS_B_04", :"SYS_B_05", num_rows, blocks, NULL FROM ALL_TABLES T WHERE table_name=:"SYS_B_06" UNION SELECT :"SYS_B_07", a.table_owner, a.table_name, decode(a.uniqueness, :"SYS_B_08", :"SYS_B_09", :"SYS_B_10"), a.owner, a.index_name, :"SYS_B_11&q uot;, b.column_position, b.column_name, :"SYS_B_12", a.distinct_keys, a.leaf_blocks, NULL FROM ALL_INDEXES a, ALL_IND_COLUMNS b WHERE a.owner = b.index_owner AND a.index_name = b.index_name AND a.table_owner=:"SYS_B_13" AND a.table_name=:"SYS_B_14" UNION SELECT :"SYS_B_15", c.owner, c.synonym_name, decode(a.uniqueness, :"SYS_B_16", :"SYS_B_17", :"SYS_B_18"), a.owner, a.index_name, :"SYS_B_19", b.colu mn_position, b.column_name, :"SYS_B_20", a.distinct_keys, a.leaf_blocks, NULL FROM ALL_INDEXES a, ALL_IND_COLUMNS b, ALL_SYNONYMS c WHERE c.synonym_name=:"SYS_B_21" AND c.owner=:"SYS_B_22" AND c.table_name = a.table_name AND c.table_name = b.table_name AND c.table_owner= a.table_owner AND c.table_owner= b.table_owner AND a.owner = b.index_owner AND a.index_name = b.index_name ) ORDER BY :"SYS_B_23", :"SYS_B_24", :"SYS_B_25", : "SYS_B_26"
Does anyone know why it is so??
I have gathered System Statistics and data dictionary statistics also, but had same performance issue.
Thanks,
Raj

We have a similar issue:
SELECT '', T.owner, T.table_name, TO_NUMBER(NULL), '', '', 0, TO_NUMBER(NULL), '', '', num_rows, blocks, NULL FROM ALL_TABLES...
It appears this kind of statement is being generated from MS Access 2007 as part of a translation to Oracle SQL. I suspect Access 2007 doesn't know about the 11gR2 system catalog changes.
The Oracle SQL Advisor indicates the following on the SQL statement comming from Acess 2007:
Restructure SQL An expensive cartesian product operation was found at line ID 5 of the execution plan. Consider removing the disconnected table or view from this statement or add a join condition which refers to it. A cartesian product should be avoided whenever possible because it is an expensive operation and might produce a large amount of data.
Restructure SQL An expensive "UNION" operation was found at line ID 1 of the execution plan. Consider using "UNION ALL" instead of "UNION", if duplicates are allowed or uniqueness is guaranteed. "UNION" is an expensive and blocking operation because it requires elimination of duplicate rows. "UNION ALL" is a cheaper alternative, assuming that duplicates are allowed or uniqueness is guaranteed.
I think application needs to upgrade to Access 2010 or Access 2007 needs a service pack.
There is also supposed to be a way to remove the system & sys catalog calls from Access 2007 on the PC this is coming from.

CUCM 8.6(2) - High CPU utilization - CCM process

Hello,
Process name ccm is peacking 91% of CPU utilization in one of Subscribers.
On cluster there are 1 Pub, 2 Subs, and 2 TFTP.
CCM service was already restart, and Subs reload, but problem remain.
We have checked and removed association with phones not registered, but problem remain.
Proc,PID,CPU,Status,SharedMem,Nice(Level)VmRSS,VMSize,VMData,ThreadCount,DataStackSize,PageFault
ccm,32687,90,SLEEPING,87380,0,426792,605276,468544,47,418345,744
VMware Installation:
        1 vCPU: Intel(R) Xeon(R) CPU E5-2643 0 @ 3.30GHz
        Disk 1: 80GB
        4096 Mbytes RAM
admin:show process name ccm
PID PPID   TID %CPU S COMMAND
32687     1 32687 0.0 S ccm
32687     1 19549 0.0 S ccm
32687     1 19570 0.0 S ccm
32687     1 19639 0.0 S ccm
32687     1 20057 0.0 S ccm
32687     1 20331 0.0 S ccm
32687     1 20332 0.0 S ccm
32687     1 20333 0.0 S ccm
32687     1 20354 0.0 S ccm
32687     1 20360 0.0 S ccm
32687     1 20361 0.0 S ccm
32687     1 23336 0.0 S ccm
32687     1 23337 0.0 S ccm
32687     1 23338 0.0 S ccm
32687     1 23339 1.0 S ccm
32687     1 23340 0.1 S ccm
32687     1 23341 0.2 S ccm
32687     1 23342 0.0 S ccm
32687     1 23349 0.0 S ccm
32687     1 23988 0.0 S ccm
32687     1 23989 21.6 S ccm
32687     1 23990 0.7 S ccm
32687     1 24013 0.0 S ccm
32687     1 24043 0.0 R ccm
32687     1 24044 0.0 S ccm
32687     1 24045 0.0 S ccm
32687     1 24046 0.0 S ccm
32687     1 24047 0.0 S ccm
32687     1 24048 0.7 R ccm
32687     1 24049 0.2 S ccm
32687     1 24050 0.1 R ccm
32687     1 24051 0.0 S ccm
32687     1 24052 0.0 S ccm
32687     1 24053 0.0 S ccm
32687     1 24054 0.0 S ccm
32687     1 24091 0.0 S ccm
32687     1 24092 0.0 S ccm
32687     1 24093 0.0 S ccm
32687     1 24181 0.0 S ccm
32687     1 24182 0.0 S ccm
32687     1 24192 0.0 S ccm
32687     1 24277 0.1 S ccm
32687     1 24278 0.0 S ccm
32687     1 24279 0.0 S ccm
32687     1 24280 0.0 S ccm
32687     1 24281 0.0 S ccm
32687     1 24282 0.0 S ccm
admin:
Are there any specific tests, or logs prior to isolate this issue?

Hi,
A few points:
> Use one of the recommended OVA templates
> Check if the spike is random or occurs at a specific time. If it occurs at a specific time it could be coinciding with something like DRS backup, CDR load, busy hours etc.
> Minimum set of logs needed for one such high CPU spike instance are:
Detailed ccm traces from all nodes
RisDC Perfmon logs
Proglogs
Also, capture the output of the following:
utils diagnose test
utils core active list
show process load
HTH
Manish

6500 - HIGH CPU UTILIZAITON

Similar Messages

Maybe you are looking for