Switch High cpu Catalyst 4500 Version 12.2(53)SG5

I need help trying to understand the following.
                     %CPU   %CPU    RunTimeMax   Priority Average %CPU Total
                     Target Actual Target Actual   Fg   Bg 5Sec Min Hour CPU
GalChassisVp-review    3.00   0.10     10     45 100 500    0   0    0 701:22
K2AclCamMan hw stats   3.00   1.48     10      5 100 500    0   0    0 3265:20
K2AclCamMan kx stats   1.00   0.10     10      5 100 500    0   0    0 1917:38
K2L2 Address Table R   2.00 72.93     12      5 100 500   95 87   66 458521:03
K2PortMan Review       3.00   4.73     15     11 100 500    5   5    4 28199:47
K2Fib Consistency Ch   1.00   0.19      5      2 100 500    0   0    0 1082:02
K2FibPbr route map r   2.00   0.21     20      5 100 500    0   0    0 2031:50
K2QosDblMan Rate DBL   2.00   0.11      7      1 100 500    0   0    0 662:26
K2 VlanStatsMan Revi   2.00   0.39     15      2 100 500    0   0    0 2062:11
K2PacketBufMonitor-P   3.00   2.76     10      1 100 500    2   2    2 13968:10
RkiosPortMan Port Re   2.00   0.30     12     29 100 500    0   0    0 1744:23
RkiosIpPbr IrmPort R   2.00   0.22     10      3 100 500    0   0    0 342:05
Grandprix 1-1 Stub R   2.00   0.17     15      5 100 500    0   0    0 1244:55
Grandprix 1-2 Stub R   2.00   0.14     15      5 100 500    0   0    0 866:57
Grandprix 1-3 Stub R   2.00   0.13     15      5 100 500    0   0    0 840:36
Grandprix 1-4 Stub R   2.00   0.16     15      5 100 500    0   0    0 846:55
Grandprix 1-5 Stub R   2.00   0.14     15      5 100 500    0   0    0 855:31
Grandprix 1-6 Stub R   2.00   0.15     15    124 100 500    0   0    0 1051:18
Grandprix 1-1 Stats    2.00   0.64      4      2 100 500    0   0    0 3151:58
Grandprix 1-2 Stats    2.00   0.48      4      2 100 500    0   0    0 675:30
Grandprix 1-3 Stats    2.00   0.20      4      2 100 500    0   0    0 567:34
Grandprix 1-6 Stats    2.00   0.35      4      2 100 500    0   0    0 2072:59
%CPU Totals          241.20 101.19
                       Allocation ceiling        Current allocation
                       kbytes    % in use        kbytes    % in use
Linecard 1's Store        258.00      62%          161.12      100%
TSM objects            ------------------        ------------------
PacketInfoItem            859.37       0%            0.64        0%
VbufNodes1600              55.50       0%            5.20        0%
VbufNodes400              288.00       0%            1.12       50%
PacketBufRaw            25219.50     100%        25219.50      100%
PacketBufRawJumbo         184.29     100%          184.29      100%
Packet                   2079.42       0%           54.10        0%
PimPhyports              1054.68       5%           54.84      100%
PimPorts                  906.25      11%          105.12      100%
PimModules                162.00       0%            0.63      100%
PimChassis                 38.37       6%            2.39      100%
EbmVlans                 5088.00       1%           67.07      100%
EbmPorts                  344.00      11%           38.63      100%
IrmVrfs                   315.00       0%            2.46       50%
IrmFibEntries           12288.00       0%            0.75        6%
IrmMfibEntryMemMan       6656.00       0%            0.10      100%
Acl                      1536.00       0%            1.87      100%
Ace24                    9215.85       0%            4.92      100%
Ace48                   15359.76       0%            0.35      100%
AclListNode               256.00       0%            0.30      100%
AclClassifierActionL     1152.00       0%            1.40       87%
CommandTables              48.00      22%           10.59      100%
K2FibVrfs                 152.00       0%            1.18       50%
K2TxPacketInfo            256.00       0%            0.25        0%
Packets Dropped In Hardware By CPU Subport (txQueueNotAvail)
CPU Subport TxQueue 0       TxQueue 1       TxQueue 2       TxQueue 3
           1               0               0               0             822
           2               0         7538177               0               0
RkiosSysPacketMan:
Packet allocation failures: 0
Packet Buffer(Software Common) allocation failures: 0
Packet Buffer(Software ESMP) allocation failures: 0
Packet Buffer(Software EOBC) allocation failures: 0
Packet Buffer(Software SupToSup) allocation failures: 0
IOS Packet Buffer Wrapper allocation failures: 0
Packets Dropped In Processing Overall
Total                5 sec avg 1 min avg 5 min avg 1 hour avg
                 881         0         0         0          0
Packets Dropped In Processing by CPU event
Event             Total                5 sec avg 1 min avg 5 min avg 1 hour avg
SA Miss                            874         0         0         0          0
Packets Dropped In Processing by Priority
Priority          Total                5 sec avg 1 min avg 5 min avg 1 hour avg
Normal                               7         0         0         0          0
Medium                             881         0         0         0          0
Packets Dropped In Processing by Reason
Reason             Total                5 sec avg 1 min avg 5 min avg 1 hour avg
SrcAddrTableFilt                     87         0         0         0          0
STPDrop                             771         0         0         0          0
L2DstDrop                            21         0         0         0          0
NoDstPorts                            2         0         0         0          0
Total packet queues 16
Packets Received by Packet Queue
Queue                  Total           5 sec avg 1 min avg 5 min avg 1 hour avg
L2/L3Control                7269264609       236       268       214        205
Host Learning               3617387874        38        49        38         53
L3 Fwd Low                    21851501         0         0         0          0
L2 Fwd Low                     6786759         0         0         0          0
L3 Rx High                        1582         0         0         0          0
L3 Rx Low                        10306         0         0         0          0
Packets Dropped by Packet Queue
Queue                  Total           5 sec avg 1 min avg 5 min avg 1 hour avg
L2/L3Control                     73992         0         0         0          0
Host Learning                  7561249         0         0         0          0
Queue                  Total           5 sec avg 1 min avg 5 min avg 1 hour avg
L2/L3Control                7269264609       236       268       214        205
PacketBufRaw            25219.50     100%        25219.50      100%
PacketBufRawJumbo         184.29     100%          184.29      100%
Both of these seem a bit high don't you think?
If you have any idea as to why this is happening. Or is this normal?
Thanks

Hi,
This could be related to L2 issues like a loop, see that the K2L2 Address Table R process has a target of 2.00% and is currently running at 72.93%, which is way over the expected target, this can be an indication of host/mac flapping issues. Also the host learning queue seems very high and the L2/L3 control.
You can enable mac notification mac move command to see if on the logs are any flapping issues. Also below is a link which is very helpful when dealing with high cpu issues on 4500.
http://www.cisco.com/c/en/us/support/docs/switches/catalyst-4000-series-switches/65591-cat4500-high-cpu.html
Hope this helps.

Similar Messages

High cpu C4948

Could you explain please reason first ACL,log unreach.
No log key in ACL, switch has a lot of VLAN with ACL in.
Packets Received by Packet Queue
Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
L2/L3Control 236758309 36 34 35 34
Host Learning 6011600 0 0 0 0
L3 Fwd Low 2424793938 2 0 1 8
L2 Fwd Low 201893895 34 33 36 43
L3 Rx Low 34737942 19 3 3 5
RPF Failure 494739 0 0 0 0
ACL log, unreach 27408733812 2770 13291 11964 6553
ACL sw processing 520 0 0 0 0
Packets Dropped by Packet Queue
Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
L2/L3Control 1509428 0 0 0 0
Host Learning 24358337 0 0 0 0
L3 Fwd Low 32625 0 0 0 0
L2 Fwd Low 29248805 0 0 0 0
L3 Rx Low 19362 0 0 0 0
ACL log, unreach 4465098816 5 410 345 339
Thank you

Looks to be like some issue iwth your ACL.
To help isolate the issue, I would request you to answer the following
questions:
1. Since how long the device has been running with high Cpu?
2. Have you made any hardware/software or configuration changes on these
devices which lead to high CPU utilization?
To isolate the issue, I would request you to send me the following:
1. Show proc cpu sorted | ex 0.00 (3-4 times)
2. Show proc cpu history
3. Show platform cpu packet statistics all
4. Show platform health
Additionally I would also like you to:
#debug platform packet all receive buffer
Wait 30 seconds and capture the command below:
#show platform cpu packet buffered (Twice)
#undebug all
Note: All these outputs should be taken while the CPU indicates high.
Please see a very handy document on handling high CPU on 4500 switches
http://www.cisco.com/en/US/products/hw/switches/ps663/products_tech_note0918
6a00804cef15.shtml
HTH

High CPU with error "%ADJ-3-RESOLVE_REQ:" in Catalyst 4500-X VSS after making L3 function (static routing)

We have a VSS based on 2x WS-C4500X-16., The VSS is used as Layer 2 Switch for diffrents Vlan in our DC.
After making the VSS as a Layer 3 gateway for our production VLAN and added 2 routes for routing purposes, we encountered a network down time with high CPU in the VSS and a huges log messages :
.May 14 12:11:25.947: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.7.22 Vlan100
.May 14 12:11:34.516: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.7.22 Vlan100
.May 14 12:11:40.072: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.1.1.254 Vlan100
.May 14 12:11:49.682: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.1.253 Vlan100
.May 14 12:11:55.079: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.1.1.254 Vlan100
.May 14 12:12:00.926: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.7.40 Vlan100
.May 14 12:12:06.701: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.8.32 Vlan100
.May 14 12:12:12.624: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.7.40 Vlan100
.May 14 12:12:21.627: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.7.40 Vlan100
.May 14 12:12:32.261: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.8.32 Vlan100
.May 14 12:12:41.801: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.2.105 Vlan100
.May 14 12:12:49.633: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.1.253 Vlan100
.May 14 12:12:54.831: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.1.1.254 Vlan100
.May 14 12:12:59.960: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.1.1.254 Vlan100
.May 14 12:13:08.745: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.1.253 Vlan100
.May 14 12:13:16.138: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.1.253 Vlan100
.May 14 12:13:22.393: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.1.253 Vlan100
.May 14 12:13:31.415: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.1.141 Vlan100
.May 14 12:13:38.944: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.2.215 Vlan100
.May 14 12:13:45.972: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.1.253 Vlan100
Bellow are the show version of our VSS,
Cisco IOS Software, IOS-XE Software, Catalyst 4500 L3 Switch Software (cat4500e-UNIVERSALK9-M), Version 03.04.00.SG RELEASE SOFTWARE (fc3)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2012 by Cisco Systems, Inc.
Compiled Wed 05-Dec-12 04:38 by prod_rel_team
ROM: 15.0(1r)SG10
S_C4500X_01 uptime is 33 weeks, 1 day, 14 minutes
Uptime for this control processor is 33 weeks, 1 day, 16 minutes
System returned to ROM by power-on
System restarted at 11:59:10 UTC Tue Sep 24 2013
Running default software
Jawa Revision 2, Winter Revision 0x0.0x40
Last reload reason: power-on
License Information for 'WS-C4500X-16'
License Level: ipbase Type: Permanent
Next reboot license Level: ipbase
cisco WS-C4500X-16 (MPC8572) processor (revision 9) with 4194304K/20480K bytes of memory.
Processor board ID JAE173303CF
MPC8572 CPU at 1.5GHz, Cisco Catalyst 4500X
Last reset from PowerUp
4 Virtual Ethernet interfaces
32 Ten Gigabit Ethernet interfaces
511K bytes of non-volatile configuration memory.
Configuration register is 0x2101
Can you help please,

Hi,
thanks for your reply, but there is no hsrp configured, just an interface vlan. with 2 static routes and the problem was there for more than an hour before we decided to rollback.
Is there a BugId with this problem in Cisco DataBase.
here is a show ip route
S_C4500X_01# show ip route
Codes: L - local, C - connected, S - static, R - RIP, M - mobile, B - BGP
D - EIGRP, EX - EIGRP external, O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2
i - IS-IS, su - IS-IS summary, L1 - IS-IS level-1, L2 - IS-IS level-2
ia - IS-IS inter area, * - candidate default, U - per-user static route
o - ODR, P - periodic downloaded static route, H - NHRP, l - LISP
+ - replicated route, % - next hop override
Gateway of last resort is 10.2.1.253 to network 0.0.0.0
S* 0.0.0.0/0 [1/0] via 10.2.1.253
10.0.0.0/8 is variably subnetted, 2 subnets, 2 masks
C 10.0.0.0/8 is directly connected, Vlan100
L 10.1.1.250/32 is directly connected, Vlan100
172.31.0.0/16 is variably subnetted, 2 subnets, 2 masks
C 172.31.0.0/16 is directly connected, Vlan120
L 172.31.0.1/32 is directly connected, Vlan120
S 192.1.0.0/16 [1/0] via 10.1.1.254
and the show ip cef:
_C4500X_01# show ip cef
.May 14 12:13:57.859: %ADJ-3-RESOLVE_REQ: Adj resolve request: Failed to resolve 10.2.1.158 Vlan100 f
Prefix Next Hop Interface
0.0.0.0/0 10.2.1.253 Vlan100
0.0.0.0/8 drop
0.0.0.0/32 receive
10.0.0.0/8 attached Vlan100
10.0.0.0/32 receive Vlan100
10.1.1.6/32 attached Vlan100
10.1.1.17/32 attached Vlan100
10.1.1.40/32 attached Vlan100
10.1.1.41/32 attached Vlan100
10.1.1.50/32 attached Vlan100
10.1.1.60/32 attached Vlan100
10.1.1.99/32 attached Vlan100
10.1.1.121/32 attached Vlan100
10.1.1.122/32 attached Vlan100
10.1.1.124/32 attached Vlan100
10.1.1.125/32 attached Vlan100
10.1.1.126/32 attached Vlan100
10.1.1.225/32 attached Vlan100
10.1.1.227/32 attached Vlan100
10.1.1.250/32 receive Vlan100
10.1.1.254/32 10.1.1.254 Vlan100
10.2.1.3/32 attached Vlan100
10.2.1.4/32 attached Vlan100
10.2.1.6/32 attached Vlan100
10.2.1.8/32 attached Vlan100
10.2.1.9/32 attached Vlan100
10.2.1.18/32 attached Vlan100
10.2.1.23/32 attached Vlan100
10.2.1.24/32 attached Vlan100
Prefix Next Hop Interface
10.2.1.26/32 attached Vlan100
10.2.1.28/32 attached Vlan100
10.2.1.29/32 attached Vlan100
10.2.1.31/32 attached Vlan100
10.2.1.103/32 attached Vlan100
10.2.1.108/32 attached Vlan100
10.2.1.109/32 attached Vlan100
10.2.1.124/32 attached Vlan100
10.2.1.129/32 attached Vlan100
10.2.1.137/32 attached Vlan100
10.2.1.139/32 attached Vlan100
10.2.1.143/32 attached Vlan100
10.2.1.144/32 attached Vlan100
10.2.1.159/32 attached Vlan100
10.2.1.167/32 attached Vlan100
10.2.1.174/32 attached Vlan100
10.2.1.175/32 attached Vlan100
10.2.1.176/32 attached Vlan100
10.2.1.181/32 attached Vlan100
10.2.4.38/32 attached Vlan100
10.2.4.39/32 attached Vlan100
10.2.4.43/32 attached Vlan100
10.2.4.47/32 attached Vlan100
10.2.4.51/32 attached Vlan100
10.2.4.63/32 attached Vlan100
10.2.4.65/32 attached Vlan100
10.2.4.69/32 attached Vlan100
10.2.4.71/32 attached Vlan100
10.2.4.73/32 attached Vlan100
10.2.4.102/32 attached Vlan100
10.2.4.106/32 attached Vlan100
10.2.4.107/32 attached Vlan100
10.2.4.113/32 attached Vlan100
10.2.4.116/32 attached Vlan100
10.2.4.119/32 attached Vlan100
10.2.4.120/32 attached Vlan100
10.2.4.122/32 attached Vlan100
10.2.4.141/32 attached Vlan100
10.2.4.148/32 attached Vlan100
10.2.6.7/32 attached Vlan100
Prefix Next Hop Interface
10.2.6.16/32 attached Vlan100
10.2.6.31/32 attached Vlan100
10.2.7.14/32 attached Vlan100
10.2.7.22/32 attached Vlan100
10.2.7.24/32 attached Vlan100
10.2.7.34/32 attached Vlan100
10.2.7.37/32 attached Vlan100
10.2.7.41/32 attached Vlan100
10.2.7.48/32 attached Vlan100
10.2.8.18/32 attached Vlan100
10.2.8.32/32 attached Vlan100
10.2.8.59/32 attached Vlan100
10.2.8.70/32 attached Vlan100
10.2.8.85/32 attached Vlan100
10.2.8.88/32 attached Vlan100
10.2.8.104/32 attached Vlan100
10.2.8.135/32 attached Vlan100
10.2.99.10/32 attached Vlan100
10.2.99.54/32 attached Vlan100
10.255.255.255/32 receive Vlan100
127.0.0.0/8 drop
172.31.0.0/16 attached Vlan120
172.31.0.0/32 receive Vlan120
172.31.0.1/32 receive Vlan120
172.31.0.5/32 attached Vlan120
172.31.0.29/32 attached Vlan120
172.31.255.255/32 receive Vlan120
192.1.0.0/16 10.1.1.254 Vlan100
224.0.0.0/4 drop
224.0.0.0/24 receive
Prefix Next Hop Interface
240.0.0.0/4 drop
and show ip arp
Protocol Address Age (min) Hardware Addr Type Interface
Internet 10.1.1.1 0 aa00.0400.c286 ARPA Vlan100
Internet 10.1.1.6 0 0050.5689.24b8 ARPA Vlan100
Internet 10.1.1.10 0 0050.5694.7d20 ARPA Vlan100
Internet 10.1.1.11 0 0050.5694.7d20 ARPA Vlan100
Internet 10.1.1.12 0 0050.5694.6ae7 ARPA Vlan100
Internet 10.1.1.13 0 0050.5694.6ae7 ARPA Vlan100
Internet 10.1.1.14 0 0050.568a.6321 ARPA Vlan100
Internet 10.1.1.16 0 0050.5694.0ab5 ARPA Vlan100
Internet 10.1.1.17 0 0050.5694.493d ARPA Vlan100
Internet 10.1.1.40 0 0013.19b0.9c40 ARPA Vlan100
Internet 10.1.1.41 0 1c17.d35a.c840 ARPA Vlan100
Internet 10.1.1.50 0 0002.b9b4.a5c0 ARPA Vlan100
Internet 10.1.1.60 0 000a.410f.e500 ARPA Vlan100
Internet 10.1.1.71 - 0008.e3ff.fc28 ARPA Vlan100
Internet 10.1.1.96 0 e02f.6d12.4df3 ARPA Vlan100
Internet 10.1.1.98 0 0050.5696.6d86 ARPA Vlan100
Internet 10.1.1.99 0 0050.5696.6d88 ARPA Vlan100
Internet 10.1.1.121 0 e02f.6d12.4dea ARPA Vlan100
Internet 10.1.1.122 0 e02f.6d12.4e61 ARPA Vlan100
Internet 10.1.1.123 0 e02f.6d5b.c10e ARPA Vlan100
Internet 10.1.1.124 0 e02f.6d17.c869 ARPA Vlan100
Internet 10.1.1.125 0 e02f.6d5b.c217 ARPA Vlan100
Internet 10.1.1.126 0 e02f.6d17.c8ec ARPA Vlan100
Internet 10.1.1.127 0 e02f.6d17.c876 ARPA Vlan100
Internet 10.1.1.128 0 e02f.6d5b.bef3 ARPA Vlan100
Internet 10.1.1.202 0 0000.85b7.9031 ARPA Vlan100
Internet 10.1.1.222 0 000f.f84d.2ca9 ARPA Vlan100
Internet 10.1.1.225 0 000f.f84d.3963 ARPA Vlan100
Internet 10.1.1.227 0 00c0.ee26.9367 ARPA Vlan100
Protocol Address Age (min) Hardware Addr Type Interface
Internet 10.1.1.250 - 0008.e3ff.fc28 ARPA Vlan100
Internet 10.1.1.254 0 0000.0c07.ac07 ARPA Vlan100
Internet 10.2.1.2 0 0011.4333.bcda ARPA Vlan100
Internet 10.2.1.3 0 0050.5689.5d38 ARPA Vlan100
Internet 10.2.1.4 0 0050.5689.0404 ARPA Vlan100
Internet 10.2.1.6 0 0050.5689.6d3b ARPA Vlan100
Internet 10.2.1.7 0 1cc1.def4.6940 ARPA Vlan100
Internet 10.2.1.8 0 0050.5689.330e ARPA Vlan100
Internet 10.2.1.9 0 0012.793a.3ccc ARPA Vlan100
Internet 10.2.1.10 0 0012.7990.e5d3 ARPA Vlan100
Internet 10.2.1.13 0 0050.568a.6dcf ARPA Vlan100
Internet 10.2.1.15 0 0050.568a.60ff ARPA Vlan100
Internet 10.2.1.18 0 0050.5689.091b ARPA Vlan100
Internet 10.2.1.20 0 0050.5689.451c ARPA Vlan100
Internet 10.2.1.21 0 0050.568a.0cf4 ARPA Vlan100
Internet 10.2.1.22 0 0050.5689.6c59 ARPA Vlan100
Internet 10.2.1.23 0 0050.5696.6d9e ARPA Vlan100
Internet 10.2.1.24 0 0050.5689.76c4 ARPA Vlan100
Internet 10.2.1.26 0 0050.5689.2f4e ARPA Vlan100
Internet 10.2.1.27 0 0050.5689.0632 ARPA Vlan100
Internet 10.2.1.28 0 0050.5689.1ce9 ARPA Vlan100
Internet 10.2.1.29 0 0050.5689.6aaa ARPA Vlan100
Internet 10.2.1.31 0 0050.5689.0d1a ARPA Vlan100
Internet 10.2.1.37 0 0050.5696.6d81 ARPA Vlan100
Internet 10.2.1.103 0 d4be.d9be.8eef ARPA Vlan100
Internet 10.2.1.106 0 14fe.b5e1.c595 ARPA Vlan100
Internet 10.2.1.107 0 0023.ae7d.a966 ARPA Vlan100
Internet 10.2.1.108 0 d4be.d9c8.6770 ARPA Vlan100
Internet 10.2.1.109 0 14fe.b5e9.c5b5 ARPA Vlan100
Internet 10.2.1.110 0 14fe.b5ea.5f9d ARPA Vlan100
Protocol Address Age (min) Hardware Addr Type Interface
Internet 10.2.1.111 0 001e.c959.d4f0 ARPA Vlan100
Internet 10.2.1.114 0 b8ac.6f48.4538 ARPA Vlan100
Internet 10.2.1.115 0 14fe.b5e1.ed89 ARPA Vlan100
Internet 10.2.1.116 0 7845.c409.1959 ARPA Vlan100
Thanks
Lotfi

Catalyst 4500 Hi CPU

Hi,
I have an issue with a Catalyst-4500 (4507R-E, ipbase, 12.2.46SG), that is running very hi CPU since some days:
By investigating, I observed a couple of processes that are realy CPU-consuming:
I don't know where to look ...
Some help and/or some suggestion ?
Best regars,
Claudio

Two good resources for troubleshooting high CPU on the 4K
High CPU Utilization on Cisco IOS Software-Based Catalyst 4500 Switches
http://www.cisco.com/c/en/us/support/docs/switches/catalyst-4000-series-switches/65591-cat4500-high-cpu.html
Troubleshooting High CPU on the Catalyst 4500-E Series Switch
http://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst4500/troubleshooting/cpu_util.html
HTH
Luke

High CPU Usage / Dropped Packets - Switch Blade WS-CBS3120X-S

Hi all,
I have a couple of Switches Blade 3120, working as active-standby model (HSRP) on a new site deployment. There are other 20 sites more or less, working on the same model, without issues. But in this one, we are seeing a high cpu usage. The traffic going through the platform is 600Mbps (on peaks), and in this case we have 40% of CPU usage. Traffic should be close to 3 Gbps. When we tried to send the whole traffic through the platform, active switch began to drop packets on the majority of interfaces.
When we analyze the CPU usage, there is a special process called "HL3U bkgrd proce" always have the most CPU use, but we do not know what concerns. We do not know if it is caused because there are PBRs configured. It should not matter. How I mentioned, there are other sites working fine and have had always the same PBR number.
Could you guys help us?. Any idea what is causing the high usage?. Is there a special debug we could to perform to diagnose the issue?. Also, we have seen a high interrupt CPU usage (9% in this case).
Find attached the whole diagnosis outputs.
Thanks for your assistance guys.
Cheers,
Juan Pablo
bog-sib-INT-rtr-1#show processes cpu sorted 5sec
CPU utilization for five seconds: 30%/9%; one minute: 25%; five minutes: 23%
PID Runtime(ms)     Invoked      uSecs   5Sec   1Min   5Min TTY Process
157   140004809   107071220       1307 14.24% 10.19% 9.01%   0 HL3U bkgrd proce
119     6860957     1519183       4516 0.79% 0.59% 0.53%   0 hpm counter proc
166     2511492      302802       8294 0.15% 0.15% 0.15%   0 HQM Stack Proces
199     4182906    15255882        274 0.15% 0.21% 0.20%   0 IP Input
357      237531      782101        303 0.15% 0.03% 0.00%   0 IP SNMP
186         101         148        682 0.15% 0.09% 0.02%   1 Virtual Exec
242       63071     2330717         27 0.15% 0.02% 0.00%   0 CEF: IPv4 proces
12      163754      620353        263 0.15% 0.01% 0.00%   0 ARP Input
   9           0           2          0 0.00% 0.00% 0.00%   0 License Client N
   8          41        1827         22 0.00% 0.00% 0.00%   0 WATCH_AFS
11          50           4      12500 0.00% 0.00% 0.00%   0 Image License br
   7           0           2          0 0.00% 0.00% 0.00%   0 Timers
bog-sib-INT-rtr-1#sh ip cef summary
IPv4 CEF is enabled for distributed and running
VRF Default
119 prefixes (119/0 fwd/non-fwd)
Table id 0x0
Database epoch:        2 (119 entries at this epoch)

Hi Leolaohoo,
I had not played with this one too !!!!...
1). IOS version (It was recently updated)
bog-sib-INT-rtr-1#sh ver
Cisco IOS Software, CBS31X0 Software (CBS31X0-UNIVERSALK9-M), Version 12.2(58)SE1, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2011 by Cisco Systems, Inc.
Compiled Thu 05-May-11 04:08 by prod_rel_team
ROM: Bootstrap program is CBS31X0 boot loader
BOOTLDR: CBS31X0 Boot Loader (CBS31X0-HBOOT-M) Version 12.2(0.0.951)SE3, CISCO DEVELOPMENT TEST VERSION
bog-sib-INT-rtr-1 uptime is 2 weeks, 3 days, 17 hours, 14 minutes
System returned to ROM by power-on
System restarted at 00:59:27 UTC Sat Jun 9 2012
System image file is "flash:cbs31x0-universalk9-mz.122-58.SE1.bin"
2). What interface do you want to see?, do you want to see all interfaces? . This switch has 16 interfaces that connect servers, and other going to our client. Below, the state of the two kind of interfaces:
Interface to Client (Bearer)
TenGigabitEthernet1/0/1 is up, line protocol is up (connected)
Hardware is Ten Gigabit Ethernet, address is 001f.275d.d81b (bia 001f.275d.d81b)
Description: BearerNContent_Aggregrate
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 10/255, rxload 14/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 10Gb/s, link type is auto, media type is 10GBase-LR
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 2w3d, output hang never
Last clearing of "show interface" counters 07:07:56
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 562469000 bits/sec, 83641 packets/sec
5 minute output rate 430500000 bits/sec, 73141 packets/sec
     2020563158 packets input, 1739897855828 bytes, 0 no buffer
     Received 13257 broadcasts (13257 multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 13257 multicast, 0 pause input
     0 input packets with dribble condition detected
     1745065310 packets output, 1347244137726 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out
Interface to Server
GigabitEthernet1/0/8 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 001f.275d.d808 (bia 001f.275d.d808)
Description: bog-15
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
     reliability 255/255, txload 15/255, rxload 12/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 1000Mb/s, link type is auto, media type is 1000BaseX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 00:00:17, output hang never
Last clearing of "show interface" counters 07:09:12
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 19418
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 47705000 bits/sec, 7155 packets/sec
5 minute output rate 58897000 bits/sec, 8011 packets/sec
     178178750 packets input, 153802177226 bytes, 0 no buffer
     Received 4091 broadcasts (0 multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 0 multicast, 0 pause input
     0 input packets with dribble condition detected
     212233312 packets output, 206621942776 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 unknown protocol drops
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 pause output
     0 output buffer failures, 0 output buffers swapped out
Thanks for your help. I am losing my hair with this issue.
Cheers,
Juan P.

4500 High CPU due to "K2CpuMan"

I am facing high CPU on one of my 4507R-E Chassis. I am having "WS-X45-SUP6-E" SUP and all of my line cards are "WS-X4648-RJ45V-E".
My current IOS is : 12.2(54)SG1
I have followed the below document.
http://www.cisco.com/c/en/us/support/docs/switches/catalyst-4000-series-switches/65591-cat4500-high-cpu.html
Till the time I have not run any CPU SPAN nor I have taken the debug outputs which I cannot do due to sensitivity of application running over the servers terminated over that switch to avoid any millisecond downtime.
I am pasting the rest of the output. Please suggest what can be the possible cause as we are not using DAI, DHCP Snooping or IGMP.
Please suggest if someone can suggest in this regard
------------------ SHOW PROC CPU ------------------
CPU utilization for five seconds: 81%/1%; one minute: 63%; five minutes: 61%
60   5656124073704026290        152 54.15% 55.05% 54.58%   0 Cat4k Mgmt LoPri
------------------ SHOW PLATFORM HEALTH ------------------
                     %CPU   %CPU    RunTimeMax   Priority Average %CPU Total
                                      Target       Actual    Target   Actual    Fg      Bg     5Sec     Min     Hour     CPU
K5CpuMan Review       30.00      60.02        30         34       100     500     62        74        62       32140:33
K2CpuMan Review The process that performs software packet forwarding If you see high CPU utilization due to this process, investigate the packets that hit the CPU with use of the show platform cpu packet statistics command.
---------------------SHOW PLATFORM CPU PACKET STATISTICS-----------------------------
Queue                                            Total             5 sec avg      1 min avg    5 min avg     1 hour avg
Unknown                                            0                       0                      0                        0                     0
Esmp                                                  0                       0                      0                        0                     0
Input ACL fwd(snooping)         2715401932            1734               1920                   1703               1667
ACL fwd(snooping): Packets that are processed by the DHCP snooping, dynamic ARP inspection, or IGMP snooping

I have got the root cause. I took the CPU Span and right after that I came to know there was a server which was consistently sending Multicast Packets causing high CPU. After disabling the related service on server CPU got normal.

Cisco 4500 High CPU-GaliosObflFilesys process

Hi All,
We are using Cisco 4510R-E Switch with 2 WS-X45-SUP6-E in SSO.
The IOS which running on Chassis: cat4500e-ipbasek9-mz.122-54.SG1.bin
From past 3-4 Days we are observing High CPU in this chassis and the process which is consuming maximum CPU is GaliosObflFilesys process.
The output is here:
Yogesh_Cisco4500#sh processes cpu sorted
CPU utilization for five seconds: 59%/0%; one minute: 65%; five minutes: 65%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
80 3582290369 198427228 18053 47.67% 50.69% 50.72% 0 GaliosObflFilesy
Apart from this, we are getting below error messages continously on Console:
384665: Mar 27 08:41:46.933 IST: %C4K_SWITCHINGENGINEMAN-4-TCAMINTERRUPT: (Suppressed 380 times)flCam0 aPErr interrupt. errAddr: 0x1FD9 dPErr: 0 mPErr: 1 valid: 1
384666: Mar 27 08:41:54.538 IST: %C4K_L3HWFORWARDING-4-FLTCAMPARITYERROR: (Suppressed 766 times)FL Tcam Perr with no FwdEntry Hw index: 8152 Hw entry: Sw entry:
384667: Mar 27 08:42:16.972 IST: %C4K_SWITCHINGENGINEMAN-4-TCAMINTERRUPT: (Suppressed 384 times)flCam0 aPErr interrupt. errAddr: 0x1FD9 dPErr: 0 mPErr: 1 valid: 1
384668: Mar 27 08:42:47.006 IST: %C4K_SWITCHINGENGINEMAN-4-TCAMINTERRUPT: (Suppressed 393 times)flCam0 aPErr interrupt. errAddr: 0x1FD9 dPErr: 0 mPErr: 1 valid: 1
384669: Mar 27 08:42:54.571 IST: %C4K_L3HWFORWARDING-4-FLTCAMPARITYERROR: (Suppressed 763 times)FL Tcam Perr with no FwdEntry Hw index: 8152 Hw entry: Sw entry:
Also got the error messages are generated because of SUP in slot 5 which is in Active state:
Yogesh_Cisco4500#sh platform software obfl module all
1 : no obfl storage
2 : no obfl storage
3 : no obfl storage
4 : no obfl storage
5 : slot-5: messages=95200748 int-logged=80533419 int-dropped=0 dirty=yes
5 : slot-5: version=1 sector: size=4096 written=47182041 dirty=21
6 : remote supervisor
7 : no obfl storage
8 : no obfl storage
9 : no obfl storage
10 : no obfl storage
We got one Bug CSCsv17545 which is not hitting in our case since it is resolved 12.2(54)SG1.
Wanted to know whether it is Software issue or hardware and how to isolate the same.

Hi Rizwan,
Here, as per observation, Software is unable to recover these error messages (As the HW Index and ErrAddress in these errors are common) or SUP Engine is having Hardware problem (Since the Errors are collected on Active SUP Engine only). We have to isolate this issue by below method.
Remove the SUP & Reinsert it again / if you have spare SUP then replace Active SUP Engin
If same errors observed, we need to upgrade the Image & if not then need to replace the SUP Engine.
In our case, issue got resolved after removing and reinserting the SUP Engine.
CPU was normal too.
Additionally, you can enable Bootup level complete, so that HW issue of Active SUP can be tackled during Bootup only & then you can remove the Active SUP Engine.
Regards,
YSR.

My macbook pro i7 (2011 version) has a loud fan and high cpu % when I have Skype on or when I am on Safari. Help please!

My macbook pro i7 (2011 version) has a loud fan and a high cpu % when I have Skype on or when I am on Safari. My laptop would sometimes freeze for a while and it is usually hot. Has anyone else encounter this problem and know how to fix it? Thanks!

Skype is a very resource intensive activity...it has been reported on here users are seeing cpu temperatures on the order of 80-85 °C, within the limits of the cpu, but still hot to the touch.
Make sure nothing else is running so you keep the thermal load down.

Core switches experience High CPU while generating syslog report from LMS

Hi Everyone,
Are there anyone who experience that the CPU utilization of some devices went up while generating a report from RME. Basing from other monitoring tool SNMP is taking up a huge cpu process. Any idea why this happened considering that the report is generated daily but only on one instance it caused the core switches to be paralyze due to high cpu. Changing the SNMP community string is the immediate action that resolve the issue to disconnect it from LMS.
BTW, this is LMS 2.6.
Thank you.

The problem did not reoccurred any more. When I checked on the Syslogcollector.log it appeared that it is unable to subscribe. I assumed that the reason why snmp packets were flooded during the time that it they experience high cpu is because the client is generating syslog report for all devices while the syslog collector is not subscribe. Is this possible?
Thanks

Latest flashplayer not work well, even the early version in 11x and has high CPU usage

why is it that flashplayer 11x always has a High CPU Usage? detected by NOrton Antivirus

you can't rely on norton antivirus.
but if you check your active processes and directly confirm a problem with flash player 11+, uninstall your current flash player (http://helpx.adobe.com/flash-player/kb/uninstall-flash-player-mac-os.html or http://helpx.adobe.com/flash-player/kb/uninstall-flash-player-windows.html) and install an older version: http://helpx.adobe.com/flash-player/kb/archived-flash-player-versions.html

ITunes 10.6 has High CPU Usage when switched to Mini Player

iTunes has high CPU usage when switched to mini player. The CPU usage goes to 80-100% when the next song is played in Mini Player. iTunes then stays at high CPU usage.
Upon exiting mini player the CPU usage will drop back to the normal 0-5% levels.
This only happens when playing from the main music library; which my library is at 7089 items, 42.04 GB.
When playing from a smaller playlist such as a smart playlist with about 15 songs in it for example, the CPU usage stays low/normal.

Do you have any better luck with that if you update to iTunes 10.6.1.7?
From the notes for the release:
iTunes 10.6.1 provides a number of improvements, including:
• Fixes several issues that may cause iTunes to unexpectedly quit while playing videos, changing artwork size in Grid view and syncing photos to devices.
• Addresses an issue where some iTunes interface elements are incorrectly described by VoiceOver and WindowEyes.
• Fixes a problem where iTunes may become unresponsive while syncing iPod nano or iPod shuffle.
• Resolves an ordering problem while browsing TV episodes in your iTunes library on Apple TV.
http://www.apple.com/itunes/download/

Packet drops and High CPU on Cisco 3845 Switch

Hello Experts,
We are facing a lot of packet drops in our LAN.
When we try to ping one of the access switches from the CE router, we get the follwoing output:
pdel1799#ping 10.132.136.17 so 10.132.164.1 si 100 re 500
Type escape sequence to abort.
Sending 500, 100-byte ICMP Echos to 10.132.136.17, timeout is 2 seconds:
Packet sent with a source address of 10.132.164.1
Success rate is 98 percent (491/500), round-trip min/avg/max = 1/9/44 ms
pdel1799#
Success rate is 98 percent (491/500), round-trip min/avg/max = 1/9/44 ms
pdel1799#
Some command outputs and show tech of all switches attached from the customer which I have attached.
I have also attached a diagram but the only router''s IP address is correct in the diagram while IP address of switches in the diagram are incorrect. Here are the correct IPs of the switches:
Core Switch : 10.132.139.2
Access Switches:
10.132.136.17
10.132.136.18
10.132.136.29
Apart from packet drops on VLAN 1 we are seeing high CPU utilization on core switch
ingur-msl-coresw#sh processes cpu sorted | ex 0.0
Core 0: CPU utilization for five seconds: 61%; one minute: 45%; five minutes: 47%
Core 1: CPU utilization for five seconds: 63%; one minute: 46%; five minutes: 56%
Core 2: CPU utilization for five seconds: 36%; one minute: 74%; five minutes: 69%
Core 3: CPU utilization for five seconds: 85%; one minute: 69%; five minutes: 65%
PID    Runtime(ms) Invoked uSecs 5Sec     1Min     5Min     TTY   Process
5638   2374911     23863975 131    52.03    52.24    52.58    1088 fed
9227   43623       21191441 182    8.36     5.53     5.71     0     iosd
6146   1437288     13888905 56     0.95     0.68     0.70     0     pdsd
5639   1292905     86276135 11     0.13     0.13     0.11     0     platform_mgr
6161   2831440     20952285 955    0.13     0.12     0.10     0     cpumemd
I can get more details required to resolve this, please help!!

Hi,
I can see several Mac Flaps in the logs provided.... i.e. on int gi 1/1/3. have you verified you don't have any bridging loop occurring on the network?
Regards,
Yaseen

CSCsi78581 - Hulc LED Process has even higher CPU (20%) running "fixed" version 15.2(2)E

A known good fix for the CPU issue was listed as version 15.2(2)E.
However, I have found that this version has even a higher CPU usage of 20% than the original bug indicated at 15%.
Does anyone know a fix for this?

Experiencing this with 12.2(55)SE9 as well.

High CPU utilization on 2960 switch

Hi
I have a 2960 switch connected in my network. It is showing high CPU utilization upto 80-90%. When I checked I found that the below processes are taking the highest utilization. The image in the switch is LAN base. Can someone please advice on why I am having high utilization on the switch for the below processes and how can I reduce it.
14.69% 14.98% 15.00%   0 Hulc LED Process
14.69% 11.49% 13.97%   0 IP Input
29.07% 28.44% 30.06%   0 DHCPD Receive

Duplicate post.
Go HERE.

CPU Low Conext Switches High

I'm getting a proc bottleneck reported on my exchange servers.
CPU utilization is very low, yet the Context Swtiching is well greater than the recommended 20,000 (43358.69)
there are NO processes with high CPU utilization. System idle is apx. 92-95%
Even my servers in the DR datacenter have high Context switching of 60,190... which service NO users.
Something isn't making sense.
Bobby Pendino

I just checked %Privileged Time and it's very low as well... average of 2.0%
According to this article, I should be more concerned with the Context Switches if the %Priv Time is high as well. (Apx. 40-50%)
http://technet.microsoft.com/en-us/library/cc938613.aspx
Bobby Pendino

Switch High cpu Catalyst 4500 Version 12.2(53)SG5

Similar Messages

Maybe you are looking for