Spanning Tree on 2950 (High CPU)
Just swapped out a 2924 with a 2950 (Copying config as closely as the 2950 would allow), and now icmp to Management IP is extremely latent (200m/sec+ from server connected directly to it)....icmp through the 2950 is unaffected.
Spanning tree appears to be the culprit:
36 12275368 3206214 3828 4.99% 4.07% 4.05% 0 Spanning Tree
2950 connects to Cat4k on multiple ports (Both trunks/Non Trunks)
spanning-tree mode is pvst on 2950.
Hoping someone has come across this before :)
Regards,
MB
Further investigation revealed that all the cat4k's vlans where in the 2950's dynamic table (show mac-address-table dynamic) - These vlans where definitely not supposed to be there, so I checked out the interconnecting ports(On Cat4k) to discover that about 5 had turned into trunk ports!(Does CatOS automagically enable trunking on ports in certain circumstances?)
Systematically disabling trunking on these ports stopped all the cat4k's vlans being advertised to the 2950, and also reduced the cpu of spanning tree:
36 15213172 3875075 3925 1.14% 1.37% 1.61% 0 Spanning Tree
icmp had now also dramatically reduced.
Regards,
MB
Similar Messages
-
Sh run command is showing high cpu / ssh process
HI
When we execute sh run command on 45xx or 65xx switch , cpu spike momentarily to >85 & ssh process is taking most of the cpu cycle
This is normal how IOS behave or something we need to check
4500#sh processes cpu sorted | exc 0.00
CPU utilization for five seconds: 88%/1%; one minute: 41%; five minutes: 36%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
146 4136 871 4748 59.27% 6.05% 1.30% 1 SSH Process
48 16866873922152633381 0 14.55% 14.98% 15.01% 0 Cat4k Mgmt HiPri
103 16552592322880818592 0 6.31% 6.57% 6.59% 0 Spanning Tree
6500#sh processes cpu sorted | exc 0.00
CPU utilization for five seconds: 82%/6%; one minute: 17%; five minutes: 9%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
66 7408 4713 1571 70.47% 9.15% 1.95% 1 SSH Process
273 2680382442700124902 0 1.67% 1.13% 1.02% 0 IP Input
267 176292656 43570676 4046 1.27% 1.09% 1.09% 0 CDP Protocol
12 56465396 138235369 408 0.47% 0.35% 0.32% 0 ARP Input
Br/SubhojitHI,
Our config size is bit high
Apart from the time, when we run the command CPU is low
Is there any way to put some command to fine tune the same
Find 1 command, but not sure about the Impact, Pls suggest
parser config cache interface
Br/Subhojit -
Here is the problem we are having , we have a 2950 hooked to a 6509 hybrid dist box with approx 90 vlans on it . We hook up a new 2950 and we get the following message, Dec 21 19:47:45.116: %SPANTREE_VLAN_SW-2-MAX_INSTANCE: Platform limit of 64 STP instances exceeded. No instance created. Ok , I know about the spanning tree issues with the 2950 only having limited PVST instances . But up at the dist side we have "manually pruned off all but 5 vlans on the trunk feeding this 2950 with the "clear trunk" command . I thought manually pruning off the vlans from the trunk would eliminate this problem , maybe i have a misunderstanding of how this works. Also the message on the 2950 complains about it only having 64 instances of spanning tree yet when you do a "show vtp status it says it supports 250 instances locally so whats up with that , 2950 running 12.1.22EA4 . So I guess I'm asking is there any way around this for the 2950 . Also in client/server mode do you have to manually prune off the vlans on both the server side and the client side ??
Hello Glen,
I guess instead of manually pruning the VLANs off the trunk, you could also try and enable VTP pruning globally on the 6509 (set vtp pruning enable). I assume you have the 6509 configured as the VTP server (set vtp mode server) ?
I am not sure if CatOS and IOS defaults to the same VTP version, can you check this (with 'show vtp domain' for CatOS and 'show vtp status' for the IOS switch) ?
Also, in a purely IOS environment, manually pruning VLANs off a trunk requires doing that only on the server side, but with a mix of CatOS and IOS, it might have to be done on both sides, you might want to give it a try and use the 'switchport trunk allowed' command on the 2950 as well...
Regards,
GP -
Getting High cpu in s720 due to snmp(Prime)
Hi Team,
We are getting high cpu Spike in our all distribution switches in many locations.
Also we found our Cisco prime infrastructure causing the high cpu.but the spike only for 20 to 30 seconds.
If we deny the PI there will be no CPU spike..
Is there any troubleshooting or configuration need to done for this issue..but we are getting in all our sites due to this in different cpu process I'd ..
Affected sup like 720 but in core we are not getting that issue with same sup and ios.
Kindly suggest any action plan regarding the high cpu due to the High cpu due to snmp..
Regards,
ArunHi Afroj,
PFB
i have attached the EEM logs during high snmp cpu(605).
Please expertise
Process 605: SNMP ENGINE
Stack segment 0x528E3084 - 0x528E5F64
FP: 0x528E5E88, RA: 0x413DFB00
FP: 0x528E5EB8, RA: 0x41200E60
Process 605: SNMP ENGINE
Stack segment 0x528E3084 - 0x528E5F64
FP: 0x528E5E88, RA: 0x413DFB00
FP: 0x528E5EB8, RA: 0x41200E60
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.237.102.34 162 10.251.1.1 52465 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.238.53.198 162 10.251.1.1 53296 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.238.53.200 162 10.251.1.1 61585 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.238.53.202 162 10.251.1.1 58228 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.242.225.134 162 10.251.1.1 52865 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.242.225.136 162 10.251.1.1 50720 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 209.51.49.10 162 10.251.1.1 51376 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 209.51.49.21 162 10.251.1.1 49787 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 209.51.49.25 162 10.251.1.1 58862 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 209.51.49.3 162 10.251.1.1 56352 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 209.51.49.40 162 10.251.1.1 53080 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 209.51.49.41 162 10.251.1.1 59354 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 209.51.49.42 162 10.251.1.1 64147 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.251.1.14 56112 10.251.1.1 2228 0 0 211 0
Queues: output 0
input 0 (drops 0, max 50, highwater 1)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 --listen-- 10.251.1.66 1645 0 0 11 0
Queues: output 0
input 0 (drops 0, max 50, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 --listen-- 10.251.1.66 1646 0 0 11 0
Queues: output 0
input 0 (drops 0, max 50, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.184.66.171 67 10.251.9.225 67 0 0 2211 0
Queues: output 0
input 0 (drops 0, max 50, highwater 22)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.238.53.198 1342 10.251.1.1 161 0 0 1001 0
Queues: output 0
input 0 (drops 0, max 50, highwater 28)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 --listen-- 10.251.1.66 162 0 0 1011 0
Queues: output 0
input 0 (drops 0, max 50, highwater 2)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 --listen-- 10.251.1.66 55325 0 0 1011 0
Queues: output 0
input 0 (drops 0, max 50, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17(v6) --listen-- --any-- 161 0 0 20001 0
Queues: output 0
input 0 (drops 0, max 50, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17(v6) --listen-- --any-- 162 0 0 20011 0
Queues: output 0
input 0 (drops 0, max 50, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17(v6) --listen-- --any-- 61700 0 0 20001 0
Queues: output 0
input 0 (drops 0, max 50, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 --listen-- 10.251.1.66 123 0 0 1 0
Queues: output 0
input 0 (drops 0, max 50, highwater 2)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.237.100.198 514 10.251.1.1 57434 0 0 400241 0
Queues: output 0
input 0 (drops 0, max 50, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.237.204.214 514 10.251.1.1 50817 0 0 400241 0
Queues: output 0
input 0 (drops 0, max 50, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.238.60.34 514 10.251.1.1 51858 0 0 400241 0
Queues: output 0
input 0 (drops 0, max 50, highwater 0)
Proto Remote Port Local Port In Out Stat TTY OutputIF
17 10.243.115.105 162 10.251.1.1 52505 0 0 0 0
Queues: output 0
input 0 (drops 0, max 0, highwater 0)
11:50:13.680 IST Wed Jan 8 2014
Process 605: SNMP ENGINE
Stack segment 0x528E3084 - 0x528E5F64
FP: 0x528E5E88, RA: 0x413DFB00
FP: 0x528E5EB8, RA: 0x41200E60
Process 605: SNMP ENGINE
Stack segment 0x528E3084 - 0x528E5F64
FP: 0x528E5E88, RA: 0x413DFB00
FP: 0x528E5EB8, RA: 0x41200E60
CPU utilization for five seconds: 40%/7%; one minute: 23%; five minutes: 16%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
169 12896 12026 1072 23.10% 9.12% 2.93% 2 SSH Process
11 103780680 268103677 387 2.95% 2.77% 2.70% 0 ARP Input
323 59149684 230740289 256 1.67% 1.50% 1.40% 0 IP Input
215 112 632 177 1.67% 0.13% 0.02% 3 Virtual Exec
412 35386816 13614064 2599 0.63% 0.69% 0.69% 0 CEF: IPv4 proces
214 12 47 255 0.39% 0.03% 0.00% 0 EEM Callback Thr
608 23656 4174 5667 0.23% 0.02% 0.00% 0 SNMP Traps
268 1711956 38291258 44 0.23% 0.21% 0.22% 0 cpf_process_tpQ
85 11661952 28435848 410 0.23% 0.28% 0.29% 0 ARP HA
317 3057232 14577406 209 0.15% 0.17% 0.16% 0 CDP Protocol
350 1365761024332778 0 0.15% 0.17% 0.16% 0 Ethernet Msec Ti
2 9760 1621549 6 0.15% 0.01% 0.00% 0 Load Meter
601 9567588 11060330 865 0.15% 0.20% 0.21% 0 DHCPD Receive
455 159172 114655346 1 0.07% 0.04% 0.02% 0 OSPF-1 Hello
168 20 6694 2 0.07% 0.00% 0.00% 0 TACACS+
50 804004 8351522 96 0.07% 0.09% 0.11% 0 Per-Second Jobs
454 59648 252056393 0 0.07% 0.03% 0.02% 0 RADIUS
325 1268180 11957057 106 0.07% 0.02% 0.00% 0 ADJ resolve proc
456 9988 34907 286 0.07% 0.03% 0.01% 0 TPLUS
293 56980 16209877 3 0.07% 0.01% 0.00% 0 ACE Config Prop
267 6486544 1768422 3667 0.07% 0.07% 0.07% 0 Compute load avg
577 516 47525 10 0.07% 0.00% 0.00% 0 EEM ED SNMP
23 74331892 646724056 114 0.00% 0.90% 0.83% 0 IPC Seat Manager
22 0 1 0 0.00% 0.00% 0.00% 0 IPC Process leve
25 0 1 0 0.00% 0.00% 0.00% 0 IPC Stdby Update
24 0 1 0 0.00% 0.00% 0.00% 0 IPC Session Serv
21 7584 8101413 0 0.00% 0.00% 0.00% 0 IPC Deferred Por
28 0 2 0 0.00% 0.00% 0.00% 0 Dialer event
29 0 12 0 0.00% 0.00% 0.00% 0 ifIndex Receive
30 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun
20 232492 8101397 28 0.00% 0.04% 0.05% 0 IPC Periodic Tim
26 176 810789 0 0.00% 0.00% 0.00% 0 Compute SRP rate
33 0 1 0 0.00% 0.00% 0.00% 0 VSL LTL PACL ICC
27 0 2 0 0.00% 0.00% 0.00% 0 DDR Timers
35 280 2529 110 0.00% 0.00% 0.00% 0 rf proxy rp agen
19 0 1 0 0.00% 0.00% 0.00% 0 NTI Example Proc
37 4 3 1333 0.00% 0.00% 0.00% 0 client_entity_se
38 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect
39 0 1 0 0.00% 0.00% 0.00% 0 Connection Mgr
40 4 40 100 0.00% 0.00% 0.00% 0 Snmp ICC Process
41 60 262 229 0.00% 0.00% 0.00% 0 Cat6k SNMP
42 8 239 33 0.00% 0.00% 0.00% 0 Cat6k SNMP Trap
31 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
32 1182260 6068061 194 0.00% 0.01% 0.00% 0 EnvMon
45 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
46 70304 1415029 49 0.00% 0.00% 0.00% 0 Net Background
18 2224 135036 16 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
48 212 8653 24 0.00% 0.00% 0.00% 0 Logger
49 24752 8101358 3 0.00% 0.00% 0.00% 0 TTY Background
34 25544 8101346 3 0.00% 0.00% 0.00% 0 GraphIt
36 0 41 0 0.00% 0.00% 0.00% 0 rf proxy message
52 28 209 133 0.00% 0.00% 0.00% 0 Cat6k NTI ICC pr
53 152 511 297 0.00% 0.00% 0.00% 0 IF-MGR control p
43 0 1 0 0.00% 0.00% 0.00% 0 ARP Snoop
55 60 583 102 0.00% 0.00% 0.00% 0 Env action
56 0 2 0 0.00% 0.00% 0.00% 0 Flash ICC Server
57 0 13514 0 0.00% 0.00% 0.00% 0 foundation
58 0 1 0 0.00% 0.00% 0.00% 0 VS Redirect EOBC
59 3450908 116847868 29 0.00% 0.04% 0.04% 0 VSIBC process
60 8 80 100 0.00% 0.00% 0.00% 0 ICC Nego
61 0 13522 0 0.00% 0.00% 0.00% 0 itasca
62 124 67 1850 0.00% 0.00% 0.00% 0 EOBC Monitor Pro
63 2543040 128884246 19 0.00% 0.03% 0.02% 0 Net Input
64 12 45 266 0.00% 0.00% 0.00% 0 draco-oir-proces
65 0 1 0 0.00% 0.00% 0.00% 0 EnergyWise incre
66 0 1 0 0.00% 0.00% 0.00% 0 K+ RED MAMBA pr
67 0 1 0 0.00% 0.00% 0.00% 0 K+ RED MAMBA Adj
68 0 9 0 0.00% 0.00% 0.00% 0 MWAM CONFIG ON S
44 11928 8101398 1 0.00% 0.00% 0.00% 0 Dynamic ARP Insp
47 0 3 0 0.00% 0.00% 0.00% 0 IDB Work
71 0 1 0 0.00% 0.00% 0.00% 0 PF Sync process
72 0 1 0 0.00% 0.00% 0.00% 0 PF SCP process
73 0 8 0 0.00% 0.00% 0.00% 0 RPC rf_rfmib_not
74 12 11 1090 0.00% 0.00% 0.00% 0 RPC Sync
75 0 11 0 0.00% 0.00% 0.00% 0 SCP Multicast
76 0 2 0 0.00% 0.00% 0.00% 0 SCP Generic Unso
77 16 487 32 0.00% 0.00% 0.00% 0 TCAM API Process
17 0 1 0 0.00% 0.00% 0.00% 0 IFS Agent Manage
79 7608 8101392 0 0.00% 0.00% 0.00% 0 VS CHASSIS Info
80 0 16 0 0.00% 0.00% 0.00% 0 VS ICC request p
81 0 2 0 0.00% 0.00% 0.00% 0 cpf_msg_holdq_pr
82 336 1211 277 0.00% 0.00% 0.00% 0 cpf_msg_rcvq_pro
16 336 4338 77 0.00% 0.00% 0.00% 0 EEM ED Syslog
51 6060004 221751 27328 0.00% 0.07% 0.05% 0 Per-minute Jobs
14 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager
54 36 524 68 0.00% 0.00% 0.00% 0 IF-MGR event pro
87 0 2 0 0.00% 0.00% 0.00% 0 IPSEC HA Mgr
88 14092 135040 104 0.00% 0.00% 0.00% 0 RF CWAN HA Proce
89 0 3 0 0.00% 0.00% 0.00% 0 CWAN HA VLAN SYN
90 0 7 0 0.00% 0.00% 0.00% 0 CWAN IF EVENT HA
91 0 3 0 0.00% 0.00% 0.00% 0 CWAN APS HA Proc
69 12 386 31 0.00% 0.00% 0.00% 0 svclc
93 0 5 0 0.00% 0.00% 0.00% 0 DHCP Snooping HA
94 0 1 0 0.00% 0.00% 0.00% 0 Inode Table Dest
95 0 1 0 0.00% 0.00% 0.00% 0 FM HA Sync
96 26576 8102313 3 0.00% 0.00% 0.00% 0 Heartbeat Proces
97 4 108 37 0.00% 0.00% 0.00% 0 Const ICC reques
98 0 1 0 0.00% 0.00% 0.00% 0 Const ICC event
99 0 1 0 0.00% 0.00% 0.00% 0 Const ICC except
100 0 1 0 0.00% 0.00% 0.00% 0 ICC Local Reques
101 16660 246024 67 0.00% 0.00% 0.00% 0 ICC Async mcast
102 0 1 0 0.00% 0.00% 0.00% 0 ICC_REQ Debug Pr
103 16 148 108 0.00% 0.00% 0.00% 0 ICC FC Process
104 0 1 0 0.00% 0.00% 0.00% 0 ICC FC Test Send
105 0 1 0 0.00% 0.00% 0.00% 0 ICC FC Test Low
106 0 1 0 0.00% 0.00% 0.00% 0 L3 Manager HA
107 0 1 0 0.00% 0.00% 0.00% 0 FWSM HA Sync
108 0 1 0 0.00% 0.00% 0.00% 0 QoS HA CHKPT
109 0 5 0 0.00% 0.00% 0.00% 0 CWRP SPA TSM HA
110 4 4 1000 0.00% 0.00% 0.00% 0 Switch IP Host T
111 0 3 0 0.00% 0.00% 0.00% 0 RPC virtual_mode
112 0 3 0 0.00% 0.00% 0.00% 0 RPC vs_sp_print_
113 0 3 0 0.00% 0.00% 0.00% 0 RPC vs_rp2sp_rpc
114 4 20 200 0.00% 0.00% 0.00% 0 IP Admission HA
115 0 1 0 0.00% 0.00% 0.00% 0 Mistral Reset Pr
116 0 1 0 0.00% 0.00% 0.00% 0 ECC correctable
117 300 44 6818 0.00% 0.00% 0.00% 0 PF_Init Process
118 0 1 0 0.00% 0.00% 0.00% 0 K+ RED MAMBA STA
119 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
120 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
121 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
122 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
70 0 21 0 0.00% 0.00% 0.00% 0 PF IPC ICC Init
78 0 3 0 0.00% 0.00% 0.00% 0 RPC vs_prov_lc-R
125 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
126 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
127 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
128 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
129 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
130 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
131 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
132 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
133 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
134 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
135 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
136 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
137 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
138 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
139 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
83 0 1 0 0.00% 0.00% 0.00% 0 CHKPT Test clien
141 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
142 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
143 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
144 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
145 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
146 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
147 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
148 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
149 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
84 7804 68315 114 0.00% 0.00% 0.00% 0 DHCP Snooping
151 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
86 0 2 0 0.00% 0.00% 0.00% 0 IKE HA Mgr
153 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
154 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
155 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
92 0 3 0 0.00% 0.00% 0.00% 0 CWAN SRP HA Proc
157 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
158 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
159 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
160 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
161 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
162 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
163 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
164 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
165 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
166 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
167 0 35 0 0.00% 0.00% 0.00% 0 KEYSTORE HA IPC
123 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
13 0 2 0 0.00% 0.00% 0.00% 0 AAA high-capacit
170 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
171 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
172 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
173 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
174 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
175 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
176 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
177 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
178 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
179 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
180 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
181 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
182 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
183 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
184 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
185 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
186 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
187 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
188 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
189 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
190 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
191 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
192 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
193 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
194 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
195 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
196 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
197 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
198 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
199 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
200 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
201 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
202 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
203 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
204 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
205 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
206 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
207 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
208 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
209 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
210 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
211 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
212 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
213 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
12 0 1 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
10 0 2 0 0.00% 0.00% 0.00% 0 Timers
217 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
218 0 196 0 0.00% 0.00% 0.00% 0 SNMP Timers
219 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
220 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
221 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
222 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
223 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
224 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
225 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
9 448 1689 265 0.00% 0.00% 0.00% 0 Pool Manager
227 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
228 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
229 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
230 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
231 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
124 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
140 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
235 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
236 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
237 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
238 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
239 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
240 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
241 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
242 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
243 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
244 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
245 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
246 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
247 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
248 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
249 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
250 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
251 4 1 4000 0.00% 0.00% 0.00% 0 IPC ISSU Version
252 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
253 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
254 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
255 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
256 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
257 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
258 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
259 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
260 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
261 0 1 0 0.00% 0.00% 0.00% 0 Cat6k NTI RP Exa
262 0 3 0 0.00% 0.00% 0.00% 0 RPC rpc-slave-11
263 16 126 126 0.00% 0.00% 0.00% 0 PF_Split Sync Pr
264 36 233 154 0.00% 0.00% 0.00% 0 RPC pf-split-rp
265 40 104 384 0.00% 0.00% 0.00% 0 RPC idprom-MP
266 0 1 0 0.00% 0.00% 0.00% 0 BACK CHECK
150 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
8 33163948 1904341 17414 0.00% 0.31% 0.37% 0 Check heaps
269 0 13 0 0.00% 0.00% 0.00% 0 IPC Apps Task
271 12 13 923 0.00% 0.00% 0.00% 0 RTTYS Process
272 0 8 0 0.00% 0.00% 0.00% 0 RFS server proce
273 0 35 0 0.00% 0.00% 0.00% 0 OBFL Cfg Dispatc
274 8 2254 3 0.00% 0.00% 0.00% 0 PF Clock Process
275 0 1 0 0.00% 0.00% 0.00% 0 PPP IP Add Route
276 16 16330 0 0.00% 0.00% 0.00% 0 Transport Port A
277 0 15 0 0.00% 0.00% 0.00% 0 AggMgr Process
278 48 59125 0 0.00% 0.00% 0.00% 0 SFF8472
279 0 1 0 0.00% 0.00% 0.00% 0 const_dump_info_
280 0 1 0 0.00% 0.00% 0.00% 0 POS APS Event Pr
281 0 1 0 0.00% 0.00% 0.00% 0 DSX3MIB ll handl
282 0 1 0 0.00% 0.00% 0.00% 0 FPD Management P
283 0 1 0 0.00% 0.00% 0.00% 0 FPD Action Proce
284 16 253 63 0.00% 0.00% 0.00% 0 Remote Console P
285 0 1 0 0.00% 0.00% 0.00% 0 DIAG-RP-PROC
286 0 1 0 0.00% 0.00% 0.00% 0 DiagErrorLogProc
287 0 3 0 0.00% 0.00% 0.00% 0 Remote CWAN OIR
152 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
289 0 1 0 0.00% 0.00% 0.00% 0 SCP async: LCP#5
290 0 2 0 0.00% 0.00% 0.00% 0 CWAN ACD tasks
291 0 4 0 0.00% 0.00% 0.00% 0 ACE_REQUESTS han
292 61004 252151322 0 0.00% 0.04% 0.02% 0 ACE Tunnel Task
156 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
294 0 3 0 0.00% 0.00% 0.00% 0 ACE VRF Task
295 13552 8101376 1 0.00% 0.00% 0.00% 0 CWAN CHOCX PROCE
296 0 1 0 0.00% 0.00% 0.00% 0 HAL Mailbox
297 22672 8101370 2 0.00% 0.00% 0.00% 0 CWAN CHDSX PROCE
298 0 1 0 0.00% 0.00% 0.00% 0 CT3 Mailbox
299 0 1 0 0.00% 0.00% 0.00% 0 CE3 Mailbox
15 244 647 377 0.00% 0.00% 0.00% 0 Entity MIB API
301 0 1 0 0.00% 0.00% 0.00% 0 CWAN OIR Handler
302 4 7 571 0.00% 0.00% 0.00% 0 Earl NDE Task
7 0 1 0 0.00% 0.00% 0.00% 0 PF Redun ICC Req
304 1619456 4378957 369 0.00% 0.01% 0.00% 0 esw_vlan_stat_pr
6 0 1 0 0.00% 0.00% 0.00% 0 PF Redun ICC Req
306 0 1 0 0.00% 0.00% 0.00% 0 CWRP SPA ATM OIR
307 0 1 0 0.00% 0.00% 0.00% 0 ACE event
308 0 1 0 0.00% 0.00% 0.00% 0 ACE HAPI
309 2128 540126 3 0.00% 0.00% 0.00% 0 ACE policy loade
310 40 191 209 0.00% 0.00% 0.00% 0 CMFI RP process
311 132 3822 34 0.00% 0.00% 0.00% 0 AAA Server
312 88 3276 26 0.00% 0.00% 0.00% 0 AAA ACCT Proc
313 0 1 0 0.00% 0.00% 0.00% 0 ACCT Periodic Pr
314 0 1 0 0.00% 0.00% 0.00% 0 AAA System Acct
315 0 1 0 0.00% 0.00% 0.00% 0 Auth-proxy AAA B
316 24 27027 0 0.00% 0.00% 0.00% 0 IP Admin SM Proc
5 0 10 0 0.00% 0.00% 0.00% 0 IPC ISSU Dispatc
319 0 3 0 0.00% 0.00% 0.00% 0 BFD HA
320 44 4952 8 0.00% 0.00% 0.00% 0 CDP EXPORT PROCE
321 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R
322 0 2 0 0.00% 0.00% 0.00% 0 CEF switching ba
4 0 150 0 0.00% 0.00% 0.00% 0 Retransmission o
324 0 1 0 0.00% 0.00% 0.00% 0 ICMP event handl
232 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
326 0 1 0 0.00% 0.00% 0.00% 0 PPCP RP Stats Ba
327 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Echo event
328 0 2 0 0.00% 0.00% 0.00% 0 PASVC create VA
330 0 3 0 0.00% 0.00% 0.00% 0 HDLC HA
331 0 2 0 0.00% 0.00% 0.00% 0 Spanning Tree
332 0 2 0 0.00% 0.00% 0.00% 0 SpanTree Msg
333 8 5 1600 0.00% 0.00% 0.00% 0 EAPoUDP Process
334 0 2 0 0.00% 0.00% 0.00% 0 KRB5 AAA
335 0 3 0 0.00% 0.00% 0.00% 0 CTS CORE
336 24 381 62 0.00% 0.00% 0.00% 0 SXP CORE
337 0 1 0 0.00% 0.00% 0.00% 0 LSP Tunnel FRR
338 0 3 0 0.00% 0.00% 0.00% 0 MPLS Auto-Tunnel
339 0 1 0 0.00% 0.00% 0.00% 0 O-UNI Client Msg
340 8 266 30 0.00% 0.00% 0.00% 0 SSM connection m
341 4 4 1000 0.00% 0.00% 0.00% 0 cv6 per prefix a
342 0 2 0 0.00% 0.00% 0.00% 0 REP Topology cha
343 0 1 0 0.00% 0.00% 0.00% 0 AUTH POLICY Fram
344 52 255 203 0.00% 0.00% 0.00% 0 Auth Manager
345 0 1 0 0.00% 0.00% 0.00% 0 CMD HANDLER
346 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Mgr Proces
347 0 1 0 0.00% 0.00% 0.00% 0 EAP Framework
348 0 2 0 0.00% 0.00% 0.00% 0 Ethernet CFM
349 7040 48484291 0 0.00% 0.00% 0.00% 0 Ethernet Timer C
3 316 905 349 0.00% 0.00% 0.00% 1 SSH Process
351 0 2 0 0.00% 0.00% 0.00% 0 Ethernet LMI
352 0 1 0 0.00% 0.00% 0.00% 0 MAB Framework
353 244 690 353 0.00% 0.00% 0.00% 0 SW VLAN RP
354 0 9 0 0.00% 0.00% 0.00% 0 const ipfib per-
355 0 2 0 0.00% 0.00% 0.00% 0 CFMPAL-RP Proces
356 0 2 0 0.00% 0.00% 0.00% 0 CFMPAL RPC Proce
357 8 7 1142 0.00% 0.00% 0.00% 0 Const Rate Limit
358 0 1 0 0.00% 0.00% 0.00% 0 802.1x Webauth F
360 0 2 0 0.00% 0.00% 0.00% 0 Ethernet OAM Pro
361 0 1 0 0.00% 0.00% 0.00% 0 DMLP Counter
362 388 1200 323 0.00% 0.00% 0.00% 0 HWIF QoS Process
363 0 5 0 0.00% 0.00% 0.00% 0 MLS FIB RP
364 12 47 255 0.00% 0.00% 0.00% 0 mcast_rp_icc Pro
365 0 2 0 0.00% 0.00% 0.00% 0 QOS Stats Export
366 5543336 4050397 1368 0.00% 0.06% 0.05% 0 QOS Stats Gather
367 0 1 0 0.00% 0.00% 0.00% 0 satvs_interf_pro
368 8 264 30 0.00% 0.00% 0.00% 0 Switch IP Host T
369 0 1 0 0.00% 0.00% 0.00% 0 SSS Manager
370 0 1 0 0.00% 0.00% 0.00% 0 SSS Feature Mana
371 9872 31671669 0 0.00% 0.00% 0.00% 0 SSS Feature Time
372 0 1 0 0.00% 0.00% 0.00% 0 AC Switch
373 0 3 0 0.00% 0.00% 0.00% 0 ATM HA
374 15156 162270 93 0.00% 0.00% 0.00% 0 CEF background p
375 0 1 0 0.00% 0.00% 0.00% 0 IP IRDP
376 269560 141933 1899 0.00% 0.00% 0.00% 0 IP Background
377 44808 135215 331 0.00% 0.00% 0.00% 0 IP RIB Update
378 0 1 0 0.00% 0.00% 0.00% 0 IP Traceroute
379 0 30 0 0.00% 0.00% 0.00% 0 Socket Timers
380 0 3 0 0.00% 0.00% 0.00% 0 FR HA
381 4 4 1000 0.00% 0.00% 0.00% 0 GLBP HA
382 224 29448 7 0.00% 0.00% 0.00% 0 TCP Timer
383 712 3708 192 0.00% 0.00% 0.00% 0 TCP Protocols
384 0 27049 0 0.00% 0.00% 0.00% 0 HTTP CORE
385 0 4 0 0.00% 0.00% 0.00% 0 HSRP HA
386 0 6 0 0.00% 0.00% 0.00% 0 MRIB RP Proxy
387 0 9 0 0.00% 0.00% 0.00% 0 PIM HA
388 0 3 0 0.00% 0.00% 0.00% 0 XDR background p
389 278160 298487 931 0.00% 0.00% 0.00% 0 XDR mcast
390 17463136 4115749 4243 0.00% 0.22% 0.23% 0 IPC LC Message H
391 0 3 0 0.00% 0.00% 0.00% 0 XDR RP Ping Back
392 185652 143551 1293 0.00% 0.00% 0.00% 0 XDR RP backgroun
393 0 1 0 0.00% 0.00% 0.00% 0 XDR RP Test Back
394 0 1 0 0.00% 0.00% 0.00% 0 RETRY_REPOPULATE
395 0 3 0 0.00% 0.00% 0.00% 0 LSD HA Proc
396 0 11 0 0.00% 0.00% 0.00% 0 PPP HA
397 0 3 0 0.00% 0.00% 0.00% 0 PPP IPC flow con
398 0 1 0 0.00% 0.00% 0.00% 0 SLB CF process
399 0 4 0 0.00% 0.00% 0.00% 0 VRRP HA
400 0 2 0 0.00% 0.00% 0.00% 0 CTS DATAPATH
401 0 1 0 0.00% 0.00% 0.00% 0 ac_atm_state_eve
402 0 1 0 0.00% 0.00% 0.00% 0 Inspect Timer
403 0 4 0 0.00% 0.00% 0.00% 0 IPv6 ACL RP Proc
404 0 1 0 0.00% 0.00% 0.00% 0 MFI Comm RP Proc
405 0 10 0 0.00% 0.00% 0.00% 0 MPLS ACL IPC Bac
406 0 16 0 0.00% 0.00% 0.00% 0 LDP HA
407 0 3 0 0.00% 0.00% 0.00% 0 MPLS VPN HA Clie
408 0 4 0 0.00% 0.00% 0.00% 0 RSVP HA Services
409 0 6 0 0.00% 0.00% 0.00% 0 TSPTUN HA
410 0 4 0 0.00% 0.00% 0.00% 0 Inter Chassis Pr
411 0 2 0 0.00% 0.00% 0.00% 0 LFDp Input Proc
1 19280 100248 192 0.00% 0.00% 0.00% 0 Chunk Manager
413 0 4 0 0.00% 0.00% 0.00% 0 ADJ background
414 0 1 0 0.00% 0.00% 0.00% 0 Cv6 RP Process
415 4 10 400 0.00% 0.00% 0.00% 0 mfib-const-rp Pr
416 0 3 0 0.00% 0.00% 0.00% 0 AAA HA INT
417 0 1 0 0.00% 0.00% 0.00% 0 Critical Auth
418 0 1 0 0.00% 0.00% 0.00% 0 COPS
419 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Supplicant
420 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Supplicant
421 0 2 0 0.00% 0.00% 0.00% 0 Dot1x Supplicant
422 0 3 0 0.00% 0.00% 0.00% 0 ECFM HA IPC flow
423 4525688 8507921 531 0.00% 0.01% 0.01% 0 L3 Manager
424 0 6 0 0.00% 0.00% 0.00% 0 L3 Manager Commo
425 84556 10616336 7 0.00% 0.00% 0.00% 0 FM core
426 0 1 0 0.00% 0.00% 0.00% 0 Probe Input
427 0 2 0 0.00% 0.00% 0.00% 0 Netflow XDR Mana
428 0 2 0 0.00% 0.00% 0.00% 0 RARP Input
429 0 1 0 0.00% 0.00% 0.00% 0 PAD InCall
430 0 2 0 0.00% 0.00% 0.00% 0 X.25 Background
431 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps Mana
432 36 67566 0 0.00% 0.00% 0.00% 0 DHCPD Timer
433 3164500 4053966 780 0.00% 0.04% 0.05% 0 HIDDEN VLAN Proc
434 0 1 0 0.00% 0.00% 0.00% 0 CWAN LTL manager
435 0 1 0 0.00% 0.00% 0.00% 0 CWAN-RP SCP Proc
436 0 14 0 0.00% 0.00% 0.00% 0 CWAN-RP SCP Inpu
437 0 14 0 0.00% 0.00% 0.00% 0 IPHC RP Process
438 0 6 0 0.00% 0.00% 0.00% 0 L2TRACE SERVER
439 0 1 0 0.00% 0.00% 0.00% 0 MLSM-CC Process
440 0 2 0 0.00% 0.00% 0.00% 0 MWAM_CONSOLE Tim
441 0 2 0 0.00% 0.00% 0.00% 0 CWPA QoS
442 0 2 0 0.00% 0.00% 0.00% 0 Const TCAM Mgr R
443 0 2 0 0.00% 0.00% 0.00% 0 Dual active proc
444 8 2 4000 0.00% 0.00% 0.00% 0 BFD Splitb
445 0 1 0 0.00% 0.00% 0.00% 0 ATM HA AC
446 4 2 2000 0.00% 0.00% 0.00% 0 CMFI VPN HA Proc
447 0 1 0 0.00% 0.00% 0.00% 0 Crypto PAS Proc
448 0 1 0 0.00% 0.00% 0.00% 0 Crypto HW Proc
449 0 1 0 0.00% 0.00% 0.00% 0 EPM MAIN PROCESS
450 0 1 0 0.00% 0.00% 0.00% 0 EM Background Pr
451 16 132 121 0.00% 0.00% 0.00% 0 LOCAL AAA
452 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA
453 0 2 0 0.00% 0.00% 0.00% 0 LINE AAA
233 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
226 0 1 0 0.00% 0.00% 0.00% 0 IPC ISSU Version
288 0 1 0 0.00% 0.00% 0.00% 0 SEA_SCP_PRC
457 8 7 1142 0.00% 0.00% 0.00% 0 CEF RP IPC Backg
458 0 1 0 0.00% 0.00% 0.00% 0 CWAN OIR IPC Rea
459 0 2 0 0.00% 0.00% 0.00% 0 Crypto Support
460 4 52 76 0.00% 0.00% 0.00% 0 MPLS Auto Mesh P
461 0 12 0 0.00% 0.00% 0.00% 0 crypto engine pr
462 0 1 0 0.00% 0.00% 0.00% 0 encrypt proc
463 0 7 0 0.00% 0.00% 0.00% 0 Crypto CA
464 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-CRL
465 0 1 0 0.00% 0.00% 0.00% 0 Crypto SSL
466 0 35 0 0.00% 0.00% 0.00% 0 Crypto ACL
467 0 1 0 0.00% 0.00% 0.00% 0 Crypto INT
468 0 2 0 0.00% 0.00% 0.00% 0 Crypto IKE Dispa
469 0 3 0 0.00% 0.00% 0.00% 0 Crypto IKMP
470 3844 405097 9 0.00% 0.00% 0.00% 0 IPSEC key engine
471 0 1 0 0.00% 0.00% 0.00% 0 IPSEC manual key
472 0 1 0 0.00% 0.00% -
Dear All
I have 7200 router, it was runing 124-4.XD3 IOS, the CPU was working normal avarage around 15%, its use for L2TP users, it was have avarage 2000 concurrent L2TP connection, there was no CPU consuming.
Then for business plan we change the IOS to 12.2(33)SR and configured Broadband aggregation, after that the CPU become higher day after day even the PPPoE and L2TP session not more than 900 concurrent. the CPU reach 60%, even in non-peak hours it reach 50%
sh ver
Cisco IOS Software, 7200 Software (C7200P-ADVIPSERVICESK9-M), Version 12.2(33)SR
C6, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2010 by Cisco Systems, Inc.
Compiled Mon 08-Mar-10 08:03 by prod_rel_team
ROM: System Bootstrap, Version 12.4(12.2r)T, RELEASE SOFTWARE (fc1)
BOOTLDR: Cisco IOS Software, 7200 Software (C7200P-KBOOT-M), Version 12.2(33)SRC
6, RELEASE SOFTWARE (fc1)
System returned to ROM by reload at 14:58:14 UTC Thu Jun 2 2011
System image file is "disk2:c7200p-advipservicesk9-mz.122-33.SRC6.bin"
Last reload reason: Reload command
This product contains cryptographic features and is subject to United
States and local country laws governing import, export, transfer and
use. Delivery of Cisco cryptographic products does not imply
third-party authority to import, export, distribute or use encryption.
Importers, exporters, distributors and users are responsible for
compliance with U.S. and local country laws. By using this product you
agree to comply with applicable laws and regulations. If you are unable
to comply with U.S. and local laws, return this product immediately.
A summary of U.S. laws governing Cisco cryptographic products may be found at:
http://www.cisco.com/wwl/export/crypto/tool/stqrg.html
If you require further assistance please contact us by sending email to
[email protected].
Cisco 7206VXR (NPE-G2) processor (revision A) with 917504K/65536K bytes of memor
y.
Processor board ID 36743260
MPC7448 CPU at 1666Mhz, Implementation 0, Rev 2.2
6 slot VXR midplane, Version 2.11
Last reset from power-on
PCI bus mb1 (Slots 1, 3 and 5) has a capacity of 600 bandwidth points.
Current configuration on bus mb1 has a total of 0 bandwidth points.
This configuration is within the PCI bus capacity and is supported.
PCI bus mb2 (Slots 2, 4 and 6) has a capacity of 600 bandwidth points.
Current configuration on bus mb2 has a total of 0 bandwidth points.
This configuration is within the PCI bus capacity and is supported.
Please refer to the following document "Cisco 7200 Series Port Adaptor
Hardware Configuration Guidelines" on Cisco.com <http://www.cisco.com>
for c7200 bandwidth points oversubscription and usage guidelines.
1 FastEthernet interface
3 Gigabit Ethernet interfaces
2045K bytes of NVRAM.
250880K bytes of ATA PCMCIA card at slot 2 (Sector size 512 bytes).
65536K bytes of Flash internal SIMM (Sector size 512K).
Configuration register is 0x2102
sh processes cpu
CPU utilization for five seconds: 73%/17%; one minute: 67%; five minutes: 66%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
1 620 11401 54 0.00% 0.00% 0.00% 0 Chunk Manager
2 1400 238221 5 0.00% 0.00% 0.00% 0 Load Meter
3 0 1 0 0.00% 0.00% 0.00% 0 L2X Socket proce
4 4594808 312806 14689 7.27% 0.99% 0.69% 0 Check heaps
5 36380 195739 185 0.07% 0.00% 0.00% 0 Pool Manager
6 0 2 0 0.00% 0.00% 0.00% 0 Timers
7 1789408 3141124 569 0.15% 0.16% 0.16% 0 ARP Input
8 408 1241861 0 0.00% 0.00% 0.00% 0 ARP Background
9 0 2 0 0.00% 0.00% 0.00% 0 ATM Idle Timer
10 0 1 0 0.00% 0.00% 0.00% 0 ATM ASYNC PROC
11 0 85 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
12 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager
13 0 4 0 0.00% 0.00% 0.00% 0 Entity MIB API
14 87356 1933514 45 0.00% 0.00% 0.00% 0 EEM ED Syslog
15 8 19853 0 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
16 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager
17 1276 237895 5 0.00% 0.00% 0.00% 0 IPC Service NonC
18 896 1189354 0 0.00% 0.00% 0.00% 0 IPC Periodic Tim
19 0 1 0 0.00% 0.00% 0.00% 0 IPC Managed Time
20 644 1189353 0 0.00% 0.00% 0.00% 0 IPC Deferred Por
21 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Manager
22 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Control
23 88 238222 0 0.00% 0.00% 0.00% 0 IPC Loadometer
24 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun
25 0 1 0 0.00% 0.00% 0.00% 0 RO Notify Timers
26 0 1 0 0.00% 0.00% 0.00% 0 RMI RM Notify Wa
27 472 151083 3 0.00% 0.00% 0.00% 0 DDR Timers
28 0 2 0 0.00% 0.00% 0.00% 0 ATM AutoVC Perio
29 0 2 0 0.00% 0.00% 0.00% 0 ATM VC Auto Crea
30 16 119115 0 0.00% 0.00% 0.00% 0 Compute SRP rate
31 2400080 21414450 112 0.00% 0.01% 0.08% 0 EnvMon
32 0 1 0 0.00% 0.00% 0.00% 0 OIR Handler
33 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
34 0 1 0 0.00% 0.00% 0.00% 0 Exception contro
35 2200 237093 9 0.00% 0.00% 0.00% 0 ALARM_TRIGGER_SC
36 0 1 0 0.00% 0.00% 0.00% 0 CEF MIB API
37 948 1189356 0 0.00% 0.00% 0.00% 0 GraphIt
38 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect
39 0 2 0 0.00% 0.00% 0.00% 0 Dialer event
40 0 2 0 0.00% 0.00% 0.00% 0 SMART
41 0 1 0 0.00% 0.00% 0.00% 0 RFS server proce
42 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
43 112568 578621 194 0.00% 0.04% 0.05% 0 Net Background
44 0 2 0 0.00% 0.00% 0.00% 0 IDB Work
45 23576 664891 35 0.00% 0.00% 0.00% 0 Logger
46 1564 1189352 1 0.00% 0.00% 0.00% 0 TTY Background
47 38788 1189374 32 0.00% 0.03% 0.02% 0 Per-Second Jobs
48 80568 23708 3398 0.00% 0.00% 0.00% 0 Per-minute Jobs
49 776 5 155200 0.00% 0.00% 0.00% 0 PrstVbl
50 5160 154631 33 0.00% 0.00% 0.00% 0 IF-MGR control p
51 0 15 0 0.00% 0.00% 0.00% 0 IF-MGR event pro
52 0 1 0 0.00% 0.00% 0.00% 0 Inode Table Dest
53 4 13677 0 0.00% 0.00% 0.00% 0 Transport Port A
54 0 2 0 0.00% 0.00% 0.00% 0 INTR MGR PROCESS
55 1553620 253665 6124 0.00% 0.13% 0.12% 0 HC Counter Timer
56 0 2 0 0.00% 0.00% 0.00% 0 CES Timer
57 0 1 0 0.00% 0.00% 0.00% 0 POS APS Event Pr
58 0 1 0 0.00% 0.00% 0.00% 0 SONET alarm time
59 0 2 0 0.00% 0.00% 0.00% 0 Hawkeye Backgrou
60 0 1 0 0.00% 0.00% 0.00% 0 CSP Timer
61 0 2 0 0.00% 0.00% 0.00% 0 FPD Management P
62 0 1 0 0.00% 0.00% 0.00% 0 FPD Action Proce
63 1108 74393 14 0.00% 0.00% 0.00% 0 Collection proce
64 0 1 0 0.00% 0.00% 0.00% 0 CES Line Conditi
65 0 2 0 0.00% 0.00% 0.00% 0 Flash MIB Update
66 4 6 666 0.00% 0.00% 0.00% 0 Flash Card Oir
67 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
68 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
69 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
70 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
71 8 19853 0 0.00% 0.00% 0.00% 0 DFS flush period
72 1190120 12956856 91 0.23% 0.23% 0.22% 0 AAA Server
73 37948 166779 227 0.00% 0.00% 0.00% 0 AAA ACCT Proc
74 3796 36930272 0 0.00% 0.00% 0.00% 0 ACCT Periodic Pr
75 0 1 0 0.00% 0.00% 0.00% 0 AAA System Acct
76 0 1 0 0.00% 0.00% 0.00% 0 tHUB
77 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R
78 0 2 0 0.00% 0.00% 0.00% 0 CEF switching ba
79 0 2 0 0.00% 0.00% 0.00% 0 IPAM/ODAP Events
80 4792 36930277 0 0.00% 0.01% 0.00% 0 IPAM Manager
81 0 2 0 0.00% 0.00% 0.00% 0 IPAM Events
82 0 15 0 0.00% 0.00% 0.00% 0 IP ARP Adjacency
83 4277228 78191448 54 0.95% 0.95% 0.92% 0 IP Input
84 0 1 0 0.00% 0.00% 0.00% 0 ICMP event handl
85 0 5 0 0.00% 0.00% 0.00% 0 TurboACL
86 0 2 0 0.00% 0.00% 0.00% 0 TurboACL chunk
87 168 3204 52 0.00% 0.00% 0.00% 0 ADJ resolve proc
88 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Echo event
89 0 1 0 0.00% 0.00% 0.00% 0 LSP Tunnel FRR
90 0 1 0 0.00% 0.00% 0.00% 0 MPLS Auto-Tunnel
91 0 1 0 0.00% 0.00% 0.00% 0 O-UNI Client Msg
92 0 1 0 0.00% 0.00% 0.00% 0 AAA EPD HANDLER
93 0 1 0 0.00% 0.00% 0.00% 0 PM EPD API
94 0 5 0 0.00% 0.00% 0.00% 0 PPP SIP
95 14144 101572 139 0.00% 0.00% 0.00% 0 PPP Bind
96 33920 303835 111 0.00% 0.00% 0.00% 0 PPP IP Route
98 1568632 37728948 41 0.15% 0.13% 0.11% 0 SSM connection m
99 0 2 0 0.00% 0.00% 0.00% 0 Spanning Tree
100 0 2 0 0.00% 0.00% 0.00% 0 ATM OAM Input
101 0 2 0 0.00% 0.00% 0.00% 0 ATM OAM TIMER
102 28 1987 14 0.00% 0.00% 0.00% 0 MOP Protocols
103 6304800 22987724 274 1.03% 0.88% 0.81% 0 SSS Manager
104 0 1 0 0.00% 0.00% 0.00% 0 SSS Policy Manag
105 22984 468723 49 0.00% 0.00% 0.00% 0 SSS Feature Mana
106 860 4652544 0 0.00% 0.00% 0.00% 0 SSS Feature Time
107 0 1 0 0.00% 0.00% 0.00% 0 SG DPM
108 0 1 0 0.00% 0.00% 0.00% 0 Timer handler fo
109 0 1 0 0.00% 0.00% 0.00% 0 Prepaid response
110 0 1 0 0.00% 0.00% 0.00% 0 Timed Policy act
111 0 1 0 0.00% 0.00% 0.00% 0 AAA response han
112 0 2 0 0.00% 0.00% 0.00% 0 KRB5 AAA
113 0 1 0 0.00% 0.00% 0.00% 0 delayed evt hand
114 0 1 0 0.00% 0.00% 0.00% 0 AC Switch
115 0 1 0 0.00% 0.00% 0.00% 0 SG CMD HANDLER
116 0 2 0 0.00% 0.00% 0.00% 0 IP PORTBUNDLE
117 52 290816 0 0.00% 0.00% 0.00% 0 IP SIP Process
118 4044 36930299 0 0.00% 0.00% 0.00% 0 RADIUS Proxy
119 0 1 0 0.00% 0.00% 0.00% 0 TC SIP
120 72 23792 3 0.00% 0.00% 0.00% 0 CEF background p
121 0 1 0 0.00% 0.00% 0.00% 0 IP IRDP
122 0 2 0 0.00% 0.00% 0.00% 0 SNMP Timers
123 42784 919143 46 0.00% 0.00% 0.00% 0 IP Background
124 124252 846556 146 0.00% 0.00% 0.00% 0 IP RIB Update
125 32 998 32 0.00% 0.00% 0.00% 2 Virtual Exec
126 4900 178197 27 0.00% 0.00% 0.00% 0 VPDN failure man
127 0 1 0 0.00% 0.00% 0.00% 0 IP Traceroute
128 0 1 0 0.00% 0.00% 0.00% 0 Socket Timers
129 1644 27024 60 0.00% 0.00% 0.00% 0 DHCPD Receive
130 52 2068 25 0.00% 0.00% 0.00% 0 static
131 240 49569 4 0.00% 0.00% 0.00% 0 TCP Timer
132 1696 7889 214 0.00% 0.00% 0.00% 0 TCP Protocols
133 0 3971 0 0.00% 0.00% 0.00% 0 HTTP CORE
134 10896 293774766 0 0.07% 0.07% 0.07% 0 HQF Shaper Backg
135 6972 293774795 0 0.07% 0.06% 0.07% 0 HQF Input Shaper
136 0 2 0 0.00% 0.00% 0.00% 0 LFDp Input Proc
137 0 2 0 0.00% 0.00% 0.00% 0 SCTP Main Proces
138 0 2 0 0.00% 0.00% 0.00% 0 PPP Compress Inp
139 0 2 0 0.00% 0.00% 0.00% 0 PPP Compress Res
140 0 1 0 0.00% 0.00% 0.00% 0 COPS
141 0 2 0 0.00% 0.00% 0.00% 0 Dialer Forwarder
142 0 3 0 0.00% 0.00% 0.00% 0 Flow Exporter Ti
143 0 1 0 0.00% 0.00% 0.00% 0 RARP Input
144 0 2 0 0.00% 0.00% 0.00% 0 PPP NBF
145 0 1 0 0.00% 0.00% 0.00% 0 PAD InCall
146 0 2 0 0.00% 0.00% 0.00% 0 X.25 Background
147 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps Mana
148 2452 11862393 0 0.00% 0.00% 0.00% 0 RBSCP Background
149 0 1 0 0.00% 0.00% 0.00% 0 VPDN call manage
150 748224 1825397 409 0.23% 0.16% 0.16% 0 CEF: IPv4 proces
151 3408 77652 43 0.00% 0.00% 0.00% 0 ADJ background
152 0 1 0 0.00% 0.00% 0.00% 0 ac_atm_state_eve
153 0 2 0 0.00% 0.00% 0.00% 0 IP Inband Sessio
154 0 1 0 0.00% 0.00% 0.00% 0 EM Background Pr
155 0 1 0 0.00% 0.00% 0.00% 0 IDMGR CORE
156 240 4710 50 0.00% 0.00% 0.00% 0 LOCAL AAA
157 0 5 0 0.00% 0.00% 0.00% 0 MPLS Auto Mesh P
158 360 219 1643 0.00% 0.20% 0.07% 3 Virtual Exec
159 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA
160 0 2 0 0.00% 0.00% 0.00% 0 LINE AAA
161 0 2 0 0.00% 0.00% 0.00% 0 TPLUS
162 0 2 0 0.00% 0.00% 0.00% 0 Crypto Support
163 0 12 0 0.00% 0.00% 0.00% 0 crypto engine pr
164 0 1 0 0.00% 0.00% 0.00% 0 Key Proc
165 0 6 0 0.00% 0.00% 0.00% 0 Crypto ACL
166 0 1 0 0.00% 0.00% 0.00% 0 Crypto INT
167 0 4 0 0.00% 0.00% 0.00% 0 Crypto IKMP
168 16 59560 0 0.00% 0.00% 0.00% 0 IPSEC key engine
169 0 1 0 0.00% 0.00% 0.00% 0 IPSEC manual key
170 0 1 0 0.00% 0.00% 0.00% 0 Crypto PAS Proc
171 0 4 0 0.00% 0.00% 0.00% 0 Crypto CA
172 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-CRL
173 0 1 0 0.00% 0.00% 0.00% 0 Crypto SSL
174 0 1 0 0.00% 0.00% 0.00% 0 encrypt proc
175 0 1 0 0.00% 0.00% 0.00% 0 GDOI GM Process
176 362624 4767399 76 0.00% 0.02% 0.00% 0 AAA SEND STOP EV
177 0 2 0 0.00% 0.00% 0.00% 0 EEM ED Resource
178 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Track
179 0 1 0 0.00% 0.00% 0.00% 0 Syslog Traps
180 56 119107 0 0.00% 0.00% 0.00% 0 RMON Recycle Pro
181 0 2 0 0.00% 0.00% 0.00% 0 RMON Deferred Se
182 24 138 173 0.00% 0.01% 0.00% 4 Virtual Exec
183 0 1 0 0.00% 0.00% 0.00% 0 MV64 TDR Process
184 0 37 0 0.00% 0.00% 0.00% 0 EEM Server
185 0 2 0 0.00% 0.00% 0.00% 0 EEM Policy Direc
186 0 3 0 0.00% 0.00% 0.00% 0 EEM ED CLI
187 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Config
188 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Counter
189 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Env
190 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Interface
191 0 3 0 0.00% 0.00% 0.00% 0 EEM ED IOSWD
192 0 3 0 0.00% 0.00% 0.00% 0 EEM ED None
193 0 3 0 0.00% 0.00% 0.00% 0 EEM ED OIR
194 0 2 0 0.00% 0.00% 0.00% 0 tENM
195 0 3 0 0.00% 0.00% 0.00% 0 EEM ED SNMP
196 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Test
197 4 29860 0 0.00% 0.00% 0.00% 0 EEM ED Timer
198 12 56583 0 0.00% 0.00% 0.00% 0 IP SLA MPLSLM Pr
199 20 305 65 0.00% 0.00% 0.00% 0 Syslog
200 0 1 0 0.00% 0.00% 0.00% 0 RMON Packets
201 0 1 0 0.00% 0.00% 0.00% 0 IP SLAs Ethernet
202 0 1 0 0.00% 0.00% 0.00% 0 IP SLA AutoEther
203 264 22608 11 0.00% 0.00% 0.00% 0 Net Input
204 5244200 388598 13495 0.47% 0.44% 0.43% 0 Compute load avg
205 8 5 1600 0.00% 0.00% 0.00% 0 crypto sw pk pro
207 1398812 547611831 2 5.27% 5.27% 5.24% 0 L2X Data Daemon
208 447680 774468 578 0.07% 0.05% 0.04% 0 L2TP mgmt daemon
209 213684 638194 334 0.07% 0.02% 0.00% 0 L2TUN Applicatio
210 0 1 0 0.00% 0.00% 0.00% 0 VPDN Test
211 1440332 27764880 51 0.07% 0.13% 0.11% 0 PPPoE Background
212 2845100 35973988 79 0.31% 0.29% 0.28% 0 PPPoE Discovery
213 91560 46276259 1 0.07% 0.04% 0.05% 0 PPP manager
214 3801560 70682638 53 0.63% 0.61% 0.58% 0 PPP Events
215 116 1190837 0 0.00% 0.00% 0.00% 0 Multilink PPP
216 0 2 0 0.00% 0.00% 0.00% 0 Multilink event
218 75752 1395317 54 0.00% 0.00% 0.00% 0 IP SNMP
219 21072 698269 30 0.00% 0.00% 0.00% 0 PDU DISPATCHER
220 86136 697192 123 0.00% 0.00% 0.00% 0 SNMP ENGINE
221 0 2 0 0.00% 0.00% 0.00% 0 IP SNMPV6
222 0 1 0 0.00% 0.00% 0.00% 0 SNMP ConfCopyPro
223 0 1 0 0.00% 0.00% 0.00% 0 SNMP Traps
224 1520096 73207009 20 0.31% 0.29% 0.26% 0 RADIUS
225 8 19906 0 0.00% 0.00% 0.00% 0 Time Range Proce
226 695960 234558 2967 0.00% 0.11% 0.11% 0 VTEMPLATE Backgr
227 4 9927 0 0.00% 0.00% 0.00% 0 DHCPD Timer
228 4 19853 0 0.00% 0.00% 0.00% 0 DHCPD Database
229 2120 545479 3 0.00% 0.00% 0.00% 0 EIGRP-IPv4: Rout
230 844824 22549554 37 0.15% 0.07% 0.07% 0 EIGRP-IPv4: PDM
231 3497712 279146321 12 39.35% 39.22% 39.04% 0 EIGRP-IPv4: HELL
please note that EIGRP process have high CPU
also note that i have 2 7200 router have the same confiugration but runing 12.4(4)XD10 and same number of session the CPU working normal 6% and EIGRP normail
Thank you
QaesHi There,
Just want to share a tip on ow to filter your CPU utilisation on your Cisco router. I find alias commands handy and use them all the time. From the config mode, you can type as below.
R(config)#alias exec cpu sho process cpu sorted | exc 0.00%__0.00%__0.00%
This will create an alias called cpu, from priviledge mode, you can then type cpu and it will filter all process' that are not consuming the CPU, this is done with the help of exc [exclude]. This excludes all process' with 0% utilisation.
Below is my example on one of my routers.
Thanks,
Faraimd -
Troubleshooting high cpu on ciso 7200 for ADSL L2tp
hi all ,
i have cisco 7200 as LNS router for ADSL.
now there is cpu 10 % differ between hardware & software !!
in rush hour the differ is 20 % and cpu is 95 % !!!!
here i want to ask ,
does a high value if (IP INPUT)
i have the cpu as :
Bras2#sh processes cpu sorted
CPU utilization for five seconds: 46%/36%; one minute: 48%; five minutes: 47%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
87 17598348 81792634 215 3.75% 3.82% 3.85% 0 IP Input
122 6780696 68885502 98 1.43% 1.49% 1.51% 0 L2X Data Daemon
267 652328 3839852 169 0.87% 0.83% 0.80% 0 PPP Events
261 837328 436010 1920 0.55% 0.44% 0.35% 0 L2TP mgmt daemon
275 1665220 1634254 1018 0.55% 0.57% 0.55% 0 SNMP ENGINE
262 574524 378112 1519 0.39% 0.29% 0.24% 0 L2TUN Applicatio
52 1019288 22961 44392 0.39% 0.39% 0.39% 0 Compute load avg
112 951036 174201 5459 0.31% 0.31% 0.31% 0 CEF: IPv4 proces
142 59512 26465240 2 0.15% 0.19% 0.18% 0 HQF Shaper Backg
256 89812 1276789 70 0.15% 0.15% 0.15% 0 IPHC Admin
102 182336 433843 420 0.15% 0.10% 0.08% 0 SSM connection m
97 150508 128933 1167 0.15% 0.09% 0.08% 0 SSS Manager
258 486356 1268702 383 0.15% 0.18% 0.16% 0 RADIUS
78 83244 300654 276 0.15% 0.15% 0.14% 0 ACCT Periodic Pr
56 225176 23195 9707 0.15% 0.08% 0.05% 0 HC Counter Timer
273 623508 3248144 191 0.15% 0.20% 0.21% 0 IP SNMP
16 780412 2008294 388 0.07% 0.55% 0.46% 0 EnvMon
291 176 380 463 0.07% 0.01% 0.00% 2 SSH Process
289 3296 447173 7 0.07% 0.00% 0.00% 0 MLD
20 992 117612 8 0.07% 0.00% 0.00% 0 ARP Background
80 41692 18825 2214 0.07% 0.02% 0.00% 0 CDP Protocol
266 30024 3564894 8 0.07% 0.05% 0.07% 0 PPP manager
274 323728 1633937 198 0.07% 0.11% 0.13% 0 PDU DISPATCHER
139 35600 64784 549 0.07% 0.01% 0.00% 0 PPP Bind
25 0 1 0 0.00% 0.00% 0.00% 0 Policy Manager
26 636 16121 39 0.00% 0.00% 0.00% 0 DDR Timers
24 0 8 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
28 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun
29 0 1 0 0.00% 0.00% 0.00% 0 RO Notify Timers
27 0 5 0 0.00% 0.00% 0.00% 0 Entity MIB API
30 0 1 0 0.00% 0.00% 0.00% 0 RMI RM Notify Wa
32 0 2 0 0.00% 0.00% 0.00% 0 SMART
33 576 112990 5 0.00% 0.00% 0.00% 0 GraphIt
34 0 2 0 0.00% 0.00% 0.00% 0 Dialer event
35 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect
36 0 2 0 0.00% 0.00% 0.00% 0 XML Proxy Client
31 12 220 54 0.00% 0.00% 0.00% 0 EEM ED Syslog
23 166932 860 194106 0.00% 0.02% 0.01% 0 AAA high-capacit
39 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
40 33388 90640 368 0.00% 0.05% 0.01% 0 Net Background
41 0 4 0 0.00% 0.00% 0.00% 0 IDB Work
42 16 412 38 0.00% 0.00% 0.00% 0 Logger
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
43 852 112782 7 0.00% 0.00% 0.00% 0 TTY Background
44 2484 112998 21 0.00% 0.00% 0.00% 0 Per-Second Jobs
45 8444 30499 276 0.00% 0.00% 0.00% 0 IF-MGR control p
46 612 33340 18 0.00% 0.00% 0.00% 0 IF-MGR event pro
47 0 1 0 0.00% 0.00% 0.00% 0 Inode Table Dest
48 0 1 0 0.00% 0.00% 0.00% 0 IKE HA Mgr
49 0 1 0 0.00% 0.00% 0.00% 0 IPSEC HA Mgr
50 0 4 0 0.00% 0.00% 0.00% 0 rf task
37 0 2 0 0.00% 0.00% 0.00% 0 VSA background
38 0 1 0 0.00% 0.00% 0.00% 0 VSA Cleanup Proc
22 0 1 0 0.00% 0.00% 0.00% 0 CEF MIB API
54 0 1 0 0.00% 0.00% 0.00% 0 Token Daemon
55 8 1553 5 0.00% 0.00% 0.00% 0 Transport Port A
17 0 1 0 0.00% 0.00% 0.00% 0 OIR Handler
57 0 1 0 0.00% 0.00% 0.00% 0 Coproc Event Pro
58 0 1 0 0.00% 0.00% 0.00% 0 POS APS Event Pr
59 0 1 0 0.00% 0.00% 0.00% 0 SONET alarm time
60 0 1 0 0.00% 0.00% 0.00% 0 CSP Timer
61 204 4 51000 0.00% 0.00% 0.00% 0 USB Startup
62 0 2 0 0.00% 0.00% 0.00% 0 FPD Management P
63 0 1 0 0.00% 0.00% 0.00% 0 FPD Action Proce
64 0 2 0 0.00% 0.00% 0.00% 0 VNM DSPRM MAIN
65 0 1 0 0.00% 0.00% 0.00% 0 RF_INTERDEV_DELA
66 0 1 0 0.00% 0.00% 0.00% 0 RF_INTERDEV_SCTP
67 312 112992 2 0.00% 0.00% 0.00% 0 ISA Common Helpe
68 0 2 0 0.00% 0.00% 0.00% 0 Flash MIB Update
69 0 137 0 0.00% 0.00% 0.00% 0 Flash Card Oir
70 0 1 0 0.00% 0.00% 0.00% 0 CES Line Conditi
71 0 1 0 0.00% 0.00% 0.00% 0 CF_INTERDEV_SCTP
72 608 13885 43 0.00% 0.00% 0.00% 0 Collection proce
73 0 2 0 0.00% 0.00% 0.00% 0 Ethernet CFM
74 420 110120 3 0.00% 0.00% 0.00% 0 Ethernet Timer C
75 0 1 0 0.00% 0.00% 0.00% 0 delayed evt hand
76 14204 76635 185 0.00% 0.01% 0.00% 0 AAA Server
77 152732 330843 461 0.00% 0.07% 0.07% 0 AAA ACCT Proc
15 0 1 0 0.00% 0.00% 0.00% 0 IPC BackPressure
79 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R
51 1360 34703 39 0.00% 0.00% 0.00% 0 Net Input
18 0 1 0 0.00% 0.00% 0.00% 0 Crash writer
82 0 2 0 0.00% 0.00% 0.00% 0 Ethernet LMI
53 27432 2073 13232 0.00% 0.01% 0.00% 0 Per-minute Jobs
21 0 2 0 0.00% 0.00% 0.00% 0 ATM Idle Timer
85 4 14 285 0.00% 0.00% 0.00% 0 IP ARP Adjacency
86 0 1 0 0.00% 0.00% 0.00% 0 IP ARP Retry Age
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
14 0 1 0 0.00% 0.00% 0.00% 0 IPC Seat Manager
88 340 22531 15 0.00% 0.00% 0.00% 0 ICMP event handl
89 0 5 0 0.00% 0.00% 0.00% 0 TurboACL
90 0 2 0 0.00% 0.00% 0.00% 0 TurboACL chunk
91 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Echo event
92 52 191 272 0.00% 0.00% 0.00% 0 MOP Protocols
93 0 1 0 0.00% 0.00% 0.00% 0 LSP Tunnel FRR
94 0 1 0 0.00% 0.00% 0.00% 0 MPLS Auto-Tunnel
95 7280 94698 76 0.00% 0.00% 0.00% 0 PPP Hooks
96 3312 186 17806 0.00% 0.21% 0.05% 0 AAA aux
13 300 110122 2 0.00% 0.00% 0.00% 0 IPC Deferred Por
98 0 1 0 0.00% 0.00% 0.00% 0 SSS Feature Mana
99 0 1 0 0.00% 0.00% 0.00% 0 SSS Feature Time
100 0 2 0 0.00% 0.00% 0.00% 0 Spanning Tree
101 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps Mana
12 420 110123 3 0.00% 0.00% 0.00% 0 IPC Periodic Tim
103 0 1 0 0.00% 0.00% 0.00% 0 AC Switch
104 4 377 10 0.00% 0.00% 0.00% 0 Authentication P
105 0 1 0 0.00% 0.00% 0.00% 0 Auth-proxy AAA B
106 0 2 0 0.00% 0.00% 0.00% 0 EAPoUDP Process
107 0 2 0 0.00% 0.00% 0.00% 0 IP Host Track Pr
108 0 2 0 0.00% 0.00% 0.00% 0 KRB5 AAA
109 10700 103089 103 0.00% 0.00% 0.00% 0 IP Background
110 20472 32419 631 0.00% 0.01% 0.00% 0 IP RIB Update
111 28 2276 12 0.00% 0.00% 0.00% 0 CEF background p
11 0 1 0 0.00% 0.00% 0.00% 0 IPC Zone Manager
113 2984 18512 161 0.00% 0.00% 0.00% 0 ADJ background
114 38364 30893 1241 0.00% 0.02% 0.00% 0 PPP IP Route
115 16196 84753 191 0.00% 0.00% 0.00% 0 PPP IPCP
116 0 1 0 0.00% 0.00% 0.00% 0 IP Traceroute
117 296 3464 85 0.00% 0.00% 0.00% 0 TCP Timer
118 252 1714 147 0.00% 0.00% 0.00% 0 TCP Protocols
119 0 1 0 0.00% 0.00% 0.00% 0 Socket Timers
120 0 377 0 0.00% 0.00% 0.00% 0 HTTP CORE
121 0 2 0 0.00% 0.00% 0.00% 0 RLM groups Proce
10 0 1884 0 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
123 0 1 0 0.00% 0.00% 0.00% 0 ac_atm_state_eve
124 0 2 0 0.00% 0.00% 0.00% 0 SNMP Timers
125 876 112720 7 0.00% 0.00% 0.00% 0 RUDPV1 Main Proc
126 0 1 0 0.00% 0.00% 0.00% 0 bsm_timers
127 416 112720 3 0.00% 0.00% 0.00% 0 bsm_xmt_proc
128 0 1 0 0.00% 0.00% 0.00% 0 COPS
129 0 2 0 0.00% 0.00% 0.00% 0 Dialer Forwarder
130 0 3 0 0.00% 0.00% 0.00% 0 Flow Exporter Ti
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
131 0 2 0 0.00% 0.00% 0.00% 0 ATM OAM Input
132 0 2 0 0.00% 0.00% 0.00% 0 ATM OAM TIMER
133 0 1 0 0.00% 0.00% 0.00% 0 RARP Input
134 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Inspect Tim
135 0 1 0 0.00% 0.00% 0.00% 0 LAPB Process
136 0 2 0 0.00% 0.00% 0.00% 0 LFDp Input Proc
137 0 1 0 0.00% 0.00% 0.00% 0 PAD InCall
9 0 2 0 0.00% 0.00% 0.00% 0 ATM VC Auto Crea
81 0 2 0 0.00% 0.00% 0.00% 0 Ethernet OAM Pro
140 0 2 0 0.00% 0.00% 0.00% 0 PPP SSS
141 0 1 0 0.00% 0.00% 0.00% 0 MQC Flow Event B
83 0 2 0 0.00% 0.00% 0.00% 0 CEF switching ba
143 4904 1113579 4 0.00% 0.00% 0.00% 0 RBSCP Background
144 0 2 0 0.00% 0.00% 0.00% 0 SCTP Main Proces
7 0 2 0 0.00% 0.00% 0.00% 0 Timers
84 4388 11191 392 0.00% 0.00% 0.00% 0 ADJ resolve proc
8 0 2 0 0.00% 0.00% 0.00% 0 ATM AutoVC Perio
148 0 1 0 0.00% 0.00% 0.00% 0 IPS Process
149 0 2 0 0.00% 0.00% 0.00% 0 IPS Auto Update
150 0 2 0 0.00% 0.00% 0.00% 0 SDEE Management
151 620 219806 2 0.00% 0.00% 0.00% 0 Inspect process
152 0 1 0 0.00% 0.00% 0.00% 0 xcpa-driver
153 60 9030 6 0.00% 0.00% 0.00% 0 FW DP Inspect pr
154 640 219803 2 0.00% 0.00% 0.00% 0 CCE DP URLF cach
155 0 2 0 0.00% 0.00% 0.00% 0 URL filter proc
156 0 1 0 0.00% 0.00% 0.00% 0 XSM_EVENT_ENGINE
157 284 11275 25 0.00% 0.00% 0.00% 0 XSM_ENQUEUER
158 196 11275 17 0.00% 0.00% 0.00% 0 XSM Historian
159 0 1 0 0.00% 0.00% 0.00% 0 Select Timers
160 0 2 0 0.00% 0.00% 0.00% 0 HTTP Process
161 0 2 0 0.00% 0.00% 0.00% 0 CIFS API Process
162 0 2 0 0.00% 0.00% 0.00% 0 CIFS Proxy Proce
163 0 1 0 0.00% 0.00% 0.00% 0 Crypto HW Proc
164 24 7532 3 0.00% 0.00% 0.00% 0 ACE policy loade
165 60 4521 13 0.00% 0.00% 0.00% 0 CRM_CALL_UPDATE_
166 0 2 0 0.00% 0.00% 0.00% 0 cpf_process_msg_
167 0 2 0 0.00% 0.00% 0.00% 0 AAA Cached Serve
168 0 2 0 0.00% 0.00% 0.00% 0 ENABLE AAA
169 0 1 0 0.00% 0.00% 0.00% 0 EM Background Pr
170 0 1 0 0.00% 0.00% 0.00% 0 Key chain liveke
171 0 2 0 0.00% 0.00% 0.00% 0 LINE AAA
172 28872 54359 531 0.00% 0.00% 0.00% 0 LOCAL AAA
173 0 6 0 0.00% 0.00% 0.00% 0 MPLS Auto Mesh P
174 0 2 0 0.00% 0.00% 0.00% 0 TPLUS
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
175 0 2 0 0.00% 0.00% 0.00% 0 VSP_MGR
176 0 1 0 0.00% 0.00% 0.00% 0 FW_TEST_TRP
177 0 1 0 0.00% 0.00% 0.00% 0 EPM MAIN PROCESS
178 4 3 1333 0.00% 0.00% 0.00% 0 Crypto WUI
179 0 2 0 0.00% 0.00% 0.00% 0 Crypto Support
180 0 1 0 0.00% 0.00% 0.00% 0 IPSECv6 PS Proc
181 4 1 4000 0.00% 0.00% 0.00% 0 CCVPM_HTSP
182 0 1 0 0.00% 0.00% 0.00% 0 CCVPM_R2
183 0 1 0 0.00% 0.00% 0.00% 0 EPHONE MWI Refre
184 0 126 0 0.00% 0.00% 0.00% 0 FB/KS Log HouseK
185 0 2 0 0.00% 0.00% 0.00% 0 EPHONE MWI BG Pr
186 0 1 0 0.00% 0.00% 0.00% 0 Skinny HW confer
187 0 1 0 0.00% 0.00% 0.00% 0 CCSWVOICE
188 0 1 0 0.00% 0.00% 0.00% 0 cpf_process_tpQ
189 0 1 0 0.00% 0.00% 0.00% 0 http client proc
190 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
191 0 1 0 0.00% 0.00% 0.00% 0 QOS_MODULE_MAIN
192 0 1 0 0.00% 0.00% 0.00% 0 RPMS_PROC_MAIN
193 0 1 0 0.00% 0.00% 0.00% 0 VoIP AAA
194 0 2 0 0.00% 0.00% 0.00% 0 Dialog Manager
195 36 9 4000 0.00% 0.00% 0.00% 0 crypto engine pr
196 0 4 0 0.00% 0.00% 0.00% 0 Crypto CA
197 0 1 0 0.00% 0.00% 0.00% 0 Crypto PKI-CRL
198 0 1 0 0.00% 0.00% 0.00% 0 encrypt proc
199 18492 1442 12823 0.00% 0.00% 0.00% 0 crypto sw pk pro
200 0 1 0 0.00% 0.00% 0.00% 0 Crypto INT
201 0 3 0 0.00% 0.00% 0.00% 0 Crypto IKE Dispa
202 0 3 0 0.00% 0.00% 0.00% 0 Crypto IKMP
203 0 1 0 0.00% 0.00% 0.00% 0 IPSEC manual key
204 56 5652 9 0.00% 0.00% 0.00% 0 IPSEC key engine
205 0 1 0 0.00% 0.00% 0.00% 0 CRYPTO QoS proce
206 4 8 500 0.00% 0.00% 0.00% 0 Crypto ACL
207 0 1 0 0.00% 0.00% 0.00% 0 Crypto PAS Proc
208 0 1 0 0.00% 0.00% 0.00% 0 GDOI GM Process
209 0 1 0 0.00% 0.00% 0.00% 0 UNICAST REKEY
210 0 1 0 0.00% 0.00% 0.00% 0 UNICAST REKEY AC
211 0 1 0 0.00% 0.00% 0.00% 0 MV64 TDR Process
212 0 1 0 0.00% 0.00% 0.00% 0 IMA Traps
213 0 1 0 0.00% 0.00% 0.00% 0 SYSMGT Events
214 0 2 0 0.00% 0.00% 0.00% 0 Control-plane ho
215 0 1 0 0.00% 0.00% 0.00% 0 DATA Transfer Pr
216 0 1 0 0.00% 0.00% 0.00% 0 DATA Collector
217 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
218 22396 77367 289 0.00% 0.00% 0.00% 0 AAA SEND STOP EV
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
219 24 11298 2 0.00% 0.00% 0.00% 0 RMON Recycle Pro
220 0 2 0 0.00% 0.00% 0.00% 0 RMON Deferred Se
221 0 1 0 0.00% 0.00% 0.00% 0 Syslog Traps
222 0 2 0 0.00% 0.00% 0.00% 0 EEM ED Resource
223 0 2 0 0.00% 0.00% 0.00% 0 EEM ED Routing
224 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Track
225 20 3531 5 0.00% 0.00% 0.00% 0 Crypto cTCP proc
226 0 1 0 0.00% 0.00% 0.00% 0 IP SLAs Ethernet
227 0 1 0 0.00% 0.00% 0.00% 0 RMON Packets
228 780 112376 6 0.00% 0.00% 0.00% 0 trunk conditioni
229 0 1 0 0.00% 0.00% 0.00% 0 trunk conditioni
230 0 157 0 0.00% 0.00% 0.00% 0 EEM Server
231 4 2 2000 0.00% 0.00% 0.00% 0 Call Home proces
232 48 213 225 0.00% 0.00% 0.00% 0 Syslog
233 0 1 0 0.00% 0.00% 0.00% 0 VPDN Test
234 0 2 0 0.00% 0.00% 0.00% 0 EEM Policy Direc
235 0 2 0 0.00% 0.00% 0.00% 0 EEM ED CLI
236 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Counter
237 0 3 0 0.00% 0.00% 0.00% 0 EM ED GOLD
238 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Interface
239 0 3 0 0.00% 0.00% 0.00% 0 EEM ED IOSWD
240 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Ipsla
241 0 3 0 0.00% 0.00% 0.00% 0 EEM ED None
242 0 2 0 0.00% 0.00% 0.00% 0 EEM ED Nf
243 0 3 0 0.00% 0.00% 0.00% 0 EEM ED OIR
244 0 3 0 0.00% 0.00% 0.00% 0 EEM ED RF
245 0 3 0 0.00% 0.00% 0.00% 0 EEM ED SNMP
246 0 2 0 0.00% 0.00% 0.00% 0 EEM ED SNMP Noti
247 12 2881 4 0.00% 0.00% 0.00% 0 EEM ED Timer
248 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Test
249 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Config
250 0 3 0 0.00% 0.00% 0.00% 0 EEM ED Env
251 0 3 0 0.00% 0.00% 0.00% 0 EEM ED RPC
252 0 1 0 0.00% 0.00% 0.00% 0 L2X Socket proce
253 0 1 0 0.00% 0.00% 0.00% 0 Key Proc
254 4 1884 2 0.00% 0.00% 0.00% 0 Call Home Timer
255 0 1 0 0.00% 0.00% 0.00% 0 tHUB
6 3008 10386 289 0.00% 0.00% 0.00% 0 Pool Manager
257 16 65 246 0.00% 0.00% 0.00% 0 SSH Event handle
5 541952 28222 19203 0.00% 0.12% 0.15% 0 Check heaps
259 0 3 0 0.00% 0.00% 0.00% 0 WCCP V2 Protocol
260 8 1887 4 0.00% 0.00% 0.00% 0 Secure Login
4 0 1 0 0.00% 0.00% 0.00% 0 EDDRI_MAIN
3 0 1 0 0.00% 0.00% 0.00% 0 chkpt message ha
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
263 11512 129066 89 0.00% 0.00% 0.00% 0 VPDN failure man
264 1044 22558 46 0.00% 0.00% 0.00% 0 Track
265 0 1 0 0.00% 0.00% 0.00% 0 IP VFR proc
19 14880 59648 249 0.00% 0.00% 0.00% 0 ARP Input
2 2376 22599 105 0.00% 0.01% 0.00% 0 Load Meter
268 316 112815 2 0.00% 0.00% 0.00% 0 Multilink PPP
269 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
270 736 219805 3 0.00% 0.00% 0.00% 0 IP NAT Ager
271 0 1 0 0.00% 0.00% 0.00% 0 IP NAT WLAN
272 620 24477 25 0.00% 0.00% 0.00% 0 IP SLAs Event Pr
138 0 2 0 0.00% 0.00% 0.00% 0 X.25 Background
147 0 1 0 0.00% 0.00% 0.00% 0 CHKPT DevTest
145 0 1 0 0.00% 0.00% 0.00% 0 VPDN call manage
276 0 2 0 0.00% 0.00% 0.00% 0 IP SNMPV6
277 0 1 0 0.00% 0.00% 0.00% 0 SNMP ConfCopyPro
278 0 1 0 0.00% 0.00% 0.00% 0 SNMP Traps
279 360116 45545 7906 0.00% 0.22% 0.11% 0 VTEMPLATE Backgr
280 0 4 0 0.00% 0.00% 0.00% 0 IP-EIGRP Router
281 40020 226871 176 0.00% 0.03% 0.00% 0 IP-EIGRP: PDM
282 10660 92668 115 0.00% 0.00% 0.00% 0 IP-EIGRP: HELLO
283 0 1 0 0.00% 0.00% 0.00% 0 Async write proc
284 20 1869 10 0.00% 0.00% 0.00% 0 DFS flush period
285 1764 61146 28 0.00% 0.00% 0.00% 0 IPv6 IDB
286 8 1870 4 0.00% 0.00% 0.00% 0 IPv6 Input
287 0 1 0 0.00% 0.00% 0.00% 0 IPv6 ND
288 0 1 0 0.00% 0.00% 0.00% 0 IPv6 Address
1 156 2155 72 0.00% 0.00% 0.00% 0 Chunk Manager
290 0 3 0 0.00% 0.00% 0.00% 0 IPv6 RIB Event H
146 0 1 0 0.00% 0.00% 0.00% 0 CHKPT EXAMPLEIn an Adaptive Session Redundancy (ASR) environment, if you run traffic to a configuration that contains discrepancies between the redundant indexes on the two CSSs, the CPU utilization for each processor on the CSS may climb to an abnormal level (at 2000 flows/second, approximately 50 percent utilization for each processor).
If you set the logging level to notice-5 or higher, the SCM utilization may peak at approximately 90 percent because each connection generates a redundant index mismatch log entry. For example:
AUG 7 14:12:15 3/1 1124272 SLR-5: Rejected. Redundant global rule index (7) not found.
This might probably the reason for the High CPU utilization.
The CSS 11800 with CSS8-SCM Redundant System Control Module (SCM) is designated for end of sales.
The recommended replacements for the Cisco CSS 11800 include the Cisco CSS 11500 Series Content Services Switch or the Content Switching Module (CSM)an integrated services module for the Cisco Catalyst. 6500 Series Switch and the Cisco 7600 Internet Router. -
HIGH CPU IOS REACH 100 % - 6500 Series
Hi, please help us how can we minimize the cpu usage of our 6500 series core switch.. below is the cpu usage and the version.. i think we need upgrade the ios . please teach us detailed steps for opening ticket. thanks. attached here is the cpu ios usage.
CPU PROCESS
91.5% 90.3% 90.3% ios base
Version
Cisco Internetwork Operating System Software
IOS (tm) s72033_rp Software (s72033_rp-IPSERVICES_WAN-VM), Version 12.2(18)SXF14
, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2008 by cisco Systems, Inc.
Compiled Thu 08-May-08 03:25 by kellythw
Image text-base: 0x01020150, data-base: 0x01021000
ROM: System Bootstrap, Version 12.2(17r)SX5, RELEASE SOFTWARE (fc1)
BOOTLDR:
XXXXXXXX uptime is 17 hours, 39 minutes
Time since RM-NT3-BB1 switched to active is 17 hours, 39 minutes
System returned to ROM by reload at 21:01:56 GMT Mon May 5 2014 (SP by reload)
System restarted at 21:05:06 GMT Mon May 5 2014
System image file is "sup-bootdisk:s72033-ipservices_wan-vz.122-18.SXF14.bin"
cisco WS-C6506-E (R7000) processor (revision 1.1) with 491520K/32768K bytes of m
emory.
Processor board ID SAL12351U4Q
SR71000 CPU at 600Mhz, Implementation 1284, Rev 1.2, 512KB L2 Cache
Last reset from s/w reset
Bridging software.
X.25 software, Version 3.0.0.
SuperLAT software (copyright 1990 by Meridian Technology Corp).
TN3270 Emulation software.
391 Virtual Ethernet/IEEE 802.3 interfaces
146 Gigabit Ethernet/IEEE 802.3 interfaces
1917K bytes of non-volatile configuration memory.
65536K bytes of Flash internal SIMM (Sector size 512K).
Configuration register is 0x2102Sir Navevenk,
Please check bellow thanks.
1. sh proc cpu sorted
XXXXX#sh proc cpu sorted ?
% Unrecognized command
XXXXX#sh proc cpu ?
detailed Show CPU use per process detailed
history Show CPU history in graph format
| Output modifiers
2. sh proc cpu de ios-base | ex 0.0
CPU utilization for five seconds: 37%; one minute: 38%; five minutes: 39%
PID/TID 5Sec 1Min 5Min Process Prio STATE CPU
16408 33.1% 31.4% 31.4% ios-base 1d05h
1 0.2% 0.3% 0.4% 10 Receive 19m12s
3 4.6% 3.7% 3.2% 10 Receive 1h38m
7 5.6% 5.4% 6.0% 21 Intr 9h39m
8 3.0% 1.8% 1.8% 22 Intr 1h10m
12 0.6% 1.1% 2.1% 10 Receive 1h44m
13 5.3% 3.6% 1.4% 10 Receive 1h42m
14 3.6% 3.2% 2.1% 10 Reply 1h36m
15 1.5% 3.2% 1.3% 10 Receive 1h35m
19 6.9% 4.2% 3.5% 10 Receive 1h39m
20 1.8% 3.7% 3.2% 10 Reply 1h43m
Process sbin/ios-base, type IOS, PID = 16408
CPU utilization for five seconds: 14%/6%; one minute: 22%; five minutes: 22%
Task Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Task Name
3 1613034 32981487 48 0.39% 0.54% 0.55% 0 Service Task
4 1116381 11672688 95 0.31% 0.43% 0.44% 0 Service Task
17 1079952 702528 1537 0.71% 0.51% 0.44% 0 ARP Input
32 313016 507290 617 0.15% 0.14% 0.14% 0 RPCP Slave
41 549787 59949 9170 0.21% 0.19% 0.21% 0 HC Counter Timer
93 757717 199397 3800 0.21% 0.27% 0.28% 0 Compute load avg
125 1151381 13529847 85 0.15% 0.44% 0.46% 0 ION IP output
126 34179777 23406153 1460 8.00% 13.82% 13.29% 0 IP Input
131 5195876 9372573 554 0.71% 0.64% 1.15% 0 IP NAT Ager
168 3852539 25022469 153 0.95% 1.44% 1.49% 0 Standby (HSRP)
223 3494398 13872600 251 0.95% 1.45% 1.45% 0 Port manager per
3. Sh proc cpu
PID 5Sec 1Min 5Min Process
1 0.0% 0.5% 0.6% kernel
3 0.0% 0.0% 0.0% qdelogger
4 0.0% 0.0% 0.0% devc-pty
5 0.0% 0.0% 0.0% devc-mistral.proc
6 0.0% 0.0% 0.0% pipe
7 0.0% 0.0% 0.0% dumper.proc
4104 0.0% 0.0% 0.0% bflash_driver.proc
12297 0.0% 0.0% 0.0% pcmcia_driver.proc
12298 0.0% 0.0% 0.0% mqueue
12299 0.0% 0.0% 0.0% flashfs_hes.proc
12300 0.0% 0.0% 0.0% dfs_bootdisk.proc
12301 0.0% 0.0% 0.0% ldcache.proc
12302 0.0% 0.0% 0.0% watchdog.proc
12303 0.0% 0.0% 0.0% syslogd.proc
12304 0.0% 0.0% 0.0% name_svr.proc
12305 0.1% 0.0% 0.0% wdsysmon.proc
12306 0.0% 0.0% 0.0% sysmgr.proc
16386 0.0% 0.0% 0.0% chkptd.proc
16403 0.0% 0.0% 0.0% sysmgr.proc
16404 0.0% 0.0% 0.0% syslog_dev.proc
16405 0.0% 0.0% 0.0% itrace_exec.proc
16406 0.0% 0.0% 0.0% packet.proc
16407 0.0% 0.0% 0.0% installer.proc
16408 36.8% 30.7% 30.8% ios-base
16409 0.0% 0.0% 0.0% fh_fd_rf.proc
16410 0.0% 0.0% 0.0% fh_fd_oir.proc
16411 0.0% 0.0% 0.0% fh_fd_cli.proc
16412 0.0% 0.0% 0.0% fh_metric_dir.proc
16413 0.0% 0.0% 0.0% fh_fd_snmp.proc
16414 0.0% 0.0% 0.0% fh_fd_none.proc
16415 0.0% 0.0% 0.0% fh_fd_intf.proc
16416 0.0% 0.0% 0.0% fh_fd_gold.proc
16417 0.0% 0.0% 0.0% fh_fd_counter.proc
16418 0.0% 0.0% 0.0% fh_fd_timer.proc
16419 0.0% 0.0% 0.0% fh_fd_ioswd.proc
16420 0.0% 0.0% 0.0% fh_server.proc
16421 0.0% 0.0% 0.0% fh_policy_dir.proc
16422 0.0% 0.0% 0.0% ipfs_daemon.proc
16423 0.4% 0.4% 0.4% raw_ip.proc
16424 0.0% 0.0% 0.0% inetd.proc
16425 0.1% 0.1% 0.1% tcp.proc
16426 1.2% 1.5% 2.2% udp.proc
16427 0.7% 0.9% 1.1% iprouting.iosproc
16428 0.3% 0.5% 0.5% cdp2.iosproc
4.sh proc cpu detailed 16408
CPU utilization for five seconds: 29%; one minute: 34%; five minutes: 37%
PID/TID 5Sec 1Min 5Min Process Prio STATE CPU
16408 26.2% 27.9% 30.0% ios-base 1d05h
1 0.3% 0.3% 0.4% 10 Receive 19m13s
2 0.0% 0.0% 0.0% 5 Condvar 0.000
3 4.4% 3.2% 3.1% 10 Reply 1h38m
4 0.0% 0.0% 0.9% 10 Receive 1h35m
5 0.0% 0.0% 0.0% 11 Nanosleep 1.456
6 0.4% 1.5% 1.7% 10 Reply 1h32m
7 6.3% 5.7% 5.9% 21 Intr 9h40m
8 1.1% 1.7% 1.8% 22 Intr 1h10m
9 0.0% 0.0% 0.0% 23 Intr 3m14s
10 0.0% 0.0% 0.0% 25 Intr 0.000
11 0.0% 0.0% 0.0% 10 Reply 10.284
12 2.6% 1.4% 1.8% 10 Receive 1h44m
13 0.3% 2.6% 1.9% 10 Receive 1h42m
14 1.9% 2.7% 2.1% 10 Receive 1h36m
15 4.0% 3.6% 2.2% 10 Receive 1h35m
16 0.0% 0.0% 1.1% 10 Receive 1h38m
17 0.0% 0.0% 1.0% 10 Receive 1h33m
18 0.0% 0.0% 0.0% 20 Sigwaitin 0.068
19 4.2% 2.5% 3.0% 10 Receive 1h39m
20 0.7% 2.7% 3.1% 10 Receive 1h43m
Process sbin/ios-base, type IOS, PID = 16408
CPU utilization for five seconds: 16%/7%; one minute: 19%; five minutes: 21%
Task Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Task Name
1 264 1931 136 0.00% 0.00% 0.00% 1 Hot Service Task
2 2734366 47825930 57 0.87% 0.93% 1.03% 0 Service Task
3 1613598 32998937 48 0.23% 0.47% 0.53% 0 Service Task
4 1116773 11678121 95 0.15% 0.33% 0.40% 0 Service Task
5 1548 3907 396 0.00% 0.00% 0.00% 0 Chunk Manager
6 0 1 0 0.00% 0.00% 0.00% 0 Connection Mgr
7 68 2013 33 0.00% 0.00% 0.00% 0 DHCPD Timer
8 0 1 0 0.00% 0.00% 0.00% 0 PF Redun ICC Req
9 5296 48248 109 0.00% 0.00% 0.00% 0 Load Meter
10 276 231 1194 0.00% 0.13% 0.05% 1 Virtual Exec
11 820407 55486 14785 0.00% 0.39% 0.31% 0 Check heaps
12 0 1 0 0.00% 0.00% 0.00% 0 Pool Manager
13 0 2 0 0.00% 0.00% 0.00% 0 Timers
14 32864 105392 311 0.00% 0.00% 0.00% 0 EnvMon
15 0 1 0 0.00% 0.00% 0.00% 0 AAA_SERVER_DEADT
16 0 2 0 0.00% 0.00% 0.00% 0 AAA high-capacit
17 1080472 702876 1537 0.23% 0.42% 0.44% 0 ARP Input
18 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun
19 935 89 10505 0.00% 0.00% 0.00% 0 Entity MIB API
20 320 24146 13 0.00% 0.00% 0.00% 0 Compute SRP rate
21 0 2 0 0.00% 0.00% 0.00% 0 DDR Timers
22 0 2 0 0.00% 0.00% 0.00% 0 Dialer event
23 0 1 0 0.00% 0.00% 0.00% 0 IFS Agent Manage
24 68 4026 16 0.00% 0.00% 0.00% 0 IPC Dynamic Cach
25 20 49 408 0.00% 0.00% 0.00% 0 PF_Split Sync Pr
26 0 1 0 0.00% 0.00% 0.00% 0 IPC Punt Process
27 4840 238240 20 0.00% 0.00% 0.00% 0 IPC Periodic Tim
28 2792 238239 11 0.00% 0.00% 0.00% 0 IPC Deferred Por
29 149640 419666 356 0.00% 0.04% 0.05% 0 IPC Seat Manager
30 0 1 0 0.00% 0.00% 0.00% 0 IPC Stdby Update
31 24 198 121 0.00% 0.00% 0.00% 0 EEM ED Syslog
32 313156 507543 617 0.31% 0.13% 0.13% 0 RPCP Slave
33 81072 162088 500 0.07% 0.03% 0.01% 0 RPCP Slave
34 14900 34458 432 0.00% 0.00% 0.00% 0 RPCP Slave
35 5000 12573 397 0.00% 0.00% 0.00% 0 RPCP Slave
36 1320 3539 372 0.00% 0.00% 0.00% 0 RPCP Slave
37 0 1 0 0.00% 0.00% 0.00% 0 Snmp ICC Process
38 4 83 48 0.00% 0.00% 0.00% 0 Cat6k SNMP
39 59 461 127 0.00% 0.00% 0.00% 0 Cat6k SNMP Trap
40 0 1 0 0.00% 0.00% 0.00% 0 SERIAL A'detect
Task Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Task Name
41 550027 59977 9170 0.21% 0.19% 0.21% 0 HC Counter Timer
42 4412 238241 18 0.00% 0.00% 0.00% 0 Dynamic ARP Insp
43 68 462 147 0.00% 0.00% 0.00% 0 rf proxy rp agen
44 16 11 1454 0.00% 0.00% 0.00% 0 NSP:IPC Task
45 51664 499624 103 0.07% 0.01% 0.00% 0 Net Critical I/O
46 0 1 0 0.00% 0.00% 0.00% 0 Critical Bkgnd
47 45528 562754 80 0.00% 0.00% 0.00% 0 Net Background
48 32 132 242 0.00% 0.00% 0.00% 0 Logger
49 6392 238199 26 0.00% 0.00% 0.00% 0 TTY Background
50 52012 267518 194 0.00% 0.00% 0.00% 0 Per-Second Jobs
51 84607 6042 14003 0.00% 0.02% 0.00% 0 Per-minute Jobs
52 8 11 727 0.00% 0.00% 0.00% 0 RPC Sync
53 0 3 0 0.00% 0.00% 0.00% 0 RPC rpc-slave-15
54 0 1 0 0.00% 0.00% 0.00% 0 PF Sync process
55 0 2 0 0.00% 0.00% 0.00% 0 SCP Multicast
56 0 7 0 0.00% 0.00% 0.00% 0 draco-oir-proces
57 396 896 441 0.00% 0.00% 0.00% 0 RPCP Slave
58 0 1 0 0.00% 0.00% 0.00% 0 EOBC Monitor Pro
59 76 513 148 0.00% 0.00% 0.00% 0 Env action
60 4 330 12 0.00% 0.00% 0.00% 0 svclc
61 0 5 0 0.00% 0.00% 0.00% 0 RPC rf_rfmib_not
62 885605 1935944 457 0.00% 0.00% 0.00% 0 Net Input
63 0 5 0 0.00% 0.00% 0.00% 0 MWAM CONFIG ON S
64 12 407 29 0.00% 0.00% 0.00% 0 itasca
65 0 2 0 0.00% 0.00% 0.00% 0 Flash ICC Server
66 0 2 0 0.00% 0.00% 0.00% 0 Const ICC reques
67 0 1 0 0.00% 0.00% 0.00% 0 Const ICC event
68 0 1 0 0.00% 0.00% 0.00% 0 Const ICC except
69 0 1 0 0.00% 0.00% 0.00% 0 ICC Local Reques
70 416 3328 125 0.00% 0.00% 0.00% 0 ICC Async mcast
71 0 1 0 0.00% 0.00% 0.00% 0 ICC_REQ Debug Pr
72 0 1 0 0.00% 0.00% 0.00% 0 ICC FC Process
73 0 1 0 0.00% 0.00% 0.00% 0 ICC FC Test Send
74 0 1 0 0.00% 0.00% 0.00% 0 ICC FC Test Low
75 0 1 0 0.00% 0.00% 0.00% 0 IfIndex Bulk Syn
76 0 1 0 0.00% 0.00% 0.00% 0 CWRP SPA TSM HA
77 0 1 0 0.00% 0.00% 0.00% 0 CWAN APS HA Proc
78 0 1 0 0.00% 0.00% 0.00% 0 CWAN IF EVENT HA
79 0 1 0 0.00% 0.00% 0.00% 0 CWAN LTL Mgr HA
80 0 1 0 0.00% 0.00% 0.00% 0 CWAN SRP HA Proc
81 0 1 0 0.00% 0.00% 0.00% 0 CWAN HA VLAN SYN
82 212 4060 52 0.00% 0.00% 0.00% 0 RF CWAN HA Proce
83 24520 239411 102 0.00% 0.00% 0.00% 0 Heartbeat Proces
84 0 2 0 0.00% 0.00% 0.00% 0 Switch IP Host T
85 0 14 0 0.00% 0.00% 0.00% 0 EEM RF Event Det
86 0 1 0 0.00% 0.00% 0.00% 0 Mistral Reset Pr
87 0 1 0 0.00% 0.00% 0.00% 0 ECC correctable
88 0 19 0 0.00% 0.00% 0.00% 0 PF_Init Process
89 12 21 571 0.00% 0.00% 0.00% 0 RPC pf-split-rp
90 20 19 1052 0.00% 0.00% 0.00% 0 RPC idprom-MP
91 0 1 0 0.00% 0.00% 0.00% 0 RTTYS Process
92 0 1 0 0.00% 0.00% 0.00% 0 BACK CHECK
93 758089 199450 3800 0.23% 0.30% 0.29% 0 Compute load avg
94 338541 2791511 121 0.07% 0.08% 0.08% 0 Service Task
95 0 1 0 0.00% 0.00% 0.00% 0 chkpt message ha
96 0 2 0 0.00% 0.00% 0.00% 0 cpf_process_msg_
97 0 1 0 0.00% 0.00% 0.00% 0 cpf_process_ipcQ
98 0 1 0 0.00% 0.00% 0.00% 0 IPC Apps Task
99 0 1 0 0.00% 0.00% 0.00% 0 RPCP Slave
100 0 26 0 0.00% 0.00% 0.00% 0 AggMgr Process
101 0 1 0 0.00% 0.00% 0.00% 0 SFF8472
102 0 1 0 0.00% 0.00% 0.00% 0 Remote Console P
103 0 1 0 0.00% 0.00% 0.00% 0 RTTYS Process
104 0 2 0 0.00% 0.00% 0.00% 0 CWAN OIR Handler
105 0 1 0 0.00% 0.00% 0.00% 0 spa_oir_audit_pr
106 0 1 0 0.00% 0.00% 0.00% 0 FPD Management P
Task Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Task Name
107 0 1 0 0.00% 0.00% 0.00% 0 FPD Action Proce
108 0 1 0 0.00% 0.00% 0.00% 0 DSX3MIB ll handl
109 0 1 0 0.00% 0.00% 0.00% 0 POS APS Event Pr
110 0 2 0 0.00% 0.00% 0.00% 0 CWAN port channe
111 0 1 0 0.00% 0.00% 0.00% 0 CE3 Mailbox
112 0 1 0 0.00% 0.00% 0.00% 0 CT3 Mailbox
113 0 2 0 0.00% 0.00% 0.00% 0 MIP Mailbox
114 0 1 0 0.00% 0.00% 0.00% 0 vcq_proc
115 0 1 0 0.00% 0.00% 0.00% 0 Earl NDE Task
116 3672 238244 15 0.00% 0.00% 0.00% 0 CWAN CHOCX PROCE
117 4496 238242 18 0.00% 0.00% 0.00% 0 CWAN CHDSX PROCE
118 0 1 0 0.00% 0.00% 0.00% 0 HAL Mailbox
119 0 1 0 0.00% 0.00% 0.00% 0 CWRP SPA ATM OIR
120 0 15 0 0.00% 0.00% 0.00% 0 Gemini L3 forwar
121 186288 323021 576 0.15% 0.06% 0.05% 0 esw_vlan_stat_pr
122 0 2 0 0.00% 0.00% 0.00% 0 Spanning Tree
123 0 2 0 0.00% 0.00% 0.00% 0 AAA Dictionary R
124 1015 401 2531 0.00% 0.00% 0.00% 0 SW VLAN RP
125 1151665 13536983 85 0.15% 0.23% 0.38% 0 ION IP output
126 34194165 23417270 1460 9.83% 11.61% 12.80% 0 IP Input
127 0 1 0 0.00% 0.00% 0.00% 0 Socket Timers
128 308 23714 12 0.00% 0.00% 0.00% 0 QOS Stats Gather
129 9636 24804 388 0.00% 0.00% 0.00% 0 CEF Scanner
130 96 2244 42 0.00% 0.00% 0.00% 0 DHCP Snooping
131 5196652 9375380 554 0.47% 0.66% 0.99% 0 IP NAT Ager
132 45100 1908039 23 0.07% 0.01% 0.00% 0 CEF RP IPC Backg
133 0 1 0 0.00% 0.00% 0.00% 0 MLS FIB RP
134 0 1 0 0.00% 0.00% 0.00% 0 mcast_rp_icc Pro
135 12 5 2400 0.00% 0.00% 0.00% 0 Const Rate Limit
136 0 1 0 0.00% 0.00% 0.00% 0 CWAN LTL manager
137 528 1699 310 0.00% 0.00% 0.00% 0 HWIF QoS Process
138 0 2 0 0.00% 0.00% 0.00% 0 AAA Server
139 0 1 0 0.00% 0.00% 0.00% 0 AAA ACCT Proc
140 0 1 0 0.00% 0.00% 0.00% 0 ACCT Periodic Pr
141 0 2 0 0.00% 0.00% 0.00% 0 QOS Stats Export
142 0 1 0 0.00% 0.00% 0.00% 0 SSS Manager
143 308 32181 9 0.00% 0.00% 0.00% 0 SSS Test Client
144 0 2 0 0.00% 0.00% 0.00% 0 Switch IP Host T
145 0 1 0 0.00% 0.00% 0.00% 0 Switch IP Admiss
146 0 1 0 0.00% 0.00% 0.00% 0 ARP HA
147 0 1 0 0.00% 0.00% 0.00% 0 HDLC HA
148 0 1 0 0.00% 0.00% 0.00% 0 RPCP Slave
149 0 1 0 0.00% 0.00% 0.00% 0 PPPATM Session d
150 0 2 0 0.00% 0.00% 0.00% 0 PASVC create VA
151 12364 7189 1719 0.00% 0.00% 0.00% 0 MOP Protocols
152 0 2 0 0.00% 0.00% 0.00% 0 IP Hdr Comp Proc
153 0 1 0 0.00% 0.00% 0.00% 0 AC Mgr
154 0 1 0 0.00% 0.00% 0.00% 0 DMLP Counter
155 8 14 571 0.00% 0.00% 0.00% 0 EAPoUDP Process
156 0 3 0 0.00% 0.00% 0.00% 0 cfib v6 per pref
157 0 2 0 0.00% 0.00% 0.00% 0 const ipfib per-
158 0 1 0 0.00% 0.00% 0.00% 0 RPCP Slave
159 0 1 0 0.00% 0.00% 0.00% 0 IP IRDP
160 584 68359 8 0.00% 0.00% 0.00% 0 DHCPD Database
161 219 1924 113 0.00% 0.00% 0.00% 1 Hot Service Task
162 208 1924 108 0.00% 0.00% 0.00% 1 Hot Service Task
163 251 1922 130 0.00% 0.00% 0.00% 1 Hot Service Task
164 0 2 0 0.00% 0.00% 0.00% 0 CWPA QoS
165 0 2 0 0.00% 0.00% 0.00% 0 Const TCAM Mgr R
166 0 1 0 0.00% 0.00% 0.00% 0 HTTP Timer
167 209768 103078 2035 0.00% 0.06% 0.07% 0 IPC LC Message H
168 3853927 25036944 153 0.47% 1.12% 1.36% 0 Standby (HSRP)
169 116 608 190 0.00% 0.00% 0.00% 0 IP SNMP
170 249944 404013 618 0.00% 0.05% 0.06% 0 CEF process
171 28888 120725 239 0.07% 0.01% 0.00% 0 HIDDEN VLAN Proc
172 252327 66898 3771 0.05% 0.08% 0.07% 0 Adj Manager
Task Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Task Name
173 172 4023 42 0.00% 0.00% 0.00% 0 IP Cache Ager
174 0 1 0 0.00% 0.00% 0.00% 0 CWAN-RP SCP Proc
175 0 15 0 0.00% 0.00% 0.00% 0 CWAN-RP SCP Inpu
176 8940 249596 35 0.00% 0.00% 0.00% 0 L3 Manager
177 0 1 0 0.00% 0.00% 0.00% 0 MLSM-CC Process
178 0 6 0 0.00% 0.00% 0.00% 0 mfib-const-rp Pr
179 275065 514397 534 0.00% 0.05% 0.11% 0 FM core
180 0 38 0 0.00% 0.00% 0.00% 0 SNMP Timers
181 3 1 3000 0.00% 0.00% 0.00% 0 PPP IP Add Route
182 101408 422029 240 0.39% 0.06% 0.05% 0 DHCPD Receive
183 0 1 0 0.00% 0.00% 0.00% 0 VFI Mgr
184 0 1 0 0.00% 0.00% 0.00% 0 PAD InCall
185 0 2 0 0.00% 0.00% 0.00% 0 X.25 Background
186 0 1 0 0.00% 0.00% 0.00% 0 X.25 Encaps Mana
187 0 1 0 0.00% 0.00% 0.00% 0 Inspect Timer
188 0 1 0 0.00% 0.00% 0.00% 0 Auth-proxy AAA B
189 28 806 34 0.00% 0.00% 0.00% 0 IP Admin SM Proc
190 0 1 0 0.00% 0.00% 0.00% 0 SLB CF process
191 0 1 0 0.00% 0.00% 0.00% 0 PPP HA
192 0 1 0 0.00% 0.00% 0.00% 0 IDS Timer
193 0 2 0 0.00% 0.00% 0.00% 0 MWAM_CONSOLE Tim
194 0 3 0 0.00% 0.00% 0.00% 0 L2TRACE SERVER
195 0 4 0 0.00% 0.00% 0.00% 0 IPv6 CEF process
196 0 1 0 0.00% 0.00% 0.00% 0 RARP Input
197 0 1 0 0.00% 0.00% 0.00% 0 PDU DISPATCHER
198 0 1 0 0.00% 0.00% 0.00% 0 Probe Input
199 0 1 0 0.00% 0.00% 0.00% 0 FR HA
200 0 75 0 0.00% 0.00% 0.00% 0 CWAN QinQ tasks
201 0 1 0 0.00% 0.00% 0.00% 0 COPS
202 0 1 0 0.00% 0.00% 0.00% 0 CHKPT DevTest
203 0 1 0 0.00% 0.00% 0.00% 0 ATM HA
204 0 2 0 0.00% 0.00% 0.00% 0 ATIP_UDP_TSK
205 0 2 0 0.00% 0.00% 0.00% 0 AAA Cached Serve
206 0 2 0 0.00% 0.00% 0.00% 0 LOCAL AAA
207 0 1 0 0.00% 0.00% 0.00% 0 SNMP ENGINE
208 0 1 0 0.00% 0.00% 0.00% 0 SNMP ConfCopyPro
209 0 1 0 0.00% 0.00% 0.00% 0 Laminar Icc Eve
210 0 2 0 0.00% 0.00% 0.00% 0 Laminar Config C
211 0 2 0 0.00% 0.00% 0.00% 0 SLB Main CPU pro
212 7912 1885 4197 0.00% 0.00% 0.00% 0 SNMP Traps
213 3 1 3000 0.00% 0.00% 0.00% 0 CCSWVOICE
214 0 2 0 0.00% 0.00% 0.00% 0 Rommon upgrade p
215 0 3 0 0.00% 0.00% 0.00% 0 RADIUS TEST CMD
216 0 2 0 0.00% 0.00% 0.00% 0 AAA SEND STOP EV
217 4 7 571 0.00% 0.00% 0.00% 0 RPC fabman_sp
218 0 14 0 0.00% 0.00% 0.00% 0 RPC lcc_sp
219 23224 329953 70 0.00% 0.00% 0.00% 0 NTP
220 988 2080 475 0.00% 0.00% 0.00% 0 RPC pm-mp
221 17856 830863 21 0.00% 0.00% 0.00% 0 PM Callback
222 4 11 363 0.00% 0.00% 0.00% 0 EC-Card-Cfg
223 3496382 13880531 251 0.00% 1.51% 1.50% 0 Port manager per
224 792 48148 16 0.00% 0.00% 0.00% 0 Max CPU utilizat
225 72 214 336 0.00% 0.00% 0.00% 0 RPC capi_rp
226 0 2 0 0.00% 0.00% 0.00% 0 RPC dot1x_aaa_rp
227 0 2 0 0.00% 0.00% 0.00% 0 RPC epld_sp2rp
228 40 205 195 0.00% 0.00% 0.00% 0 RPC idbman_sp2mp
229 111455 27328 4078 0.00% 0.04% 0.03% 0 RPC online_diag_
230 0 2 0 0.00% 0.00% 0.00% 0 RPC online_wan_d
231 32 16 2000 0.00% 0.00% 0.00% 0 RPC pagp_switch_
232 0 80 0 0.00% 0.00% 0.00% 0 RPC pm_switch_sp
233 0 2 0 0.00% 0.00% 0.00% 0 RPC psecure_rp
234 0 2 0 0.00% 0.00% 0.00% 0 RPC pt_switch_sp
235 12 79 151 0.00% 0.00% 0.00% 0 RPC qnq_switch_s
236 0 2 0 0.00% 0.00% 0.00% 0 RPC rf_cli_sp2rp
237 0 2 0 0.00% 0.00% 0.00% 0 RPC snmp_notify
238 0 6 0 0.00% 0.00% 0.00% 0 RPC snmp_stackli
Task Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Task Name
239 0 2 0 0.00% 0.00% 0.00% 0 RPC span_switch_
240 268 1289 207 0.00% 0.00% 0.00% 0 RPC stp_sp2mp_ap
241 0 2 0 0.00% 0.00% 0.00% 0 RPC sw_backup_in
242 104 672 154 0.00% 0.00% 0.00% 0 RPC sw_vlan_rp
243 0 6 0 0.00% 0.00% 0.00% 0 RPC udld_rp
244 156 620 251 0.00% 0.00% 0.00% 0 RPC vtp_const_ap
245 0 2 0 0.00% 0.00% 0.00% 0 VTPMIB EDIT BUFF
246 0 1 0 0.00% 0.00% 0.00% 0 RPCP Slave
247 24 31 774 0.00% 0.00% 0.00% 0 RPC c6k_power_rp
248 8 37 216 0.00% 0.00% 0.00% 0 RPC c6k_rp_envir
250 0 2 0 0.00% 0.00% 0.00% 0 Module enable-di
251 0 2 0 0.00% 0.00% 0.00% 0 RPC pikachu_rp
252 0 1 0 0.00% 0.00% 0.00% 0 RP L2 Applicatio
253 0 1 0 0.00% 0.00% 0.00% 0 Const FIB MAC
254 236 842 280 0.00% 0.00% 0.00% 0 Constellation Ba
255 24 57 421 0.00% 0.00% 0.00% 0 RPC pclc_g2_fw_r
256 0 2 0 0.00% 0.00% 0.00% 0 RPC chapi_rp
257 0 1 0 0.00% 0.00% 0.00% 0 CONST AFL
258 0 5 0 0.00% 0.00% 0.00% 0 PAgP-MP Process
259 0 5 0 0.00% 0.00% 0.00% 0 LACP-MP Process
260 8 34 235 0.00% 0.00% 0.00% 0 Logger ICC Proce
261 112 52 2153 0.00% 0.00% 0.00% 0 Syslog Traps
262 12 69 173 0.00% 0.00% 0.00% 0 rp to lc clock u
263 0 1 0 0.00% 0.00% 0.00% 0 LC Registry Expo
264 0 2 0 0.00% 0.00% 0.00% 0 RPC pclc_g2_agsm
265 96 112 857 0.00% 0.00% 0.00% 0 Online Diag EEM
266 0 1 0 0.00% 0.00% 0.00% 0 L3MM Process
267 0 2 0 0.00% 0.00% 0.00% 0 RPC itasca_rp
268 0 1 0 0.00% 0.00% 0.00% 0 HW Capacity ICC
269 0 2 0 0.00% 0.00% 0.00% 0 RPC error_detect
270 916 40190 22 0.00% 0.00% 0.00% 0 RP Error Detecti
271 0 2 0 0.00% 0.00% 0.00% 0 WiSM Process
272 0 1 0 0.00% 0.00% 0.00% 0 SONET Traps
273 0 10 0 0.00% 0.00% 0.00% 0 RPC aapi_rp
274 44 208 211 0.00% 0.00% 0.00% 0 QM Process on RP
275 0 2 0 0.00% 0.00% 0.00% 0 QM Reply Process
276 0 2 0 0.00% 0.00% 0.00% 0 QM Timer ACL Pro
277 0 3 0 0.00% 0.00% 0.00% 0 CWAN Bridge task
278 40 4027 9 0.00% 0.00% 0.00% 0 VACL Logger
279 0 1 0 0.00% 0.00% 0.00% 0 DHCP Snooping Sw
280 0 2 0 0.00% 0.00% 0.00% 0 SIP10G QM Proces
281 0 1 0 0.00% 0.00% 0.00% 0 Online Diag CNS
282 0 1 0 0.00% 0.00% 0.00% 0 Online Diag CNS
284 232 1922 120 0.00% 0.00% 0.00% 1 Hot Service Task
286 0 1 0 0.00% 0.00% 0.00% 0 NetFlow Agg Task
287 0 1 0 0.00% 0.00% 0.00% 0 CWAN OIR IPC Rea
288 0 1 0 0.00% 0.00% 0.00% 0 PF Clock Process
Thanks. -
Good day, can someone analyze this for me, in regards with high cpu usage.
2222222222222222222222222222222222333332222244444222222222
8888555559999955555777773333344444000007777711111555559999
100
90
80
70
60
50
40 *****
30 ************************ ************************
20 **********************************************************
10 **********************************************************
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per second (last 60 seconds)
4443333334443433334333333333333333333333343333333333333333
1006530591135079734601132535328062177773414263667168577916
100
90
80
70
60
50
40 ***** ********** ** * * * * **** * * *** ****** *
30 #############**##*####*#*##*###*#*#########*##*****###****
20 ##########################################################
10 ##########################################################
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
4744444545444444444444444444333344444444444444444434444444433344344444
4547425182436632379924402500899822115303104140406471591734499730802883
100
90
80 *
70 *
60 *
50 * * **** ** *** * * * ** * **
40 **********************************************************************
30 #*******###**********##**********#********************************####
20 ######################################################################
10 ######################################################################
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
Local_Backbone#sh proc cpu sorted 5sec
CPU utilization for five seconds: 24%/16%; one minute: 27%; five minutes: 27%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
123 1380698152 938782622 1470 6.07% 6.66% 6.52% 0 IP Input
9 71590456 190912340 374 0.39% 0.48% 0.47% 0 ARP Input
213 53552228 246488976 217 0.23% 0.42% 0.48% 0 SNMP ENGINE
176 2804332 35409778 79 0.15% 0.02% 0.00% 0 OSPF Hello
319 918144 11719407 78 0.15% 0.01% 0.00% 0 OSPF Router 100
4 236 195 1210 0.07% 0.00% 0.00% 1 Virtual Exec
169 2374788 2035919 1166 0.07% 0.03% 0.00% 0 Adj Manager
118 5885520 15709517 374 0.07% 0.07% 0.07% 0 CDP Protocol
36 69788 9934569 7 0.07% 0.00% 0.00% 0 TTY Background
179 30669516 309965501 98 0.07% 0.23% 0.24% 0 IP SNMP
need a quick opinion as i have another backbone abroad that uses only 5-10% of cpu usage.
- same config
- same setup (2BB for Sec/firewall, 2BB for Integration, 6Distro SW)
- different number of users
thank you and god bless.I also agree with Stephan that this is not a concern that the cpu you are seeing it sohuld reduce down.
If in case still want to do the troubleshooting here is the procedure:
Here are some of the commands you can refer while you see the high cpu:
•1- Show proc cpu sorted | ex 0.00% >> First check whether CPU is due to Interrupt or due to Process Switching.
Eg: CPU utilization for five seconds: 6%/2%; one minute: 2%; five minutes: 2%
6% is total CPU utilization and 2 % is due to Interrupt. You would see this on a higher bit when you have the high cpu. Total-interrupt will give you the value of Process.
More info: http://www.cisco.com/en/US/products/hw/switches/ps708/products_tech_note09186a00804916e0.shtml
b) Show proc cpu history :---Check since how long is the CPU been affected.
2- Check if there is any interface drops are been seen:
show interface | include line|drops ( Check if any vlan/interface are having input drops)
3- check if there are any STP issue:
show spanning tree detail
show spann det | in ieee|from|occur|is exec
show spann det | in executing | changes
show interface | include line|drops
show cef drop
show ip traffic >> Check the traffic utilization.
4- There are some internal debugging which would help to find out which packets ( from Src,dst) is hitting the CPU:
debug netdr capture rx <<<<( DEBUG OF NETDR IS VERY USEFULL TO CHECK WHAT PACKETSS ARE COMING TO CPU)
show netdr capture-packet >> This will give you the captured outputs were you can see the Src and dst . Then you can take the action with those src ip address guys to check why they are punting the traffic.
HTH
Regards
Inayath
***Plz rate if this info is helpfull. -
Support Community
We recently configured a stack of four 48 port 3750-x switches . We are noticing high CPU usage. "Hulc LED process" seems pretty high.
This has coincided with VMware servers getting slow and non-responsive at times, perhaps a coincidence, not sure.
Below I provided some outputs that might help to diagnose it
Thanks
John
System image file is "flash:/c3750e-ipbasek9-mz.122-58.SE2/c3750e-ipbasek9-mz.122-58.SE2.bin"
Show inventory output
NAME: "1", DESCR: "WS-C3750X-48"
PID: WS-C3750X-48T-S , VID: V02 ,
NAME: "Switch 1 - Power Supply 0", DESCR: "FRU Power Supply"
PID: C3KX-PWR-350WAC , VID: V02L ,
NAME: "2", DESCR: "WS-C3750X-48"
PID: WS-C3750X-48T-S , VID: V02
NAME: "Switch 2 - Power Supply 0", DESCR: "FRU Power Supply"
PID: C3KX-PWR-350WAC , VID: V02D ,
NAME: "3", DESCR: "WS-C3750X-48"
PID: WS-C3750X-48T-S , VID: V02
NAME: "Switch 3 - Power Supply 0", DESCR: "FRU Power Supply"
PID: C3KX-PWR-350WAC , VID: V02L ,
NAME: "4", DESCR: "WS-C3750X-48"
PID: WS-C3750X-48T-S , VID: V02
NAME: "Switch 4 - Power Supply 0", DESCR: "FRU Power Supply"
PID: C3KX-PWR-350WAC , VID: V02L ,
SWITCH#sh processes cpu sorted
CPU utilization for five seconds: 61%/5%; one minute: 50%; five minutes: 49%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
168 260466386 44948517 5794 14.53% 13.98% 13.70% 0 Hulc LED Process
231 97586088 27253906 3580 4.95% 4.73% 4.64% 0 Spanning Tree
213 63106121 154928892 407 4.15% 3.89% 3.91% 0 IP Input
284 70113217 34537588 2030 3.51% 3.98% 4.17% 0 RARP Input
4 6663412 421278 15817 3.03% 0.43% 0.32% 0 Check heaps
374 9872291 10805181 913 3.03% 0.77% 0.62% 0 IP SNMP
376 11142951 5370604 2074 3.03% 0.73% 0.66% 0 SNMP ENGINE
12 35389011 32152175 1100 2.87% 2.08% 2.20% 0 ARP Input
128 34962407 3622140 9652 2.07% 1.69% 1.63% 0 hpm counter proc
85 49034286 8536062 5744 1.91% 2.44% 2.44% 0 RedEarth Tx Mana
107 25127806 46459053 540 1.27% 1.10% 0.93% 0 HLFM address lea
174 2412 1714 1407 0.95% 0.39% 0.25% 1 SSH Process
220 6423643 12634764 508 0.79% 0.70% 0.56% 0 ADJ resolve proc
181 6913179 2890070 2392 0.63% 0.31% 0.36% 0 HRPC qos request
375 1681949 5000777 336 0.47% 0.08% 0.07% 0 PDU DISPATCHER
84 10180707 12623537 806 0.47% 0.30% 0.37% 0 RedEarth I2C dri
1
666666096996666666666666659666667666666666666666666766676666666656666666
249363098992351145264823289455360612252332233522344115537230141392553343
100 ** ** *
90 ** ** *
80 ** ** *
70 * * ***** * * * * * ** *** * * * **** **
60 **********************************************************************
50 ######################################################################
40 ######################################################################
30 ######################################################################
20 ######################################################################
10 ######################################################################
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7..
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
455555555554444444444555554444455555555555555555555444444444
922222111118888866666000009999911111555554444422222444448888
100
90
80
70
60 *****
50 *************************************************** **
40 **********************************************************
30 **********************************************************
20 **********************************************************
10 **********************************************************
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per second (last 60 seconds)
565756555555555555555555555555555556555555555555565555565556
518841757869248569271526666733778330496833777819929379701861
100
90
80 *
70 *
60 **** ******* **** * * ***** *** * *** **** **** **** *
50 ##########################################################
40 ##########################################################
30 ##########################################################
20 ##########################################################
10 ##########################################################
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%Thanks to all for your replies.
Jeff
I was aware of the many ACLs however we used to have the same ACLs in a previous 3750G stack about 2 weeks ago and we never had this issue. I agree I need to optimize them and do somehing because it is reaching its max before the CPU starts processing them but I am not certain this is what is causing the issue.
Nikolay,
I am trying to understand "interrupts" with the analysis of the outputs I posted. Here is another output deom the link you provided. Please post your thoughts if you can.
This switch also serves as a gateway(L3 role) for many systems. Would it make sense to offload that responsability from this switch and let an actual router do it?
Thanks
Johnny
show controllers cpu-interface
ASIC Rxbiterr Rxunder Fwdctfix Txbuflos Rxbufloc Rxbufdrain
ASIC0 0 0 0 0 0 0
ASIC1 0 0 0 0 0 0
ASIC2 0 0 0 0 0 0
HOL Fix Counts
No Fixes: 0 Added: 0 In Use: 0 Both: 0
CPU Heartbeat Statistics
Tx Success Tx Fail 1st Thr 2nd Thr Unthr RetryCtMax
37139562 0 0 0 0 1
Rx Delay
0 1 2 3 4
37139562 0 0 0 0
AddlDelay AdvanceCnt
0 0
Rx Retries by RetryCount
0 1 2 3 4 5 6
37139562 0 0 0 0 0 0
7 8 9
0 0 0
AddlRetry
0
cpu-queue-frames retrieved dropped invalid hol-block stray
rpc 104077409 0 0 0 0
stp 19189469 0 0 0 0
ipc 11093838 0 0 0 0
routing protocol 141021559 0 0 0 0
L2 protocol 230347 0 0 0 0
remote console 17 0 0 0 0
sw forwarding 257436702 0 0 0 0
host 21146276 0 0 0 0
broadcast 332154608 0 0 0 0
cbt-to-spt 0 0 0 0 0
igmp snooping 2796987 0 0 0 0
icmp 90752156 0 0 0 0
logging 0 0 0 0 0
rpf-fail 0 0 0 0 0
dstats 0 0 0 0 0
cpu heartbeat 37139562 0 0 0 0
cpu-queue static inuse static added
rpc 0 0
stp 0 0
ipc 0 0
routing protocol 0 0
L2 protocol 0 0
remote console 0 0
sw forwarding 0 0
host 0 0
broadcast 0 0
cbt-to-spt 0 0
igmp snooping 0 0
icmp 0 0
logging 0 0
rpf-fail 0 0
dstats 0 0
cpu heartbeat 0 0
Supervisor ASIC receive-queue parameters
queue 0 maxrecevsize 7E0 pakhead 5505A88 paktail 54655A8
queue 1 maxrecevsize 7E0 pakhead 5689164 paktail 5687F54
queue 2 maxrecevsize 7E0 pakhead 5547AA4 paktail 554719C
queue 3 maxrecevsize 7E0 pakhead 5DC233C paktail 5DBA4CC
queue 4 maxrecevsize 7E0 pakhead 56A7198 paktail 56A7AA0
queue 5 maxrecevsize 7E0 pakhead 5D61304 paktail 5D72F80
queue 6 maxrecevsize 7E0 pakhead 5D856D4 paktail 5D989E4
queue 7 maxrecevsize 7E0 pakhead 5BDE29C paktail 5BDC784
queue 8 maxrecevsize 7E0 pakhead 5CC00A8 paktail 5CB3574
queue 9 maxrecevsize 7E0 pakhead 59DD86C paktail 59DD86C
queue A maxrecevsize 7E0 pakhead 59BF43C paktail 59C13D8
queue B maxrecevsize 7E0 pakhead 5DD18A0 paktail 5DCE6F4
queue C maxrecevsize 7E0 pakhead 59E9CBC paktail 5A049B8
queue D maxrecevsize 7E0 pakhead 59D8EA0 paktail 59DD25C
queue E maxrecevsize 0 pakhead 0 paktail 0
queue F maxrecevsize 7E0 pakhead 59A7080 paktail 59A6BFC
Supervisor ASIC exception status
Receive overrun 00000000 Transmit overrun 00000000
FrameSignatureErr 00000000 MicInitialize 00000002
BadFrameErr 00000000 LenExceededErr 00000000
BadJumboSegments 00000000
Supervisor ASIC Mic Registers
MicDirectPollInfo 80000200
MicIndicationsReceived 00000000
MicInterruptsReceived 00000009
MicPcsInfo 0000001F
MicPlbMasterConfiguration 00000000
MicRxFifosAvailable 00000000
MicRxFifosReady 0000BFFF
MicTimeOutPeriod: FrameTOPeriod: 00000EA6 DirectTOPeriod: 00004000
MicTransmFramesCopied 00000003
MicTxFifosAvailable 0000000E
MicConfiguration: Conf flag: 00000110 Interrupt Flag: 00000008
MicReceiveFifoAssignmen Queue 0 - 7: 33333333 Queue 8 - 15:33333333
MicReceiveFramesReady: FrameAvailable: 00000181 frameAvaiMask: 00000000
MicException:
Exception_flag 00000000
Message-1 00000000
Message-2 00000000
Message-3 00000000
MicIntRxFifo:
ReadPtr 000005C0 WritePtr 000005C0
WHeadPtr 000005C0 TxFifoDepth C0000800
MicIntTxFifo:
ReadPtr 00000728 WritePtr 00000728
WHeadPtr 00000728 TxFifoDepth C0000800
MicDecodeInfo:
Fifo0: address: 03FF4000 asic_num: 00000100
Fifo1: address: 03FF4400 asic_num: 00000101
MicTransmitFifoInfo:
Fifo0: StartPtrs: 0E2CE800 ReadPtr: 0E2CEBE8
WritePtrs: 0E2CEBE8 Fifo_Flag: 8A800800
Weights: 001E001E
Fifo1: StartPtrs: 0E02D000 ReadPtr: 0E02D138
WritePtrs: 0E02D138 Fifo_Flag: 89800400
Weights: 000A000A
MicReceiveFifoInfo:
Fifo0: StartPtr: 0E4AF000 ReadPtr: 0E4AF2A8
WritePtrs: 0E4AF308 Fifo_Flag: 8B000FA0
writeHeaderPtr: 0E4AF308
Fifo1: StartPtr: 0E78C000 ReadPtr: 0E78C2E8
WritePtrs: 0E78C2E8 Fifo_Flag: 89800400
writeHeaderPtr: 0E78C2E8
Fifo2: StartPtr: 0E744800 ReadPtr: 0E744A70
WritePtrs: 0E744A70 Fifo_Flag: 89800400
writeHeaderPtr: 0E744A70
Fifo3: StartPtr: 0EBD1000 ReadPtr: 0EBD13B8
WritePtrs: 0EBD13B8 Fifo_Flag: 89800400
writeHeaderPtr: 0EBD13B8
Fifo4: StartPtr: 0E7D3800 ReadPtr: 0E7D3A58
WritePtrs: 0E7D3A58 Fifo_Flag: 89800400
writeHeaderPtr: 0E7D3A58
Fifo5: StartPtr: 0EB40600 ReadPtr: 0EB40688
WritePtrs: 0EB40688 Fifo_Flag: 88800200
writeHeaderPtr: 0EB40688
Fifo6: StartPtr: 0EB87400 ReadPtr: 0EB874F0
WritePtrs: 0EB874F0 Fifo_Flag: 89800400
writeHeaderPtr: 0EB874F0
Fifo7: StartPtr: 0E880000 ReadPtr: 0E880E20
WritePtrs: 0E881520 Fifo_Flag: 8C001900
writeHeaderPtr: 0E881520
Fifo8: StartPtr: 0EB1A600 ReadPtr: 0EB1A770
WritePtrs: 0EB1A780 Fifo_Flag: 880001F0
writeHeaderPtr: 0EB1A780
Fifo9: StartPtr: 0E2E0CD8 ReadPtr: 0E2E0CD8
WritePtrs: 0E2E0CD8 Fifo_Flag: 82800008
writeHeaderPtr: 0E2E0CD8
Fifo10: StartPtr: 0E81D000 ReadPtr: 0E81D1D8
WritePtrs: 0E81D1D8 Fifo_Flag: 88800200
writeHeaderPtr: 0E81D1D8
Fifo11: StartPtr: 0E4AEF00 ReadPtr: 0E4AEF60
WritePtrs: 0E4AEF60 Fifo_Flag: 86800080
writeHeaderPtr: 0E4AEF60
Fifo12: StartPtr: 0E84A000 ReadPtr: 0E84A300
WritePtrs: 0E84A000 Fifo_Flag: 89000100
writeHeaderPtr: 0E84A000
Fifo13: StartPtr: 0E4AEE00 ReadPtr: 0E4AEE00
WritePtrs: 0E4AEE00 Fifo_Flag: 86800080
writeHeaderPtr: 0E4AEE00
Fifo14: StartPtr: 00000000 ReadPtr: 00000000
WritePtrs: 00000000 Fifo_Flag: 00800000
writeHeaderPtr: 00000000
Fifo15: StartPtr: 0E02CEC0 ReadPtr: 0E02CED0
WritePtrs: 0E02CED0 Fifo_Flag: 84800020
writeHeaderPtr: 0E02CED0
===========================================================
Complete Board Id:0x00B2
=========================================================== -
6500 HIGH CPU, Standby HSRP state changes continuously
Hi All,
We are using two 6500 User distribution connected with port channel also WLC is connected on Dist-2 now, these two 6500 are connected with backend core 7609 running ospf in between. Spanning-tree root and Standby Active on Dist-1
Suddenly we are facing High CPU utilization on switches, couldn't able to ping nor login. However I could observe to the following through console.
Switch1 is stable, all the vlans are active, but on standby all the vlans are getting state changes, suspecting there are not getting hello's on time due to which it is going to active and standby.
%HSRP-5-STATECHANGE: Vlan208 Grp 208 state Standby -> Active
%HSRP-5-STATECHANGE: Vlan160 Grp 160 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan115 Grp 115 state Standby -> Active
%HSRP-5-STATECHANGE: Vlan156 Grp 156 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan208 Grp 208 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan209 Grp 209 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan196 Grp 196 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan112 Grp 112 state Speak -> Standby
%HSRP-5-STATECHANGE: Vlan196 Grp 196 state Standby -> Active
Configuration of Wireless VLAN
on both switch
interface Vlan198
ip address 10.X.X.X
ip helper-address
standby 198 ip 10.X.X.X
standby 198 timers 250 msec 750
standby 198 priority 90
standby 198 preempt
end
All the vlans having same timers and preempt on both switches,
we are not tracking any interface, can I remove preempt on secondary switch?
I have captured packets through netdr
Dist-2
interface Vl198, routine mistral_process_rx_packet_inlin, timestamp 23:53:02.823
dbus info: src_vlan 0xC6(198), src_indx 0x2(2), len 0x40(64)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x40C6(16582)
F8020400 00C60000 00020000 40080168
S000 E0000560 8E0FFFF8 00000008 40C60000
mistral hdr: req_token 0x0(0), src_index 0x2(2), rx_offset 0x76(118)
requeue 0, obl_pkt 0, vlan 0xC6(198)
destmac FF.FF.FF.FF.FF.FF, srcmac 00.00.0C.07.AC.C6, protocol 0806
layer 3 data: 00010800 06040002 00000C07 ACC60A19 C601FFFF FFFFFFFF
0A19C601 00000000 00000000 00000000 00000000 0000C601
8300A369 00000000 0000FFFF
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 48, identifier 0
df 0, mf 0, fo 0, ttl 1, src 10.X.X.X, dst 224.0.0.2
udp src 1985, dst 1985 len 28 checksum 0x53BE
Dist -1
interface Vl198, routine mistral_process_rx_packet_inlin, timestamp 23:48:26.830
dbus info: src_vlan 0xC6(198), src_indx 0x341(833), len 0x42(66)
bpdu 0, index_dir 0, flood 1, dont_lrn 0, dest_indx 0x40C6(16582)
60020401 00C60400 03410400 42080000 00110448 0E087C7C 00000008 40C60000
mistral hdr: req_token 0x0(0), src_index 0x341(833), rx_offset 0x76(118)
requeue 0, obl_pkt 0, vlan 0xC6(198)
destmac 01.00.5E.00.00.02, srcmac 00.00.0C.07.AC.C6, protocol 0800
protocol ip: version 0x04, hlen 0x05, tos 0x00, totlen 48, identifier 0
df 0, mf 0, fo 0, ttl 1, src 10.X.X.X, dst 224.0.0.2
udp src 1985, dst 1985 len 28 checksum 0x53BF
This issue is not continuous, its triggering intermittently sometime with in couple of hours or daysAfter digging I could able to find out
VLAN0195 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 165 last change occurred 00:31:14 ago
from GigabitEthernet6/14
VLAN0196 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 122 last change occurred 00:31:14 ago
from GigabitEthernet6/14
VLAN0197 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 291 last change occurred 00:31:14 ago
from GigabitEthernet6/14
VLAN0198 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 961 last change occurred 00:31:14 ago
from GigabitEthernet6/14
VLAN0199 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 1165 last change occurred 00:31:25 ago
from GigabitEthernet6/14
VLAN0200 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 888 last change occurred 00:31:25 ago
from GigabitEthernet6/14
Port g 6/14 config
interface GigabitEthernet6/14
switchport
switchport trunk encapsulation dot1q
switchport trunk native vlan 200
switchport trunk allowed vlan 195-200
switchport mode trunk
connected to Dist2- WLC
195 Wireless-Voice active
196 GTC-VIDEO active
197 IP_Camera active
198 Wireless-client active
199 Cisco-AP-MGMT active
200 NW-MGMT active
Rest of all vlans
VLAN0110 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 824 last change occurred 00:51:49 ago
from TenGigabitEthernet1/3
VLAN0111 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 680 last change occurred 00:51:49 ago
from TenGigabitEthernet1/3
Also some ports I can root inconsistent on secondary switch configured as root secondary
Ten gig1/3 is connected to floor switch
VLAN0110 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 297 last change occurred 00:37:47 ago
from StackPort1
VLAN0111 is executing the rstp compatible Spanning Tree protocol
Number of topology changes 164 last change occurred 00:37:47 ago
from StackPort1 -
Hi,
We are observing high cpu of one of the backbone switch,
We enable eem script & below are the cpture
But we are not able to pin-point the issue.
event manager applet high_cpu
event snmp oid 1.3.6.1.4.1.9.9.109.1.1.1.1.3.1 get-type exact entry-op gt entry-val "65" poll-interval 5 action 1.01 syslog msg "------HIGH CPU DETECTED----, CPU: $_snmp_oid_val %"
action 1.02 cli command "enable"
action 1.03 cli command "term len 0"
action 1.04 cli command "debug platform packet all receive buffer"
action 1.05 cli command "show platform health | redirect slot0:high_cpu1"
action 1.06 cli command "show proc cpu sort | redirect slot0:high_cpu2"
action 1.07 cli command "show platform cpu packet statistics | redirect slot0:high_cpu3"
action 1.08 cli command "show platform cpu packet buffered | redirect slot0:high_cpu4"
action 1.09 cli command "show platform health | redirect slot0:high_cpu5"
action 1.10 cli command "show proc cpu sort | redirect slot0:high_cpu6"
action 1.11 cli command "show platform cpu packet statistics | redirect slot0:high_cpu7"
action 1.12 cli command "show platform cpu packet buffered | redirect slot0:high_cpu8"
action 1.13 cli command "show clock | redirect slot0:high_cpu9"
action 1.14 cli command "undebug all"
action 1.15 cli command "conf t"
action 1.16 cli command "no event
Switch version: cat4500e-entservicesk9-mz.122-50.SG3.bin
Model: WS-C4900M 3 slot switch
Pls suggest
Br/SubhojitHI,
I guess for every redirect command uses a vty session and thats why we might see this issue. I had a look at the logs again.
I see lots of SA Miss which is nothing but increase Source Address Miss. Have you verified if there are any topology changes(show spanning-tree detail | in ieee|exec|from|occurred)
switch##more slot0:high_cpu2 3
RkiosSysPacketMan:
Total 5 sec avg 1 min avg 5 min avg 1 hour avg
641603851 50 9 0 0
Packets Dropped In Processing by CPU event
Event Total 5 sec avg 1 min avg 5 min avg 1 hour avg
Sa Miss 641599177 50 9 0 0
L3 Receive 2 0 0 0 0
Input Acl Fwd 4669 0 0 0 0
Sw Packet for Bridge 3 0 0 0 0
Thanks & Regards,
Karthick Murugan
CCIE#39285 -
Hello,
I'm having almost 60-70% CPU utilization on a 6500 core for almost a day now. However cant seem to figure out what is overwhelming the CPU utlization. show cpu process sorted does not provide much information with top two processes being 'slcp process' - about 2-3% & spanning tree process which goes between 1-2%. The major change in the network was introduction of Nexus 2232 (10G) switches in the DC which are connected to 5K with 20 Gb uplinks to the 6500. Now almost 20 servers are connected to this switch, but none of them are going beyond 1.5 Gb/s.
Any help would be much appreciated.
Thank you.Hi,
Connecting 5ks to 6500 should not cause high CPU. Usually, when 6500s are configured in VSS mode, the CPU runs higher. Also if you are running a modular code, the CPU usually runs higher. Note that most newer IOS verions are not modular more .
Also, have a look at this doc for tips on troubleshooting high CPU.
http://www.cisco.com/c/en/us/support/docs/switches/catalyst-6500-series-switches/63992-6k-high-cpu.html
HTH -
ME4900 High CPU Because of Host Learning
Hi,
I am having the following issue:
ME02#sh processes cpu history
7777777777777777777777777777777777777777777777777777777777
0000000000333332222233336666633333111115555555555444448888
100
90
80 ***** ********** ****
70 **********************************************************
60 **********************************************************
50 **********************************************************
40 **********************************************************
30 **********************************************************
20 **********************************************************
10 **********************************************************
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per second (last 60 seconds)
8788878888978788888898878787988887878788979889989987788899
8950988091399773949001006973018149765762091698845219738701
100 ** *
90 * * * * * * * * * * * * * * * * * * * ***** ** ****
80 #*###*#######*#######** #*# #*#####*#*###########*#***#*##
70 ##########################################################
60 ##########################################################
50 ##########################################################
40 ##########################################################
30 ##########################################################
20 ##########################################################
10 ##########################################################
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
ME02-ANA#sh platform health
%CPU %CPU RunTimeMax Priority Average %CPU Total
Target Actual Target Actual Fg Bg 5Sec Min Hour CPU
GalChassisVp-review 3.00 0.08 10 46 100 500 0 0 0 665:48
S2w-JobEventSchedule 10.00 1.29 10 24 100 500 1 1 1 8849:22
Stub-JobEventSchedul 10.00 0.00 10 0 100 500 0 0 0 0:00
Lj-poll 1.00 0.02 2 0 100 500 0 0 0 176:21
StatValueMan Update 1.00 0.07 1 0 100 500 0 0 0 324:04
Pim-review 0.10 0.01 1 0 100 500 0 0 0 36:16
Ebm-host-review 1.00 0.00 8 4 100 500 0 0 0 943:27
Ebm-host-util-review 1.00 0.00 10 0 100 500 0 0 0 1:26
Ebm-port-review 0.10 0.00 1 0 100 500 0 0 0 3:10
Protocol-aging-revie 0.20 0.00 2 0 100 500 0 0 0 0:10
EbmHostRedundancyMan 2.00 0.00 20 0 100 500 0 0 0 0:00
Acl-Flattener 1.00 0.00 10 0 100 500 0 0 0 0:00
GalChassisVp Ondeman 2.00 0.00 2 0 100 500 0 0 0 0:00
KxAclPathMan create/ 1.00 0.00 10 5 100 500 0 0 0 8:09
KxAclPathMan update 2.00 0.00 10 0 100 500 0 0 0 0:00
KxAclPathMan reprogr 1.00 0.00 2 0 100 500 0 0 0 0:00
TagMan-RecreateMtegR 1.00 0.00 10 0 100 500 0 0 0 0:00
K2CpuMan Review 30.00 67.25 30 346 100 500 174 178 128 59991:10
K2AccelPacketMan: Tx 10.00 2.50 20 0 100 500 3 3 2 21944:07
K2AccelPacketMan: Au 0.10 0.00 0 0 100 500 0 0 0 0:00
K2AclMan-labeledFlat 1.00 0.00 10 0 100 500 0 0 0 0:00
K2AclCamMan stale en 1.00 0.00 10 0 100 500 0 0 0 0:00
K2AclCamMan consolid 1.00 0.00 10 0 100 500 0 0 0 0:00
K2AclCamMan hw stats 3.00 0.23 10 5 100 500 0 0 0 3065:15
K2AclCamMan kx stats 1.00 0.00 10 5 100 500 0 0 0 1115:31
K2AclCamMan Audit re 1.00 0.00 10 0 100 500 0 0 0 0:35
>>> K2CpuMan Review is using a lot of resource.
ME02#sh platform cpu packet statistics
Packets Dropped In Hardware By CPU Subport (txQueueNotAvail)
CPU Subport TxQueue 0 TxQueue 1 TxQueue 2 TxQueue 3
2 0 614764 0 0
RkiosSysPacketMan:
Packet allocation failures: 0
Packet Buffer(Software Common) allocation failures: 0
Packet Buffer(Software ESMP) allocation failures: 0
Packet Buffer(Software EOBC) allocation failures: 0
Packet Buffer(Software SupToSup) allocation failures: 0
IOS Packet Buffer Wrapper allocation failures: 0
Packets Dropped In Processing Overall
Total 5 sec avg 1 min avg 5 min avg 1 hour avg
1250698 0 0 0 0
Packets Dropped In Processing by CPU event
Event Total 5 sec avg 1 min avg 5 min avg 1 hour avg
Input Acl 56640 0 0 0 0
SA Miss 1194019 0 0 0 0
L2 Forward 1 0 0 0 0
CPU Generated 38 0 0 0 0
Packets Dropped In Processing by Priority
Priority Total 5 sec avg 1 min avg 5 min avg 1 hour avg
Normal 56053 0 0 0 0
Medium 1194019 0 0 0 0
High 588 0 0 0 0
Crucial 38 0 0 0 0
Packets Dropped In Processing by Reason
Reason Total 5 sec avg 1 min avg 5 min avg 1 hour avg
VlanZeroBadCrc 912338 0 0 0 0
SrcAddrTableFilt 1774 0 0 0 0
STPDrop 283895 0 0 0 0
L2DstDrop 146 0 0 0 0
L2DstDropInAcl 25322 0 0 0 0
NoDstPorts 27190 0 0 0 0
NoFloodPorts 33 0 0 0 0
Total packet queues 16
Packets Received by Packet Queue
Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
L2/L3Control 7479130708 272 274 222 214
Host Learning 6893729252 25471 25323 20851 24412
L3 Fwd Low 378 0 0 0 0
L2 Fwd Low 6098176 0 0 0 0
L3 Rx High 24 0 0 0 0
L3 Rx Low 31697 0 0 0 0
Packets Dropped by Packet Queue
Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
L2/L3Control 216862 0 0 0 0
Host Learning 33094924 38 35 42 139
>>>> From this output, showing that Host Learning is consuming the CPU.
I tried to find TCN by "show spanning-tree detail" but i don't find any TCN happen.
What else should i check ?The mac-move feature doesn't shows any entries. I expected to see many entries, because the Host Learning queue still shows an 1 hour average of 3819!
Regarding SPAN i don't have a SPAN Destination port at the moment.
Another question: There are two Core-Switches and some distribution switches are connected to each of the Core-Switch. On the trunks between the core-Switches and Distribution-Switches there are only some vlan allowed via "trunk allowed vlan".
Furthermore i can see that there are different spanning-tree root bridges for the same VLAN, e.g. if a VLAN is not allowed to a Distribution Switch, this Switch will be the root instead of the desired first Core-Switch. Is this a normal behaviour?
Must the trunk allowed configuration match on the link between core- and Distribution Switch? -
Hi,
I have this 3750 old switch running c3750-ipbase-mz.122-35.SE5.bin (I know it is old...) and it is used for connecting remote offices via 10Mbps circuits. It has been running fine for the last 12-month. But recently, I found the CPU usage is a little bit high, like in screenshot.
I know the average CPU usage is only about 10-20% but it bothers me that it constant has MAX CPU usage around 90+%...I also did show processes cpu sorted and the only thing having 3+% CPU usage is spanning tree...but that won't be enough to cause the CPU peaks... There is no special feature configure on the switch, just VLAN taggings.
Any suggestions on what to check?Check SDM template if you are overloading the switch.
show sdm prefer
The current template is "desktop routing" template.
The selected template optimizes the resources in
the switch to support this level of features for
8 routed interfaces and 1024 VLANs.
number of unicast mac addresses: 3K
number of IPv4 IGMP groups + multicast routes: 1K
number of IPv4 unicast routes: 11K
number of directly-connected IPv4 hosts: 3K
number of indirect IPv4 routes: 8K
number of IPv4 policy based routing aces: 0.5K
number of IPv4/MAC qos aces: 0.5K
number of IPv4/MAC security aces: 1K
If the numbers are good then you might want to check the entire LAN and causing temporary STP loops that would kick your CPU utilisation once in a while. Since you have mentioned that you are using this switch for WAN circuits, you may also check the show platform output.
show platform ip unicast failed route
Total of 0 covering fib entries
You should see zero or else that wouldn't be good. -
Spanning Tree and Admin mac address issues srw2048
Ok, I have a somewhat complex problem and hopefully someone may shed some light or have an idea as to whats wrong.
First the scenario:
I have two Cisco Cat 6509's etherchanneled to each other via two fiber cables. One of these is the STP/RSTP root. I have two SRW2048's.. one trunked to each of these 6509 switches. There is also a trunk between the SRW2048's. All this is to create a redundant topology so that if one of the switches fail's the others can still forward packets to each other. Of course the scenario described is in fact a loop that should be handled by STP/RSTP. I have RSTP enabled on all the switches in the scenario (PV RSTP on the cisco switches as they only do Cisco's brand of per vlan spanning tree). There are 3 vlan's configured on each of the srw2048's (2,55,96). There are corresponding vlan's also on the 6509's. I have put the srw2048's management interface into vlan 2.
The problem:
I need to forward packets between the srw2048's primarily and only use the 6509 that is not the root when a failure happens. I have configured the non-root 6509's spanning tree cost on the etherchannel to be higher then the alternate path through the srw's to the root. I can hook everything up and view the spanning tree and see that the srw2048's interface that goes to the non-root 6509 is blocked, and all other interfaces on the other switches are forwarding. I can in fact ping and get to the admin interface on all the switches. Then for some strange reason the admin interface of the srw2048 plugged into the non-root 6509 stops responding. If I disable either the interface its plugged into on the 6509 or the other srw2048 everything starts working again. Sometimes it responds after many failures for no apparent reason. I looked into the mac-address table on the 6509's and they are conflicting, pointing to each other for the mac-address of the broken srw2048. When I clear the mac-table the admin port comes back for about 5 seconds then again goes dark. When reviewing mac-table on the 6509's they are back to pointing to each other. The odd thing (although I haven't confirmed this completely) is that hosts placed into vlan 2 on that same srw2048 seem to work fine. If there was an STP loop or something misconfigured, I would expect it to effect any host in vlan 2 or the other vlan's for that matter on the srw2048 that stops responding. Alas, I am stuck because I need to manage this switch remotely. My only thought is that for some reason even when the STP status is blocked the broken srw2048 is still sending out arp's of its admin interface and bypassing the STP protocol. I have no way to confirm this, but maybe someone has an idea as to what I'm doing wrong, or otherwise offer a solution. For now, I simply removed vlan 2 from the 6509 that the broken srw2048 is plugged into and everything seems fine.
My apologies for such a long post, but this is somewhat complicated. Thanks in advance for any info.
-Geoff
Message Edited by gmyers on 08-19-2008 10:35 PMTo follow up, I had a ticket open with Linksys about this for about 3 months with no resolution. I submitted packet captures, stp outputs, etc and no luck. I gave up and basically had to revert to a manual failover for redundancy. It's no perfect or fast, but it works every time.
Unless linksys issues a firmware upgrade with this as a fix, I doubt we will be able to ever resolve this on our own.
Maybe you are looking for
-
I know the 5000 series XEONs in the Mac Pro support both data execution prevention (DEP) and hardware assisted virtualizaiton (Intel VT). Is there a way to turn these on since there is not EFI interface?
-
Progress indicator with currently loading images
I want to add a progress indicator (indeterminate) that is governed by the completed loading of an image from a URL. Is there a way in JavaFX to tell whether or not an image has completed loading, which would be useful in controlling a progress indic
-
How do I return to my default profile
I created a new profile to try to fix a problem with saving passwords. It fixed the problem for about a week and now it is back to the same thing. During the week, since it was working, I chose to check the box "do not show" so now I cannot return to
-
home page
-
Hi, My itunes account stopped allowing payment from my credit card. No problem with my credit card I have used it with other business. Will not accept card detaild when I re-enter them. I have even tried a different credit card with no success. Wh