CSCsi78581 - Hulc LED Process has even higher CPU (20%) running "fixed" version 15.2(2)E

A known good fix for the CPU issue was listed as version 15.2(2)E.
However, I have found that this version has even a higher CPU usage of 20% than the original bug indicated at 15%.
Does anyone know a fix for this?

Experiencing this with 12.2(55)SE9 as well.

Similar Messages

  • CSCsi78581 - Hulc LED Process uses 10-15 percent CPU on Catalyst 3750/3560 - 10

    I have the same issue, but now is in 3750E with IOS
    15.0(1)SE3 does anybody see this bug in this version of IOS ?
          345433434433338833333333444433353433343334433433333533796763
          829698281199793397776998091576799099908973089099999499163527
      100                                                        * 
       90                                                        * 
       80               **                                       * *
       70               **                                      ** *
       60   *           **               *                      ****
       50   **          **         * *   *                   *  *##*
       40 *###**#******###*********###****###**#***##*##*###########
       30 ##########################################################
       20 ##########################################################
       10 ##########################################################
         0....5....1....1....2....2....3....3....4....4....5....5....6
                   0    5    0    5    0    5    0    5    0    5    0
                   CPU% per minute (last 60 minutes)
                  * = maximum CPU%   # = average CPU%
    173  1360214457   674705267       2016 19.68% 19.77% 19.76%   0 Hulc LED Process

    I see this issue on a Catalyst 3560X-48P running IOS 15.0(2)SE2.
    switch#show proc cpu sorted
    CPU utilization for five seconds: 44%/0%; one minute: 42%; five minutes: 41%
    PID Runtime(ms)     Invoked      uSecs   5Sec   1Min   5Min TTY Process
    171  3074931895   362854359       8474 20.31% 20.10% 20.00%   0 Hulc LED Process

  • MACFLAPS seen only on 1 vlan and also has HIGH CPU HULC LED PROCESS

    Hi All, 
    Their is a weird problem we are having with MAC-FLAPS and HIGH CPU uses. The odd think is when we change the VLAN on the port to a different one then the flapping stops but when we turn it back it starts again. I removed the Vlan from a switch (3750) and the CPU usage returned back to normal even though it was only using it for a printer only (was 50%/30% cpu!). 
    However the problem now exists with TWO 2960 PCS and 1 2960 POE and they have HULC LED PROCESS at 65%/40% plus CPU usage. There are no STP or HSRP issues on that VLAN however I think it's related to that VLAN. I even backdated the IOS version and reloaded but problem still persists. 
    What else can I do or is the switch gone (memory leak?). I don't to change all 3 switches so how do I know which switch is the cause as the CPU to be High and only caused due to 1 vlan? ALso when we put something on that VLAN sometimes we get MACFLAPS; although if we change the VLAN the MACFLAPS stop. But the Macflaps are intermittent so I really am not sure what the problem is. 

    Hello.
    Regarding "Hulc led" process - it's a bug; please provide the IOS version you are running.
    It's not clear waht issue do you have with MAC flap; could you please provide command/log outputs?

  • 2960 - HULC LED PROCESS

    Dear All,
    I have cisco WS-C2960S-48FPS-L stacked. Weekly twice, my PoE connections are dropped and when the device is restarted, everything starts working normal. This issue happens weekly once or twice.
    Verified the power input and it's absolutely fine.
    show power inline
    Module   Available     Used     Remaining
              (Watts)     (Watts)    (Watts)
    1           740.0       91.5       648.5
    2           740.0       60.2       679.8
    3           740.0      144.3       595.7
    4           740.0      157.1       582.9
    Upon taking a look to the CPU Process, device is punted with 75 - 85 % at normal usage, with "Hulc LED Process" as 18% utilisation. CPU utilisation also peaks to 90 - 100% sometimes.
    CPU utilization for five seconds: 78%/48%; one minute: 58%; five minutes: 50%
    100 *              *                                                     
    90 * **  *  *     *                                                     
    80 *###############                                                     
    70 ################                                                     
    60 ################                                                     
    50 ################                                                     
    40 ################                                                     
    30 ################                                                     
    20 ################                                                     
    10 ################                                                     
       0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
                 0    5    0    5    0    5    0    5    0    5    0    5    0
                       CPU% per hour (last 72 hours)
                      * = maximum CPU%   # = average CPU%
    I can see that there is a bug id : CSCtg86211 and no work around for it.
    Does anyone faced similar issue and any updates received from Cisco TAC ?
    Any recommendations to overcome this issue !!
    BR / Vimal.

    I am also seeing an issue with two stacks of 5 x WS-C2960X-48FP-S switches similar to this case.
    Code in use:  c2960x-universalk9-mz.150-2.EX5.bin
    At the moment there is nothing connected to the copper 48 ports in any of the switches.
    Each stack has a LACP port-channel to a 2 x WS-C3850-48F-E core stack utilising ports x/0/51 and x/0/52 on each 2960X - total 10 ports in each port-channel (8 in use 2 Hot-standby)
    The uplink ports are using GLC-Ts
    There are 5 vlans (including Vlan1) on the switch.
    sw02#show proc cpu | excl 0.00
    CPU utilization for five seconds: 42%/0%; one minute: 42%; five minutes: 42%
     PID Runtime(ms)     Invoked      uSecs   5Sec   1Min   5Min TTY Process
      91     1355993    26717170         50  0.29%  0.22%  0.19%   0 RedEarth Tx Mana
      92      886939    26742049         33  0.11%  0.12%  0.16%   0 RedEarth Rx Mana
     121      618726    15414683         40  0.11%  0.06%  0.06%   0 HLFM address lea
     127     2828875    11788935        239  0.41%  0.41%  0.42%   0 hpm main process
     132      637843     4108756        155  0.05%  0.07%  0.05%   0 HRPC pm-counters
     162   176218586    15422705      11425 25.07% 25.30% 25.31%   0 Hulc LED Process
     173     2274099      122941      18497  0.35%  0.31%  0.30%   0 HQM Stack Proces
     174     1720412     1228633       1400  0.23%  0.23%  0.23%   0 HRPC qos request
     183      844538      205684       4105  0.05%  0.10%  0.11%   0 Power RPS Proces
     207        2879       22868        125  0.11%  0.10%  0.06%   0 IP Input
     220      288284     1554997        185  0.11%  0.04%  0.05%   0 Spanning Tree
     237     1356330     6170406        219  0.11%  0.07%  0.14%   0 UDLD
     293      324727     1359786        238  0.05%  0.04%  0.05%   0 Marvell wk-a Pow
     372         120         123        975  0.05%  0.07%  0.01%   1 Virtual Exec
    sw03#sh proc cpu | exc 0.00
    CPU utilization for five seconds: 42%/0%; one minute: 46%; five minutes: 45%
     PID Runtime(ms)     Invoked      uSecs   5Sec   1Min   5Min TTY Process
      63         507        1733        292  0.05%  0.06%  0.03%   0 Per-Second Jobs
      91        5409       72997         74  0.35%  0.23%  0.23%   0 RedEarth Tx Mana
      92        4526       73169         61  0.11%  0.19%  0.23%   0 RedEarth Rx Mana
     129       11881       29115        408  0.54%  0.42%  0.42%   0 hpm main process
     133        1259        1674        752  0.23%  0.16%  0.12%   0 hpm counter proc
     163      494386       41535      11902 25.38% 25.35% 25.30%   0 Hulc LED Process
     174        6130         374      16390  0.29%  0.31%  0.29%   0 HQM Stack Proces
     175        4446        3249       1368  0.29%  0.25%  0.24%   0 HRPC qos request
     183        2237         559       4001  0.11%  0.16%  0.13%   0 Power RPS Proces
     206         894       41778         21  0.05%  0.03%  0.03%   0 IP ARP Retry Age
     237        5298       16703        317  0.11%  0.14%  0.26%   0 UDLD
     251        4045         452       8949  0.29%  2.68%  0.98%   1 Virtual Exec
     291        1183        3706        319  0.05%  0.05%  0.05%   0 Marvell wk-a Pow
    Any advice from Cisco would be much appreciated.
    Mark

  • Skype 4.2.0.11 has abnormally high CPU usage while...

    Skype 4.2.0.11 has abnormally high CPU usage while idle.
    I can't get my laptop under 70 degrees celsius unless I cpulimit or quit skype, and cpulimiting it actually makes it completely unresponsive, as if some other thread is constantly generating a lot of work and taking priority over the UI thread.
    What the heck is skype doing? (And why do any of its threads need nice -10?) It takes up more CPU time than pulseaudio, truecrypt, and deluged combined.
    Its CPU usage is constantly between 5 and 50 percent*, it's absolutely horrible.
    *While idle. I'm unable to make calls.
    I know this is expected from a linux user, but for all I know, Skype is malware. It's not open-source, so I can't find out for myself, and there are no open-source alternatives so the frankly shameful amount of bugs I encounter in Skype will never be fixed.
    There are several bugs I'd love to be fixed in Skype, but first, PLEASE, optimize your code. It's absolutely horriffic at the moment.

    Attached are statistics from my desktop over approximately a 24 hour period for the processes shown (other than firefox and adb).
    Pulseaudio tops skype this time but that's because I've had music playing through mpd for a few hours. Skype uses more than 16 times the CPU that pidgin does, and almost double the RAM! RAM isn't shown in the screenshot but take my word for it. Bear in mind that I haven't taken (or made) any calls in this period of time, and pidgin has been signed into three different services and using encrypted chat.
    I really wish that at least the protocol would be documented so someone could work around this, at the moment I don't think the guys writing skype realize just how unstable the linux port is. At least it's better than the Android port.
    [Edit for those unfamiliar with linux processes: "TIME" is the cumulative time that the program has been scheduled for on any core, effectively making it a measure of total CPU usage for a given time period]
    Attachments:
    2014-06-22-233238_530x119_scrot.png ‏9 KB

  • TMG Microsoft Firewall Service Process (wspsrv.exe) high CPU. CPU Usage 100%

    TMG Microsoft Firewall Service Process (wspsrv.exe) high CPU.
    CPU Usage 100%
    Please help me.
    Thanks

    Hi,
    Since there can be multiple reasons for this issue, you can
    capture a manual dump of the wspsrv.exe process on TMG server or find some related logs to better analyze this issue firstly.
    In addition, what have you done before you encountered that issue?
    If you have any third-party programs installed, you can temporary disable them and restart the firewall service to see if the issue persists.
    For more detailed information, please refer to the links below:
    How
    to capture a manual dump of the wspsrv.exe process on TMG 2010?
    Using
    DebugDiag 1.2 to Automate Dump Analysis – TMG High CPU Utilization Scenario
    Best regards,
    Susie

  • Process svchost consuming high cpu 99 %

    Hi,
    We have installed iis 6 in windows server 2003 and the process 832 svchost consuming the high cpu and causing the slow response of the applications, hence please advise the possible work around for the same 
    please find below the dump analysis 
    All Operations
    Tip:
    To search on any particular function in the list below, highlight it with the mouse then press CTRL+C, CTRL+F, CTRL+V. This will highlight all the call stacks which contain the particular function and allow you to jump between them in
    the browser.
    Top 40 functions in all operations (excludes boiler-plate functions)
    ntdll!NtReplyWaitReceivePortEx
    svchost!ServiceStarter
    advapi32!ScSvcctrlThreadA
    ntdll!ZwRemoveIoCompletion
    ntdll!ZwDelayExecution
    rpcrt4!Invoke
    rpcrt4!DispatchToStubInCNoAvrf
    rpcrt4!RPC_INTERFACE::DispatchToStubWorker
    rpcrt4!RPC_INTERFACE::DispatchToStub
    rpcrt4!LRPC_SCALL::DealWithRequestMessage
    rpcrt4!LRPC_ADDRESS::DealWithLRPCRequest
    ntdll!RtlpWaitThread
    authz!AuthzpDeQueueThreadWorker
    rpcrt4!COMMON_ProcessCalls
    rpcrt4!LOADABLE_TRANSPORT::ProcessIOEvents
    rpcrt4!ProcessIOEventsWrapper
    browser!BrWorkerThread
    vssapi!CVssWriterImpl::RequestWriterInfo
    ole32!ThreadInvoke
    rpcrt4!RPC_INTERFACE::DispatchToStubWithObject
    ncobjapi!CNamedPipeClient::ProviderReadyThreadProc
    msvcrt!_endthreadex
    aelupsvc!AelTppWorkerThreadRoutine
    ntdll!NtReadFile
    kernel32!ReadFile
    advapi32!ScGetPipeInput
    advapi32!ScDispatcherLoop
    advapi32!StartServiceCtrlDispatcherW
    svchost!_wmainCRTStartup
    kernel32!BaseProcessStart
    ntdll!RtlpTimerThread
    wzcsvc!ServiceStart
    shsvcs!CGenericServiceManager::_ServiceMain
    schedsvc!CSchedWorker::MainServiceLoop
    schedsvc!SchedMain
    schedsvc!SchedStart
    schedsvc!SchedServiceMain
    schedsvc!WindowMsgFcn
    schedsvc!PfSvcMainThread
    schedsvc!PfSvProcessTraceThread
    13 hits
    8 hits
    8 hits
    7 hits
    3 hits
    3 hits
    3 hits
    3 hits
    3 hits
    3 hits
    3 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits

    Hi,
    We have installed iis 6 in windows server 2003 and the process 832 svchost consuming the high cpu and causing the slow response of the applications, hence please advise the possible work around for the same 
    please find below the dump analysis 
    All Operations
    Tip:
    To search on any particular function in the list below, highlight it with the mouse then press CTRL+C, CTRL+F, CTRL+V. This will highlight all the call stacks which contain the particular function and allow you to jump between them in
    the browser.
    Top 40 functions in all operations (excludes boiler-plate functions)
    ntdll!NtReplyWaitReceivePortEx
    svchost!ServiceStarter
    advapi32!ScSvcctrlThreadA
    ntdll!ZwRemoveIoCompletion
    ntdll!ZwDelayExecution
    rpcrt4!Invoke
    rpcrt4!DispatchToStubInCNoAvrf
    rpcrt4!RPC_INTERFACE::DispatchToStubWorker
    rpcrt4!RPC_INTERFACE::DispatchToStub
    rpcrt4!LRPC_SCALL::DealWithRequestMessage
    rpcrt4!LRPC_ADDRESS::DealWithLRPCRequest
    ntdll!RtlpWaitThread
    authz!AuthzpDeQueueThreadWorker
    rpcrt4!COMMON_ProcessCalls
    rpcrt4!LOADABLE_TRANSPORT::ProcessIOEvents
    rpcrt4!ProcessIOEventsWrapper
    browser!BrWorkerThread
    vssapi!CVssWriterImpl::RequestWriterInfo
    ole32!ThreadInvoke
    rpcrt4!RPC_INTERFACE::DispatchToStubWithObject
    ncobjapi!CNamedPipeClient::ProviderReadyThreadProc
    msvcrt!_endthreadex
    aelupsvc!AelTppWorkerThreadRoutine
    ntdll!NtReadFile
    kernel32!ReadFile
    advapi32!ScGetPipeInput
    advapi32!ScDispatcherLoop
    advapi32!StartServiceCtrlDispatcherW
    svchost!_wmainCRTStartup
    kernel32!BaseProcessStart
    ntdll!RtlpTimerThread
    wzcsvc!ServiceStart
    shsvcs!CGenericServiceManager::_ServiceMain
    schedsvc!CSchedWorker::MainServiceLoop
    schedsvc!SchedMain
    schedsvc!SchedStart
    schedsvc!SchedServiceMain
    schedsvc!WindowMsgFcn
    schedsvc!PfSvcMainThread
    schedsvc!PfSvProcessTraceThread
    13 hits
    8 hits
    8 hits
    7 hits
    3 hits
    3 hits
    3 hits
    3 hits
    3 hits
    3 hits
    3 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    2 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits
    1 hits

  • Safari webpage preview fetcher high CPU usage, runs hot Macbook Pro, fan

    Even when turned off in Safari Preferences, safari webpage preview fetcher starts up and starts using high CPU % (99.8% when checked on Activity Monitor!). Macbook starts running hot, fan starts running on high. You can force quit safari webpage preview fetcher in Activity Monitor, but it starts itself back up again!

    Well, I disabled safari webpage preview in preferences, and rebooted, zapping the pram and it hasn't restarted, and I haven't had the high fan / hot running so yay!

  • Update work process has too high respose time.

    Our functional team is facing issue while saving data in va03 transaction. IT prompts Sales order saved successfully and when we go to va02 and try to open getting error Document "SD document not in database or has been archived"
    So when I checked sm66 update WP is on hold due to RFC response. and in st03 it has high response time
    Task          steps  response time                                             wait time
    UPDATE2    2       1.130,0               335,0    65,0    724,0    0,0    0,0                0,0    0,0    70,5
    UPDATE    29        1.188.035,2       19,6    8,6    35,9    0,0         1.187.979,4    0,0    0,0    0,3
    Also in SM13 all updates are at Initial status. Nothing get updated in database.
    Please help as functional team is no more able to work and as basis person We need to resolve the same.

    Hi Spr,
    Please check the following
    1) Update has status active in SM13
    2) You have enough space in the oraarch directory
    3) You have enough space in tablespaces
    4) Check for any error message on in alert_<SID>.log file
    5) Update oracle dictionary, missing and all statistics in the database.
    Hope this helps.
    Regards,
    Deepak Kori

  • High CPU usage running select from dba_ts_quotas

    We recently installed grid agent on a DEV box and have seen out CPU spike like crazy at times. I have 10 instances running on this box (cringe), they are at different versions from 10 -11G. The agent is at 10.2.0.4.
    I looked up the query that's eating my CPU and got the following:
    /* OracleOEM */
    SELECT 'table_space_quotas',
    USERNAME,
    TABLESPACE_NAME
    FROM dba_ts_quotas
    WHERE (max_bytes = -1
    OR max_blocks = -1)
    AND username NOT IN ('SYS','SYSTEM','SYSMAN','CTXSYS',
    'MDSYS','ORDSYS','ORDPLUGINS','OLAPSYS',
    'DBSNMP','MGMT_VIEW','OUTLN','ANONYMOUS',
    'DMSYS','EXFSYS','LBACSYS','SI_INFORMTN_SCHEMA',
    'SYSMAN','WKPROXY','WKSYS','WK_TEST',
    'WMSYS','XDB','TRACESVR','SCOTT',
    'ADAMS','BLAKE','CLARK','JONES',
    'HR')
    AND ROWNUM <= DECODE(:1,'-1',2147483647,
    :1)
    ORDER BY USERNAME
    I've done some research and followed the suggestions:
    There was a suggestion to set the following parameter: set optimizer_secure_view_merging=false
    Disable Security Policty to monitor table spaces
    Nothing seems to help.
    Has anyone else experienced this?

    I know its been a while, but though it worthwhile posting this for others viewing this post
    Try the following from Metalink note #395064.1
    Symptoms
    The following query that is fired from Grid Control once in a day takes a lot of time and it affects the entire performance of Grid Control:
    SELECT 'table_space_quotas', username, tablespace_name
    FROM dba_ts_quotas
    WHERE (max_bytes = -1
    OR max_blocks = -1)
    AND NOT username IN ('SYS', 'SYSTEM', 'SYSMAN', 'CTXSYS', 'MDSYS',
    'ORDSYS', 'ORDPLUGINS', 'OLAPSYS', 'DBSNMP', 'MGMT_VIEW', 'OUTLN',
    'ANONYMOUS', 'DMSYS', 'EXFSYS', 'LBACSYS', 'SI_INFORMTN_SCHEMA',
    'SYSMAN', 'WKPROXY', 'WKSYS', 'WK_TEST', 'WMSYS', 'XDB', 'TRACESVR',
    'SCOTT', 'ADAMS', 'BLAKE', 'CLARK', 'JONES', 'HR')
    AND rownum <= decode(:1, '-1', 2147483647, :1)
    ORDER BY username
    Cause
    The security policy run against the 10.2.0.2 database which ensures database users are allocated a limited tablespace quota is creating the problem.
    Solution
    - From the Grid Control home page click on Targets > Databases > select 10.2.0.2 database.
    - Click on 'Metric and Policy Settings' and select 'Policies' tab.
    - Now search for the Policy Rule 'Unlimited Tablespace Quota' and click on Schedule link.
    - The default collection is every 24 hours. You need to disable Collection Schedule and click
    continue button which will take you back to the previous page.
    - Also select 'Disabled' from the drop down box available near the Policy Evaluation and click continue. After this, the security policy which ensures database users are allocated a limited tablespace quota will not run and the statement won't be executed.

  • OEM12c agents high CPU usage alerts fix (leap second Linux kernel bug)

    Just throwing this out here in case anyone else spent the weekend pulling their hair out and hasn't resolved this yet.
    Due to the leap second that occurred at midnight UTC going into July 1st, most of my OEM 12c BP1 agents on Linux servers went haywire, taking up 100%+ CPU on monitored servers. This appears to be due to a bug triggered by the leap second.
    The following seems to fix the issue without requiring a server reboot.
    as root:
    /etc/init.d/ntp stop
    date `date +"%m%d%H%M%C%y.%S"`
    /etc/init.d/ntp start
    as OEM agent user:
    $AGENT_HOME/bin/emctl stop agent ; $AGENT_HOME/bin/emctl start agent
    I didn't discover the fix, but I've confirmed it works.
    Edited by: BrianP on Jul 2, 2012 11:53 AM -- subject changed to note this is a Linux kernel bug, not a Java bug... kernel bug causes software using futexes (like Java) to spin and timeout repeatedly

    See MOS note "Enterprise Manager Management Agent or OMS CPU Use Is Excessive on or around July 1, 2012 [ID 1472651.1]" for more information on this issue. Oracle notes it may occur from versions 10.2.0.5 through 12.1.0.1.0.
    See also "Leap Second Hang - CPU Can Be Seen at 100% [ID 1472421.1]" and bug 14264454.
    Thanks abulloch for getting the note out there!

  • 3750 stack - high cpu for "hulc running con" every one or two minutes

    I have a stack of 4 x 3750 :
    Switch Ports Model              SW Version            SW Image
    *    1 28    WS-C3750G-24PS     12.2(53)SE            C3750-IPSERVICES-M
         2 12    WS-C3750G-12S      12.2(53)SE            C3750-IPSERVICES-M
         3 12    WS-C3750G-12S      12.2(53)SE            C3750-IPSERVICES-M
         4 28    WS-C3750G-24PS     12.2(53)SE            C3750-IPSERVICES-M
    And every minutes or two minutes (approximately), I have high cpu for "hulc running con" without doing anything.
    coeur#sh proc cpu sort
    CPU utilization for five seconds: 86%/28%; one minute: 49%; five minutes: 49%
     PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process 
     312   670849714   3362057     199535 44.22%  5.00%  4.96%   0 hulc running con 
      82   234351581 353049778        663  3.76%  5.99%  5.95%   0 HLFM address lea 
     277       11138      8537       1304  1.05%  1.70%  1.12%   1 Virtual Exec     
     142    10589757 353659360         29  0.90%  0.33%  0.22%   0 Hulc LED Process 
    coeur#sh proc cpu sort
    CPU utilization for five seconds: 95%/27%; one minute: 52%; five minutes: 49%
     PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process 
     312   670832227   3361981     199545 55.59%  8.95%  5.76%   0 hulc running con 
      82   234334259 353043921        663  3.99%  5.78%  6.02%   0 HLFM address lea 
     277        6286      7531        834  0.63%  1.06%  0.61%   1 Virtual Exec     
     106    15342490  19948859        769  0.47%  0.20%  0.15%   0 hpm counter proc 
     119     2034091  13865800        146  0.31%  0.04%  0.03%   0 LLDP Protocol    
     142    10588906 353653113         29  0.31%  0.21%  0.16%   0 Hulc LED Process 
    How can I find which is doing a "show run" ? Which debug can I do ?
    Thanks

    We solved our problem it was caused because we were routing in and out the same L3 interface.
    Fixed this issue and our CPU dropped dramatically.

  • High CPU usage - 3750 X stack

    Support Community
    We recently configured a stack of four 48 port 3750-x switches . We are noticing high CPU usage. "Hulc LED process" seems pretty high.
    This has coincided with VMware servers getting slow and non-responsive at times, perhaps a coincidence, not sure.
    Below I provided some outputs that might help to diagnose it
    Thanks
    John
    System image file is "flash:/c3750e-ipbasek9-mz.122-58.SE2/c3750e-ipbasek9-mz.122-58.SE2.bin"
    Show inventory output
    NAME: "1", DESCR: "WS-C3750X-48"
    PID: WS-C3750X-48T-S   , VID: V02  ,
    NAME: "Switch 1 - Power Supply 0", DESCR: "FRU Power Supply"
    PID: C3KX-PWR-350WAC   , VID: V02L ,
    NAME: "2", DESCR: "WS-C3750X-48"
    PID: WS-C3750X-48T-S   , VID: V02 
    NAME: "Switch 2 - Power Supply 0", DESCR: "FRU Power Supply"
    PID: C3KX-PWR-350WAC   , VID: V02D ,
    NAME: "3", DESCR: "WS-C3750X-48"
    PID: WS-C3750X-48T-S   , VID: V02 
    NAME: "Switch 3 - Power Supply 0", DESCR: "FRU Power Supply"
    PID: C3KX-PWR-350WAC   , VID: V02L ,
    NAME: "4", DESCR: "WS-C3750X-48"
    PID: WS-C3750X-48T-S   , VID: V02 
    NAME: "Switch 4 - Power Supply 0", DESCR: "FRU Power Supply"
    PID: C3KX-PWR-350WAC   , VID: V02L ,
    SWITCH#sh processes cpu sorted
    CPU utilization for five seconds: 61%/5%; one minute: 50%; five minutes: 49%
    PID Runtime(ms)     Invoked      uSecs   5Sec   1Min   5Min TTY Process
    168   260466386    44948517       5794 14.53% 13.98% 13.70%   0 Hulc LED Process
    231    97586088    27253906       3580  4.95%  4.73%  4.64%   0 Spanning Tree
    213    63106121   154928892        407  4.15%  3.89%  3.91%   0 IP Input
    284    70113217    34537588       2030  3.51%  3.98%  4.17%   0 RARP Input
       4     6663412      421278      15817  3.03%  0.43%  0.32%   0 Check heaps
    374     9872291    10805181        913  3.03%  0.77%  0.62%   0 IP SNMP
    376    11142951     5370604       2074  3.03%  0.73%  0.66%   0 SNMP ENGINE
      12    35389011    32152175       1100  2.87%  2.08%  2.20%   0 ARP Input
    128    34962407     3622140       9652  2.07%  1.69%  1.63%   0 hpm counter proc
      85    49034286     8536062       5744  1.91%  2.44%  2.44%   0 RedEarth Tx Mana
    107    25127806    46459053        540  1.27%  1.10%  0.93%   0 HLFM address lea
    174        2412        1714       1407  0.95%  0.39%  0.25%   1 SSH Process
    220     6423643    12634764        508  0.79%  0.70%  0.56%   0 ADJ resolve proc
    181     6913179     2890070       2392  0.63%  0.31%  0.36%   0 HRPC qos request
    375     1681949     5000777        336  0.47%  0.08%  0.07%   0 PDU DISPATCHER
      84    10180707    12623537        806  0.47%  0.30%  0.37%   0 RedEarth I2C dri
            1
          666666096996666666666666659666667666666666666666666766676666666656666666
          249363098992351145264823289455360612252332233522344115537230141392553343
      100       ** **               *
       90       ** **               *
       80       ** **               *
       70   * * *****  *   * * *    * ** ***   *       *     * ****         **
       60 **********************************************************************
       50 ######################################################################
       40 ######################################################################
       30 ######################################################################
       20 ######################################################################
       10 ######################################################################
         0....5....1....1....2....2....3....3....4....4....5....5....6....6....7..
                   0    5    0    5    0    5    0    5    0    5    0    5    0
                       CPU% per hour (last 72 hours)
                      * = maximum CPU%   # = average CPU%
          455555555554444444444555554444455555555555555555555444444444
          922222111118888866666000009999911111555554444422222444448888
      100
       90
       80
       70
       60                                     *****
       50 ***************************************************     **
       40 **********************************************************
       30 **********************************************************
       20 **********************************************************
       10 **********************************************************
         0....5....1....1....2....2....3....3....4....4....5....5....6
                   0    5    0    5    0    5    0    5    0    5    0
                   CPU% per second (last 60 seconds)
          565756555555555555555555555555555556555555555555565555565556
          518841757869248569271526666733778330496833777819929379701861
      100
       90
       80    *
       70    *
       60 **** *******  **** * * *****  ***  * ***  **** **** **** *
       50 ##########################################################
       40 ##########################################################
       30 ##########################################################
       20 ##########################################################
       10 ##########################################################
         0....5....1....1....2....2....3....3....4....4....5....5....6
                   0    5    0    5    0    5    0    5    0    5    0
                   CPU% per minute (last 60 minutes)
                  * = maximum CPU%   # = average CPU%

    Thanks to all for your replies.
    Jeff
    I was aware of the many ACLs however we used to have the same ACLs in a previous 3750G stack about 2 weeks ago and we never had this issue. I agree I need to optimize them and do somehing because it is reaching its max before the CPU starts processing them but I am not certain this is what is causing the issue.
    Nikolay,
    I am trying to understand "interrupts" with the analysis of the outputs I posted. Here is another output deom the link you provided. Please post your thoughts if you can.
    This switch also serves as a gateway(L3 role)  for many systems. Would it make sense to offload that responsability from this switch and let an actual router do it?
    Thanks
    Johnny
    show controllers cpu-interface
    ASIC    Rxbiterr   Rxunder    Fwdctfix   Txbuflos   Rxbufloc   Rxbufdrain
    ASIC0     0          0          0          0          0          0
    ASIC1     0          0          0          0          0          0
    ASIC2     0          0          0          0          0          0
    HOL Fix Counts
    No Fixes:          0 Added:          0 In Use:          0 Both:          0
    CPU Heartbeat Statistics
    Tx Success Tx Fail    1st Thr    2nd Thr    Unthr      RetryCtMax
      37139562          0          0          0          0          1
    Rx Delay
             0          1          2          3          4
      37139562          0          0          0          0
    AddlDelay AdvanceCnt
             0          0
    Rx Retries by RetryCount
             0          1          2          3          4          5          6
      37139562          0          0          0          0          0          0
             7          8          9
             0          0          0
    AddlRetry
             0
    cpu-queue-frames  retrieved  dropped    invalid    hol-block  stray
    rpc               104077409  0          0          0          0
    stp               19189469   0          0          0          0
    ipc               11093838   0          0          0          0
    routing protocol  141021559  0          0          0          0
    L2 protocol       230347     0          0          0          0
    remote console    17         0          0          0          0
    sw forwarding     257436702  0          0          0          0
    host              21146276   0          0          0          0
    broadcast         332154608  0          0          0          0
    cbt-to-spt        0          0          0          0          0
    igmp snooping     2796987    0          0          0          0
    icmp              90752156   0          0          0          0
    logging           0          0          0          0          0
    rpf-fail          0          0          0          0          0
    dstats            0          0          0          0          0
    cpu heartbeat     37139562   0          0          0          0
    cpu-queue         static inuse static added
    rpc               0            0
    stp               0            0
    ipc               0            0
    routing protocol  0            0
    L2 protocol       0            0
    remote console    0            0
    sw forwarding     0            0
    host              0            0
    broadcast         0            0
    cbt-to-spt        0            0
    igmp snooping     0            0
    icmp              0            0
    logging           0            0
    rpf-fail          0            0
    dstats            0            0
    cpu heartbeat     0            0
    Supervisor ASIC receive-queue parameters
    queue 0 maxrecevsize 7E0 pakhead 5505A88 paktail 54655A8
    queue 1 maxrecevsize 7E0 pakhead 5689164 paktail 5687F54
    queue 2 maxrecevsize 7E0 pakhead 5547AA4 paktail 554719C
    queue 3 maxrecevsize 7E0 pakhead 5DC233C paktail 5DBA4CC
    queue 4 maxrecevsize 7E0 pakhead 56A7198 paktail 56A7AA0
    queue 5 maxrecevsize 7E0 pakhead 5D61304 paktail 5D72F80
    queue 6 maxrecevsize 7E0 pakhead 5D856D4 paktail 5D989E4
    queue 7 maxrecevsize 7E0 pakhead 5BDE29C paktail 5BDC784
    queue 8 maxrecevsize 7E0 pakhead 5CC00A8 paktail 5CB3574
    queue 9 maxrecevsize 7E0 pakhead 59DD86C paktail 59DD86C
    queue A maxrecevsize 7E0 pakhead 59BF43C paktail 59C13D8
    queue B maxrecevsize 7E0 pakhead 5DD18A0 paktail 5DCE6F4
    queue C maxrecevsize 7E0 pakhead 59E9CBC paktail 5A049B8
    queue D maxrecevsize 7E0 pakhead 59D8EA0 paktail 59DD25C
    queue E maxrecevsize 0 pakhead 0 paktail 0
    queue F maxrecevsize 7E0 pakhead 59A7080 paktail 59A6BFC
    Supervisor ASIC exception status
    Receive overrun    00000000   Transmit overrun 00000000
    FrameSignatureErr  00000000   MicInitialize    00000002
    BadFrameErr        00000000   LenExceededErr   00000000
    BadJumboSegments   00000000
    Supervisor ASIC Mic Registers
    MicDirectPollInfo               80000200
    MicIndicationsReceived          00000000
    MicInterruptsReceived           00000009
    MicPcsInfo                      0000001F
    MicPlbMasterConfiguration       00000000
    MicRxFifosAvailable             00000000
    MicRxFifosReady                 0000BFFF
    MicTimeOutPeriod:       FrameTOPeriod: 00000EA6 DirectTOPeriod: 00004000
    MicTransmFramesCopied           00000003
    MicTxFifosAvailable             0000000E
    MicConfiguration:       Conf flag: 00000110     Interrupt Flag: 00000008
    MicReceiveFifoAssignmen Queue 0 - 7: 33333333   Queue 8 - 15:33333333
    MicReceiveFramesReady:  FrameAvailable: 00000181        frameAvaiMask: 00000000
    MicException:
            Exception_flag  00000000
            Message-1       00000000
            Message-2       00000000
            Message-3       00000000
    MicIntRxFifo:
            ReadPtr         000005C0        WritePtr        000005C0
            WHeadPtr        000005C0        TxFifoDepth     C0000800
    MicIntTxFifo:
            ReadPtr         00000728        WritePtr        00000728
            WHeadPtr        00000728        TxFifoDepth     C0000800
    MicDecodeInfo:
    Fifo0:  address:        03FF4000 asic_num:      00000100
    Fifo1:  address:        03FF4400 asic_num:      00000101
    MicTransmitFifoInfo:
    Fifo0:   StartPtrs:     0E2CE800        ReadPtr:        0E2CEBE8
            WritePtrs:      0E2CEBE8        Fifo_Flag:      8A800800
            Weights:        001E001E
    Fifo1:   StartPtrs:     0E02D000        ReadPtr:        0E02D138
            WritePtrs:      0E02D138        Fifo_Flag:      89800400
            Weights:        000A000A
    MicReceiveFifoInfo:
    Fifo0:  StartPtr:       0E4AF000        ReadPtr:        0E4AF2A8
            WritePtrs:      0E4AF308        Fifo_Flag:      8B000FA0
            writeHeaderPtr: 0E4AF308
    Fifo1:  StartPtr:       0E78C000        ReadPtr:        0E78C2E8
            WritePtrs:      0E78C2E8        Fifo_Flag:      89800400
            writeHeaderPtr: 0E78C2E8
    Fifo2:  StartPtr:       0E744800        ReadPtr:        0E744A70
            WritePtrs:      0E744A70        Fifo_Flag:      89800400
            writeHeaderPtr: 0E744A70
    Fifo3:  StartPtr:       0EBD1000        ReadPtr:        0EBD13B8
            WritePtrs:      0EBD13B8        Fifo_Flag:      89800400
            writeHeaderPtr: 0EBD13B8
    Fifo4:  StartPtr:       0E7D3800        ReadPtr:        0E7D3A58
            WritePtrs:      0E7D3A58        Fifo_Flag:      89800400
            writeHeaderPtr: 0E7D3A58
    Fifo5:  StartPtr:       0EB40600        ReadPtr:        0EB40688
            WritePtrs:      0EB40688        Fifo_Flag:      88800200
            writeHeaderPtr: 0EB40688
    Fifo6:  StartPtr:       0EB87400        ReadPtr:        0EB874F0
            WritePtrs:      0EB874F0        Fifo_Flag:      89800400
            writeHeaderPtr: 0EB874F0
    Fifo7:  StartPtr:       0E880000        ReadPtr:        0E880E20
            WritePtrs:      0E881520        Fifo_Flag:      8C001900
            writeHeaderPtr: 0E881520
    Fifo8:  StartPtr:       0EB1A600        ReadPtr:        0EB1A770
            WritePtrs:      0EB1A780        Fifo_Flag:      880001F0
            writeHeaderPtr: 0EB1A780
    Fifo9:  StartPtr:       0E2E0CD8        ReadPtr:        0E2E0CD8
            WritePtrs:      0E2E0CD8        Fifo_Flag:      82800008
            writeHeaderPtr: 0E2E0CD8
    Fifo10: StartPtr:       0E81D000        ReadPtr:        0E81D1D8
            WritePtrs:      0E81D1D8        Fifo_Flag:      88800200
            writeHeaderPtr: 0E81D1D8
    Fifo11: StartPtr:       0E4AEF00        ReadPtr:        0E4AEF60
            WritePtrs:      0E4AEF60        Fifo_Flag:      86800080
            writeHeaderPtr: 0E4AEF60
    Fifo12: StartPtr:       0E84A000        ReadPtr:        0E84A300
            WritePtrs:      0E84A000        Fifo_Flag:      89000100
            writeHeaderPtr: 0E84A000
    Fifo13: StartPtr:       0E4AEE00        ReadPtr:        0E4AEE00
            WritePtrs:      0E4AEE00        Fifo_Flag:      86800080
            writeHeaderPtr: 0E4AEE00
    Fifo14: StartPtr:       00000000        ReadPtr:        00000000
            WritePtrs:      00000000        Fifo_Flag:      00800000
            writeHeaderPtr: 00000000
    Fifo15: StartPtr:       0E02CEC0        ReadPtr:        0E02CED0
            WritePtrs:      0E02CED0        Fifo_Flag:      84800020
            writeHeaderPtr: 0E02CED0
    ===========================================================
    Complete Board Id:0x00B2
    ===========================================================

  • Latest flashplayer not work well, even the early version in 11x and has high CPU usage

    why is it that flashplayer 11x always has  a High CPU Usage? detected by NOrton Antivirus

    you can't rely on norton antivirus.
    but if you check your active processes and directly confirm a problem with flash player 11+, uninstall your current flash player (http://helpx.adobe.com/flash-player/kb/uninstall-flash-player-mac-os.html or http://helpx.adobe.com/flash-player/kb/uninstall-flash-player-windows.html) and install an older version:  http://helpx.adobe.com/flash-player/kb/archived-flash-player-versions.html

  • Process SERVER0 its taking High CPU Time in XI

    Hi,
    We installed XI 3.0 develpoment server ,Process <b>SERVER0</b> its taking more CPU time.
    We are using AS/400 OS & DB2 datbase.Can any one tell me the reason & Solution for this.
    Thanks & Regards,
    Gopinath.

    hi,
    Actually the user XIRWBUSER its an RFC user but its running on many dialog process.I think high CPU time due to this user only.
    using 5 work processes and 3/4 of the available CPU for an extended amount of time.
    Total Total DB
    Job or CPU Sync Async CPU
    Task User Number Thread Pty Util I/O I/O Util
    WP11 D6464 485368 00000010 20 54.0 25 37 27.8
    WP05 X4242 498642 00000098 20 49.6 5 0 36.7
    WP04 X4242 498641 00000014 20 48.8 1 0 39.1
    WP02 X4242 498639 0000025A 20 47.1 2 0 37.8
    WP06 X4242 498643 000001E6 20 43.7 0 0 38.3
    WP00 X4242 498637 00000014 20 11.1 502 194 2.9
    pls can any one help me
    Regards,
    Gopinath.

Maybe you are looking for

  • Web Filtering Cisco ASA 5510

    Hello ! I m a netword administrator, and i have been looking how to setup web filtering in a network, we are using cisco asa 5510 as a firewall and i have been looking for a way to block url such as facebook and streaming web sites since users are al

  • IR by EDI810 not matching GR with delivery note

    Hello, We met with the issues of IR not matching to the specified GR after the IR invoice is loaded by EDI 810. For example, one PO item has two GR docs, the 1st one has 2 in qty with delivery note 125-1, and the 2nd one has 3 in qty with delivery no

  • TB sees my html attachment as a text document

    I recently switched email programs from Outlook Express to Mozilla TB. In Outlook I would get a daily email report with an html attachment. I would double click the attachment and it would open in the web browser. Now, however, TB sees the attachment

  • How to get a proper week number and MATCHING year number

    Java classes such as SimpleDateFormat offer convenient means to find out the correct week number of a given date. Week numbering is locale specific and not always intuitive. For example, Dec 31, 2001 is in week 1 of 2002 in locales where a week start

  • How can I download a transcript of my text messages?

    I want to keep a record of a very long string of text messages.  Is there a way to do this, that marks every text message with the time/date stamp?