High CPU usage because of Biztalk Server
How do you prevent Biztalk Server from causing the CPU to go high?
Christiane
Hi Christiane,
To prevent
BizTalk Server from causing high CPU, identify the root cause and solve it.
Analyze the performance counters, as
Tomasso suggested start with
PAL tool and analyze its report.
MessageBox viewer should also give you indicators with critical errors.
More often it’s due to tracking. Check the level of tracking enabled. Make
sure the SQL Agent jobs are all working as expected to clean up the BizTalk tables.
Following article shall help you:
Identify Performance Bottlenecks in
your BizTalk Environment – Part I – this details about performance counter.
Identify Performance Bottlenecks in
your BizTalk Environment – Part II – this details analysing adapter and pipeline performances
Identify Performance Bottlenecks
in your BizTalk Environment – Part III – this details about analysing the orchestration for performance
Top 10 ways you can improve BizTalk Server
performance with less effort
BizTalk Server: Performance
Tuning & Optimization
BizTalk: Troubleshooting with Performance Monitor
If this answers your question please mark it accordingly. If this post is helpful, please vote as helpful.
Similar Messages
-
CF 10 sp 12 Enterprise high CPU usage hangs services, 2012 server on 2012 Hyper-V host
The last 2 days - my [removed link] CF site has suffered from high CPU usage (on and off) that stops functionality.
This will last several minutes then suddenly the high usage stops a few minute later the high cpu usage starts again.
I don't have any scheduled processes allowed to run.
Restarting the coldfusion service during a high CPS incident - the cpu usage just picks up where it left off when restarted.
I have assigned 4 CPUs (normal) or 8CPUs (as a test) to the VM and I get the same high CPU then low usage. This is a fresh install several months ago on a new VM.
I'd like some Adobe support on this issue but can't seem to find the contact phone number.
This series of high and low cpu usage first started Monday AM about midnight until 7:00 AM Tuesday was quiet and Wednesday this AM I'm having the same issues.
Ideas?
Update: While waiting for this to post - the high CPU usage started again and this time I stopped and restarted the Jetty service ... and the CPU usage went away...
Update: the high cpu started again and a restart of the jetty service didn't help --- neither did the .net service restart... the cf10 application service did stop the high usage...
Jay Bietz
Message was edited by: Jay Bietz after post accepted.After 2 hang free days -- Friday midnight (above is the gcviewer ) and ~2 hours later had the hang condition again. Current java.config includes
java.args=-server -Xms4096m -Xmx4096m -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=5005 -XX:PermSize=512m -XX:MaxPermSize=512m -XX:+UseParallelGC -Xbatch -Dcoldfusion.home={application.home} -Dcoldfusion.rootDir={application.home} -Dcoldfusion.libPath={application.home}/lib -Dorg.apache.coyote.USE_CUSTOM_STATUS_MSG_IN_HEADER=true -Dcoldfusion.jsafe.defaultalgo=FIPS186Random -Dcom.sun.management.jmxremote.port=8701 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Xmn1024m -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintHeapAtGC -verbose:gc -Xloggc:cfwhispererGClive4.log -Dcoldfusion.classPath={application.home}/lib/updates,{application.home}/lib,{application .home}/lib/axis2,{application.home}/gateway/lib/,{application.home}/wwwroot/WEB-INF/flex/j ars,{application.home}/wwwroot/WEB-INF/cfform/jars,C:\\CFusion10\\cfusion\\verisign\\payfl owpro\\Java\\PFProColdFusion,C:\\CFusion10\\cfusion\\verisign\\payflowpro\\Java\\PFProCold Fusion\\Verisign.jar
GCviewer shows that the full GCcollections suddenly start firing off many times in a short period of time.
Jay
will work on the tomcatlog issues next. -
User in Outlook gets prompted with login details during high CPU usage in HT-CAS server ?
Hi All,
I got the VMware virtual machine running Exchange Server 2010 SP2 (I know I'll upgrade that soon) as follows:
PRODHT-CAS01 (HT-CAS Server NLB node 1)
PRODHT-CAS02 (HT-CAS Server NLB node 2)
PRODMBX01 (Stand alone Mailbox Server 1) no DAG
PRODMBX02 (Stand alone Mailbox Server 2) no DAG
I'm having a problem with the Outlook 2010 in my company where
all in a sudden it is prompting for a password when the user open up their outlook first thing in the morning.
Some of the users are able to resolve the issue by retype the AD login & password but some are not able to ?
WHen testing using Outlook Web Access everything working fine with no issue,
but for some users who cannot get past Outlook prompt, even after resetting the password, the problem still exist.
I also noticed that the PRODHT-CAS01 cpu is running at 100% during the problem ?Hi,
According to your posting, I noticed that the Microsoft Exchange RPC Client Access service process consumes excessive CPU on Client Access servers.
It is a known issue in Exchange 2010 SP2. Please update your Exchange server with the latest patches and service packs to have a try. Additionally, the following KB descripted the similar issue with yours. For your reference:
http://support2.microsoft.com/kb/2854376/en-us
http://support2.microsoft.com/kb/2719894
Regards,
Winnie Liang
TechNet Community Support -
One of the web application is sudendly consumming high cpu usage.
hi
there are two web application running on the the standlone server.one of the web application is sudendly consumming high cpu usage. because of this issue, the entire cpu usages become very high and result in HTTP THROTTLING error. please suggest ways to
resolve this problem.
in the same standlone server, what are the service that must not run or minimum services that are required.
server:-
48 gb ram,
8 core processor
thanks in advancedHi jackhill,
Please check whether you configure Search service in your SharePoint.
And please use Taskmgr on the server to check which process may be cause this issue.
In addition, there is an article about high CPU in SharePoint 2013, please check if it is useful for you:
https://speverything.wordpress.com/2013/03/12/sharepoint-2013-high-cpu-and-memory-utilization-killing-my-server/
Thanks,
Wendy
TechNet Community Support
Please remember to mark the replies as answers if they help, and unmark the answers if they provide no help. If you have feedback for TechNet Support, contact
[email protected] -
SQL Server 2012 - RESOURCE MONITOR / PREEMPTIVE_XE_CALLBACKEXECUTE high CPU usage
Hello,
We are currently in the process of migrating an existing clustered SQL Server 2008 R2 instance over to a clustered SQL Server 2012 instance as we phase out the Windows Server 2008 with SQL Server 2008 R2.
The setup is identical for the SQL Server 2012 instance as it is on the SQL Server 2008 R2 instance. (meaning the RAM and CPU are both the same or better on the SQL Server 2012 instance)
The process in which we are migrating is that we're moving a few databases over to the new SQL Server 2012 instance each night. What we've noticed is that the CPU usage is much higher on the SQL Server 2012 instance than on the previous
SQL Server 2008 R2 instance even though the there is only 1/2 of the databases migrated to the 2012 instance.
Running the following script:
;with cte ([totalCPU]) as (select sum(cpu) from master.dbo.sysprocesses)
select
tblSysprocess.spid
, tblSysprocess.cpu
, CONVERT(BIGINT,(tblSysprocess.cpu * CONVERT(BIGINT,100))) / CONVERT(BIGINT, cte.totalCPU) as [percentileCPU]
, tblSysprocess.physical_io
, tblSysprocess.memusage
, tblSysprocess.cmd
, tblSysProcess.lastwaittype
from master.dbo.sysprocesses tblSysprocess
cross apply cte
order by tblSysprocess.cpu desc
Produces the following results:
In a clustered environment, is this normal and if not, does anyone know what this means or how to reduce the CPU usage?
Thanks.Hello,
The following query may help us identify extended events or audit configurations running on that SQL Server server that are producing that high CPU usage scenario.
SELECT
s.name
AS 'Sessions'
FROM
sys.server_event_sessions
AS s
WHERE
s.name
<> 'system_health'
and s.name
<> 'AlwaysOn_health';
Hope this helps.
Regards,
Alberto Morillo
SQLCoffee.com -
DNS server process, high CPU usage
Hello,
I am having a problem with high CPU usage on DNS process. We have 1921 setup in network of about 100 workstations that use it as DNS server. It also performs split view functionality for couple of domains in order to avoid hairpin NAT. I know that a router is not fit for heavy server duty but such setup was unfortunately necessary.
In peak work hours we oftenly have CPU hitting 100% with DNS server process being the root cause,and on several occasions we had DNS process stuck in such state for prolonged periods of time during which other router functions were affected (t's a default gateway, IPsec concentrator etc.). Sometimes shutting the process and restarting it would solve the problem, but once it required a full reload in order to restore functionality (such was the description that engineer on duty reported to me).
Forwarder queue statistics:
Current size = 0
Maximum size = 86
Drops = 0
IOS upgrade did not help, we are currently running 15.2(2)T.
The question is ... is such behaviour (CPU load) to be expected on LAN with 100 workstations due to slow CPU on router or we have bugged IOS DNS server (requiring a TAC case)?
The previous solution seem to do this functionality quite nicely (even though it was also a router), so I am not inclined to think that we are dealing with someone DoS-ing the DNS (WAN access to DNS is of course forbidden)
P.S.
Since we moved servers off the routers DNS, we do not receive complaints, but we had a couple of unresolved messages a day while mail server was using router for DNS. I am suspecting that an old bug where IOS DNS servers occasionaly sends clients back empty DNS replies (properly formatted message but without A record) could be still around?hi,
i have the same problem on UC540 and 2911 on IOS 15.0.1. CPU high, router crashed. Reboot helps but until CPU usage spikes again. the only fix is to remove "ip dns server" from config and use a different DNS server
111 1111 1111111111
999999999900077777777799999777778888000099990000000000
322222111119999900077776666622222111119999000088880000000000
100 ******** ******************
90 ************* ***** **********************
80 *************************** **********************
70 ******************************************************
60 ******************************************************
50 ******************************************************
40 ******************************************************
30 ******************************************************
20 ******************************************************
10 ******************************************************
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per second (last 60 seconds)
after removed IP dns server
111
99999999990007777777779999977777888
33333333332222211111999990007777666662222211111999
100 ********
90 ************* ***** ***
80 *************************** ***
70 ***********************************
60 ***********************************
50 ***********************************
40 ***********************************
30 ***********************************
20 ***********************************
10 ***********************************
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per second (last 60 seconds) -
Mixer window can cause high CPU usage, crashes
This is probably one of the weirdest bugs I've seen for a while. Here are the steps that I reproduce it for me, maybe someone will want to try this out and see if they get the same.
1) Open an Empty Project template.
2) Create 16 instrument tracks when it gives you the dialog. (even 1 will be enough, but the effect is clearer the more tracks you create)
3) Open the mixer. Either in a window or in the pane.
4) Now create a "multi-timbral" instrument track with the plus button (use the checkbox there).
5) Select the 16th track, and now select one of the arrange tracks of the multi-timbral instrument.
6) Open up Activity Monitor from your Utilities folder in Finder and see how much Logic is taking up CPU. It should be significantly higher than the idle state. On my MBP it'll be around 80%.
This is not a problem in itself, because when reproducing it like this the high CPU usage goes away when you select another track and won't return if you select the multi-timbral instrument again.
However, I have sessions where this will continue happening with a multi-timbral instrument all the time. Not only that, I've had Logic crash when this starts happening. And this whole thing will slow down the UI considerably when it's active.
The workaround that seems to work for me is simply not keeping the mixer window/pane open.This is one of the issue which has already been raised to Microsoft and hopefully a public build will be available soon in next cumulative update pack .
There are variety of reason for this starting for password mismatch or password not given , SFTP adapter unable to connect and so on .
There is good post here in below link for this issue
http://thoughtsofmarcus.blogspot.co.uk/2013/06/leaving-password-blank-in-biztalk-2013.html
Another greate artcicle is by Nino which states these issues .SFTP adapter is protocol sensitive and some configuration by server side, can cause a lot of crazy situations
http://ninocrudele.me/2014/01/29/checkstat-and-sftp-adapter-issues/
Thanks
Abhishek -
SBS 2011 - High CPU usage - Help me Microsoft forums! You're my only hope!
My company supports a client that has a SBS 2011 server. For about the past year, we've been fighting a recurring issue with performance on this server. There are about ten local users and four remote users. The server's CPU idles at
about 60%-80% but is usally running when under *any* load from 80%-100%. If you do anything on the console, it will stay pretty much at 100%. These are not power users by any means. The server is utilized for file/printer sharing, Exchange
2010, and one flat file database application (non-SQL). SharePoint is not utilized.
Needless to say, our client is frustrated. When opening files, using their database application, or doing anything Exchange-related, there is a large amount of lag on the client side. First, here are the server's specs:
Make:Dell PowerEdge T420
OS: SBS 2011 Standard SP1
CPU: 2 - Intel Xeon E5-2407
Memory: 32GB
RAID: RAID 1 - Operating System (C:)/Data Volume (E:) | RAID 5 - Data Volume (D:)
Here is what we have tried to resolve this to finality:
* Doubled resources - Initially the server had a single physical processor and 16GB of memory. While these specs alone should have been fine, and were fine when the server was installed, we had periods of time where the server would just sit all day at
100% usage. We doubled the resources and while this seemed like it would fix the issue, we are still seeing abnormally high processor usage.
* Removed all monitoring tools, antivirus, and backup software - As part of our testing, we removed our monitoring agent (LabTech) and antivirus (GFI Vipre). Mozy is utilized for an off-site backup so that was disabled. No dice.
* Verified updates - We made absolutely sure the server was 100% patched.
* Malware/Virus/Rootkit checks - We have ran scans checking for any potential issues with security.
* Ran MBSA and MBCA to fix any issues with the server's configuration.
There is no single process which is using all of the CPU, or we would simply be able to narrow it down. Our calls to Microsoft support have yielded no answers. The last call ended with Microsoft stating that a SBS server should always be running
at high CPU usage. Meanwhile, we have many other clients with less-beefy servers, with more users, who have no issues like these.
So, I'm turning to you all. I will gladly provide logs, configuration settings, even remote assistance sessions if you all can help shed some light on what might be causing my issues.
Thank you!Some comments/ideas:
How long was the server running after this screenshot? I ask because store.exe is only got a 1GB of RAM which is really low - it should grab most of the RAM within a few hours.
The server was up for about 12 hours. I believe an adjustment was made before to limit the Exchange memory usage.
Strange that SearchIndexer (wsearch service) is so high although that may be a startup condition.
The LT* processes seem to be a 3rd party monitoring tool - no idea why it would ever need that much CPU though (I thought you disabled this?).
We had, but we cannot go forever without monitoring our client's server. It has been pulled off in the past and results on performance are pretty much the same.
The taskmgr process run by amnet_admin has used a lot of total CPU Time. What is it? (can't see the command line).
That's the user I was logged in as when I took the screenshot. Even the task manager seems to eat up the CPU.
The sqlserver process right above it is also busy - may want to look at the command line and figure out which SQL database that is (SBS has 3 - WSUS, Sharepoint, and SBS monitoring)
I believe that's the SharePoint database. They don't currently use their site. Would you recommend a removal and reinstallation? I would not completely remove as I know SBS doesn't like you removing parts of the complete package.
Strange that vds.exe is 10% - that is the interface to the disk management interface IIRC. Perhaps your monitoring service has gone awry here - definitely lose it.
I'll see about pulling it off and I'll see if there are any improvements.
-- Al -
High CPU Usage / Dropped Packets - Switch Blade WS-CBS3120X-S
Hi all,
I have a couple of Switches Blade 3120, working as active-standby model (HSRP) on a new site deployment. There are other 20 sites more or less, working on the same model, without issues. But in this one, we are seeing a high cpu usage. The traffic going through the platform is 600Mbps (on peaks), and in this case we have 40% of CPU usage. Traffic should be close to 3 Gbps. When we tried to send the whole traffic through the platform, active switch began to drop packets on the majority of interfaces.
When we analyze the CPU usage, there is a special process called "HL3U bkgrd proce" always have the most CPU use, but we do not know what concerns. We do not know if it is caused because there are PBRs configured. It should not matter. How I mentioned, there are other sites working fine and have had always the same PBR number.
Could you guys help us?. Any idea what is causing the high usage?. Is there a special debug we could to perform to diagnose the issue?. Also, we have seen a high interrupt CPU usage (9% in this case).
Find attached the whole diagnosis outputs.
Thanks for your assistance guys.
Cheers,
Juan Pablo
bog-sib-INT-rtr-1#show processes cpu sorted 5sec
CPU utilization for five seconds: 30%/9%; one minute: 25%; five minutes: 23%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
157 140004809 107071220 1307 14.24% 10.19% 9.01% 0 HL3U bkgrd proce
119 6860957 1519183 4516 0.79% 0.59% 0.53% 0 hpm counter proc
166 2511492 302802 8294 0.15% 0.15% 0.15% 0 HQM Stack Proces
199 4182906 15255882 274 0.15% 0.21% 0.20% 0 IP Input
357 237531 782101 303 0.15% 0.03% 0.00% 0 IP SNMP
186 101 148 682 0.15% 0.09% 0.02% 1 Virtual Exec
242 63071 2330717 27 0.15% 0.02% 0.00% 0 CEF: IPv4 proces
12 163754 620353 263 0.15% 0.01% 0.00% 0 ARP Input
9 0 2 0 0.00% 0.00% 0.00% 0 License Client N
8 41 1827 22 0.00% 0.00% 0.00% 0 WATCH_AFS
11 50 4 12500 0.00% 0.00% 0.00% 0 Image License br
7 0 2 0 0.00% 0.00% 0.00% 0 Timers
bog-sib-INT-rtr-1#sh ip cef summary
IPv4 CEF is enabled for distributed and running
VRF Default
119 prefixes (119/0 fwd/non-fwd)
Table id 0x0
Database epoch: 2 (119 entries at this epoch)Hi Leolaohoo,
I had not played with this one too !!!!...
1). IOS version (It was recently updated)
bog-sib-INT-rtr-1#sh ver
Cisco IOS Software, CBS31X0 Software (CBS31X0-UNIVERSALK9-M), Version 12.2(58)SE1, RELEASE SOFTWARE (fc1)
Technical Support: http://www.cisco.com/techsupport
Copyright (c) 1986-2011 by Cisco Systems, Inc.
Compiled Thu 05-May-11 04:08 by prod_rel_team
ROM: Bootstrap program is CBS31X0 boot loader
BOOTLDR: CBS31X0 Boot Loader (CBS31X0-HBOOT-M) Version 12.2(0.0.951)SE3, CISCO DEVELOPMENT TEST VERSION
bog-sib-INT-rtr-1 uptime is 2 weeks, 3 days, 17 hours, 14 minutes
System returned to ROM by power-on
System restarted at 00:59:27 UTC Sat Jun 9 2012
System image file is "flash:cbs31x0-universalk9-mz.122-58.SE1.bin"
2). What interface do you want to see?, do you want to see all interfaces? . This switch has 16 interfaces that connect servers, and other going to our client. Below, the state of the two kind of interfaces:
Interface to Client (Bearer)
TenGigabitEthernet1/0/1 is up, line protocol is up (connected)
Hardware is Ten Gigabit Ethernet, address is 001f.275d.d81b (bia 001f.275d.d81b)
Description: BearerNContent_Aggregrate
MTU 1500 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 10/255, rxload 14/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 10Gb/s, link type is auto, media type is 10GBase-LR
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 2w3d, output hang never
Last clearing of "show interface" counters 07:07:56
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 562469000 bits/sec, 83641 packets/sec
5 minute output rate 430500000 bits/sec, 73141 packets/sec
2020563158 packets input, 1739897855828 bytes, 0 no buffer
Received 13257 broadcasts (13257 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 13257 multicast, 0 pause input
0 input packets with dribble condition detected
1745065310 packets output, 1347244137726 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
Interface to Server
GigabitEthernet1/0/8 is up, line protocol is up (connected)
Hardware is Gigabit Ethernet, address is 001f.275d.d808 (bia 001f.275d.d808)
Description: bog-15
MTU 1500 bytes, BW 1000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 15/255, rxload 12/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 1000Mb/s, link type is auto, media type is 1000BaseX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 00:00:17, output hang never
Last clearing of "show interface" counters 07:09:12
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 19418
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 47705000 bits/sec, 7155 packets/sec
5 minute output rate 58897000 bits/sec, 8011 packets/sec
178178750 packets input, 153802177226 bytes, 0 no buffer
Received 4091 broadcasts (0 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 watchdog, 0 multicast, 0 pause input
0 input packets with dribble condition detected
212233312 packets output, 206621942776 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 pause output
0 output buffer failures, 0 output buffers swapped out
Thanks for your help. I am losing my hair with this issue.
Cheers,
Juan P. -
Support Community
We recently configured a stack of four 48 port 3750-x switches . We are noticing high CPU usage. "Hulc LED process" seems pretty high.
This has coincided with VMware servers getting slow and non-responsive at times, perhaps a coincidence, not sure.
Below I provided some outputs that might help to diagnose it
Thanks
John
System image file is "flash:/c3750e-ipbasek9-mz.122-58.SE2/c3750e-ipbasek9-mz.122-58.SE2.bin"
Show inventory output
NAME: "1", DESCR: "WS-C3750X-48"
PID: WS-C3750X-48T-S , VID: V02 ,
NAME: "Switch 1 - Power Supply 0", DESCR: "FRU Power Supply"
PID: C3KX-PWR-350WAC , VID: V02L ,
NAME: "2", DESCR: "WS-C3750X-48"
PID: WS-C3750X-48T-S , VID: V02
NAME: "Switch 2 - Power Supply 0", DESCR: "FRU Power Supply"
PID: C3KX-PWR-350WAC , VID: V02D ,
NAME: "3", DESCR: "WS-C3750X-48"
PID: WS-C3750X-48T-S , VID: V02
NAME: "Switch 3 - Power Supply 0", DESCR: "FRU Power Supply"
PID: C3KX-PWR-350WAC , VID: V02L ,
NAME: "4", DESCR: "WS-C3750X-48"
PID: WS-C3750X-48T-S , VID: V02
NAME: "Switch 4 - Power Supply 0", DESCR: "FRU Power Supply"
PID: C3KX-PWR-350WAC , VID: V02L ,
SWITCH#sh processes cpu sorted
CPU utilization for five seconds: 61%/5%; one minute: 50%; five minutes: 49%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
168 260466386 44948517 5794 14.53% 13.98% 13.70% 0 Hulc LED Process
231 97586088 27253906 3580 4.95% 4.73% 4.64% 0 Spanning Tree
213 63106121 154928892 407 4.15% 3.89% 3.91% 0 IP Input
284 70113217 34537588 2030 3.51% 3.98% 4.17% 0 RARP Input
4 6663412 421278 15817 3.03% 0.43% 0.32% 0 Check heaps
374 9872291 10805181 913 3.03% 0.77% 0.62% 0 IP SNMP
376 11142951 5370604 2074 3.03% 0.73% 0.66% 0 SNMP ENGINE
12 35389011 32152175 1100 2.87% 2.08% 2.20% 0 ARP Input
128 34962407 3622140 9652 2.07% 1.69% 1.63% 0 hpm counter proc
85 49034286 8536062 5744 1.91% 2.44% 2.44% 0 RedEarth Tx Mana
107 25127806 46459053 540 1.27% 1.10% 0.93% 0 HLFM address lea
174 2412 1714 1407 0.95% 0.39% 0.25% 1 SSH Process
220 6423643 12634764 508 0.79% 0.70% 0.56% 0 ADJ resolve proc
181 6913179 2890070 2392 0.63% 0.31% 0.36% 0 HRPC qos request
375 1681949 5000777 336 0.47% 0.08% 0.07% 0 PDU DISPATCHER
84 10180707 12623537 806 0.47% 0.30% 0.37% 0 RedEarth I2C dri
1
666666096996666666666666659666667666666666666666666766676666666656666666
249363098992351145264823289455360612252332233522344115537230141392553343
100 ** ** *
90 ** ** *
80 ** ** *
70 * * ***** * * * * * ** *** * * * **** **
60 **********************************************************************
50 ######################################################################
40 ######################################################################
30 ######################################################################
20 ######################################################################
10 ######################################################################
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7..
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
455555555554444444444555554444455555555555555555555444444444
922222111118888866666000009999911111555554444422222444448888
100
90
80
70
60 *****
50 *************************************************** **
40 **********************************************************
30 **********************************************************
20 **********************************************************
10 **********************************************************
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per second (last 60 seconds)
565756555555555555555555555555555556555555555555565555565556
518841757869248569271526666733778330496833777819929379701861
100
90
80 *
70 *
60 **** ******* **** * * ***** *** * *** **** **** **** *
50 ##########################################################
40 ##########################################################
30 ##########################################################
20 ##########################################################
10 ##########################################################
0....5....1....1....2....2....3....3....4....4....5....5....6
0 5 0 5 0 5 0 5 0 5 0
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%Thanks to all for your replies.
Jeff
I was aware of the many ACLs however we used to have the same ACLs in a previous 3750G stack about 2 weeks ago and we never had this issue. I agree I need to optimize them and do somehing because it is reaching its max before the CPU starts processing them but I am not certain this is what is causing the issue.
Nikolay,
I am trying to understand "interrupts" with the analysis of the outputs I posted. Here is another output deom the link you provided. Please post your thoughts if you can.
This switch also serves as a gateway(L3 role) for many systems. Would it make sense to offload that responsability from this switch and let an actual router do it?
Thanks
Johnny
show controllers cpu-interface
ASIC Rxbiterr Rxunder Fwdctfix Txbuflos Rxbufloc Rxbufdrain
ASIC0 0 0 0 0 0 0
ASIC1 0 0 0 0 0 0
ASIC2 0 0 0 0 0 0
HOL Fix Counts
No Fixes: 0 Added: 0 In Use: 0 Both: 0
CPU Heartbeat Statistics
Tx Success Tx Fail 1st Thr 2nd Thr Unthr RetryCtMax
37139562 0 0 0 0 1
Rx Delay
0 1 2 3 4
37139562 0 0 0 0
AddlDelay AdvanceCnt
0 0
Rx Retries by RetryCount
0 1 2 3 4 5 6
37139562 0 0 0 0 0 0
7 8 9
0 0 0
AddlRetry
0
cpu-queue-frames retrieved dropped invalid hol-block stray
rpc 104077409 0 0 0 0
stp 19189469 0 0 0 0
ipc 11093838 0 0 0 0
routing protocol 141021559 0 0 0 0
L2 protocol 230347 0 0 0 0
remote console 17 0 0 0 0
sw forwarding 257436702 0 0 0 0
host 21146276 0 0 0 0
broadcast 332154608 0 0 0 0
cbt-to-spt 0 0 0 0 0
igmp snooping 2796987 0 0 0 0
icmp 90752156 0 0 0 0
logging 0 0 0 0 0
rpf-fail 0 0 0 0 0
dstats 0 0 0 0 0
cpu heartbeat 37139562 0 0 0 0
cpu-queue static inuse static added
rpc 0 0
stp 0 0
ipc 0 0
routing protocol 0 0
L2 protocol 0 0
remote console 0 0
sw forwarding 0 0
host 0 0
broadcast 0 0
cbt-to-spt 0 0
igmp snooping 0 0
icmp 0 0
logging 0 0
rpf-fail 0 0
dstats 0 0
cpu heartbeat 0 0
Supervisor ASIC receive-queue parameters
queue 0 maxrecevsize 7E0 pakhead 5505A88 paktail 54655A8
queue 1 maxrecevsize 7E0 pakhead 5689164 paktail 5687F54
queue 2 maxrecevsize 7E0 pakhead 5547AA4 paktail 554719C
queue 3 maxrecevsize 7E0 pakhead 5DC233C paktail 5DBA4CC
queue 4 maxrecevsize 7E0 pakhead 56A7198 paktail 56A7AA0
queue 5 maxrecevsize 7E0 pakhead 5D61304 paktail 5D72F80
queue 6 maxrecevsize 7E0 pakhead 5D856D4 paktail 5D989E4
queue 7 maxrecevsize 7E0 pakhead 5BDE29C paktail 5BDC784
queue 8 maxrecevsize 7E0 pakhead 5CC00A8 paktail 5CB3574
queue 9 maxrecevsize 7E0 pakhead 59DD86C paktail 59DD86C
queue A maxrecevsize 7E0 pakhead 59BF43C paktail 59C13D8
queue B maxrecevsize 7E0 pakhead 5DD18A0 paktail 5DCE6F4
queue C maxrecevsize 7E0 pakhead 59E9CBC paktail 5A049B8
queue D maxrecevsize 7E0 pakhead 59D8EA0 paktail 59DD25C
queue E maxrecevsize 0 pakhead 0 paktail 0
queue F maxrecevsize 7E0 pakhead 59A7080 paktail 59A6BFC
Supervisor ASIC exception status
Receive overrun 00000000 Transmit overrun 00000000
FrameSignatureErr 00000000 MicInitialize 00000002
BadFrameErr 00000000 LenExceededErr 00000000
BadJumboSegments 00000000
Supervisor ASIC Mic Registers
MicDirectPollInfo 80000200
MicIndicationsReceived 00000000
MicInterruptsReceived 00000009
MicPcsInfo 0000001F
MicPlbMasterConfiguration 00000000
MicRxFifosAvailable 00000000
MicRxFifosReady 0000BFFF
MicTimeOutPeriod: FrameTOPeriod: 00000EA6 DirectTOPeriod: 00004000
MicTransmFramesCopied 00000003
MicTxFifosAvailable 0000000E
MicConfiguration: Conf flag: 00000110 Interrupt Flag: 00000008
MicReceiveFifoAssignmen Queue 0 - 7: 33333333 Queue 8 - 15:33333333
MicReceiveFramesReady: FrameAvailable: 00000181 frameAvaiMask: 00000000
MicException:
Exception_flag 00000000
Message-1 00000000
Message-2 00000000
Message-3 00000000
MicIntRxFifo:
ReadPtr 000005C0 WritePtr 000005C0
WHeadPtr 000005C0 TxFifoDepth C0000800
MicIntTxFifo:
ReadPtr 00000728 WritePtr 00000728
WHeadPtr 00000728 TxFifoDepth C0000800
MicDecodeInfo:
Fifo0: address: 03FF4000 asic_num: 00000100
Fifo1: address: 03FF4400 asic_num: 00000101
MicTransmitFifoInfo:
Fifo0: StartPtrs: 0E2CE800 ReadPtr: 0E2CEBE8
WritePtrs: 0E2CEBE8 Fifo_Flag: 8A800800
Weights: 001E001E
Fifo1: StartPtrs: 0E02D000 ReadPtr: 0E02D138
WritePtrs: 0E02D138 Fifo_Flag: 89800400
Weights: 000A000A
MicReceiveFifoInfo:
Fifo0: StartPtr: 0E4AF000 ReadPtr: 0E4AF2A8
WritePtrs: 0E4AF308 Fifo_Flag: 8B000FA0
writeHeaderPtr: 0E4AF308
Fifo1: StartPtr: 0E78C000 ReadPtr: 0E78C2E8
WritePtrs: 0E78C2E8 Fifo_Flag: 89800400
writeHeaderPtr: 0E78C2E8
Fifo2: StartPtr: 0E744800 ReadPtr: 0E744A70
WritePtrs: 0E744A70 Fifo_Flag: 89800400
writeHeaderPtr: 0E744A70
Fifo3: StartPtr: 0EBD1000 ReadPtr: 0EBD13B8
WritePtrs: 0EBD13B8 Fifo_Flag: 89800400
writeHeaderPtr: 0EBD13B8
Fifo4: StartPtr: 0E7D3800 ReadPtr: 0E7D3A58
WritePtrs: 0E7D3A58 Fifo_Flag: 89800400
writeHeaderPtr: 0E7D3A58
Fifo5: StartPtr: 0EB40600 ReadPtr: 0EB40688
WritePtrs: 0EB40688 Fifo_Flag: 88800200
writeHeaderPtr: 0EB40688
Fifo6: StartPtr: 0EB87400 ReadPtr: 0EB874F0
WritePtrs: 0EB874F0 Fifo_Flag: 89800400
writeHeaderPtr: 0EB874F0
Fifo7: StartPtr: 0E880000 ReadPtr: 0E880E20
WritePtrs: 0E881520 Fifo_Flag: 8C001900
writeHeaderPtr: 0E881520
Fifo8: StartPtr: 0EB1A600 ReadPtr: 0EB1A770
WritePtrs: 0EB1A780 Fifo_Flag: 880001F0
writeHeaderPtr: 0EB1A780
Fifo9: StartPtr: 0E2E0CD8 ReadPtr: 0E2E0CD8
WritePtrs: 0E2E0CD8 Fifo_Flag: 82800008
writeHeaderPtr: 0E2E0CD8
Fifo10: StartPtr: 0E81D000 ReadPtr: 0E81D1D8
WritePtrs: 0E81D1D8 Fifo_Flag: 88800200
writeHeaderPtr: 0E81D1D8
Fifo11: StartPtr: 0E4AEF00 ReadPtr: 0E4AEF60
WritePtrs: 0E4AEF60 Fifo_Flag: 86800080
writeHeaderPtr: 0E4AEF60
Fifo12: StartPtr: 0E84A000 ReadPtr: 0E84A300
WritePtrs: 0E84A000 Fifo_Flag: 89000100
writeHeaderPtr: 0E84A000
Fifo13: StartPtr: 0E4AEE00 ReadPtr: 0E4AEE00
WritePtrs: 0E4AEE00 Fifo_Flag: 86800080
writeHeaderPtr: 0E4AEE00
Fifo14: StartPtr: 00000000 ReadPtr: 00000000
WritePtrs: 00000000 Fifo_Flag: 00800000
writeHeaderPtr: 00000000
Fifo15: StartPtr: 0E02CEC0 ReadPtr: 0E02CED0
WritePtrs: 0E02CED0 Fifo_Flag: 84800020
writeHeaderPtr: 0E02CED0
===========================================================
Complete Board Id:0x00B2
=========================================================== -
Screen Sharing freezing and high CPU usage
Hello all,
I use screen sharing to remote my mac mini as a media server connected to ma HD TV to play movies, music and surf.
Since I upgrade to mavericks on my macs (Macbook Pro Retina and my Mac Mini) I have some troubles with the screen sharing feature.
No problems with the login step, the connexion is fast, all permissions are OK (I saw there were a bug with some RDP release) but sometimes, when I use fullscreen software as VLC, Firefox, etc (not the native apple full screen feature, I just clic on the + at the top of the window), my sreen sharing freeze and I can't do or move anything on the remoted mac mini. I'm unable to close (or reduce) the screen sharing app too, it's totaly busy (But I can see the movie or the website on the 2 computer, there is no deconnection)... I have to kill the process through the monitoring activity.
During the freezing time, I try to use vnc light from my Iphone and I have no problem, I can move the mouse, reduce le VLC windows... As soon I reduce the VLC windows, the screen sharing works again. I also use the logitech TouchMouse to remote the mouse, everything work fine.
Here are a screen shot of the monitoring activity of the Mac running the screen sharing app, we can see that there is a very high CPU usage when I use VLC in fullscreen on my mac mini. The first is in normal mode. The second is in freeze mode. Screen Sharing is named "Partage d'écran".
Can someone help me to fix that, everything works fine with Mountain Lion.I have a Macbook Pro 13.5" 2.8 GHz 4 core (2 real, 2 hyperthreaded) i7 machine running with 1920X1200 display, 3 virtual screens and VMWare adding a few virtual screens (full sized). I have another Macbook Pro 15" with 2.6 GHz Haswell 8 core (4 real, 4 hyperthreaded). I see the problem using Screen Sharing on the 15 inch (Retina screen) mode simulating 1920 X 1200 pixels using Screen Sharing to the 13.5" Macbook Pro.
When I get the ScreenSharing problem, I have identified it as related to the VMWare screen on the 13.5" Macbook Pro being shown through Screen Sharing on the Retina Screen. Before you conclude it is a VMWare problem, the computations are only on the Screen Sharing client side, not on the server side running VMWare. The mouse gets unusable through Screen Sharing. If I physically move the mouse on the 13.5" Macbook, no problem. If I switch virtual screens, the Screen Sharing goes to normal processing.
I see an appearance of a compute-bound thread on the Screen Sharing client. It takes 100% CPU on one thread, the machine as a whole is 12.5% busy (the performance monitor considers all 8 threads as equal when in fact, they are not).
A few more pieces of information. The VMWare client ends up having a lot of overlapping windows with a lot of changing graphics. My mouse runs into problems especially when it is overlaying a changing plot (Perfmon running in Windows 7, or updating email client). It does turn out that VMWare has a "native" VNC server built-in and I tried to connect to the virtual screen using the Screen Sharing Client on the machine with computing problem and voila!, no problem. I end up having a Screen Sharing Client running native running screen (supposed to be VNC, but I have not verified that) sharing protocol on a virtual screen that is NOT the VMWare virtual screen and a separate session using actual VNC protocol using the VMWare VNC server. It works perfectly fine.
If I may hazard a guess, I think I know what the bug is, or at least, what is the nature of the problem that I have. The rest of you may have a different bug. When I have difficulty, it is because I am on a window that suppresses the dock, both in remote virtual screen and on the local machine showing the screen. Two docks are suppressed, one remote, one local. Throw in overlapping windows with changing graphics in the overlapped windows and toss in a mouse on top of that. I think that the Screen Sharing is trying to refresh overlapping windows with mouse and going through the suppressed dock calculations and never converging on what the picture should be. The mouse ends up being the visible cue that shows the time frame for iterating the windows - flickers with a timeframe of greater than a second. That is far greater than the screen update time. It is totally compute bound with all the overlapping stuff that it is deconflicting. At least, that is what I think is going on.
Meanwhile, the VMWare VNC server appears to send out a single graphics context and causes the Screen Sharing client to converge to a picture. Note, the mouse appearance is very different when attaching to the VMWare VNC Server rather than the ScreenSharing native server. I see two mouse renderings, the virtual machine remote and a mouse rendering from my Screen Sharing client side. They are mostly in sync in position unless I move the mouse very quickly. If I use Screen Sharing client and server instead, I usually see only one mouse, the client side's mouse rendering.
I have a solution for my problem. It is similar to using a different VNC server/client pairing. I will use a VNC server for the systems giving me trouble that is not Screen Sharing Server exercising a probable bug in the Client (though, it could be a problem in the design of Screen Sharing itself). -
High cpu usage when handling multiple rtmfp direct connections?
I'm writing a realtime multiplayer game with adobe AIR and RTMFP. The game uses a server client architecture in which all players are directly connected to a single computer ( host has one output netstream and one input netstream for each player). The problem is that the cpu usage will increase dramatically with the number of connections. 20 players is enough to bring my cpu down to it's knees.
I've made an experiment replacing RTMFP with TCP sockets ( Using AIR ServerSocket for the host ), with this the game handled 20 connections while using only 2% cpu. Unfortunately TCP sockets create a lot of extra lag because of nagle's algorithm so I can't use them as a replacement of RTMFP, but this experiment almost definitely proves that the bottleneck is in the usage of RTMFP NetStreams.
Is such high cpu requirements expeceted? If so, what makes it so cpu intensive? Is there anything I can do to lower the cpu usage?
Some extra data about my game:
I'm not using NetGroups.
The host will send about 15 small messages per second to all clients, all messages target the same method called "msg" and use ByteArray as argument. ( myNetStream.send( "msg", msgByteArrayData ); )
A single game with 20 players is too much for my pc, but 3 game instances with 10 players would still run fine ( although still somewhat high cpu usage )
Thanks in advance for any help you could provide.I just did a couple of net stream connection tests. It appears that the CPU load increase quadratically with the number of connections.
I also attached the summary for all the results in .png format as attaching the pdf format is not supported. -
High cpu usage during JSF lifecycle phase execution
In our performance test we encountered a high cpu usage (100%) and the thread dumps indicated that most of the times the threads are either executing restore view or render response phase of the JSF lifecycle or they are blocked while accessing the jar files which containing the xhtml pages.
One of the thread dump of a runnable thread is
java.lang.Thread.State: RUNNABLE
at java.util.HashMap.get(HashMap.java:317)
at javax.faces.component.ComponentStateHelper.get(ComponentStateHelper.java:174)
at javax.faces.component.ComponentStateHelper.add(ComponentStateHelper.java:216)
at javax.faces.component.UIComponent.setValueExpression(UIComponent.java:436)
at com.sun.faces.facelets.tag.jsf.CompositeComponentTagHandler$CompositeComponentRule$CompositeExpressionMetadata.applyMetadata(CompositeComponentTagHandler.java:631)
at com.sun.faces.facelets.tag.MetadataImpl.applyMetadata(MetadataImpl.java:81)
at javax.faces.view.facelets.MetaTagHandler.setAttributes(MetaTagHandler.java:129)
at javax.faces.view.facelets.DelegatingMetaTagHandler.setAttributes(DelegatingMetaTagHandler.java:102)
at com.sun.faces.facelets.tag.jsf.CompositeComponentTagHandler.setAttributes(CompositeComponentTagHandler.java:246)
at com.sun.faces.facelets.tag.jsf.CompositeComponentTagHandler.applyNextHandler(CompositeComponentTagHandler.java:184)
at com.sun.faces.facelets.tag.jsf.ComponentTagHandlerDelegateImpl.apply(ComponentTagHandlerDelegateImpl.java:184)
at javax.faces.view.facelets.DelegatingMetaTagHandler.apply(DelegatingMetaTagHandler.java:120)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at com.sun.faces.facelets.compiler.NamespaceHandler.apply(NamespaceHandler.java:93)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at com.sun.faces.facelets.compiler.EncodingHandler.apply(EncodingHandler.java:86)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:308)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:367)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:346)
at com.sun.faces.facelets.impl.DefaultFaceletContext.includeFacelet(DefaultFaceletContext.java:199)
at com.sun.faces.facelets.tag.ui.IncludeHandler.apply(IncludeHandler.java:120)
at javax.faces.view.facelets.DelegatingMetaTagHandler.applyNextHandler(DelegatingMetaTagHandler.java:137)
at com.sun.faces.facelets.tag.jsf.ComponentTagHandlerDelegateImpl.apply(ComponentTagHandlerDelegateImpl.java:184)
at javax.faces.view.facelets.DelegatingMetaTagHandler.apply(DelegatingMetaTagHandler.java:120)
at com.sun.faces.facelets.tag.ui.DefineHandler.applyDefinition(DefineHandler.java:107)
at com.sun.faces.facelets.tag.ui.CompositionHandler.apply(CompositionHandler.java:178)
at com.sun.faces.facelets.impl.DefaultFaceletContext$TemplateManager.apply(DefaultFaceletContext.java:395)
at com.sun.faces.facelets.impl.DefaultFaceletContext.includeDefinition(DefaultFaceletContext.java:366)
at com.sun.faces.facelets.tag.ui.InsertHandler.apply(InsertHandler.java:112)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at javax.faces.view.facelets.DelegatingMetaTagHandler.applyNextHandler(DelegatingMetaTagHandler.java:137)
at com.sun.faces.facelets.tag.jsf.ComponentTagHandlerDelegateImpl.apply(ComponentTagHandlerDelegateImpl.java:184)
at javax.faces.view.facelets.DelegatingMetaTagHandler.apply(DelegatingMetaTagHandler.java:120)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at com.sun.faces.facelets.compiler.NamespaceHandler.apply(NamespaceHandler.java:93)
at com.sun.faces.facelets.compiler.EncodingHandler.apply(EncodingHandler.java:86)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:308)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:367)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:346)
at com.sun.faces.facelets.impl.DefaultFaceletContext.includeFacelet(DefaultFaceletContext.java:199)
at com.sun.faces.facelets.tag.ui.CompositionHandler.apply(CompositionHandler.java:155)
at com.sun.faces.facelets.compiler.NamespaceHandler.apply(NamespaceHandler.java:93)
at com.sun.faces.facelets.compiler.EncodingHandler.apply(EncodingHandler.java:86)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:308)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:367)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:346)
at com.sun.faces.facelets.impl.DefaultFaceletContext.includeFacelet(DefaultFaceletContext.java:199)
at com.sun.faces.facelets.tag.ui.IncludeHandler.apply(IncludeHandler.java:120)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at com.sun.faces.facelets.compiler.NamespaceHandler.apply(NamespaceHandler.java:93)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at com.sun.faces.facelets.compiler.EncodingHandler.apply(EncodingHandler.java:86)
at com.sun.faces.facelets.impl.DefaultFacelet.apply(DefaultFacelet.java:152)
at com.sun.faces.application.view.FaceletViewHandlingStrategy.buildView(FaceletViewHandlingStrategy.java:774)
at com.sun.faces.lifecycle.RenderResponsePhase.execute(RenderResponsePhase.java:100)
at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101)
at com.sun.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:139)
at javax.faces.webapp.FacesServlet.service(FacesServlet.java:594)
at org.apache.catalina.core.StandardWrapper.service(StandardWrapper.java:1550)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:343)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:217)while a thread trace for a blocked thread is
java.lang.Thread.State: BLOCKED (on object monitor)
at java.util.zip.ZipFile.getEntry(ZipFile.java:302)
- waiting to lock <0x00000000c0f678f8> (a java.util.jar.JarFile)
at java.util.jar.JarFile.getEntry(JarFile.java:225)
at java.util.jar.JarFile.getJarEntry(JarFile.java:208)
at sun.misc.URLClassPath$JarLoader.getResource(URLClassPath.java:817)
at sun.misc.URLClassPath$JarLoader.findResource(URLClassPath.java:795)
at sun.misc.URLClassPath.findResource(URLClassPath.java:172)
at java.net.URLClassLoader$2.run(URLClassLoader.java:551)
at java.net.URLClassLoader$2.run(URLClassLoader.java:549)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findResource(URLClassLoader.java:548)
at java.lang.ClassLoader.getResource(ClassLoader.java:1138)
at java.lang.ClassLoader.getResource(ClassLoader.java:1133)
at org.glassfish.web.loader.WebappClassLoader.getResource(WebappClassLoader.java:1156)
at org.glassfish.web.loader.WebappClassLoader.getResourceFromJars(WebappClassLoader.java:1111)
at org.apache.catalina.core.StandardContext.getMetaInfResource(StandardContext.java:7586)
at org.apache.catalina.core.StandardContext.getResource(StandardContext.java:6979)
at org.apache.catalina.core.ApplicationContext.getResource(ApplicationContext.java:382)
at org.apache.catalina.core.ApplicationContextFacade.getResource(ApplicationContextFacade.java:260)
at com.sun.faces.context.ExternalContextImpl.getResource(ExternalContextImpl.java:502)
at com.sun.faces.application.resource.WebappResourceHelper.getURL(WebappResourceHelper.java:119)
at com.sun.faces.application.resource.ResourceImpl.getURL(ResourceImpl.java:190)
at com.sun.faces.facelets.tag.jsf.CompositeComponentTagHandler.applyCompositeComponent(CompositeComponentTagHandler.java:366)
at com.sun.faces.facelets.tag.jsf.CompositeComponentTagHandler.applyNextHandler(CompositeComponentTagHandler.java:191)
at com.sun.faces.facelets.tag.jsf.ComponentTagHandlerDelegateImpl.apply(ComponentTagHandlerDelegateImpl.java:184)
at javax.faces.view.facelets.DelegatingMetaTagHandler.apply(DelegatingMetaTagHandler.java:120)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at com.sun.faces.facelets.compiler.NamespaceHandler.apply(NamespaceHandler.java:93)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at com.sun.faces.facelets.compiler.EncodingHandler.apply(EncodingHandler.java:86)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:308)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:367)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:346)
at com.sun.faces.facelets.impl.DefaultFaceletContext.includeFacelet(DefaultFaceletContext.java:199)
at com.sun.faces.facelets.tag.ui.IncludeHandler.apply(IncludeHandler.java:120)
at javax.faces.view.facelets.DelegatingMetaTagHandler.applyNextHandler(DelegatingMetaTagHandler.java:137)
at com.sun.faces.facelets.tag.jsf.ComponentTagHandlerDelegateImpl.apply(ComponentTagHandlerDelegateImpl.java:184)
at javax.faces.view.facelets.DelegatingMetaTagHandler.apply(DelegatingMetaTagHandler.java:120)
at com.sun.faces.facelets.tag.ui.DefineHandler.applyDefinition(DefineHandler.java:107)
at com.sun.faces.facelets.tag.ui.CompositionHandler.apply(CompositionHandler.java:178)
at com.sun.faces.facelets.impl.DefaultFaceletContext$TemplateManager.apply(DefaultFaceletContext.java:395)
at com.sun.faces.facelets.impl.DefaultFaceletContext.includeDefinition(DefaultFaceletContext.java:366)
at com.sun.faces.facelets.tag.ui.InsertHandler.apply(InsertHandler.java:112)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at javax.faces.view.facelets.DelegatingMetaTagHandler.applyNextHandler(DelegatingMetaTagHandler.java:137)
at com.sun.faces.facelets.tag.jsf.ComponentTagHandlerDelegateImpl.apply(ComponentTagHandlerDelegateImpl.java:184)
at javax.faces.view.facelets.DelegatingMetaTagHandler.apply(DelegatingMetaTagHandler.java:120)
at javax.faces.view.facelets.CompositeFaceletHandler.apply(CompositeFaceletHandler.java:98)
at com.sun.faces.facelets.compiler.NamespaceHandler.apply(NamespaceHandler.java:93)
at com.sun.faces.facelets.compiler.EncodingHandler.apply(EncodingHandler.java:86)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:308)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:367)
at com.sun.faces.facelets.impl.DefaultFacelet.include(DefaultFacelet.java:346)
at com.sun.faces.facelets.impl.DefaultFaceletContext.includeFacelet(DefaultFaceletContext.java:199)
at com.sun.faces.facelets.tag.ui.CompositionHandler.apply(CompositionHandler.java:155)
at com.sun.faces.facelets.compiler.NamespaceHandler.apply(NamespaceHandler.java:93)
at com.sun.faces.facelets.compiler.EncodingHandler.apply(EncodingHandler.java:86)
at com.sun.faces.facelets.impl.DefaultFacelet.apply(DefaultFacelet.java:152)
at com.sun.faces.application.view.FaceletViewHandlingStrategy.buildView(FaceletViewHandlingStrategy.java:774)
at com.sun.faces.application.view.StateManagementStrategyImpl.restoreView(StateManagementStrategyImpl.java:223)
at com.sun.faces.application.StateManagerImpl.restoreView(StateManagerImpl.java:188)
at com.sun.faces.application.view.ViewHandlingStrategy.restoreView(ViewHandlingStrategy.java:123)
at com.sun.faces.application.view.FaceletViewHandlingStrategy.restoreView(FaceletViewHandlingStrategy.java:453)
at com.sun.faces.application.view.MultiViewHandler.restoreView(MultiViewHandler.java:148)
at com.sun.faces.lifecycle.RestoreViewPhase.execute(RestoreViewPhase.java:192)
at com.sun.faces.lifecycle.Phase.doPhase(Phase.java:101)
at com.sun.faces.lifecycle.RestoreViewPhase.doPhase(RestoreViewPhase.java:116)
at com.sun.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:118)
at javax.faces.webapp.FacesServlet.service(FacesServlet.java:593)
at org.apache.catalina.core.StandardWrapper.service(StandardWrapper.java:1550)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:343)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:217)We use glassfish 3.1.1 as our application and the project_stage property is set to System_test. I would like to get suggestions on how should I investigate this further. Is this a normal behavior? Does glassfish provide an alternative for resolving blocked threads like some caching mechanism for resources etc?
Thanks in advanceNik wrote:
Even if it is legal, have you tried moving them out of there (just to pinpoint a possible bug since the stacktrace indicates a wait on a jar file)?Indeed. If that clears up the issue it is good information to put in a JSF bug report (which may even cascade to the Glassfish level).
Putting resources in a jar file is only really useful when you want to share those resources among different web applications, which should be a rare case. Even when it happens I would probably still choose to simply copy the resources so they are individually managed and you don't get unnecessary dependencies between applications. Just because something is technically possible doesn't make it a good idea. -
High CPU Usage On client application when upgrade remote SQL database
Hi,
Is anyone here encountered very high CPU usage after upgraded the database from SQL 2005 to SQL 2012? Following describes my issue.
I have my client application running on Windows 7 that access to central database (SQL 2005) on Windows server 2003 using ODBC connection, this client application basically query data and perform data insert and update. There are a number of this similar
clients connected to the database.
Due to slowness of the database server, company decided to upgrade the database server to SQL 2012 and also new hardware runing Windows Server 2012. There is no change on the client application and client hardware and the client application still using the
same ODBC connection to query, insert or update the new database server.
The problem I am now experiencing now is that my client PC where my client application running the CPU usage is very high almost hitting 100% when accessing to the central database. I am also noticed this program lsass.exe that utilized almost 40-50% of
the CPU time when client application accessing the central database.
Is anyone here know, why client PC CPU usage 100% when access to upgraded SQL 2012 database? What is lsass.exe program doing, it only appear when accessing to database server. How to reduce the CPU usage on client?
Thanks.
Chee Wee.Hello,
After upgrading, please rebuild indexes and update statistics on the databases.
http://www.mssqltips.com/sqlservertip/1367/sql-server-script-to-rebuild-all-indexes-for-all-tables-and-all-databases/
http://www.mssqltips.com/sqlservertip/1606/execute-update-statistics-for-all-sql-server-databases/
Configure maxdop on the instance.
http://blogs.msdn.com/b/sqlsakthi/archive/2012/05/24/wow-we-have-maxdop-calculator-for-sql-server-it-makes-my-job-easier.aspx
If the above does not solve the issue, let us know.
Hope this helps.
Regards,
Alberto Morillo
SQLCoffee.com -
High cpu usage for garbage collection (uptime vs total gc time)
Hi Team,
We have a very high cpu usage issue in the production.
When we restart the server, the cpu idle time would be around 95% and it comes down as days goes by. Today idle cpu is 30% and it is just 6th day after the server restart.
Environemnt details:
Jrockit version:
Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_05-b04)
BEA WebLogic JRockit(TM) 1.4.2_05 JVM R24.4.0-1 (build ari-38120-20041118-1131-linux-ia32, Native Threads, GC strategy: parallel)
Gc Algorithm: JRockit Garbage Collection System currently running strategy: Single generational, parallel mark, parallel sweep
Number Of Processors: 4
Max Heap Size: 1073741824
Total Garbage Collection Time: 21:43:56.5
Uptime: 114:33:4.1
Total Garbage Collection Count: 420872
Total Number Of Threads: 198
Number Of Daemon Threads: 191
Can you guys please tell me what would be problem in the server which causing the high cpu usage?
One more thing I would like to know is that why the total number of threads is 198 when we specified the Executor pool size as 25? I agree that weblogic would create some threads for its maintenance but around 160 threads!!! something is wrong I guess.
Santhosh.
[email protected]Hi,
I'm having a similar problem, but haven't been able to resolve it yet. Troubleshooting is made even harder by the fact that this is only happening on our production server, and I've been unable to reproduce it in the lab.
I'll post whatever findings I have and hopefully we'll be able to find a solution with the help of BEA engineers.
In my case, I have a stand-alone Tomcat server that runs fine for about 1-2 days, and then the JVM suddenly starts using more CPU, and as a result, the server load shoots up (normal CPU utilization is ~5% but eventually goes up to ~95%; load goes from 0.1 to 4+).
What I have found so far is that this corresponds to increased GC activity.
Let me list my environment specs before I proceed, though:
CPU: Dual Xeon 3.06GHz
RAM: 2GB
OS: RHEL4.4 (2.6.9-42.0.2.ELsmp)
JVM build 1.5.0_03-b07 (BEA JRockit(R) (build dra-45238-20050523-2008-linux-ia32, R25.2.0-28))
Tomcat version 5.5.12
JAVA_OPTS="-Xms768m -Xmx768m -XXtlasize16k -XXlargeobjectlimit16k -Xverbose:memory,cpuinfo -Xverboselog:/var/log/tomcat5/jvm.log -Xverbosetimestamp"
Here are excerpts from my verbose log (I'm getting some HT warning, not sure if that's a problem):
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Detected SMP with 2 CPUs that support HT.
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Trying to determine if HT is enabled.
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Trying to read from /dev/cpu/0/cpuid
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Warning: Failed to read from /dev/cpu/0/cpuid
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Trying to read from /dev/cpu/1/cpuid
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Warning: Failed to read from /dev/cpu/1/cpuid
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] HT is: supported by the CPU, not enabled by the OS, enabled in JRockit.
[Fri Oct 20 15:54:18 2006][22855][cpuinfo] Warning: HT enabled even though OS does not seem to support it.
[Fri Oct 20 15:54:55 2006][22855][memory ] GC strategy: System optimized over throughput (initial strategy singleparpar)
[Fri Oct 20 15:54:55 2006][22855][memory ] heap size: 786432K, maximal heap size: 786432K
[Fri Oct 20 16:07:30 2006][22855][memory ] Changing GC strategy to generational, parallel mark and parallel sweep
[Fri Oct 20 16:07:30 2006][22855][memory ] 791.642-791.874: GC 786432K->266892K (786432K), 232.000 ms
[Fri Oct 20 16:08:02 2006][22855][memory ] 824.122: nursery GC 291998K->274164K (786432K), 175.873 ms
[Fri Oct 20 16:09:51 2006][22855][memory ] 932.526: nursery GC 299321K->281775K (786432K), 110.879 ms
[Fri Oct 20 16:10:24 2006][22855][memory ] 965.844: nursery GC 308151K->292222K (786432K), 174.609 ms
[Fri Oct 20 16:11:54 2006][22855][memory ] 1056.368: nursery GC 314718K->300068K (786432K), 66.032 ms
[Sat Oct 21 23:21:09 2006][22855][memory ] 113210.427: nursery GC 734274K->676137K (786432K), 188.985 ms
[Sat Oct 21 23:30:41 2006][22855][memory ] 113783.140: nursery GC 766601K->708592K (786432K), 96.007 ms
[Sat Oct 21 23:36:15 2006][22855][memory ] 114116.332-114116.576: GC 756832K->86835K (786432K), 243.333 ms
[Sat Oct 21 23:48:20 2006][22855][memory ] 114841.653: nursery GC 182299K->122396K (786432K), 175.252 ms
[Sat Oct 21 23:48:52 2006][22855][memory ] 114873.851: nursery GC 195060K->130483K (786432K), 142.122 ms
[Sun Oct 22 00:01:31 2006][22855][memory ] 115632.706: nursery GC 224096K->166618K (786432K), 327.264 ms
[Sun Oct 22 00:16:37 2006][22855][memory ] 116539.368: nursery GC 246564K->186328K (786432K), 173.888 ms
[Sun Oct 22 00:26:21 2006][22855][memory ] 117122.577: nursery GC 279056K->221543K (786432K), 170.367 ms
[Sun Oct 22 00:26:21 2006][22855][memory ] 117123.041: nursery GC 290439K->225833K (786432K), 69.170 ms
[Sun Oct 22 00:29:10 2006][22855][memory ] 117291.795: nursery GC 298947K->238083K (786432K), 207.200 ms
[Sun Oct 22 00:39:05 2006][22855][memory ] 117886.478: nursery GC 326956K->263441K (786432K), 87.009 ms
[Sun Oct 22 00:55:22 2006][22855][memory ] 118863.947: nursery GC 357229K->298971K (786432K), 246.643 ms
[Sun Oct 22 01:08:17 2006][22855][memory ] 119638.750: nursery GC 381744K->322332K (786432K), 147.996 ms
[Sun Oct 22 01:11:22 2006][22855][memory ] 119824.249: nursery GC 398678K->336478K (786432K), 93.046 ms
[Sun Oct 22 01:21:35 2006][22855][memory ] 120436.740: nursery GC 409150K->345186K (786432K), 81.304 ms
[Sun Oct 22 01:21:38 2006][22855][memory ] 120439.582: nursery GC 409986K->345832K (786432K), 153.534 ms
[Sun Oct 22 01:21:42 2006][22855][memory ] 120443.544: nursery GC 410632K->346473K (786432K), 121.371 ms
[Sun Oct 22 01:21:44 2006][22855][memory ] 120445.508: nursery GC 411273K->347591K (786432K), 60.688 ms
[Sun Oct 22 01:21:44 2006][22855][memory ] 120445.623: nursery GC 412391K->347785K (786432K), 68.935 ms
[Sun Oct 22 01:21:45 2006][22855][memory ] 120446.576: nursery GC 412585K->348897K (786432K), 152.333 ms
[Sun Oct 22 01:21:45 2006][22855][memory ] 120446.783: nursery GC 413697K->349080K (786432K), 70.456 ms
[Sun Oct 22 01:34:16 2006][22855][memory ] 121197.612: nursery GC 437378K->383392K (786432K), 165.771 ms
[Sun Oct 22 01:37:37 2006][22855][memory ] 121398.496: nursery GC 469709K->409076K (786432K), 78.257 ms
[Sun Oct 22 01:37:37 2006][22855][memory ] 121398.730: nursery GC 502490K->437713K (786432K), 65.747 ms
[Sun Oct 22 01:44:03 2006][22855][memory ] 121785.259: nursery GC 536605K->478156K (786432K), 132.293 ms
[Sun Oct 22 01:44:04 2006][22855][memory ] 121785.603: nursery GC 568408K->503635K (786432K), 71.751 ms
[Sun Oct 22 01:50:39 2006][22855][memory ] 122180.985: nursery GC 591332K->530811K (786432K), 131.831 ms
[Sun Oct 22 02:13:52 2006][22855][memory ] 123573.719: nursery GC 655566K->595257K (786432K), 117.311 ms
[Sun Oct 22 02:36:04 2006][22855][memory ] 124905.507: nursery GC 688896K->632129K (786432K), 346.990 ms
[Sun Oct 22 02:50:24 2006][22855][memory ] 125765.715-125765.904: GC 786032K->143954K (786432K), 189.000 ms
[Sun Oct 22 02:50:26 2006][22855][memory ] 125767.535-125767.761: GC 723232K->70948K (786432K), 225.000 ms
vvvvv
[Sun Oct 22 02:50:27 2006][22855][memory ] 125768.751-125768.817: GC 712032K->71390K (786432K), 64.919 ms
[Sun Oct 22 02:50:28 2006][22855][memory ] 125769.516-125769.698: GC 711632K->61175K (786432K), 182.000 ms
[Sun Oct 22 02:50:29 2006][22855][memory ] 125770.753-125770.880: GC 709632K->81558K (786432K), 126.000 ms
[Sun Oct 22 02:50:30 2006][22855][memory ] 125771.699-125771.878: GC 708432K->61368K (786432K), 179.000 ms
So, I'm running with the default GC strategy which lets the GC pick the most suitable approach (single space or generational). It seems to switch to generational almost immediately and runs well - most GC runs are in the nursery, and only once in a while it goes through the older space.
Now, if you look at [Sun Oct 22 02:50:27 2006], that's when everything changes. GC starts running every second (later on it's running 3 times a second) doing huge sweeps. It never goes through the nursery again, although the strategy is still generational.
It's all downhill from this point on, and it's a matter of hours (maybe a day) before we restart the server.
I guess my only question is: What would cause such GC behavior?
I would appreciate your ideas/comments!
Thanks,
Tenyo
Maybe you are looking for
-
It seems like something has changed with 10.5.6 or so with respect to the ability to use networked drives. I have a PowerMac G5 that I have been using as a server with an second internal (IDE) drive that I have been using for time machine backups fro
-
Does anybody know how to read from a .doc???
This isn't for a project or anything, just simple curiosity.
-
Configuring 2 NICs for Load sharing
I have 2 NICs installed in my desktop system. I need to establish a TCP/IP connection through one NIC With a server. At the same time I need to load balance the packets through both the NICs. The above setup incolves coding in Windows. Also the imple
-
The new update 5.0.1 wont put my songs in alphabetical order
Is anyone else having this problem? is there anyway to fix it?
-
Do I need to cancel the selection key when I close it's socket channel?
I have a non blocking server implementation and I need to know is it mandatory to call SelectionKey#cancel after I have called the SocketChannel#close to it's channel? When I close the channel, will it cancel the key automatically or what if I don't