Load testing and 100% CPU Utilization - Multiple JVMs?

Hi,
Problem:
While stress testing the application with 20 simultaneous users, unix is 100% utilized and there is degradation in response times.
One component of the application is invoking a unix script which is executing a java program after setting CLASSPATH, PATH etc. I guess thus each execution will be invoking a jvm. At the end of the program it will do a System.Exit(). This java program generates around 15-60 barcode images. It takes 2 secs normally.
When, 5 and 10 concurrent users executing this unix script for a steady state time of 30 minutes is also working fine even through response time degrades to 4 secs.
With 20 concurrent users, unix box with 4 CPUs is 100% utilized and response time degrades to 11 secs or so.
We need to do this through unix script only because it is executed from database tier (oracle reports - rdfs) and java stored procs doesn't allow awt operations (image file creation).
I repeated this testing using a java class which just loops for 2 secs. With 20 concurrent users, it was also degrading to 6 secs or so and fluctuating between 100% CPU utilization.
Any pointers on what we should be analyzing more and how should we try to solve this issue.
Thanks,
Ayyappa

Stupid forums made me change the ``screen name.'' Whatever...
Anyway, it is resource intensive to invoke a new JVM per request. You can do several things but it comes down to the fact you will want to keep ONE JVM running in the background awaiting requests to do work. These requests can come from several mechanisms, such as polling a database table, sending requests over a local TCP socket, listening in on a Unix fifo file, etc, etc.
When the shell script is exec'd, connect to your JVM (for example) by opening a socket to it, enter your request for work, and wait for the response, the JVM app will listen and accept socket requests, thread off and process and then return data. Something in this form will be substantially more scalable that what is currently being done.

Similar Messages

OHJ4.1.16 Repainting Problems and 100%CPU on java 1.4

Hi
We are considering using OHJ4.1.16 as our application help, I have it working such that when the help is invoked either from the toolbar or the menu OHJ is displayed, but there are major repainting problems when the OHJ window is closed by clicking on the X button and then the help is invoked again from the toolbar or the menu item.
Please note that the first time it displays and paints fine only when the OHJ frame is closed and invoked again the problem occurs
The problems encountered are repainting(really whacky), 100% CPU utilization
Please have a look at the code below and tell me if i am not doing it right, Also is there anyway i can trap events on the OHJ frame so that i can dispose it everytime the window is closed by the user??
The following code is executed when the help is invoked
     public void startHelp()
     helpObject.showNavigatorWindow();
     helpObject.setVisible(true);
     public static void launchApplication()
          String helpset1 = "/resources/help/Test.hs";
          Vector booksVector = new Vector();
          booksVector.add(helpset1);
               if(m_instance == null)
                    m_instance = new ApplicationHelp(booksVector);
               else
                    m_instance.startHelp();
we are using java 1.4, the above problem makes OHJ unusable!!

Hi, John. We're trying to reproduce your problem. If you run any of the OHJ 4.1.16 demos in the bin directory of the installation, do you run into the 100% CPU utilization problem? If so, how? The cshDemo.bat file creates a dummy application that has an OHJ deployment, so please test that one in particular.
Thanks,
Ryan

Missing Load Test and Coded UI Templates

Missing Load Test and Coded UI Templates even though i have installed Premium Version of Visual studio 2010.
How can we install these?
saikalyan

Hi saikkalyan,
Based on your issue, as far as I know that the Premium Version of Visual studio 2010 is only support the Unit test and coded UI test template.
And I know that the load test template is only supported with the Ultimate version of Visual Studio 2010.
Reference:
https://msdn.microsoft.com/en-us/library/ms182572(v=vs.100).aspx
So if you want to get the load test project template, you will need to install the VS2010 Ultimate.
However, as you said that the coded UI test template missing in the VS2010 Premium, I suggest you could try to
delete your ItemTemplatesCache, ProjectTemplatesCache folder and then run the the devenv /InstallVSTemplates switch and
devenv /Setup switch. Please refer to the following steps:
Step1: Please open Windows Explorer, and navigate to <Visual Studio Installation Path>\Common7\IDE (by default is <C:\Program Files(x86) \Microsoft Visual Studio 10.0\Common7\IDE>)
Step2:
Delete the ItemTemplatesCache, ProjectTemplatesCache folder;
Step3: Open Visual Studio Command Prompt (2010 x64 Cross Tools Command Prompt under Start menu -> All Programs -> Microsoft Visual Studio 2010 -> Visual Studio Tools
(run it with Administrator privilege: right-click the program -> Run as administrator);
Step4: Run the devenv /InstallVSTemplates switch and the devenv /Setup switch
http://msdn.microsoft.com/en-us/library/ms241279.aspx
http://msdn.microsoft.com/en-us/library/ex6a2fad.aspx
If you want to get both the load test and coded UI test template, you will need to install the VS2010 Ultimate as I pervious said.
Best Regards,
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

100% CPU utilization on svchost.exe or Automatic Updates service

We have upgraded from WSUS 2.0 to 3.0 SP1 and now have few Windows XP SP2 PCs that are extremely slow because the CPU is at 100% utilization running a process called "svchost.exe." If I go into services and stop and disable the "Automatic Updates" service the CPU drop to normal almost instantly. I tried forcing a reinstall of the Windows Update Agent. After I enable the "Automatic Updates" service the machine works fine for a day, than after a reboot it goes back to 100% CPU utilization. We need this fixed so we can get these computers updates.

Hi Ryan / Folks,
NO CA Products here - but I have had the same issues with Microsoft updates!
Here's the install path I used during my experience :
Cold install of XP with SP1 on the PC (Full factory system restore/rebuild).
Acer - Semperon 1.8GHz + 1GB RAM - 8Mb ADSL connection to Internet
XP SP2
Windows updates OK - used to install IE7
Reason - I found IE is compromised if you go straight to XP SP3
XP SP3
Next Office 2003 Pro
Switch to Microsoft updates - Custom Updates - SVCHost issue - Still checking for updates after 15 minutes
Switch back to Windows updates - Custom Updates - NO SVCHost Issue - Checking complete after 2 minutes
Tried both Microsoft fixes mentioned above
http://support.microsoft.com/kb/927891
Same report back - i.e. SP3 newer etc.
http://support.microsoft.com/kb/943144 - Method 2
Seems to install ok
Reboot PC
Swich back to manual Microsoft Updates and all is not really rosey as the initial "checking updates" scan can take at least 5 minutes with SVCHost at better than 90% CPU usage. So I believe the issue is not fixed, but it is just about useable.
Interestingly, no issues on my work LAN where I am the systems manager - 20 PCs and 8 servers using WSUS. All units are up to date and no SVCHost issues.
So.... No fix yet here, however my solution is as follows:
On the problematic PC I decided to switch back to Automatic Windows Updates. This keeps the PC up to date with all Operating System patches. Performance is not affected. I have decided that I will manually switch to the Microsoft update system once every couple of weeks or so to catch the updates for Office etc. I'll just have to set the updates scan running over a quiet period I suppose.
Plan B = Manual Office Updates http://office.microsoft.com/en-gb/downloads/default.aspx - Left Pane - Office Updates.
Hope this sheds some light.
Regards,
Knaphie

Running awr report between start of load testing and end of load testing

Hi,
How i can get awr report between 2 intervals(snap before the load testing and snap after the load testing)
supoose load testing will happening for 1 hours and 30 minute and i need to get awr report how i can get this since i know interval between snapshots 60 minutes by default .
is it accomplished by manually inputs appreciated.
Thanks
Prakash

You change the interval to the increment you wish.
http://www.morganslibrary.org/reference/dbms_wrkld_repos.html
DBMS_WORKLOAD_REPOSITORY.MODIFY_SNAPSHOT_SETTINGS.

100% cpu utilization

We have been struggling for few month now trying to figure out this problem. Application runs fine for few days (or even few weeks in some instances), and then load average (uptime) goes to 1 and cpu is becomes 100% utilized. If I leave it running, in few hours load average starts going up. The the entire application locks up when load average is around 15. Some of our applications actually have been running for few month before this happens.
We are running on linux. The problem shows itself much faster on Redhat 9, it�s not as bad on Redhat8. Also, it�s much better under 1.4.2_02 jvm, and pretty bad on 1.4.2_06. It also happens in 1.5.0_01. It looks to be most stable with 1.5.0_01 with ConcurrentGC. We have few dozen servers each running at least 2 JVMs, and tested every combination possible.
Our application is heavily thread, custom built. We have a load test running at 10 times the number of threads and can not replicate this problem within few days, so I believe it has nothing to do with the number of threads and the way we use them.

General technique for Java apps that use 100% CPU is to take a series of thread dumps (send SIGQUIT on UNIX, Ctrl-Break on Windows), once a second for 10 seconds.
When you analyze these dumps, look for threads that are consistently in Runnable state. If you've got some sort of loop running, you'll see the same set of threads Runnable in all the traces, and you'll see the stack trace showing what they're executing.
Also, search the Bug Parade for your symptoms. Link is available from the main java.sun.com page.

Safari hangs, beach ball and 100% CPU confusion

I'm struggling!
Safri 5.1 on Lion 10.7.3 and on both my Mackbook Air and iMac after the recent updates something is stopping Safar from loading. It just hangs, beachball kicks in and the CPU shoots upto around 100% with a "web process".
I've turned off and deleted all extensions, Flash, Flip4Mac, Perian, Ad Block, 1Password etc and restarted and the problem remains on both computers.
I'm stuck. Any help would be appreciated.
Thanks

Please read this whole message before doing anything.
This procedure is a diagnostic test. It won’t solve your problem. Don’t be disappointed when you find that nothing has changed after you complete it.
Third-party system modifications are a common cause of usability problems. By a “system modification,” I mean software that affects the operation of other software -- potentially for the worse. The following procedure will help identify which such modifications you've installed. Don’t be alarmed by the complexity of these instructions -- they’re easy to carry out and won’t change anything on your Mac.
These steps are to be taken while booted in “normal” mode, not in safe mode. If you’re now running in safe mode, reboot as usual before continuing.
Below are several lines of text in monospaced type, which are UNIX shell commands. They’re harmless, but they must be entered exactly as given in order to work. If you have doubts about the safety of running these commands, search this site for other discussions in which they’ve been used without any report of ill effects.
Some of the commands will line-wrap or scroll in your browser, but each one is really just a single line, all of which must be selected. You can accomplish this easily by triple-clicking anywhere in the line. The whole line will highlight, and you can then either copy or drag it. The headings “Step 1” and so on are not part of the commands.
Note: If you have more than one user account, Step 2 must be taken as an administrator. Ordinarily that would be the user created automatically when you booted the system for the first time. The other steps should be taken as the user who has the problem, if different. Most personal Macs have only one user, and in that case this paragraph doesn’t apply.
To begin, launch the Terminal application; e.g., by entering the first few letters of its name in a Spotlight search. A text window will open with a line already in it, ending either in a dollar sign (“$”) or a percent sign (“%”). If you get the percent sign, enter “sh” (without the quotes) and press return. You should then get a new line ending in a dollar sign.
Step 1
Copy or drag -- do not type -- the line below into the Terminal window, then press return:
kextstat -kl | awk '!/com\.apple/{printf "%s %s\n", $6, $7}'
Post the lines of output (if any) that appear below what you just entered (the text, please, not a screenshot.)
Step 2
Repeat with this line:
sudo launchctl list | sed 1d | awk '!/0x|com\.(apple|openssh|vix)|edu\.mit|org\.(x|postfix|ntp|cups)/{print $3}'
This time, you'll be prompted for your login password, which won't be displayed when you type it. You may get a one-time warning not to screw up. You don't need to post the warning.
Step 3
launchctl list | sed 1d | awk '!/0x|com\.apple|edu\.mit|org\.(x|openbsd)/{print $3}'
Step 4
ls -1A /e*/mach* {,/}L*/{Ad,Compon,Ex,Fram,In,Keyb,La,Mail/Bu,P*P,Priv,Qu,Scripti,Servi,Spo,Sta}* L*/Fonts 2> /dev/null
Important: If you synchronize with a MobileMe account, your me.com email address may appear in the output of the above command. If so, anonymize it before posting.
Step 5
osascript -e 'tell application "System Events" to get name of every login item'
Remember, steps 1-5 are all drag-and-drop or copy-and-paste, whichever you prefer -- no typing, except your password. Also remember to post the output.
You can then quit Terminal.

JRun 100% CPU Utilization - Source: Attack

When I came in this morning, I found my server (HP ML370, 2x
Xeon 3.06MHz, 4GB RAM, Windows 2003, CF7, Java 1.4.2_05) extremely
slow. Checking out the Task Manager, I found that JRun was taking
up 100% of my CPU utilization. Yikes!
First I thought it was a JVM problem, so I went about
applying the various tweaks: No improvement.
Rebooted: No improvement.
Went through the CF and JVM logs: Nothing of importance
Finally looked at the 404 error log: Blam! Ton of entries
(where usually it's pretty empty). It appears that since midnight
my website was under some sort of attack from 84.32.147.110 (RIPE
network machine). Refer to the attached code - this is a single URL
request (the /directory names/ are correct, but not that deep on my
server - appears he's adding them one after another in a DOS attach
or something).
What is this? Once I tracked it down to this machine, I
blocked access from our firewall. Yes, even now, hours later, he's
still trying to hammer our site. Once I blocked him JRun went back
down to around 3-15% (leaning more towards the 3%) and everything
went to normal.
I've written an abuse complaint to his ISP in Lithuania (I'm
not holding by breath).
What else can I do to avoid future attacks?
Has anyone heard of anything like this?
Help!!!!

The only difference I can discern is that on the machine that doesn't work, the root drive is E
hmmmm. if you have the drive letter for the root drive that high, it's probably worth checking to see if you're getting a Windows drive letter confusion. for troubleshooting advice on that, see:
Windows confuses iPod with network drive or hard drive and may keep iPod from mounting or songs may seem to disappear

IWS 6.0 100% CPU utilization hanging- very urgent

Hi,
We are using Iplanet Web server 6.0 on windows-2000 SP2.The problem we are facing is after 10 concurrent users have logged in the CPU utilization shoots up to 100% and we have to reboot the systesm
Our billing Application is affected very much due to this.
Can anybody throw some light on this?
Thanks in advance.

Hi,
Are you using any plugin with iWS. Please let me know your config file. Mean while please check tunning parameters of solaris for Performance bench mark.
http://docs.iplanet.com/docs/manuals/enterprise/50/tuning/perf6.htm#17580
Regards,
Dakshin.

100% CPU Utilization on

I have a 1U Server purchased in August, 2003. The motherboard model is MS-9129, motherboard chipset is Intel 845E ( Brookdale-E) + ICH4. Bios is Phoneix Award 6.00 PG, dated 12/10/2002. We are running Windows 2003 Standard Edition, SP1
The system is currently operating at 100% CPU, with the System process consuming all otherwise unused capacity. Within the System process, an ACPI thread is utilizing all the resources. Our analysis, together win Microsoft Tech Support suggests upgrading the bios to a more current version.
Two Questions:
1) Have you experienced this, and do you concurr with the solution, or do you have a better one?
2) What, and where can I get it, is the most current BIOS? Do you have Installation instructions?
Thanks
Phil Rounds
[email protected]
Time is of the essence here.

I've run a virus scan showing no viruses, and Symantec AV is up to date and running.
I can't get a screen shot, as there is no software on the server capable of getting one, and I can't load anything when it is this slow. Besides, all diagnostics I have, or that Microsoft has had me run, show that it is the ACPI subsystem which is causing the problem. I have disabled all software other than the basic operating system, have assured that the OS up to date and still have the same issues.
MSI's LiveUpdate shows the BIOS to be version 1.0, with the most up to date one for this system seems to be 1.3. Does anyone know how
this translates to Phoenix's numbering system? All the system diagnostic tools I have shows my current BIOS to be Phoenix 6.00. Is the MSI 1.3 BIOS really an upgrade?
Thanks

SDK-based Management Pack causes 100% CPU utilization for HealtService.exe

We developed an MP that uses SDK to create SCOM objects and insert a large number of performance counters ~ 2000 every 5 minute interval.
On SCOM side the MP has about 2000 instances of UnitMonitor (only ~20 per class but there are lots of actual objects). In these monitors we use
DataSource based on Microsoft.SystemCenter.TargetEntitySdkPerformanceDataProvider. All worked fine for a year but lately added a bunch of new objects/counters and CPU utilization for the MonitoringHost.exe started to spike
to 100% a few seconds after the Performance Counters were posted via SDK. The spike lasts for up to 3 minutes. No DB or Network spikes observed. We suspect SCOM does not deal efficiently with SDK Performance data - as if a separate SdkPerformanceDataProvider
is started for every UnitMonitor when the counters are posted rather than having cooked-down - one per Target instance.
Can anyone shed some light on this? I suspect only the Microsoft engineers would know.
Our environment is like this:
SCOM 2012 R2 UR4
Windows Server 2012 8 Core, 16 GB Ram
Thanks,
Dave

Hi Dave,
is there a way that you can reduce the number of performance insertions? Regardless of even fixing the performance issue, the impact from a database standpoint may be something to consider in the long term. My point is that fixing one issue, will take us
to the next one, etc etc.
I would reduce the number of insertions, only to the either insertion of the "most critical" or "top #". Also, aren't those counters already captured out of the box?
hth
Jose

Virtual User Minutes, Load Testing, and Billing

I am struggling with figuring out how to handle my QA organization's potential use of the Cloud-Based Load Testing. I have about 30 individuals in my QA organization with MSDN Ultimate licenses. Many of these individuals do not do Load Testing.
Ideally I would like to 'pool' all of their 15,000 Virtual User Minutes together - and have my organization be able to use those minutes for our monthly load testing, as the individuals that would be doing the testing invidually would exceed their own
15,000 Virtual User Minutes; plus - in a large organization, having individuals utilize their own MSDN benefits seems odd.
How does the Windows Azure Organization Account option fit into this?
Our company also has a Enterprise Azure Agreement - but I'm not sure how that works either - in order to determine how I would budget for these costs.
We would only be utilizing the Load Testing option within my team. Please advise on how I determine what route to go and potential budget.

Hi Psandstrom,
I understand that you are looking forward to know about the Azure benefits for MSDN users, every MSDN user /individual can get up to $150/month.
If you exceed your monthly credits, your service will be disabled for that month. You can choose to turn off your Spending Limit, and any usage each month in excess of the monthly credits will be charged at the rates specified in this offer. For more information
See
Monthly Azure credits.
To grab the benefits, I recommend you to let the 30 individuals who own MSDN licenses to activate the Azure benefits.
To activate Azure benefits, log into http://msdn.microsoft.com , select My Account and click
activate azure.
Hope this answers your query.
Regards,
Shirisha Paderu

NUMA node zero at 100% CPU utilization while others are around 50% - why?

Questions:
How can I tell which processes are maxing out one of my eight NUMA nodes' CPU? i.e. what tool would give me that insight? I've poked around procmon.exe and don't think it has this, but am not sure yet.
Any thoughts on what's going wrong overall, given the description below?
Symptoms:
Task Manager shows one NUMA node at 100% CPU (and in processors view, shows all 8 CPUs in that node at 100%), while other nodes range from 0-90% depending on load
SQL Server, which is the only significant CPU user on this box, is running regular jobs 2x slower than it did last week. Last week it was running Windows and SQL 2008 R2 SP1, and this week it has been rebuilt (from scratch - not upgraded) with Windows
and SQL 2012.
Environment:
HP DL980 G7, 64 cores, 1TB RAM, 50TB fast disk for SQL use, 120TB slow disk for file storage
Hyperthreading enabled - last week, it was not (since it's not supported well in Windows 2008 R2 with the Hyper-V role and 64 cores)
Windows Server 2012 Standard, installer we got via Software Assurance (and yes, I have an MS support case, ID 112110854959943, but I often lose days before my case escalates to the right person, so I'm hoping someone knowledgeable sees this first,
as I have some very unhappy users!). Last week was Windows 2008 R2 SP1 Enterprise.
SQL Server 2012 RTM Enterprise Core. Will update to latest CU as soon as I get a maintenance window. Last week was SQL 2008 R2 SP1 Enterprise.
Max d.o.p. on six SQL instances is set to 8, on the seventh it is set to 16. No CPU affinity set by us for SQL or anything else.
Hyper-V role installed. Had this role last week too.
Domain controller. Had this role last week too.
Also running DFS (with replication turned off this week, though it was on last week), not much going on there right now so I don't think it's related to the problem.
Task Manager and Resource Monitor show Memory is fine (100GB free), Disk is fine (<500 MB/s I/O, compared to regularly running at 1-2 GB/s in the past). perfmon won't open for me, possibly due to an unrelated problem (port exhausting with DNS Client,
another MS support case we have ongoing)
Planned next steps:
I have removed the Hyper-V role and am awaiting user permission to reboot for that to complete. Will see if that fixes it.
If it doesn't, I'll reboot again and remove hyperthreading.
And in the meantime, via MS support and this post, I'm trying to understand what is going on, what is wrong. I would love your help!

To follow-up on Ethan's post (he works with me) - this is what it looks like in Task Manager.
Normally, all 64 CPUs would be at/near 100%. But SQL jobs look they are being bottlenecked on NUMA node 0 (despite no affinity being set - everything is default/automatic). Another symptom (other than very slow SQL jobs) is that various management tools
in the host partition are very unresponsive.
The significant changes are:
* WS2012 vs WS2008R2 SP1
* SQL2012 vs. SQL2008R2
* Hyperthreading enabled in BIOS to give 128 logical processors to the hypervisor. 64 logical processors are made available to the host partition (the limit in WS2012)
All SQL instances are running in the host partition. There is no significant network or other activity on this box. No VMs are running. CPU-Z shows 8 sockets, 8 cores/socket, 8 thread/socket in the host partition. So despite hyperthreading/SMT being
turned on, it looks like all 64 real cores are being exposed to the host partition.
See also here, where Microsoft recommends leaving SMT/hyperthreading on in all cases with WS2012:
http://blogs.technet.com/b/matthts/archive/2012/10/14/windows-server-sockets-logical-processors-symmetric-multi-threading.aspx

100% CPU utilization issue by Adobe Form

Hi
I am creating a new Adobe Interactive Form in my web dynpro java application.
When I am trying to run that application on server which is having only 2-3 UI elements in interactive form it's using 100% CPU and adobe form is not getting render.
Some of the adobe forms are already working properly on the server.
Does anybody faced such issue or somebody knows what may cause this issue so please help me out on that.
Thanks
Ravi

Clear CPU Temp folders START->RUN-><Type TEMP> you will get processed Forms that are locally stored in your system Temp folder select all and delete.
and also START->RUN-><Type %TEMP%> and delete the corresponding files in that folder.
Kanagaraja L

Instense hd activity and 100%cpu make my system completely unsable

hi.
it happenned the first time with some app (i don't know which one) using the hard disk quite intensively.
and then i couldn't even move my mouse. well i move it but 10 seconds later the pointer move on the screen. and i coudn't do anything under X. even type something.
i manage to go to a console via CTRL-ALT-F1. but couldn't login because login give me a time-out ! and then i finally rebooted so i could get back my system and use it.
then,later, i decided to run dd if=/dev/urandom of=/somepartition bs=1024 before setting up a crypted partition. and it happened again !
the hard-disk activity and the 100% CPU usage . and i couldn't do again anything except reboot !!
when i run the same dd command on my Arch 32 bits. it does give 100% CPU usage too but i can still use X without problem. even without any slow down.
so the 32bits system is an old Athlon XP 1800+ with an IDE disk.
and the Arch64 is a brand new Athlon 64 X2 4400+ with a SATA drive and a nforce chipset MCP61.
so what is the cause of that ? clearly the cpu is so used that nothing could work. but on the 32bits system too. and it still works. so ?
is the configuration of the kernel of arch64 different from arch32 ?
i am thinking at compiling my own kernel with PREEMT configured or even compiled an rt kernel. but why is this needed whereas on the 32bit arch all is fine ???

may be that's bs=1024 the problem and what that caused the slowdown ?
or may be i mistyped /dev/urandom and used /dev/random ?
i am using now :
schedtool -B -e dd if=/dev/urandom of=/somepartition
and it works nice. no more than 50% CPu usage. and no slowdown...
the schedtool -B is to be sure there will be no freeze and that dd will not take all the cpu power...

Load testing and 100% CPU Utilization - Multiple JVMs?

Similar Messages

Maybe you are looking for