Prstat output

Dear all,
One of my server shows 99% used by Oracle continuously. I just want to know is there any issue related with lack of memory or Issue from Solaris 10 Operating System. Please see the output of prstat -a.
NPROC USERNAME SIZE RSS MEMORY TIME CPU
206 oracle 157G 154G 99% 0:05:39 0.3%
46 root 219M 92M 0.1% 1:21:56 0.1%
58 application 1020M 689M 0.4% 0:00:15 0.0%
1 noaccess 225M 110M 0.1% 0:35:31 0.0%
1 smmsp 7752K 936K 0.0% 0:00:05 0.0%
Best Regards
Bikash

Hi,
Extremely sorry if I had mentioned something wrong. The truncated output of �prstat �a� is the same what I mentioned above. I just want to know whether there is any issue relater to Operating System or memory if the output seems as below,
NPROC USERNAME SIZE RSS MEMORY TIME CPU
206 oracle 157G 154G 99% 0:05:39 0.3%
46 root 219M 92M 0.1% 1:21:56 0.1%
58 finadm 1020M 689M 0.4% 0:00:15 0.0%
1 noaccess 225M 110M 0.1% 0:35:31 0.0%
1 smmsp 7752K 936K 0.0% 0:00:05 0.0%
Total: 318 processes, 842 lwps, load averages: 0.16, 0.18, 0.21
Bikash

Similar Messages

Prstat output in Solaris 11

Hi all,
Looking at prstat output in Solaris 11, something has clearly changed from Solaris 10 prstat version, since the results are quite different.
Looking at an x86 server with S11+SRU7.5, the Oracle instance is eating(RSS) 57GB memory from a machine that only has 14GB memory in total. Is RSS calculated now with used memory+swap? if so, whats the SWAP column for then?
NPROC USERNAME SWAP RSS MEMORY TIME CPU
82 root 2755M 2003M 3.3% 4:19:21 0.8%
46 oracleoc 61G 57G 96% 0:22:08 0.0%
11 gdm 609M 143M 0.2% 0:02:53 0.0%
5 daemon 36M 13M 0.0% 0:01:31 0.0%
RSS
The resident set size of the process (RSS), in kilobytes
(K), megabytes (M), or gigabytes (G). The RSS value is
an estimate provided by proc(4) that might underestimate
the actual resident set size. Users who want to get more
accurate usage information for capacity planning should
use the -x option to pmap(1) instead.

I hope it's a bug.
Have you seen bug 7117588. It reads in part:
"prstat should account for shared pages when counting RSS and swap for zones, projects, tasks, and users. It does not due so after the fix for 6522129."
I am not sure how to read this statement but I guess it is/was broke.
GlenG

Explanation of prstat output

Dear All,
Pls explain to me in details
1. what you mean by the total virtual memory size of the process ?
2. resident set size of the process?
3. difference between cpu state and run state ?
these all the outputs of prstat command
Since iam new to solaris ,I require your help in detail
Thanks in advance
Regards
Yogesh

Virtual Size, or "Size" - the amount of memory allocated by the process.
Resident, or "RSS" - the amount of resident memory, aka memory that can't be swaped.
The CPU state is simply if the process is sleeping (not doing anything) waiting to get CPU (running) time or currently on the CPU.
.7/M.

Prstat output question

Hi all,
I have 2 problems I don't manage to explain when running prstat on Solaris 8 :
1- prstat does not see fsflush process !!!!
You can even try to force it : prstat -p 3 : it won't work...
2- prstat -a differs from prstat -aL when you look at TIME (and MEMORY) value for each user
Does anybody know the reason why ???
Thanks,
Jerome

Thanks for your answer about processes 0, 2 and 3
I found the answer to my second question : bug 4481976 : prstat without -L reports wrong CPU time for multithreaded processes
resolved by patch 109033-03....
Jerome

Please assist - strange prstat / unable to kill process (-9)

Hi Guys,
I have some questions and I hope someone here will be able to help. Kindly refer to below for my prstat output.
1. I have this ora10g process taking 8.3 CPU (sftp-server2/1). Just now, our dba attempted to perform a sftp from a remote macine to this machine, however, the process has already been terminated. We tried to perform a kill -9 <pid>, however, the process is still there? Any other way to kill it since rebooting the mission critical server is not an option.
2. From prstat -a, we can see the total RSS by ora10g is 362G. It won't be possible right as our server has only 32 GB of memory. Anyone can advise? Is it normal?
prtdiag:
System Configuration: Sun Microsystems sun4u Sun Fire V890
System clock frequency: 150 MHz
Memory size: 32768 Megabytes
prstat -a:
PID USERNAME SIZE RSS STATE PRI NICE TIME CPU PROCESS/NLWP
15443 ora10g 3152K 1608K cpu1 0 0 2:12:45 8.3% sftp-server2/1
20170 nsm 1730M 1445M cpu4 0 0 16:10:22 7.1% oracle/1
20139 nsm 642M 449M sleep 59 0 2:45:36 3.4% oracle/1
27064 ora10g 641M 447M sleep 59 0 0:00:17 0.7% oracle/1
20147 nsm 642M 549M sleep 59 0 1:54:47 0.7% oracle/1
29529 nsm 2135M 1030M sleep 59 0 0:01:12 0.6% oracle/1
20175 nsm 642M 449M sleep 59 0 1:34:41 0.4% oracle/1
20161 nsm 642M 449M sleep 59 0 1:20:21 0.3% oracle/1
20145 nsm 642M 449M sleep 59 0 1:21:10 0.3% oracle/1
20150 nsm 642M 449M sleep 59 0 0:50:01 0.2% oracle/1
10230 oracle9i 2143M 1015M sleep 59 0 3:04:46 0.2% oracle/35
28159 nsm 642M 453M sleep 59 0 0:01:06 0.2% oracle/1
20171 nsm 643M 449M sleep 59 0 0:44:10 0.2% oracle/1
20172 nsm 1730M 981M sleep 59 0 0:46:05 0.2% oracle/1
20144 nsm 450M 349M sleep 59 0 0:52:51 0.2% oracle/1
NPROC USERNAME SIZE RSS MEMORY TIME CPU
56 nsm 26G 18G 3.1% 33:25:26 16%
513 ora10g 503G 362G 65% 22:26:19 9.6%
183 oracle9i 373G 180G 32% 4:24:06 2.0%
87 root 489M 192M 0.0% 2:58:27 0.4%
7 jgxu 20M 13M 0.0% 0:00:22 0.1%
Total: 850 processes, 8444 lwps, load averages: 3.35, 2.83, 4.06
Please advise.
thanks

Hi,
It may b possible coz of some temproray issue or may be dispatcher connection is closed.. first try starting java stack , if it doen't work out try starting dispatcher and the j2ee stack.
Regards
Aashish Sinha

Which Process using high Swap

Dear All,
Any specific command or steps to find which process consuming lot of swap space and there is any specific step to reduce the usage without kill the actual process.
Regards,
Siva

prstat -s size
..gives you a list of processes sorted on their memory consumption. The swap and memory are tightly connected in a virtual-memory structure, which means that i don't think you can tell exactly how much of a process which is swapped out and how much which is in RAM.
The RSS column of the prstat output shows how much which is residential, that part is for sure in the RAM, the rest may or may not be swapped out.
You can not reduce the amount of swap used by a process (i'ld guess that you probably could force it into the RAM, but thats probably not what you want), but if swap size is an issue, you can add space to the swap easily by using swap -a on a file or device.
.7/M.

Xsun (high CPU utilization) on Solaris 10 Sparc

hi
i have sun blade 1500 and am running solaris 10 on it. the machine is a 2 CPU (750Mhz) 4GB Sparc with the lastest cluster patch.
The Xsun process is alway at 50% util and the windowmaker (wmaker) is at 27%.
The Xsun is alway using all available CPU and the machine is really slow.. any help on what patch will fix the Xsun process ? any operation on the machine increases the Xsun's CPU util.
thx
Sriram

Hi sridhar,
can i know which platform you are using....
if it is solaris,
can you paste the details of the prstat -L -p wlpid 1 1 ---> which gives the light wieght pid threads
and also (pstact wlspid) for lwpid to process id mapping
or you can follow these steps for finding which thread is causing the hight cpu utilization
1.find the highest usage lwpid in prstat output
2.find the lwpid in pstack output and get the matching thread number
3.convert the thread number to hexadecimal
4.find the hexadecimal thread number in the server thread dump (nid= xxx)
5.determine what thread was doing to cause the high cpu usage
you can find similar way if it is linux..
ps u -Lp wlspid and thread dump
Thank you,
Bob
Edited by: Bob on Sep 21, 2010 10:18 AM
Edited by: Bob on Sep 21, 2010 10:24 AM

Rcapd to limit zone RSS usage - total confusion!

I'm trying to use rcapd to limit an entire zone to a certain RSS limit.
i do this by setting all processes in the zone to run in within the 'system' project, with the following /etc/project file set to cap RSS at 128MB:
system:0::*::process.max-file-descriptor=(basic,4096,deny);rcap.max-rss=134217728
user.root:1::::process.max-file-descriptor=(basic,4096,deny);rcap.max-rss=134217728
noproject:2::::rcap.max-rss=134217728
default:3::::process.max-file-descriptor=(basic,4096,deny);rcap.max-rss=134217728
group.staff:10::::process.maxand-file-descriptor=(basic,4096,deny);rcap.max-rss=134217728and the follwing /etc/user_attr :
adm::::profiles=Log Management;project=system
lp::::profiles=Printer Management;project=system
root::::auths=solaris.*,solaris.grant;profiles=All;lock_after_retries=no;project
=systemThis appears to properly put everything within the zone running within a single project :
zone11# ps -e -o pid,project,comm
PID PROJECT COMMAND
20772   system /usr/local/apache2/bin/httpd
2121   system /usr/lib/sendmail
2107   system /usr/lib/sendmail
20798   system /usr/local/apache2/bin/httpd
2662   system zsched
26755   system /usr/local/sbin/clamd
533   system /opt/local/pgsql/bin/postmaster
3489   system /sbin/init
27103   system /usr/lib/rcap/rcapd
26840   system /usr/bin/mimedefang
3548   system /lib/svc/bin/svc.startd
1300   system /usr/local/apache2/bin/httpd
1301   system /usr/local/bin/ruby
24109   system /usr/bin/perl
583   system /opt/local/pgsql/bin/postmaster
20773   system /usr/local/apache2/bin/httpd
1292   system /usr/local/apache2/bin/httpd
3639   system /bin/perl
3551   system /lib/svc/bin/svc.configd
4786   system /usr/lib/utmpd
4813   system /usr/lib/saf/ttymon
4791   system /usr/lib/inet/inetd
4790   system /usr/sbin/syslogd
4751   system /usr/sbin/cron
4306   system /usr/sbin/saslauthd
4304   system /usr/sbin/saslauthd
4305   system /usr/sbin/saslauthd
4307   system /usr/sbin/saslauthd
4308   system /usr/sbin/saslauthd
4316   system /usr/lib/crypto/kcfd
2880   system /opt/local/pgsql/bin/postmaster
27361   system /bin/ksh
4815   system /usr/lib/ssh/sshd
1302   system /usr/local/apache2/bin/httpd
1303   system /usr/local/apache2/bin/httpd
24116   system /usr/bin/perl
26824   system /usr/bin/mimedefang-multiplexor
25826   system /opt/local/pgsql/bin/postmaster
582   system /opt/local/pgsql/bin/postmaster
1316   system /usr/local/bin/ruby
17091   system /usr/local/apache2/bin/httpd
4946   system /usr/bin/perl
1305   system /usr/local/apache2/bin/httpd
24117   system /usr/bin/perl
1304   system /usr/local/apache2/bin/httpd
2879   system /usr/local/apache2/bin/httpd
584   system /opt/local/pgsql/bin/postmaster
20763   system /usr/local/apache2/bin/httpd
8913   system /usr/bin/perl
28246   system psSo - unless I've totally misunderstood things, this should cap RSS for the entire zone to 128MB......
But - 'prstat' from the global zone shows:
   PID USERNAME SIZE   RSS STATE PRI NICE      TIME CPU PROCESS/NLWP
27103 daemon    155M 135M sleep    1    0   0:13:33 0.0% rcapd/1
1316 nobody     34M   22M sleep   59    0   0:00:27 0.0% dispatch.fcgi/1
25826 203        16M   13M sleep    1    0   0:00:01 0.0% postgres/1
2880 203        16M   12M sleep   59    0   0:00:01 0.0% postgres/1
   533 203        15M   11M sleep   59    0   0:00:00 0.0% postgres/1
   582 203        15M   11M sleep   59    0   0:00:19 0.0% postgres/1
1301 nobody     33M 6952K sleep   59    0   0:00:27 0.0% dispatch.fcgi/1
3551 root     8768K 4072K sleep   59    0   0:12:36 0.0% svc.configd/22
24109 root       26M 2408K sleep   58    0   0:03:50 0.0% spamd/1
1302 nobody     18M 2336K sleep    1    0   0:00:00 0.0% httpd/1
3639 root       10M 2280K sleep   59    0   0:00:47 0.0% miniserv.pl/1
4316 daemon   4292K 1912K sleep   59    0   0:03:54 0.0% kcfd/4
1303 nobody     18M 1884K sleep    1    0   0:00:00 0.0% httpd/1
4791 root     3280K 1608K sleep   58    0   0:00:36 0.0% inetd/4
24116 root       26M 1600K sleep   57    0   0:00:03 0.0% spamd/1
ZONEID    NPROC SIZE   RSS MEMORY      TIME CPU ZONE
    15       48 755M 262M   4.3%   0:40:57 0.1% zone11
Total: 48 processes, 106 lwps, load averages: 0.26, 0.30, 0.30So the zone is using 262MB of RSS, with the largest abuser being - rcapd .... ??
What am I missing here??
Oh, this is x86 S10u1 :
# uname -a
SunOS srv1 5.10 Generic_Patch_118844-30 i86pc i386 i86pc

If you have the RSS capped at 128MB and an application crosses that threshold, the scanner will begin working on paging until it gets below the set cap. Note that it is perfectly reasonable that this may not be a successful attempt if the app's RSS is genuinely larger than 128MB, in which case you'll be glad you have more on tap.
In the prstat output, swap is the total swap space allocated to the zone, and RSS is the resident set. In other words, the actively consumed memory. So, if I had swap of 462M and RSS of 415M, I have 47M which has been successfully paged.
-Chris

Store Critical: Unable to read index file for user/mailtest: System I/O err

more imap
[27/Nov/2007:13:36:52 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:52 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/&V4NXPnux-: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:52 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/&XfJT0ZAB-: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:52 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/&g0l6Pw-: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:52 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/test: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:52 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:54 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:54 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/&V4NXPnux-: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:54 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/&XfJT0ZAB-: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:54 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/&g0l6Pw-: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:54 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/test: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:36:58 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:37:00 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:37:00 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/&V4NXPnux-: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:37:00 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/&XfJT0ZAB-: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:37:00 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/&g0l6Pw-: System I/O error. Administrator, check server log for details.
[27/Nov/2007:13:37:00 +0800] e69-1-c imapd[5984]: Store Critical: Unable to read index file for user/mailtest/test: System I/O error. Administrator, check server log for details.

whr25 wrote:
root@e69-1-c # ./imsimta version
Sun Java(tm) System Messaging Server 6.3-0.15 (built Feb 9 2007)
libimta.so 6.3-0.15 (built 19:27:56, Feb 9 2007)
SunOS e69-1-c 5.10 Generic_118833-24 sun4u sparc SUNW,Sun-FireThis is an old release of 6.3, you should be planning to upgrade to proactivly prevent known bugs.
prstat
2255 mailsrv 407M 310M sleep 59 0 0:00:44 0.0% imapd/3Not 3GB. Of course if you had just restarted messaging server as you noted below then that isn't unexpected.
I'm restart Messaging Server,I't is not problem
This issue is about two days after the RuningWhen the problem does occur what is the prstat output? The size of the imapd processes will increase over-time depending on the number of people accessing the store via IMAP, and the size of the mailboxes (store.idx files) they are accessing.
Regards,
Shane.

Large number of lwp_suspend calls.

Hi,
i have a sample test program which moves files between directories. The code is pasted below.
The mv is taking more time on one of the servers compared to others.
A truss reveals an unusally high number of lwp_supend sys calls on the problematic server.
What could be the reason for this? How can we trouble shoot this.
public class Test {
      * @param args
     public static void main(String[] args) {
          if (args.length != 2) {
               System.out.println("Usage:: InputDir OutputDir ");
               return;
          String commandEx, commandSym;
          String inDir = args[0];
          File inDirFile = new File(inDir);
          String outDir = args[1];
          while (true) {
               File[] files = inDirFile.listFiles();
               if (files.length != 0) {
                    System.out.println("No of files = " + files.length);
                    Date startTime = Calendar.getInstance().getTime();
                    System.out.println("Time Before moving files is :" + startTime);
                    for (int j = 0; j < files.length; j++) {
                         commandEx = "/bin/mv " + files[j] + " " + outDir;
                         Runtime rt = Runtime.getRuntime();
                         Process result = null;
                         try {
                              result = rt.exec(commandEx);
                              result.waitFor();
                         } catch (Exception e) {
                              System.out
                                        .println("Encountered exception while trying to copy files");
                         if (0 != result.exitValue()) {
                              System.out.println("Failed to copy file");
                    Date endTime = Calendar.getInstance().getTime();
                    System.out.println("Time after moving all the files:"
                              + Calendar.getInstance().getTime());
                    long diff = endTime.getTime() - startTime.getTime();
                    System.out.println("Time to move: " + diff / 1000 + " secs");
               } else {
                    System.out.println("No files in the input directory");
                    return;
               return;
}

Quite frankly, I'm surprised this code isn't causing a noticeable headache on all your machines, if any of them. It's hard to imagine they are all the same kind of system, with comparable loads, but only one is struggling with this task.
How many CPUs on the system? If your load averages, as shown in the prstat output you gave, exceed the number of CPUs, the box in question is probably saturated.
I'd first be curious how many LWPs are attributable to the Java process itself. I'm finding it hard to take my eyes off this section:
                    for (int j = 0; j < files.length; j++) {
                         commandEx = "/bin/mv " + files[j] + " " + outDir;
                         Runtime rt = Runtime.getRuntime();
                         Process result = null;
The code draws one Runtime object for every mv(1). That can scale to fork-bomb status depending on the number of files you're moving. And since each separate process runs in its own subshell, it's going to fight all other concurrent processes for access to the target directory's lock, in order to place and record its file entry safely. The many lwp_suspend calls may be attributable to all but one of those processes being told to wait until the directory lock is freed by the current owner.
It would be good for all systems to economize on the action here. Why this approach would afflict one system but not others that are effectively the same is a puzzler.
I'd suggest looking at prstat -L, but with 16k+ LWPs it's going to output a small phonebook of entries.

Zone's vm+rss usage

I have two limits set, one for swap and one for rss in a Solaris u4 zone.
How do the applications behave in this environment? If I have 128mb capped-memory (rss) set, and I set swap to 256mb. Do the applications start eating swap once the 128mb gets used up? (Is it a full contiguous 384mb of vm?)
I am trying to ascertain, how much total memory a zone is using - should I just look at rss or add rss+swap (from "prstat -s rss -Z output")?
Thanks

If you have the RSS capped at 128MB and an application crosses that threshold, the scanner will begin working on paging until it gets below the set cap. Note that it is perfectly reasonable that this may not be a successful attempt if the app's RSS is genuinely larger than 128MB, in which case you'll be glad you have more on tap.
In the prstat output, swap is the total swap space allocated to the zone, and RSS is the resident set. In other words, the actively consumed memory. So, if I had swap of 462M and RSS of 415M, I have 47M which has been successfully paged.
-Chris

Sockd process uses a lot of CPU time

Hi,
I'm running the Sun Java System Web Proxy Server version 4.02 on a SunFire V210 dual processor box running Solaris 10 with the default socks5.conf for testing.
Just browsing a few web pages in Firefox or IE using the socks proxy boosts CPU usage from the sockd process to a staggering 50% and stay there for several minutes.
Comparing with the old NEC reference Socks5 daemon the Sun version is really performing badly.
The system is pretty standard though I have tuned /etc/system and the tcp stack using recommendations in the proxy administration manual. All Solaris 10 patches are installed.
prstat output:
   PID USERNAME SIZE   RSS STATE PRI NICE      TIME CPU PROCESS/NLWP
24519 proxy    6664K 4384K cpu1     0   10   0:11:18 50% sockd/43Any ideas what's wrong or do I have to stick with the old NEC reference daemon?
Regards
Kasper L�vschall

Using:
truss -dlfo truss.out ./sockd-wdog
Where things begin to happen:
5259/1:          11.2858     lwp_park(0xFFBFF290, 0)                    Err#62 ETIME
5259/1:          12.2958     lwp_park(0xFFBFF290, 0)                    Err#62 ETIME
5259/1:          13.3058     lwp_park(0xFFBFF290, 0)                    Err#62 ETIME
5259/1:          14.3158     lwp_park(0xFFBFF290, 0)                    Err#62 ETIME
5259/2:          15.1858     pollsys(0xFEAEFDC8, 1, 0xFEAEFD58, 0x00000000)     = 0
5259/1:          15.3258     lwp_park(0xFFBFF290, 0)                    Err#62 ETIME
5259/2:          pollsys(0xFEAEFDC8, 1, 0xFEAEFD58, 0x00000000) (sleeping...)
5259/1:          lwp_park(0xFFBFF290, 0)          (sleeping...)
5259/1:          16.3359     lwp_park(0xFFBFF290, 0)                    Err#62 ETIME
5259/1:          lwp_park(0xFFBFF290, 0)          (sleeping...)
5259/1:          17.3459     lwp_park(0xFFBFF290, 0)                    Err#62 ETIME
5259/2:          18.2382     pollsys(0xFEAEFDC8, 1, 0xFEAEFD58, 0x00000000)     = 1
5259/2:          18.2385     accept(3, 0xFEAEFEC8, 0xFEAEFE64, SOV_DEFAULT)     = 5
5259/2:          18.2386     lwp_unpark(43)                         = 0
5259/43:     18.2386     lwp_park(0x00000000, 0)                    = 0
5259/2:          18.2388     accept(3, 0xFEAEFEC8, 0xFEAEFE64, SOV_DEFAULT)     Err#11 EAGAIN
5259/43:     18.2389     getsockname(5, 0xFE5AFEA8, 0xFE5AFDA4, SOV_DEFAULT) = 0
5259/43:     18.2391     getpeername(5, 0xFE5AFE38, 0xFE5AFDA4, SOV_DEFAULT) = 0
5259/43:     18.2391     read(5, 0x00063B7E, 1)                    Err#11 EAGAIN
5259/43:     18.2407     pollsys(0xFE5AFD08, 1, 0xFE5AFCA0, 0x00000000)     = 1
5259/43:     18.2408     read(5, "04", 1)                    = 1
5259/43:     18.2409     read(5, "01\0 P BF9 ] c", 7)               = 7
5259/43:     18.2411     read(5, " k l\0", 255)                    = 3
5259/43:     18.2412     write(4, " [ 0 1 / M a r / 2 0 0 6".., 88)     = 88
5259/43:     18.2413     so_socket(PF_INET, SOCK_STREAM, IPPROTO_IP, "", SOV_DEFAULT) = 6
5259/43:     18.2414     fcntl(6, F_GETFL)                    = 2
5259/43:     18.2415     fcntl(6, F_SETFL, FWRITE|FNONBLOCK)          = 0
5259/43:     18.2416     bind(6, 0xFE5AF980, 16, SOV_SOCKBSD)          = 0
5259/43:     18.2418     connect(6, 0xFE5AF910, 16, SOV_DEFAULT)          Err#150 EINPROGRESS
5259/43:     18.2970     pollsys(0xFE5AF798, 1, 0xFE5AF730, 0x00000000)     = 1
5259/43:     18.2971     getsockopt(6, SOL_SOCKET, SO_ERROR, 0xFE5AF6D0, 0xFE5AF6D4, SOV_DEFAULT) = 0
5259/43:     18.2972     getsockname(6, 0xFE5AF980, 0xFE5AF8A4, SOV_DEFAULT) = 0
5259/43:     18.2973     write(5, "\0 Z918782E1 511", 8)               = 8
5259/43:     18.2974     lwp_unpark(3)                         = 0
5259/3:          18.2974     lwp_park(0x00000000, 0)                    = 0
5259/3:          18.2977     brk(0x00064850)                         = 0
5259/3:          18.2977     brk(0x00078850)                         = 0
5259/3:          18.2981     pollsys(0xFEACF458, 50, 0xFEACF3E8, 0x00000000)     = 0
5259/3:          18.2982     pollsys(0xFEACF458, 50, 0xFEACF3E8, 0x00000000)     = 0
5259/3:          18.2983     pollsys(0xFEACF458, 50, 0xFEACF3E8, 0x00000000)     = 0Then loades of pollsys(0xFEACF458, 50, 0xFEACF3E8, 0x00000000)     = 0 until I kill the daemon - seems like they are killing the server?
Thanks,
Kasper

How to improve Grid control performance

Hi ,
We are facing very slowness in grid control from past one week.
Page took more than 3 minutes to load.
Please provide some workaround to imporove the performance.
Grid version : 10.2.0.5.0
OS : Sun /5.10
Thanks in Advance.

Hi thank for your reply,
Stil we are facing slowness . I found some errors in emoms.trc and emoms.log file.
Below is the prstat output
   PID USERNAME SIZE   RSS STATE PRI NICE      TIME CPU PROCESS/NLWP
14556 oracle   1344M 811M cpu22   59    0 160:03:17 8.9% java/149
5045 oracle   2150M 2036M sleep   60    0   0:30:35 0.8% oracle/11
18388 oracle   2158M 2044M sleep   60    0   6:00:33 0.1% oracle/11
16194 oracle    225M 141M sleep   59    0   5:32:52 0.1% emagent/18
18393 oracle   2159M 2044M sleep   60    0   6:16:49 0.1% oracle/11
   239 oracle     36M 2944K sleep   60    0   0:06:04 0.1% httpd/3
23466 oracle   2664K 1944K cpu20   59    0   0:00:01 0.0% prstat/1
29035 oracle   2157M 2037M sleep   60    0   1:41:37 0.0% oracle/11From emoms.trc file :
2010-12-18 05:54:11,782 [XMLLoader2 40000030302.xml] ERROR emdrep.XMLLoaderContext flushTableStatements.1592 - Error while flushing insert statementjava.sql.
SQLException: ORA-00001: unique constraint (SYSMAN.MGMT_DB_HDM_METRIC_HELPER) violated
2010-12-18 05:54:18,462 [AJPRequestHandler-ApplicationServerThread-7843] ERROR eml.OMSHandshake processFailure.843 - OMSHandshake failed.(AGENT URL = https:/
/usadc-vzdb26:3872/emd/main/)(ERROR = KEY_MISMATCH)From emoms.log file :
2010-12-18 05:45:49,216 [XMLLoader0 30000006013.xml] ERROR emdrep.XMLLoaderContext flushTableStatements.1592 - Error while flushing insert statementjava.sql.
SQLException: ORA-00001: unique constraint (SYSMAN.MGMT_DB_HDM_METRIC_HELPER) violated
2010-12-18 05:45:55,769 [HealthMonitor] ERROR emd.main run.365 - HealthMonitor : Found errant task : TaskRegn:ID105128,Callback:class oracle.sysman.emdrep.jo
bs.JobWorker,Iterative:true,Duration:900,DueTime:1292669155584
2010-12-18 05:46:10,284 [AJPRequestHandler-ApplicationServerThread-7184] ERROR eml.OMSHandshake processFailure.843 - OMSHandshake failed.(AGENT URL = https:/
/usadc-vzdb26:3872/emd/main/)(ERROR = KEY_MISMATCH)Please need your suggestion .
Thanks.

Question of the output of "prstat -a" on solaris 10

Hi, all
Recently, I'm debugging a memory issue on the solaris 10 system. I executed the command like "prstat -U root -n 200 -s rss -a" to list all root user memory consumption and sorted by rss. I'm sure that the total number of root process is less than 100. My target is to find which root process takes the memory most. However I'm concerning the output of the above command. The summary on the bottom of the command showed that the total RSS of root was about 4G, the NPROC was about 150. When I did a "sum" of the RSS of all 150 root processes, the value was 1.5G which was far less than the 4G on the bottom summary.
Does anyone know if my understanding is correct or not? Should they be identical?
Thanks

Because of the way Solaris allocates and reports memory usage it is often (very) hard to account for the different values reported by the various commands. Most often the differences involve shared memory.
Why do you think you have a memory problem?
Do you think the problem is with virtual or physical memory?
Have you looked at:
How to Check and Analyze Solaris Memory Usage [ID 1009500.1]
GlenG

Using dtrace how can we get the functionality of prstat ,vmstat

Hi,
I would like to know what probes can be used to generate a dtrace (.d) script which could produce the output of prstat,vmstat etc.I cannot use these commands at the command prompt directly to know my system's behavior.Can any one here help me out to get this thing realized.I have stiff deadlines to meet .....and i am behind them already...
Thanking for your support in advance.
Karthik

There's probably not an exact equivalent. I'd start with the 'dtrace toolkit' and see if there's something in there that meets your needs.
But it's not designed to replace tools that already work well. Why would you be able to use dtrace and not vmstat?
Darren

Prstat output

Similar Messages

Maybe you are looking for