OS thread startup
I am running Oracle 11g R2 on Windows 2008 R2 . I see "Os thread startup" in my AWR as my top wait .
Browsing thru the internet , I happened to see that 11g has changed the way that the user is connected . ( I am not clear on this ... I did not get it ) ...
Is there are any changes to 11g, how a user is connected via using JDBC?
Browsing thru the internet , I happened to see that 11g has changed the way that the user is connected Could you provide the URL ? Maybe some of us could understand / explain / refute it.
Hemant K Chitale
Similar Messages
-
Oracle Linux 6.3 and Oracle VM 3.0.3 : high "os thread startup" waits
Hi all,
we just installed Oracle Linux 6.3 as a PVM guest with Oracle VM 3.0.3.
The vm is acting as a dbserver.
We see high "os thread startup" wait times from statspack report. A 10-hour report shows:
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time
CPU time 13,819 57.5
db file sequential read 1,839,279 5,791 3 24.1
enq: TX - row lock contention 1 664 ###### 2.8
os thread startup 1,350 451 334 1.9
control file sequential read 166,312 386 2 1.6
This seems to be an OS or virtualization issue: if i run some very simple commands like "ls " or "top", sometimes I see them hangig some seconds .
What should I check for ?
Thanks,
AndreaThis will sound silly, but: Make sure you aren't a victim of the "Some Linux machines have high CPU utilization after Leap Second insertion on July 1st". If your server was "doing NTP", this might have happened. You can google this, if you didn't hear of it. A reboot makes it go away.
-
Os thread startup in Top 5 Timed Events AWR
Hi all,
I have Oracle 10.2.0.5 for HP UX
I'm experiencing some slowness. While checking AWR I see the following:
Top 5 Timed Events
Event Waits Time(s) Avg Wait(ms) % Total Call Time Wait Class
CPU time 732 28.0
os thread startup 983 665 676 25.4 Concurrency
log file switch (checkpoint incomplete) 1,279 617 482 23.6 Configuration
row cache lock 98,641 577 6 22.1 Concurrency
latch: session allocation 1,377 253 184 9.7 Other
What could be the reason for os thread startup?
too many processes due to parallellism?
I have all tables in NOPARALLEL.
And regarding log file switch (checkpoint incomplete), I changed redo size from 100 MB to 200 MB to reduce the frequency of logswitching.
Thanks in advance.GOOGLE is your friend, but only when you actually use it!
http://karlarao.wordpress.com/2009/04/06/os-thread-startup/ -
PerfMon reporting dramatic disk access time increase on Oracle startup
Hi,
My oracle 10g (10.2.0.4) database is hosted on a windows 2003 server.
The datafiles are stored on a RAID1 disk array, on a dedicated partition : currently 30 gigs free out of 180, wich should not be a concern unless i'm wrong, because the datafiles were created as 10 Go files with no autogrowth. I add a new datafile whenever i need more room for my tables (alerts when 80% used).
Since 2 days i experience a dramatic performance loss :
The EM console reports nothing special (no alarms related to storage) apart from the need for more paginated memory.
I issue a reorg when the segmentation advisor suggests it.
My optimizer statistics are calculated by the default scheduled job.
The weird thing I noticed is that as soon as I start the database, there's a huge increase in disk activity even though no query at all is submitted to the database.
PerfMon reports Current Disk Queue Length > 1000 and disk access time > 3000 ms
CPU is 2% activity on the 4-cpus server.
I have plenty of spare memory (currently 3 Go used out of 16).
This is only a dev server for ETL processes, it has very few concurrent connections.
Any suggestions welcome.
AWR report is available here
http://min.us/mqnXQhd5Z
Edited by: user10799939 on 22 mars 2012 09:30Cache Sizes
~~~~~~~~~~~ Begin End
Buffer Cache: 1,296M 1,296M Std Block Size: 8K
Shared Pool Size: 160M 160M Log Buffer: 14,364K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 460,955.72 ; 2,477,358.63
Logical reads: 3,392.16 ; 18,230.80
Block changes: 6,451.93 ; 34,675.22
Physical reads: 2.92 ; 15.67
Physical writes: 394.52 ; 2,120.28
User calls: 1.69 ; 9.08
Parses: 3.31 ; 17.81
Hard parses: 0.17 ; 0.90
Sorts: 1.32 ; 7.09
Logons: 0.06 ; 0.31
Executes: 7.01 ; 37.68
Transactions: 0.19
% Blocks changed per Read: 190.20 ; Recursive Call %: 96.23
Rollback per transaction %: 0.30 ; Rows per Sort: 14.41
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 99.98 ; Redo NoWait %: 99.86
Buffer Hit %: 99.92 ; In-memory Sort %: 100.00
Library Hit %: 96.30 ; Soft Parse %: 94.96
Execute to Parse %: 52.74 ; Latch Hit %: 99.07
Parse CPU to Parse Elapsd %: 0.35 ; % Non-Parse CPU: 99.30
Shared Pool Statistics Begin End
Memory Usage %: 75.48 ; 75.51
% SQL with executions>1: 79.92 ; 85.03
% Memory for SQL w/exec>1: 77.07 ; 70.09
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
db file sequential read 9,052 17,688 1954 51.3 ; User I/O
log file switch (checkpoint in 5,303 4,649 877 13.5 Configurat
log file switch completion 4,245 4,023 948 11.7 Configurat
wait for a undo record 32,393 3,531 109 10.3 ; Other
db file parallel write 18,771 3,437 183 10.0 System I/O Havent seen this much wait on average. For example 877ms for "log file switch" is over threshold. And other wait events too..
Time Model Statistics DB/Inst: MDMPRJ/MDMPRJ Snaps: 2840-2841
-> Total time in database user-calls (DB Time): 34446.5s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 4,008.5 ; 11.6
parse time elapsed 352.9 ; 1.0
hard parse elapsed time 352.7 ; 1.0
PL/SQL compilation elapsed time 120.1 ; .3
DB CPU 61.8 ; .2
failed parse elapsed time 21.3 ; .1
PL/SQL execution elapsed time 8.0 ; .0
connection management call elapsed time 0.0 ; .0
hard parse (sharing criteria) elapsed time 0.0 ; .0
repeated bind elapsed time 0.0 ; .0
hard parse (bind mismatch) elapsed time 0.0 ; .0
DB time 34,446.5 ; N/A
background elapsed time 14,889.7 ; N/A
background cpu time 39.0 ; N/A
Wait Class DB/Inst: MDMPRJ/MDMPRJ Snaps: 2840-2841
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc
Avg
%Time Total Wait wait Waits
Wait Class Waits -outs Time (s) (ms) /txn
User I/O 10,515 .1 17,785 1691 15.8
Configuration 10,186 79.5 ; 8,865 870 15.3
System I/O 27,619 .0 8,774 318 41.6
Other 57,768 98.3 ; 6,915 120 87.0
Commit 2,634 88.6 ; 2,481 942 4.0
Concurrency 2,847 75.4 ; 2,240 787 4.3
Application 219 2.3 ; 23 105 0.3
Network 4,790 .0 0 0 7.2
------------------------------------------------------------- again seen, there is very high wait on User IO
Wait Events DB/Inst: MDMPRJ/MDMPRJ Snaps: 2840-2841
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file sequential read 9,052 .0 17,688 1954 13.6
log file switch (checkpoint 5,303 78.0 ; 4,649 877 8.0
log file switch completion 4,245 89.2 ; 4,023 948 6.4
wait for a undo record 32,393 99.8 ; 3,531 109 48.8
db file parallel write 18,771 .0 3,437 183 28.3
wait for stopper event to be 24,203 99.8 ; 2,634 109 36.5
log file sync 2,634 88.6 ; 2,481 942 4.0
control file sequential read 7,356 .0 2,431 330 11.1
buffer busy waits 2,513 83.1 ; 2,173 865 3.8
log file parallel write 520 .0 1,566 3012 0.8
control file parallel write 840 .0 1,334 1588 1.3
rdbms ipc reply 172 91.3 ; 330 1916 0.3
enq: CF - contention 309 23.0 ; 268 867 0.5
log buffer space 638 28.5 ; 192 301 1.0
enq: PS - contention 52 23.1 ; 71 1362 0.1
db file scattered read 113 .0 67 590 0.2
os thread startup 76 77.6 ; 63 834 0.1
reliable message 57 78.9 ; 50 878 0.1
enq: RO - fast object reuse 22 22.7 ; 23 1038 0.0
latch free 537 .0 16 30 0.8
Streams AQ: qmn coordinator 3 100.0 ; 15 5005 0.0 Overstepping
Background Wait Events DB/Inst: MDMPRJ/MDMPRJ Snaps: 2840-2841
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file parallel write 18,772 .0 3,437 183 28.3
events in waitclass Other 24,367 99.5 ; 3,010 124 36.7
control file sequential read 6,654 .0 2,333 351 10.0
log file parallel write 520 .0 1,566 3012 0.8
control file parallel write 840 .0 1,334 1588 1.3
buffer busy waits 899 94.2 ; 884 984 1.4
log file switch (checkpoint 206 82.0 ; 185 898 0.3
os thread startup 76 77.6 ; 63 834 0.1
log file switch completion 46 93.5 ; 45 982 0.1
log buffer space 158 31.0 ; 12 77 0.2
db file sequential read 62 .0 7 111 0.1
db file scattered read 20 .0 6 318 0.0
direct path read 660 .0 5 7 1.0
log file sequential read 66 .0 4 65 0.1
log file single write 66 .0 1 16 0.1
enq: RO - fast object reuse 2 .0 0 38 0.0
latch: cache buffers chains 3 .0 0 6 0.0
direct path write 660 .0 -5 -8 1.0
rdbms ipc message 9,052 87.5 ; 21,399 2364 13.6
pmon timer 1,318 90.4 ; 3,562 2703 2.0
Streams AQ: qmn coordinator 633 97.6 ; 3,546 5602 1.0
Streams AQ: waiting for time 77 61.0 ; 3,449 44795 0.1
PX Deq: Join ACK 21 .0 0 0 0.0 Again overshooting
Tablespace IO Stats DB/Inst: MDMPRJ/MDMPRJ Snaps: 2840-2841
-> ordered by IOs (Reads + Writes) desc
Tablespace
Av Av Av Av Buffer Av Buf
Reads Reads/s Rd(ms) Blks/Rd Writes Writes/s Waits Wt(ms)
UNDOTBS1
914 0 ###### 1.0 ; 1,368,515 383 2,534 863.2
MDMREF_INDICES
6,918 2 ###### 1.0 ; 11,086 3 0 0.0
SYSAUX
626 0 ###### 1.1 ; 1,804 1 0 0.0
SYSTEM
850 0 ###### 1.7 ; 296 0 0 0.0
MDMREF_DATA
293 0 712.3 ; 1.0 ; 274 0 0 0.0
MDMPRJ_ODS
198 0 72.1 ; 1.0 ; 198 0 0 0.0
FEU_VERT
33 0 61.5 ; 1.0 ; 33 0 0 0.0
USERS
33 0 31.5 ; 1.0 ; 33 0 0 0.0
------------------------------------------------------------- Now have a serious look at it. Av Rd(ms). Now for some tablespace value cannot event fit in window thats why its showing ##
According to oracle recommendation Av Rd(ms) shouldn't be greater then 20, if its goes over 20 then its considered to be an issue with IO subsystem. But as its seen that in your case its overshooting.
Now the question from my side
Have done any configuration changes?
I would suggest you to revert these changes asap and contact storage admin guys...
Hope this helps -
Failure: Error creating DaemonSession thread
Hi All,
I am getting failure: Error creating DaemonSession thread errior when I start the web-server instance as follows
bash-3.00$ ./start
Sun ONE Web Server 6.1SP2 B04/07/2004 17:28
info: CORE5076: Using [Java HotSpot(TM) Server VM, Version 1.4.1.05] from [Hewle
tt-Packard Company]
info: WEB0100: Loading web module in virtual server [https-myWebServer] at [/sea
rch]
info: HTTP3072: [LS ls1] http://hpux-lab:8000 ready to accept requests
failure: Error creating DaemonSession thread
startup: server started successfully
bash-3.00$
Please reply with a solutionThis was related to kernel level settings
The attribute max_thread_proc was set to 64 which was not enough. So increase that to 2048 and the Web-Server Instance wil start. -
ORA 04030 Out of process memory error
Dear experts,
I know there are multiple discussions around this error and I have been reading through most of them in the past one week or so, but looks like we are running out of options or are missing the color altogether. Ok, we are getting ORA-04030 - out of process memory while allocating....while one of our batch process runs in the night. It simply tries to insert/update to a table. Our installation is 11.2.0.1.0 with no RAC configuration and on 64-bit AIX having 6 cores, 12 CPUs and 16 GB memory.
We have checked the Workarea_Size_Policy is set to be as Auto so Oracle decides how much memory to allocate to PGA automatically on run-time based on the demand. And based on the AWR report it doesnt look like we are anywhere near the country having a PGA-deficit!! I am attaching the AWR report in a word document here for your reference.
Also attached below are the configurations and the ulimit values.
IKBTRN1> show parameter workarea;
NAME TYPE VALUE
workarea_size_policy string AUTO
oraipeikbtrn1:/home/oracle-> ulimit -a
time(seconds) unlimited
file(blocks) unlimited
data(kbytes) unlimited
stack(kbytes) 4194304
memory(kbytes) unlimited
coredump(blocks) unlimited
nofiles(descriptors) unlimited
threads(per process) unlimited
processes(per user) unlimited
Now, nothing seems to have contributed to the out of process memory issue from Oracle standpoint. I would be happy to be proved wrong here, if I am wrong.
So, whats going wrong here? A possible memory leak which we cannot zero down to, a OS memory limit or something else?
Seeking expert's advise on this, and also sincerely appreciate your time in looking at this.
Thanks.
P.S - I am pasting the whole AWR report since there is no 'upload file' option here that I can see.
WORKLOAD REPOSITORY report for
DB Name DB Id Instance Inst num Startup Time Release RAC
IKBTRN1 54659199 IKBTRN1 1 06-Jun-11 02:06 11.2.0.1.0 NO
Host Name Platform CPUs Cores Sockets Memory (GB)
oraipeikbtrn1.******.com AIX-Based Systems (64-bit) 12 6 16.00
Snap Id Snap Time Sessions Cursors/Session
Begin Snap: 5952 26-Aug-11 03:00:48 34 2.0
End Snap: 5953 26-Aug-11 04:00:52 32 1.9
Elapsed: 60.07 (mins)
DB Time: 1.93 (mins)
Report Summary
Cache Sizes
Begin End
Buffer Cache: 1,056M 704M Std Block Size: 8K
Shared Pool Size: 3,456M 3,456M Log Buffer: 7,184K
Load Profile
Load Profile
Per Second Per Transaction Per Exec Per Call
DB Time(s): 0.0 2.0 0.02 0.02
DB CPU(s): 0.0 0.5 0.00 0.00
Redo size: 556.1 34,554.8
Logical reads: 151.4 9,407.6
Block changes: 1.9 119.8
Physical reads: 14.2 882.6
Physical writes: 9.5 590.4
User calls: 1.8 112.8
Parses: 1.5 93.7
Hard parses: 0.1 8.9
W/A MB processed: -0.1 -6.9
Logons: 0.0 1.6
Executes: 1.9 115.4
Rollbacks: 0.0 0.0
Transactions: 0.0
Instance Efficiency Percentages (Target 100%)
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 96.63 In-memory Sort %: 99.97
Library Hit %: 95.68 Soft Parse %: 90.49
Execute to Parse %: 18.74 Latch Hit %: 100.00
Parse CPU to Parse Elapsd %: 57.23 % Non-Parse CPU: 86.28
Shared Pool Statistics
Begin End
Memory Usage %: 85.72 85.76
% SQL with executions>1: 93.91 96.66
% Memory for SQL w/exec>1: 89.07 87.04
Top 5 Timed Foreground Events
Event Waits Time(s) Avg wait (ms) % DB time Wait Class
DB CPU 29 24.66
db file scattered read 3,456 17 5 14.92 User I/O
db file sequential read 4,304 17 4 14.77 User I/O
direct path read temp 764 17 22 14.31 User I/O
direct path write temp 259 5 21 4.70 User I/O
Host CPU (CPUs: 12 Cores: 6 Sockets: )
Load Average Begin Load Average End %User %System %WIO %Idle
1.39 1.37 0.2 0.2 0.2 99.6
Instance CPU
%Total CPU %Busy CPU %DB time waiting for CPU (Resource Manager)
0.1 20.5 0.0
Memory Statistics
Begin End
Host Mem (MB): 16,384.0 16,384.0
SGA use (MB): 4,704.0 4,352.0
PGA use (MB): 196.1 188.4
% Host Mem used for SGA+PGA: 29.91 27.71
Main Report
• Report Summary
• Wait Events Statistics
• SQL Statistics
• Instance Activity Statistics
• IO Stats
• Buffer Pool Statistics
• Advisory Statistics
• Wait Statistics
• Undo Statistics
• Latch Statistics
• Segment Statistics
• Dictionary Cache Statistics
• Library Cache Statistics
• Memory Statistics
• Streams Statistics
• Resource Limit Statistics
• Shared Server Statistics
• init.ora Parameters
Back to Top
Wait Events Statistics
• Time Model Statistics
• Operating System Statistics
• Operating System Statistics - Detail
• Foreground Wait Class
• Foreground Wait Events
• Background Wait Events
• Wait Event Histogram
• Wait Event Histogram Detail (64 msec to 2 sec)
• Wait Event Histogram Detail (4 sec to 2 min)
• Wait Event Histogram Detail (4 min to 1 hr)
• Service Statistics
• Service Wait Class Stats
Back to Top
Time Model Statistics
• Total time in database user-calls (DB Time): 115.9s
• Statistics including the word "background" measure background process time, and so do not contribute to the DB time statistic
• Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 101.69 87.75
DB CPU 28.58 24.66
parse time elapsed 10.14 8.75
hard parse elapsed time 9.92 8.56
failed parse elapsed time 4.92 4.25
hard parse (sharing criteria) elapsed time 4.27 3.68
connection management call elapsed time 0.42 0.36
PL/SQL compilation elapsed time 0.34 0.30
PL/SQL execution elapsed time 0.18 0.15
sequence load elapsed time 0.00 0.00
repeated bind elapsed time 0.00 0.00
DB time 115.88
background elapsed time 86.01
background cpu time 5.06
Back to Wait Events Statistics
Back to Top
Operating System Statistics
• *TIME statistic values are diffed. All others display actual values. End Value is displayed if different
• ordered by statistic type (CPU Use, Virtual Memory, Hardware Config), Name
Statistic Value End Value
NUM_LCPUS 0
NUM_VCPUS 0
AVG_BUSY_TIME 1,260
AVG_IDLE_TIME 360,705
AVG_IOWAIT_TIME 534
AVG_SYS_TIME 483
AVG_USER_TIME 679
BUSY_TIME 16,405
IDLE_TIME 4,329,811
IOWAIT_TIME 7,284
SYS_TIME 7,092
USER_TIME 9,313
LOAD 1 1
OS_CPU_WAIT_TIME 503,900
PHYSICAL_MEMORY_BYTES 17,179,869,184
NUM_CPUS 12
NUM_CPU_CORES 6
GLOBAL_RECEIVE_SIZE_MAX 1,310,720
GLOBAL_SEND_SIZE_MAX 1,310,720
TCP_RECEIVE_SIZE_DEFAULT 16,384
TCP_RECEIVE_SIZE_MAX 9,223,372,036,854,775,807
TCP_RECEIVE_SIZE_MIN 4,096
TCP_SEND_SIZE_DEFAULT 16,384
TCP_SEND_SIZE_MAX 9,223,372,036,854,775,807
TCP_SEND_SIZE_MIN 4,096
Back to Wait Events Statistics
Back to Top
Operating System Statistics - Detail
Snap Time Load %busy %user %sys %idle %iowait
26-Aug 03:00:48 1.39
26-Aug 04:00:52 1.37 0.38 0.21 0.16 99.62 0.17
Back to Wait Events Statistics
Back to Top
Foreground Wait Class
• s - second, ms - millisecond - 1000th of a second
• ordered by wait time desc, waits desc
• %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
• Captured Time accounts for 78.2% of Total DB time 115.88 (s)
• Total FG Wait Time: 62.08 (s) DB CPU time: 28.58 (s)
Wait Class Waits %Time -outs Total Wait Time (s) Avg wait (ms) %DB time
User I/O 8,949 0 56 6 48.74
DB CPU 29 24.66
System I/O 1,916 0 3 1 2.18
Other 506 88 1 2 0.92
Configuration 2 50 1 500 0.86
Commit 37 0 1 18 0.56
Application 20 0 0 17 0.29
Network 4,792 0 0 0 0.01
Concurrency 1 0 0 0 0.00
Back to Wait Events Statistics
Back to Top
Foreground Wait Events
• s - second, ms - millisecond - 1000th of a second
• Only events with Total Wait Time (s) >= .001 are shown
• ordered by wait time desc, waits desc (idle events last)
• %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn % DB time
db file scattered read 3,456 0 17 5 59.59 14.92
db file sequential read 4,304 0 17 4 74.21 14.77
direct path read temp 764 0 17 22 13.17 14.31
direct path write temp 259 0 5 21 4.47 4.70
control file sequential read 1,916 0 3 1 33.03 2.18
ADR block file read 38 0 1 28 0.66 0.92
log buffer space 2 50 1 500 0.03 0.86
log file sync 37 0 1 18 0.64 0.56
enq: RO - fast object reuse 14 0 0 24 0.24 0.29
local write wait 44 0 0 1 0.76 0.03
SQL*Net message to client 4,772 0 0 0 82.28 0.01
Disk file operations I/O 110 0 0 0 1.90 0.00
ADR block file write 7 0 0 0 0.12 0.00
SQL*Net message from client 4,773 0 15,396 3226 82.29
Streams AQ: waiting for messages in the queue 720 100 3,600 5000 12.41
Back to Wait Events Statistics
Back to Top
Background Wait Events
• ordered by wait time desc, waits desc (idle events last)
• Only events with Total Wait Time (s) >= .001 are shown
• %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn % bg time
control file sequential read 4,950 0 35 7 85.34 40.74
control file parallel write 1,262 0 31 25 21.76 36.46
log file parallel write 383 0 4 10 6.60 4.37
db file parallel write 627 0 2 3 10.81 2.36
change tracking file synchronous read 56 0 2 34 0.97 2.21
os thread startup 17 0 1 88 0.29 1.74
ADR block file read 135 0 1 7 2.33 1.04
change tracking file synchronous write 56 0 1 15 0.97 0.98
SGA: allocation forcing component growth 8 100 1 100 0.14 0.93
db file sequential read 112 0 1 6 1.93 0.75
process diagnostic dump 94 0 0 1 1.62 0.09
ADR block file write 92 0 0 1 1.59 0.07
LGWR wait for redo copy 11 0 0 1 0.19 0.01
log file sync 2 0 0 3 0.03 0.01
ADR file lock 92 22 0 0 1.59 0.01
Parameter File I/O 24 0 0 0 0.41 0.01
direct path write 6 0 0 1 0.10 0.00
Disk file operations I/O 54 0 0 0 0.93 0.00
rdbms ipc message 17,637 97 61,836 3506 304.09
Streams AQ: waiting for time management or cleanup tasks 5 60 11,053 2210602 0.09
DIAG idle wait 7,203 100 7,203 1000 124.19
PX Idle Wait 1,802 100 3,604 2000 31.07
pmon timer 1,212 99 3,603 2973 20.90
Space Manager: slave idle wait 726 99 3,603 4963 12.52
smon timer 12 100 3,600 300004 0.21
Streams AQ: qmn slave idle wait 128 0 3,583 27993 2.21
Streams AQ: qmn coordinator idle wait 256 50 3,583 13996 4.41
SQL*Net message from client 293 0 2 5 5.05
Back to Wait Events Statistics
Back to Top
Wait Event Histogram
• Units for Total Waits column: K is 1000, M is 1000000, G is 1000000000
• % of Waits: value of .0 indicates value was <.05%; value of null is truly 0
• % of Waits: column heading of <=1s is truly <1024ms, >1s is truly >=1024ms
• Ordered by Event (idle events last)
% of Waits
Event Total Waits <1ms <2ms <4ms <8ms <16ms <32ms <=1s >1s
ADR block file read 173 80.3 5.2 2.3 5.8 1.7 4.6
ADR block file write 99 96.0 3.0 1.0
ADR file lock 102 100.0
Disk file operations I/O 165 100.0
LGWR wait for redo copy 11 90.9 9.1
Parameter File I/O 24 100.0
SGA: allocation forcing component growth 8 100.0
SQL*Net break/reset to client 6 100.0
SQL*Net message to client 4992 100.0
SQL*Net more data from client 20 100.0
asynch descriptor resize 541 100.0
change tracking file synchronous read 56 83.9 1.8 14.3
change tracking file synchronous write 56 80.4 7.1 1.8 10.7
control file parallel write 1262 80.3 1.7 .6 .6 .8 1.3 14.7
control file sequential read 6866 94.1 .9 .7 .7 .3 .4 2.9
db file parallel write 628 94.3 2.1 1.0 .8 .3 .3 1.3
db file scattered read 3457 72.6 7.2 5.4 6.9 5.7 .5 1.6
db file sequential read 4525 78.7 2.7 1.8 9.6 5.3 .4 1.5
direct path read temp 764 40.2 18.6 9.4 6.2 11.0 5.8 8.9
direct path sync 1 100.0
direct path write 6 83.3 16.7
direct path write temp 259 .4 1.2 88.8 .4 9.3
enq: RO - fast object reuse 14 42.9 42.9 7.1 7.1
latch free 1 100.0
latch: cache buffers lru chain 2 100.0
latch: checkpoint queue latch 2 100.0
latch: messages 2 100.0
latch: object queue header operation 2 100.0
latch: redo allocation 1 100.0
latch: row cache objects 1 100.0
local write wait 44 100.0
log buffer space 2 50.0 50.0
log file parallel write 383 92.4 .8 1.0 5.7
log file sync 39 82.1 2.6 2.6 12.8
os thread startup 17 100.0
process diagnostic dump 94 34.0 63.8 2.1
reliable message 7 100.0
utl_file I/O 12 100.0
DIAG idle wait 7204 100.0
PX Idle Wait 1802 100.0
SQL*Net message from client 5067 87.1 6.6 1.0 .5 .5 .1 .5 3.7
Space Manager: slave idle wait 726 .6 99.4
Streams AQ: qmn coordinator idle wait 256 49.2 .8 50.0
Streams AQ: qmn slave idle wait 128 100.0
Streams AQ: waiting for messages in the queue 721 100.0
Streams AQ: waiting for time management or cleanup tasks 5 40.0 20.0 40.0
class slave wait 17 100.0
pmon timer 1212 .9 99.1
rdbms ipc message 17.6K 1.8 .4 .2 .2 .1 .1 21.0 76.2
smon timer 12 100.0
Back to Wait Events Statistics
Back to Top
I couldnt add the rest of the report here since it is telling me I have exceeded 30000 characters. If you want to see the full report, please email me at [email protected]Unless your database is strictly a DSS-type of database, your AWR report exposes loads of issues with it. And I think none of the time during the AWR window was spent on database. Look at the DB time (with all those multi cores) compared with the elapsed time of the AWR.
As you are on 11g, why not make use of MEMORY_TARGET (a single parameter to manage both SGA and PGA)? If you are already on it, ignore this as I can't see it anywhere. If not, get rid of SGA_TARGET and PGA_AGGREGATE_TARGET and replace it with a single MEMORY_TARGET parameter. However you may have a minimum threshold set for different SGA pools so that they won't shrink beyond that point.
Having said that, setting MEMORY_TARGET is not a guarantee to avoid ORA-4030. Just a single bad PL/SQL code could go and exploit the untunable part of your process memory and even go and blow up the physical memory. If you are using FORALL and BULK load, see if you can cut it down into few chunks rather than running as a single process.
What does your V$PGASTAT say? -
Update Statement Simply hanged but doing db file sequential read
Hi,
Last night we had issue with one of the prod server where we updating one of table which contains large number records in millions.Same identical machine completed in1 hour and other box never completed but doing db file sequential read but in the long ops the last statement it was done 20:16 after that nothing is happening but i ran few trace on that user.
/u01/app/oracle/admin/SURV2/udump/surv2_ora_10048.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 18
Unix process pid: 10048, image: oracle@prdfa001
*** 2010-09-09 23:37:07.484
*** ACTION NAME:() 2010-09-09 23:37:07.473
*** MODULE NAME:(SQL*Plus) 2010-09-09 23:37:07.473
*** SERVICE NAME:(SURV2) 2010-09-09 23:37:07.473
*** SESSION ID:(289.54) 2010-09-09 23:37:07.473
Received ORADEBUG command 'unlimit' from process Unix process pid: 3983, image:
*** 2010-09-09 23:37:20.315
Received ORADEBUG command 'event 10046 trace name context forever, level 12' from process Unix process pid: 3983, image:
WAIT #7: nam='db file sequential read' ela= 11160 file#=13 block#=2252349 blocks=1 obj#=166421 tim=12499462835161
WAIT #7: nam='db file sequential read' ela= 2857 file#=13 block#=2249751 blocks=1 obj#=166421 tim=12499462838137
WAIT #7: nam='db file sequential read' ela= 3810 file#=13 block#=2251361 blocks=1 obj#=166421 tim=12499462842048
WAIT #7: nam='db file sequential read' ela= 4459 file#=13 block#=2247059 blocks=1 obj#=166421 tim=12499462846564
WAIT #7: nam='db file sequential read' ela= 2841 file#=13 block#=2247507 blocks=1 obj#=166421 tim=12499462849468
WAIT #7: nam='db file sequential read' ela= 427 file#=13 block#=2247568 blocks=1 obj#=166421 tim=12499462850032
WAIT #7: nam='db file sequential read' ela= 1187 file#=13 block#=2248264 blocks=1 obj#=166421 tim=12499462851327
WAIT #7: nam='db file sequential read' ela= 2687 file#=13 block#=2250707 blocks=1 obj#=166421 tim=12499462854178
WAIT #7: nam='db file sequential read' ela= 3657 file#=13 block#=2249697 blocks=1 obj#=166421 tim=12499462857896
WAIT #7: nam='db file sequential read' ela= 4139 file#=13 block#=2247074 blocks=1 obj#=166421 tim=12499462862093
WAIT #7: nam='db file sequential read' ela= 4180 file#=47 block#=3649690 blocks=1 obj#=166421 tim=12499509270445
WAIT #7: nam='db file sequential read' ela= 4802 file#=47 block#=3649309 blocks=1 obj#=166421 tim=12499509275327
WAIT #7: nam='db file sequential read' ela= 2459 file#=47 block#=3652697 blocks=1 obj#=166421 tim=12499509277859
WAIT #7: nam='db file sequential read' ela= 4015 file#=47 block#=3652826 blocks=1 obj#=166421 tim=12499509281948
WAIT #7: nam='db file sequential read' ela= 2248 file#=47 block#=3651610 blocks=1 obj#=166421 tim=12499509284269
WAIT #7: nam='db file sequential read' ela= 4824 file#=47 block#=3654297 blocks=1 obj#=166421 tim=12499509289166
WAIT #7: nam='db file sequential read' ela= 2008 file#=47 block#=3652312 blocks=1 obj#=166421 tim=12499509291248
WAIT #7: nam='db file sequential read' ela= 1925 file#=47 block#=3654490 blocks=1 obj#=166421 tim=12499509293246
WAIT #7: nam='db file sequential read' ela= 2859 file#=47 block#=3648458 blocks=1 obj#=166421 tim=12499509296178
WAIT #7: nam='db file sequential read' ela= 1740 file#=47 block#=3648212 blocks=1 obj#=166421 tim=12499509297991
WAIT #7: nam='db file sequential read' ela= 2566 file#=47 block#=3648411 blocks=1 obj#=166421 tim=12499509300631
WAIT #7: nam='db file sequential read' ela= 50772 file#=5 block#=480749 blocks=1 obj#=166421 tim=12499509351477
WAIT #7: nam='db file sequential read' ela= 12928 file#=5 block#=477177 blocks=1 obj#=166421 tim=12499509364482
WAIT #7: nam='db file sequential read' ela= 11116 file#=5 block#=479412 blocks=1 obj#=166421 tim=12499509375672
WAIT #7: nam='db file sequential read' ela= 4803 file#=5 block#=483440 blocks=1 obj#=166421 tim=12499509380549
WAIT #7: nam='db file sequential read' ela= 6900 file#=5 block#=481454 blocks=1 obj#=166421 tim=12499509387522
Received ORADEBUG command 'event 10046 trace name context off' from process Unix process pid: 3983, image:
/u01/app/oracle/admin/SURV2/udump/surv2_ora_1545.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 22
Unix process pid: 1545, image: oracle@prdfa001 (TNS V1-V3)
*** ACTION NAME:() 2010-09-09 23:20:13.485
*** MODULE NAME:(sqlplus@prdfa001 (TNS V1-V3)) 2010-09-09 23:20:13.485
*** SERVICE NAME:(SYS$USERS) 2010-09-09 23:20:13.485
*** SESSION ID:(290.697) 2010-09-09 23:20:13.485
===================================================
SYSTEM STATE
System global information:
processes: base 47819b480, size 300, cleanup 4781a5638
allocation: free sessions 47f1d6148, free calls 0
control alloc errors: 0 (process), 0 (session), 0 (call)
PMON latch cleanup depth: 0
seconds since PMON's last scan for dead processes: 20
system statistics:
1171 logons cumulative
19 logons current
89219 opened cursors cumulative
86 opened cursors current
15095069 user commits
5 user rollbacks
58632904 user calls
44023255 recursive calls
224311 recursive cpu usage
201424173 session logical reads
0 session stored procedure space
901812 CPU used when call started
995437 CPU used by this session
6814196 DB time
0 cluster wait time
22542300822 concurrency wait time
3095 application wait time
16479074661 user I/O wait time
1284052668 session connect time
1284067190 process last non-idle time
189018343568 session uga memory
1249667216 session uga memory max
26059216 messages sent
26059220 messages received
239739 background timeouts
162399896 session pga memory
189662872 session pga memory max
4 enqueue timeouts
901146 enqueue waits
0 enqueue deadlocks
32122711 enqueue requests
17819 enqueue conversions
32122676 enqueue releases
0 global enqueue gets sync
0 global enqueue gets async
0 global enqueue get time
0 global enqueue releases
2865667 physical read total IO requests
262620 physical read total multi block requests
270093476864 physical read total bytes
select SYS_CONTEXT('USERENV', 'SERVER_HOST'), SYS_CONTEXT('USERENV', 'DB_UNIQUE_NAME'), SYS_CONTEXT('USERENV', 'INSTANCE_NAME'), SYS_CONTEXT('USERENV', 'SERVICE_NAME'), INSTANCE_NUMBER, STARTUP_TIME, SYS_CONTEXT('USERENV', 'DB_DOMAIN') from v$instance where INSTANCE_NAME=SYS_CONTEXT('USERENV', 'INSTANCE_NAME')
hash=550c95f3d0cfa8290e60ea8382d3a2ca timestamp=09-09-2010 04:24:19
namespace=CRSR flags=RON/KGHP/TIM/PN0/LRG/KST/DBN/MTX/[100100d1]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=9 hpc=0582 hlc=0582
lwt=47df576e8[47df576e8,47df576e8] ltm=47df576f8[47df576f8,47df576f8]
pwt=47df576b0[47df576b0,47df576b0] ptm=47df576c0[47df576c0,47df576c0]
ref=47df57718[47df57718,47df57718] lnd=47df57730[47df57730,47df57730]
LIBRARY OBJECT: object=471ee1d38
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 471ee1800 471ee1470 47df7dce0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47df7de48 471ee1e50 I/P/A/-/- 0 NONE 00
SO: 473691d60, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473691d60 handle=47bb22fa0 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=473691de0[4735dbcb8,476cfbf58] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x0
LIBRARY OBJECT HANDLE: handle=47bb22fa0 mtx=47bb230d0(0) cdp=0
namespace=CRSR flags=RON/KGHP/PN0/EXP/[10010100]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=fd84 hlc=fd84
lwt=47bb23048[47bb23048,47bb23048] ltm=47bb23058[47bb23058,47bb23058]
pwt=47bb23010[47bb23010,47bb23010] ptm=47bb23020[47bb23020,47bb23020]
ref=47bb23078[472f8de18,472f8de18] lnd=47bb23090[47bb23090,47bb23090]
LIBRARY OBJECT: object=472f8d9d8
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DEPENDENCIES: count=1 size=16
AUTHORIZATIONS: count=1 size=16 minimum entrysize=16
ACCESSES: count=1 size=16
TRANSLATIONS: count=1 size=16
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb22ee0 472f8daf0 I/P/A/-/- 0 NONE 00
6 472f8e508 46be86250 I/-/A/-/E 0 NONE 00
SO: 4735dbc38, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=4735dbc38 handle=47bb231c8 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4735dbcb8[476cfbf58,473691de0] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bb231c8 mtx=47bb232f8(1) cdp=1
name=select value$ from props$ where name = 'GLOBAL_DB_NAME'
hash=4bb432d65c5a391a42a5c3fa74472c7a timestamp=09-09-2010 04:24:12
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/KST/DBN/MTX/[120100d0]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=0584 hlc=0584
lwt=47bb23270[47bb23270,47bb23270] ltm=47bb23280[47bb23280,47bb23280]
pwt=47bb23238[47bb23238,47bb23238] ptm=47bb23248[47bb23248,47bb23248]
ref=47bb232a0[47bb232a0,47bb232a0] lnd=47bb232b8[47bb232b8,47bb232b8]
LIBRARY OBJECT: object=472f8e6e0
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 472f8e1a8 472f8de18 47bb22fa0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb23108 472f8e7f8 I/P/A/-/- 0 NONE 00
SO: 473644348, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473644348 handle=47bbde418 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4736443c8[476cfc0b8,476cfc0b8] htb=476cfc0b8 ssga=476cfb6a0
user=47924e810 session=47924e810 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bbde418 mtx=47bbde548(0) cdp=0
name=ALTER SESSION SET TIME_ZONE='+02:00'
hash=3878dff8839e71e3dd05a2e75fbd6390 timestamp=09-09-2010 04:24:04
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/DBN/[12010040]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=11 hpc=04e8 hlc=04e8
lwt=47bbde4c0[47bbde4c0,47bbde4c0] ltm=47bbde4d0[47bbde4d0,47bbde4d0]
pwt=47bbde488[47bbde488,47bbde488] ptm=47bbde498[47bbde498,47bbde498]
ref=47bbde4f0[47bbde4f0,47bbde4f0] lnd=47bbde508[47bbde508,47bbde508]
LIBRARY OBJECT: object=472fffc08
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bbde320 472fffd20 I/P/A/-/- 0 NONE 00
SO: 47aecf9e8, type: 41, owner: 47924e810, flag: INIT/-/-/0x00
(dummy) nxc=0, nlb=0
SO: 47f290540, type: 11, owner: 4781a7dc0, flag: INIT/-/-/0x00
(broadcast handle) flag: (2) ACTIVE SUBSCRIBER, owner: 4781a7dc0,
event: 1132, last message event: 1132,
last message waited event: 1132, next message: 0(0), messages read: 0
channel: (47a2df4f8) system events broadcast channel
scope: 2, event: 1132, last mesage event: 18,
publishers/subscribers: 0/17,
messages published: 1
SO: 47826b228, type: 3, owner: 4781a7dc0, flag: INIT/-/-/0x00
(call) sess: cur 47924e810, rec 0, usr 47924e810; depth: 0
SO: 476c52968, type: 16, owner: 4781a7dc0, flag: INIT/-/-/0x00
(osp req holder)
PSEUDO PROCESS for group DEFAULT:
SO: 47a1eb7d0, type: 2, owner: 0, flag: INIT/-/-/0x00
(process) Oracle pid=0, calls cur/top: 0/0, flag: (20) PSEUDO
int error: 0, call error: 0, sess error: 0, txn error 0
(post info) last post received: 0 0 0
last post received-location: No post
last process to post me: none
last post sent: 0 0 0
last post sent-location: No post
last process posted by me: none
(latch info) wait_event=0 bits=0
Process Group: DEFAULT, pseudo proc: 47a1eb7d0
O/S info: user: , term: , ospid: (DEAD)
OSD pid info: Unix process pid: 0, image: PSEUDO
Dump of memory from 0x00000004791BF538 to 0x00000004791BF740
4791BF530 00000000 00000000 [........]
4791BF540 00000000 00000000 00000000 00000000 [................]
Repeat 31 times
NO DETACHED BRANCHES.
NO DETACHED NETWORK CONNECTIONS.
CLEANUP STATE OBJECTS:
SO: 47f0cd038, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: instance enqueue anchor state
latch: 0x380009890
SO: 4782cf080, type: 5, owner: 47f0cd038, flag: INIT/-/-/0x00
(enqueue) TA-00000006-00000001 DID: 0001-000F-0000000B
lv: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 res_flag: 0x2
res: 0x47a28d020, mode: X, lock_flag: 0x0
own: 0x0, sess: 0x0, prv: 0x47a28d030
SO: 47f0cd098, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: switchable channel handle anch
latch: 0x38000ac98
SO: 47f28f868, type: 11, owner: 47f0cd098, flag: INIT/-/-/0x00
(broadcast handle) flag: (c2) ACTIVE SUBSCRIBER, owner: 0,
event: 1, last message event: 1,
last message waited event: 1, next message: 0(0), messages read: 0
channel: (47a2e4190) KPON channel
scope: 2, event: 1, last mesage event: 0,
publishers/subscribers: 0/1,
messages published: 0
SO: 47f0cd0f8, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: TT shared object cleanup SO
latch: 0x38001c6b8
SO: 47f0cd158, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: SS shared object cleanup SO
latch: 0x38001cd48
END OF SYSTEM STATE
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
db file sequential read 2,347,652 9,215 4 64.5 User I/O
db file scattered read 245,687 4,199 17 29.4 User I/O
CPU time 974 6.8
db file parallel write 50,082 408 8 2.9 System I/O
log file parallel write 6,963 52 7 0.4 System I/O
Time Model Statistics DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Total time in database user-calls (DB Time): 14286.4s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 14,280.3 100.0
DB CPU 974.5 6.8
PL/SQL execution elapsed time 531.8 3.7
parse time elapsed 30.5 .2
hard parse elapsed time 27.1 .2
connection management call elapsed time 14.9 .1
hard parse (sharing criteria) elapsed time 3.4 .0
hard parse (bind mismatch) elapsed time 3.1 .0
PL/SQL compilation elapsed time 2.4 .0
failed parse elapsed time 0.0 .0
repeated bind elapsed time 0.0 .0
sequence load elapsed time 0.0 .0
DB time 14,286.4 N/A
background elapsed time 670.2 N/A
background cpu time 186.1 N/A
Wait Class DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc
Avg
%Time Total Wait wait Waits
Wait Class Waits -outs Time (s) (ms) /txn
User I/O 2,593,484 .0 13,415 5 150.0
System I/O 87,506 .0 515 6 5.1
Other 839 11.4 6 7 0.0
Commit 3,225 .1 6 2 0.2
Concurrency 1,033 .0 5 5 0.1
Configuration 2,514 99.4 0 0 0.1
Network 47,559 .0 0 0 2.8
Application 7 .0 0 0 0.0
Wait Events DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file sequential read 2,347,652 .0 9,215 4 135.8
db file scattered read 245,687 .0 4,199 17 14.2
db file parallel write 50,082 .0 408 8 2.9
log file parallel write 6,963 .0 52 7 0.4
control file parallel write 6,203 .0 44 7 0.4
control file sequential read 24,242 .0 11 0 1.4
log file sync 3,225 .1 6 2 0.2
latch free 84 .0 4 47 0.0
os thread startup 25 .0 3 120 0.0
latch: session allocation 39 .0 1 33 0.0
db file parallel read 12 .0 1 92 0.0
enq: TX - index contention 186 .0 1 3 0.0
latch: shared pool 47 .0 1 11 0.0
LGWR wait for redo copy 319 3.1 0 1 0.0
library cache load lock 2 .0 0 172 0.0
buffer busy waits 590 .0 0 0 0.0
log file switch completion 6 .0 0 29 0.0
SGA: allocation forcing comp 11 54.5 0 14 0.0
latch: library cache lock 50 .0 0 3 0.0
read by other session 38 .0 0 4 0.0
direct path read 42 .0 0 3 0.0
SQL*Net message to client 44,807 .0 0 0 2.6
rdbms ipc reply 207 .0 0 0 0.0
SQL*Net more data from clien 1,014 .0 0 0 0.1
latch: cache buffers chains 24 .0 0 1 0.0
latch: library cache 29 .0 0 1 0.0
log file sequential read 8 .0 0 3 0.0
direct path write 50 .0 0 0 0.0
SQL*Net more data to client 398 .0 0 0 0.0
latch: object queue header o 12 .0 0 1 0.0
latch: In memory undo latch 78 .0 0 0 0.0
undo segment extension 2,507 99.7 0 0 0.1
latch: cache buffers lru cha 4 .0 0 1 0.0
log file single write 8 .0 0 0 0.0
local write wait 3 .0 0 1 0.0
enq: RO - fast object reuse 3 .0 0 1 0.0
buffer deadlock 87 92.0 0 0 0.0
enq: JS - queue lock 1 .0 0 1 0.0
cursor: pin S 70 .0 0 0 0.0
latch: row cache objects 2 .0 0 1 0.0
SQL*Net message to dblink 1,338 .0 0 0 0.1
latch: checkpoint queue latc 2 .0 0 0 0.0
reliable message 3 .0 0 0 0.0
log buffer space 1 .0 0 1 0.0
SQL*Net break/reset to clien 4 .0 0 0 0.0
SQL*Net more data from dblin 2 .0 0 0 0.0
SQL*Net message from client 44,949 .0 155,701 3464 2.6
virtual circuit status 621 100.0 18,156 29237 0.0
Streams AQ: qmn slave idle w 664 .0 18,127 27299 0.0
Streams AQ: qmn coordinator 1,339 50.4 18,099 13517 0.1
Streams AQ: waiting for time 12 100.0 8,741 728394 0.0
jobq slave wait 130 100.0 380 2927 0.0
PL/SQL lock timer 1 100.0 1 978 0.0
SQL*Net message from dblink 1,338 .0 0 0 0.1
single-task message 1 .0 0 38 0.0
class slave wait 11 .0 0 1 0.0
SQL ordered by Elapsed Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
Elapsed CPU Elap per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
13,664 906 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
8,792 195 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
2,524 368 1 2524.1 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
1,414 177 1 1414.4 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
742 137 1 742.2 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
274 11 1 274.2 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
264 8 27 9.8 1.8 8szmwam7fysa3
Module: DBMS_SCHEDULER
insert into wri$_adv_objspace_trend_data select timepoint, space_usage, space_a
lloc, quality from table(dbms_space.object_growth_trend(:1, :2, :3, :4, NULL, N
ULL, NULL, 'FALSE', :5, 'FALSE'))
99 1 1 99.4 0.7 1z0x41f66nvjr
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTADMIN SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
21 10 1 21.5 0.2 bbc1ck8594kvj
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTDAILYHIST SET ADJOPEN=NVL(ADJOPEN,OPEN), ADJHIGH=NVL(ADJH
IGH,HIGH), ADJLOW=NVL(ADJLOW,LOW), ADJMID=NVL(ADJMID,MID), ADJCLOSE=NVL(ADJCLOSE
,CLOSE), ADJVOLUME=NVL(ADJVOLUME,VOLUME), ADJCLOSINGBID=NVL(ADJCLOSINGBID,CLOSIN
GBID), ADJCLOSINGOFFER=NVL(ADJCLOSINGOFFER,CLOSINGOFFER)
12 0 1 12.5 0.1 6xm9p9uy5kaap
Module: SQL*Plus
SELECT count(*) FROM TIBEX_INSTRUMENTSTATE WHERE INSTRUMENTID=:"SYS_B_0"
SQL ordered by CPU Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
CPU Elapsed CPU per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
906 13,664 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
368 2,524 1 367.51 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
195 8,792 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
177 1,414 1 176.93 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
137 742 1 137.38 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
11 274 1 10.82 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
10 21 1 9.65 0.2 bbc1ck8594kvjEdited by: NM on 10-Sep-2010 07:39Hi,
Last night we had issue with one of the prod server where we updating one of table which contains large number records in millions.Same identical machine completed in1 hour and other box never completed but doing db file sequential read but in the long ops the last statement it was done 20:16 after that nothing is happening but i ran few trace on that user.
/u01/app/oracle/admin/SURV2/udump/surv2_ora_10048.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 18
Unix process pid: 10048, image: oracle@prdfa001
*** 2010-09-09 23:37:07.484
*** ACTION NAME:() 2010-09-09 23:37:07.473
*** MODULE NAME:(SQL*Plus) 2010-09-09 23:37:07.473
*** SERVICE NAME:(SURV2) 2010-09-09 23:37:07.473
*** SESSION ID:(289.54) 2010-09-09 23:37:07.473
Received ORADEBUG command 'unlimit' from process Unix process pid: 3983, image:
*** 2010-09-09 23:37:20.315
Received ORADEBUG command 'event 10046 trace name context forever, level 12' from process Unix process pid: 3983, image:
WAIT #7: nam='db file sequential read' ela= 11160 file#=13 block#=2252349 blocks=1 obj#=166421 tim=12499462835161
WAIT #7: nam='db file sequential read' ela= 2857 file#=13 block#=2249751 blocks=1 obj#=166421 tim=12499462838137
WAIT #7: nam='db file sequential read' ela= 3810 file#=13 block#=2251361 blocks=1 obj#=166421 tim=12499462842048
WAIT #7: nam='db file sequential read' ela= 4459 file#=13 block#=2247059 blocks=1 obj#=166421 tim=12499462846564
WAIT #7: nam='db file sequential read' ela= 2841 file#=13 block#=2247507 blocks=1 obj#=166421 tim=12499462849468
WAIT #7: nam='db file sequential read' ela= 427 file#=13 block#=2247568 blocks=1 obj#=166421 tim=12499462850032
WAIT #7: nam='db file sequential read' ela= 1187 file#=13 block#=2248264 blocks=1 obj#=166421 tim=12499462851327
WAIT #7: nam='db file sequential read' ela= 2687 file#=13 block#=2250707 blocks=1 obj#=166421 tim=12499462854178
WAIT #7: nam='db file sequential read' ela= 3657 file#=13 block#=2249697 blocks=1 obj#=166421 tim=12499462857896
WAIT #7: nam='db file sequential read' ela= 4139 file#=13 block#=2247074 blocks=1 obj#=166421 tim=12499462862093
WAIT #7: nam='db file sequential read' ela= 4180 file#=47 block#=3649690 blocks=1 obj#=166421 tim=12499509270445
WAIT #7: nam='db file sequential read' ela= 4802 file#=47 block#=3649309 blocks=1 obj#=166421 tim=12499509275327
WAIT #7: nam='db file sequential read' ela= 2459 file#=47 block#=3652697 blocks=1 obj#=166421 tim=12499509277859
WAIT #7: nam='db file sequential read' ela= 4015 file#=47 block#=3652826 blocks=1 obj#=166421 tim=12499509281948
WAIT #7: nam='db file sequential read' ela= 2248 file#=47 block#=3651610 blocks=1 obj#=166421 tim=12499509284269
WAIT #7: nam='db file sequential read' ela= 4824 file#=47 block#=3654297 blocks=1 obj#=166421 tim=12499509289166
WAIT #7: nam='db file sequential read' ela= 2008 file#=47 block#=3652312 blocks=1 obj#=166421 tim=12499509291248
WAIT #7: nam='db file sequential read' ela= 1925 file#=47 block#=3654490 blocks=1 obj#=166421 tim=12499509293246
WAIT #7: nam='db file sequential read' ela= 2859 file#=47 block#=3648458 blocks=1 obj#=166421 tim=12499509296178
WAIT #7: nam='db file sequential read' ela= 1740 file#=47 block#=3648212 blocks=1 obj#=166421 tim=12499509297991
WAIT #7: nam='db file sequential read' ela= 2566 file#=47 block#=3648411 blocks=1 obj#=166421 tim=12499509300631
WAIT #7: nam='db file sequential read' ela= 50772 file#=5 block#=480749 blocks=1 obj#=166421 tim=12499509351477
WAIT #7: nam='db file sequential read' ela= 12928 file#=5 block#=477177 blocks=1 obj#=166421 tim=12499509364482
WAIT #7: nam='db file sequential read' ela= 11116 file#=5 block#=479412 blocks=1 obj#=166421 tim=12499509375672
WAIT #7: nam='db file sequential read' ela= 4803 file#=5 block#=483440 blocks=1 obj#=166421 tim=12499509380549
WAIT #7: nam='db file sequential read' ela= 6900 file#=5 block#=481454 blocks=1 obj#=166421 tim=12499509387522
Received ORADEBUG command 'event 10046 trace name context off' from process Unix process pid: 3983, image:
/u01/app/oracle/admin/SURV2/udump/surv2_ora_1545.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 22
Unix process pid: 1545, image: oracle@prdfa001 (TNS V1-V3)
*** ACTION NAME:() 2010-09-09 23:20:13.485
*** MODULE NAME:(sqlplus@prdfa001 (TNS V1-V3)) 2010-09-09 23:20:13.485
*** SERVICE NAME:(SYS$USERS) 2010-09-09 23:20:13.485
*** SESSION ID:(290.697) 2010-09-09 23:20:13.485
===================================================
SYSTEM STATE
System global information:
processes: base 47819b480, size 300, cleanup 4781a5638
allocation: free sessions 47f1d6148, free calls 0
control alloc errors: 0 (process), 0 (session), 0 (call)
PMON latch cleanup depth: 0
seconds since PMON's last scan for dead processes: 20
system statistics:
1171 logons cumulative
19 logons current
89219 opened cursors cumulative
86 opened cursors current
15095069 user commits
5 user rollbacks
58632904 user calls
44023255 recursive calls
224311 recursive cpu usage
201424173 session logical reads
0 session stored procedure space
901812 CPU used when call started
995437 CPU used by this session
6814196 DB time
0 cluster wait time
22542300822 concurrency wait time
3095 application wait time
16479074661 user I/O wait time
1284052668 session connect time
1284067190 process last non-idle time
189018343568 session uga memory
1249667216 session uga memory max
26059216 messages sent
26059220 messages received
239739 background timeouts
162399896 session pga memory
189662872 session pga memory max
4 enqueue timeouts
901146 enqueue waits
0 enqueue deadlocks
32122711 enqueue requests
17819 enqueue conversions
32122676 enqueue releases
0 global enqueue gets sync
0 global enqueue gets async
0 global enqueue get time
0 global enqueue releases
2865667 physical read total IO requests
262620 physical read total multi block requests
270093476864 physical read total bytes
select SYS_CONTEXT('USERENV', 'SERVER_HOST'), SYS_CONTEXT('USERENV', 'DB_UNIQUE_NAME'), SYS_CONTEXT('USERENV', 'INSTANCE_NAME'), SYS_CONTEXT('USERENV', 'SERVICE_NAME'), INSTANCE_NUMBER, STARTUP_TIME, SYS_CONTEXT('USERENV', 'DB_DOMAIN') from v$instance where INSTANCE_NAME=SYS_CONTEXT('USERENV', 'INSTANCE_NAME')
hash=550c95f3d0cfa8290e60ea8382d3a2ca timestamp=09-09-2010 04:24:19
namespace=CRSR flags=RON/KGHP/TIM/PN0/LRG/KST/DBN/MTX/[100100d1]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=9 hpc=0582 hlc=0582
lwt=47df576e8[47df576e8,47df576e8] ltm=47df576f8[47df576f8,47df576f8]
pwt=47df576b0[47df576b0,47df576b0] ptm=47df576c0[47df576c0,47df576c0]
ref=47df57718[47df57718,47df57718] lnd=47df57730[47df57730,47df57730]
LIBRARY OBJECT: object=471ee1d38
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 471ee1800 471ee1470 47df7dce0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47df7de48 471ee1e50 I/P/A/-/- 0 NONE 00
SO: 473691d60, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473691d60 handle=47bb22fa0 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=473691de0[4735dbcb8,476cfbf58] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x0
LIBRARY OBJECT HANDLE: handle=47bb22fa0 mtx=47bb230d0(0) cdp=0
namespace=CRSR flags=RON/KGHP/PN0/EXP/[10010100]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=fd84 hlc=fd84
lwt=47bb23048[47bb23048,47bb23048] ltm=47bb23058[47bb23058,47bb23058]
pwt=47bb23010[47bb23010,47bb23010] ptm=47bb23020[47bb23020,47bb23020]
ref=47bb23078[472f8de18,472f8de18] lnd=47bb23090[47bb23090,47bb23090]
LIBRARY OBJECT: object=472f8d9d8
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DEPENDENCIES: count=1 size=16
AUTHORIZATIONS: count=1 size=16 minimum entrysize=16
ACCESSES: count=1 size=16
TRANSLATIONS: count=1 size=16
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb22ee0 472f8daf0 I/P/A/-/- 0 NONE 00
6 472f8e508 46be86250 I/-/A/-/E 0 NONE 00
SO: 4735dbc38, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=4735dbc38 handle=47bb231c8 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4735dbcb8[476cfbf58,473691de0] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bb231c8 mtx=47bb232f8(1) cdp=1
name=select value$ from props$ where name = 'GLOBAL_DB_NAME'
hash=4bb432d65c5a391a42a5c3fa74472c7a timestamp=09-09-2010 04:24:12
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/KST/DBN/MTX/[120100d0]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=0584 hlc=0584
lwt=47bb23270[47bb23270,47bb23270] ltm=47bb23280[47bb23280,47bb23280]
pwt=47bb23238[47bb23238,47bb23238] ptm=47bb23248[47bb23248,47bb23248]
ref=47bb232a0[47bb232a0,47bb232a0] lnd=47bb232b8[47bb232b8,47bb232b8]
LIBRARY OBJECT: object=472f8e6e0
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 472f8e1a8 472f8de18 47bb22fa0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb23108 472f8e7f8 I/P/A/-/- 0 NONE 00
SO: 473644348, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473644348 handle=47bbde418 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4736443c8[476cfc0b8,476cfc0b8] htb=476cfc0b8 ssga=476cfb6a0
user=47924e810 session=47924e810 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bbde418 mtx=47bbde548(0) cdp=0
name=ALTER SESSION SET TIME_ZONE='+02:00'
hash=3878dff8839e71e3dd05a2e75fbd6390 timestamp=09-09-2010 04:24:04
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/DBN/[12010040]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=11 hpc=04e8 hlc=04e8
lwt=47bbde4c0[47bbde4c0,47bbde4c0] ltm=47bbde4d0[47bbde4d0,47bbde4d0]
pwt=47bbde488[47bbde488,47bbde488] ptm=47bbde498[47bbde498,47bbde498]
ref=47bbde4f0[47bbde4f0,47bbde4f0] lnd=47bbde508[47bbde508,47bbde508]
LIBRARY OBJECT: object=472fffc08
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bbde320 472fffd20 I/P/A/-/- 0 NONE 00
SO: 47aecf9e8, type: 41, owner: 47924e810, flag: INIT/-/-/0x00
(dummy) nxc=0, nlb=0
SO: 47f290540, type: 11, owner: 4781a7dc0, flag: INIT/-/-/0x00
(broadcast handle) flag: (2) ACTIVE SUBSCRIBER, owner: 4781a7dc0,
event: 1132, last message event: 1132,
last message waited event: 1132, next message: 0(0), messages read: 0
channel: (47a2df4f8) system events broadcast channel
scope: 2, event: 1132, last mesage event: 18,
publishers/subscribers: 0/17,
messages published: 1
SO: 47826b228, type: 3, owner: 4781a7dc0, flag: INIT/-/-/0x00
(call) sess: cur 47924e810, rec 0, usr 47924e810; depth: 0
SO: 476c52968, type: 16, owner: 4781a7dc0, flag: INIT/-/-/0x00
(osp req holder)
PSEUDO PROCESS for group DEFAULT:
SO: 47a1eb7d0, type: 2, owner: 0, flag: INIT/-/-/0x00
(process) Oracle pid=0, calls cur/top: 0/0, flag: (20) PSEUDO
int error: 0, call error: 0, sess error: 0, txn error 0
(post info) last post received: 0 0 0
last post received-location: No post
last process to post me: none
last post sent: 0 0 0
last post sent-location: No post
last process posted by me: none
(latch info) wait_event=0 bits=0
Process Group: DEFAULT, pseudo proc: 47a1eb7d0
O/S info: user: , term: , ospid: (DEAD)
OSD pid info: Unix process pid: 0, image: PSEUDO
Dump of memory from 0x00000004791BF538 to 0x00000004791BF740
4791BF530 00000000 00000000 [........]
4791BF540 00000000 00000000 00000000 00000000 [................]
Repeat 31 times
NO DETACHED BRANCHES.
NO DETACHED NETWORK CONNECTIONS.
CLEANUP STATE OBJECTS:
SO: 47f0cd038, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: instance enqueue anchor state
latch: 0x380009890
SO: 4782cf080, type: 5, owner: 47f0cd038, flag: INIT/-/-/0x00
(enqueue) TA-00000006-00000001 DID: 0001-000F-0000000B
lv: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 res_flag: 0x2
res: 0x47a28d020, mode: X, lock_flag: 0x0
own: 0x0, sess: 0x0, prv: 0x47a28d030
SO: 47f0cd098, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: switchable channel handle anch
latch: 0x38000ac98
SO: 47f28f868, type: 11, owner: 47f0cd098, flag: INIT/-/-/0x00
(broadcast handle) flag: (c2) ACTIVE SUBSCRIBER, owner: 0,
event: 1, last message event: 1,
last message waited event: 1, next message: 0(0), messages read: 0
channel: (47a2e4190) KPON channel
scope: 2, event: 1, last mesage event: 0,
publishers/subscribers: 0/1,
messages published: 0
SO: 47f0cd0f8, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: TT shared object cleanup SO
latch: 0x38001c6b8
SO: 47f0cd158, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: SS shared object cleanup SO
latch: 0x38001cd48
END OF SYSTEM STATE
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
db file sequential read 2,347,652 9,215 4 64.5 User I/O
db file scattered read 245,687 4,199 17 29.4 User I/O
CPU time 974 6.8
db file parallel write 50,082 408 8 2.9 System I/O
log file parallel write 6,963 52 7 0.4 System I/O
Time Model Statistics DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Total time in database user-calls (DB Time): 14286.4s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 14,280.3 100.0
DB CPU 974.5 6.8
PL/SQL execution elapsed time 531.8 3.7
parse time elapsed 30.5 .2
hard parse elapsed time 27.1 .2
connection management call elapsed time 14.9 .1
hard parse (sharing criteria) elapsed time 3.4 .0
hard parse (bind mismatch) elapsed time 3.1 .0
PL/SQL compilation elapsed time 2.4 .0
failed parse elapsed time 0.0 .0
repeated bind elapsed time 0.0 .0
sequence load elapsed time 0.0 .0
DB time 14,286.4 N/A
background elapsed time 670.2 N/A
background cpu time 186.1 N/A
Wait Class DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc
Avg
%Time Total Wait wait Waits
Wait Class Waits -outs Time (s) (ms) /txn
User I/O 2,593,484 .0 13,415 5 150.0
System I/O 87,506 .0 515 6 5.1
Other 839 11.4 6 7 0.0
Commit 3,225 .1 6 2 0.2
Concurrency 1,033 .0 5 5 0.1
Configuration 2,514 99.4 0 0 0.1
Network 47,559 .0 0 0 2.8
Application 7 .0 0 0 0.0
Wait Events DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file sequential read 2,347,652 .0 9,215 4 135.8
db file scattered read 245,687 .0 4,199 17 14.2
db file parallel write 50,082 .0 408 8 2.9
log file parallel write 6,963 .0 52 7 0.4
control file parallel write 6,203 .0 44 7 0.4
control file sequential read 24,242 .0 11 0 1.4
log file sync 3,225 .1 6 2 0.2
latch free 84 .0 4 47 0.0
os thread startup 25 .0 3 120 0.0
latch: session allocation 39 .0 1 33 0.0
db file parallel read 12 .0 1 92 0.0
enq: TX - index contention 186 .0 1 3 0.0
latch: shared pool 47 .0 1 11 0.0
LGWR wait for redo copy 319 3.1 0 1 0.0
library cache load lock 2 .0 0 172 0.0
buffer busy waits 590 .0 0 0 0.0
log file switch completion 6 .0 0 29 0.0
SGA: allocation forcing comp 11 54.5 0 14 0.0
latch: library cache lock 50 .0 0 3 0.0
read by other session 38 .0 0 4 0.0
direct path read 42 .0 0 3 0.0
SQL*Net message to client 44,807 .0 0 0 2.6
rdbms ipc reply 207 .0 0 0 0.0
SQL*Net more data from clien 1,014 .0 0 0 0.1
latch: cache buffers chains 24 .0 0 1 0.0
latch: library cache 29 .0 0 1 0.0
log file sequential read 8 .0 0 3 0.0
direct path write 50 .0 0 0 0.0
SQL*Net more data to client 398 .0 0 0 0.0
latch: object queue header o 12 .0 0 1 0.0
latch: In memory undo latch 78 .0 0 0 0.0
undo segment extension 2,507 99.7 0 0 0.1
latch: cache buffers lru cha 4 .0 0 1 0.0
log file single write 8 .0 0 0 0.0
local write wait 3 .0 0 1 0.0
enq: RO - fast object reuse 3 .0 0 1 0.0
buffer deadlock 87 92.0 0 0 0.0
enq: JS - queue lock 1 .0 0 1 0.0
cursor: pin S 70 .0 0 0 0.0
latch: row cache objects 2 .0 0 1 0.0
SQL*Net message to dblink 1,338 .0 0 0 0.1
latch: checkpoint queue latc 2 .0 0 0 0.0
reliable message 3 .0 0 0 0.0
log buffer space 1 .0 0 1 0.0
SQL*Net break/reset to clien 4 .0 0 0 0.0
SQL*Net more data from dblin 2 .0 0 0 0.0
SQL*Net message from client 44,949 .0 155,701 3464 2.6
virtual circuit status 621 100.0 18,156 29237 0.0
Streams AQ: qmn slave idle w 664 .0 18,127 27299 0.0
Streams AQ: qmn coordinator 1,339 50.4 18,099 13517 0.1
Streams AQ: waiting for time 12 100.0 8,741 728394 0.0
jobq slave wait 130 100.0 380 2927 0.0
PL/SQL lock timer 1 100.0 1 978 0.0
SQL*Net message from dblink 1,338 .0 0 0 0.1
single-task message 1 .0 0 38 0.0
class slave wait 11 .0 0 1 0.0
SQL ordered by Elapsed Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
Elapsed CPU Elap per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
13,664 906 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
8,792 195 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
2,524 368 1 2524.1 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
1,414 177 1 1414.4 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
742 137 1 742.2 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
274 11 1 274.2 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
264 8 27 9.8 1.8 8szmwam7fysa3
Module: DBMS_SCHEDULER
insert into wri$_adv_objspace_trend_data select timepoint, space_usage, space_a
lloc, quality from table(dbms_space.object_growth_trend(:1, :2, :3, :4, NULL, N
ULL, NULL, 'FALSE', :5, 'FALSE'))
99 1 1 99.4 0.7 1z0x41f66nvjr
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTADMIN SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
21 10 1 21.5 0.2 bbc1ck8594kvj
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTDAILYHIST SET ADJOPEN=NVL(ADJOPEN,OPEN), ADJHIGH=NVL(ADJH
IGH,HIGH), ADJLOW=NVL(ADJLOW,LOW), ADJMID=NVL(ADJMID,MID), ADJCLOSE=NVL(ADJCLOSE
,CLOSE), ADJVOLUME=NVL(ADJVOLUME,VOLUME), ADJCLOSINGBID=NVL(ADJCLOSINGBID,CLOSIN
GBID), ADJCLOSINGOFFER=NVL(ADJCLOSINGOFFER,CLOSINGOFFER)
12 0 1 12.5 0.1 6xm9p9uy5kaap
Module: SQL*Plus
SELECT count(*) FROM TIBEX_INSTRUMENTSTATE WHERE INSTRUMENTID=:"SYS_B_0"
SQL ordered by CPU Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
CPU Elapsed CPU per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
906 13,664 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
368 2,524 1 367.51 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
195 8,792 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
177 1,414 1 176.93 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
137 742 1 137.38 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
11 274 1 10.82 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
10 21 1 9.65 0.2 bbc1ck8594kvjEdited by: NM on 10-Sep-2010 07:39 -
Database Performace Is Very Poor On IBM AIX Compared To Windows NT
Hi,
Recently we have migrated Our Oracle 10g DataBase from Windows NT to IBM AIX Box. Unfortunately, the Database Performance is gone down when compared to Windows NT environment. Since been a week we are working to pick the problem. We have altered the init.ora parameters to see the database behaviour., But there no Improvement is been observerd.
Below are the Init.Ora Parameters ,
Name Value Description
tracefile_identifier null trace file custom identifier
lock_name_space null lock name space used for generating lock names for standby/clone database
processes 395 user processes
sessions 439 user and system sessions
timed_statistics TRUE maintain internal timing statistics
timed_os_statistics 0 internal os statistic gathering interval in seconds
resource_limit TRUE master switch for resource limit
license_max_sessions 0 maximum number of non-system user sessions allowed
license_sessions_warning 0 warning level for number of non-system user sessions
cpu_count 16 number of CPUs for this instance
instance_groups null list of instance group names
event null debug event control - default null string
sga_max_size 15032385536 max total SGA size
pre_page_sga FALSE pre-page sga for process
shared_memory_address 0 SGA starting address (low order 32-bits on 64-bit platforms)
hi_shared_memory_address 0 SGA starting address (high order 32-bits on 64-bit platforms)
use_indirect_data_buffers FALSE Enable indirect data buffers (very large SGA on 32-bit platforms)
lock_sga TRUE Lock entire SGA in physical memory
shared_pool_size 0 size in bytes of shared pool
large_pool_size 0 size in bytes of large pool
java_pool_size 0 size in bytes of java pool
streams_pool_size 50331648 size in bytes of the streams pool
shared_pool_reserved_size 84724940 size in bytes of reserved area of shared pool
java_soft_sessionspace_limit 0 warning limit on size in bytes of a Java sessionspace
java_max_sessionspace_size 0 max allowed size in bytes of a Java sessionspace
spfile /oracle/app/product/10.2.0.3.0/dbs/spfileCALMDB.ora server parameter file
instance_type RDBMS type of instance to be executed
trace_enabled FALSE enable KST tracing
nls_language AMERICAN NLS language name
nls_territory AMERICA NLS territory name
nls_sort null NLS linguistic definition name
nls_date_language null NLS date language name
nls_date_format null NLS Oracle date format
nls_currency null NLS local currency symbol
nls_numeric_characters null NLS numeric characters
nls_iso_currency null NLS ISO currency territory name
nls_calendar null NLS calendar system name
nls_time_format null time format
nls_timestamp_format null time stamp format
nls_time_tz_format null time with timezone format
nls_timestamp_tz_format null timestampe with timezone format
nls_dual_currency null Dual currency symbol
nls_comp null NLS comparison
nls_length_semantics BYTE create columns using byte or char semantics by default
nls_nchar_conv_excp FALSE NLS raise an exception instead of allowing implicit conversion
fileio_network_adapters null Network Adapters for File I/O
filesystemio_options asynch IO operations on filesystem files
disk_asynch_io FALSE Use asynch I/O for random access devices
tape_asynch_io TRUE Use asynch I/O requests for tape devices
dbwr_io_slaves 0 DBWR I/O slaves
backup_tape_io_slaves FALSE BACKUP Tape I/O slaves
resource_manager_plan null resource mgr top plan
cluster_interconnects null interconnects for RAC use
file_mapping FALSE enable file mapping
gcs_server_processes 0 number of background gcs server processes to start
active_instance_count null number of active instances in the cluster database
sga_target 15032385536 Target size of SGA
control_files /oradata10/oradata/CALMDB/control/CONTROL02.CTL control file names list
db_file_name_convert null datafile name convert patterns and strings for standby/clone db
log_file_name_convert null logfile name convert patterns and strings for standby/clone db
control_file_record_keep_time 0 control file record keep time in days
db_block_buffers 0 Number of database blocks cached in memory
db_block_checksum TRUE store checksum in db blocks and check during reads
db_block_size 8192 Size of database block in bytes
db_cache_size 2147483648 Size of DEFAULT buffer pool for standard block size buffers
db_2k_cache_size 0 Size of cache for 2K buffers
db_4k_cache_size 0 Size of cache for 4K buffers
db_8k_cache_size 0 Size of cache for 8K buffers
db_16k_cache_size 0 Size of cache for 16K buffers
db_32k_cache_size 0 Size of cache for 32K buffers
db_keep_cache_size 0 Size of KEEP buffer pool for standard block size buffers
db_recycle_cache_size 0 Size of RECYCLE buffer pool for standard block size buffers
db_writer_processes 6 number of background database writer processes to start
buffer_pool_keep null Number of database blocks/latches in keep buffer pool
buffer_pool_recycle null Number of database blocks/latches in recycle buffer pool
db_cache_advice ON Buffer cache sizing advisory
max_commit_propagation_delay 0 Max age of new snapshot in .01 seconds
compatible 10.2.0.3.0 Database will be completely compatible with this software version
remote_archive_enable TRUE remote archival enable setting
log_archive_config null log archive config parameter
log_archive_start FALSE start archival process on SGA initialization
log_archive_dest null archival destination text string
log_archive_duplex_dest null duplex archival destination text string
log_archive_dest_1 null archival destination #1 text string
log_archive_dest_2 null archival destination #2 text string
log_archive_dest_3 null archival destination #3 text string
log_archive_dest_4 null archival destination #4 text string
log_archive_dest_5 null archival destination #5 text string
log_archive_dest_6 null archival destination #6 text string
log_archive_dest_7 null archival destination #7 text string
log_archive_dest_8 null archival destination #8 text string
log_archive_dest_9 null archival destination #9 text string
log_archive_dest_10 null archival destination #10 text string
log_archive_dest_state_1 enable archival destination #1 state text string
log_archive_dest_state_2 enable archival destination #2 state text string
log_archive_dest_state_3 enable archival destination #3 state text string
log_archive_dest_state_4 enable archival destination #4 state text string
log_archive_dest_state_5 enable archival destination #5 state text string
log_archive_dest_state_6 enable archival destination #6 state text string
log_archive_dest_state_7 enable archival destination #7 state text string
log_archive_dest_state_8 enable archival destination #8 state text string
log_archive_dest_state_9 enable archival destination #9 state text string
log_archive_dest_state_10 enable archival destination #10 state text string
log_archive_max_processes 2 maximum number of active ARCH processes
log_archive_min_succeed_dest 1 minimum number of archive destinations that must succeed
standby_archive_dest ?/dbs/arch standby database archivelog destination text string
log_archive_trace 0 Establish archivelog operation tracing level
log_archive_local_first TRUE Establish EXPEDITE attribute default value
log_archive_format %t_%s_%r.dbf archival destination format
fal_client null FAL client
fal_server null FAL server list
log_buffer 176918528 redo circular buffer size
log_checkpoint_interval 0 # redo blocks checkpoint threshold
log_checkpoint_timeout 0 Maximum time interval between checkpoints in seconds
archive_lag_target 0 Maximum number of seconds of redos the standby could lose
db_files 200 max allowable # db files
db_file_multiblock_read_count 128 db block to be read each IO
read_only_open_delayed FALSE if TRUE delay opening of read only files until first access
cluster_database FALSE if TRUE startup in cluster database mode
parallel_server FALSE if TRUE startup in parallel server mode
parallel_server_instances 1 number of instances to use for sizing OPS SGA structures
cluster_database_instances 1 number of instances to use for sizing cluster db SGA structures
db_create_file_dest null default database location
db_create_online_log_dest_1 null online log/controlfile destination #1
db_create_online_log_dest_2 null online log/controlfile destination #2
db_create_online_log_dest_3 null online log/controlfile destination #3
db_create_online_log_dest_4 null online log/controlfile destination #4
db_create_online_log_dest_5 null online log/controlfile destination #5
db_recovery_file_dest null default database recovery file location
db_recovery_file_dest_size 0 database recovery files size limit
standby_file_management MANUAL if auto then files are created/dropped automatically on standby
gc_files_to_locks null mapping between file numbers and global cache locks
thread 0 Redo thread to mount
fast_start_io_target 0 Upper bound on recovery reads
fast_start_mttr_target 0 MTTR target of forward crash recovery in seconds
log_checkpoints_to_alert FALSE log checkpoint begin/end to alert file
recovery_parallelism 0 number of server processes to use for parallel recovery
logmnr_max_persistent_sessions 1 maximum number of threads to mine
db_flashback_retention_target 1440 Maximum Flashback Database log retention time in minutes.
dml_locks 1000 dml locks - one for each table modified in a transaction
ddl_wait_for_locks FALSE Disable NOWAIT DML lock acquisitions
replication_dependency_tracking TRUE tracking dependency for Replication parallel propagation
instance_number 0 instance number
transactions 482 max. number of concurrent active transactions
transactions_per_rollback_segment 5 number of active transactions per rollback segment
rollback_segments null undo segment list
undo_management AUTO instance runs in SMU mode if TRUE, else in RBU mode
undo_tablespace UNDOTBS1 use/switch undo tablespace
undo_retention 10800 undo retention in seconds
fast_start_parallel_rollback LOW max number of parallel recovery slaves that may be used
resumable_timeout 0 set resumable_timeout
db_block_checking FALSE header checking and data and index block checking
recyclebin off recyclebin processing
create_stored_outlines null create stored outlines for DML statements
serial_reuse disable reuse the frame segments
ldap_directory_access NONE RDBMS's LDAP access option
os_roles FALSE retrieve roles from the operating system
rdbms_server_dn null RDBMS's Distinguished Name
max_enabled_roles 150 max number of roles a user can have enabled
remote_os_authent FALSE allow non-secure remote clients to use auto-logon accounts
remote_os_roles FALSE allow non-secure remote clients to use os roles
O7_DICTIONARY_ACCESSIBILITY FALSE Version 7 Dictionary Accessibility Support
remote_login_passwordfile NONE password file usage parameter
license_max_users 0 maximum number of named users that can be created in the database
audit_sys_operations TRUE enable sys auditing
global_context_pool_size null Global Application Context Pool Size in Bytes
db_domain null directory part of global database name stored with CREATE DATABASE
global_names TRUE enforce that database links have same name as remote database
distributed_lock_timeout 60 number of seconds a distributed transaction waits for a lock
commit_point_strength 1 Bias this node has toward not preparing in a two-phase commit
instance_name CALMDB instance name supported by the instance
service_names CALMDB service names supported by the instance
dispatchers (PROTOCOL=TCP) (SERVICE=CALMDB) specifications of dispatchers
shared_servers 1 number of shared servers to start up
max_shared_servers null max number of shared servers
max_dispatchers null max number of dispatchers
circuits null max number of circuits
shared_server_sessions null max number of shared server sessions
local_listener null local listener
remote_listener null remote listener
cursor_space_for_time FALSE use more memory in order to get faster execution
session_cached_cursors 200 Number of cursors to cache in a session.
remote_dependencies_mode TIMESTAMP remote-procedure-call dependencies mode parameter
utl_file_dir null utl_file accessible directories list
smtp_out_server null utl_smtp server and port configuration parameter
plsql_v2_compatibility FALSE PL/SQL version 2.x compatibility flag
plsql_compiler_flags INTERPRETED, NON_DEBUG PL/SQL compiler flags
plsql_native_library_dir null plsql native library dir
plsql_native_library_subdir_count 0 plsql native library number of subdirectories
plsql_warnings DISABLE:ALL PL/SQL compiler warnings settings
plsql_code_type INTERPRETED PL/SQL code-type
plsql_debug FALSE PL/SQL debug
plsql_optimize_level 2 PL/SQL optimize level
plsql_ccflags null PL/SQL ccflags
job_queue_processes 10 number of job queue slave processes
parallel_min_percent 0 minimum percent of threads required for parallel query
create_bitmap_area_size 8388608 size of create bitmap buffer for bitmap index
bitmap_merge_area_size 1048576 maximum memory allow for BITMAP MERGE
cursor_sharing FORCE cursor sharing mode
parallel_min_servers 10 minimum parallel query servers per instance
parallel_max_servers 320 maximum parallel query servers per instance
parallel_instance_group null instance group to use for all parallel operations
parallel_execution_message_size 4096 message buffer size for parallel execution
hash_area_size 62914560 size of in-memory hash work area
shadow_core_dump partial Core Size for Shadow Processes
background_core_dump partial Core Size for Background Processes
background_dump_dest /oradata28/oradata/CALMDB/bdump Detached process dump directory
user_dump_dest /oradata28/oradata/CALMDB/udump User process dump directory
max_dump_file_size 10M Maximum size (blocks) of dump file
core_dump_dest /oradata28/oradata/CALMDB/cdump Core dump directory
use_sigio TRUE Use SIGIO signal
audit_file_dest /oracle/app/product/10.2.0.3.0/rdbms/audit Directory in which auditing files are to reside
audit_syslog_level null Syslog facility and level
object_cache_optimal_size 102400 optimal size of the user session's object cache in bytes
object_cache_max_size_percent 10 percentage of maximum size over optimal of the user session's object cache
session_max_open_files 20 maximum number of open files allowed per session
open_links 4 max # open links per session
open_links_per_instance 4 max # open links per instance
commit_write null transaction commit log write behaviour
optimizer_features_enable 10.2.0.3 optimizer plan compatibility parameter
fixed_date null fixed SYSDATE value
audit_trail DB enable system auditing
sort_area_size 31457280 size of in-memory sort work area
sort_area_retained_size 3145728 size of in-memory sort work area retained between fetch calls
db_name TESTDB database name specified in CREATE DATABASE
db_unique_name TESTDB Database Unique Name
open_cursors 2000 max # cursors per session
ifile null include file in init.ora
sql_trace FALSE enable SQL trace
os_authent_prefix ops$ prefix for auto-logon accounts
optimizer_mode ALL_ROWS optimizer mode
sql92_security FALSE require select privilege for searched update/delete
blank_trimming FALSE blank trimming semantics parameter
star_transformation_enabled FALSE enable the use of star transformation
parallel_adaptive_multi_user TRUE enable adaptive setting of degree for multiple user streams
parallel_threads_per_cpu 2 number of parallel execution threads per CPU
parallel_automatic_tuning TRUE enable intelligent defaults for parallel execution parameters
optimizer_index_cost_adj 250 optimizer index cost adjustment
optimizer_index_caching 0 optimizer percent index caching
query_rewrite_enabled TRUE allow rewrite of queries using materialized views if enabled
query_rewrite_integrity enforced perform rewrite using materialized views with desired integrity
sql_version NATIVE sql language version parameter for compatibility issues
pga_aggregate_target 3221225472 Target size for the aggregate PGA memory consumed by the instance
workarea_size_policy AUTO policy used to size SQL working areas (MANUAL/AUTO)
optimizer_dynamic_sampling 2 optimizer dynamic sampling
statistics_level TYPICAL statistics level
skip_unusable_indexes TRUE skip unusable indexes if set to TRUE
optimizer_secure_view_merging TRUE optimizer secure view merging and predicate pushdown/movearound
aq_tm_processes 1 number of AQ Time Managers to start
hs_autoregister TRUE enable automatic server DD updates in HS agent self-registration
dg_broker_start FALSE start Data Guard broker framework (DMON process)
drs_start FALSE start DG Broker monitor (DMON process)
dg_broker_config_file1 /oracle/app/product/10.2.0.3.0/dbs/dr1CALMDB.dat data guard broker configuration file #1
dg_broker_config_file2 /oracle/app/product/10.2.0.3.0/dbs/dr2CALMDB.dat data guard broker configuration file #2
olap_page_pool_size 0 size of the olap page pool in bytes
asm_diskstring null disk set locations for discovery
asm_diskgroups null disk groups to mount automatically
asm_power_limit 1 number of processes for disk rebalancing
sqltune_category DEFAULT Category qualifier for applying hintsets pls suggest
Thanks
KrWe have examined the AWR Reports, That shows ,
Snap Id Snap Time Sessions Cursors/Session
Begin Snap: 1074 27-Jul-09 13:00:03 147 16.7
End Snap: 1075 27-Jul-09 14:01:00 150 22.3
Elapsed: 60.96 (mins)
DB Time: 9.63 (mins)
Report Summary
Cache Sizes
Begin End
Buffer Cache: 12,368M 12,368M Std Block Size: 8K
Shared Pool Size: 1,696M 1,696M Log Buffer: 178,172K
Load Profile
Per Second Per Transaction
Redo size: 12,787.87 24,786.41
Logical reads: 7,409.85 14,362.33
Block changes: 61.17 118.57
Physical reads: 0.51 0.98
Physical writes: 4.08 7.90
User calls: 60.11 116.50
Parses: 19.38 37.56
Hard parses: 0.36 0.69
Sorts: 7.87 15.25
Logons: 0.07 0.14
Executes: 50.34 97.57
Transactions: 0.52
% Blocks changed per Read: 0.83 Recursive Call %: 74.53
Rollback per transaction %: 3.29 Rows per Sort: 292.67
Instance Efficiency Percentages (Target 100%)
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 99.99 In-memory Sort %: 100.00
Library Hit %: 98.40 Soft Parse %: 98.15
Execute to Parse %: 61.51 Latch Hit %: 99.96
Parse CPU to Parse Elapsd %: 24.44 % Non-Parse CPU: 98.99
Shared Pool Statistics
Begin End
Memory Usage %: 72.35 72.86
% SQL with executions>1: 98.69 96.86
% Memory for SQL w/exec>1: 96.72 87.64
Top 5 Timed Events
Event Waits Time(s) Avg Wait(ms) % Total Call Time Wait Class
CPU time 535 92.5
db file parallel write 596 106 177 18.3 System I/O
log file parallel write 3,844 40 10 6.9 System I/O
control file parallel write 1,689 29 17 5.0 System I/O
log file sync 2,357 29 12 5.0 Commit
Time Model Statistics
Total time in database user-calls (DB Time): 578s
Statistics including the word "background" measure background process time, and so do not contribute to the DB time statistic
Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 560.61 96.99
DB CPU 534.91 92.55
parse time elapsed 24.16 4.18
hard parse elapsed time 17.90 3.10
PL/SQL execution elapsed time 7.65 1.32
connection management call elapsed time 0.89 0.15
repeated bind elapsed time 0.49 0.08
hard parse (sharing criteria) elapsed time 0.28 0.05
sequence load elapsed time 0.05 0.01
PL/SQL compilation elapsed time 0.03 0.00
failed parse elapsed time 0.02 0.00
hard parse (bind mismatch) elapsed time 0.00 0.00
DB time 577.98
background elapsed time 190.39
background cpu time 15.49
Wait Class
s - second
cs - centisecond - 100th of a second
ms - millisecond - 1000th of a second
us - microsecond - 1000000th of a second
ordered by wait time desc, waits desc
Wait Class Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn
System I/O 8,117 0.00 175 22 4.30
Commit 2,357 0.00 29 12 1.25
Network 226,127 0.00 7 0 119.83
User I/O 1,004 0.00 4 4 0.53
Application 91 0.00 2 27 0.05
Other 269 0.00 1 4 0.14
Concurrency 32 0.00 0 7 0.02
Configuration 59 0.00 0 3 0.03
Wait Events
s - second
cs - centisecond - 100th of a second
ms - millisecond - 1000th of a second
us - microsecond - 1000000th of a second
ordered by wait time desc, waits desc (idle events last)
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn
db file parallel write 596 0.00 106 177 0.32
log file parallel write 3,844 0.00 40 10 2.04
control file parallel write 1,689 0.00 29 17 0.90
log file sync 2,357 0.00 29 12 1.25
SQL*Net more data from client 4,197 0.00 7 2 2.22
db file sequential read 689 0.00 4 5 0.37
enq: RO - fast object reuse 32 0.00 2 50 0.02
rdbms ipc reply 32 0.00 1 34 0.02
db file scattered read 289 0.00 1 2 0.15
enq: KO - fast object checkpoint 47 0.00 1 14 0.02
control file sequential read 1,988 0.00 0 0 1.05
SQL*Net message to client 218,154 0.00 0 0 115.61
os thread startup 6 0.00 0 34 0.00
SQL*Net break/reset to client 12 0.00 0 15 0.01
log buffer space 59 0.00 0 3 0.03
latch free 10 0.00 0 8 0.01
SQL*Net more data to client 3,776 0.00 0 0 2.00
latch: shared pool 5 0.00 0 5 0.00
reliable message 79 0.00 0 0 0.04
LGWR wait for redo copy 148 0.00 0 0 0.08
buffer busy waits 19 0.00 0 0 0.01
direct path write temp 24 0.00 0 0 0.01
latch: cache buffers chains 2 0.00 0 0 0.00
direct path write 2 0.00 0 0 0.00
SQL*Net message from client 218,149 0.00 136,803 627 115.61
PX Idle Wait 18,013 100.06 35,184 1953 9.55
virtual circuit status 67,690 0.01 3,825 57 35.87
Streams AQ: qmn slave idle wait 130 0.00 3,563 27404 0.07
Streams AQ: qmn coordinator idle wait 264 50.76 3,563 13494 0.14
class slave wait 3 0.00 0 0 0.00
Back to Wait Events Statistics
Back to Top
Background Wait Events
ordered by wait time desc, waits desc (idle events last)
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn
db file parallel write 596 0.00 106 177 0.32
log file parallel write 3,843 0.00 40 10 2.04
control file parallel write 1,689 0.00 29 17 0.90
os thread startup 6 0.00 0 34 0.00
log buffer space 59 0.00 0 3 0.03
control file sequential read 474 0.00 0 0 0.25
log file sync 1 0.00 0 11 0.00
events in waitclass Other 148 0.00 0 0 0.08
rdbms ipc message 32,384 54.67 49,367 1524 17.16
pmon timer 1,265 100.00 3,568 2821 0.67
Streams AQ: qmn slave idle wait 130 0.00 3,563 27404 0.07
Streams AQ: qmn coordinator idle wait 264 50.76 3,563 13494 0.14
smon timer 63 11.11 3,493 55447 0.03
SQL ordered by Gets
Resources reported for PL/SQL code includes the resources used by all SQL statements called by the code.
Total Buffer Gets: 27,101,711
Captured SQL account for 81.1% of Total
Buffer Gets Executions Gets per Exec %Total CPU Time (s) Elapsed Time (s) SQL Id SQL Module SQL Text
11,889,257 3 3,963,085.67 43.87 145.36 149.62 8hr7mrcqpvw7n Begin Pkg_Pg_consolidation.Pro...
5,877,417 17,784 330.49 21.69 59.94 62.30 3mw7tf64wzgv4 SELECT TOTALVOL.PERIOD_NUMBER ...
5,877,303 17,784 330.48 21.69 62.01 63.54 g3vhvg8cz6yu3 SELECT TOTALVOL.PERIOD_NUMBER ...
3,423,336 0 12.63 200.67 200.67 6jrnq2ua8cjnq SELECT ROWNUM , first , sec...
2,810,100 2,465 1,140.00 10.37 19.29 19.29 7f4y1a3k1tzjn SELECT /*+CLUSTER(VA_STATIC_CC...
1,529,253 230 6,648.93 5.64 15.92 16.97 6trp3txn7rh1q SELECT /*+ index(va_gap_irlc_P...
1,523,043 230 6,621.93 5.62 16.22 17.18 3fu81ar131nj9 SELECT /*+ index(va_gap_irla_P...
855,620 358 2,390.00 3.16 11.49 13.31 a3g12c11x7yd0 SELECT FX_DATE, FX_RATE, CCY...
689,979 708 974.55 2.55 4.37 4.43 b7znr5szwjrtx SELECT /*+RULE*/ YIELD_CURVE_C...
603,631 2,110 286.08 2.23 11.03 13.40 3c2gyz9fhswxx SELECT ASSET_LIABILITY_GAP, AL...
554,080 5 110,816.00 2.04 2.37 2.44 9w1b11p6baqat SELECT DISTINCT consolidation_...
318,378 624 510.22 1.17 3.20 3.45 1auhbw1rd5yn2 SELECT /*+ index(va_gap_irla_P...
318,378 624 510.22 1.17 3.19 3.42 6gq9rj96p9aq0 SELECT /*+ index(va_gap_irlc_P...
313,923 3 104,641.00 1.16 2.38 2.38 7vsznt4tvh1b5 ...
SQL ordered by Reads
Total Disk Reads: 1,857
Captured SQL account for 2.1% of Total
Physical Reads Executions Reads per Exec %Total CPU Time (s) Elapsed Time (s) SQL Id SQL Module SQL Text
57 36 1.58 3.07 3.55 5.81 c6vdhsbw1t03d BEGIN citidba.proc_analyze_tab...
32 507 0.06 1.72 0.22 0.40 c49tbx3qqrtm4 insert into dependency$(d_obj#...
28 8 3.50 1.51 0.76 3.02 4crh3z5ya2r27 BEGIN PROC_DELETE_PACK_TABLES(...
20 3 6.67 1.08 145.36 149.62 8hr7mrcqpvw7n Begin Pkg_Pg_consolidation.Pro...
10 1 10.00 0.54 6.21 18.11 4m9ts1b1b27sv BEGIN domain.create_tables(:1,...
7 23 0.30 0.38 1.56 2.22 4vw03w673b9k7 BEGIN PROC_CREATE_PACK_TABLES(...
4 4 1.00 0.22 0.29 1.06 1vw6carbvp4z0 BEGIN Proc_ReCreate_Gap_temp_t...
2 182 0.01 0.11 0.06 0.08 2h0gb24h6zpnu insert into access$(d_obj#, or...
2 596 0.00 0.11 0.26 0.29 5fbmafvm27kfm insert into obj$(owner#, name,...
1 1 1.00 0.05 0.01 0.02 7jsrvff8hnqft UPDATE VA_PRR_IRUT_POL_IBCB_R...
SQL ordered by Executions
Total Executions: 184,109
Captured SQL account for 71.6% of Total
Executions Rows Processed Rows per Exec CPU per Exec (s) Elap per Exec (s) SQL Id SQL Module SQL Text
43,255 43,255 1.00 0.00 0.00 4m94ckmu16f9k JDBC Thin Client select count(*) from dual
25,964 24,769 0.95 0.00 0.00 2kxdq3m953pst SELECT SURROGATE_KEY FROM TB_P...
17,784 54,585 3.07 0.00 0.00 3mw7tf64wzgv4 SELECT TOTALVOL.PERIOD_NUMBER ...
17,784 54,585 3.07 0.00 0.00 g3vhvg8cz6yu3 SELECT TOTALVOL.PERIOD_NUMBER ...
2,631 2,631 1.00 0.00 0.00 60uw2vh6q9vn2 insert into col$(obj#, name, i...
2,465 924,375 375.00 0.01 0.01 7f4y1a3k1tzjn SELECT /*+CLUSTER(VA_STATIC_CC...
2,202 36 0.02 0.00 0.00 96g93hntrzjtr select /*+ rule */ bucket_cnt,...
2,110 206,464 97.85 0.01 0.01 3c2gyz9fhswxx SELECT ASSET_LIABILITY_GAP, AL...
2,043 2,043 1.00 0.00 0.00 28dvpph9k610y SELECT COUNT(*) FROM TB_TECH_S...
842 35 0.04 0.00 0.00 04xtrk7uyhknh select obj#, type#, ctime, mti...
SQL ordered by Parse Calls
Total Parse Calls: 70,872
Captured SQL account for 69.7% of Total
Parse Calls Executions % Total Parses SQL Id SQL Module SQL Text
17,784 17,784 25.09 3mw7tf64wzgv4 SELECT TOTALVOL.PERIOD_NUMBER ...
17,784 17,784 25.09 g3vhvg8cz6yu3 SELECT TOTALVOL.PERIOD_NUMBER ...
2,110 2,110 2.98 3c2gyz9fhswxx SELECT ASSET_LIABILITY_GAP, AL...
786 786 1.11 2s6amyv4qz2h2 exp@PSLDB03 (TNS V1-V3) SELECT INIEXT, SEXT, MINEXT,...
596 596 0.84 5fbmafvm27kfm insert into obj$(owner#, name,...
590 590 0.83 2ym6hhaq30r73 select type#, blocks, extents,...
550 550 0.78 7gtztzv329wg0 select c.name, u.name from co...
512 512 0.72 9qgtwh66xg6nz update seg$ set type#=:4, bloc...
480 480 0.68 6x2cz59yrxz3a exp@PSLDB03 (TNS V1-V3) SELECT NAME, OBJID, OWNER, ...
457 457 0.64 bsa0wjtftg3uw select file# from file$ where ...
Instance Activity Stats
Statistic Total per Second per Trans
CPU used by this session 54,051 14.78 28.64
CPU used when call started 53,326 14.58 28.26
CR blocks created 1,114 0.30 0.59
Cached Commit SCN referenced 755,322 206.51 400.28
Commit SCN cached 29 0.01 0.02
DB time 62,190 17.00 32.96
DBWR checkpoint buffers written 3,247 0.89 1.72
DBWR checkpoints 79 0.02 0.04
DBWR object drop buffers written 118 0.03 0.06
DBWR parallel query checkpoint buffers written 0 0.00 0.00
DBWR revisited being-written buffer 0 0.00 0.00
DBWR tablespace checkpoint buffers written 169 0.05 0.09
DBWR thread checkpoint buffers written 3,078 0.84 1.63
DBWR transaction table writes 0 0.00 0.00
DBWR undo block writes 11,245 3.07 5.96
DFO trees parallelized 0 0.00 0.00
DML statements parallelized 0 0.00 0.00
IMU CR rollbacks 29 0.01 0.02
IMU Flushes 982 0.27 0.52
IMU Redo allocation size 1,593,112 435.57 844.26
IMU commits 991 0.27 0.53
IMU contention 3 0.00 0.00
IMU ktichg flush 3 0.00 0.00
IMU pool not allocated 0 0.00 0.00
IMU recursive-transaction flush 1 0.00 0.00
IMU undo allocation size 3,280,968 897.05 1,738.72
IMU- failed to get a private strand 0 0.00 0.00
Misses for writing mapping 0 0.00 0.00
OS Integral shared text size 0 0.00 0.00
OS Integral unshared data size 0 0.00 0.00
OS Involuntary context switches 0 0.00 0.00
OS Maximum resident set size 0 0.00 0.00
OS Page faults 0 0.00 0.00
OS Page reclaims 0 0.00 0.00
OS System time used 0 0.00 0.00
OS User time used 0 0.00 0.00
OS Voluntary context switches 0 0.00 0.00
PX local messages recv'd 0 0.00 0.00
PX local messages sent 0 0.00 0.00
Parallel operations downgraded to serial 0 0.00 0.00
Parallel operations not downgraded 0 0.00 0.00
SMON posted for dropping temp segment 0 0.00 0.00
SMON posted for undo segment shrink 0 0.00 0.00
SQL*Net roundtrips to/from client 266,339 72.82 141.14
active txn count during cleanout 677 0.19 0.36
application wait time 243 0.07 0.13
background checkpoints completed 0 0.00 0.00
background checkpoints started 0 0.00 0.00
background timeouts 17,769 4.86 9.42
branch node splits 0 0.00 0.00
buffer is not pinned count 11,606,002 3,173.19 6,150.50
buffer is pinned count 65,043,685 17,783.53 34,469.36
bytes received via SQL*Net from client 27,009,252 7,384.57 14,313.33
bytes sent via SQL*Net to client ############### 69,310,703.02 134,343,168.92
calls to get snapshot scn: kcmgss 382,084 104.47 202.48
calls to kcmgas 15,558 4.25 8.24
calls to kcmgcs 1,886 0.52 1.00
change write time 488 0.13 0.26
cleanout - number of ktugct calls 628 0.17 0.33
cleanouts and rollbacks - consistent read gets 3 0.00 0.00
cleanouts only - consistent read gets 53 0.01 0.03
cluster key scan block gets 77,478 21.18 41.06
cluster key scans 41,479 11.34 21.98
commit batch/immediate performed 550 0.15 0.29
commit batch/immediate requested 550 0.15 0.29
commit cleanout failures: block lost 0 0.00 0.00
commit cleanout failures: buffer being written 0 0.00 0.00
commit cleanout failures: callback failure 29 0.01 0.02
commit cleanout failures: cannot pin 0 0.00 0.00
commit cleanouts 19,562 5.35 10.37
commit cleanouts successfully completed 19,533 5.34 10.35
commit immediate performed 550 0.15 0.29
commit immediate requested 550 0.15 0.29
commit txn count during cleanout 396 0.11 0.21
concurrency wait time 23 0.01 0.01
consistent changes 1,803 0.49 0.96
consistent gets 26,887,134 7,351.18 14,248.61
consistent gets - examination 1,524,222 416.74 807.75
consistent gets direct 0 0.00 0.00
consistent gets from cache 26,887,134 7,351.18 14,248.61
cursor authentications 773 0.21 0.41
data blocks consistent reads - undo records applied 1,682 0.46 0.89
db block changes 223,743 61.17 118.57
db block gets 214,573 58.67 113.71
db block gets direct 74 0.02 0.04
db block gets from cache 214,499 58.65 113.67
deferred (CURRENT) block cleanout applications 9,723 2.66 5.15
dirty buffers inspected 5,106 1.40 2.71
enqueue conversions 1,130 0.31 0.60
enqueue releases 49,151 13.44 26.05
enqueue requests 49,151 13.44 26.05
enqueue timeouts 0 0.00 0.00
enqueue waits 79 0.02 0.04
exchange deadlocks 0 0.00 0.00
execute count 184,109 50.34 97.57
failed probes on index block reclamation 1 0.00 0.00
free buffer inspected 6,521 1.78 3.46
free buffer requested 8,656 2.37 4.59
global undo segment hints helped 0 0.00 0.00
global undo segment hints were stale 0 0.00 0.00
heap block compress 457 0.12 0.24
hot buffers moved to head of LRU 5,016 1.37 2.66
immediate (CR) block cleanout applications 56 0.02 0.03
immediate (CURRENT) block cleanout applications 4,230 1.16 2.24
index crx upgrade (found) 0 0.00 0.00
index crx upgrade (positioned) 8,362 2.29 4.43
index fast full scans (full) 3,845 1.05 2.04
index fast full scans (rowid ranges) 0 0.00 0.00
index fetch by key 842,761 230.42 446.61
index scans kdiixs1 376,413 102.91 199.48
leaf node 90-10 splits 42 0.01 0.02
leaf node splits 89 0.02 0.05
lob reads 6,759,932 1,848.23 3,582.37
lob writes 11,788 3.22 6.25
lob writes unaligned 11,788 3.22 6.25
logons cumulative 272 0.07 0.14
messages received 133,602 36.53 70.80
messages sent 133,602 36.53 70.80
no buffer to keep pinned count 219 0.06 0.12
no work - consistent read gets 18,462,318 5,047.76 9,783.95
opened cursors cumulative 77,042 21.06 40.83
parse count (failures) 57 0.02 0.03
parse count (hard) 1,311 0.36 0.69
parse count (total) 70,872 19.38 37.56
parse time cpu 542 0.15 0.29
parse time elapsed 2,218 0.61 1.18
physical read IO requests 821 0.22 0.44
physical read bytes 15,212,544 4,159.25 8,061.76
physical read total IO requests 2,953 0.81 1.56
physical read total bytes 48,963,584 13,387.08 25,947.85
physical read total multi block requests 289 0.08 0.15
physical reads 1,857 0.51 0.98
physical reads cache 1,857 0.51 0.98
physical reads cache prefetch 1,036 0.28 0.55
physical reads direct 0 0.00 0.00
physical reads direct (lob) 0 0.00 0.00
physical reads direct temporary tablespace 0 0.00 0.00
physical reads prefetch warmup 0 0.00 0.00
physical write IO requests 6,054 1.66 3.21
physical write bytes 122,142,720 33,394.92 64,728.52
physical write total IO requests 11,533 3.15 6.11
physical write total bytes 199,223,808 54,469.58 105,577.00
physical write total multi block requests 5,894 1.61 3.12
physical writes 14,910 4.08 7.90
physical writes direct 74 0.02 0.04
physical writes direct (lob) 0 0.00 0.00
physical writes direct temporary tablespace 72 0.02 0.04
physical writes from cache 14,836 4.06 7.86
physical writes non checkpoint 14,691 4.02 7.79
pinned buffers inspected 4 0.00 0.00
prefetch clients - default 0 0.00 0.00
prefetch warmup blocks aged out before use 0 0.00 0.00
prefetch warmup blocks flushed out before use 0 0.00 0.00
prefetched blocks aged out before use 0 0.00 0.00
process last non-idle time 2,370 0.65 1.26
queries parallelized 0 0.00 0.00
recovery blocks read 0 0.00 0.00
recursive aborts on index block reclamation 0 0.00 0.00
recursive calls 643,220 175.86 340.87
recursive cpu usage 15,900 4.35 8.43
redo blocks read for recovery 0 0.00 0.00
redo blocks written 96,501 26.38 51.14
redo buffer allocation retries 0 0.00 0.00
redo entries 115,246 31.51 61.07
redo log space requests 0 0.00 0.00
redo log space wait time 0 0.00 0.00
redo ordering marks 3,605 0.99 1.91 -
Performance issue showing read by other session Event
Hi All,
we are having a severe performance issue in my database when we are running batch jobs.
This was a new database(11.2.0.2) and we are testing the performance by running some batch jobs. These batch jobs included some inserts and updates.
I am seeing read by other session in top 5 timed events and cache buffers chains in Latch Miss Sources section.
Please help me to solve this out.
Inst Num Startup Time Release RAC
1 27-Feb-12 09:03 11.2.0.2.0 NO
Platform CPUs Cores Sockets Memory(GB)
Linux x86 64-bit 8 8 8 48.00
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 5605 29-Feb-12 03:00:27 63 4.5
End Snap: 5614 29-Feb-12 12:00:47 63 4.3
Elapsed: 540.32 (mins)
DB Time: 1,774.23 (mins)
Cache Sizes Begin End
~~~~~~~~~~~ ---------- ----------
Buffer Cache: 1,952M 1,952M Std Block Size: 16K
Shared Pool Size: 1,024M 1,024M Log Buffer: 18,868K
Load Profile Per Second Per Transaction Per Exec Per Call
~~~~~~~~~~~~ --------------- --------------- ---------- ----------
DB Time(s): 3.3 0.8 0.02 0.05
DB CPU(s): 1.1 0.3 0.01 0.02
Redo size: 55,763.8 13,849.3
Logical reads: 23,906.6 5,937.4
Block changes: 325.7 80.9
Physical reads: 665.6 165.3
Physical writes: 40.4 10.0
User calls: 60.7 15.1
Parses: 10.6 2.6
Hard parses: 1.1 0.3
W/A MB processed: 0.6 0.2
Logons: 0.1 0.0
Executes: 151.2 37.6
Rollbacks: 0.0 0.0
Transactions: 4.0
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 99.94 Redo NoWait %: 100.00
Buffer Hit %: 97.90 In-memory Sort %: 100.00
Library Hit %: 98.06 Soft Parse %: 90.16
Execute to Parse %: 92.96 Latch Hit %: 100.00
Parse CPU to Parse Elapsd %: 76.71 % Non-Parse CPU: 98.57
Shared Pool Statistics Begin End
Memory Usage %: 89.38 87.96
% SQL with executions>1: 97.14 95.15
% Memory for SQL w/exec>1: 96.05 92.46
Top 5 Timed Foreground Events
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Avg
wait % DB
Event Waits Time(s) (ms) time Wait Class
db file sequential read 14,092,706 65,613 5 61.6 User I/O
DB CPU 34,819 32.7
read by other session 308,534 1,260 4 1.2 User I/O
direct path read 97,454 987 10 .9 User I/O
db file scattered read 71,870 910 13 .9 User I/O
Host CPU (CPUs: 8 Cores: 8 Sockets: 8)
~~~~~~~~ Load Average
Begin End %User %System %WIO %Idle
0.43 0.36 13.7 0.6 9.7 85.7
Instance CPU
~~~~~~~~~~~~
% of total CPU for Instance: 13.5
% of busy CPU for Instance: 94.2
%DB time waiting for CPU - Resource Mgr: 0.0
Memory Statistics
~~~~~~~~~~~~~~~~~ Begin End
Host Mem (MB): 49,152.0 49,152.0
SGA use (MB): 3,072.0 3,072.0
PGA use (MB): 506.5 629.1
% Host Mem used for SGA+PGA: 7.28 7.53
Time Model Statistics
-> Total time in database user-calls (DB Time): 106453.8s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 105,531.1 99.1
DB CPU 34,818.8 32.7
parse time elapsed 714.7 .7
hard parse elapsed time 684.8 .6
PL/SQL execution elapsed time 161.9 .2
PL/SQL compilation elapsed time 44.2 .0
connection management call elapsed time 16.9 .0
hard parse (sharing criteria) elapsed time 10.2 .0
hard parse (bind mismatch) elapsed time 9.4 .0
sequence load elapsed time 2.9 .0
repeated bind elapsed time 0.5 .0
failed parse elapsed time 0.0 .0
DB time 106,453.8
background elapsed time 1,753.9
background cpu time 61.7
Operating System Statistics
-> *TIME statistic values are diffed.
All others display actual values. End Value is displayed if different
-> ordered by statistic type (CPU Use, Virtual Memory, Hardware Config), Name
Statistic Value End Value
BUSY_TIME 3,704,415
IDLE_TIME 22,203,740
IOWAIT_TIME 2,517,864
NICE_TIME 3
SYS_TIME 145,696
USER_TIME 3,557,758
LOAD 0 0
RSRC_MGR_CPU_WAIT_TIME 0
VM_IN_BYTES 358,813,045,760
VM_OUT_BYTES 29,514,830,848
PHYSICAL_MEMORY_BYTES 51,539,607,552
NUM_CPUS 8
NUM_CPU_CORES 8
NUM_CPU_SOCKETS 8
GLOBAL_RECEIVE_SIZE_MAX 4,194,304
GLOBAL_SEND_SIZE_MAX 1,048,586
TCP_RECEIVE_SIZE_DEFAULT 87,380
TCP_RECEIVE_SIZE_MAX 4,194,304
TCP_RECEIVE_SIZE_MIN 4,096
TCP_SEND_SIZE_DEFAULT 16,384
TCP_SEND_SIZE_MAX 4,194,304
TCP_SEND_SIZE_MIN 4,096
Operating System Statistics -
Snap Time Load %busy %user %sys %idle %iowait
29-Feb 03:00:27 0.4 N/A N/A N/A N/A N/A
29-Feb 04:00:35 1.4 11.9 11.2 0.6 88.1 14.3
29-Feb 05:00:41 1.7 13.8 13.2 0.6 86.2 15.8
29-Feb 06:00:48 1.5 14.0 13.5 0.6 86.0 12.3
29-Feb 07:01:00 1.8 16.3 15.8 0.5 83.7 10.4
29-Feb 08:00:12 2.6 23.2 22.5 0.6 76.8 12.6
29-Feb 09:00:26 1.3 16.6 16.0 0.5 83.4 5.7
29-Feb 10:00:33 1.2 13.8 13.3 0.5 86.2 2.0
29-Feb 11:00:43 1.3 14.5 14.0 0.5 85.5 3.8
29-Feb 12:00:47 0.4 4.9 4.2 0.7 95.1 10.6
Foreground Wait Class
-> s - second, ms - millisecond - 1000th of a second
-> ordered by wait time desc, waits desc
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
-> Captured Time accounts for 97.9% of Total DB time 106,453.79 (s)
-> Total FG Wait Time: 69,415.64 (s) DB CPU time: 34,818.79 (s)
Avg
%Time Total Wait wait
Wait Class Waits -outs Time (s) (ms) %DB time
User I/O 14,693,843 0 69,222 5 65.0
DB CPU 34,819 32.7
Commit 40,629 0 119 3 0.1
System I/O 26,504 0 57 2 0.1
Network 1,945,010 0 11 0 0.0
Other 125,200 99 4 0 0.0
Application 2,673 0 2 1 0.0
Concurrency 3,059 0 1 0 0.0
Configuration 31 19 0 15 0.0
Foreground Wait Events
-> s - second, ms - millisecond - 1000th of a second
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by wait time desc, waits desc (idle events last)
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Avg
%Time Total Wait wait Waits % DB
Event Waits -outs Time (s) (ms) /txn time
db file sequential read 14,092,706 0 65,613 5 108.0 61.6
read by other session 308,534 0 1,260 4 2.4 1.2
direct path read 97,454 0 987 10 0.7 .9
db file scattered read 71,870 0 910 13 0.6 .9
db file parallel read 35,001 0 372 11 0.3 .3
log file sync 40,629 0 119 3 0.3 .1
control file sequential re 26,504 0 57 2 0.2 .1
direct path read temp 14,499 0 49 3 0.1 .0
direct path write temp 9,186 0 28 3 0.1 .0
SQL*Net message to client 1,923,973 0 5 0 14.7 .0
SQL*Net message from dblin 1,056 0 5 5 0.0 .0
Disk file operations I/O 8,848 0 2 0 0.1 .0
ASM file metadata operatio 36 0 2 54 0.0 .0
SQL*Net break/reset to cli 2,636 0 1 1 0.0 .0
ADR block file read 472 0 1 1 0.0 .0
os thread startup 8 0 1 74 0.0 .0
SQL*Net more data to clien 17,656 0 1 0 0.1 .0
asynch descriptor resize 123,852 100 0 0 0.9 .0
local write wait 110 0 0 4 0.0 .0
utl_file I/O 55,635 0 0 0 0.4 .0
log file switch (private s 8 0 0 52 0.0 .0
cursor: pin S wait on X 2 0 0 142 0.0 .0
enq: KO - fast object chec 13 0 0 20 0.0 .0
PX Deq: Slave Session Stat 248 0 0 1 0.0 .0
enq: RO - fast object reus 18 0 0 11 0.0 .0
latch: cache buffers chain 2,511 0 0 0 0.0 .0
latch: shared pool 195 0 0 1 0.0 .0
CSS initialization 12 0 0 8 0.0 .0
PX qref latch 54 100 0 2 0.0 .0
SQL*Net more data from cli 995 0 0 0 0.0 .0
SQL*Net more data from dbl 300 0 0 0 0.0 .0
kksfbc child completion 1 100 0 56 0.0 .0
library cache: mutex X 244 0 0 0 0.0 .0
PX Deq: Signal ACK RSG 124 0 0 0 0.0 .0
undo segment extension 6 100 0 7 0.0 .0
PX Deq: Signal ACK EXT 124 0 0 0 0.0 .0
library cache load lock 3 0 0 9 0.0 .0
ADR block file write 45 0 0 1 0.0 .0
CSS operation: action 12 0 0 2 0.0 .0
reliable message 28 0 0 1 0.0 .0
CSS operation: query 72 0 0 0 0.0 .0
latch: row cache objects 14 0 0 1 0.0 .0
enq: SQ - contention 17 0 0 0 0.0 .0
latch free 32 0 0 0 0.0 .0
buffer busy waits 52 0 0 0 0.0 .0
enq: PS - contention 16 0 0 0 0.0 .0
enq: TX - row lock content 6 0 0 1 0.0 .0
SQL*Net message to dblink 1,018 0 0 0 0.0 .0
cursor: pin S 23 0 0 0 0.0 .0
latch: cache buffers lru c 8 0 0 0 0.0 .0
SQL*Net message from clien 1,923,970 0 944,508 491 14.7
jobq slave wait 66,732 100 33,334 500 0.5
Streams AQ: waiting for me 6,481 100 32,412 5001 0.0
wait for unread message on 32,858 98 32,411 986 0.3
PX Deq: Execution Msg 1,448 0 190 131 0.0
PX Deq: Execute Reply 1,196 0 74 62 0.0
HS message to agent 228 0 4 19 0.0
single-task message 42 0 4 97 0.0
PX Deq Credit: send blkd 904 0 2 3 0.0
PX Deq Credit: need buffer 205 0 1 3 0.0
Foreground Wait Events
-> s - second, ms - millisecond - 1000th of a second
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by wait time desc, waits desc (idle events last)
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Avg
%Time Total Wait wait Waits % DB
Event Waits -outs Time (s) (ms) /txn time
PX Deq: Table Q Normal 4,291 0 1 0 0.0
PX Deq: Join ACK 124 0 0 1 0.0
PX Deq: Parse Reply 124 0 0 0 0.0
KSV master wait 256 0 0 0 0.0
Latch Miss Sources
-> only latches with sleeps are shown
-> ordered by name, sleeps desc
NoWait Waiter
Latch Name Where Misses Sleeps Sleeps
ASM map operation freeli kffmTranslate2 0 2 0
DML lock allocation ktadmc 0 2 0
FOB s.o list latch ksfd_allfob 0 2 2
In memory undo latch ktiFlushMe 0 5 0
In memory undo latch ktichg: child 0 3 0
PC and Classifier lists No latch 0 6 0
Real-time plan statistic keswxAddNewPlanEntry 0 20 20
SQL memory manager worka qesmmIRegisterWorkArea:1 0 1 1
active service list kswslogon: session logout 0 23 12
active service list kswssetsvc: PX session swi 0 6 1
active service list kswsite: service iterator 0 1 0
archive process latch kcrrgpll 0 3 3
cache buffers chains kcbgtcr_2 0 1,746 573
cache buffers chains kcbgtcr: fast path (cr pin 0 1,024 2,126
cache buffers chains kcbgcur_2 0 60 8
cache buffers chains kcbchg1: kslbegin: bufs no 0 16 3
cache buffers chains kcbgtcr: fast path 0 14 20
cache buffers chains kcbzibmlt: multi-block rea 0 10 0
cache buffers chains kcbrls_2 0 9 53
cache buffers chains kcbgtcr: kslbegin shared 0 8 1
cache buffers chains kcbrls_1 0 7 84
cache buffers chains kcbgtcr: kslbegin excl 0 6 14
cache buffers chains kcbnew: new latch again 0 6 0
cache buffers chains kcbzgb: scan from tail. no 0 6 0
cache buffers chains kcbzwb 0 5 8
cache buffers chains kcbgcur: fast path (shr) 0 3 0
cache buffers chains kcbget: pin buffer 0 3 0
cache buffers chains kcbzhngcbk2_1 0 1 0
cache buffers lru chain kcbzgws 0 19 0
cache buffers lru chain kcbo_link_q 0 3 0
call allocation ksuxds 0 14 10
call allocation ksudlp: top call 0 2 3
enqueue hash chains ksqgtl3 0 2 1
enqueue hash chains ksqrcl 0 1 2
enqueues ksqgel: create enqueue 0 1 0
object queue header oper kcbo_unlink_q 0 5 2
object queue header oper kcbo_sw_buf 0 2 0
object queue header oper kcbo_link_q 0 1 2
object queue header oper kcbo_switch_cq 0 1 2
object queue header oper kcbo_switch_mq_bg 0 1 4
parallel query alloc buf kxfpbalo 0 1 1
process allocation ksucrp:1 0 2 0
process queue reference kxfpqrsnd 0 1 0
qmn task queue latch kwqmnmvtsks: delay to read 0 1 0
redo allocation kcrfw_redo_gen: redo alloc 0 17 0
row cache objects kqreqd: reget 0 6 0
row cache objects kqrpre: find obj 0 6 13
row cache objects kqrso 0 2 0
row cache objects kqreqd 0 1 2
row cache objects kqrpre: init complete 0 1 1
shared pool kghalo 0 199 106
shared pool kghupr1 0 39 109
shared pool kghfre 0 18 19
shared pool kghalp 0 7 29
space background task la ktsj_grab_task 0 21 27
Mutex Sleep Summary
-> ordered by number of sleeps desc
Wait
Mutex Type Location Sleeps Time (ms)
Library Cache kglhdgn2 106 338 12
Library Cache kgllkc1 57 259 10
Library Cache kgllkdl1 85 123 21
Cursor Pin kkslce [KKSCHLPIN2] 70 286
Library Cache kglget2 2 31 1
Library Cache kglhdgn1 62 31 2
Library Cache kglpin1 4 26 1
Library Cache kglpnal1 90 18 0
Library Cache kglpndl1 95 15 2
Library Cache kgllldl2 112 6 0
Library Cache kglini1 32 1 0
-------------------------------------------------------------Thanks in advance.Hi,
Thanks for reply.
I provided one hour report.
Inst Num Startup Time Release RAC
1 27-Feb-12 09:03 11.2.0.2.0 NO
Platform CPUs Cores Sockets Memory(GB)
Linux x86 64-bit 8 8 8 48.00
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 5606 29-Feb-12 04:00:35 63 3.7
End Snap: 5607 29-Feb-12 05:00:41 63 3.6
Elapsed: 60.11 (mins)
DB Time: 382.67 (mins)
Cache Sizes Begin End
~~~~~~~~~~~ ---------- ----------
Buffer Cache: 1,952M 1,952M Std Block Size: 16K
Shared Pool Size: 1,024M 1,024M Log Buffer: 18,868K
Load Profile Per Second Per Transaction Per Exec Per Call
~~~~~~~~~~~~ --------------- --------------- ---------- ----------
DB Time(s): 6.4 0.8 0.03 0.03
DB CPU(s): 1.0 0.1 0.00 0.00
Redo size: 84,539.3 10,425.6
Logical reads: 23,345.6 2,879.1
Block changes: 386.5 47.7
Physical reads: 1,605.0 197.9
Physical writes: 7.1 0.9
User calls: 233.9 28.9
Parses: 4.0 0.5
Hard parses: 0.1 0.0
W/A MB processed: 0.1 0.0
Logons: 0.1 0.0
Executes: 210.9 26.0
Rollbacks: 0.0 0.0
Transactions: 8.1
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 99.62 Redo NoWait %: 100.00
Buffer Hit %: 95.57 In-memory Sort %: 100.00
Library Hit %: 99.90 Soft Parse %: 98.68
Execute to Parse %: 98.10 Latch Hit %: 99.99
Parse CPU to Parse Elapsd %: 32.08 % Non-Parse CPU: 99.90
Shared Pool Statistics Begin End
Memory Usage %: 89.25 89.45
% SQL with executions>1: 96.79 97.52
% Memory for SQL w/exec>1: 95.67 96.56
Top 5 Timed Foreground Events
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Avg
wait % DB
Event Waits Time(s) (ms) time Wait Class
db file sequential read 3,054,464 17,002 6 74.0 User I/O
DB CPU 3,748 16.3
read by other session 199,603 796 4 3.5 User I/O
direct path read 46,301 439 9 1.9 User I/O
db file scattered read 21,113 269 13 1.2 User I/O
Host CPU (CPUs: 8 Cores: 8 Sockets: 8)
~~~~~~~~ Load Average
Begin End %User %System %WIO %Idle
1.45 1.67 13.2 0.6 15.8 86.2
Instance CPU
~~~~~~~~~~~~
% of total CPU for Instance: 13.0
% of busy CPU for Instance: 94.7
%DB time waiting for CPU - Resource Mgr: 0.0
Memory Statistics
~~~~~~~~~~~~~~~~~ Begin End
Host Mem (MB): 49,152.0 49,152.0
SGA use (MB): 3,072.0 3,072.0
PGA use (MB): 513.5 467.7
% Host Mem used for SGA+PGA: 7.29 7.20
Time Model Statistics
-> Total time in database user-calls (DB Time): 22960.5s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 22,835.9 99.5
DB CPU 3,748.4 16.3
parse time elapsed 15.4 .1
hard parse elapsed time 14.3 .1
PL/SQL execution elapsed time 7.5 .0
PL/SQL compilation elapsed time 6.0 .0
connection management call elapsed time 1.6 .0
sequence load elapsed time 0.4 .0
hard parse (sharing criteria) elapsed time 0.0 .0
repeated bind elapsed time 0.0 .0
failed parse elapsed time 0.0 .0
DB time 22,960.5
background elapsed time 238.1
background cpu time 4.9
Operating System Statistics
-> *TIME statistic values are diffed.
All others display actual values. End Value is displayed if different
-> ordered by statistic type (CPU Use, Virtual Memory, Hardware Config), Name
Statistic Value End Value
BUSY_TIME 396,506
IDLE_TIME 2,483,725
IOWAIT_TIME 455,495
NICE_TIME 0
SYS_TIME 16,163
USER_TIME 380,052
LOAD 1 2
RSRC_MGR_CPU_WAIT_TIME 0
VM_IN_BYTES 95,646,943,232
VM_OUT_BYTES 1,686,059,008
PHYSICAL_MEMORY_BYTES 51,539,607,552
NUM_CPUS 8
NUM_CPU_CORES 8
NUM_CPU_SOCKETS 8
GLOBAL_RECEIVE_SIZE_MAX 4,194,304
GLOBAL_SEND_SIZE_MAX 1,048,586
TCP_RECEIVE_SIZE_DEFAULT 87,380
TCP_RECEIVE_SIZE_MAX 4,194,304
TCP_RECEIVE_SIZE_MIN 4,096
TCP_SEND_SIZE_DEFAULT 16,384
TCP_SEND_SIZE_MAX 4,194,304
TCP_SEND_SIZE_MIN 4,096
Operating System Statistics -
Snap Time Load %busy %user %sys %idle %iowait
29-Feb 04:00:35 1.4 N/A N/A N/A N/A N/A
29-Feb 05:00:41 1.7 13.8 13.2 0.6 86.2 15.8
Foreground Wait Class
-> s - second, ms - millisecond - 1000th of a second
-> ordered by wait time desc, waits desc
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
-> Captured Time accounts for 97.6% of Total DB time 22,960.46 (s)
-> Total FG Wait Time: 18,651.75 (s) DB CPU time: 3,748.35 (s)
Avg
%Time Total Wait wait
Wait Class Waits -outs Time (s) (ms) %DB time
User I/O 3,327,253 0 18,576 6 80.9
DB CPU 3,748 16.3
Commit 23,882 0 69 3 0.3
System I/O 1,035 0 3 3 0.0
Network 842,393 0 2 0 0.0
Other 10,120 99 0 0 0.0
Configuration 3 0 0 58 0.0
Application 264 0 0 1 0.0
Concurrency 1,482 0 0 0 0.0
Foreground Wait Events
-> s - second, ms - millisecond - 1000th of a second
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by wait time desc, waits desc (idle events last)
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Avg
%Time Total Wait wait Waits % DB
Event Waits -outs Time (s) (ms) /txn time
db file sequential read 3,054,464 0 17,002 6 104.5 74.0
read by other session 199,603 0 796 4 6.8 3.5
direct path read 46,301 0 439 9 1.6 1.9
db file scattered read 21,113 0 269 13 0.7 1.2
log file sync 23,882 0 69 3 0.8 .3
db file parallel read 4,727 0 68 14 0.2 .3
control file sequential re 1,035 0 3 3 0.0 .0
SQL*Net message to client 840,792 0 2 0 28.8 .0
direct path read temp 95 0 2 18 0.0 .0
local write wait 79 0 0 4 0.0 .0
Disk file operations I/O 870 0 0 0 0.0 .0
ASM file metadata operatio 4 0 0 50 0.0 .0
log file switch (private s 3 0 0 58 0.0 .0
ADR block file read 36 0 0 3 0.0 .0
enq: RO - fast object reus 5 0 0 16 0.0 .0
latch: cache buffers chain 1,465 0 0 0 0.1 .0
SQL*Net break/reset to cli 256 0 0 0 0.0 .0
asynch descriptor resize 10,059 100 0 0 0.3 .0
SQL*Net more data to clien 1,510 0 0 0 0.1 .0
enq: KO - fast object chec 3 0 0 8 0.0 .0
SQL*Net more data from cli 91 0 0 0 0.0 .0
latch: shared pool 14 0 0 0 0.0 .0
ADR block file write 5 0 0 1 0.0 .0
reliable message 8 0 0 0 0.0 .0
direct path write temp 1 0 0 2 0.0 .0
SQL*Net message from clien 840,794 0 68,885 82 28.8
jobq slave wait 7,365 100 3,679 499 0.3
Streams AQ: waiting for me 721 100 3,605 5000 0.0
wait for unread message on 3,648 98 3,603 988 0.1
KSV master wait 20 0 0 0 0.0
Background Wait Events
-> ordered by wait time desc, waits desc (idle events last)
-> Only events with Total Wait Time (s) >= .001 are shown
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Avg
%Time Total Wait wait Waits % bg
Event Waits -outs Time (s) (ms) /txn time
log file parallel write 29,353 0 83 3 1.0 34.8
db file parallel write 5,753 0 17 3 0.2 6.9
db file sequential read 1,638 0 15 9 0.1 6.1
control file sequential re 5,142 0 13 2 0.2 5.4
os thread startup 140 0 8 58 0.0 3.4
control file parallel writ 1,440 0 8 6 0.0 3.4
log file sequential read 304 0 8 26 0.0 3.3
db file scattered read 214 0 2 9 0.0 .8
ASM file metadata operatio 1,199 0 1 1 0.0 .3
direct path write 35 0 0 6 0.0 .1
direct path read 41 0 0 5 0.0 .1
kfk: async disk IO 6 0 0 9 0.0 .0
Disk file operations I/O 1,266 0 0 0 0.0 .0
ADR block file read 16 0 0 2 0.0 .0
read by other session 3 0 0 8 0.0 .0
Log archive I/O 2 0 0 10 0.0 .0
log file sync 3 0 0 5 0.0 .0
asynch descriptor resize 341 100 0 0 0.0 .0
CSS initialization 1 0 0 6 0.0 .0
log file single write 4 0 0 1 0.0 .0
latch: redo allocation 3 0 0 1 0.0 .0
ADR block file write 5 0 0 1 0.0 .0
LGWR wait for redo copy 45 0 0 0 0.0 .0
CSS operation: query 6 0 0 0 0.0 .0
CSS operation: action 1 0 0 1 0.0 .0
SQL*Net message to client 420 0 0 0 0.0 .0
rdbms ipc message 47,816 39 61,046 1277 1.6
DIAG idle wait 7,200 100 7,200 1000 0.2
Space Manager: slave idle 1,146 98 5,674 4951 0.0
class slave wait 284 0 3,983 14026 0.0
dispatcher timer 61 100 3,660 60006 0.0
Streams AQ: qmn coordinato 258 50 3,613 14003 0.0
Streams AQ: qmn slave idle 130 0 3,613 27789 0.0
Streams AQ: waiting for ti 7 71 3,608 515430 0.0
wait for unread message on 3,605 100 3,606 1000 0.1
pmon timer 1,201 100 3,604 3001 0.0
smon timer 15 73 3,603 240207 0.0
ASM background timer 754 0 3,602 4777 0.0
shared server idle wait 120 100 3,601 30006 0.0
SQL*Net message from clien 554 0 4 7 0.0
KSV master wait 101 0 0 2 0.0
Wait Event Histogram
-> Units for Total Waits column: K is 1000, M is 1000000, G is 1000000000
-> % of Waits: value of .0 indicates value was <.05%; value of null is truly 0
-> % of Waits: column heading of <=1s is truly <1024ms, >1s is truly >=1024ms
-> Ordered by Event (idle events last)
% of Waits
Total
Event Waits <1ms <2ms <4ms <8ms <16ms <32ms <=1s >1s
ADR block file read 52 73.1 1.9 9.6 13.5 1.9
ADR block file write 10 100.0
ADR file lock 12 100.0
ARCH wait for archivelog l 3 100.0
ASM file metadata operatio 1203 97.3 .5 .7 .3 .2 .9
CSS initialization 1 100.0
CSS operation: action 1 100.0
CSS operation: query 6 83.3 16.7
Disk file operations I/O 2118 95.4 4.5 .1
LGWR wait for redo copy 45 100.0
Log archive I/O 2 100.0
SQL*Net break/reset to cli 256 99.6 .4
SQL*Net message to client 839.9 100.0 .0
SQL*Net more data from cli 91 100.0
SQL*Net more data to clien 1503 100.0
asynch descriptor resize 10.4K 100.0
buffer busy waits 2 100.0
control file parallel writ 1440 5.7 35.1 24.0 16.3 12.0 5.5 1.5
control file sequential re 6177 69.4 7.5 5.9 8.1 7.1 1.7 .3
db file parallel read 4727 1.7 3.2 3.2 10.1 46.6 33.3 1.8
db file parallel write 5755 42.3 21.3 18.6 11.2 4.6 1.4 .5
db file scattered read 21.5K 8.4 4.3 11.9 18.9 26.3 25.3 4.9
db file sequential read 3053. 28.7 15.1 11.1 17.9 21.5 5.4 .3 .0
direct path read 46.3K 9.9 8.8 18.5 21.7 22.8 15.7 2.7
direct path read temp 95 9.5 9.5 23.2 49.5 8.4
direct path write 35 11.4 31.4 17.1 22.9 11.4 2.9 2.9
direct path write temp 1 100.0
enq: KO - fast object chec 3 66.7 33.3
enq: RO - fast object reus 5 20.0 20.0 20.0 20.0 20.0
kfk: async disk IO 6 50.0 16.7 16.7 16.7
latch free 3 100.0
latch: cache buffers chain 1465 100.0
latch: cache buffers lru c 1 100.0
latch: object queue header 2 100.0
latch: redo allocation 3 33.3 33.3 33.3
latch: row cache objects 2 100.0
latch: shared pool 15 93.3 6.7
local write wait 79 35.4 34.2 21.5 8.9
log file parallel write 29.4K 47.8 21.7 11.9 9.9 6.8 1.6 .3
log file sequential read 304 6.3 3.0 3.6 10.2 23.4 24.3 29.3
log file single write 4 25.0 75.0
log file switch (private s 3 100.0
log file sync 23.9K 40.9 28.0 12.9 9.7 6.7 1.5 .3
os thread startup 140 100.0
read by other session 199.6 37.1 19.9 12.9 13.1 13.8 3.1 .2
reliable message 8 100.0
ASM background timer 755 2.9 .4 .1 .1 .3 .1 .3 95.8
DIAG idle wait 7196 100.0
KSV master wait 121 88.4 2.5 3.3 2.5 .8 .8 1.7
SQL*Net message from clien 840.1 97.1 1.8 .5 .2 .2 .1 .0 .1
Space Manager: slave idle 1147 .1 .5 99.4
Streams AQ: qmn coordinato 258 49.6 .4 50.0
Streams AQ: qmn slave idle 130 .8 99.2
Streams AQ: waiting for me 721 100.0
Streams AQ: waiting for ti 7 28.6 42.9 28.6
class slave wait 283 39.9 2.5 2.5 3.5 4.9 9.2 15.2 22.3
dispatcher timer 60 100.0
jobq slave wait 7360 .0 .0 .0 99.9
pmon timer 1201 100.0
rdbms ipc message 47.8K 2.7 31.6 17.4 1.1 1.1 .9 20.9 24.3
Wait Event Histogram DB/Inst: I2KPROD/I2KPROD Snaps: 5606-5607
-> Units for Total Waits column: K is 1000, M is 1000000, G is 1000000000
-> % of Waits: value of .0 indicates value was <.05%; value of null is truly 0
-> % of Waits: column heading of <=1s is truly <1024ms, >1s is truly >=1024ms
-> Ordered by Event (idle events last)
% of Waits
Total
Event Waits <1ms <2ms <4ms <8ms <16ms <32ms <=1s >1s
shared server idle wait 120 100.0
smon timer 16 6.3 93.8
wait for unread message on 7250 .1 99.9
Latch Miss Sources
-> only latches with sleeps are shown
-> ordered by name, sleeps desc
NoWait Waiter
Latch Name Where Misses Sleeps Sleeps
In memory undo latch ktichg: child 0 1 0
active service list kswslogon: session logout 0 2 0
cache buffers chains kcbgtcr_2 0 1,123 483
cache buffers chains kcbgtcr: fast path (cr pin 0 496 1,131
cache buffers chains kcbrls_2 0 5 6
cache buffers chains kcbgcur_2 0 4 0
cache buffers chains kcbgtcr: fast path 0 3 1
cache buffers chains kcbzwb 0 2 4
cache buffers chains kcbchg1: kslbegin: bufs no 0 1 0
cache buffers chains kcbnew: new latch again 0 1 0
cache buffers chains kcbrls_1 0 1 6
cache buffers chains kcbzgb: scan from tail. no 0 1 0
cache buffers lru chain kcbzgws 0 1 0
object queue header oper kcbo_switch_cq 0 1 0
object queue header oper kcbo_switch_mq_bg 0 1 2
redo allocation kcrfw_redo_gen: redo alloc 0 3 0
row cache objects kqrpre: find obj 0 1 1
row cache objects kqrso 0 1 0
shared pool kghalo 0 13 3
shared pool kghupr1 0 4 15
shared pool kghalp 0 1 0
space background task la ktsj_grab_task 0 2 2
------------------------------------------------------------- -
Hi: I'm analyzing this STATSPACK report: it is "volume test" on our UAT server, so most input is from 'bind variables'. Our shared pool is well utilized in oracle. Oracle redo logs is not appropriately configured on this server, as in 'Top 5 wait events' there are 2 for redos.
I need to know what else information can be dig-out from 'foreground wait events' & 'background wait events', and what can assist us to better understanding, in combination of 'Top 5 wait event's, that how the server/test went? it could be overwelming No. of wait events, so appreciate any helpful diagnostic or analysis. Database is oracle 11.2.0.4 upgraded from 11.2.0.3, on IBM AIX power system 64bit, level 6.x
STATSPACK report for
Database DB Id Instance Inst Num Startup Time Release RAC
~~~~~~~~ ----------- ------------ -------- --------------- ----------- ---
700000XXX XXX 1 22-Apr-15 12:12 11.2.0.4.0 NO
Host Name Platform CPUs Cores Sockets Memory (G)
~~~~ ---------------- ---------------------- ----- ----- ------- ------------
dXXXX_XXX AIX-Based Systems (64- 2 1 0 16.0
Snapshot Snap Id Snap Time Sessions Curs/Sess Comment
~~~~~~~~ ---------- ------------------ -------- --------- ------------------
Begin Snap: 5635 22-Apr-15 13:00:02 114 4.6
End Snap: 5636 22-Apr-15 14:00:01 128 8.8
Elapsed: 59.98 (mins) Av Act Sess: 0.6
DB time: 35.98 (mins) DB CPU: 19.43 (mins)
Cache Sizes Begin End
~~~~~~~~~~~ ---------- ----------
Buffer Cache: 2,064M Std Block Size: 8K
Shared Pool: 3,072M Log Buffer: 13,632K
Load Profile Per Second Per Transaction Per Exec Per Call
~~~~~~~~~~~~ ------------------ ----------------- ----------- -----------
DB time(s): 0.6 0.0 0.00 0.00
DB CPU(s): 0.3 0.0 0.00 0.00
Redo size: 458,720.6 8,755.7
Logical reads: 12,874.2 245.7
Block changes: 1,356.4 25.9
Physical reads: 6.6 0.1
Physical writes: 61.8 1.2
User calls: 2,033.7 38.8
Parses: 286.5 5.5
Hard parses: 0.5 0.0
W/A MB processed: 1.7 0.0
Logons: 1.2 0.0
Executes: 801.1 15.3
Rollbacks: 6.1 0.1
Transactions: 52.4
Instance Efficiency Indicators
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 99.98 Optimal W/A Exec %: 100.00
Library Hit %: 99.77 Soft Parse %: 99.82
Execute to Parse %: 64.24 Latch Hit %: 99.98
Parse CPU to Parse Elapsd %: 53.15 % Non-Parse CPU: 98.03
Shared Pool Statistics Begin End
Memory Usage %: 10.50 12.79
% SQL with executions>1: 69.98 78.37
% Memory for SQL w/exec>1: 70.22 81.96
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time
CPU time 847 50.2
enq: TX - row lock contention 4,480 434 97 25.8
log file sync 284,169 185 1 11.0
log file parallel write 299,537 164 1 9.7
log file sequential read 698 16 24 1.0
Host CPU (CPUs: 2 Cores: 1 Sockets: 0)
~~~~~~~~ Load Average
Begin End User System Idle WIO WCPU
1.16 1.84 19.28 14.51 66.21 1.20 82.01
Instance CPU
~~~~~~~~~~~~ % Time (seconds)
Host: Total time (s): 7,193.8
Host: Busy CPU time (s): 2,430.7
% of time Host is Busy: 33.8
Instance: Total CPU time (s): 1,203.1
% of Busy CPU used for Instance: 49.5
Instance: Total Database time (s): 2,426.4
%DB time waiting for CPU (Resource Mgr): 0.0
Memory Statistics Begin End
~~~~~~~~~~~~~~~~~ ------------ ------------
Host Mem (MB): 16,384.0 16,384.0
SGA use (MB): 7,136.0 7,136.0
PGA use (MB): 282.5 361.4
% Host Mem used for SGA+PGA: 45.3 45.8
Foreground Wait Events DB/Inst: XXXXXs Snaps: 5635-5636
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by Total Wait Time desc, Waits desc (idle events last)
Avg %Total
%Tim Total Wait wait Waits Call
Event Waits out Time (s) (ms) /txn Time
enq: TX - row lock contentio 4,480 0 434 97 0.0 25.8
log file sync 284,167 0 185 1 1.5 11.0
Disk file operations I/O 8,741 0 4 0 0.0 .2
direct path write 13,247 0 3 0 0.1 .2
db file sequential read 6,058 0 1 0 0.0 .1
buffer busy waits 1,800 0 1 1 0.0 .1
SQL*Net more data to client 29,161 0 1 0 0.2 .1
direct path read 7,696 0 1 0 0.0 .0
db file scattered read 316 0 1 2 0.0 .0
latch: shared pool 144 0 0 2 0.0 .0
CSS initialization 30 0 0 3 0.0 .0
cursor: pin S 10 0 0 9 0.0 .0
row cache lock 41 0 0 2 0.0 .0
latch: row cache objects 19 0 0 3 0.0 .0
log file switch (private str 8 0 0 7 0.0 .0
library cache: mutex X 28 0 0 2 0.0 .0
latch: cache buffers chains 54 0 0 1 0.0 .0
latch free 290 0 0 0 0.0 .0
control file sequential read 1,568 0 0 0 0.0 .0
log file switch (checkpoint 4 0 0 6 0.0 .0
direct path sync 8 0 0 3 0.0 .0
latch: redo allocation 60 0 0 0 0.0 .0
SQL*Net break/reset to clien 34 0 0 1 0.0 .0
latch: enqueue hash chains 45 0 0 0 0.0 .0
latch: cache buffers lru cha 7 0 0 2 0.0 .0
latch: session allocation 5 0 0 1 0.0 .0
latch: object queue header o 6 0 0 1 0.0 .0
ASM file metadata operation 30 0 0 0 0.0 .0
latch: In memory undo latch 15 0 0 0 0.0 .0
latch: undo global data 8 0 0 0 0.0 .0
SQL*Net message from client 6,362,536 0 278,225 44 33.7
jobq slave wait 7,270 100 3,635 500 0.0
SQL*Net more data from clien 7,976 0 15 2 0.0
SQL*Net message to client 6,362,544 0 8 0 33.7
Background Wait Events DB/Inst: XXXXXs Snaps: 5635-5636
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by Total Wait Time desc, Waits desc (idle events last)
Avg %Total
%Tim Total Wait wait Waits Call
Event Waits out Time (s) (ms) /txn Time
log file parallel write 299,537 0 164 1 1.6 9.7
log file sequential read 698 0 16 24 0.0 1.0
db file parallel write 9,556 0 13 1 0.1 .8
os thread startup 146 0 10 70 0.0 .6
control file parallel write 2,037 0 2 1 0.0 .1
Log archive I/O 35 0 1 30 0.0 .1
LGWR wait for redo copy 2,447 0 0 0 0.0 .0
db file async I/O submit 9,556 0 0 0 0.1 .0
db file sequential read 145 0 0 2 0.0 .0
Disk file operations I/O 349 0 0 0 0.0 .0
db file scattered read 30 0 0 4 0.0 .0
control file sequential read 5,837 0 0 0 0.0 .0
ADR block file read 19 0 0 4 0.0 .0
ADR block file write 5 0 0 15 0.0 .0
direct path write 14 0 0 2 0.0 .0
direct path read 3 0 0 7 0.0 .0
latch: shared pool 3 0 0 6 0.0 .0
log file single write 56 0 0 0 0.0 .0
latch: redo allocation 53 0 0 0 0.0 .0
latch: active service list 1 0 0 3 0.0 .0
latch free 11 0 0 0 0.0 .0
rdbms ipc message 314,523 5 57,189 182 1.7
Space Manager: slave idle wa 4,086 88 18,996 4649 0.0
DIAG idle wait 7,185 100 7,186 1000 0.0
Streams AQ: waiting for time 2 50 4,909 ###### 0.0
Streams AQ: qmn slave idle w 129 0 3,612 28002 0.0
Streams AQ: qmn coordinator 258 50 3,612 14001 0.0
smon timer 43 2 3,605 83839 0.0
pmon timer 1,199 99 3,596 2999 0.0
SQL*Net message from client 17,019 0 31 2 0.1
SQL*Net message to client 12,762 0 0 0 0.1
class slave wait 28 0 0 0 0.0
thank you very much!Hi: just know it now: it is a large amount of 'concurrent transaction' designed in this "Volume Test" - to simulate large incoming transaction volme, so I guess wait in eq:TX - row is expected.
The fact: (1) redo logs at uat server is known to not well-tune for configurations (2) volume test slow 5%, however data amount in its test is kept the same by each time import production data, by the team. So why it slowed 5% this year?
The wait histogram is pasted below, any one interest to take a look? any ideas?
Wait Event Histogram DB/Inst: XXXX/XXXX Snaps: 5635-5636
-> Total Waits - units: K is 1000, M is 1000000, G is 1000000000
-> % of Waits - column heading: <=1s is truly <1024ms, >1s is truly >=1024ms
-> % of Waits - value: .0 indicates value was <.05%, null is truly 0
-> Ordered by Event (idle events last)
Total ----------------- % of Waits ------------------
Event Waits <1ms <2ms <4ms <8ms <16ms <32ms <=1s >1s
ADR block file read 19 26.3 5.3 10.5 57.9
ADR block file write 5 40.0 60.0
ADR file lock 6 100.0
ARCH wait for archivelog l 14 100.0
ASM file metadata operatio 30 100.0
CSS initialization 30 100.0
Disk file operations I/O 9090 97.2 1.4 .6 .4 .2 .1 .1
LGWR wait for redo copy 2447 98.5 .5 .4 .2 .2 .2 .1
Log archive I/O 35 40.0 8.6 25.7 2.9 22.9
SQL*Net break/reset to cli 34 85.3 8.8 5.9
SQL*Net more data to clien 29K 99.9 .0 .0 .0 .0 .0
buffer busy waits 1800 96.8 .7 .7 .6 .3 .4 .5
control file parallel writ 2037 90.7 5.0 2.1 .8 1.0 .3 .1
control file sequential re 7405 100.0 .0
cursor: pin S 10 10.0 90.0
db file async I/O submit 9556 99.9 .0 .0 .0
db file parallel read 1 100.0
db file parallel write 9556 62.0 32.4 1.7 .8 1.5 1.3 .1
db file scattered read 345 72.8 3.8 2.3 11.6 9.0 .6
db file sequential read 6199 97.2 .2 .3 1.6 .7 .0 .0
direct path read 7699 99.1 .4 .2 .1 .1 .0
direct path sync 8 25.0 37.5 12.5 25.0
direct path write 13K 97.8 .9 .5 .4 .3 .1 .0
enq: TX - row lock content 4480 .4 .7 1.3 3.0 6.8 12.3 75.4 .1
latch free 301 98.3 .3 .7 .7
latch: In memory undo latc 15 93.3 6.7
latch: active service list 1 100.0
latch: cache buffers chain 55 94.5 3.6 1.8
latch: cache buffers lru c 9 88.9 11.1
latch: call allocation 6 100.0
latch: checkpoint queue la 3 100.0
latch: enqueue hash chains 45 97.8 2.2
latch: messages 4 100.0
latch: object queue header 7 85.7 14.3
latch: redo allocation 113 97.3 1.8 .9
latch: row cache objects 19 89.5 5.3 5.3
latch: session allocation 5 80.0 20.0
latch: shared pool 147 90.5 1.4 2.7 1.4 .7 1.4 2.0
latch: undo global data 8 100.0
library cache: mutex X 28 89.3 3.6 3.6 3.6
log file parallel write 299K 95.6 2.6 1.0 .4 .3 .2 .0
log file sequential read 698 29.5 .1 4.6 46.8 18.9
log file single write 56 100.0
log file switch (checkpoin 4 25.0 50.0 25.0
log file switch (private s 8 12.5 37.5 50.0
log file sync 284K 93.3 3.7 1.4 .7 .5 .3 .1
os thread startup 146 100.0
row cache lock 41 85.4 9.8 2.4 2.4
DIAG idle wait 7184 100.0
SQL*Net message from clien 6379K 86.6 5.1 2.9 1.3 .7 .3 2.8 .3
SQL*Net message to client 6375K 100.0 .0 .0 .0 .0 .0 .0
Wait Event Histogram DB/Inst: XXXX/xxxx Snaps: 5635-5636
-> Total Waits - units: K is 1000, M is 1000000, G is 1000000000
-> % of Waits - column heading: <=1s is truly <1024ms, >1s is truly >=1024ms
-> % of Waits - value: .0 indicates value was <.05%, null is truly 0
-> Ordered by Event (idle events last)
Total ----------------- % of Waits ------------------
Event Waits <1ms <2ms <4ms <8ms <16ms <32ms <=1s >1s
SQL*Net more data from cli 7976 99.7 .1 .1 .0 .1
Space Manager: slave idle 4086 .1 .2 .0 .0 .3 3.2 96.1
Streams AQ: qmn coordinato 258 49.2 .8 50.0
Streams AQ: qmn slave idle 129 100.0
Streams AQ: waiting for ti 2 50.0 50.0
class slave wait 28 92.9 3.6 3.6
jobq slave wait 7270 .0 100.0
pmon timer 1199 100.0
rdbms ipc message 314K 10.3 7.3 39.7 15.4 10.6 5.3 8.2 3.3
smon timer 43 100.0 -
How to find where is bottleneck oracle 11.2
I am running oracle 11gr2 on windows server 2008 R2 having ram 20gb.
I am taking statspack report on database and following is it:
i am not getting where is actual bottleneck is and some time there is problem regarding procedure hangup which having business logic fetch by cursor.
i am generate statistics every day using :
begin
dbms_stats.gather_schema_stats(ownname => 'MFG',cascade => TRUE,no_invalidate => FALSE);
end;
and also using:
analyze table abc compute statistics;
stats pack report:
Load Profile Per Second Per Transaction Per Exec Per Call
~~~~~~~~~~~~ ------------------ ----------------- ----------- -----------
DB time(s): 2.0 0.8 0.00 0.01
DB CPU(s): 1.5 0.6 0.00 0.00
Redo size: 68,274.8 28,441.6
Logical reads: 83,672.4 34,855.8
Block changes: 633.0 263.7
Physical reads: 2,763.0 1,151.0
Physical writes: 37.4 15.6
User calls: 379.8 158.2
Parses: 342.6 142.7
Hard parses: 0.3 0.1
W/A MB processed: 9.9 4.1
Logons: 34.0 14.2
Executes: 2,702.3 1,125.7
Rollbacks: 0.0 0.0
Transactions: 2.4
Instance Efficiency Indicators
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 98.06 Optimal W/A Exec %: 99.99
Library Hit %: 100.03 Soft Parse %: 99.90
Execute to Parse %: 87.32 Latch Hit %: 99.97
Parse CPU to Parse Elapsd %: 91.04 % Non-Parse CPU: 99.19
Shared Pool Statistics Begin End
Memory Usage %: 68.94 69.12
% SQL with executions>1: 64.57 65.59
% Memory for SQL w/exec>1: 81.76 82.22
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time
CPU time 2,194 71.4
db file sequential read 131,781 323 2 10.5
db file scattered read 89,404 206 2 6.7
Disk file operations I/O 91,788 176 2 5.7
direct path read 17,001 89 5 2.9
Host CPU (CPUs: 8 Cores: 4 Sockets: 1)
~~~~~~~~ Load Average
Begin End User System Idle WIO WCPU
16.82 5.62 77.56
Instance CPU
~~~~~~~~~~~~ % Time (seconds)
Host: Total time (s): 15,156.8
Host: Busy CPU time (s): 3,401.3
% of time Host is Busy: 22.4
Instance: Total CPU time (s): 2,827.1
% of Busy CPU used for Instance: 83.1
Instance: Total Database time (s): 3,753.3
%DB time waiting for CPU (Resource Mgr): 0.0
Memory Statistics Begin End
~~~~~~~~~~~~~~~~~ ------------ ------------
Host Mem (MB): 20,468.5 20,468.5
SGA use (MB): 11,022.6 11,022.6
PGA use (MB): 779.3 807.4
% Host Mem used for SGA+PGA: 57.7 57.8
Time Model System Stats DB/Inst: ORACLE/oracle Snaps: 511-512
-> Ordered by % of DB time desc, Statistic name
Statistic Time (s) % DB time
sql execute elapsed time 2,912.2 78.8
DB CPU 2,825.0 76.4
connection management call elapsed 343.6 9.3
PL/SQL execution elapsed time 56.6 1.5
parse time elapsed 42.8 1.2
hard parse elapsed time 25.1 .7
PL/SQL compilation elapsed time 1.1 .0
repeated bind elapsed time 1.0 .0
inbound PL/SQL rpc elapsed time 0.7 .0
hard parse (sharing criteria) elaps 0.5 .0
sequence load elapsed time 0.1 .0
failed parse elapsed time 0.0 .0
hard parse (bind mismatch) elapsed 0.0 .0
DB time 3,697.2
background elapsed time 56.1
background cpu time 2.1
Foreground Wait Events DB/Inst: ORACLE/oracle Snaps: 511-512
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by Total Wait Time desc, Waits desc (idle events last)
Avg %Total
%Tim Total Wait wait Waits Call
Event Waits out Time (s) (ms) /txn Time
db file sequential read 131,324 0 321 2 28.9 10.5
db file scattered read 89,376 0 206 2 19.6 6.7
Disk file operations I/O 91,705 0 176 2 20.2 5.7
direct path read 16,992 0 89 5 3.7 2.9
log file sync 5,064 0 16 3 1.1 .5
db file parallel read 1,575 0 14 9 0.3 .4
enq: KO - fast object checkp 8 0 5 591 0.0 .2
control file sequential read 4,457 0 2 0 1.0 .1
direct path write temp 1,635 0 2 1 0.4 .1
SQL*Net more data to client 14,776 0 1 0 3.2 .0
SQL*Net message from dblink 603 0 0 1 0.1 .0
ADR block file read 91 0 0 4 0.0 .0
direct path read temp 713 0 0 0 0.2 .0
SQL*Net break/reset to clien 152 0 0 0 0.0 .0
asynch descriptor resize 8,239 100 0 0 1.8 .0
library cache: mutex X 1,238 0 0 0 0.3 .0
SQL*Net more data from dblin 345 0 0 0 0.1 .0
ADR block file write 5 0 0 0 0.0 .0
latch free 66 0 0 0 0.0 .0
direct path write 4 0 0 0 0.0 .0
cursor: pin S 10 0 0 0 0.0 .0
SQL*Net message from client 526,480 0 238,770 454 115.7
jobq slave wait 3,954 100 2,034 514 0.9
wait for unread message on b 1,896 98 1,894 999 0.4
Streams AQ: waiting for mess 379 100 1,892 4993 0.1
SQL*Net more data from clien 11,597 0 4 0 2.5
single-task message 29 0 1 21 0.0
SQL*Net message to client 526,478 0 1 0 115.7
Background Wait Events DB/Inst: ORACLE/oracle Snaps: 511-512
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by Total Wait Time desc, Waits desc (idle events last)
Avg %Total
%Tim Total Wait wait Waits Call
Event Waits out Time (s) (ms) /txn Time
log file parallel write 7,020 0 16 2 1.5 .5
db file parallel write 5,529 0 14 3 1.2 .5
control file sequential read 5,966 0 5 1 1.3 .2
control file parallel write 1,618 0 3 2 0.4 .1
log file sequential read 66 0 3 50 0.0 .1
SQL*Net more data to client 64,218 0 2 0 14.1 .1
db file sequential read 457 0 2 4 0.1 .1
os thread startup 66 0 1 8 0.0 .0
Disk file operations I/O 83 0 0 1 0.0 .0
asynch descriptor resize 64,343 100 0 0 14.1 .0
direct path read 9 0 0 6 0.0 .0
db file scattered read 28 0 0 2 0.0 .0
rdbms ipc reply 8 0 0 0 0.0 .0
LGWR wait for redo copy 57 0 0 0 0.0 .0
log file single write 8 0 0 0 0.0 .0
db file single write 1 0 0 2 0.0 .0
rdbms ipc message 14,376 51 31,809 2213 3.2
DIAG idle wait 3,738 100 3,788 1013 0.8
smon timer 12 33 2,077 ###### 0.0
dispatcher timer 32 100 1,920 60012 0.0
Streams AQ: qmn coordinator 136 50 1,905 14009 0.0
Streams AQ: qmn slave idle w 68 0 1,905 28017 0.0
pmon timer 2,099 30 1,896 903 0.5
Space Manager: slave idle wa 381 98 1,894 4970 0.1
shared server idle wait 63 100 1,891 30014 0.0
SQL*Net message from client 257,103 0 1,741 7 56.5
SQL*Net more data from clien 64,218 0 88 1 14.1
SQL*Net message to client 192,827 0 0 0 42.4
-------------------------------------------------------------Now , I am perform only analyzed method for statics.
but even though dbms_stats is new method and cover all limit of analyzed method why should you not prefer it?..
second thing we don't have licence for performance tuning so,AWR does not work . I am using stats pack utility and some query to find top sql on load time which are as below:
high memory consumed:
110125 19483 5.65
begin CHECK_EMP_ISSUE(P_FOR_COMP=>:P_FOR_COMP, P_FOR_TRANS_DATE=>:P_FOR_TRANS_DATE, P_FOR_EMP_CODE=>:P_FOR_EMP_CODE, P_FOR_DEPT_CODE=>:P_FOR_DEPT_CODE, P_FOR_PROCESS=>:P_FOR_PROCESS, P_FOR_KAPAN_NO=>:P_FOR_KAPAN_NO, P_FOR_PACKET_NO=>:P_FOR_PACKET_NO, P_FOR_PACKET_ID=>:P_FOR_PACKET_ID, P_FOR_ISSUE_TYPE=>:P_FOR_ISSUE_TYPE, P_FOR_SHIFT_NO=>:P_FOR_SHIFT_NO, P_FOR_MC_CODE=>:P_FOR_MC_CODE, P_FOR_CHECK_PREF_EMP=>:P_FOR_CHECK_PREF_EMP, P_FOR_DUMMY=>:P_FOR_DUMMY, P_FOR_MSG=>:P_FOR_MSG, P_FOR_WARNING=>:P_FOR_WARNING, P_FOR_MSG_VALUE=>:P_FOR_MSG_VALUE, VREC=>:VREC); end; high i/o consumed:
EVENT WAIT_CLASS USER_IO_WAIT_TIME SQL_TEXT
asynch descriptor resize Other 32454263 SELECT /*+ result_cache */ COMP_CODE,KAPAN_GROUP,VKAPAN_GROUP,SEQ_NO,PACKET_ID,CHILD_ID,INW_DATE, VKAPAN_NO,KAPAN_NO,VPACKET_NO,PACKET_NO,SUB_ID,STONE_TYPE,PCS,WGT,CUR_WGT,P_SEQ_NO,L_SEQ_NO, STAGE,STATUS,PACKET_TYPE,:B1 DEPT_CODE,EMP_CODE,PROCESS,CLV_END_DATE,MFG_END_DATE,TRUNC(SYSDATE)-TRUNC(INW_DATE)VDAYS FROM ( SELECT /*+ leading(a) use_hash(b)*/ :B3 COMP_CODE,A.KAPAN_GROUP,A.VKAPAN_GROUP,:B1 DEPT_CODE,A.SEQ_NO,A.PACKET_ID,A.CHILD_ID,A.INW_DATE, A.VKAPAN_NO,A.KAPAN_NO,A.VPACKET_NO,A.PACKET_NO,A.SUB_ID,A.STONE_TYPE,A.PCS PCS,A.WGT,A.CUR_WGT,A.P_SEQ_NO,A.L_SEQ_NO, -
How do I interpret it ...And can anyone please suggest measures to improve my database performance from the available report.
STATSPACK report for
Database DB Id Instance Inst Num Startup Time Release RAC
~~~~~~~~ ----------- ------------ -------- --------------- ----------- ---
1184214567 orcl 1 03-Jun-08 16:02 10.2.0.1.0 NO
Host Name: KRISHNAF39E Num CPUs: 1 Phys Memory (MB): 512
~~~~
Snapshot Snap Id Snap Time Sessions Curs/Sess Comment
~~~~~~~~ ---------- ------------------ -------- --------- -------------------
Begin Snap: 1 03-Jun-08 16:07:21 17 5.8
End Snap: 32 03-Jun-08 21:35:08 22 9.0
Elapsed: 327.78 (mins)
Cache Sizes Begin End
~~~~~~~~~~~ ---------- ----------
Buffer Cache: 76M 72M Std Block Size: 8K
Shared Pool Size: 72M 76M Log Buffer: 2,832K
Load Profile Per Second Per Transaction
~~~~~~~~~~~~ --------------- ---------------
Redo size: 626.65 10,085.31
Logical reads: 18.57 298.82
Block changes: 2.72 43.79
Physical reads: 0.13 2.07
Physical writes: 0.34 5.40
User calls: 1.31 21.14
Parses: 1.56 25.10
Hard parses: 0.20 3.14
Sorts: 0.95 15.27
Logons: 0.01 0.17
Executes: 4.16 67.02
Transactions: 0.06
% Blocks changed per Read: 14.66 Recursive Call %: 95.81
Rollback per transaction %: 5.32 Rows per Sort: 9.86
Instance Efficiency Percentages
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 99.99
Buffer Hit %: 99.31 In-memory Sort %: 100.00
Library Hit %: 92.48 Soft Parse %: 87.47
Execute to Parse %: 62.55 Latch Hit %: 99.99
Parse CPU to Parse Elapsd %: 76.73 % Non-Parse CPU: 86.05
Shared Pool Statistics Begin End
Memory Usage %: 75.34 93.45
% SQL with executions>1: 64.78 93.71
% Memory for SQL w/exec>1: 85.34 95.57
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time
control file parallel write 5,371 147 27 28.2
CPU time 108 20.7
db file parallel write 3,730 86 23 16.5
log file parallel write 2,080 45 22 8.7
control file sequential read 5,651 42 7 8.0
Host CPU (CPUs: 1)
~~~~~~~~ Load Average
Begin End User System Idle WIO WCPU
0.89 3.04 96.07
Note: There is a 18% discrepancy between the OS Stat total CPU time and
the total CPU time estimated by Statspack
OS Stat CPU time: 16115(s) (BUSY_TIME + IDLE_TIME)
Statspack CPU time: 19667(s) (Elapsed time * num CPUs in end snap)
Instance CPU
~~~~~~~~~~~~
% of total CPU for Instance: 0.92
% of busy CPU for Instance: 23.31
%DB time waiting for CPU - Resource Mgr:
Memory Statistics Begin End
~~~~~~~~~~~~~~~~~ ------------ ------------
Host Mem (MB): 511.6 511.6
SGA use (MB): 160.0 160.0
PGA use (MB): 24.5 29.5
% Host Mem used for SGA+PGA: 36.1 37.1
Time Model System Stats DB/Inst: ORCL/orcl Snaps: 1-32
-> Ordered by % of DB time desc, Statistic name
Statistic Time (s) % of DB time
sql execute elapsed time 162.4 76.3
DB CPU 103.7 48.7
PL/SQL execution elapsed time 50.2 23.6
parse time elapsed 36.3 17.1
hard parse elapsed time 34.0 16.0
PL/SQL compilation elapsed time 5.5 2.6
hard parse (sharing criteria) elaps 0.8 .4
connection management call elapsed 0.6 .3
repeated bind elapsed time 0.2 .1
hard parse (bind mismatch) elapsed 0.0 .0
sequence load elapsed time 0.0 .0
failed parse elapsed time 0.0 .0
DB time 212.8
background elapsed time 366.6
background cpu time 43.9
Wait Events DB/Inst: ORCL/orcl Snaps: 1-32
-> s - second, cs - centisecond, ms - millisecond, us - microsecond
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by Total Wait Time desc, Waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
control file parallel write 5,371 0 147 27 4.4
db file parallel write 3,730 0 86 23 3.1
log file parallel write 2,080 0 45 22 1.7
control file sequential read 5,651 0 42 7 4.6
db file sequential read 2,009 0 37 19 1.6
log file sync 910 1 35 38 0.7
Streams AQ: qmn coordinator waiti 2 100 10 5004 0.0
db file scattered read 111 0 4 35 0.1
os thread startup 71 0 3 41 0.1
Data file init write 16 0 1 72 0.0
library cache load lock 3 0 1 337 0.0
SQL*Net break/reset to client 1,232 0 1 1 1.0
log file switch completion 3 0 1 192 0.0
SGA: MMAN sleep for component shr 64 67 0 7 0.1
latch free 416 0 0 0 0.3
read by other session 6 0 0 20 0.0
rdbms ipc reply 62 0 0 2 0.1
library cache pin 4 0 0 16 0.0
log file sequential read 2 0 0 14 0.0
latch: library cache 6 0 0 3 0.0
LGWR wait for redo copy 24 0 0 1 0.0
log file single write 2 0 0 5 0.0
buffer busy waits 9 0 0 1 0.0
latch: shared pool 5 0 0 0 0.0
direct path write 21 0 0 0 0.0
SQL*Net message from client 23,572 0 49,054 2081 19.3
Streams AQ: qmn slave idle wait 705 16 18,942 26868 0.6
Streams AQ: qmn coordinator idle 1,015 76 16,085 15848 0.8
Streams AQ: waiting for messages 3,226 99 16,080 4985 2.6
virtual circuit status 538 100 16,071 29872 0.4
wait for unread message on broadc 15,873 100 15,891 1001 13.0
Streams AQ: waiting for time mana 87 47 10,271 ###### 0.1
jobq slave wait 1,263 99 3,780 2993 1.0
class slave wait 3 100 15 5004 0.0
SQL*Net message to client 23,577 0 0 0 19.3
SQL*Net more data from client 139 0 0 0 0.1
Background Wait Events DB/Inst: ORCL/orcl Snaps: 1-32
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by Total Wait Time desc, Waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
control file parallel write 5,368 0 147 27 4.4
db file parallel write 3,730 0 86 23 3.1
log file parallel write 2,080 0 45 22 1.7
events in waitclass Other 369 1 10 28 0.3
control file sequential read 783 0 8 10 0.6
os thread startup 71 0 3 41 0.1
db file sequential read 112 0 2 17 0.1
db file scattered read 70 0 1 20 0.1
log file switch completion 3 0 1 192 0.0
SGA: MMAN sleep for component shr 64 67 0 7 0.1
log file sequential read 2 0 0 14 0.0
log file single write 2 0 0 5 0.0
buffer busy waits 9 0 0 1 0.0
rdbms ipc message 53,282 96 139,790 2624 43.6
pmon timer 5,447 100 16,111 2958 4.5
Streams AQ: qmn coordinator idle 1,015 76 16,085 15848 0.8
smon timer 67 73 15,427 ###### 0.1
Streams AQ: qmn slave idle wait 456 11 12,775 28016 0.4
Streams AQ: waiting for time mana 87 47 10,271 ###### 0.1
Wait Event Histogram DB/Inst: ORCL/orcl Snaps: 1-32
-> Total Waits - units: K is 1000, M is 1000000, G is 1000000000
-> % of Waits - column heading: <=1s is truly <1024ms, >1s is truly >=1024ms
-> % of Waits - value: .0 indicates value was <.05%, null is truly 0
-> Ordered by Event (idle events last)
Total ----------------- % of Waits ------------------
Event Waits <1ms <2ms <4ms <8ms <16ms <32ms <=1s >1s
Data file init write 16 37.5 18.8 31.3 12.5
LGWR wait for redo copy 24 95.8 4.2
SGA: MMAN sleep for compon 64 14.1 4.7 6.3 29.7 43.8 1.6
SQL*Net break/reset to cli 1232 91.2 6.9 .8 .6 .2 .2
SQL*Net more data to clien 12 100.0
Streams AQ: qmn coordinato 2 100.0
buffer busy waits 9 88.9 11.1
control file parallel writ 5371 .4 39.6 54.2 .8 .4 .8 3.3 .5
control file sequential re 5651 86.9 2.9 1.3 .9 1.7 3.1 3.0 .1
db file parallel write 3730 28.7 6.1 10.0 9.7 15.4 20.1 9.8 .2
db file scattered read 111 10.8 9.0 18.9 11.7 10.8 17.1 21.6
db file sequential read 2010 28.6 14.3 4.3 4.7 13.5 20.4 14.2
db file single write 1 100.0
direct path read 6 100.0
direct path write 21 100.0
latch free 413 96.9 1.7 .7 .7
latch: enqueue hash chains 1 100.0
latch: library cache 4 75.0 25.0
latch: library cache pin 1 100.0
latch: shared pool 5 80.0 20.0
library cache load lock 3 100.0
library cache pin 4 50.0 25.0 25.0
log file parallel write 2080 69.3 4.7 1.9 .9 2.9 10.2 9.8 .2
log file sequential read 2 50.0 50.0
log file single write 2 50.0 50.0
log file switch completion 3 33.3 33.3 33.3
log file sync 910 41.0 17.7 2.1 3.0 5.4 13.2 17.7
os thread startup 71 1.4 1.4 35.2 31.0 12.7 18.3
rdbms ipc reply 62 83.9 3.2 1.6 4.8 6.5
read by other session 6 33.3 50.0 16.7
undo segment extension 1 100.0
SQL*Net message from clien 23K 84.4 2.2 1.1 .7 .6 .5 .6 9.9
SQL*Net message to client 23K 99.9 .1
SQL*Net more data from cli 139 100.0
Streams AQ: qmn coordinato 1015 22.9 .9 .1 .2 .1 75.9
Streams AQ: qmn slave idle 705 4.1 .1 .1 .6 1.0 94.0
Streams AQ: waiting for me 3226 .0 .3 99.7
Streams AQ: waiting for ti 87 23.0 10.3 66.7
class slave wait 3 100.0
dispatcher timer 269 100.0
jobq slave wait 1263 .4 99.6
pmon timer 5447 1.4 .1 .1 98.4
rdbms ipc message 53K 1.0 .2 .2 .2 .3 .2 31.2 66.7
smon timer 67 9.0 1.5 89.6
virtual circuit status 538 100.0
wait for unread message on 15K .0 .0 99.9 .1
SQL ordered by CPU DB/Inst: ORCL/orcl Snaps: 1-32
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> Total DB CPU (s): 104
-> Captured SQL accounts for 61.1% of Total DB CPU
-> SQL reported below exceeded 1.0% of Total DB CPU
CPU CPU per Elapsd Old
Time (s) Executions Exec (s) %Total Time (s) Buffer Gets Hash Value
44.02 576 0.08 42.5 46.47 12,780 1206412919
Module: OEM.SystemPool
BEGIN EMD_NOTIFICATION.QUEUE_READY(:1, :2, :3); END;
5.77 6,381 0.00 5.6 5.98 40,624 1396250429
Module: OEM.SystemPool
begin MGMT_JOB_ENGINE.get_scheduled_steps(:1, :2, :3, :4); end;
1.81 1 1.81 1.7 2.08 13,786 2522684317
Module: SQL*Plus
BEGIN statspack.snap; END;
SQL ordered by Elapsed DB/Inst: ORCL/orcl Snaps: 1-32
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> Total DB Time (s): 213
-> Captured SQL accounts for 39.2% of Total DB Time
-> SQL reported below exceeded 1.0% of Total DB Time
Elapsed Elap per CPU Old
Time (s) Executions Exec (s) %Total Time (s) Physical Reads Hash Value
46.47 576 0.08 21.8 44.02 76 1206412919
Module: OEM.SystemPool
BEGIN EMD_NOTIFICATION.QUEUE_READY(:1, :2, :3); END;
6.18 478 0.01 2.9 0.27 288 986338823
select /*+ index(idl_ub1$ i_idl_ub11) +*/ piece#,length,piece fr
om idl_ub1$ where obj#=:1 and part=:2 and version=:3 order by pi
ece#
5.98 6,381 0.00 2.8 5.77 6 1396250429
Module: OEM.SystemPool
begin MGMT_JOB_ENGINE.get_scheduled_steps(:1, :2, :3, :4); end;
SQL ordered by Gets DB/Inst: ORCL/orcl Snaps: 1-32
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> End Buffer Gets Threshold: 10000 Total Buffer Gets: 365,154
-> Captured SQL accounts for 54.0% of Total Buffer Gets
-> SQL reported below exceeded 1.0% of Total Buffer Gets
CPU Elapsd Old
Buffer Gets Executions Gets per Exec %Total Time (s) Time (s) Hash Value
40,624 6,381 6.4 11.1 5.77 5.98 1396250429
Module: OEM.SystemPool
begin MGMT_JOB_ENGINE.get_scheduled_steps(:1, :2, :3, :4); end;
20,280 4,090 5.0 5.6 0.38 0.38 2482976222
select intcol#,nvl(pos#,0),col#,nvl(spare1,0) from ccol$ where c
on#=:1
19,221 6,381 3.0 5.3 0.74 0.74 2360644236
Module: OEM.SystemPool
SELECT JOB_ID, EXECUTION_ID, STEP_ID, STEP_NAME, STEP_TYPE, ITER
ATE_PARAM, ITERATE_PARAM_INDEX, COMMAND_TYPE, TIMEZONE_REGION FR
OM MGMT_JOB_EXECUTION J WHERE STEP_TYPE IN (:B7 , :B6 , :B5 ) AN
D STEP_STATUS = :B4 AND COMMAND_TYPE = :B3 AND STEP_NAME LIKE :B
2 AND START_TIME <= SYS_EXTRACT_UTC(SYSTIMESTAMP) AND ROWNUM <=
13,786 1 13,786.0 3.8 1.81 2.08 2522684317
Module: SQL*Plus
BEGIN statspack.snap; END;
12,780 576 22.2 3.5 44.02 46.47 1206412919
Module: OEM.SystemPool
BEGIN EMD_NOTIFICATION.QUEUE_READY(:1, :2, :3); END;
12,293 3,871 3.2 3.4 0.55 1.24 3665763022
update sys.col_usage$ set equality_preds = equality_preds
+ decode(bitand(:flag,1),0,0,1), equijoin_preds = equijoi
n_preds + decode(bitand(:flag,2),0,0,1), nonequijoin_preds
= nonequijoin_preds + decode(bitand(:flag,4),0,0,1), range_pre
ds = range_preds + decode(bitand(:flag,8),0,0,1),
11,781 860 13.7 3.2 0.28 1.33 2062595902
select owner#,name,namespace,remoteowner,linkname,p_timestamp,p_
obj#, nvl(property,0),subname,d_attrs from dependency$ d, obj$ o
where d_obj#=:1 and p_obj#=obj#(+) order by order#
10,106 152 66.5 2.8 0.57 0.99 1405417040
Module: OEM.SystemPool
INSERT INTO MGMT_METRICS_RAW(COLLECTION_TIMESTAMP, KEY_VALUE, ME
TRIC_GUID, STRING_VALUE, TARGET_GUID, VALUE) VALUES ( :1, NVL(:2
, ' '), :3, :4, :5, :6)
9,538 1,313 7.3 2.6 0.20 0.21 2889900621
select pos#,intcol#,col#,spare1,bo#,spare2 from icol$ where obj#
=:1
9,414 860 10.9 2.6 0.22 1.05 1198893840
select order#,columns,types from access$ where d_obj#=:1
8,535 1,002 8.5 2.3 0.48 0.88 3694268570
SQL ordered by Gets DB/Inst: ORCL/orcl Snaps: 1-32
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> End Buffer Gets Threshold: 10000 Total Buffer Gets: 365,154
-> Captured SQL accounts for 54.0% of Total Buffer Gets
-> SQL reported below exceeded 1.0% of Total Buffer Gets
CPU Elapsd Old
Buffer Gets Executions Gets per Exec %Total Time (s) Time (s) Hash Value
select i.obj#,i.ts#,i.file#,i.block#,i.intcols,i.type#,i.flags,i
.property,i.pctfree$,i.initrans,i.maxtrans,i.blevel,i.leafcnt,i.
distkey,i.lblkkey,i.dblkkey,i.clufac,i.cols,i.analyzetime,i.samp
lesize,i.dataobj#,nvl(i.degree,1),nvl(i.instances,1),i.rowcnt,mo
d(i.pctthres$,256),i.indmethod#,i.trunccnt,nvl(c.unicols,0),nvl(
8,516 3,330 2.6 2.3 0.23 1.51 4274598960
select /*+ rule */ bucket_cnt, row_cnt, cache_cnt, null_cnt, tim
estamp#, sample_size, minimum, maximum, distcnt, lowval, hival,
density, col#, spare1, spare2, avgcln from hist_head$ where obj#
=:1 and intcol#=:2
7,836 194 40.4 2.1 0.06 0.06 1129615673
select u.name,o.name, t.update$, t.insert$, t.delete$, t.enabled
from obj$ o,user$ u,trigger$ t where t.baseobject=:1 and t.ob
j#=o.obj# and o.owner#=u.user# and bitand(property,16)=0 and bi
tand(property,8)=0 order by o.obj#
6,647 3,269 2.0 1.8 0.99 0.99 1316169839
select job, nvl2(last_date, 1, 0) from sys.job$ where (((:1 <= n
ext_date) and (next_date < :2)) or ((last_date is null) and
(next_date < :3))) and (field1 = :4 or (field1 = 0 and 'Y' = :5)
) and (this_date is null) order by next_date, job
6,643 860 7.7 1.8 0.18 0.20 1937775682
select con#,type#,condlength,intcols,robj#,rcon#,match#,refact,n
vl(enabled,0),rowid,cols,nvl(defer,0),mtime,nvl(spare1,0) from c
def$ where obj#=:1
6,152 112 54.9 1.7 0.62 1.05 1666200974
Module: OEM.SystemPool
BEGIN EM_PING.RECORD_BATCH_HEARTBEAT(:1, :2, :3); END;
5,398 173 31.2 1.5 0.36 0.47 2384968239
Module: OEM.SystemPool
BEGIN :1 := MGMT_BLACKOUT_ENGINE.get_blackout_windows(:2,:3); EN
D;
5,037 1,247 4.0 1.4 0.52 0.54 839312984
select name,intcol#,segcol#,type#,length,nvl(precision#,0),decod
e(type#,2,nvl(scale,-127/*MAXSB1MINAL*/),178,scale,179,scale,180
,scale,181,scale,182,scale,183,scale,231,scale,0),null$,fixedsto
rage,nvl(deflength,0),default$,rowid,col#,property, nvl(charseti
d,0),nvl(charsetform,0),spare1,spare2,nvl(spare3,0) from col$ wh
SQL ordered by Reads DB/Inst: ORCL/orcl Snaps: 1-32
-> End Disk Reads Threshold: 1000 Total Disk Reads: 2,530
-> Captured SQL accounts for 28.4% of Total Disk Reads
-> SQL reported below exceeded 1.0% of Total Disk Reads
CPU Elapsd Old
Physical Reads Executions Reads per Exec %Total Time (s) Time (s) Hash Value
288 478 0.6 11.4 0.27 6.18 986338823
select /*+ index(idl_ub1$ i_idl_ub11) +*/ piece#,length,piece fr
om idl_ub1$ where obj#=:1 and part=:2 and version=:3 order by pi
ece#
76 576 0.1 3.0 44.02 46.47 1206412919
Module: OEM.SystemPool
BEGIN EMD_NOTIFICATION.QUEUE_READY(:1, :2, :3); END;
69 478 0.1 2.7 0.12 1.25 386388955
select /*+ index(idl_ub2$ i_idl_ub21) +*/ piece#,length,piece fr
om idl_ub2$ where obj#=:1 and part=:2 and version=:3 order by pi
ece#
47 3,330 0.0 1.9 0.23 1.51 4274598960
select /*+ rule */ bucket_cnt, row_cnt, cache_cnt, null_cnt, tim
estamp#, sample_size, minimum, maximum, distcnt, lowval, hival,
density, col#, spare1, spare2, avgcln from hist_head$ where obj#
=:1 and intcol#=:2
43 860 0.1 1.7 0.28 1.33 2062595902
select owner#,name,namespace,remoteowner,linkname,p_timestamp,p_
obj#, nvl(property,0),subname,d_attrs from dependency$ d, obj$ o
where d_obj#=:1 and p_obj#=obj#(+) order by order#
36 478 0.1 1.4 0.11 1.58 2954231783
select /*+ index(idl_sb4$ i_idl_sb41) +*/ piece#,length,piece fr
om idl_sb4$ where obj#=:1 and part=:2 and version=:3 order by pi
ece#
35 860 0.0 1.4 0.22 1.05 1198893840
select order#,columns,types from access$ where d_obj#=:1
26 173 0.2 1.0 0.36 0.47 2384968239
Module: OEM.SystemPool
BEGIN :1 := MGMT_BLACKOUT_ENGINE.get_blackout_windows(:2,:3); EN
D;
SQL ordered by Executions DB/Inst: ORCL/orcl Snaps: 1-32
-> End Executions Threshold: 100 Total Executions: 81,903
-> Captured SQL accounts for 76.9% of Total Executions
-> SQL reported below exceeded 1.0% of Total Executions
CPU per Elap per Old
Executions Rows Processed Rows per Exec Exec (s) Exec (s) Hash Value
6,435 6,435 1.0 0.00 0.00 1667689875
Module: EM_PING
SELECT SYS_EXTRACT_UTC(SYSTIMESTAMP) FROM DUAL
6,381 6,381 1.0 0.00 0.00 1396250429
Module: OEM.SystemPool
begin MGMT_JOB_ENGINE.get_scheduled_steps(:1, :2, :3, :4); end;
6,381 0 0.0 0.00 0.00 2360644236
Module: OEM.SystemPool
SELECT JOB_ID, EXECUTION_ID, STEP_ID, STEP_NAME, STEP_TYPE, ITER
ATE_PARAM, ITERATE_PARAM_INDEX, COMMAND_TYPE, TIMEZONE_REGION FR
OM MGMT_JOB_EXECUTION J WHERE STEP_TYPE IN (:B7 , :B6 , :B5 ) AN
D STEP_STATUS = :B4 AND COMMAND_TYPE = :B3 AND STEP_NAME LIKE :B
2 AND START_TIME <= SYS_EXTRACT_UTC(SYSTIMESTAMP) AND ROWNUM <=
4,090 6,051 1.5 0.00 0.00 2482976222
select intcol#,nvl(pos#,0),col#,nvl(spare1,0) from ccol$ where c
on#=:1
3,871 3,255 0.8 0.00 0.00 3665763022
update sys.col_usage$ set equality_preds = equality_preds
+ decode(bitand(:flag,1),0,0,1), equijoin_preds = equijoi
n_preds + decode(bitand(:flag,2),0,0,1), nonequijoin_preds
= nonequijoin_preds + decode(bitand(:flag,4),0,0,1), range_pre
ds = range_preds + decode(bitand(:flag,8),0,0,1),
3,330 1,856 0.6 0.00 0.00 4274598960
select /*+ rule */ bucket_cnt, row_cnt, cache_cnt, null_cnt, tim
estamp#, sample_size, minimum, maximum, distcnt, lowval, hival,
density, col#, spare1, spare2, avgcln from hist_head$ where obj#
=:1 and intcol#=:2
3,269 52 0.0 0.00 0.00 1316169839
select job, nvl2(last_date, 1, 0) from sys.job$ where (((:1 <= n
ext_date) and (next_date < :2)) or ((last_date is null) and
(next_date < :3))) and (field1 = :4 or (field1 = 0 and 'Y' = :5)
) and (this_date is null) order by next_date, job
3,218 3,218 1.0 0.00 0.00 1693927332
select count(*) from sys.job$ where (next_date > sysdate) and (n
ext_date < (sysdate+5/86400))
1,313 3,457 2.6 0.00 0.00 2889900621
select pos#,intcol#,col#,spare1,bo#,spare2 from icol$ where obj#
=:1
1,247 15,878 12.7 0.00 0.00 839312984
select name,intcol#,segcol#,type#,length,nvl(precision#,0),decod
e(type#,2,nvl(scale,-127/*MAXSB1MINAL*/),178,scale,179,scale,180
,scale,181,scale,182,scale,183,scale,231,scale,0),null$,fixedsto
rage,nvl(deflength,0),default$,rowid,col#,property, nvl(charseti
SQL ordered by Executions DB/Inst: ORCL/orcl Snaps: 1-32
-> End Executions Threshold: 100 Total Executions: 81,903
-> Captured SQL accounts for 76.9% of Total Executions
-> SQL reported below exceeded 1.0% of Total Executions
CPU per Elap per Old
Executions Rows Processed Rows per Exec Exec (s) Exec (s) Hash Value
d,0),nvl(charsetform,0),spare1,spare2,nvl(spare3,0) from col$ wh
1,003 474 0.5 0.00 0.00 1980305124
select grantee#,privilege#,nvl(col#,0),max(mod(nvl(option$,0),2)
)from objauth$ where obj#=:1 group by grantee#,privilege#,nvl(co
l#,0) order by grantee#
1,002 1,313 1.3 0.00 0.00 3694268570
select i.obj#,i.ts#,i.file#,i.block#,i.intcols,i.type#,i.flags,i
.property,i.pctfree$,i.initrans,i.maxtrans,i.blevel,i.leafcnt,i.
distkey,i.lblkkey,i.dblkkey,i.clufac,i.cols,i.analyzetime,i.samp
lesize,i.dataobj#,nvl(i.degree,1),nvl(i.instances,1),i.rowcnt,mo
d(i.pctthres$,256),i.indmethod#,i.trunccnt,nvl(c.unicols,0),nvl(
999 0 0.0 0.00 0.00 204386021
select col#, grantee#, privilege#,max(mod(nvl(option$,0),2)) fro
m objauth$ where obj#=:1 and col# is not null group by privilege
#, col#, grantee# order by col#, grantee#
927 856 0.9 0.00 0.00 2703824309
select obj#,type#,ctime,mtime,stime,status,dataobj#,flags,oid$,
spare1, spare2 from obj$ where owner#=:1 and name=:2 and namespa
ce=:3 and remoteowner is null and linkname is null and subname i
s null
901 365 0.4 0.00 0.00 2018736380
select timestamp, flags from fixed_obj$ where obj#=:1
860 3,847 4.5 0.00 0.00 1198893840
select order#,columns,types from access$ where d_obj#=:1
860 4,090 4.8 0.00 0.00 1937775682
select con#,type#,condlength,intcols,robj#,rcon#,match#,refact,n
vl(enabled,0),rowid,cols,nvl(defer,0),mtime,nvl(spare1,0) from c
def$ where obj#=:1
860 4,216 4.9 0.00 0.00 2062595902
select owner#,name,namespace,remoteowner,linkname,p_timestamp,p_
obj#, nvl(property,0),subname,d_attrs from dependency$ d, obj$ o
where d_obj#=:1 and p_obj#=obj#(+) order by order#
860 216 0.3 0.00 0.00 2065408759
select con#,obj#,rcon#,enabled,nvl(defer,0) from cdef$ where rob
j#=:1
857 857 1.0 0.00 0.00 3047156589
select t.ts#,t.file#,t.block#,nvl(t.bobj#,0),nvl(t.tab#,0),t.int
cols,nvl(t.clucols,0),t.audit$,t.flags,t.pctfree$,t.pctused$,t.i
nitrans,t.maxtrans,t.rowcnt,t.blkcnt,t.empcnt,t.avgspc,t.chncnt,
t.avgrln,t.analyzetime,t.samplesize,t.cols,t.property,nvl(t.degr
ee,1),nvl(t.instances,1),t.avgspc_flb,t.flbcnt,t.kernelcols,nvl(
SQL ordered by Executions DB/Inst: ORCL/orcl Snaps: 1-32
-> End Executions Threshold: 100 Total Executions: 81,903
-> Captured SQL accounts for 76.9% of Total Executions
-> SQL reported below exceeded 1.0% of Total Executions
CPU per Elap per Old
Executions Rows Processed Rows per Exec Exec (s) Exec (s) Hash Value
SQL ordered by Parse Calls DB/Inst: ORCL/orcl Snaps: 1-32
-> End Parse Calls Threshold: 1000 Total Parse Calls: 30,669
-> Captured SQL accounts for 57.7% of Total Parse Calls
-> SQL reported below exceeded 1.0% of Total Parse Calls
% Total Old
Parse Calls Executions Parses Hash Value
1,388 616 4.53 260339297
insert into sys.col_usage$ values ( :objn, :coln, decode(bit
and(:flag,1),0,0,1), decode(bitand(:flag,2),0,0,1), decode(b
itand(:flag,4),0,0,1), decode(bitand(:flag,8),0,0,1), decode
(bitand(:flag,16),0,0,1), decode(bitand(:flag,32),0,0,1), :t
ime)
1,388 3,871 4.53 3665763022
update sys.col_usage$ set equality_preds = equality_preds
+ decode(bitand(:flag,1),0,0,1), equijoin_preds = equijoi
n_preds + decode(bitand(:flag,2),0,0,1), nonequijoin_preds
= nonequijoin_preds + decode(bitand(:flag,4),0,0,1), range_pre
ds = range_preds + decode(bitand(:flag,8),0,0,1),
901 901 2.94 2018736380
select timestamp, flags from fixed_obj$ where obj#=:1
860 860 2.80 1198893840
select order#,columns,types from access$ where d_obj#=:1
860 860 2.80 2062595902
select owner#,name,namespace,remoteowner,linkname,p_timestamp,p_
obj#, nvl(property,0),subname,d_attrs from dependency$ d, obj$ o
where d_obj#=:1 and p_obj#=obj#(+) order by order#
595 595 1.94 1348827743
select type#,blocks,extents,minexts,maxexts,extsize,extpct,user#
,iniexts,NVL(lists,65535),NVL(groups,65535),cachehint,hwmincr, N
VL(spare1,0),NVL(scanhint,0) from seg$ where ts#=:1 and file#=:2
and block#=:3
515 514 1.68 2803285
update sys.mon_mods$ set inserts = inserts + :ins, updates = upd
ates + :upd, deletes = deletes + :del, flags = (decode(bitand(fl
ags, :flag), :flag, flags, flags + :flag)), drop_segments = drop
_segments + :dropseg, timestamp = :time where obj# = :objn
478 478 1.56 336764478
select /*+ index(idl_char$ i_idl_char1) +*/ piece#,length,piece
from idl_char$ where obj#=:1 and part=:2 and version=:3 order by
piece#
478 478 1.56 386388955
select /*+ index(idl_ub2$ i_idl_ub21) +*/ piece#,length,piece fr
om idl_ub2$ where obj#=:1 and part=:2 and version=:3 order by pi
ece#
478 478 1.56 986338823
select /*+ index(idl_ub1$ i_idl_ub11) +*/ piece#,length,piece fr
om idl_ub1$ where obj#=:1 and part=:2 and version=:3 order by pi
ece#
SQL ordered by Parse Calls DB/Inst: ORCL/orcl Snaps: 1-32
-> End Parse Calls Threshold: 1000 Total Parse Calls: 30,669
-> Captured SQL accounts for 57.7% of Total Parse Calls
-> SQL reported below exceeded 1.0% of Total Parse Calls
% Total Old
Parse Calls Executions Parses Hash Value
478 478 1.56 2954231783
select /*+ index(idl_sb4$ i_idl_sb41) +*/ piece#,length,piece fr
om idl_sb4$ where obj#=:1 and part=:2 and version=:3 order by pi
ece#
469 576 1.53 1206412919
Module: OEM.SystemPool
BEGIN EMD_NOTIFICATION.QUEUE_READY(:1, :2, :3); END;
463 463 1.51 3468666020
select text from view$ where rowid=:1
442 442 1.44 4143084494
select privilege#,level from sysauth$ connect by grantee#=prior
privilege# and privilege#>0 start with grantee#=:1 and privilege
#>0
437 1,003 1.42 1980305124
select grantee#,privilege#,nvl(col#,0),max(mod(nvl(option$,0),2)
)from objauth$ where obj#=:1 group by grantee#,privilege#,nvl(co
l#,0) order by grantee#
433 999 1.41 204386021
select col#, grantee#, privilege#,max(mod(nvl(option$,0),2)) fro
m objauth$ where obj#=:1 and col# is not null group by privilege
#, col#, grantee# order by col#, grantee#
429 1,247 1.40 839312984
select name,intcol#,segcol#,type#,length,nvl(precision#,0),decod
e(type#,2,nvl(scale,-127/*MAXSB1MINAL*/),178,scale,179,scale,180
,scale,181,scale,182,scale,183,scale,231,scale,0),null$,fixedsto
rage,nvl(deflength,0),default$,rowid,col#,property, nvl(charseti
d,0),nvl(charsetform,0),spare1,spare2,nvl(spare3,0) from col$ wh
383 383 1.25 794436051
Module: OEM.SystemPool
SELECT INSTANTIABLE, supertype_owner, supertype_name, LOCAL_ATTR
IBUTES FROM all_types WHERE type_name = :1 AND owner = :2
320 860 1.04 2065408759
select con#,obj#,rcon#,enabled,nvl(defer,0) from cdef$ where rob
j#=:1
316 860 1.03 1937775682
select con#,type#,condlength,intcols,robj#,rcon#,match#,refact,n
vl(enabled,0),rowid,cols,nvl(defer,0),mtime,nvl(spare1,0) from c
def$ where obj#=:1
Instance Activity Stats DB/Inst: ORCL/orcl Snaps: 1-32
Statistic Total per Second per Trans
CPU used by this session 10,750 0.6 8.8
CPU used when call started 8,740 0.4 7.2
CR blocks created 325 0.0 0.3
DB time 3,594,299 182.8 2,941.3
DBWR checkpoint buffers written 6,467 0.3 5.3
DBWR checkpoints 1 0.0 0.0
DBWR revisited being-written buff 0 0.0 0.0
DBWR transaction table writes 341 0.0 0.3
DBWR undo block writes 1,453 0.1 1.2
IMU CR rollbacks 114 0.0 0.1
IMU Flushes 5,074 0.3 4.2
IMU Redo allocation size 654,720 33.3 535.8
IMU commits 712 0.0 0.6
IMU contention 1 0.0 0.0
IMU pool not allocated 3,388 0.2 2.8
IMU recursive-transaction flush 5 0.0 0.0
IMU undo allocation size 3,035,144 154.3 2,483.8
IMU- failed to get a private stra 3,388 0.2 2.8
SMON posted for undo segment shri 12 0.0 0.0
SQL*Net roundtrips to/from client 23,321 1.2 19.1
active txn count during cleanout 322 0.0 0.3
application wait time 79 0.0 0.1
background checkpoints completed 1 0.0 0.0
background checkpoints started 1 0.0 0.0
background timeouts 51,421 2.6 42.1
buffer is not pinned count 174,337 8.9 142.7
buffer is pinned count 50,933 2.6 41.7
bytes received via SQL*Net from c 2,725,918 138.6 2,230.7
bytes sent via SQL*Net to client 2,576,029 131.0 2,108.0
calls to get snapshot scn: kcmgss 116,448 5.9 95.3
calls to kcmgas 4,353 0.2 3.6
calls to kcmgcs 358 0.0 0.3
change write time 22 0.0 0.0
cleanout - number of ktugct calls 419 0.0 0.3
cleanouts only - consistent read 66 0.0 0.1
cluster key scan block gets 16,867 0.9 13.8
cluster key scans 9,001 0.5 7.4
commit batch performed 0 0.0 0.0
commit batch requested 0 0.0 0.0
commit batch/immediate performed 63 0.0 0.1
commit batch/immediate requested 63 0.0 0.1
commit cleanout failures: callbac 42 0.0 0.0
commit cleanouts 7,347 0.4 6.0
commit cleanouts successfully com 7,305 0.4 6.0
commit immediate performed 63 0.0 0.1
commit immediate requested 63 0.0 0.1
commit txn count during cleanout 224 0.0 0.2
concurrency wait time 399 0.0 0.3
consistent changes 334 0.0 0.3
consistent gets 319,228 16.2 261.2
consistent gets - examination 120,857 6.2 98.9
consistent gets from cache 319,228 16.2 261.2
cursor authentications 928 0.1 0.8
data blocks consistent reads - un 334 0.0 0.3
db block changes 53,514 2.7 43.8
db block gets 45,926 2.3 37.6
Instance Activity Stats DB/Inst: ORCL/orcl Snaps: 1-32
Statistic Total per Second per Trans
db block gets direct 6 0.0 0.0
db block gets from cache 45,920 2.3 37.6
deferred (CURRENT) block cleanout 4,343 0.2 3.6
dirty buffers inspected 3 0.0 0.0
enqueue conversions 3,469 0.2 2.8
enqueue releases 171,287 8.7 140.2
enqueue requests 171,286 8.7 140.2
execute count 81,903 4.2 67.0
free buffer inspected 2,042 0.1 1.7
free buffer requested 4,152 0.2 3.4
heap block compress 26 0.0 0.0
hot buffers moved to head of LRU 2,424 0.1 2.0
immediate (CR) block cleanout app 66 0.0 0.1
immediate (CURRENT) block cleanou 1,169 0.1 1.0
index fast full scans (full) 24 0.0 0.0
index fetch by key 53,607 2.7 43.9
index scans kdiixs1 76,910 3.9 62.9
leaf node 90-10 splits 25 0.0 0.0
leaf node splits 127 0.0 0.1
lob reads 299 0.0 0.2
lob writes 265 0.0 0.2
lob writes unaligned 265 0.0 0.2
logons cumulative 208 0.0 0.2
messages received 5,731 0.3 4.7
messages sent 5,731 0.3 4.7
no buffer to keep pinned count 0 0.0 0.0
no work - consistent read gets 124,209 6.3 101.6
opened cursors cumulative 42,875 2.2 35.1
parse count (failures) 1 0.0 0.0
parse count (hard) 3,843 0.2 3.1
parse count (total) 30,669 1.6 25.1
parse time cpu 1,500 0.1 1.2
parse time elapsed 1,955 0.1 1.6
physical read IO requests 2,043 0.1 1.7
physical read bytes 20,725,760 1,053.8 16,960.5
physical read total IO requests 7,860 0.4 6.4
physical read total bytes 114,110,464 5,802.1 93,380.1
physical read total multi block r 163 0.0 0.1
physical reads 2,530 0.1 2.1
physical reads cache 2,524 0.1 2.1
physical reads cache prefetch 487 0.0 0.4
physical reads direct 6 0.0 0.0
physical reads direct temporary t 0 0.0 0.0
physical write IO requests 3,745 0.2 3.1
physical write bytes 54,067,200 2,749.1 44,244.8
physical write total IO requests 22,112 1.1 18.1
physical write total bytes 341,971,968 17,388.1 279,846.1
physical write total multi block 2,744 0.1 2.3
physical writes 6,600 0.3 5.4
physical writes direct 12 0.0 0.0
physical writes direct (lob) 6 0.0 0.0
physical writes from cache 6,588 0.3 5.4
physical writes non checkpoint 3,981 0.2 3.3
process last non-idle time 17,544 0.9 14.4
recursive calls 591,275 30.1 483.9
recursive cpu usage 7,791 0.4 6.4
Instance Activity Stats DB/Inst: ORCL/orcl Snaps: 1-32
Statistic Total per Second per Trans
redo blocks written 25,836 1.3 21.1
redo buffer allocation retries 1 0.0 0.0
redo entries 27,110 1.4 22.2
redo log space requests 3 0.0 0.0
redo log space wait time 57 0.0 0.1
redo size 12,324,244 626.7 10,085.3
redo synch time 3,512 0.2 2.9
redo synch writes 8,475 0.4 6.9
redo wastage 589,132 30.0 482.1
redo write time 4,543 0.2 3.7
redo writer latching time 2 0.0 0.0
redo writes 2,080 0.1 1.7
rollback changes - undo records a 106 0.0 0.1
rollbacks only - consistent read 325 0.0 0.3
rows fetched via callback 27,348 1.4 22.4
session connect time 6 0.0 0.0
session cursor cache hits 29,153 1.5 23.9
session logical reads 365,154 18.6 298.8
session pga memory 78,268,312 3,979.7 64,049.4
session pga memory max 96,324,768 4,897.8 78,825.5
session uga memory 262,001,112,732 13,321,864.7 ############
session uga memory max 116,009,500 5,898.7 94,934.1
shared hash latch upgrades - no w 65,452 3.3 53.6
sorts (memory) 18,654 1.0 15.3
sorts (rows) 183,882 9.4 150.5
sql area purged 41 0.0 0.0
summed dirty queue length 49 0.0 0.0
switch current to new buffer 246 0.0 0.2
table fetch by rowid 76,818 3.9 62.9
table fetch continued row 684 0.0 0.6
table scan blocks gotten 34,161 1.7 28.0
table scan rows gotten 2,017,936 102.6 1,651.3
table scans (long tables) 1 0.0 0.0
table scans (short tables) 3,180 0.2 2.6
total number of times SMON posted 18 0.0 0.0
transaction rollbacks 63 0.0 0.1
undo change vector size 3,993,928 203.1 3,268.4
user I/O wait time 4,256 0.2 3.5
user calls 25,832 1.3 21.1
user commits 1,157 0.1 1.0
user rollbacks 65 0.0 0.1
workarea executions - optimal 9,385 0.5 7.7
write clones created in backgroun 0 0.0 0.0
write clones created in foregroun 1 0.0 0.0
Instance Activity Stats DB/Inst: ORCL/orcl Snaps: 1-32
-> Statistics with absolute values (should not be diffed)
Statistic Begin Value End Value
logons current 17 22
opened cursors current 98 199
session cursor cache count 168 2,568
Instance Activity Stats DB/Inst: ORCL/orcl Snaps: 1-32
-> Statistics identified by '(derived)' come from sources other than SYSSTAT
Statistic Total per Hour
log switches (derived) 1 .18
OS Statistics DB/Inst: ORCL/orcl Snaps: 1-32
-> ordered by statistic type (CPU use, Virtual Memory, Hardware Config), Name
Statistic Total
BUSY_TIME 63,332
IDLE_TIME 1,548,195
SYS_TIME 48,954
USER_TIME 14,378
VM_IN_BYTES 78,569,472
VM_OUT_BYTES 22,740,992
PHYSICAL_MEMORY_BYTES 536,399,872
NUM_CPUS 1
Tablespace IO Stats DB/Inst: ORCL/orcl Snaps: 1-32
->ordered by IOs (Reads + Writes) desc
Tablespace
Av Av Av Av Buffer Av Buf
Reads Reads/s Rd(ms) Blks/Rd Writes Writes/s Waits Wt(ms)
SYSTEM
5,659 0 12.7 1.2 452 0 10 24.0
SYSAUX
1,057 0 16.6 1.1 1,217 0 0 0.0
PERFSTAT
22 0 30.0 1.0 1,381 0 0 0.0
UNDOTBS1
34 0 23.5 1.0 768 0 9 0.0
EXAMPLE
8 0 75.0 1.0 2 0 0 0.0
USERS
6 0 50.0 1.0 2 0 0 0.0
File IO Stats DB/Inst: ORCL/orcl Snaps: 1-32
->Mx Rd Bkt: Max bucket time for single block read
->ordered by Tablespace, File
Tablespace Filename
Av Mx Av
Av Rd Rd Av Av Buffer BufWt
Reads Reads/s (ms) Bkt Blks/Rd Writes Writes/s Waits (ms)
EXAMPLE C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\EXAMPLE01.DBF
8 0 75.0 32 1.0 2 0 0
PERFSTAT C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\PERFSTAT.DBF
22 0 30.0 64 1.0 1,381 0 0
SYSAUX C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\SYSAUX01.DBF
1,057 0 16.6 ### 1.1 1,217 0 0
SYSTEM C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\SYSTEM01.DBF
5,659 0 12.7 ### 1.2 452 0 10 24.0
UNDOTBS1 C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\UNDOTBS01.DBF
34 0 23.5 32 1.0 768 0 9 0.0
USERS C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\USERS01.DBF
6 0 50.0 32 1.0 2 0 0
File Read Histogram Stats DB/Inst: ORCL/orcl Snaps: 1-32
->Number of single block reads in each time range
->ordered by Tablespace, File
Tablespace Filename
0 - 2 ms 2 - 4 ms 4 - 8 ms 8 - 16 ms 16 - 32 ms 32+ ms
SYSTEM C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\SYSTEM01.DBF
326 37 57 155 196 167
SYSAUX C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\SYSAUX01.DBF
497 48 35 100 177 98
USERS C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\USERS01.DBF
0 0 0 0 1 0
UNDOTBS1 C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\UNDOTBS01.DBF
2 1 0 0 4 0
EXAMPLE C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\EXAMPLE01.DBF
0 0 0 0 1 0
PERFSTAT C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\PERFSTAT.DBF
13 1 1 4 1 1
Buffer Pool Statistics DB/Inst: ORCL/orcl Snaps: 1-32
-> Standard block size Pools D: default, K: keep, R: recycle
-> Default Pools for other block sizes: 2k, 4k, 8k, 16k, 32k
-> Buffers: the number of buffers. Units of K, M, G are divided by 1000
Free Writ Buffer
Pool Buffer Physical Physical Buffer Comp Busy
P Buffers Hit% Gets Reads Writes Waits Wait Waits
D 8982 99 366,134 2,521 6,588 0 0 15
Instance Recovery Stats DB/Inst: ORCL/orcl Snaps: 1-32
-> B: Begin snapshot, E: End snapshot
Targt Estd Log File Log Ckpt Log Ckpt
MTTR MTTR Recovery Actual Target Size Timeout Interval
(s) (s) Estd IOs Redo Blks Redo Blks Redo Blks Redo Blks Redo Blks
B 0 17 2499 23208 184320 184320
E 0 14 215 23 2153 184320 2153
Buffer Pool Advisory DB/Inst: ORCL/orcl End Snap: 32
-> Only rows with estimated physical reads >0 are displayed
-> ordered by Pool, Block Size, Buffers For Estimate
Est
Phys Estimated Est
Size for Size Buffers Read Phys Reads Est Phys % dbtime
P Est (M) Factr (thousands) Factr (thousands) Read Time for Rds
D 4 .1 0 3.4 28 345 121.1
D 8 .1 1 2.7 22 265 93.0
D 12 .2 1 2.5 20 245 86.0
D 16 .2 2 2.3 19 230 80.7
D 20 .3 2 2.2 18 212 74.4
D 24 .3 3 1.8 15 177 62.1
D 28 .4 3 1.7 14 158 55.4
D 32 .4 4 1.4 12 131 46.0
D 36 .5 4 1.3 10 118 41.4
D 40 .6 5 1.2 10 107 37.5
D 44 .6 5 1.1 9 104 36.5
D 48 .7 6 1.1 9 101 35.4
D 52 .7 6 1.1 9 100 35.1
D 56 .8 7 1.1 9 98 34.4
D 60 .8 7 1.1 9 95 33.3
D 64 .9 8 1.0 9 94 33.0
D 68 .9 8 1.0 9 94 33.0
D 72 1.0 9 1.0 8 89 31.2
D 76 1.1 9 1.0 8 88 30.9
D 80 1.1 10 1.0 8 87 30.5
Buffer wait Statistics DB/Inst: ORCL/orcl Snaps: 1-32
-> ordered by wait time desc, waits desc
Class Waits Total Wait Time (s) Avg Time (ms)
data block 6 0 20
undo header 9 0 0
PGA Aggr Target Stats DB/Inst: ORCL/orcl Snaps: 1-32
-> B: Begin snap E: End snap (rows identified with B or E contain data
which is absolute i.e. not diffed over the interval)
-> PGA cache hit % - percentage of W/A (WorkArea) data processed only in-memory
-> Auto PGA Target - actual workarea memory target
-> W/A PGA Used - amount of memory used for all Workareas (manual + auto)
-> %PGA W/A Mem - percentage of PGA memory allocated to workareas
-> %Auto W/A Mem - percentage of workarea memory controlled by Auto Mem Mgmt
-> %Man W/A Mem - percentage of workarea memory under manual control
PGA Cache Hit % W/A MB Processed Extra W/A MB Read/Written
100.0 193 0
Warning: pga_aggregate_target was set too low for current workload, as this
value was exceeded during this interval. Use the PGA Advisory view
to help identify a different value for pga_aggregate_target.
%PGA %Auto %Man
PGA Aggr Auto PGA PGA Mem W/A PGA W/A W/A W/A Global Mem
Target(M) Target(M) Alloc(M) Used(M) Mem Mem Mem Bound(K)
B 16 4 24.5 0.0 .0 .0 .0 3,276
E 16 4 29.5 0.0 .0 .0 .0 3,276
PGA Aggr Target Histogram DB/Inst: ORCL/orcl Snaps: 1-32
-> Optimal Executions are purely in-memory operations
Low High
Optimal Optimal Total Execs Optimal Execs 1-Pass Execs M-Pass Execs
2K 4K 9,075 9,075 0 0
64K 128K 27 27 0 0
512K 1024K 232 232 0 0
PGA Memory Advisory DB/Inst: ORCL/orcl End Snap: 32
-> When using Auto Memory Mgmt, minimally choose a pga_aggregate_target value
where Estd PGA Overalloc Count is 0
Estd Extra Estd PGA Estd PGA
PGA Target Size W/A MB W/A MB Read/ Cache Overalloc
Est (MB) Factr Processed Written to Disk Hit % Count
12 0.8 211.0 0.0 100.0 1
16 1.0 211.0 0.0 100.0 1
19 1.2 211.0 0.0 100.0 1
22 1.4 211.0 0.0 100.0 0
26 1.6 211.0 0.0 100.0 0
29 1.8 211.0 0.0 100.0 0
32 2.0 211.0 0.0 100.0 0
48 3.0 211.0 0.0 100.0 0
64 4.0 211.0 0.0 100.0 0
96 6.0 211.0 0.0 100.0 0
128 8.0 211.0 0.0 100.0 0
Process Memory Summary Stats DB/Inst: ORCL/orcl Snaps: 1-32
-> B: Begin snap E: End snap
-> All rows below contain absolute values (i.e. not diffed over the interval)
-> Max Alloc is Maximum PGA Allocation size at snapshot time
Hist Max Alloc is the Historical Max Allocation for still-connected processes
-> Num Procs or Allocs: For Begin/End snapshot lines, it is the number of
processes. For Category lines, it is the number of allocations
-> ordered by Begin/End snapshot, Alloc (MB) desc
Hist Num
Avg Std Dev Max Max Procs
Alloc Used Freeabl Alloc Alloc Alloc Alloc or
Category (MB) (MB) (MB) (MB) (MB) (MB) (MB) Allocs
B -------- 24.8 12.4 .0 1.3 2.0 9 14 19
Other 24.1 1.3 2.0 9 10 19
SQL .6 .3 .1 .0 0 2 9
PL/SQL .2 .1 .0 .0 0 6 17
E -------- 29.7 16.1 .0 1.2 1.7 9 14 24
Other 28.6
null
Message was edited by:
user73673567
nullHi,
How do I interpret it ...That's a mighty big question. The STATSPACK report is very complex. I have my notes here, on how I do it:
http://www.dba-oracle.com/t_reading_statspack_report.htm
And can anyone please suggest measures The way your report is posted, it's very difficult to read!
I wrote a free tool that will accept your STATYSPACK report and make rudimentary suggestions, you might want to give it a try:
http://www.statspackanalyzer.com
Hope this helps. . .
Donald K. Burleson
Oracle Press author
Author of "Oracle Tuning: The Definitive Reference": -
Any general tips on getting better performance out of multi table insert?
I have been struggling with coding a multi table insert which is the first time I ever use one and my Oracle skills are pretty poor in general so now that the query is built and works fine I am sad to see its quite slow.
I have checked numerous articles on optimizing but the things I try dont seem to get me much better performance.
First let me describe my scenario to see if you agree that my performance is slow...
its an insert all command, which ends up inserting into 5 separate tables, conditionally (at least 4 inserts, sometimes 5 but the fifth is the smallest table). Some stats on these tables as follows:
Source table: 5.3M rows, ~150 columns wide. Parallel degree 4. everything else default.
Target table 1: 0 rows, 27 columns wide. Parallel 4. everything else default.
Target table 2: 0 rows, 63 columns wide. Parallel 4. default.
Target table 3: 0 rows, 33 columns wide. Parallel 4. default.
Target table 4: 0 rows, 9 columns wide. Parallel 4. default.
Target table 5: 0 rows, 13 columns wide. Parallel 4. default.
The parallelism is just about the only customization I myself have done. Why 4? I dont know it's pretty arbitrary to be honest.
Indexes?
Table 1 has 3 index + PK.
Table 2 has 0 index + FK + PK.
Table 3 has 4 index + FK + PK
Table 4 has 3 index + FK + PK
Table 5 has 4 index + FK + PK
None of the indexes are anything crazy, maybe 3 or 4 of all of them are on multiple columns, 2-3 max. The rest are on single columns.
The query itself looks something like this:
insert /*+ append */ all
when 1=1 then
into table1 (...) values (...)
into table2 (...) values (...)
when a=b then
into table3 (...) values (...)
when a=c then
into table3 (...) values (...)
when p=q then
into table4(...) values (...)
when x=y then
into table5(...) values (...)
select .... from source_table
Hints I tried are with append, without append, and parallel (though adding parallel seemed to make the query behave in serial, according to my session browser).
Now for the performance:
It does about 8,000 rows per minute on table1. So that means it should also have that much in table2, table3 and table4, and then a subset of that in table5.
Does that seem normal or am I expecting too much?
I find articles talking about millions of rows per minute... Obviously i dont think I can achieve that much... but maybe 30k or so on each table is a reasonable goal?
If it seems my performance is slow, what else do you think I should try? Is there any information I may try to get to see if maybe its a poorly configured database for this?
P.S. Is it possible I can run this so that it commits every x rows or something? I had the heartbreaking event of a network issue giving me this sudden "ora-25402: transaction must roll back" after it was running for 3.5 hours. So I lost all the progress it made... have to start over. plus i wonder if the sheer amount of data being queued for commit/rollback is causing some of the problem?
Edited by: trant on Jun 27, 2011 9:29 PMLooks like there are about 54 sessions on my database, 7 of the sessions belong to me (2 taken by TOAD and 4 by my parallel slave sessions and 1 by the master of those 4)
In v$session_event there are 546 rows, if i filter it to the SIDs of my current session and order my micro_wait_time desc:
510 events in waitclass Other 30670 9161 329759 10.75 196 3297590639 1736664284 1893977003 0 Other
512 events in waitclass Other 32428 10920 329728 10.17 196 3297276553 1736664284 1893977003 0 Other
243 events in waitclass Other 21513 5 329594 15.32 196 3295935977 1736664284 1893977003 0 Other
223 events in waitclass Other 21570 52 329590 15.28 196 3295898897 1736664284 1893977003 0 Other
241 row cache lock 1273669 0 42137 0.03 267 421374408 1714089451 3875070507 4 Concurrency
241 events in waitclass Other 614793 0 34266 0.06 12 342660764 1736664284 1893977003 0 Other
241 db file sequential read 13323 0 3948 0.3 13 39475015 2652584166 1740759767 8 User I/O
241 SQL*Net message from client 7 0 1608 229.65 1566 16075283 1421975091 2723168908 6 Idle
241 log file switch completion 83 0 459 5.54 73 4594763 3834950329 3290255840 2 Configuration
241 gc current grant 2-way 5023 0 159 0.03 0 1591377 2685450749 3871361733 11 Cluster
241 os thread startup 4 0 55 13.82 26 552895 86156091 3875070507 4 Concurrency
241 enq: HW - contention 574 0 38 0.07 0 378395 1645217925 3290255840 2 Configuration
512 PX Deq: Execution Msg 3 0 28 9.45 28 283374 98582416 2723168908 6 Idle
243 PX Deq: Execution Msg 3 0 27 9.1 27 272983 98582416 2723168908 6 Idle
223 PX Deq: Execution Msg 3 0 25 8.26 24 247673 98582416 2723168908 6 Idle
510 PX Deq: Execution Msg 3 0 24 7.86 23 235777 98582416 2723168908 6 Idle
243 PX Deq Credit: need buffer 1 0 17 17.2 17 171964 2267953574 2723168908 6 Idle
223 PX Deq Credit: need buffer 1 0 16 15.92 16 159230 2267953574 2723168908 6 Idle
512 PX Deq Credit: need buffer 1 0 16 15.84 16 158420 2267953574 2723168908 6 Idle
510 direct path read 360 0 15 0.04 4 153411 3926164927 1740759767 8 User I/O
243 direct path read 352 0 13 0.04 6 134188 3926164927 1740759767 8 User I/O
223 direct path read 359 0 13 0.04 5 129859 3926164927 1740759767 8 User I/O
241 PX Deq: Execute Reply 6 0 13 2.12 10 127246 2599037852 2723168908 6 Idle
510 PX Deq Credit: need buffer 1 0 12 12.28 12 122777 2267953574 2723168908 6 Idle
512 direct path read 351 0 12 0.03 5 121579 3926164927 1740759767 8 User I/O
241 PX Deq: Parse Reply 7 0 9 1.28 6 89348 4255662421 2723168908 6 Idle
241 SQL*Net break/reset to client 2 0 6 2.91 6 58253 1963888671 4217450380 1 Application
241 log file sync 1 0 5 5.14 5 51417 1328744198 3386400367 5 Commit
510 cursor: pin S wait on X 3 2 2 0.83 1 24922 1729366244 3875070507 4 Concurrency
512 cursor: pin S wait on X 2 2 2 1.07 1 21407 1729366244 3875070507 4 Concurrency
243 cursor: pin S wait on X 2 2 2 1.06 1 21251 1729366244 3875070507 4 Concurrency
241 library cache lock 29 0 1 0.05 0 13228 916468430 3875070507 4 Concurrency
241 PX Deq: Join ACK 4 0 0 0.07 0 2789 4205438796 2723168908 6 Idle
241 SQL*Net more data from client 6 0 0 0.04 0 2474 3530226808 2000153315 7 Network
241 gc current block 2-way 5 0 0 0.04 0 2090 111015833 3871361733 11 Cluster
241 enq: KO - fast object checkpoint 4 0 0 0.04 0 1735 4205197519 4217450380 1 Application
241 gc current grant busy 4 0 0 0.03 0 1337 2277737081 3871361733 11 Cluster
241 gc cr block 2-way 1 0 0 0.06 0 586 737661873 3871361733 11 Cluster
223 db file sequential read 1 0 0 0.05 0 461 2652584166 1740759767 8 User I/O
223 gc current block 2-way 1 0 0 0.05 0 452 111015833 3871361733 11 Cluster
241 latch: row cache objects 2 0 0 0.02 0 434 1117386924 3875070507 4 Concurrency
241 enq: TM - contention 1 0 0 0.04 0 379 668627480 4217450380 1 Application
512 PX Deq: Msg Fragment 4 0 0 0.01 0 269 77145095 2723168908 6 Idle
241 latch: library cache 3 0 0 0.01 0 243 589947255 3875070507 4 Concurrency
510 PX Deq: Msg Fragment 3 0 0 0.01 0 215 77145095 2723168908 6 Idle
223 PX Deq: Msg Fragment 4 0 0 0 0 145 77145095 2723168908 6 Idle
241 buffer busy waits 1 0 0 0.01 0 142 2161531084 3875070507 4 Concurrency
243 PX Deq: Msg Fragment 2 0 0 0 0 84 77145095 2723168908 6 Idle
241 latch: cache buffers chains 4 0 0 0 0 73 2779959231 3875070507 4 Concurrency
241 SQL*Net message to client 7 0 0 0 0 51 2067390145 2000153315 7 Network
(yikes, is there a way to wrap that in equivalent of other forums' tag?)
v$session_wait;
223 835 PX Deq Credit: send blkd sleeptime/senderid 268697599 000000001003FFFF passes 1 0000000000000001 qref 0 00 1893977003 0 Other 0 10 WAITING
241 22819 row cache lock cache id 13 000000000000000D mode 0 00 request 5 0000000000000005 3875070507 4 Concurrency -1 0 WAITED SHORT TIME
243 747 PX Deq Credit: send blkd sleeptime/senderid 268697599 000000001003FFFF passes 1 0000000000000001 qref 0 00 1893977003 0 Other 0 7 WAITING
510 10729 PX Deq Credit: send blkd sleeptime/senderid 268697599 000000001003FFFF passes 1 0000000000000001 qref 0 00 1893977003 0 Other 0 2 WAITING
512 12718 PX Deq Credit: send blkd sleeptime/senderid 268697599 000000001003FFFF passes 1 0000000000000001 qref 0 00 1893977003 0 Other 0 4 WAITING
v$sess_io:
223 0 5779 5741 0 0
241 38773810 2544298 15107 27274891 0
243 0 5702 5688 0 0
510 0 5729 5724 0 0
512 0 5682 5678 0 0 -
Performance Degradated Possibly due to CPU Time
Hi Gurus,
There is a utility in our application with which we can upload an excel sheet containing data and schedule the timing of the job, now when the job is executed, each row in the excel sheet leads to dml operations on multiple tables finally leading to generation of a transaction no. Now at the start around 100-120 transaction nos were generated which goes down drastically to around 30-35 after 6-7 hours. AWR report at the two instances shows that CPU time has decreased considerably in the 2nd case.
I would like you experts to check the awr reports and suggest me the probable reason for the decrease in performance.
Brief AWR Report When Performance was OK
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 2151 14-Dec-10 16:32:57 26 3.7
End Snap: 2152 14-Dec-10 17:31:04 40 16.7
Elapsed: 58.13 (mins)
DB Time: 55.37 (mins)
Cache Sizes
~~~~~~~~~~~ Begin End
Buffer Cache: 436M 444M Std Block Size: 8K
Shared Pool Size: 120M 120M Log Buffer: 6,968K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 27,541.56 1,747.07
Logical reads: 49,830.97 3,160.97
Block changes: 181.79 11.53
Physical reads: 1,270.12 80.57
Physical writes: 2.81 0.18
User calls: 119.95 7.61
Parses: 200.94 12.75
Hard parses: 29.29 1.86
Sorts: 91.80 5.82
Logons: 0.03 0.00
Executes: 457.16 29.00
Transactions: 15.76
% Blocks changed per Read: 0.36 Recursive Call %: 96.36
Rollback per transaction %: 0.01 Rows per Sort: 270.64
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 97.45 In-memory Sort %: 100.00
Library Hit %: 90.18 Soft Parse %: 85.42
Execute to Parse %: 56.05 Latch Hit %: 100.00
Parse CPU to Parse Elapsd %: 98.04 % Non-Parse CPU: 94.98
Shared Pool Statistics Begin End
Memory Usage %: 72.65 84.55
% SQL with executions>1: 71.49 75.08
% Memory for SQL w/exec>1: 84.79 85.25
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
CPU time 2,541 76.5
db file scattered read 284,992 410 1 12.3 User I/O
log file parallel write 31,188 145 5 4.4 System I/O
TCP Socket (KGAS) 24 131 5459 3.9 Network
log file sync 8,617 46 5 1.4 Commit
Time Model Statistics DB/Inst: ABCTEST/abctest Snaps: 2151-2152
-> Total time in database user-calls (DB Time): 3322.4s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 3,176.8 95.6
DB CPU 2,541.1 76.5
PL/SQL execution elapsed time 288.5 8.7
parse time elapsed 278.7 8.4
hard parse elapsed time 254.6 7.7
PL/SQL compilation elapsed time 28.9 .9
failed parse elapsed time 4.9 .1
hard parse (sharing criteria) elapsed time 1.3 .0
sequence load elapsed time 1.1 .0
repeated bind elapsed time 1.1 .0
connection management call elapsed time 0.7 .0
hard parse (bind mismatch) elapsed time 0.3 .0
DB time 3,322.4 N/A
background elapsed time 197.1 N/A
background cpu time 5.6 N/A
Wait Class DB/Inst: ABCTEST/abctest Snaps: 2151-2152
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc
Avg
%Time Total Wait wait Waits
Wait Class Waits -outs Time (s) (ms) /txn
User I/O 292,720 .0 427 1 5.3
System I/O 37,408 .0 190 5 0.7
Network 272,062 .0 132 0 4.9
Commit 8,617 .0 46 5 0.2
Configuration 4 .0 2 593 0.0
Application 3,212 .0 0 0 0.1
Other 280 .4 0 0 0.0
Concurrency 247 .0 0 0 0.0
Wait Events DB/Inst: ABCTEST/abctest Snaps: 2151-2152
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file scattered read 284,992 .0 410 1 5.2
log file parallel write 31,188 .0 145 5 0.6
TCP Socket (KGAS) 24 .0 131 5459 0.0
log file sync 8,617 .0 46 5 0.2
db file parallel write 4,215 .0 29 7 0.1
db file sequential read 7,634 .0 16 2 0.1
control file parallel write 1,202 .0 16 13 0.0
Streams AQ: enqueue blocked 1 .0 2 2055 0.0
control file sequential read 795 .0 1 1 0.0
Data file init write 48 .0 0 9 0.0
SQL*Net message to client 266,802 .0 0 0 4.9
log file switch completion 3 .0 0 106 0.0
SQL*Net break/reset to clien 3,212 .0 0 0 0.1
SQL*Net more data to client 4,789 .0 0 0 0.1
direct path write 23 .0 0 3 0.0
rdbms ipc reply 67 .0 0 1 0.0
kksfbc child completion 1 100.0 0 47 0.0
latch: shared pool 213 .0 0 0 0.0
latch: library cache 26 .0 0 1 0.0
log file single write 4 .0 0 7 0.0
log file sequential read 4 .0 0 5 0.0
db file single write 3 .0 0 5 0.0
os thread startup 3 .0 0 4 0.0
enq: JS - queue lock 4 .0 0 3 0.0
LGWR wait for redo copy 207 .0 0 0 0.0
library cache pin 1 .0 0 6 0.0
SQL*Net more data from clien 447 .0 0 0 0.0
library cache load lock 1 .0 0 2 0.0
latch: cache buffers chains 1 .0 0 0 0.0
latch: row cache objects 1 .0 0 0 0.0
direct path read 20 .0 0 0 0.0
latch free 1 .0 0 0 0.0
cursor: mutex S 1 .0 0 0 0.0
SQL*Net message from client 266,789 .0 64,143 240 4.9
Streams AQ: qmn slave idle w 124 .0 3,488 28127 0.0
Streams AQ: qmn coordinator 257 51.4 3,488 13571 0.0
virtual circuit status 116 100.0 3,480 29999 0.0
Streams AQ: waiting for time 5 60.0 745 148902 0.0
jobq slave wait 52 96.2 155 2987 0.0
PL/SQL lock timer 16 100.0 16 995 0.0
class slave wait 1 100.0 5 4995 0.0
Background Wait Events DB/Inst: ABCTEST/abctest Snaps: 2151-2152
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
log file parallel write 31,188 .0 145 5 0.6
db file parallel write 4,215 .0 29 7 0.1
control file parallel write 1,193 .0 16 13 0.0
Streams AQ: enqueue blocked 1 .0 2 2055 0.0
control file sequential read 691 .0 0 1 0.0
db file sequential read 66 .0 0 5 0.0
direct path write 23 .0 0 3 0.0
log file single write 4 .0 0 7 0.0
log file sequential read 4 .0 0 5 0.0
events in waitclass Other 211 .0 0 0 0.0
os thread startup 3 .0 0 4 0.0
db file scattered read 1 .0 0 13 0.0
latch: shared pool 5 .0 0 0 0.0
direct path read 20 .0 0 0 0.0
latch: library cache 1 .0 0 0 0.0
rdbms ipc message 34,411 32.3 30,621 890 0.6
Streams AQ: qmn slave idle w 124 .0 3,488 28127 0.0
Streams AQ: qmn coordinator 257 51.4 3,488 13571 0.0
pmon timer 1,235 100.0 3,486 2822 0.0
smon timer 19 47.4 3,460 182099 0.0
Streams AQ: waiting for time 5 60.0 745 148902 0.0
class slave wait 1 100.0 5 4995 0.0
Operating System Statistics DB/Inst: ABCTEST/abctest Snaps: 2151-2152
Statistic Total
AVG_BUSY_TIME 81,951
AVG_IDLE_TIME 266,698
AVG_SYS_TIME 10,482
AVG_USER_TIME 71,389
BUSY_TIME 328,163
IDLE_TIME 1,067,144
SYS_TIME 42,281
USER_TIME 285,882
RSRC_MGR_CPU_WAIT_TIME 0
VM_IN_BYTES 1,625,600,000
VM_OUT_BYTES 145,162,240
PHYSICAL_MEMORY_BYTES 3,755,851,776
NUM_CPUS 4
NUM_CPU_CORES 1
Brief AWR Report When Performance* Deteriorated.
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 2168 15-Dec-10 08:31:05 32 18.4
End Snap: 2169 15-Dec-10 09:30:56 32 18.3
Elapsed: 59.85 (mins)
DB Time: 17.97 (mins)
Cache Sizes
~~~~~~~~~~~ Begin End
Buffer Cache: 448M 448M Std Block Size: 8K
Shared Pool Size: 116M 116M Log Buffer: 6,968K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 10,503.58 1,792.02
Logical reads: 17,583.21 2,999.87
Block changes: 68.60 11.70
Physical reads: 472.37 80.59
Physical writes: 1.54 0.26
User calls: 39.12 6.67
Parses: 53.32 9.10
Hard parses: 7.99 1.36
Sorts: 13.84 2.36
Logons: 0.00 0.00
Executes: 130.30 22.23
Transactions: 5.86
% Blocks changed per Read: 0.39 Recursive Call %: 94.39
Rollback per transaction %: 0.00 Rows per Sort: 691.64
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 97.31 In-memory Sort %: 100.00
Library Hit %: 92.41 Soft Parse %: 85.02
Execute to Parse %: 59.08 Latch Hit %: 100.00
Parse CPU to Parse Elapsd %: 100.28 % Non-Parse CPU: 95.35
Shared Pool Statistics Begin End
Memory Usage %: 88.40 88.48
% SQL with executions>1: 76.15 80.48
% Memory for SQL w/exec>1: 86.82 88.85
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
CPU time 918 85.1
db file scattered read 113,003 127 1 11.7 User I/O
log file parallel write 11,978 52 4 4.8 System I/O
db file parallel write 3,089 16 5 1.4 System I/O
control file parallel write 1,217 15 13 1.4 System I/O
Time Model Statistics DB/Inst: ABCTEST/abctest Snaps: 2168-2169
-> Total time in database user-calls (DB Time): 1078.1s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 1,032.1 95.7
DB CPU 917.6 85.1
parse time elapsed 71.8 6.7
hard parse elapsed time 52.4 4.9
PL/SQL execution elapsed time 7.2 .7
PL/SQL compilation elapsed time 6.2 .6
failed parse elapsed time 1.8 .2
sequence load elapsed time 0.4 .0
repeated bind elapsed time 0.3 .0
connection management call elapsed time 0.1 .0
hard parse (sharing criteria) elapsed time 0.0 .0
hard parse (bind mismatch) elapsed time 0.0 .0
DB time 1,078.1 N/A
background elapsed time 89.4 N/A
background cpu time 6.4 N/A
Wait Class DB/Inst: ABCTEST/abctest Snaps: 2168-2169
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc
Avg
%Time Total Wait wait Waits
Wait Class Waits -outs Time (s) (ms) /txn
User I/O 122,810 .0 133 1 5.8
System I/O 17,013 .0 83 5 0.8
Commit 3,129 .0 14 5 0.1
Network 90,186 .0 0 0 4.3
Configuration 2 .0 0 63 0.0
Application 1,120 .0 0 0 0.1
Other 112 .0 0 0 0.0
Concurrency 2 .0 0 6 0.0
Wait Events DB/Inst: ABCTEST/abctest Snaps: 2168-2169
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file scattered read 113,003 .0 127 1 5.4
log file parallel write 11,978 .0 52 4 0.6
db file parallel write 3,089 .0 16 5 0.1
control file parallel write 1,217 .0 15 13 0.1
log file sync 3,129 .0 14 5 0.1
db file sequential read 9,753 .0 6 1 0.5
control file sequential read 725 .0 0 0 0.0
Data file init write 32 .0 0 7 0.0
SQL*Net message to client 88,906 .0 0 0 4.2
log file switch completion 2 .0 0 63 0.0
SQL*Net break/reset to clien 1,120 .0 0 0 0.1
rdbms ipc reply 4 .0 0 8 0.0
direct path write 10 .0 0 3 0.0
SQL*Net more data to client 1,120 .0 0 0 0.1
db file single write 2 .0 0 6 0.0
os thread startup 2 .0 0 6 0.0
log file single write 2 .0 0 4 0.0
log file sequential read 2 .0 0 3 0.0
SQL*Net more data from clien 160 .0 0 0 0.0
LGWR wait for redo copy 108 .0 0 0 0.0
direct path read 10 .0 0 0 0.0
SQL*Net message from client 88,906 .0 55,500 624 4.2
virtual circuit status 120 100.0 3,588 29900 0.0
Streams AQ: qmn slave idle w 127 .0 3,550 27949 0.0
Streams AQ: qmn coordinator 260 51.2 3,550 13652 0.0
class slave wait 2 100.0 10 4994 0.0
SGA: MMAN sleep for componen 9 22.2 0 4 0.0
Background Wait Events DB/Inst: ABCTEST/abctest Snaps: 2168-2169
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
log file parallel write 11,978 .0 52 4 0.6
db file parallel write 3,089 .0 16 5 0.1
control file parallel write 1,211 .0 15 13 0.1
db file scattered read 175 .0 0 1 0.0
control file sequential read 33 .0 0 2 0.0
db file sequential read 53 .0 0 1 0.0
direct path write 10 .0 0 3 0.0
os thread startup 2 .0 0 6 0.0
log file single write 2 .0 0 4 0.0
log file sequential read 2 .0 0 3 0.0
events in waitclass Other 108 .0 0 0 0.0
direct path read 10 .0 0 0 0.0
rdbms ipc message 19,991 57.4 31,320 1567 0.9
pmon timer 1,208 100.0 3,590 2972 0.1
Streams AQ: qmn slave idle w 127 .0 3,550 27949 0.0
Streams AQ: qmn coordinator 260 51.2 3,550 13652 0.0
smon timer 12 100.0 3,302 275149 0.0
SGA: MMAN sleep for componen 9 22.2 0 4 0.0
Operating System Statistics DB/Inst: ABCTEST/abctest Snaps: 2168-2169
Statistic Total
AVG_BUSY_TIME 30,152
AVG_IDLE_TIME 328,781
AVG_SYS_TIME 4,312
AVG_USER_TIME 25,757
BUSY_TIME 120,981
IDLE_TIME 1,315,433
SYS_TIME 17,612
USER_TIME 103,369
RSRC_MGR_CPU_WAIT_TIME 0
VM_IN_BYTES 353,361,920
VM_OUT_BYTES 163,041,280
PHYSICAL_MEMORY_BYTES 3,755,851,776
NUM_CPUS 4
NUM_CPU_CORES 1
Request you to help me.
Thanks in Advance,
RajeshHi CKPT,
Thanks for your reply.
The main finding that I have got from addm report (in both the cases i.e when performance was good initially vis a vis when performance deteriorated is the same -
FINDING 1: 100% impact (3234 seconds)
Significant virtual memory paging was detected on the host operating system.
RECOMMENDATION 1: Host Configuration, 100% benefit (3234 seconds)
ACTION: Host operating system was experiencing significant paging but no
particular root cause could be detected. Investigate processes that
do not belong to this instance running on the host that are consuming
significant amount of virtual memory. Also consider adding more
physical memory to the host.
I still am unable to find out the reasons ... pls help.
Thanks
Rajesh -
Log file sync top event during performance test -av 36ms
Hi,
During the performance test for our product before deployment into product i see "log file sync" on top with Avg wait (ms) being 36 which i feel is too high.
Avg
wait % DB
Event Waits Time(s) (ms) time Wait Class
log file sync 208,327 7,406 36 46.6 Commit
direct path write 646,833 3,604 6 22.7 User I/O
DB CPU 1,599 10.1
direct path read temp 1,321,596 619 0 3.9 User I/O
log buffer space 4,161 558 134 3.5 ConfiguratAlthough testers are not complaining about the performance of the appplication , we ,DBAs, are expected to be proactive about the any bad signals from DB.
I am not able to figure out why "log file sync" is having such slow response.
Below is the snapshot from the load profile.
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 108127 16-May-13 20:15:22 105 6.5
End Snap: 108140 16-May-13 23:30:29 156 8.9
Elapsed: 195.11 (mins)
DB Time: 265.09 (mins)
Cache Sizes Begin End
~~~~~~~~~~~ ---------- ----------
Buffer Cache: 1,168M 1,136M Std Block Size: 8K
Shared Pool Size: 1,120M 1,168M Log Buffer: 16,640K
Load Profile Per Second Per Transaction Per Exec Per Call
~~~~~~~~~~~~ --------------- --------------- ---------- ----------
DB Time(s): 1.4 0.1 0.02 0.01
DB CPU(s): 0.1 0.0 0.00 0.00
Redo size: 607,512.1 33,092.1
Logical reads: 3,900.4 212.5
Block changes: 1,381.4 75.3
Physical reads: 134.5 7.3
Physical writes: 134.0 7.3
User calls: 145.5 7.9
Parses: 24.6 1.3
Hard parses: 7.9 0.4
W/A MB processed: 915,418.7 49,864.2
Logons: 0.1 0.0
Executes: 85.2 4.6
Rollbacks: 0.0 0.0
Transactions: 18.4Some of the top background wait events:
^LBackground Wait Events DB/Inst: Snaps: 108127-108140
-> ordered by wait time desc, waits desc (idle events last)
-> Only events with Total Wait Time (s) >= .001 are shown
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Avg
%Time Total Wait wait Waits % bg
Event Waits -outs Time (s) (ms) /txn time
log file parallel write 208,563 0 2,528 12 1.0 66.4
db file parallel write 4,264 0 785 184 0.0 20.6
Backup: sbtbackup 1 0 516 516177 0.0 13.6
control file parallel writ 4,436 0 97 22 0.0 2.6
log file sequential read 6,922 0 95 14 0.0 2.5
Log archive I/O 6,820 0 48 7 0.0 1.3
os thread startup 432 0 26 60 0.0 .7
Backup: sbtclose2 1 0 10 10094 0.0 .3
db file sequential read 2,585 0 8 3 0.0 .2
db file single write 560 0 3 6 0.0 .1
log file sync 28 0 1 53 0.0 .0
control file sequential re 36,326 0 1 0 0.2 .0
log file switch completion 4 0 1 207 0.0 .0
buffer busy waits 5 0 1 116 0.0 .0
LGWR wait for redo copy 924 0 1 1 0.0 .0
log file single write 56 0 1 9 0.0 .0
Backup: sbtinfo2 1 0 1 500 0.0 .0During a previous perf test , things didnt look this bad for "log file sync. Few sections from the comparision report(awrddprt.sql)
{code}
Workload Comparison
~~~~~~~~~~~~~~~~~~~ 1st Per Sec 2nd Per Sec %Diff 1st Per Txn 2nd Per Txn %Diff
DB time: 0.78 1.36 74.36 0.02 0.07 250.00
CPU time: 0.18 0.14 -22.22 0.00 0.01 100.00
Redo size: 573,678.11 607,512.05 5.90 15,101.84 33,092.08 119.13
Logical reads: 4,374.04 3,900.38 -10.83 115.14 212.46 84.52
Block changes: 1,593.38 1,381.41 -13.30 41.95 75.25 79.38
Physical reads: 76.44 134.54 76.01 2.01 7.33 264.68
Physical writes: 110.43 134.00 21.34 2.91 7.30 150.86
User calls: 197.62 145.46 -26.39 5.20 7.92 52.31
Parses: 7.28 24.55 237.23 0.19 1.34 605.26
Hard parses: 0.00 7.88 100.00 0.00 0.43 100.00
Sorts: 3.88 4.90 26.29 0.10 0.27 170.00
Logons: 0.09 0.08 -11.11 0.00 0.00 0.00
Executes: 126.69 85.19 -32.76 3.34 4.64 38.92
Transactions: 37.99 18.36 -51.67
First Second Diff
1st 2nd
Event Wait Class Waits Time(s) Avg Time(ms) %DB time Event Wait Class Waits Time(s) Avg Time
(ms) %DB time
SQL*Net more data from client Network 2,133,486 1,270.7 0.6 61.24 log file sync Commit 208,355 7,407.6
35.6 46.57
CPU time N/A 487.1 N/A 23.48 direct path write User I/O 646,849 3,604.7
5.6 22.66
log file sync Commit 99,459 129.5 1.3 6.24 log file parallel write System I/O 208,564 2,528.4
12.1 15.90
log file parallel write System I/O 100,732 126.6 1.3 6.10 CPU time N/A 1,599.3
N/A 10.06
SQL*Net more data to client Network 451,810 103.1 0.2 4.97 db file parallel write System I/O 4,264 784.7 1
84.0 4.93
-direct path write User I/O 121,044 52.5 0.4 2.53 -SQL*Net more data from client Network 7,407,435 279.7
0.0 1.76
-db file parallel write System I/O 986 22.8 23.1 1.10 -SQL*Net more data to client Network 2,714,916 64.6
0.0 0.41
{code}
*To sum it sup:
1. Why is the IO response getting such an hit during the new perf test? Please suggest*
2. Does the number of DB writer impact "log file sync" wait event? We have only one DB writer as the number of cpu on the host is only 4
{code}
select *from v$version;
BANNER
Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - 64bit Production
PL/SQL Release 11.1.0.7.0 - Production
CORE 11.1.0.7.0 Production
TNS for HPUX: Version 11.1.0.7.0 - Production
NLSRTL Version 11.1.0.7.0 - Production
{code}
Please let me know if you would like to see any other stats.
Edited by: Kunwar on May 18, 2013 2:20 PM1. A snapshot interval of 3 hours always generates meaningless results
Below are some details from the 1 hour interval AWR report.
Platform CPUs Cores Sockets Memory(GB)
HP-UX IA (64-bit) 4 4 3 31.95
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 108129 16-May-13 20:45:32 140 8.0
End Snap: 108133 16-May-13 21:45:53 150 8.8
Elapsed: 60.35 (mins)
DB Time: 140.49 (mins)
Cache Sizes Begin End
~~~~~~~~~~~ ---------- ----------
Buffer Cache: 1,168M 1,168M Std Block Size: 8K
Shared Pool Size: 1,120M 1,120M Log Buffer: 16,640K
Load Profile Per Second Per Transaction Per Exec Per Call
~~~~~~~~~~~~ --------------- --------------- ---------- ----------
DB Time(s): 2.3 0.1 0.03 0.01
DB CPU(s): 0.1 0.0 0.00 0.00
Redo size: 719,553.5 34,374.6
Logical reads: 4,017.4 191.9
Block changes: 1,521.1 72.7
Physical reads: 136.9 6.5
Physical writes: 158.3 7.6
User calls: 167.0 8.0
Parses: 25.8 1.2
Hard parses: 8.9 0.4
W/A MB processed: 406,220.0 19,406.0
Logons: 0.1 0.0
Executes: 88.4 4.2
Rollbacks: 0.0 0.0
Transactions: 20.9
Top 5 Timed Foreground Events
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Avg
wait % DB
Event Waits Time(s) (ms) time Wait Class
log file sync 73,761 6,740 91 80.0 Commit
log buffer space 3,581 541 151 6.4 Configurat
DB CPU 348 4.1
direct path write 238,962 241 1 2.9 User I/O
direct path read temp 487,874 174 0 2.1 User I/O
Background Wait Events DB/Inst: Snaps: 108129-108133
-> ordered by wait time desc, waits desc (idle events last)
-> Only events with Total Wait Time (s) >= .001 are shown
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Avg
%Time Total Wait wait Waits % bg
Event Waits -outs Time (s) (ms) /txn time
log file parallel write 61,049 0 1,891 31 0.8 87.8
db file parallel write 1,590 0 251 158 0.0 11.6
control file parallel writ 1,372 0 56 41 0.0 2.6
log file sequential read 2,473 0 50 20 0.0 2.3
Log archive I/O 2,436 0 20 8 0.0 .9
os thread startup 135 0 8 60 0.0 .4
db file sequential read 668 0 4 6 0.0 .2
db file single write 200 0 2 9 0.0 .1
log file sync 8 0 1 152 0.0 .1
log file single write 20 0 0 21 0.0 .0
control file sequential re 11,218 0 0 0 0.1 .0
buffer busy waits 2 0 0 161 0.0 .0
direct path write 6 0 0 37 0.0 .0
LGWR wait for redo copy 380 0 0 0 0.0 .0
log buffer space 1 0 0 89 0.0 .0
latch: cache buffers lru c 3 0 0 1 0.0 .0 2 The log file sync is a result of commit --> you are committing too often, maybe even every individual record.
Thanks for explanation. +Actually my question is WHY is it so slow (avg wait of 91ms)+3 Your IO subsystem hosting the online redo log files can be a limiting factor.
We don't know anything about your online redo log configuration
Below is my redo log configuration.
GROUP# STATUS TYPE MEMBER IS_
1 ONLINE /oradata/fs01/PERFDB1/redo_1a.log NO
1 ONLINE /oradata/fs02/PERFDB1/redo_1b.log NO
2 ONLINE /oradata/fs01/PERFDB1/redo_2a.log NO
2 ONLINE /oradata/fs02/PERFDB1/redo_2b.log NO
3 ONLINE /oradata/fs01/PERFDB1/redo_3a.log NO
3 ONLINE /oradata/fs02/PERFDB1/redo_3b.log NO
6 rows selected.
04:13:14 perf_monitor@PERFDB1> col FIRST_CHANGE# for 999999999999999999
04:13:26 perf_monitor@PERFDB1> select *from v$log;
GROUP# THREAD# SEQUENCE# BYTES MEMBERS ARC STATUS FIRST_CHANGE# FIRST_TIME
1 1 40689 524288000 2 YES INACTIVE 13026185905545 18-MAY-13 01:00
2 1 40690 524288000 2 YES INACTIVE 13026185931010 18-MAY-13 03:32
3 1 40691 524288000 2 NO CURRENT 13026185933550 18-MAY-13 04:00Edited by: Kunwar on May 18, 2013 2:46 PM
Maybe you are looking for
-
How do you buy the adobe creative cloud student package in UK not usa
I am really starting to lose my wick trying to buy this software i want to get it purchased tonight and ive been trying to figure out how to pay for it in uk not usa all day. I have selected united kingdom on the location thing but everytime i go to
-
My old PC died and I replaced it with a MacBook Pro. Although I was able to copy the data from the PC's hard drive, I am unable to export my previous bookmarks/favorites to an html file because that PC won't boot. Is there any other way to import t
-
HP prime entering simple routines
Hi, I am trying the HP prime and I am somewhat disappointed. A couple of simple things have baffled me: First of all I use RPN all the time. With my 50G I could enter numbers, store them in variables and those would be available in the VAR menu by si
-
XDK DOM 3 implementation doesn't work (i.e ElementEditVAL)
Hi, I want to use XDK DOM 3 implementation to be able to validate my modification against the schema and then save it to file, for that I found that I have to use ElementEditVAL class and canSetXXX methods, but unfortunately none of them is working a
-
Hello, i am very new to the world of the mac, having always used a pc and have a long way to go before i learn how to use it properly. one of the reasons for the switch from pc to mac was a new camera i had bought and wanted to learn to use properly,