Resolving PS enqueue waits
Hi All,
I find the following in statspack report.
Enqueue activity for DB: FCRLIVE Instance: fcrlive Snaps: 8318 -8319
-> Enqueue stats gathered prior to 9i should not be compared with 9i data
-> ordered by Wait Time desc, Waits desc
Avg Wt Wait
Eq Requests Succ Gets Failed Gets Waits Time (ms) Time (s)
PS 33,012 19,048 13,964 2,876 .00 0
Kindly denote how do we interprete this and how do we resolve this??
Regards
Vijay
Vijay Salian wrote:
Hi
Below are the wait events.I more concerned about Failed Gets in Enqueue -PS part which shows 15,187.What does that denote??Secondly how do we resolve it??
Event Waits Time (s) Ela Time
SQL*Net message from dblink 8,190 12,641 88.42
db file scattered read 389,290 858 6.00
db file sequential read 125,058 515 3.60
PX Deq Credit: send blkd 50,441 117 .82
PX Deq: Execute Reply 21,396 71 .50Avg Wt Wait
Eq Requests Succ Gets Failed Gets Waits Time (ms) Time (s)
PS 35,991 20,804 *15,187* 3,141 .00 0
Regards
vijayCheck your "Instance statistics" for the number of parallel queries that have been downgraded - (search for downgraded) and show us the results.
Looking at your Top 5 you seem to spend all your time waiting on a remote database - so if you have specific queries that are slower than expected it might something to do with the remote database rather than the behaviour of local PQ slaves. Note - a parallel query that goes distributed HAS to go through a serial step to get remote data - which may make problems with parallel slaves insignificant.
Regards
Jonathan Lewis
Similar Messages
-
HI all,
9.0.1
The users are encountering lots of enqueue waits while running an application.The application updates 2 tables in a single pl/sql block.
select * from v$lock;
.................................................................Press Enter Key
ADDR KADDR SID TY ID1 ID2 LMODE REQUEST
CTIME BLOCK
6A4BCD30 6A4BCD40 2 MR 202 0 4 0
7819 0
6A4BCCE4 6A4BCCF4 2 MR 201 0 4 0
7819 0
6A4BCC98 6A4BCCA8 2 MR 12 0 4 0
7819 0
6A4BCC4C 6A4BCC5C 2 MR 11 0 4 0
7819 0
6A4BCC00 6A4BCC10 2 MR 10 0 4 0
7819 0
.................................................................Press Enter Key
ADDR KADDR SID TY ID1 ID2 LMODE REQUEST
CTIME BLOCK
6A4BCBB4 6A4BCBC4 2 MR 9 0 4 0
7819 0
6A4BCB68 6A4BCB78 2 MR 8 0 4 0
7819 0
6A4BCB1C 6A4BCB2C 2 MR 7 0 4 0
7819 0
6A4BCAD0 6A4BCAE0 2 MR 6 0 4 0
7819 0
6A4BCA84 6A4BCA94 2 MR 5 0 4 0
7819 0
.................................................................Press Enter Key
ADDR KADDR SID TY ID1 ID2 LMODE REQUEST
CTIME BLOCK
6A4BCA38 6A4BCA48 2 MR 4 0 4 0
7819 0
6A4BC9EC 6A4BC9FC 2 MR 3 0 4 0
7819 0
6A4BC9A0 6A4BC9B0 2 MR 2 0 4 0
7819 0
6A4BC954 6A4BC964 2 MR 1 0 4 0
7819 0
6A4BC870 6A4BC880 3 RT 1 0 6 0
7821 0
.................................................................Press Enter Key
ADDR KADDR SID TY ID1 ID2 LMODE REQUEST
CTIME BLOCK
6A4BC8BC 6A4BC8CC 4 KT 3317 0 4 0
7817 0
6A4BC7D8 6A4BC7E8 5 TS 11 1 3 0
7037 0
B5CA4AC8 B5CA4BB0 8 TX 524333 1430 6 0
2079 0
6ABBE34C 6ABBE360 8 TM 32282 0 3 0
2079 0
6ABBE244 6ABBE258 8 TM 32296 0 3 0
2079 0
.................................................................Press Enter Key
ADDR KADDR SID TY ID1 ID2 LMODE REQUEST
CTIME BLOCK
6A4BC908 6A4BC918 8 TX 196637 1411 0 6
2079 0
B5CA4AC8 B5CA4BB0 16 TX 196637 1411 6 0
2227 1
6ABBE2C8 6ABBE2DC 16 TM 32282 0 3 0
2227 0
6ABBE13C 6ABBE150 16 TM 32296 0 3 0
2227 0
6A4BC824 6A4BC834 16 TX 131104 1439 0 6
2227 0
.................................................................Press Enter Key
ADDR KADDR SID TY ID1 ID2 LMODE REQUEST
CTIME BLOCK
B5CA4AC8 B5CA4BB0 18 TX 327709 1446 6 0
1864 0
6ABBE664 6ABBE678 18 TM 32282 0 3 0
1864 0
6ABBE0B8 6ABBE0CC 18 TM 32296 0 3 0
1864 0
6A4BCE14 6A4BCE24 18 TX 196637 1411 0 6
1864 0
B5CA4AC8 B5CA4BB0 24 TX 131104 1439 6 0
2920 1
.................................................................Press Enter Key
ADDR KADDR SID TY ID1 ID2 LMODE REQUEST
CTIME BLOCK
B5CA4AC8 B5CA4BB0 27 TX 262167 1433 6 0
2002 0
6ABBE3D0 6ABBE3E4 27 TM 32282 0 3 0
2002 0
6ABBE1C0 6ABBE1D4 27 TM 32296 0 3 0
2002 0
6A4BCD7C 6A4BCD8C 27 TX 196637 1411 0 6
2002 0
B5CA4AC8 B5CA4BB0 29 TX 65573 1409 6 0
1924 0
.................................................................Press Enter Key
ADDR KADDR SID TY ID1 ID2 LMODE REQUEST
CTIME BLOCK
6ABBE5E0 6ABBE5F4 29 TM 32282 0 3 0
1924 0
6ABBE454 6ABBE468 29 TM 32296 0 3 0
1924 0
6A4BCDC8 6A4BCDD8 29 TX 196637 1411 0 6
1924 0
B5CA4AC8 B5CA4BB0 35 CF 0 3 6 0
2 0
6A4BCE60 6A4BCE70 35 TX 589858 1474 1 0
2 0How to resolve the issue?SQL> SELECT DECODE(request,0,'Holder: ','Waiter: ') ||
sid sess, id1, id2, lmode, request, type
FROM V$LOCK
WHERE (id1, id2, type) IN (SELECT id1, id2, type FROM V$LOCK WHERE request > 0) ORDER BY id1, request; 2 3 4 5
.................................................................Press Enter Key
SESS ID1 ID2
LMODE REQUEST TY
Holder: 24 131104 1439
6 0 TX
Waiter: 16 131104 1439
0 6 TX
Holder: 16 196637 1411
6 0 TX
Waiter: 8 196637 1411
0 6 TX
Waiter: 29 196637 1411
0 6 TX
.................................................................Press Enter Key
SESS ID1 ID2
LMODE REQUEST TY
Waiter: 35 196637 1411
0 6 TX
Waiter: 27 196637 1411
0 6 TX
Waiter: 17 196637 1411
0 6 TX
Waiter: 18 196637 1411
0 6 TXThe users says that they are updating separate rows ie every user is updating different rows.So no concurrent cupdation is going on in any row.
Edited by: MYH on Jan 23, 2009 11:02 PM -
High Enqueue Waits in Statspack Report
Hi Everybody,
Oracle Version:Oracle9i Enterprise Edition Release 9.2.0.7.0 - 64bit Production
OS:Solaris 64 bit
Statspack Report is showing High Enqueue Waits
Here is a Snapshot.....
STATSPACK report for
DB Name DB Id Instance Inst Num Release Cluster Host
XXXXX 434917312 XXXXX 1 9.2.0.7.0 NO INgenius1
Snap Id Snap Time Sessions Curs/Sess Comment
Begin Snap: 1064 24-Sep-08 06:00:01 1,333 19.6
End Snap: 1065 24-Sep-08 07:00:01 1,344 19.7
Elapsed: 60.00 (mins)
Cache Sizes (end)
~~~~~~~~~~~~~~~~~
Buffer Cache: 1,152M Std Block Size: 8K
Shared Pool Size: 752M Log Buffer: 1,536K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 27,771.53 1,196.23
Logical reads: 777.20 33.48
Block changes: 180.58 7.78
Physical reads: 33.25 1.43
Physical writes: 7.51 0.32
User calls: 76.89 3.31
Parses: 23.29 1.00
Hard parses: 0.27 0.01
Sorts: 0.42 0.02
Logons: 0.05 0.00
Executes: 88.69 3.82
Transactions: 23.22
% Blocks changed per Read: 23.23 Recursive Call %: 61.50
Rollback per transaction %: 0.00 Rows per Sort: 738.76
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 96.90 In-memory Sort %: 99.67
Library Hit %: 99.76 Soft Parse %: 98.84
Execute to Parse %: 73.74 Latch Hit %: 99.98
Parse CPU to Parse Elapsd %: 94.38 % Non-Parse CPU: 94.45
Shared Pool Statistics Begin End
Memory Usage %: 86.56 87.54
% SQL with executions>1: 50.57 63.10
% Memory for SQL w/exec>1: 10.02 14.63
Top 5 Timed Events
~~~~~~~~~~~~~~~~~~ % Total
Event Waits Time (s) Ela Time
enqueue 19,553 57,405 98.39
db file sequential read 44,161 384 .66
CPU time 333 .57
log file parallel write 166,602 82 .14
log file sync 67,683 71 .12
Wait Events for DB: XXXXX Instance: XXXXX Snaps: 1064 - 1065
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
Total Wait wait Waits
Event Waits Timeouts Time (s) (ms) /txn
enqueue 19,553 19,540 57,405 2936 0.2
db file sequential read 44,161 0 384 9 0.5
log file parallel write 166,602 0 82 0 2.0
log file sync 67,683 0 71 1 0.8
db file scattered read 6,676 0 54 8 0.1
db file parallel write 1,135 0 7 6 0.0
direct path read 1,117 0 3 3 0.0
SQL*Net more data to client 3,932 0 2 0 0.0
control file parallel write 1,200 0 2 1 0.0
control file sequential read 1,389 0 1 1 0.0
PX Deq: Execute Reply 112 0 0 4 0.0
direct path write 752 0 0 1 0.0
db file parallel read 9 0 0 42 0.0
Background Wait Events for DB: XXXXX Instance: XXXXX Snaps: 1064 - 10
-> ordered by wait time desc, waits desc (idle events last)
Avg Wt Wait
Eq Requests Succ Gets Failed Gets Waits Time (ms) Time (s)
TC 25 24 0 4 32.00 0
TX 84,615 84,605 0 3 8.33 0
HW 118 118 0 2 2.00 0
PS 29 25 4 2 1.00 0
Here frm Statspack Report we can see that enqueue type- TX is taking up most of the resources.......
I want to find out which sql statements are causing this high enqueue waits......
Any Help Appreciated....
Regards,
Prosenjit MukherjeeHi All,
Here is the Statspack Report..........
STATSPACK report for
DB Name DB Id Instance Inst Num Release Cluster Host
XXXXX 434917312 XXXXX 1 9.2.0.7.0 NO XXXXXxxx1
Snap Id Snap Time Sessions Curs/Sess Comment
Begin Snap: 1064 24-Sep-08 06:00:01 1,333 19.6
End Snap: 1065 24-Sep-08 07:00:01 1,344 19.7
Elapsed: 60.00 (mins)
Cache Sizes (end)
~~~~~~~~~~~~~~~~~
Buffer Cache: 1,152M Std Block Size: 8K
Shared Pool Size: 752M Log Buffer: 1,536K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 27,771.53 1,196.23
Logical reads: 777.20 33.48
Block changes: 180.58 7.78
Physical reads: 33.25 1.43
Physical writes: 7.51 0.32
User calls: 76.89 3.31
Parses: 23.29 1.00
Hard parses: 0.27 0.01
Sorts: 0.42 0.02
Logons: 0.05 0.00
Executes: 88.69 3.82
Transactions: 23.22
% Blocks changed per Read: 23.23 Recursive Call %: 61.50
Rollback per transaction %: 0.00 Rows per Sort: 738.76
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 96.90 In-memory Sort %: 99.67
Library Hit %: 99.76 Soft Parse %: 98.84
Execute to Parse %: 73.74 Latch Hit %: 99.98
Parse CPU to Parse Elapsd %: 94.38 % Non-Parse CPU: 94.45
Shared Pool Statistics Begin End
Memory Usage %: 86.56 87.54
% SQL with executions>1: 50.57 63.10
% Memory for SQL w/exec>1: 10.02 14.63
Top 5 Timed Events
~~~~~~~~~~~~~~~~~~ % Total
Event Waits Time (s) Ela Time
enqueue 19,553 57,405 98.39
db file sequential read 44,161 384 .66
CPU time 333 .57
log file parallel write 166,602 82 .14
log file sync 67,683 71 .12
Wait Events for DB: XXXXX Instance: XXXXX Snaps: 1064 - 1065
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
Total Wait wait Waits
Event Waits Timeouts Time (s) (ms) /txn
enqueue 19,553 19,540 57,405 2936 0.2
db file sequential read 44,161 0 384 9 0.5
log file parallel write 166,602 0 82 0 2.0
log file sync 67,683 0 71 1 0.8
db file scattered read 6,676 0 54 8 0.1
db file parallel write 1,135 0 7 6 0.0
direct path read 1,117 0 3 3 0.0
SQL*Net more data to client 3,932 0 2 0 0.0
control file parallel write 1,200 0 2 1 0.0
control file sequential read 1,389 0 1 1 0.0
PX Deq: Execute Reply 112 0 0 4 0.0
direct path write 752 0 0 1 0.0
db file parallel read 9 0 0 42 0.0
process startup 6 0 0 44 0.0
SQL*Net break/reset to clien 296 0 0 1 0.0
PX Deq: Signal ACK 3 1 0 33 0.0
latch free 17 4 0 3 0.0
LGWR wait for redo copy 286 0 0 0 0.0
PX Deq: Join ACK 3 0 0 2 0.0
PX Deq: Parse Reply 4 0 0 1 0.0
buffer busy waits 12 0 0 0 0.0
PX Deq Credit: need buffer 4 0 0 0 0.0
PX Deq: Table Q Sample 1 0 0 0 0.0
SQL*Net message from client 204,628 0 4,620,111 22578 2.4
virtual circuit status 120 120 3,516 29297 0.0
PX Idle Wait 753 749 1,470 1953 0.0
SQL*Net more data from clien 20,540 0 3 0 0.2
PX Deq: Execution Msg 128 0 2 13 0.0
SQL*Net message to client 204,628 0 0 0 2.4
Background Wait Events for DB: XXXXX Instance: XXXXX Snaps: 1064 - 10
-> ordered by wait time desc, waits desc (idle events last)
Avg
Total Wait wait Waits
Event Waits Timeouts Time (s) (ms) /txn
log file parallel write 166,634 0 82 0 2.0
db file parallel write 1,134 0 8 7 0.0
control file parallel write 1,200 0 2 1 0.0
control file sequential read 1,327 0 1 1 0.0
db file scattered read 44 0 0 10 0.0
db file sequential read 25 0 0 3 0.0
direct path read 23 0 0 3 0.0
rdbms ipc reply 67 0 0 0 0.0
LGWR wait for redo copy 286 0 0 0 0.0
direct path write 23 0 0 0 0.0
buffer busy waits 2 0 0 0 0.0
rdbms ipc message 86,933 3,437 20,199 232 1.0
pmon timer 1,194 1,194 3,504 2935 0.0
smon timer 17 8 3,239 ###### 0.0
Enqueue activity for DB: XXXXX Instance: XXXXX Snaps: 1064 - 1065
-> Enqueue stats gathered prior to 9i should not be compared with 9i data
-> ordered by Wait Time desc, Waits desc
Avg Wt Wait
Eq Requests Succ Gets Failed Gets Waits Time (ms) Time (s)
TC 25 24 0 4 32.00 0
TX 84,615 84,605 0 3 8.33 0
HW 118 118 0 2 2.00 0
PS 29 25 4 2 1.00 0
End of Report (this is not the entire report,only posted part of it,getting error page when trying to post the entire report)
Regards,
Prosenjit Mukherjee -
Redo log space requests and Enqueue Waits
Hi all,
I am seeing an increase on the Enqueue Waits and Redo Log Space Request from 58, 274 to 192, 1245 in two weeks time respectively.
The DB is a production database and runs on an HP cluster with 4X1G ram and 550mghz cpu.
There are four Redo Log files with 200M (2 members each)which I have increased to 400M over this past weekend.
I have included below the memory structure details:
Redo Log Summary
Total System Global Area 1646094824 bytes
Fixed Size 104936 bytes
Variable Size 408989696 bytes
Database Buffers 1228800000 bytes
Redo Buffers 8200192 bytes
My question is that, who do I stop it from growing further and passing the 1:5000 ratio ?
At the moment the ratio is in the range of 1:186194.
Your input is much appreciated.
Cheers,
Seyoum.Here is some information from Oracle's Peformance Tuning Guide.
The V$SYSSTAT statistic redo log space requests indicates how many times a server process had to wait for space in the online redo log, not for space in the redo log buffer. A significant value for this statistic and the wait events should be used as an indication that checkpoints, DBWR, or archiver activity should be tuned, not LGWR. Increasing the size of log buffer does not help. -
The oracle version is 9.2.0.7. The total memory of machine is 16g. I change sga max size from 2g to 7g. I changed the db cache size from 1.5g to 6g because i was getting law buffer hit.I increased processes parameter to 1000 from 700 and sessions parameter to 1000 from 700.Now I am seeing the high enqueue wait in the database like 90% in statspack.
What could be the reason for thisThere are no rows return from those queries
But i got this
select * from v$enqueue_stat where cum_wait_time>0
order by cum_wait_time desc;
INST_ID EQ TOTAL_REQ# TOTAL_WAIT# SUCC_REQ#
FAILED_REQ# CUM_WAIT_TIME
1 TX 310179 8293 310175
4 76761677
TC 130 25 130 0
526
US 21407 7 21407 0
97
SQ 14093 217 14093 0
78
HW 9835 13 9835 0
40
CF 8901 2 8901 0
29Well, the result says that your enqueue waits were "TX" type.
Followings are genercal cases of TX lock contention:
- Row lock contention - Row update confliction, PK confliction, Bitmap Index confliction, ...
- ITL entry contention
- Index split contention
- Misc
Unfortunately, TX lock contention generally has no relationship with buffer cache size. I don't think your increased enqueue wait was caused by bigger buffer cache. TX lock contention means that multiple transactions are modifying/accessing same data.
You need to capture V$SESSION_WAIT, V$SESSION and V$SQL(as i said) just when the enqueue wait happens. More info will tell you more reasonable explanation. -
Resolving Host & waiting for website issues
Have had infinity now for 8 months or so and ever since upgrading I have trouble connecting to websites with either 'resolving host' or 'waiting for web site' listed in bottom left corner. One of the worst sites this happens on is in fact BT.com! At times sites don't even load at all or correctly.
I have checked down/upload speeds and they seem to be fine most of the time at around 75/17MB per second. Today however this has dropped to 41/17MB.
Can anyone advise what I need to do/update.
Many thanks in advanceTry changing your DNS servers to OpenDNS on your PC network connectoid
See here for instructions https://use.opendns.com/
If you found this post helpful, please click on the star on the left
If not, I'll try again -
Buffer busy waits after cnanging lob storage to oracle securefiles
Hi Everyone
I need help resolving a problem with buffer busy waits in for a lob segment using securefiles for storage.
During the load the application inserts a record into a table with the lob segment and update the record after, populating lob data. The block size on the table space holding the lob is 8 kb and the chunk size on the lob segment is set to 8kb. The average size of the lob record is 6 kb and the minimum size is 4.03 KB. The problem occurs only when running a job with a big number of relatively small inserts (4.03 Kb) in to the lob column . The table definition allow in-row storage and the ptcfree set to 10%. The same jobs runs without problem when using basicfiles storage for the lob column.
According to [oracle white paper |http://www.oracle.com/technetwork/database/options/compression/overview/securefiles-131281.pdf] securefiles have a number of performance enhancements. I was particular interested to test Write Gather Cache as our application does a lot of relatively small inserts into a lob segment.
Below is a fragment from the AWR report. It looks like all buffer busy waits belong to a free list class. The lob segment is located in an ASSM tablespace and I cannot increase freelists.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Partitioning option
Host Name Platform CPUs Cores Sockets Memory(GB)
DB5 Microsoft Windows x86 64-bit 8 2 31.99
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 1259 01-Apr-11 14:40:45 135 5.5
End Snap: 1260 01-Apr-11 15:08:59 155 12.0
Elapsed: 28.25 (mins)
DB Time: 281.55 (mins)
Cache Sizes Begin End
~~~~~~~~~~~ ---------- ----------
Buffer Cache: 2,496M 2,832M Std Block Size: 8K
Shared Pool Size: 1,488M 1,488M Log Buffer: 11,888K
Load Profile Per Second Per Transaction Per Exec Per Call
~~~~~~~~~~~~ --------------- --------------- ---------- ----------
DB Time(s): 10.0 0.1 0.01 0.00
DB CPU(s): 2.8 0.0 0.00 0.00
Redo size: 1,429,862.3 9,390.5
Logical reads: 472,459.0 3,102.8
Block changes: 9,849.7 64.7
Physical reads: 61.1 0.4
Physical writes: 98.6 0.7
User calls: 2,718.8 17.9
Parses: 669.8 4.4
Hard parses: 2.2 0.0
W/A MB processed: 1.1 0.0
Logons: 0.1 0.0
Executes: 1,461.0 9.6
Rollbacks: 0.0 0.0
Transactions: 152.3
Top 5 Timed Foreground Events
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Avg
wait % DB
Event Waits Time(s) (ms) time Wait Class
buffer busy waits 1,002,549 8,951 9 53.0 Concurrenc
DB CPU 4,724 28.0
latch: cache buffers chains 11,927,297 1,396 0 8.3 Concurrenc
direct path read 121,767 863 7 5.1 User I/O
enq: DW - contention 209,278 627 3 3.7 Other
?Host CPU (CPUs: 8 Cores: 2 Sockets: )
~~~~~~~~ Load Average
Begin End %User %System %WIO %Idle
38.7 3.5 57.9
Instance CPU
~~~~~~~~~~~~
% of total CPU for Instance: 40.1
% of busy CPU for Instance: 95.2
%DB time waiting for CPU - Resource Mgr: 0.0
Memory Statistics
~~~~~~~~~~~~~~~~~ Begin End
Host Mem (MB): 32,762.6 32,762.6
SGA use (MB): 4,656.0 4,992.0
PGA use (MB): 318.4 413.5
% Host Mem used for SGA+PGA: 15.18 16.50
Avg
%Time Total Wait wait Waits % DB
Event Waits -outs Time (s) (ms) /txn time
buffer busy waits 1,002,549 0 8,951 9 3.9 53.0
latch: cache buffers chain 11,927,297 0 1,396 0 46.2 8.3
direct path read 121,767 0 863 7 0.5 5.1
enq: DW - contention 209,278 0 627 3 0.8 3.7
log file sync 288,785 0 118 0 1.1 .7
SQL*Net more data from cli 1,176,770 0 103 0 4.6 .6
Buffer Wait Statistics DB/Inst: ORA11G/ora11g Snaps: 1259-1260
-> ordered by wait time desc, waits desc
Class Waits Total Wait Time (s) Avg Time (ms)
free list 818,606 8,780 11
undo header 512,358 141 0
2nd level bmb 105,816 29 0
-> Total Logical Reads: 800,688,490
-> Captured Segments account for 19.8% of Total
Tablespace Subobject Obj. Logical
Owner Name Object Name Name Type Reads %Total
EAG50NSJ EAG50NSJ SYS_LOB0000082335C00 LOB 127,182,208 15.88
SYS SYSTEM TS$ TABLE 7,641,808 .95
Segments by Physical Reads DB/Inst: ORA11G/ora11g Snaps: 1259-1260
-> Total Physical Reads: 103,481
-> Captured Segments account for 224.4% of Total
Tablespace Subobject Obj. Physical
Owner Name Object Name Name Type Reads %Total
EAG50NSJ EAG50NSJ SYS_LOB0000082335C00 LOB 218,858 211.50
....Best regards
Yuri KogunHi Jonathan,
I was puzzled by the number of logical reads as well. This hasn't happened when the lob was stored as a basic fille and I assumed that the database is able to store the records in-row when we switched to securefiles. With regards to ASSM, according to the documentation this is the only option when using securefiles.
We did have high number of HW-enqueue waits in the database when running the test with basic files and had to set 44951 event
alter system set EVENTS '44951 TRACE NAME CONTEXT FOREVER, LEVEL 1024' There are 2 application servers running 16 jobs each, so we should not have more than 32 sessions inserting the data in the same time but I need to check wheter jobs can be brocken to smaller peaces. I that case the number of concurrent session may be bigger. Each session is configured with bundle size of 30 and it will issue commit every 30 inserts.
I am not sure how exactly the code does insert, as I've been told it should be straight insert and update I will be able to check this on Monday.
Below is the extract from the AWR reports with top SQL, I could not find any SQL related to the $TS table in the report. The query to the V$SEGMENT_STATISTICS was executed by me during the job run.
?SQL ordered by Elapsed Time DB/Inst: ORA11G/ora11g Snaps: 1259-1260
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
-> %Total - Elapsed Time as a percentage of Total DB time
-> %CPU - CPU Time as a percentage of Elapsed Time
-> %IO - User I/O Time as a percentage of Elapsed Time
-> Captured SQL account for 91.3% of Total DB Time (s): 16,893
-> Captured PL/SQL account for 0.1% of Total DB Time (s): 16,893
Elapsed Elapsed Time
Time (s) Executions per Exec (s) %Total %CPU %IO SQL Id
7,837.5 119,351 0.07 46.4 28.3 .7 2zrh6mw372asz
Module: JDBC Thin Client
update JS_CHANNELDESTS set CHANNELID=:1, DESTID=:2, CHANNELDESTSTATUSDATE=:3, ST
ATUS=:4, BINOFFSET=:5, BINNAME=:6, PAGECOUNT=:7, DATA=:8, SORTORDER=:9, PRINTFOR
MAT=:10, ENVELOPEID=:11, DOCID=:12, CEENVELOPEID=:13, CHANNELTYPE=:14 where ID=:
15
7,119.0 115,997 0.06 42.1 23.1 .2 3vjx93vur4dw1
Module: JDBC Thin Client
insert into JS_CHANNELDESTS (CHANNELID, DESTID, CHANNELDESTSTATUSDATE, STATUS, B
INOFFSET, BINNAME, PAGECOUNT, DATA, SORTORDER, PRINTFORMAT, ENVELOPEID, DOCID, C
EENVELOPEID, CHANNELTYPE, ID) values (:1, :2, :3, :4, :5, :6, :7, :8, :9, :10, :
11, :12, :13, :14, :15)
85.6 2 42.80 .5 98.3 .0 cc19qha9pxsa4
Module: SQL Developer
select object_name, statistic_name, value from V$SEGMENT_STATISTICS
where object_name = 'SYS_LOB0000082335C00011$$'
35.0 111,900 0.00 .2 74.3 7.6 c5q15mpnbc43w
Module: JDBC Thin Client
insert into JS_ENVELOPES (BATCHID, TRANSACTIONNO, SPOOLID, JOBSETUPID, JOBSETUPN
AME, SPOOLNAME, STEPNO, MASTERCHANNELJOBID, SORTKEY1, SORTKEY2, SORTKEY3, ID) va
lues (:1, :2, :3, :4, :5, :6, :7, :8, :9, :10, :11, :12)
34.9 111,902 0.00 .2 63.0 2.6 a0hmmbjwgwh1k
Module: JDBC Thin Client
insert into JS_CHANNELJOBPROPERTIES (NAME, VALUE, CHANNELJOBID, ID) values (:1,
:2, :3, :4)
29.2 950 0.03 .2 95.9 .1 du0hgjbn9vw0v
Module: JDBC Thin Client
SELECT * FROM JS_BATCHOVERVIEW WHERE BATCHID = :1
?SQL ordered by Executions DB/Inst: ORA11G/ora11g Snaps: 1259-1260
-> %CPU - CPU Time as a percentage of Elapsed Time
-> %IO - User I/O Time as a percentage of Elapsed Time
-> Total Executions: 2,476,038
-> Captured SQL account for 96.0% of Total
Elapsed
Executions Rows Processed Rows per Exec Time (s) %CPU %IO SQL Id
223,581 223,540 1.0 22.4 63.7 .0 gz7n75pf57c
Module: JDBC Thin Client
SELECT SQ_CHANNELJOBPROPERTIES.NEXTVAL FROM DUAL
120,624 120,616 1.0 8.1 99.0 .0 6y3ayqzubcb
Module: JDBC Thin Client
select batch0_.BATCHID as BATCHID0_0_, batch0_.BATCHNAME as BATCHNAME0_0_, batch
0_.STARTDATE as STARTDATE0_0_, batch0_.PARFINDATE as PARFINDATE0_0_, batch0_.PRO
CCOMPDATE as PROCCOMP5_0_0_, batch0_.BATCHSTATUS as BATCHSTA6_0_0_, batch0_.DATA
FILE as DATAFILE0_0_, batch0_.BATCHCFG as BATCHCFG0_0_, batch0_.FINDATE as FINDA
119,351 227,878 1.9 7,837.5 28.3 .7 2zrh6mw372a
Module: JDBC Thin Client
update JS_CHANNELDESTS set CHANNELID=:1, DESTID=:2, CHANNELDESTSTATUSDATE=:3, ST
ATUS=:4, BINOFFSET=:5, BINNAME=:6, PAGECOUNT=:7, DATA=:8, SORTORDER=:9, PRINTFOR
MAT=:10, ENVELOPEID=:11, DOCID=:12, CEENVELOPEID=:13, CHANNELTYPE=:14 where ID=:
15
116,033 223,892 1.9 8.0 92.2 .0 406wh6gd9nk
Module: JDBC Thin Client
select m_jobprope0_.CHANNELJOBID as CHANNELJ4_1_, m_jobprope0_.ID as ID1_, m_job
prope0_.NAME as formula0_1_, m_jobprope0_.ID as ID4_0_, m_jobprope0_.NAME as NAM
E4_0_, m_jobprope0_.VALUE as VALUE4_0_, m_jobprope0_.CHANNELJOBID as CHANNELJ4_4
_0_ from JS_CHANNELJOBPROPERTIES m_jobprope0_ where m_jobprope0_.CHANNELJOBID=:1
115,997 115,996 1.0 7,119.0 23.1 .2 3vjx93vur4d
Module: JDBC Thin Client
insert into JS_CHANNELDESTS (CHANNELID, DESTID, CHANNELDESTSTATUSDATE, STATUS, B
INOFFSET, BINNAME, PAGECOUNT, DATA, SORTORDER, PRINTFORMAT, ENVELOPEID, DOCID, C
EENVELOPEID, CHANNELTYPE, ID) values (:1, :2, :3, :4, :5, :6, :7, :8, :9, :10, :
11, :12, :13, :14, :15)
115,996 115,996 1.0 15.9 75.0 4.5 3h58syyk145
Module: JDBC Thin Client
insert into JS_DOCJOBS (CREATEDATE, EFFDATE, JURIST, LANG, IDIOM, DD, DDVID, USE
RKEY1, USERKEY2, USERKEY3, USERKEY4, USERKEY5, USERKEY6, USERKEY7, USERKEY8, USE
RKEY9, USERKEY10, USERKEY11, USERKEY12, USERKEY13, USERKEY14, USERKEY15, USERKEY
16, USERKEY17, USERKEY18, USERKEY19, USERKEY20, REVIEWCASEID, ID) values (:1, :2
115,440 115,422 1.0 11.5 63.3 .0 2vn581q83s6
Module: JDBC Thin Client
SELECT SQ_CHANNELDESTS.NEXTVAL FROM DUAL
...The tablespace holding the lob segment has system extent allocation and the number of blocks for the lob segments roughly the same as the number of blocks in allocated extents.
select segment_name, blocks, count (*)
from dba_extents where segment_name = 'SYS_LOB0000082335C00011$$'
group by segment_name, blocks
order by blocks
SEGMENT_NAME BLOCKS COUNT(*)
SYS_LOB0000082335C00011$$ 8 1
SYS_LOB0000082335C00011$$ 16 1
SYS_LOB0000082335C00011$$ 128 158
SYS_LOB0000082335C00011$$ 256 1
SYS_LOB0000082335C00011$$ 1024 120
SYS_LOB0000082335C00011$$ 2688 1
SYS_LOB0000082335C00011$$ 8192 117
SELECT
sum(ceil(dbms_lob.getlength(data)/8000))
from EAG50NSJ.JS_CHANNELDESTS
SUM(CEIL(DBMS_LOB.GETLENGTH(DATA)/8000))
993216
select sum (blocks) from dba_extents where segment_name = 'SYS_LOB0000082335C00011$$'
SUM(BLOCKS)
1104536 Below is the instance activity stats related to securefiles from the AWR report
Statistic Total per Second per Trans
securefile allocation bytes 3,719,995,392 2,195,042.4 14,415.7
securefile allocation chunks 380,299 224.4 1.5
securefile bytes non-transformed 2,270,735,265 1,339,883.4 8,799.6
securefile direct read bytes 1,274,585,088 752,089.2 4,939.3
securefile direct read ops 119,725 70.7 0.5
securefile direct write bytes 3,719,995,392 2,195,042.4 14,415.7
securefile direct write ops 380,269 224.4 1.5
securefile number of non-transfo 343,918 202.9 1.3Best regards
Yuri
Edited by: ykogun on 02-Apr-2011 13:33 -
Hi,
Version : Oracle 9i
I am getting buffer busy waits on some tables. Will increase in inittrans & pctfree of those tables reduce buffer busy waits?
Tablespace is having segment space mgmt auto & extent management local.
cursor_sharing is similar.
Users are not experiencing any problem.Is there any problem other than this in statspack report?
STATSPACK report for
DB Name DB Id Instance Inst Num Release Cluster Host
AHD 3712247982 ahd 1 9.2.0.1.0 NO SBGSDPRI
Snap Id Snap Time Sessions Curs/Sess Comment
Begin Snap: 20 13-Feb-07 14:48:35 33 9.9
End Snap: 21 13-Feb-07 15:12:19 34 10.4
Elapsed: 23.73 (mins)
Cache Sizes (end)
~~~~~~~~~~~~~~~~~
Buffer Cache: 656M Std Block Size: 8K
Shared Pool Size: 152M Log Buffer: 768K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 5,960.83 2,761.29
Logical reads: 2,376.85 1,101.05
Block changes: 35.48 16.44
Physical reads: 97.56 45.20
Physical writes: 1.15 0.53
User calls: 92.63 42.91
Parses: 20.00 9.27
Hard parses: 0.29 0.13
Sorts: 4.80 2.22
Logons: 0.01 0.00
Executes: 23.14 10.72
Transactions: 2.16
% Blocks changed per Read: 1.49 Recursive Call %: 14.69
Rollback per transaction %: 0.00 Rows per Sort: 472.64
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 99.65 Redo NoWait %: 100.00
Buffer Hit %: 95.90 In-memory Sort %: 100.00
Library Hit %: 99.15 Soft Parse %: 98.55
Execute to Parse %: 13.57 Latch Hit %: 99.70
Parse CPU to Parse Elapsd %: 90.83 % Non-Parse CPU: 96.58
Shared Pool Statistics Begin End
Memory Usage %: 84.68 84.76
% SQL with executions>1: 77.32 79.22
% Memory for SQL w/exec>1: 90.74 92.81
Top 5 Timed Events
~~~~~~~~~~~~~~~~~~ % Total
Event Waits Time (s) Ela Time
CPU time 125 54.23
db file sequential read 83,110 69 30.14
db file scattered read 23,196 27 11.75
buffer busy waits 11,760 6 2.42
log file sync 3,078 1 .45
Wait Events for DB: AHD Instance: ahd Snaps: 20 -21
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
Total Wait wait Waits
Event Waits Timeouts Time (s) (ms) /txn
db file sequential read 83,110 0 69 1 27.0
db file scattered read 23,196 0 27 1 7.5
buffer busy waits 11,760 0 6 0 3.8
log file sync 3,078 0 1 0 1.0
log file parallel write 5,216 4,841 1 0 1.7
control file sequential read 1,390 0 1 1 0.5
control file parallel write 462 0 0 1 0.2
db file parallel write 672 336 0 0 0.2
latch free 54 24 0 2 0.0
SQL*Net more data to client 1,026 0 0 0 0.3
LGWR wait for redo copy 12 0 0 0 0.0
SQL*Net message from client 131,863 0 22,857 173 42.9
virtual circuit status 48 48 1,497 31188 0.0
wakeup time manager 45 45 1,446 32123 0.0
SQL*Net message to client 131,864 0 0 0 42.9
SQL*Net more data from clien 27 0 0 0 0.0
Background Wait Events for DB: AHD Instance: ahd Snaps: 20 -21
-> ordered by wait time desc, waits desc (idle events last)
Avg
Total Wait wait Waits
Event Waits Timeouts Time (s) (ms) /txn
log file parallel write 5,216 4,841 1 0 1.7
control file parallel write 462 0 0 1 0.2
control file sequential read 184 0 0 2 0.1
db file parallel write 672 336 0 0 0.2
log file sync 24 0 0 0 0.0
db file sequential read 1 0 0 8 0.0
LGWR wait for redo copy 12 0 0 0 0.0
rdbms ipc message 12,386 7,345 10,752 868 4.0
SQL*Net message from client 384 0 1,498 3901 0.1
smon timer 4 4 1,229 ###### 0.0
SQL*Net message to client 384 0 0 0 0.1
SQL ordered by Gets for DB: AHD Instance: ahd Snaps: 20 -21
-> End Buffer Gets Threshold: 10000
-> Note that resources reported for PL/SQL includes the resources used by
all SQL statements called within the PL/SQL code. As individual SQL
statements are also reported, it is possible and valid for the summed
total % to exceed 100
CPU Elapsd
Buffer Gets Executions Gets per Exec %Total Time (s) Time (s) Hash Value
1,269,773 52 24,418.7 37.5 27.03 76.26 3370382957
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1" ) AND ( (
381,394 44 8,668.0 11.3 21.30 22.94 3653016280
SELECT count(*) FROM call_req, ctct, loc, site, z_zo, z_lho WHER
E ( call_req.customer = ctct.id AND ctct.c_l_id = loc.id AND l
oc.l_si_id = site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo
lhoid = z_lho.id AND z_lho.lho_name LIKE :"SYS_B_0" AND cal
l_req.active_flag = :"SYS_B_1" ) AND ( ( call_req.group_id != :"
239,582 10 23,958.2 7.1 5.95 17.44 1650906216
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" ) AND ( ( call_req.group_id != :"SYS_B_1" ) and
146,016 9 16,224.0 4.3 2.58 12.01 977739309
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_B_00" O
R id = :"SYS_B_01" OR id = :"SYS_B_02" OR id = :"SYS_B_03" OR id
= :"SYS_B_04" OR id = :"SYS_B_05" OR id = :"SYS_B_06" OR id = :
"SYS_B_07" OR id = :"SYS_B_08" OR id = :"SYS_B_09" OR id = :"SYS
117,569 7 16,795.6 3.5 0.52 0.52 1972089848
SELECT call_req.open_date, call_req.id FROM call_req, ctct WHERE
( call_req.status = :"SYS_B_00" AND call_req.group_id = ctct.id
AND ctct.c_last_name LIKE :"SYS_B_01" AND ( call_req.assigne
e IS NULL ) ) AND ( call_req.group_id IN ( SELECT id FROM ctct W
HERE id = :"SYS_B_02" OR id = :"SYS_B_03" OR id = :"SYS_B_04" OR
100,276 4 25,069.0 3.0 2.77 6.95 771782876
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho, ctct cn01 WHERE ( call_req.customer = ctct.i
d AND ctct.c_l_id = loc.id AND loc.l_si_id = site.id AND site
.z_si_zo_id = z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.
lho_name LIKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1"
95,832 4 23,958.0 2.8 2.13 3.80 1755292198
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_00" AND call_req.active_flag = :"SYS_B_01" AND ( ca
86,680 10 8,668.0 2.6 7.69 8.21 3407388950
SQL ordered by Gets for DB: AHD Instance: ahd Snaps: 20 -21
-> End Buffer Gets Threshold: 10000
-> Note that resources reported for PL/SQL includes the resources used by
all SQL statements called within the PL/SQL code. As individual SQL
statements are also reported, it is possible and valid for the summed
total % to exceed 100
CPU Elapsd
Buffer Gets Executions Gets per Exec %Total Time (s) Time (s) Hash Value
SELECT count(*) FROM call_req, ctct, loc, site, z_zo, z_lho WHER
E ( call_req.customer = ctct.id AND ctct.c_l_id = loc.id AND l
oc.l_si_id = site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo
lhoid = z_lho.id AND z_lho.lho_name LIKE :"SYS_B_0" ) AND (
( call_req.group_id != :"SYS_B_1" ) and ( call_req.group_id !=
71,839 3 23,946.3 2.1 2.73 6.07 1599404397
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo WHERE ( call_req.active_flag = :"SYS_B_0" AND call_r
eq.customer = ctct.id AND ctct.c_l_id = loc.id AND loc.l_si_id
= site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo_name LIK
E :"SYS_B_1" ) AND ( ( call_req.group_id != :"SYS_B_2" ) and (
60,507 9 6,723.0 1.8 1.47 1.49 632450130
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho, ctct cn01 WHERE ( call_req.customer = ctct.i
d AND ctct.c_l_id = loc.id AND loc.l_si_id = site.id AND site
.z_si_zo_id = z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.
lho_name LIKE :"SYS_B_0" AND call_req.status = :"SYS_B_1" AND
57,682 191 302.0 1.7 3.48 3.52 484128938
SELECT cnote.posted_date, cnote.text FROM cnote WHERE ( ( cnote.
loc_id = :"SYS_B_0" ) OR cnote.loc_id IS NULL ) AND ( cnote.inte
rnal IS NULL OR cnote.internal != :"SYS_B_1" ) ORDER BY cnote.p
osted_date DESC
52,146 3 17,382.0 1.5 1.22 3.60 930247717
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_B_00" O
R id = :"SYS_B_01" OR id = :"SYS_B_02" OR id = :"SYS_B_03" OR id
= :"SYS_B_04" OR id = :"SYS_B_05" OR id = :"SYS_B_06" OR id = :
"SYS_B_07" OR id = :"SYS_B_08" OR id = :"SYS_B_09" OR id = :"SYS
43,534 4 10,883.5 1.3 2.05 2.10 2363733805
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho, prob_ctg, ctct cn01 WHERE ( call_req.custome
r = ctct.id AND ctct.c_l_id = loc.id AND loc.l_si_id = site.id
AND site.z_si_zo_id = z_zo.id AND z_zo.zo_lho_id = z_lho.id A
ND z_lho.lho_name LIKE :"SYS_B_00" AND call_req.active_flag =
SQL ordered by Reads for DB: AHD Instance: ahd Snaps: 20 -21
-> End Disk Reads Threshold: 1000
CPU Elapsd
Physical Reads Executions Reads per Exec %Total Time (s) Time (s) Hash Value
81,653 52 1,570.3 58.8 27.03 76.26 3370382957
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1" ) AND ( (
15,402 10 1,540.2 11.1 5.95 17.44 1650906216
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" ) AND ( ( call_req.group_id != :"SYS_B_1" ) and
13,371 9 1,485.7 9.6 2.58 12.01 977739309
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_B_00" O
R id = :"SYS_B_01" OR id = :"SYS_B_02" OR id = :"SYS_B_03" OR id
= :"SYS_B_04" OR id = :"SYS_B_05" OR id = :"SYS_B_06" OR id = :
"SYS_B_07" OR id = :"SYS_B_08" OR id = :"SYS_B_09" OR id = :"SYS
6,157 4 1,539.3 4.4 2.77 6.95 771782876
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho, ctct cn01 WHERE ( call_req.customer = ctct.i
d AND ctct.c_l_id = loc.id AND loc.l_si_id = site.id AND site
.z_si_zo_id = z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.
lho_name LIKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1"
6,152 4 1,538.0 4.4 2.13 3.80 1755292198
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_00" AND call_req.active_flag = :"SYS_B_01" AND ( ca
4,622 3 1,540.7 3.3 2.73 6.07 1599404397
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo WHERE ( call_req.active_flag = :"SYS_B_0" AND call_r
eq.customer = ctct.id AND ctct.c_l_id = loc.id AND loc.l_si_id
= site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo_name LIK
E :"SYS_B_1" ) AND ( ( call_req.group_id != :"SYS_B_2" ) and (
2,982 3 994.0 2.1 1.22 3.60 930247717
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_B_00" O
R id = :"SYS_B_01" OR id = :"SYS_B_02" OR id = :"SYS_B_03" OR id
= :"SYS_B_04" OR id = :"SYS_B_05" OR id = :"SYS_B_06" OR id = :
"SYS_B_07" OR id = :"SYS_B_08" OR id = :"SYS_B_09" OR id = :"SYS
1,566 44 35.6 1.1 21.30 22.94 3653016280
SELECT count(*) FROM call_req, ctct, loc, site, z_zo, z_lho WHER
E ( call_req.customer = ctct.id AND ctct.c_l_id = loc.id AND l
oc.l_si_id = site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo
_lho_id = z_lho.id AND z_lho.lho_name LIKE :"SYS_B_0" AND cal
SQL ordered by Reads for DB: AHD Instance: ahd Snaps: 20 -21
-> End Disk Reads Threshold: 1000
CPU Elapsd
Physical Reads Executions Reads per Exec %Total Time (s) Time (s) Hash Value
l_req.active_flag = :"SYS_B_1" ) AND ( ( call_req.group_id != :"
1,540 1 1,540.0 1.1 0.56 1.64 2582352638
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1" AND ( call
1,106 2 553.0 0.8 1.25 3.01 548248759
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( ( c
all_req.assignee IS NOT NULL OR call_req.group_id IS NOT NULL )
AND ( call_req.type = :"SYS_B_00" OR call_req.type = :"SYS_B_01"
OR call_req.type IS NULL ) AND call_req.active_flag = :"SYS_B_0
2" ) AND ( call_req.group_id IN ( SELECT id FROM ctct WHERE id =
875 2 437.5 0.6 0.94 2.95 1195215130
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( ( c
all_req.assignee IS NULL AND call_req.group_id IS NULL ) AND ( c
all_req.type = :"SYS_B_00" OR call_req.type = :"SYS_B_01" OR cal
l_req.type IS NULL ) AND call_req.active_flag = :"SYS_B_02" ) AN
D ( call_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_
473 1 473.0 0.3 1.80 5.57 3376831664
BEGIN statspack.snap; END;
357 10 35.7 0.3 7.69 8.21 3407388950
SELECT count(*) FROM call_req, ctct, loc, site, z_zo, z_lho WHER
E ( call_req.customer = ctct.id AND ctct.c_l_id = loc.id AND l
oc.l_si_id = site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo
_lho_id = z_lho.id AND z_lho.lho_name LIKE :"SYS_B_0" ) AND (
( call_req.group_id != :"SYS_B_1" ) and ( call_req.group_id !=
177 5 35.4 0.1 1.81 2.08 920690862
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct, ct_ty WHERE ( ctct.c_ctp_id = ct_ty.id A
SQL ordered by Executions for DB: AHD Instance: ahd Snaps: 20 -21
-> End Executions Threshold: 100
CPU per Elap per
Executions Rows Processed Rows per Exec Exec (s) Exec (s) Hash Value
7,741 7,738 1.0 0.00 0.00 1060224445
SELECT grpmem.group_id , grpmem.manager_flag , grpmem.member , g
rpmem.notify_flag FROM grpmem WHERE grpmem.id = :"SYS_B_0"
2,459 2,459 1.0 0.00 0.00 3026674282
SELECT act_log.action_desc , act_log.analyst , act_log.call_req_
id , act_log.description , act_log.internal , act_log.knowledge_
session , act_log.knowledge_tool , act_log.last_mod_dt , act_log
.persid , act_log.system_time , act_log.time_spent , act_log.tim
e_stamp , act_log.type FROM act_log WHERE act_log.id = :"SYS_B_0
1,449 1,449 1.0 0.00 0.00 3299996875
SELECT att_evt.cancel_time , att_evt.event_tmpl , att_evt.fire_t
ime , att_evt.first_fire_time , att_evt.group_name , att_evt.las
t_mod_dt , att_evt.num_fire , att_evt.obj_id , att_evt.persid ,
att_evt.start_time , att_evt.status_flag , att_evt.user_smag , a
tt_evt.wait_time FROM att_evt WHERE att_evt.id = :"SYS_B_0"
1,336 1,336 1.0 0.00 0.00 3034229510
SELECT cr_prp.description , cr_prp.label , cr_prp.last_mod_by ,
cr_prp.last_mod_dt , cr_prp.owning_cr , cr_prp.persid , cr_prp.r
equired , cr_prp.sample , cr_prp.sequence , cr_prp.value FROM cr
prp WHERE crprp.id = :"SYS_B_0"
968 968 1.0 0.00 0.00 3460529092
select t.name, (select owner_instance from sys.aq$_queue_table_
affinities where table_objno = t.objno) from system.aq$_queue
_tables t where t.name = :1 and t.schema = :2 for update skip lo
cked
808 808 1.0 0.00 0.00 3346182257
SELECT call_req.active_flag , call_req.affected_rc , call_req.as
signee , call_req.call_back_date , call_req.call_back_flag , cal
l_req.category , call_req.change , call_req.charge_back_id , cal
l_req.close_date , call_req.created_via , call_req.customer , ca
ll_req.description , call_req.event_token , call_req.extern_ref
720 720 1.0 0.00 0.00 140137628
Module: Spotlight On Oracle, classic
SELECT DECODE(:b1,'BL','Buffer hash table instance lock','CF','C
ontrol file schema global enqueue lock','CI','Cross-instance fun
ction invocation instance lock','CS','Control file schema global
enqueue lock','CU','Cursor bind lock','DF','Data file instance
lock','DL','Direct loader parallel index create','DM','Mount/sta
718 718 1.0 0.00 0.00 4078915446
SELECT options.app_name, options.sym, options.id FROM options WH
ERE ( options.sym = :"SYS_B_0" ) AND ( options.del = :"SYS_B_1"
) ORDER BY options.app_name
634 634 1.0 0.00 0.00 1199698393
SELECT loc.alias , loc.del , loc.l_addr1 , loc.l_addr2 , loc.l_a
ddr3 , loc.l_addr4 , loc.l_addr5 , loc.l_addr6 , loc.l_details ,
loc.l_name , loc.l_si_id , loc.last_mod , loc.persid , loc.z_cb
SQL ordered by Executions for DB: AHD Instance: ahd Snaps: 20 -21
-> End Executions Threshold: 100
CPU per Elap per
Executions Rows Processed Rows per Exec Exec (s) Exec (s) Hash Value
l1 , loc.zcb_l2 , loc.z_cb_l3 , loc.z_l_code , loc.z_ro_code ,
loc.z_zo_code FROM loc WHERE loc.id = :"SYS_B_0"
531 208 0.4 0.00 0.00 800192270
SELECT lrel.l_persid, lrel.l_attr, lrel.l_sql, lrel.r_persid, lr
el.r_attr, lrel.r_sql, lrel.id FROM lrel WHERE lrel.l_persid = :
"SYS_B_0" and lrel.l_attr = :"SYS_B_1" ORDER BY lrel.l_persid ,
lrel.l_attr , lrel.l_sql
438 438 1.0 0.00 0.00 1317334374
Select PROPERTY_NAME,PROPERTY_VALUE,PROPERTY_TYPE from CI_PROPER
TIES where PROPERTY_NAME=:"SYS_B_0"
429 8,151 19.0 0.00 0.00 1976028604
SELECT cr_stat.sym, cr_stat.code FROM cr_stat WHERE cr_stat.del
= :"SYS_B_0" ORDER BY cr_stat.sym
383 383 1.0 0.00 0.00 2599265718
DELETE FROM anima WHERE id = :"SYS_B_0"
359 359 1.0 0.00 0.00 1719939797
DELETE FROM att_evt WHERE id = :"SYS_B_0"
337 337 1.0 0.00 0.00 3069423312
SELECT anima.a_act , anima.a_delta , anima.a_lock , anima.a_name
, anima.a_org , anima.a_string , anima.a_time , anima.t_method
, anima.t_persid , anima.t_type FROM anima WHERE anima.id = :"SY
S_B_0"
332 331 1.0 0.00 0.00 1549656119
SELECT crsq.id FROM crsq WHERE crsq.code = :"SYS_B_0"
315 315 1.0 0.00 0.00 1734736338
UPDATE cr_prp SET last_mod_by = :"SYS_B_0" , last_mod_dt = :"SYS
_B_1" WHERE id = :"SYS_B_2"
308 1,580 5.1 0.00 0.00 618252548
SELECT cr_prp.sequence, cr_prp.id FROM cr_prp WHERE cr_prp.ownin
g_cr = :"SYS_B_0" ORDER BY cr_prp.sequence
279 1,716 6.2 0.00 0.00 749386807
SELECT call_req.open_date, call_req.id FROM call_req WHERE call_
req.customer = :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1"
ORDER BY call_req.open_date DESC
277 277 1.0 0.00 0.00 321149819
INSERT INTO anima ( a_act, a_delta, a_lock, a_name, a_org, a_str
ing, a_time, t_method, t_persid, t_type, id ) VALUES ( :"SYS_B_
0" , :"SYS_B_1" , :"SYS_B_2" , :"SYS_B_3" , :"SYS_B_4" , nu
ll , :"SYS_B_5" , :"SYS_B_6" , :"SYS_B_7" , :"SYS_B_8" , :"
SQL ordered by Parse Calls for DB: AHD Instance: ahd Snaps: 20 -21
-> End Parse Calls Threshold: 1000
% Total
Parse Calls Executions Parses Hash Value
7,733 7,741 27.15 1060224445
SELECT grpmem.group_id , grpmem.manager_flag , grpmem.member , g
rpmem.notify_flag FROM grpmem WHERE grpmem.id = :"SYS_B_0"
2,459 2,459 8.63 3026674282
SELECT act_log.action_desc , act_log.analyst , act_log.call_req_
id , act_log.description , act_log.internal , act_log.knowledge_
session , act_log.knowledge_tool , act_log.last_mod_dt , act_log
.persid , act_log.system_time , act_log.time_spent , act_log.tim
e_stamp , act_log.type FROM act_log WHERE act_log.id = :"SYS_B_0
1,449 1,449 5.09 3299996875
SELECT att_evt.cancel_time , att_evt.event_tmpl , att_evt.fire_t
ime , att_evt.first_fire_time , att_evt.group_name , att_evt.las
t_mod_dt , att_evt.num_fire , att_evt.obj_id , att_evt.persid ,
att_evt.start_time , att_evt.status_flag , att_evt.user_smag , a
tt_evt.wait_time FROM att_evt WHERE att_evt.id = :"SYS_B_0"
1,336 1,336 4.69 3034229510
SELECT cr_prp.description , cr_prp.label , cr_prp.last_mod_by ,
cr_prp.last_mod_dt , cr_prp.owning_cr , cr_prp.persid , cr_prp.r
equired , cr_prp.sample , cr_prp.sequence , cr_prp.value FROM cr
prp WHERE crprp.id = :"SYS_B_0"
808 808 2.84 3346182257
SELECT call_req.active_flag , call_req.affected_rc , call_req.as
signee , call_req.call_back_date , call_req.call_back_flag , cal
l_req.category , call_req.change , call_req.charge_back_id , cal
l_req.close_date , call_req.created_via , call_req.customer , ca
ll_req.description , call_req.event_token , call_req.extern_ref
718 718 2.52 4078915446
SELECT options.app_name, options.sym, options.id FROM options WH
ERE ( options.sym = :"SYS_B_0" ) AND ( options.del = :"SYS_B_1"
) ORDER BY options.app_name
634 634 2.23 1199698393
SELECT loc.alias , loc.del , loc.l_addr1 , loc.l_addr2 , loc.l_a
ddr3 , loc.l_addr4 , loc.l_addr5 , loc.l_addr6 , loc.l_details ,
loc.l_name , loc.l_si_id , loc.last_mod , loc.persid , loc.z_cb
l1 , loc.zcb_l2 , loc.z_cb_l3 , loc.z_l_code , loc.z_ro_code ,
loc.z_zo_code FROM loc WHERE loc.id = :"SYS_B_0"
531 531 1.86 800192270
SELECT lrel.l_persid, lrel.l_attr, lrel.l_sql, lrel.r_persid, lr
el.r_attr, lrel.r_sql, lrel.id FROM lrel WHERE lrel.l_persid = :
"SYS_B_0" and lrel.l_attr = :"SYS_B_1" ORDER BY lrel.l_persid ,
lrel.l_attr , lrel.l_sql
438 438 1.54 1317334374
Select PROPERTY_NAME,PROPERTY_VALUE,PROPERTY_TYPE from CI_PROPER
TIES where PROPERTY_NAME=:"SYS_B_0"
429 429 1.51 1976028604
SQL ordered by Parse Calls for DB: AHD Instance: ahd Snaps: 20 -21
-> End Parse Calls Threshold: 1000
% Total
Parse Calls Executions Parses Hash Value
SELECT cr_stat.sym, cr_stat.code FROM cr_stat WHERE cr_stat.del
= :"SYS_B_0" ORDER BY cr_stat.sym
383 383 1.34 2599265718
DELETE FROM anima WHERE id = :"SYS_B_0"
359 359 1.26 1719939797
DELETE FROM att_evt WHERE id = :"SYS_B_0"
337 337 1.18 3069423312
SELECT anima.a_act , anima.a_delta , anima.a_lock , anima.a_name
, anima.a_org , anima.a_string , anima.a_time , anima.t_method
, anima.t_persid , anima.t_type FROM anima WHERE anima.id = :"SY
S_B_0"
330 332 1.16 1549656119
SELECT crsq.id FROM crsq WHERE crsq.code = :"SYS_B_0"
315 315 1.11 1734736338
UPDATE cr_prp SET last_mod_by = :"SYS_B_0" , last_mod_dt = :"SYS
_B_1" WHERE id = :"SYS_B_2"
308 308 1.08 618252548
SELECT cr_prp.sequence, cr_prp.id FROM cr_prp WHERE cr_prp.ownin
g_cr = :"SYS_B_0" ORDER BY cr_prp.sequence
277 277 0.97 321149819
INSERT INTO anima ( a_act, a_delta, a_lock, a_name, a_org, a_str
ing, a_time, t_method, t_persid, t_type, id ) VALUES ( :"SYS_B_
0" , :"SYS_B_1" , :"SYS_B_2" , :"SYS_B_3" , :"SYS_B_4" , nu
ll , :"SYS_B_5" , :"SYS_B_6" , :"SYS_B_7" , :"SYS_B_8" , :"
SYS_B_9" )
277 279 0.97 749386807
SELECT call_req.open_date, call_req.id FROM call_req WHERE call_
req.customer = :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1"
ORDER BY call_req.open_date DESC
275 275 0.97 2816620377
INSERT INTO att_evt ( cancel_time, event_tmpl, fire_time, first_
fire_time, group_name, last_mod_dt, num_fire, obj_id, persid, st
art_time, status_flag, user_smag, wait_time, id ) VALUES ( null
, :"SYS_B_00" , :"SYS_B_01" , :"SYS_B_02" , :"SYS_B_03" ,
:"SYS_B_04" , :"SYS_B_05" , :"SYS_B_06" , :"SYS_B_07" , :"SY
269 269 0.94 3605948696
SELECT slatpl.del , slatpl.elapsed , slatpl.event , slatpl.last_
mod_by , slatpl.last_mod_dt , slatpl.object_type , slatpl.persid
, slatpl.service_type , slatpl.sym FROM slatpl WHERE slatpl.id
SQL ordered by Sharable Memory for DB: AHD Instance: ahd Snaps: 20 -21
-> End Sharable Memory Threshold: 1048576
Sharable Mem (b) Executions % Total Hash Value
23,912,520 231 13.6 139964375
SELECT anima.a_name, anima.t_persid, anima.t_method, anima.id FR
OM anima WHERE anima.t_persid LIKE :"SYS_B_0" ORDER BY anima.
a_name
18,314,292 26 10.4 380755726
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.ref_num LIKE :"SYS_B_00" ) AND ( call_req.group_id IN (
SELECT id FROM ctct WHERE id = :"SYS_B_01" OR id = :"SYS_B_02" O
R id = :"SYS_B_03" OR id = :"SYS_B_04" OR id = :"SYS_B_05" OR id
= :"SYS_B_06" OR id = :"SYS_B_07" OR id = :"SYS_B_08" OR id = :
12,365,844 107 7.0 1877135209
SELECT chg.open_date, chg.chg_ref_num, chg.id FROM chg WHERE ( c
hg.affected_contact = :"SYS_B_0" and chg.active_flag = :"SYS_B_1
" ) AND ( chg.affected_contact = :"SYS_B_2" ) ORDER BY chg.open
_date DESC
2,692,852 17 1.5 4181730075
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct, ct_ty WHERE ( ctct.c_last_name LIKE :"
SYS_B_0" AND ctct.c_ctp_id = ct_ty.id AND ct_ty.id = :"SYS_B_1"
AND ctct.del = :"SYS_B_2" AND ctct.id IN ( SELECT member FROM g
2,048,083 10 1.2 153455816
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct WHERE ( ctct.c_last_name LIKE :"SYS_B_0
" ) AND ( ( ctct.del = :"SYS_B_1" ) AND ( ctct.c_ctp_id = :"SYS_
B_2" AND ctct.alias = -:"SYS_B_3" ) ) ORDER BY ctct.c_last_name
1,653,628 3 0.9 1096419296
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.ref_num LIKE :"SYS_B_0" ) AND ( ( call_req.group_id IN (
SELECT group_id FROM grpmem WHERE member = :"SYS_B_1" ) ) or ca
ll_req.assignee = :"SYS_B_2" or call_req.customer = :"SYS_B_3" )
ORDER BY call_req.open_date DESC
SQL ordered by Version Count for DB: AHD Instance: ahd Snaps: 20 -21
-> End Version Count Threshold: 20
Version
Count Executions Hash Value
349 231 139964375
SELECT anima.a_name, anima.t_persid, anima.t_method, anima.id FR
OM anima WHERE anima.t_persid LIKE :"SYS_B_0" ORDER BY anima.
a_name
196 107 1877135209
SELECT chg.open_date, chg.chg_ref_num, chg.id FROM chg WHERE ( c
hg.affected_contact = :"SYS_B_0" and chg.active_flag = :"SYS_B_1
" ) AND ( chg.affected_contact = :"SYS_B_2" ) ORDER BY chg.open
_date DESC
127 26 380755726
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.ref_num LIKE :"SYS_B_00" ) AND ( call_req.group_id IN (
SELECT id FROM ctct WHERE id = :"SYS_B_01" OR id = :"SYS_B_02" O
R id = :"SYS_B_03" OR id = :"SYS_B_04" OR id = :"SYS_B_05" OR id
= :"SYS_B_06" OR id = :"SYS_B_07" OR id = :"SYS_B_08" OR id = :
36 17 4181730075
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct, ct_ty WHERE ( ctct.c_last_name LIKE :"
SYS_B_0" AND ctct.c_ctp_id = ct_ty.id AND ct_ty.id = :"SYS_B_1"
AND ctct.del = :"SYS_B_2" AND ctct.id IN ( SELECT member FROM g
33 10 153455816
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct WHERE ( ctct.c_last_name LIKE :"SYS_B_0
" ) AND ( ( ctct.del = :"SYS_B_1" ) AND ( ctct.c_ctp_id = :"SYS_
B_2" AND ctct.alias = -:"SYS_B_3" ) ) ORDER BY ctct.c_last_name
26 3 1096419296
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.ref_num LIKE :"SYS_B_0" ) AND ( ( call_req.group_id IN (
SELECT group_id FROM grpmem WHERE member = :"SYS_B_1" ) ) or ca
ll_req.assignee = :"SYS_B_2" or call_req.customer = :"SYS_B_3" )
ORDER BY call_req.open_date DESC
Instance Activity Stats for DB: AHD Instance: ahd Snaps: 20 -21
Statistic Total per Second per Trans
CPU used by this session 12,450 8.7 4.1
CPU used when call started 12,515 8.8 4.1
CR blocks created 53 0.0 0.0
DBWR buffers scanned 0 0.0 0.0
DBWR checkpoint buffers written 1,644 1.2 0.5
DBWR checkpoints 0 0.0 0.0
DBWR free buffers found 0 0.0 0.0
DBWR lru scans 0 0.0 0.0
DBWR make free requests 0 0.0 0.0
DBWR summed scan depth 0 0.0 0.0
DBWR transaction table writes 10 0.0 0.0
DBWR undo block writes 238 0.2 0.1
SQL*Net roundtrips to/from client 131,833 92.6 42.9
active txn count during cleanout 130 0.1 0.0
background checkpoints completed 0 0.0 0.0
background checkpoints started 0 0.0 0.0
background timeouts 2,161 1.5 0.7
branch node splits 0 0.0 0.0
buffer is not pinned count 3,147,925 2,210.6 1,024.1
buffer is pinned count 638,155 448.1 207.6
bytes received via SQL*Net from c 20,116,711 14,126.9 6,544.2
bytes sent via SQL*Net to client 33,961,169 23,849.1 11,047.9
calls to get snapshot scn: kcmgss 76,324 53.6 24.8
calls to kcmgas 6,266 4.4 2.0
calls to kcmgcs 110 0.1 0.0
change write time 25 0.0 0.0
cleanout - number of ktugct calls 145 0.1 0.1
cleanouts and rollbacks - consist 0 0.0 0.0
cleanouts only - consistent read 0 0.0 0.0
cluster key scan block gets 1,361 1.0 0.4
cluster key scans 1,146 0.8 0.4
commit cleanout failures: buffer 0 0.0 0.0
commit cleanout failures: callbac 3 0.0 0.0
commit cleanout failures: cannot 0 0.0 0.0
commit cleanouts 14,837 10.4 4.8
commit cleanouts successfully com 14,834 10.4 4.8
commit txn count during cleanout 106 0.1 0.0
consistent changes 2,123 1.5 0.7
consistent gets 3,336,864 2,343.3 1,085.5
consistent gets - examination 197,061 138.4 64.1
cursor authentications 71 0.1 0.0
data blocks consistent reads - un 2,123 1.5 0.7
db block changes 50,525 35.5 16.4
db block gets 47,774 33.6 15.5
deferred (CURRENT) block cleanout 7,940 5.6 2.6
dirty buffers inspected 0 0.0 0.0
enqueue conversions 29 0.0 0.0
enqueue releases 14,210 10.0 4.6
enqueue requests 14,210 10.0 4.6
enqueue waits 0 0.0 0.0
execute count 32,955 23.1 10.7
free buffer inspected 16 0.0 0.0
free buffer requested 140,283 98.5 45.6
hot buffers moved to head of LRU 950 0.7 0.3
immediate (CR) block cleanout app 0 0.0 0.0
immediate (CURRENT) block cleanou 2,804 2.0 0.9
Instance Activity Stats for DB: AHD Instance: ahd Snaps: 20 -21
Statistic Total per Second per Trans
index fast full scans (full) 157 0.1 0.1
index fetch by key 70,378 49.4 22.9
index scans kdiixs1 28,181 19.8 9.2
leaf node 90-10 splits 10 0.0 0.0
leaf node splits 76 0.1 0.0
logons cumulative 11 0.0 0.0
messages received 5,452 3.8 1.8
messages sent 5,452 3.8 1.8
no buffer to keep pinned count 0 0.0 0.0
no work - consistent read gets 3,085,481 2,166.8 1,003.7
opened cursors cumulative 4,561 3.2 1.5
parse count (failures) 0 0.0 0.0
parse count (hard) 412 0.3 0.1
parse count (total) 28,484 20.0 9.3
parse time cpu 426 0.3 0.1
parse time elapsed 469 0.3 0.2
physical reads 138,930 97.6 45.2
physical reads direct 0 0.0 0.0
physical writes 1,644 1.2 0.5
physical writes direct 0 0.0 0.0
physical writes non checkpoint 232 0.2 0.1
pinned buffers inspected 7 0.0 0.0
prefetched blocks 32,732 23.0 10.7
process last non-idle time 12,884,949,552 9,048,419.6 4,191,590.6
recursive calls 22,718 16.0 7.4
recursive cpu usage 226 0.2 0.1
redo blocks written 19,178 13.5 6.2
redo buffer allocation retries 0 0.0 0.0
redo entries 27,265 19.2 8.9
redo log space requests 0 0.0 0.0
redo log space wait time 0 0.0 0.0
redo size 8,488,216 5,960.8 2,761.3
redo synch time 74 0.1 0.0
redo synch writes 3,078 2.2 1.0
redo wastage 1,040,788 730.9 338.6
redo write time 75 0.1 0.0
redo writer latching time 0 0.0 0.0
redo writes 5,216 3.7 1.7
rollback changes - undo records a 6 0.0 0.0
rollbacks only - consistent read 233 0.2 0.1
rows fetched via callback 54,581 38.3 17.8
session connect time 12,884,949,552 9,048,419.6 4,191,590.6
session logical reads 3,384,638 2,376.9 1,101.1
session pga memory max 6,168,536 4,331.8 2,006.7
session uga memory 599,984 421.3 195.2
session uga memory max 9,592,864 6,736.6 3,120.7
shared hash latch upgrades - no w 27,737 19.5 9.0
shared hash latch upgrades - wait 84 0.1 0.0
sorts (disk) 0 0.0 0.0
sorts (memory) 6,834 4.8 2.2
sorts (rows) 3,229,994 2,268.3 1,050.8
summed dirty queue length 0 0.0 0.0
switch current to new buffer 990 0.7 0.3
table fetch by rowid 474,673 333.3 154.4
table fetch continued row 8 0.0 0.0
table scan blocks gotten 2,751,375 1,932.2 895.1
Instance Activity Stats for DB: AHD Instance: ahd Snaps: 20 -21
Statistic Total per Second per Trans
table scan rows gotten 55,928,200 39,275.4 18,194.0
table scans (long tables) 245 0.2 0.1
table scans (short tables) 3,383 2.4 1.1
transaction rollbacks 3 0.0 0.0
transaction tables consistent rea 0 0.0 0.0
transaction tables consistent rea 0 0.0 0.0
user calls 131,904 92.6 42.9
user commits 3,074 2.2 1.0
user rollbacks 0 0.0 0.0
workarea executions - onepass 0 0.0 0.0
workarea executions - optimal 8,438 5.9 2.7
write clones created in backgroun 0 0.0 0.0
write clones created in foregroun 0 0.0 0.0
Tablespace IO Stats for DB: AHD Instance: ahd Snaps: 20 -21
->ordered by IOs (Reads + Writes) desc
Tablespace
Av Av Av Av Buffer Av Buf
Reads Reads/s Rd(ms) Blks/Rd Writes Writes/s Waits Wt(ms)
AHD1_DATA
105,869 74 0.9 1.3 828 1 11,740 0.5
AHD1_IDX
38 0 7.4 1.0 563 0 0 0.0
PERFSTAT
372 0 3.6 1.0 0 0 0 0.0
UNDOTBS1
0 0 0.0 248 0 0 0.0
SYSTEM
6 0 6.7 1.0 5 0 0 0.0
File IO Stats for DB: AHD Instance: ahd Snaps: 20 -21
->ordered by Tablespace, File
Tablespace Filename
Av Av Av Av Buffer Av Buf
Reads Reads/s Rd(ms) Blks/Rd Writes Writes/s Waits Wt(ms)
AHD1_DATA E:\ORACLE\ORADATA\AHD\AHD1_DATA.ORA
53,454 38 0.9 1.3 432 0 5,949 0.5
E:\ORACLE\ORADATA\AHD\AHD2_DATA.ORA
52,415 37 0.9 1.3 396 0 5,791 0.5
AHD1_IDX E:\ORACLE\ORADATA\AHD\AHD1_IDX.ORA
38 0 7.4 1.0 563 0 0
PERFSTAT E:\ORACLE\ORADATA\AHD\PERFSTAT.ORA
372 0 3.6 1.0 0 0 0
SYSTEM E:\ORACLE\ORADATA\AHD\SYSTEM01.DBF
6 0 6.7 1.0 5 0 0
UNDOTBS1 E:\ORACLE\ORADATA\AHD\UNDOTBS01.DBF
0 0 248 0 0
Buffer Pool Statistics for DB: AHD Instance: ahd Snaps: 20 -21
-> Standard block size Pools D: default, K: keep, R: recycle
-> Default Pools for other block sizes: 2k, 4k, 8k, 16k, 32k
Free Write Buffer
Number of Cache Buffer Physical Physical Buffer Complete Busy
P Buffers Hit % Gets Reads Writes Waits Waits Waits
D 82,082 97.8 6,327,007 138,971 1,644 0 0 11,760
Instance Recovery Stats for DB: AHD Instance: ahd Snaps: 20 -21
-> B: Begin snapshot, E: End snapshot
Targt Estd Log File Log Ckpt Log Ckpt
MTTR MTTR Recovery Actual Target Size Timeout Interval
(s) (s) Estd IOs Redo Blks Redo Blks Redo Blks Redo Blks Redo Blks
B 75 26 2354 18057 17632 184320 17632
E 75 27 2967 23569 22952 184320 22952
Buffer Pool Advisory for DB: AHD Instance: ahd End Snap: 21
-> Only rows with estimated physical reads >0 are displayed
-> ordered by Block Size, Buffers For Estimate
Size for Size Buffers for Est Physical Estimated
P Estimate (M) Factr Estimate Read Factor Physical Reads
D 64 .1 8,008 261.38 4,357,231,706
D 128 .2 16,016 207.44 3,458,029,385
D 192 .3 24,024 143.22 2,387,570,894
D 256 .4 32,032 2.29 38,243,018
D 320 .5 40,040 1.89 31,541,321
D 384 .6 48,048 1.74 29,023,767
D 448 .7 56,056 1.69 28,232,064
D 512 .8 64,064 1.20 19,951,481
D 576 .9 72,072 1.11 18,529,925
D 640 1.0 80,080 1.04 17,367,752
D 656 1.0 82,082 1.00 16,670,129
D 704 1.1 88,088 0.97 16,124,256
D 768 1.2 96,096 0.91 15,155,822
D 832 1.3 104,104 0.90 15,055,099
D 896 1.4 112,112 0.89 14,839,567
D 960 1.5 120,120 0.88 14,668,682
D 1,024 1.6 128,128 0.87 14,479,726
D 1,088 1.7 136,136 0.84 13,988,866
D 1,152 1.8 144,144 0.70 11,723,518
D 1,216 1.9 152,152 0.61 10,156,857
D 1,280 2.0 160,160 0.20 3,281,883
Buffer wait Statistics for DB: AHD Instance: ahd Snaps: 20 -21
-> ordered by wait time desc, waits desc
Tot Wait Avg
Class Waits Time (s) Time (ms)
data block 11,754 6 0
PGA Aggr Target Stats for DB: AHD Instance: ahd Snaps: 20 -21
-> B: Begin snap E: End snap (rows dentified with B or E contain data
which is absolute i.e. not diffed over the interval)
-> PGA cache hit % - percentage of W/A (WorkArea) data processed only in-memory
-> Auto PGA Target - actual workarea memory target
-> W/A PGA Used - amount of memory used for all Workareas (manual + auto)
-> %PGA W/A Mem - percentage of PGA memory allocated to workareas
-> %Auto W/A Mem - percentage of workarea memory controlled by Auto Mem Mgmt
-> %Man W/A Mem - percentage of workarea memory under manual control
PGA Cache Hit % W/A MB Processed Extra W/A MB Read/Written
100.0 1,169 0
%PGA %Auto %Man
PGA Aggr Auto PGA PGA Mem W/A PGA W/A W/A W/A Global Mem
Target(M) Target(M) Alloc(M) Used(M) Mem Mem Mem Bound(K)
B 350 293 37.6 0.0 .0 .0 .0 17,920
E 350 293 37.5 0.2 .6 100.0 .0 17,920
PGA Aggr Target Histogram for DB: AHD Instance: ahd Snaps: 20 -21
-> Optimal Executions are purely in-memory operations
Low High
Optimal Optimal Total Execs Optimal Execs 1-Pass Execs M-Pass Execs
8K 16K 6,809 6,809 0 0
16K 32K 148 148 0 0
32K 64K 90 90 0 0
64K 128K 154 154 0 0
128K 256K 73 73 0 0
256K 512K 308 308 0 0
512K 1024K 374 374 0 0
1M 2M 171 171 0 0
2M 4M 217 217 0 0
4M 8M 10 10 0 0
PGA Memory Advisory for DB: AHD Instance: ahd End Snap: 21
-> When using Auto Memory Mgmt, minimally choose a pga_aggregate_target value
where Estd PGA Overalloc Count is 0
Estd Extra Estd PGA Estd PGA
PGA Target Size W/A MB W/A MB Read/ Cache Overalloc
Est (MB) Factr Processed Written to Disk Hit % Count
44 0.1 180,060.5 42,218.7 81.0 4
88 0.3 180,060.5 23,194.7 89.0 0
175 0.5 180,060.5 9,436.8 95.0 0
263 0.8 180,060.5 9,356.7 95.0 0
350 1.0 180,060.5 9,274.8 95.0 0
420 1.2 180,060.5 9,169.9 95.0 0
490 1.4 180,060.5 9,148.0 95.0 0
560 1.6 180,060.5 9,148.0 95.0 0
630 1.8 180,060.5 9,148.0 95.0 0
700 2.0 180,060.5 9,148.0 95.0 0
1,050 3.0 180,060.5 9,148.0 95.0 0
1,400 4.0 180,060.5 9,148.0 95.0 0
2,100 6.0 180,060.5 3,983.3 98.0 0
2,800 8.0 180,060.5 3,983.3 98.0 0
Rollback Segment Stats for DB: AHD Instance: ahd Snaps: 20 -21
->A high value for "Pct Waits" suggests more rollback segments may be required
->RBS stats may not be accurate between begin and end snaps when using Auto Undo
managment, as RBS may be dynamically created and dropped as needed
Trans Table Pct Undo Bytes
RBS No Gets Waits Written Wraps Shrinks Extends
0 29.0 0.00 0 0 0 0
1 975.0 0.00 122,796 0 0 0
2 1,244.0 0.00 1,094,706 10 0 5
3 816.0 0.00 118,596 0 0 0
4 1,430.0 0.00 212,754 2 0 0
5 1,716.0 0.00 291,940 2 0 0
6 1,287.0 0.00 197,900 0 0 0
7 1,674.0 0.00 279,160 0 0 0
8 1,031.0 0.00 148,216 0 0 0
9 947.0 0.00 141,870 0 0 0
10 834.0 0.00 117,422 0 0 0
Rollback Segment Storage for DB: AHD Instance: ahd Snaps: 20 -21
->Optimal Size should be larger than Avg Active
RBS No Segment Size Avg Active Optimal Size Maximum Size
0 385,024 0 385,024
1 2,220,032 455,412 2,220,032
2 2,088,960 333,026 2,220,032
3 2,220,032 456,101 2,220,032
4 2,220,032 474,584 3,268,608
5 2,220,032 480,865 3,268,608
6 2,220,032 513,967 3,268,608
7 2,220,032 480,785 2,220,032
8 2,220,032 496,182 2,220,032
9 2,220,032 486,763 2,220,032
10 2,220,032 430,016 6,414,336
Undo Segment Summary for DB: AHD Instance: ahd Snaps: 20 -21
-> Undo segment block stats:
-> uS - unexpired Stolen, uR - unexpired Released, uU - unexpired reUsed
-> eS - expired Stolen, eR - expired Released, eU - expired reUsed
Undo Undo Num Max Qry Max Tx Snapshot Out of uS/uR/uU/
TS# Blocks Trans Len (s) Concurcy Too Old Space eS/eR/eU
1 395 2,900,725 5 1 0 0 0/0/0/0/0/0
Undo Segment Stats for DB: AHD Instance: ahd Snaps: 20 -21
-> ordered by Time desc
Undo Num Max Qry Max Tx Snap Out of uS/uR/uU/
End Time Blocks Trans Len (s) Concy Too Old Space eS/eR/eU
13-Feb 15:04 96 ######## 4 1 0 0 0/0/0/0/0/0
13-Feb 14:54 299 ######## 5 1 0 0 0/0/0/0/0/0
Latch Activity for DB: AHD Instance: ahd Snaps: 20 -21
->"Get Requests", "Pct Get Miss" and "Avg Slps/Miss" are statistics for
willing-to-wait latch get requests
->"NoWait Requests", "Pct NoWait Miss" are for no-wait latch get requests
->"Pct Misses" for both should be very close to 0.0
Pct Avg Wait Pct
Get Get Slps Time NoWait NoWait
Latch Requests Miss /Miss (s) Requests Miss
Consistent RBA 5,216 0.0 0 0
FOB s.o list latch 34 0.0 0 0
SQL memory manager latch 1 0.0 0 462 0.0
SQL memory manager worka 40,347 0.0 0 0
active checkpoint queue 1,261 0.0 0 0
archive control 163 0.0 0 0
archive process latch 29 0.0 0 0
cache buffer handles 378 0.0 0 0
cache buffers chains 6,836,244 0.4 0.0 0 266,617 0.0
cache buffers lru chain 244,157 0.0 0.0 0 140,432 0.0
channel handle pool latc 21 0.0 0 0
channel operations paren 960 0.0 0 0
checkpoint queue latch 86,982 0.0 0 2,337 0.0
child cursor hash table 6,464 0.0 0.0 0 0
dml lock allocation 15,005 0.0 0 0
dummy allocation 21 0.0 0 0
enqueue hash chains 28,447 0.0 0 0
enqueues 8,689 0.0 0 0
event group latch 11 0.0 0 0
file number translation 4,079 0.0 0 0
hash table column usage 38 0.0 0 187,596 0.0
hash table modification 1 0.0 0 0
job_queue_processes para 23 0.0 0 0
ktm global data 4 0.0 0 0
kwqit: protect wakeup ti 45 0.0 0 0
lgwr LWN SCN 5,328 0.4 0.0 0 0
library cache 342,865 0.2 0.0 0 342 0.6
library cache load lock 452 0.0 0 0
library cache pin 197,662 0.0 0.0 0 0
library cache pin alloca 124,035 0.0 0.0 0 0
list of block allocation 55 0.0 0 0
messages 30,779 0.0 0.0 0 0
mostly latch-free SCN 5,459 1.8 0.0 0 0
multiblock read objects 194,822 0.0 0.0 0 0
ncodef allocation latch 23 0.0 0 0
object stats modificatio 618 0.0 0 0
post/wait queue 10,441 0.0 0 3,078 0.0
process allocation 11 0.0 0 11 0.0
process group creation 21 0.0 0 0
redo allocation 37,773 0.0 0.0 0 0
redo copy 0 0 27,274 0.0
redo writing 17,880 0.0 0 0
row cache enqueue latch 169,423 0.0 0.0 0 0
row cache objects 169,795 0.0 0 3 0.0
sequence cache 38 0.0 0 0
session allocation 15,580 0.0 0 0
session idle bit 269,419 0.0 0.0 0 0
session switching 23 0.0 0 0
session timer 478 0.0 0 0
shared pool 104,427 0.1 0.0 0 0
Latch Activity for DB: AHD Instance: ahd Snaps: 20 -21
->"Get Requests", "Pct Get Miss" and "Avg Slps/Miss" are statistics for
willing-to-wait latch get requests
->"NoWait Requests", "Pct NoWait Miss" are for no-wait latch get requests
->"Pct Misses" for both should be very close to 0.0
Pct Avg Wait Pct
Get Get Slps Time NoWait NoWait
Latch Requests Miss /Miss (s) Requests Miss
sim partition latch 0 0 32 0.0
simulator hash latch 217,119 0.0 0.0 0 0
simulator lru latch 16,247 0.0 0 902 0.4
sort extent pool 29 0.0 0 0
transaction allocation 36 0.0 0 0
transaction branch alloc 23 0.0 0 0
undo global data 19,973 0.0 0 0
user lock 42 0.0 0 0
Latch Sleep breakdown for DB: AHD Instance: ahd Snaps: 20 -21
-> ordered by misses desc
Get Spin &
Latch Name Requests Misses Sleeps Sleeps 1->4
cache buffers chains 6,836,244 26,201 46 0/0/0/0/0
library cache 342,865 778 5 773/5/0/0/0
shared pool 104,427 125 3 122/3/0/0/0
Latch Miss Sources for DB: AHD Instance: ahd Snaps: 20 -21
-> only latches with sleeps are shown
-> ordered by name, sleeps desc
NoWait Waiter
Latch Name Where Misses Sleeps Sleeps
cache buffers chains kcbgtcr: kslbegin excl 0 32 30
cache buffers chains kcbrls: kslbegin 0 7 13
cache buffers chains kcbzwb 0 4 3
cache buffers chains kcbgtcr: fast path 0 3 0
library cache kglic 0 2 0
library cache kglobpn: child: 0 2 0
library cache kgllkdl: child: cleanup 0 1 0
shared pool kghalo 0 2 0
shared pool kghalp 0 1 0
Child Latch Statistics DB: AHD Instance: ahd Snaps: 20 -21
-> only latches with sleeps/gets > 1/100000 are shown
-> ordered by name, gets desc
Child Get Spin &
Latch Name Num Requests Misses Sleeps Sleeps 1->4
cache buffers chains 439 28,269 1,276 1 0/0/0/0/0
cache buffers chains 269 26,297 842 1 0/0/0/0/0
cache buffers chains 1010 17,482 49 2 0/0/0/0/0
cache buffers chains 260 11,141 20 1 0/0/0/0/0
cache buffers chains 324 9,454 29 1 0/0/0/0/0
cache buffers chains 840 7,235 20 1 0/0/0/0/0
cache buffers chains 46 6,868 25 1 0/0/0/0/0
cache buffers chains 835 6,799 26 2 0/0/0/0/0
cache buffers chains 202 6,768 17 1 0/0/0/0/0
cache buffers chains 740 6,573 38 2 0/0/0/0/0
cache buffers chains 592 6,508 30 1 0/0/0/0/0
cache buffers chains 436 6,485 25 2 0/0/0/0/0
cache buffers chains 513 6,443 16 1 0/0/0/0/0
cache buffers chains 844 6,436 28 1 0/0/0/0/0
cache buffers chains 117 6,423 25 1 0/0/0/0/0
cache buffers chains 389 6,381 25 1 0/0/0/0/0
cache buffers chains 116 6,349 29 1 0/0/0/0/0
cache buffers chains 51 6,340 34 1 0/0/0/0/0
cache buffers chains 914 6,259 31 1 0/0/0/0/0
cache buffers chains 713 6,249 24 1 0/0/0/0/0
cache buffers chains 465 6,198 27 2 0/0/0/0/0
cache buffers chains 416 6,193 27 1 0/0/0/0/0
cache buffers chains 432 6,155 34 1 0/0/0/0/0
cache buffers chains 583 6,152 23 2 0/0/0/0/0
cache buffers chains 126 6,147 35 1 0/0/0/0/0
cache buffers chains 879 6,043 21 1 0/0/0/0/0
cache buffers chains 110 6,010 25 1 0/0/0/0/0
cache buffers chains 138 6,010 25 1 0/0/0/0/0
cache buffers chains 472 6,002 31 1 0/0/0/0/0
cache buffers chains 908 5,964 20 1 0/0/0/0/0
cache buffers chains 860 5,950 23 1 0/0/0/0/0
cache buffers chains 71 5,945 29 3 0/0/0/0/0
cache buffers chains 20 5,780 28 1 0/0/0/0/0
cache buffers chains 932 5,759 25 1 0/0/0/0/0
cache buffers chains 866 5,610 22 1 0/0/0/0/0
cache buffers chains 989 5,454 34 2 0/0/0/0/0
cache buffers chains 1005 5,434 40 1 0/0/0/0/0
library cache 6 47,067 52 3 49/3/0/0/0
shared pool 1 99,771 124 3 121/3/0/0/0
Top 5 Logical Reads per Segment for DB: AHD Instance: ahd Snaps: 20 -21
-> End Segment Logical Reads Threshold: 10000
Subobject Obj. Logical
Owner Tablespace Object Name Name Type Reads %Total
AHD AHD1_DATA CALL_REQ TABLE 1,714,928 51.19
AHD AHD1_DATA CTCT TABLE 1,169,360 34.90
AHD AHD1_IDX SYS_C003707 INDEX 89,152 2.66
AHD AHD1_DATA CNOTE TABLE 66,272 1.98
AHD AHD1_IDX CALL_REQ_X5 INDEX 61,360 1.83
Top 5 Physical Reads per Segment for DB: AHD Instance: ahd Snaps: 20 -21
-> End Segment Physical Reads Threshold: 1000
Subobject Obj. Physical
Owner Tablespace Object Name Name Type Reads %Total
AHD AHD1_DATA CALL_REQ TABLE 132,989 95.95
AHD AHD1_DATA CTCT TABLE 5,325 3.84
AHD AHD1_DATA CI_AUDIT_TRAILS_GU_I INDEX 43 .03
AHD AHD1_DATA ACT_LOG TABLE 38 .03
AHD AHD1_DATA CI_EXT_CALLS_GUID INDEX 36 .03
Top 5 Buf. Busy Waits per Segment for DB: AHD Instance: ahd Snaps: 20 -21
-> End Segment Buffer Busy Waits Threshold: 100
Buffer
Subobject Obj. Busy
Owner Tablespace Object Name Name Type Waits %Total
AHD AHD1_DATA CALL_REQ TABLE 11,751 99.95
AHD AHD1_DATA CTCT TABLE 6 .05
Dictionary Cache Stats for DB: AHD Instance: ahd Snaps: 20 -21
->"Pct Misses" should be very low (< 2% in most cases)
->"Cache Usage" is the number of cache entries being used
->"Pct SGA" is the ratio of usage to allocated size for that cache
Get Pct Scan Pct Mod Final
Cache Requests Miss Reqs Miss Reqs Usage
dc_files 30 0.0 0 0 15
dc_histogram_defs 3,022 3.9 0 0 1,919
dc_object_ids 22,961 0.1 0 0 1,181
dc_objects 1,092 9.2 0 0 1,026
dc_profiles 11 0.0 0 0 1
dc_rollback_segments 168 0.0 0 0 22
dc_segments 5,519 0.1 0 0 1,334
dc_sequences 1 0.0 0 1 2
dc_tablespace_quotas 3 0.0 0 3 2
dc_tablespaces 25,902 0.0 0 0 16
dc_user_grants 127 0.0 0 0 22
dc_usernames 110 0.0 0 0 18
dc_users 26,077 0.0 0 0 30
Library Cache Activity for DB: AHD Instance: ahd Snaps: 20 -21
->"Pct Misses" should be very low
Get Pct Pin Pct Invali-
Namespace Requests Miss Requests Miss Reloads dations
CLUSTER 19 0.0 16 0.0 0 0
INDEX 315 0.0 315 0.0 0 0
SQL AREA 27,908 0.0 94,300 0.5 38 0
TABLE/PROCEDURE 3,793 2.6 6,017 6.5 55 0
TRIGGER 20 0.0 20 0.0 0 0
Shared Pool Advisory for DB: AHD Instance: ahd End Snap: 21
-> Note there is often a 1:Many correlation between a single logical object
in the Library Cache, and the physical number of memory objects associated
with it. Therefore comparing the number of Lib Cache objects (e.g. in
v$librarycache), with the number of Lib Cache Memory Objects is invalid
Estd
Shared Pool SP Estd Estd Estd Lib LC Time
Size for Size Lib Cache Lib Cache Cache Time Saved Estd Lib Cache
Estim (M) Factr Size (M) Mem Obj Saved (s) Factr Mem Obj Hits
88 .6 81 11,169 59,229 1.0 6,202,663
104 .7 96 13,308 59,237 1.0 6,207,373
120 .8 112 15,603 59,277 1.0 6,228,405
136 .9 127 18,086 59,348 1.0 6,265,370
152 1.0 142 19,501 59,379 1.0 6,295,279
168 1.1 157 21,035 59,426 1.0 6,314,861
184 1.2 172 22,038 59,455 1.0 6,325,903
200 1.3 187 23,807 59,459 1.0 6,328,446
216 1.4 202 25,911 59,460 1.0 6,329,386
232 1.5 217 28,194 59,461 1.0 6,330,245
248 1.6 232 29,884 59,462 1.0 6,330,914
264 1.7 248 31,127 59,462 1.0 6,331,222
280 1.8 263 32,878 59,463 1.0 6,331,563
296 1.9 278 34,121 59,463 1.0 6,331,898
312 2.1 295 36,139 59,463 1.0 6,332,102
SGA Memory Summary for DB: AHD Instance: ahd Snaps: 20 -21
SGA regions Size in Bytes
Database Buffers 687,865,856
Fixed Size 455,196
Redo Buffers 929,792
Variable Size 293,601,280
sum 982,852,124
SGA breakdown difference for DB: AHD Instance: ahd Snaps: 20 -21
Pool Name Begin value End value % Diff
java free memory 75,497,472 75,497,472 0.00
large free memory 41,943,040 41,943,040 0.00
shared 1M buffer 2,098,176 2,098,176 0.00
shared Checkpoint queue 846,912 846,912 0.00
shared FileOpenBlock 695,504 695,504 0.00
shared KGK heap 3,756 3,756 0.00
shared KGLS heap 1,230,944 1,438,740 16.88
shared KQR L PO 2,064 2,064 0.00
shared KQR M PO 2,480,924 2,514,220 1.34
shared KQR S PO 383,036 383,036 0.00
shared KQR S SO 5,636 5,636 0.00
shared KSXR pending messages que 841,036 841,036 0.00
shared KSXR receive buffers 1,033,000 1,033,000 0.00
shared MTTR advisory 97,412 97,412 0.00
shared PL/SQL DIANA 624,112 624,112 0.00
shared PL/SQL MPCODE 422,640 422,640 0.00
shared PLS non-lib hp 2,068 2,068 0.00
shared character set object 323,724 323,724 0.00
shared dictionary cache 1,610,880 1,610,880 0.00
shared errors 35,964 35,964 0.00
shared event statistics per sess 1,718,360 1,718,360 0.00
shared fixed allocation callback 300 300 0.00
shared free memory 26,982,004 26,841,956 -0.52
shared joxs heap init 4,220 4,220 0.00
shared kgl simulator 3,980,240 3,996,976 0.42
shared library cache 54,425,164 53,999,624 -0.78
shared message pool freequeue 834,752 834,752 0.00
shared miscellaneous 8,126,704 8,177,516 0.63
shared parameters 1,632 1,632 0.00
shared sessions 410,720 410,720 0.00
shared sim memory hea 377,656 377,656 0.00
shared sql area 66,513,080 66,768,476 0.38
shared subheap 45,216 45,216 0.00
shared table definiti 1,200 2,752 129.33
shared trigger defini 340 340 0.00
shared trigger inform 1,292 1,292 0.00
shared trigger source 100 100 0.00
buffer_cache 687,865,856 687,865,856 0.00
fixed_sga 455,196 455,196 0.00
log_buffer 918,528 918,528 0.00
init.ora Parameters for DB: AHD Instance: ahd Snaps: 20 -21
End value
Parameter Name Begin value (if different)
aq_tm_processes 1
background_dump_dest E:\oracle\admin\ahd\bdump
compatible 9.2.0.0.0
control_files E:\oracle\oradata\ahd\CONTROL01.C
core_dump_dest E:\oracle\admin\ahd\cdump
cursor_sharing SIMILAR
db_block_size 8192
db_cache_size 687865856
db_domain
db_file_multiblock_read_count 8
db_name ahd
db_writer_processes 2
dispatchers (PROTOCOL=TCP) (SERVICE=ahdXDB)
fast_start_mttr_target 300
hash_join_enabled TRUE
instance_name ahd
java_pool_size 75497472
job_queue_processes 10
large_pool_size 41943040
log_archive_dest_1 location=c:\archive
log_archive_format arc%d_%t_%s.arc
log_archive_start TRUE
open_cursors 300
pga_aggregate_target 367001600
processes 150
query_rewrite_enabled FALSE
remote_login_passwordfile EXCLUSIVE
shared_pool_size 159383552
sort_area_size 10485760
star_transformation_enabled FALSE
timed_statistics TRUE
undo_management AUTO
undo_retention 3600
undo_tablespace UNDOTBS1
user_dump_dest E:\oracle\admin\ahd\udump
End of ReportI am getting buffer busy waits on some tables.
Users are not experiencing any problem.Looks like you got bit by the CTD troll while sleeping.
Note also that (if I'm reading the report alright) out of 23 mins you have 6 seconds accounted to buffer busy waits.
Read the sample chapter here. -
Statspack interpreting help - buffer busy waits
Hi,
I've got statspack report from 9.2.0.8 DB, cpu_count = 12 , there is 'buffer busy waits' in top 5 .
Is there a problem ?
DB Name DB Id Instance Inst Num Release Cluster Host
XXXX 138180125 XXXX 1 9.2.0.8.0 NO X1
Snap Id Snap Time Sessions Curs/Sess Comment
Begin Snap: 35980 14-Jul-10 01:00:02 17 8.8
End Snap: 35984 14-Jul-10 05:00:01 17 8.8
Elapsed: 239.98 (mins)
Cache Sizes (end)
~~~~~~~~~~~~~~~~~
Buffer Cache: 3,072M Std Block Size: 8K
Shared Pool Size: 512M Log Buffer: 4,096K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 317,746.23 4,498.59
Logical reads: 11,150.77 157.87
Block changes: 2,134.89 30.23
Physical reads: 466.05 6.60
Physical writes: 133.62 1.89
User calls: 82.42 1.17
Parses: 67.92 0.96
Hard parses: 0.02 0.00
Sorts: 106.77 1.51
Logons: 0.03 0.00
Executes: 516.58 7.31
Transactions: 70.63
% Blocks changed per Read: 19.15 Recursive Call %: 95.00
Rollback per transaction %: 0.00 Rows per Sort: 4.34
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 99.03 Redo NoWait %: 100.00
Buffer Hit %: 95.91 In-memory Sort %: 100.00
Library Hit %: 100.00 Soft Parse %: 99.98
Execute to Parse %: 86.85 Latch Hit %: 99.65
Parse CPU to Parse Elapsd %: 7.82 % Non-Parse CPU: 99.91
Shared Pool Statistics Begin End
Memory Usage %: 43.53 43.92
% SQL with executions>1: 64.89 70.00
% Memory for SQL w/exec>1: 55.95 61.64
Top 5 Timed Events
~~~~~~~~~~~~~~~~~~ % Total
Event Waits Time (s) Ela Time
SQL*Net message from dblink 797,760 44,575 41.69
PL/SQL lock timer 1,207 34,992 32.73
db file sequential read 3,297,249 17,047 15.94
buffer busy waits 1,558,995 3,987 3.73
CPU time 3,204 3.00
Statistic Total per Second per Trans
enqueue timeouts 299 0.0 0.0
enqueue waits 425 0.0 0.0
exchange deadlocks 41 0.0 0.0
execute count 7,438,297 516.6 7.3
failed probes on index block recl 13 0.0 0.0
free buffer inspected 107,385 7.5 0.1
free buffer requested 7,344,870 510.1 7.2
hot buffers moved to head of LRU 2,332,802 162.0 2.3
immediate (CR) block cleanout app 356,492 24.8 0.4
immediate (CURRENT) block cleanou 1,751,731 121.7 1.7
index crx upgrade (found) 7 0.0 0.0
index crx upgrade (positioned) 25,604 1.8 0.0
index fast full scans (full) 888 0.1 0.0
index fetch by key 6,008,269 417.3 5.9
index scans kdiixs1 2,343,163 162.7 2.3
leaf node 90-10 splits 330 0.0 0.0
leaf node splits 13,681 1.0 0.0
logons cumulative 447 0.0 0.0
messages received 2,760,503 191.7 2.7
messages sent 2,760,503 191.7 2.7
no buffer to keep pinned count 0 0.0 0.0
no work - consistent read gets 89,143,249 6,190.9 87.7
opened cursors cumulative 978,462 68.0 1.0
parse count (failures) 0 0.0 0.0
parse count (hard) 243 0.0 0.0
parse count (total) 977,939 67.9 1.0
parse time cpu 276 0.0 0.0
parse time elapsed 3,531 0.3 0.0
physical reads 6,710,684 466.1 6.6
physical reads direct 140,520 9.8 0.1
physical writes 1,924,011 133.6 1.9
physical writes direct 149,434 10.4 0.2
physical writes non checkpoint 1,160,293 80.6 1.1
pinned buffers inspected 88,165 6.1 0.1
prefetched blocks 2,965,135 205.9 2.9
prefetched blocks aged out before 1,485 0.1 0.0
process last non-idle time 14,401 1.0 0.0
recovery blocks read 0 0.0 0.0
recursive calls 22,566,381 1,567.2 22.2
recursive cpu usage 314,662 21.9 0.3
redo blocks written 9,712,190 674.5 9.6
redo buffer allocation retries 483 0.0 0.0
redo entries 17,147,344 1,190.9 16.9
redo log space requests 760 0.1 0.0
redo log space wait time 1,255 0.1 0.0
redo ordering marks 21 0.0 0.0
redo size 4,575,228,028 317,746.2 4,498.6
redo synch time 73,190 5.1 0.1
redo synch writes 333,440 23.2 0.3
redo wastage 240,517,096 16,703.7 236.5
redo write time 136,628 9.5 0.1
redo writer latching time 56 0.0 0.0
redo writes 865,653 60.1 0.9
rollback changes - undo records a 60,510 4.2 0.1
rows fetched via callback 3,948,006 274.2 3.9
session connect time 0 0.0 0.0
Statistic Total per Second per Trans
session logical reads 160,559,938 11,150.8 157.9
session pga memory 223,020,424 15,488.6 219.3
session pga memory max 841,058,240 58,410.9 827.0
session uga memory 682,912,005,944 47,427,738.5 671,472.1
session uga memory max 505,627,192 35,115.4 497.2
shared hash latch upgrades - no w 1,661,152 115.4 1.6
shared hash latch upgrades - wait 101 0.0 0.0
sorts (disk) 2 0.0 0.0
sorts (memory) 1,537,403 106.8 1.5
sorts (rows) 6,669,072 463.2 6.6
summed dirty queue length 71,613 5.0 0.1
switch current to new buffer 80,971 5.6 0.1
table fetch by rowid 79,047,167 5,489.8 77.7
table fetch continued row 5,013,545 348.2 4.9
table scan blocks gotten 10,328,271 717.3 10.2
table scan rows gotten 381,848,913 26,519.1 375.5
table scans (long tables) 82 0.0 0.0
table scans (short tables) 1,117,114 77.6 1.1
transaction rollbacks 32,437 2.3 0.0
transaction tables consistent rea 39 0.0 0.0
transaction tables consistent rea 82,904 5.8 0.1
user calls 1,186,828 82.4 1.2
user commits 1,017,037 70.6 1.0
user rollbacks 0 0.0 0.0
workarea executions - onepass 7 0.0 0.0
workarea executions - optimal 2,291,005 159.1 2.3
write clones created in backgroun 3 0.0 0.0
write clones created in foregroun 711 0.1 0.0
Class Waits Time (s) Time (ms)
data block 1,549,301 4,015 3
segment header 253 1 2
undo block 2,574 0 0
undo header 2,209 0 0
extent map 2 0 5
Eq Requests Succ Gets Failed Gets Waits Time (ms) Time (s)
TX 1,749,961 1,749,961 0 202 6.47 1
HW 20,789 20,789 0 223 .40 0
Pct Avg Wait Pct
Get Get Slps Time NoWait NoWait
Latch Requests Miss /Miss (s) Requests Miss
Consistent RBA 866,126 0.0 0.0 0 0
FIB s.o chain latch 594 0.0 0 0
FOB s.o list latch 2,891 0.0 0.0 0 0
SQL memory manager latch 4 0.0 0 4,793 0.0
SQL memory manager worka 3,266,221 0.0 0.0 0 0
active checkpoint queue 1,905,423 0.5 0.0 0 0
archive control 28 0.0 0 0
cache buffer handles 12,070 0.0 0 0
cache buffers chains 387,508,854 0.6 0.0 134 11,212,815 0.1
cache buffers lru chain 1,946,036 0.0 0.0 0 14,681,284 0.2
channel handle pool latc 668 0.0 0 0
channel operations paren 12,460 0.0 0.0 0 0
checkpoint queue latch 209,244,852 0.0 0.0 0 1,775,314 0.0
child cursor hash table 3,240 0.7 0.0 0 0
commit callback allocati 16 0.0 0 0
dictionary lookup 13 0.0 0 0
dml lock allocation 5,900,238 0.3 0.0 0 0
dummy allocation 894 0.2 0.0 0 0
enqueue hash chains 19,444,854 0.1 0.0 0 0
enqueues 9,380,299 0.7 0.0 0 0
event group latch 288 0.0 0 0
event range base latch 3 0.0 0 0
global tx hash mapping 4,988,645 0.0 0.0 0 0
hash table column usage 82 0.0 0 1,783 0.0
job workq parent latch 1 100.0 0.0 0 242 15.3
job_queue_processes para 287 0.0 0 0
ktm global data 265 0.0 0 0
lgwr LWN SCN 868,053 0.1 0.0 0 0
library cache 29,540,874 0.1 0.0 0 37 0.0
library cache load lock 102 0.0 0 0
library cache pin 24,145,848 0.0 0.0 0 0
library cache pin alloca 3,988,997 0.0 0.0 0 0
list of block allocation 363,684 0.0 0.0 0 0
loader state object free 912 0.0 0 0
longop free list parent 479 0.0 0 60 1.7
message pool operations 100 1.0 0.0 0 0
messages 8,036,523 0.3 0.0 0 0
mostly latch-free SCN 878,016 1.0 0.0 0 0
multiblock read objects 922,048 0.1 0.0 0 0
ncodef allocation latch 230 0.0 0 0
object stats modificatio 2,100 0.0 0 0
post/wait queue 709,603 0.0 0.0 0 334,338 0.0
process allocation 576 0.0 0 288 0.0
process group creation 576 0.2 0.0 0 0
redo allocation 18,881,467 0.7 0.0 0 0
redo copy 0 0 17,155,579 0.1
redo writing 4,513,716 0.2 0.0 0 0
resumable state object 48 0.0 0 0
row cache enqueue latch 3,556,148 0.1 0.0 0 0
row cache objects 6,671,783 0.1 0.0 0 0
Pct Avg Wait Pct
Get Get Slps Time NoWait NoWait
Latch Requests Miss /Miss (s) Requests Miss
sequence cache 1,533,482 0.0 0.0 0 0
session allocation 15,194,281 0.1 0.0 0 0
session idle bit 3,005,477 0.0 0.0 0 0
session switching 230 0.0 0 0
session timer 4,825 0.0 0 0
shared pool 2,114,153 0.0 0.0 0 0
sim partition latch 0 0 10,243 0.6
simulator hash latch 8,460,492 0.0 0.0 0 0
simulator lru latch 223,868 0.0 0.3 0 470,589 0.1
sort extent pool 1,823 0.5 0.0 0 0
temporary table state ob 16 0.0 0 0
transaction allocation 533,964 0.0 0 0
transaction branch alloc 1,259,723 0.1 0.0 0 0
undo global data 17,460,173 0.0 0.0 0 14,976 0.0
user lock 906 0.1 0.0 0 0
Get Spin &
Latch Name Requests Misses Sleeps Sleeps 1->4
cache buffers chains 387,508,854 2,447,832 12,701 2435135/1269
3/4/0/0
redo allocation 18,881,467 131,460 343 131118/341/1
/0/0
enqueues 9,380,299 62,436 122 62314/122/0/
0/0
library cache 29,540,874 38,344 80 38264/80/0/0
/0
messages 8,036,523 25,266 28 25238/28/0/0
/0
dml lock allocation 5,900,238 19,220 25 19195/25/0/0
/0
enqueue hash chains 19,444,854 10,510 27 10483/27/0/0
/0
active checkpoint queue la 1,905,423 9,896 36 9860/36/0/0/
0
library cache pin 24,145,848 8,451 17 8434/17/0/0/
0
mostly latch-free SCN 878,016 8,423 17 8406/17/0/0/
0
session allocation 15,194,281 8,290 33 8257/33/0/0/
0
redo writing 4,513,716 7,235 13 7222/13/0/0/
0
undo global data 17,460,173 4,113 8 4105/8/0/0/0
row cache objects 6,671,783 3,680 4 3676/4/0/0/0
row cache enqueue latch 3,556,148 2,015 1 2014/1/0/0/0
checkpoint queue latch 209,244,852 1,756 6 1750/6/0/0/0
transaction branch allocat 1,259,723 1,236 7 1229/7/0/0/0
shared pool 2,114,153 808 2 806/2/0/0/0
library cache pin allocati 3,988,997 649 1 648/1/0/0/0
cache buffers lru chain 1,946,036 588 13 575/13/0/0/0
multiblock read objects 922,048 469 8 461/8/0/0/0
sequence cache 1,533,482 333 1 332/1/0/0/0
session idle bit 3,005,477 97 1 96/1/0/0/0
Consistent RBA 866,126 55 1 54/1/0/0/0
simulator lru latch 223,868 33 9 24/9/0/0/0
post/wait queue 709,603 27 1 26/1/0/0/0
NoWait Waiter
Latch Name Where Misses Sleeps Sleeps
active checkpoint queue kcbbacq: scan active check 0 36 36
cache buffers chains kcbgtcr: kslbegin excl 0 10,706 10,084
cache buffers chains kcbrls: kslbegin 0 937 1,577
cache buffers chains kcbzwb 0 371 388
cache buffers chains kcbgtcr: fast path 0 223 174
cache buffers chains kcbgcur: kslbegin 0 86 114
cache buffers chains kcbget: pin buffer 0 57 47
cache buffers chains kcbzib: finish free bufs 0 54 27
cache buffers chains kcbchg: kslbegin: bufs not 0 52 89
cache buffers chains kcbnlc 0 46 37
cache buffers chains kcbzgb: scan from tail. no 0 42 0
cache buffers chains kcbzib: multi-block read: 0 25 0
cache buffers chains kcbget: exchange rls 0 12 3
cache buffers chains kcbchg: kslbegin: call CR 0 12 80
cache buffers chains kcbget: exchange 0 10 8
cache buffers chains kcbnew 0 9 0
cache buffers chains kcbcge 0 1 0
cache buffers chains kcbgtcr 0 1 0
cache buffers chains kcbbxsv 0 1 16
cache buffers chains kcbkzs 0 1 3
cache buffers chains kcbbic2 0 1 2
cache buffers chains kcbbic1 0 1 5
cache buffers lru chain kcbzgb: multiple sets nowa 10,344 10 0
cache buffers lru chain kcbbiop: lru scan 112 3 0
checkpoint queue latch kcbklbc: Link buffer into 0 6 0
dml lock allocation ktaiam 0 15 16
dml lock allocation ktaidm 0 10 9
enqueue hash chains ksqgtl3 0 17 11
enqueue hash chains ksqrcl 0 9 15
enqueue hash chains ksqcnl 0 1 1
enqueues ksqdel 0 60 50
enqueues ksqgel: create enqueue 0 60 56
enqueues ksqies 0 2 16
lgwr LWN SCN kcs023 0 9 0
library cache kglpnc: child 0 29 29
library cache kglupc: child 0 25 22
library cache kgllkdl: child: cleanup 0 11 2
library cache kglpndl: child: before pro 0 5 4
library cache kglhdgn: child: 0 3 13
library cache kglhdgc: child: 0 2 1
library cache kglpndl: child: after proc 0 2 0
library cache kgldte: child 0 0 1 2
library cache kglpin: child: heap proces 0 1 0
library cache kglobpn: child: 0 1 5
library cache pin kglpndl 0 6 1
library cache pin kglpnc: child 0 6 8
library cache pin kglupc 0 5 4
library cache pin alloca kglpnal 0 1 1
messages ksarcv 0 12 5
messages ksarcv: after wait 0 8 19
messages ksaamb: after wakeup 0 8 4
mostly latch-free SCN kcslcu3 0 8 17
mostly latch-free SCN kcsnew_scn_rba 0 1 0
Latch Name Where Misses Sleeps Sleeps
multiblock read objects kcbzib: mbr get 0 4 4
multiblock read objects kcbzib: normal mbr free 0 4 4
post/wait queue ksliwat:add:nowait 0 1 0
redo allocation kcrfwr 0 322 248
redo allocation kcrfwi: more space 0 14 88
redo allocation kcrfwi: before write 0 7 7
redo writing kcrfwcr 0 9 12
redo writing kcrfwint: rba scn pair 0 2 0
redo writing kcrfwint: after write 0 2 6
row cache enqueue latch kqreqa 0 1 1
row cache objects kqrpre: find obj 0 3 1
row cache objects kqrpfl: not dirty 0 1 1
sequence cache kdnss 0 1 1
session allocation ksuprc 0 14 5
session allocation ksudlc 0 10 7
session allocation ksucri 0 6 14
session allocation ksuxds: not user session 0 3 7
session idle bit ksupuc: clear busy 0 1 0
shared pool kghalo 0 1 0
shared pool kghupr1 0 1 2
simulator lru latch kcbs_simulate: simulate se 0 8 9
simulator lru latch kcbs_lookup_setid 0 1 0
transaction branch alloc ktcbba 0 4 2
transaction branch alloc ktcbod 0 2 3
transaction branch alloc ksupuc 0 1 2
undo global data ktudba: KSLBEGIN 0 8 7
Top 5 Logical Reads per Segment for DB: XXXXX Instance: XXXXX Snaps: 35980
-> End Segment Logical Reads Threshold: 10000
Subobject Obj. Logical
Owner Tablespace Object Name Name Type Reads %Total
xxxxxxxx XXXXXDATA TAB1TABLE TABLE 39,838,592 37.65
Top 5 Physical Reads per Segment for DB: XXXXX Instance: XXXXX Snaps: 3598
-> End Segment Physical Reads Threshold: 1000
Subobject Obj. Physical
Owner Tablespace Object Name Name Type Reads %Total
xxxxxxxx XXXXXDATA TAB1TABLE TABLE 3,568,038 58.64
Top 5 Buf. Busy Waits per Segment for DB: XXXXX Instance: XXXXX Snaps: 359
-> End Segment Buffer Busy Waits Threshold: 100
Buffer
Subobject Obj. Busy
Owner Tablespace Object Name Name Type Waits %Total
xxxxxxxx XXXXXDATA TAB1TABLE 1,421,043 91.65
xxxxxxxx XXXXXDATA IDX_SOMEIDX INDEX 62,638 4.04
xxxxxxxx XXXXXTABLE TABLE 26,914 1.74
----------So, for me It looks like :
TAB1TABLE is buffer busy deliver but there are no inserts reported for that table,
I've checked that TAB1TABLE tablespace is NO ASSM and extent management is local with uniform size 1M .
So this is not obvious free list problem . Kind of strange for me .
Any ideas greatly appreciated :).
Regards.
Greguser10388717 wrote:
Hi,
I've got statspack report from 9.2.0.8 DB, cpu_count = 12 , there is 'buffer busy waits' in top 5 .
Is there a problem ?
DB Name DB Id Instance Inst Num Release Cluster Host
XXXX 138180125 XXXX 1 9.2.0.8.0 NO X1
Snap Id Snap Time Sessions Curs/Sess Comment
Begin Snap: 35980 14-Jul-10 01:00:02 17 8.8
End Snap: 35984 14-Jul-10 05:00:01 17 8.8
Elapsed: 239.98 (mins)
----------So, for me It looks like :
TAB1TABLE is buffer busy deliver but there are no inserts reported for that table,
I've checked that TAB1TABLE tablespace is NO ASSM and extent management is local with uniform size 1M .
So this is not obvious free list problem . Kind of strange for me .
Any ideas greatly appreciated :).We can't tell if you have a problem - only you (or your users) can know.
But you've shown us a statspack snapshot covering 4 hours and in that time you've reported about 30 hours of database time (sum foreground "in-database" waits and CPU), with a fairly small number of sessions which (allowing for background sessions) means most of your foreground sessions seem to be working pretty much non-stop for the entire period. I could take a guess and say that you would like some of the work that they're doing completed sooner.
The largest fraction of your time goes into waiting for messages from db link, with an average time of 55ms - maybe you have a network problem, maybe you have a query that has a bad choice of execution path that is doing lots of unnecessary trips to the remote db, maybe the queries that get to the remote db could be made much more efficient. (Look for 'sql ordered by executions' in a statspack from the remote db for clues).
pl/sql lock timer is the next big chunk of time - but this is deliberately coded waits in pl/sql (dbms_lock.sleep) maybe that's supposed to be happening, but you could check the logic to see if some "slow" processes are actually coded to sleep much longer than necessary.
Your db file sequential reads (single block reads) are, on average taking 5.5 ms - which is reasonable, so you have to ask if the number (and we know which table a lot of them are hitting) is reasonable. This brings us to your buffer busy waits: these can be caused by updates and deletes as well as inserts, but in 9i they are also caused by "read by other session" - so the buffer busy wait may simple be one session waiting for another session to complete a db file sequential read.
I'd look at your "SQL ordered by Reads" to see if you have some inefficient execution plans (or poorly defined indexes) that result in large amounts of the critical table being constantly re-read. It's possible that you can eliminate redundant visits to this table and reduce your I/O, BBW, and CPU in one shot.
Regards
Jonathan Lewis -
USER I/O Wait (Please help kind of stuck here from long time)
I have a delete statement running from more than 24 hrs now and the session info says its waiting on user I/O. There are no blocking sessions and its doing a full table scan of a table having around 500000 records. I dont understand what exactly its waiting on and how to check that and why it taking more than 24 hrs to FTS of 1 table? Here are some of the statistics:
SQL> select blocking_session, event, wait_class, wait_time, seconds_in_wait, state from v$session where sid=1026;
BLOCKING_SESSION EVENT WAIT_CLASS WAIT_TIME SECONDS_IN_WAIT
STATE
db file scattered read User I/O 0 0
WAITING
SQL> select * from table(dbms_xplan.display_cursor('1g5k0k3qpy8j2'));
PLAN_TABLE_OUTPUT
SQL_ID 1g5k0k3qpy8j2, child number 0
DELETE FROM RX_TX WHERE ID IN (SELECT ID FROM TEMP_PURGE WHERE TABLE_NAME = 'rx_
tx')
Plan hash value: 3126475949
PLAN_TABLE_OUTPUT
| Id | Operation | Name | Rows | Bytes |TempSpc| Cost (%CPU)
| Time |
| 0 | DELETE STATEMENT | | | | | 17239 (100)
| |
| 1 | DELETE | RX_TX | | | |
| |
PLAN_TABLE_OUTPUT
|* 2 | HASH JOIN RIGHT SEMI| | 513K| 123M| 14M| 17239 (2)
| 00:03:27 |
|* 3 | TABLE ACCESS FULL | TEMP_PURGE | 557K| 8717K| | 2789 (2)
| 00:00:34 |
| 4 | TABLE ACCESS FULL | RX_TX | 578K| 130M| | 6918 (2)
| 00:01:24 |
PLAN_TABLE_OUTPUT
Predicate Information (identified by operation id):
2 - access("ID"="ID")
3 - filter("TABLE_NAME"='rx_tx')
22 rows selected.
SQL> select b.name, a.value from v$sesstat a, v$statname b
where a.statistic# = b.statistic#
and a.value > 0 2 3
4 and b.name like '%wait%'
5 and a.sid=1026;
NAME VALUE
concurrency wait time 1615
application wait time 388
user I/O wait time 13403000
enqueue waits 1
shared hash latch upgrades - no wait 7924935
redo log space wait time 2852
6 rows selected.
Any help would be appreciable.
This deletes more that 60% of the records from this table so indexed should be out of question here, i think.
Daljit Singh
Message was edited by:
DaljitThanks for replying Reega, here is the required
info:
SQL> select p1text, p1, p2text, p2, p3text, p3 from
v$session where sid=1026;
P1TEXT
1
P2TEXT
2
P3TEXT
3
file#
block#
16937
blocks
6
Actually Reega had a good point, not sure why he didn't go down the route.
You may want to find out what's that table/index your session is waiting from the value, something like
select owner||'.'||segment_name, segment_type
from dba_extents
where file_id=4 and (block_id between 116937 and 116937+66)This might be a long run query if you have many objects.
Actually the better view to query is v$session_wait instead of v$session.
Check article you might find useful,
Oracle wait tuning with v$session_wait -
Explanation Database Time Spent Waiting (%)
Dear DBA's
i would like to ask the meaning for this statements
*(Metrics "Database Time Spent Waiting (%)" is at 61.01392 for event class "Commit")*
*(Metrics "Database Time Spent Waiting (%)" is at 99.48281 for event class "Network")*
*(Metrics "Database Time Spent Waiting (%)" is at 48.36914 for event class "Other")*
i often get this error on my OEM alerts
could some one say me why this wait is happening and what should i do to resolve this time wait.
Thanks and regards
Raja...
Edited by: [email protected] on Apr 6, 2010 5:59 AMHi,
These are database waits for different reasons. Network waits could be due to excessive waits on due to slow network. Other waits can be for different reasons. Majority of the waits falling in the other catagory are idle waits.
Run AWR report on your database to find specific issues.
HTH -
Wait for MTTR advisory state object
Hello I am running a snapshot in 10g and the MMon slave process is waiting for the MTTR advisory for over 2hrs now. Does anyone know what the issue is?
If one takes the time to read the OP's question, you can see that he states the version: 10.1. Anyway, one can infer that the question is about 10g, since enq: WF - contention is a new 10g wait event.
But I'm curious about this event too. None of my Milsap or Lewis books mentions it, and neither does the excellent Shee/Deshpande/Gopalakrishnan. The event does not merit a mention on Metalink, nor can you find it in the 10g or 11g online docs.
According to the naming convention of other enqueue wait events, WF would be the type of lock that is being waited on. But I have never heard of a WF lock. What could it mean?
All I can find out about this event is that it has one parameter, name|mode.
I am seeing it in the context of running a SQL Tuning Set cursor cache capture operation. A quick cruise through DBA_HIST_SYSTEM_EVENT tells me that this event has (almost) never arisen before on my system.
This is my first experience with STS, which is why I'm curious about new things that come my way. Is this event causing a problem? I'm not sure. It has only been experiencing about 8 seconds of wait per 10 minute snapshot since I started running my STS capture. Nobody is complaining, yet. But as they say, Knowledge is power.
So does anyone have insight into this mysterious wait event?
Thanks. -
I have a computer Mac, and I enter in the module, so that it can unlock, but I cant not write does not accept letters, numbers or symbols, and asks me is waiting for root device, What can I do?....
Some more details will probably be required. The OS X version will help, as a start.
If you have the diagnostics DVD disk, boot that and see if there are any errors logged.
If this is OS X that's installed on a MacBook Air that you're using, then some of the usual triggers and approaches for resolving the still waiting for root device errors are discussed here. Have a look at that, and see if something in that sequence looks familiar, whether the PRAM reset or the safe boot helps or works here.
If there's any anti-malware, I/O accellerator, antivirus tools or similar installed, get rid of it. At least for testing.
There's a mention of "other OS" in your footer. If not OS X, what is the operating system in use here? If this is some other hardware or software involved, then the triggers for this error can vary. Widely. -
What is "resolving alias issue"
I have a Lacie HD connected to my TimeCapsule by USB, When I try to open it for the first time after awakening my IMAC it always says "resolving alias issues" waits a few seconds and then the HD appears on my desk top and all is well. What is going on behind the scenes?
Also what is a Sparsebundle?I wonder if it is because you have multiple mount points for the same drive?
If you have the HD currently mounted, eject it.
In the Finder go up to the Go menu and select "Go to Folder...".
Type in:
/Volumes
and click "Go".
Do you have any alias for the drive while it is NOT connected? If so, you should be able to delete them from here.
Now try the same thing after mounting the HD in question. Is there more than one alias to the HD while it is mounted? Perhaps "HD" and then "HD-1" and then "HD-2" etc? -
I have been running statspack regularly and need help in interpretation. I believe the database in question is running ok from user's point of view. However, we will be doubling the users in a few weeks and I am trying to be proactive about preparing for this. I have looked at the statspack reports and have sent them through oraperf.com, but I still have questions. Can anyone help? I can share a couple of statspack reports with specific questions. Thanks in advance, Kim
This is a good reference to interpret Statspack.
Perspective EXPERT ADVICE
Advanced Tuning with Statspack
By Rich Niemiec
But wait, there's more! What waits mean in Statspack reports and how to tune them out.
If you could choose just two Oracle utilities to find and monitor performance problems in your Oracle9i Database system, those two utilities would be Oracle Enterprise Manager (now available in Release 4.0) and Statspack. As of Oracle8i Release 8.1.6, the Statspack utility replaced the UTLBSTAT/UTLESTAT scripts available for performance monitoring with earlier versions of Oracle Database; Statspack offers several significant enhancements to those scripts. This column focuses on solutions to advanced issues regarding wait eventsthose events for which your system had to wait during processing for a resource to become available, an action to complete, and so on.
Top 5 Wait Events
When you are trying to eliminate bottlenecks on your system, your Statspack report's Top 5 Wait Events section is the first place to look. This section of the report shows the top 5 wait events, the full list of wait events, and the background wait events. If your system's TIMED_STATISTICS initialization parameter is set to true, the events are ordered in time waited, which is preferable, since all events don't show the waits. If TIMED_STATISTICS is false, the events are ordered by the number of waits.
Listing 1 shows a large number of waits related to reading a single block (db file sequential read) as well as waits for latches (latch free). You can see in this listing high waits for some of the writing to datafiles and log files. To identify which of these are major issues, you must narrow down the list by investigating the granular reports within other sections of Statspack.
Resolving Your Wait Events
The following are 10 of the most common causes for wait events, along with explanations and potential solutions:
1. DB File Scattered Read. This generally indicates waits related to full table scans. As full table scans are pulled into memory, they rarely fall into contiguous buffers but instead are scattered throughout the buffer cache. A large number here indicates that your table may have missing or suppressed indexes. Although it may be more efficient in your situation to perform a full table scan than an index scan, check to ensure that full table scans are necessary when you see these waits. Try to cache small tables to avoid reading them in over and over again, since a full table scan is put at the cold end of the LRU (Least Recently Used) list.
2. DB File Sequential Read. This event generally indicates a single block read (an index read, for example). A large number of waits here could indicate poor joining orders of tables, or unselective indexing. It is normal for this number to be large for a high-transaction, well-tuned system, but it can indicate problems in some circumstances. You should correlate this wait statistic with other known issues within the Statspack report, such as inefficient SQL. Check to ensure that index scans are necessary, and check join orders for multiple table joins. The DB_CACHE_SIZE will also be a determining factor in how often these waits show up. Problematic hash-area joins should show up in the PGA memory, but they're also memory hogs that could cause high wait numbers for sequential reads. They can also show up as direct path read/write waits.
3. Free Buffer. This indicates your system is waiting for a buffer in memory, because none is currently available. Waits in this category may indicate that you need to increase the DB_BUFFER_CACHE, if all your SQL is tuned. Free buffer waits could also indicate that unselective SQL is causing data to flood the buffer cache with index blocks, leaving none for this particular statement that is waiting for the system to process. This normally indicates that there is a substantial amount of DML (insert/update/delete) being done and that the Database Writer (DBWR) is not writing quickly enough; the buffer cache could be full of multiple versions of the same buffer, causing great inefficiency. To address this, you may want to consider accelerating incremental checkpointing, using more DBWR processes, or increasing the number of physical disks.
4. Buffer Busy. This is a wait for a buffer that is being used in an unshareable way or is being read into the buffer cache. Buffer busy waits should not be greater than 1 percent. Check the Buffer Wait Statistics section (or V$WAITSTAT) to find out if the wait is on a segment header. If this is the case, increase the freelist groups or increase the pctused to pctfree gap. If the wait is on an undo header, you can address this by adding rollback segments; if it's on an undo block, you need to reduce the data density on the table driving this consistent read or increase the DB_CACHE_SIZE. If the wait is on a data block, you can move data to another block to avoid this hot block, increase the freelists on the table, or use Locally Managed Tablespaces (LMTs). If it's on an index block, you should rebuild the index, partition the index, or use a reverse key index. To prevent buffer busy waits related to data blocks, you can also use a smaller block size: fewer records fall within a single block in this case, so it's not as "hot." When a DML (insert/update/ delete) occurs, Oracle Database writes information into the block, including all users who are "interested" in the state of the block (Interested Transaction List, ITL). To decrease waits in this area, you can increase the initrans, which will create the space in the block to allow multiple ITL slots. You can also increase the pctfree on the table where this block exists (this writes the ITL information up to the number specified by maxtrans, when there are not enough slots built with the initrans that is specified). Next Steps
READ MORE about Statspack
In "Performance Tuning with Statspack" on OTN
/deploy/performance/pdf/
statspack_tuning_otn_new.pdf
In Rich Niemiec's "Oracle Performance Tuning Tips and Techniques," available from Amazon.com
amazon.com/oracle
GET SUPPORT from MetaLink
oracle.com/support/metalink/index.html
GET EDUCATED on Oracle9i
/oramag/oracle/searchou.html
5. Latch Free. Latches are low-level queuing mechanisms (they're accurately referred to as mutual exclusion mechanisms) used to protect shared memory structures in the system global area (SGA). Latches are like locks on memory that are very quickly obtained and released. Latches are used to prevent concurrent access to a shared memory structure. If the latch is not available, a latch free miss is recorded. Most latch problems are related to the failure to use bind variables (library cache latch), redo generation issues (redo allocation latch), buffer cache contention issues (cache buffers LRU chain), and hot blocks in the buffer cache (cache buffers chain). There are also latch waits related to bugs; check MetaLink for bug reports if you suspect this is the case (oracle.com/support). When latch miss ratios are greater than 0.5 percent, you should investigate the issue. I will cover latch waits in detail in my next Oracle Magazine column; the topic requires an article in itself.
6. Enqueue. An enqueue is a lock that protects a shared resource. Locks protect shared resources, such as data in a record, to prevent two people from updating the same data at the same time. An enqueue includes a queuing mechanism, which is FIFO (first in, first out). Note that Oracle's latching mechanism is not FIFO. Enqueue waits usually point to the ST enqueue, the HW enqueue, the TX4 enqueue, and the TM enqueue. The ST enqueue is used for space management and allocation for dictionary-managed tablespaces. Use LMTs, or try to preallocate extents or at least make the next extent larger for problematic dictionary-managed tablespaces. HW enqueues are used with the high-water mark of a segment; manually allocating the extents can circumvent this wait. TX4s are the most common enqueue waits. TX4 enqueue waits are usually the result of one of three issues. The first issue is duplicates in a unique index; you need to commit/rollback to free the enqueue. The second is multiple updates to the same bitmap index fragment. Since a single bitmap fragment may contain multiple rowids, you need to issue a commit or rollback to free the enqueue when multiple users are trying to update the same fragment. The third and most likely issue is when multiple users are updating the same block. If there are no free ITL slots, a block-level lock could occur. You can easily avoid this scenario by increasing the initrans and/or maxtrans to allow multiple ITL slots and/or by increasing the pctfree on the table. Finally, TM enqueues occur during DML to prevent DDL to the affected object. If you have foreign keys, be sure to index them to avoid this general locking issue.
7. Log Buffer Space. This wait occurs because you are writing the log buffer faster than LGWR can write it to the redo logs, or because log switches are too slow. To address this problem, increase the size of the log files, or increase the size of the log buffer, or get faster disks to write to. You might even consider using solid-state disks, for their high speed.
8. Log File Switch. All commit requests are waiting for "logfile switch (archiving needed)" or "logfile switch (chkpt. Incomplete)." Ensure that the archive disk is not full or slow. DBWR may be too slow because of I/O. You may need to add more or larger redo logs, and you may potentially need to add database writers if the DBWR is the problem.
9. Log File Sync. When a user commits or rolls back data, the LGWR flushes the session's redo from the log buffer to the redo logs. The log file sync process must wait for this to successfully complete. To reduce wait events here, try to commit more records (try to commit a batch of 50 instead of one at a time, for example). Put redo logs on a faster disk, or alternate redo logs on different physical disks, to reduce the archiving effect on LGWR. Don't use RAID 5, since it is very slow for applications that write a lot; potentially consider using file system direct I/O or raw devices, which are very fast at writing information.
10. Idle Event. There are several idle wait events listed after the output; you can ignore them. Idle events are generally listed at the bottom of each section and include such things as SQL*Net message to/from client and other background-related timings. Idle events are listed in the stats$idle_event table.
Stay Tuned
In the next issue of Oracle Magazine, I'll investigate latchesanother of the top waits you may encounterlooking at the usual latch waits you'll see and how to tune them for maximum performance.
Rich Niemiec is the CEO of TUSC (www.tusc.com) and president of the International Oracle Users Group (www.ioug.org). Thanks to Steve Adams for editing help.
Wait Events Quick Reference Guide
Wait Problem Potential Fix
DB File Scattered Read Indicates many full table scans: tune the code; cache small tables.
DB File Sequential Read Indicates many index reads: tune the code (especially joins).
Free Buffer Increase the DB_CACHE_SIZE; shorten the checkpoint; tune the code.
Buffer Busy Segment header: add freelists or freelist groups.
Buffer Busy Data block: separate "hot" data; use reverse key indexes and/or smaller blocks.
Buffer Busy Data block: increase initrans and/or maxtrans.
Buffer Busy Undo header: add rollback segments or areas.
Buffer Busy Undo block: commit more often; use larger rollback segments or areas.
Latch Free Investigate the latch detail.
EnqueueST Use LMTs or preallocate large extents.
EnqueueHW Preallocate extents above high-water mark.
EnqueueTX4 Increase initrans and/or maxtrans on the table or index.
EnqueueTM Index foreign keys; check application locking of tables.
Log Buffer Space Increase the log buffer; use faster disks for the redo logs.
Log File Switch Archive destination slow or full; add more or larger redo logs.
Log File Sync Commit more records at a time; use faster redo log disks or raw devices.
Idle Event Ignore it.
Common Idle Events
Event Idle Event Type
Dispatcher timer Shared server
Lock manager wait for remote message Oracle9i Real Application Clusters
Pipe get User process
pmon timer Background process
PX Idle wait Parallel query
PX Deq Credit: need buffer Parallel query
PX Deq Credit: send blkd Parallel query
rdbms ipc message Background process
smon timer Background process
SQL*Net message from client User process
virtual Circuit status Shared server
http://otn.oracle.com/oramag/oracle/03-jan/o13expert.html
Joel Pérez
Maybe you are looking for
-
Refreshing the data in a flat file
Hi I am working on data integration. I need to fetch data from Oracle data base and then write it to a flat file. It is working fine now,but for the next fetch I don't need the old data to remain there in the file.The data should get refreshed and on
-
Screen Problem on macbook pro MD102
Hi , i 've got a macbook pro MD102 and i put my foot on it, i realized that fast, but my screen on the black color some area became less black, it's like some kind of pale, but there's no problem in any other thing , what can i do for it? ,
-
Pricing ..Very Critical....How to Map
Hey SAP Gurus... Could you all tell me how to configure the below requirement ...plz provide me the solution precisely..its critical need to resolve asap...plz help meeeeeeeeeeee.... Thanks in advance....Heres the requirement.... The Client has gone
-
I often copy video clips from the internet using Quicktime. The downloaded Clips play fine using QT Player or Preview, but when I drag the clips to IMovie to edit them for burning to a disk, there is no sound. The video plays fine in IMovie, but ther
-
Can't drag & click on the track pad of the macbook pro; what to do?
can't drag & click on the track pad of the macbook pro; what to do?