Buffer Exterminate Wait Event
Hello Experts,
In our database (10g/Solaris 9) the major wait event is "Buffer Exterminate". Ours is an OLTP database. We have set Auto SGA. As per metalink this wait event happens when Oracle tries to pull memory out of some pool and allocates it to something else. Even after increasing SGA_TARGET we are unable to get rid of it.
Can you please describe how to reduce this wait event? Should we go for manual SGA?
Regards,
Deepak
do you have oracle support and metalink access, if yes as mentioned in the link there are notes related to this wait and if they do not help you you may open a service request of course - https://metalink.oracle.com/metalink/plsql/f?p=130:14:10666479452361189216::::p14_database_id,p14_docid,p14_show_header,p14_show_help,p14_black_frame,p14_font:NOT,259137.1,1,1,1,helvetica
https://metalink.oracle.com/metalink/plsql/f?p=130:14:10666479452361189216::::p14_database_id,p14_docid,p14_show_header,p14_show_help,p14_black_frame,p14_font:NOT,429390.1,1,1,1,helvetica
best regards.
Similar Messages
-
Problem identifying db object for "buffer busy waits" event.
10.2.0.3
AIX 64
SELECT username, a.p1text, a.p1, a.p2text, a.p2, a.p3text, a.p3, event FROM v$session a WHERE
a.status='ACTIVE'
AND a.event = 'buffer busy waits'
Query reports about 40 active sessions with this information:
file# 3746
block# 2
class# 13
select
owner,
segment_name,
segment_type
from
dba_extents
where
file_id = 3746
and
2 between block_id and block_id + blocks -1;
no rows returned
SELECT MAX(a.file#) FROM sys.file$ a
3535
This was only a temporary situation when after couple of minutes(7) wait event "buffer busy waits" dissapeared completely.
Any ideas?
Thank you,
Daniel.http://perfvision.com/papers/06_buffer_cache.ppt
Slide 80-81 points at increasing the size of the initial and next extent for File Header Block buffer busy waits
Side 85 points at high extent allocation for File Header Block buffer busy waits
http://perfvision.com/ftp/hotsos/aas.ppt
Side 55 points at extent allocation too small/too many extents being allocated for File Header Block buffer busy waits
A couple hints from the documentation:
http://download.oracle.com/docs/cd/B19306_01/server.102/b14211/instance_tune.htm
"To determine the possible causes [of buffer busy waits], first query V$SESSION to identify the value of ROW_WAIT_OBJ# when the session waits for buffer busy waits."
"To identify the object and object type contended for, query DBA_OBJECTS using the value for ROW_WAIT_OBJ# that is returned from V$SESSION."
"V$SEGMENT_STATISTICS - This is a user-friendly view of statistic values. In addition to all the columns of V$SEGSTAT, it has information about such things as the segment owner and table space name. It makes the statistics easy to understand, but it is more costly."
You may want to query DBA_TEMP_FILES for the specific FILE_ID identified by the V$SESSION. Taking a look at V$SEGMENT_STATISTICS might also be helpful.
Are you using dictionary managed tablespaces, locally managed tablespaces with manual extent size management, ASSM with manual extent size management, or ASSM with automatic extent size management?
Charles Hooper
IT Manager/Oracle DBA
K&M Machine-Fabricating, Inc. -
CPU time & buffer busy waits events are causing performance degradation.
Oracle Version : - 11.2.0.2.0 Standard Edition
OS Platform :- Linux x86 64-bit
Edited by: 861928 on Aug 17, 2011 5:52 PMHi,
Please find the select query trace.
Edited by: 861928 on Aug 17, 2011 5:52 PM -
What is the difference between buffer busy waits and free buffer waits
what is the difference between buffer busy waits events and free buffer waits in Oracle database?
select *
from
v$system_event
where
event like ‘%wait%’;
EVENT TOTAL_WAITS TOTAL_TIMEOUTS TIME_WAITED AVERAGE_WAIT
buffer busy waits 636528 1557 549700 .863591232
write complete waits 1193 0 14799 12.4048617
free buffer waits 1601 0 622 .388507183jetq wrote:
Buffer busy waits occur when an Oracle session needs to access a block in the buffer cache, but cannot because the buffer copy of the data block is locked. This buffer busy wait condition can happen for either of the following reasons:
* The block is being read into the buffer by another session, so the waiting session must wait for the block read to complete. If the OP is running 10g, that would be recorded as "read by other session" not "buffer busy waits" - and unfortunately he didn't tell us the version.
* Another session has the buffer block locked in a mode that is incompatible with the waiting session's request.
The Free Buffer Waits Oracle metric wait event indicates that a server process was unable to find a free buffer and has posted the database writer to make free buffers by writing out dirty buffers.
There is another possibility - if the OP is using a keep and recycle pool: see http://jonathanlewis.wordpress.com/2006/11/21/free-buffer-waits/
Regards
Jonathan Lewis
http://jonathanlewis.wordpress.com
http://www.jlcomp.demon.co.uk
To post code, statspack/AWR report, execution plans or trace files, start and end the section with the tag {noformat}{noformat} (lowercase, curly brackets, no spaces) so that the text appears in fixed format.
"For every expert there is an equal and opposite expert"
Arthur C. Clarke -
Id column in gc buffer busy waits
Hello,
What's the id column show for gc buffer busy or gc current request waits.. I could not find any description for "gc current request". However, Here is what I found in oracle doc .. It's not so clear..
Parameter Description
file# See "file#" on page C-3
block# See "block#" on page C-2
id The buffer busy wait event is called from different places in the sessionThanksAny one??
-
Buffer busy waits and chained rows
Hi,
I've a db with many buffer busy waits events.
This is caused by the application that run on it and many tablespaces that are in MSSM.
Many tables suffers of chained rows.
My question is, may chained rows create further impact on buffer busy waits?
Thanks.HI Stefan,
> Caused by the application due to what? High amount of INSERTs or what? Insufficient MSSM settings by database object creation? Bad physical database design (e.g. > 255 columns, column types)?
Applications and jobs perform every 30s DELETE, UPDATE and INSERT. Tablespace are in Manual Segment Space Management, not in AUTO (i think wrong database design).
>It depends. Do you mean intra-block row chaining or row chaining across various blocks? What kind of access path? Do you really experience chained
rows and not migrated rows (it is mixed up a lot of times)?
Migrated rows, row chaining across various block, caused by frequently update and delete. Migrated resolved with alter table move or exp/imp.
Thank you -
Read by other session wait event
I have some reports in my database that whenever executed by two or more session these reports suffers with read by other session wait event. Tables which are involving in that's query i moves them to other tablespace and then move back to original tablespace. Some how this could solves read by other session wait event. But after some days these problem occur again.
How can i permanently solve this problem??
My db is Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - Prod
Oracle Block size 4096
ThanksHi there,
Searching for this wait eventin the docs gave this,
http://download.oracle.com/docs/cd/B19306_01/server.102/b14237/waitevents003.htm#sthref3159
read by other session
This event occurs when a session requests a buffer that is currently being read into the buffer cache by another session. Prior to release 10.1, waits for this event were grouped with the other reasons for waiting for buffers under the 'buffer busy wait' event
Wait Time: Time waited for the buffer to be read by the other session (in microseconds)And a quick google search for the same gave these results in the top.
http://www.confio.com/English/Tips/Read_By_Other_Session.php
http://www.dbafan.com/blog/?p=132
HTH
Aman.... -
Hi,
DB_VERSION=10.2.0.4
OS_VERSION=Windows 2003 server
We often ecountering "Pipe get buffer length " wait event.
SQL> @wait
SID EVENT SECS_WAIT STATE P1 P2 P3 WAIT_TIME P1TEXT
P2TEXT P3TEXT
148 pipe get 10 WAITING 1407483584 4096 86400000 0 handle address
buffer length timeout
157 SQL*Net message from client 0 WAITED SHORT TIME 1413697536 1 0 -1 driver id
#bytes
169 pipe get 8 WAITING 1408205168 4096 86400000 0 handle address
buffer length timeout
170 pipe get 9 WAITING 1378585472 4096 86400000 0 handle address
buffer length timeout
187 pipe get 9 WAITING 1378585816 4096 86400000 0 handle address
buffer length timeout How to handle this wait event ?Hi;
Is it rac or standalone?
Please check this search
Regard
Helios -
We have transaction stuck with this event at paticular index block# for long time.Even we tried to restart many times.Is that related to interconnect issue ?
Global Cache Buffer Busy wait is similar to 'Buffer Busy' wait in a single instance enviroment. When more than one process is looking for an current buffer (exclusive access) you may see this wait event. If you know what kind of block (i guess you already know), you can easily address the problem.
Also you had got some good inputs so far. You may want to consider partitioning the objects if you had not already done. Also investigate the reverse key indexes option.
-Gopal -
Difference between wait events 'buffer busy waits' & 'latch: CBC'
Hi ,
Can some one explain me the Difference Between 'Buffer Busy Waits' and 'Latch: Cache Buffers Chains"? What was explained in metalink note Doc ID: 833303.1
, is incomprehensible to me.
Looking for easy and better explanation.
Thanks
NaveenNaveen Sangam wrote:
Can some one explain me the Difference Between 'Buffer Busy Waits' and 'Latch: Cache Buffers Chains"? What was explained in metalink note Doc ID: 833303.1
, is incomprehensible to me.
That note is awful and should be witdrawn - amongst other things it makes it sound as if there is only one reason for buffer busy waits. There is an option to comment on such notes - I suggest you use it.
Going back a little further from Aman's description - and ignoring some of the internal details:
The buffer cache is split into a large number of small groups of buffered blocks; these groups are usually called "hash buckets" or "hash chains". If you need to find a block and it is buffered, Oracle can do some hashing arithmetic to work out which chain the block will be in.
The chains are protected by latches (typically a single latch protects 64 - 128 chains). You cannot examine a chain unless you are able to get the latch that protects it. So the commonest action you go through to view or modify a buffered block is:
<ul>
work out which chain
get the latch for the chain xxx
search along the chain to see if the block is in memory
attach a "pin" to the buffered block block if you find it (to make sure it can't be kicked out of memory)
release the latch
do what you want to do with the buffered block ***
get the latch for the chain xxx
remove the pin from the buffered block
release the latch
</ul>
The two points marked xxx are where you might end up sleeping in a wait for the "cache buffers chains latch". If too many people try to get the latch at the same time some of them will eventually fail and go to sleep for a short period.
The point marked *** is where you get the buffer busy wait. When you attach the pin to the buffered block it's possible that what you want to do to the bllock is incompatible with what other people are already doing - so you have to attach your pin to the "waiters" list (the people currently using the block will have their pins attached to the "users" list". Eventually your wait will time out, or the users will get out of the way and you can move your pin to the users list and do whatever it was you wanted to do.
Regards
Jonathan Lewis
http://jonathanlewis.wordpress.com
http://www.jlcomp.demon.co.uk
To post code, statspack/AWR report, execution plans or trace files, start and end the section with the tag {noformat}{noformat} (lowercase, curly brackets, no spaces) so that the text appears in fixed format.
"Science is more than a body of knowledge; it is a way of thinking"
Carl Sagan -
Oracle hang 大量的log file sync 和Buffer Exterminate
进程
select a.EVENT,count(*) from v$session a group by a.EVENT
1 log file sync 449
2 SQL*Net message from client 203
3 enq: TX - row lock contention 1
4 SQL*Net break/reset to client 1
5 row cache lock 1
6 rdbms ipc message 4
7 pmon timer 1
8 latch free 1
9 cleanup of aborted process 1
10 latch: redo writing 2
11 buffer exterminate 48
12 enq: PR - contention 2
13 enq: SQ - contention 35
14 Streams AQ: waiting for time management or cleanup tasks 5
帖子经 user10731836编辑过State of nodes
([nodenum]/cnode/sid/sess_srno/session/ospid/state/start/finish/[adjlist]/predecessor):
[0]/0/1/9438/0xdc7548b0/22169/NLEAF/1/4/[993]/none
[1]/0/2/56592/0xdf743dd0/23484/IGN_DMP/5/14/[1126]/none
[2]/0/3/42105/0xdc755ce8/24207/IGN/15/16/[1126]/none
[4]/0/5/4813/0xdc757120/25677/IGN_DMP/17/20/[429]/none
[5]/0/6/33840/0xdf746640/25783/IGN/21/22/[429]/none
[7]/0/8/33711/0xdf747a78/22599/IGN/23/24//none
[9]/0/10/3298/0xdf748eb0/22241/IGN/25/26//none
[12]/0/13/7575/0xdc75c200/25541/IGN/27/28/[429]/none
[13]/0/14/44594/0xdf74b720/25643/IGN/29/30/[429]/none
[14]/0/15/5377/0xdc75d638/23566/IGN/31/32/[1126]/none
[18]/0/19/36215/0xdc75fea8/25305/IGN/33/34/[429]/none
[19]/0/20/291/0xdf74f3c8/25339/IGN/35/36/[429]/none
[20]/0/21/62414/0xdc7612e0/22397/IGN/37/38//none
[21]/0/22/10832/0xdf750800/22637/IGN/39/40/[1126]/none
[23]/0/24/22403/0xdf751c38/25707/IGN/41/42/[429]/none
[25]/0/26/49869/0xdf753070/25418/IGN/43/44/[429]/none
[27]/0/28/43401/0xdf7544a8/22289/IGN/45/46//none
[29]/0/30/63602/0xdf7558e0/25509/IGN/47/48/[429]/none
[30]/0/31/44102/0xdc7677f8/22215/IGN/49/50//none
[31]/0/32/59135/0xdf756d18/23837/IGN/51/52/[1126]/none
[32]/0/33/13666/0xdc768c30/25333/IGN/53/54/[429]/none
[36]/0/37/23992/0xdc76b4a0/22209/IGN/55/56//none
[39]/0/40/11000/0xdf75bdf8/23891/IGN/57/58/[1126]/none
[40]/0/41/27214/0xdc76dd10/23975/IGN/59/60/[1126]/none
[42]/0/43/53314/0xdc76f148/25709/IGN/61/62/[429]/none
[45]/0/46/49651/0xdf75faa0/25737/IGN/63/64/[429]/none
[46]/0/47/42472/0xdc7719b8/25797/IGN/65/66/[429]/none
[49]/0/50/44503/0xdf762310/25087/IGN/67/68//none
[50]/0/51/19119/0xdc774228/22641/IGN_DMP/69/72/[549]/none
[51]/0/52/10012/0xdf763748/25813/IGN/73/74/[429]/none
[52]/0/53/26163/0xdc775660/23851/IGN/75/76//none
[53]/0/54/23519/0xdf764b80/25352/IGN/77/78/[429]/none
[54]/0/55/8911/0xdc776a98/22307/IGN/79/80//none
[58]/0/59/16077/0xdc779308/25565/IGN/81/82/[429]/none
[59]/0/60/47926/0xdf768828/25627/IGN/83/84/[429]/none
[60]/0/61/24262/0xdc77a740/25675/IGN/85/86/[429]/none
[64]/0/65/33671/0xdc77cfb0/22185/IGN/87/88/[1126]/none
[67]/0/68/28365/0xdf76d908/22601/IGN/89/90//none
[68]/0/69/13003/0xdc77f820/22549/IGN/91/92//none
[70]/0/71/5318/0xdc780c58/25639/IGN/93/94/[429]/none
[71]/0/72/26583/0xdf770178/25416/IGN/95/96/[429]/none
[72]/0/73/17584/0xdc782090/23362/IGN/97/98/[1126]/none
[76]/0/77/4123/0xdc784900/22325/IGN/99/100/[1126]/none
[77]/0/78/1857/0xdf773e20/23769/IGN/101/102//none
[79]/0/80/64588/0xdf775258/25711/IGN/103/104/[429]/none
[81]/0/82/373/0xdf776690/22249/IGN/105/106//none
[82]/0/83/20000/0xdc7885a8/22287/IGN/107/108/[549]/none
[84]/0/85/35408/0xdc7899e0/24505/IGN/109/110/[1126]/none
[85]/0/86/63617/0xdf778f00/22273/IGN/111/112//none
[86]/0/87/41142/0xdc78ae18/25285/SINGLE_NODE/113/114//none
[87]/0/88/1314/0xdf77a338/25803/IGN/115/116/[429]/none
[88]/0/89/22658/0xdc78c250/25095/IGN/117/118/[1126]/none
[89]/0/90/18817/0xdf77b770/24115/IGN/119/120/[1126]/none
[90]/0/91/37733/0xdc78d688/25681/IGN/121/122/[429]/none
[91]/0/92/8288/0xdf77cba8/25327/IGN/123/124/[429]/none
[93]/0/94/22259/0xdf77dfe0/23151/IGN/125/126/[1126]/none
[94]/0/95/43404/0xdc78fef8/25460/IGN/127/128/[429]/none
[95]/0/96/24277/0xdf77f418/22335/IGN/129/130/[1126]/none
[97]/0/98/5276/0xdf780850/25715/IGN/131/132/[429]/none
[98]/0/99/36896/0xdc792768/21873/IGN/133/134/[1126]/none
[100]/0/101/44196/0xdc793ba0/25619/IGN/135/136/[429]/none
[102]/0/103/60298/0xdc794fd8/25438/IGN/137/138/[429]/none
[103]/0/104/59238/0xdf7844f8/22225/IGN/139/140//none
[106]/0/107/44741/0xdc797848/22315/IGN/141/142//none
[107]/0/108/25523/0xdf786d68/23841/IGN/143/144/[1126]/none
[109]/0/110/30811/0xdf7881a0/25649/IGN/145/146/[429]/none
[111]/0/112/38952/0xdf7895d8/23561/IGN/147/148/[1126]/none
[112]/0/113/36048/0xdc79b4f0/25717/IGN/149/150/[429]/none
[113]/0/114/17864/0xdf78aa10/25380/IGN/151/152/[429]/none
[116]/0/117/63454/0xdc79dd60/22445/IGN/153/154//none
[117]/0/118/50482/0xdf78d280/25759/IGN/155/156/[429]/none
[119]/0/120/4493/0xdf78e6b8/25513/IGN/157/158/[429]/none
[120]/0/121/58635/0xdc7a05d0/24047/IGN/159/160/[1126]/none
[123]/0/124/3631/0xdf790f28/24213/IGN/161/162/[1126]/none
[127]/0/128/1031/0xdf793798/25749/IGN/163/164/[429]/none
[128]/0/129/60958/0xdc7a56b0/25821/IGN/165/166/[429]/none
[129]/0/130/54429/0xdf794bd0/22295/IGN/167/168//none
[130]/0/131/34304/0xdc7a6ae8/25713/IGN/169/170/[429]/none
[132]/0/133/55106/0xdc7a7f20/23596/IGN/171/172/[1126]/none
[133]/0/134/64234/0xdf797440/25362/IGN/173/174/[429]/none
[134]/0/135/4308/0xdc7a9358/23887/IGN/175/176//none
[135]/0/136/47850/0xdf798878/25398/IGN/177/178/[429]/none
[136]/0/137/9393/0xdc7aa790/25154/IGN/179/180/[1126]/none
[137]/0/138/46337/0xdf799cb0/22984/SINGLE_NODE/181/182//none
[140]/0/141/44709/0xdc7ad000/22117/IGN/183/184/[1126]/none
[141]/0/142/53618/0xdf79c520/25767/IGN/185/186/[429]/none
[142]/0/143/52925/0xdc7ae438/22275/IGN/187/188//none
[143]/0/144/49358/0xdf79d958/25659/IGN/189/190/[429]/none
[144]/0/145/20368/0xdc7af870/25468/IGN/191/192/[429]/none
[146]/0/147/17036/0xdc7b0ca8/22057/IGN/193/194/[1126]/none
[148]/0/149/57049/0xdc7b20e0/25297/IGN/195/196/[1126]/none
[149]/0/150/38466/0xdf7a1600/13729/SINGLE_NODE/197/198//none
[150]/0/151/48009/0xdc7b3518/23349/IGN/199/200/[1126]/none
[151]/0/152/7666/0xdf7a2a38/25563/IGN/201/202/[429]/none
[154]/0/155/7991/0xdc7b5d88/22199/IGN/203/204//none
[155]/0/156/37925/0xdf7a52a8/25313/IGN/205/206/[429]/none
[156]/0/157/864/0xdc7b71c0/24995/LEAF/207/208//163
[157]/0/158/13628/0xdf7a66e0/23883/IGN/209/210/[1126]/none
[158]/0/159/14300/0xdc7b85f8/25571/IGN/211/212/[429]/none
[159]/0/160/27016/0xdf7a7b18/25657/IGN/213/214/[429]/none
[161]/0/162/63060/0xdf7a8f50/22235/NLEAF/215/216/[993]/none
[163]/0/164/61480/0xdf7aa388/25089/NLEAF/217/218/[156]/none
[164]/0/165/10545/0xdc7bc2a0/23382/IGN/219/220/[1126]/none
[165]/0/166/55572/0xdf7ab7c0/24409/IGN/221/222/[1126]/none
[166]/0/167/22862/0xdc7bd6d8/22409/IGN/223/224//none
[168]/0/169/62001/0xdc7beb10/22976/IGN/225/226/[1126]/none
[170]/0/171/32561/0xdc7bff48/25583/IGN/227/228/[429]/none
[171]/0/172/14402/0xdf7af468/23775/IGN/229/230/[1126]/none
[172]/0/173/38158/0xdc7c1380/22447/IGN/231/232/[1126]/none
[173]/0/174/49829/0xdf7b08a0/24591/IGN/233/234/[1126]/none
[176]/0/177/27460/0xdc7c3bf0/25370/IGN/235/236/[429]/none
[177]/0/178/57900/0xdf7b3110/24527/IGN/237/238/[1126]/none
[178]/0/179/29624/0xdc7c5028/25501/IGN/239/240/[429]/none
[179]/0/180/52551/0xdf7b4548/22139/SINGLE_NODE/241/242//none
[180]/0/181/31071/0xdc7c6460/22265/NLEAF/243/244/[993]/none
[183]/0/184/5951/0xdf7b6db8/25390/IGN/245/246/[429]/none
[184]/0/185/31216/0xdc7c8cd0/24545/IGN/247/248/[1126]/none
[187]/0/188/52370/0xdf7b9628/25577/IGN/249/250/[429]/none
[190]/0/191/44844/0xdc7cc978/23903/IGN/251/252/[549]/none
[192]/0/193/6923/0xdc7cddb0/22297/IGN/253/254/[1126]/none
[193]/0/194/61128/0xdf7bd2d0/25481/IGN/255/256/[429]/none
[194]/0/195/62087/0xdc7cf1e8/23406/IGN/257/258//none
[195]/0/196/46671/0xdf7be708/25350/IGN/259/260/[429]/none
[196]/0/197/9913/0xdc7d0620/22137/IGN/261/262/[1126]/none
[198]/0/199/50992/0xdc7d1a58/23071/IGN/263/264//none
[204]/0/205/6204/0xdc7d5700/25609/IGN/265/266/[429]/none
[206]/0/207/25523/0xdc7d6b38/25755/IGN/267/268/[429]/none
[207]/0/208/26191/0xdf7c6058/22987/IGN/269/270//none
[208]/0/209/45813/0xdc7d7f70/22589/IGN/271/272/[549]/none
[209]/0/210/3985/0xdf7c7490/25366/IGN/273/274/[429]/none
[210]/0/211/39024/0xdc7d93a8/22189/IGN/275/276//none
[211]/0/212/58931/0xdf7c88c8/25479/IGN/277/278/[429]/none
[212]/0/213/31629/0xdc7da7e0/25505/IGN/279/280/[429]/none
[213]/0/214/36307/0xdf7c9d00/25691/IGN/281/282/[429]/none
[214]/0/215/54654/0xdc7dbc18/23454/IGN/283/284/[1126]/none
[215]/0/216/56991/0xdf7cb138/25651/IGN/285/286/[429]/none
[216]/0/217/13157/0xdc7dd050/25376/IGN/287/288/[429]/none
[217]/0/218/56210/0xdf7cc570/25456/IGN/289/290/[429]/none
[219]/0/220/16220/0xdf7cd9a8/24967/IGN/291/292/[1126]/none
[221]/0/222/5564/0xdf7cede0/25587/IGN/293/294/[429]/none
[222]/0/223/6252/0xdc7e0cf8/24005/IGN/295/296/[1126]/none
[223]/0/224/674/0xdf7d0218/24087/IGN/297/298/[1126]/none
[226]/0/227/34225/0xdc7e3568/25695/IGN/299/300/[429]/none
[227]/0/228/50250/0xdf7d2a88/22293/IGN/301/302/[1126]/none
[228]/0/229/2035/0xdc7e49a0/22631/NLEAF/303/306/[333]/none
[229]/0/230/42885/0xdf7d3ec0/24465/IGN/307/308/[1126]/none
[230]/0/231/56331/0xdc7e5dd8/22415/IGN/309/310//none
[231]/0/232/63376/0xdf7d52f8/23777/IGN/311/312/[1126]/none
[233]/0/234/6988/0xdf7d6730/22237/IGN/313/314/[549]/none
[234]/0/235/19888/0xdc7e8648/25331/IGN/315/316/[429]/none
[236]/0/237/11547/0xdc7e9a80/25761/IGN/317/318/[429]/none
[237]/0/238/29758/0xdf7d8fa0/22029/IGN/319/320/[1126]/none
[241]/0/242/2921/0xdf7db810/24993/IGN/321/322//none
[242]/0/243/3308/0xdc7ed728/23785/IGN/323/324/[1126]/none
[244]/0/245/41361/0xdc7eeb60/25739/IGN/325/326/[429]/none
[246]/0/247/39113/0xdc7eff98/25631/IGN/327/328/[429]/none
[248]/0/249/48404/0xdc7f13d0/23153/SINGLE_NODE/329/330//none
[249]/0/250/10325/0xdf7e08f0/25733/IGN/331/332/[429]/none
[251]/0/252/38421/0xdf7e1d28/23432/IGN/333/334/[1126]/none
[252]/0/253/26786/0xdc7f3c40/22365/IGN/335/336//none
[253]/0/254/25998/0xdf7e3160/23041/IGN/337/338/[1126]/none
[255]/0/256/30232/0xdf7e4598/22427/IGN/339/340//none
[257]/0/258/35051/0xdf7e59d0/22897/IGN/341/342/[1126]/none
[260]/0/261/62789/0xdc7f8d20/23580/IGN/343/344/[1126]/none
[262]/0/263/18420/0xdc7fa158/22603/NLEAF/345/346/[333]/none
[263]/0/264/49813/0xdf7e9678/25321/IGN/347/348/[429]/none
[264]/0/265/28824/0xdc7fb590/22607/IGN/349/350//none
[266]/0/267/22641/0xdc7fc9c8/22263/IGN/351/352//none
[267]/0/268/31020/0xdf7ebee8/25807/IGN/353/354/[429]/none
[268]/0/269/61295/0xdc7fde00/22281/IGN/355/356/[1126]/none
[269]/0/270/64886/0xdf7ed320/25743/IGN/357/358/[429]/none
[270]/0/271/30510/0xdc7ff238/25220/IGN/359/360/[1126]/none
[274]/0/275/46692/0xdc801aa8/25348/IGN/361/362/[429]/none
[278]/0/279/57449/0xdc804318/24963/IGN/363/364/[1126]/none
[279]/0/280/31255/0xdf7f3838/25613/IGN/365/366/[429]/none
[283]/0/284/63085/0xdf7f60a8/25791/IGN/367/368/[429]/none
[284]/0/285/52334/0xdc807fc0/25317/IGN/369/370/[429]/none
[285]/0/286/15414/0xdf7f74e0/22229/SINGLE_NODE/371/372//none
[286]/0/287/60364/0xdc8093f8/22609/IGN/373/374/[1126]/none
[287]/0/288/56766/0xdf7f8918/23781/IGN/375/376/[549]/none
[288]/0/289/10958/0xdc80a830/22255/IGN/377/378/[1126]/none
[293]/0/294/52270/0xdf7fc5c0/24259/IGN/379/380//none
[294]/0/295/25539/0xdc80e4d8/22269/IGN/381/382/[1126]/none
[295]/0/296/20563/0xdf7fd9f8/23965/IGN/383/384/[1126]/none
[296]/0/297/56200/0xdc80f910/22625/IGN/385/386//none
[301]/0/302/47342/0xdf8016a0/22207/NLEAF/387/388/[993]/none
[303]/0/304/12948/0xdf802ad8/22980/IGN/389/390/[1126]/none
[304]/0/305/6615/0xdc8149f0/22359/IGN/391/392//none
[306]/0/307/50369/0xdc815e28/25414/IGN/393/394/[429]/none
[307]/0/308/60233/0xdf805348/25579/IGN/395/396/[429]/none
[308]/0/309/47728/0xdc817260/22291/IGN/397/398//none
[310]/0/311/45365/0xdc818698/23843/IGN/399/400/[1126]/none
[313]/0/314/53023/0xdf808ff0/22309/IGN/401/402/[1126]/none
[314]/0/315/12306/0xdc81af08/25406/IGN/403/404/[429]/none
[315]/0/316/13758/0xdf80a428/22087/IGN/405/406/[1126]/none
[316]/0/317/42890/0xdc81c340/25647/IGN/407/408/[429]/none
[317]/0/318/967/0xdf80b860/22465/IGN/409/410//none
[319]/0/320/1484/0xdf80cc98/24113/IGN/411/412/[1126]/none
[323]/0/324/22398/0xdf80f508/22267/IGN/413/414//none
[324]/0/325/48541/0xdc821420/24391/IGN/415/416/[1126]/none
[327]/0/328/44022/0xdf811d78/24172/IGN/417/418/[1126]/none
[328]/0/329/29551/0xdc823c90/23626/IGN/419/420/[1126]/none
[331]/0/332/41718/0xdf8145e8/25763/IGN/421/422/[429]/none
[332]/0/333/46950/0xdc826500/24198/IGN/423/424/[1126]/none
[333]/0/334/12383/0xdf815a20/21947/LEAF/304/305//228
[335]/0/336/52495/0xdf816e58/25623/IGN/425/426/[429]/none
[336]/0/337/7686/0xdc828d70/25569/IGN/427/428/[429]/none
[337]/0/338/5517/0xdf818290/22972/SINGLE_NODE/429/430//none
[340]/0/341/63130/0xdc82b5e0/25703/IGN/431/432/[429]/none
[341]/0/342/13800/0xdf81ab00/22253/IGN/433/434/[1126]/none
[343]/0/344/40400/0xdf81bf38/25771/IGN/435/436/[429]/none
[345]/0/346/2766/0xdf81d370/22181/IGN/437/438//none
[346]/0/347/5979/0xdc82f288/25799/IGN/439/440/[429]/none
[349]/0/350/14553/0xdf81fbe0/22643/IGN/441/442//none
[351]/0/352/58307/0xdf821018/25021/IGN/443/444/[1126]/none
[354]/0/355/4873/0xdc834368/24652/IGN/445/446/[1126]/none
[355]/0/356/42316/0xdf823888/23271/IGN/447/448/[1126]/none
[356]/0/357/2005/0xdc8357a0/25811/IGN/449/450/[429]/none
[357]/0/358/30156/0xdf824cc0/25629/IGN/451/452/[429]/none
[359]/0/360/28770/0xdf8260f8/22387/IGN/453/454//none
[365]/0/366/55540/0xdf829da0/22223/SINGLE_NODE/455/456//none
[366]/0/367/9174/0xdc83bcb8/22647/IGN/457/458//none
[368]/0/369/9663/0xdc83d0f0/24929/IGN/459/460/[1126]/none
[370]/0/371/20903/0xdc83e528/25360/IGN/461/462/[429]/none
[371]/0/372/54285/0xdf82da48/25442/IGN/463/464/[429]/none
[372]/0/373/6710/0xdc83f960/23771/IGN/465/466/[1126]/none
[373]/0/374/37018/0xdf82ee80/25567/IGN/467/468/[429]/none
[375]/0/376/15229/0xdf8302b8/23456/IGN/469/470/[549]/none
[376]/0/377/58470/0xdc8421d0/25420/IGN/471/472/[429]/none
[377]/0/378/50505/0xdf8316f0/24135/IGN/473/474/[1126]/none
[380]/0/381/21465/0xdc844a40/25553/IGN/475/476/[429]/none
[383]/0/384/24601/0xdf835398/22617/IGN/477/478/[1126]/none
[384]/0/385/28104/0xdc8472b0/25777/IGN/479/480/[429]/none
[386]/0/387/64238/0xdc8486e8/25611/IGN/481/482/[429]/none
[387]/0/388/26680/0xdf837c08/22271/IGN/483/484//none
[390]/0/391/40342/0xdc84af58/25549/IGN/485/486/[429]/none
[392]/0/393/65412/0xdc84c390/25527/IGN/487/488/[429]/none
[393]/0/394/30187/0xdf83b8b0/24127/IGN/489/490/[1126]/none
[395]/0/396/42242/0xdf83cce8/22247/IGN/491/492//none
[397]/0/398/33574/0xdf83e120/23402/IGN/493/494/[549]/none
[398]/0/399/44546/0xdc850038/25729/IGN/495/496/[429]/none
[399]/0/400/33053/0xdf83f558/25372/IGN/497/498/[429]/none
[400]/0/401/62487/0xdc851470/23586/IGN/499/500/[549]/none
[402]/0/403/64374/0xdc8528a8/24585/IGN/501/502/[1126]/none
[404]/0/405/10583/0xdc853ce0/24188/IGN/503/504/[1126]/none
[406]/0/407/4624/0xdc855118/22333/IGN/505/506//none
[407]/0/408/51023/0xdf844638/25785/IGN/507/508/[429]/none
[410]/0/411/41112/0xdc857988/23670/IGN/509/510/[1126]/none
[413]/0/414/4731/0xdf8482e0/22699/LEAF/511/512//1030
[415]/0/416/42807/0xdf849718/23073/IGN/513/514/[1126]/none
[416]/0/417/6159/0xdc85b630/22417/IGN/515/516/[1126]/none
[417]/0/418/48258/0xdf84ab50/25625/IGN/517/518/[429]/none
[420]/0/421/60734/0xdc85dea0/22171/IGN/519/520/[549]/none
[422]/0/423/23571/0xdc85f2d8/22183/IGN/521/522//none
[423]/0/424/2576/0xdf84e7f8/25555/IGN/523/524/[429]/none
[425]/0/426/41714/0xdf84fc30/21979/LEAF/525/526//485
[427]/0/428/6860/0xdf851068/25621/IGN/527/528/[429]/none
[428]/0/429/4287/0xdc862f80/24245/IGN/529/530/[1126]/none
[429]/0/430/29293/0xdf8524a0/25301/LEAF/18/19//4
[430]/0/431/16152/0xdc8643b8/22085/IGN/531/532//none
[431]/0/432/62586/0xdf8538d8/23672/IGN/533/534/[549]/none
[432]/0/433/42224/0xdc8657f0/25561/IGN/535/536/[429]/none
[433]/0/434/3967/0xdf854d10/23358/IGN/537/538/[1126]/none
[434]/0/435/3206/0xdc866c28/25402/IGN/539/540/[429]/none
[436]/0/437/50814/0xdc868060/25450/IGN/541/542/[429]/none
[437]/0/438/41203/0xdf857580/22451/IGN/543/544/[549]/none
[438]/0/439/37196/0xdc869498/25341/IGN/545/546/[429]/none
[440]/0/441/24812/0xdc86a8d0/22329/IGN/547/548/[1126]/none
[441]/0/442/5053/0xdf859df0/25515/IGN/549/550/[429]/none
[442]/0/443/49748/0xdc86bd08/25511/IGN/551/552/[429]/none
[443]/0/444/9438/0xdf85b228/22319/IGN/553/554//none
[445]/0/446/34186/0xdf85c660/25557/IGN/555/556/[429]/none
[446]/0/447/46094/0xdc86e578/25585/SINGLE_NODE_NW/557/558//none
[447]/0/448/39677/0xdf85da98/25356/IGN/559/560/[429]/none
[448]/0/449/31278/0xdc86f9b0/24425/NLEAF/561/562/[1125]/none
[449]/0/450/6771/0xdf85eed0/22405/IGN/563/564/[549]/none
[450]/0/451/10200/0xdc870de8/24969/IGN/565/566/[1126]/none
[451]/0/452/43231/0xdf860308/22017/IGN/567/568//none
[453]/0/454/63527/0xdf861740/22493/IGN/569/570/[1126]/none
[455]/0/456/62090/0xdf862b78/25655/IGN/571/572/[429]/none
[456]/0/457/11522/0xdc874a90/23247/IGN/573/574/[1126]/none
[457]/0/458/40511/0xdf863fb0/25507/IGN/575/576/[429]/none
[459]/0/460/56836/0xdf8653e8/25428/IGN/577/578/[429]/none
[462]/0/463/24563/0xdc878738/23584/IGN/579/580//none
[463]/0/464/43142/0xdf867c58/23681/IGN/581/582/[1126]/none
[464]/0/465/10202/0xdc879b70/22217/IGN/583/584/[1126]/none
[465]/0/466/24277/0xdf869090/24322/IGN/585/586/[1126]/none
[466]/0/467/30867/0xdc87afa8/23464/IGN/587/588/[1126]/none
[467]/0/468/12185/0xdf86a4c8/22597/IGN/589/590//none
[468]/0/469/65261/0xdc87c3e0/23755/IGN/591/592/[1126]/none
[471]/0/472/22187/0xdf86cd38/31401/SINGLE_NODE/593/594//none
[473]/0/474/56402/0xdf86e170/23923/IGN/595/596/[1126]/none
[474]/0/475/6256/0xdc880088/23803/IGN/597/598/[1126]/none
[476]/0/477/1400/0xdc8814c0/25539/IGN/599/600/[429]/none
[477]/0/478/48776/0xdf8709e0/24117/IGN/601/602/[1126]/none
[478]/0/479/42209/0xdc8828f8/25495/IGN/603/604/[429]/none
[482]/0/483/54930/0xdc885168/25597/IGN/605/606/[429]/none
[483]/0/484/9924/0xdf874688/25765/IGN/607/608/[429]/none
[485]/0/486/38916/0xdf875ac0/25011/NLEAF/609/610/[425]/none
[486]/0/487/64182/0xdc8879d8/22285/NLEAF/611/612/[993]/none
[488]/0/489/37500/0xdc888e10/22455/IGN/613/614/[1126]/none
[490]/0/491/60366/0xdc88a248/26481/NLEAF/615/616/[1109]/none
[492]/0/493/12173/0xdc88b680/25523/IGN/617/618/[429]/none
[493]/0/494/18725/0xdf87aba0/23849/IGN/619/620//none
[494]/0/495/41411/0xdc88cab8/1501/SINGLE_NODE/621/622//none
[495]/0/496/14529/0xdf87bfd8/24961/IGN/623/624//none
[501]/0/502/34573/0xdf87fc80/22349/IGN/625/626/[1126]/none
[502]/0/503/43280/0xdc891b98/25757/IGN/627/628/[429]/none
[503]/0/504/17893/0xdf8810b8/24184/IGN/629/630//none
[504]/0/505/45648/0xdc892fd0/24704/IGN/631/632/[1126]/none
[505]/0/506/58393/0xdf8824f0/25545/IGN/633/634/[429]/none
[506]/0/507/57193/0xdc894408/25358/IGN/635/636/[429]/none
[507]/0/508/58469/0xdf883928/22431/IGN/637/638//none
[508]/0/509/37540/0xdc895840/25307/IGN/639/640/[429]/none
[509]/0/510/34695/0xdf884d60/25368/IGN/641/642/[429]/none
[511]/0/512/8793/0xdf886198/25667/IGN/643/644/[429]/none
[516]/0/517/19351/0xdc89a920/22655/IGN/645/646//none
[517]/0/518/65359/0xdf889e40/23480/IGN/647/648/[549]/none
[518]/0/519/47179/0xdc89bd58/23925/IGN/649/650/[1126]/none
[519]/0/520/7587/0xdf88b278/22195/IGN/651/652/[1126]/none
[520]/0/521/27465/0xdc89d190/25543/IGN/653/654/[429]/none
[522]/0/523/25387/0xdc89e5c8/25683/IGN/655/656/[429]/none
[525]/0/526/22891/0xdf88ef20/25705/IGN/657/658/[429]/none
[526]/0/527/44009/0xdc8a0e38/22345/IGN/659/660/[1126]/none
[528]/0/529/27389/0xdc8a2270/23474/IGN/661/662/[1126]/none
[529]/0/530/22591/0xdf891790/22361/IGN/663/664//none
[530]/0/531/3266/0xdc8a36a8/25685/IGN/665/666/[429]/none
[532]/0/533/9957/0xdc8a4ae0/22363/IGN/667/668/[1126]/none
[533]/0/534/18584/0xdf894000/23057/IGN/669/670/[1126]/none
[534]/0/535/60484/0xdc8a5f18/23026/IGN/671/672/[1126]/none
[535]/0/536/23022/0xdf895438/23559/IGN/673/674/[1126]/none
[536]/0/537/29515/0xdc8a7350/22517/IGN/675/676//none
[540]/0/541/790/0xdc8a9bc0/24429/IGN/677/678/[1126]/none
[541]/0/542/50532/0xdf8990e0/25573/IGN/679/680/[429]/none
[542]/0/543/63968/0xdc8aaff8/24423/IGN/681/682/[1126]/none
[543]/0/544/58537/0xdf89a518/25303/IGN/683/684/[429]/none
[544]/0/545/58442/0xdc8ac430/23576/IGN/685/686/[549]/none
[545]/0/546/4571/0xdf89b950/25781/IGN/687/688/[429]/none
[546]/0/547/15390/0xdc8ad868/24463/IGN/689/690/[1126]/none
[547]/0/548/43877/0xdf89cd88/25503/IGN/691/692/[429]/none
[549]/0/550/50928/0xdf89e1c0/22613/LEAF/70/71//50
[550]/0/551/2367/0xdc8b00d8/23404/IGN/693/694/[1126]/none
[551]/0/552/57593/0xdf89f5f8/22425/IGN/695/696//none
[552]/0/553/52695/0xdc8b1510/23592/IGN/697/698/[1126]/none
[553]/0/554/59366/0xdf8a0a30/25551/IGN/699/700/[429]/none
[554]/0/555/42007/0xdc8b2948/24535/IGN/701/702/[1126]/none
[555]/0/556/14080/0xdf8a1e68/24125/IGN/703/704/[1126]/none
[557]/0/558/19112/0xdf8a32a0/25595/IGN/705/706/[429]/none
[558]/0/559/29629/0xdc8b51b8/25452/IGN/707/708/[429]/none
[563]/0/564/22498/0xdf8a6f48/22583/IGN/709/710//none
[564]/0/565/47830/0xdc8b8e60/23508/IGN/711/712/[549]/none
[568]/0/569/43575/0xdc8bb6d0/25525/IGN/713/714/[429]/none
[569]/0/570/20157/0xdf8aabf0/25392/IGN/715/716/[429]/none
[571]/0/572/16616/0xdf8ac028/24951/IGN/717/718/[1126]/none
[572]/0/573/21266/0xdc8bdf40/25378/IGN/719/720/[429]/none
[573]/0/574/26283/0xdf8ad460/25519/IGN/721/722/[429]/none
[575]/0/576/52181/0xdf8ae898/25422/IGN/723/724/[429]/none
[577]/0/578/23325/0xdf8afcd0/25396/IGN/725/726/[429]/none
[578]/0/579/57294/0xdc8c1be8/25440/IGN/727/728/[429]/none
[579]/0/580/56788/0xdf8b1108/23574/IGN/729/730/[1126]/none
[581]/0/582/31176/0xdf8b2540/25823/IGN/731/732/[429]/none
[582]/0/583/12699/0xdc8c4458/22379/IGN/733/734/[549]/none
[583]/0/584/24351/0xdf8b3978/22177/IGN/735/736/[1126]/none
[584]/0/585/47609/0xdc8c5890/25719/IGN/737/738/[429]/none
[586]/0/587/33247/0xdc8c6cc8/22635/IGN/739/740//none
[587]/0/588/65244/0xdf8b61e8/22691/SINGLE_NODE/741/742//none
[588]/0/589/15851/0xdc8c8100/25747/IGN/743/744/[429]/none
[589]/0/590/21695/0xdf8b7620/25615/IGN/745/746/[429]/none
[590]/0/591/25236/0xdc8c9538/24233/IGN/747/748/[1126]/none
[591]/0/592/2527/0xdf8b8a58/23523/IGN/749/750/[549]/none
[592]/0/593/30632/0xdc8ca970/22459/IGN/751/752//none
[593]/0/594/38855/0xdf8b9e90/24296/IGN/753/754/[1126]/none
[594]/0/595/27310/0xdc8cbda8/25412/IGN/755/756/[429]/none
[596]/0/597/33147/0xdc8cd1e0/25529/IGN/757/758/[429]/none
[598]/0/599/35259/0xdc8ce618/23765/IGN/759/760/[1126]/none
[599]/0/600/58734/0xdf8bdb38/25410/IGN/761/762/[429]/none
[601]/0/602/48180/0xdf8bef70/23374/IGN/763/764/[1126]/none
[602]/0/603/1594/0xdc8d0e88/23149/SINGLE_NODE/765/766//none
[604]/0/605/37933/0xdc8d22c0/25727/IGN/767/768/[429]/none
[605]/0/606/34721/0xdf8c17e0/25593/IGN/769/770/[429]/none
[606]/0/607/32545/0xdc8d36f8/25661/IGN/771/772/[429]/none
[607]/0/608/11008/0xdf8c2c18/23845/IGN/773/774/[549]/none
[608]/0/609/32175/0xdc8d4b30/23067/IGN/775/776/[1126]/none
[609]/0/610/63937/0xdf8c4050/23679/IGN/777/778//none
[610]/0/611/39737/0xdc8d5f68/22355/IGN/779/780//none
[612]/0/613/53286/0xdc8d73a0/23472/IGN/781/782/[1126]/none
[619]/0/620/62657/0xdf8ca568/25483/IGN/783/784/[429]/none
[620]/0/621/38959/0xdc8dc480/24215/IGN/785/786/[1126]/none
[621]/0/622/43399/0xdf8cb9a0/25789/IGN/787/788/[429]/none
[624]/0/625/30691/0xdc8decf0/23875/IGN/789/790/[549]/none
[625]/0/626/62481/0xdf8ce210/23468/IGN/791/792/[1126]/none
[626]/0/627/15540/0xdc8e0128/24696/IGN/793/794/[1126]/none
[627]/0/628/45341/0xdf8cf648/25735/IGN/795/796/[429]/none
[629]/0/630/44001/0xdf8d0a80/22357/IGN/797/798/[1126]/none
[630]/0/631/61741/0xdc8e2998/25472/IGN/799/800/[429]/none
[632]/0/633/1602/0xdc8e3dd0/25603/IGN/801/802/[429]/none
[633]/0/634/39418/0xdf8d32f0/22205/IGN/803/804//none
[635]/0/636/35135/0xdf8d4728/23758/IGN/805/806/[1126]/none
[636]/0/637/53626/0xdc8e6640/25773/IGN/807/808/[429]/none
[637]/0/638/18916/0xdf8d5b60/22937/IGN/809/810/[1126]/none
[640]/0/641/40678/0xdc8e8eb0/22453/IGN/811/812//none
[641]/0/642/18143/0xdf8d83d0/23582/IGN/813/814/[1126]/none
[642]/0/643/32220/0xdc8ea2e8/22523/IGN/815/816/[1126]/none
[644]/0/645/40645/0xdc8eb720/22337/IGN/817/818/[1126]/none
[645]/0/646/18042/0xdf8dac40/22323/IGN/819/820//none
[646]/0/647/58579/0xdc8ecb58/23235/IGN/821/822/[1126]/none
[648]/0/649/29918/0xdc8edf90/22645/IGN/823/824/[1126]/none
[649]/0/650/40129/0xdf8dd4b0/25663/IGN/825/826/[429]/none
[650]/0/651/3205/0xdc8ef3c8/25426/IGN/827/828/[429]/none
[651]/0/652/58160/0xdf8de8e8/25671/IGN/829/830/[429]/none
[652]/0/653/42901/0xdc8f0800/22615/IGN/831/832//none
[654]/0/655/7732/0xdc8f1c38/25769/IGN/833/834/[429]/none
[656]/0/657/31700/0xdc8f3070/25448/IGN/835/836/[429]/none
[657]/0/658/19437/0xdf8e2590/25605/IGN/837/838/[429]/none
[661]/0/662/7463/0xdf8e4e00/22239/IGN/839/840//none
[663]/0/664/14145/0xdf8e6238/25591/IGN/841/842/[429]/none
[664]/0/665/59571/0xdc8f8150/22777/IGN/843/844/[1126]/none
[665]/0/666/20531/0xdf8e7670/25140/IGN/845/846/[1126]/none
[666]/0/667/39877/0xdc8f9588/22377/IGN/847/848/[1126]/none
[668]/0/669/9961/0xdc8fa9c0/25408/IGN/849/850/[429]/none
[670]/0/671/37236/0xdc8fbdf8/22385/IGN/851/852/[1126]/none
[671]/0/672/26355/0xdf8eb318/25795/IGN/853/854/[429]/none
[672]/0/673/24062/0xdc8fd230/25382/IGN/855/856/[429]/none
[673]/0/674/60469/0xdf8ec750/23763/IGN/857/858/[1126]/none
[674]/0/675/18144/0xdc8fe668/24754/IGN/859/860/[1126]/none
[676]/0/677/41976/0xdc8ffaa0/3473/IGN/861/862/[1126]/none
[677]/0/678/38276/0xdf8eefc0/22371/IGN/863/864//none
[678]/0/679/13010/0xdc900ed8/22469/IGN/865/866//none
[680]/0/681/16959/0xdc902310/23905/IGN/867/868/[549]/none
[682]/0/683/30989/0xdc903748/23069/IGN/869/870/[1126]/none
[683]/0/684/56317/0xdf8f2c68/24461/IGN/871/872/[1126]/none
[685]/0/686/65266/0xdf8f40a0/22213/IGN/873/874//none
[686]/0/687/4053/0xdc905fb8/24625/IGN/875/876/[1126]/none
[688]/0/689/20206/0xdc9073f0/21955/IGN/877/878/[1126]/none
[689]/0/690/18230/0xdf8f6910/24251/IGN/879/880//none
[691]/0/692/60201/0xdf8f7d48/23674/IGN/881/882/[1126]/none
[692]/0/693/27191/0xdc909c60/22627/IGN/883/884//none
[693]/0/694/10093/0xdf8f9180/24889/IGN/885/886/[1126]/none
[695]/0/696/36166/0xdf8fa5b8/24211/IGN/887/888/[1126]/none
[696]/0/697/19706/0xdc90c4d0/23307/IGN/889/890/[1126]/none
[698]/0/699/24174/0xdc90d908/23767/IGN/891/892//none
[701]/0/702/18231/0xdf8fe260/25444/IGN/893/894/[429]/none
[705]/0/706/6864/0xdf900ad0/23394/IGN/895/896/[1126]/none
[708]/0/709/46956/0xdc913e20/25234/IGN/897/898/[1126]/none
[709]/0/710/16404/0xdf903340/23636/IGN/899/900/[1126]/none
[710]/0/711/61105/0xdc915258/25335/IGN/901/902/[429]/none
[711]/0/712/59433/0xdf904778/23578/IGN/903/904/[1126]/none
[714]/0/715/33216/0xdc917ac8/25701/IGN/905/906/[429]/none
[716]/0/717/54780/0xdc918f00/23337/SINGLE_NODE/907/908//none
[717]/0/718/38356/0xdf908420/25374/IGN/909/910/[429]/none
[718]/0/719/19438/0xdc91a338/25665/IGN/911/912/[429]/none
[719]/0/720/17453/0xdf909858/24279/IGN/913/914//none
[721]/0/722/56764/0xdf90ac90/25689/IGN/915/916/[429]/none
[723]/0/724/38932/0xdf90c0c8/25673/IGN/917/918/[429]/none -
My wait events - can anyone see a problem?
hi,
this is what i have, can anyone see a problem?
thanks
EVENT TOTAL_WAITS PCT_WAITS TIME_WAIT_SEC PCT_TIME_WAITED TOTAL_TIMEOUTS PCT_TIMEOUTS AVERAGE_WAIT_SEC
Streams AQ: qmn slave idle wait 148147 .3 4051461.88 38.04 3478 .07 27.35
Streams AQ: qmn coordinator idle wa 291006 .59 3962890.53 37.21 148370 3.13 13.62
it
Streams AQ: waiting for time manage 948 0 2021434.2 18.98 948 .02 2132.31
ment or cleanup tasks
control file parallel write 1292057 2.64 266839.64 2.51 0 0 .21
log file parallel write 28433394 58.02 134658.55 1.26 0 0 0
db file sequential read 8307195 16.95 69830.07 .66 0 0 .01
free buffer waits 3117839 6.36 43374.04 .41 3106093 65.55 .01
log buffer space 55520 .11 20810.2 .2 20235 .43 .37
db file scattered read 583604 1.19 18169.58 .17 0 0 .03
write complete waits 17946 .04 17536.66 .16 17941 .38 .98
log file sync 282268 .58 10005.35 .09 9369 .2 .04
enq: RO - fast object reuse 26602 .05 6623.44 .06 2171 .05 .25
enq: CF - contention 1839 0 5178.14 .05 1723 .04 2.82
Streams AQ: qmn coordinator waiting 999 0 4311.01 .04 883 .02 4.32
for slave to start
buffer busy waits 32464 .07 3898.51 .04 3950 .08 .12
control file sequential read 2199199 4.49 3558.34 .03 0 0 0
SGA: MMAN sleep for component shrin 234330 .48 2523.65 .02 234216 4.94 .01
k
buffer exterminate 1583 0 1539.72 .01 1573 .03 .97
library cache pin 317 0 927.71 .01 316 .01 2.93
enq: CI - contention 1829 0 570.84 .01 159 0 .31
log file switch completion 1658 0 517.18 0 425 .01 .31
enq: TX - row lock contention 257 0 438.8 0 149 0 1.71
read by other session 27269 .06 355.17 0 52 0 .01
os thread startup 3869 .01 338.67 0 98 0 .09
latch: shared pool 760 0 285.87 0 0 0 .38
latch: row cache objects 664 0 250 0 0 0 .38
Data file init write 16324 .03 231.59 0 0 0 .01
reliable message 19189 .04 218.16 0 170 0 .01
latch: library cache 483 0 172.51 0 0 0 .36
SQL*Net message from dblink 1143086 2.33 128.69 0 0 0 0
latch free 6091 .01 121.1 0 0 0 .02
library cache load lock 90 0 89.48 0 18 0 .99
log file single write 1894 0 69.76 0 0 0 .04
cursor: pin S wait on X 5183 .01 55.87 0 5165 .11 .01
local write wait 6732 .01 42.58 0 2 0 .01
log file switch (checkpoint incompl 95 0 42.11 0 30 0 .44
ete)
row cache lock 119 0 30.96 0 10 0 .26
SQL*Net more data from dblink 17198 .04 25.92 0 0 0 0
log file switch (private strand flu 69 0 17.54 0 5 0 .25
sh incomplete)
enq: HW - contention 180 0 16.53 0 5 0 .09
enq: PR - contention 9 0 14.5 0 2 0 1.61
enq: JS - queue lock 51 0 12.36 0 0 0 .24
SQL*Net more data to client 48311 .1 11.66 0 0 0 0
enq: TM - contention 12 0 10.66 0 3 0 .89
class slave wait 3128 .01 7.03 0 1 0 0
JS coord start wait 68 0 6.42 0 68 0 .09
direct path write 92712 .19 6.06 0 0 0 0
control file heartbeat 1 0 3.91 0 1 0 3.91
PX Deq: Par Recov Execute 100 0 3.8 0 0 0 .04
log file sequential read 1900 0 2.88 0 0 0 0
single-task message 50 0 2.61 0 0 0 .05
enq: TX - contention 11 0 2.38 0 0 0 .22
undo segment extension 1181001 2.41 1.95 0 1180981 24.92 0
db file single write 165 0 1.3 0 0 0 .01
enq: TX - index contention 97 0 1.27 0 0 0 .01
LGWR wait for redo copy 20840 .04 .66 0 0 0 0
JS kgl get object wait 8 0 .63 0 8 0 .08
SQL*Net message to dblink 1143086 2.33 .55 0 0 0 0
kksfbc child completion 14 0 .55 0 11 0 .04
direct path read temp 217237 .44 .41 0 0 0 0
latch: cache buffers chains 2138 0 .37 0 0 0 0
latch: messages 1245 0 .27 0 0 0 0
latch: redo writing 786 0 .15 0 0 0 0
PX Deq: Par Recov Reply 65 0 .09 0 0 0 0
latch: checkpoint queue latch 171 0 .09 0 0 0 0
latch: redo allocation 1029 0 .08 0 0 0 0
latch: cache buffers lru chain 268 0 .07 0 0 0 0
SGA: allocation forcing component g 5 0 .05 0 2 0 .01
rowth
db file parallel read 83 0 .04 0 0 0 0
latch: In memory undo latch 558 0 .04 0 0 0 0
latch: object queue header operatio 338 0 .04 0 0 0 0
n
direct path read 5042 .01 .03 0 0 0 0
PX Deque wait 7 0 .02 0 0 0 0
direct path write temp 4691 .01 .02 0 0 0 0
enq: SQ - contention 1 0 .02 0 0 0 .02
latch: session allocation 190 0 .02 0 0 0 0
PX Deq: Join ACK 15 0 .01 0 0 0 0
cursor: pin S 894 0 .01 0 0 0 0
enq: TX - allocate ITL entry 37 0 .01 0 0 0 0
kkdlgon 15 0 .01 0 0 0 0
latch: enqueue hash chains 37 0 .01 0 0 0 0
library cache lock 1 0 .01 0 0 0 .01
Log archive I/O 1 0 0 0 0 0 0
PX Deq: Par Recov Change Vector 2 0 0 0 0 0 0
PX Deq: Signal ACK 3 0 0 0 0 0 0
PX Deq: Test for msg 1 0 0 0 0 0 0
PX qref latch 1 0 0 0 1 0 0
SQL*Net break/reset to dblink 5 0 0 0 0 0 0
SQL*Net more data to dblink 1 0 0 0 0 0 0
buffer deadlock 27 0 0 0 27 0 0
checkpoint completed 4 0 0 0 0 0 0
cursor: mutex S 3 0 0 0 0 0 0
cursor: mutex X 1 0 0 0 0 0 0
enq: JS - q mem clnup lck 1 0 0 0 0 0 0
enq: PS - contention 2 0 0 0 0 0 0
enq: US - contention 1 0 0 0 0 0 0
instance state change 2 0 0 0 0 0 0
latch: library cache lock 4 0 0 0 0 0 0
latch: library cache pin 1 0 0 0 0 0 0
latch: object queue header heap 8 0 0 0 0 0 0
latch: undo global data 3 0 0 0 0 0 0
recovery read 39 0 0 0 0 0 0Hi,
If its for a week than I won't bother. Probably you should try to get teh same report for these wait events in a much smaller period , like 20-30minutes of time period when your db is fully operational. If still at that time the wait events,these or any other, shoot up to high wait times, things can be investigated more deeply.
HTH
Aman.... -
Hi,
Version : Oracle 9i
I am getting buffer busy waits on some tables. Will increase in inittrans & pctfree of those tables reduce buffer busy waits?
Tablespace is having segment space mgmt auto & extent management local.
cursor_sharing is similar.
Users are not experiencing any problem.Is there any problem other than this in statspack report?
STATSPACK report for
DB Name DB Id Instance Inst Num Release Cluster Host
AHD 3712247982 ahd 1 9.2.0.1.0 NO SBGSDPRI
Snap Id Snap Time Sessions Curs/Sess Comment
Begin Snap: 20 13-Feb-07 14:48:35 33 9.9
End Snap: 21 13-Feb-07 15:12:19 34 10.4
Elapsed: 23.73 (mins)
Cache Sizes (end)
~~~~~~~~~~~~~~~~~
Buffer Cache: 656M Std Block Size: 8K
Shared Pool Size: 152M Log Buffer: 768K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 5,960.83 2,761.29
Logical reads: 2,376.85 1,101.05
Block changes: 35.48 16.44
Physical reads: 97.56 45.20
Physical writes: 1.15 0.53
User calls: 92.63 42.91
Parses: 20.00 9.27
Hard parses: 0.29 0.13
Sorts: 4.80 2.22
Logons: 0.01 0.00
Executes: 23.14 10.72
Transactions: 2.16
% Blocks changed per Read: 1.49 Recursive Call %: 14.69
Rollback per transaction %: 0.00 Rows per Sort: 472.64
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 99.65 Redo NoWait %: 100.00
Buffer Hit %: 95.90 In-memory Sort %: 100.00
Library Hit %: 99.15 Soft Parse %: 98.55
Execute to Parse %: 13.57 Latch Hit %: 99.70
Parse CPU to Parse Elapsd %: 90.83 % Non-Parse CPU: 96.58
Shared Pool Statistics Begin End
Memory Usage %: 84.68 84.76
% SQL with executions>1: 77.32 79.22
% Memory for SQL w/exec>1: 90.74 92.81
Top 5 Timed Events
~~~~~~~~~~~~~~~~~~ % Total
Event Waits Time (s) Ela Time
CPU time 125 54.23
db file sequential read 83,110 69 30.14
db file scattered read 23,196 27 11.75
buffer busy waits 11,760 6 2.42
log file sync 3,078 1 .45
Wait Events for DB: AHD Instance: ahd Snaps: 20 -21
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
Total Wait wait Waits
Event Waits Timeouts Time (s) (ms) /txn
db file sequential read 83,110 0 69 1 27.0
db file scattered read 23,196 0 27 1 7.5
buffer busy waits 11,760 0 6 0 3.8
log file sync 3,078 0 1 0 1.0
log file parallel write 5,216 4,841 1 0 1.7
control file sequential read 1,390 0 1 1 0.5
control file parallel write 462 0 0 1 0.2
db file parallel write 672 336 0 0 0.2
latch free 54 24 0 2 0.0
SQL*Net more data to client 1,026 0 0 0 0.3
LGWR wait for redo copy 12 0 0 0 0.0
SQL*Net message from client 131,863 0 22,857 173 42.9
virtual circuit status 48 48 1,497 31188 0.0
wakeup time manager 45 45 1,446 32123 0.0
SQL*Net message to client 131,864 0 0 0 42.9
SQL*Net more data from clien 27 0 0 0 0.0
Background Wait Events for DB: AHD Instance: ahd Snaps: 20 -21
-> ordered by wait time desc, waits desc (idle events last)
Avg
Total Wait wait Waits
Event Waits Timeouts Time (s) (ms) /txn
log file parallel write 5,216 4,841 1 0 1.7
control file parallel write 462 0 0 1 0.2
control file sequential read 184 0 0 2 0.1
db file parallel write 672 336 0 0 0.2
log file sync 24 0 0 0 0.0
db file sequential read 1 0 0 8 0.0
LGWR wait for redo copy 12 0 0 0 0.0
rdbms ipc message 12,386 7,345 10,752 868 4.0
SQL*Net message from client 384 0 1,498 3901 0.1
smon timer 4 4 1,229 ###### 0.0
SQL*Net message to client 384 0 0 0 0.1
SQL ordered by Gets for DB: AHD Instance: ahd Snaps: 20 -21
-> End Buffer Gets Threshold: 10000
-> Note that resources reported for PL/SQL includes the resources used by
all SQL statements called within the PL/SQL code. As individual SQL
statements are also reported, it is possible and valid for the summed
total % to exceed 100
CPU Elapsd
Buffer Gets Executions Gets per Exec %Total Time (s) Time (s) Hash Value
1,269,773 52 24,418.7 37.5 27.03 76.26 3370382957
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1" ) AND ( (
381,394 44 8,668.0 11.3 21.30 22.94 3653016280
SELECT count(*) FROM call_req, ctct, loc, site, z_zo, z_lho WHER
E ( call_req.customer = ctct.id AND ctct.c_l_id = loc.id AND l
oc.l_si_id = site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo
lhoid = z_lho.id AND z_lho.lho_name LIKE :"SYS_B_0" AND cal
l_req.active_flag = :"SYS_B_1" ) AND ( ( call_req.group_id != :"
239,582 10 23,958.2 7.1 5.95 17.44 1650906216
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" ) AND ( ( call_req.group_id != :"SYS_B_1" ) and
146,016 9 16,224.0 4.3 2.58 12.01 977739309
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_B_00" O
R id = :"SYS_B_01" OR id = :"SYS_B_02" OR id = :"SYS_B_03" OR id
= :"SYS_B_04" OR id = :"SYS_B_05" OR id = :"SYS_B_06" OR id = :
"SYS_B_07" OR id = :"SYS_B_08" OR id = :"SYS_B_09" OR id = :"SYS
117,569 7 16,795.6 3.5 0.52 0.52 1972089848
SELECT call_req.open_date, call_req.id FROM call_req, ctct WHERE
( call_req.status = :"SYS_B_00" AND call_req.group_id = ctct.id
AND ctct.c_last_name LIKE :"SYS_B_01" AND ( call_req.assigne
e IS NULL ) ) AND ( call_req.group_id IN ( SELECT id FROM ctct W
HERE id = :"SYS_B_02" OR id = :"SYS_B_03" OR id = :"SYS_B_04" OR
100,276 4 25,069.0 3.0 2.77 6.95 771782876
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho, ctct cn01 WHERE ( call_req.customer = ctct.i
d AND ctct.c_l_id = loc.id AND loc.l_si_id = site.id AND site
.z_si_zo_id = z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.
lho_name LIKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1"
95,832 4 23,958.0 2.8 2.13 3.80 1755292198
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_00" AND call_req.active_flag = :"SYS_B_01" AND ( ca
86,680 10 8,668.0 2.6 7.69 8.21 3407388950
SQL ordered by Gets for DB: AHD Instance: ahd Snaps: 20 -21
-> End Buffer Gets Threshold: 10000
-> Note that resources reported for PL/SQL includes the resources used by
all SQL statements called within the PL/SQL code. As individual SQL
statements are also reported, it is possible and valid for the summed
total % to exceed 100
CPU Elapsd
Buffer Gets Executions Gets per Exec %Total Time (s) Time (s) Hash Value
SELECT count(*) FROM call_req, ctct, loc, site, z_zo, z_lho WHER
E ( call_req.customer = ctct.id AND ctct.c_l_id = loc.id AND l
oc.l_si_id = site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo
lhoid = z_lho.id AND z_lho.lho_name LIKE :"SYS_B_0" ) AND (
( call_req.group_id != :"SYS_B_1" ) and ( call_req.group_id !=
71,839 3 23,946.3 2.1 2.73 6.07 1599404397
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo WHERE ( call_req.active_flag = :"SYS_B_0" AND call_r
eq.customer = ctct.id AND ctct.c_l_id = loc.id AND loc.l_si_id
= site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo_name LIK
E :"SYS_B_1" ) AND ( ( call_req.group_id != :"SYS_B_2" ) and (
60,507 9 6,723.0 1.8 1.47 1.49 632450130
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho, ctct cn01 WHERE ( call_req.customer = ctct.i
d AND ctct.c_l_id = loc.id AND loc.l_si_id = site.id AND site
.z_si_zo_id = z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.
lho_name LIKE :"SYS_B_0" AND call_req.status = :"SYS_B_1" AND
57,682 191 302.0 1.7 3.48 3.52 484128938
SELECT cnote.posted_date, cnote.text FROM cnote WHERE ( ( cnote.
loc_id = :"SYS_B_0" ) OR cnote.loc_id IS NULL ) AND ( cnote.inte
rnal IS NULL OR cnote.internal != :"SYS_B_1" ) ORDER BY cnote.p
osted_date DESC
52,146 3 17,382.0 1.5 1.22 3.60 930247717
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_B_00" O
R id = :"SYS_B_01" OR id = :"SYS_B_02" OR id = :"SYS_B_03" OR id
= :"SYS_B_04" OR id = :"SYS_B_05" OR id = :"SYS_B_06" OR id = :
"SYS_B_07" OR id = :"SYS_B_08" OR id = :"SYS_B_09" OR id = :"SYS
43,534 4 10,883.5 1.3 2.05 2.10 2363733805
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho, prob_ctg, ctct cn01 WHERE ( call_req.custome
r = ctct.id AND ctct.c_l_id = loc.id AND loc.l_si_id = site.id
AND site.z_si_zo_id = z_zo.id AND z_zo.zo_lho_id = z_lho.id A
ND z_lho.lho_name LIKE :"SYS_B_00" AND call_req.active_flag =
SQL ordered by Reads for DB: AHD Instance: ahd Snaps: 20 -21
-> End Disk Reads Threshold: 1000
CPU Elapsd
Physical Reads Executions Reads per Exec %Total Time (s) Time (s) Hash Value
81,653 52 1,570.3 58.8 27.03 76.26 3370382957
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1" ) AND ( (
15,402 10 1,540.2 11.1 5.95 17.44 1650906216
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" ) AND ( ( call_req.group_id != :"SYS_B_1" ) and
13,371 9 1,485.7 9.6 2.58 12.01 977739309
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_B_00" O
R id = :"SYS_B_01" OR id = :"SYS_B_02" OR id = :"SYS_B_03" OR id
= :"SYS_B_04" OR id = :"SYS_B_05" OR id = :"SYS_B_06" OR id = :
"SYS_B_07" OR id = :"SYS_B_08" OR id = :"SYS_B_09" OR id = :"SYS
6,157 4 1,539.3 4.4 2.77 6.95 771782876
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho, ctct cn01 WHERE ( call_req.customer = ctct.i
d AND ctct.c_l_id = loc.id AND loc.l_si_id = site.id AND site
.z_si_zo_id = z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.
lho_name LIKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1"
6,152 4 1,538.0 4.4 2.13 3.80 1755292198
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_00" AND call_req.active_flag = :"SYS_B_01" AND ( ca
4,622 3 1,540.7 3.3 2.73 6.07 1599404397
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo WHERE ( call_req.active_flag = :"SYS_B_0" AND call_r
eq.customer = ctct.id AND ctct.c_l_id = loc.id AND loc.l_si_id
= site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo_name LIK
E :"SYS_B_1" ) AND ( ( call_req.group_id != :"SYS_B_2" ) and (
2,982 3 994.0 2.1 1.22 3.60 930247717
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_B_00" O
R id = :"SYS_B_01" OR id = :"SYS_B_02" OR id = :"SYS_B_03" OR id
= :"SYS_B_04" OR id = :"SYS_B_05" OR id = :"SYS_B_06" OR id = :
"SYS_B_07" OR id = :"SYS_B_08" OR id = :"SYS_B_09" OR id = :"SYS
1,566 44 35.6 1.1 21.30 22.94 3653016280
SELECT count(*) FROM call_req, ctct, loc, site, z_zo, z_lho WHER
E ( call_req.customer = ctct.id AND ctct.c_l_id = loc.id AND l
oc.l_si_id = site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo
_lho_id = z_lho.id AND z_lho.lho_name LIKE :"SYS_B_0" AND cal
SQL ordered by Reads for DB: AHD Instance: ahd Snaps: 20 -21
-> End Disk Reads Threshold: 1000
CPU Elapsd
Physical Reads Executions Reads per Exec %Total Time (s) Time (s) Hash Value
l_req.active_flag = :"SYS_B_1" ) AND ( ( call_req.group_id != :"
1,540 1 1,540.0 1.1 0.56 1.64 2582352638
SELECT call_req.open_date, call_req.id FROM call_req, ctct, loc,
site, z_zo, z_lho WHERE ( call_req.customer = ctct.id AND ctct
.c_l_id = loc.id AND loc.l_si_id = site.id AND site.z_si_zo_id
= z_zo.id AND z_zo.zo_lho_id = z_lho.id AND z_lho.lho_name L
IKE :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1" AND ( call
1,106 2 553.0 0.8 1.25 3.01 548248759
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( ( c
all_req.assignee IS NOT NULL OR call_req.group_id IS NOT NULL )
AND ( call_req.type = :"SYS_B_00" OR call_req.type = :"SYS_B_01"
OR call_req.type IS NULL ) AND call_req.active_flag = :"SYS_B_0
2" ) AND ( call_req.group_id IN ( SELECT id FROM ctct WHERE id =
875 2 437.5 0.6 0.94 2.95 1195215130
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( ( c
all_req.assignee IS NULL AND call_req.group_id IS NULL ) AND ( c
all_req.type = :"SYS_B_00" OR call_req.type = :"SYS_B_01" OR cal
l_req.type IS NULL ) AND call_req.active_flag = :"SYS_B_02" ) AN
D ( call_req.group_id IN ( SELECT id FROM ctct WHERE id = :"SYS_
473 1 473.0 0.3 1.80 5.57 3376831664
BEGIN statspack.snap; END;
357 10 35.7 0.3 7.69 8.21 3407388950
SELECT count(*) FROM call_req, ctct, loc, site, z_zo, z_lho WHER
E ( call_req.customer = ctct.id AND ctct.c_l_id = loc.id AND l
oc.l_si_id = site.id AND site.z_si_zo_id = z_zo.id AND z_zo.zo
_lho_id = z_lho.id AND z_lho.lho_name LIKE :"SYS_B_0" ) AND (
( call_req.group_id != :"SYS_B_1" ) and ( call_req.group_id !=
177 5 35.4 0.1 1.81 2.08 920690862
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct, ct_ty WHERE ( ctct.c_ctp_id = ct_ty.id A
SQL ordered by Executions for DB: AHD Instance: ahd Snaps: 20 -21
-> End Executions Threshold: 100
CPU per Elap per
Executions Rows Processed Rows per Exec Exec (s) Exec (s) Hash Value
7,741 7,738 1.0 0.00 0.00 1060224445
SELECT grpmem.group_id , grpmem.manager_flag , grpmem.member , g
rpmem.notify_flag FROM grpmem WHERE grpmem.id = :"SYS_B_0"
2,459 2,459 1.0 0.00 0.00 3026674282
SELECT act_log.action_desc , act_log.analyst , act_log.call_req_
id , act_log.description , act_log.internal , act_log.knowledge_
session , act_log.knowledge_tool , act_log.last_mod_dt , act_log
.persid , act_log.system_time , act_log.time_spent , act_log.tim
e_stamp , act_log.type FROM act_log WHERE act_log.id = :"SYS_B_0
1,449 1,449 1.0 0.00 0.00 3299996875
SELECT att_evt.cancel_time , att_evt.event_tmpl , att_evt.fire_t
ime , att_evt.first_fire_time , att_evt.group_name , att_evt.las
t_mod_dt , att_evt.num_fire , att_evt.obj_id , att_evt.persid ,
att_evt.start_time , att_evt.status_flag , att_evt.user_smag , a
tt_evt.wait_time FROM att_evt WHERE att_evt.id = :"SYS_B_0"
1,336 1,336 1.0 0.00 0.00 3034229510
SELECT cr_prp.description , cr_prp.label , cr_prp.last_mod_by ,
cr_prp.last_mod_dt , cr_prp.owning_cr , cr_prp.persid , cr_prp.r
equired , cr_prp.sample , cr_prp.sequence , cr_prp.value FROM cr
prp WHERE crprp.id = :"SYS_B_0"
968 968 1.0 0.00 0.00 3460529092
select t.name, (select owner_instance from sys.aq$_queue_table_
affinities where table_objno = t.objno) from system.aq$_queue
_tables t where t.name = :1 and t.schema = :2 for update skip lo
cked
808 808 1.0 0.00 0.00 3346182257
SELECT call_req.active_flag , call_req.affected_rc , call_req.as
signee , call_req.call_back_date , call_req.call_back_flag , cal
l_req.category , call_req.change , call_req.charge_back_id , cal
l_req.close_date , call_req.created_via , call_req.customer , ca
ll_req.description , call_req.event_token , call_req.extern_ref
720 720 1.0 0.00 0.00 140137628
Module: Spotlight On Oracle, classic
SELECT DECODE(:b1,'BL','Buffer hash table instance lock','CF','C
ontrol file schema global enqueue lock','CI','Cross-instance fun
ction invocation instance lock','CS','Control file schema global
enqueue lock','CU','Cursor bind lock','DF','Data file instance
lock','DL','Direct loader parallel index create','DM','Mount/sta
718 718 1.0 0.00 0.00 4078915446
SELECT options.app_name, options.sym, options.id FROM options WH
ERE ( options.sym = :"SYS_B_0" ) AND ( options.del = :"SYS_B_1"
) ORDER BY options.app_name
634 634 1.0 0.00 0.00 1199698393
SELECT loc.alias , loc.del , loc.l_addr1 , loc.l_addr2 , loc.l_a
ddr3 , loc.l_addr4 , loc.l_addr5 , loc.l_addr6 , loc.l_details ,
loc.l_name , loc.l_si_id , loc.last_mod , loc.persid , loc.z_cb
SQL ordered by Executions for DB: AHD Instance: ahd Snaps: 20 -21
-> End Executions Threshold: 100
CPU per Elap per
Executions Rows Processed Rows per Exec Exec (s) Exec (s) Hash Value
l1 , loc.zcb_l2 , loc.z_cb_l3 , loc.z_l_code , loc.z_ro_code ,
loc.z_zo_code FROM loc WHERE loc.id = :"SYS_B_0"
531 208 0.4 0.00 0.00 800192270
SELECT lrel.l_persid, lrel.l_attr, lrel.l_sql, lrel.r_persid, lr
el.r_attr, lrel.r_sql, lrel.id FROM lrel WHERE lrel.l_persid = :
"SYS_B_0" and lrel.l_attr = :"SYS_B_1" ORDER BY lrel.l_persid ,
lrel.l_attr , lrel.l_sql
438 438 1.0 0.00 0.00 1317334374
Select PROPERTY_NAME,PROPERTY_VALUE,PROPERTY_TYPE from CI_PROPER
TIES where PROPERTY_NAME=:"SYS_B_0"
429 8,151 19.0 0.00 0.00 1976028604
SELECT cr_stat.sym, cr_stat.code FROM cr_stat WHERE cr_stat.del
= :"SYS_B_0" ORDER BY cr_stat.sym
383 383 1.0 0.00 0.00 2599265718
DELETE FROM anima WHERE id = :"SYS_B_0"
359 359 1.0 0.00 0.00 1719939797
DELETE FROM att_evt WHERE id = :"SYS_B_0"
337 337 1.0 0.00 0.00 3069423312
SELECT anima.a_act , anima.a_delta , anima.a_lock , anima.a_name
, anima.a_org , anima.a_string , anima.a_time , anima.t_method
, anima.t_persid , anima.t_type FROM anima WHERE anima.id = :"SY
S_B_0"
332 331 1.0 0.00 0.00 1549656119
SELECT crsq.id FROM crsq WHERE crsq.code = :"SYS_B_0"
315 315 1.0 0.00 0.00 1734736338
UPDATE cr_prp SET last_mod_by = :"SYS_B_0" , last_mod_dt = :"SYS
_B_1" WHERE id = :"SYS_B_2"
308 1,580 5.1 0.00 0.00 618252548
SELECT cr_prp.sequence, cr_prp.id FROM cr_prp WHERE cr_prp.ownin
g_cr = :"SYS_B_0" ORDER BY cr_prp.sequence
279 1,716 6.2 0.00 0.00 749386807
SELECT call_req.open_date, call_req.id FROM call_req WHERE call_
req.customer = :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1"
ORDER BY call_req.open_date DESC
277 277 1.0 0.00 0.00 321149819
INSERT INTO anima ( a_act, a_delta, a_lock, a_name, a_org, a_str
ing, a_time, t_method, t_persid, t_type, id ) VALUES ( :"SYS_B_
0" , :"SYS_B_1" , :"SYS_B_2" , :"SYS_B_3" , :"SYS_B_4" , nu
ll , :"SYS_B_5" , :"SYS_B_6" , :"SYS_B_7" , :"SYS_B_8" , :"
SQL ordered by Parse Calls for DB: AHD Instance: ahd Snaps: 20 -21
-> End Parse Calls Threshold: 1000
% Total
Parse Calls Executions Parses Hash Value
7,733 7,741 27.15 1060224445
SELECT grpmem.group_id , grpmem.manager_flag , grpmem.member , g
rpmem.notify_flag FROM grpmem WHERE grpmem.id = :"SYS_B_0"
2,459 2,459 8.63 3026674282
SELECT act_log.action_desc , act_log.analyst , act_log.call_req_
id , act_log.description , act_log.internal , act_log.knowledge_
session , act_log.knowledge_tool , act_log.last_mod_dt , act_log
.persid , act_log.system_time , act_log.time_spent , act_log.tim
e_stamp , act_log.type FROM act_log WHERE act_log.id = :"SYS_B_0
1,449 1,449 5.09 3299996875
SELECT att_evt.cancel_time , att_evt.event_tmpl , att_evt.fire_t
ime , att_evt.first_fire_time , att_evt.group_name , att_evt.las
t_mod_dt , att_evt.num_fire , att_evt.obj_id , att_evt.persid ,
att_evt.start_time , att_evt.status_flag , att_evt.user_smag , a
tt_evt.wait_time FROM att_evt WHERE att_evt.id = :"SYS_B_0"
1,336 1,336 4.69 3034229510
SELECT cr_prp.description , cr_prp.label , cr_prp.last_mod_by ,
cr_prp.last_mod_dt , cr_prp.owning_cr , cr_prp.persid , cr_prp.r
equired , cr_prp.sample , cr_prp.sequence , cr_prp.value FROM cr
prp WHERE crprp.id = :"SYS_B_0"
808 808 2.84 3346182257
SELECT call_req.active_flag , call_req.affected_rc , call_req.as
signee , call_req.call_back_date , call_req.call_back_flag , cal
l_req.category , call_req.change , call_req.charge_back_id , cal
l_req.close_date , call_req.created_via , call_req.customer , ca
ll_req.description , call_req.event_token , call_req.extern_ref
718 718 2.52 4078915446
SELECT options.app_name, options.sym, options.id FROM options WH
ERE ( options.sym = :"SYS_B_0" ) AND ( options.del = :"SYS_B_1"
) ORDER BY options.app_name
634 634 2.23 1199698393
SELECT loc.alias , loc.del , loc.l_addr1 , loc.l_addr2 , loc.l_a
ddr3 , loc.l_addr4 , loc.l_addr5 , loc.l_addr6 , loc.l_details ,
loc.l_name , loc.l_si_id , loc.last_mod , loc.persid , loc.z_cb
l1 , loc.zcb_l2 , loc.z_cb_l3 , loc.z_l_code , loc.z_ro_code ,
loc.z_zo_code FROM loc WHERE loc.id = :"SYS_B_0"
531 531 1.86 800192270
SELECT lrel.l_persid, lrel.l_attr, lrel.l_sql, lrel.r_persid, lr
el.r_attr, lrel.r_sql, lrel.id FROM lrel WHERE lrel.l_persid = :
"SYS_B_0" and lrel.l_attr = :"SYS_B_1" ORDER BY lrel.l_persid ,
lrel.l_attr , lrel.l_sql
438 438 1.54 1317334374
Select PROPERTY_NAME,PROPERTY_VALUE,PROPERTY_TYPE from CI_PROPER
TIES where PROPERTY_NAME=:"SYS_B_0"
429 429 1.51 1976028604
SQL ordered by Parse Calls for DB: AHD Instance: ahd Snaps: 20 -21
-> End Parse Calls Threshold: 1000
% Total
Parse Calls Executions Parses Hash Value
SELECT cr_stat.sym, cr_stat.code FROM cr_stat WHERE cr_stat.del
= :"SYS_B_0" ORDER BY cr_stat.sym
383 383 1.34 2599265718
DELETE FROM anima WHERE id = :"SYS_B_0"
359 359 1.26 1719939797
DELETE FROM att_evt WHERE id = :"SYS_B_0"
337 337 1.18 3069423312
SELECT anima.a_act , anima.a_delta , anima.a_lock , anima.a_name
, anima.a_org , anima.a_string , anima.a_time , anima.t_method
, anima.t_persid , anima.t_type FROM anima WHERE anima.id = :"SY
S_B_0"
330 332 1.16 1549656119
SELECT crsq.id FROM crsq WHERE crsq.code = :"SYS_B_0"
315 315 1.11 1734736338
UPDATE cr_prp SET last_mod_by = :"SYS_B_0" , last_mod_dt = :"SYS
_B_1" WHERE id = :"SYS_B_2"
308 308 1.08 618252548
SELECT cr_prp.sequence, cr_prp.id FROM cr_prp WHERE cr_prp.ownin
g_cr = :"SYS_B_0" ORDER BY cr_prp.sequence
277 277 0.97 321149819
INSERT INTO anima ( a_act, a_delta, a_lock, a_name, a_org, a_str
ing, a_time, t_method, t_persid, t_type, id ) VALUES ( :"SYS_B_
0" , :"SYS_B_1" , :"SYS_B_2" , :"SYS_B_3" , :"SYS_B_4" , nu
ll , :"SYS_B_5" , :"SYS_B_6" , :"SYS_B_7" , :"SYS_B_8" , :"
SYS_B_9" )
277 279 0.97 749386807
SELECT call_req.open_date, call_req.id FROM call_req WHERE call_
req.customer = :"SYS_B_0" AND call_req.active_flag = :"SYS_B_1"
ORDER BY call_req.open_date DESC
275 275 0.97 2816620377
INSERT INTO att_evt ( cancel_time, event_tmpl, fire_time, first_
fire_time, group_name, last_mod_dt, num_fire, obj_id, persid, st
art_time, status_flag, user_smag, wait_time, id ) VALUES ( null
, :"SYS_B_00" , :"SYS_B_01" , :"SYS_B_02" , :"SYS_B_03" ,
:"SYS_B_04" , :"SYS_B_05" , :"SYS_B_06" , :"SYS_B_07" , :"SY
269 269 0.94 3605948696
SELECT slatpl.del , slatpl.elapsed , slatpl.event , slatpl.last_
mod_by , slatpl.last_mod_dt , slatpl.object_type , slatpl.persid
, slatpl.service_type , slatpl.sym FROM slatpl WHERE slatpl.id
SQL ordered by Sharable Memory for DB: AHD Instance: ahd Snaps: 20 -21
-> End Sharable Memory Threshold: 1048576
Sharable Mem (b) Executions % Total Hash Value
23,912,520 231 13.6 139964375
SELECT anima.a_name, anima.t_persid, anima.t_method, anima.id FR
OM anima WHERE anima.t_persid LIKE :"SYS_B_0" ORDER BY anima.
a_name
18,314,292 26 10.4 380755726
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.ref_num LIKE :"SYS_B_00" ) AND ( call_req.group_id IN (
SELECT id FROM ctct WHERE id = :"SYS_B_01" OR id = :"SYS_B_02" O
R id = :"SYS_B_03" OR id = :"SYS_B_04" OR id = :"SYS_B_05" OR id
= :"SYS_B_06" OR id = :"SYS_B_07" OR id = :"SYS_B_08" OR id = :
12,365,844 107 7.0 1877135209
SELECT chg.open_date, chg.chg_ref_num, chg.id FROM chg WHERE ( c
hg.affected_contact = :"SYS_B_0" and chg.active_flag = :"SYS_B_1
" ) AND ( chg.affected_contact = :"SYS_B_2" ) ORDER BY chg.open
_date DESC
2,692,852 17 1.5 4181730075
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct, ct_ty WHERE ( ctct.c_last_name LIKE :"
SYS_B_0" AND ctct.c_ctp_id = ct_ty.id AND ct_ty.id = :"SYS_B_1"
AND ctct.del = :"SYS_B_2" AND ctct.id IN ( SELECT member FROM g
2,048,083 10 1.2 153455816
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct WHERE ( ctct.c_last_name LIKE :"SYS_B_0
" ) AND ( ( ctct.del = :"SYS_B_1" ) AND ( ctct.c_ctp_id = :"SYS_
B_2" AND ctct.alias = -:"SYS_B_3" ) ) ORDER BY ctct.c_last_name
1,653,628 3 0.9 1096419296
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.ref_num LIKE :"SYS_B_0" ) AND ( ( call_req.group_id IN (
SELECT group_id FROM grpmem WHERE member = :"SYS_B_1" ) ) or ca
ll_req.assignee = :"SYS_B_2" or call_req.customer = :"SYS_B_3" )
ORDER BY call_req.open_date DESC
SQL ordered by Version Count for DB: AHD Instance: ahd Snaps: 20 -21
-> End Version Count Threshold: 20
Version
Count Executions Hash Value
349 231 139964375
SELECT anima.a_name, anima.t_persid, anima.t_method, anima.id FR
OM anima WHERE anima.t_persid LIKE :"SYS_B_0" ORDER BY anima.
a_name
196 107 1877135209
SELECT chg.open_date, chg.chg_ref_num, chg.id FROM chg WHERE ( c
hg.affected_contact = :"SYS_B_0" and chg.active_flag = :"SYS_B_1
" ) AND ( chg.affected_contact = :"SYS_B_2" ) ORDER BY chg.open
_date DESC
127 26 380755726
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.ref_num LIKE :"SYS_B_00" ) AND ( call_req.group_id IN (
SELECT id FROM ctct WHERE id = :"SYS_B_01" OR id = :"SYS_B_02" O
R id = :"SYS_B_03" OR id = :"SYS_B_04" OR id = :"SYS_B_05" OR id
= :"SYS_B_06" OR id = :"SYS_B_07" OR id = :"SYS_B_08" OR id = :
36 17 4181730075
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct, ct_ty WHERE ( ctct.c_last_name LIKE :"
SYS_B_0" AND ctct.c_ctp_id = ct_ty.id AND ct_ty.id = :"SYS_B_1"
AND ctct.del = :"SYS_B_2" AND ctct.id IN ( SELECT member FROM g
33 10 153455816
SELECT ctct.c_last_name, ctct.c_first_name, ctct.c_middle_name,
ctct.c_public_phone, ctct.c_contact_num, ctct.c_org_id, ctct.c_l
_id, ctct.id FROM ctct WHERE ( ctct.c_last_name LIKE :"SYS_B_0
" ) AND ( ( ctct.del = :"SYS_B_1" ) AND ( ctct.c_ctp_id = :"SYS_
B_2" AND ctct.alias = -:"SYS_B_3" ) ) ORDER BY ctct.c_last_name
26 3 1096419296
SELECT call_req.open_date, call_req.id FROM call_req WHERE ( cal
l_req.ref_num LIKE :"SYS_B_0" ) AND ( ( call_req.group_id IN (
SELECT group_id FROM grpmem WHERE member = :"SYS_B_1" ) ) or ca
ll_req.assignee = :"SYS_B_2" or call_req.customer = :"SYS_B_3" )
ORDER BY call_req.open_date DESC
Instance Activity Stats for DB: AHD Instance: ahd Snaps: 20 -21
Statistic Total per Second per Trans
CPU used by this session 12,450 8.7 4.1
CPU used when call started 12,515 8.8 4.1
CR blocks created 53 0.0 0.0
DBWR buffers scanned 0 0.0 0.0
DBWR checkpoint buffers written 1,644 1.2 0.5
DBWR checkpoints 0 0.0 0.0
DBWR free buffers found 0 0.0 0.0
DBWR lru scans 0 0.0 0.0
DBWR make free requests 0 0.0 0.0
DBWR summed scan depth 0 0.0 0.0
DBWR transaction table writes 10 0.0 0.0
DBWR undo block writes 238 0.2 0.1
SQL*Net roundtrips to/from client 131,833 92.6 42.9
active txn count during cleanout 130 0.1 0.0
background checkpoints completed 0 0.0 0.0
background checkpoints started 0 0.0 0.0
background timeouts 2,161 1.5 0.7
branch node splits 0 0.0 0.0
buffer is not pinned count 3,147,925 2,210.6 1,024.1
buffer is pinned count 638,155 448.1 207.6
bytes received via SQL*Net from c 20,116,711 14,126.9 6,544.2
bytes sent via SQL*Net to client 33,961,169 23,849.1 11,047.9
calls to get snapshot scn: kcmgss 76,324 53.6 24.8
calls to kcmgas 6,266 4.4 2.0
calls to kcmgcs 110 0.1 0.0
change write time 25 0.0 0.0
cleanout - number of ktugct calls 145 0.1 0.1
cleanouts and rollbacks - consist 0 0.0 0.0
cleanouts only - consistent read 0 0.0 0.0
cluster key scan block gets 1,361 1.0 0.4
cluster key scans 1,146 0.8 0.4
commit cleanout failures: buffer 0 0.0 0.0
commit cleanout failures: callbac 3 0.0 0.0
commit cleanout failures: cannot 0 0.0 0.0
commit cleanouts 14,837 10.4 4.8
commit cleanouts successfully com 14,834 10.4 4.8
commit txn count during cleanout 106 0.1 0.0
consistent changes 2,123 1.5 0.7
consistent gets 3,336,864 2,343.3 1,085.5
consistent gets - examination 197,061 138.4 64.1
cursor authentications 71 0.1 0.0
data blocks consistent reads - un 2,123 1.5 0.7
db block changes 50,525 35.5 16.4
db block gets 47,774 33.6 15.5
deferred (CURRENT) block cleanout 7,940 5.6 2.6
dirty buffers inspected 0 0.0 0.0
enqueue conversions 29 0.0 0.0
enqueue releases 14,210 10.0 4.6
enqueue requests 14,210 10.0 4.6
enqueue waits 0 0.0 0.0
execute count 32,955 23.1 10.7
free buffer inspected 16 0.0 0.0
free buffer requested 140,283 98.5 45.6
hot buffers moved to head of LRU 950 0.7 0.3
immediate (CR) block cleanout app 0 0.0 0.0
immediate (CURRENT) block cleanou 2,804 2.0 0.9
Instance Activity Stats for DB: AHD Instance: ahd Snaps: 20 -21
Statistic Total per Second per Trans
index fast full scans (full) 157 0.1 0.1
index fetch by key 70,378 49.4 22.9
index scans kdiixs1 28,181 19.8 9.2
leaf node 90-10 splits 10 0.0 0.0
leaf node splits 76 0.1 0.0
logons cumulative 11 0.0 0.0
messages received 5,452 3.8 1.8
messages sent 5,452 3.8 1.8
no buffer to keep pinned count 0 0.0 0.0
no work - consistent read gets 3,085,481 2,166.8 1,003.7
opened cursors cumulative 4,561 3.2 1.5
parse count (failures) 0 0.0 0.0
parse count (hard) 412 0.3 0.1
parse count (total) 28,484 20.0 9.3
parse time cpu 426 0.3 0.1
parse time elapsed 469 0.3 0.2
physical reads 138,930 97.6 45.2
physical reads direct 0 0.0 0.0
physical writes 1,644 1.2 0.5
physical writes direct 0 0.0 0.0
physical writes non checkpoint 232 0.2 0.1
pinned buffers inspected 7 0.0 0.0
prefetched blocks 32,732 23.0 10.7
process last non-idle time 12,884,949,552 9,048,419.6 4,191,590.6
recursive calls 22,718 16.0 7.4
recursive cpu usage 226 0.2 0.1
redo blocks written 19,178 13.5 6.2
redo buffer allocation retries 0 0.0 0.0
redo entries 27,265 19.2 8.9
redo log space requests 0 0.0 0.0
redo log space wait time 0 0.0 0.0
redo size 8,488,216 5,960.8 2,761.3
redo synch time 74 0.1 0.0
redo synch writes 3,078 2.2 1.0
redo wastage 1,040,788 730.9 338.6
redo write time 75 0.1 0.0
redo writer latching time 0 0.0 0.0
redo writes 5,216 3.7 1.7
rollback changes - undo records a 6 0.0 0.0
rollbacks only - consistent read 233 0.2 0.1
rows fetched via callback 54,581 38.3 17.8
session connect time 12,884,949,552 9,048,419.6 4,191,590.6
session logical reads 3,384,638 2,376.9 1,101.1
session pga memory max 6,168,536 4,331.8 2,006.7
session uga memory 599,984 421.3 195.2
session uga memory max 9,592,864 6,736.6 3,120.7
shared hash latch upgrades - no w 27,737 19.5 9.0
shared hash latch upgrades - wait 84 0.1 0.0
sorts (disk) 0 0.0 0.0
sorts (memory) 6,834 4.8 2.2
sorts (rows) 3,229,994 2,268.3 1,050.8
summed dirty queue length 0 0.0 0.0
switch current to new buffer 990 0.7 0.3
table fetch by rowid 474,673 333.3 154.4
table fetch continued row 8 0.0 0.0
table scan blocks gotten 2,751,375 1,932.2 895.1
Instance Activity Stats for DB: AHD Instance: ahd Snaps: 20 -21
Statistic Total per Second per Trans
table scan rows gotten 55,928,200 39,275.4 18,194.0
table scans (long tables) 245 0.2 0.1
table scans (short tables) 3,383 2.4 1.1
transaction rollbacks 3 0.0 0.0
transaction tables consistent rea 0 0.0 0.0
transaction tables consistent rea 0 0.0 0.0
user calls 131,904 92.6 42.9
user commits 3,074 2.2 1.0
user rollbacks 0 0.0 0.0
workarea executions - onepass 0 0.0 0.0
workarea executions - optimal 8,438 5.9 2.7
write clones created in backgroun 0 0.0 0.0
write clones created in foregroun 0 0.0 0.0
Tablespace IO Stats for DB: AHD Instance: ahd Snaps: 20 -21
->ordered by IOs (Reads + Writes) desc
Tablespace
Av Av Av Av Buffer Av Buf
Reads Reads/s Rd(ms) Blks/Rd Writes Writes/s Waits Wt(ms)
AHD1_DATA
105,869 74 0.9 1.3 828 1 11,740 0.5
AHD1_IDX
38 0 7.4 1.0 563 0 0 0.0
PERFSTAT
372 0 3.6 1.0 0 0 0 0.0
UNDOTBS1
0 0 0.0 248 0 0 0.0
SYSTEM
6 0 6.7 1.0 5 0 0 0.0
File IO Stats for DB: AHD Instance: ahd Snaps: 20 -21
->ordered by Tablespace, File
Tablespace Filename
Av Av Av Av Buffer Av Buf
Reads Reads/s Rd(ms) Blks/Rd Writes Writes/s Waits Wt(ms)
AHD1_DATA E:\ORACLE\ORADATA\AHD\AHD1_DATA.ORA
53,454 38 0.9 1.3 432 0 5,949 0.5
E:\ORACLE\ORADATA\AHD\AHD2_DATA.ORA
52,415 37 0.9 1.3 396 0 5,791 0.5
AHD1_IDX E:\ORACLE\ORADATA\AHD\AHD1_IDX.ORA
38 0 7.4 1.0 563 0 0
PERFSTAT E:\ORACLE\ORADATA\AHD\PERFSTAT.ORA
372 0 3.6 1.0 0 0 0
SYSTEM E:\ORACLE\ORADATA\AHD\SYSTEM01.DBF
6 0 6.7 1.0 5 0 0
UNDOTBS1 E:\ORACLE\ORADATA\AHD\UNDOTBS01.DBF
0 0 248 0 0
Buffer Pool Statistics for DB: AHD Instance: ahd Snaps: 20 -21
-> Standard block size Pools D: default, K: keep, R: recycle
-> Default Pools for other block sizes: 2k, 4k, 8k, 16k, 32k
Free Write Buffer
Number of Cache Buffer Physical Physical Buffer Complete Busy
P Buffers Hit % Gets Reads Writes Waits Waits Waits
D 82,082 97.8 6,327,007 138,971 1,644 0 0 11,760
Instance Recovery Stats for DB: AHD Instance: ahd Snaps: 20 -21
-> B: Begin snapshot, E: End snapshot
Targt Estd Log File Log Ckpt Log Ckpt
MTTR MTTR Recovery Actual Target Size Timeout Interval
(s) (s) Estd IOs Redo Blks Redo Blks Redo Blks Redo Blks Redo Blks
B 75 26 2354 18057 17632 184320 17632
E 75 27 2967 23569 22952 184320 22952
Buffer Pool Advisory for DB: AHD Instance: ahd End Snap: 21
-> Only rows with estimated physical reads >0 are displayed
-> ordered by Block Size, Buffers For Estimate
Size for Size Buffers for Est Physical Estimated
P Estimate (M) Factr Estimate Read Factor Physical Reads
D 64 .1 8,008 261.38 4,357,231,706
D 128 .2 16,016 207.44 3,458,029,385
D 192 .3 24,024 143.22 2,387,570,894
D 256 .4 32,032 2.29 38,243,018
D 320 .5 40,040 1.89 31,541,321
D 384 .6 48,048 1.74 29,023,767
D 448 .7 56,056 1.69 28,232,064
D 512 .8 64,064 1.20 19,951,481
D 576 .9 72,072 1.11 18,529,925
D 640 1.0 80,080 1.04 17,367,752
D 656 1.0 82,082 1.00 16,670,129
D 704 1.1 88,088 0.97 16,124,256
D 768 1.2 96,096 0.91 15,155,822
D 832 1.3 104,104 0.90 15,055,099
D 896 1.4 112,112 0.89 14,839,567
D 960 1.5 120,120 0.88 14,668,682
D 1,024 1.6 128,128 0.87 14,479,726
D 1,088 1.7 136,136 0.84 13,988,866
D 1,152 1.8 144,144 0.70 11,723,518
D 1,216 1.9 152,152 0.61 10,156,857
D 1,280 2.0 160,160 0.20 3,281,883
Buffer wait Statistics for DB: AHD Instance: ahd Snaps: 20 -21
-> ordered by wait time desc, waits desc
Tot Wait Avg
Class Waits Time (s) Time (ms)
data block 11,754 6 0
PGA Aggr Target Stats for DB: AHD Instance: ahd Snaps: 20 -21
-> B: Begin snap E: End snap (rows dentified with B or E contain data
which is absolute i.e. not diffed over the interval)
-> PGA cache hit % - percentage of W/A (WorkArea) data processed only in-memory
-> Auto PGA Target - actual workarea memory target
-> W/A PGA Used - amount of memory used for all Workareas (manual + auto)
-> %PGA W/A Mem - percentage of PGA memory allocated to workareas
-> %Auto W/A Mem - percentage of workarea memory controlled by Auto Mem Mgmt
-> %Man W/A Mem - percentage of workarea memory under manual control
PGA Cache Hit % W/A MB Processed Extra W/A MB Read/Written
100.0 1,169 0
%PGA %Auto %Man
PGA Aggr Auto PGA PGA Mem W/A PGA W/A W/A W/A Global Mem
Target(M) Target(M) Alloc(M) Used(M) Mem Mem Mem Bound(K)
B 350 293 37.6 0.0 .0 .0 .0 17,920
E 350 293 37.5 0.2 .6 100.0 .0 17,920
PGA Aggr Target Histogram for DB: AHD Instance: ahd Snaps: 20 -21
-> Optimal Executions are purely in-memory operations
Low High
Optimal Optimal Total Execs Optimal Execs 1-Pass Execs M-Pass Execs
8K 16K 6,809 6,809 0 0
16K 32K 148 148 0 0
32K 64K 90 90 0 0
64K 128K 154 154 0 0
128K 256K 73 73 0 0
256K 512K 308 308 0 0
512K 1024K 374 374 0 0
1M 2M 171 171 0 0
2M 4M 217 217 0 0
4M 8M 10 10 0 0
PGA Memory Advisory for DB: AHD Instance: ahd End Snap: 21
-> When using Auto Memory Mgmt, minimally choose a pga_aggregate_target value
where Estd PGA Overalloc Count is 0
Estd Extra Estd PGA Estd PGA
PGA Target Size W/A MB W/A MB Read/ Cache Overalloc
Est (MB) Factr Processed Written to Disk Hit % Count
44 0.1 180,060.5 42,218.7 81.0 4
88 0.3 180,060.5 23,194.7 89.0 0
175 0.5 180,060.5 9,436.8 95.0 0
263 0.8 180,060.5 9,356.7 95.0 0
350 1.0 180,060.5 9,274.8 95.0 0
420 1.2 180,060.5 9,169.9 95.0 0
490 1.4 180,060.5 9,148.0 95.0 0
560 1.6 180,060.5 9,148.0 95.0 0
630 1.8 180,060.5 9,148.0 95.0 0
700 2.0 180,060.5 9,148.0 95.0 0
1,050 3.0 180,060.5 9,148.0 95.0 0
1,400 4.0 180,060.5 9,148.0 95.0 0
2,100 6.0 180,060.5 3,983.3 98.0 0
2,800 8.0 180,060.5 3,983.3 98.0 0
Rollback Segment Stats for DB: AHD Instance: ahd Snaps: 20 -21
->A high value for "Pct Waits" suggests more rollback segments may be required
->RBS stats may not be accurate between begin and end snaps when using Auto Undo
managment, as RBS may be dynamically created and dropped as needed
Trans Table Pct Undo Bytes
RBS No Gets Waits Written Wraps Shrinks Extends
0 29.0 0.00 0 0 0 0
1 975.0 0.00 122,796 0 0 0
2 1,244.0 0.00 1,094,706 10 0 5
3 816.0 0.00 118,596 0 0 0
4 1,430.0 0.00 212,754 2 0 0
5 1,716.0 0.00 291,940 2 0 0
6 1,287.0 0.00 197,900 0 0 0
7 1,674.0 0.00 279,160 0 0 0
8 1,031.0 0.00 148,216 0 0 0
9 947.0 0.00 141,870 0 0 0
10 834.0 0.00 117,422 0 0 0
Rollback Segment Storage for DB: AHD Instance: ahd Snaps: 20 -21
->Optimal Size should be larger than Avg Active
RBS No Segment Size Avg Active Optimal Size Maximum Size
0 385,024 0 385,024
1 2,220,032 455,412 2,220,032
2 2,088,960 333,026 2,220,032
3 2,220,032 456,101 2,220,032
4 2,220,032 474,584 3,268,608
5 2,220,032 480,865 3,268,608
6 2,220,032 513,967 3,268,608
7 2,220,032 480,785 2,220,032
8 2,220,032 496,182 2,220,032
9 2,220,032 486,763 2,220,032
10 2,220,032 430,016 6,414,336
Undo Segment Summary for DB: AHD Instance: ahd Snaps: 20 -21
-> Undo segment block stats:
-> uS - unexpired Stolen, uR - unexpired Released, uU - unexpired reUsed
-> eS - expired Stolen, eR - expired Released, eU - expired reUsed
Undo Undo Num Max Qry Max Tx Snapshot Out of uS/uR/uU/
TS# Blocks Trans Len (s) Concurcy Too Old Space eS/eR/eU
1 395 2,900,725 5 1 0 0 0/0/0/0/0/0
Undo Segment Stats for DB: AHD Instance: ahd Snaps: 20 -21
-> ordered by Time desc
Undo Num Max Qry Max Tx Snap Out of uS/uR/uU/
End Time Blocks Trans Len (s) Concy Too Old Space eS/eR/eU
13-Feb 15:04 96 ######## 4 1 0 0 0/0/0/0/0/0
13-Feb 14:54 299 ######## 5 1 0 0 0/0/0/0/0/0
Latch Activity for DB: AHD Instance: ahd Snaps: 20 -21
->"Get Requests", "Pct Get Miss" and "Avg Slps/Miss" are statistics for
willing-to-wait latch get requests
->"NoWait Requests", "Pct NoWait Miss" are for no-wait latch get requests
->"Pct Misses" for both should be very close to 0.0
Pct Avg Wait Pct
Get Get Slps Time NoWait NoWait
Latch Requests Miss /Miss (s) Requests Miss
Consistent RBA 5,216 0.0 0 0
FOB s.o list latch 34 0.0 0 0
SQL memory manager latch 1 0.0 0 462 0.0
SQL memory manager worka 40,347 0.0 0 0
active checkpoint queue 1,261 0.0 0 0
archive control 163 0.0 0 0
archive process latch 29 0.0 0 0
cache buffer handles 378 0.0 0 0
cache buffers chains 6,836,244 0.4 0.0 0 266,617 0.0
cache buffers lru chain 244,157 0.0 0.0 0 140,432 0.0
channel handle pool latc 21 0.0 0 0
channel operations paren 960 0.0 0 0
checkpoint queue latch 86,982 0.0 0 2,337 0.0
child cursor hash table 6,464 0.0 0.0 0 0
dml lock allocation 15,005 0.0 0 0
dummy allocation 21 0.0 0 0
enqueue hash chains 28,447 0.0 0 0
enqueues 8,689 0.0 0 0
event group latch 11 0.0 0 0
file number translation 4,079 0.0 0 0
hash table column usage 38 0.0 0 187,596 0.0
hash table modification 1 0.0 0 0
job_queue_processes para 23 0.0 0 0
ktm global data 4 0.0 0 0
kwqit: protect wakeup ti 45 0.0 0 0
lgwr LWN SCN 5,328 0.4 0.0 0 0
library cache 342,865 0.2 0.0 0 342 0.6
library cache load lock 452 0.0 0 0
library cache pin 197,662 0.0 0.0 0 0
library cache pin alloca 124,035 0.0 0.0 0 0
list of block allocation 55 0.0 0 0
messages 30,779 0.0 0.0 0 0
mostly latch-free SCN 5,459 1.8 0.0 0 0
multiblock read objects 194,822 0.0 0.0 0 0
ncodef allocation latch 23 0.0 0 0
object stats modificatio 618 0.0 0 0
post/wait queue 10,441 0.0 0 3,078 0.0
process allocation 11 0.0 0 11 0.0
process group creation 21 0.0 0 0
redo allocation 37,773 0.0 0.0 0 0
redo copy 0 0 27,274 0.0
redo writing 17,880 0.0 0 0
row cache enqueue latch 169,423 0.0 0.0 0 0
row cache objects 169,795 0.0 0 3 0.0
sequence cache 38 0.0 0 0
session allocation 15,580 0.0 0 0
session idle bit 269,419 0.0 0.0 0 0
session switching 23 0.0 0 0
session timer 478 0.0 0 0
shared pool 104,427 0.1 0.0 0 0
Latch Activity for DB: AHD Instance: ahd Snaps: 20 -21
->"Get Requests", "Pct Get Miss" and "Avg Slps/Miss" are statistics for
willing-to-wait latch get requests
->"NoWait Requests", "Pct NoWait Miss" are for no-wait latch get requests
->"Pct Misses" for both should be very close to 0.0
Pct Avg Wait Pct
Get Get Slps Time NoWait NoWait
Latch Requests Miss /Miss (s) Requests Miss
sim partition latch 0 0 32 0.0
simulator hash latch 217,119 0.0 0.0 0 0
simulator lru latch 16,247 0.0 0 902 0.4
sort extent pool 29 0.0 0 0
transaction allocation 36 0.0 0 0
transaction branch alloc 23 0.0 0 0
undo global data 19,973 0.0 0 0
user lock 42 0.0 0 0
Latch Sleep breakdown for DB: AHD Instance: ahd Snaps: 20 -21
-> ordered by misses desc
Get Spin &
Latch Name Requests Misses Sleeps Sleeps 1->4
cache buffers chains 6,836,244 26,201 46 0/0/0/0/0
library cache 342,865 778 5 773/5/0/0/0
shared pool 104,427 125 3 122/3/0/0/0
Latch Miss Sources for DB: AHD Instance: ahd Snaps: 20 -21
-> only latches with sleeps are shown
-> ordered by name, sleeps desc
NoWait Waiter
Latch Name Where Misses Sleeps Sleeps
cache buffers chains kcbgtcr: kslbegin excl 0 32 30
cache buffers chains kcbrls: kslbegin 0 7 13
cache buffers chains kcbzwb 0 4 3
cache buffers chains kcbgtcr: fast path 0 3 0
library cache kglic 0 2 0
library cache kglobpn: child: 0 2 0
library cache kgllkdl: child: cleanup 0 1 0
shared pool kghalo 0 2 0
shared pool kghalp 0 1 0
Child Latch Statistics DB: AHD Instance: ahd Snaps: 20 -21
-> only latches with sleeps/gets > 1/100000 are shown
-> ordered by name, gets desc
Child Get Spin &
Latch Name Num Requests Misses Sleeps Sleeps 1->4
cache buffers chains 439 28,269 1,276 1 0/0/0/0/0
cache buffers chains 269 26,297 842 1 0/0/0/0/0
cache buffers chains 1010 17,482 49 2 0/0/0/0/0
cache buffers chains 260 11,141 20 1 0/0/0/0/0
cache buffers chains 324 9,454 29 1 0/0/0/0/0
cache buffers chains 840 7,235 20 1 0/0/0/0/0
cache buffers chains 46 6,868 25 1 0/0/0/0/0
cache buffers chains 835 6,799 26 2 0/0/0/0/0
cache buffers chains 202 6,768 17 1 0/0/0/0/0
cache buffers chains 740 6,573 38 2 0/0/0/0/0
cache buffers chains 592 6,508 30 1 0/0/0/0/0
cache buffers chains 436 6,485 25 2 0/0/0/0/0
cache buffers chains 513 6,443 16 1 0/0/0/0/0
cache buffers chains 844 6,436 28 1 0/0/0/0/0
cache buffers chains 117 6,423 25 1 0/0/0/0/0
cache buffers chains 389 6,381 25 1 0/0/0/0/0
cache buffers chains 116 6,349 29 1 0/0/0/0/0
cache buffers chains 51 6,340 34 1 0/0/0/0/0
cache buffers chains 914 6,259 31 1 0/0/0/0/0
cache buffers chains 713 6,249 24 1 0/0/0/0/0
cache buffers chains 465 6,198 27 2 0/0/0/0/0
cache buffers chains 416 6,193 27 1 0/0/0/0/0
cache buffers chains 432 6,155 34 1 0/0/0/0/0
cache buffers chains 583 6,152 23 2 0/0/0/0/0
cache buffers chains 126 6,147 35 1 0/0/0/0/0
cache buffers chains 879 6,043 21 1 0/0/0/0/0
cache buffers chains 110 6,010 25 1 0/0/0/0/0
cache buffers chains 138 6,010 25 1 0/0/0/0/0
cache buffers chains 472 6,002 31 1 0/0/0/0/0
cache buffers chains 908 5,964 20 1 0/0/0/0/0
cache buffers chains 860 5,950 23 1 0/0/0/0/0
cache buffers chains 71 5,945 29 3 0/0/0/0/0
cache buffers chains 20 5,780 28 1 0/0/0/0/0
cache buffers chains 932 5,759 25 1 0/0/0/0/0
cache buffers chains 866 5,610 22 1 0/0/0/0/0
cache buffers chains 989 5,454 34 2 0/0/0/0/0
cache buffers chains 1005 5,434 40 1 0/0/0/0/0
library cache 6 47,067 52 3 49/3/0/0/0
shared pool 1 99,771 124 3 121/3/0/0/0
Top 5 Logical Reads per Segment for DB: AHD Instance: ahd Snaps: 20 -21
-> End Segment Logical Reads Threshold: 10000
Subobject Obj. Logical
Owner Tablespace Object Name Name Type Reads %Total
AHD AHD1_DATA CALL_REQ TABLE 1,714,928 51.19
AHD AHD1_DATA CTCT TABLE 1,169,360 34.90
AHD AHD1_IDX SYS_C003707 INDEX 89,152 2.66
AHD AHD1_DATA CNOTE TABLE 66,272 1.98
AHD AHD1_IDX CALL_REQ_X5 INDEX 61,360 1.83
Top 5 Physical Reads per Segment for DB: AHD Instance: ahd Snaps: 20 -21
-> End Segment Physical Reads Threshold: 1000
Subobject Obj. Physical
Owner Tablespace Object Name Name Type Reads %Total
AHD AHD1_DATA CALL_REQ TABLE 132,989 95.95
AHD AHD1_DATA CTCT TABLE 5,325 3.84
AHD AHD1_DATA CI_AUDIT_TRAILS_GU_I INDEX 43 .03
AHD AHD1_DATA ACT_LOG TABLE 38 .03
AHD AHD1_DATA CI_EXT_CALLS_GUID INDEX 36 .03
Top 5 Buf. Busy Waits per Segment for DB: AHD Instance: ahd Snaps: 20 -21
-> End Segment Buffer Busy Waits Threshold: 100
Buffer
Subobject Obj. Busy
Owner Tablespace Object Name Name Type Waits %Total
AHD AHD1_DATA CALL_REQ TABLE 11,751 99.95
AHD AHD1_DATA CTCT TABLE 6 .05
Dictionary Cache Stats for DB: AHD Instance: ahd Snaps: 20 -21
->"Pct Misses" should be very low (< 2% in most cases)
->"Cache Usage" is the number of cache entries being used
->"Pct SGA" is the ratio of usage to allocated size for that cache
Get Pct Scan Pct Mod Final
Cache Requests Miss Reqs Miss Reqs Usage
dc_files 30 0.0 0 0 15
dc_histogram_defs 3,022 3.9 0 0 1,919
dc_object_ids 22,961 0.1 0 0 1,181
dc_objects 1,092 9.2 0 0 1,026
dc_profiles 11 0.0 0 0 1
dc_rollback_segments 168 0.0 0 0 22
dc_segments 5,519 0.1 0 0 1,334
dc_sequences 1 0.0 0 1 2
dc_tablespace_quotas 3 0.0 0 3 2
dc_tablespaces 25,902 0.0 0 0 16
dc_user_grants 127 0.0 0 0 22
dc_usernames 110 0.0 0 0 18
dc_users 26,077 0.0 0 0 30
Library Cache Activity for DB: AHD Instance: ahd Snaps: 20 -21
->"Pct Misses" should be very low
Get Pct Pin Pct Invali-
Namespace Requests Miss Requests Miss Reloads dations
CLUSTER 19 0.0 16 0.0 0 0
INDEX 315 0.0 315 0.0 0 0
SQL AREA 27,908 0.0 94,300 0.5 38 0
TABLE/PROCEDURE 3,793 2.6 6,017 6.5 55 0
TRIGGER 20 0.0 20 0.0 0 0
Shared Pool Advisory for DB: AHD Instance: ahd End Snap: 21
-> Note there is often a 1:Many correlation between a single logical object
in the Library Cache, and the physical number of memory objects associated
with it. Therefore comparing the number of Lib Cache objects (e.g. in
v$librarycache), with the number of Lib Cache Memory Objects is invalid
Estd
Shared Pool SP Estd Estd Estd Lib LC Time
Size for Size Lib Cache Lib Cache Cache Time Saved Estd Lib Cache
Estim (M) Factr Size (M) Mem Obj Saved (s) Factr Mem Obj Hits
88 .6 81 11,169 59,229 1.0 6,202,663
104 .7 96 13,308 59,237 1.0 6,207,373
120 .8 112 15,603 59,277 1.0 6,228,405
136 .9 127 18,086 59,348 1.0 6,265,370
152 1.0 142 19,501 59,379 1.0 6,295,279
168 1.1 157 21,035 59,426 1.0 6,314,861
184 1.2 172 22,038 59,455 1.0 6,325,903
200 1.3 187 23,807 59,459 1.0 6,328,446
216 1.4 202 25,911 59,460 1.0 6,329,386
232 1.5 217 28,194 59,461 1.0 6,330,245
248 1.6 232 29,884 59,462 1.0 6,330,914
264 1.7 248 31,127 59,462 1.0 6,331,222
280 1.8 263 32,878 59,463 1.0 6,331,563
296 1.9 278 34,121 59,463 1.0 6,331,898
312 2.1 295 36,139 59,463 1.0 6,332,102
SGA Memory Summary for DB: AHD Instance: ahd Snaps: 20 -21
SGA regions Size in Bytes
Database Buffers 687,865,856
Fixed Size 455,196
Redo Buffers 929,792
Variable Size 293,601,280
sum 982,852,124
SGA breakdown difference for DB: AHD Instance: ahd Snaps: 20 -21
Pool Name Begin value End value % Diff
java free memory 75,497,472 75,497,472 0.00
large free memory 41,943,040 41,943,040 0.00
shared 1M buffer 2,098,176 2,098,176 0.00
shared Checkpoint queue 846,912 846,912 0.00
shared FileOpenBlock 695,504 695,504 0.00
shared KGK heap 3,756 3,756 0.00
shared KGLS heap 1,230,944 1,438,740 16.88
shared KQR L PO 2,064 2,064 0.00
shared KQR M PO 2,480,924 2,514,220 1.34
shared KQR S PO 383,036 383,036 0.00
shared KQR S SO 5,636 5,636 0.00
shared KSXR pending messages que 841,036 841,036 0.00
shared KSXR receive buffers 1,033,000 1,033,000 0.00
shared MTTR advisory 97,412 97,412 0.00
shared PL/SQL DIANA 624,112 624,112 0.00
shared PL/SQL MPCODE 422,640 422,640 0.00
shared PLS non-lib hp 2,068 2,068 0.00
shared character set object 323,724 323,724 0.00
shared dictionary cache 1,610,880 1,610,880 0.00
shared errors 35,964 35,964 0.00
shared event statistics per sess 1,718,360 1,718,360 0.00
shared fixed allocation callback 300 300 0.00
shared free memory 26,982,004 26,841,956 -0.52
shared joxs heap init 4,220 4,220 0.00
shared kgl simulator 3,980,240 3,996,976 0.42
shared library cache 54,425,164 53,999,624 -0.78
shared message pool freequeue 834,752 834,752 0.00
shared miscellaneous 8,126,704 8,177,516 0.63
shared parameters 1,632 1,632 0.00
shared sessions 410,720 410,720 0.00
shared sim memory hea 377,656 377,656 0.00
shared sql area 66,513,080 66,768,476 0.38
shared subheap 45,216 45,216 0.00
shared table definiti 1,200 2,752 129.33
shared trigger defini 340 340 0.00
shared trigger inform 1,292 1,292 0.00
shared trigger source 100 100 0.00
buffer_cache 687,865,856 687,865,856 0.00
fixed_sga 455,196 455,196 0.00
log_buffer 918,528 918,528 0.00
init.ora Parameters for DB: AHD Instance: ahd Snaps: 20 -21
End value
Parameter Name Begin value (if different)
aq_tm_processes 1
background_dump_dest E:\oracle\admin\ahd\bdump
compatible 9.2.0.0.0
control_files E:\oracle\oradata\ahd\CONTROL01.C
core_dump_dest E:\oracle\admin\ahd\cdump
cursor_sharing SIMILAR
db_block_size 8192
db_cache_size 687865856
db_domain
db_file_multiblock_read_count 8
db_name ahd
db_writer_processes 2
dispatchers (PROTOCOL=TCP) (SERVICE=ahdXDB)
fast_start_mttr_target 300
hash_join_enabled TRUE
instance_name ahd
java_pool_size 75497472
job_queue_processes 10
large_pool_size 41943040
log_archive_dest_1 location=c:\archive
log_archive_format arc%d_%t_%s.arc
log_archive_start TRUE
open_cursors 300
pga_aggregate_target 367001600
processes 150
query_rewrite_enabled FALSE
remote_login_passwordfile EXCLUSIVE
shared_pool_size 159383552
sort_area_size 10485760
star_transformation_enabled FALSE
timed_statistics TRUE
undo_management AUTO
undo_retention 3600
undo_tablespace UNDOTBS1
user_dump_dest E:\oracle\admin\ahd\udump
End of ReportI am getting buffer busy waits on some tables.
Users are not experiencing any problem.Looks like you got bit by the CTD troll while sleeping.
Note also that (if I'm reading the report alright) out of 23 mins you have 6 seconds accounted to buffer busy waits.
Read the sample chapter here. -
Performance Issue: Wait event "log file sync" and "Execute to Parse %"
In one of our test environments users are complaining about slow response.
In statspack report folowing are the top-5 wait events
Event Waits Time (cs) Wt Time
log file parallel write 1,046 988 37.71
log file sync 775 774 29.54
db file scattered read 4,946 248 9.47
db file parallel write 66 248 9.47
control file parallel write 188 152 5.80
And after runing the same application 4 times, we are geting Execute to Parse % = 0.10. Cursor sharing is forced and query rewrite is enabled
When I view v$sql, following command is parsed frequently
EXECUTIONS PARSE_CALLS
SQL_TEXT
93380 93380
select SEQ_ORDO_PRC.nextval from DUAL
Please suggest what should be the method to troubleshoot this and if I need to check some more information
Regards,
Sudhanshu BhandariWell, of course, you probably can't eliminate this sort of thing entirely: a setup such as yours is inevitably a compromise. What you can do is make sure your log buffer is a good size (say 10MB or so); that your redo logs are large (at least 100MB each, and preferably large enough to hold one hour or so of redo produced at the busiest time for your database without filling up); and finally set ARCHIVE_LAG_TARGET to something like 1800 seconds or more to ensure a regular, routine, predictable log switch.
It won't cure every ill, but that sort of setup often means the redo subsystem ceases to be a regular driver of foreground waits. -
Hi: I'm analyzing this STATSPACK report: it is "volume test" on our UAT server, so most input is from 'bind variables'. Our shared pool is well utilized in oracle. Oracle redo logs is not appropriately configured on this server, as in 'Top 5 wait events' there are 2 for redos.
I need to know what else information can be dig-out from 'foreground wait events' & 'background wait events', and what can assist us to better understanding, in combination of 'Top 5 wait event's, that how the server/test went? it could be overwelming No. of wait events, so appreciate any helpful diagnostic or analysis. Database is oracle 11.2.0.4 upgraded from 11.2.0.3, on IBM AIX power system 64bit, level 6.x
STATSPACK report for
Database DB Id Instance Inst Num Startup Time Release RAC
~~~~~~~~ ----------- ------------ -------- --------------- ----------- ---
700000XXX XXX 1 22-Apr-15 12:12 11.2.0.4.0 NO
Host Name Platform CPUs Cores Sockets Memory (G)
~~~~ ---------------- ---------------------- ----- ----- ------- ------------
dXXXX_XXX AIX-Based Systems (64- 2 1 0 16.0
Snapshot Snap Id Snap Time Sessions Curs/Sess Comment
~~~~~~~~ ---------- ------------------ -------- --------- ------------------
Begin Snap: 5635 22-Apr-15 13:00:02 114 4.6
End Snap: 5636 22-Apr-15 14:00:01 128 8.8
Elapsed: 59.98 (mins) Av Act Sess: 0.6
DB time: 35.98 (mins) DB CPU: 19.43 (mins)
Cache Sizes Begin End
~~~~~~~~~~~ ---------- ----------
Buffer Cache: 2,064M Std Block Size: 8K
Shared Pool: 3,072M Log Buffer: 13,632K
Load Profile Per Second Per Transaction Per Exec Per Call
~~~~~~~~~~~~ ------------------ ----------------- ----------- -----------
DB time(s): 0.6 0.0 0.00 0.00
DB CPU(s): 0.3 0.0 0.00 0.00
Redo size: 458,720.6 8,755.7
Logical reads: 12,874.2 245.7
Block changes: 1,356.4 25.9
Physical reads: 6.6 0.1
Physical writes: 61.8 1.2
User calls: 2,033.7 38.8
Parses: 286.5 5.5
Hard parses: 0.5 0.0
W/A MB processed: 1.7 0.0
Logons: 1.2 0.0
Executes: 801.1 15.3
Rollbacks: 6.1 0.1
Transactions: 52.4
Instance Efficiency Indicators
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 99.98 Optimal W/A Exec %: 100.00
Library Hit %: 99.77 Soft Parse %: 99.82
Execute to Parse %: 64.24 Latch Hit %: 99.98
Parse CPU to Parse Elapsd %: 53.15 % Non-Parse CPU: 98.03
Shared Pool Statistics Begin End
Memory Usage %: 10.50 12.79
% SQL with executions>1: 69.98 78.37
% Memory for SQL w/exec>1: 70.22 81.96
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time
CPU time 847 50.2
enq: TX - row lock contention 4,480 434 97 25.8
log file sync 284,169 185 1 11.0
log file parallel write 299,537 164 1 9.7
log file sequential read 698 16 24 1.0
Host CPU (CPUs: 2 Cores: 1 Sockets: 0)
~~~~~~~~ Load Average
Begin End User System Idle WIO WCPU
1.16 1.84 19.28 14.51 66.21 1.20 82.01
Instance CPU
~~~~~~~~~~~~ % Time (seconds)
Host: Total time (s): 7,193.8
Host: Busy CPU time (s): 2,430.7
% of time Host is Busy: 33.8
Instance: Total CPU time (s): 1,203.1
% of Busy CPU used for Instance: 49.5
Instance: Total Database time (s): 2,426.4
%DB time waiting for CPU (Resource Mgr): 0.0
Memory Statistics Begin End
~~~~~~~~~~~~~~~~~ ------------ ------------
Host Mem (MB): 16,384.0 16,384.0
SGA use (MB): 7,136.0 7,136.0
PGA use (MB): 282.5 361.4
% Host Mem used for SGA+PGA: 45.3 45.8
Foreground Wait Events DB/Inst: XXXXXs Snaps: 5635-5636
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by Total Wait Time desc, Waits desc (idle events last)
Avg %Total
%Tim Total Wait wait Waits Call
Event Waits out Time (s) (ms) /txn Time
enq: TX - row lock contentio 4,480 0 434 97 0.0 25.8
log file sync 284,167 0 185 1 1.5 11.0
Disk file operations I/O 8,741 0 4 0 0.0 .2
direct path write 13,247 0 3 0 0.1 .2
db file sequential read 6,058 0 1 0 0.0 .1
buffer busy waits 1,800 0 1 1 0.0 .1
SQL*Net more data to client 29,161 0 1 0 0.2 .1
direct path read 7,696 0 1 0 0.0 .0
db file scattered read 316 0 1 2 0.0 .0
latch: shared pool 144 0 0 2 0.0 .0
CSS initialization 30 0 0 3 0.0 .0
cursor: pin S 10 0 0 9 0.0 .0
row cache lock 41 0 0 2 0.0 .0
latch: row cache objects 19 0 0 3 0.0 .0
log file switch (private str 8 0 0 7 0.0 .0
library cache: mutex X 28 0 0 2 0.0 .0
latch: cache buffers chains 54 0 0 1 0.0 .0
latch free 290 0 0 0 0.0 .0
control file sequential read 1,568 0 0 0 0.0 .0
log file switch (checkpoint 4 0 0 6 0.0 .0
direct path sync 8 0 0 3 0.0 .0
latch: redo allocation 60 0 0 0 0.0 .0
SQL*Net break/reset to clien 34 0 0 1 0.0 .0
latch: enqueue hash chains 45 0 0 0 0.0 .0
latch: cache buffers lru cha 7 0 0 2 0.0 .0
latch: session allocation 5 0 0 1 0.0 .0
latch: object queue header o 6 0 0 1 0.0 .0
ASM file metadata operation 30 0 0 0 0.0 .0
latch: In memory undo latch 15 0 0 0 0.0 .0
latch: undo global data 8 0 0 0 0.0 .0
SQL*Net message from client 6,362,536 0 278,225 44 33.7
jobq slave wait 7,270 100 3,635 500 0.0
SQL*Net more data from clien 7,976 0 15 2 0.0
SQL*Net message to client 6,362,544 0 8 0 33.7
Background Wait Events DB/Inst: XXXXXs Snaps: 5635-5636
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by Total Wait Time desc, Waits desc (idle events last)
Avg %Total
%Tim Total Wait wait Waits Call
Event Waits out Time (s) (ms) /txn Time
log file parallel write 299,537 0 164 1 1.6 9.7
log file sequential read 698 0 16 24 0.0 1.0
db file parallel write 9,556 0 13 1 0.1 .8
os thread startup 146 0 10 70 0.0 .6
control file parallel write 2,037 0 2 1 0.0 .1
Log archive I/O 35 0 1 30 0.0 .1
LGWR wait for redo copy 2,447 0 0 0 0.0 .0
db file async I/O submit 9,556 0 0 0 0.1 .0
db file sequential read 145 0 0 2 0.0 .0
Disk file operations I/O 349 0 0 0 0.0 .0
db file scattered read 30 0 0 4 0.0 .0
control file sequential read 5,837 0 0 0 0.0 .0
ADR block file read 19 0 0 4 0.0 .0
ADR block file write 5 0 0 15 0.0 .0
direct path write 14 0 0 2 0.0 .0
direct path read 3 0 0 7 0.0 .0
latch: shared pool 3 0 0 6 0.0 .0
log file single write 56 0 0 0 0.0 .0
latch: redo allocation 53 0 0 0 0.0 .0
latch: active service list 1 0 0 3 0.0 .0
latch free 11 0 0 0 0.0 .0
rdbms ipc message 314,523 5 57,189 182 1.7
Space Manager: slave idle wa 4,086 88 18,996 4649 0.0
DIAG idle wait 7,185 100 7,186 1000 0.0
Streams AQ: waiting for time 2 50 4,909 ###### 0.0
Streams AQ: qmn slave idle w 129 0 3,612 28002 0.0
Streams AQ: qmn coordinator 258 50 3,612 14001 0.0
smon timer 43 2 3,605 83839 0.0
pmon timer 1,199 99 3,596 2999 0.0
SQL*Net message from client 17,019 0 31 2 0.1
SQL*Net message to client 12,762 0 0 0 0.1
class slave wait 28 0 0 0 0.0
thank you very much!Hi: just know it now: it is a large amount of 'concurrent transaction' designed in this "Volume Test" - to simulate large incoming transaction volme, so I guess wait in eq:TX - row is expected.
The fact: (1) redo logs at uat server is known to not well-tune for configurations (2) volume test slow 5%, however data amount in its test is kept the same by each time import production data, by the team. So why it slowed 5% this year?
The wait histogram is pasted below, any one interest to take a look? any ideas?
Wait Event Histogram DB/Inst: XXXX/XXXX Snaps: 5635-5636
-> Total Waits - units: K is 1000, M is 1000000, G is 1000000000
-> % of Waits - column heading: <=1s is truly <1024ms, >1s is truly >=1024ms
-> % of Waits - value: .0 indicates value was <.05%, null is truly 0
-> Ordered by Event (idle events last)
Total ----------------- % of Waits ------------------
Event Waits <1ms <2ms <4ms <8ms <16ms <32ms <=1s >1s
ADR block file read 19 26.3 5.3 10.5 57.9
ADR block file write 5 40.0 60.0
ADR file lock 6 100.0
ARCH wait for archivelog l 14 100.0
ASM file metadata operatio 30 100.0
CSS initialization 30 100.0
Disk file operations I/O 9090 97.2 1.4 .6 .4 .2 .1 .1
LGWR wait for redo copy 2447 98.5 .5 .4 .2 .2 .2 .1
Log archive I/O 35 40.0 8.6 25.7 2.9 22.9
SQL*Net break/reset to cli 34 85.3 8.8 5.9
SQL*Net more data to clien 29K 99.9 .0 .0 .0 .0 .0
buffer busy waits 1800 96.8 .7 .7 .6 .3 .4 .5
control file parallel writ 2037 90.7 5.0 2.1 .8 1.0 .3 .1
control file sequential re 7405 100.0 .0
cursor: pin S 10 10.0 90.0
db file async I/O submit 9556 99.9 .0 .0 .0
db file parallel read 1 100.0
db file parallel write 9556 62.0 32.4 1.7 .8 1.5 1.3 .1
db file scattered read 345 72.8 3.8 2.3 11.6 9.0 .6
db file sequential read 6199 97.2 .2 .3 1.6 .7 .0 .0
direct path read 7699 99.1 .4 .2 .1 .1 .0
direct path sync 8 25.0 37.5 12.5 25.0
direct path write 13K 97.8 .9 .5 .4 .3 .1 .0
enq: TX - row lock content 4480 .4 .7 1.3 3.0 6.8 12.3 75.4 .1
latch free 301 98.3 .3 .7 .7
latch: In memory undo latc 15 93.3 6.7
latch: active service list 1 100.0
latch: cache buffers chain 55 94.5 3.6 1.8
latch: cache buffers lru c 9 88.9 11.1
latch: call allocation 6 100.0
latch: checkpoint queue la 3 100.0
latch: enqueue hash chains 45 97.8 2.2
latch: messages 4 100.0
latch: object queue header 7 85.7 14.3
latch: redo allocation 113 97.3 1.8 .9
latch: row cache objects 19 89.5 5.3 5.3
latch: session allocation 5 80.0 20.0
latch: shared pool 147 90.5 1.4 2.7 1.4 .7 1.4 2.0
latch: undo global data 8 100.0
library cache: mutex X 28 89.3 3.6 3.6 3.6
log file parallel write 299K 95.6 2.6 1.0 .4 .3 .2 .0
log file sequential read 698 29.5 .1 4.6 46.8 18.9
log file single write 56 100.0
log file switch (checkpoin 4 25.0 50.0 25.0
log file switch (private s 8 12.5 37.5 50.0
log file sync 284K 93.3 3.7 1.4 .7 .5 .3 .1
os thread startup 146 100.0
row cache lock 41 85.4 9.8 2.4 2.4
DIAG idle wait 7184 100.0
SQL*Net message from clien 6379K 86.6 5.1 2.9 1.3 .7 .3 2.8 .3
SQL*Net message to client 6375K 100.0 .0 .0 .0 .0 .0 .0
Wait Event Histogram DB/Inst: XXXX/xxxx Snaps: 5635-5636
-> Total Waits - units: K is 1000, M is 1000000, G is 1000000000
-> % of Waits - column heading: <=1s is truly <1024ms, >1s is truly >=1024ms
-> % of Waits - value: .0 indicates value was <.05%, null is truly 0
-> Ordered by Event (idle events last)
Total ----------------- % of Waits ------------------
Event Waits <1ms <2ms <4ms <8ms <16ms <32ms <=1s >1s
SQL*Net more data from cli 7976 99.7 .1 .1 .0 .1
Space Manager: slave idle 4086 .1 .2 .0 .0 .3 3.2 96.1
Streams AQ: qmn coordinato 258 49.2 .8 50.0
Streams AQ: qmn slave idle 129 100.0
Streams AQ: waiting for ti 2 50.0 50.0
class slave wait 28 92.9 3.6 3.6
jobq slave wait 7270 .0 100.0
pmon timer 1199 100.0
rdbms ipc message 314K 10.3 7.3 39.7 15.4 10.6 5.3 8.2 3.3
smon timer 43 100.0
Maybe you are looking for
-
Xml matrix report not expending horizontally
hi guys m trying to develop xml matrix report but m totally stuck.value are not expanding vertically. RTF tags are here.Plz tell me how can i attach rtf and xml file with this post so you people can help me in better way. plz help me its very urgent
-
Forcing pdf to open in current browser window
I have a pdf (that is to be viewed through a browser) with links that open other pdfs. Currently, when I click on the links in this pdf, they open the linked pdfs in a separate browser window. Is there a way to force it to open in the same window and
-
Summation of column in Bex Report
Hi All, I have a requirement where user wants to see that no. of Materials belongs to each vendor. And at the end of query user wants to see the over all count of material. I am able to get no. of Materials belongs to each vendor but I am not able t
-
Dear all, I am applying support packages on SAP BW 3.1. On support package basis 20, the status bar display "Main import finished with return code 0" and the clock show in process but no activity. When i checked in os, TP show no cpu utilization and
-
Maximizing an application window
Mac newbie here; former windows user. How do I mazimize an application window. I.e. the equivalent of right clicking on the title bar in Windows and selecting Windows?