Latch: cache buffers chains
Hi,
I am facing the following in my DB.Oracle version is 11.1.0.7.0
Event Waits Time(s) Avg wait (ms) % DB time Wait Class
latch: cache buffers chains 37,910,465 17,344 0 42.64 Concurrency
I checked the SQL causing the wait using following query.
select count(*), SQL_ID from gv$active_session_history where event like '%cache buffers%' group by SQL_ID;
COUNT(*) SQL_ID
1
3 3wunvbmu64d8j
2 9q2ux8f92za7m
36000 47g8dw48ghk5s
2 5arqxftxr7tjr
Also i tried the following.
select count(*) child_count, sum(gets) sum_gets, sum(misses) sum_misses, sum(sleeps) sum_sleeps from v$latch_children where name = 'cache buffers chains';
CHILD_COUNT SUM_GETS SUM_MISSES SUM_SLEEPS
65536 1.5723E+10 3163139088 56744600
SQL> select P1 from v$session_wait where event = 'cache buffer chains';
no rows selected
How do i proceed with this?
SQL ID - 47g8dw48ghk5s is an update query.Can increasing freelists of this table help ??Kindly assist me.
Thanks.
user10698496 wrote:
Elapsed Time (s) CPU Time (s) Executions Elap per Exec (s) % Total DB Time SQL Id SQL Module SQL Text
29,725 6,747 82,289 0.36 73.08 47g8dw48ghk5s app2 (TNS V1-V3) UPDATE ZH_TBL SE
CPU Time (s) Elapsed Time (s) Executions CPU per Exec (s) % Total % Total DB Time SQL Id SQL Module SQL Text
6,747 29,725 82,289 0.08 62.52 73.08 47g8dw48ghk5s app2 (TNS V1-V3) UPDATE ZH_TBL SE...
Assuming that this is the standard one-hour snapshot that seems to be a rather small number of executions to waste so much latch time.
Moreover, since it's an update by rowid it's surprising that it should take so much CPU per executions unless you have a very large number of indexes on the table which have to be maintained.
Can you show us the "Load profile" and "Top 5 timed events" from the same period, plus the system summary bit (memory, cache size, CPU count) that's near the top of the report.
In your position I'd run up a little query to look at the stats in v$sql for that sql_id, and watch the executions, buffer_gets, cpu_time etc. changing over a few minutes in case there's something funny with the snapshot and youre losing large numbers in the execution counts. (I'd be particularly interested in the number of CPUs you have, and the CPU load on the system - sometimes you can get really wierd latching issue which are basically caused by CPU loading, especially on NUMA systems).
Since you've got the ASH data, there's also more information you can get from there - is it
a) the same latch all the time
b) a small number of different latches
c) a small number of different latches, but the same latch for any specific sid/serial
d) does the latch seem to change over time
If it's a small number of fixed latches you may be able to query the buffer cache with the latch address to see if there are any "obvious" blocks with a high touch count covered by those latches - they may be things like the root blocks of indexes used for referential integrity.
If the latch seems to keep moving it could be an indication that the update is slowly travelling along a table and every block is subject to competition from a number of concurrent processes.
Kyle Hailey has some sample queries against ASH that may point you in the right direction: http://sites.google.com/site/embtdbo/wait-event-documentation/oracle-latch-cache-buffers-chains
If you can spot a session hitting the problem you could also start tracing it to see if that level of detail gives you more clues, and I'd also start thinking about read up Tanel's notes.
Regards
Jonathan Lewis
To post code, statspack/AWR report, execution plans or trace files, START and END the text with the tag {noformat}{noformat} (the word "code" in lowercase, curly brackets, no spaces) so that the text appears in fixed format.
There is a +"Preview"+ tab at the top of the text entry panel. Use this to check what your message will look like before you post the message. If it looks a complete mess you're unlikely to get a response. (Click on the +"Plain text"+ tab if you want to edit the text to tidy it up.)
Similar Messages
-
AWR showing high latch: cache buffers chains
OS:Solaris 5.8
DB:10.2.0.2
AWR report show high latch: cache buffers chains . Please suggestuser8850066 wrote:
OS:Solaris 5.8
DB:10.2.0.2
AWR report show high latch: cache buffers chains . Please suggestYour question is not sensible - so the first answer you got may be a complete waste of your time, or it may be a lucky shot in the dark that helps.
How did you decide that your "latch: cache buffers chains" was high ?
The evidence that led you to this conclusion may help us understand what your problem is and how to help you.
Regards
Jonathan Lewis
http://jonathanlewis.wordpress.com
http://www.jlcomp.demon.co.uk
To post code, statspack/AWR report, execution plans or trace files, start and end the section with the tag {noformat}{noformat} (lowercase, curly brackets, no spaces) so that the text appears in fixed format.
There is a +"Preview"+ tab at the top of the text entry panel. Use this to check what your message will look like before you post the message. If it looks a complete mess you're unlikely to get a response. (Click on the +"Plain text"+ tab if you want to edit the text to tidy it up.)
+"I believe in evidence. I believe in observation, measurement, and reasoning, confirmed by independent observers. I'll believe anything, no matter how wild and ridiculous, if there is evidence for it. The wilder and more ridiculous something is, however, the firmer and more solid the evidence will have to be."+
Isaac Asimov -
Why the event latch: cache buffers chains wait event arises and resolution
Can any one please give full information about:
latch: cache buffers chains wait event
Why this event arises and resolution?Google gave me
http://www.pythian.com/news/1135/tuning-latch-contention-cache-buffers-chain-latches/ -
100 %CPU utilizationis , cache buffers chains and cursor: pin S
Hi every one ,
we have incident causing system response very slow with very bad response time, below top 5 wait events from AWR (RAC database)
Event Waits Time(s) Avg Wait(ms) % Total Call Time Wait Class
latch: cache buffers chains 122,492 198,139 1,618 16.8 Concurrency
gc buffer busy 119,903 83,248 694 7.1 Cluster
cursor: pin S 18,674,280 72,651 4 6.2 Other
log file sync 639,867 66,673 104 5.7
Commit latch free 143,519 54,239 378 4.6 Other
Oracle support clearly identified the issue with latch cache buffer chains as SQL statement executed around 35000 times which is too high based on execution plan . and they suggest to tune SQL statements .
my question is cursor: pin S wait on X and library cache lock related ot it is just a symptoms , and is document 742599.1 applicable to us or not as we have 10.2.0.5 (suggest disable automatic memory management)
As I know high CPU utilization as result of latch: cache buffers chains , the cursor Pin S Wait should not .
Thank you in advanceHi,
All these 4 top events (excluding log file sync) are quite unusual and in your case, if all these are comming atop, these quite well be related. So, you can't say that cursor pin s wait on x should not be dealt saperatly, but, still you can try out suggestion in the note. First find out from v$sgasta about current allocation of shared pool, then after disabling automatic memory management, increase shared_pool significantly as compared to current value, and then monito the system
Definitely you should tune your SQL also, as suggested by support.
Salman -
question from oracler:
由于没有代码，所以sql语句没法改。
1、4_28_awr.html是最初的状态cache buffers chains 征用严重，后来我把热点的2个索引INFO_KEYWORD、PKKEY_ARTICLE单独挪到了16k和4k的非标准表空间，这样多增加了几个池子希望可以降低征用。
2、4_28_2awr.html虽然cache buffers chains 还是比较多，但是waitstime比较低，没有影响前台使用。
3、428_3_awr.html 是刚才cpu的使用率又上去了，做的awr报告，发现cache buffers chains仍然较多，waitstime明显上去了。
请教：因为没办法修改sql语句的程序代码，只能从数据库层面入手。尽量降低热点块。是不是可以尝试将2个索引表空间的pctfree再增加到30%或者更高。或者2个索引采用4k的非标准块，这样分布在每个块中的行会比较少一点。我觉得我设置的16k块大小可能有点问题，盼赐教。
http://t.askmaclean.com/viewthread.php?tid=866&extra=page%3D1%26amp%3Bfilter%3Ddigest就症结来看 是SQL语句存在优化空间，大多都Buffer Gets过高 这意味着大量的逻辑读
Logical reads: 952,053.46 511,723.68
在其中一个AWR中 每秒逻辑读 达到 7G
buffer gets 较高 存在优化的SQL包括：
SQL ordered by Gets
Resources reported for PL/SQL code includes the resources used by all SQL statements called by the code.
Total Buffer Gets: 1,733,719,818
Captured SQL account for 42.9% of Total
Buffer Gets Executions Gets per Exec %Total CPU Time (s) Elapsed Time (s) SQL Id SQL Module SQL Text
150,857,840 6 25,142,973.33 8.70 1296.33 1769.90 gmm6ktqrft6n1 select rowid, title, filep...
57,452,737 234 245,524.52 3.31 676.45 678.49 06r32459s5kzc select rowid, ArticleID, S...
50,264,264 2 25,132,132.00 2.90 311.70 329.90 731rq4a5rd9by select rowid, title, filep...
28,441,522 2 14,220,761.00 1.64 310.11 570.12 bxa7c0y5p6smg select rowid, title, filep...
28,440,949 2 14,220,474.50 1.64 279.11 464.68 68pwkvkgs7taj select rowid, title, filep...
28,433,242 2 14,216,621.00 1.64 234.45 391.91 f442cdh9hp6sk select rowid, title, filep...
粗略看 可能是因为 希望执行计划准确 而没有去绑定变量
这里考虑到 无法修改SQL 语句， 但是 有没有想过 通过其他手段(不修改语句 添加hint)而 改善其执行计划？
Segments by Logical Reads
Total Logical Reads: 1,733,719,818
Captured Segments account for 98.8% of Total
Owner Tablespace Name Object Name Subobject Name Obj. Type Logical Reads %Total
JSCMS JSCMS INFO_KEYWORD INDEX 1,159,873,824 66.90
JSCMS JSCMS PKKEY_ARTICLE INDEX 215,263,104 12.42
JSCMS JSCMS ARTICLE SYS_P76 TABLE PARTITION 198,657,088 11.46
逻辑较高的 segment 包括 INFO_KEYWORD 和 PKKEY_ARTICLE 把他们 移动到 block size的 非标准表空间上确实可以一定程度缓解 对这个segment 上buffer的交叉访问争用 ， 但是 使用 16KB的block size意味着 数据行的分布更为集中 ， 这可能导致段内buffer的争用加剧 。
建议：
1. 考虑在 不修改SQL文本 的情况下 调优SQL ，包括使用SQL Profile等技术
2. 考试使用 global hash index ，当然hash index不是一定能缓解cbc
3. 内存允许的话 可以吧 一个索引 keep到 db cache keep pool中(而非16k pool)，另一个使用 4k pool
一些Cache buffer chains相关的master Notes:
ODM FINDING:
Cache Buffers Chains Latch waits are caused by contention where multiple sessions waiting to read the same block.
Typical solutions are:-
o Look for SQL that accesses the blocks in question and determine if the repeated reads are necessary.
o Check for suboptimal SQL (this is the most common cause of the events) - look at the execution plan for the
SQL being run and try to reduce the gets per executions which will minimise the number of blocks being accessed
and therefore reduce the chances of multiple sessions contending for the same block
Note 34405.1 WAITEVENT: "buffer busy waits" Reference Note
@Note 42152.1 LATCH: CACHE BUFFERS CHAINS
Note 155971.1 Ext/Pub Resolving Intense and "Random" Buffer Busy Wait Performance Problems:
Note 163424.1 Ext/Pub How To Identify a Hot Block Within The Database Buffer Cache.:
These queries would benefit from tuning. They either do too much buffer gets (logical reads) per execution or just do a lot of buffer gets. Tuning these queries would lower the load on the CPU and reduce the CPU wait time. Check if all objects in these queries have representative and up to date stats present. Also check if all the indexes are present.
If a query does not do an excessive amount of gets for 1 run but when the query runs often, then lowering the amount of buffer gets per run with for example 10% will have a big impact overall.
To see the full SQL open the html AWR report and select SQL Statistics in the Main Report section, then select SQL ordered by Gets clicking on the SQL id then gives the complete statement.
"Cache Buffers Chains Latch waits are caused by contention where multiple sessions waiting to read the same block.
那么与
read by others session 这个等待事件有什么区别？"
通俗的说 (不深究技术细节)
CBC latch 是 大家都要逻辑读取同一个块，对于Consistent Read会使用kcbgtcr函数， kcbgtcr 函数可能使用2中模式去get cache buffer chains， 分别是 kcbgtcr: kslbegin excl 和 kcbgtcr: kslbegin shared， 在上述AWR中 主要是 kslbegin excl
“我们一般认为Latch结构是Mostly exclusive access的，也就是极少会有共享访问闩的机会。但Oracle一般对外宣称读取数据时服务进程是以共享模式使用cache buffers chains闩，这就造成了许多人误以为读读是不会出现latch: cache buffers chains争用的。
但是实际上查询语句大部分情况下仍需要以exclusive模式持有该类子闩(有时会以SHARED模式持有，这取决于读取时是使用kcbgtcr: kslbegin shared还是kcbgtcr: kslbegin excl；kcbgtcr是Oracle rdbms中重要的获取一致性读的函数，其含义为Kernal Cache Buffer GeT Cosistents Read，显然该函数存在两种获取cache buffers chains的方式即kslbegin shared和excl。与之相对应的是kcbgcur: kslbegin，kcbgcur的含义为Kernel Cache Buffer Get Current，该函数用以获取当前块以便修改，也就是”写”；很显然kcbgcur: kslbegin函数只有以excl排他方式持有child cache buffers chains latch的必要)，原因在于虽然是查询语句但同样需要修改buffer header结构，譬如修改tch抢手度、holder list的hash变量us_nxt、us_prv以及waiter list的hash变量wa_prv、wa_nxt等。换而言之读读是会引起Latch free:cache buffers chains等待的，而非许多人认为的仅有读写、写写会导致缓存链闩争用。”
FROM http://www.oracledatabase12g.com/archives/oracle%E9%97%A9latch-cache-buffers-chains.html
cache buffers chains kcbgtcr: kslbegin excl 0 28,633,140 27,628,172
cache buffers chains kcbrls: kslbegin 0 27,162,431 28,455,820
cache buffers chains kcbgtcr: fast path 0 1,969 2,664
read by others session 是这个block不在缓存(buffer cache)中，大家都想要访问这个block，但是只需要一个人去做物理读取到Buffer cache， 其他人在 有一个人去做physical read 的情况下非空闲(non-idle wait)等待即可。 -
After a data load the data increased by around 30%. After the load, one statement now takes 5h compared to 40min before the load. The statement runs during the nighty batch so there are no other connections. Statistics for tables and indexes are gathered and current.
I have compared the AWRs before the data load and the current AWR:
- latch: cache buffers increased from 12Mio waits to 95Mio waits. As a consequence CPU usage is very high during the load period.
- consistent gets increased 3 times
- select count(distinct(hladdr)) from x$bh; result is 8192
- I checked for hot blocks - there are none as there is no other process during that time
The slow statement is an CTAS like (The same statement runs in an environment with much more data in less time.)
CREATE TABLE XXX NOLOGGING PARALLEL TABLESPACE YYY COMPRESS PARTITION BY RANGE(...) select with some outer joins.
What else should I examine/consider?The object statistics including indexes are current & complete. I have rerun the whole queries on both environments - the plans are different.
Difference between the databases:
- the slow one uses AL32UTF8 as DB character set, the fast one WE8ISO8859P1.
- the fast DB has temporary tablespace on raw devices
SELECT
count(*)
FROM
SELECT
mand,
c2v_thk1, c2v_thk1origin,
c2v_thk1 AS thk1,
sustainid,
_from, _to,
FROM
SELECT
mand,
CASE WHEN c2v_thk1skr IS NOT NULL THEN c2v_thk1skr ELSE thk1 END AS c2v_thk1,
CASE WHEN c2v_thk1skr IS NOT NULL THEN thk1 ELSE NULL END AS c2v_thk1origin,
sustainid,
_from, _to,
FROM chem.exper LEFT OUTER JOIN
SELECT
olr.mand,
olr.sustainid,
o.handoverdate
FROM
chem.order olr, chem.ch_order o
WHERE
(olr.mand = o.mand AND olr.sustainorderno = o.sustainorderno) AND
olr.finishDate IS NULL AND
o.finishDate IS NULL
) v2o USING (mand, sustainid) LEFT OUTER JOIN
SELECT
mand, thk1, sustainid,
selling_retuid,
CASE WHEN liqudateStep = 0 THEN liqu_retuid ELSE NULL END AS liqu_retuid,
CASE WHEN liqudateStep = 0 THEN trj55_lastliqudate ELSE NULL END AS trj55_lastliqudate
FROM
SELECT
mand,
thk1,
sustainid,
DECODE(roleselling, 0, retuid, NULL) AS selling_retuid, DECODE(roleliqu, 1, retuid, NULL) AS liqu_retuid,
DECODE(roleliqu, 2, lastliqudate, NULL) AS trj55_lastliqudate,
ROW_NUMBER () OVER (PARTITION BY mand, thk1, sustainid ORDER BY roleliqu DESC NULLS LAST, lastliqudate DESC NULLS LAST,retuid) AS liqudateStep
FROM chem.sat_trj55etu trj55
WHERE finishDate IS NULL
WHERE
(liqudateStep = 1 OR liqu_retuid IS NULL OR selling_retuid IS NOT NULL)
) trj55 USING (mand, thk1, sustainid) LEFT OUTER JOIN
SELECT
mand,
thk1origin AS thk1,
thk1skr AS c2v_thk1skr
FROM chem.x_ref
WHERE finishDate IS NULL
) USING (mand, thk1) )
) bs LEFT OUTER JOIN (
SELECT
tk_pla.mand,
tk_pla.thk1company AS thk1,
CASE WHEN ss.thk1skr IS NOT NULL THEN ss.thk1skr ELSE tk_pla.thk1individual END AS tk_pla_thk1individual,
CASE WHEN ss.thk1skr IS NOT NULL THEN tk_pla.thk1individual ELSE NULL END AS tk_pla_thk1individualorigin,
FROM chem.sat_indy tk_pla, (SELECT * FROM chem.x_ref WHERE finishDate IS NULL) ss
WHERE tk_pla.finishDate IS NULL
AND (tk_pla.mand = ss.mand(+) AND tk_pla.thk1individual = ss.thk1origin(+))
AND tk_pla._to IS NULL
) tk_pla USING (mand, thk1);Slow environment with much less data (execution time much more since last data load; object statistics are current)
| Id | Operation | Name | Rows | Bytes |TempSpc| Cost (%CPU)| Time | Pstart| Pstop | TQ |IN-OUT| PQ Distrib |
| 0 | SELECT STATEMENT | | 1 | 62 | | 116 (6)| 00:00:02 | | | | |
| 1 | SORT AGGREGATE | | 1 | 62 | | | | | | | |
| 2 | NESTED LOOPS OUTER | | 90571 | 5483K| | 116 (6)| 00:00:02 | | | | |
| 3 | VIEW | | 73410 | 2437K| | 116 (6)| 00:00:02 | | | | |
| 4 | PX COORDINATOR | | | | | | | | | | |
| 5 | PX SEND QC (RANDOM) | :TQ10003 | 73410 | 10M| | 116 (6)| 00:00:02 | | | Q1,03 | P->S | QC (RAND)
| 6 | NESTED LOOPS OUTER | | 73410 | 10M| | 116 (6)| 00:00:02 | | | Q1,03 | PCWP |
| 7 | NESTED LOOPS OUTER | | 73410 | 8674K| | 115 (5)| 00:00:02 | | | Q1,03 | PCWP |
|* 8 | HASH JOIN RIGHT OUTER | | 73410 | 4588K| | 115 (5)| 00:00:02 | | | Q1,03 | PCWP |
| 9 | PX RECEIVE | | 49290 | 1540K| | 9 (12)| 00:00:01 | | | Q1,03 | PCWP |
| 10 | PX SEND HASH | :TQ10002 | 49290 | 1540K| | 9 (12)| 00:00:01 | | | Q1,02 | P->P | HASH
| 11 | VIEW | | 49290 | 1540K| | 9 (12)| 00:00:01 | | | Q1,02 | PCWP |
|* 12 | VIEW | | 49290 | 6979K| | 9 (12)| 00:00:01 | | | Q1,02 | PCWP |
| 13 | WINDOW SORT | | 49290 | 2406K| 7000K| 9 (12)| 00:00:01 | | | Q1,02 | PCWP |
| 14 | PX RECEIVE | | 49290 | 2406K| | 8 (0)| 00:00:01 | | | Q1,02 | PCWP |
| 15 | PX SEND HASH | :TQ10001 | 49290 | 2406K| | 8 (0)| 00:00:01 | | | Q1,01 | P->P | HASH
| 16 | PX BLOCK ITERATOR | | 49290 | 2406K| | 8 (0)| 00:00:01 | 1 | 6 | Q1,01 | PCWC |
|* 17 | TABLE ACCESS FULL | SAT_trj55etu | 49290 | 2406K| | 8 (0)| 00:00:01 | 1 | 6 | Q1,01 | PCWP |
| 18 | BUFFER SORT | | | | | | | | | Q1,03 | PCWC |
| 19 | PX RECEIVE | | 73410 | 2294K| | 106 (4)| 00:00:02 | | | Q1,03 | PCWP |
| 20 | PX SEND HASH | :TQ10000 | 73410 | 2294K| | 106 (4)| 00:00:02 | | | | S->P | HASH
| 21 | PARTITION RANGE ALL | | 73410 | 2294K| | 106 (4)| 00:00:02 | 1 | 6 | | |
| 22 | TABLE ACCESS FULL | exper | 73410 | 2294K| | 106 (4)| 00:00:02 | 1 | 6 | | |
| 23 | PARTITION RANGE ITERATOR | | 1 | 57 | | 0 (0)| 00:00:01 | KEY | KEY | Q1,03 | PCWP |
|* 24 | INDEX FAST FULL SCAN | X_x_ref | 1 | 57 | | 0 (0)| 00:00:01 | KEY | KEY | Q1,03 | PCWP |
|* 25 | VIEW PUSHED PREDICATE | | 1 | 35 | | 0 (0)| 00:00:01 | | | Q1,03 | PCWP |
|* 26 | TABLE ACCESS BY LOCAL INDEX ROWID| order | 1 | 106 | | 0 (0)| 00:00:01 | 1 | 1 | Q1,03 | PCWP |
| 27 | NESTED LOOPS | | 1 | 199 | | 0 (0)| 00:00:01 | | | Q1,03 | PCWP |
| 28 | PARTITION RANGE ALL | | 1 | 93 | | 0 (0)| 00:00:01 | 1 | 6 | Q1,03 | PCWP |
|* 29 | INDEX SKIP SCAN | X_ch_order | 1 | 93 | | 0 (0)| 00:00:01 | 1 | 6 | Q1,03 | PCWP |
| 30 | PARTITION RANGE SINGLE | | 1 | | | 0 (0)| 00:00:01 | KEY | KEY | Q1,03 | PCWP |
|* 31 | INDEX RANGE SCAN | XPKorder | 1 | | | 0 (0)| 00:00:01 | KEY | KEY | Q1,03 | PCWP |
| 32 | PX COORDINATOR | | | | | | | | | | |
| 33 | PX SEND QC (RANDOM) | :TQ20000 | 1 | 28 | | 0 (0)| 00:00:01 | | | Q2,00 | P->S | QC (RAND)
|* 34 | VIEW PUSHED PREDICATE | | 1 | 28 | | 0 (0)| 00:00:01 | | | Q2,00 | PCWP |
| 35 | NESTED LOOPS OUTER | | 40517 | 3204K| | 2 (0)| 00:00:01 | | | Q2,00 | PCWP |
| 36 | PX BLOCK ITERATOR | | 40517 | 1463K| | 2 (0)| 00:00:01 | KEY | KEY | Q2,00 | PCWC |
|* 37 | TABLE ACCESS FULL | SAT_INDI | 40517 | 1463K| | 2 (0)| 00:00:01 | KEY | KEY | Q2,00 | PCWP |
| 38 | PARTITION RANGE ITERATOR | | 1 | 44 | | 0 (0)| 00:00:01 | KEY | KEY | Q2,00 | PCWP |
|* 39 | INDEX FAST FULL SCAN | X_x_ref | 1 | 44 | | 0 (0)| 00:00:01 | KEY | KEY | Q2,00 | PCWP |
Predicate Information (identified by operation id):
8 - access("exper"."mand"="trj55"."mand"(+) AND "exper"."thk1"="trj55"."thk1"(+) AND
"exper"."sustainID"="trj55"."sustainID"(+))
12 - filter("liqudateStep"=1 OR "liqu_retuID" IS NULL OR "SELLIN
17 - filter("finishDate" IS NULL)
24 - filter("finishDate"(+) IS NULL AND "exper"."mand"="mand"(+) AND "exper"."thk1"="thk1ORIGIN"(+))
25 - filter("exper"."sustainID"="V2O"."sustainID"(+))
26 - filter("olr"."finishDate" IS NULL)
29 - access("O"."finishDate" IS NULL)
filter("O"."finishDate" IS NULL)
31 - access("olr"."mand"="O"."mand" AND "olr"."sustainORDERNO"="O"."sustainORDERNO")
filter("olr"."mand"="exper"."mand")
34 - filter("BS"."thk1"="tk_pla"."thk1"(+))
37 - filter("tk_pla"."finishDate" IS NULL AND "tk_pla"."_to" IS NULL AND "tk_pla"."mand"="BS"."mand")
39 - filter("finishDate"(+) IS NULL AND "tk_pla"."mand"="x_ref"."mand"(+) AND "tk_pla"."thk1INDIVIDUAL"="x_ref"."thk1ORIGIN"(+))
optimizer_dynamic_sampling integer 2
optimizer_features_enable string 10.2.0.3
optimizer_index_caching integer 0
optimizer_index_cost_adj integer 100
optimizer_mode string ALL_ROWS
optimizer_secure_view_merging boolean TRUE
db_file_multiblock_read_count integer 32
db_block_size integer 8192
parallel_max_servers integer 17
parallel_min_percent integer 0
parallel_min_servers integer 0
parallel_server boolean FALSE
parallel_server_instances integer 1
parallel_threads_per_cpu integer 2
SYSSTATS_INFO FLAGS 1
SYSSTATS_MAIN CPUSPEEDNW 1653.70019
SYSSTATS_MAIN IOSEEKTIM 10
SYSSTATS_MAIN IOTFRSPEED 4096
SYSSTATS_MAIN SREADTIM 3.684
SYSSTATS_MAIN MREADTIM
SYSSTATS_MAIN CPUSPEED 1471
{code}
Fast environment with more data
{code}
| Id | Operation | Name | Rows | Bytes |TempSpc| Cost (%CPU)| Time | Pstart| Pstop | TQ |IN-OUT| PQ Distrib |
| 0 | SELECT STATEMENT | | 1 | 33 | | 52357 (6)| 00:04:29 | | | | | |
| 1 | SORT AGGREGATE | | 1 | 33 | | | | | | | | |
| 2 | PX COORDINATOR | | | | | | | | | | | |
| 3 | PX SEND QC (RANDOM) | :TQ10010 | 1 | 33 | | | | | | Q1,10 | P->S | QC (RAND) |
| 4 | SORT AGGREGATE | | 1 | 33 | | | | | | Q1,10 | PCWP | |
|* 5 | HASH JOIN RIGHT OUTER | | 22M| 698M| | 52357 (6)| 00:04:29 | | | Q1,10 | PCWP | |
| 6 | PX RECEIVE | | 294K| 4020K| | 86 (3)| 00:00:01 | | | Q1,10 | PCWP | |
| 7 | PX SEND BROADCAST | :TQ10007 | 294K| 4020K| | 86 (3)| 00:00:01 | | | Q1,07 | P->P | BROADCAST |
| 8 | VIEW | | 294K| 4020K| | 86 (3)| 00:00:01 | | | Q1,07 | PCWP | |
|* 9 | HASH JOIN OUTER BUFFERED | | 294K| 10M| | 86 (3)| 00:00:01 | | | Q1,07 | PCWP | |
| 10 | PX RECEIVE | | 294K| 6892K| | 77 (2)| 00:00:01 | | | Q1,07 | PCWP | |
| 11 | PX SEND HASH | :TQ10002 | 294K| 6892K| | 77 (2)| 00:00:01 | | | Q1,02 | P->P | HASH |
| 12 | PX BLOCK ITERATOR | | 294K| 6892K| | 77 (2)| 00:00:01 | 1 | 6 | Q1,02 | PCWC | |
|* 13 | TABLE ACCESS FULL | SAT_INDI | 294K| 6892K| | 77 (2)| 00:00:01 | 1 | 6 | Q1,02 | PCWP | |
| 14 | PX RECEIVE | | 71698 | 980K| | 8 (0)| 00:00:01 | | | Q1,07 | PCWP | |
| 15 | PX SEND HASH | :TQ10003 | 71698 | 980K| | 8 (0)| 00:00:01 | | | Q1,03 | P->P | HASH |
| 16 | PX BLOCK ITERATOR | | 71698 | 980K| | 8 (0)| 00:00:01 | 1 | 6 | Q1,03 | PCWC | |
|* 17 | INDEX FAST FULL SCAN | X_x_ref | 71698 | 980K| | 8 (0)| 00:00:01 | 1 | 6 | Q1,03 | PCWP | |
| 18 | VIEW | | 22M| 402M| | 52253 (6)| 00:04:28 | | | Q1,10 | PCWP | |
|* 19 | HASH JOIN RIGHT OUTER | | 22M| 1524M| | 52253 (6)| 00:04:28 | | | Q1,10 | PCWP | |
| 20 | PX RECEIVE | | 1673K| 28M| | 706 (3)| 00:00:04 | | | Q1,10 | PCWP | |
| 21 | PX SEND HASH | :TQ10008 | 1673K| 28M| | 706 (3)| 00:00:04 | | | Q1,08 | P->P | HASH |
| 22 | VIEW | | 1673K| 28M| | 706 (3)| 00:00:04 | | | Q1,08 | PCWP | |
|* 23 | VIEW | | 1673K| 111M| | 706 (3)| 00:00:04 | | | Q1,08 | PCWP | |
| 24 | WINDOW SORT | | 1673K| 63M| 192M| 706 (3)| 00:00:04 | | | Q1,08 | PCWP | |
| 25 | PX RECEIVE | | 1673K| 63M| | 695 (2)| 00:00:04 | | | Q1,08 | PCWP | |
| 26 | PX SEND HASH | :TQ10004 | 1673K| 63M| | 695 (2)| 00:00:04 | | | Q1,04 | P->P | HASH
| 27 | PX BLOCK ITERATOR | | 1673K| 63M| | 695 (2)| 00:00:04 | 1 | 6 | Q1,04 | PCWC |
|* 28 | TABLE ACCESS FULL | SAT_trj55etu | 1673K| 63M| | 695 (2)| 00:00:04 | 1 | 6 | Q1,04 | PCWP |
| 29 | PX RECEIVE | | 22M| 1143M| | 51528 (6)| 00:04:25 | | | Q1,10 | PCWP |
| 30 | PX SEND HASH | :TQ10009 | 22M| 1143M| | 51528 (6)| 00:04:25 | | | Q1,09 | P->P | HASH
|* 31 | HASH JOIN RIGHT OUTER | | 22M| 1143M| | 51528 (6)| 00:04:25 | | | Q1,09 | PCWP |
| 32 | PX RECEIVE | | 504K| 6893K| | 167 (3)| 00:00:01 | | | Q1,09 | PCWP |
| 33 | PX SEND BROADCAST | :TQ10005 | 504K| 6893K| | 167 (3)| 00:00:01 | | | Q1,05 | P->P | BROADCAST
| 34 | VIEW | | 504K| 6893K| | 167 (3)| 00:00:01 | | | Q1,05 | PCWP |
|* 35 | HASH JOIN | | 504K| 21M| | 167 (3)| 00:00:01 | | | Q1,05 | PCWP |
| 36 | PX BLOCK ITERATOR | | 692K| 16M| | 67 (2)| 00:00:01 | 1 | 6 | Q1,05 | PCWC |
|* 37 | INDEX FAST FULL SCAN | X_order | 692K| 16M| | 67 (2)| 00:00:01 | 1 | 6 | Q1,05 | PCWP |
| 38 | BUFFER SORT | | | | | | | | | Q1,05 | PCWC |
| 39 | PX RECEIVE | | 698K| 12M| | 98 (3)| 00:00:01 | | | Q1,05 | PCWP |
| 40 | PX SEND BROADCAST LOCAL| :TQ10001 | 698K| 12M| | 98 (3)| 00:00:01 | | | Q1,01 | P->P | BCSTLOCAL
| 41 | PX BLOCK ITERATOR | | 698K| 12M| | 98 (3)| 00:00:01 | 1 | 6 | Q1,01 | PCWC |
|* 42 | INDEX FAST FULL SCAN | X_ch_order | 698K| 12M| | 98 (3)| 00:00:01 | 1 | 6 | Q1,01 | PCWP |
|* 43 | HASH JOIN RIGHT OUTER | | 22M| 846M| | 51344 (6)| 00:04:24 | | | Q1,09 | PCWP |
| 44 | PX RECEIVE | | 71698 | 1400K| | 8 (0)| 00:00:01 | | | Q1,09 | PCWP |
| 45 | PX SEND HASH | :TQ10006 | 71698 | 1400K| | 8 (0)| 00:00:01 | | | Q1,06 | P->P | HASH
| 46 | PX BLOCK ITERATOR | | 71698 | 1400K| | 8 (0)| 00:00:01 | 1 | 6 | Q1,06 | PCWC |
|* 47 | INDEX FAST FULL SCAN | X_x_ref | 71698 | 1400K| | 8 (0)| 00:00:01 | 1 | 6 | Q1,06 | PCWP |
| 48 | BUFFER SORT | | | | | | | | | Q1,09 | PCWC |
| 49 | PX RECEIVE | | 22M| 423M| | 51319 (6)| 00:04:24 | | | Q1,09 | PCWP |
| 50 | PX SEND HASH | :TQ10000 | 22M| 423M| | 51319 (6)| 00:04:24 | | | | S->P | HASH
| 51 | PARTITION RANGE ALL | | 22M| 423M| | 51319 (6)| 00:04:24 | 1 | 6 | | |
| 52 | TABLE ACCESS FULL | exper | 22M| 423M| | 51319 (6)| 00:04:24 | 1 | 6 | | |
Predicate Information (identified by operation id):
5 - access("BS"."mand"="tk_pla"."mand"(+) AND "BS"."thk1"="tk_pla"."thk1"(+))
9 - access("tk_pla"."mand"="x_ref"."mand"(+) AND "tk_pla"."thk1INDIVIDUAL"="x_ref"."thk1ORIGIN"(+))
13 - filter("tk_pla"."finishDate" IS NULL AND "tk_pla"."_to" IS NULL)
17 - filter("finishDate"(+) IS NULL)
19 - access("exper"."mand"="trj55"."mand"(+) AND "exper"."thk1"="trj55"."thk1"(+) AND
"exper"."sustainID"="trj55"."sustainID"(+))
23 - filter("liqudateStep"=1 OR "liqu_retuID" IS NULL OR "SELLING_retuID" IS NOT NULL)
28 - filter("finishDate" IS NULL)
31 - access("exper"."mand"="V2O"."mand"(+) AND "exper"."sustainID"="V2O"."sustainID"(+))
35 - access("olr"."mand"="O"."mand" AND "olr"."sustainORDERNO"="O"."sustainORDERNO")
37 - filter("olr"."finishDate" IS NULL)
42 - filter("O"."finishDate" IS NULL)
43 - access("exper"."mand"="mand"(+) AND "exper"."thk1"="thk1ORIGIN"(+))
47 - filter("finishDate"(+) IS NULL)
optimizer_dynamic_sampling integer 2
optimizer_features_enable string 10.2.0.3
optimizer_index_caching integer 0
optimizer_index_cost_adj integer 100
optimizer_mode string ALL_ROWS
optimizer_secure_view_merging boolean TRUE
db_file_multiblock_read_count integer 32
db_block_size integer 8192
parallel_max_servers integer 17
parallel_min_percent integer 0
parallel_min_servers integer 0
parallel_server boolean FALSE
parallel_server_instances integer 1
parallel_threads_per_cpu integer 2
(actually workload stats are missing)
SYSSTATS_INFO FLAGS 1
SYSSTATS_MAIN CPUSPEEDNW 1644.207
SYSSTATS_MAIN IOSEEKTIM 3.775
SYSSTATS_MAIN IOTFRSPEED 6059.372
SYSSTATS_MAIN SREADTIM
SYSSTATS_MAIN MREADTIM
SYSSTATS_MAIN CPUSPEED 1663
{code}
Edited by: TanteKaethe on May 26, 2009 1:38 PM -
Slow/choppy playback - cache buffering issue
On playback, PP6 randomly slows down and plays back choppy on visually complex shots. It takes repeated stops and starts to clear it out. I have troubleshot the life out of this, read every relevant thread, and tried everything imaginable to fix it. Windows 7 pro is fully optimized. There are no software conflicts (installed a drive with only windows and CS6) I’ve got plenty of horsepower - 3930K in an asusp9x79pro, gtx 670 w/4mb, 32mb ram, OC to 4.5. Eric Bowen at ADK has personally tuned the system and done a manual overclock. Memtest confirms the ram is fine. There are no hardware issues. Dropped frame indicator stays green, no dropped frames. Switching from hardware to software mercury playback does nothing. Rendering has no effect, nor do any playback settings. It happens with AVCHD and h.264 mp4’s as well, on short clips, not just long ones. It does not happen outside of ppro. Since I have eliminated hardware and software issues, all this leaves is Premiere.
As Eric explains it, it is a cache buffering issue, related to how the nvidia card and ppro interact, and he sees it frequently enough. I can't do his explanation justice, but he has offered to jump in and provide more detail if need be.
Whatever it is, it’s ridiculous. It is totally unacceptable to play down a sequence and have it intermittently slow down on a system with this much power that has been properly set up by a pro. It’s a shame, because it’s the only thing from keeping ppro/cs6 from being the best platform I’ve edited on in my 12 years as an editor.
I’ve filed a bug report, but gotten no response. If others are seeing it, and can file a bug report, maybe it will be publicly acknowledged and resolved.
https://www.adobe.com/cfusion/mmform/index.cfm?name=wishformHi,
I think I have similair problem. First of all my current specs is:
Asus Sabertooth z77 mainboard with intel i7 2700K processor
32 gb (8*4) ram
120 gb ssd sata3 drive for OS and CS6
500 gb sata3 7200rpm hd for cache files
1 tb sata3 7200rpm hd for source video and audio
and finally Nvidia GeForce GTX 660 Ti with 2gb of memory
Blackmagic shuttle io card etc
This system were combined specially for my endless highend compositing needs and it works like a charm with all applications other than Premiere Pro.
Yesterday I barley finished editing a short (approx 2 minutes) 1080p project that shot with Canon 5D MKII. Without using mercury playback engine application
works fine but once I activate it all playback became really slow and laggy and sometime it freeze if I move playhead quickly.
I only use one video and one audio track in timeline so we can say this editing scenario is a fundamental for production grade NLE application.
My graphic processor has a lot of cuda power but Adobe doesn't support it natively so I have to edit the famous text file.
On CS5 and CS5.5 I done lots of 1080p project with my old gtx 480 card and I never encountered any similair problem.
I hope my favorite and trusted software company Adobe will find the problem and will fix it soon...
Thanks
M.Maya -
Difference between wait events 'buffer busy waits' & 'latch: CBC'
Hi ,
Can some one explain me the Difference Between 'Buffer Busy Waits' and 'Latch: Cache Buffers Chains"? What was explained in metalink note Doc ID: 833303.1
, is incomprehensible to me.
Looking for easy and better explanation.
Thanks
NaveenNaveen Sangam wrote:
Can some one explain me the Difference Between 'Buffer Busy Waits' and 'Latch: Cache Buffers Chains"? What was explained in metalink note Doc ID: 833303.1
, is incomprehensible to me.
That note is awful and should be witdrawn - amongst other things it makes it sound as if there is only one reason for buffer busy waits. There is an option to comment on such notes - I suggest you use it.
Going back a little further from Aman's description - and ignoring some of the internal details:
The buffer cache is split into a large number of small groups of buffered blocks; these groups are usually called "hash buckets" or "hash chains". If you need to find a block and it is buffered, Oracle can do some hashing arithmetic to work out which chain the block will be in.
The chains are protected by latches (typically a single latch protects 64 - 128 chains). You cannot examine a chain unless you are able to get the latch that protects it. So the commonest action you go through to view or modify a buffered block is:
<ul>
work out which chain
get the latch for the chain xxx
search along the chain to see if the block is in memory
attach a "pin" to the buffered block block if you find it (to make sure it can't be kicked out of memory)
release the latch
do what you want to do with the buffered block ***
get the latch for the chain xxx
remove the pin from the buffered block
release the latch
</ul>
The two points marked xxx are where you might end up sleeping in a wait for the "cache buffers chains latch". If too many people try to get the latch at the same time some of them will eventually fail and go to sleep for a short period.
The point marked *** is where you get the buffer busy wait. When you attach the pin to the buffered block it's possible that what you want to do to the bllock is incompatible with what other people are already doing - so you have to attach your pin to the "waiters" list (the people currently using the block will have their pins attached to the "users" list". Eventually your wait will time out, or the users will get out of the way and you can move your pin to the users list and do whatever it was you wanted to do.
Regards
Jonathan Lewis
http://jonathanlewis.wordpress.com
http://www.jlcomp.demon.co.uk
To post code, statspack/AWR report, execution plans or trace files, start and end the section with the tag {noformat}{noformat} (lowercase, curly brackets, no spaces) so that the text appears in fixed format.
"Science is more than a body of knowledge; it is a way of thinking"
Carl Sagan -
Latch contention in Oracle 10.2.0.4
Hello All,
There is one script which takes 8 hours to complete on one of our Oracle 10.2.0.3 databases.
The TKPROF Output shows the below Wait events:
Elapsed times include waiting on following events:
Event waited on Times Max. Wait Total Waited
---------------------------------------- Waited ---------- ------------
db file scattered read 28965 0.00 0.00
db file sequential read 1394318 0.00 0.00
SQL*Net message to client 4467645 0.00 0.00
SQL*Net message from client 4467645 0.00 0.00
latch: shared pool 2847 29.05 864.44
latch: library cache 1221 5.78 389.93
latch: row cache objects 126 0.58 2.39
latch: cache buffers chains 2765 0.02 0.16
log file sync 3 0.00 0.00
latch free 63 1.06 1.71
latch: object queue header operation 5 0.00 0.01
SQL*Net break/reset to client 1156 0.00 0.00
read by other session 21609 0.99 3.99
latch: library cache lock 1 0.01 0.01How can we reduce the "latch: shared pool" and "latch: library cache" wait/contentions?
The script in question runs 95 SELECT Statements, 3 UPDATE Statements and 1 INSERT Statement.
For more information, please let me know. Thanks.
Suddhasatwa.
Edited by: user13021719 on Mar 16, 2012 12:27 AMThanks for the above note.
yes the numbers are correct: there are 95 SELECT statements only in the program as well as in the TRACE file.
From the output of TKPROF I can see these 2 SELECT Statements taking maximum of these wait events:
TKPROF: Release 10.2.0.4.0 - Production on Fri Mar 16 01:25:38 2012
Copyright (c) 1982, 2007, Oracle. All rights reserved.
Trace file: hr84tax_ora_3391.trc
Sort options: exeela fchela prsela
count = number of times OCI procedure was executed
cpu = cpu time in seconds executing
elapsed = elapsed time in seconds executing
disk = number of physical reads of buffers from disk
query = number of buffers gotten for consistent read
current = number of buffers gotten in current mode (usually for update)
rows = number of rows processed by the fetch or execute call
SELECT PAYCALL2.PAY_BEGIN_DT, PAYCALL2.PAY_END_DT, PAYCALL2.CHECK_DT,
PSPCL1.COMPANY, PSPCL1.PAYGROUP, PSPCL1.PAY_END_DT, PSPCL1.PAGE_NUM,
PSPCL1.LINE_NUM, PSPCL1.OFF_CYCLE, PSPCL1.SEPCHK, PSPCL1.EMPLID,
PSPCL1.CHECK_DT, PSPCL1.PAYCHECK_OPTION, PSPCL1.PAYCHECK_STATUS
FROM
PS_PAY_CHECK PSPCL1, PS_PAY_CALENDAR PAYCALL2, PS_PAY_CAL_BAL_ID BALL1
WHERE PAYCALL2.COMPANY = BALL1.COMPANY AND PAYCALL2.PAYGROUP =
BALL1.PAYGROUP AND PAYCALL2.PAY_END_DT = BALL1.PAY_END_DT AND
BALL1.BALANCE_ID = :1 AND PAYCALL2.CHECK_DT >= :2 AND
PAYCALL2.CHECK_DT <= :3 AND PSPCL1.COMPANY = :4 AND PSPCL1.EMPLID
= :5 AND PSPCL1.COMPANY = PAYCALL2.COMPANY AND PSPCL1.PAYGROUP
= PAYCALL2.PAYGROUP AND PSPCL1.PAY_END_DT = PAYCALL2.PAY_END_DT AND
PSPCL1.PAYCHECK_STATUS IN ('F','R','A') ORDER BY PAYCALL2.CHECK_DT
call count cpu elapsed disk query current rows
Parse 11087 0.00 0.60 0 0 0 0
Execute 15222 0.00 17.59 11 22 0 0
Fetch 30444 0.00 16726.93 976663 8991463 0 23572
total 56753 0.00 16745.12 976674 8991485 0 23572
Misses in library cache during parse: 1
Misses in library cache during execute: 1
Optimizer mode: ALL_ROWS
Parsing user id: 28
Elapsed times include waiting on following events:
Event waited on Times Max. Wait Total Waited
---------------------------------------- Waited ---------- ------------
latch: shared pool 60 1.34 10.00
latch: library cache 22 0.34 0.86
SQL*Net message to client 41531 0.00 0.00
SQL*Net message from client 41531 0.00 0.00
db file sequential read 976663 0.00 0.00
latch: cache buffers chains 2 0.00 0.00
latch: object queue header operation 2 0.00 0.00
SELECT JB.OFFICER_CD, JB.EMPL_CLASS, JB.JOBCODE, JB.PAYGROUP,
JB.BUSINESS_UNIT, JB.STD_HOURS, JB.STD_HRS_FREQUENCY, JB.COMPRATE,
JB.EMPL_STATUS, JB.TAX_LOCATION_CD, JB.LOCATION, JB.EMPL_TYPE, JB.HOURLY_RT,
JB.EFFDT, JB.EFFSEQ, JB.EMPL_RCD, JB.DEPTID, JB.SETID_JOBCODE, JB.ESTABID,
JB.SAL_ADMIN_PLAN, JB.FICA_STATUS_EE, JB.SETID_LOCATION
from
PS_JOB JB Where JB.EMPLID = :1 AND JB.COMPANY = :2 AND JB.EFFDT =
(SELECT MAX(JB1.EFFDT) FROM PS_JOB JB1 WHERE JB1.EMPLID = JB.EMPLID
AND JB1.COMPANY = JB.COMPANY AND JB1.EFFDT <= :3) AND JB.EFFSEQ = (SELECT
MAX(JB2.EFFSEQ) FROM PS_JOB JB2 WHERE JB2.EMPLID = JB.EMPLID AND
JB2.COMPANY = JB.COMPANY AND JB2.EFFDT = JB.EFFDT) ORDER by JB.EFFDT,
JB.EFFSEQ
call count cpu elapsed disk query current rows
Parse 14305 0.00 1.62 0 0 0 0
Execute 25852 0.00 62.80 0 44 0 0
Fetch 51704 0.00 2429.58 167169 1036420 0 25888
total 91861 0.00 2494.01 167169 1036464 0 25888
Misses in library cache during parse: 1
Misses in library cache during execute: 1
Optimizer mode: ALL_ROWS
Parsing user id: 28
Elapsed times include waiting on following events:
Event waited on Times Max. Wait Total Waited
---------------------------------------- Waited ---------- ------------
latch: shared pool 242 9.08 66.46
latch: library cache 108 5.78 61.32
latch: row cache objects 23 0.06 0.20
SQL*Net message to client 66009 0.00 0.00
SQL*Net message from client 66009 0.00 0.00
db file sequential read 167169 0.00 0.00
latch free 1 0.04 0.04
read by other session 1 0.00 0.00
********************************************************************************The OEM tuning advisor does not recommend any tuning options for these.
Please advice.
For more information, please let me know.
Thanks
Suddhasatwa
Edited by: user13021719 on Mar 16, 2012 12:27 AM -
Oracle 10.2.0.4 library cache contention,every event wait 64s! strange
my database suddently very slow in a few seconds.After a while, all become normal.
In awr report,I find no special sql.
I paste two trouble time awr report here.
If you have any more information for troubleshooting ,I will paste if you require.
Thanks.
AWR report1:
WORKLOAD REPOSITORY report for
DB Name DB Id Instance Inst Num Release RAC Host
DB 3594421410 db2 2 10.2.0.4.0 YES db2
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 2342 17-Mar-09 21:30:23 521 1.1
End Snap: 2344 17-Mar-09 22:30:25 498 1.0
Elapsed: 60.03 (mins)
DB Time: 750.95 (mins)
Cache Sizes
~~~~~~~~~~~ Begin End
Buffer Cache: 3,504M 3,504M Std Block Size: 8K
Shared Pool Size: 1,200M 1,200M Log Buffer: 14,340K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 18,182.64 2,754.51
Logical reads: 326.19 49.41
Block changes: 123.54 18.72
Physical reads: 21.33 3.23
Physical writes: 7.29 1.10
User calls: 178.46 27.03
Parses: 62.04 9.40
Hard parses: 0.09 0.01
Sorts: 2.00 0.30
Logons: 0.20 0.03
Executes: 63.12 9.56
Transactions: 6.60
% Blocks changed per Read: 37.87 Recursive Call %: 17.93
Rollback per transaction %: 14.26 Rows per Sort: 44.63
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 99.99 Redo NoWait %: 99.95
Buffer Hit %: 93.46 In-memory Sort %: 100.00
Library Hit %: 99.52 Soft Parse %: 99.86
Execute to Parse %: 1.70 Latch Hit %: 99.97
Parse CPU to Parse Elapsd %: 0.82 % Non-Parse CPU: 98.60
Shared Pool Statistics Begin End
Memory Usage %: 78.60 78.77
% SQL with executions>1: 99.38 99.27
% Memory for SQL w/exec>1: 99.00 98.78
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
latch: library cache 736 47,078 63965 104.5 Concurrenc
CPU time 236 0.5
rdbms ipc reply 360 219 608 0.5 Other
log file sync 20,469 137 7 0.3 Commit
gc cr block 2-way 35,641 102 3 0.2 Cluster
AWR report 2:
DB Name DB Id Instance Inst Num Release RAC Host
db 3594421410 db2 2 10.2.0.4.0 YES yt-db2
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 2364 18-Mar-09 08:30:29 497 1.1
End Snap: 2365 18-Mar-09 08:42:28 511 1.0
Elapsed: 11.99 (mins)
DB Time: 277.14 (mins)
Cache Sizes
~~~~~~~~~~~ Begin End
Buffer Cache: 3,504M 3,504M Std Block Size: 8K
Shared Pool Size: 1,200M 1,200M Log Buffer: 14,340K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 23,306.73 2,556.74
Logical reads: 337.31 37.00
Block changes: 159.74 17.52
Physical reads: 0.72 0.08
Physical writes: 9.74 1.07
User calls: 274.07 30.06
Parses: 95.29 10.45
Hard parses: 0.04 0.00
Sorts: 2.52 0.28
Logons: 0.19 0.02
Executes: 95.71 10.50
Transactions: 9.12
% Blocks changed per Read: 47.36 Recursive Call %: 9.14
Rollback per transaction %: 11.13 Rows per Sort: 32.48
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 98.81 Redo NoWait %: 100.00
Buffer Hit %: 99.79 In-memory Sort %: 100.00
Library Hit %: 99.86 Soft Parse %: 99.95
Execute to Parse %: 0.44 Latch Hit %: 99.94
Parse CPU to Parse Elapsd %: 40.91 % Non-Parse CPU: 81.90
Shared Pool Statistics Begin End
Memory Usage %: 79.91 80.01
% SQL with executions>1: 99.52 99.52
% Memory for SQL w/exec>1: 98.83 98.77
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
latch free 176 4,391 24950 26.4 Other
gc buffer busy 3,726 3,335 895 20.1 Cluster
gc cr multi block request 4,165 2,204 529 13.3 Cluster
gc current grant busy 3,938 1,798 457 10.8 Cluster
latch: cache buffers chains 124 1,548 12487 9.3 Concurrenc
^LRAC Statistics DB/Inst: db/db2 Snaps: 2364-2365
Begin End
Number of Instances: 2 2
Global Cache Load Profile
~~~~~~~~~~~~~~~~~~~~~~~~~ Per Second Per Transaction
Global Cache blocks received: 19.36 2.12
Global Cache blocks served: 19.39 2.13
GCS/GES messages received: 63.76 6.99
GCS/GES messages sent: 63.64 6.98
DBWR Fusion writes: 2.58 0.28
Estd Interconnect traffic (KB) 334.84
Edited by: gaoyafang on 2009-3-18 上午12:46my database suddently very slow in a few seconds.After a while, all become normal.
In awr report,I find no special sql.
I paste two trouble time awr report here.
If you have any more information for troubleshooting ,I will paste if you require.
Thanks.
AWR report1:
WORKLOAD REPOSITORY report for
DB Name DB Id Instance Inst Num Release RAC Host
DB 3594421410 db2 2 10.2.0.4.0 YES db2
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 2342 17-Mar-09 21:30:23 521 1.1
End Snap: 2344 17-Mar-09 22:30:25 498 1.0
Elapsed: 60.03 (mins)
DB Time: 750.95 (mins)
Cache Sizes
~~~~~~~~~~~ Begin End
Buffer Cache: 3,504M 3,504M Std Block Size: 8K
Shared Pool Size: 1,200M 1,200M Log Buffer: 14,340K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 18,182.64 2,754.51
Logical reads: 326.19 49.41
Block changes: 123.54 18.72
Physical reads: 21.33 3.23
Physical writes: 7.29 1.10
User calls: 178.46 27.03
Parses: 62.04 9.40
Hard parses: 0.09 0.01
Sorts: 2.00 0.30
Logons: 0.20 0.03
Executes: 63.12 9.56
Transactions: 6.60
% Blocks changed per Read: 37.87 Recursive Call %: 17.93
Rollback per transaction %: 14.26 Rows per Sort: 44.63
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 99.99 Redo NoWait %: 99.95
Buffer Hit %: 93.46 In-memory Sort %: 100.00
Library Hit %: 99.52 Soft Parse %: 99.86
Execute to Parse %: 1.70 Latch Hit %: 99.97
Parse CPU to Parse Elapsd %: 0.82 % Non-Parse CPU: 98.60
Shared Pool Statistics Begin End
Memory Usage %: 78.60 78.77
% SQL with executions>1: 99.38 99.27
% Memory for SQL w/exec>1: 99.00 98.78
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
latch: library cache 736 47,078 63965 104.5 Concurrenc
CPU time 236 0.5
rdbms ipc reply 360 219 608 0.5 Other
log file sync 20,469 137 7 0.3 Commit
gc cr block 2-way 35,641 102 3 0.2 Cluster
AWR report 2:
DB Name DB Id Instance Inst Num Release RAC Host
db 3594421410 db2 2 10.2.0.4.0 YES yt-db2
Snap Id Snap Time Sessions Curs/Sess
Begin Snap: 2364 18-Mar-09 08:30:29 497 1.1
End Snap: 2365 18-Mar-09 08:42:28 511 1.0
Elapsed: 11.99 (mins)
DB Time: 277.14 (mins)
Cache Sizes
~~~~~~~~~~~ Begin End
Buffer Cache: 3,504M 3,504M Std Block Size: 8K
Shared Pool Size: 1,200M 1,200M Log Buffer: 14,340K
Load Profile
~~~~~~~~~~~~ Per Second Per Transaction
Redo size: 23,306.73 2,556.74
Logical reads: 337.31 37.00
Block changes: 159.74 17.52
Physical reads: 0.72 0.08
Physical writes: 9.74 1.07
User calls: 274.07 30.06
Parses: 95.29 10.45
Hard parses: 0.04 0.00
Sorts: 2.52 0.28
Logons: 0.19 0.02
Executes: 95.71 10.50
Transactions: 9.12
% Blocks changed per Read: 47.36 Recursive Call %: 9.14
Rollback per transaction %: 11.13 Rows per Sort: 32.48
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 98.81 Redo NoWait %: 100.00
Buffer Hit %: 99.79 In-memory Sort %: 100.00
Library Hit %: 99.86 Soft Parse %: 99.95
Execute to Parse %: 0.44 Latch Hit %: 99.94
Parse CPU to Parse Elapsd %: 40.91 % Non-Parse CPU: 81.90
Shared Pool Statistics Begin End
Memory Usage %: 79.91 80.01
% SQL with executions>1: 99.52 99.52
% Memory for SQL w/exec>1: 98.83 98.77
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
latch free 176 4,391 24950 26.4 Other
gc buffer busy 3,726 3,335 895 20.1 Cluster
gc cr multi block request 4,165 2,204 529 13.3 Cluster
gc current grant busy 3,938 1,798 457 10.8 Cluster
latch: cache buffers chains 124 1,548 12487 9.3 Concurrenc
^LRAC Statistics DB/Inst: db/db2 Snaps: 2364-2365
Begin End
Number of Instances: 2 2
Global Cache Load Profile
~~~~~~~~~~~~~~~~~~~~~~~~~ Per Second Per Transaction
Global Cache blocks received: 19.36 2.12
Global Cache blocks served: 19.39 2.13
GCS/GES messages received: 63.76 6.99
GCS/GES messages sent: 63.64 6.98
DBWR Fusion writes: 2.58 0.28
Estd Interconnect traffic (KB) 334.84
Edited by: gaoyafang on 2009-3-18 上午12:46 -
Sessions hangs with library cache lock
Der all,
11.1.0.7 rac on solaris 10
Our workflow session yesterday hanged on a particular step the session was waiting on a library cache lock (by using query select event,p1,p2 from v$session where sid=<my_sid>;)
when I checked the blocking session , using the note 122793.1 and http://oracle-study-notes.blogspot.com/2009/05/resolving-library-cache-lock-issue.html and http://oracle-study-notes.blogspot.com/2009/05/find-session-holding-library-cache-lock.html .
I found that
SQL> SELECT SID,USERNAME,TERMINAL,PROGRAM FROM V$SESSION
2 WHERE SADDR in
3 (SELECT KGLLKSES FROM X$KGLLK LOCK_A
4 WHERE KGLLKREQ > 0
5 AND EXISTS (SELECT LOCK_B.KGLLKHDL FROM X$KGLLK LOCK_B
WHERE KGLLKSES = '&SADDR_OF_BLKING_SESS'
6 7 AND LOCK_A.KGLLKHDL = LOCK_B.KGLLKHDL
8 AND KGLLKREQ = 0)
9 );
Enter value for saddr_of_blking_sess: 0000000770E494E0
old 6: WHERE KGLLKSES = '&SADDR_OF_BLKING_SESS'
new 6: WHERE KGLLKSES = '0000000770E494E0'
SID USERNAME TERMINAL PROGRAM
817 SYS UNKNOWN oracle@tabsdb07
(J002)
828 SYS UNKNOWN oracle@tabsdb07
(J001)after killing the session, the library cache locks still remained.when I ran trace on the session
select /*+ all_rows ordered */ A.rowid, :1, :2, :3
from
"DBMRPT"."DBM_BIAUTO_SUSP" A , "DBMRPT"."DBM_CDR_FILE_HEAD" B where(
"A"."CDR_TYPE" is not null and "A"."FILE_ID" is not null) and(
"B"."CDR_TYPE" (+)= "A"."CDR_TYPE" and "B"."FILE_ID" (+)= "A"."FILE_ID")
and( "B"."CDR_TYPE" is null or "B"."FILE_ID" is null)
call count cpu elapsed disk query current rows
Parse 1 0.01 0.01 0 0 0 0
Execute 1 0.00 0.00 0 0 0 0
Fetch 0 0.00 0.00 0 0 0 0
total 2 0.01 0.01 0 0 0 0
Misses in library cache during parse: 1
Misses in library cache during execute: 1
Optimizer mode: ALL_ROWS
Parsing user id: SYS (recursive depth: 3)
Elapsed times include waiting on following events:
Event waited on Times Max. Wait Total Waited
---------------------------------------- Waited ---------- ------------
row cache lock 5 0.00 0.00
db file sequential read 295932636 0.07 5066.63
gc cr grant 2-way 727813 0.02 233.95
latch: gc element 80 0.00 0.00
latch: gcs resource hash 870 0.00 0.00
latch free 2 0.00 0.00
gc remaster 9 2.00 12.91
gcs drm freeze in enter server mode 9 0.54 2.08
latch: object queue header operation 66 0.00 0.05
latch: cache buffers chains 15 0.03 0.20
resmgr:internal state change 63 0.10 5.30
latch: cache buffers lru chain 1260 0.00 0.01
********************************************************************************Please guide
Kai
all this time sql_id for the session remanined in the sql :
ALTER TABLE DBMRPT.DBM_BIAUTO_SUSP ENABLE CONSTRAINT DBS1_DCFH_FK ..hi..
Go through [http://orainternals.wordpress.com/2009/06/02/library-cache-lock-and-library-cache-pin-waits/]
Anand -
Sql Query Tuning. Please help me to tune this query
Hi All ,
I have this problematic Sql . It is taking huge time to execute. It contains a view CIDV, which i think is the bottleneck.
I have pasted the query below. I will be pasting TKPROF and explain plan for the same. Please advice me to tune this query.
SELECT GCC.SEGMENT1 || '.' || GCC.SEGMENT2 || '.' || GCC.SEGMENT3 || '.' ||
GCC.SEGMENT4 || '.' || GCC.SEGMENT5 || '.' || GCC.SEGMENT6 || '.' ||
GCC.SEGMENT7 || '.' || GCC.SEGMENT8 || '.' || GCC.SEGMENT9 OFFSET_ACCOUNT,
OOD.ORGANIZATION_CODE,
CIDV.SUBINVENTORY_CODE OFFSET_SUBINV,
MIL.SEGMENT1 || '.' || MIL.SEGMENT2 || '.' || MIL.SEGMENT3 || '.' ||
MIL.SEGMENT4 || '.' || MIL.SEGMENT5 OFFSET_LOCATOR,
CIDV.LAST_UPDATE_LOGIN
FROM APPS.CST_INV_DISTRIBUTION_V CIDV,
APPS.GL_CODE_COMBINATIONS GCC,
APPS.MTL_ITEM_LOCATIONS MIL,
APPS.ORG_ORGANIZATION_DEFINITIONS OOD
WHERE CIDV.TRANSACTION_ID = :B2
AND CIDV.PRIMARY_QUANTITY = (-1) * :B1
AND CIDV.REFERENCE_ACCOUNT = GCC.CODE_COMBINATION_ID
AND OOD.ORGANIZATION_ID = CIDV.ORGANIZATION_ID
AND MIL.INVENTORY_LOCATION_ID = CIDV.LOCATOR_ID
AND GCC.ACCOUNT_TYPE = 'A'****************
TKPROF
call count cpu elapsed disk query current rows
Parse 1 0.00 0.00 0 0 0 0
Execute 68337 10.32 10.32 0 0 0 0
Fetch 68337 229.75 936.36 58819 6743323 1121 68232
total 136675 240.07 946.69 58819 6743323 1121 68232
Misses in library cache during parse: 1
Misses in library cache during execute: 1
Optimizer mode: ALL_ROWS
Parsing user id: 203 (recursive depth: 1)
Number of plan statistics captured: 1
Rows (1st) Rows (avg) Rows (max) Row Source Operation
1 1 1 MERGE JOIN CARTESIAN (cr=102 pr=15 pw=0 time=193608 us cost=56 size=219 card=1)
1 1 1 NESTED LOOPS (cr=100 pr=15 pw=0 time=193483 us cost=53 size=219 card=1)
1 1 1 NESTED LOOPS (cr=99 pr=15 pw=0 time=193407 us cost=52 size=215 card=1)
1 1 1 NESTED LOOPS (cr=96 pr=15 pw=0 time=193378 us cost=51 size=190 card=1)
1 1 1 NESTED LOOPS (cr=93 pr=15 pw=0 time=193284 us cost=49 size=162 card=1)
1 1 1 NESTED LOOPS (cr=89 pr=14 pw=0 time=185515 us cost=46 size=138 card=1)
1 1 1 NESTED LOOPS (cr=85 pr=12 pw=0 time=157975 us cost=44 size=81 card=1)
1 1 1 NESTED LOOPS (cr=83 pr=12 pw=0 time=157925 us cost=43 size=73 card=1)
1 1 1 NESTED LOOPS (cr=81 pr=12 pw=0 time=157641 us cost=43 size=132 card=2)
1 1 1 VIEW CST_INV_DISTRIBUTION_V (cr=78 pr=12 pw=0 time=156386 us cost=41 size=118 card=2)
1 1 1 UNION-ALL (cr=78 pr=12 pw=0 time=156378 us)
0 0 0 NESTED LOOPS OUTER (cr=44 pr=9 pw=0 time=124997 us cost=20 size=291 card=1)
0 0 0 NESTED LOOPS (cr=44 pr=9 pw=0 time=124993 us cost=18 size=255 card=1)
0 0 0 NESTED LOOPS (cr=44 pr=9 pw=0 time=124990 us cost=18 size=251 card=1)
33 33 33 MERGE JOIN CARTESIAN (cr=25 pr=6 pw=0 time=98544 us cost=14 size=192 card=1)
1 1 1 NESTED LOOPS OUTER (cr=22 pr=5 pw=0 time=85754 us cost=12 size=156 card=1)
1 1 1 NESTED LOOPS (cr=19 pr=4 pw=0 time=79830 us cost=10 size=120 card=1)
1 1 1 NESTED LOOPS OUTER (cr=17 pr=4 pw=0 time=79813 us cost=9 size=113 card=1)
1 1 1 NESTED LOOPS (cr=15 pr=4 pw=0 time=79752 us cost=8 size=106 card=1)
1 1 1 NESTED LOOPS (cr=11 pr=2 pw=0 time=43120 us cost=6 size=93 card=1)
1 1 1 NESTED LOOPS (cr=7 pr=2 pw=0 time=43087 us cost=4 size=83 card=1)
1 1 1 NESTED LOOPS (cr=6 pr=2 pw=0 time=43072 us cost=4 size=80 card=1)
1 1 1 TABLE ACCESS BY INDEX ROWID MTL_MATERIAL_TRANSACTIONS (cr=5 pr=2 pw=0 time=43042 us cost=4 size=76 card=1)
1 1 1 INDEX UNIQUE SCAN MTL_MATERIAL_TRANSACTIONS_U1 (cr=4 pr=2 pw=0 time=43011 us cost=3 size=0 card=1)(object id 12484094)
1 1 1 INDEX UNIQUE SCAN MTL_TRANSACTION_TYPES_U1 (cr=1 pr=0 pw=0 time=20 us cost=0 size=764 card=191)(object id 9983)
1 1 1 INDEX UNIQUE SCAN MTL_TXN_SOURCE_TYPES_U1 (cr=1 pr=0 pw=0 time=7 us cost=0 size=54 card=18)(object id 9987)
1 1 1 INDEX UNIQUE SCAN MTL_SYSTEM_ITEMS_B_U1 (cr=4 pr=0 pw=0 time=27 us cost=2 size=736324450 card=73632445)(object id 12484155)
1 1 1 INDEX UNIQUE SCAN MTL_SYSTEM_ITEMS_TL_U1 (cr=4 pr=2 pw=0 time=36626 us cost=2 size=957481070 card=73652390)(object id 12484137)
1 1 1 TABLE ACCESS BY INDEX ROWID MTL_PARAMETERS (cr=2 pr=0 pw=0 time=42 us cost=1 size=3290 card=470)
1 1 1 INDEX UNIQUE SCAN MTL_PARAMETERS_U1 (cr=1 pr=0 pw=0 time=28 us cost=0 size=0 card=1)(object id 9847)
1 1 1 TABLE ACCESS BY INDEX ROWID MTL_PARAMETERS (cr=2 pr=0 pw=0 time=12 us cost=1 size=3290 card=470)
1 1 1 INDEX UNIQUE SCAN MTL_PARAMETERS_U1 (cr=1 pr=0 pw=0 time=7 us cost=0 size=0 card=1)(object id 9847)
0 0 0 INDEX RANGE SCAN FND_LOOKUP_VALUES_U1 (cr=3 pr=1 pw=0 time=5915 us cost=2 size=36 card=1)(object id 705891)
33 33 33 BUFFER SORT (cr=3 pr=1 pw=0 time=12713 us cost=12 size=36 card=1)
33 33 33 INDEX RANGE SCAN FND_LOOKUP_VALUES_U1 (cr=3 pr=1 pw=0 time=12582 us cost=2 size=36 card=1)(object id 705891)
0 0 0 TABLE ACCESS BY INDEX ROWID MTL_TRANSACTION_ACCOUNTS (cr=19 pr=3 pw=0 time=26591 us cost=4 size=59 card=1)
66 66 66 INDEX RANGE SCAN MTL_TRANSACTION_ACCOUNTS_N1 (cr=18 pr=2 pw=0 time=13607 us cost=3 size=0 card=3)(object id 12484127)
0 0 0 INDEX UNIQUE SCAN MTL_PARAMETERS_U1 (cr=0 pr=0 pw=0 time=0 us cost=0 size=4 card=1)(object id 9847)
0 0 0 INDEX RANGE SCAN FND_LOOKUP_VALUES_U1 (cr=0 pr=0 pw=0 time=0 us cost=2 size=36 card=1)(object id 705891)
1 1 1 NESTED LOOPS (cr=34 pr=3 pw=0 time=31269 us cost=21 size=288 card=1)
1 1 1 NESTED LOOPS (cr=30 pr=3 pw=0 time=31161 us cost=19 size=275 card=1)
1 1 1 NESTED LOOPS (cr=26 pr=3 pw=0 time=31105 us cost=17 size=265 card=1)
1 1 1 NESTED LOOPS (cr=25 pr=3 pw=0 time=31082 us cost=17 size=261 card=1)
1 1 1 NESTED LOOPS OUTER (cr=23 pr=3 pw=0 time=31027 us cost=16 size=254 card=1)
1 1 1 NESTED LOOPS (cr=21 pr=3 pw=0 time=30980 us cost=15 size=247 card=1)
1 1 1 NESTED LOOPS (cr=20 pr=3 pw=0 time=30957 us cost=15 size=243 card=1)
1 1 1 NESTED LOOPS OUTER (cr=19 pr=3 pw=0 time=30926 us cost=15 size=240 card=1)
1 1 1 NESTED LOOPS (cr=16 pr=3 pw=0 time=30389 us cost=13 size=204 card=1)
1 1 1 NESTED LOOPS (cr=11 pr=0 pw=0 time=665 us cost=9 size=131 card=1)
1 1 1 NESTED LOOPS OUTER (cr=8 pr=0 pw=0 time=306 us cost=7 size=95 card=1)
1 1 1 TABLE ACCESS BY INDEX ROWID MTL_TRANSACTION_ACCOUNTS (cr=5 pr=0 pw=0 time=37 us cost=5 size=59 card=1)
2 2 2 INDEX RANGE SCAN MTL_TRANSACTION_ACCOUNTS_N1 (cr=4 pr=0 pw=0 time=17 us cost=4 size=0 card=3)(object id 12484127)
1 1 1 INDEX RANGE SCAN FND_LOOKUP_VALUES_U1 (cr=3 pr=0 pw=0 time=216 us cost=2 size=36 card=1)(object id 705891)
1 1 1 INDEX RANGE SCAN FND_LOOKUP_VALUES_U1 (cr=3 pr=0 pw=0 time=352 us cost=2 size=36 card=1)(object id 705891)
1 1 1 TABLE ACCESS BY INDEX ROWID MTL_MATERIAL_TRANSACTIONS (cr=5 pr=3 pw=0 time=29716 us cost=4 size=73 card=1)
1 1 1 INDEX RANGE SCAN MTL_MATERIAL_TRANSACTIONS_N23 (cr=4 pr=3 pw=0 time=29588 us cost=3 size=0 card=1)(object id 12484133)
0 0 0 INDEX RANGE SCAN FND_LOOKUP_VALUES_U1 (cr=3 pr=0 pw=0 time=520 us cost=2 size=36 card=1)(object id 705891)
1 1 1 INDEX UNIQUE SCAN MTL_TXN_SOURCE_TYPES_U1 (cr=1 pr=0 pw=0 time=22 us cost=0 size=3 card=1)(object id 9987)
1 1 1 INDEX UNIQUE SCAN MTL_TRANSACTION_TYPES_U1 (cr=1 pr=0 pw=0 time=16 us cost=0 size=4 card=1)(object id 9983)
1 1 1 TABLE ACCESS BY INDEX ROWID MTL_PARAMETERS (cr=2 pr=0 pw=0 time=34 us cost=1 size=7 card=1)
1 1 1 INDEX UNIQUE SCAN MTL_PARAMETERS_U1 (cr=1 pr=0 pw=0 time=19 us cost=0 size=0 card=1)(object id 9847)
1 1 1 TABLE ACCESS BY INDEX ROWID MTL_PARAMETERS (cr=2 pr=0 pw=0 time=44 us cost=1 size=7 card=1)
1 1 1 INDEX UNIQUE SCAN MTL_PARAMETERS_U1 (cr=1 pr=0 pw=0 time=14 us cost=0 size=0 card=1)(object id 9847)
1 1 1 INDEX UNIQUE SCAN MTL_PARAMETERS_U1 (cr=1 pr=0 pw=0 time=13 us cost=0 size=4 card=1)(object id 9847)
1 1 1 INDEX UNIQUE SCAN MTL_SYSTEM_ITEMS_B_U1 (cr=4 pr=0 pw=0 time=49 us cost=2 size=10 card=1)(object id 12484155)
1 1 1 INDEX UNIQUE SCAN MTL_SYSTEM_ITEMS_TL_U1 (cr=4 pr=0 pw=0 time=96 us cost=2 size=13 card=1)(object id 12484137)
1 1 1 TABLE ACCESS BY INDEX ROWID HR_ALL_ORGANIZATION_UNITS (cr=3 pr=0 pw=0 time=1246 us cost=1 size=7 card=1)
1 1 1 INDEX UNIQUE SCAN HR_ORGANIZATION_UNITS_PK (cr=2 pr=0 pw=0 time=24 us cost=0 size=0 card=1)(object id 250158)
1 1 1 INDEX UNIQUE SCAN HR_ALL_ORGANIZATION_UNTS_TL_PK (cr=2 pr=0 pw=0 time=275 us cost=0 size=7 card=1)(object id 689101)
1 1 1 TABLE ACCESS BY INDEX ROWID MTL_PARAMETERS (cr=2 pr=0 pw=0 time=38 us cost=1 size=8 card=1)
1 1 1 INDEX UNIQUE SCAN MTL_PARAMETERS_U1 (cr=1 pr=0 pw=0 time=15 us cost=0 size=0 card=1)(object id 9847)
1 1 1 TABLE ACCESS BY INDEX ROWID GL_CODE_COMBINATIONS (cr=4 pr=2 pw=0 time=27531 us cost=2 size=57 card=1)
1 1 1 INDEX UNIQUE SCAN GL_CODE_COMBINATIONS_U1 (cr=3 pr=1 pw=0 time=19925 us cost=1 size=0 card=1)(object id 51426)
1 1 1 TABLE ACCESS BY INDEX ROWID MTL_ITEM_LOCATIONS (cr=4 pr=1 pw=0 time=7758 us cost=3 size=24 card=1)
1 1 1 INDEX RANGE SCAN MTL_ITEM_LOCATIONS_U1 (cr=3 pr=0 pw=0 time=51 us cost=2 size=0 card=1)(object id 9761)
1 1 1 TABLE ACCESS BY INDEX ROWID HR_ORGANIZATION_INFORMATION (cr=3 pr=0 pw=0 time=85 us cost=2 size=28 card=1)
1 1 1 INDEX RANGE SCAN HR_ORGANIZATION_INFORMATIO_FK2 (cr=2 pr=0 pw=0 time=29 us cost=1 size=0 card=2)(object id 5379798)
1 1 1 TABLE ACCESS BY INDEX ROWID HR_ORGANIZATION_INFORMATION (cr=3 pr=0 pw=0 time=25 us cost=1 size=25 card=1)
1 1 1 INDEX RANGE SCAN HR_ORGANIZATION_INFORMATIO_FK2 (cr=2 pr=0 pw=0 time=11 us cost=1 size=0 card=1)(object id 5379798)
1 1 1 INDEX FULL SCAN GL_SETS_OF_BOOKS_U2 (cr=1 pr=0 pw=0 time=69 us cost=1 size=4 card=1)(object id 1380842)
1 1 1 BUFFER SORT (cr=2 pr=0 pw=0 time=110 us cost=55 size=0 card=1)
1 1 1 TABLE ACCESS FULL FND_PRODUCT_GROUPS (cr=2 pr=0 pw=0 time=59 us cost=3 size=0 card=1)
Elapsed times include waiting on following events:
Event waited on Times Max. Wait Total Waited
---------------------------------------- Waited ---------- ------------
library cache lock 2 0.00 0.00
library cache pin 2 0.00 0.00
Disk file operations I/O 249 0.00 0.00
db file sequential read 58819 2.61 714.28
gc cr grant 2-way 5198 0.16 4.52
gc current grant busy 1 0.00 0.00
KJC: Wait for msg sends to complete 517 0.00 0.05
library cache: mutex X 433 0.01 0.04
gc cr grant congested 28 0.08 0.18
latch: ges resource hash list 5 0.00 0.00
gc current block 2-way 513 0.11 0.61
gc current block congested 2 0.00 0.00
latch: gc element 16 0.00 0.01
latch: cache buffers chains 4 0.00 0.00
latch: object queue header operation 3 0.00 0.00
********************************************************************************Explain Plan for the query
SELECT STATEMENT, GOAL = ALL_ROWS Cost=56 Cardinality=1 Bytes=219
MERGE JOIN CARTESIAN Cost=56 Cardinality=1 Bytes=219
NESTED LOOPS Cost=53 Cardinality=1 Bytes=219
NESTED LOOPS Cost=52 Cardinality=1 Bytes=215
NESTED LOOPS Cost=51 Cardinality=1 Bytes=190
NESTED LOOPS Cost=49 Cardinality=1 Bytes=162
NESTED LOOPS Cost=46 Cardinality=1 Bytes=138
NESTED LOOPS Cost=44 Cardinality=1 Bytes=81
NESTED LOOPS Cost=43 Cardinality=1 Bytes=73
NESTED LOOPS Cost=43 Cardinality=2 Bytes=132
VIEW Object owner=APPS Object name=CST_INV_DISTRIBUTION_V Cost=41 Cardinality=2 Bytes=118
UNION-ALL
NESTED LOOPS OUTER Cost=20 Cardinality=1 Bytes=291
NESTED LOOPS Cost=18 Cardinality=1 Bytes=255
NESTED LOOPS Cost=18 Cardinality=1 Bytes=251
MERGE JOIN CARTESIAN Cost=14 Cardinality=1 Bytes=192
NESTED LOOPS OUTER Cost=12 Cardinality=1 Bytes=156
NESTED LOOPS Cost=10 Cardinality=1 Bytes=120
NESTED LOOPS OUTER Cost=9 Cardinality=1 Bytes=113
NESTED LOOPS Cost=8 Cardinality=1 Bytes=106
NESTED LOOPS Cost=6 Cardinality=1 Bytes=93
NESTED LOOPS Cost=4 Cardinality=1 Bytes=83
NESTED LOOPS Cost=4 Cardinality=1 Bytes=80
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_MATERIAL_TRANSACTIONS Cost=4 Cardinality=1 Bytes=76
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_MATERIAL_TRANSACTIONS_U1 Cost=3 Cardinality=1
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_TRANSACTION_TYPES_U1 Cost=0 Cardinality=191 Bytes=764
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_TXN_SOURCE_TYPES_U1 Cost=0 Cardinality=18 Bytes=54
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_SYSTEM_ITEMS_B_U1 Cost=2 Cardinality=73632445 Bytes=736324450
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_SYSTEM_ITEMS_TL_U1 Cost=2 Cardinality=73652390 Bytes=957481070
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_PARAMETERS Cost=1 Cardinality=470 Bytes=3290
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_PARAMETERS_U1 Cost=0 Cardinality=1
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_PARAMETERS Cost=1 Cardinality=470 Bytes=3290
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_PARAMETERS_U1 Cost=0 Cardinality=1
INDEX RANGE SCAN Object owner=APPLSYS Object name=FND_LOOKUP_VALUES_U1 Cost=2 Cardinality=1 Bytes=36
BUFFER SORT Cost=12 Cardinality=1 Bytes=36
INDEX RANGE SCAN Object owner=APPLSYS Object name=FND_LOOKUP_VALUES_U1 Cost=2 Cardinality=1 Bytes=36
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_TRANSACTION_ACCOUNTS Cost=4 Cardinality=1 Bytes=59
INDEX RANGE SCAN Object owner=INV Object name=MTL_TRANSACTION_ACCOUNTS_N1 Cost=3 Cardinality=3
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_PARAMETERS_U1 Cost=0 Cardinality=1 Bytes=4
INDEX RANGE SCAN Object owner=APPLSYS Object name=FND_LOOKUP_VALUES_U1 Cost=2 Cardinality=1 Bytes=36
NESTED LOOPS Cost=21 Cardinality=1 Bytes=288
NESTED LOOPS Cost=19 Cardinality=1 Bytes=275
NESTED LOOPS Cost=17 Cardinality=1 Bytes=265
NESTED LOOPS Cost=17 Cardinality=1 Bytes=261
NESTED LOOPS OUTER Cost=16 Cardinality=1 Bytes=254
NESTED LOOPS Cost=15 Cardinality=1 Bytes=247
NESTED LOOPS Cost=15 Cardinality=1 Bytes=243
NESTED LOOPS OUTER Cost=15 Cardinality=1 Bytes=240
NESTED LOOPS Cost=13 Cardinality=1 Bytes=204
NESTED LOOPS Cost=9 Cardinality=1 Bytes=131
NESTED LOOPS OUTER Cost=7 Cardinality=1 Bytes=95
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_TRANSACTION_ACCOUNTS Cost=5 Cardinality=1 Bytes=59
INDEX RANGE SCAN Object owner=INV Object name=MTL_TRANSACTION_ACCOUNTS_N1 Cost=4 Cardinality=3
INDEX RANGE SCAN Object owner=APPLSYS Object name=FND_LOOKUP_VALUES_U1 Cost=2 Cardinality=1 Bytes=36
INDEX RANGE SCAN Object owner=APPLSYS Object name=FND_LOOKUP_VALUES_U1 Cost=2 Cardinality=1 Bytes=36
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_MATERIAL_TRANSACTIONS Cost=4 Cardinality=1 Bytes=73
INDEX RANGE SCAN Object owner=INV Object name=MTL_MATERIAL_TRANSACTIONS_N23 Cost=3 Cardinality=1
INDEX RANGE SCAN Object owner=APPLSYS Object name=FND_LOOKUP_VALUES_U1 Cost=2 Cardinality=1 Bytes=36
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_TXN_SOURCE_TYPES_U1 Cost=0 Cardinality=1 Bytes=3
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_TRANSACTION_TYPES_U1 Cost=0 Cardinality=1 Bytes=4
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_PARAMETERS Cost=1 Cardinality=1 Bytes=7
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_PARAMETERS_U1 Cost=0 Cardinality=1
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_PARAMETERS Cost=1 Cardinality=1 Bytes=7
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_PARAMETERS_U1 Cost=0 Cardinality=1
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_PARAMETERS_U1 Cost=0 Cardinality=1 Bytes=4
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_SYSTEM_ITEMS_B_U1 Cost=2 Cardinality=1 Bytes=10
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_SYSTEM_ITEMS_TL_U1 Cost=2 Cardinality=1 Bytes=13
TABLE ACCESS BY INDEX ROWID Object owner=HR Object name=HR_ALL_ORGANIZATION_UNITS Cost=1 Cardinality=1 Bytes=7
INDEX UNIQUE SCAN Object owner=HR Object name=HR_ORGANIZATION_UNITS_PK Cost=0 Cardinality=1
INDEX UNIQUE SCAN Object owner=HR Object name=HR_ALL_ORGANIZATION_UNTS_TL_PK Cost=0 Cardinality=1 Bytes=7
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_PARAMETERS Cost=1 Cardinality=1 Bytes=8
INDEX UNIQUE SCAN Object owner=INV Object name=MTL_PARAMETERS_U1 Cost=0 Cardinality=1
TABLE ACCESS BY INDEX ROWID Object owner=GL Object name=GL_CODE_COMBINATIONS Cost=2 Cardinality=1 Bytes=57
INDEX UNIQUE SCAN Object owner=GL Object name=GL_CODE_COMBINATIONS_U1 Cost=1 Cardinality=1
TABLE ACCESS BY INDEX ROWID Object owner=INV Object name=MTL_ITEM_LOCATIONS Cost=3 Cardinality=1 Bytes=24
INDEX RANGE SCAN Object owner=INV Object name=MTL_ITEM_LOCATIONS_U1 Cost=2 Cardinality=1
TABLE ACCESS BY INDEX ROWID Object owner=HR Object name=HR_ORGANIZATION_INFORMATION Cost=2 Cardinality=1 Bytes=28
INDEX RANGE SCAN Object owner=HR Object name=HR_ORGANIZATION_INFORMATIO_FK2 Cost=1 Cardinality=2
TABLE ACCESS BY INDEX ROWID Object owner=HR Object name=HR_ORGANIZATION_INFORMATION Cost=1 Cardinality=1 Bytes=25
INDEX RANGE SCAN Object owner=HR Object name=HR_ORGANIZATION_INFORMATIO_FK2 Cost=1 Cardinality=1
INDEX FULL SCAN Object owner=GL Object name=GL_SETS_OF_BOOKS_U2 Cost=1 Cardinality=1 Bytes=4
BUFFER SORT Cost=55 Cardinality=1
TABLE ACCESS FULL Object owner=APPLSYS Object name=FND_PRODUCT_GROUPS Cost=3 Cardinality=1 -
Update Statement Simply hanged but doing db file sequential read
Hi,
Last night we had issue with one of the prod server where we updating one of table which contains large number records in millions.Same identical machine completed in1 hour and other box never completed but doing db file sequential read but in the long ops the last statement it was done 20:16 after that nothing is happening but i ran few trace on that user.
/u01/app/oracle/admin/SURV2/udump/surv2_ora_10048.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 18
Unix process pid: 10048, image: oracle@prdfa001
*** 2010-09-09 23:37:07.484
*** ACTION NAME:() 2010-09-09 23:37:07.473
*** MODULE NAME:(SQL*Plus) 2010-09-09 23:37:07.473
*** SERVICE NAME:(SURV2) 2010-09-09 23:37:07.473
*** SESSION ID:(289.54) 2010-09-09 23:37:07.473
Received ORADEBUG command 'unlimit' from process Unix process pid: 3983, image:
*** 2010-09-09 23:37:20.315
Received ORADEBUG command 'event 10046 trace name context forever, level 12' from process Unix process pid: 3983, image:
WAIT #7: nam='db file sequential read' ela= 11160 file#=13 block#=2252349 blocks=1 obj#=166421 tim=12499462835161
WAIT #7: nam='db file sequential read' ela= 2857 file#=13 block#=2249751 blocks=1 obj#=166421 tim=12499462838137
WAIT #7: nam='db file sequential read' ela= 3810 file#=13 block#=2251361 blocks=1 obj#=166421 tim=12499462842048
WAIT #7: nam='db file sequential read' ela= 4459 file#=13 block#=2247059 blocks=1 obj#=166421 tim=12499462846564
WAIT #7: nam='db file sequential read' ela= 2841 file#=13 block#=2247507 blocks=1 obj#=166421 tim=12499462849468
WAIT #7: nam='db file sequential read' ela= 427 file#=13 block#=2247568 blocks=1 obj#=166421 tim=12499462850032
WAIT #7: nam='db file sequential read' ela= 1187 file#=13 block#=2248264 blocks=1 obj#=166421 tim=12499462851327
WAIT #7: nam='db file sequential read' ela= 2687 file#=13 block#=2250707 blocks=1 obj#=166421 tim=12499462854178
WAIT #7: nam='db file sequential read' ela= 3657 file#=13 block#=2249697 blocks=1 obj#=166421 tim=12499462857896
WAIT #7: nam='db file sequential read' ela= 4139 file#=13 block#=2247074 blocks=1 obj#=166421 tim=12499462862093
WAIT #7: nam='db file sequential read' ela= 4180 file#=47 block#=3649690 blocks=1 obj#=166421 tim=12499509270445
WAIT #7: nam='db file sequential read' ela= 4802 file#=47 block#=3649309 blocks=1 obj#=166421 tim=12499509275327
WAIT #7: nam='db file sequential read' ela= 2459 file#=47 block#=3652697 blocks=1 obj#=166421 tim=12499509277859
WAIT #7: nam='db file sequential read' ela= 4015 file#=47 block#=3652826 blocks=1 obj#=166421 tim=12499509281948
WAIT #7: nam='db file sequential read' ela= 2248 file#=47 block#=3651610 blocks=1 obj#=166421 tim=12499509284269
WAIT #7: nam='db file sequential read' ela= 4824 file#=47 block#=3654297 blocks=1 obj#=166421 tim=12499509289166
WAIT #7: nam='db file sequential read' ela= 2008 file#=47 block#=3652312 blocks=1 obj#=166421 tim=12499509291248
WAIT #7: nam='db file sequential read' ela= 1925 file#=47 block#=3654490 blocks=1 obj#=166421 tim=12499509293246
WAIT #7: nam='db file sequential read' ela= 2859 file#=47 block#=3648458 blocks=1 obj#=166421 tim=12499509296178
WAIT #7: nam='db file sequential read' ela= 1740 file#=47 block#=3648212 blocks=1 obj#=166421 tim=12499509297991
WAIT #7: nam='db file sequential read' ela= 2566 file#=47 block#=3648411 blocks=1 obj#=166421 tim=12499509300631
WAIT #7: nam='db file sequential read' ela= 50772 file#=5 block#=480749 blocks=1 obj#=166421 tim=12499509351477
WAIT #7: nam='db file sequential read' ela= 12928 file#=5 block#=477177 blocks=1 obj#=166421 tim=12499509364482
WAIT #7: nam='db file sequential read' ela= 11116 file#=5 block#=479412 blocks=1 obj#=166421 tim=12499509375672
WAIT #7: nam='db file sequential read' ela= 4803 file#=5 block#=483440 blocks=1 obj#=166421 tim=12499509380549
WAIT #7: nam='db file sequential read' ela= 6900 file#=5 block#=481454 blocks=1 obj#=166421 tim=12499509387522
Received ORADEBUG command 'event 10046 trace name context off' from process Unix process pid: 3983, image:
/u01/app/oracle/admin/SURV2/udump/surv2_ora_1545.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 22
Unix process pid: 1545, image: oracle@prdfa001 (TNS V1-V3)
*** ACTION NAME:() 2010-09-09 23:20:13.485
*** MODULE NAME:(sqlplus@prdfa001 (TNS V1-V3)) 2010-09-09 23:20:13.485
*** SERVICE NAME:(SYS$USERS) 2010-09-09 23:20:13.485
*** SESSION ID:(290.697) 2010-09-09 23:20:13.485
===================================================
SYSTEM STATE
System global information:
processes: base 47819b480, size 300, cleanup 4781a5638
allocation: free sessions 47f1d6148, free calls 0
control alloc errors: 0 (process), 0 (session), 0 (call)
PMON latch cleanup depth: 0
seconds since PMON's last scan for dead processes: 20
system statistics:
1171 logons cumulative
19 logons current
89219 opened cursors cumulative
86 opened cursors current
15095069 user commits
5 user rollbacks
58632904 user calls
44023255 recursive calls
224311 recursive cpu usage
201424173 session logical reads
0 session stored procedure space
901812 CPU used when call started
995437 CPU used by this session
6814196 DB time
0 cluster wait time
22542300822 concurrency wait time
3095 application wait time
16479074661 user I/O wait time
1284052668 session connect time
1284067190 process last non-idle time
189018343568 session uga memory
1249667216 session uga memory max
26059216 messages sent
26059220 messages received
239739 background timeouts
162399896 session pga memory
189662872 session pga memory max
4 enqueue timeouts
901146 enqueue waits
0 enqueue deadlocks
32122711 enqueue requests
17819 enqueue conversions
32122676 enqueue releases
0 global enqueue gets sync
0 global enqueue gets async
0 global enqueue get time
0 global enqueue releases
2865667 physical read total IO requests
262620 physical read total multi block requests
270093476864 physical read total bytes
select SYS_CONTEXT('USERENV', 'SERVER_HOST'), SYS_CONTEXT('USERENV', 'DB_UNIQUE_NAME'), SYS_CONTEXT('USERENV', 'INSTANCE_NAME'), SYS_CONTEXT('USERENV', 'SERVICE_NAME'), INSTANCE_NUMBER, STARTUP_TIME, SYS_CONTEXT('USERENV', 'DB_DOMAIN') from v$instance where INSTANCE_NAME=SYS_CONTEXT('USERENV', 'INSTANCE_NAME')
hash=550c95f3d0cfa8290e60ea8382d3a2ca timestamp=09-09-2010 04:24:19
namespace=CRSR flags=RON/KGHP/TIM/PN0/LRG/KST/DBN/MTX/[100100d1]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=9 hpc=0582 hlc=0582
lwt=47df576e8[47df576e8,47df576e8] ltm=47df576f8[47df576f8,47df576f8]
pwt=47df576b0[47df576b0,47df576b0] ptm=47df576c0[47df576c0,47df576c0]
ref=47df57718[47df57718,47df57718] lnd=47df57730[47df57730,47df57730]
LIBRARY OBJECT: object=471ee1d38
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 471ee1800 471ee1470 47df7dce0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47df7de48 471ee1e50 I/P/A/-/- 0 NONE 00
SO: 473691d60, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473691d60 handle=47bb22fa0 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=473691de0[4735dbcb8,476cfbf58] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x0
LIBRARY OBJECT HANDLE: handle=47bb22fa0 mtx=47bb230d0(0) cdp=0
namespace=CRSR flags=RON/KGHP/PN0/EXP/[10010100]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=fd84 hlc=fd84
lwt=47bb23048[47bb23048,47bb23048] ltm=47bb23058[47bb23058,47bb23058]
pwt=47bb23010[47bb23010,47bb23010] ptm=47bb23020[47bb23020,47bb23020]
ref=47bb23078[472f8de18,472f8de18] lnd=47bb23090[47bb23090,47bb23090]
LIBRARY OBJECT: object=472f8d9d8
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DEPENDENCIES: count=1 size=16
AUTHORIZATIONS: count=1 size=16 minimum entrysize=16
ACCESSES: count=1 size=16
TRANSLATIONS: count=1 size=16
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb22ee0 472f8daf0 I/P/A/-/- 0 NONE 00
6 472f8e508 46be86250 I/-/A/-/E 0 NONE 00
SO: 4735dbc38, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=4735dbc38 handle=47bb231c8 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4735dbcb8[476cfbf58,473691de0] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bb231c8 mtx=47bb232f8(1) cdp=1
name=select value$ from props$ where name = 'GLOBAL_DB_NAME'
hash=4bb432d65c5a391a42a5c3fa74472c7a timestamp=09-09-2010 04:24:12
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/KST/DBN/MTX/[120100d0]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=0584 hlc=0584
lwt=47bb23270[47bb23270,47bb23270] ltm=47bb23280[47bb23280,47bb23280]
pwt=47bb23238[47bb23238,47bb23238] ptm=47bb23248[47bb23248,47bb23248]
ref=47bb232a0[47bb232a0,47bb232a0] lnd=47bb232b8[47bb232b8,47bb232b8]
LIBRARY OBJECT: object=472f8e6e0
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 472f8e1a8 472f8de18 47bb22fa0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb23108 472f8e7f8 I/P/A/-/- 0 NONE 00
SO: 473644348, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473644348 handle=47bbde418 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4736443c8[476cfc0b8,476cfc0b8] htb=476cfc0b8 ssga=476cfb6a0
user=47924e810 session=47924e810 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bbde418 mtx=47bbde548(0) cdp=0
name=ALTER SESSION SET TIME_ZONE='+02:00'
hash=3878dff8839e71e3dd05a2e75fbd6390 timestamp=09-09-2010 04:24:04
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/DBN/[12010040]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=11 hpc=04e8 hlc=04e8
lwt=47bbde4c0[47bbde4c0,47bbde4c0] ltm=47bbde4d0[47bbde4d0,47bbde4d0]
pwt=47bbde488[47bbde488,47bbde488] ptm=47bbde498[47bbde498,47bbde498]
ref=47bbde4f0[47bbde4f0,47bbde4f0] lnd=47bbde508[47bbde508,47bbde508]
LIBRARY OBJECT: object=472fffc08
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bbde320 472fffd20 I/P/A/-/- 0 NONE 00
SO: 47aecf9e8, type: 41, owner: 47924e810, flag: INIT/-/-/0x00
(dummy) nxc=0, nlb=0
SO: 47f290540, type: 11, owner: 4781a7dc0, flag: INIT/-/-/0x00
(broadcast handle) flag: (2) ACTIVE SUBSCRIBER, owner: 4781a7dc0,
event: 1132, last message event: 1132,
last message waited event: 1132, next message: 0(0), messages read: 0
channel: (47a2df4f8) system events broadcast channel
scope: 2, event: 1132, last mesage event: 18,
publishers/subscribers: 0/17,
messages published: 1
SO: 47826b228, type: 3, owner: 4781a7dc0, flag: INIT/-/-/0x00
(call) sess: cur 47924e810, rec 0, usr 47924e810; depth: 0
SO: 476c52968, type: 16, owner: 4781a7dc0, flag: INIT/-/-/0x00
(osp req holder)
PSEUDO PROCESS for group DEFAULT:
SO: 47a1eb7d0, type: 2, owner: 0, flag: INIT/-/-/0x00
(process) Oracle pid=0, calls cur/top: 0/0, flag: (20) PSEUDO
int error: 0, call error: 0, sess error: 0, txn error 0
(post info) last post received: 0 0 0
last post received-location: No post
last process to post me: none
last post sent: 0 0 0
last post sent-location: No post
last process posted by me: none
(latch info) wait_event=0 bits=0
Process Group: DEFAULT, pseudo proc: 47a1eb7d0
O/S info: user: , term: , ospid: (DEAD)
OSD pid info: Unix process pid: 0, image: PSEUDO
Dump of memory from 0x00000004791BF538 to 0x00000004791BF740
4791BF530 00000000 00000000 [........]
4791BF540 00000000 00000000 00000000 00000000 [................]
Repeat 31 times
NO DETACHED BRANCHES.
NO DETACHED NETWORK CONNECTIONS.
CLEANUP STATE OBJECTS:
SO: 47f0cd038, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: instance enqueue anchor state
latch: 0x380009890
SO: 4782cf080, type: 5, owner: 47f0cd038, flag: INIT/-/-/0x00
(enqueue) TA-00000006-00000001 DID: 0001-000F-0000000B
lv: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 res_flag: 0x2
res: 0x47a28d020, mode: X, lock_flag: 0x0
own: 0x0, sess: 0x0, prv: 0x47a28d030
SO: 47f0cd098, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: switchable channel handle anch
latch: 0x38000ac98
SO: 47f28f868, type: 11, owner: 47f0cd098, flag: INIT/-/-/0x00
(broadcast handle) flag: (c2) ACTIVE SUBSCRIBER, owner: 0,
event: 1, last message event: 1,
last message waited event: 1, next message: 0(0), messages read: 0
channel: (47a2e4190) KPON channel
scope: 2, event: 1, last mesage event: 0,
publishers/subscribers: 0/1,
messages published: 0
SO: 47f0cd0f8, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: TT shared object cleanup SO
latch: 0x38001c6b8
SO: 47f0cd158, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: SS shared object cleanup SO
latch: 0x38001cd48
END OF SYSTEM STATE
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
db file sequential read 2,347,652 9,215 4 64.5 User I/O
db file scattered read 245,687 4,199 17 29.4 User I/O
CPU time 974 6.8
db file parallel write 50,082 408 8 2.9 System I/O
log file parallel write 6,963 52 7 0.4 System I/O
Time Model Statistics DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Total time in database user-calls (DB Time): 14286.4s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 14,280.3 100.0
DB CPU 974.5 6.8
PL/SQL execution elapsed time 531.8 3.7
parse time elapsed 30.5 .2
hard parse elapsed time 27.1 .2
connection management call elapsed time 14.9 .1
hard parse (sharing criteria) elapsed time 3.4 .0
hard parse (bind mismatch) elapsed time 3.1 .0
PL/SQL compilation elapsed time 2.4 .0
failed parse elapsed time 0.0 .0
repeated bind elapsed time 0.0 .0
sequence load elapsed time 0.0 .0
DB time 14,286.4 N/A
background elapsed time 670.2 N/A
background cpu time 186.1 N/A
Wait Class DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc
Avg
%Time Total Wait wait Waits
Wait Class Waits -outs Time (s) (ms) /txn
User I/O 2,593,484 .0 13,415 5 150.0
System I/O 87,506 .0 515 6 5.1
Other 839 11.4 6 7 0.0
Commit 3,225 .1 6 2 0.2
Concurrency 1,033 .0 5 5 0.1
Configuration 2,514 99.4 0 0 0.1
Network 47,559 .0 0 0 2.8
Application 7 .0 0 0 0.0
Wait Events DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file sequential read 2,347,652 .0 9,215 4 135.8
db file scattered read 245,687 .0 4,199 17 14.2
db file parallel write 50,082 .0 408 8 2.9
log file parallel write 6,963 .0 52 7 0.4
control file parallel write 6,203 .0 44 7 0.4
control file sequential read 24,242 .0 11 0 1.4
log file sync 3,225 .1 6 2 0.2
latch free 84 .0 4 47 0.0
os thread startup 25 .0 3 120 0.0
latch: session allocation 39 .0 1 33 0.0
db file parallel read 12 .0 1 92 0.0
enq: TX - index contention 186 .0 1 3 0.0
latch: shared pool 47 .0 1 11 0.0
LGWR wait for redo copy 319 3.1 0 1 0.0
library cache load lock 2 .0 0 172 0.0
buffer busy waits 590 .0 0 0 0.0
log file switch completion 6 .0 0 29 0.0
SGA: allocation forcing comp 11 54.5 0 14 0.0
latch: library cache lock 50 .0 0 3 0.0
read by other session 38 .0 0 4 0.0
direct path read 42 .0 0 3 0.0
SQL*Net message to client 44,807 .0 0 0 2.6
rdbms ipc reply 207 .0 0 0 0.0
SQL*Net more data from clien 1,014 .0 0 0 0.1
latch: cache buffers chains 24 .0 0 1 0.0
latch: library cache 29 .0 0 1 0.0
log file sequential read 8 .0 0 3 0.0
direct path write 50 .0 0 0 0.0
SQL*Net more data to client 398 .0 0 0 0.0
latch: object queue header o 12 .0 0 1 0.0
latch: In memory undo latch 78 .0 0 0 0.0
undo segment extension 2,507 99.7 0 0 0.1
latch: cache buffers lru cha 4 .0 0 1 0.0
log file single write 8 .0 0 0 0.0
local write wait 3 .0 0 1 0.0
enq: RO - fast object reuse 3 .0 0 1 0.0
buffer deadlock 87 92.0 0 0 0.0
enq: JS - queue lock 1 .0 0 1 0.0
cursor: pin S 70 .0 0 0 0.0
latch: row cache objects 2 .0 0 1 0.0
SQL*Net message to dblink 1,338 .0 0 0 0.1
latch: checkpoint queue latc 2 .0 0 0 0.0
reliable message 3 .0 0 0 0.0
log buffer space 1 .0 0 1 0.0
SQL*Net break/reset to clien 4 .0 0 0 0.0
SQL*Net more data from dblin 2 .0 0 0 0.0
SQL*Net message from client 44,949 .0 155,701 3464 2.6
virtual circuit status 621 100.0 18,156 29237 0.0
Streams AQ: qmn slave idle w 664 .0 18,127 27299 0.0
Streams AQ: qmn coordinator 1,339 50.4 18,099 13517 0.1
Streams AQ: waiting for time 12 100.0 8,741 728394 0.0
jobq slave wait 130 100.0 380 2927 0.0
PL/SQL lock timer 1 100.0 1 978 0.0
SQL*Net message from dblink 1,338 .0 0 0 0.1
single-task message 1 .0 0 38 0.0
class slave wait 11 .0 0 1 0.0
SQL ordered by Elapsed Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
Elapsed CPU Elap per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
13,664 906 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
8,792 195 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
2,524 368 1 2524.1 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
1,414 177 1 1414.4 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
742 137 1 742.2 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
274 11 1 274.2 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
264 8 27 9.8 1.8 8szmwam7fysa3
Module: DBMS_SCHEDULER
insert into wri$_adv_objspace_trend_data select timepoint, space_usage, space_a
lloc, quality from table(dbms_space.object_growth_trend(:1, :2, :3, :4, NULL, N
ULL, NULL, 'FALSE', :5, 'FALSE'))
99 1 1 99.4 0.7 1z0x41f66nvjr
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTADMIN SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
21 10 1 21.5 0.2 bbc1ck8594kvj
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTDAILYHIST SET ADJOPEN=NVL(ADJOPEN,OPEN), ADJHIGH=NVL(ADJH
IGH,HIGH), ADJLOW=NVL(ADJLOW,LOW), ADJMID=NVL(ADJMID,MID), ADJCLOSE=NVL(ADJCLOSE
,CLOSE), ADJVOLUME=NVL(ADJVOLUME,VOLUME), ADJCLOSINGBID=NVL(ADJCLOSINGBID,CLOSIN
GBID), ADJCLOSINGOFFER=NVL(ADJCLOSINGOFFER,CLOSINGOFFER)
12 0 1 12.5 0.1 6xm9p9uy5kaap
Module: SQL*Plus
SELECT count(*) FROM TIBEX_INSTRUMENTSTATE WHERE INSTRUMENTID=:"SYS_B_0"
SQL ordered by CPU Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
CPU Elapsed CPU per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
906 13,664 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
368 2,524 1 367.51 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
195 8,792 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
177 1,414 1 176.93 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
137 742 1 137.38 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
11 274 1 10.82 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
10 21 1 9.65 0.2 bbc1ck8594kvjEdited by: NM on 10-Sep-2010 07:39Hi,
Last night we had issue with one of the prod server where we updating one of table which contains large number records in millions.Same identical machine completed in1 hour and other box never completed but doing db file sequential read but in the long ops the last statement it was done 20:16 after that nothing is happening but i ran few trace on that user.
/u01/app/oracle/admin/SURV2/udump/surv2_ora_10048.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 18
Unix process pid: 10048, image: oracle@prdfa001
*** 2010-09-09 23:37:07.484
*** ACTION NAME:() 2010-09-09 23:37:07.473
*** MODULE NAME:(SQL*Plus) 2010-09-09 23:37:07.473
*** SERVICE NAME:(SURV2) 2010-09-09 23:37:07.473
*** SESSION ID:(289.54) 2010-09-09 23:37:07.473
Received ORADEBUG command 'unlimit' from process Unix process pid: 3983, image:
*** 2010-09-09 23:37:20.315
Received ORADEBUG command 'event 10046 trace name context forever, level 12' from process Unix process pid: 3983, image:
WAIT #7: nam='db file sequential read' ela= 11160 file#=13 block#=2252349 blocks=1 obj#=166421 tim=12499462835161
WAIT #7: nam='db file sequential read' ela= 2857 file#=13 block#=2249751 blocks=1 obj#=166421 tim=12499462838137
WAIT #7: nam='db file sequential read' ela= 3810 file#=13 block#=2251361 blocks=1 obj#=166421 tim=12499462842048
WAIT #7: nam='db file sequential read' ela= 4459 file#=13 block#=2247059 blocks=1 obj#=166421 tim=12499462846564
WAIT #7: nam='db file sequential read' ela= 2841 file#=13 block#=2247507 blocks=1 obj#=166421 tim=12499462849468
WAIT #7: nam='db file sequential read' ela= 427 file#=13 block#=2247568 blocks=1 obj#=166421 tim=12499462850032
WAIT #7: nam='db file sequential read' ela= 1187 file#=13 block#=2248264 blocks=1 obj#=166421 tim=12499462851327
WAIT #7: nam='db file sequential read' ela= 2687 file#=13 block#=2250707 blocks=1 obj#=166421 tim=12499462854178
WAIT #7: nam='db file sequential read' ela= 3657 file#=13 block#=2249697 blocks=1 obj#=166421 tim=12499462857896
WAIT #7: nam='db file sequential read' ela= 4139 file#=13 block#=2247074 blocks=1 obj#=166421 tim=12499462862093
WAIT #7: nam='db file sequential read' ela= 4180 file#=47 block#=3649690 blocks=1 obj#=166421 tim=12499509270445
WAIT #7: nam='db file sequential read' ela= 4802 file#=47 block#=3649309 blocks=1 obj#=166421 tim=12499509275327
WAIT #7: nam='db file sequential read' ela= 2459 file#=47 block#=3652697 blocks=1 obj#=166421 tim=12499509277859
WAIT #7: nam='db file sequential read' ela= 4015 file#=47 block#=3652826 blocks=1 obj#=166421 tim=12499509281948
WAIT #7: nam='db file sequential read' ela= 2248 file#=47 block#=3651610 blocks=1 obj#=166421 tim=12499509284269
WAIT #7: nam='db file sequential read' ela= 4824 file#=47 block#=3654297 blocks=1 obj#=166421 tim=12499509289166
WAIT #7: nam='db file sequential read' ela= 2008 file#=47 block#=3652312 blocks=1 obj#=166421 tim=12499509291248
WAIT #7: nam='db file sequential read' ela= 1925 file#=47 block#=3654490 blocks=1 obj#=166421 tim=12499509293246
WAIT #7: nam='db file sequential read' ela= 2859 file#=47 block#=3648458 blocks=1 obj#=166421 tim=12499509296178
WAIT #7: nam='db file sequential read' ela= 1740 file#=47 block#=3648212 blocks=1 obj#=166421 tim=12499509297991
WAIT #7: nam='db file sequential read' ela= 2566 file#=47 block#=3648411 blocks=1 obj#=166421 tim=12499509300631
WAIT #7: nam='db file sequential read' ela= 50772 file#=5 block#=480749 blocks=1 obj#=166421 tim=12499509351477
WAIT #7: nam='db file sequential read' ela= 12928 file#=5 block#=477177 blocks=1 obj#=166421 tim=12499509364482
WAIT #7: nam='db file sequential read' ela= 11116 file#=5 block#=479412 blocks=1 obj#=166421 tim=12499509375672
WAIT #7: nam='db file sequential read' ela= 4803 file#=5 block#=483440 blocks=1 obj#=166421 tim=12499509380549
WAIT #7: nam='db file sequential read' ela= 6900 file#=5 block#=481454 blocks=1 obj#=166421 tim=12499509387522
Received ORADEBUG command 'event 10046 trace name context off' from process Unix process pid: 3983, image:
/u01/app/oracle/admin/SURV2/udump/surv2_ora_1545.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 22
Unix process pid: 1545, image: oracle@prdfa001 (TNS V1-V3)
*** ACTION NAME:() 2010-09-09 23:20:13.485
*** MODULE NAME:(sqlplus@prdfa001 (TNS V1-V3)) 2010-09-09 23:20:13.485
*** SERVICE NAME:(SYS$USERS) 2010-09-09 23:20:13.485
*** SESSION ID:(290.697) 2010-09-09 23:20:13.485
===================================================
SYSTEM STATE
System global information:
processes: base 47819b480, size 300, cleanup 4781a5638
allocation: free sessions 47f1d6148, free calls 0
control alloc errors: 0 (process), 0 (session), 0 (call)
PMON latch cleanup depth: 0
seconds since PMON's last scan for dead processes: 20
system statistics:
1171 logons cumulative
19 logons current
89219 opened cursors cumulative
86 opened cursors current
15095069 user commits
5 user rollbacks
58632904 user calls
44023255 recursive calls
224311 recursive cpu usage
201424173 session logical reads
0 session stored procedure space
901812 CPU used when call started
995437 CPU used by this session
6814196 DB time
0 cluster wait time
22542300822 concurrency wait time
3095 application wait time
16479074661 user I/O wait time
1284052668 session connect time
1284067190 process last non-idle time
189018343568 session uga memory
1249667216 session uga memory max
26059216 messages sent
26059220 messages received
239739 background timeouts
162399896 session pga memory
189662872 session pga memory max
4 enqueue timeouts
901146 enqueue waits
0 enqueue deadlocks
32122711 enqueue requests
17819 enqueue conversions
32122676 enqueue releases
0 global enqueue gets sync
0 global enqueue gets async
0 global enqueue get time
0 global enqueue releases
2865667 physical read total IO requests
262620 physical read total multi block requests
270093476864 physical read total bytes
select SYS_CONTEXT('USERENV', 'SERVER_HOST'), SYS_CONTEXT('USERENV', 'DB_UNIQUE_NAME'), SYS_CONTEXT('USERENV', 'INSTANCE_NAME'), SYS_CONTEXT('USERENV', 'SERVICE_NAME'), INSTANCE_NUMBER, STARTUP_TIME, SYS_CONTEXT('USERENV', 'DB_DOMAIN') from v$instance where INSTANCE_NAME=SYS_CONTEXT('USERENV', 'INSTANCE_NAME')
hash=550c95f3d0cfa8290e60ea8382d3a2ca timestamp=09-09-2010 04:24:19
namespace=CRSR flags=RON/KGHP/TIM/PN0/LRG/KST/DBN/MTX/[100100d1]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=9 hpc=0582 hlc=0582
lwt=47df576e8[47df576e8,47df576e8] ltm=47df576f8[47df576f8,47df576f8]
pwt=47df576b0[47df576b0,47df576b0] ptm=47df576c0[47df576c0,47df576c0]
ref=47df57718[47df57718,47df57718] lnd=47df57730[47df57730,47df57730]
LIBRARY OBJECT: object=471ee1d38
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 471ee1800 471ee1470 47df7dce0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47df7de48 471ee1e50 I/P/A/-/- 0 NONE 00
SO: 473691d60, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473691d60 handle=47bb22fa0 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=473691de0[4735dbcb8,476cfbf58] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x0
LIBRARY OBJECT HANDLE: handle=47bb22fa0 mtx=47bb230d0(0) cdp=0
namespace=CRSR flags=RON/KGHP/PN0/EXP/[10010100]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=fd84 hlc=fd84
lwt=47bb23048[47bb23048,47bb23048] ltm=47bb23058[47bb23058,47bb23058]
pwt=47bb23010[47bb23010,47bb23010] ptm=47bb23020[47bb23020,47bb23020]
ref=47bb23078[472f8de18,472f8de18] lnd=47bb23090[47bb23090,47bb23090]
LIBRARY OBJECT: object=472f8d9d8
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DEPENDENCIES: count=1 size=16
AUTHORIZATIONS: count=1 size=16 minimum entrysize=16
ACCESSES: count=1 size=16
TRANSLATIONS: count=1 size=16
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb22ee0 472f8daf0 I/P/A/-/- 0 NONE 00
6 472f8e508 46be86250 I/-/A/-/E 0 NONE 00
SO: 4735dbc38, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=4735dbc38 handle=47bb231c8 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4735dbcb8[476cfbf58,473691de0] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bb231c8 mtx=47bb232f8(1) cdp=1
name=select value$ from props$ where name = 'GLOBAL_DB_NAME'
hash=4bb432d65c5a391a42a5c3fa74472c7a timestamp=09-09-2010 04:24:12
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/KST/DBN/MTX/[120100d0]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=0584 hlc=0584
lwt=47bb23270[47bb23270,47bb23270] ltm=47bb23280[47bb23280,47bb23280]
pwt=47bb23238[47bb23238,47bb23238] ptm=47bb23248[47bb23248,47bb23248]
ref=47bb232a0[47bb232a0,47bb232a0] lnd=47bb232b8[47bb232b8,47bb232b8]
LIBRARY OBJECT: object=472f8e6e0
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 472f8e1a8 472f8de18 47bb22fa0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb23108 472f8e7f8 I/P/A/-/- 0 NONE 00
SO: 473644348, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473644348 handle=47bbde418 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4736443c8[476cfc0b8,476cfc0b8] htb=476cfc0b8 ssga=476cfb6a0
user=47924e810 session=47924e810 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bbde418 mtx=47bbde548(0) cdp=0
name=ALTER SESSION SET TIME_ZONE='+02:00'
hash=3878dff8839e71e3dd05a2e75fbd6390 timestamp=09-09-2010 04:24:04
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/DBN/[12010040]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=11 hpc=04e8 hlc=04e8
lwt=47bbde4c0[47bbde4c0,47bbde4c0] ltm=47bbde4d0[47bbde4d0,47bbde4d0]
pwt=47bbde488[47bbde488,47bbde488] ptm=47bbde498[47bbde498,47bbde498]
ref=47bbde4f0[47bbde4f0,47bbde4f0] lnd=47bbde508[47bbde508,47bbde508]
LIBRARY OBJECT: object=472fffc08
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bbde320 472fffd20 I/P/A/-/- 0 NONE 00
SO: 47aecf9e8, type: 41, owner: 47924e810, flag: INIT/-/-/0x00
(dummy) nxc=0, nlb=0
SO: 47f290540, type: 11, owner: 4781a7dc0, flag: INIT/-/-/0x00
(broadcast handle) flag: (2) ACTIVE SUBSCRIBER, owner: 4781a7dc0,
event: 1132, last message event: 1132,
last message waited event: 1132, next message: 0(0), messages read: 0
channel: (47a2df4f8) system events broadcast channel
scope: 2, event: 1132, last mesage event: 18,
publishers/subscribers: 0/17,
messages published: 1
SO: 47826b228, type: 3, owner: 4781a7dc0, flag: INIT/-/-/0x00
(call) sess: cur 47924e810, rec 0, usr 47924e810; depth: 0
SO: 476c52968, type: 16, owner: 4781a7dc0, flag: INIT/-/-/0x00
(osp req holder)
PSEUDO PROCESS for group DEFAULT:
SO: 47a1eb7d0, type: 2, owner: 0, flag: INIT/-/-/0x00
(process) Oracle pid=0, calls cur/top: 0/0, flag: (20) PSEUDO
int error: 0, call error: 0, sess error: 0, txn error 0
(post info) last post received: 0 0 0
last post received-location: No post
last process to post me: none
last post sent: 0 0 0
last post sent-location: No post
last process posted by me: none
(latch info) wait_event=0 bits=0
Process Group: DEFAULT, pseudo proc: 47a1eb7d0
O/S info: user: , term: , ospid: (DEAD)
OSD pid info: Unix process pid: 0, image: PSEUDO
Dump of memory from 0x00000004791BF538 to 0x00000004791BF740
4791BF530 00000000 00000000 [........]
4791BF540 00000000 00000000 00000000 00000000 [................]
Repeat 31 times
NO DETACHED BRANCHES.
NO DETACHED NETWORK CONNECTIONS.
CLEANUP STATE OBJECTS:
SO: 47f0cd038, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: instance enqueue anchor state
latch: 0x380009890
SO: 4782cf080, type: 5, owner: 47f0cd038, flag: INIT/-/-/0x00
(enqueue) TA-00000006-00000001 DID: 0001-000F-0000000B
lv: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 res_flag: 0x2
res: 0x47a28d020, mode: X, lock_flag: 0x0
own: 0x0, sess: 0x0, prv: 0x47a28d030
SO: 47f0cd098, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: switchable channel handle anch
latch: 0x38000ac98
SO: 47f28f868, type: 11, owner: 47f0cd098, flag: INIT/-/-/0x00
(broadcast handle) flag: (c2) ACTIVE SUBSCRIBER, owner: 0,
event: 1, last message event: 1,
last message waited event: 1, next message: 0(0), messages read: 0
channel: (47a2e4190) KPON channel
scope: 2, event: 1, last mesage event: 0,
publishers/subscribers: 0/1,
messages published: 0
SO: 47f0cd0f8, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: TT shared object cleanup SO
latch: 0x38001c6b8
SO: 47f0cd158, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: SS shared object cleanup SO
latch: 0x38001cd48
END OF SYSTEM STATE
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
db file sequential read 2,347,652 9,215 4 64.5 User I/O
db file scattered read 245,687 4,199 17 29.4 User I/O
CPU time 974 6.8
db file parallel write 50,082 408 8 2.9 System I/O
log file parallel write 6,963 52 7 0.4 System I/O
Time Model Statistics DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Total time in database user-calls (DB Time): 14286.4s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 14,280.3 100.0
DB CPU 974.5 6.8
PL/SQL execution elapsed time 531.8 3.7
parse time elapsed 30.5 .2
hard parse elapsed time 27.1 .2
connection management call elapsed time 14.9 .1
hard parse (sharing criteria) elapsed time 3.4 .0
hard parse (bind mismatch) elapsed time 3.1 .0
PL/SQL compilation elapsed time 2.4 .0
failed parse elapsed time 0.0 .0
repeated bind elapsed time 0.0 .0
sequence load elapsed time 0.0 .0
DB time 14,286.4 N/A
background elapsed time 670.2 N/A
background cpu time 186.1 N/A
Wait Class DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc
Avg
%Time Total Wait wait Waits
Wait Class Waits -outs Time (s) (ms) /txn
User I/O 2,593,484 .0 13,415 5 150.0
System I/O 87,506 .0 515 6 5.1
Other 839 11.4 6 7 0.0
Commit 3,225 .1 6 2 0.2
Concurrency 1,033 .0 5 5 0.1
Configuration 2,514 99.4 0 0 0.1
Network 47,559 .0 0 0 2.8
Application 7 .0 0 0 0.0
Wait Events DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file sequential read 2,347,652 .0 9,215 4 135.8
db file scattered read 245,687 .0 4,199 17 14.2
db file parallel write 50,082 .0 408 8 2.9
log file parallel write 6,963 .0 52 7 0.4
control file parallel write 6,203 .0 44 7 0.4
control file sequential read 24,242 .0 11 0 1.4
log file sync 3,225 .1 6 2 0.2
latch free 84 .0 4 47 0.0
os thread startup 25 .0 3 120 0.0
latch: session allocation 39 .0 1 33 0.0
db file parallel read 12 .0 1 92 0.0
enq: TX - index contention 186 .0 1 3 0.0
latch: shared pool 47 .0 1 11 0.0
LGWR wait for redo copy 319 3.1 0 1 0.0
library cache load lock 2 .0 0 172 0.0
buffer busy waits 590 .0 0 0 0.0
log file switch completion 6 .0 0 29 0.0
SGA: allocation forcing comp 11 54.5 0 14 0.0
latch: library cache lock 50 .0 0 3 0.0
read by other session 38 .0 0 4 0.0
direct path read 42 .0 0 3 0.0
SQL*Net message to client 44,807 .0 0 0 2.6
rdbms ipc reply 207 .0 0 0 0.0
SQL*Net more data from clien 1,014 .0 0 0 0.1
latch: cache buffers chains 24 .0 0 1 0.0
latch: library cache 29 .0 0 1 0.0
log file sequential read 8 .0 0 3 0.0
direct path write 50 .0 0 0 0.0
SQL*Net more data to client 398 .0 0 0 0.0
latch: object queue header o 12 .0 0 1 0.0
latch: In memory undo latch 78 .0 0 0 0.0
undo segment extension 2,507 99.7 0 0 0.1
latch: cache buffers lru cha 4 .0 0 1 0.0
log file single write 8 .0 0 0 0.0
local write wait 3 .0 0 1 0.0
enq: RO - fast object reuse 3 .0 0 1 0.0
buffer deadlock 87 92.0 0 0 0.0
enq: JS - queue lock 1 .0 0 1 0.0
cursor: pin S 70 .0 0 0 0.0
latch: row cache objects 2 .0 0 1 0.0
SQL*Net message to dblink 1,338 .0 0 0 0.1
latch: checkpoint queue latc 2 .0 0 0 0.0
reliable message 3 .0 0 0 0.0
log buffer space 1 .0 0 1 0.0
SQL*Net break/reset to clien 4 .0 0 0 0.0
SQL*Net more data from dblin 2 .0 0 0 0.0
SQL*Net message from client 44,949 .0 155,701 3464 2.6
virtual circuit status 621 100.0 18,156 29237 0.0
Streams AQ: qmn slave idle w 664 .0 18,127 27299 0.0
Streams AQ: qmn coordinator 1,339 50.4 18,099 13517 0.1
Streams AQ: waiting for time 12 100.0 8,741 728394 0.0
jobq slave wait 130 100.0 380 2927 0.0
PL/SQL lock timer 1 100.0 1 978 0.0
SQL*Net message from dblink 1,338 .0 0 0 0.1
single-task message 1 .0 0 38 0.0
class slave wait 11 .0 0 1 0.0
SQL ordered by Elapsed Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
Elapsed CPU Elap per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
13,664 906 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
8,792 195 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
2,524 368 1 2524.1 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
1,414 177 1 1414.4 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
742 137 1 742.2 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
274 11 1 274.2 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
264 8 27 9.8 1.8 8szmwam7fysa3
Module: DBMS_SCHEDULER
insert into wri$_adv_objspace_trend_data select timepoint, space_usage, space_a
lloc, quality from table(dbms_space.object_growth_trend(:1, :2, :3, :4, NULL, N
ULL, NULL, 'FALSE', :5, 'FALSE'))
99 1 1 99.4 0.7 1z0x41f66nvjr
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTADMIN SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
21 10 1 21.5 0.2 bbc1ck8594kvj
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTDAILYHIST SET ADJOPEN=NVL(ADJOPEN,OPEN), ADJHIGH=NVL(ADJH
IGH,HIGH), ADJLOW=NVL(ADJLOW,LOW), ADJMID=NVL(ADJMID,MID), ADJCLOSE=NVL(ADJCLOSE
,CLOSE), ADJVOLUME=NVL(ADJVOLUME,VOLUME), ADJCLOSINGBID=NVL(ADJCLOSINGBID,CLOSIN
GBID), ADJCLOSINGOFFER=NVL(ADJCLOSINGOFFER,CLOSINGOFFER)
12 0 1 12.5 0.1 6xm9p9uy5kaap
Module: SQL*Plus
SELECT count(*) FROM TIBEX_INSTRUMENTSTATE WHERE INSTRUMENTID=:"SYS_B_0"
SQL ordered by CPU Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
CPU Elapsed CPU per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
906 13,664 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
368 2,524 1 367.51 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
195 8,792 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
177 1,414 1 176.93 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
137 742 1 137.38 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
11 274 1 10.82 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
10 21 1 9.65 0.2 bbc1ck8594kvjEdited by: NM on 10-Sep-2010 07:39 -
Database Performace Is Very Poor On IBM AIX Compared To Windows NT
Hi,
Recently we have migrated Our Oracle 10g DataBase from Windows NT to IBM AIX Box. Unfortunately, the Database Performance is gone down when compared to Windows NT environment. Since been a week we are working to pick the problem. We have altered the init.ora parameters to see the database behaviour., But there no Improvement is been observerd.
Below are the Init.Ora Parameters ,
Name Value Description
tracefile_identifier null trace file custom identifier
lock_name_space null lock name space used for generating lock names for standby/clone database
processes 395 user processes
sessions 439 user and system sessions
timed_statistics TRUE maintain internal timing statistics
timed_os_statistics 0 internal os statistic gathering interval in seconds
resource_limit TRUE master switch for resource limit
license_max_sessions 0 maximum number of non-system user sessions allowed
license_sessions_warning 0 warning level for number of non-system user sessions
cpu_count 16 number of CPUs for this instance
instance_groups null list of instance group names
event null debug event control - default null string
sga_max_size 15032385536 max total SGA size
pre_page_sga FALSE pre-page sga for process
shared_memory_address 0 SGA starting address (low order 32-bits on 64-bit platforms)
hi_shared_memory_address 0 SGA starting address (high order 32-bits on 64-bit platforms)
use_indirect_data_buffers FALSE Enable indirect data buffers (very large SGA on 32-bit platforms)
lock_sga TRUE Lock entire SGA in physical memory
shared_pool_size 0 size in bytes of shared pool
large_pool_size 0 size in bytes of large pool
java_pool_size 0 size in bytes of java pool
streams_pool_size 50331648 size in bytes of the streams pool
shared_pool_reserved_size 84724940 size in bytes of reserved area of shared pool
java_soft_sessionspace_limit 0 warning limit on size in bytes of a Java sessionspace
java_max_sessionspace_size 0 max allowed size in bytes of a Java sessionspace
spfile /oracle/app/product/10.2.0.3.0/dbs/spfileCALMDB.ora server parameter file
instance_type RDBMS type of instance to be executed
trace_enabled FALSE enable KST tracing
nls_language AMERICAN NLS language name
nls_territory AMERICA NLS territory name
nls_sort null NLS linguistic definition name
nls_date_language null NLS date language name
nls_date_format null NLS Oracle date format
nls_currency null NLS local currency symbol
nls_numeric_characters null NLS numeric characters
nls_iso_currency null NLS ISO currency territory name
nls_calendar null NLS calendar system name
nls_time_format null time format
nls_timestamp_format null time stamp format
nls_time_tz_format null time with timezone format
nls_timestamp_tz_format null timestampe with timezone format
nls_dual_currency null Dual currency symbol
nls_comp null NLS comparison
nls_length_semantics BYTE create columns using byte or char semantics by default
nls_nchar_conv_excp FALSE NLS raise an exception instead of allowing implicit conversion
fileio_network_adapters null Network Adapters for File I/O
filesystemio_options asynch IO operations on filesystem files
disk_asynch_io FALSE Use asynch I/O for random access devices
tape_asynch_io TRUE Use asynch I/O requests for tape devices
dbwr_io_slaves 0 DBWR I/O slaves
backup_tape_io_slaves FALSE BACKUP Tape I/O slaves
resource_manager_plan null resource mgr top plan
cluster_interconnects null interconnects for RAC use
file_mapping FALSE enable file mapping
gcs_server_processes 0 number of background gcs server processes to start
active_instance_count null number of active instances in the cluster database
sga_target 15032385536 Target size of SGA
control_files /oradata10/oradata/CALMDB/control/CONTROL02.CTL control file names list
db_file_name_convert null datafile name convert patterns and strings for standby/clone db
log_file_name_convert null logfile name convert patterns and strings for standby/clone db
control_file_record_keep_time 0 control file record keep time in days
db_block_buffers 0 Number of database blocks cached in memory
db_block_checksum TRUE store checksum in db blocks and check during reads
db_block_size 8192 Size of database block in bytes
db_cache_size 2147483648 Size of DEFAULT buffer pool for standard block size buffers
db_2k_cache_size 0 Size of cache for 2K buffers
db_4k_cache_size 0 Size of cache for 4K buffers
db_8k_cache_size 0 Size of cache for 8K buffers
db_16k_cache_size 0 Size of cache for 16K buffers
db_32k_cache_size 0 Size of cache for 32K buffers
db_keep_cache_size 0 Size of KEEP buffer pool for standard block size buffers
db_recycle_cache_size 0 Size of RECYCLE buffer pool for standard block size buffers
db_writer_processes 6 number of background database writer processes to start
buffer_pool_keep null Number of database blocks/latches in keep buffer pool
buffer_pool_recycle null Number of database blocks/latches in recycle buffer pool
db_cache_advice ON Buffer cache sizing advisory
max_commit_propagation_delay 0 Max age of new snapshot in .01 seconds
compatible 10.2.0.3.0 Database will be completely compatible with this software version
remote_archive_enable TRUE remote archival enable setting
log_archive_config null log archive config parameter
log_archive_start FALSE start archival process on SGA initialization
log_archive_dest null archival destination text string
log_archive_duplex_dest null duplex archival destination text string
log_archive_dest_1 null archival destination #1 text string
log_archive_dest_2 null archival destination #2 text string
log_archive_dest_3 null archival destination #3 text string
log_archive_dest_4 null archival destination #4 text string
log_archive_dest_5 null archival destination #5 text string
log_archive_dest_6 null archival destination #6 text string
log_archive_dest_7 null archival destination #7 text string
log_archive_dest_8 null archival destination #8 text string
log_archive_dest_9 null archival destination #9 text string
log_archive_dest_10 null archival destination #10 text string
log_archive_dest_state_1 enable archival destination #1 state text string
log_archive_dest_state_2 enable archival destination #2 state text string
log_archive_dest_state_3 enable archival destination #3 state text string
log_archive_dest_state_4 enable archival destination #4 state text string
log_archive_dest_state_5 enable archival destination #5 state text string
log_archive_dest_state_6 enable archival destination #6 state text string
log_archive_dest_state_7 enable archival destination #7 state text string
log_archive_dest_state_8 enable archival destination #8 state text string
log_archive_dest_state_9 enable archival destination #9 state text string
log_archive_dest_state_10 enable archival destination #10 state text string
log_archive_max_processes 2 maximum number of active ARCH processes
log_archive_min_succeed_dest 1 minimum number of archive destinations that must succeed
standby_archive_dest ?/dbs/arch standby database archivelog destination text string
log_archive_trace 0 Establish archivelog operation tracing level
log_archive_local_first TRUE Establish EXPEDITE attribute default value
log_archive_format %t_%s_%r.dbf archival destination format
fal_client null FAL client
fal_server null FAL server list
log_buffer 176918528 redo circular buffer size
log_checkpoint_interval 0 # redo blocks checkpoint threshold
log_checkpoint_timeout 0 Maximum time interval between checkpoints in seconds
archive_lag_target 0 Maximum number of seconds of redos the standby could lose
db_files 200 max allowable # db files
db_file_multiblock_read_count 128 db block to be read each IO
read_only_open_delayed FALSE if TRUE delay opening of read only files until first access
cluster_database FALSE if TRUE startup in cluster database mode
parallel_server FALSE if TRUE startup in parallel server mode
parallel_server_instances 1 number of instances to use for sizing OPS SGA structures
cluster_database_instances 1 number of instances to use for sizing cluster db SGA structures
db_create_file_dest null default database location
db_create_online_log_dest_1 null online log/controlfile destination #1
db_create_online_log_dest_2 null online log/controlfile destination #2
db_create_online_log_dest_3 null online log/controlfile destination #3
db_create_online_log_dest_4 null online log/controlfile destination #4
db_create_online_log_dest_5 null online log/controlfile destination #5
db_recovery_file_dest null default database recovery file location
db_recovery_file_dest_size 0 database recovery files size limit
standby_file_management MANUAL if auto then files are created/dropped automatically on standby
gc_files_to_locks null mapping between file numbers and global cache locks
thread 0 Redo thread to mount
fast_start_io_target 0 Upper bound on recovery reads
fast_start_mttr_target 0 MTTR target of forward crash recovery in seconds
log_checkpoints_to_alert FALSE log checkpoint begin/end to alert file
recovery_parallelism 0 number of server processes to use for parallel recovery
logmnr_max_persistent_sessions 1 maximum number of threads to mine
db_flashback_retention_target 1440 Maximum Flashback Database log retention time in minutes.
dml_locks 1000 dml locks - one for each table modified in a transaction
ddl_wait_for_locks FALSE Disable NOWAIT DML lock acquisitions
replication_dependency_tracking TRUE tracking dependency for Replication parallel propagation
instance_number 0 instance number
transactions 482 max. number of concurrent active transactions
transactions_per_rollback_segment 5 number of active transactions per rollback segment
rollback_segments null undo segment list
undo_management AUTO instance runs in SMU mode if TRUE, else in RBU mode
undo_tablespace UNDOTBS1 use/switch undo tablespace
undo_retention 10800 undo retention in seconds
fast_start_parallel_rollback LOW max number of parallel recovery slaves that may be used
resumable_timeout 0 set resumable_timeout
db_block_checking FALSE header checking and data and index block checking
recyclebin off recyclebin processing
create_stored_outlines null create stored outlines for DML statements
serial_reuse disable reuse the frame segments
ldap_directory_access NONE RDBMS's LDAP access option
os_roles FALSE retrieve roles from the operating system
rdbms_server_dn null RDBMS's Distinguished Name
max_enabled_roles 150 max number of roles a user can have enabled
remote_os_authent FALSE allow non-secure remote clients to use auto-logon accounts
remote_os_roles FALSE allow non-secure remote clients to use os roles
O7_DICTIONARY_ACCESSIBILITY FALSE Version 7 Dictionary Accessibility Support
remote_login_passwordfile NONE password file usage parameter
license_max_users 0 maximum number of named users that can be created in the database
audit_sys_operations TRUE enable sys auditing
global_context_pool_size null Global Application Context Pool Size in Bytes
db_domain null directory part of global database name stored with CREATE DATABASE
global_names TRUE enforce that database links have same name as remote database
distributed_lock_timeout 60 number of seconds a distributed transaction waits for a lock
commit_point_strength 1 Bias this node has toward not preparing in a two-phase commit
instance_name CALMDB instance name supported by the instance
service_names CALMDB service names supported by the instance
dispatchers (PROTOCOL=TCP) (SERVICE=CALMDB) specifications of dispatchers
shared_servers 1 number of shared servers to start up
max_shared_servers null max number of shared servers
max_dispatchers null max number of dispatchers
circuits null max number of circuits
shared_server_sessions null max number of shared server sessions
local_listener null local listener
remote_listener null remote listener
cursor_space_for_time FALSE use more memory in order to get faster execution
session_cached_cursors 200 Number of cursors to cache in a session.
remote_dependencies_mode TIMESTAMP remote-procedure-call dependencies mode parameter
utl_file_dir null utl_file accessible directories list
smtp_out_server null utl_smtp server and port configuration parameter
plsql_v2_compatibility FALSE PL/SQL version 2.x compatibility flag
plsql_compiler_flags INTERPRETED, NON_DEBUG PL/SQL compiler flags
plsql_native_library_dir null plsql native library dir
plsql_native_library_subdir_count 0 plsql native library number of subdirectories
plsql_warnings DISABLE:ALL PL/SQL compiler warnings settings
plsql_code_type INTERPRETED PL/SQL code-type
plsql_debug FALSE PL/SQL debug
plsql_optimize_level 2 PL/SQL optimize level
plsql_ccflags null PL/SQL ccflags
job_queue_processes 10 number of job queue slave processes
parallel_min_percent 0 minimum percent of threads required for parallel query
create_bitmap_area_size 8388608 size of create bitmap buffer for bitmap index
bitmap_merge_area_size 1048576 maximum memory allow for BITMAP MERGE
cursor_sharing FORCE cursor sharing mode
parallel_min_servers 10 minimum parallel query servers per instance
parallel_max_servers 320 maximum parallel query servers per instance
parallel_instance_group null instance group to use for all parallel operations
parallel_execution_message_size 4096 message buffer size for parallel execution
hash_area_size 62914560 size of in-memory hash work area
shadow_core_dump partial Core Size for Shadow Processes
background_core_dump partial Core Size for Background Processes
background_dump_dest /oradata28/oradata/CALMDB/bdump Detached process dump directory
user_dump_dest /oradata28/oradata/CALMDB/udump User process dump directory
max_dump_file_size 10M Maximum size (blocks) of dump file
core_dump_dest /oradata28/oradata/CALMDB/cdump Core dump directory
use_sigio TRUE Use SIGIO signal
audit_file_dest /oracle/app/product/10.2.0.3.0/rdbms/audit Directory in which auditing files are to reside
audit_syslog_level null Syslog facility and level
object_cache_optimal_size 102400 optimal size of the user session's object cache in bytes
object_cache_max_size_percent 10 percentage of maximum size over optimal of the user session's object cache
session_max_open_files 20 maximum number of open files allowed per session
open_links 4 max # open links per session
open_links_per_instance 4 max # open links per instance
commit_write null transaction commit log write behaviour
optimizer_features_enable 10.2.0.3 optimizer plan compatibility parameter
fixed_date null fixed SYSDATE value
audit_trail DB enable system auditing
sort_area_size 31457280 size of in-memory sort work area
sort_area_retained_size 3145728 size of in-memory sort work area retained between fetch calls
db_name TESTDB database name specified in CREATE DATABASE
db_unique_name TESTDB Database Unique Name
open_cursors 2000 max # cursors per session
ifile null include file in init.ora
sql_trace FALSE enable SQL trace
os_authent_prefix ops$ prefix for auto-logon accounts
optimizer_mode ALL_ROWS optimizer mode
sql92_security FALSE require select privilege for searched update/delete
blank_trimming FALSE blank trimming semantics parameter
star_transformation_enabled FALSE enable the use of star transformation
parallel_adaptive_multi_user TRUE enable adaptive setting of degree for multiple user streams
parallel_threads_per_cpu 2 number of parallel execution threads per CPU
parallel_automatic_tuning TRUE enable intelligent defaults for parallel execution parameters
optimizer_index_cost_adj 250 optimizer index cost adjustment
optimizer_index_caching 0 optimizer percent index caching
query_rewrite_enabled TRUE allow rewrite of queries using materialized views if enabled
query_rewrite_integrity enforced perform rewrite using materialized views with desired integrity
sql_version NATIVE sql language version parameter for compatibility issues
pga_aggregate_target 3221225472 Target size for the aggregate PGA memory consumed by the instance
workarea_size_policy AUTO policy used to size SQL working areas (MANUAL/AUTO)
optimizer_dynamic_sampling 2 optimizer dynamic sampling
statistics_level TYPICAL statistics level
skip_unusable_indexes TRUE skip unusable indexes if set to TRUE
optimizer_secure_view_merging TRUE optimizer secure view merging and predicate pushdown/movearound
aq_tm_processes 1 number of AQ Time Managers to start
hs_autoregister TRUE enable automatic server DD updates in HS agent self-registration
dg_broker_start FALSE start Data Guard broker framework (DMON process)
drs_start FALSE start DG Broker monitor (DMON process)
dg_broker_config_file1 /oracle/app/product/10.2.0.3.0/dbs/dr1CALMDB.dat data guard broker configuration file #1
dg_broker_config_file2 /oracle/app/product/10.2.0.3.0/dbs/dr2CALMDB.dat data guard broker configuration file #2
olap_page_pool_size 0 size of the olap page pool in bytes
asm_diskstring null disk set locations for discovery
asm_diskgroups null disk groups to mount automatically
asm_power_limit 1 number of processes for disk rebalancing
sqltune_category DEFAULT Category qualifier for applying hintsets pls suggest
Thanks
KrWe have examined the AWR Reports, That shows ,
Snap Id Snap Time Sessions Cursors/Session
Begin Snap: 1074 27-Jul-09 13:00:03 147 16.7
End Snap: 1075 27-Jul-09 14:01:00 150 22.3
Elapsed: 60.96 (mins)
DB Time: 9.63 (mins)
Report Summary
Cache Sizes
Begin End
Buffer Cache: 12,368M 12,368M Std Block Size: 8K
Shared Pool Size: 1,696M 1,696M Log Buffer: 178,172K
Load Profile
Per Second Per Transaction
Redo size: 12,787.87 24,786.41
Logical reads: 7,409.85 14,362.33
Block changes: 61.17 118.57
Physical reads: 0.51 0.98
Physical writes: 4.08 7.90
User calls: 60.11 116.50
Parses: 19.38 37.56
Hard parses: 0.36 0.69
Sorts: 7.87 15.25
Logons: 0.07 0.14
Executes: 50.34 97.57
Transactions: 0.52
% Blocks changed per Read: 0.83 Recursive Call %: 74.53
Rollback per transaction %: 3.29 Rows per Sort: 292.67
Instance Efficiency Percentages (Target 100%)
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 99.99 In-memory Sort %: 100.00
Library Hit %: 98.40 Soft Parse %: 98.15
Execute to Parse %: 61.51 Latch Hit %: 99.96
Parse CPU to Parse Elapsd %: 24.44 % Non-Parse CPU: 98.99
Shared Pool Statistics
Begin End
Memory Usage %: 72.35 72.86
% SQL with executions>1: 98.69 96.86
% Memory for SQL w/exec>1: 96.72 87.64
Top 5 Timed Events
Event Waits Time(s) Avg Wait(ms) % Total Call Time Wait Class
CPU time 535 92.5
db file parallel write 596 106 177 18.3 System I/O
log file parallel write 3,844 40 10 6.9 System I/O
control file parallel write 1,689 29 17 5.0 System I/O
log file sync 2,357 29 12 5.0 Commit
Time Model Statistics
Total time in database user-calls (DB Time): 578s
Statistics including the word "background" measure background process time, and so do not contribute to the DB time statistic
Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 560.61 96.99
DB CPU 534.91 92.55
parse time elapsed 24.16 4.18
hard parse elapsed time 17.90 3.10
PL/SQL execution elapsed time 7.65 1.32
connection management call elapsed time 0.89 0.15
repeated bind elapsed time 0.49 0.08
hard parse (sharing criteria) elapsed time 0.28 0.05
sequence load elapsed time 0.05 0.01
PL/SQL compilation elapsed time 0.03 0.00
failed parse elapsed time 0.02 0.00
hard parse (bind mismatch) elapsed time 0.00 0.00
DB time 577.98
background elapsed time 190.39
background cpu time 15.49
Wait Class
s - second
cs - centisecond - 100th of a second
ms - millisecond - 1000th of a second
us - microsecond - 1000000th of a second
ordered by wait time desc, waits desc
Wait Class Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn
System I/O 8,117 0.00 175 22 4.30
Commit 2,357 0.00 29 12 1.25
Network 226,127 0.00 7 0 119.83
User I/O 1,004 0.00 4 4 0.53
Application 91 0.00 2 27 0.05
Other 269 0.00 1 4 0.14
Concurrency 32 0.00 0 7 0.02
Configuration 59 0.00 0 3 0.03
Wait Events
s - second
cs - centisecond - 100th of a second
ms - millisecond - 1000th of a second
us - microsecond - 1000000th of a second
ordered by wait time desc, waits desc (idle events last)
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn
db file parallel write 596 0.00 106 177 0.32
log file parallel write 3,844 0.00 40 10 2.04
control file parallel write 1,689 0.00 29 17 0.90
log file sync 2,357 0.00 29 12 1.25
SQL*Net more data from client 4,197 0.00 7 2 2.22
db file sequential read 689 0.00 4 5 0.37
enq: RO - fast object reuse 32 0.00 2 50 0.02
rdbms ipc reply 32 0.00 1 34 0.02
db file scattered read 289 0.00 1 2 0.15
enq: KO - fast object checkpoint 47 0.00 1 14 0.02
control file sequential read 1,988 0.00 0 0 1.05
SQL*Net message to client 218,154 0.00 0 0 115.61
os thread startup 6 0.00 0 34 0.00
SQL*Net break/reset to client 12 0.00 0 15 0.01
log buffer space 59 0.00 0 3 0.03
latch free 10 0.00 0 8 0.01
SQL*Net more data to client 3,776 0.00 0 0 2.00
latch: shared pool 5 0.00 0 5 0.00
reliable message 79 0.00 0 0 0.04
LGWR wait for redo copy 148 0.00 0 0 0.08
buffer busy waits 19 0.00 0 0 0.01
direct path write temp 24 0.00 0 0 0.01
latch: cache buffers chains 2 0.00 0 0 0.00
direct path write 2 0.00 0 0 0.00
SQL*Net message from client 218,149 0.00 136,803 627 115.61
PX Idle Wait 18,013 100.06 35,184 1953 9.55
virtual circuit status 67,690 0.01 3,825 57 35.87
Streams AQ: qmn slave idle wait 130 0.00 3,563 27404 0.07
Streams AQ: qmn coordinator idle wait 264 50.76 3,563 13494 0.14
class slave wait 3 0.00 0 0 0.00
Back to Wait Events Statistics
Back to Top
Background Wait Events
ordered by wait time desc, waits desc (idle events last)
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn
db file parallel write 596 0.00 106 177 0.32
log file parallel write 3,843 0.00 40 10 2.04
control file parallel write 1,689 0.00 29 17 0.90
os thread startup 6 0.00 0 34 0.00
log buffer space 59 0.00 0 3 0.03
control file sequential read 474 0.00 0 0 0.25
log file sync 1 0.00 0 11 0.00
events in waitclass Other 148 0.00 0 0 0.08
rdbms ipc message 32,384 54.67 49,367 1524 17.16
pmon timer 1,265 100.00 3,568 2821 0.67
Streams AQ: qmn slave idle wait 130 0.00 3,563 27404 0.07
Streams AQ: qmn coordinator idle wait 264 50.76 3,563 13494 0.14
smon timer 63 11.11 3,493 55447 0.03
SQL ordered by Gets
Resources reported for PL/SQL code includes the resources used by all SQL statements called by the code.
Total Buffer Gets: 27,101,711
Captured SQL account for 81.1% of Total
Buffer Gets Executions Gets per Exec %Total CPU Time (s) Elapsed Time (s) SQL Id SQL Module SQL Text
11,889,257 3 3,963,085.67 43.87 145.36 149.62 8hr7mrcqpvw7n Begin Pkg_Pg_consolidation.Pro...
5,877,417 17,784 330.49 21.69 59.94 62.30 3mw7tf64wzgv4 SELECT TOTALVOL.PERIOD_NUMBER ...
5,877,303 17,784 330.48 21.69 62.01 63.54 g3vhvg8cz6yu3 SELECT TOTALVOL.PERIOD_NUMBER ...
3,423,336 0 12.63 200.67 200.67 6jrnq2ua8cjnq SELECT ROWNUM , first , sec...
2,810,100 2,465 1,140.00 10.37 19.29 19.29 7f4y1a3k1tzjn SELECT /*+CLUSTER(VA_STATIC_CC...
1,529,253 230 6,648.93 5.64 15.92 16.97 6trp3txn7rh1q SELECT /*+ index(va_gap_irlc_P...
1,523,043 230 6,621.93 5.62 16.22 17.18 3fu81ar131nj9 SELECT /*+ index(va_gap_irla_P...
855,620 358 2,390.00 3.16 11.49 13.31 a3g12c11x7yd0 SELECT FX_DATE, FX_RATE, CCY...
689,979 708 974.55 2.55 4.37 4.43 b7znr5szwjrtx SELECT /*+RULE*/ YIELD_CURVE_C...
603,631 2,110 286.08 2.23 11.03 13.40 3c2gyz9fhswxx SELECT ASSET_LIABILITY_GAP, AL...
554,080 5 110,816.00 2.04 2.37 2.44 9w1b11p6baqat SELECT DISTINCT consolidation_...
318,378 624 510.22 1.17 3.20 3.45 1auhbw1rd5yn2 SELECT /*+ index(va_gap_irla_P...
318,378 624 510.22 1.17 3.19 3.42 6gq9rj96p9aq0 SELECT /*+ index(va_gap_irlc_P...
313,923 3 104,641.00 1.16 2.38 2.38 7vsznt4tvh1b5 ...
SQL ordered by Reads
Total Disk Reads: 1,857
Captured SQL account for 2.1% of Total
Physical Reads Executions Reads per Exec %Total CPU Time (s) Elapsed Time (s) SQL Id SQL Module SQL Text
57 36 1.58 3.07 3.55 5.81 c6vdhsbw1t03d BEGIN citidba.proc_analyze_tab...
32 507 0.06 1.72 0.22 0.40 c49tbx3qqrtm4 insert into dependency$(d_obj#...
28 8 3.50 1.51 0.76 3.02 4crh3z5ya2r27 BEGIN PROC_DELETE_PACK_TABLES(...
20 3 6.67 1.08 145.36 149.62 8hr7mrcqpvw7n Begin Pkg_Pg_consolidation.Pro...
10 1 10.00 0.54 6.21 18.11 4m9ts1b1b27sv BEGIN domain.create_tables(:1,...
7 23 0.30 0.38 1.56 2.22 4vw03w673b9k7 BEGIN PROC_CREATE_PACK_TABLES(...
4 4 1.00 0.22 0.29 1.06 1vw6carbvp4z0 BEGIN Proc_ReCreate_Gap_temp_t...
2 182 0.01 0.11 0.06 0.08 2h0gb24h6zpnu insert into access$(d_obj#, or...
2 596 0.00 0.11 0.26 0.29 5fbmafvm27kfm insert into obj$(owner#, name,...
1 1 1.00 0.05 0.01 0.02 7jsrvff8hnqft UPDATE VA_PRR_IRUT_POL_IBCB_R...
SQL ordered by Executions
Total Executions: 184,109
Captured SQL account for 71.6% of Total
Executions Rows Processed Rows per Exec CPU per Exec (s) Elap per Exec (s) SQL Id SQL Module SQL Text
43,255 43,255 1.00 0.00 0.00 4m94ckmu16f9k JDBC Thin Client select count(*) from dual
25,964 24,769 0.95 0.00 0.00 2kxdq3m953pst SELECT SURROGATE_KEY FROM TB_P...
17,784 54,585 3.07 0.00 0.00 3mw7tf64wzgv4 SELECT TOTALVOL.PERIOD_NUMBER ...
17,784 54,585 3.07 0.00 0.00 g3vhvg8cz6yu3 SELECT TOTALVOL.PERIOD_NUMBER ...
2,631 2,631 1.00 0.00 0.00 60uw2vh6q9vn2 insert into col$(obj#, name, i...
2,465 924,375 375.00 0.01 0.01 7f4y1a3k1tzjn SELECT /*+CLUSTER(VA_STATIC_CC...
2,202 36 0.02 0.00 0.00 96g93hntrzjtr select /*+ rule */ bucket_cnt,...
2,110 206,464 97.85 0.01 0.01 3c2gyz9fhswxx SELECT ASSET_LIABILITY_GAP, AL...
2,043 2,043 1.00 0.00 0.00 28dvpph9k610y SELECT COUNT(*) FROM TB_TECH_S...
842 35 0.04 0.00 0.00 04xtrk7uyhknh select obj#, type#, ctime, mti...
SQL ordered by Parse Calls
Total Parse Calls: 70,872
Captured SQL account for 69.7% of Total
Parse Calls Executions % Total Parses SQL Id SQL Module SQL Text
17,784 17,784 25.09 3mw7tf64wzgv4 SELECT TOTALVOL.PERIOD_NUMBER ...
17,784 17,784 25.09 g3vhvg8cz6yu3 SELECT TOTALVOL.PERIOD_NUMBER ...
2,110 2,110 2.98 3c2gyz9fhswxx SELECT ASSET_LIABILITY_GAP, AL...
786 786 1.11 2s6amyv4qz2h2 exp@PSLDB03 (TNS V1-V3) SELECT INIEXT, SEXT, MINEXT,...
596 596 0.84 5fbmafvm27kfm insert into obj$(owner#, name,...
590 590 0.83 2ym6hhaq30r73 select type#, blocks, extents,...
550 550 0.78 7gtztzv329wg0 select c.name, u.name from co...
512 512 0.72 9qgtwh66xg6nz update seg$ set type#=:4, bloc...
480 480 0.68 6x2cz59yrxz3a exp@PSLDB03 (TNS V1-V3) SELECT NAME, OBJID, OWNER, ...
457 457 0.64 bsa0wjtftg3uw select file# from file$ where ...
Instance Activity Stats
Statistic Total per Second per Trans
CPU used by this session 54,051 14.78 28.64
CPU used when call started 53,326 14.58 28.26
CR blocks created 1,114 0.30 0.59
Cached Commit SCN referenced 755,322 206.51 400.28
Commit SCN cached 29 0.01 0.02
DB time 62,190 17.00 32.96
DBWR checkpoint buffers written 3,247 0.89 1.72
DBWR checkpoints 79 0.02 0.04
DBWR object drop buffers written 118 0.03 0.06
DBWR parallel query checkpoint buffers written 0 0.00 0.00
DBWR revisited being-written buffer 0 0.00 0.00
DBWR tablespace checkpoint buffers written 169 0.05 0.09
DBWR thread checkpoint buffers written 3,078 0.84 1.63
DBWR transaction table writes 0 0.00 0.00
DBWR undo block writes 11,245 3.07 5.96
DFO trees parallelized 0 0.00 0.00
DML statements parallelized 0 0.00 0.00
IMU CR rollbacks 29 0.01 0.02
IMU Flushes 982 0.27 0.52
IMU Redo allocation size 1,593,112 435.57 844.26
IMU commits 991 0.27 0.53
IMU contention 3 0.00 0.00
IMU ktichg flush 3 0.00 0.00
IMU pool not allocated 0 0.00 0.00
IMU recursive-transaction flush 1 0.00 0.00
IMU undo allocation size 3,280,968 897.05 1,738.72
IMU- failed to get a private strand 0 0.00 0.00
Misses for writing mapping 0 0.00 0.00
OS Integral shared text size 0 0.00 0.00
OS Integral unshared data size 0 0.00 0.00
OS Involuntary context switches 0 0.00 0.00
OS Maximum resident set size 0 0.00 0.00
OS Page faults 0 0.00 0.00
OS Page reclaims 0 0.00 0.00
OS System time used 0 0.00 0.00
OS User time used 0 0.00 0.00
OS Voluntary context switches 0 0.00 0.00
PX local messages recv'd 0 0.00 0.00
PX local messages sent 0 0.00 0.00
Parallel operations downgraded to serial 0 0.00 0.00
Parallel operations not downgraded 0 0.00 0.00
SMON posted for dropping temp segment 0 0.00 0.00
SMON posted for undo segment shrink 0 0.00 0.00
SQL*Net roundtrips to/from client 266,339 72.82 141.14
active txn count during cleanout 677 0.19 0.36
application wait time 243 0.07 0.13
background checkpoints completed 0 0.00 0.00
background checkpoints started 0 0.00 0.00
background timeouts 17,769 4.86 9.42
branch node splits 0 0.00 0.00
buffer is not pinned count 11,606,002 3,173.19 6,150.50
buffer is pinned count 65,043,685 17,783.53 34,469.36
bytes received via SQL*Net from client 27,009,252 7,384.57 14,313.33
bytes sent via SQL*Net to client ############### 69,310,703.02 134,343,168.92
calls to get snapshot scn: kcmgss 382,084 104.47 202.48
calls to kcmgas 15,558 4.25 8.24
calls to kcmgcs 1,886 0.52 1.00
change write time 488 0.13 0.26
cleanout - number of ktugct calls 628 0.17 0.33
cleanouts and rollbacks - consistent read gets 3 0.00 0.00
cleanouts only - consistent read gets 53 0.01 0.03
cluster key scan block gets 77,478 21.18 41.06
cluster key scans 41,479 11.34 21.98
commit batch/immediate performed 550 0.15 0.29
commit batch/immediate requested 550 0.15 0.29
commit cleanout failures: block lost 0 0.00 0.00
commit cleanout failures: buffer being written 0 0.00 0.00
commit cleanout failures: callback failure 29 0.01 0.02
commit cleanout failures: cannot pin 0 0.00 0.00
commit cleanouts 19,562 5.35 10.37
commit cleanouts successfully completed 19,533 5.34 10.35
commit immediate performed 550 0.15 0.29
commit immediate requested 550 0.15 0.29
commit txn count during cleanout 396 0.11 0.21
concurrency wait time 23 0.01 0.01
consistent changes 1,803 0.49 0.96
consistent gets 26,887,134 7,351.18 14,248.61
consistent gets - examination 1,524,222 416.74 807.75
consistent gets direct 0 0.00 0.00
consistent gets from cache 26,887,134 7,351.18 14,248.61
cursor authentications 773 0.21 0.41
data blocks consistent reads - undo records applied 1,682 0.46 0.89
db block changes 223,743 61.17 118.57
db block gets 214,573 58.67 113.71
db block gets direct 74 0.02 0.04
db block gets from cache 214,499 58.65 113.67
deferred (CURRENT) block cleanout applications 9,723 2.66 5.15
dirty buffers inspected 5,106 1.40 2.71
enqueue conversions 1,130 0.31 0.60
enqueue releases 49,151 13.44 26.05
enqueue requests 49,151 13.44 26.05
enqueue timeouts 0 0.00 0.00
enqueue waits 79 0.02 0.04
exchange deadlocks 0 0.00 0.00
execute count 184,109 50.34 97.57
failed probes on index block reclamation 1 0.00 0.00
free buffer inspected 6,521 1.78 3.46
free buffer requested 8,656 2.37 4.59
global undo segment hints helped 0 0.00 0.00
global undo segment hints were stale 0 0.00 0.00
heap block compress 457 0.12 0.24
hot buffers moved to head of LRU 5,016 1.37 2.66
immediate (CR) block cleanout applications 56 0.02 0.03
immediate (CURRENT) block cleanout applications 4,230 1.16 2.24
index crx upgrade (found) 0 0.00 0.00
index crx upgrade (positioned) 8,362 2.29 4.43
index fast full scans (full) 3,845 1.05 2.04
index fast full scans (rowid ranges) 0 0.00 0.00
index fetch by key 842,761 230.42 446.61
index scans kdiixs1 376,413 102.91 199.48
leaf node 90-10 splits 42 0.01 0.02
leaf node splits 89 0.02 0.05
lob reads 6,759,932 1,848.23 3,582.37
lob writes 11,788 3.22 6.25
lob writes unaligned 11,788 3.22 6.25
logons cumulative 272 0.07 0.14
messages received 133,602 36.53 70.80
messages sent 133,602 36.53 70.80
no buffer to keep pinned count 219 0.06 0.12
no work - consistent read gets 18,462,318 5,047.76 9,783.95
opened cursors cumulative 77,042 21.06 40.83
parse count (failures) 57 0.02 0.03
parse count (hard) 1,311 0.36 0.69
parse count (total) 70,872 19.38 37.56
parse time cpu 542 0.15 0.29
parse time elapsed 2,218 0.61 1.18
physical read IO requests 821 0.22 0.44
physical read bytes 15,212,544 4,159.25 8,061.76
physical read total IO requests 2,953 0.81 1.56
physical read total bytes 48,963,584 13,387.08 25,947.85
physical read total multi block requests 289 0.08 0.15
physical reads 1,857 0.51 0.98
physical reads cache 1,857 0.51 0.98
physical reads cache prefetch 1,036 0.28 0.55
physical reads direct 0 0.00 0.00
physical reads direct (lob) 0 0.00 0.00
physical reads direct temporary tablespace 0 0.00 0.00
physical reads prefetch warmup 0 0.00 0.00
physical write IO requests 6,054 1.66 3.21
physical write bytes 122,142,720 33,394.92 64,728.52
physical write total IO requests 11,533 3.15 6.11
physical write total bytes 199,223,808 54,469.58 105,577.00
physical write total multi block requests 5,894 1.61 3.12
physical writes 14,910 4.08 7.90
physical writes direct 74 0.02 0.04
physical writes direct (lob) 0 0.00 0.00
physical writes direct temporary tablespace 72 0.02 0.04
physical writes from cache 14,836 4.06 7.86
physical writes non checkpoint 14,691 4.02 7.79
pinned buffers inspected 4 0.00 0.00
prefetch clients - default 0 0.00 0.00
prefetch warmup blocks aged out before use 0 0.00 0.00
prefetch warmup blocks flushed out before use 0 0.00 0.00
prefetched blocks aged out before use 0 0.00 0.00
process last non-idle time 2,370 0.65 1.26
queries parallelized 0 0.00 0.00
recovery blocks read 0 0.00 0.00
recursive aborts on index block reclamation 0 0.00 0.00
recursive calls 643,220 175.86 340.87
recursive cpu usage 15,900 4.35 8.43
redo blocks read for recovery 0 0.00 0.00
redo blocks written 96,501 26.38 51.14
redo buffer allocation retries 0 0.00 0.00
redo entries 115,246 31.51 61.07
redo log space requests 0 0.00 0.00
redo log space wait time 0 0.00 0.00
redo ordering marks 3,605 0.99 1.91 -
Performance Degradation - High fetches and Prses
Hello,
My analysis on a particular job trace file drew my attention towards:
1) High rate of Parses instead of Bind variables usage.
2) High fetches and poor number/ low number of rows being processed
Please let me kno as to how the performance degradation can be minimised, Perhaps the high number of SQL* Net Client wait events may be due to multiple fetches and transactions with the client.
EXPLAIN PLAN FOR SELECT /*+ FIRST_ROWS (1) */ * FROM SAPNXP.INOB
WHERE MANDT = :A0
AND KLART = :A1
AND OBTAB = :A2
AND OBJEK LIKE :A3 AND ROWNUM <= :A4;
call count cpu elapsed disk query current rows
Parse 119 0.00 0.00 0 0 0 0
Execute 239 0.16 0.13 0 0 0 0
Fetch 239 2069.31 2127.88 0 13738804 0 0
total 597 2069.47 2128.01 0 13738804 0 0
PLAN_TABLE_OUTPUT
Plan hash value: 1235313998
| Id | Operation | Name | Rows | Bytes | Cost (%CPU)| Time |
| 0 | SELECT STATEMENT | | 2 | 268 | 1 (0)| 00:00:01 |
|* 1 | COUNT STOPKEY | | | | | |
|* 2 | TABLE ACCESS BY INDEX ROWID| INOB | 2 | 268 | 1 (0)| 00:00:01 |
|* 3 | INDEX SKIP SCAN | INOB~2 | 7514 | | 1 (0)| 00:00:01 |
Predicate Information (identified by operation id):
1 - filter(ROWNUM<=TO_NUMBER(:A4))
2 - filter("OBJEK" LIKE :A3 AND "KLART"=:A1)
3 - access("MANDT"=:A0 AND "OBTAB"=:A2)
filter("OBTAB"=:A2)
18 rows selected.
SQL> SELECT INDEX_NAME,TABLE_NAME,COLUMN_NAME FROM DBA_IND_COLUMNS WHERE INDEX_OWNER='SAPNXP' AND INDEX_NAME='INOB~2';
INDEX_NAME TABLE_NAME COLUMN_NAME
INOB~2 INOB MANDT
INOB~2 INOB CLINT
INOB~2 INOB OBTAB
Is it possible to Maximise the rows/fetch
call count cpu elapsed disk query current rows
Parse 163 0.03 0.00 0 0 0 0
Execute 163 0.01 0.03 0 0 0 0
Fetch 174899 55.26 59.14 0 1387649 0 4718932
total 175225 55.30 59.19 0 1387649 0 4718932
Misses in library cache during parse: 0
Optimizer mode: ALL_ROWS
Parsing user id: 27
Rows Row Source Operation
28952 TABLE ACCESS BY INDEX ROWID EDIDC (cr=8505 pr=0 pw=0 time=202797 us)
28952 INDEX RANGE SCAN EDIDC~1 (cr=1457 pr=0 pw=0 time=29112 us)(object id 202995)
Elapsed times include waiting on following events:
Event waited on Times Max. Wait Total Waited
---------------------------------------- Waited ---------- ------------
SQL*Net message to client 174899 0.00 0.16
SQL*Net more data to client 155767 0.01 5.69
SQL*Net message from client 174899 0.11 208.21
latch: cache buffers chains 2 0.00 0.00
latch free 4 0.00 0.00
********************************************************************************user4566776 wrote:
My analysis on a particular job trace file drew my attention towards:
1) High rate of Parses instead of Bind variables usage.
But if you look at the text you are using bind variables.
The first query is executed 239 times - which matches the 239 fetches. You cut off some of the useful information from the tkprof output, but the figures show that you're executing more than once per parse call. The time is CPU time spent using a bad execution plan to find no data -- this looks like a bad choice of index, possibly a side effect of the first_rows(1) hint.
2) High fetches and poor number/ low number of rows being processedThe second query is doing a lot of fetches because in 163 executions it is fetching 4.7 million rows at roughly 25 rows per fetch. You might improve performance a little by increasing the array fetch size - but probably not by more than a factor of 2.
You'll notice that even though you record 163 parse calls for the second statement the number of " Misses in library cache during parse" is zero - so the parse calls are pretty irrelevant, the cursor is being re-used.
Regards
Jonathan Lewis
http://jonathanlewis.wordpress.com
http://www.jlcomp.demon.co.uk
To post code, statspack/AWR report, execution plans or trace files, start and end the section with the tag {noformat}{noformat} (lowercase, curly brackets, no spaces) so that the text appears in fixed format.
"Science is more than a body of knowledge; it is a way of thinking"
Carl Sagan
Maybe you are looking for
-
Error while running Master Data IP
HI Xpertz Could any one tell me resolution for the following.I am running a master data Ip It gives the following error "errors in source system". Its daily load. If any docs please send it to the following id : [email protected] Any answer will appr
-
What to do if your iphone is stolen and find my iphone is disabled in your phone. Is there a possible chance to lock my iphone? How? Thanks. Uhm Good day i have a problem because my iphone 5s is stolen Can you give me possible ways to lock my iphone?
-
"Adobe Photoshop Elements editor quit unexpectedly" Mac OS X Yosemite 10.10.3 and Elements 11. photoshop quits and I get this message every time I try and apply a filter to a pic? Please help
-
HT1320 ipod not showing up on computer in i tunes
hi my i pod classicn has died and is showing the red cross on the screen. tried to reset nothing happens pluged it into computer and nothing shows up HELP!!!!!
-
I am unable to update firmware so as to install na...
Hi I live in Barcelona spain and bought a new 5800XM for christmas. As soon as I saw the new free navagator I tried to install, but it says that it needs latest firmware 31.0.008 or onwards, so I duely try to update my phone, I download the nokia sof