SGA allocation
Hello folks,
We have a dataguard setup with primary database on 10.2.0.3 on AIX. I have kept all the parameters same in parameter file but querying SHOW SGA gives different results on primary database and DR database which causes ORA-04030 - Out of memory error. Can you please suggest some guidance?
Parameters on Primary:
SQL> show parameter db_cache
NAME TYPE VALUE
db_cache_advice string OFF
db_cache_size big integer 368M
SQL> show parameter shared_
NAME TYPE VALUE
hi_shared_memory_address integer 0
max_shared_servers integer
shared_memory_address integer 0
shared_pool_reserved_size big integer 5M
shared_pool_size big integer 224M
shared_server_sessions integer
shared_servers integer 0
SQL> show parameter sga_
NAME TYPE VALUE
sga_max_size big integer 2512M
sga_target big integer 2000M
SQL> show parameter pga_
NAME TYPE VALUE
pga_aggregate_target big integer 250M
SQL>
===========================
Parameters on DR:
SQL> show parameter db_cache
NAME TYPE VALUE
db_cache_advice string OFF
db_cache_size big integer 368M
SQL> show parameter shared_
NAME TYPE VALUE
hi_shared_memory_address integer 0
max_shared_servers integer
shared_memory_address integer 0
shared_pool_reserved_size big integer 5M
shared_pool_size big integer 224M
shared_server_sessions integer
shared_servers integer 0
SQL> show parameter sga_
NAME TYPE VALUE
sga_max_size big integer 2512M
sga_target big integer 2000M
SQL> show parameter pga_
NAME TYPE VALUE
pga_aggregate_target big integer 250M
SQL>
==================================
Primary SGA --
SQL> show sga
Total System Global Area 2634022912 bytes
Fixed Size 2075184 bytes
Variable Size 1761609168 bytes
Database Buffers 754974720 bytes
Redo Buffers 115363840 bytes
SQL>
DR SGA --
SQL> show sga
Total System Global Area 2634022912 bytes
Fixed Size 2075184 bytes
Variable Size 805307856 bytes
Database Buffers 1711276032 bytes
Redo Buffers 115363840 bytes
SQL>
Why primary and DR Variable size & Database buffers is different?
Though my database is small and max 50 users connect at a time on primary. I got this error on DR and never received the same error or any memory error on primary site. that wonders me..!!I am not sure how good you explore below threads, but if these do not helps more then may be a bug and Oracle support is the solution :
ora-04030 error in dataguard environment
11g and ORA-04030 problems
Regards
Girish Sharma
Similar Messages
-
SGA: allocation forcing component growth
Oracle 11g - 11.1.0.7
Redht 5.3 4GB RAM
SGA MAX Size 1GB
SGA_target 800M
pga_aggregate_target = 600MB
========================
SQL> SHOW SGA:
Total system Global Area 1043886080
Fixed size: 2166288
Variable Size: 1002439152
Database Buffers: 33554432
redo Buffers 5726208
==========================
I was notified by 11g DB control that I need to increase my SGA size to 1000M (1GB) from 800M. I went into the server option/Intitialization file (I am using SPFILE) and only increased it by 50mb, making the SGA 850M total. I did not use the "impliment" option to increase the SGA to 1GB like 11g suggested - because normally, 800M suffices.
However, after I went into my initialization parameters, edited the "CURRENT' intit paramaters to reflect the new sga_target to be: 850MB vs. 800M, hit apply, and it just sits there waiting. I clicked on the 'Active Sessions' link on the main DB control page showing a wait activity, and I found the session that states: SGA: allocating forcing component growth." No error message, just sitting there trying to add the additonal 50MB to the current 800MB. I normally have no issues doing this, it recently started. Have I consumed all my availabe memory that Oracle can use?
Like I said, I only have 4GB in the box. Can I kill the session that is trying to execute the SQL to increase the SGA size?
Thanks,
Rob
Edited by: ronthe11gdba on May 7, 2009 11:27 AM
Edited by: ronthe11gdba on May 7, 2009 12:21 PMOracle 11g - 11.1.0.7
Redht 5.3 4GB RAM
SGA MAX Size 1GB
SGA_target 800M
pga_aggregate_target = 600MB
========================
SQL> SHOW SGA:
Total system Global Area 1043886080
Fixed size: 2166288
Variable Size: 1002439152
Database Buffers: 33554432
redo Buffers 5726208
==========================
I was notified by 11g DB control that I need to increase my SGA size to 1000M (1GB) from 800M. I went into the server option/Intitialization file (I am using SPFILE) and only increased it by 50mb, making the SGA 850M total. I did not use the "impliment" option to increase the SGA to 1GB like 11g suggested - because normally, 800M suffices.
However, after I went into my initialization parameters, edited the "CURRENT' intit paramaters to reflect the new sga_target to be: 850MB vs. 800M, hit apply, and it just sits there waiting. I clicked on the 'Active Sessions' link on the main DB control page showing a wait activity, and I found the session that states: SGA: allocating forcing component growth." No error message, just sitting there trying to add the additonal 50MB to the current 800MB. I normally have no issues doing this, it recently started. Have I consumed all my availabe memory that Oracle can use?
Like I said, I only have 4GB in the box. Can I kill the session that is trying to execute the SQL to increase the SGA size?
Thanks,
Rob
Edited by: ronthe11gdba on May 7, 2009 11:27 AM
Edited by: ronthe11gdba on May 7, 2009 12:21 PM -
When SGA is initialized and when it will be allocated ? Whether in nomount or mount stage?
For example,
If the SHARED_POOL size is greater than the SGA_MAX_SIZE , When the error will be thrown WHEN WE STARTUP THE DATABASE , whether in NOMOUNT or MOUNT STAGE ?.Sorry mate I don't understand your question?
OP? Operating from operating system? Sorry if I missed something.
The SGA may not get all of the memory it requests initially for example AIX says yep the memory is available but logically allocates the memory and even steals pages back afterwards if they are unused to reallocate to other processes.
There are options in AIX to stop stealing of memory from the SGA but AIX is very good at allocating pages and its a memory efficiency/performance feature.
Windows on the other hand I know less about. The parameter PRE_PAGE_SGA is worth reviewing depending on your operating system Windows, HP-UX, VMS, Solaris, Linux and IBM AIX. -
Oracle 8.1.7.4 32 bit and SGA size
hi gurus,
OS : solaris 5.8 64 bit
Oracle: 8.1.7.4 32 bit
i have seen documents saying that maximum SGA allocation possible is only 1.75 GB due to 32 bit application limitation.
is there a way in which we can allocate > 1.75 GB for the SGA granules?
any option like /AWE in windows?
thanks,
charlesOS : solaris 5.8 64 bit
Oracle: 8.1.7.4 32 bitAs far as i know mixing 32-bit database and 64-bit operating system is not supported - as 8i is.
Anyway with a 32-bit database you are basically limited to 2 GB per process. You can use "indirect_data_buffer" which will
enable you to increase your database block buffers > 2 GB....
Ronny Egner
My blog: http://blog.ronnyegner-consulting.de -
Hi All,
I'm running 10g on Linux. I'm trying to optimize the SGA in our environment. I occationally get alerts that our memory on the db server is at 99%. I'd like to not get those anymore. Currently i have the following set for our memory parameters:
Total SGA size: 850M
Max SGA size is 1.2G
PGA: 200M
Questions is this. When i boot up oracle with the above parameters does oracle use/claim the Max SGA size from the server or does it only take the Total SGA size.
The reason i ask is because i want to reduce the total memory used on the machine and hoping to do this by reducing the Total SGA size w/o rebooting the db. If i have to change the Max SGA then i have to reboot the db.
If i run a "top" command i see that oracle is using roughly 1.2G of virtual memory so it seems that oracle has the Max SGA allocated to it even though the Total SGA is only 850M. Does this make sense.
Basically if i want to reduce the memory usage on my machine do i reduce Max SGA or Total SGA parameter?
Thanks, daveThanks for the response Pierre. So if i run that i get:
oracle@db1:~$ ipcs -m | grep oracle
0x42d513ec 622593 oracle 640 1258295296 49
Shows 1200M in the shared memory segment. That tells me that the Max SGA setting dictates how much memory is used on the server. Is that right?
My Max is set to 1200M
My Total is set to 850M -
ORA 04030 Out of process memory error
Dear experts,
I know there are multiple discussions around this error and I have been reading through most of them in the past one week or so, but looks like we are running out of options or are missing the color altogether. Ok, we are getting ORA-04030 - out of process memory while allocating....while one of our batch process runs in the night. It simply tries to insert/update to a table. Our installation is 11.2.0.1.0 with no RAC configuration and on 64-bit AIX having 6 cores, 12 CPUs and 16 GB memory.
We have checked the Workarea_Size_Policy is set to be as Auto so Oracle decides how much memory to allocate to PGA automatically on run-time based on the demand. And based on the AWR report it doesnt look like we are anywhere near the country having a PGA-deficit!! I am attaching the AWR report in a word document here for your reference.
Also attached below are the configurations and the ulimit values.
IKBTRN1> show parameter workarea;
NAME TYPE VALUE
workarea_size_policy string AUTO
oraipeikbtrn1:/home/oracle-> ulimit -a
time(seconds) unlimited
file(blocks) unlimited
data(kbytes) unlimited
stack(kbytes) 4194304
memory(kbytes) unlimited
coredump(blocks) unlimited
nofiles(descriptors) unlimited
threads(per process) unlimited
processes(per user) unlimited
Now, nothing seems to have contributed to the out of process memory issue from Oracle standpoint. I would be happy to be proved wrong here, if I am wrong.
So, whats going wrong here? A possible memory leak which we cannot zero down to, a OS memory limit or something else?
Seeking expert's advise on this, and also sincerely appreciate your time in looking at this.
Thanks.
P.S - I am pasting the whole AWR report since there is no 'upload file' option here that I can see.
WORKLOAD REPOSITORY report for
DB Name DB Id Instance Inst num Startup Time Release RAC
IKBTRN1 54659199 IKBTRN1 1 06-Jun-11 02:06 11.2.0.1.0 NO
Host Name Platform CPUs Cores Sockets Memory (GB)
oraipeikbtrn1.******.com AIX-Based Systems (64-bit) 12 6 16.00
Snap Id Snap Time Sessions Cursors/Session
Begin Snap: 5952 26-Aug-11 03:00:48 34 2.0
End Snap: 5953 26-Aug-11 04:00:52 32 1.9
Elapsed: 60.07 (mins)
DB Time: 1.93 (mins)
Report Summary
Cache Sizes
Begin End
Buffer Cache: 1,056M 704M Std Block Size: 8K
Shared Pool Size: 3,456M 3,456M Log Buffer: 7,184K
Load Profile
Load Profile
Per Second Per Transaction Per Exec Per Call
DB Time(s): 0.0 2.0 0.02 0.02
DB CPU(s): 0.0 0.5 0.00 0.00
Redo size: 556.1 34,554.8
Logical reads: 151.4 9,407.6
Block changes: 1.9 119.8
Physical reads: 14.2 882.6
Physical writes: 9.5 590.4
User calls: 1.8 112.8
Parses: 1.5 93.7
Hard parses: 0.1 8.9
W/A MB processed: -0.1 -6.9
Logons: 0.0 1.6
Executes: 1.9 115.4
Rollbacks: 0.0 0.0
Transactions: 0.0
Instance Efficiency Percentages (Target 100%)
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 96.63 In-memory Sort %: 99.97
Library Hit %: 95.68 Soft Parse %: 90.49
Execute to Parse %: 18.74 Latch Hit %: 100.00
Parse CPU to Parse Elapsd %: 57.23 % Non-Parse CPU: 86.28
Shared Pool Statistics
Begin End
Memory Usage %: 85.72 85.76
% SQL with executions>1: 93.91 96.66
% Memory for SQL w/exec>1: 89.07 87.04
Top 5 Timed Foreground Events
Event Waits Time(s) Avg wait (ms) % DB time Wait Class
DB CPU 29 24.66
db file scattered read 3,456 17 5 14.92 User I/O
db file sequential read 4,304 17 4 14.77 User I/O
direct path read temp 764 17 22 14.31 User I/O
direct path write temp 259 5 21 4.70 User I/O
Host CPU (CPUs: 12 Cores: 6 Sockets: )
Load Average Begin Load Average End %User %System %WIO %Idle
1.39 1.37 0.2 0.2 0.2 99.6
Instance CPU
%Total CPU %Busy CPU %DB time waiting for CPU (Resource Manager)
0.1 20.5 0.0
Memory Statistics
Begin End
Host Mem (MB): 16,384.0 16,384.0
SGA use (MB): 4,704.0 4,352.0
PGA use (MB): 196.1 188.4
% Host Mem used for SGA+PGA: 29.91 27.71
Main Report
• Report Summary
• Wait Events Statistics
• SQL Statistics
• Instance Activity Statistics
• IO Stats
• Buffer Pool Statistics
• Advisory Statistics
• Wait Statistics
• Undo Statistics
• Latch Statistics
• Segment Statistics
• Dictionary Cache Statistics
• Library Cache Statistics
• Memory Statistics
• Streams Statistics
• Resource Limit Statistics
• Shared Server Statistics
• init.ora Parameters
Back to Top
Wait Events Statistics
• Time Model Statistics
• Operating System Statistics
• Operating System Statistics - Detail
• Foreground Wait Class
• Foreground Wait Events
• Background Wait Events
• Wait Event Histogram
• Wait Event Histogram Detail (64 msec to 2 sec)
• Wait Event Histogram Detail (4 sec to 2 min)
• Wait Event Histogram Detail (4 min to 1 hr)
• Service Statistics
• Service Wait Class Stats
Back to Top
Time Model Statistics
• Total time in database user-calls (DB Time): 115.9s
• Statistics including the word "background" measure background process time, and so do not contribute to the DB time statistic
• Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 101.69 87.75
DB CPU 28.58 24.66
parse time elapsed 10.14 8.75
hard parse elapsed time 9.92 8.56
failed parse elapsed time 4.92 4.25
hard parse (sharing criteria) elapsed time 4.27 3.68
connection management call elapsed time 0.42 0.36
PL/SQL compilation elapsed time 0.34 0.30
PL/SQL execution elapsed time 0.18 0.15
sequence load elapsed time 0.00 0.00
repeated bind elapsed time 0.00 0.00
DB time 115.88
background elapsed time 86.01
background cpu time 5.06
Back to Wait Events Statistics
Back to Top
Operating System Statistics
• *TIME statistic values are diffed. All others display actual values. End Value is displayed if different
• ordered by statistic type (CPU Use, Virtual Memory, Hardware Config), Name
Statistic Value End Value
NUM_LCPUS 0
NUM_VCPUS 0
AVG_BUSY_TIME 1,260
AVG_IDLE_TIME 360,705
AVG_IOWAIT_TIME 534
AVG_SYS_TIME 483
AVG_USER_TIME 679
BUSY_TIME 16,405
IDLE_TIME 4,329,811
IOWAIT_TIME 7,284
SYS_TIME 7,092
USER_TIME 9,313
LOAD 1 1
OS_CPU_WAIT_TIME 503,900
PHYSICAL_MEMORY_BYTES 17,179,869,184
NUM_CPUS 12
NUM_CPU_CORES 6
GLOBAL_RECEIVE_SIZE_MAX 1,310,720
GLOBAL_SEND_SIZE_MAX 1,310,720
TCP_RECEIVE_SIZE_DEFAULT 16,384
TCP_RECEIVE_SIZE_MAX 9,223,372,036,854,775,807
TCP_RECEIVE_SIZE_MIN 4,096
TCP_SEND_SIZE_DEFAULT 16,384
TCP_SEND_SIZE_MAX 9,223,372,036,854,775,807
TCP_SEND_SIZE_MIN 4,096
Back to Wait Events Statistics
Back to Top
Operating System Statistics - Detail
Snap Time Load %busy %user %sys %idle %iowait
26-Aug 03:00:48 1.39
26-Aug 04:00:52 1.37 0.38 0.21 0.16 99.62 0.17
Back to Wait Events Statistics
Back to Top
Foreground Wait Class
• s - second, ms - millisecond - 1000th of a second
• ordered by wait time desc, waits desc
• %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
• Captured Time accounts for 78.2% of Total DB time 115.88 (s)
• Total FG Wait Time: 62.08 (s) DB CPU time: 28.58 (s)
Wait Class Waits %Time -outs Total Wait Time (s) Avg wait (ms) %DB time
User I/O 8,949 0 56 6 48.74
DB CPU 29 24.66
System I/O 1,916 0 3 1 2.18
Other 506 88 1 2 0.92
Configuration 2 50 1 500 0.86
Commit 37 0 1 18 0.56
Application 20 0 0 17 0.29
Network 4,792 0 0 0 0.01
Concurrency 1 0 0 0 0.00
Back to Wait Events Statistics
Back to Top
Foreground Wait Events
• s - second, ms - millisecond - 1000th of a second
• Only events with Total Wait Time (s) >= .001 are shown
• ordered by wait time desc, waits desc (idle events last)
• %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn % DB time
db file scattered read 3,456 0 17 5 59.59 14.92
db file sequential read 4,304 0 17 4 74.21 14.77
direct path read temp 764 0 17 22 13.17 14.31
direct path write temp 259 0 5 21 4.47 4.70
control file sequential read 1,916 0 3 1 33.03 2.18
ADR block file read 38 0 1 28 0.66 0.92
log buffer space 2 50 1 500 0.03 0.86
log file sync 37 0 1 18 0.64 0.56
enq: RO - fast object reuse 14 0 0 24 0.24 0.29
local write wait 44 0 0 1 0.76 0.03
SQL*Net message to client 4,772 0 0 0 82.28 0.01
Disk file operations I/O 110 0 0 0 1.90 0.00
ADR block file write 7 0 0 0 0.12 0.00
SQL*Net message from client 4,773 0 15,396 3226 82.29
Streams AQ: waiting for messages in the queue 720 100 3,600 5000 12.41
Back to Wait Events Statistics
Back to Top
Background Wait Events
• ordered by wait time desc, waits desc (idle events last)
• Only events with Total Wait Time (s) >= .001 are shown
• %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
Event Waits %Time -outs Total Wait Time (s) Avg wait (ms) Waits /txn % bg time
control file sequential read 4,950 0 35 7 85.34 40.74
control file parallel write 1,262 0 31 25 21.76 36.46
log file parallel write 383 0 4 10 6.60 4.37
db file parallel write 627 0 2 3 10.81 2.36
change tracking file synchronous read 56 0 2 34 0.97 2.21
os thread startup 17 0 1 88 0.29 1.74
ADR block file read 135 0 1 7 2.33 1.04
change tracking file synchronous write 56 0 1 15 0.97 0.98
SGA: allocation forcing component growth 8 100 1 100 0.14 0.93
db file sequential read 112 0 1 6 1.93 0.75
process diagnostic dump 94 0 0 1 1.62 0.09
ADR block file write 92 0 0 1 1.59 0.07
LGWR wait for redo copy 11 0 0 1 0.19 0.01
log file sync 2 0 0 3 0.03 0.01
ADR file lock 92 22 0 0 1.59 0.01
Parameter File I/O 24 0 0 0 0.41 0.01
direct path write 6 0 0 1 0.10 0.00
Disk file operations I/O 54 0 0 0 0.93 0.00
rdbms ipc message 17,637 97 61,836 3506 304.09
Streams AQ: waiting for time management or cleanup tasks 5 60 11,053 2210602 0.09
DIAG idle wait 7,203 100 7,203 1000 124.19
PX Idle Wait 1,802 100 3,604 2000 31.07
pmon timer 1,212 99 3,603 2973 20.90
Space Manager: slave idle wait 726 99 3,603 4963 12.52
smon timer 12 100 3,600 300004 0.21
Streams AQ: qmn slave idle wait 128 0 3,583 27993 2.21
Streams AQ: qmn coordinator idle wait 256 50 3,583 13996 4.41
SQL*Net message from client 293 0 2 5 5.05
Back to Wait Events Statistics
Back to Top
Wait Event Histogram
• Units for Total Waits column: K is 1000, M is 1000000, G is 1000000000
• % of Waits: value of .0 indicates value was <.05%; value of null is truly 0
• % of Waits: column heading of <=1s is truly <1024ms, >1s is truly >=1024ms
• Ordered by Event (idle events last)
% of Waits
Event Total Waits <1ms <2ms <4ms <8ms <16ms <32ms <=1s >1s
ADR block file read 173 80.3 5.2 2.3 5.8 1.7 4.6
ADR block file write 99 96.0 3.0 1.0
ADR file lock 102 100.0
Disk file operations I/O 165 100.0
LGWR wait for redo copy 11 90.9 9.1
Parameter File I/O 24 100.0
SGA: allocation forcing component growth 8 100.0
SQL*Net break/reset to client 6 100.0
SQL*Net message to client 4992 100.0
SQL*Net more data from client 20 100.0
asynch descriptor resize 541 100.0
change tracking file synchronous read 56 83.9 1.8 14.3
change tracking file synchronous write 56 80.4 7.1 1.8 10.7
control file parallel write 1262 80.3 1.7 .6 .6 .8 1.3 14.7
control file sequential read 6866 94.1 .9 .7 .7 .3 .4 2.9
db file parallel write 628 94.3 2.1 1.0 .8 .3 .3 1.3
db file scattered read 3457 72.6 7.2 5.4 6.9 5.7 .5 1.6
db file sequential read 4525 78.7 2.7 1.8 9.6 5.3 .4 1.5
direct path read temp 764 40.2 18.6 9.4 6.2 11.0 5.8 8.9
direct path sync 1 100.0
direct path write 6 83.3 16.7
direct path write temp 259 .4 1.2 88.8 .4 9.3
enq: RO - fast object reuse 14 42.9 42.9 7.1 7.1
latch free 1 100.0
latch: cache buffers lru chain 2 100.0
latch: checkpoint queue latch 2 100.0
latch: messages 2 100.0
latch: object queue header operation 2 100.0
latch: redo allocation 1 100.0
latch: row cache objects 1 100.0
local write wait 44 100.0
log buffer space 2 50.0 50.0
log file parallel write 383 92.4 .8 1.0 5.7
log file sync 39 82.1 2.6 2.6 12.8
os thread startup 17 100.0
process diagnostic dump 94 34.0 63.8 2.1
reliable message 7 100.0
utl_file I/O 12 100.0
DIAG idle wait 7204 100.0
PX Idle Wait 1802 100.0
SQL*Net message from client 5067 87.1 6.6 1.0 .5 .5 .1 .5 3.7
Space Manager: slave idle wait 726 .6 99.4
Streams AQ: qmn coordinator idle wait 256 49.2 .8 50.0
Streams AQ: qmn slave idle wait 128 100.0
Streams AQ: waiting for messages in the queue 721 100.0
Streams AQ: waiting for time management or cleanup tasks 5 40.0 20.0 40.0
class slave wait 17 100.0
pmon timer 1212 .9 99.1
rdbms ipc message 17.6K 1.8 .4 .2 .2 .1 .1 21.0 76.2
smon timer 12 100.0
Back to Wait Events Statistics
Back to Top
I couldnt add the rest of the report here since it is telling me I have exceeded 30000 characters. If you want to see the full report, please email me at [email protected]Unless your database is strictly a DSS-type of database, your AWR report exposes loads of issues with it. And I think none of the time during the AWR window was spent on database. Look at the DB time (with all those multi cores) compared with the elapsed time of the AWR.
As you are on 11g, why not make use of MEMORY_TARGET (a single parameter to manage both SGA and PGA)? If you are already on it, ignore this as I can't see it anywhere. If not, get rid of SGA_TARGET and PGA_AGGREGATE_TARGET and replace it with a single MEMORY_TARGET parameter. However you may have a minimum threshold set for different SGA pools so that they won't shrink beyond that point.
Having said that, setting MEMORY_TARGET is not a guarantee to avoid ORA-4030. Just a single bad PL/SQL code could go and exploit the untunable part of your process memory and even go and blow up the physical memory. If you are using FORALL and BULK load, see if you can cut it down into few chunks rather than running as a single process.
What does your V$PGASTAT say? -
How to update Portal 10.1.2 to 10.1.4 under multiportal environment ?
I install two portal and one infra.
And Configuring Multiple Middle Tiers with a Load Balancing Router successfully.
The origin portal virsion is 10.1.2.
Now i want to update to 10.1.4 but have somthing wrong after I enter the update commond.
Error message is java.SQLException: IO Exception : connection is reset.
Then I run de upgrade command again , get the different error message
### ERROR: OracleAS Portal 10.1.4 upgrade precheck failed. See /raid/product/OraHome_1/upgrade/temp/portal/precheck.log for details.
Error: Component upgrade failed PORTAL
Error: PORTAL component version is: 10.1.2.0.2 INVALID
FAILURE: Some OracleAS plug-ins report failure during upgrade.
The Portal Upgrade precheck log is follow:
-- Portal Upgrade release information: 10.1.4 Release 1
Upgrade Started in -precheck -force mode at Wed Oct 18 21:22:19 2006
### PHASE 1: Initial setup
Existing temporary directory /raid/product/OraHome_1/upgrade/temp/portal/prechktmp renamed to /raid/product/OraHome_1/upgrade/temp/portal/prechktmp.Wed-Oct-18-21.14.10-2006
Existing log file /raid/product/OraHome_1/upgrade/temp/portal/precheck.log renamed to /raid/product/OraHome_1/upgrade/temp/portal/precheck.log.Wed-Oct-18-21.14.10-2006
Creating /raid/product/OraHome_1/upgrade/temp/portal/prechktmp directory
Creating /raid/product/OraHome_1/upgrade/temp/portal/prechktmp/gen directory
Welcome to the Oracle Portal Production Upgrade
The script will lead you through the upgrade step by step.
For questions asked in this script that have appropriate defaults
those defaults will be shown in square brackets after the question.
To accept a default value, simply hit the Return key.
### Set New Variables and Validate Environment Variables
Step started at Wed Oct 18 21:22:19 2006
PERL5LIB set to ../../../perl/lib/site_perl/5.6.1/i686-linux:../../../perl/lib:../../../perl/lib/5.6.1
Check SQL*Plus version
Running upg/frwk/upchkpls.sql### Log shared and environment variables
Step started at Wed Oct 18 21:22:19 2006
Log file: /raid/product/OraHome_1/upgrade/temp/portal/precheck.log
Log dir: /raid/product/OraHome_1/upgrade/temp/portal/prechktmp
Profile dir: /raid/product/OraHome_1/upgrade/temp/portal/prechktmp/gen
Verbose flag: 0
Debug mode: 0
Force flag: 1
Nosave flag: 0
Save flag: 1
Repos flag: 0
Compile flag: 0
Oldver flag: 0
isPatch flag: 0
Will save Tables: 1
Environment variables:
===========================================================
DISPLAY: :0
G_BROKEN_FILENAMES: 1
HISTSIZE: 1000
HOME: /home/oracle
HOSTNAME: portal1.bizmatch.com.cn
IBPATH: /usr/bin
INPUTRC: /etc/inputrc
KDEDIR: /usr
LANG: en_US.UTF-8
LC_CTYPE: en_US.UTF-8
LD_ASSUME_KERNEL: 2.4.19
LD_LIBRARY_PATH: /raid/product/OraHome_1/lib32:/raid/product/OraHome_1/lib:/raid/tmp/jdk/jre/lib/i386/client:/raid/tmp/jdk/jre/lib/i386:/raid/tmp/jdk/jre/../lib/i386:/raid/product/OraHome_1/lib32:/raid/product/OraHome_1/network/lib32:/raid/product/OraHome_1/lib:/raid/product/OraHome_1/network/lib:/raid/product/OraHome_1/lib:/usr/lib:/usr/local/lib
LD_LIBRARY_PATH_64: /raid/product/OraHome_1/lib:/raid/product/OraHome_1/lib32:/raid/product/OraHome_1/network/lib32:/raid/product/OraHome_1/lib:/raid/product/OraHome_1/network/lib:
LESSOPEN: |/usr/bin/lesspipe.sh %s
LIBPATH: /raid/product/OraHome_1/lib32:/raid/product/OraHome_1/lib
LOGNAME: oracle
LS_COLORS: no=00:fi=00:di=00;34:ln=00;36:pi=40;33:so=00;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi=01;05;37;41:ex=00;32:*.cmd=00;32:*.exe=00;32:*.com=00;32:*.btm=00;32:*.bat=00;32:*.sh=00;32:*.csh=00;32:*.tar=00;31:*.tgz=00;31:*.arj=00;31:*.taz=00;31:*.lzh=00;31:*.zip=00;31:*.z=00;31:*.Z=00;31:*.gz=00;31:*.bz2=00;31:*.bz=00;31:*.tz=00;31:*.rpm=00;31:*.cpio=00;31:*.jpg=00;35:*.gif=00;35:*.bmp=00;35:*.xbm=00;35:*.xpm=00;35:*.png=00;35:*.tif=00;35:
MAIL: /var/spool/mail/oracle
NLSPATH: /usr/dt/lib/nls/msg/%L/%N.cat
ORACLE_BASE: /raid/product
ORACLE_HOME: /raid/product/OraHome_1
ORACLE_SID:
PATH: /raid/product/OraHome_1/bin:../../../perl/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/home/oracle/bin:/raid/product/OraHome_1/bin:/usr/local/sbin:/usr/bin/X11:/usr/X11R6/bin:/home/oracle/bin:/bin:/sbin:/usr/bin
PERL5LIB: ../../../perl/lib/site_perl/5.6.1/i686-linux:../../../perl/lib:../../../perl/lib/5.6.1
PWD: /raid/tmp/mrua
QTDIR: /usr/lib/qt-3.3
REPCA_ORACLE_HOME: /raid/tmp
SHELL: /bin/bash
SHLIB_PATH: /raid/product/OraHome_1/lib32:/raid/product/OraHome_1/lib
SHLVL: 3
SQLPATH: .:owa:/raid/product/OraHome_1/upgrade/temp/portal/prechktmp/gen:upg/frwk:sql:wwc
SSH_ASKPASS: /usr/libexec/openssh/gnome-ssh-askpass
TERM: xterm
USER: oracle
XAUTHORITY: /root/.Xauthority
XFILESEARCHPATH: /usr/dt/app-defaults/%L/Dt
_: /raid/tmp/jdk/bin/java
### PHASE 2: User inputs
Upgrade phase started at Wed Oct 18 21:22:19 2006
Processing Metadata File: upg/common/inputchk/inputchk.met Running upg/common/inputchk/inputchk.pl ### Verify that the database has been backed up
Step started at Wed Oct 18 21:22:19 2006
Before beginning the upgrade, it is important that you backup your database.
Have you backed up your database (y/n)? [y]: y
Ask user for schema and database details
Enter the name of schema that you would like to upgrade [PORTAL]: portal
Enter the password for the schema that you would like to upgrade [portal]:
Enter the password for the SYS user of your database [CHANGE_ON_INSTALL]:
Enter the TNS connect string to connect to the database [ORCL]: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=portaldb.bizmatch.com.cn)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=IASDB.bizmatch.com.cn)))
Responses to the above questions will now be recorded in the file
upgrade.in. Placeholders are recorded instead of actual passwords,
for security reasons. If you wish, this file can be edited and used
as the standard input for a subsequent run of upgrade.pl.
### Verify database connection information.
Step started at Wed Oct 18 21:22:19 2006
Validating the connection information supplied by the user
Running CheckConnections()Check connection to the Portal repository.
Check connection as SYS to the Portal repository.
Ending CheckConnections() Wed Oct 18 21:22:19 2006
### PHASE 3: Setup
Upgrade phase started at Wed Oct 18 21:22:19 2006
Processing Metadata File: upg/common/setup/setup.met Running upg/common/setup/setup.pl Analyzing the product schema
Running upg/common/setup/upgettbs.sqlPortal SQL script started at Wed Oct 18 21:22:19 2006
Connected.
### Install messaging framework
Step started at Wed Oct 18 21:22:19 2006
Portal SQL script started at Wed Oct 18 21:22:19 2006
Connected.
No errors.
No errors.
Creating sequence 'wwpof_output_id_seq'
Creating sequence 'wwpof_output_script_run_id_seq'
Creating table 'wwpof_output$'
Creating table 'wwpof_msg$'
Creating index 'wwpof_output_idx1' in tablespace PORTAL
Creating index 'wwpof_output_idx2' in tablespace PORTAL
Creating index 'wwpof_output_idx3' in tablespace PORTAL
Creating index 'wwpof_msg_uk1' in tablespace PORTAL
No errors.
No errors.
Granting privileges on POF objects to SYS
Loading /raid/product/OraHome_1/upgrade/temp/portal/prechktmp/upgus.ctl using sqlldr
Copying scripts to de-install message objects.
Get Portal version and determine upgrade sequence
Running upg/common/setup/upgetver.sqlPortal SQL script started at Wed Oct 18 21:22:22 2006
Connected.
Upgrading to version 10.1.4.0.0
Version directories to be traversed: upg/10140
Running upg/common/setup/setseq.pl Set the correct Traversal Sequence
### PHASE 4: Pre upgrade checks
Upgrade phase started at Wed Oct 18 21:22:22 2006
Processing Metadata File: upg/common/prechk/prechk.met Running upg/common/prechk/prechk.pl Set up subscriber iteration
Running upg/common/prechk/upgetsub.sqlPortal SQL script started at Wed Oct 18 21:22:22 2006
Connected.
### Perform pre upgrade checks
Step started at Wed Oct 18 21:22:22 2006
Running upg/frwk/utlchvpd.sqlPortal SQL script started at Wed Oct 18 21:22:22 2006
Connected.
Calling DoPreChecks()Starting precheck at Wed Oct 18 21:22:23 2006
Calling upg/common/prechk/sysuppre.sql
Connected.
Running upg/common/prechk/upgtabs.sqlPortal SQL script started at Wed Oct 18 21:22:23 2006
Connected.
### ERROR: WWU-00013: Tables with UPG_ prefix were found in the OracleAS Portal
### schema.
### Table Name
### UPG_PTL_OBJECTS$
### UPG_PTL_TABLES$
### UPG_WWV_DOCINFO
### CAUSE: The upgrade is terminated when UPG_ prefix tables are present in the
### OracleAS Portal schema.
### ACTION: Back up all tables with the UPG_ prefix, then delete them from the
### OracleAS Portal schema. The script
### /raid/product/OraHome_1/upgrade/temp/portal/prechktmp/dropupg.sql can
### be used for this purpose.
### Check Failed at Wed Oct 18 21:22:23 2006 Continuing as PreCheck mode is specified
Calling upg/common/prechk/wwvcheck.sql
Portal SQL script started at Wed Oct 18 21:22:23 2006
Connected.
# Beginning outer script: prechk/wwvcheck
# Check for invalid Portlet Builder (webview) components.
# Checking if there are too many archive components.
# Checking for missing application schemas.
# Ending outer script: prechk/wwvcheck, 0.31 seconds
Ending precheck at Wed Oct 18 21:22:24 2006
Running upg/common/prechk/upchkobj.sqlPortal SQL script started at Wed Oct 18 21:22:24 2006
Connected.
Running upg/common/prechk/chkmrreg.sqlPortal SQL script started at Wed Oct 18 21:22:24 2006
Connected.
# Beginning outer script: prechk/chkmrreg
# Pre-check to determine that OracleAS Portal is registered with OracleAS Internet Directory
# OracleAS Portal has been wired with OracleAS Internet Directory
# Ending outer script: prechk/chkmrreg, 0.10 seconds
### Connect to OID as Application Entry
Running upg/common/prechk/bindapp.sql . Portal SQL script started at Wed Oct 18 21:22:24 2006
Connected.
# Beginning outer script: prechk/bindapp
#-- Beginning inner script: prechk/bindapp
# Pre-check to test bind to OracleAS Internet Directory Server
# Connecting to OracleAS Internet Directory as the Application Entry
# Connecting to OracleAS Internet Directory as the Application Entry was successful
#-- Ending inner script: prechk/bindapp, 0.14 seconds
# Ending outer script: prechk/bindapp, 0.20 seconds
### Display Tablespace and Parameter Settings
Running upg/common/prechk/../../frwk/upshoset.sql .
Subscriber independent Processing.
Portal SQL script started at Wed Oct 18 21:22:24 2006
Connected.
# Beginning outer script: prechk/upshoset
Tablespace Usage
TABLESPACE BYTES_USED BYTES_FREE TOTAL BYTES CREATE_BYTES AUT FILE STAT STATUS ENABLED BLOCKS BLOCK_SIZE FILE_NAME
B2B_DT 63766528 20054016 83886080 0 YES AVAILABLE ONLINE READ WRITE 10240 8192 /raid/product/oradata/IASDB/b2b_dt.dbf
B2B_IDX 14942208 26935296 41943040 0 YES AVAILABLE ONLINE READ WRITE 5120 8192 /raid/product/oradata/IASDB/b2b_idx.dbf
B2B_LOB 11141120 30736384 41943040 0 YES AVAILABLE ONLINE READ WRITE 5120 8192 /raid/product/oradata/IASDB/b2b_lob.dbf
B2B_RT 39780352 12582912 52428800 0 YES AVAILABLE ONLINE READ WRITE 6400 8192 /raid/product/oradata/IASDB/b2b_rt.dbf
BAM 6553600 3866624 10485760 0 YES AVAILABLE ONLINE READ WRITE 1280 8192 /raid/product/oradata/IASDB/bam.dbf
DCM 237174784 20709376 257949696 0 YES AVAILABLE ONLINE READ WRITE 31488 8192 /raid/product/oradata/IASDB/dcm.dbf
DISCO_PTM5 1310720 1769472 3145728 0 YES AVAILABLE ONLINE READ WRITE 384 8192 /raid/product/oradata/IASDB/discopltc1.dbf
_CACHE
DISCO_PTM5 1310720 1769472 3145728 0 YES AVAILABLE ONLINE READ WRITE 384 8192 /raid/product/oradata/IASDB/discopltm1.dbf
_META
DSGATEWAY_ 5701632 1572864 7340032 0 YES AVAILABLE ONLINE READ WRITE 896 8192 /raid/product/oradata/IASDB/oss_sys01.dbf
TAB
IAS_META 210567168 30539776 241172480 0 YES AVAILABLE ONLINE READ WRITE 29440 8192 /raid/product/oradata/IASDB/ias_meta01.dbf
OCATS 1769472 5505024 7340032 0 YES AVAILABLE ONLINE READ WRITE 896 8192 /raid/product/oradata/IASDB/oca.dbf
OLTS_ATTRS 2555904 917504 3538944 0 YES AVAILABLE ONLINE READ WRITE 432 8192 /raid/product/oradata/IASDB/attrs1_oid.dbf
TORE
OLTS_BATTR 262144 131072 516096 0 YES AVAILABLE ONLINE READ WRITE 63 8192 /raid/product/oradata/IASDB/battrs1_oid.dbf
STORE
OLTS_DEFAU 3997696 851968 4915200 0 YES AVAILABLE ONLINE READ WRITE 600 8192 /raid/product/oradata/IASDB/gdefault1_oid.dbf
LT
ORABPEL 11993088 29884416 41943040 0 YES AVAILABLE ONLINE READ WRITE 5120 8192 /raid/product/oradata/IASDB/orabpel.dbf
PORTAL 74383360 6946816 78643200 0 YES AVAILABLE ONLINE READ WRITE 9600 8192 /raid/product/oradata/IASDB/portal.dbf
PORTAL_DOC 851968 3276800 4194304 0 YES AVAILABLE ONLINE READ WRITE 512 8192 /raid/product/oradata/IASDB/ptldoc.dbf
PORTAL_IDX 11206656 41156608 52428800 0 YES AVAILABLE ONLINE READ WRITE 6400 8192 /raid/product/oradata/IASDB/ptlidx.dbf
PORTAL_LOG 262144 3866624 4194304 0 YES AVAILABLE ONLINE READ WRITE 512 8192 /raid/product/oradata/IASDB/ptllog.dbf
SYSAUX 235732992 5373952 241172480 0 YES AVAILABLE ONLINE READ WRITE 29440 8192 /raid/product/oradata/IASDB/sysaux01.dbf
SYSTEM 834404352 4390912 838860800 0 YES AVAILABLE SYSTEM READ WRITE 102400 8192 /raid/product/oradata/IASDB/system01.dbf
TEMP 6291456 18874368 25165824 25165824 YES AVAILABLE ONLINE READ WRITE 3072 8192 /raid/product/oradata/IASDB/temp01.dbf
UDDISYS_TS 19988480 28180480 48234496 0 YES AVAILABLE ONLINE READ WRITE 5888 8192 /raid/product/oradata/IASDB/uddisys01.dbf
UNDOTBS1 247201792 4390912 251658240 0 YES AVAILABLE ONLINE READ WRITE 30720 8192 /raid/product/oradata/IASDB/undotbs01.dbf
USERS 327680 4849664 5242880 0 YES AVAILABLE ONLINE READ WRITE 640 8192 /raid/product/oradata/IASDB/users01.dbf
WCRSYS_TS 1703936 15007744 16777216 0 YES AVAILABLE ONLINE READ WRITE 2048 8192 /raid/product/oradata/IASDB/wcrsys01.dbf
Sort Segment Data
TABLESPACE EXTENT_SIZE TOTAL_EXTENTS USED_EXTENTS FREE_EXTENTS MAX_USED_SIZE
TEMP 128 5 0 5 1
SGA Allocation Stats
POOL NAME BYTES
java pool free memory 67108864
Total 67108864
SGA Allocation Stats
POOL NAME BYTES
large pool free memory 8388608
Total 8388608
SGA Allocation Stats
POOL NAME BYTES
shared pool fixed allocation callback 344
shared pool pl/sql source 1156
shared pool table definiti 1712
shared pool alert threshol 2648
shared pool trigger inform 3048
shared pool joxs heap 4220
shared pool policy hash ta 4220
shared pool trigger defini 5980
shared pool KQR S SO 7176
shared pool PLS non-lib hp 12208
shared pool trigger source 18652
shared pool KQR L SO 44032
shared pool repository 76264
shared pool KQR M SO 81408
shared pool parameters 105696
shared pool type object de 194164
shared pool KQR S PO 207136
shared pool VIRTUAL CIRCUITS 649340
shared pool FileOpenBlock 746704
shared pool kmgsb circular statistics 821248
shared pool KSXR pending messages que 841036
shared pool KSXR receive buffers 1032500
shared pool KQR M PO 1675892
shared pool sessions 1835204
shared pool PL/SQL DIANA 2910560
shared pool private strands 2928640
shared pool KTI-UNDO 3019632
shared pool KGLS heap 3105320
shared pool PL/SQL MPCODE 3705484
shared pool row cache 3707272
shared pool ASH buffers 4194304
shared pool event statistics per sess 9094400
shared pool sql area 9234624
shared pool library cache 10361688
shared pool miscellaneous 15820288
shared pool free memory 74540744
Total 150994944
SGA Allocation Stats
POOL NAME BYTES
log_buffer 524288
fixed_sga 778968
buffer_cache 50331648
Total 51634904
Database Parameters
NAME VALUE
O7_DICTIONARY_ACCESSIBILITY FALSE
active_instance_count
aq_tm_processes 1
archive_lag_target 0
asm_diskgroups
asm_diskstring
asm_power_limit 1
audit_file_dest /raid/product/OraHome_1/rdbms/audit
audit_sys_operations FALSE
audit_trail NONE
background_core_dump partial
background_dump_dest /raid/product/admin/IASDB/bdump
backup_tape_io_slaves FALSE
bitmap_merge_area_size 1048576
blank_trimming FALSE
buffer_pool_keep
buffer_pool_recycle
circuits
cluster_database FALSE
cluster_database_instances 1
cluster_interconnects
commit_point_strength 1
compatible 10.1.0.2.0
control_file_record_keep_time 7
control_files /raid/product/oradata/IASDB/control01.ctl, /raid/product/oradata/IASDB/control02
.ctl, /raid/product/oradata/IASDB/control03.ctl
core_dump_dest /raid/product/admin/IASDB/cdump
cpu_count 2
create_bitmap_area_size 8388608
create_stored_outlines
cursor_sharing EXACT
cursor_space_for_time FALSE
db_16k_cache_size 0
db_2k_cache_size 0
db_32k_cache_size 0
db_4k_cache_size 0
db_8k_cache_size 0
db_block_buffers 0
db_block_checking FALSE
db_block_checksum TRUE
db_block_size 8192
db_cache_advice ON
db_cache_size 50331648
db_create_file_dest
db_create_online_log_dest_1
db_create_online_log_dest_2
db_create_online_log_dest_3
db_create_online_log_dest_4
db_create_online_log_dest_5
db_domain bizmatch.com.cn
db_file_multiblock_read_count 16
db_file_name_convert
db_files 200
db_flashback_retention_target 1440
db_keep_cache_size 0
db_name IASDB
db_recovery_file_dest /raid/product/flash_recovery_area
db_recovery_file_dest_size 2147483648
db_recycle_cache_size 0
db_unique_name IASDB
db_writer_processes 1
dbwr_io_slaves 0
ddl_wait_for_locks FALSE
dg_broker_config_file1 /raid/product/OraHome_1/dbs/dr1IASDB.dat
dg_broker_config_file2 /raid/product/OraHome_1/dbs/dr2IASDB.dat
dg_broker_start FALSE
disk_asynch_io TRUE
dispatchers (PROTOCOL=TCP)(PRE=oracle.aurora.server.GiopServer), (PROTOCOL=TCP)(PRE=oracle.a
urora.server.SGiopServer)
distributed_lock_timeout 60
dml_locks 1760
drs_start FALSE
enqueue_resources 1980
event
fal_client
fal_server
fast_start_io_target 0
fast_start_mttr_target 0
fast_start_parallel_rollback LOW
file_mapping FALSE
fileio_network_adapters
filesystemio_options none
fixed_date
gc_files_to_locks
gcs_server_processes 0
global_context_pool_size
global_names FALSE
hash_area_size 131072
hi_shared_memory_address 0
hs_autoregister TRUE
ifile
instance_groups
instance_name IASDB
instance_number 0
instance_type RDBMS
java_max_sessionspace_size 0
java_pool_size 67108864
java_soft_sessionspace_limit 0
job_queue_processes 5
large_pool_size 8388608
ldap_directory_access NONE
license_max_sessions 0
license_max_users 0
license_sessions_warning 0
local_listener
lock_name_space
lock_sga FALSE
log_archive_config
log_archive_dest
log_archive_dest_1
log_archive_dest_10
log_archive_dest_2
log_archive_dest_3
log_archive_dest_4
log_archive_dest_5
log_archive_dest_6
log_archive_dest_7
log_archive_dest_8
log_archive_dest_9
log_archive_dest_state_1 enable
log_archive_dest_state_10 enable
log_archive_dest_state_2 enable
log_archive_dest_state_3 enable
log_archive_dest_state_4 enable
log_archive_dest_state_5 enable
log_archive_dest_state_6 enable
log_archive_dest_state_7 enable
log_archive_dest_state_8 enable
log_archive_dest_state_9 enable
log_archive_duplex_dest
log_archive_format %t_%s_%r.dbf
log_archive_local_first TRUE
log_archive_max_processes 2
log_archive_min_succeed_dest 1
log_archive_start FALSE
log_archive_trace 0
log_buffer 524288
log_checkpoint_interval 0
log_checkpoint_timeout 1800
log_checkpoints_to_alert FALSE
log_file_name_convert
logmnr_max_persistent_sessions 1
max_commit_propagation_delay 0
max_dispatchers
max_dump_file_size UNLIMITED
max_enabled_roles 150
max_shared_servers
nls_calendar
nls_comp
nls_currency
nls_date_format
nls_date_language
nls_dual_currency
nls_iso_currency
nls_language AMERICAN
nls_length_semantics BYTE
nls_nchar_conv_excp FALSE
nls_numeric_characters
nls_sort
nls_territory AMERICA
nls_time_format
nls_time_tz_format
nls_timestamp_format
nls_timestamp_tz_format
object_cache_max_size_percent 10
object_cache_optimal_size 102400
olap_page_pool_size 0
open_cursors 300
open_links 4
open_links_per_instance 4
optimizer_dynamic_sampling 2
optimizer_features_enable 10.1.0.5
optimizer_index_caching 0
optimizer_index_cost_adj 100
optimizer_mode ALL_ROWS
os_authent_prefix ops$
os_roles FALSE
parallel_adaptive_multi_user TRUE
parallel_automatic_tuning FALSE
parallel_execution_message_size 2148
parallel_instance_group
parallel_max_servers 40
parallel_min_percent 0
parallel_min_servers 0
parallel_server FALSE
parallel_server_instances 1
parallel_threads_per_cpu 2
pga_aggregate_target 33554432
plsql_code_type INTERPRETED
plsql_compiler_flags INTERPRETED, NON_DEBUG
plsql_debug FALSE
plsql_native_library_dir
plsql_native_library_subdir_count 0
plsql_optimize_level 2
plsql_v2_compatibility FALSE
plsql_warnings DISABLE:ALL
pre_page_sga FALSE
processes 150
query_rewrite_enabled TRUE
query_rewrite_integrity enforced
rdbms_server_dn
read_only_open_delayed FALSE
recovery_parallelism 0
remote_archive_enable true
remote_dependencies_mode TIMESTAMP
remote_listener
remote_login_passwordfile EXCLUSIVE
remote_os_authent FALSE
remote_os_roles FALSE
replication_dependency_tracking TRUE
resource_limit FALSE
resource_manager_plan
resumable_timeout 0
rollback_segments
serial_reuse disable
service_names IASDB.bizmatch.com.cn
session_cached_cursors 0
session_max_open_files 10
sessions 400
sga_max_size 281018368
sga_target 0
shadow_core_dump partial
shared_memory_address 0
shared_pool_reserved_size 7549747
shared_pool_size 150994944
shared_server_sessions
shared_servers 1
skip_unusable_indexes TRUE
smtp_out_server
sort_area_retained_size 0
sort_area_size 65536
sp_name IASDB
spfile /raid/product/OraHome_1/dbs/spfileIASDB.ora
sql92_security FALSE
sql_trace FALSE
sql_version NATIVE
sqltune_category DEFAULT
standby_archive_dest ?/dbs/arch
standby_file_management MANUAL
star_transformation_enabled FALSE
statistics_level TYPICAL
streams_pool_size 0
tape_asynch_io TRUE
thread 0
timed_os_statistics 0
timed_statistics TRUE
trace_enabled TRUE
tracefile_identifier
transactions 440
transactions_per_rollback_segment 5
undo_management AUTO
undo_retention 900
undo_tablespace UNDOTBS1
use_indirect_data_buffers FALSE
user_dump_dest /raid/product/admin/IASDB/udump
utl_file_dir
workarea_size_policy AUTO
All Portal DBMS jobs
JOB LOG_USER PRIV_USER SCHEMA_USER
17 PORTAL PORTAL PORTAL
18 PORTAL PORTAL PORTAL
27 PORTAL PORTAL PORTAL
28 PORTAL PORTAL PORTAL
43 PORTAL PORTAL PORTAL
Details of all Portal DBMS jobs
JOB WHAT
17 begin execute immediate 'begin wwctx_sso.cleanup_sessions(
p_hours_old => 168 ); end;' ; exception when others then
null; end;
18 wwsec_api_private.rename_users;
27 wwv_context.sync;
28 wwv_context.optimize(CTX_DDL.OPTLEVEL_FULL,1440,null);
43 begin execute immediate 'begin wwutl_cache_sys.process_background_inv
al; end;' ; exception when others then wwlog_api.log(p_
domain=>'utl', p_subdomain=>'cache', p_name=>'background
', p_action=>'process_background_inval', p_information =
> 'Error in process_background_inval '|| sqlerrm);end;
Database version details
BANNER
Oracle Database 10g Enterprise Edition Release 10.1.0.4.2 - Prod
PL/SQL Release 10.1.0.4.2 - Production
CORE 10.1.0.4.0 Production
TNS for Linux: Version 10.1.0.4.0 - Production
NLSRTL Version 10.1.0.4.2 - Production
# Ending outer script: prechk/upshoset, 1.83 seconds
### Log invalid DB objects in the temporary directory.
List count of invalid objects in the database in /raid/product/OraHome_1/upgrade/temp/portal/prechktmp/dbinvob1.log
Running upg/frwk/dbinvobj.sqlPortal SQL script started at Wed Oct 18 21:22:26 2006
Connected.
### Install Schema Validation Utility
Running upg/common/prechk/svuver.sql . Portal SQL script started at Wed Oct 18 21:22:26 2006
Connected.
# Beginning outer script: prechk/svuver
#-- Beginning inner script: prechk/svuver
# Portal Schema Version = 10.1.2.0.2
# Version of schema validation utility being installed = 101202
# Load the Schema Validation Utility
Installed version of schema validation utility: 10.1.2.0.6
Schema Validation Utility version: 10.1.2.0.6 will be installed.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
No errors.
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_SCHEMA_COMMON:
44/9 PL/SQL: Statement ignored
44/16 PLS-00905: object PORTAL.WWSBR_SITE_DB is invalid
70/9 PL/SQL: Statement ignored
70/17 PLS-00905: object PORTAL.WWPOB_API_PAGE is invalid
96/10 PL/SQL: Statement ignored
96/18 PLS-00905: object PORTAL.WWV_THINGDB is invalid
122/10 PL/SQL: Statement ignored
122/18 PLS-00905: object PORTAL.WWV_THINGDB is invalid
No errors.
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_ATTR_VALIDATION:
740/9 PL/SQL: SQL Statement ignored
778/26 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_PAGE_GROUP_VALIDATION:
366/9 PL/SQL: SQL Statement ignored
372/31 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
1447/13 PL/SQL: SQL Statement ignored
1458/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
1624/13 PL/SQL: SQL Statement ignored
1635/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
1783/13 PL/SQL: SQL Statement ignored
1794/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
1896/13 PL/SQL: SQL Statement ignored
1907/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
2009/13 PL/SQL: SQL Statement ignored
2020/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
2126/13 PL/SQL: SQL Statement ignored
2137/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
No errors.
No errors.
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_PAGE_VALIDATION:
137/9 PL/SQL: SQL Statement ignored
144/53 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
258/21 PL/SQL: SQL Statement ignored
260/43 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
277/17 PL/SQL: SQL Statement ignored
279/39 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
322/9 PL/SQL: SQL Statement ignored
327/25 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
353/25 PL/SQL: Statement ignored
353/40 PLS-00905: object PORTAL.WWPOB_API_PAGE is invalid
362/29 PL/SQL: SQL Statement ignored
369/42 PL/SQL: ORA-06575: Package or function WWPOB_API_PAGE is in an
invalid state
376/33 PL/SQL: Statement ignored
376/48 PLS-00905: object PORTAL.WWPOB_API_PAGE is invalid
385/21 PL/SQL: SQL Statement ignored
388/39 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
1214/21 PL/SQL: SQL Statement ignored
1216/42 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
1262/9 PL/SQL: SQL Statement ignored
1266/30 PL/SQL: ORA-06575: Package or function WWPOB_API_PAGE is in an
invalid state
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_REGION_VALIDATION:
237/9 PL/SQL: SQL Statement ignored
249/41 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_STYLE_VALIDATION:
414/9 PL/SQL: SQL Statement ignored
424/44 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
584/21 PL/SQL: Statement ignored
584/52 PLS-00905: object PORTAL.WWSBR_SITE_DB is invalid
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_THING_VALIDATION:
2129/32 PL/SQL: Item ignored
2130/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
2131/32 PL/SQL: Item ignored
2132/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
2133/32 PL/SQL: Item ignored
2134/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
2135/31 PL/SQL: Item ignored
2136/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
2137/31 PL/SQL: Item ignored
2138/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
2139/31 PL/SQL: Item ignored
2140/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
2151/32 PL/SQL: Item ignored
2151/42 PLS-00320: the declaration of the type of this expression is
incomplete or malformed
2152/32 PL/SQL: Item ignored
2152/42 PLS-00320: the declaration of the type of this expression is
incomplete or malformed
2153/32 PL/SQL: Item ignored
2153/42 PLS-00320: the declaration of the type of this expression is
incomplete or malformed
2202/17 PL/SQL: SQL Statement ignored
2212/27 PL/SQL: ORA-06575: Package or function WWSBR_THING_TYPES is in an
invalid state
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_ITEM_VALIDATION:
322/9 PL/SQL: SQL Statement ignored
338/30 PL/SQL: ORA-06575: Package or function WWPOB_API_PAGE is in an
invalid state
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_PORTLET_VALIDATION:
155/13 PL/SQL: SQL Statement ignored
163/36 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
170/13 PL/SQL: SQL Statement ignored
178/36 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
invalid state
459/9 PL/SQL: SQL Statement ignored
467/31 PL/SQL: ORA-06575: Package or function WWSBR_SITEBUILDER_PROVIDER
is in an invalid state
581/9 PL/SQL: SQL Statement ignored
584/21 PL/SQL: ORA-06575: Package or function WWSBR_SITEBUILDER_PROVIDER
is in an invalid state
588/9 PL/SQL: SQL Statement ignored
591/29 PL/SQL: ORA-06575: Package or function WWSBR_SITEBUILDER_PROVIDER
is in an invalid state
Warning: Package Body created with compilation errors.
Errors for PACKAGE BODY WWUTL_DBPROV_VALIDATION:
341/25 PL/SQL: Item ignored
341/45 PLS-00302: component 'URL' must be declared
559/17 PL/SQL: Statement ignored
559/17 PLS-00320: the declaration of the type of this expression is
incomplete or malformed
562/17 PL/SQL: Statement ignored
564/40 PLS-00320: the declaration of the type of this expression is
incomplete or malformed
No errors.
No errors.
### Invoke Schema Validation Utility in Report Mode
Running upg/common/prechk/../../frwk/svurun.sql . Portal SQL script started at Wed Oct 18 21:22:31 2006
Connected.
# Beginning outer script: prechk/svurun
#-- Beginning inner script: frwk/svurun
declare
ERROR at line 1:
ORA-20000:
ORA-06512: at "PORTAL.WWPOF", line 440
ORA-06512: at line 45
ORA-20000:
ORA-06512: at "PORTAL.WWPOF", line 440
ORA-06512: at "PORTAL.WWUTL_SCHEMA_VALIDATION", line 263
ORA-04063: package body "PORTAL.WWUTL_PAGE_GROUP_VALIDATION" has errors
ORA-06508: PL/SQL: could not find program unit being called
Connected.
# Run the report mode of the schema validation utility
#---- Beginning inner script: wwutl_schema_validation.validate_all
# Running the validation in report mode
# Schema Validation Utility Version = 10.1.2.0.6
# Validate Page Groups
# Handling exception
# ERROR: When executing schema validation utility
# ERROR: ORA-06508: PL/SQL: could not find program unit being called
# ----- PL/SQL Call Stack -----
object line object
handle number name
0x5c4fef28 434 package body PORTAL.WWPOF
0x5bb96e20 263 package body PORTAL.WWUTL_SCHEMA_VALIDATION
0x5bb96e20 297 package body PORTAL.WWUTL_SCHEMA_VALIDATION
0x5b885fe4 18 anonymous block
# Handling exception
# ERROR: When running the schema validation utility
# ERROR: ORA-20000:
ORA-06512: at "PORTAL.WWPOF", line 440
ORA-06512: at "PORTAL.WWUTL_SCHEMA_VALIDATION", line 263
ORA-04063: package body "PORTAL.WWUTL_PAGE_GROUP_VALIDATION" has errors
ORA-06508: PL/SQL: could not find program unit being called
# ----- PL/SQL Call Stack -----
object line object
handle number name
0x5c4fef28 434 package body PORTAL.WWPOF
0x5b885fe4 45 anonymous block
### ERROR: Exception Executing upg/common/prechk/../../frwk/svurun.sql REPORT PRECHK for Subscriber: 1
### Check Failed at Wed Oct 18 21:22:31 2006 Continuing as PreCheck mode is specified
### PHASE 5: Version specific user inputs
Upgrade phase started at Wed Oct 18 21:22:31 2006
Processing Metadata File: upg/10140/inputchk/inputchk.met ###
### PHASE 6: Version specific pre upgrade checks
Upgrade phase started at Wed Oct 18 21:22:31 2006
Processing Metadata File: upg/10140/prechk/prechk.met ###
### PHASE 7: Pre upgrade common information gathering
Upgrade phase started at Wed Oct 18 21:22:31 2006
Processing Metadata File: upg/common/info/info.met ### Log portal configuration info in the temporary directory.
Running upg/common/info/ptlinfo.sql . Portal SQL script started at Wed Oct 18 21:22:31 2006
Connected.
# Beginning outer script: info/ptlinfo
# Ending outer script: info/ptlinfo, 0.13 seconds
Metadata File upg/10140/info/info.met does not exist.
### PHASE 8: Verify user inputs
Upgrade phase started at Wed Oct 18 21:22:32 2006
Processing Metadata File: upg/common/verfyinp/verfyinp.met Running upg/common/verfyinp/verfyinp.pl The following details have been determined:
General Details
===========================================================
Log File Name : /raid/product/OraHome_1/upgrade/temp/portal/precheck.log
RDBMS Version : 10.1.0
Product Version : 10.1.2.0.2
Oracle PL/SQL Toolkit Schema : SYS
Oracle PL/SQL Toolkit version : 10.1.2.0.2
O7 accessibility : FALSE
Schema Details
===========================================================
Name : portal
Connect String : (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=portaldb.bizmatch.com.cn)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=IASDB.bizmatch.com.cn)))
Tablespace Details
===========================================================
Default Tablespace : PORTAL
Temporary Tablespace : TEMP
Document Tablespace : PORTAL_DOC
Logging Tablespace : PORTAL_LOG
Index Tablespace : PORTAL
### ERROR: WWU-00030: Pre-Check mode encountered the following errors:
### 184 : ### ERROR: WWU-00013: Tables with UPG_ prefix were found in the OracleAS Portal
### 706 : 44/16 PLS-00905: object PORTAL.WWSBR_SITE_DB is invalid
### 708 : 70/17 PLS-00905: object PORTAL.WWPOB_API_PAGE is invalid
### 710 : 96/18 PLS-00905: object PORTAL.WWV_THINGDB is invalid
### 712 : 122/18 PLS-00905: object PORTAL.WWV_THINGDB is invalid
### 719 : 778/26 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 727 : 372/31 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 731 : 1458/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 735 : 1635/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 739 : 1794/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 743 : 1907/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 747 : 2020/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 751 : 2137/28 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 761 : 144/53 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 765 : 260/43 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 769 : 279/39 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 773 : 327/25 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 777 : 353/40 PLS-00905: object PORTAL.WWPOB_API_PAGE is invalid
### 779 : 369/42 PL/SQL: ORA-06575: Package or function WWPOB_API_PAGE is in an
### 783 : 376/48 PLS-00905: object PORTAL.WWPOB_API_PAGE is invalid
### 785 : 388/39 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 789 : 1216/42 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 793 : 1266/30 PL/SQL: ORA-06575: Package or function WWPOB_API_PAGE is in an
### 801 : 249/41 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 809 : 424/44 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 813 : 584/52 PLS-00905: object PORTAL.WWSBR_SITE_DB is invalid
### 819 : 2130/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
### 821 : 2132/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
### 823 : 2134/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
### 825 : 2136/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
### 827 : 2138/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
### 829 : 2140/13 PLS-00905: object PORTAL.WWSBR_THING_TYPES is invalid
### 831 : 2151/42 PLS-00320: the declaration of the type of this expression is
### 835 : 2152/42 PLS-00320: the declaration of the type of this expression is
### 839 : 2153/42 PLS-00320: the declaration of the type of this expression is
### 843 : 2212/27 PL/SQL: ORA-06575: Package or function WWSBR_THING_TYPES is in an
### 851 : 338/30 PL/SQL: ORA-06575: Package or function WWPOB_API_PAGE is in an
### 859 : 163/36 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 863 : 178/36 PL/SQL: ORA-06575: Package or function WWSBR_SITE_DB is in an
### 867 : 467/31 PL/SQL: ORA-06575: Package or function WWSBR_SITEBUILDER_PROVIDER
### 871 : 584/21 PL/SQL: ORA-06575: Package or function WWSBR_SITEBUILDER_PROVIDER
### 875 : 591/29 PL/SQL: ORA-06575: Package or function WWSBR_SITEBUILDER_PROVIDER
### 883 : 341/45 PLS-00302: component 'URL' must be declared
### 885 : 559/17 PLS-00320: the declaration of the type of this expression is
### 889 : 564/40 PLS-00320: the declaration of the type of this expression is
### 904 : ERROR at line 1:
### 905 : ORA-20000:
### 906 : ORA-06512: at "PORTAL.WWPOF", line 440
### 907 : ORA-06512: at line 45
### 908 : ORA-20000:
### 909 : ORA-06512: at "PORTAL.WWPOF", line 440
### 910 : ORA-06512: at "PORTAL.WWUTL_SCHEMA_VALIDATION", line 263
### 911 : ORA-04063: package body "PORTAL.WWUTL_PAGE_GROUP_VALIDATION" has errors
### 912 : ORA-06508: PL/SQL: could not find program unit being called
### 922 : # ERROR: When executing schema validation utility
### 923 : # ERROR: ORA-06508: PL/SQL: could not find program unit being called
### 933 : # ERROR: When running the schema validation utility
### 934 : # ERROR: ORA-20000:
### 935 : ORA-06512: at "PORTAL.WWPOF", line 440
### 936 : ORA-06512: at "PORTAL.WWUTL_SCHEMA_VALIDATION", line 263
### 937 : ORA-04063: package body "PORTAL.WWUTL_PAGE_GROUP_VALIDATION" has errors
### 938 : ORA-06508: PL/SQL: could not find program unit being called
### 947 : ### ERROR: Exception Executing upg/common/prechk/../../frwk/svurun.sql REPORT PRECHK for Subscriber: 1
### Check Failed at Wed Oct 18 21:22:32 2006 Continuing as PreCheck mode is specified
Pre-Check Completed at Wed Oct 18 21:22:32 2006Hi,
Its good that u pasted the complete log file. In your environment you have to run this upgrade tool only once from any of the middle tier.
And with respect to your error that u got in precheck is quite simple. All u have to do is just run this script from by connecting to portal schema using sqlplus.
Run dropupg.sql
Location-------- /raid/product/OraHome_1/upgrade/temp/portal/prechktmp/dropupg.sql
Later you re-run the upgrade tool and let me know the status.
Good luck
Tanmai -
Update Statement Simply hanged but doing db file sequential read
Hi,
Last night we had issue with one of the prod server where we updating one of table which contains large number records in millions.Same identical machine completed in1 hour and other box never completed but doing db file sequential read but in the long ops the last statement it was done 20:16 after that nothing is happening but i ran few trace on that user.
/u01/app/oracle/admin/SURV2/udump/surv2_ora_10048.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 18
Unix process pid: 10048, image: oracle@prdfa001
*** 2010-09-09 23:37:07.484
*** ACTION NAME:() 2010-09-09 23:37:07.473
*** MODULE NAME:(SQL*Plus) 2010-09-09 23:37:07.473
*** SERVICE NAME:(SURV2) 2010-09-09 23:37:07.473
*** SESSION ID:(289.54) 2010-09-09 23:37:07.473
Received ORADEBUG command 'unlimit' from process Unix process pid: 3983, image:
*** 2010-09-09 23:37:20.315
Received ORADEBUG command 'event 10046 trace name context forever, level 12' from process Unix process pid: 3983, image:
WAIT #7: nam='db file sequential read' ela= 11160 file#=13 block#=2252349 blocks=1 obj#=166421 tim=12499462835161
WAIT #7: nam='db file sequential read' ela= 2857 file#=13 block#=2249751 blocks=1 obj#=166421 tim=12499462838137
WAIT #7: nam='db file sequential read' ela= 3810 file#=13 block#=2251361 blocks=1 obj#=166421 tim=12499462842048
WAIT #7: nam='db file sequential read' ela= 4459 file#=13 block#=2247059 blocks=1 obj#=166421 tim=12499462846564
WAIT #7: nam='db file sequential read' ela= 2841 file#=13 block#=2247507 blocks=1 obj#=166421 tim=12499462849468
WAIT #7: nam='db file sequential read' ela= 427 file#=13 block#=2247568 blocks=1 obj#=166421 tim=12499462850032
WAIT #7: nam='db file sequential read' ela= 1187 file#=13 block#=2248264 blocks=1 obj#=166421 tim=12499462851327
WAIT #7: nam='db file sequential read' ela= 2687 file#=13 block#=2250707 blocks=1 obj#=166421 tim=12499462854178
WAIT #7: nam='db file sequential read' ela= 3657 file#=13 block#=2249697 blocks=1 obj#=166421 tim=12499462857896
WAIT #7: nam='db file sequential read' ela= 4139 file#=13 block#=2247074 blocks=1 obj#=166421 tim=12499462862093
WAIT #7: nam='db file sequential read' ela= 4180 file#=47 block#=3649690 blocks=1 obj#=166421 tim=12499509270445
WAIT #7: nam='db file sequential read' ela= 4802 file#=47 block#=3649309 blocks=1 obj#=166421 tim=12499509275327
WAIT #7: nam='db file sequential read' ela= 2459 file#=47 block#=3652697 blocks=1 obj#=166421 tim=12499509277859
WAIT #7: nam='db file sequential read' ela= 4015 file#=47 block#=3652826 blocks=1 obj#=166421 tim=12499509281948
WAIT #7: nam='db file sequential read' ela= 2248 file#=47 block#=3651610 blocks=1 obj#=166421 tim=12499509284269
WAIT #7: nam='db file sequential read' ela= 4824 file#=47 block#=3654297 blocks=1 obj#=166421 tim=12499509289166
WAIT #7: nam='db file sequential read' ela= 2008 file#=47 block#=3652312 blocks=1 obj#=166421 tim=12499509291248
WAIT #7: nam='db file sequential read' ela= 1925 file#=47 block#=3654490 blocks=1 obj#=166421 tim=12499509293246
WAIT #7: nam='db file sequential read' ela= 2859 file#=47 block#=3648458 blocks=1 obj#=166421 tim=12499509296178
WAIT #7: nam='db file sequential read' ela= 1740 file#=47 block#=3648212 blocks=1 obj#=166421 tim=12499509297991
WAIT #7: nam='db file sequential read' ela= 2566 file#=47 block#=3648411 blocks=1 obj#=166421 tim=12499509300631
WAIT #7: nam='db file sequential read' ela= 50772 file#=5 block#=480749 blocks=1 obj#=166421 tim=12499509351477
WAIT #7: nam='db file sequential read' ela= 12928 file#=5 block#=477177 blocks=1 obj#=166421 tim=12499509364482
WAIT #7: nam='db file sequential read' ela= 11116 file#=5 block#=479412 blocks=1 obj#=166421 tim=12499509375672
WAIT #7: nam='db file sequential read' ela= 4803 file#=5 block#=483440 blocks=1 obj#=166421 tim=12499509380549
WAIT #7: nam='db file sequential read' ela= 6900 file#=5 block#=481454 blocks=1 obj#=166421 tim=12499509387522
Received ORADEBUG command 'event 10046 trace name context off' from process Unix process pid: 3983, image:
/u01/app/oracle/admin/SURV2/udump/surv2_ora_1545.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 22
Unix process pid: 1545, image: oracle@prdfa001 (TNS V1-V3)
*** ACTION NAME:() 2010-09-09 23:20:13.485
*** MODULE NAME:(sqlplus@prdfa001 (TNS V1-V3)) 2010-09-09 23:20:13.485
*** SERVICE NAME:(SYS$USERS) 2010-09-09 23:20:13.485
*** SESSION ID:(290.697) 2010-09-09 23:20:13.485
===================================================
SYSTEM STATE
System global information:
processes: base 47819b480, size 300, cleanup 4781a5638
allocation: free sessions 47f1d6148, free calls 0
control alloc errors: 0 (process), 0 (session), 0 (call)
PMON latch cleanup depth: 0
seconds since PMON's last scan for dead processes: 20
system statistics:
1171 logons cumulative
19 logons current
89219 opened cursors cumulative
86 opened cursors current
15095069 user commits
5 user rollbacks
58632904 user calls
44023255 recursive calls
224311 recursive cpu usage
201424173 session logical reads
0 session stored procedure space
901812 CPU used when call started
995437 CPU used by this session
6814196 DB time
0 cluster wait time
22542300822 concurrency wait time
3095 application wait time
16479074661 user I/O wait time
1284052668 session connect time
1284067190 process last non-idle time
189018343568 session uga memory
1249667216 session uga memory max
26059216 messages sent
26059220 messages received
239739 background timeouts
162399896 session pga memory
189662872 session pga memory max
4 enqueue timeouts
901146 enqueue waits
0 enqueue deadlocks
32122711 enqueue requests
17819 enqueue conversions
32122676 enqueue releases
0 global enqueue gets sync
0 global enqueue gets async
0 global enqueue get time
0 global enqueue releases
2865667 physical read total IO requests
262620 physical read total multi block requests
270093476864 physical read total bytes
select SYS_CONTEXT('USERENV', 'SERVER_HOST'), SYS_CONTEXT('USERENV', 'DB_UNIQUE_NAME'), SYS_CONTEXT('USERENV', 'INSTANCE_NAME'), SYS_CONTEXT('USERENV', 'SERVICE_NAME'), INSTANCE_NUMBER, STARTUP_TIME, SYS_CONTEXT('USERENV', 'DB_DOMAIN') from v$instance where INSTANCE_NAME=SYS_CONTEXT('USERENV', 'INSTANCE_NAME')
hash=550c95f3d0cfa8290e60ea8382d3a2ca timestamp=09-09-2010 04:24:19
namespace=CRSR flags=RON/KGHP/TIM/PN0/LRG/KST/DBN/MTX/[100100d1]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=9 hpc=0582 hlc=0582
lwt=47df576e8[47df576e8,47df576e8] ltm=47df576f8[47df576f8,47df576f8]
pwt=47df576b0[47df576b0,47df576b0] ptm=47df576c0[47df576c0,47df576c0]
ref=47df57718[47df57718,47df57718] lnd=47df57730[47df57730,47df57730]
LIBRARY OBJECT: object=471ee1d38
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 471ee1800 471ee1470 47df7dce0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47df7de48 471ee1e50 I/P/A/-/- 0 NONE 00
SO: 473691d60, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473691d60 handle=47bb22fa0 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=473691de0[4735dbcb8,476cfbf58] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x0
LIBRARY OBJECT HANDLE: handle=47bb22fa0 mtx=47bb230d0(0) cdp=0
namespace=CRSR flags=RON/KGHP/PN0/EXP/[10010100]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=fd84 hlc=fd84
lwt=47bb23048[47bb23048,47bb23048] ltm=47bb23058[47bb23058,47bb23058]
pwt=47bb23010[47bb23010,47bb23010] ptm=47bb23020[47bb23020,47bb23020]
ref=47bb23078[472f8de18,472f8de18] lnd=47bb23090[47bb23090,47bb23090]
LIBRARY OBJECT: object=472f8d9d8
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DEPENDENCIES: count=1 size=16
AUTHORIZATIONS: count=1 size=16 minimum entrysize=16
ACCESSES: count=1 size=16
TRANSLATIONS: count=1 size=16
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb22ee0 472f8daf0 I/P/A/-/- 0 NONE 00
6 472f8e508 46be86250 I/-/A/-/E 0 NONE 00
SO: 4735dbc38, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=4735dbc38 handle=47bb231c8 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4735dbcb8[476cfbf58,473691de0] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bb231c8 mtx=47bb232f8(1) cdp=1
name=select value$ from props$ where name = 'GLOBAL_DB_NAME'
hash=4bb432d65c5a391a42a5c3fa74472c7a timestamp=09-09-2010 04:24:12
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/KST/DBN/MTX/[120100d0]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=0584 hlc=0584
lwt=47bb23270[47bb23270,47bb23270] ltm=47bb23280[47bb23280,47bb23280]
pwt=47bb23238[47bb23238,47bb23238] ptm=47bb23248[47bb23248,47bb23248]
ref=47bb232a0[47bb232a0,47bb232a0] lnd=47bb232b8[47bb232b8,47bb232b8]
LIBRARY OBJECT: object=472f8e6e0
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 472f8e1a8 472f8de18 47bb22fa0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb23108 472f8e7f8 I/P/A/-/- 0 NONE 00
SO: 473644348, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473644348 handle=47bbde418 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4736443c8[476cfc0b8,476cfc0b8] htb=476cfc0b8 ssga=476cfb6a0
user=47924e810 session=47924e810 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bbde418 mtx=47bbde548(0) cdp=0
name=ALTER SESSION SET TIME_ZONE='+02:00'
hash=3878dff8839e71e3dd05a2e75fbd6390 timestamp=09-09-2010 04:24:04
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/DBN/[12010040]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=11 hpc=04e8 hlc=04e8
lwt=47bbde4c0[47bbde4c0,47bbde4c0] ltm=47bbde4d0[47bbde4d0,47bbde4d0]
pwt=47bbde488[47bbde488,47bbde488] ptm=47bbde498[47bbde498,47bbde498]
ref=47bbde4f0[47bbde4f0,47bbde4f0] lnd=47bbde508[47bbde508,47bbde508]
LIBRARY OBJECT: object=472fffc08
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bbde320 472fffd20 I/P/A/-/- 0 NONE 00
SO: 47aecf9e8, type: 41, owner: 47924e810, flag: INIT/-/-/0x00
(dummy) nxc=0, nlb=0
SO: 47f290540, type: 11, owner: 4781a7dc0, flag: INIT/-/-/0x00
(broadcast handle) flag: (2) ACTIVE SUBSCRIBER, owner: 4781a7dc0,
event: 1132, last message event: 1132,
last message waited event: 1132, next message: 0(0), messages read: 0
channel: (47a2df4f8) system events broadcast channel
scope: 2, event: 1132, last mesage event: 18,
publishers/subscribers: 0/17,
messages published: 1
SO: 47826b228, type: 3, owner: 4781a7dc0, flag: INIT/-/-/0x00
(call) sess: cur 47924e810, rec 0, usr 47924e810; depth: 0
SO: 476c52968, type: 16, owner: 4781a7dc0, flag: INIT/-/-/0x00
(osp req holder)
PSEUDO PROCESS for group DEFAULT:
SO: 47a1eb7d0, type: 2, owner: 0, flag: INIT/-/-/0x00
(process) Oracle pid=0, calls cur/top: 0/0, flag: (20) PSEUDO
int error: 0, call error: 0, sess error: 0, txn error 0
(post info) last post received: 0 0 0
last post received-location: No post
last process to post me: none
last post sent: 0 0 0
last post sent-location: No post
last process posted by me: none
(latch info) wait_event=0 bits=0
Process Group: DEFAULT, pseudo proc: 47a1eb7d0
O/S info: user: , term: , ospid: (DEAD)
OSD pid info: Unix process pid: 0, image: PSEUDO
Dump of memory from 0x00000004791BF538 to 0x00000004791BF740
4791BF530 00000000 00000000 [........]
4791BF540 00000000 00000000 00000000 00000000 [................]
Repeat 31 times
NO DETACHED BRANCHES.
NO DETACHED NETWORK CONNECTIONS.
CLEANUP STATE OBJECTS:
SO: 47f0cd038, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: instance enqueue anchor state
latch: 0x380009890
SO: 4782cf080, type: 5, owner: 47f0cd038, flag: INIT/-/-/0x00
(enqueue) TA-00000006-00000001 DID: 0001-000F-0000000B
lv: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 res_flag: 0x2
res: 0x47a28d020, mode: X, lock_flag: 0x0
own: 0x0, sess: 0x0, prv: 0x47a28d030
SO: 47f0cd098, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: switchable channel handle anch
latch: 0x38000ac98
SO: 47f28f868, type: 11, owner: 47f0cd098, flag: INIT/-/-/0x00
(broadcast handle) flag: (c2) ACTIVE SUBSCRIBER, owner: 0,
event: 1, last message event: 1,
last message waited event: 1, next message: 0(0), messages read: 0
channel: (47a2e4190) KPON channel
scope: 2, event: 1, last mesage event: 0,
publishers/subscribers: 0/1,
messages published: 0
SO: 47f0cd0f8, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: TT shared object cleanup SO
latch: 0x38001c6b8
SO: 47f0cd158, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: SS shared object cleanup SO
latch: 0x38001cd48
END OF SYSTEM STATE
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
db file sequential read 2,347,652 9,215 4 64.5 User I/O
db file scattered read 245,687 4,199 17 29.4 User I/O
CPU time 974 6.8
db file parallel write 50,082 408 8 2.9 System I/O
log file parallel write 6,963 52 7 0.4 System I/O
Time Model Statistics DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Total time in database user-calls (DB Time): 14286.4s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 14,280.3 100.0
DB CPU 974.5 6.8
PL/SQL execution elapsed time 531.8 3.7
parse time elapsed 30.5 .2
hard parse elapsed time 27.1 .2
connection management call elapsed time 14.9 .1
hard parse (sharing criteria) elapsed time 3.4 .0
hard parse (bind mismatch) elapsed time 3.1 .0
PL/SQL compilation elapsed time 2.4 .0
failed parse elapsed time 0.0 .0
repeated bind elapsed time 0.0 .0
sequence load elapsed time 0.0 .0
DB time 14,286.4 N/A
background elapsed time 670.2 N/A
background cpu time 186.1 N/A
Wait Class DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc
Avg
%Time Total Wait wait Waits
Wait Class Waits -outs Time (s) (ms) /txn
User I/O 2,593,484 .0 13,415 5 150.0
System I/O 87,506 .0 515 6 5.1
Other 839 11.4 6 7 0.0
Commit 3,225 .1 6 2 0.2
Concurrency 1,033 .0 5 5 0.1
Configuration 2,514 99.4 0 0 0.1
Network 47,559 .0 0 0 2.8
Application 7 .0 0 0 0.0
Wait Events DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file sequential read 2,347,652 .0 9,215 4 135.8
db file scattered read 245,687 .0 4,199 17 14.2
db file parallel write 50,082 .0 408 8 2.9
log file parallel write 6,963 .0 52 7 0.4
control file parallel write 6,203 .0 44 7 0.4
control file sequential read 24,242 .0 11 0 1.4
log file sync 3,225 .1 6 2 0.2
latch free 84 .0 4 47 0.0
os thread startup 25 .0 3 120 0.0
latch: session allocation 39 .0 1 33 0.0
db file parallel read 12 .0 1 92 0.0
enq: TX - index contention 186 .0 1 3 0.0
latch: shared pool 47 .0 1 11 0.0
LGWR wait for redo copy 319 3.1 0 1 0.0
library cache load lock 2 .0 0 172 0.0
buffer busy waits 590 .0 0 0 0.0
log file switch completion 6 .0 0 29 0.0
SGA: allocation forcing comp 11 54.5 0 14 0.0
latch: library cache lock 50 .0 0 3 0.0
read by other session 38 .0 0 4 0.0
direct path read 42 .0 0 3 0.0
SQL*Net message to client 44,807 .0 0 0 2.6
rdbms ipc reply 207 .0 0 0 0.0
SQL*Net more data from clien 1,014 .0 0 0 0.1
latch: cache buffers chains 24 .0 0 1 0.0
latch: library cache 29 .0 0 1 0.0
log file sequential read 8 .0 0 3 0.0
direct path write 50 .0 0 0 0.0
SQL*Net more data to client 398 .0 0 0 0.0
latch: object queue header o 12 .0 0 1 0.0
latch: In memory undo latch 78 .0 0 0 0.0
undo segment extension 2,507 99.7 0 0 0.1
latch: cache buffers lru cha 4 .0 0 1 0.0
log file single write 8 .0 0 0 0.0
local write wait 3 .0 0 1 0.0
enq: RO - fast object reuse 3 .0 0 1 0.0
buffer deadlock 87 92.0 0 0 0.0
enq: JS - queue lock 1 .0 0 1 0.0
cursor: pin S 70 .0 0 0 0.0
latch: row cache objects 2 .0 0 1 0.0
SQL*Net message to dblink 1,338 .0 0 0 0.1
latch: checkpoint queue latc 2 .0 0 0 0.0
reliable message 3 .0 0 0 0.0
log buffer space 1 .0 0 1 0.0
SQL*Net break/reset to clien 4 .0 0 0 0.0
SQL*Net more data from dblin 2 .0 0 0 0.0
SQL*Net message from client 44,949 .0 155,701 3464 2.6
virtual circuit status 621 100.0 18,156 29237 0.0
Streams AQ: qmn slave idle w 664 .0 18,127 27299 0.0
Streams AQ: qmn coordinator 1,339 50.4 18,099 13517 0.1
Streams AQ: waiting for time 12 100.0 8,741 728394 0.0
jobq slave wait 130 100.0 380 2927 0.0
PL/SQL lock timer 1 100.0 1 978 0.0
SQL*Net message from dblink 1,338 .0 0 0 0.1
single-task message 1 .0 0 38 0.0
class slave wait 11 .0 0 1 0.0
SQL ordered by Elapsed Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
Elapsed CPU Elap per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
13,664 906 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
8,792 195 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
2,524 368 1 2524.1 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
1,414 177 1 1414.4 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
742 137 1 742.2 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
274 11 1 274.2 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
264 8 27 9.8 1.8 8szmwam7fysa3
Module: DBMS_SCHEDULER
insert into wri$_adv_objspace_trend_data select timepoint, space_usage, space_a
lloc, quality from table(dbms_space.object_growth_trend(:1, :2, :3, :4, NULL, N
ULL, NULL, 'FALSE', :5, 'FALSE'))
99 1 1 99.4 0.7 1z0x41f66nvjr
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTADMIN SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
21 10 1 21.5 0.2 bbc1ck8594kvj
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTDAILYHIST SET ADJOPEN=NVL(ADJOPEN,OPEN), ADJHIGH=NVL(ADJH
IGH,HIGH), ADJLOW=NVL(ADJLOW,LOW), ADJMID=NVL(ADJMID,MID), ADJCLOSE=NVL(ADJCLOSE
,CLOSE), ADJVOLUME=NVL(ADJVOLUME,VOLUME), ADJCLOSINGBID=NVL(ADJCLOSINGBID,CLOSIN
GBID), ADJCLOSINGOFFER=NVL(ADJCLOSINGOFFER,CLOSINGOFFER)
12 0 1 12.5 0.1 6xm9p9uy5kaap
Module: SQL*Plus
SELECT count(*) FROM TIBEX_INSTRUMENTSTATE WHERE INSTRUMENTID=:"SYS_B_0"
SQL ordered by CPU Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
CPU Elapsed CPU per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
906 13,664 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
368 2,524 1 367.51 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
195 8,792 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
177 1,414 1 176.93 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
137 742 1 137.38 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
11 274 1 10.82 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
10 21 1 9.65 0.2 bbc1ck8594kvjEdited by: NM on 10-Sep-2010 07:39Hi,
Last night we had issue with one of the prod server where we updating one of table which contains large number records in millions.Same identical machine completed in1 hour and other box never completed but doing db file sequential read but in the long ops the last statement it was done 20:16 after that nothing is happening but i ran few trace on that user.
/u01/app/oracle/admin/SURV2/udump/surv2_ora_10048.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 18
Unix process pid: 10048, image: oracle@prdfa001
*** 2010-09-09 23:37:07.484
*** ACTION NAME:() 2010-09-09 23:37:07.473
*** MODULE NAME:(SQL*Plus) 2010-09-09 23:37:07.473
*** SERVICE NAME:(SURV2) 2010-09-09 23:37:07.473
*** SESSION ID:(289.54) 2010-09-09 23:37:07.473
Received ORADEBUG command 'unlimit' from process Unix process pid: 3983, image:
*** 2010-09-09 23:37:20.315
Received ORADEBUG command 'event 10046 trace name context forever, level 12' from process Unix process pid: 3983, image:
WAIT #7: nam='db file sequential read' ela= 11160 file#=13 block#=2252349 blocks=1 obj#=166421 tim=12499462835161
WAIT #7: nam='db file sequential read' ela= 2857 file#=13 block#=2249751 blocks=1 obj#=166421 tim=12499462838137
WAIT #7: nam='db file sequential read' ela= 3810 file#=13 block#=2251361 blocks=1 obj#=166421 tim=12499462842048
WAIT #7: nam='db file sequential read' ela= 4459 file#=13 block#=2247059 blocks=1 obj#=166421 tim=12499462846564
WAIT #7: nam='db file sequential read' ela= 2841 file#=13 block#=2247507 blocks=1 obj#=166421 tim=12499462849468
WAIT #7: nam='db file sequential read' ela= 427 file#=13 block#=2247568 blocks=1 obj#=166421 tim=12499462850032
WAIT #7: nam='db file sequential read' ela= 1187 file#=13 block#=2248264 blocks=1 obj#=166421 tim=12499462851327
WAIT #7: nam='db file sequential read' ela= 2687 file#=13 block#=2250707 blocks=1 obj#=166421 tim=12499462854178
WAIT #7: nam='db file sequential read' ela= 3657 file#=13 block#=2249697 blocks=1 obj#=166421 tim=12499462857896
WAIT #7: nam='db file sequential read' ela= 4139 file#=13 block#=2247074 blocks=1 obj#=166421 tim=12499462862093
WAIT #7: nam='db file sequential read' ela= 4180 file#=47 block#=3649690 blocks=1 obj#=166421 tim=12499509270445
WAIT #7: nam='db file sequential read' ela= 4802 file#=47 block#=3649309 blocks=1 obj#=166421 tim=12499509275327
WAIT #7: nam='db file sequential read' ela= 2459 file#=47 block#=3652697 blocks=1 obj#=166421 tim=12499509277859
WAIT #7: nam='db file sequential read' ela= 4015 file#=47 block#=3652826 blocks=1 obj#=166421 tim=12499509281948
WAIT #7: nam='db file sequential read' ela= 2248 file#=47 block#=3651610 blocks=1 obj#=166421 tim=12499509284269
WAIT #7: nam='db file sequential read' ela= 4824 file#=47 block#=3654297 blocks=1 obj#=166421 tim=12499509289166
WAIT #7: nam='db file sequential read' ela= 2008 file#=47 block#=3652312 blocks=1 obj#=166421 tim=12499509291248
WAIT #7: nam='db file sequential read' ela= 1925 file#=47 block#=3654490 blocks=1 obj#=166421 tim=12499509293246
WAIT #7: nam='db file sequential read' ela= 2859 file#=47 block#=3648458 blocks=1 obj#=166421 tim=12499509296178
WAIT #7: nam='db file sequential read' ela= 1740 file#=47 block#=3648212 blocks=1 obj#=166421 tim=12499509297991
WAIT #7: nam='db file sequential read' ela= 2566 file#=47 block#=3648411 blocks=1 obj#=166421 tim=12499509300631
WAIT #7: nam='db file sequential read' ela= 50772 file#=5 block#=480749 blocks=1 obj#=166421 tim=12499509351477
WAIT #7: nam='db file sequential read' ela= 12928 file#=5 block#=477177 blocks=1 obj#=166421 tim=12499509364482
WAIT #7: nam='db file sequential read' ela= 11116 file#=5 block#=479412 blocks=1 obj#=166421 tim=12499509375672
WAIT #7: nam='db file sequential read' ela= 4803 file#=5 block#=483440 blocks=1 obj#=166421 tim=12499509380549
WAIT #7: nam='db file sequential read' ela= 6900 file#=5 block#=481454 blocks=1 obj#=166421 tim=12499509387522
Received ORADEBUG command 'event 10046 trace name context off' from process Unix process pid: 3983, image:
/u01/app/oracle/admin/SURV2/udump/surv2_ora_1545.trc
Oracle Database 10g Release 10.2.0.4.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db
System name: SunOS
Node name: prdfa001
Release: 5.10
Version: Generic_139556-08
Machine: i86pc
Instance name: SURV2
Redo thread mounted by this instance: 1
Oracle process number: 22
Unix process pid: 1545, image: oracle@prdfa001 (TNS V1-V3)
*** ACTION NAME:() 2010-09-09 23:20:13.485
*** MODULE NAME:(sqlplus@prdfa001 (TNS V1-V3)) 2010-09-09 23:20:13.485
*** SERVICE NAME:(SYS$USERS) 2010-09-09 23:20:13.485
*** SESSION ID:(290.697) 2010-09-09 23:20:13.485
===================================================
SYSTEM STATE
System global information:
processes: base 47819b480, size 300, cleanup 4781a5638
allocation: free sessions 47f1d6148, free calls 0
control alloc errors: 0 (process), 0 (session), 0 (call)
PMON latch cleanup depth: 0
seconds since PMON's last scan for dead processes: 20
system statistics:
1171 logons cumulative
19 logons current
89219 opened cursors cumulative
86 opened cursors current
15095069 user commits
5 user rollbacks
58632904 user calls
44023255 recursive calls
224311 recursive cpu usage
201424173 session logical reads
0 session stored procedure space
901812 CPU used when call started
995437 CPU used by this session
6814196 DB time
0 cluster wait time
22542300822 concurrency wait time
3095 application wait time
16479074661 user I/O wait time
1284052668 session connect time
1284067190 process last non-idle time
189018343568 session uga memory
1249667216 session uga memory max
26059216 messages sent
26059220 messages received
239739 background timeouts
162399896 session pga memory
189662872 session pga memory max
4 enqueue timeouts
901146 enqueue waits
0 enqueue deadlocks
32122711 enqueue requests
17819 enqueue conversions
32122676 enqueue releases
0 global enqueue gets sync
0 global enqueue gets async
0 global enqueue get time
0 global enqueue releases
2865667 physical read total IO requests
262620 physical read total multi block requests
270093476864 physical read total bytes
select SYS_CONTEXT('USERENV', 'SERVER_HOST'), SYS_CONTEXT('USERENV', 'DB_UNIQUE_NAME'), SYS_CONTEXT('USERENV', 'INSTANCE_NAME'), SYS_CONTEXT('USERENV', 'SERVICE_NAME'), INSTANCE_NUMBER, STARTUP_TIME, SYS_CONTEXT('USERENV', 'DB_DOMAIN') from v$instance where INSTANCE_NAME=SYS_CONTEXT('USERENV', 'INSTANCE_NAME')
hash=550c95f3d0cfa8290e60ea8382d3a2ca timestamp=09-09-2010 04:24:19
namespace=CRSR flags=RON/KGHP/TIM/PN0/LRG/KST/DBN/MTX/[100100d1]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=9 hpc=0582 hlc=0582
lwt=47df576e8[47df576e8,47df576e8] ltm=47df576f8[47df576f8,47df576f8]
pwt=47df576b0[47df576b0,47df576b0] ptm=47df576c0[47df576c0,47df576c0]
ref=47df57718[47df57718,47df57718] lnd=47df57730[47df57730,47df57730]
LIBRARY OBJECT: object=471ee1d38
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 471ee1800 471ee1470 47df7dce0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47df7de48 471ee1e50 I/P/A/-/- 0 NONE 00
SO: 473691d60, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473691d60 handle=47bb22fa0 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=473691de0[4735dbcb8,476cfbf58] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x0
LIBRARY OBJECT HANDLE: handle=47bb22fa0 mtx=47bb230d0(0) cdp=0
namespace=CRSR flags=RON/KGHP/PN0/EXP/[10010100]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=fd84 hlc=fd84
lwt=47bb23048[47bb23048,47bb23048] ltm=47bb23058[47bb23058,47bb23058]
pwt=47bb23010[47bb23010,47bb23010] ptm=47bb23020[47bb23020,47bb23020]
ref=47bb23078[472f8de18,472f8de18] lnd=47bb23090[47bb23090,47bb23090]
LIBRARY OBJECT: object=472f8d9d8
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DEPENDENCIES: count=1 size=16
AUTHORIZATIONS: count=1 size=16 minimum entrysize=16
ACCESSES: count=1 size=16
TRANSLATIONS: count=1 size=16
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb22ee0 472f8daf0 I/P/A/-/- 0 NONE 00
6 472f8e508 46be86250 I/-/A/-/E 0 NONE 00
SO: 4735dbc38, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=4735dbc38 handle=47bb231c8 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4735dbcb8[476cfbf58,473691de0] htb=476cfbf58 ssga=476cfb6a0
user=47924e810 session=47f2310f0 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bb231c8 mtx=47bb232f8(1) cdp=1
name=select value$ from props$ where name = 'GLOBAL_DB_NAME'
hash=4bb432d65c5a391a42a5c3fa74472c7a timestamp=09-09-2010 04:24:12
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/KST/DBN/MTX/[120100d0]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=3 hpc=0584 hlc=0584
lwt=47bb23270[47bb23270,47bb23270] ltm=47bb23280[47bb23280,47bb23280]
pwt=47bb23238[47bb23238,47bb23238] ptm=47bb23248[47bb23248,47bb23248]
ref=47bb232a0[47bb232a0,47bb232a0] lnd=47bb232b8[47bb232b8,47bb232b8]
LIBRARY OBJECT: object=472f8e6e0
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
CHILDREN: size=16
child# table reference handle
0 472f8e1a8 472f8de18 47bb22fa0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bb23108 472f8e7f8 I/P/A/-/- 0 NONE 00
SO: 473644348, type: 53, owner: 47924e810, flag: INIT/-/-/0x00
LIBRARY OBJECT LOCK: lock=473644348 handle=47bbde418 mode=N
call pin=0 session pin=0 hpc=0000 hlc=0000
htl=4736443c8[476cfc0b8,476cfc0b8] htb=476cfc0b8 ssga=476cfb6a0
user=47924e810 session=47924e810 count=1 flags=[0000] savepoint=0x4c894f8b
LIBRARY OBJECT HANDLE: handle=47bbde418 mtx=47bbde548(0) cdp=0
name=ALTER SESSION SET TIME_ZONE='+02:00'
hash=3878dff8839e71e3dd05a2e75fbd6390 timestamp=09-09-2010 04:24:04
namespace=CRSR flags=RON/KGHP/TIM/PN0/SML/DBN/[12010040]
kkkk-dddd-llll=0000-0001-0001 lock=N pin=0 latch#=11 hpc=04e8 hlc=04e8
lwt=47bbde4c0[47bbde4c0,47bbde4c0] ltm=47bbde4d0[47bbde4d0,47bbde4d0]
pwt=47bbde488[47bbde488,47bbde488] ptm=47bbde498[47bbde498,47bbde498]
ref=47bbde4f0[47bbde4f0,47bbde4f0] lnd=47bbde508[47bbde508,47bbde508]
LIBRARY OBJECT: object=472fffc08
type=CRSR flags=EXS[0001] pflags=[0000] status=VALD load=0
DATA BLOCKS:
data# heap pointer status pins change whr
0 47bbde320 472fffd20 I/P/A/-/- 0 NONE 00
SO: 47aecf9e8, type: 41, owner: 47924e810, flag: INIT/-/-/0x00
(dummy) nxc=0, nlb=0
SO: 47f290540, type: 11, owner: 4781a7dc0, flag: INIT/-/-/0x00
(broadcast handle) flag: (2) ACTIVE SUBSCRIBER, owner: 4781a7dc0,
event: 1132, last message event: 1132,
last message waited event: 1132, next message: 0(0), messages read: 0
channel: (47a2df4f8) system events broadcast channel
scope: 2, event: 1132, last mesage event: 18,
publishers/subscribers: 0/17,
messages published: 1
SO: 47826b228, type: 3, owner: 4781a7dc0, flag: INIT/-/-/0x00
(call) sess: cur 47924e810, rec 0, usr 47924e810; depth: 0
SO: 476c52968, type: 16, owner: 4781a7dc0, flag: INIT/-/-/0x00
(osp req holder)
PSEUDO PROCESS for group DEFAULT:
SO: 47a1eb7d0, type: 2, owner: 0, flag: INIT/-/-/0x00
(process) Oracle pid=0, calls cur/top: 0/0, flag: (20) PSEUDO
int error: 0, call error: 0, sess error: 0, txn error 0
(post info) last post received: 0 0 0
last post received-location: No post
last process to post me: none
last post sent: 0 0 0
last post sent-location: No post
last process posted by me: none
(latch info) wait_event=0 bits=0
Process Group: DEFAULT, pseudo proc: 47a1eb7d0
O/S info: user: , term: , ospid: (DEAD)
OSD pid info: Unix process pid: 0, image: PSEUDO
Dump of memory from 0x00000004791BF538 to 0x00000004791BF740
4791BF530 00000000 00000000 [........]
4791BF540 00000000 00000000 00000000 00000000 [................]
Repeat 31 times
NO DETACHED BRANCHES.
NO DETACHED NETWORK CONNECTIONS.
CLEANUP STATE OBJECTS:
SO: 47f0cd038, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: instance enqueue anchor state
latch: 0x380009890
SO: 4782cf080, type: 5, owner: 47f0cd038, flag: INIT/-/-/0x00
(enqueue) TA-00000006-00000001 DID: 0001-000F-0000000B
lv: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 res_flag: 0x2
res: 0x47a28d020, mode: X, lock_flag: 0x0
own: 0x0, sess: 0x0, prv: 0x47a28d030
SO: 47f0cd098, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: switchable channel handle anch
latch: 0x38000ac98
SO: 47f28f868, type: 11, owner: 47f0cd098, flag: INIT/-/-/0x00
(broadcast handle) flag: (c2) ACTIVE SUBSCRIBER, owner: 0,
event: 1, last message event: 1,
last message waited event: 1, next message: 0(0), messages read: 0
channel: (47a2e4190) KPON channel
scope: 2, event: 1, last mesage event: 0,
publishers/subscribers: 0/1,
messages published: 0
SO: 47f0cd0f8, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: TT shared object cleanup SO
latch: 0x38001c6b8
SO: 47f0cd158, type: 1, owner: 0, flag: INIT/-/-/0x00
(cleanup state object) description: SS shared object cleanup SO
latch: 0x38001cd48
END OF SYSTEM STATE
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
db file sequential read 2,347,652 9,215 4 64.5 User I/O
db file scattered read 245,687 4,199 17 29.4 User I/O
CPU time 974 6.8
db file parallel write 50,082 408 8 2.9 System I/O
log file parallel write 6,963 52 7 0.4 System I/O
Time Model Statistics DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Total time in database user-calls (DB Time): 14286.4s
-> Statistics including the word "background" measure background process
time, and so do not contribute to the DB time statistic
-> Ordered by % or DB time desc, Statistic name
Statistic Name Time (s) % of DB Time
sql execute elapsed time 14,280.3 100.0
DB CPU 974.5 6.8
PL/SQL execution elapsed time 531.8 3.7
parse time elapsed 30.5 .2
hard parse elapsed time 27.1 .2
connection management call elapsed time 14.9 .1
hard parse (sharing criteria) elapsed time 3.4 .0
hard parse (bind mismatch) elapsed time 3.1 .0
PL/SQL compilation elapsed time 2.4 .0
failed parse elapsed time 0.0 .0
repeated bind elapsed time 0.0 .0
sequence load elapsed time 0.0 .0
DB time 14,286.4 N/A
background elapsed time 670.2 N/A
background cpu time 186.1 N/A
Wait Class DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc
Avg
%Time Total Wait wait Waits
Wait Class Waits -outs Time (s) (ms) /txn
User I/O 2,593,484 .0 13,415 5 150.0
System I/O 87,506 .0 515 6 5.1
Other 839 11.4 6 7 0.0
Commit 3,225 .1 6 2 0.2
Concurrency 1,033 .0 5 5 0.1
Configuration 2,514 99.4 0 0 0.1
Network 47,559 .0 0 0 2.8
Application 7 .0 0 0 0.0
Wait Events DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> s - second
-> cs - centisecond - 100th of a second
-> ms - millisecond - 1000th of a second
-> us - microsecond - 1000000th of a second
-> ordered by wait time desc, waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file sequential read 2,347,652 .0 9,215 4 135.8
db file scattered read 245,687 .0 4,199 17 14.2
db file parallel write 50,082 .0 408 8 2.9
log file parallel write 6,963 .0 52 7 0.4
control file parallel write 6,203 .0 44 7 0.4
control file sequential read 24,242 .0 11 0 1.4
log file sync 3,225 .1 6 2 0.2
latch free 84 .0 4 47 0.0
os thread startup 25 .0 3 120 0.0
latch: session allocation 39 .0 1 33 0.0
db file parallel read 12 .0 1 92 0.0
enq: TX - index contention 186 .0 1 3 0.0
latch: shared pool 47 .0 1 11 0.0
LGWR wait for redo copy 319 3.1 0 1 0.0
library cache load lock 2 .0 0 172 0.0
buffer busy waits 590 .0 0 0 0.0
log file switch completion 6 .0 0 29 0.0
SGA: allocation forcing comp 11 54.5 0 14 0.0
latch: library cache lock 50 .0 0 3 0.0
read by other session 38 .0 0 4 0.0
direct path read 42 .0 0 3 0.0
SQL*Net message to client 44,807 .0 0 0 2.6
rdbms ipc reply 207 .0 0 0 0.0
SQL*Net more data from clien 1,014 .0 0 0 0.1
latch: cache buffers chains 24 .0 0 1 0.0
latch: library cache 29 .0 0 1 0.0
log file sequential read 8 .0 0 3 0.0
direct path write 50 .0 0 0 0.0
SQL*Net more data to client 398 .0 0 0 0.0
latch: object queue header o 12 .0 0 1 0.0
latch: In memory undo latch 78 .0 0 0 0.0
undo segment extension 2,507 99.7 0 0 0.1
latch: cache buffers lru cha 4 .0 0 1 0.0
log file single write 8 .0 0 0 0.0
local write wait 3 .0 0 1 0.0
enq: RO - fast object reuse 3 .0 0 1 0.0
buffer deadlock 87 92.0 0 0 0.0
enq: JS - queue lock 1 .0 0 1 0.0
cursor: pin S 70 .0 0 0 0.0
latch: row cache objects 2 .0 0 1 0.0
SQL*Net message to dblink 1,338 .0 0 0 0.1
latch: checkpoint queue latc 2 .0 0 0 0.0
reliable message 3 .0 0 0 0.0
log buffer space 1 .0 0 1 0.0
SQL*Net break/reset to clien 4 .0 0 0 0.0
SQL*Net more data from dblin 2 .0 0 0 0.0
SQL*Net message from client 44,949 .0 155,701 3464 2.6
virtual circuit status 621 100.0 18,156 29237 0.0
Streams AQ: qmn slave idle w 664 .0 18,127 27299 0.0
Streams AQ: qmn coordinator 1,339 50.4 18,099 13517 0.1
Streams AQ: waiting for time 12 100.0 8,741 728394 0.0
jobq slave wait 130 100.0 380 2927 0.0
PL/SQL lock timer 1 100.0 1 978 0.0
SQL*Net message from dblink 1,338 .0 0 0 0.1
single-task message 1 .0 0 38 0.0
class slave wait 11 .0 0 1 0.0
SQL ordered by Elapsed Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
Elapsed CPU Elap per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
13,664 906 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
8,792 195 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
2,524 368 1 2524.1 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
1,414 177 1 1414.4 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
742 137 1 742.2 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
274 11 1 274.2 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
264 8 27 9.8 1.8 8szmwam7fysa3
Module: DBMS_SCHEDULER
insert into wri$_adv_objspace_trend_data select timepoint, space_usage, space_a
lloc, quality from table(dbms_space.object_growth_trend(:1, :2, :3, :4, NULL, N
ULL, NULL, 'FALSE', :5, 'FALSE'))
99 1 1 99.4 0.7 1z0x41f66nvjr
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTADMIN SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
21 10 1 21.5 0.2 bbc1ck8594kvj
Module: SQL*Plus
UPDATE TIBEX_INSTRUMENTDAILYHIST SET ADJOPEN=NVL(ADJOPEN,OPEN), ADJHIGH=NVL(ADJH
IGH,HIGH), ADJLOW=NVL(ADJLOW,LOW), ADJMID=NVL(ADJMID,MID), ADJCLOSE=NVL(ADJCLOSE
,CLOSE), ADJVOLUME=NVL(ADJVOLUME,VOLUME), ADJCLOSINGBID=NVL(ADJCLOSINGBID,CLOSIN
GBID), ADJCLOSINGOFFER=NVL(ADJCLOSINGOFFER,CLOSINGOFFER)
12 0 1 12.5 0.1 6xm9p9uy5kaap
Module: SQL*Plus
SELECT count(*) FROM TIBEX_INSTRUMENTSTATE WHERE INSTRUMENTID=:"SYS_B_0"
SQL ordered by CPU Time DB/Inst: SURV2/SURV2 Snaps: 19172-19178
-> Resources reported for PL/SQL code includes the resources used by all SQL
statements called by the code.
-> % Total DB Time is the Elapsed Time of the SQL statement divided
into the Total Database Time multiplied by 100
CPU Elapsed CPU per % Total
Time (s) Time (s) Executions Exec (s) DB Time SQL Id
906 13,664 0 N/A 95.6 gr2cx6athc5j5
Module: SQL*Plus
BEGIN DBMS_OUTPUT.PUT_LINE(equiduct.eod(NULL,NULL)); END;
368 2,524 1 367.51 17.7 c4uf0x6hdgnwq
Module: SQL*Plus
UPDATE TIBEX_FIXSESSIONSTATE SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"
SYS_B_1"
195 8,792 0 N/A 61.5 986fzxtzr52u5
Module: SQL*Plus
UPDATE TIBEX_ORDER SET INSTRUMENTID=:"SYS_B_0" WHERE INSTRUMENTID=:"SYS_B_1"
177 1,414 1 176.93 9.9 cbg09ma34kq8w
Module: SQL*Plus
SELECT count(*) FROM TIBEX_ORDER WHERE INSTRUMENTID=:"SYS_B_0"
137 742 1 137.38 5.2 g0sg6v994wssq
Module: SQL*Plus
SELECT count(*) FROM TIBEX_FIXSESSIONSTATE WHERE INSTRUMENTID=:"SYS_B_0"
11 274 1 10.82 1.9 6mcpb06rctk0x
Module: DBMS_SCHEDULER
call dbms_space.auto_space_advisor_job_proc ( )
10 21 1 9.65 0.2 bbc1ck8594kvjEdited by: NM on 10-Sep-2010 07:39 -
Automatic Parallelism causes Merge statement to take longer.
We have a problem in a new project as part of the ETL load into the Oracle datawarehouse we perform a merge statement to update rows in a global temporary table then load
the results into a permanant table, when testing with automatic parallel execution enabled the plan changes and the merge never finishes and consumes vast amounts of resources.
The database version is:-
Database version :11.2.0.3
OS: redhat 64bit
three node rac 20 cores per node
when executing serially the query response is typically similar to the following:
MERGE /*+ gather_plan_statistics no_parallel */ INTO T_GTTCHARGEVALUES USING
(SELECT
CASTACCOUNTID,
CHARGESCHEME,
MAX(CUMULATIVEVALUE) AS MAXMONTHVALUE,
MAX(CUMULATIVECOUNT) AS MAXMONTHCOUNT
FROM
V_CACHARGESALL
WHERE
CHARGEDATE >= TRUNC(TO_DATE(:B1,'YYYY-MM-DD'),'MM')
AND CHARGEDATE < TO_DATE(:B1,'YYYY-MM-DD')
GROUP BY
CASTACCOUNTID,
CHARGESCHEME
HAVING MAX(CUMULATIVECOUNT) IS NOT NULL ) MTOTAL
ON
(T_GTTCHARGEVALUES.CASTACCOUNTID=MTOTAL.CASTACCOUNTID AND
T_GTTCHARGEVALUES.CHARGESCHEME=MTOTAL.CHARGESCHEME)
WHEN MATCHED
THEN UPDATE SET
CUMULATIVEVALUE=CUMULATIVEVALUE+MTOTAL.MAXMONTHVALUE ,
CUMULATIVECOUNT=CUMULATIVECOUNT+MTOTAL.MAXMONTHCOUNT;
1448340 rows merged.
select * from table(dbms_xplan.display_cursor(null,null,'ALLSTATS LAST'));
| Id | Operation | Name | Starts | E-Rows | A-Rows | A-Time | Buffers | Reads | OMem | 1Mem | Used-Mem |
| 0 | MERGE STATEMENT | | 1 | | 0 |00:03:08.43 | 2095K| 186K| | | |
| 1 | MERGE | T_GTTCHARGEVALUES | 1 | | 0 |00:03:08.43 | 2095K| 186K| | | |
| 2 | VIEW | | 1 | | 1448K|00:02:53.14 | 619K| 177K| | | |
|* 3 | HASH JOIN | | 1 | 1 | 1448K|00:02:52.70 | 619K| 177K| 812K| 812K| 1218K (0)|
| 4 | VIEW | | 1 | 1 | 203 |00:02:51.26 | 608K| 177K| | | |
|* 5 | FILTER | | 1 | | 203 |00:02:51.26 | 608K| 177K| | | |
| 6 | SORT GROUP BY | | 1 | 1 | 480 |00:02:51.26 | 608K| 177K| 73728 | 73728 | |
|* 7 | FILTER | | 1 | | 21M|00:02:56.04 | 608K| 177K| | | |
| 8 | PARTITION RANGE ITERATOR| | 1 | 392K| 21M|00:02:51.32 | 608K| 177K| | | |
|* 9 | TABLE ACCESS FULL | T_CACHARGES | 24 | 392K| 21M|00:02:47.48 | 608K| 177K| | | |
| 10 | TABLE ACCESS FULL | T_GTTCHARGEVALUES | 1 | 1451K| 1451K|00:00:00.48 | 10980 | 0 | | | |
Predicate Information (identified by operation id):
3 - access("T_GTTCHARGEVALUES"."CASTACCOUNTID"="MTOTAL"."CASTACCOUNTID" AND "T_GTTCHARGEVALUES"."CHARGESCHEME"="MTOTAL"."CHARGESCHEME")
5 - filter(MAX("CUMULATIVECOUNT") IS NOT NULL)
7 - filter(TRUNC(TO_DATE(:B1,'YYYY-MM-DD'),'fmmm')<TO_DATE(:B1,'YYYY-MM-DD'))
9 - filter(("LOGICALLYDELETED"=0 AND "CHARGEDATE">=TRUNC(TO_DATE(:B1,'YYYY-MM-DD'),'fmmm') AND "CHARGEDATE"<TO_DATE(:B1,'YYYY-MM-DD')))removing the no_parallel hint results in the following, (this is pulled from the sql monitoring report and editied to remove the lines relating to individual parallel servers)
I understand that the query is considered for parallel execution due to the estimated length of time it will run for and although the degree of parallleism seems excessive
it is the default maximum for the server configuration, what we are tryig to understand is which statistics could be inacurate or missing and could cause this kind of problem.
In this case we can add the no_parallel hint in the etl package as a workaround but would really liek to identify the root cause to avoid similar problems elsewhere.
SQL Monitoring Report
SQL Text
MERGE INTO T_GTTCHARGEVALUES USING (SELECT CASTACCOUNTID, CHARGESCHEME, MAX(CUMULATIVEVALUE) AS MAXMONTHVALUE,
MAX(CUMULATIVECOUNT) AS MAXMONTHCOUNT FROM V_CACHARGESALL WHERE CHARGEDATE >= TRUNC(TO_DATE(:B1,'YYYY-MM-DD'),'MM')
AND CHARGEDATE < to_date(:B1,'YYYY-MM-DD')
GROUP BY CASTACCOUNTID, CHARGESCHEME HAVING MAX(CUMULATIVECOUNT) IS NOT NULL ) MTOTAL
ON (T_GTTCHARGEVALUES.CASTACCOUNTID=MTOTAL.CASTACCOUNTID AND
T_GTTCHARGEVALUES.CHARGESCHEME=MTOTAL.CHARGESCHEME) WHEN MATCHED THEN UPDATE SET
CUMULATIVEVALUE=CUMULATIVEVALUE+MTOTAL.MAXMONTHVALUE ,
CUMULATIVECOUNT=CUMULATIVECOUNT+MTOTAL.MAXMONTHCOUNT
Error: ORA-1013
ORA-01013: user requested cancel of current operation
Global Information
Status : DONE (ERROR)
Instance ID : 1
Session : XXXX(2815:12369)
SQL ID : 70kzttjbyyspt
SQL Execution ID : 16777216
Execution Started : 04/27/2012 09:43:27
First Refresh Time : 04/27/2012 09:43:27
Last Refresh Time : 04/27/2012 09:48:43
Duration : 316s
Module/Action : SQL*Plus/-
Service : SYS$USERS
Program : sqlplus@XXXX (TNS V1-V3)
Binds
========================================================================================================================
| Name | Position | Type | Value |
========================================================================================================================
| :B1 | 1 | VARCHAR2(32) | 2012-04-25 |
========================================================================================================================
Global Stats
====================================================================================================================
| Elapsed | Queuing | Cpu | IO | Application | Concurrency | Cluster | Other | Buffer | Read | Read |
| Time(s) | Time(s) | Time(s) | Waits(s) | Waits(s) | Waits(s) | Waits(s) | Waits(s) | Gets | Reqs | Bytes |
====================================================================================================================
| 7555 | 0.00 | 4290 | 2812 | 0.08 | 27 | 183 | 243 | 3M | 294K | 7GB |
====================================================================================================================
SQL Plan Monitoring Details (Plan Hash Value=323941584)
==========================================================================================================================================================================================================
| Id | Operation | Name | Rows | Cost | Time | Start | Execs | Rows | Read | Read | Mem | Activity | Activity Detail |
| | | | (Estim) | | Active(s) | Active | | (Actual) | Reqs | Bytes | (Max) | (%) | (# samples) |
==========================================================================================================================================================================================================
| 0 | MERGE STATEMENT | | | | | | 1 | | | | | | |
| 1 | MERGE | T_GTTCHARGEVALUES | | | | | 1 | | | | | | |
| 2 | PX COORDINATOR | | | | 57 | +1 | 481 | 0 | 317 | 5MB | | 4.05 | latch: shared pool (40) |
| | | | | | | | | | | | | | os thread startup (17) |
| | | | | | | | | | | | | | Cpu (7) |
| | | | | | | | | | | | | | DFS lock handle (36) |
| | | | | | | | | | | | | | SGA: allocation forcing component growth (14) |
| | | | | | | | | | | | | | latch: parallel query alloc buffer (200) |
| 3 | PX SEND QC (RANDOM) | :TQ10003 | 1 | 19054 | | | | | | | | | |
| 4 | VIEW | | | | | | | | | | | | |
| 5 | FILTER | | | | | | | | | | | | |
| 6 | SORT GROUP BY | | 1 | 19054 | | | | | | | | | |
| 7 | PX RECEIVE | | 1 | 19054 | | | | | | | | | |
| 8 | PX SEND HASH | :TQ10002 | 1 | 19054 | | | 240 | | | | | | |
| 9 | SORT GROUP BY | | 1 | 19054 | 246 | +70 | 240 | 0 | | | 228M | 49.32 | Cpu (3821) |
| 10 | FILTER | | | | 245 | +71 | 240 | 3G | | | | 0.08 | Cpu (6) |
| 11 | HASH JOIN | | 1 | 19054 | 259 | +57 | 240 | 3G | | | 276M | 4.31 | Cpu (334) |
| 12 | PX RECEIVE | | 1M | 5 | 259 | +57 | 240 | 1M | | | | 0.04 | Cpu (3) |
| 13 | PX SEND HASH | :TQ10000 | 1M | 5 | 6 | +56 | 240 | 1M | | | | 0.01 | Cpu (1) |
| 14 | PX BLOCK ITERATOR | | 1M | 5 | 6 | +56 | 240 | 1M | | | | 0.03 | Cpu (1) |
| | | | | | | | | | | | | | PX Deq: reap credit (1) |
| 15 | TABLE ACCESS FULL | T_GTTCHARGEVALUES | 1M | 5 | 7 | +55 | 5486 | 1M | 5487 | 86MB | | 2.31 | gc cr grant 2-way (3) |
| | | | | | | | | | | | | | gc current block lost (7) |
| | | | | | | | | | | | | | Cpu (7) |
| | | | | | | | | | | | | | db file sequential read (162) |
| 16 | PX RECEIVE | | 78M | 19047 | 255 | +61 | 240 | 801K | | | | 0.03 | IPC send completion sync (2) |
| 17 | PX SEND HASH | :TQ10001 | 78M | 19047 | 250 | +66 | 240 | 3M | | | | 0.06 | Cpu (5) |
| 18 | PX BLOCK ITERATOR | | 78M | 19047 | 250 | +66 | 240 | 4M | | | | | |
| 19 | TABLE ACCESS FULL | T_CACHARGES | 78M | 19047 | 254 | +62 | 1016 | 4M | 288K | 6GB | | 37.69 | gc buffer busy acquire (104) |
| | | | | | | | | | | | | | gc cr block 2-way (1) |
| | | | | | | | | | | | | | gc cr block lost (9) |
| | | | | | | | | | | | | | gc cr grant 2-way (14) |
| | | | | | | | | | | | | | gc cr multi block request (1) |
| | | | | | | | | | | | | | gc current block 2-way (3) |
| | | | | | | | | | | | | | gc current block 3-way (2) |
| | | | | | | | | | | | | | gc current block busy (1) |
| | | | | | | | | | | | | | gc current grant busy (2) |
| | | | | | | | | | | | | | Cpu (58) |
| | | | | | | | | | | | | | latch: gc element (1) |
| | | | | | | | | | | | | | db file parallel read (26) |
| | | | | | | | | | | | | | db file scattered read (207) |
| | | | | | | | | | | | | | db file sequential read (2433) |
| | | | | | | | | | | | | | direct path read (1) |
| | | | | | | | | | | | | | read by other session (57) |
==========================================================================================================================================================================================================
Parallel Execution Details (DOP=240 , Servers Allocated=480)
Instances : 3chris_c wrote:
| Id | Operation | Name | Starts | E-Rows | A-Rows | A-Time | Buffers | Reads | OMem | 1Mem | Used-Mem |
|* 9 | TABLE ACCESS FULL | T_CACHARGES | 24 | 392K| 21M|00:02:47.48 | 608K| 177K| | | |
Based on the discrepancy between the estimated number of rows and the actual, and the below posted bind value of 2012-04-25 i'd first be checking if the statistics on T_CACHARGES are up to date.
As a reference
http://asktom.oracle.com/pls/asktom/f?p=100:11:0::::P11_QUESTION_ID:4399338600346902127
So that would be my first avenue of exploration.
Cheers, -
Here's is the contents of v$system_event..
Is this
EVENT TOTAL_WAITS TIME_WAITED AVERAGE_WAIT
enq: TX - index contention 40564851 214701526 5.29
enq: TX - row lock contention 188846 12454614 65.95
enq: SQ - contention 141971 70568 0.5
cause for concern?
EVENT TOTAL_WAITS TIME_WAITED AVERAGE_WAIT
SQL*Net message to client 6015051449 607254 0
SQL*Net message from client 6015048542 178177969892 29.62
gcs remote message 2948555287 2633481757 0.89
CGS wait for IPC msg 1517805027 634397 0
db file sequential read 1500615188 816364485 0.54
ges remote message 1247679701 1407300224 1.13
gc cr multi block request 778432813 9913464 0.01
gc current block 2-way 747852637 38030616 0.05
db file scattered read 709428365 460939295 0.65
rdbms ipc message 708473316 37650068633 53.14
gc buffer busy acquire 671285134 1033621285 1.54
PX Deq: reap credit 667784615 484449 0
gcs log flush sync 592376026 171712257 0.29
gc cr block 2-way 530861847 19607062 0.04
library cache pin 437937120 15126237 0.03
log file sync 379523272 797193932 2.1
DIAG idle wait 359607166 2822108755 7.85
log file parallel write 351225436 259263769 0.74
LNS ASYNC end of log 350170653 1398410516 3.99
LNS wait on SENDREQ 321652621 3209301 0.01
PX qref latch 297396661 94308 0
read by other session 289140108 148440270 0.51
buffer deadlock 163505781 983055 0.01
gc current block busy 119223825 467716658 3.92
PX Deq: Table Q Normal 117332841 23574867 0.2
ksxr poll remote instances 110480324 90333 0
buffer busy waits 106938153 19933900 0.19
direct path read 93429599 108427028 1.16
SQL*Net more data from client 86471785 23026529 0.27
gc current grant busy 84978157 28215346 0.33
control file sequential read 82646297 23694583 0.29
PX Deq Credit: send blkd 78641669 9569299 0.12
latch: cache buffers chains 74218671 690277 0.01
gc current grant 2-way 72557796 1920419 0.03
library cache: mutex X 71106697 75993 0
DFS lock handle 70722498 2716407 0.04
gc cr grant 2-way 64558237 1633004 0.03
PX Deq: Execution Msg 61706261 314222076 5.09
gc cr block busy 61469863 119850802 1.95
library cache lock 52428649 3773354 0.07
PX Deq: Slave Session Stats 48040224 1886805 0.04
db file parallel read 46415188 118467902 2.55
IPC send completion sync 46250594 965101 0.02
enq: TX - index contention 40564851 214701526 5.29
PX Deq: Execute Reply 39689685 17243721 0.43
gc buffer busy release 36976909 242714774 6.56
SQL*Net more data to client 36627952 44167 0
PX Deq: Msg Fragment 30501244 343397 0.01
rdbms ipc reply 29725302 1352370 0.05
RMAN backup & recovery I/O 28824547 37722662 1.31
reliable message 27892263 3082134 0.11
PX Idle Wait 27356097 4651277341 170.03
ASM file metadata operation 25098749 8850323 0.35
gc object scan 22705857 7485 0
db file parallel write 19896252 52152606 2.62
latch: ges resource hash list 19336183 427451 0.02
enq: PS - contention 19143961 707455 0.04
PX Deq: Parse Reply 19093356 895799 0.05
gc cr disk read 17816846 448909 0.03
ASM background timer 16101806 1383957874 85.95
PX Deq: Slave Join Frag 16044789 233149 0.01
wait for unread message on broadcast channel 15056320 1413552546 93.88
cursor: mutex X 13435193 24140 0
KJC: Wait for msg sends to complete 13268497 11397 0
PX Deq: Signal ACK RSG 13214824 101941 0.01
KSV master wait 13206286 4235645 0.32
direct path read temp 12617694 5487608 0.43
PX Deq Credit: need buffer 11675868 879967 0.08
row cache lock 11536185 398216 0.03
PX Deq Credit: Session Stats 9480862 78910 0.01
SQL*Net message to dblink 9312894 1538 0
SQL*Net message from dblink 9312894 6279631 0.67
control file parallel write 7760982 11854435 1.53
pmon timer 7558889 1412576090 186.88
PX Deq: Join ACK 7548816 498931 0.07
gc current multi block request 6035173 155898 0.03
PING 5706961 1413230267 247.63
enq: XR - database force logging 4662671 198813 0.04
class slave wait 4561877 7097429006 1555.81
Streams AQ: waiting for messages in the queue 4495828 1543411682 343.3
SQL*Net more data from dblink 3696582 444575 0.12
LGWR wait for redo copy 3655353 17840 0
log file sequential read 3387305 6610414 1.95
Log archive I/O 2990486 276772 0.09
SQL*Net break/reset to client 2971976 2385935 0.8
direct path write temp 2839390 2522114 0.89
Space Manager: slave idle wait 2827526 1412987186 499.73
latch: shared pool 2808517 298150 0.11
latch: gc element 2421717 24688 0.01
SGA: MMAN sleep for component shrink 2336447 2458094 1.05
latch: enqueue hash chains 2279645 15435 0.01
latch free 2089418 78732 0.04
gc current split 2044784 1864009 0.91
PX Deq: Signal ACK EXT 1976164 19263 0.01
enq: FB - contention 1473469 61036 0.04
cursor: pin S wait on X 1313129 1464789 1.12
SQL*Net more data to dblink 1232891 986 0
Streams AQ: RAC qmn coordinator idle wait 1211300 788 0
enq: HW - contention 1175390 2077008 1.77
latch: session allocation 1167768 21883 0.02
Streams AQ: qmn coordinator idle wait 1144699 1412546634 1233.99
Streams AQ: qmn slave idle wait 1031585 2227183681 2158.99
lock deadlock retry 962937 4698 0
enq: CF - contention 956154 609647 0.64
latch: cache buffers lru chain 902764 37552 0.04
latch: object queue header operation 817911 27717 0.03
global enqueue expand wait 768633 654105 0.85
Data file init write 756191 329758 0.44
latch: gcs resource hash 647021 4147 0.01
local write wait 603007 286191 0.47
latch: row cache objects 599358 6453 0.01
ges lmd/lmses to freeze in rcfg - mrcvr 481759 156345 0.32
shared server idle wait 471190 1413238589 2999.3
enq: RF - DG Broker Current File ID 469833 23209 0.05
smon timer 432383 1411851085 3265.28
SGA: allocation forcing component growth 363333 379008 1.04
gc current retry 341104 1121252 3.29
enq: RF - synch: DG Broker metadata 319143 588290 1.84
enq: PG - contention 313659 14830 0.05
enq: TT - contention 260134 11207172 43.08
enq: KO - fast object checkpoint 236745 820808 3.47
dispatcher timer 236637 1413242481 5972.2
direct path write 231382 191008 0.83
cursor: pin S 229011 394 0
Streams AQ: waiting for time management or cleanup tasks 199981 1413148548 7066.41
enq: TX - row lock contention 188846 12454614 65.95
enq: TX - allocate ITL entry 153703 54252 0.35
enq: SQ - contention 141971 70568 0.5
ksdxexeother 141885 56 0
latch: redo allocation 138912 1858 0.01
recovery area: computing applied logs 126415 45925 0.36
gc current block congested 126318 21768 0.17
resmgr:cpu quantum 123074 151384 1.23
jobq slave wait 120678 35574221 294.79
Datapump dump file I/O 90431 9127 0.1
ges inquiry response 89402 4041 0.05
os thread startup 83809 222586 2.66
cr request retry 80062 71896 0.9
PX Deq: Table Q Sample 79665 133402 1.67
gc cr block congested 79026 14792 0.19
gc cr failure 77521 25019 0.32
enq: WF - contention 73983 825388 11.16
enq: TQ - TM contention 72871 3319 0.05
lock escalate retry 65714 1574 0.02
buffer exterminate 59775 64919 1.09
fbar timer 47136 1413183353 29980.98
log file switch completion 46911 452097 9.64
recovery area: computing obsolete files 45699 8547 0.19
enq: US - contention 40401 8805 0.22
enq: TM - contention 39149 5435032 138.83
library cache load lock 36311 382575 10.54
kjbdrmcvtq lmon drm quiesce: ping completion 31668 47443 1.5
enq: TD - KTF dump entries 31468 1424 0.05
enq: RO - fast object reuse 28422 31772 1.12
parallel recovery slave wait for change 27558 3163 0.11
name-service call wait 23694 181533 7.66
control file single write 22375 1624 0.07
kksfbc child completion 21239 106926 5.03
PX Deq: Table Q qref 19325 245 0.01
enq: TX - contention 18805 113253 6.02
latch: messages 17203 181 0.01
enq: RS - prevent file delete 16913 1013 0.06
enq: RS - prevent aging list update 15682 642 0.04
PX Deq: Table Q Get Keys 14322 42935 3
gc current grant congested 14292 2192 0.15
cursor: mutex S 13285 8 0
log file single write 13164 5371 0.41
latch: undo global data 12649 178 0.01
kksfbc research 11894 12680 1.07
parallel recovery slave idle wait 11193 5872 0.52
wait list latch free 11026 11794 1.07
enq: CT - state 11001 417 0.04
latch: checkpoint queue latch 10526 132 0.01
enq: PE - contention 10506 1139 0.11
ARCH wait on SENDREQ 9957 216480 21.74
gc cr grant congested 9465 1584 0.17
wait for scn ack 9377 3155 0.34
enq: TA - contention 8856 324 0.04
log buffer space 8777 89323 10.18
enq: TK - Auto Task Serialization 8542 343 0.04
enq: DR - contention 7842 323 0.04
process diagnostic dump 7707 2072 0.27
JOX Jit Process Sleep 7612 11286431 1482.72
enq: TC - contention 7357 340817 46.33
ges global resource directory to be frozen 7140 12299 1.72
enq: CO - master slave det 6850 312 0.05
enq: JS - job run lock - synchronize 6704 397 0.06
gcs drm freeze in enter server mode 6542 40742 6.23
enq: TS - contention 5959 89332 14.99
ARCH wait for archivelog lock 5600 36 0.01
PX Nsq: PQ load info query 5377 104798 19.49
db file single write 5373 3452 0.64
gc remaster 5315 50625 9.52
latch: parallel query alloc buffer 4939 1906 0.39
enq: TO - contention 4799 143 0.03
enq: AF - task serialization 4395 161 0.04
enq: PI - contention 4251 163 0.04
ges2 LMON to wake up LMD - mrcvr 4210 28 0.01
enq: DL - contention 3889 239 0.06
kjctssqmg: quick message send wait 3408 22 0.01
LNS wait on DETACH 3275 741 0.23
ksfd: async disk IO 3274 1 0
LNS wait on ATTACH 3273 51940 15.87
ARCH wait on DETACH 3231 714 0.22
ARCH wait on ATTACH 3226 43238 13.4
enq: BR - file shrink 2787 116 0.04
write complete waits 2631 1070 0.41
enq: MD - contention 2596 67 0.03
enq: WL - contention 2198 266518 121.25
single-task message 2098 25896 12.34
enq: OD - Serializing DDLs 2054 66 0.03
resmgr:internal state change 2001 14735 7.36
ARCH wait on c/f tx acquire 2 1751 175230 100.07
enq: WR - contention 1636 69 0.04
latch: cache buffer handles 1610 29 0.02
statement suspended, wait error to be cleared 1497 22626 15.11
Streams AQ: qmn coordinator waiting for slave to start 1214 678966 559.28
enq: PD - contention 1182 33 0.03
JS kgl get object wait 1096 4922 4.49
undo segment extension 1070 10065 9.41
PL/SQL lock timer 949 8739819 9209.5
enq: AE - lock 937 28 0.03
LGWR-LNS wait on channel 832 913 1.1
ges DFS hang analysis phase 2 acks 816 495 0.61
latch: redo writing 729 9 0.01
gc quiesce 665 564 0.85
enq: JS - queue lock 482 2111 4.38
PX Deq: Test for credit 442 13 0.03
enq: SS - contention 386 274 0.71
recovery area: computing dropped files 328 1400 4.27
recovery area: computing backed up files 328 496 1.51
ksdxexeotherwait 279 10592 37.97
log switch/archive 250 137570 550.28
gc domain validation 223 39964 179.21
auto-sqltune: wait graph update 195 96514 494.95
wait for a undo record 170 1214 7.14
parallel recovery coord send blocked 168 4 0.02
enq: JS - wdw op 168 3741 22.27
enq: KT - contention 165 5 0.03
switch logfile command 156 6290 40.32
gcs resource directory to be unfrozen 149 12839 86.17
Data Guard Broker Wait 139 10906 78.46
enq: SK - contention 129 4 0.03
enq: JS - job recov lock 128 4 0.03
gc cr block lost 125 6772 54.17
virtual circuit wait 122 3 0.03
ges LMON to get to FTDONE 100 187 1.87
enq: CU - contention 80 242 3.02
enq: JQ - contention 78 7 0.09
cursor: pin X 73 83 1.14
parallel recovery coord wait for reply 70 510 7.29
PX Deq: Txn Recovery Start 67 3436 51.29
SQL*Net break/reset to dblink 60 0 0
gc current block lost 57 2869 50.33
ges LMD suspend for testing event 51 709 13.89
inactive session 46 4550 98.91
recovery read 45 5 0.11
JS kill job wait 41 3548 86.53
enq: AS - service activation 40 1 0.03
enq: TL - contention 35 2 0.05
enq: UL - contention 34 524 15.42
gcs enter server mode 33 1559 47.24
wait for stopper event to be increased 30 218 7.27
enq: TQ - DDL contention 24 300 12.52
enq: MR - contention 21 1 0.03
ges reconfiguration to start 20 54 2.72
ges enter server mode 20 502 25.08
buffer latch 18 1337 74.26
enq: SR - contention 18 1 0.05
Streams: RAC waiting for inter instance ack 18 3748 208.21
enq: PR - contention 17 46 2.72
kupp process wait 16 166 10.39
checkpoint completed 15 3678 245.19
PX Deque wait 14 68 4.87
enq: BF - allocation contention 14 1 0.08
enq: XL - fault extent map 14 51 3.66
enq: FU - contention 14 17 1.18
enq: TH - metric threshold evaluation 13 114 8.78
enq: MW - contention 12 0 0.04
enq: DD - contention 10 0 0.04
process terminate 8 41 5.08
ges cgs registration 8 151 18.9
buffer resize 7 0 0
ktm: instance recovery 7 698 99.66
LNS wait on LGWR 6 0 0
ASM background starting 6 381 63.43
gc cr block 3-way 5 0 0.08
enq: PV - syncstart 5 9 1.74
Global transaction acquire instance locks 4 4 1.09
enq: RS - read alert level 4 0 0.04
LGWR wait on LNS 3 0 0
gc recovery 3 540 179.85
Streams AQ: enqueue blocked on low memory 3 544 181.2
DBWR range invalidation sync 3 17 5.83
enq: DM - contention 3 0 0.03
enq: RF - FSFO Observer Heartbeat 3 0 0.03
enq: JS - q mem clnup lck 3 0 0
DG Broker configuration file I/O 2 0 0
enq: RC - Result Cache: Contention 2 493 246.6
enq: KM - contention 2 0 0.03
enq: RT - contention 2 0 0.04
instance state change 2 0 0.12
kkdlgon 2 10 5.11
enq: TQ - INI contention 2 292 146.07
enq: JS - contention 2 0 0
ARCH wait for netserver start 1 400 400.02
log file switch (checkpoint incomplete) 1 3 3.44
JS coord start wait 1 50 50.09
ges lmd and pmon to attach 1 1 1.26
wait for tmc2 to complete 1 3 3.03
control file heartbeat 1 400 400.02
enq: SW - contention 1 0 0.04
enq: PW - perwarm status in dbw0 1 0 0.09
enq: FS - contention 1 0 0.04
enq: XR - quiesce database 1 0 0.04
enq: RS - write alert level 1 0 0.02
enq: CN - race with init 1 0 0.03
enq: FE - contention 1 4 3.77
Wait for shrink lock2 1 10 10.03
enq: IA - contention 1 0 0.02
enq: RF - atomicity 1 0 0.05
enq: RF - synchronization: aifo master 1 0 0.02
enq: RF - RF - Database Automatic Disable 1 0 0.06
enq: WP - contention 1 0 0.02
enq: TB - SQL Tuning Base Cache Load 1 0 0.05
enq: JS - evt notify 1 0 0.02Edited by: steffi on Mar 20, 2011 12:21 AM
Edited by: steffi on Mar 20, 2011 8:18 AM
Edited by: steffi on Mar 20, 2011 8:19 AMText can be formatted by tagging the beginning and end of the block of text with the code ta
\Formatted text goes here.
\Example:
This is formatted.When cutting and pasting text such as execution plans, excerpts from AWR reports, etc, it will maintain spacing and formatting, and make for much easier reading.
As to the content, well, dumping the contents of v$system_event is pretty close to useless.
As to the first three events you listed, 'enq: TX - index contention', 'enq: TX - row lock contention', 'enq: SQ - contention', well, all of those are easily tunable.
First, for 'enq: SQ - contention', check your sequences. Do you have any NOCACHE sequences? Or sequences with small caches?
As for 'enq: TX - row lock contention', well that's fairly self-explanatory. You have multiple sessions trying to lock the same row in the same table at the same time.
Last, 'enq: TX - index contention', that's non-row level contention on an index. For example, if you have a unique index, insert a row w/ column value 1, but don't commit, then try to insert that same value from another session.
But, before you do any of that, I think you need to clearly understand where the bottlenecks are. Try taking some AWR snapshots, about 5 minutes apart, when you're having performance problems. Look at the AWR report for that 5 minute period. In particular, look at your Top 5 timed events.
Hope that helps,
-Mark -
Hi,
I have one quick question regarding the SGA_TARGET parameter.
This is my sga allocation so far:
Total System Global Area 2147483648 bytes
Fixed Size 2140320 bytes
Variable Size 2124240736 bytes
Database Buffers 16777216 bytes
Redo Buffers 4325376 bytes
My RAM size is 16GB and i would be creating many other applications as well. now i have the following sga parameters:
SQL> sho parameter sga;
NAME TYPE VALUE
lock_sga boolean FALSE
pre_page_sga boolean FALSE
sga_max_size big integer 2G
sga_target big integer 0
Now my worry is the sga_target i want to make use but i have given old parameters as well and i am getting the error
Error: ORA-00381 (ORA-381)
Text: cannot use both new and old parameters for buffer cache size
specification
now my db* parameter settings are:
SQL> sho parameter db;
NAME TYPE VALUE
db_16k_cache_size big integer 0
db_2k_cache_size big integer 0
db_32k_cache_size big integer 0
db_4k_cache_size big integer 0
db_8k_cache_size big integer 0
db_block_buffers integer 2048
db_block_checking string FALSE
db_block_checksum string TRUE
db_block_size integer 8192
db_cache_advice string ON
db_cache_size big integer 0
NAME TYPE VALUE
db_create_file_dest string
db_create_online_log_dest_1 string
db_create_online_log_dest_2 string
db_create_online_log_dest_3 string
db_create_online_log_dest_4 string
db_create_online_log_dest_5 string
db_domain string PFIZER.COM
db_file_multiblock_read_count integer 16
db_file_name_convert string
db_files integer 1024
db_flashback_retention_target integer 1440
NAME TYPE VALUE
db_keep_cache_size big integer 0
db_name string EAMS01
db_recovery_file_dest string
db_recovery_file_dest_size big integer 0
db_recycle_cache_size big integer 0
db_unique_name string EAMS01
db_writer_processes integer 2
dbwr_io_slaves integer 0
rdbms_server_dn string
standby_archive_dest string ?/dbs/arch
standby_file_management string MANUAL
and my init parameters are:
EAMS01.__streams_pool_size=33554432
*._allow_level_without_connect_by=TRUE
*.aq_tm_processes=1
*.ARCHIVE_LAG_TARGET=900
*.audit_file_dest='/u03/oracle/admin/EAMS01/adump'
*.audit_trail='TRUE'
*.background_dump_dest='/u03/oracle/admin/EAMS01/bdump'
*.control_files='/u04/oradata/EAMS01/control01.ctl','/u04/oradata/EAMS01/control02.ctl','/u04/oradata/EAMS01/control03.ctl'
*.core_dump_dest='/u03/oracle/admin/EAMS01/cdump'
*.db_block_buffers=550# SMALL
*.db_domain='PFIZER.COM'
*.db_file_multiblock_read_count=16# SMALL
*.db_files=1024# SMALL
*.db_name='EAMS01'
*.global_names=TRUE
*.java_pool_size=96M
*.job_queue_processes=15
*.large_pool_size=32M
*.log_archive_dest='/u04/arch/EAMS01'
*.log_archive_format='EAMS01_%t_%s_%r.arc'
*.log_archive_max_processes=5
*.log_checkpoint_interval=10000
*.log_checkpoints_to_alert=TRUE
*.max_dump_file_size='10240'# limit trace file size to 5 Meg each
*.NLS_DATE_FORMAT='YYYY-MM-DD'
*.nls_length_semantics='CHAR'
*.NLS_TERRITORY='AMERICA'
*.open_cursors=768
*.open_links=128
*.open_links_per_instance=128
*.optimizer_features_enable='10.2.0.3'
*.parallel_max_servers=5# SMALL
*.pga_aggregate_target=500M
*.processes=512# SMALL
*.query_rewrite_enabled='TRUE'
*.query_rewrite_integrity='STALE_TOLERATED'
*.remote_login_passwordfile='EXCLUSIVE'
*.resource_limit=TRUE
*.service_names='EAMS01.pfizer.com'
*.sga_max_size=2G
*.shared_pool_size=500000000# SMALL
*.streams_pool_size=33554432
*.timed_statistics=TRUE
*.undo_management='AUTO'
*.user_dump_dest='/u03/oracle/admin/EAMS01/udump'
now what the parameters i am missing or need to edit sga_target so that oralce will use empirically over
time. Thank you.
-- Raman.Hi..
>
# symptom: ORA-00381: cannot use both new and old parameters for buffer cache size specification
# cause: Both db_block_buffers and db_cache_size parameters are defined in the init.ora (instance parameter file). The db_block_buffers parameter has been deprecated and has been maintained only for backward compatibility. The db_cache_size parameter is one of the size parameters which defines the size of the cache for buffers. These parameters cannot be combined. Setting this along with the Dynamic SGA parameters errors out.
>
For sga_target refer to [http://download.oracle.com/docs/cd/B19306_01/server.102/b14237/initparams193.htm#REFRN10256]
which quotes
>
SGA_TARGET specifies the total size of all SGA components. If SGA_TARGET is specified, then the following memory pools are automatically sized:
*Buffer cache (DB_CACHE_SIZE)
* Shared pool (SHARED_POOL_SIZE)
* Large pool (LARGE_POOL_SIZE)
* Java pool (JAVA_POOL_SIZE)
* Streams pool (STREAMS_POOL_SIZE)
If these automatically tuned memory pools are set to non-zero values, then those values are used as minimum levels by Automatic Shared Memory Management. You would set minimum values if an application component needs a minimum amount of memory to function properly.
>
So, the what ever the value are set for the parameter will act as minimum value when sga_target is set.
HTH
Anand -
JDBC, SQL*Net wait interface, performance degradation on 10g vs. 9i
Hi All,
I came across performance issue that I think results from mis-configuration of something between Oracle and JDBC. The logic of my system executes 12 threads in java. Each thread performs simple 'select a,b,c...f from table_xyz' on different tables. (so I have 12 different tables with cardinality from 3 to 48 millions and one working thread per table).
In each thread I'm creating result set that is explicitly marked as forward_only, transaction is set read only, fetch size is set to 100000 records. Java logic processes records in standard while(rs.next()) {...} loop.
I'm experiencing performance degradation between execution on Oracle 9i and Oracle 10g of the same java code, on the same machine, on the same data. The difference is enormous, 9i execution takes 26 hours while 10g execution takes 39 hours.
I have collected statspack for 9i and awr report for 10g. Below I've enclosed top wait events for 9i and 10g
===== 9i ===================
Avg
Total Wait wait Waits
Event Waits Timeouts Time (s) (ms) /txn
db file sequential read 22,939,988 0 6,240 0 0.7
control file parallel write 6,152 0 296 48 0.0
SQL*Net more data to client 2,877,154 0 280 0 0.1
db file scattered read 26,842 0 91 3 0.0
log file parallel write 3,528 0 83 23 0.0
latch free 94,845 0 50 1 0.0
process startup 93 0 5 50 0.0
log file sync 34 0 2 46 0.0
log file switch completion 2 0 0 215 0.0
db file single write 9 0 0 33 0.0
control file sequential read 4,912 0 0 0 0.0
wait list latch free 15 0 0 12 0.0
LGWR wait for redo copy 84 0 0 1 0.0
log file single write 2 0 0 18 0.0
async disk IO 263 0 0 0 0.0
direct path read 2,058 0 0 0 0.0
slave TJ process wait 1 1 0 12 0.0
===== 10g ==================
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file scattered read 268,314 .0 2,776 10 0.0
SQL*Net message to client 278,082,276 .0 813 0 7.1
io done 20,715 .0 457 22 0.0
control file parallel write 10,971 .0 336 31 0.0
db file parallel write 15,904 .0 294 18 0.0
db file sequential read 66,266 .0 257 4 0.0
log file parallel write 3,510 .0 145 41 0.0
SQL*Net more data to client 2,221,521 .0 102 0 0.1
SGA: allocation forcing comp 2,489 99.9 27 11 0.0
log file sync 564 .0 23 41 0.0
os thread startup 176 4.0 19 106 0.0
latch: shared pool 372 .0 11 29 0.0
latch: library cache 537 .0 5 10 0.0
rdbms ipc reply 57 .0 3 49 0.0
log file switch completion 5 40.0 3 552 0.0
latch free 4,141 .0 2 0 0.0
I put full blame for the slowdown on SQL*Net message to client wait event. All I could find about this event is that it is a network related problem. I assume it would be true if database and client were on different machines.. However in my case they are on them very same machine.
I'd be very very grateful if someone could point me in the right direction, i.e. give a hint what statistics should I analyze further? what might cause this event to appear? why probable cause (that is said be outside db) affects only 10g instance?
Thanks in advance,
Rafi.Hi Steven,
Thanks for the input. It's a fact that I did not gather statistics on my tables. My understanding is that statistics are useful for queries more complex than simple select * from table_xxx. In my case tables don't have indexes. There's no filtering condition as well. Full table scan is what I actually want as all software logic is inside the java code.
Explain plans are as follows:
======= 10g ================================
PLAN_TABLE_OUTPUT
Plan hash value: 1141003974
| Id | Operation | Name | Rows | Bytes | Cost (%CPU)| Time |
| 0 | SELECT STATEMENT | | 1 | 259 | 2 (0)| 00:00:01 |
| 1 | TABLE ACCESS FULL| xxx | 1 | 259 | 2 (0)| 00:00:01 |
In sqlplus I get:
SQL> set autotrace traceonly explain statistics;
SQL> select * from xxx;
36184384 rows selected.
Elapsed: 00:38:44.35
Execution Plan
Plan hash value: 1141003974
| Id | Operation | Name | Rows | Bytes | Cost (%CPU)| Time |
| 0 | SELECT STATEMENT | | 1 | 259 | 2 (0)| 00:00:01 |
| 1 | TABLE ACCESS FULL| xxx | 1 | 259 | 2 (0)| 00:00:01 |
Statistics
1 recursive calls
0 db block gets
3339240 consistent gets
981517 physical reads
116 redo size
26535700 bytes received via SQL*Net from client
2412294 SQL*Net roundtrips to/from client
0 sorts (memory)
0 sorts (disk)
36184384 rows processed
======= 9i =================================
PLAN_TABLE_OUTPUT
| Id | Operation | Name | Rows | Bytes | Cost |
| 0 | SELECT STATEMENT | | | | |
| 1 | TABLE ACCESS FULL | xxx | | | |
Note: rule based optimization
In sqlplus I get:
SQL> set autotrace traceonly explain statistics;
SQL> select * from xxx;
36184384 rows selected.
Elapsed: 00:17:43.06
Execution Plan
0 SELECT STATEMENT Optimizer=CHOOSE
1 0 TABLE ACCESS (FULL) OF 'xxx'
Statistics
0 recursive calls
1 db block gets
3306118 consistent gets
957515 physical reads
100 redo size
23659424 bytes sent via SQL*Net to client
26535867 bytes received via SQL*Net from client
2412294 SQL*Net roundtrips to/from client
0 sorts (memory)
0 sorts (disk)
36184384 rows processed
Thanks for pointing me difference in table scans. I infer that 9i is doing single-block full table scan (db file sequential read) while 10g is using multi-block full table scan (db file scattered read).
I now have theory that 9i is faster because sequential reads use continuous buffer space while scattered reads use discontinuous buffer space. Since I'm accessing data 'row by row' in jdbc 10g might have an overhead in providing data from discontinuous buffer space. This overhead shows itself as SQL*Net message to client wait. Is that making any sense?
Is there any way I could force 10g (i.e. with hint) to use sequential reads instead of scattered reads for full table scan?
I'll experiment with FTS tuning in 10g by enabling automatic multi-block reads tuning (i.e. db_file_multiblock_read_count=0 instead of 32 as it is now). I'll also check if response time improves after statistics are gathered.
Please advice if you have any other ideas.
Thanks & regards,
Rafi. -
Hi All,
using 10gR2 on Sun-Solaris. Getting consistently "db file parallel read" over 35 ms as an average wait for the past few months. No performance issues as such.
Using RAID 1+0. DB Size is 2 TB. Transactions are OLTP/Batch
Is this metric high or normal. How to justify that..
Please advise. Statspack excerpt as below;
Database DB Id Instance Inst Num Startup Time Release RAC
~~~~~~~~ ----------- ------------ -------- --------------- ----------- ---
817713220 jdedb 1 20-Jan-13 12:04 10.2.0.4.0 NO
Host Name: AVIJDEDB Num CPUs: 32 Phys Memory (MB): 32,047
~~~~
Snapshot Snap Id Snap Time Sessions Curs/Sess Comment
~~~~~~~~ ---------- ------------------ -------- --------- -------------------
Begin Snap: 1112 04-Feb-13 11:00:03 542 21.8
End Snap: 1113 04-Feb-13 12:00:05 551 22.0
Elapsed: 60.03 (mins)
Cache Sizes Begin End
~~~~~~~~~~~ ---------- ----------
Buffer Cache: 20,960M 21,008M Std Block Size: 8K
Shared Pool Size: 1,424M 1,376M Log Buffer: 13,909K
Load Profile Per Second Per Transaction
~~~~~~~~~~~~ --------------- ---------------
Redo size: 63,672.15 3,896.95
Logical reads: 22,421.78 1,372.29
Block changes: 237.54 14.54
Physical reads: 8,628.59 528.10
Physical writes: 58.18 3.56
User calls: 1,438.67 88.05
Parses: 363.68 22.26
Hard parses: 0.71 0.04
Sorts: 111.80 6.84
Logons: 0.32 0.02
Executes: 904.41 55.35
Transactions: 16.34
% Blocks changed per Read: 1.06 Recursive Call %: 14.04
Rollback per transaction %: 2.36 Rows per Sort: 25.35
Instance Efficiency Percentages
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 61.53 In-memory Sort %: 100.00
Library Hit %: 99.77 Soft Parse %: 99.80
Execute to Parse %: 59.79 Latch Hit %: 99.99
Parse CPU to Parse Elapsd %: 90.27 % Non-Parse CPU: 99.05
Shared Pool Statistics Begin End
Memory Usage %: 52.21 52.29
% SQL with executions>1: 85.63 87.51
% Memory for SQL w/exec>1: 82.23 86.58
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time
CPU time 8,073 61.6
db file sequential read 764,853 2,671 3 20.4
db file scattered read 487,789 1,661 3 12.7
db file parallel read 8,823 333 38 2.5
direct path write temp 5,478 91 17 .7
Host CPU (CPUs: 32)
~~~~~~~~ Load Average
Begin End User System Idle WIO WCPU
2.65 2.25 6.25 2.87 90.88 0.00 0.38
Instance CPU
~~~~~~~~~~~~
% of total CPU for Instance: 7.11
% of busy CPU for Instance: 77.95
%DB time waiting for CPU - Resource Mgr:
Memory Statistics Begin End
~~~~~~~~~~~~~~~~~ ------------ ------------
Host Mem (MB): 32,046.5 32,046.5
SGA use (MB): 22,528.0 22,528.0
PGA use (MB): 1,473.7 1,334.7
% Host Mem used for SGA+PGA: 74.9 74.5
Time Model System Stats -> Ordered by % of DB time desc, Statistic name
Statistic Time (s) % of DB time
sql execute elapsed time 7,939.4 90.8
DB CPU 5,811.5 66.4
parse time elapsed 183.9 2.1
hard parse elapsed time 109.4 1.3
connection management call elapsed 10.7 .1
PL/SQL execution elapsed time 4.2 .0
repeated bind elapsed time 2.0 .0
hard parse (sharing criteria) elaps 0.4 .0
PL/SQL compilation elapsed time 0.1 .0
hard parse (bind mismatch) elapsed 0.1 .0
sequence load elapsed time 0.0 .0
failed parse elapsed time 0.0 .0
DB time 8,746.6
background elapsed time 2,621.5
background cpu time 2,381.4
Wait Events
-> s - second, cs - centisecond, ms - millisecond, us - microsecond
-> %Timeouts: value of 0 indicates value was < .5%. Value of null is truly 0
-> Only events with Total Wait Time (s) >= .001 are shown
-> ordered by Total Wait Time desc, Waits desc (idle events last)
Avg
%Time Total Wait wait Waits
Event Waits -outs Time (s) (ms) /txn
db file sequential read 764,853 0 2,671 3 13.0
db file scattered read 487,789 0 1,661 3 8.3
db file parallel read 8,823 0 333 38 0.1
direct path write temp 5,478 0 91 17 0.1
SQL*Net more data to client 1,324,395 0 82 0 22.5
log file sync 57,449 0 67 1 1.0
log file parallel write 59,434 0 61 1 1.0
db file parallel write 19,065 0 27 1 0.3
direct path read 9,621 0 16 2 0.2
os thread startup 49 0 5 103 0.0
control file parallel write 1,706 0 3 2 0.0
control file sequential read 4,935 0 1 0 0.1
read by other session 691 0 1 2 0.0
direct path write 2,523 0 1 0 0.0
direct path read temp 1,218 0 1 0 0.0
cursor: pin S wait on X 32 100 0 10 0.0
SGA: MMAN sleep for component shr 87 8 0 3 0.0
SQL*Net break/reset to client 1,064 0 0 0 0.0
SGA: allocation forcing component 12 83 0 10 0.0
latch free 17 0 0 7 0.0
rdbms ipc reply 4 0 0 11 0.0
LGWR wait for redo copy 228 0 0 0 0.0
enq: HW - contention 4 0 0 4 0.0
latch: cache buffers lru chain 12 0 0 1 0.0
latch: shared pool 2 0 0 3 0.0
undo segment extension 403 100 0 0 0.0
buffer busy waits 36 0 0 0 0.0
enq: TX - row lock contention 2 0 0 1 0.0
SQL*Net message from client 5,041,043 0 1,604,869 318 85.7
Streams AQ: qmn slave idle wait 382 0 7,003 18332 0.0
virtual circuit status 121 100 3,540 29258 0.0
wait for unread message on broadc 3,599 100 3,514 976 0.1
Streams AQ: waiting for messages 720 100 3,513 4880 0.0
Streams AQ: qmn coordinator idle 259 50 3,501 13518 0.0
jobq slave wait 1,167 99 3,402 2916 0.0
Streams AQ: waiting for time mana 14 100 3,077 ###### 0.0
SQL*Net more data from client 185,834 0 15 0 3.2
SQL*Net message to client 5,041,055 0 10 0 85.7
------------------------------------------------------------->
>
using 10gR2 on Sun-Solaris. Getting consistently "db file parallel read" over 35 ms as an average wait for the past few months. No performance issues as such.
Using RAID 1+0. DB Size is 2 TB. Transactions are OLTP/Batch
Is this metric high or normal. How to justify that..
Looking at your results it's not really possible to say.
db file parallel read is a request for a number of randomly distirbuted blocks, and the time for a read is the time for the last block of the set to be returned.
Without knowing how many blocks are being requested at a time you can't really determine what constitutes a reasonable time. Given that you say OLTP + Batch, and have a large volume of scattered reads, it's quite possible that you have some queries on the Batch side doing very large index range scans - which would allow for some very large db file parallel reads.
I take it from the use of statspack that you're not licensed for the diagnostic and performance packs; it would be easy to query v$active_session_history to get some idea of the number of blocks per request as this is given by the P2 parameter. As it is. you may be able to get a rough idea by messing about with the various "physical read" numbers in the Instance Activity section of statspack.
Regards
Jonathan Lewis -
Oracle stream not working as Logminer is down
Hi,
Oracle streams capture process is not capturing any updates made on table for which capture & apply process are configured.
Capture process & apply process are running fine showing enabled as status & no error. But, No new records are captured in ‘streams_queue_table’ when I update record in table, which is configured for capturing changes.
This setup was working till I got ‘ORA-01341: LogMiner out-of-memory’ error in alert.log file. I guess logminer is not capturing the updates from redo log.
Current Alert log is showing following lines for logminer init process
LOGMINER: Parameters summary for session# = 1
LOGMINER: Number of processes = 3, Transaction Chunk Size = 1
LOGMINER: Memory Size = 10M, Checkpoint interval = 10M
But same log was like this before
LOGMINER: Parameters summary for session# = 1
LOGMINER: Number of processes = 3, Transaction Chunk Size = 1
LOGMINER: Memory Size = 10M, Checkpoint interval = 10M
LOGMINER: session# = 1, reader process P002 started with pid=18 OS id=5812
LOGMINER: session# = 1, builder process P003 started with pid=36 OS id=3304
LOGMINER: session# = 1, preparer process P004 started with pid=37 OS id=1496We can clearly see reader, builder & preparer process are not starting after I got Out of memory exception in log miner.
To allocate more space to logminer, I tried to setup tablespace to logminer I got 2 exception which was contradicting each other error.
SQL> exec DBMS_LOGMNR.END_LOGMNR();
BEGIN DBMS_LOGMNR.END_LOGMNR(); END;
*ERROR at line 1:
ORA-01307: no LogMiner session is currently activeORA-06512: at "SYS.DBMS_LOGMNR", line 76
ORA-06512: at line 1
SQL> EXECUTE DBMS_LOGMNR_D.SET_TABLESPACE('logmnrts');
BEGIN DBMS_LOGMNR_D.SET_TABLESPACE('logmnrts'); END;
*ERROR at line 1:
ORA-01356: active logminer sessions foundORA-06512: at "SYS.DBMS_LOGMNR_D", line 232
ORA-06512: at line 1
When I tried stopping logminer exception was ‘no logminer session is active’, But when I tried to setup tablespace exception was ‘active logminer sessions found’. I am not sure how to resolve this issue.
Please let me know how to resolve this issue.
Thanks
sivaThe Logminer session associated with a capture process is a special kind of session which is called a "persistent session". You will not be able to stop it using DBMS_LOGMNR. This package controls only non-persistent sessions.
To stop the persistent LogMiner session you must stop the capture process.
However, I think your problem is more related to a lack of RAM space instead of tablespace (i. e, disk) space. Try to increase the size of the SGA allocated to LogMiner, by setting capture parameter SGASIZE. I can see you are using the default of 10M, which may be not enough for your case. Of course, you will have to increase the values of init parameters streams_pool_size, sga_target/sga_max_size accordingly, to avoid other memory problems.
To set the SGASIZE parameter, use the PL/SQL procedure DBMS_CAPTURE_ADM.SET_PARAMETER. The example below would set it to 100Megs:
begin
DBMS_CAPTURE_ADM.set_parameter('<name of capture process','_SGA_SIZE','100');
end;
I hope this helps.
Ilidio. -
Hi,
DB Version :10.2.0.3.0
OS :Windows Vista
I am getting error ORA_01092, even thouh I shutdown the database with "shutdown immediate mode". When I am trying start the database SGA allocation is happening and database is getting mounted and Giving the mentioned error. I had checked the alert log file and trace file, Looks problem with background processes.
I cannot send/attach the alert log,trace file since it is in my laptop and does not have net connection.
Thnaks,
TippuHi ,
Please find the alert log information ..
DB version :10.2.0.3.0
OS :Windows Vista (32 bit)
Error when starting the DB :
C:\>sqlplus /nolog
SQL*Plus: Release 10.2.0.3.0 - Production on Mon Dec 21 23:31:37 2009
Copyright (c) 1982, 2006, Oracle. All Rights Reserved.
SQL> connect sys as sysdba
Enter password:
Connected to an idle instance.
SQL> startup
ORACLE instance started.
Total System Global Area 293601280 bytes
Fixed Size 1290208 bytes
Variable Size 276824096 bytes
Database Buffers 8388608 bytes
Redo Buffers 7098368 bytes
Database mounted.
ORA-01092: ORACLE instance terminated. Disconnection forced
SQL>
alert log file
Instance terminated by USER, pid = 4960
ORA-1092 signalled during: alter database open...
Dump file c:\oracle\product\10.2.0\admin\acumen\bdump\alert_acumen.log
Mon Dec 21 20:54:01 2009
ORACLE V10.2.0.3.0 - Production vsnsta=0
vsnsql=14 vsnxtr=3
Windows NT Version V6.0 Service Pack 2
CPU : 2 - type 586, 2 Physical Cores
Process Affinity : 0x00000000
Memory (Avail/Total): Ph:1907M/3069M, Ph+PgF:5297M/6340M, VA:1917M/2047M
Mon Dec 21 20:54:01 2009
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 2
Using LOG_ARCHIVE_DEST_10 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =18
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.3.0.
System parameters with non-default values:
processes = 150
__shared_pool_size = 268435456
__large_pool_size = 4194304
__java_pool_size = 4194304
__streams_pool_size = 0
sga_target = 293601280
control_files = C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\CONTROL01.CTL, C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\CONTROL02.CTL, C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\CONTROL03.CTL
db_block_size = 8192
__db_cache_size = 8388608
compatible = 10.2.0.3.0
db_file_multiblock_read_count= 16
db_recovery_file_dest = C:\oracle\product\10.2.0\flash_recovery_area
db_recovery_file_dest_size= 2147483648
undo_management = AUTO
undo_tablespace = UNDOTBS1
remote_login_passwordfile= EXCLUSIVE
db_domain =
dispatchers = (PROTOCOL=TCP) (SERVICE=acumenXDB)
job_queue_processes = 10
audit_file_dest = C:\ORACLE\PRODUCT\10.2.0\ADMIN\ACUMEN\ADUMP
background_dump_dest = C:\ORACLE\PRODUCT\10.2.0\ADMIN\ACUMEN\BDUMP
user_dump_dest = C:\ORACLE\PRODUCT\10.2.0\ADMIN\ACUMEN\UDUMP
core_dump_dest = C:\ORACLE\PRODUCT\10.2.0\ADMIN\ACUMEN\CDUMP
db_name = acumen
open_cursors = 300
pga_aggregate_target = 96468992
Mon Dec 21 20:54:02 2009
WARNING:Shared I/O Pool created with size=0 set size=0
PMON started with pid=2, OS id=2652
PSP0 started with pid=3, OS id=2700
MMAN started with pid=4, OS id=2704
DBW0 started with pid=5, OS id=2708
LGWR started with pid=6, OS id=2720
CKPT started with pid=7, OS id=2724
SMON started with pid=8, OS id=2736
RECO started with pid=9, OS id=2740
CJQ0 started with pid=10, OS id=2780
MMON started with pid=11, OS id=2816
MMNL started with pid=12, OS id=2880
Mon Dec 21 20:54:02 2009
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
starting up 1 shared server(s) ...
Mon Dec 21 20:54:03 2009
alter database mount exclusive
Mon Dec 21 20:54:07 2009
Setting recovery target incarnation to 2
Mon Dec 21 20:54:07 2009
Successful mount of redo thread 1, with mount id 2842687595
Mon Dec 21 20:54:07 2009
Database mounted in Exclusive Mode
Completed: alter database mount exclusive
Mon Dec 21 20:54:07 2009
alter database open
Mon Dec 21 20:54:07 2009
Beginning crash recovery of 1 threads
parallel recovery started with 2 processes
Mon Dec 21 20:54:07 2009
Started redo scan
Mon Dec 21 20:54:08 2009
Completed redo scan
19 redo blocks read, 15 data blocks need recovery
Mon Dec 21 20:54:08 2009
Started redo application at
Thread 1: logseq 72, block 63
Mon Dec 21 20:54:08 2009
Recovery of Online Redo Log: Thread 1 Group 2 Seq 72 Reading mem 0
Mem# 0: C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\REDO02.LOG
Mon Dec 21 20:54:08 2009
Completed redo application
Mon Dec 21 20:54:08 2009
Completed crash recovery at
Thread 1: logseq 72, block 82, scn 1994102
15 data blocks read, 15 data blocks written, 19 redo blocks read
Mon Dec 21 20:54:08 2009
Thread 1 advanced to log sequence 73
Thread 1 opened at log sequence 73
Current log# 3 seq# 73 mem# 0: C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\REDO03.LOG
Successful open of redo thread 1
Mon Dec 21 20:54:08 2009
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Mon Dec 21 20:54:08 2009
SMON: enabling cache recovery
Mon Dec 21 20:54:09 2009
Successfully onlined Undo Tablespace 1.
Mon Dec 21 20:54:09 2009
SMON: enabling tx recovery
Mon Dec 21 20:54:09 2009
Database Characterset is WE8MSWIN1252
replication_dependency_tracking turned off (no async multimaster replication found)
Mon Dec 21 20:54:11 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_3036.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8F49990], [], [], [], [], [], []
Mon Dec 21 20:54:14 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_3036.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8F49990], [], [], [], [], [], []
Mon Dec 21 20:54:16 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_3036.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8F49990], [], [], [], [], [], []
Starting background process QMNC
QMNC started with pid=18, OS id=2452
Mon Dec 21 20:54:17 2009
Error 0 in kwqmnpartition(), aborting txn
Error 0 in kwqmnpartition-update_aqs_instance, aborting txn
Mon Dec 21 20:54:18 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_3036.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8FC3E90], [], [], [], [], [], []
Mon Dec 21 20:54:20 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_3036.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8FE936C], [], [], [], [], [], []
Mon Dec 21 20:54:23 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_3036.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8FE936C], [], [], [], [], [], []
Error 600 happened during db open, shutting down database
USER: terminating instance due to error 600
Mon Dec 21 20:54:23 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_dbw0_2708.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 20:54:23 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_p000_3600.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 20:54:23 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_pmon_2652.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 20:54:23 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_p001_3604.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 20:54:25 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_reco_2740.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 20:54:25 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_smon_2736.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 20:54:25 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_ckpt_2724.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 20:54:25 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_lgwr_2720.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 20:54:25 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_mman_2704.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 20:54:26 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_psp0_2700.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Instance terminated by USER, pid = 3036
ORA-1092 signalled during: alter database open...
Dump file c:\oracle\product\10.2.0\admin\acumen\bdump\alert_acumen.log
Mon Dec 21 22:40:21 2009
ORACLE V10.2.0.3.0 - Production vsnsta=0
vsnsql=14 vsnxtr=3
Windows NT Version V6.0 Service Pack 2
CPU : 2 - type 586, 2 Physical Cores
Process Affinity : 0x00000000
Memory (Avail/Total): Ph:1894M/3069M, Ph+PgF:5285M/6340M, VA:1917M/2047M
Mon Dec 21 22:40:21 2009
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 2
Using LOG_ARCHIVE_DEST_10 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =18
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.3.0.
System parameters with non-default values:
processes = 150
__shared_pool_size = 268435456
__large_pool_size = 4194304
__java_pool_size = 4194304
__streams_pool_size = 0
sga_target = 293601280
control_files = C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\CONTROL01.CTL, C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\CONTROL02.CTL, C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\CONTROL03.CTL
db_block_size = 8192
__db_cache_size = 8388608
compatible = 10.2.0.3.0
db_file_multiblock_read_count= 16
db_recovery_file_dest = C:\oracle\product\10.2.0\flash_recovery_area
db_recovery_file_dest_size= 2147483648
undo_management = AUTO
undo_tablespace = UNDOTBS1
remote_login_passwordfile= EXCLUSIVE
db_domain =
dispatchers = (PROTOCOL=TCP) (SERVICE=acumenXDB)
job_queue_processes = 10
audit_file_dest = C:\ORACLE\PRODUCT\10.2.0\ADMIN\ACUMEN\ADUMP
background_dump_dest = C:\ORACLE\PRODUCT\10.2.0\ADMIN\ACUMEN\BDUMP
user_dump_dest = C:\ORACLE\PRODUCT\10.2.0\ADMIN\ACUMEN\UDUMP
core_dump_dest = C:\ORACLE\PRODUCT\10.2.0\ADMIN\ACUMEN\CDUMP
db_name = acumen
open_cursors = 300
pga_aggregate_target = 96468992
Mon Dec 21 22:40:22 2009
WARNING:Shared I/O Pool created with size=0 set size=0
PMON started with pid=2, OS id=2752
PSP0 started with pid=3, OS id=2816
MMAN started with pid=4, OS id=2824
DBW0 started with pid=5, OS id=2836
LGWR started with pid=6, OS id=2864
CKPT started with pid=7, OS id=2880
SMON started with pid=8, OS id=2884
RECO started with pid=9, OS id=2900
CJQ0 started with pid=10, OS id=2912
MMON started with pid=11, OS id=2916
Mon Dec 21 22:40:23 2009
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=12, OS id=2920
Mon Dec 21 22:40:23 2009
starting up 1 shared server(s) ...
Mon Dec 21 22:40:23 2009
alter database mount exclusive
Mon Dec 21 22:40:27 2009
Setting recovery target incarnation to 2
Mon Dec 21 22:40:28 2009
Successful mount of redo thread 1, with mount id 2842735447
Mon Dec 21 22:40:28 2009
Database mounted in Exclusive Mode
Completed: alter database mount exclusive
Mon Dec 21 22:40:28 2009
alter database open
Mon Dec 21 22:40:28 2009
Beginning crash recovery of 1 threads
parallel recovery started with 2 processes
Mon Dec 21 22:40:28 2009
Started redo scan
Mon Dec 21 22:40:28 2009
Completed redo scan
48 redo blocks read, 19 data blocks need recovery
Mon Dec 21 22:40:28 2009
Started redo application at
Thread 1: logseq 73, block 32
Mon Dec 21 22:40:28 2009
Recovery of Online Redo Log: Thread 1 Group 3 Seq 73 Reading mem 0
Mem# 0: C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\REDO03.LOG
Mon Dec 21 22:40:28 2009
Completed redo application
Mon Dec 21 22:40:29 2009
Completed crash recovery at
Thread 1: logseq 73, block 80, scn 2014191
19 data blocks read, 19 data blocks written, 48 redo blocks read
Mon Dec 21 22:40:29 2009
Thread 1 advanced to log sequence 74
Thread 1 opened at log sequence 74
Current log# 1 seq# 74 mem# 0: C:\ORACLE\PRODUCT\10.2.0\ORADATA\ACUMEN\REDO01.LOG
Successful open of redo thread 1
Mon Dec 21 22:40:29 2009
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Mon Dec 21 22:40:29 2009
SMON: enabling cache recovery
Mon Dec 21 22:40:30 2009
Successfully onlined Undo Tablespace 1.
Mon Dec 21 22:40:30 2009
SMON: enabling tx recovery
Mon Dec 21 22:40:30 2009
Database Characterset is WE8MSWIN1252
replication_dependency_tracking turned off (no async multimaster replication found)
Mon Dec 21 22:40:32 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_2968.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8F39990], [], [], [], [], [], []
Mon Dec 21 22:40:35 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_2968.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8F39990], [], [], [], [], [], []
Mon Dec 21 22:40:36 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_2968.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8F39990], [], [], [], [], [], []
Starting background process QMNC
QMNC started with pid=18, OS id=3868
Mon Dec 21 22:40:37 2009
Error 0 in kwqmnpartition(), aborting txn
Error 0 in kwqmnpartition-update_aqs_instance, aborting txn
Mon Dec 21 22:40:38 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_2968.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8FB3E90], [], [], [], [], [], []
Mon Dec 21 22:40:39 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_2968.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8FD9188], [], [], [], [], [], []
Mon Dec 21 22:40:40 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\udump\acumen_ora_2968.trc:
ORA-00600: internal error code, arguments: [kksfbc-reparse-infinite-loop], [0x8FD9188], [], [], [], [], [], []
Error 600 happened during db open, shutting down database
USER: terminating instance due to error 600
Mon Dec 21 22:40:40 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_pmon_2752.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 22:40:40 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_p001_3692.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 22:40:40 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_p000_3688.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 22:40:40 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_psp0_2816.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 22:40:40 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_lgwr_2864.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 22:40:40 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_mman_2824.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 22:40:41 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_ckpt_2880.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 22:40:41 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_dbw0_2836.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 22:40:41 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_reco_2900.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Mon Dec 21 22:40:41 2009
Errors in file c:\oracle\product\10.2.0\admin\acumen\bdump\acumen_smon_2884.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Instance terminated by USER, pid = 2968
ORA-1092 signalled during: alter database open...
Maybe you are looking for
-
I have a column of consecutive dates that span multiple months. A second column list the day name for the date. How do I find every 3rd Friday of any month? I'd like to have it display some text in a 3rd column next to the particular Friday. If th
-
After upgrading memory Ovolab Phlink no longer working
Mac Mini as server running OS 10.5.8. I just put in 1 GB of new memory in my server (Mac Mini) so now it has two modules one 256 and one 1GB. Nothing else changed. Since doing that Ovolab Phlink (is my 'answering machine' programme) stopped working.
-
Query Help: Report of BPs and creation user
Hi, Which field in the ACRD table contains the user who created the BP? I am trying to create a list of BPs and which users created them Thanks Greig
-
Table cells for imported picture of invoice
Hello, I have watermark picture of invoice with fields. I have to align table cells with fields in the picture. I have problem that on the left side fields are different positioned than on the right side. When I want to move border of cell, all line
-
Hi All, Does anyone know if tethered shooting works with the Nikon D7000 in Lightroom 3.3? If not, is it already announced when? Thanks