Automatic instance getting down with ORA-600

ORA-00600: internal error code, arguments: [6006], [1], [], [], [], [], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [ktspfredo-setstate-1], [0], [1], [16], [], [], [], [], [], [], [], []
help me start the instance to stable state@

These errors indicate a detected corruption when trying to apply undo/redo information, probably during instance recovery. [6006] is for an index, [ktspfredo-setstate-1] for a LOB (related bug: #11790175). The trace file should include more information though in the cryptic form of a diagnostic block/undo/redo dump.
Back up the current state of the database (to be able to restart the whole recovery process). Then, if you have a valid older backup, try restoring from that backup. If you have no backup, it may be difficult to recover. If you have a support contract, Oracle Support will probably be able to help. It is not possible to effectively help with recovery of a corrupted database in a community forum.
Thanks,
Sergiusz

Similar Messages

ASM instance getting down

While production database is operational, ASM instance gets down out of sudden.
The error reflecting in alert log is :
ORA-15064: communication failure with ASM instance
ORA-03113: end-of-file on communication channel
Also in trace files the same error is reflecting. I am unable to find the root cause why the ASM instance getting down again n again .
Kindly help !
Thanks !!

I thought about more input. But well: Check for errors in the clusterware logs next. And check your system logs.
Any tracefiles created by the ASM instance?
A note: You´re on 10.2.0.2.0. Thats way too old. The current version is 10.2.0.4.0. I STRONGLY recommend to upgrade your clusterware and ASM to that version. If you need for some reason you can leave your database on 10.2.0.2.0.
Ronny Egner
My Blog: http://blog.ronnyegner-consulting.de

DB was down with ora-7445

Hi,
oracle 9.2.0.8
os:solaris
one of my (OLAP) prod DB was down with ora-7445.can any one please help.
thanks ,
Sam.

sam995972 wrote:
log info:
Thu Apr 3 16 00:42:54 2013
ARCH: Completed archiving log 3 thread 1 sequence 135381
Thu Apr 3 16 00:43:03 2013
Completed checkpoint up to RBA [0x210d6.2.10], SCN: 0x09f8.7497c3b
Completed checkpoint up to RBA [0x210d5.2.10], SCN: 0x09f8.7497c35
Completed checkpoint up to RBA [0x210d4.2.10], SCN: 0x09f8.747b09d
Thu Apr 3 16 00:52:01 2013
Errors in file /ora/admin/JP00DP/udump/JP00DP_ora_16715.trc:
ORA-07445: exception encountered: core dump [0000000101CA36F8] [SIGBUS] [Invalid address alignment] [0xA9875D0008000B] [] []
Thu Apr 3 16 00:52:06 2013
Errors in file /ora/admin/JP00DP/bdump/JP00DP_pmon_17895.trc:
ORA-07445: exception encountered: core dump [0000000101CA33F8] [SIGBUS] [Invalid address alignment] [0xA9875D0008000B] [] []
Thu Apr 3 16 00:52:06 2013
Errors in file /ora/admin/JP00DP/bdump/JP00DP_pmon_17895.trc:
ORA-07445: exception encountered: core dump [0000000101E55984] [SIGBUS] [Invalid address alignment] [0xA9875D0008000B] [] []
ORA-00602: internal programming exception
ORA-07445: exception encountered: core dump [0000000101CA33F8] [SIGBUS] [Invalid address alignment] [0xA9875D0008000B] [] []
Thu Apr 3 16 00:52:11 2013according to above info it is a BUG.
if you have extended support plz contact support.oracle.com

11.2.0.2, MRP gets cancled with ORA-16037

Hello.
I'm testing ADG in 11.2.0.2 release on RHEL to check if important (for us) bugs are actually fixed.
So im trying to set up a dataguard configuration with two hosts. The problem is that managed recovery on standby gets canceled in about 1-3 minutes claiming that its user who issued the command (which is not true)
If there is something to recover (some archived logs) - MRP recovers them succesfully waits for short time and then cancels.
I tried different options - recover ... noparallel, with and witout SRLs - it behaves the same way and I dont understand the reason why it cancels.
So I did log_archive_trace=4096 and here is an exerpt from mrp's trace file -
MRP: Reading thread 1 seq 35 bno 8161 min 0
RTA boundary:[thr=1 seq=35 bno=8161];MRP read:[thr=1 seq35 bno=8161 blks_to_read=196640]
..reducing blks_to_read from 196640 -> 0. Reason:[RTA block# <= MRP block#]
MRP: entering loop for logical end of file [thr=1 seq=35 bno=8161 min=0]
*** 2010-10-02 21:34:11.170 11453 krr.c
MRP: Reading thread 1 seq 35 bno 8161 min 0
RTA boundary:[thr=1 seq=35 bno=8161];MRP read:[thr=1 seq35 bno=8161 blks_to_read=196640]
..reducing blks_to_read from 196640 -> 0. Reason:[RTA block# <= MRP block#]
MRP: entering loop for logical end of file [thr=1 seq=35 bno=8161 min=0]
MRP: Reading control file to determine SRL completion for [thr=1,seq=35]
Checking completion of thread 1 seq 35 lno 10
MRP RTA: rhp_seq 35 seq 35 rhp_thr 1 thr 1 le_seq 35 le_lot 731362796 rhp_rlc 731342665 rlc 731342665
RTA Re-read SRL header thread 1 seq 35 lno 10. Found NAB -1 LOS 0:810072 NXS 65535:-1
.. SRL valid
RTA boundary:[thr=1 seq=35 bno=8161];MRP read:[thr=1 seq35 bno=8161 blks_to_read=196640]
..reducing blks_to_read from 196640 -> 0. Reason:[RTA block# <= MRP block#]
RTA boundary:[thr=1 seq=35 bno=8161];MRP read:[thr=1 seq35 bno=8161 blks_to_read=196640]
..reducing blks_to_read from 196640 -> 0. Reason:[RTA block# <= MRP block#]
RTA boundary:[thr=1 seq=35 bno=8161];MRP read:[thr=1 seq35 bno=8161 blks_to_read=2048]
..reducing blks_to_read from 2048 -> 0. Reason:[RTA block# <= MRP block#]
RTA boundary:[thr=1 seq=35 bno=8161];MRP read:[thr=1 seq35 bno=8161 blks_to_read=2048]
..reducing blks_to_read from 2048 -> 0. Reason:[RTA block# <= MRP block#]
*** 2010-10-02 21:34:11.173 12280 krr.c
MRP: LAG_TIMING: sleeping and waiting to be posted or for timeout
*** 2010-10-02 21:34:11.880
*** 2010-10-02 21:34:11.880 12293 krr.c
MRP: LAG_TIMING: RTA woke up due to <Post>
*** 2010-10-02 21:34:11.881 4265 krsh.c
MRP0: Background Media Recovery cancelled with status 16037
ORA-16037: user requested cancel of managed recovery operation
MRP: Disabling Real Time Apply due to end media recovery
*** 2010-10-02 21:34:11.881 12701 krsm.c
Managed Standby Real Time Apply Update Call [opcode=7, var1=1, var2=0, var3=0]
*** 2010-10-02 21:34:11.881 4265 krsh.c
Managed Standby Recovery not using Real Time Apply
krst_get_appstats: apply rate is 0, timestamp is 10/02/2010 21:35:15
MRP: Prodding archiver at standby for thread 1 seq 35
----- Redo read statistics for thread 1 -----
Read rate (ASYNC): 1278Kb in 14.70s => 0.08 Mb/sec
Total redo bytes: 1278Kb Longest record: 1Kb, moves: 0/1382 moved: 0Mb (0%)
Longest LWN: 69Kb, reads: 1969
Last redo scn: 0x0000.000c7181 (815489)
Change vector header moves = 187/2292 (8%)
*** 2010-10-02 21:34:11.896
Media Recovery drop redo thread 1
KCBR: Number of read descriptors = 1024
KCBR: Media recovery blocks read (ASYNC) = 69
KCBR: Influx buffers flushed = 16 times
KCBR: Reads = 2 reaps (1 null, 0 wait), 1 all
KCBR: Redo cache copies/changes = 912/912
*** 2010-10-02 21:34:11.896
Completed Media Recovery
Checking to start in-flux buffer recovery from SCN 0.813293 to SCN (non-inclusive) 0.815490
Managed Recovery: Not Active posted.
*** 2010-10-02 21:34:11.972 4265 krsh.c
MRP0: Background Media Recovery process shutdown
In alert.log it states that database is opened in RO mode after that (I didnt ask for that) -
ALTER SYSTEM SET log_archive_trace=4096 SCOPE=BOTH;
ALTER DATABASE RECOVER managed standby database using current logfile disconnect from session noparallel
All dispatchers and shared servers shutdown
CLOSE: killing server sessions.
CLOSE: all sessions shutdown successfully.
Sat Oct 02 21:33:52 2010
SMON: disabling cache recovery
Attempt to start background Managed Standby Recovery process (test1)
Sat Oct 02 21:33:52 2010
MRP0 started with pid=19, OS id=15235
MRP0: Background Managed Standby Recovery process started (test1)
Serial Media Recovery started
Managed Standby Recovery starting Real Time Apply
Waiting for all non-current ORLs to be archived...
All non-current ORLs have been archived.
Clearing online redo logfile 1 /oradata/redo1.log
Clearing online log 1 of thread 1 sequence number 21
Clearing online redo logfile 1 complete
Clearing online redo logfile 2 /oradata/redo2.log
Clearing online log 2 of thread 1 sequence number 33
Clearing online redo logfile 2 complete
Clearing online redo logfile 3 /oradata/redo3.log
Clearing online log 3 of thread 1 sequence number 33
Clearing online redo logfile 3 complete
Clearing online redo logfile 4 /oradata/redo4.log
Clearing online log 4 of thread 1 sequence number 35
Clearing online redo logfile 4 complete
Clearing online redo logfile 5 /oradata/redo5.log
Clearing online log 5 of thread 1 sequence number 35
Clearing online redo logfile 5 complete
Media Recovery Waiting for thread 1 sequence 35 (in transit)
Recovery of Online Redo Log: Thread 1 Group 10 Seq 35 Reading mem 0
Mem# 0: /oradata/TEST1/onlinelog/o1_mf_10_6bg8hhll_.log
Completed: ALTER DATABASE RECOVER managed standby database using current logfile disconnect from session noparallel
Sat Oct 02 21:34:11 2010
alter database recover managed standby database cancel
Sat Oct 02 21:34:11 2010
MRP0: Background Media Recovery cancelled with status 16037
Errors in file /opt/oracle/diag/rdbms/test1_mdb120b/test1/trace/test1_mrp0_15235.trc:
ORA-16037: user requested cancel of managed recovery operation
Managed Standby Recovery not using Real Time Apply
Recovery interrupted!
Recovered data files to a consistent state at change 815490
MRP0: Background Media Recovery process shutdown (test1)
Managed Standby Recovery Canceled (test1)
Completed: alter database recover managed standby database cancel
Sat Oct 02 21:34:12 2010
alter database open read only
Sat Oct 02 21:34:13 2010

Sorry, I cant reproduce it now because I reistalled rdbms software on primary, rebuilt the standby and now it works as expected.
I'm not sure about the exactly startup sequence, maybe I indeed started my standby instance without mount or nomount options directly up to open mode.
But afterwards I closed instance explicitly with "alter database close" (it produced a warning that it's not a publicly supported command) and issued "recover managed standby database ..." command as i did with old 10g databases.
And after a while MRP process canceled itself and instance opened in RO mode automatically.
Maybe open is that thing that implicitly caused MRP to cancel, so I need to find out who opened my standby database while I wanted it to remain closed and recovering.
I have an exerpt of the alert.log from that standby -
Sat Oct 02 19:28:02 2010
alter database close <--- I did it manually
Warning: ALTER DATABASE CLOSE is not a publicly supported command.
All dispatchers and shared servers shutdown
CLOSE: killing server sessions.
CLOSE: all sessions shutdown successfully.
Sat Oct 02 19:28:02 2010
SMON: disabling cache recovery
Completed: alter database close
Sat Oct 02 19:28:39 2010
ALTER DATABASE RECOVER managed standby database using current logfile disconnect from session <--- and this command too
Attempt to start background Managed Standby Recovery process (test1)
Sat Oct 02 19:28:39 2010
MRP0 started with pid=29, OS id=2815
MRP0: Background Managed Standby Recovery process started (test1)
started logmerger process
Sat Oct 02 19:28:44 2010
Managed Standby Recovery starting Real Time Apply
Parallel Media Recovery started with 16 slaves
Waiting for all non-current ORLs to be archived...
All non-current ORLs have been archived.
Clearing online redo logfile 1 /oradata/redo1.log
Process [pid 2815] clearing log 1
Clearing online log 1 of thread 1 sequence number 21
Clearing online redo logfile 1 complete
Clearing online redo logfile 2 /oradata/redo2.log
Process [pid 2815] clearing log 2
Clearing online log 2 of thread 1 sequence number 12
Clearing online redo logfile 2 complete
Clearing online redo logfile 3 /oradata/redo3.log
Process [pid 2815] clearing log 3
Clearing online log 3 of thread 1 sequence number 13
Clearing online redo logfile 3 complete
Clearing online redo logfile 4 /oradata/redo4.log
Process [pid 2815] clearing log 4
Clearing online log 4 of thread 1 sequence number 14
Clearing online redo logfile 4 complete
Clearing online redo logfile 5 /oradata/redo5.log
Process [pid 2815] clearing log 5
Clearing online log 5 of thread 1 sequence number 21
Clearing online redo logfile 5 complete
Recovery of Online Redo Log: Thread 1 Group 10 Seq 21 Reading mem 0
Mem# 0: /oradata/TEST1/onlinelog/o1_mf_10_6bg8hhll_.log
Completed: ALTER DATABASE RECOVER managed standby database using current logfile disconnect from session
Sat Oct 02 19:28:50 2010
alter database open <---- no idea who opened my standby db
ORA-10456 signalled during: alter database open...
alter database open
ORA-10456 signalled during: alter database open...
Sat Oct 02 19:29:05 2010
idle dispatcher 'D000' terminated, pid = (20, 5)
Sat Oct 02 19:29:12 2010
alter database recover managed standby database cancel <---- so it's got canceled because of open, right?
Sat Oct 02 19:29:12 2010
MRP0: Background Media Recovery cancelled with status 16037
Errors in file /opt/oracle/diag/rdbms/test1_mdb120b/test1/trace/test1_pr00_2817.trc:
ORA-16037: user requested cancel of managed recovery operation
Managed Standby Recovery not using Real Time Apply
Recovery interrupted!
Sat Oct 02 19:29:12 2010
MRP0: Background Media Recovery process shutdown (test1)
Managed Standby Recovery Canceled (test1)
Completed: alter database recover managed standby database cancel
Sat Oct 02 19:29:13 2010
alter database open read only

Whether instance gets down due to insufficient memory ?

hi,
11g R2 (Linux)
Other day one of the 3 nodes got evicted due to insufficient memory
Err message is
ORA-04031: unable to allocate 4136 bytes of shared memory ("shared pool","unknown object","sga heap(3,0)","gcs dynamic r")"
"LMS0 (ospid: 8489): terminating the instance due to error 4031"
Thanks

Hi, Have you configured memory_target or memory_max_target? If so then it may supersede depending on values set. Please post all memory parameters set and based on that we can answer. Also let us know the OS since in Linux there is a concept of tempfs which also limits the maximum memory to be allocated. While in solaris there is concept of project, which limits max memory per oracle instance depending on OS user.
Regards
Tushar

ORA-600 with HTMLDB 1.6

Hi guys,
I meet OERI again.
Symptoms:
When I change any page element (i.e region - I need to change region source from txt to html) I've got ORA-600.
In HTMLDB it look like this:
ERR-1029 Unable to store session info. session=7510900237229644713 item=3469326686
Return to application. ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
In background dump file:
Errors in file /export/home/OraHome1/admin/SUN92/udump/sun92_ora_972.trc:
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
Mon Jan 17 17:35:12 2005
Errors in file /export/home/OraHome1/admin/SUN92/udump/sun92_ora_978.trc:
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
Mon Jan 17 17:35:54 2005
Errors in file /export/home/OraHome1/admin/SUN92/udump/sun92_ora_988.trc:
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
Mon Jan 17 17:36:37 2005
Errors in file /export/home/OraHome1/admin/SUN92/udump/sun92_ora_1010.trc:
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
Mon Jan 17 17:38:07 2005
Errors in file /export/home/OraHome1/admin/SUN92/udump/sun92_ora_1064.trc:
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
Mon Jan 17 17:40:15 2005
Errors in file /export/home/OraHome1/admin/SUN92/udump/sun92_ora_1066.trc:
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
Mon Jan 17 17:41:25 2005
Peace of one of reference UDUMP files:
/export/home/OraHome1/admin/SUN92/udump/sun92_ora_972.trc
Oracle9i Enterprise Edition Release 9.2.0.6.0 - 64bit Production
With the Partitioning and Oracle Label Security options
JServer Release 9.2.0.6.0 - Production
ORACLE_HOME = /export/home/OraHome1/app/oracle/product/9.2.0
System name: SunOS
Node name: blade
Release: 5.9
Version: Generic_112233-11
Machine: sun4u
Instance name: SUN92
Redo thread mounted by this instance: 1
Oracle process number: 12
Unix process pid: 972, image: oracle@blade (TNS V1-V3)
*** SESSION ID:(12.692) 2005-01-17 17:34:48.672
*** 2005-01-17 17:34:48.671
ksedmp: internal or fatal error
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
Current SQL statement for this session:
INSERT INTO WWV_FLOW_DATA ( FLOW_INSTANCE, ITEM_ID, ITEM_ELEMENT_ID, ITEM_NAME, ITEM_VALUE, SESSION_STATE_STATUS, FLOW_ID ) VALUES ( :B6 , :B5 , :B4 , :B3 , :B2 , 'I', :B1 )
----- PL/SQL Call Stack -----
object line object
handle number name
39786c0e8 810 package body FLOWS_010600.WWV_FLOW
39786c0e8 4573 package body FLOWS_010600.WWV_FLOW
39786c0e8 10074 package body FLOWS_010600.WWV_FLOW
39aa6f690 8 anonymous block
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
ksedmp()+328 CALL ksedst() 00000000B ? 000000000 ?
000000000 ? 00000004A ?
FFFFFFFF7FFF2C58 ?
102F5EFF8 ?
kgerinv()+184 PTR_CALL 0000000000000000 000103349 ? 103349000 ?
103349BA8 ? 10334E000 ?
It not first incident with ORA-600 after upgrade HTMLDB on our local site.
Whats wrong?

SMON: enabling tx recovery
Wed Jan 26 15:31:05 2005
Database Characterset is CL8MSWIN1251
replication_dependency_tracking turned off (no async multimaster replication found)
Completed: ALTER DATABASE OPEN
Wed Jan 26 15:33:06 2005
Errors in file /export/home/OraHome1/admin/SUN92/udump/sun92_ora_1207.trc:
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
ORA-00001: unique constraint (FLOWS_010600.WWV_FLOW_DATA_IDX1) violated
/export/home/OraHome1/admin/SUN92/udump/sun92_ora_1207.trc
Oracle9i Enterprise Edition Release 9.2.0.6.0 - 64bit Production
With the Partitioning and Oracle Label Security options
JServer Release 9.2.0.6.0 - Production
ORACLE_HOME = /export/home/OraHome1/app/oracle/product/9.2.0
System name: SunOS
Node name: blade
Release: 5.9
Version: Generic_112233-11
Machine: sun4u
Instance name: SUN92
Redo thread mounted by this instance: 1
Oracle process number: 12
Unix process pid: 1207, image: oracle@blade (TNS V1-V3)
*** SESSION ID:(9.19) 2005-01-26 15:33:06.290
*** 2005-01-26 15:33:06.290
ksedmp: internal or fatal error
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
ORA-00001: unique constraint (FLOWS_010600.WWV_FLOW_DATA_IDX1) violated
Current SQL statement for this session:
UPDATE WWV_FLOW_DATA SET ITEM_VALUE = :B4 , SESSION_STATE_STATUS = DECODE(SESSION_STATE_STATUS,'R','I','U') WHERE FLOW_INSTANCE = :B3 AND ITEM_ELEMENT_ID = :B2 AND ITEM_ID = :B1
----- PL/SQL Call Stack -----
object line object
handle number name
3979f8a70 836 package body FLOWS_010600.WWV_FLOW
3979f8a70 4573 package body FLOWS_010600.WWV_FLOW
3979f8a70 10074 package body FLOWS_010600.WWV_FLOW
397aa79f0 8 anonymous block
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
ksedmp()+328 CALL ksedst() 00000000B ? 000000000 ?
000000000 ? 00000004A ?
FFFFFFFF7FFF2C58 ?
102F5EFF8 ?
kgerinv()+184 PTR_CALL 0000000000000000 000103349 ? 103349000 ?
103349BA8 ? 10334E000 ?
000102800 ? 000000000 ?
kgeasnmierr()+28 CALL kgerinv() 103349E08 ? 10344B650 ?
0000013C8 ? 000000000 ?
10334BF14 ? 10334B1D8 ?
*** SESSION ID:(24.5784) 2005-01-24 22:10:39.442
*** 2005-01-24 22:10:39.441
ksedmp: internal or fatal error
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
Current SQL statement for this session:
INSERT INTO WWV_FLOW_DATA ( FLOW_INSTANCE, ITEM_ID, ITEM_ELEMENT_ID, ITEM_NAME, ITEM_VALUE, SESSION_STATE_STATUS, FLOW_ID ) VALUES ( :B6 , :B5 , :B4 , :B3 , :B2 , 'I', :B1 )
----- PL/SQL Call Stack -----
object line object
handle number name
3990a5318 810 package body FLOWS_010600.WWV_FLOW
3990a5318 4573 package body FLOWS_010600.WWV_FLOW
3990a5318 10074 package body FLOWS_010600.WWV_FLOW
39f8b51d0 8 anonymous block
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
ksedmp()+328 CALL ksedst() 00000000B ? 000000000 ?
000000000 ? 00000004A ?
FFFFFFFF7FFF2C58 ?
102F5EFF8 ?
kgerinv()+184 PTR_CALL 0000000000000000 000103349 ? 103349000 ?
*** SESSION ID:(13.1360) 2005-01-26 15:25:05.977
*** 2005-01-26 15:25:05.977
ksedmp: internal or fatal error
ORA-00600: internal error code, arguments: [kpoblblen: pos1], [], [], [], [], [], [], []
Current SQL statement for this session:
INSERT INTO WWV_FLOW_DATA ( FLOW_INSTANCE, ITEM_ID, ITEM_ELEMENT_ID, ITEM_NAME, ITEM_VALUE, SESSION_STATE_STATUS, FLOW_ID ) VALUES ( :B6 , :B5 , :B4 , :B3 , :B2 , 'I', :B1 )
----- PL/SQL Call Stack -----
object line object
handle number name
397958a68 810 package body FLOWS_010600.WWV_FLOW
397958a68 4573 package body FLOWS_010600.WWV_FLOW
397958a68 10074 package body FLOWS_010600.WWV_FLOW
399aa3960 8 anonymous block
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
ksedmp()+328 CALL ksedst() 00000000B ? 000000000 ?
000000000 ? 00000004A ?
FFFFFFFF7FFF2C58 ?
102F5EFF8 ?
kgerinv()+184 PTR_CALL 0000000000000000 000103349 ? 103349000 ?
103349BA8 ? 10334E000 ?
000102800 ? 000000000 ?
kgeasnmierr()+28 CALL kgerinv() 103349E08 ? 10344B650 ?
0000013C8 ? 000000000 ?
10334BF14 ? 10334B1D8 ?
kpoblblen()+84 CALL kgeasnmierr() 103349E08 ? 10344B650 ?
Anyway database problem?

Oracle DR Setup Problems / ORA - 600 /

Dear All,
Recently we have implemented DR(Disaster Recovery setup Using Oracle data guard in 10g, GUI configurations ) in our Production server. The DR setups are based on the Maximum performance with Realtime apply mode.
The configuration went fine and both servers(DR and ) were syncing fine together as well.
But unfortunately, there was a power failure in the DR site(Which is on the other network) and also the UPS also went down after some time, the real problem started here,
Once the DR server was down, after sometime we are not able to login in to the production system, Interestingly, both DB server and application server are running fine. But we are not able to login into server - SAPGUI hangs. There are no such error written in SAP level and but in oracle alert log, we found out ORA 600 error and also connection timed out for placing the archive log(log_destination_2) in the standby server(This is the DR server - And due to power failure, its not able to reach the server for placing the archive log file )
Temporary solution,
If we restart the production server, we are able to work continuously in the production system without any problem.
So, my query is that, what makes the production system hangs if DR server is unavailable and how it work if we restart the instance? Is this the normal procedure in DR setup? or its a bug in the oracle data guard or in the parameter log_archive_dest2?
Looking forward for your answers with your valuable suggestions
For the reference, I am pasting a part of alert log
Detected ARCH process failure
ARCH: STARTING ARCH PROCESSES
ARC1: Archival started
ARCH: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=92, OS id=4296940
ARC1: Becoming the heartbeat ARCH
Sat Oct 30 02:30:54 2010
WARNING: inbound connection timed out (ORA-3136)
Sat Oct 30 02:31:54 2010
WARNING: inbound connection timed out (ORA-3136)
Sat Oct 30 02:33:33 2010
Incremental checkpoint up to RBA [0x2e2b7.cf96.0], current log tail at RBA [0x2e2b7.cf96.0]
Sat Oct 30 02:37:14 2010
WARNING: inbound connection timed out (ORA-3136)
Sat Oct 30 02:37:52 2010
GES: Potential blocker (pid=2056210) on resource CF-00000000-00000000;
enqueue info in file /oracle/XXX/saptrace/background/xxx_rsm0_2015456.trc
Sat Oct 30 02:38:14 2010
WARNING: inbound connection timed out (ORA-3136)
Sat Oct 30 02:38:22 2010
Errors in file /oracle/XXX/saptrace/background/xxx_rsm0_2015456.trc:
ORA-00600: internal error code, arguments: [2103], [1], [0], [1], [900], [], [], []
Sat Oct 30 02:40:30 2010
GES: Potential blocker (pid=2056210) on resource CF-00000000-00000000;
enqueue info in file /oracle/xxx/saptrace/background/xxx_arc0_4329544.trc
Sat Oct 30 02:41:00 2010
Errors in file /oracle/xxx/saptrace/background/xxx_arc0_4329544.trc:
ORA-00600: internal error code, arguments: [2103], [1], [0], [1], [900], [], [], []
Sat Oct 30 02:41:02 2010
Errors in file /oracle/xxx/saptrace/background/xxx_arc0_4329544.trc:
ORA-00600: internal error code, arguments: [2103], [1], [0], [1], [900], [], [], []
Sat Oct 30 02:41:02 2010
Errors in file /oracle/xxx/saptrace/background/xxx_arc0_4329544.trc:
ORA-00600: internal error code, arguments: [2103], [1], [0], [1], [900], [], [], []
Sat Oct 30 02:41:02 2010
Errors in file /oracle/xxx/saptrace/background/xxx_arc0_4329544.trc:
ORA-00600: internal error code, arguments: [2103], [1], [0], [1], [900], [], [], []
Sat Oct 30 02:41:02 2010
Errors in file /oracle/xxx/saptrace/background/xxx_arc0_4329544.trc:
ORA-00600: internal error code, arguments: [2103], [1], [0], [1], [900], [], [], []
Sat Oct 30 02:41:02 2010
Errors in file /oracle/xxx/saptrace/background/xxx_arc0_4329544.trc:
ORA-00600: internal error code, arguments: [2103], [1], [0], [1], [900], [], [], []
Sat Oct 30 02:41:06 2010
ARCH: Detected ARCH process failure
ARCH: STARTING ARCH PROCESSES
ARC0: Archival started
ARCH: STARTING ARCH PROCESSES COMPLETE
ARC0 started with pid=91, OS id=1642728
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
Sat Oct 30 02:42:20 2010
WARNING: inbound connection timed out (ORA-3136)
Sat Oct 30 02:42:33 2010
GES: Potential blocker (pid=2056210) on resource CF-00000000-00000000;
enqueue info in file /oracle/xxx/saptrace/background/xxx_arc1_4296940.trc
Sat Oct 30 02:43:03 2010
Errors in file
Thanks and Regards
Vijay Kumar G

Hi Vijay,
Get oracle metalink ID from service market place and search for you will get handy information
ORA-600 [2103] "Timeout on 'Control file' or 'Checkpoint Progress' Enqueue" [ID 28045.1]
Also one very good tool to analyse [Metalink|https://metalink.oracle.com/metalink/plsql/ml2_documents.showDocument?p_database_id=NOT&p_id=153788.1]
Regards,

DDE: Problem Key 'ORA 600 [qcsprfro_tree:jrs present]' was flood controlled

Hi All,
I have oracle 11gR2 installed on OVM. From last few days I am getting below error ORA-600 in my alert.log file
Errors in file /u02/app/oracle/diag/rdbms/......./SID_ora_30314.trc (incident=169998):
ORA-00600: internal error code, arguments: [qcsprfro_tree:jrs present], [0x2B7CA0837030], [], [], [], [], [], [], [], [], [], []
from the above referenced trc file : I got below message:
DDE: Problem Key 'ORA 600 [qcsprfro_tree:jrs present]' was flood controlled (0x6) (incident: 169998)
ORA-00600: internal error code, arguments: [qcsprfro_tree:jrs present], [0x2B7CA0837030], [], [], [], [], [], [], [], [], [], []
"/u02/app/oracle/diag/rdbms/....../SID_eng11g02_ora_30314.trc" 60L, 3421C
Is anybody having any idea about this error's first argument [qcsprfro_tree:jrs present] ? I am not getting any reference document from oracle support also.
Thanks...

Hello,
I have oracle 11gR2 installed on OVMAs previously posted, you must open a SR to My Oracle Support.
In *11.2* you have the possibility with ADR (Automatic Diagnostic Repository) to create a Incident Package that you could send to the Support. It can help in the resolution process.
Please, find enclosed a link to this new features in 11g:
http://download.oracle.com/docs/cd/E11882_01/server.112/e17120/diag002.htm#CHDJDBCH
Hope this help.
Best regards,
Jean-Valentin

My lovely complicated SQL crashes with ORA-00600: internal[qerpfAllocateX2]

ORACLE 9201
Hi all
I wrote a nice query to look for combinations of transactions using a "connect by prior" to arrange a half-cartesian join, then look for all connected paths that were a certain depth and whose nodes added up to a certain value. It works great and has tested out fine in the debug runs I've given it, but it is falling over in live with the following weird error:
ORA-00600: internal error code, arguments: [qerpfAllocateX2], [4038], [4028], [], [], [], [], []
I was originally getting this and I solved it during debug, using a WITH statement rather than twice doing a nested select on my source table.. I double checked and I'm using the WITH verison (in PL/SQL)
What I dont get, is I can run it straight from e.g. Visual Studio just fine, but when my PL/SQL code calls into the function, it all falls apart with this error. Is there anything I can do to help investigate the cause or to fix?
The original thread, where you guys helped me write the SQL, is: Re: A little help writing an SQL please? May need some advanced functionality..
Regards
cj
Edited by: charred on Sep 15, 2008 8:05 AM

If you are running on 9i this could be as a result of a known database bug.
"A query may fail with ORA-600[qerpfAllocateX2] when the prefetch size exceeds the sort buffersize."
Bug: 2277191
Fixed in 10g or > v9202
With most ORA-600 errors, the only solution available is to contact Oracle Support or try and re-write the query to use different access methods (plans).
Christopher Soza
Oracle BI DBA
Orix Consultancy Services Ltd
http://sozaman.blogspot.com

ORA-600 starting MRP on Physical Standby

Hello everybody
My enviroment:
Primary Site: SLES 10 SP2, Oracle 11gR1 U7
Standby Site:SLES 10 SP2, Oracle 11gR1 U7
I have a big problem starting MRP on my physical standby. After I restored standby database from a Level 0 Backup, I start MRP (SQL>recover managed standby database disconnect ) and some lines appears at alert log file with ora-600 error, something like this:
mrp0 - ora-00600 arguments:[KGHALO4]
mrp0 - ora-00600 arguments[kghfrh1]
mrp0 - ora-00600 arguments[17113]
It's the first time that I see this behavior, I don't know what it is happening but I think that it's a bug.
Could something help me???
Thanks a lot

I have a big problem starting MRP on my physical standby. After I restored standby database from a Level 0 Backup, I start MRP (SQL>recover managed standby database disconnect ) and some lines appears at alert log file with ora-600 error, something like this:
mrp0 - ora-00600 arguments:[KGHALO4]
mrp0 - ora-00600 arguments[kghfrh1]
mrp0 - ora-00600 arguments[17113]
It's the first time that I see this behavior, I don't know what it is happening but I think that it's a bug.Submit SR to Oracle Support and also refer the below links as per the below second link it is a bug in recovery.
+ORA-600 [kghalo4] [ID 273721.1]+
*Bug 7420448 - ORA-600 [kghalo4] signalled during recovery [ID 7420448.8]*
Work around, you can create a new standby controlfile and restore it. If still exist you can raise an SR further.

Odisrv services getting down automatically

odisrv services getting down automatically even though I have started services manually.
Please suggest

Please refer to the piece of log:
2012-01-06 04:11:03,543 INFO [main] CSS is initialized as client. The default logger properties will be loaded com.hyperion.css.CSSSystem.<init>(Unknown Source)
2012-01-06 04:11:03,543 INFO [main] CSS Log file will be generated at E:\Hyperion\logs\essbase\SharedServices_Security_Client.log com.hyperion.css.CSSSystem.<init>(Unknown Source)
2012-01-06 04:11:03,558 INFO [main] Configure CSS with registry com.hyperion.css.CSSSystem.initCSSSystem(Unknown Source)
2012-01-06 04:11:03,558 INFO [main] Initializing CSS from Registry. com.hyperion.css.common.configuration.CSSConfigurationManager.getConfiguration(Unknown Source)
2012-01-06 04:11:03,590 INFO [main] Trying to get Registry Instance com.hyperion.css.registry.RegistryManager.<init>(Unknown Source)
2012-01-06 04:11:05,777 INFO [main] Got Registry Instance com.hyperion.css.registry.RegistryManager.<init>(Unknown Source)
2012-01-06 04:11:06,324 INFO [main] Got hub location from Registry:http://US1SAWN00077.wmservice.corpnet1.com:28080 com.hyperion.css.registry.RegistryManager.getHubLocationFromRegistry(Unknown Source)
2012-01-06 04:11:06,527 INFO [main] Got native directory location from Registry:US1SAWN00077.wmservice.corpnet1.com:28089 com.hyperion.css.registry.RegistryManager.getNativeProviderLocationFromRegistry(Unknown Source)
2012-01-06 04:11:06,527 INFO [main] URL constructed out of values in Registry database:ldap://US1SAWN00077.wmservice.corpnet1.com:28089/dc=css,dc=hyperion,dc=com com.hyperion.css.common.configuration.CSSConfigurationImplXML.initConfiguration(Unknown Source)

ORA-600: [kestb_ebv_load-6], [Bad Oracle number] on startup of RAC Instance

We have Installed Oracle Database 11g R2 Enterprise edition with RAC option.
today at 1115am instance 2 down abnormally on racnode2 and after that we
started mannually it is giving error
Th.
Fri Apr 13 11:15:53 2012
Errors in file /oracle/app/oracle/diag/rdbms/nhpcerp/nhpcerp2/incident/incdir_594369/nhpcerp2_o
ra_18547020_i594369.trc:
ORA-00308: cannot open archived log '/arch11/2_51023_762112515.arc'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory
Additional information: 3
ORA-00600: internal error code, arguments: [kestb_ebv_load-6], [Bad Oracle number], [], [], [],
Errors in file /oracle/app/oracle/diag/rdbms/nhpcerp/nhpcerp2/trace/nhpcerp2_ora_18547020.trc:
ORA-00600: internal error code, arguments: [kestb_ebv_load-6], [Bad Oracle number], [], [], [],
Errors in file /oracle/app/oracle/diag/rdbms/nhpcerp/nhpcerp2/trace/nhpcerp2_ora_18547020.trc:
ORA-00600: internal error code, arguments: [kestb_ebv_load-6], [Bad Oracle number], [], [], [],
Error 600 happened during db open, shutting down database
USER (ospid: 18547020): terminating the instance due to error 600
Instance terminated by USER, pid = 18547020
ORA-1092 signalled during: ALTER DATABASE OPEN...
opiodr aborting process unknown ospid (18547020) as a result of ORA-1092
Fri Apr 13 11:15:55 2012
ORA-1092 : opitsk aborting process
message after starting mannually
$
$ hostname
racnode2
$
$ srvctl start instance -d nhpcerp -i nhpcerp2
PRCR-1013 : Failed to start resource ora.nhpcerp.db
PRCR-1064 : Failed to start resource ora.nhpcerp.db on node racnode2
ORA-01092: ORACLE instance terminated. Disconnection forced
ORA-00600: internal error code, arguments: [kestb_ebv_load-6], [Bad Oracle number]
Process ID: 18940646
Any help would be highly appreciated.

Start here:
ORA-00308: cannot open archived log '/arch11/2_51023_762112515.arc'
ORA-27037: unable to obtain file status
IBM AIX RISC System/6000 Error: 2: No such file or directory

Problem with generating xml and nested cursor (ora-600)

I have a problem with generating xml (with dbms_xmlquery or xmlgen) and nested cursors.
When I execute the following command, I get a ORA-600 error:
select dbms_xmlquery.getxml('select mst_id
, mst_source
, cursor(select per.*
, cursor(select ftm_fdf_number
, ftm_value
from t_feature_master
where ftm_mstr_id = pers_master_id ) as features
from t_person per
where pers_master_id = mst_id ) as persons
from f_master
where mst_id = 3059435')
from dual;
<?xml version = '1.0'?>
<ERROR>oracle.xml.sql.OracleXMLSQLException: ORA-00600: internal error code, arguments: [kokbnp2], [1731], [], [], [], [], [], []
</ERROR>
The problem is the second cursor (t_feature_master).
I want to generate this:
<master>
<..>
<persons>
<..>
<features>
<..>
</features>
</persons>
<persons>
<..>
<features>
<..>
</features>
</persons>
</master>
If i execute the select-statement in sql-plus, then I get the next result.
MST_ID MST_SOURCE PERSONS
3059435 GG CURSOR STATEMENT : 3
CURSOR STATEMENT : 3
PERS_MASTER_ID PERS_TITLE PERS_INITI PERS_FIRSTNAME PERS_MIDDL PERS_LASTNAME
3059435 W. Name
CURSOR STATEMENT : 15
FTM_FDF_NUMBER FTM_VALUE
1 [email protected]
10 ....
I use Oracle 8.1.7.4 with Oracle XDK v9.2.0.5.0.
Is this a bug and do somebody know a workaround?

Very simple...Drop all type objects and nested tables and create them again. You will get no error. I'll explain the reason later.

OAF Update of Custom Table causing ORA-600 with database block corruption?

Using OA Framework 12.1.3, running under EBusiness Suite 12.1.3
Created Custom Web page operating against Custom Tables
ISSUE
On about 2% of new records, when OAF is UPDATING a record in a certain table, it is failing with
java.sql.SQLException: ORA-00607: Internal error occurred while making a change to a data block
ORA-00600: internal error code, arguments: [kddummy_blkchk], [815], [26412], [6110], [], [], [], []
ORA-06512: at line 1
Before the DBA turned on 10.2.0.4.0 DB_BLOCK_CHECKING parameter, this actually
resulted in corrupted data blocks in the database and corrupted indexes that
eventually crashed the database and we had to do a full recovery with 2 days downtime.
Now that we have turned on DB_BLOCK_CHECKING, it simply errors out and puts things
in the alert log, but the records still fail to update as the writes are blocked.
Then oddly, a few days later.. the records become editable. And others fail.
This is ONLY happening on the one particular table being updated by OAF. Other custom pages
posting to other custom tables are having no problems. We've CTAS'd the table back and
forth and recreated the indexes, and that did not help.
Support says to post to the Forum ( So I am! ) or hire Oracle consulting.. which doesn't make
much sense given the error. The Recovery Team that helped us in a separate SR ( we had
to do db_repairs not just recovery ) felt it was an important problem the OAF team needed to
strongly review.
Anyone else encounter this already and know of a solution?
TIA
Karl

After MANY hours of trial and error and research, we've identified ONE use case that seems to apply to 90% of the issue we have encountered.
YMMV.
The BC4J generated SQL which is generating the ORA-600 is
BEGIN UPDATE XXRETURNHEADER ReturnHeaderEO SET INTERNAL_TEXT=?,LAST_MOD_USERNAME=?,OBJECT_VERSION_NUMBER=?,LAST_UPDATE_DATE=?,LAST_UPDATED_BY=?,LAST_UPDATE_LOGIN=? WHERE RMA_NUMBER=? AND ORGANIZATION_ID=? RETURNING TROUBLESHOOT_DATE, FAA_TAG_DATE, FAILURE_ANALYSIS_DATE, LAST_MOD_DATE, FAA_REVISED_DATE, TTE_TECH_SEND_DATE, TTE_REP_RESPONSE_DATE, TTE_REP_APPROVED, TTE_RMA_RANDOM_KEY, OBJECT_VERSION_NUMBER, LAST_UPDATE_DATE, LAST_UPDATED_BY, LAST_UPDATE_LOGIN INTO ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?; END;".
We determined that if TTE_RMA_RANDOM_KEY was not a null value, we would get an ORA-600 error whenever we did an APPLY from the OAF Page to update the record.
If we set that table attribute to NULL for the record using SQL.. then used the OAF Page to APPLY.. it worked fine and the record saved without error.
We then modified the EO to NOT "Refresh After Update" ( thus removing it from the RETURNING clause generated )... and even if the TTE_RMA_RANDOM_KEY
had a value... the OAF Page APPLY worked and the record saved without error.
I cannot identify anything from the User programming side that is wrong ( and neither could Oracle ), and it REALLY should be in the RETURNING clause list of
attributes.. but this is the only workaround I've found that doesn't crash the Page and irritate the user to no end.
I have reported my findings via the SR back to Oracle to do with it what they may... but it looks strongly ,to me, to be an error in the BC4J/JDBC/Database
coordination and passing data between those black boxes.

ORA-29786: SIHA attribute GET failed with error [Attribute 'ASM_DISKSTRING'

Hi,
I un-register below services to configure them with solaris SMF (I know oracle won't support SMF yet).
they are running quite good, but only issue we are facing was RBAL create error logs in trace file.
/u01/grid/oracle/product/11.2.0/asm_1/bin/crs_unregister ora.LISTENER.lsnr
/u01/grid/oracle/product/11.2.0/asm_1/bin/crs_unregister ora.DATA.dg
/u01/grid/oracle/product/11.2.0/asm_1/bin/crs_unregister ora.FRA.dg
/u01/grid/oracle/product/11.2.0/asm_1/bin/crs_unregister ora.asm
Errors in file /u01/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_rbal_14028.trc:
ORA-29786: SIHA attribute GET failed with error [Attribute 'ASM_DISKSTRING' sts[200] lsts[0]]
KGGPNP_SIHA: resource 'ora.asm' is not available [200]
KGGPNP_SIHA: attribute 'ASM_DISKSTRING' get failed sts[200] lsts[0]
NOTE: failed to discover disks from gpnp profile asm diskstring
ORA-29786: SIHA attribute GET failed with error [Attribute 'ASM_DISKSTRING' sts[200] lsts[0]]
WARNING::lib=/opt/oracle/extapi/64/asm err:9 rc:opendir location:skgdllOpenDi
errbuf=2
msgbuf=No such file or directory other=Directory does not exist
*** 2011-03-22 11:23:02.281
kfgbRegister: registering group 1/0xB9966B09 (DATA)
kfgbBind: binding kfgpn for group 1/0xB9966B09 (DATA)
kfdp_query(DATA): 7 Edited by: Sachin B on Mar 28, 2011 3:17 AM

Hi, it seems this errors comes from the fact that the asm wasn't registred in the cluster.
so you have ti recreate the asm instance and register this instance in the cluster.
srvctl add asm -p $ORACLE_HOME/dbs/init$+ASM.ora
srvctl config asm
i hope it could help !
Huet Bruno
Senior DBA Brinks France.

Automatic instance getting down with ORA-600

Similar Messages

Maybe you are looking for