Cannot start RAC DB using srvctl start database

Hello Fellows,
We used to have a 10.1.0.4 RAC DB on top of CRS 10.1.0.4 on top of Sun cluster 3.1 on both Sun Solaris SPARC 64-bit 5.9 nodes.
We :
- Unregisted the current RAC DB from the 10.1.0.4 CRS.
- Removed the CRS 10.1.0.4 permanently and cleanly
- Installed a new Clusterware 10.2.0.1 and patched to 10.2.0.4 + patch 8705958.
- CRS servcies are healthy and up :
$ crs_status.sh
ora.tibisdb1.LISTENER_TIBISDB1.lsnr ONLINE ....etc for all other services
Now we are trying to upgrade the RAC DB from 10.1.0.4 to 10.2.
When i started the DBUA it i chose the cluster mode and then DBUA tried to startup both DB instances but it failed. To reproduce this, i registed the databse TIBIS with the 2 instances to the CRS and then tried to startup the DB but it failed:
$ crs_status.sh
ora.TIBIS.TIBIS1.inst OFFLINE OFFLINE
ora.TIBIS.TIBIS2.inst OFFLINE OFFLINE
ora.TIBIS.db OFFLINE OFFLINE ...etc
$ srvctl start database -d TIBIS
PRKP-1001 : Error starting instance TIBIS1 on node tibisdb1
tibisdb1:ora.TIBIS.TIBIS1.inst:
tibisdb1:ora.TIBIS.TIBIS1.inst:
SQL*Plus: Release 10.1.0.4.0 ...
Connected to an idle instance.
ORA-00603: ORACLE server session terminated by fatal error
ORA-27504: IPC error creating OSD context
ORA-27300: OS system dependent operation:IPC init failed with status: 65
ORA-27301: OS failure message: Package not installed
ORA-27302: failure occurred at: skgxpcini
ORA-27303: additional information:libskgxpd.so called
tibisdb1:ora.TIBIS.TIBIS1.inst:libskgxp10.so should reference real implementation.
tibisdb1:ora.TIBIS.TIBIS1.inst:SQL> Disconnected
CRS-0215: Could not start resource 'ora.TIBIS.TIBIS1.inst'.
PRKP-1001 : Error starting instance TIBIS2 on node tibisdb2
CRS-0215: Could not start resource 'ora.TIBIS.TIBIS2.inst
BTW, i can open the instances fine through SQLPLUS.
I did a full SRVCTL trace for the command and got the same errors above only.
I also followed also Note :Note : 814896.1
1. cd $ORACLE_HOME/rdbms/lib
2. rename the original library (if exists)
mv libskgxp10.so libskgxp10.so.old
3. Relink to configure UDP for IPC
make -f ins_rdbms.mk rac_on ipc_udp ioracle
4. Check whether the library exists
ls -l $ORACLE_HOME/lib/libskgxp10.so
Same result when try to SRVCTL START DATABASE -D TIBIS
RECENT CHANGES:
- Unregisted the current 10.1.0.4 RAC DB from the 10.1.0.4 CRS.
- Removed the CRS 10.1.0.4 permanently and cleanly
- Installed a new Clusterware 10.2.0.1 and patched to 10.2.0.4 + patch 8705958.
- Try to upgrade/register the 101 RAC DB to 10.2 .
O/S DETAILS:
$ uname -a
SunOS tibisdb1 5.9 Generic_122300-29 sun4u sparc SUNW,Sun-Fire-V240
CLUSTERWARE:
Sun Cluster 3.1
Please advise,
Thank you.
Feras

Hello,
Thanks first for your following up and trying to help. I appreciate that.
Here is what you suggested :
$ srvctl start instance -d TIBIS -i TIBIS1
PRKP-1001 : Error starting instance TIBIS1 on node tibisdb1
tibisdb1:ora.TIBIS.TIBIS1.inst:
tibisdb1:ora.TIBIS.TIBIS1.inst:SQL*Plus: Release 10.1.0.4.0 - Production on Tue Nov 17 08:57:50 2009
tibisdb1:ora.TIBIS.TIBIS1.inst:
tibisdb1:ora.TIBIS.TIBIS1.inst:Copyright (c) 1982, 2005, Oracle. All rights reserved.
tibisdb1:ora.TIBIS.TIBIS1.inst:
tibisdb1:ora.TIBIS.TIBIS1.inst:Enter user-name: Connected to an idle instance.
tibisdb1:ora.TIBIS.TIBIS1.inst:
tibisdb1:ora.TIBIS.TIBIS1.inst:SQL> ORA-00603: ORACLE server session terminated by fatal error
tibisdb1:ora.TIBIS.TIBIS1.inst:ORA-27504: IPC error creating OSD context
tibisdb1:ora.TIBIS.TIBIS1.inst:ORA-27300: OS system dependent operation:IPC init failed with status: 65
tibisdb1:ora.TIBIS.TIBIS1.inst:ORA-27301: OS failure message: Package not installed
tibisdb1:ora.TIBIS.TIBIS1.inst:ORA-27302: failure occurred at: skgxpcini
tibisdb1:ora.TIBIS.TIBIS1.inst:ORA-27303: additional information: libskgxpd.so called
tibisdb1:ora.TIBIS.TIBIS1.inst:libskgxp10.so should reference real implementation.
tibisdb1:ora.TIBIS.TIBIS1.inst:SQL> Disconnected
tibisdb1:ora.TIBIS.TIBIS1.inst:
CRS-0215: Could not start resource 'ora.TIBIS.TIBIS1.inst'.
$ $ORA_CRS_HOME/bin/crs_stat -p ora.TIBIS.TIBIS1.inst
NAME=ora.TIBIS.TIBIS1.inst
TYPE=application
ACTION_SCRIPT=/oracle/product/10.1.0/db_1/bin/racgwrap
ACTIVE_PLACEMENT=0
AUTO_START=1
CHECK_INTERVAL=600
DESCRIPTION=CRS application for Instance
FAILOVER_DELAY=0
FAILURE_INTERVAL=0
FAILURE_THRESHOLD=0
HOSTING_MEMBERS=tibisdb1
OPTIONAL_RESOURCES=
PLACEMENT=restricted
REQUIRED_RESOURCES=ora.tibisdb1.vip
RESTART_ATTEMPTS=5
SCRIPT_TIMEOUT=600
START_TIMEOUT=0
STOP_TIMEOUT=0
UPTIME_THRESHOLD=7d
USR_ORA_ALERT_NAME=
USR_ORA_CHECK_TIMEOUT=0
USR_ORA_CONNECT_STR=/ as sysdba
USR_ORA_DEBUG=0
USR_ORA_DISCONNECT=false
USR_ORA_FLAGS=
USR_ORA_IF=
USR_ORA_INST_NOT_SHUTDOWN=
USR_ORA_LANG=
USR_ORA_NETMASK=
USR_ORA_OPEN_MODE=
USR_ORA_OPI=false
USR_ORA_PFILE=
USR_ORA_PRECONNECT=none
USR_ORA_SRV=
USR_ORA_START_TIMEOUT=0
USR_ORA_STOP_MODE=immediate
USR_ORA_STOP_TIMEOUT=0
USR_ORA_VIP=
$ CRS_HOME/bin/crs_stat -p ora.oradb.oradb1.inst | grep ACTION_SCRIPT
/usr/bin/ksh: CRS_HOME/bin/crs_stat: not found
$ $ORA_CRS_HOME/bin/crs_stat -p ora.TIBIS.TIBIS1.inst | grep ACTION_SCRIPT
ACTION_SCRIPT=/oracle/product/10.1.0/db_1/bin/racgwrap
$ ls -ltr /oracle/product/10.1.0/db_1/bin/racgwrap
-rwxr-x--x 1 oracle dba 629 Oct 17 14:23 /oracle/product/10.1.0/db_1/bin/racgwrap
$ more /oracle/product/10.1.0/db_1/bin/racgwrap
#!/bin/sh
# Wrapper script
ORACLE_HOME=/oracle/product/10.1.0/db_1
export ORACLE_HOME
ORACLE_BASE=/oracle/product/10.1.0/db_1
# export ORACLE_BASE if it is set
if [ ! -z "$ORACLE_BASE" ]
then
export ORACLE_BASE
fi
PATH=$ORACLE_HOME/bin:/usr/bin:$PATH
export PATH
# environment variable need to be set for executing
# lsnrctl, agentctl and sqlplus
ORA_RACG_EXEC_ENV="LD_LIBRARY_PATH=$ORACLE_HOME/lib:$LD_LIBRARY_PATH"
export ORA_RACG_EXEC_ENV
LD_LIBRARY_PATH=$ORACLE_HOME/lib:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH
#_USR_ORA_DEBUG=1
#export USRORA_DEBUG
$ORACLE_HOME/bin/racgmain "$@"
status=$?
exit $status
$Regarding the Oracle SR, they replied yesterday and requested logs..etc. Waiting for their feedback while trying to resolve this.
Please advise.
Thanks,
Feras

Similar Messages

Cannot start JavaFX Task using Thread.start()

Well I am currently studying JavaFX and as a total beginner(but not in Java) I started reading the official tutorials in Java and I'm currently studying Concurrency in JavaFX. and I tried to create my first JavaFx Task Object and start it. This what I have tried so far
package concurrency;
import javafx.concurrent.Task;
public class JavaTaskClass {
      * @param args
     public static void main(String[] args) {
          //create task object
          Task<Integer> task = new Task<Integer>(){
               @Override
               protected Integer call() throws Exception{
                    System.out.println("Background task started...");
                    int iterations;
                    for(iterations = 0; iterations < 10000; iterations++){
                         if(isCancelled()){
                              break;
                         System.out.println("Iteration " + iterations);
                         Thread.sleep(3000);
                    return iterations;
          //start the background task
          Thread th = new Thread(task);
          th.setDaemon(true);
          System.out.println("Starting background task...");
          th.start();
but the task doesn't start. I don't see any messages in my console. Is there something I missed?
Edited by: 979420 on Jan 1, 2013 10:02 PM
Edited by: 979420 on Jan 1, 2013 10:02 PM
Edited by: 979420 on Jan 1, 2013 10:03 PM
Edited by: 979420 on Jan 1, 2013 10:49 PM

Tasks are meant to be run in the context of a JavaFX application, like in the example below:
import javafx.application.Application;
import javafx.concurrent.Task;
import javafx.scene.Scene;
import javafx.scene.layout.StackPane;
import javafx.scene.paint.Color;
import javafx.stage.Stage;
import java.io.IOException;
public class TaskApp extends Application {
public static void main(String[] args) { launch(args); }
@Override public void start(final Stage stage) throws IOException {
    //create task object
    Task<Integer> task = new Task<Integer>(){
      @Override
      protected Integer call() throws Exception{
        System.out.println("Background task started...");
        int iterations;
        for(iterations = 0; iterations < 10000; iterations++){
          if(isCancelled()){
            break;
          System.out.println("Iteration " + iterations);
          Thread.sleep(3000);
        return iterations;
    //start the background task
    Thread th = new Thread(task);
    th.setDaemon(true);
    System.out.println("Starting background task...");
    th.start();
    stage.setScene(new Scene(new StackPane(), 200, 100, Color.BLANCHEDALMOND));
    stage.show();
}Also your code was setting the task thread as a daemon thread. The Java Virtual Machine exits when the only threads running are all daemon threads. So once your main routine finished (which would be really quickly), the program would just exit without doing anything much. Note that, in your example, even if you made the Task thread a non-daemon thread, it still doesn't work (likely because the Task class has some reliance on the JavaFX system being initialized). For your simple background process you could skip Task and just use a Runnable or a Callable (which doesn't require JavaFX and hence would work in a non-daemon thread invoked from main), but I guess it's just an experiment.

Enable/DIsable Services in RAC Database using srvctl

Hello,
I am using Oracle Database 11g on a two node RAC. For the service management on the RAC I use srvctl and I have problems in understanding why the tool offers redundant information for some services.
To be more exact, let's say I have a two node RAC, one database called DB_NAME and one instance on each node called DB_NAME1 and DB_NAME2.
I create a service called DB_SRV using srvctl like this:
srvctl add service -d DB_NAME -s DB_SRV -r DB_NAME1 -a DB_NAME2
Then I run srvctl config to see service parameters like this:
srvctl config service -d DB_NAME -s SRV_NAME
And I get the output:
Service name: DB_SRV
Service is enabled
Preferred instances: DB_NAME1
Available instances: DB_NAME2
So I can see that the the service DB_SRV is enabled by default, and I want to disable the service, like this:
srvctl disable service -d DB_NAME -s DB_SRV -i DB_NAME1
After than I run srvctl config again:
srvctl config service -d DB_NAME -s SRV_NAME
And I get the output:
Service name: DB_SRV
Service is enabled
Preferred instances: DB_NAME1
Available instances: DB_NAME2
Service is disabled on instances: DB_NAME1
So far,it all makes sense. The service is enabled to all the instances, but disabled for DB_NAME1 so this means the the service is enabled on DB_NAME2. All ok.
But then, I want to enable the service on DB_NAME2 (although it is already enabled there) and I run:
srvctl enable service -d DB_NAME -s DB_SRV -i DB_NAME2
After than I run srvctl config again:
srvctl config service -d DB_NAME -s SRV_NAME
And I get the output:
Service name: DB_SRV
Service is enabled
Preferred instances: DB_NAME1
Available instances: DB_NAME2
Service is enabled on instances: DB_NAME2
Service is disabled on instances: DB_NAME1
So my real question is:
Why isn't oracle giving me an error when I run
srvctl enable service -d DB_NAME -s DB_SRV -i DB_NAME2
and instead adds this line (redundant, I would say)
Service is enabled on instances: DB_NAME2
in the srvctl config output?
Thank you in advance!

So for me it seems redundant because if the service is enabled (this means it is enabled for every instance in the RAC), you shouldn't be able to enable it on one of that instance again.
So in my last output I think that this line:
Service is enabled
is equal to this line
Service is enabled on instances: DB_NAME2
If I am wrong, can someone point the difference between the two lines based on my scenario?
Edited by: 881081 on Aug 23, 2011 8:53 AM

(RAC) node 2 dont start automatically

hi gurus,
we have intalled a RAC (with 2 nodes) on database version 11.2.0.3.
When we reboot node 1, it restart automatically but when we reboot node 2 we have to restart manually using:
srvctl start instance -d DB_name -i NODE_2
how to check if we have autostart configured in node 2?
i did
[oracle@sifnode2 ~]$ crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
if HAS is online it means that is autostart on?

Hi,
You sould know there is important change in 11.2 CRS...
With Oracle 11.2 database auto start policy in the clusterware is restore, which means that clusterware will remember the last state of the database. If the database was stopped normally then on the next restart of clusterware it won’t be started. Otherwise if the server crashes or by some reason the OS is rebooted then clusterware will start the database because last state was ONLINE (running).
If you are running on Linux there is no need to write your own scripts for automatically startup/shutdown anymore. But you need to configure something.
Here is what it is:
By default with Oracle 11.2 several important resources come in the profile with attribute AUTO_START=restore. Such resources are Oracle Database resource, Oracle ASM resource, CRS resource type for the Listener. This means that if Oracle database server is restarted for some reason , it will keep and restore the last state.
It is a good practice to change this default behaviour and it is the first thing I usually do after a new installation. I change AUTO_START=always for the resources listed above.
Coming back to your issue....
Please check following to know the auto_start policy
crsctl config crs
crs_stat -p <resource name>
crsctl status resource <resource name> -p | grep AUTO_START

RAC service can't start after upgrading to 10.2.0.4

Hi All,
After upgrading to 10.2.0.4 from 10.2.01 (linux32 with 2 nodes), I am experiencing the following:
1. The rac service (created after the database was created, not the default service) can not start after the database started with "prkp-1030" error.
2.The service somehow is online and available from the "lsnrctl status" command. Further verified that the users could connect to the rac via that service.
3. The "crs_stat -t" command and the "srvctl status service..." also show the service is not running.
Have anyone seen this problem before? what is need to be done to make it consistent.
Thanks,
TN

I found something that might cause this problem.
When I shut down everything (service, db, asm, nodeapps), and start them back on one by one in the opposite order (nodeapps, asm, database). I found out that the service is somehow get restarted when I start the database (when I have yet started the service itself). the lsnrctl status shows that the service is up. but the crs_stat shows the service is down.
My question is that why the service is tied up with the database startup (using srvctl start database -d database_name)?

Srvctl start listener -n rac1 gives CRS-1028 and CRS-0223

Boot up 2 linux 10.2.0.1.0 RAC nodes.
everything starts except listeners
srvctl start listener -n rac1
or
srvctl start listener -n rac2
gives
CRS-1028
CRS-0223
However, if you start listeners manually, using
lsnrctl start listener_rac1
or
lsnrctl start listener_rac2
they start right up. Moreover, once you have started them manually, the srvctl start listener commands now work, both stopping and starting the listeners with srvctl now works. However, when reboot systems, again srvctl must be "primed" for starting listener by doing one "manual" startup of listener.
Any thoughts on what is causing this behavior?
Thanks!

Alan, thanks - excellent advice. However, I just ended up redoing the entire install and this of course fixed the problem :-)
Thanks for your reply, Gil
PS also, btw I use the crsstat script instead of the crs_stat for better formatting, i.e. this script (which I named crsstat) lives in $ORA_CRS_HOME/bin. Also, note I am not the author of this script, I downloaded it from Metalink:
#!/usr/bin/ksh
# Sample 10g CRS resource status query script
# Description:
# - Returns formatted version of crs_stat -t, in tabular
# format, with the complete rsc names and filtering keywords
# - The argument, $RSC_KEY, is optional and if passed to the script, will
# limit the output to HA resources whose names match $RSC_KEY.
# Requirements:
# - $ORA_CRS_HOME should be set in your environment
RSC_KEY=$1
QSTAT=-u
AWK=/usr/bin/awk # if not available use /usr/bin/awk
# Table header:echo ""
$AWK \
'BEGIN {printf "%-45s %-10s %-18s\n", "HA Resource", "Target", "State";
printf "%-45s %-10s %-18s\n", "-----------", "------", "-----";}'
# Table body:
$ORA_CRS_HOME/bin/crs_stat $QSTAT | $AWK \
'BEGIN { FS="="; state = 0; }
$1~/NAME/ && $2~/'$RSC_KEY'/ {appname = $2; state=1};
state == 0 {next;}
$1~/TARGET/ && state == 1 {apptarget = $2; state=2;}
$1~/STATE/ && state == 2 {appstate = $2; state=3;}
state == 3 {printf "%-45s %-10s %-18s\n", appname, apptarget, appstate; state=0;}'

Difference between sqlplus - start and srvctl start instance

Hello,
why we need to start RAC instances with SRVCTL command, what is the difference between sqlplus -- startup and (srvctl start instance -d dbname -i inst_name)
Thanks
Karthick K

The first ever thing that comes to mind is that sql*plus is not a clusterware utility which means, any updations done from it, may not update correctly the OCR . If you would play with RAC, you may see that doing the startup/shutdown using the sql*plus at times show a conflict the status of the instance when checked through crs_stat command. That's a reason that the srvctl is preferred against sql*plus in the cluster environments.
HTH
Aman....

Srvctl config database won't show databases

by using
$ srvctl config database
I saw there is no result I expected. but I do have a couple of RAC databases are running, anywhere I missed to configure?
10.2.0.4 Rac AIX
thanks
Edited by: ROY123 on Nov 30, 2010 12:43 PM

by using below:
select name,network_name,creation_date,goal,dtp,AQ_HA_NOTIFICATION,clb_goal from v$services;
I can find out the service name in this RAC
I think the previous dba shoudl do below, to add database...(register):
The configuration should have been performed during the database creation, but it can be performed subsequently using the following commands.
srvctl add database -d ORCL -o /u01/app/oracle/product/10.1.0/db_1
srvctl add instance -d ORCL -i ORCL1 -n server01
srvctl add instance -d ORCL -i ORCL2 -n server02
srvctl add instance -d ORCL -i ORCL3 -n server03
thanks

Can not start the cluster database using srvctl

Created a RAC database with CRS.
When i start the cluster database with srvctl, it appears that the database is started (i made sure using srvctl status), but when i try to login to the database using sqlplus, i get a message 'connected to idle instance'. if i try to start the database from sqlplus, i get message 'requested INSTANCE_NUMBER is busy!.
any thoughts why i can not connect to the database using sqlplus after i start the database using srvctl?
I stop the database using srvctl and started using traditional sqlplus, it will start with out any problem.
what am i missing?

check ur oracle_sid,also try to connect as sqlplus sys/****@prod as sysdba
may be this is due to improper setting of init.ora file.
and post ur sqlplus output here.
Thanks
Kuljeet Pal Singh

Databases instances stuck in MOUNT MODE after srvctl start database -d

Hi,
I wonder if anyone can shed some light on why the following scenario is happening in our environment.
We have a 4 node site, configured with RAC on nodes 1 & 2 and dataguard shipping the logs to a standby physical cluster
database on nodes 3 & 4.
Our issue is this:
When the database instances on nodes 1 & 2 are stopped and restarted using this command sequence
srvctl stop database -d SOCPRODCAV
srvctl start database -d SOCPRODCAV
each database instance gets started up only as far as MOUNT mode.
The databases are not opened and i have to go in and do this manually for each instance.
The above command sequence used to successfully restart the database and leave it open for use so i'm wondering how the start
mode has been changed and if there is an area of configuration or view anyone can guide me to look at it.
I provide remote DBA support for this client's and it is possible that another onsite DBA may have changed something.
Any pointers gratefully received.
Regards,
George

See current configuration as follows
srvctl config database -d SOCPRODCAV -aThis should show you current startup/stop settings as follows
Start options: open
Stop options: immediate
Now you can change current settings if Start option is not "open"
srvctl modify database -d SOCPRODCAV -s OPENReference
http://docs.oracle.com/cd/E14072_01/server.112/e10595/restart005.htm#i1009665
Salman

Srvctl start database -d dbname error tns lost contact

hi,
i am facing error while starting the databse by using srvctl in single node database.
srvctl status database -d <dbname> is working fine and it is giving output. i am able to start the database manually too.
srvctl start database -d <dbname>
PRCR-1133 : Failed to stop database <dbname> and its running services
PRCR-1132 : Failed to stop resources using a filter
ORA-12547: TNS:lost contact
any advice.
regards
Suresh J
Edited by: user11982371 on Apr 20, 2012 6:53 AM

may i know what you have done before....srvctl start...etc...
do you have done any changes?
post your oracle version and OS....
please find below notes from metalink..it may helpful to you....
This could be many things but a popular issue is when you have a separate ASM Home and the listener is running out of this home (it was the first home installed). Srvctl needs a TNS_ADMIN alias to the network/admin directory in this home instead of using the default ORACLE_HOME/network/admin for the database you are trying to start. For srvctl to work you must
srvctl setenv nodeapps -n node -T TNS_ADMIN=full path
on each node in the cluster.
You cannot rely on a TNS_ADMIN environment variable.
See Note 420977.1
Another cause is non-existent spfile, see Note 732683.1
source support.oracle.com
Edited by: dbc001 on Mar 23, 2013 10:55 AM

Problem starting RAC database instance on Node 2

Hi all,
I have the following problem after installing RAC 10.2.0 with 2 nodes (clusternode1 & clusternode2).
I'll greatly appreciate if someone could help fix this:
oracle@clusternode2:~> srvctl status nodeapps -n clusternode1
VIP is running on node: clusternode1
GSD is running on node: clusternode1
Listener is running on node: clusternode1
ONS daemon is running on node: clusternode1
oracle@clusternode2:~> srvctl status nodeapps -n clusternode2
VIP is running on node: clusternode2
GSD is running on node: clusternode2
Listener is running on node: clusternode2
ONS daemon is running on node: clusternode2
oracle@clusternode2:~>
oracle@clusternode2:~> srvctl status asm -n clusternode1
ASM instance +ASM1 is running on node clusternode1.
oracle@clusternode2:~> srvctl status asm -n clusternode2
ASM instance +ASM2 is running on node clusternode2.
oracle@clusternode2:~>
oracle@clusternode2:~> srvctl status database -d orcl
Instance orcl1 is running on node clusternode1
Instance orcl2 is not running on node clusternode2 <-------Here is the problem!!!!!!!!!!!!!!!!
oracle@clusternode2:~>
So when I try to start the orcl2 instance I receive:
oracle@clusternode2:~> srvctl start instance -d orcl -i orcl2
PRKP-1001 : Error starting instance orcl2 on node clusternode2
CRS-0215: Could not start resource 'ora.orcl.orcl2.inst'.
oracle@clusternode2:~>
I tried to do it per SQL*PLus:
oracle@clusternode2:~> echo $ORACLE_SID
orcl2
oracle@clusternode2:~> sqlplus "/as sysdba"
SQL*Plus: Release 10.2.0.1.0 - Production on Mon Mar 27 21:08:59 2006
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Connected to an idle instance.
SQL> startup
ORA-01078: failure in processing system parameters
ORA-01565: error in identifying file '+ORCLDATAGRP1/orcl/spfileorcl.ora'
ORA-17503: ksfdopn:2 Failed to open file +ORCLDATAGRP1/orcl/spfileorcl.ora
ORA-15077: could not locate ASM instance serving a required diskgroup
SQL>
But ASM is there and running !!!!!!!!!!!
Thanks very much for any tip how to get ride of this problem.
Kind regards.
Askia.

muba_zak wrote:
Thanks John,
How the cron jobs takes care, is there any different is there between Admin Managed & Policy Managed
Thanks.
Muba
I don't know what your cron jobs do. If (for example) they logon to the database through a service published by the scan listeners, they will be happy. If they logon using a deterministic connect string, you have a problem - a problem caused by mis-using the system.

Can not start Rac database

Hi,
Oracle RAC database 10.2.0.3/RedHat4 with 2 nodes.
In the begining we had an error ORA-600[12803] so only sys can connect to database I find the note 1026653.6 this note said that we need to create AUDSES$ sequence but befor that we have to restart the database.
When we stop the datanbase we had another ORA-600 and it's impossible to start it!!
Here is a coppy of our alert file:
Picked latch-free SCN scheme 2
Autotune of undo retention is turned on.
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.3.0.
System parameters with non-default values:
processes = 300
sessions = 335
sga_max_size = 524288000
__shared_pool_size = 310378496
__large_pool_size = 4194304
__java_pool_size = 8388608
__streams_pool_size = 8388608
spfile = +DATA/osista/spfileosista.ora
nls_language = FRENCH
nls_territory = FRANCE
nls_length_semantics = CHAR
sga_target = 524288000
control_files = DATA/osista/controlfile/control01.ctl, DATA/osista/controlfile/control02.ctl
db_block_size = 8192
__db_cache_size = 184549376
compatible = 10.2.0.3.0
log_archive_dest_1 = LOCATION=USE_DB_RECOVERY_FILE_DEST
db_file_multiblock_read_count= 16
cluster_database = TRUE
cluster_database_instances= 2
db_create_file_dest = +DATA
db_recovery_file_dest = +FLASH
db_recovery_file_dest_size= 68543315968
thread = 2
instance_number = 2
undo_management = AUTO
undo_tablespace = UNDOTBS2
undo_retention = 29880
remote_login_passwordfile= EXCLUSIVE
db_domain =
dispatchers = (PROTOCOL=TCP) (SERVICE=OSISTAXDB)
local_listener = (address=(protocol=tcp)(port=1521)(host=132.147.160.243))
remote_listener = LISTENERS_OSISTA
job_queue_processes = 10
background_dump_dest = /oracle/product/admin/OSISTA/bdump
user_dump_dest = /oracle/product/admin/OSISTA/udump
core_dump_dest = /oracle/product/admin/OSISTA/cdump
audit_file_dest = /oracle/product/admin/OSISTA/adump
db_name = OSISTA
open_cursors = 300
pga_aggregate_target = 104857600
aq_tm_processes = 1
Cluster communication is configured to use the following interface(s) for this instance
172.16.0.2
Wed Jun 13 11:04:30 2012
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PMON started with pid=2, OS id=8560
DIAG started with pid=3, OS id=8562
PSP0 started with pid=4, OS id=8566
LMON started with pid=5, OS id=8570
LMD0 started with pid=6, OS id=8574
LMS0 started with pid=7, OS id=8576
LMS1 started with pid=8, OS id=8580
MMAN started with pid=9, OS id=8584
DBW0 started with pid=10, OS id=8586
LGWR started with pid=11, OS id=8588
CKPT started with pid=12, OS id=8590
SMON started with pid=13, OS id=8592
RECO started with pid=14, OS id=8594
CJQ0 started with pid=15, OS id=8596
MMON started with pid=16, OS id=8598
Wed Jun 13 11:04:31 2012
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=17, OS id=8600
Wed Jun 13 11:04:31 2012
starting up 1 shared server(s) ...
Wed Jun 13 11:04:31 2012
lmon registered with NM - instance id 2 (internal mem no 1)
Wed Jun 13 11:04:31 2012
Reconfiguration started (old inc 0, new inc 2)
List of nodes:
1
Global Resource Directory frozen
* allocate domain 0, invalid = TRUE
Communication channels reestablished
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Wed Jun 13 11:04:31 2012
LMS 0: 0 GCS shadows cancelled, 0 closed
Wed Jun 13 11:04:31 2012
LMS 1: 0 GCS shadows cancelled, 0 closed
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Post SMON to start 1st pass IR
Wed Jun 13 11:04:31 2012
LMS 0: 0 GCS shadows traversed, 0 replayed
Wed Jun 13 11:04:31 2012
LMS 1: 0 GCS shadows traversed, 0 replayed
Wed Jun 13 11:04:31 2012
Submitted all GCS remote-cache requests
Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=20, OS id=8877
Wed Jun 13 11:04:43 2012
alter database mount
Wed Jun 13 11:04:43 2012
This instance was first to mount
Wed Jun 13 11:04:43 2012
Starting background process ASMB
ASMB started with pid=25, OS id=10068
Starting background process RBAL
RBAL started with pid=26, OS id=10072
Wed Jun 13 11:04:47 2012
SUCCESS: diskgroup DATA was mounted
Wed Jun 13 11:04:51 2012
Setting recovery target incarnation to 1
Wed Jun 13 11:04:52 2012
Successful mount of redo thread 2, with mount id 3005749259
Wed Jun 13 11:04:52 2012
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Completed: alter database mount
Wed Jun 13 11:05:06 2012
alter database open
Wed Jun 13 11:05:06 2012
This instance was first to open
Wed Jun 13 11:05:06 2012
Beginning crash recovery of 1 threads
parallel recovery started with 2 processes
Wed Jun 13 11:05:07 2012
Started redo scan
Wed Jun 13 11:05:07 2012
Completed redo scan
61 redo blocks read, 4 data blocks need recovery
Wed Jun 13 11:05:07 2012
Started redo application at
Thread 1: logseq 7924, block 3, scn 506098125
Wed Jun 13 11:05:07 2012
Recovery of Online Redo Log: Thread 1 Group 2 Seq 7924 Reading mem 0
Mem# 0: +DATA/osista/onlinelog/group_2.372.742132543
Wed Jun 13 11:05:07 2012
Completed redo application
Wed Jun 13 11:05:07 2012
Completed crash recovery at
Thread 1: logseq 7924, block 64, scn 506118186
4 data blocks read, 4 data blocks written, 61 redo blocks read
Switch log for thread 1 to sequence 7925
Picked broadcast on commit scheme to generate SCNs
db_recovery_file_dest_size of 65368 MB is 0.61% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
SUCCESS: diskgroup FLASH was mounted
SUCCESS: diskgroup FLASH was dismounted
Thread 1 advanced to log sequence 7926
SUCCESS: diskgroup FLASH was mounted
SUCCESS: diskgroup FLASH was dismounted
Thread 1 advanced to log sequence 7927
Wed Jun 13 11:05:11 2012
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=31, OS id=12747
Wed Jun 13 11:05:11 2012
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=32, OS id=12749
Wed Jun 13 11:05:12 2012
Thread 2 opened at log sequence 7176
Current log# 4 seq# 7176 mem# 0: +DATA/osista/onlinelog/group_4.289.742134597
Wed Jun 13 11:05:12 2012
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
Wed Jun 13 11:05:12 2012
Successful open of redo thread 2
Wed Jun 13 11:05:12 2012
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Wed Jun 13 11:05:12 2012
ARC0: Becoming the heartbeat ARCH
Wed Jun 13 11:05:12 2012
SMON: enabling cache recovery
Wed Jun 13 11:05:15 2012
Successfully onlined Undo Tablespace 20.
Wed Jun 13 11:05:15 2012
SMON: enabling tx recovery
Wed Jun 13 11:05:15 2012
Database Characterset is AL32UTF8
Wed Jun 13 11:05:16 2012
Errors in file /oracle/product/admin/OSISTA/udump/osista2_ora_9174.trc:
ORA-00600: code d'erreur interne, arguments : [kokiasg1], [], [], [], [], [], [], []
Wed Jun 13 11:05:16 2012
Errors in file /oracle/product/admin/OSISTA/udump/osista2_ora_9174.trc:
ORA-00600: code d'erreur interne, arguments : [kokiasg1], [], [], [], [], [], [], []
Error 600 happened during db open, shutting down database
USER: terminating instance due to error 600
Instance terminated by USER, pid = 9174
ORA-1092 signalled during: alter database open...
Wed Jun 13 11:06:16 2012
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth0 172.16.0.0 configured from OCR for use as a cluster interconnect
Interface type 1 bond0 132.147.160.0 configured from OCR for use as a public interface
Picked latch-free SCN scheme 2
Autotune of undo retention is turned on.
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.3.0.
System parameters with non-default values:
processes = 300
sessions = 335
sga_max_size = 524288000
__shared_pool_size = 314572800
__large_pool_size = 4194304
__java_pool_size = 8388608
__streams_pool_size = 8388608
spfile = +DATA/osista/spfileosista.ora
nls_language = FRENCH
nls_territory = FRANCE
nls_length_semantics = CHAR
sga_target = 524288000
control_files = DATA/osista/controlfile/control01.ctl, DATA/osista/controlfile/control02.ctl
db_block_size = 8192
__db_cache_size = 180355072
compatible = 10.2.0.3.0
log_archive_dest_1 = LOCATION=USE_DB_RECOVERY_FILE_DEST
db_file_multiblock_read_count= 16
cluster_database = TRUE
cluster_database_instances= 2
db_create_file_dest = +DATA
db_recovery_file_dest = +FLASH
db_recovery_file_dest_size= 68543315968
thread = 2
instance_number = 2
undo_management = AUTO
undo_tablespace = UNDOTBS2
undo_retention = 29880
remote_login_passwordfile= EXCLUSIVE
db_domain =
dispatchers = (PROTOCOL=TCP) (SERVICE=OSISTAXDB)
local_listener = (address=(protocol=tcp)(port=1521)(host=132.147.160.243))
remote_listener = LISTENERS_OSISTA
job_queue_processes = 10
background_dump_dest = /oracle/product/admin/OSISTA/bdump
user_dump_dest = /oracle/product/admin/OSISTA/udump
core_dump_dest = /oracle/product/admin/OSISTA/cdump
audit_file_dest = /oracle/product/admin/OSISTA/adump
db_name = OSISTA
open_cursors = 300
pga_aggregate_target = 104857600
aq_tm_processes = 1
Cluster communication is configured to use the following interface(s) for this instance
172.16.0.2
Wed Jun 13 11:06:16 2012
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PMON started with pid=2, OS id=18682
DIAG started with pid=3, OS id=18684
PSP0 started with pid=4, OS id=18695
LMON started with pid=5, OS id=18704
LMD0 started with pid=6, OS id=18721
LMS0 started with pid=7, OS id=18735
LMS1 started with pid=8, OS id=18753
MMAN started with pid=9, OS id=18767
DBW0 started with pid=10, OS id=18788
LGWR started with pid=11, OS id=18796
CKPT started with pid=12, OS id=18799
SMON started with pid=13, OS id=18801
RECO started with pid=14, OS id=18803
CJQ0 started with pid=15, OS id=18805
MMON started with pid=16, OS id=18807
Wed Jun 13 11:06:17 2012
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=17, OS id=18809
Wed Jun 13 11:06:17 2012
starting up 1 shared server(s) ...
Wed Jun 13 11:06:17 2012
lmon registered with NM - instance id 2 (internal mem no 1)
Wed Jun 13 11:06:17 2012
Reconfiguration started (old inc 0, new inc 2)
List of nodes:
1
Global Resource Directory frozen
* allocate domain 0, invalid = TRUE
Communication channels reestablished
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Wed Jun 13 11:06:18 2012
LMS 0: 0 GCS shadows cancelled, 0 closed
Wed Jun 13 11:06:18 2012
LMS 1: 0 GCS shadows cancelled, 0 closed
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Post SMON to start 1st pass IR
Wed Jun 13 11:06:18 2012
LMS 0: 0 GCS shadows traversed, 0 replayed
Wed Jun 13 11:06:18 2012
LMS 1: 0 GCS shadows traversed, 0 replayed
Wed Jun 13 11:06:18 2012
Submitted all GCS remote-cache requests
Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=20, OS id=18816
Wed Jun 13 11:06:18 2012
ALTER DATABASE MOUNT
Wed Jun 13 11:06:18 2012
This instance was first to mount
Wed Jun 13 11:06:18 2012
Reconfiguration started (old inc 2, new inc 4)
List of nodes:
0 1
Wed Jun 13 11:06:18 2012
Starting background process ASMB
Wed Jun 13 11:06:18 2012
Global Resource Directory frozen
Communication channels reestablished
ASMB started with pid=22, OS id=18913
Starting background process RBAL
* domain 0 valid = 0 according to instance 0
Wed Jun 13 11:06:18 2012
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Wed Jun 13 11:06:18 2012
LMS 0: 0 GCS shadows cancelled, 0 closed
Wed Jun 13 11:06:18 2012
LMS 1: 0 GCS shadows cancelled, 0 closed
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Wed Jun 13 11:06:18 2012
LMS 0: 0 GCS shadows traversed, 0 replayed
Wed Jun 13 11:06:18 2012
LMS 1: 0 GCS shadows traversed, 0 replayed
Wed Jun 13 11:06:18 2012
Submitted all GCS remote-cache requests
Fix write in gcs resources
RBAL started with pid=23, OS id=18917
Reconfiguration complete
Wed Jun 13 11:06:22 2012
SUCCESS: diskgroup DATA was mounted
Wed Jun 13 11:06:26 2012
Setting recovery target incarnation to 1
Wed Jun 13 11:06:26 2012
Successful mount of redo thread 2, with mount id 3005703530
Wed Jun 13 11:06:26 2012
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Completed: ALTER DATABASE MOUNT
Wed Jun 13 11:06:27 2012
ALTER DATABASE OPEN
This instance was first to open
Wed Jun 13 11:06:27 2012
Beginning crash recovery of 1 threads
parallel recovery started with 2 processes
Wed Jun 13 11:06:27 2012
Started redo scan
Wed Jun 13 11:06:27 2012
Completed redo scan
61 redo blocks read, 4 data blocks need recovery
Wed Jun 13 11:06:28 2012
Started redo application at
Thread 2: logseq 7176, block 3
Wed Jun 13 11:06:28 2012
Recovery of Online Redo Log: Thread 2 Group 4 Seq 7176 Reading mem 0
Mem# 0: +DATA/osista/onlinelog/group_4.289.742134597
Wed Jun 13 11:06:28 2012
Completed redo application
Wed Jun 13 11:06:28 2012
Completed crash recovery at
Thread 2: logseq 7176, block 64, scn 506138248
4 data blocks read, 4 data blocks written, 61 redo blocks read
Picked broadcast on commit scheme to generate SCNs
Wed Jun 13 11:06:28 2012
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=28, OS id=19692
Wed Jun 13 11:06:28 2012
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=29, OS id=19695
Wed Jun 13 11:06:28 2012
Thread 2 advanced to log sequence 7177
Thread 2 opened at log sequence 7177
Current log# 3 seq# 7177 mem# 0: +DATA/osista/onlinelog/group_3.291.742134597
Successful open of redo thread 2
Wed Jun 13 11:06:28 2012
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Wed Jun 13 11:06:28 2012
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
Wed Jun 13 11:06:28 2012
ARC1: Becoming the heartbeat ARCH
Wed Jun 13 11:06:28 2012
SMON: enabling cache recovery
Wed Jun 13 11:06:28 2012
db_recovery_file_dest_size of 65368 MB is 0.61% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
SUCCESS: diskgroup FLASH was mounted
SUCCESS: diskgroup FLASH was dismounted
Wed Jun 13 11:06:31 2012
Successfully onlined Undo Tablespace 20.
Wed Jun 13 11:06:31 2012
SMON: enabling tx recovery
Wed Jun 13 11:06:31 2012
Database Characterset is AL32UTF8
Wed Jun 13 11:06:31 2012
Errors in file /oracle/product/admin/OSISTA/udump/osista2_ora_19596.trc:
ORA-00600: code d'erreur interne, arguments : [kokiasg1], [], [], [], [], [], [], []
Wed Jun 13 11:06:32 2012
Errors in file /oracle/product/admin/OSISTA/udump/osista2_ora_19596.trc:
ORA-00600: code d'erreur interne, arguments : [kokiasg1], [], [], [], [], [], [], []
Error 600 happened during db open, shutting down database
USER: terminating instance due to error 600
Instance terminated by USER, pid = 19596
ORA-1092 signalled during: ALTER DATABASE OPEN...
Wed Jun 13 11:11:35 2012
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Interface type 1 eth0 172.16.0.0 configured from OCR for use as a cluster interconnect
Interface type 1 bond0 132.147.160.0 configured from OCR for use as a public interface
Picked latch-free SCN scheme 2
Autotune of undo retention is turned on.
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.3.0.
System parameters with non-default values:
processes = 300
sessions = 335
sga_max_size = 524288000
__shared_pool_size = 318767104
__large_pool_size = 4194304
__java_pool_size = 8388608
__streams_pool_size = 8388608
spfile = +DATA/osista/spfileosista.ora
nls_language = FRENCH
nls_territory = FRANCE
nls_length_semantics = CHAR
sga_target = 524288000
control_files = DATA/osista/controlfile/control01.ctl, DATA/osista/controlfile/control02.ctl
db_block_size = 8192
__db_cache_size = 176160768
compatible = 10.2.0.3.0
log_archive_dest_1 = LOCATION=USE_DB_RECOVERY_FILE_DEST
db_file_multiblock_read_count= 16
cluster_database = TRUE
cluster_database_instances= 2
db_create_file_dest = +DATA
db_recovery_file_dest = +FLASH
db_recovery_file_dest_size= 68543315968
thread = 2
instance_number = 2
undo_management = AUTO
undo_tablespace = UNDOTBS2
undo_retention = 29880
remote_login_passwordfile= EXCLUSIVE
db_domain =
dispatchers = (PROTOCOL=TCP) (SERVICE=OSISTAXDB)
local_listener = (address=(protocol=tcp)(port=1521)(host=132.147.160.243))
remote_listener = LISTENERS_OSISTA
job_queue_processes = 10
background_dump_dest = /oracle/product/admin/OSISTA/bdump
user_dump_dest = /oracle/product/admin/OSISTA/udump
core_dump_dest = /oracle/product/admin/OSISTA/cdump
audit_file_dest = /oracle/product/admin/OSISTA/adump
db_name = OSISTA
open_cursors = 300
pga_aggregate_target = 104857600
aq_tm_processes = 1
Cluster communication is configured to use the following interface(s) for this instance
172.16.0.2
Wed Jun 13 11:11:35 2012
cluster interconnect IPC version:Oracle UDP/IP (generic)
IPC Vendor 1 proto 2
PMON started with pid=2, OS id=16101
DIAG started with pid=3, OS id=16103
PSP0 started with pid=4, OS id=16105
LMON started with pid=5, OS id=16107
LMD0 started with pid=6, OS id=16110
LMS0 started with pid=7, OS id=16112
LMS1 started with pid=8, OS id=16116
MMAN started with pid=9, OS id=16120
DBW0 started with pid=10, OS id=16132
LGWR started with pid=11, OS id=16148
CKPT started with pid=12, OS id=16169
SMON started with pid=13, OS id=16185
RECO started with pid=14, OS id=16203
CJQ0 started with pid=15, OS id=16219
MMON started with pid=16, OS id=16227
Wed Jun 13 11:11:36 2012
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=17, OS id=16229
Wed Jun 13 11:11:36 2012
starting up 1 shared server(s) ...
Wed Jun 13 11:11:36 2012
lmon registered with NM - instance id 2 (internal mem no 1)
Wed Jun 13 11:11:36 2012
Reconfiguration started (old inc 0, new inc 2)
List of nodes:
1
Global Resource Directory frozen
* allocate domain 0, invalid = TRUE
Communication channels reestablished
Master broadcasted resource hash value bitmaps
Non-local Process blocks cleaned out
Wed Jun 13 11:11:36 2012
LMS 0: 0 GCS shadows cancelled, 0 closed
Wed Jun 13 11:11:36 2012
LMS 1: 0 GCS shadows cancelled, 0 closed
Set master node info
Submitted all remote-enqueue requests
Dwn-cvts replayed, VALBLKs dubious
All grantable enqueues granted
Post SMON to start 1st pass IR
Wed Jun 13 11:11:36 2012
LMS 1: 0 GCS shadows traversed, 0 replayed
Wed Jun 13 11:11:36 2012
LMS 0: 0 GCS shadows traversed, 0 replayed
Wed Jun 13 11:11:36 2012
Submitted all GCS remote-cache requests
Fix write in gcs resources
Reconfiguration complete
LCK0 started with pid=20, OS id=16235
Wed Jun 13 11:11:37 2012
ALTER DATABASE MOUNT
Wed Jun 13 11:11:37 2012
This instance was first to mount
Wed Jun 13 11:11:37 2012
Starting background process ASMB
ASMB started with pid=22, OS id=16343
Starting background process RBAL
RBAL started with pid=23, OS id=16347
Wed Jun 13 11:11:44 2012
SUCCESS: diskgroup DATA was mounted
Wed Jun 13 11:11:49 2012
Setting recovery target incarnation to 1
Wed Jun 13 11:11:49 2012
Successful mount of redo thread 2, with mount id 3005745065
Wed Jun 13 11:11:49 2012
Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
Completed: ALTER DATABASE MOUNT
Wed Jun 13 11:22:25 2012
alter database open
This instance was first to open
Wed Jun 13 11:22:26 2012
Beginning crash recovery of 1 threads
parallel recovery started with 2 processes
Wed Jun 13 11:22:26 2012
Started redo scan
Wed Jun 13 11:22:26 2012
Completed redo scan
61 redo blocks read, 4 data blocks need recovery
Wed Jun 13 11:22:26 2012
Started redo application at
Thread 1: logseq 7927, block 3
Wed Jun 13 11:22:26 2012
Recovery of Online Redo Log: Thread 1 Group 1 Seq 7927 Reading mem 0
Mem# 0: +DATA/osista/onlinelog/group_1.283.742132543
Wed Jun 13 11:22:26 2012
Completed redo application
Wed Jun 13 11:22:26 2012
Completed crash recovery at
Thread 1: logseq 7927, block 64, scn 506178382
4 data blocks read, 4 data blocks written, 61 redo blocks read
Switch log for thread 1 to sequence 7928
Picked broadcast on commit scheme to generate SCNs
Wed Jun 13 11:22:27 2012
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=31, OS id=13010
Wed Jun 13 11:22:27 2012
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=32, OS id=13033
Wed Jun 13 11:22:27 2012
Thread 2 opened at log sequence 7178
Current log# 4 seq# 7178 mem# 0: +DATA/osista/onlinelog/group_4.289.742134597
Successful open of redo thread 2
Wed Jun 13 11:22:27 2012
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Wed Jun 13 11:22:27 2012
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
Wed Jun 13 11:22:27 2012
ARC1: Becoming the heartbeat ARCH
Wed Jun 13 11:22:27 2012
SMON: enabling cache recovery
Wed Jun 13 11:22:30 2012
db_recovery_file_dest_size of 65368 MB is 0.61% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
SUCCESS: diskgroup FLASH was mounted
SUCCESS: diskgroup FLASH was dismounted
Wed Jun 13 11:22:31 2012
Successfully onlined Undo Tablespace 20.
Wed Jun 13 11:22:31 2012
SMON: enabling tx recovery
Wed Jun 13 11:22:32 2012
Database Characterset is AL32UTF8
Wed Jun 13 11:22:32 2012
Errors in file /oracle/product/admin/OSISTA/udump/osista2_ora_11751.trc:
ORA-00600: code d'erreur interne, arguments : [kokiasg1], [], [], [], [], [], [], []
Wed Jun 13 11:22:33 2012
Errors in file /oracle/product/admin/OSISTA/udump/osista2_ora_11751.trc:
ORA-00600: code d'erreur interne, arguments : [kokiasg1], [], [], [], [], [], [], []
Error 600 happened during db open, shutting down database
USER: terminating instance due to error 600
Instance terminated by USER, pid = 11751
ORA-1092 signalled during: alter database open...
regards,

Hi;
Errors in file /oracle/product/admin/OSISTA/udump/osista2_ora_9174.trc:Did you check trc file?
ORA-00600: code d'erreur interne, arguments : [kokiasg1], [], [], [], [], [], [], []You are getting oracle internal error(ORA 600) which mean you could need to work wiht oracle support team. Please see below note, if its not help than i suggest log a sr:
Troubleshoot an ORA-600 or ORA-7445 Error Using the Error Lookup Tool [ID 153788.1]
for your future rac issue please use Forum Home » High Availability » RAC, ASM & Clusterware Installation which is RAC dedicated forum site.
Regard
Helios

Getting error while starting the RAC instance through SRVCTL utility

Hi DBA's,
We are getting the below error while starting the Orcale 10g RAC instance on one of the node thru SRVCTL:
oracle:/home/oracle]>srvctl start instance -d SQLTSTM2 -i SQLTSTM21
PRKP-1001 : Error starting instance SQLTSTM21 on node r1racd
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.SQLTSTM2.SQLTSTM21.inst' has placement error.
:oracle:/home/oracle]>
srvctl status database -d SQLTSTM2
PRKO-2015 : Error in checking condition of instance on node: r1racd
Instance SQLTSTM22 is running on node r2racd
oracle:/opt/oracle/product/10.2.0/db]>
NOTE: but i am able to start the instance thru SQLPLUS.
After starting the instance thru SQLPLUS i checked the CRS_STAT -t . It shows the status offline... Please find the details below:
Name Type Target State Host
ora....21.inst application OFFLINE OFFLINE
ora....22.inst application ONLINE ONLINE r2racd
ora....VLM2.db application ONLINE ONLINE r2racd
ora....21.inst application ONLINE ONLINE r1racd
ora....22.inst application ONLINE ONLINE r2racd
ora....STM2.db application ONLINE ONLINE r2racd
ora....SM1.asm application ONLINE ONLINE r1racd
ora....CD.lsnr application ONLINE ONLINE r1racd
ora.r1racd.gsd application ONLINE ONLINE r1racd
ora.r1racd.ons application ONLINE ONLINE r1racd
ora.r1racd.vip application ONLINE ONLINE r1racd
ora....SM2.asm application ONLINE ONLINE r2racd
ora....CD.lsnr application ONLINE ONLINE r2racd
ora.r2racd.gsd application ONLINE ONLINE r2racd
ora.r2racd.ons application ONLINE ONLINE r2racd
ora.r2racd.vip application ONLINE ONLINE r2racd
Thanks in advance...
Anil

Use the 'srvctl config database -d ' command to check if the instance has been configured in the Oracle Cluster Registry; make sure that the GSDs are running on each node in the cluster.
Also refere to Metalink note 295328.1

SRVCTL START DATABASE FAILS WITH ORA-00119

Hi,
My DB version is 11.2.0.2.3
I am able to start the DB thorough sqlplus as conventional way.But when I am trying to start using SRVCTL it gives the following errors:
CRS-5017: The resource action "ora.****.db start" encountered the following error:
SRVCTL START DATABASE FAILS WITH ORA-00119: invalid specification for system parameter LOCAL_LISTENER
ORA-00132: syntax error or unresolved network name 'LISTENER_local'
Can you please suggest for any workaround.
Thanks

Did you check the TNS_ADMIN? Where does it point to?
Also check if you have all the network files placed under the directory pointed to by TNS_ADMIN.
sqlnet.ora
listener.ora
tnsnames.ora

Cannot start RAC DB using srvctl start database

Similar Messages

Maybe you are looking for