Failed to upgrade Oracle Cluster Registry configuration

I'm making a new installation of Oracle RAC environment, the clusterware version is 10 and therefore the RDBMS, I'm using oracle linux 5 update 7, the installation is being performed on only one machine. The problem occurs at the end of the installation when I try to run / u01/app/oracle/product/10.2.0/crs/root.sh the error messages are:
Failed to upgrade Oracle Cluster Registry configuration, which is issued shortly after the execution of root.sh.
And in the log the error message is:
31/10/2011 11:36:36.654: [OCRCONF] [103401184] ocrconfig starts ...
31/10/2011 11:36:36.654: [OCRCONF] [103401184] Upgrading OCR data
31/10/2011 11:36:36.661: [OCRCONF] [103401184] OCR Already in current version.
31/10/2011 11:36:36.669: [OCRCONF] [103401184] Failed to call clsssinit (21)
31/10/2011 11:36:36.670: [OCRCONF] [103401184] Failed to make a backup copy of OCR
31/10/2011 11:36:36.670: [OCRCONF] [103401184] Exiting [status = failed] ...
If anyone has faced this error and won, I'm accepting suggestions.
Att.
Italo Moisés dos Santos.

Hi;
For your issue i suggest close your thread here as changing thread status to answered and move it to Forum Home » Grid Computing » RAC, ASM & Clusterware Installation which you can get more quick response
Regard
Helios

Similar Messages

10.2.0.1 RHEL 4.0 - root.sh CRS - Failed to upgrade Oracle Cluster Registry

I am trying to install 10.2.0.1 CRS on a 2 node cluster on RHEL 4.0 Nahant Update 7. I get the following errors when root.sh is run
Failed to upgrade Oracle Cluster Registry configuration._
Due to this reason , none of the clusterware background processes fail to start, following which the Configuration Assistant screen also experiences failure (Oracle Notification Server Configuration Assistant).
I tried to apply the 10.2.0.4 patchset also, still same issue. Did anyone see this issue ?
1) We use LINUX DEVICE MAPPER for multipathing and udev
2) We configured the multipathing device partitions and bound them to raw devices
So /dev/mapper/oradisk1 bound to /dev/raw/raw1 ( OCR disk)
and /dev/mapper/oradisk2 bound to /dev/raw/raw2 (VD)
I am able to perform the dd command successfully.
Any ideas ?
-Srinivas

BTW, we our OS is Linux x86-64 with RHEL 4.0 Nahant Update 7. I also applied the patch 4679769.
Did a complete uninstall and reinstall. But issue persists.
-Srinivas

FATAL [INS-41311] One or more Oracle Cluster Registry (OCR) locations spec

I'm installing 11.2.0.3 Grid Infrastructure on Red Hat 5.7. I'm receiving the following error that I pasted below. There isn't a whole lot of information regarding it. It seems that the install sees an existing CRS install, but the NFS volumes are empty. This is a fresh install. I ran cleanup, but there's nothing to remove. Any help or insight will be appreciated.
Thank you
INFO: Checking path: /u02/udev/devices/ocr1
INFO: Checking path: /u03/udev/devices/ocr2
INFO: Checking path: /u04/udev/devices/ocr3
INFO: Validating for writability
INFO: Validating for valid OCR locations
INFO: Validating OCR locations.
INFO: validating if it is an existing directory.
INFO: Validating for free space
INFO: PATH has :==>/tmp/OraInstall2012-03-31_12-30-37AM/jdk/jre/lib/amd64/server:/tmp/OraInstall2012-03-31_12-30-37AM/jdk/jre/lib/amd64:/tmp/OraInstall2012-03-31_12-30-37AM/jdk/jre/../lib/amd64
INFO: PATH has :==>/tmp/OraInstall2012-03-31_12-30-37AM/jdk/jre/lib/amd64/server:/tmp/OraInstall2012-03-31_12-30-37AM/jdk/jre/lib/amd64:/tmp/OraInstall2012-03-31_12-30-37AM/jdk/jre/../lib/amd64
INFO: PATH has :==>/tmp/OraInstall2012-03-31_12-30-37AM/jdk/jre/lib/amd64/server:/tmp/OraInstall2012-03-31_12-30-37AM/jdk/jre/lib/amd64:/tmp/OraInstall2012-03-31_12-30-37AM/jdk/jre/../lib/amd64
SEVERE: [FATAL] [INS-41311] One or more Oracle Cluster Registry (OCR) locations specified are in an existing OCR directory.
CAUSE: One or more Oracle Cluster Registry (OCR) locations specified were in directories with existing OCR files.
ACTION: Specify locations for Oracle Cluster Registry that are not in use.
INFO: Advice is ABORT

user12006502 wrote:
These are NFS mounts off of NetApp NAS. They are volumes that don't contain anything else but an empty .snapshot subdirectory. This is my first NFS RAC implementation. We followed NetApps best practices for the NFS mount options as well as the export options on the NAS. I'm sort of lost as to what the problem could be. Ran the installer with debug and strace, but I'm still not getting any insight into the issue. Thanks for trying to help.
My first reaction to the failed CRS install is to clean it up. I ran the cleanup steps, but the installer didn't get far enough to generate any files.
I'm using the following NFS mount options:
rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,vers=3,timeo=600,noac,suidUse rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,noac,actimeo=0,vers=3,timeo=600 for Mount points for CRS voting disk and OCR
Doc id - Mount Options for Oracle files when used with NFS on NAS devices [ID 359515.1]

ERROR SPECIFYING ORACLE CLUSTER REGISTRY LOCATION

Hi all,
im implementing oracle RAC 10g on Linux version 4, now i've already prepaired the shared disks on my nodes my situiation is am facing a problem in installing the clusterware where in specifying Oracle Cluster Registry Location it gives me an ERROR saying "The Location entered for the Oracle Cluster Registry is not shared across all the nodes in the cluster. Specify a shared raw partition or cluster file system file that is visible by the same name on all nodes of the cluster".
Thanks in advance!

No wonder! How can node2 see the drive which is local to node1??? I am assuming this is for your home testing. You need to have some kind of shared storage to implement RAC - typical examples are FireWire or alternatively NFS shares/mounts. There is an article on OTN which talks about implementing RAC using Firewire in RAC. Or you check out my blog entry http://chandradba.blogspot.com/2007/08/oracle-11g-rac-install-on-red-hat-50.html which talks about implementing RAC using NFS shares.
As I said, these configuration are not for other than your own testing....meaning non-production usage.
HTH
Thanks
-Chandra Pabba

'dns' server failed to upgrade the Network Registrar configuration databases!!!

I have problem with installation the Network Registrar 7.2. According to the install log: "The 'dhcp' server failed to upgrade the Network Registrar configuration databases !!! See C:\NetworkRegistrar\Local\temp/dhcp_upgrade_status_log for details." The dhcp_upgrade_status_log is not found on my PC.
Do somebody familar with such problem?
Thank in advance.

Hi Dave,
Any luck on this thread? Where you able to find a work around on this problem? I am encountering also the same problem thou my OCR and Voting Disk are on raw partition.
I have done clean-up using the "dd" command and re-install CRS a couple of times and still with no luck...
Hope RAC gurus can help us on this.
Any help would be much appreciated.
Thanks!

Avertissement:"Echec de l'installation d'oracle cluster Registry (ORC)"

Hi,
Where I'am installing Oracle 10g, I received the following Avertissement:"Echec de l'installation d'oracle cluster Registry (ORC)".When i clicked OK the installation continue.Please can some
explain me what is the problem?
Thanks
Edited by: user12295522 on 1 déc. 2009 10:55

Without more information it is hard to help ...Even harder without any information about OS and database version (10g is an Oracle marketing label and no version).
Werner

Failed to install Oracle Service Registry

I tried to install OSR 10.1.3.1 before deploying AIA, however, the installation is not going on smoothly...
* I am doing this through VMWAre environment (RHEL5, SOA Suite 10.1.3.3, Oracle DB 10.2.0.2)
I have encountered several issues:
1) the installation screen are not properly formatted, and most of the information is actually missing...
2) at the beginning of the installation, i received a message: null, Installation Failed.
besides that, I would like to ask which ORACLE_HOME should we point to? the one for database or SOA?
Could anyone help me on these issues?
Thanks

Hi,
Please follow the below procedure for successfull installation of Service Registry
Create a Schema in the database to accommodate the registry.
Connect system/welcome1 as sysdba;
a. Create schema uddi identified by welcome1;
b. Grant connect,resource to uddi;
1. Start Oracle service registry by tying the following command in the command prompt
Java –jar oracle-service-registry-10.1.3.1.jar
2. Select Standalone Registry.
3. Select the path D:\oracle\registry_10_1_3 for registry.
4. Specify Administrator account details.
( note:keep user name as admin for successfull insatallation)
Administrator Username: Admin
Administrator Password: ********
Confirm Password: *******
Administrator Email:
5. Select Create Schema, choose Oracle 9i and later option
6. Provide Database details
Database Server address: ********
Database Server port: 1521
Existing Database Name: *******
Database User: uddi
Database User Password: ******
7. Check create data source in the application server.
8. Select JDBC Drivers under middle tier of SOA suite
D:\SOAproduct\10.1.3.1\SOA\jdbc\lib\classes12_g.jar
9. Provide application server details
Oracle Home: D:\SOAproduct\10.1.3.1\SOA
OPMN Host: ********
OPMN Port: 6003
Instance name: home
Oracle Administrator: oc4jadmin
Administrator Password: welcome1.
Note:
To access service registry use the following login information
Username: admin
Password: welcome1

ORACLE NOTIFICATION SERVER CONFIGURATION ASSISTANT(CLUSTERWARE)-FAIL

While Installing Oracle RAC Release 2 on Solaris 10 with NFS Mount, i am running into the following issue.
Step 1:
./root.sh
bash-3.00# ./root.sh
WARNING: directory '/opt/oracle/product/10.2.0' is not owned by root
WARNING: directory '/opt/oracle/product' is not owned by root
WARNING: directory '/opt/oracle' is not owned by root
chown: /data/media/RAC/voting/CSSVoteDisk0.dbf: Not owner
1
bash-3.00#
Step 2:
cd /opt/oracle/product/10.2.0/crs_1/cfgtoollogs
-bash-3.00$ ./configToolFailedCommands
PRIF-12: failed to initialize cluster support services
I believe the issue, here is location of ocr.loc file. I do not have ocr.loc file created yet.
$cat oifcfg.log
2007-05-10 13:37:48.612: [ COMMCRS][1]clsc_connect: (10043a620) NS err (12545, 12560), transport (515, 95, 0)
2007-05-10 13:37:48.614: [ OCROSD][1]utgdv:2:ocr loc file cannot be opened
2007-05-10 13:37:48.614: [ OCROSD][1]utopen:1: Couldnt find ocr,[ocrmirror] location in config file
2007-05-10 13:37:48.615: [ OCRRAW][1]proprinit: Could not open raw device
2007-05-10 13:37:48.615: [ default][1]a_init:7!: Backend init unsuccessful : [33]
2007-05-10 13:37:48.615: [ CSSCLNT][1]clsssinit: error(33 ) in OCR initialization
Any Thoughts.
Thanks
-Prasad
Message was edited by:
pinjam
Message was edited by:
pinjam
Message was edited by:
pinjam

Just in case anyone finds this thread, the problem is that the NFS mount is not configured properly, and thus the root.sh script is failing almost straight away.
Ensure that the NFS server has the following options in /etc/dfs/dfstab (Solaris 10) to allow root access:
share -F nfs -o rw,root=orac1.domain.com:orac2.domain.com /oraclerac/crs_files
share -F nfs -o rw,root=orac1.domain.com:orac2.domain.com /oraclerac/oradata
You can find out if this is the problem simply by (as root) trying to chown a file anywhere on the NFS mount.
Output of the root.sh script should be more like this:
WARNING: directory '/u01/crs/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u01/crs/oracle/product' is not owned by root
WARNING: directory '/u01/crs/oracle' is not owned by root
WARNING: directory '/u01/crs' is not owned by root
WARNING: directory '/u01' is not owned by root
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.
Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/u01/crs/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u01/crs/oracle/product' is not owned by root
WARNING: directory '/u01/crs/oracle' is not owned by root
WARNING: directory '/u01/crs' is not owned by root
WARNING: directory '/u01' is not owned by root
assigning default hostname rac1 for node 1.
assigning default hostname rac2 for node 2.
etc etc

Error while installing Oracle Cluster Ready Services Release 1 (10.1.0.2)

Hi all,
I am trying for RAC 10gR1 (10.1.0.2) using two machines with Windows 2000 Server. For this I need to install Oracle Cluster Ready Services Release 1 (10.1.0.2).
Machine details are as follows:-
Node 1:
Computer Name:     RAC1
Windows 2000 IP Configuration
Ethernet adapter Local Area Connection 2: (Used for Public Interface)
Connection-specific DNS Suffix . :
IP Address. . . . . . . . . . . . : 192.168.1.65
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
Ethernet adapter Local Area Connection: (Used for Private Interface between the two nodes)
Connection-specific DNS Suffix . :
IP Address. . . . . . . . . . . . : 10.10.10.11
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
Node 2:
     Computer Name:     RAC2
Windows 2000 IP Configuration
Ethernet adapter Local Area Connection 2: (Used for Public Interface)
Connection-specific DNS Suffix . :
IP Address. . . . . . . . . . . . : 192.168.1.181
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
Ethernet adapter Local Area Connection: (Used for Private Interface between the two nodes)
Connection-specific DNS Suffix . :
IP Address. . . . . . . . . . . . : 10.10.10.12
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
I have made following entries in Hosts file of both the machines:-
192.168.1.65     RAC1
192.168.1.181     RAC2
10.10.10.11     RAC01-PRIV
10.10.10.12     RAC02-PRIV
192.168.1.201     RAC01-VIP
192.168.1.202     RAC02-VIP
I have completed all the pre-installation steps, i.e. configuring the disk for storage, and both the machine are communicating each other through there Private and Public interfaces. Now the problem appears when I am installing Oracle Cluster Ready Services, at the end of Installation following message appears and the auto configuration steps fails.
================================================================================================================
Output generated from configuration assistant "Oracle Cluster Ready Services Configuration Assistant":
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: rac1 rac01-priv rac1
node 2: rac2 rac02-priv rac2
Creating OCR keys for user 'administrator', privgrp ''..
Operation successful.
Now formatting voting device: \\.\votedsk
Successful in setting block0 for voting disk.
Format complete.
Step 1: checking status of CRS cluster
Step 2: configuring OCR repository
Step 3: configuring safe mode for CRS stack
Step 4: Starting up CRS stack on all nodes
RAC1 service OracleCSService in improper PENDING state, err(997)
RAC2 service OracleCSService in improper PENDING state, err(997)
Configuration assistant "Oracle Cluster Ready Services Configuration Assistant" failed
================================================================================================================
Output generated from configuration assistant "Oracle Notification Server Configuration Assistant":
Configuration assistant "Oracle Notification Server Configuration Assistant" failed
================================================================================================================
Output generated from configuration assistant "Oracle Private Interconnect Configuration Assistant":
PRIF-10: failed to initialize the cluster registry
Configuration assistant "Oracle Private Interconnect Configuration Assistant" failed
===============================================================
I would be highly obliged if any one tell me why it is happing like this and what could be the possible remedy.
Waiting for the respone.
With Regards
Dinesh
[email protected]

Hi user478171,
I have the same problem with two nodes in Windows 2003 with RAC 10g R2, but I don't have idea to solve.
Please advice me
Thanks advances
regards,
IvanR

RAC - Oracle Grid Infrastructure configure failed

Hi, am trying to install 2 node RAC on Oracle VMs. Before the installation during the -preinst check there were few issues which were resolved (ex user equivalence). After that during the installation process of the Grid it failed at step "Configure Oracle Grid Infrastructure for a cluster". After it failed at this step, subsequent steps too failed which I asked OUI to ignore and then I ran both the post installation scripts. And then ran post crsinst which failed. Pasting below the output of the root.sh script, post crsinst and other checks.
[root@bsfrac01 grid]# sh root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/11.2/grid
Enter the full pathname of the local bin directory: [usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2011-02-13 00:11:55: Parsing the host name
2011-02-13 00:11:55: Checking for super user privileges
2011-02-13 00:11:55: User has super user privileges
Using configuration parameter file: /u01/app/11.2/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-2672: Attempting to start 'ora.gipcd' on 'bsfrac01'
CRS-2672: Attempting to start 'ora.mdnsd' on 'bsfrac01'
CRS-2676: Start of 'ora.mdnsd' on 'bsfrac01' succeeded
CRS-2676: Start of 'ora.gipcd' on 'bsfrac01' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'bsfrac01'
CRS-2676: Start of 'ora.gpnpd' on 'bsfrac01' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'bsfrac01'
CRS-2676: Start of 'ora.cssdmonitor' on 'bsfrac01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'bsfrac01'
CRS-2672: Attempting to start 'ora.diskmon' on 'bsfrac01'
CRS-2676: Start of 'ora.diskmon' on 'bsfrac01' succeeded
CRS-2676: Start of 'ora.cssd' on 'bsfrac01' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'bsfrac01'
CRS-2676: Start of 'ora.ctssd' on 'bsfrac01' succeeded
ASM created and started successfully.
DiskGroup DATA1 created successfully.
clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-2672: Attempting to start 'ora.crsd' on 'bsfrac01'
CRS-2676: Start of 'ora.crsd' on 'bsfrac01' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 0ea2052d8a714fd7bf46d9d5c785483e.
Successfully replaced voting disk group with +DATA1.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
1. ONLINE 0ea2052d8a714fd7bf46d9d5c785483e (ORCL:DISK1) [DATA1]
Located 1 voting disk(s).
*Failed to rmtcopy "/tmp/filekRIMbG" to "/u01/app/11.2/grid/gpnp/manifest.txt" for nodes {bsfrac01,bsfrac02}, rc=256*
*Failed to rmtcopy "/u01/app/11.2/grid/gpnp/bsfrac01/profiles/peer/profile.xml" to "/u01/app/11.2/grid/gpnp/profiles/peer/profile.xml" for nodes {bsfrac01,bsfrac02}, rc=256*
rmtcopy aborted
Failed to promote local gpnp setup to other cluster nodes
CRS-2673: Attempting to stop 'ora.crsd' on 'bsfrac01'
CRS-2677: Stop of 'ora.crsd' on 'bsfrac01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'bsfrac01'
CRS-2677: Stop of 'ora.asm' on 'bsfrac01' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'bsfrac01'
CRS-2677: Stop of 'ora.ctssd' on 'bsfrac01' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'bsfrac01'
CRS-2677: Stop of 'ora.cssdmonitor' on 'bsfrac01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'bsfrac01'
CRS-2677: Stop of 'ora.cssd' on 'bsfrac01' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'bsfrac01'
CRS-2677: Stop of 'ora.gpnpd' on 'bsfrac01' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'bsfrac01'
CRS-2677: Stop of 'ora.gipcd' on 'bsfrac01' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'bsfrac01'
CRS-2677: Stop of 'ora.mdnsd' on 'bsfrac01' succeeded
Initial cluster configuration failed. See /u01/app/11.2/grid/cfgtoollogs/crsconfig/rootcrs_bsfrac01.log for details
[root@bsfrac01 grid]#
[oracle@bsfrac01 bin]$ ./cluvfy stage -post crsinst -n bsfrac01,bsfrac02 -verbose
Performing post-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node "bsfrac01"
Destination Node Reachable?
bsfrac01 yes
bsfrac02 yes
Result: Node reachability check passed from node "bsfrac01"
Checking user equivalence...
Check: User equivalence for user "oracle"
Node Name Comment
bsfrac01 passed
bsfrac02 passed
Result: User equivalence check passed for user "oracle"
ERROR:
PRKC-1094 : Failed to retrieve the active version of crs: {0}
Checking time zone consistency...
Time zone consistency check passed.
ERROR:
PRKC-1093 : Failed to retrieve the version of crs software on node "java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
" : {1}
ERROR:
Cluster manager integrity check failed
PRVF-5434 : Cannot identify the current CRS software version
UDev attributes check for OCR locations started...
Result: UDev attributes check passed for OCR locations
UDev attributes check for Voting Disk locations started...
ERROR:
PRVF-5197 : Failed to retrieve voting disk locationsPRKC-1092 : Failed to retrieve the location of votedisks: java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
Result: UDev attributes check failed for Voting Disk locations
Check default user file creation mask
Node Name Available Required Comment
bsfrac01 0022 0022 passed
bsfrac02 0022 0022 passed
Result: Default user file creation mask check passed
Checking cluster integrity...
Node Name
bsfrac01
Cluster integrity check failed This check did not run on the following node(s):
bsfrac02
Checking OCR integrity...
Checking the absence of a non-clustered configuration...
All nodes free of non-clustered, local-only configurations
ERROR:
PRKC-1094 : Failed to retrieve the active version of crs: {0}
ERROR:
PRVF-5300 : Failed to retrieve active version for CRS on this node
OCR integrity check failed
Checking CRS integrity...
ERROR:
PRKC-1094 : Failed to retrieve the active version of crs: {0}
ERROR:
PRVF-5300 : Failed to retrieve active version for CRS on this node
CRS integrity check failed
OCR detected on ASM. Running ACFS Integrity checks...
Starting check to see if ASM is running on all cluster nodes...
PRVF-5137 : Failure while checking ASM status on node "bsfrac01"
PRVF-5137 : Failure while checking ASM status on node "bsfrac02"
Starting Disk Groups check to see if at least one Disk Group configured...
PRVF-5112 : An Exception occurred while checking for Disk Groups
PRVF-5114 : Disk Group check failed. No Disk Groups configured
Task ACFS Integrity check failed
Checking Oracle Cluster Voting Disk configuration...
ERROR:
PRKC-1093 : Failed to retrieve the version of crs software on node "java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
" : {1}
ERROR:
PRVF-5434 : Cannot identify the current CRS software version
PRVF-5431 : Oracle Cluster Voting Disk configuration check failed
Checking to make sure user "oracle" is not in "root" group
Node Name Status Comment
bsfrac01 does not exist passed
bsfrac02 does not exist passed
Result: User "oracle" is not part of "root" group. Check passed
Post-check for cluster services setup was unsuccessful on all the nodes.
[oracle@bsfrac01 bin]$ /u01/app/11.2/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 408
Available space (kbytes) : 261712
ID : 1671840043
Device/File Name : +DATA1
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check bypassed due to non-privileged user
ASM looks to be up and running..
[oracle@bsfrac01 bin]$ /usr/sbin/oracleasm listdisks
DISK1
DISK2
DISK3
DISK4
DISK5
DISK6
[oracle@bsfrac01 bin]$ /usr/sbin/oracleasm status
Checking if ASM is loaded: yes
Checking if /dev/oracleasm is mounted: yes
Please help.

before installation have u configure the private interconnect on both the nodes to same network adapter..
for example on node 1 if the private interconnect is on eth0 then on the node 2 it should use eth0 only...
for private interconnect use the hostonly option on both the nodes in the network configuration page of the vmware or virtual box..
and for public network it can be bridged
more over if you are installing on the laptop its good to configure the SSH using the OUI.. rather than doing it manually.. as it saves time
the private and the public networks should not have same range of ip address. like if public address are like 192.168.2.222/255.255.255.0 and private address have to be different like 10.10.1.2/255.0.0.0 (this is just an example)
have to configured the NTP.
any ways try installing the oracle rac on virtual box follow the steps given the below website they are pretty straight forward...
http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnOEL5UsingVirtualBox.php

INS-20802 Oracle Private Interconnect Configuration Assistant failed

Thought I would post what information I've gathered, after facing this error during install of RAC Grid Infrastructure 11.2.0.1 on Red Hat Enterprise Linux Server release 5.5 64-bit, as Oracle Support is once again unable to help. Maybe this will save someone else some time and the aggravation of dealing with lousy Oracle Support.
The error occurs after root.sh has successfully completed on all nodes. Oracle Net Configuration Assistant runs successfully, then Oracle Private Interconnect Configuration Assistant launches and subsequently fails with the following.
[INS-20802] Oracle Private Interconnect Configuration Assistant failed.
/u01/app/oraInventory/logs/installActions2010-12-13_01-26-10PM.log
INFO: Starting 'Oracle Private Interconnect Configuration Assistant'
INFO: Starting 'Oracle Private Interconnect Configuration Assistant'
INFO: PRIF-26: Error in update the profiles in the cluster
INFO:
WARNING:
INFO: Completed Plugin named: Oracle Private Interconnect Configuration Assistant
INFO: Oracle Private Interconnect Configuration Assistant failed.
INFO: Oracle Private Interconnect Configuration Assistant failed.
I was able to find another error that coincides with the PRIF-26 error: "CRS-2324:Error(s) occurred while trying to push GPnP profile. State may be inconsistent."
I was also able to duplicate the PRIF-26 error by trying to add a non-existent network interface via oifcfg:
./oifcfg setif -global jjj1/192.167.1.0:cluster_interconnect
PRIF-26: Error in update the profiles in the cluster
My best guess is the Oracle Private Interconnect Configuration Assistant makes a call to oifcfg. When oifcfg makes an update or adds a public/private interface, some XML files are also updated or maybe cross-referenced. These files are located here: <grid_home>/gpnp/<host>/profiles/peer
Any updates/changes/addtions to the private or public interfaces include changes for the Grid Plug-n-Play component, which uses the XML files. If the interface name is not contained in the XML files, my best guess is that triggers the "CRS-2324:Error(s) occurred while trying to push GPnP profile. State may be inconsistent.
I verified everything was configured correctly; the cluster verification utility reported everything was ok. I also ran the cluster verifcation utility against the GP-nP:
./cluvfy comp gpnp -verbose
I also reviewed the public and private interfaces via oifcfg and they are correct:
[oracle@ryoradb1 bin]$ ./oifcfg getif -global
eth0 10.10.2.0 global public
eth1 192.167.1.0 global cluster_interconnect
[oracle@ryoradb1 bin]$ ./oifcfg iflist -p
eth0 10.10.2.0 PRIVATE
eth1 192.167.1.0 UNKNOWN
My conclusion is the environment is configured correctly, in spite of the error generated by the Oracle Private Configuration Assistant.

I understand that you have installed 11.2.0.1 not 11.2.0.2 because multicating must be enabled if you have installed 11.2.0.2 and you may face these sort of problems because cluster nodes would not be able to communicate with each other.
Please check ocssd.log especially on the first node because this file will give more inforamtion as to why first node is not able to push GPnP file. As you have executed cluvfy to confirm the GPnP but to confirm whether GPnP profile is accurate to just narrow down the problem, I would suggest you to try to start cluster in exclusive mode so that you can sure that GPnP profile is good.
Shutdown CRS on all nodes, if there is any hung processes then kill them before executing the fllowing command to start cluster in exclusive mode.
$GRID_HOME/bin/crsctl start crs -excl
If you are able to start cluster in exclusive then it is sure that GPnP is correct and then next step would be to verify the private network.
See how you goes.
FYI, I was recently analyzing the same sort of problems where cluster was not able to access GPnP profile and finally I found issues on my private network. Customer had enabled IGMP snooping, which was avoiding multicast communication over the private network but it was 11.2.0.2, which is not the case here.
Harish Kumar
http://www.oraxperts.com

Error while checking the status of Oracle Cluster ware

Hi
I was trying to install the database using dbca after setting up the grid and database software on LINUX x86-64 RHEL 5.7 machine. The database software version is 11.2.0.3. It throwing the error regarding the connectivity of clusterware. So I checked the status of clusterware.
-bash-3.2$ ./crsctl stat res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
-bash-3.2$
But when I ran below one:
-bash-3.2$ ./crsctl stat res -t -init
NAME TARGET STATE SERVER STATE_DETAILS
Cluster Resources
ora.asm
1 ONLINE ONLINE sfv9699 Started
ora.cluster_interconnect.haip
1 ONLINE ONLINE sfv9699
ora.crf
1 ONLINE ONLINE sfv9699
ora.crsd
1 ONLINE OFFLINE
ora.cssd
1 ONLINE ONLINE sfv9699
ora.cssdmonitor
1 ONLINE ONLINE sfv9699
ora.ctssd
1 ONLINE ONLINE sfv9699 OBSERVER
ora.diskmon
1 OFFLINE OFFLINE
ora.drivers.acfs
1 ONLINE ONLINE sfv9699
ora.evmd
1 ONLINE INTERMEDIATE sfv9699
ora.gipcd
1 ONLINE ONLINE sfv9699
ora.gpnpd
1 ONLINE ONLINE sfv9699
ora.mdnsd
1 ONLINE ONLINE sfv9699
So i saw that the crsd having some issue. I checked the alert log and crsd log. Below are the output.
Alert <server_name>.log
2012-10-20 15:37:51.408
[ohasd(3694)]CRS-2765:Resource 'ora.crsd' has failed on server 'sfv9699'.
2012-10-20 15:37:52.968
[crsd(5188)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle2/app/11.2.0/grid/log/sfv9699/crsd/crsd.log.
2012-10-20 15:37:52.984
[crsd(5188)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
]. Details at (:CRSD00111:) in /oracle2/app/11.2.0/grid/log/sfv9699/crsd/crsd.log.
2012-10-20 15:37:53.471
[ohasd(3694)]CRS-2765:Resource 'ora.crsd' has failed on server 'sfv9699'.
2012-10-20 15:37:53.472
[ohasd(3694)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
CRSD.log
2012-10-20 15:37:52.456: [ CRSMAIN][3563381328] Checking the OCR device
2012-10-20 15:37:52.457: [ CRSMAIN][3563381328] Sync-up with OCR
2012-10-20 15:37:52.457: [ CRSMAIN][3563381328] Connecting to the CSS Daemon
2012-10-20 15:37:52.457: [ CRSMAIN][3563381328] Getting local node number
2012-10-20 15:37:52.459: [ CRSMAIN][3563381328] Initializing OCR
[   CLWAL][3563381328]clsw_Initialize: OLR initlevel [70000]
2012-10-20 15:37:52.897: [ OCRASM][3563381328]proprasmo: Error in open/create file in dg [DATA]
[ OCRASM][3563381328]SLOS : SLOS: cat=7, opn=kgfoAl06, dep=27140, loc=kgfokge
2012-10-20 15:37:52.898: [ OCRASM][3563381328]ASM Error Stack : ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: kgfoCheckMount returned [7]
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: The ASM instance is down
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: Failed to open [+DATA]. Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: No OCR/OLR devices are usable
2012-10-20 15:37:52.968: [ OCRASM][3563381328]proprasmcl: asmhandle is NULL
2012-10-20 15:37:52.969: [    GIPC][3563381328] gipcCheckInitialization: possible incompatible non-threaded init from [prom.c : 690], original from [clsss.c : 5326]
2012-10-20 15:37:52.975: [ default][3563381328]clsvactversion:4: Retrieving Active Version from local storage.
2012-10-20 15:37:52.978: [ CSSCLNT][3563381328]clssgsgrppubdata: group (ocr_SFV9699-cluster) not found
2012-10-20 15:37:52.978: [ OCRRAW][3563381328]proprio_repairconf: Failed to retrieve the group public data. CSS ret code [20]
2012-10-20 15:37:52.981: [ OCRRAW][3563381328]proprioo: Failed to auto repair the OCR configuration.
2012-10-20 15:37:52.981: [ OCRRAW][3563381328]proprinit: Could not open raw device
2012-10-20 15:37:52.981: [ OCRASM][3563381328]proprasmcl: asmhandle is NULL
2012-10-20 15:37:52.983: [ OCRAPI][3563381328]a_init:16!: Backend init unsuccessful : [26]
2012-10-20 15:37:52.984: [ CRSOCR][3563381328] OCR context init failure. Error: PROC-26: Error while accessing the physical storage
ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.984: [ CRSMAIN][3563381328] Created alert : (:CRSD00111:) : Could not init OCR, error: PROC-26: Error while accessing the physical storage
ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.984: [    CRSD][3563381328][PANIC] CRSD exiting: Could not init OCR, code: 26
2012-10-20 15:37:52.984: [    CRSD][3563381328] Done.
=======================
I see in the above log that saying ASM instance is down and failed to open +DATA .
But the asm instance up and running
SQL> select instance_name,status from v$instance;
INSTANCE_NAME STATUS
+ASM1            STARTED
And we havent created any disk named DATA before the installation. We have created only below two disks
SQL> select name,header_status from v$asm_disk;
NAME HEADER_STATUS
ASM_DATA MEMBER
FLASH_RECOVERY MEMBER
But I am seeing a diskgroup in the v$asm_diskgroup which we havent created.
SQL> select name,state from v$asm_diskgroup;
NAME STATE
DATA MOUNTED
Ya this is a second time installtion. In the first installtion we created the asmdisk as DATA. But later everything (RAW device ) was formatted and this new disks has been created and installtion again started
[root@SFV9699 bin]# oracleasm listdisks
ASM_DATA
FLASH_RECOVERY
Seems like its trying to read the old disk DATA.
we have done asmscanning too with oracleasm scan disks. but no use.
Where I can remove the old entry of DATA disk.
It would be a great if a quick response get.
Thanks
SHIYAS M

The permission looks fine. If it was permission issue then y it is trying to read the DATA disk which I havent created this time at all ( But created in the first installation).
2012-10-20 15:37:52.459: [ CRSMAIN][3563381328] Initializing OCR
[ CLWAL][3563381328]clsw_Initialize: OLR initlevel [70000]
2012-10-20 15:37:52.897: [ OCRASM][3563381328]proprasmo: *Error in open/create file in dg [DATA]*[ OCRASM][3563381328]SLOS : SLOS: cat=7, opn=kgfoAl06, dep=27140, loc=kgfokge
2012-10-20 15:37:52.898: [ OCRASM][3563381328]ASM Error Stack : ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: kgfoCheckMount returned [7]
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: The ASM instance is down
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: *Failed to open [+DATA].* Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: No OCR/OLR devices are usable
2012-10-20 15:37:52.968: [ OCRASM][3563381328]proprasmcl: asmhandle is NULL
The only disks created are
[root@SFV9699 dev]# oracleasm listdisks
ASM_DATA
FLASH_RECOVERY
And these disks are showing part of that group also.. Not quite sure how this happened..
what abt dropping this group.. will anything work.

Upgrade Oracle Database in Oracle Fail Safe configuration.

Dear All,
I usually upgrade Oracle Database (10g, 10g r2, 11g, 11g r2) in stand alone configuration without problems.
Now, I will must upgrade one database from 11g to 11g r2 in Fail Safe configuration.
Please, is there some link to read before this operation ?
Many thx.

Pl see if MOS Doc 223709.1 (How to upgrade or apply a patch to the RDBMS in an Oracle Fail Safe environment) can help
HTH
Srini

Installation of oracle fail safe on windows cluster - plz very urgent

hi everybody,
this is the first time i am going to install oracle failsafe on windows clusters.
i am going to install oracle 9i release 2 software.
so i have to install the patches.
plz tell me with oracle cmds how to do the following.
1. after installing oracle 9i rel 2 how to install the patches to it in windows environment?
2. how to create oracle database on one node using shared disk for storage.
3. how to install oracle fail safe on each cluster?
4. how to configure cluster using fail safemanager?
plz provide me soln asap very urgent.
and don't forget to give me the soln with commands aqnd step by step.
plz plz plz
thanks in advance
suresh

For 9i , this is better:
http://download-uk.oracle.com/docs/cd/B10501_01/rac.920/a96600/toc.htm

"Oracle Cluster Verification Utility" failed - 10gR2 - VMware - CentOS 4

Hi,
While installing 10g R2 on VMWare with CentOS 4, I am encountering an error:
Command = /u01/crs/oracle/product/10.2.0/crs/bin/cluvfy has failed
INFO: Configuration assistant "Oracle Cluster Verification Utility" failed
*** Starting OUICA ***
Oracle Home set to /u01/crs/oracle/product/10.2.0/crs
Configuration directory is set to /u01/crs/oracle/product/10.2.0/crs/cfgtoollogs. All xml files under the directory will be processed
INFO: The "/u01/crs/oracle/product/10.2.0/crs/cfgtoollogs/configToolFailedCommands" script contains all commands that failed, were skipped or were cancelled. This file may be used to run these configuration assistants outside of OUI. Note that you may have to update this script with passwords (if any) before executing the same.
SEVERE: OUI-25031:Some of the configuration assistants failed. It is strongly recommended that you retry the configuration assistants at this time. Not successfully running any "Recommended" assistants means your system will not be correctly configured.
1. Check the Details panel on the Configuration Assistant Screen to see the errors resulting in the failures.
2. Fix the errors causing these failures.
3. Select the failed assistants and click the 'Retry' button to retry them.
INFO: User Selected: Yes/OK
The logs show me:
COMMAND=/u01/crs/oracle/product/10.2.0/crs/bin/cluvfy stage -post crsinst -n rac1,rac2
Checking the version of OCR...
OCR of correct Version "2" exists.
Checking data integrity of OCR...
ERROR:
OCR integrity results are inconsistent amongst the nodes.
OCR integrity found invalid for nodes: rac2
OCR integrity found valid for nodes: rac1
OCR integrity check failed.
I have replaced "clsfmt.bin" with patch 4679769 to avoid the FAILED TO FORMAT OCR DISK USING CLSFMT error on Node 1.
But still the Oracle Cluster Verification Utility failed with OCR integrity.
Also, have religiously followed the steps mentioned in the below link & didnt have any glitches during the entire process:
http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnCentos4UsingVMware.php
Any Suggestions??

I kinda dont have that timestamp which you requested.
Posting what i have in crsd.log for node 2.
**I wish this site had an attachment section to make the threads more readable.
Anyways...
Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
2011-06-29 17:56:21.189: [ default][3086931648][ENTER]0
Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2004, Oracle. All rights reserved
2011-06-29 17:56:21.189: [ default][3086931648]0CRS Daemon Starting
2011-06-29 17:56:21.190: [ CRSMAIN][3086931648]0Checking the OCR device
2011-06-29 17:56:21.280: [ CRSMAIN][3086931648]0Connecting to the CSS Daemon
2011-06-29 17:56:21.420: [ COMMCRS][66177968]clsc_connect: (0x8655ae0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs))
2011-06-29 17:56:21.420: [ CSSCLNT][3086931648]clsssInitNative: connect failed, rc 9
2011-06-29 17:56:21.422: [ CRSRTI][3086931648]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..
2011-06-29 17:56:22.483: [ COMMCRS][66177968]clsc_connect: (0x8604c10) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs))
2011-06-29 17:56:22.484: [ CSSCLNT][3086931648]clsssInitNative: connect failed, rc 9
2011-06-29 17:56:22.485: [ CRSRTI][3086931648]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..
2011-06-29 17:56:23.537: [ COMMCRS][66177968]clsc_connect: (0x8654e20) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs))
2011-06-29 17:56:23.537: [ CSSCLNT][3086931648]clsssInitNative: connect failed, rc 9
2011-06-29 17:56:23.538: [ CRSRTI][3086931648]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..
2011-06-29 17:56:24.606: [ COMMCRS][66177968]clsc_connect: (0x8655008) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs))
2011-06-29 17:56:24.606: [ CSSCLNT][3086931648]clsssInitNative: connect failed, rc 9
2011-06-29 17:56:24.608: [ CRSRTI][3086931648]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..
2011-06-29 17:56:28.445: [    CRSD][3086931648]0Daemon Version: 10.2.0.1.0 Active Version: 10.2.0.1.0
2011-06-29 17:56:28.446: [    CRSD][3086931648]0Active Version and Software Version are same
2011-06-29 17:56:28.446: [ CRSMAIN][3086931648]0Initializing OCR
2011-06-29 17:56:28.479: [ OCRRAW][3086931648]proprioo: for disk 0 (/dev/raw/raw1), id match (1), my id set (1669906634,1028247821) total id sets (1), 1st set (1669906634,1028247821), 2nd set (0,0) my votes (2), total votes (2)
2011-06-29 17:56:28.621: [ CSSCLNT][3051752368]clssgsGroupJoin: CSS has not reached fatal mode.Registration is not yet safe. Retrying
2011-06-29 17:56:29.674: [    CRSD][3086931648]0ENV Logging level for Module: allcomp 0
2011-06-29 17:56:29.680: [    CRSD][3086931648]0ENV Logging level for Module: default 0
2011-06-29 17:56:29.720: [    CRSD][3086931648]0ENV Logging level for Module: COMMCRS 0
2011-06-29 17:56:29.730: [    CRSD][3086931648]0ENV Logging level for Module: COMMNS 0
2011-06-29 17:56:29.746: [    CRSD][3086931648]0ENV Logging level for Module: CRSUI 0
2011-06-29 17:56:29.755: [    CRSD][3086931648]0ENV Logging level for Module: CRSCOMM 0
2011-06-29 17:56:29.760: [    CRSD][3086931648]0ENV Logging level for Module: CRSRTI 0
2011-06-29 17:56:29.770: [    CRSD][3086931648]0ENV Logging level for Module: CRSMAIN 0
2011-06-29 17:56:29.823: [    CRSD][3086931648]0ENV Logging level for Module: CRSPLACE 0
2011-06-29 17:56:29.834: [    CRSD][3086931648]0ENV Logging level for Module: CRSAPP 0
2011-06-29 17:56:29.846: [    CRSD][3086931648]0ENV Logging level for Module: CRSRES 0
2011-06-29 17:56:29.852: [    CRSD][3086931648]0ENV Logging level for Module: CRSOCR 0
2011-06-29 17:56:29.871: [    CRSD][3086931648]0ENV Logging level for Module: CRSTIMER 0
2011-06-29 17:56:29.878: [    CRSD][3086931648]0ENV Logging level for Module: CRSEVT 0
2011-06-29 17:56:29.886: [    CRSD][3086931648]0ENV Logging level for Module: CRSD 0
2011-06-29 17:56:29.904: [    CRSD][3086931648]0ENV Logging level for Module: CLUCLS 0
2011-06-29 17:56:29.916: [    CRSD][3086931648]0ENV Logging level for Module: OCRRAW 0
2011-06-29 17:56:29.928: [    CRSD][3086931648]0ENV Logging level for Module: OCROSD 0
2011-06-29 17:56:29.931: [    CRSD][3086931648]0ENV Logging level for Module: CSSCLNT 0
2011-06-29 17:56:29.936: [    CRSD][3086931648]0ENV Logging level for Module: OCRAPI 0
2011-06-29 17:56:29.939: [    CRSD][3086931648]0ENV Logging level for Module: OCRUTL 0
2011-06-29 17:56:29.942: [    CRSD][3086931648]0ENV Logging level for Module: OCRMSG 0
2011-06-29 17:56:29.945: [    CRSD][3086931648]0ENV Logging level for Module: OCRCLI 0
2011-06-29 17:56:29.948: [    CRSD][3086931648]0ENV Logging level for Module: OCRCAC 0
2011-06-29 17:56:29.951: [    CRSD][3086931648]0ENV Logging level for Module: OCRSRV 0
2011-06-29 17:56:29.954: [    CRSD][3086931648]0ENV Logging level for Module: OCRMAS 0
2011-06-29 17:56:29.954: [ CRSMAIN][3086931648]0Filename is /u01/crs/oracle/product/10.2.0/crs/crs/init/rac2.pid
[ clsdmt][2862934960]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=rac2DBG_CRSD))
2011-06-29 17:56:29.986: [ CRSMAIN][3086931648]0Using Authorizer location: /u01/crs/oracle/product/10.2.0/crs/crs/auth/
2011-06-29 17:56:30.038: [ CRSMAIN][3086931648]0Initializing RTI
2011-06-29 17:56:30.039: [CRSTIMER][2841689008]0Timer Thread Starting.
2011-06-29 17:56:30.042: [ CRSRES][3086931648]0Parameter SECURITY = 1, running in USER Mode
2011-06-29 17:56:30.043: [ CRSMAIN][3086931648]0Initializing EVMMgr
2011-06-29 17:56:30.045: [ COMMCRS][2831199152]clsc_connect: (0x89a02e0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=SYSTEM.evm.acceptor.auth))
2011-06-29 17:56:30.299: [ COMMCRS][2831199152]clsc_connect: (0x89a2ab8) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=SYSTEM.evm.acceptor.auth))
2011-06-29 17:56:31.555: [ CRSMAIN][3086931648]0CRSD locked during state recovery, please wait.
2011-06-29 17:56:31.603: [ CRSMAIN][3086931648]0CRSD recovered, unlocked.
2011-06-29 17:56:31.606: [ CRSMAIN][3086931648]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
2011-06-29 17:56:31.620: [ CRSMAIN][3086931648]0CRSD UI socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=CRSD_UI_SOCKET))
2011-06-29 17:56:31.627: [ CRSMAIN][3086931648]0E2E socket on: (ADDRESS=(PROTOCOL=tcp)(HOST=rac2-priv)(PORT=49896))
2011-06-29 17:56:31.627: [ CRSMAIN][3086931648]0Starting Threads
2011-06-29 17:56:31.628: [ CRSMAIN][3086931648]0CRS Daemon Started.
2011-06-29 18:03:02.066: [ CRSRES][2735582128]0Resource Registered: ora.rac1.vip
2011-06-29 18:03:05.949: [ CRSRES][2735582128]0Resource Registered: ora.rac2.vip
2011-06-29 18:03:09.666: [ CRSRES][2735582128]0Resource Registered: ora.rac1.gsd
2011-06-29 18:03:11.523: [ CRSRES][2735582128]0Resource Registered: ora.rac2.gsd
2011-06-29 18:03:13.329: [ CRSRES][2735582128]0Resource Registered: ora.rac1.ons
2011-06-29 18:03:15.048: [ CRSRES][2735582128]0Resource Registered: ora.rac2.ons
2011-06-29 18:03:15.965: [ CRSRES][2714192816]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:03:30.471: [ CRSRES][2714192816]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:03:31.227: [ CRSRES][2714192816]0startRunnable: setting CLI values
2011-06-29 18:03:31.258: [ CRSRES][2714192816]0Attempting to start `ora.rac2.vip` on member `rac2`
2011-06-29 18:03:44.710: [ CRSRES][2714192816]0Start of `ora.rac2.vip` on member `rac2` succeeded.
2011-06-29 18:03:45.588: [ CRSRES][2714192816]0Attempting to start `ora.rac1.gsd` on member `rac1`
2011-06-29 18:03:45.777: [ CRSRES][2714192816]0Start of `ora.rac1.gsd` on member `rac1` succeeded.
2011-06-29 18:03:46.523: [ CRSRES][2714192816]0startRunnable: setting CLI values
2011-06-29 18:03:46.588: [ CRSRES][2714192816]0Attempting to start `ora.rac2.gsd` on member `rac2`
2011-06-29 18:03:47.220: [ CRSRES][2714192816]0Start of `ora.rac2.gsd` on member `rac2` succeeded.
2011-06-29 18:03:48.077: [ CRSRES][2714192816]0Attempting to start `ora.rac1.ons` on member `rac1`
2011-06-29 18:03:49.727: [ CRSRES][2714192816]0Start of `ora.rac1.ons` on member `rac1` succeeded.
2011-06-29 18:03:50.610: [ CRSRES][2714192816]0startRunnable: setting CLI values
2011-06-29 18:03:50.658: [ CRSRES][2714192816]0Attempting to start `ora.rac2.ons` on member `rac2`
2011-06-29 18:03:52.240: [ CRSRES][2714192816]0Start of `ora.rac2.ons` on member `rac2` succeeded.
2011-06-29 18:07:44.810: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:09:05.613: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:09:05.623: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:09:05.623: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:09:05.624: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:09:05.631: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:09:09.437: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:09:09.438: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:09:09.447: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:09:09.685: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:09:22.340: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:10:21.884: [ CRSAPP][2735582128]0CheckResource error for ora.rac2.vip error code = 1
2011-06-29 18:10:21.892: [ CRSRES][2735582128]0In stateChanged, ora.rac2.vip target is ONLINE
2011-06-29 18:10:21.893: [ CRSRES][2735582128]0ora.rac2.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:10:21.893: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:10:21.910: [ CRSRES][2735582128]0Attempting to stop `ora.rac2.vip` on member `rac2`
2011-06-29 18:10:25.645: [ CRSRES][2735582128]0Stop of `ora.rac2.vip` on member `rac2` succeeded.
2011-06-29 18:10:25.645: [ CRSRES][2735582128]0ora.rac2.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:10:25.657: [ CRSRES][2735582128]0ora.rac2.vip failed on rac2 relocating.
2011-06-29 18:10:25.938: [ CRSRES][2735582128]0Attempting to start `ora.rac2.vip` on member `rac1`
2011-06-29 18:10:39.079: [ CRSRES][2735582128]0Start of `ora.rac2.vip` on member `rac1` succeeded.
2011-06-29 18:11:39.443: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:11:52.836: [ OCRUTL][3009792944]u_freem: mem passed is null
2011-06-29 18:12:59.776: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:12:59.784: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:12:59.784: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:12:59.784: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:12:59.791: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:13:03.395: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:13:03.396: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:13:03.404: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:13:03.678: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:13:16.047: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:15:07.356: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:26:36.393: [ CRSAPP][2735582128]0CheckResource error for ora.rac2.vip error code = 1
2011-06-29 18:26:36.404: [ CRSRES][2735582128]0In stateChanged, ora.rac2.vip target is ONLINE
2011-06-29 18:26:36.404: [ CRSRES][2735582128]0ora.rac2.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:26:36.405: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:26:36.420: [ CRSRES][2735582128]0Attempting to stop `ora.rac2.vip` on member `rac2`
2011-06-29 18:26:40.105: [ CRSRES][2735582128]0Stop of `ora.rac2.vip` on member `rac2` succeeded.
2011-06-29 18:26:40.106: [ CRSRES][2735582128]0ora.rac2.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:26:40.114: [ CRSRES][2735582128]0ora.rac2.vip failed on rac2 relocating.
2011-06-29 18:26:40.411: [ CRSRES][2735582128]0Attempting to start `ora.rac2.vip` on member `rac1`
2011-06-29 18:26:53.678: [ CRSRES][2735582128]0Start of `ora.rac2.vip` on member `rac1` succeeded.
2011-06-29 18:28:03.601: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:28:22.695: [ CRSAPP][2735582128]0StartResource error for ora.rac2.vip error code = 1
2011-06-29 18:28:44.847: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:29:06.589: [ OCRUTL][2946853808]u_freem: mem passed is null
2011-06-29 18:30:13.581: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:30:13.598: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:30:13.599: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:30:13.599: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:30:13.606: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:30:17.227: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:30:17.228: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:30:17.236: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:30:17.563: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:30:31.358: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:33:54.570: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:34:17.302: [ OCRUTL][2988813232]u_freem: mem passed is null
2011-06-29 18:35:24.403: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:35:24.412: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:35:24.412: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:35:24.412: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:35:24.431: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:35:28.186: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:35:28.187: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:35:28.208: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:35:28.510: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:35:52.388: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:39:18.464: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:39:31.876: [ OCRUTL][2988813232]u_freem: mem passed is null
2011-06-29 18:40:38.956: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:40:38.965: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:40:38.966: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:40:38.966: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:40:38.972: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:40:42.583: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:40:42.584: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:40:42.594: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:40:42.977: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:41:08.149: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:42:18.061: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:42:31.531: [ OCRUTL][2988813232]u_freem: mem passed is null
2011-06-29 18:44:45.499: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:44:45.507: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:44:45.508: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:44:45.508: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:44:45.516: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:44:49.197: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:44:49.198: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:44:49.209: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:44:49.449: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:45:13.509: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:47:31.668: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:47:50.804: [ CRSAPP][2735582128]0StartResource error for ora.rac1.vip error code = 1

Failed to upgrade Oracle Cluster Registry configuration

Similar Messages

Maybe you are looking for