Clusterware problem

We had problems on clusterware and the clusterware is not coming up after reboot. We checked all possibilities. Tested everything.. vote disk,ocr,vip,pub ip etc. We have a SR with Oracle, and no solution yet.
it is a 2 node RAC on 11gR1 on Linux. Looks like something internally broken as multiple people were working on this issue. The current situation is that the logs are also not updated when we try to start clusterware.
We dont want to wait till support gives resolution. We want to try alternative. What are the solution for fresh installation on the second node. Can we do delete node...add node etc
please suggest.

Hi,
Can you please let us know the problem when you trying to restart the crs
please give the below details:
1. what is the cluster version
2. what is the error you are getting while restarting the cluster
3. if you want to install the cluster again first you need to deinstall and remove the cluster and you can start the installation.
4.please give the blow output
crs_stat -t
crsctl check crs
crsctl start crs
Thanks
Sudhir

Similar Messages

Oracle 10g to 11g Upgrade - Oracle Clusterware problem

Oracle10g RAC (2 Nodes) RHEL 4 64bit
Hi All,
I have began the procedure for upgrading Oracle Clusterware to 11g. However, during the install OUI was giving me certain error messages like it couldn't transfer the OUI installlogs to node 2. Well, I kept pushing through the install and after I ran the last rootupgrade script on node 2 it gave me the following error:
Checking the existence of nodeapps on this node
Exception in thread "main" java.lang.UnsupportedClassVersionError: oracle/ops/opsctl/OPSCTLDriver (Unsupported major.minor version 49.0)
at java.lang.ClassLoader.defineClass0(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:539)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:123)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:251)
at java.net.URLClassLoader.access$100(URLClassLoader.java:55)
at java.net.URLClassLoader$1.run(URLClassLoader.java:194)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:187)
at java.lang.ClassLoader.loadClass(ClassLoader.java:289)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:274)
at java.lang.ClassLoader.loadClass(ClassLoader.java:235)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:302)
Creating '/crs/home/install/paramfile.crs' with data used for CRS configuration
Exception in thread "main" java.lang.UnsupportedClassVersionError: oracle/ops/opsctl/OPSCTLDriver (Unsupported major.minor version 49.0)
at java.lang.ClassLoader.defineClass0(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:539)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:123)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:251)
at java.net.URLClassLoader.access$100(URLClassLoader.java:55)
at java.net.URLClassLoader$1.run(URLClassLoader.java:194)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:187)
at java.lang.ClassLoader.loadClass(ClassLoader.java:289)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:274)
at java.lang.ClassLoader.loadClass(ClassLoader.java:235)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:302)
Failed to retrieve VIP details
Exception in thread "main" java.lang.UnsupportedClassVersionError: oracle/ops/opsctl/OPSCTLDriver (Unsupported major.minor version 49.0)
at java.lang.ClassLoader.defineClass0(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:539)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:123)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:251)
at java.net.URLClassLoader.access$100(URLClassLoader.java:55)
at java.net.URLClassLoader$1.run(URLClassLoader.java:194)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:187)
at java.lang.ClassLoader.loadClass(ClassLoader.java:289)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:274)
at java.lang.ClassLoader.loadClass(ClassLoader.java:235)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:302)
Failed to retrieve VIP details
Setting CRS configuration values in /crs/home/install/paramfile.crs
So I ignored the error for the time being and after that I checked the status of crs and it gave me the following:
[oracle@vtl-rac2 crsd]$ crsstatus
HA Resource Target State
ora.VMRACDEV.VMRACDEV1.inst ONLINE ONLINE on vtl-rac1
ora.VMRACDEV.VMRACDEV2.inst ONLINE ONLINE on vtl-rac2
ora.VMRACDEV.db ONLINE ONLINE on vtl-rac1
ora.vtl-rac1.ASM1.asm ONLINE ONLINE on vtl-rac1
ora.vtl-rac1.LISTENER_VTL-RAC1.lsnr ONLINE ONLINE on vtl-rac1
ora.vtl-rac1.gsd ONLINE ONLINE on vtl-rac1
ora.vtl-rac1.ons ONLINE OFFLINE
ora.vtl-rac1.vip ONLINE ONLINE on vtl-rac1
ora.vtl-rac2.ASM2.asm ONLINE ONLINE on vtl-rac2
ora.vtl-rac2.LISTENER_VTL-RAC2.lsnr ONLINE ONLINE on vtl-rac2
ora.vtl-rac2.gsd ONLINE ONLINE on vtl-rac2
ora.vtl-rac2.ons ONLINE OFFLINE
ora.vtl-rac2.vip ONLINE ONLINE on vtl-rac2
So i tried to bring it back up by doing a crs_stop -all and crs_start -all and it gave me the following error:
vtl-rac1 : CRS-1019: Resource ora.vtl-rac2.ons (application) cannot run on vtl-rac1
Start of `ora.vtl-rac1.ons` on member `vtl-rac1` failed.
vtl-rac2 : CRS-1019: Resource ora.vtl-rac1.ons (application) cannot run on vtl-rac2
CRS-0223: Resource 'ora.VMRACDEV.db' has placement error.
CRS-0215: Could not start resource 'ora.vtl-rac1.ons'.
CRS-0215: Could not start resource 'ora.vtl-rac2.ons'.
I am thinking that all of this is caused by the various issues I had with the install. If I am incorrect, then please let me know. If it is true, I would like to know if there are any 11g docs on how to clean up a failed clusterware upgrade. Any advice would be greatly appreciated on any of the situations I am having.
Thank you

Hi Chandra,
Did CVU report any problems before the upgrade?No, there were no errors reported by CVU before the upgrade.
I don't there is note out there for cleaning 11g CRS
install...and I think can very use the 10g CRS note -
239998.1.Yeah I might have to go that way.
I have both the 11g CRS install and upgrade from 10g
to 11CRS at
http://chandradba.blogspot.com/2007/08/oracle-11g-rac-
install-on-red-hat-50.html
and
http://chandradba.blogspot.com/2008/02/oracle-10g-crs-
upgrade-to-11g-crs.html
see if it helps.Yup, your guide is very simple, clear and error proof :) That's how mine when pretty much except right around 75% I started getting these strange errors of files not being able to be transferred to node 2. Anyways, it shouldn't be a problem as none of those errors were configuration related...or else I would have a messed up cluster.
Well, I actually rebooted both machines and now the whole CRS stack is up!! So I guess I am ok. We'll just have to wait and see.
Thanks for your help Chandra...I always appreciate it.

ClusterWare Problem in rac.

Hi,
Linux Version : Rhel 4
When i am running the {cod}u01/app/oracle/produt/10.2.0/crs/vipcs before this when we run the Cluserware software runinstaller at the end of it i am getting only one root.sh script to run as root .PRKH-1010 : Unable to communicate with CRS services.
[OCR Error(Native: prsr_initCLSS:[21])]
PRKH-1010 : Unable to communicate with CRS services.
[OCR Error(Native: prsr_initCLSS:[21])]
PRKH-1010 : Unable to communicate with CRS services.
[OCR Error(Native: prsr_initCLSS:[21])]
Please help me.
Thanks & Regards,
Poorna Prasad.

Hi,
Before running vipca services install clusterware and crs services.
thanks,
baskar.l

Primary Node Online but State=UNKNOWN ?

Thanks in advance.
Problem: When starting up "rac1" node the result is STATE=UNKNOWN
11g Clusterware and 11g database
rac1.respecti.com>crs_resources
HA Resource Target State
ora.RAC.RAC1.inst ONLINE UNKNOWN on rac1
ora.RAC.RAC2.inst ONLINE ONLINE on rac2
ora.RAC.db ONLINE ONLINE on rac2
ora.rac1.gsd ONLINE ONLINE on rac1
ora.rac1.ons ONLINE ONLINE on rac1
ora.rac1.rac1.lsnr ONLINE ONLINE on rac1
ora.rac1.vip ONLINE ONLINE on rac1
ora.rac2.gsd ONLINE ONLINE on rac2
ora.rac2.ons ONLINE ONLINE on rac2
ora.rac2.rac2.lsnr ONLINE ONLINE on rac2
ora.rac2.vip ONLINE ONLINE on rac2
rac1.respecti.com>
login as: rac
[email protected]'s password:
Last login: Sun Feb 15 13:53:58 2009 from 192.168.1.4
rac1.respecti.com>clear
rac1.respecti.com>crs_resources
HA Resource Target State
ora.RAC.RAC1.inst ONLINE UNKNOWN on rac1
ora.RAC.RAC2.inst ONLINE ONLINE on rac2
ora.RAC.db ONLINE ONLINE on rac2
ora.rac1.gsd ONLINE ONLINE on rac1
ora.rac1.ons ONLINE ONLINE on rac1
ora.rac1.rac1.lsnr ONLINE ONLINE on rac1
ora.rac1.vip ONLINE ONLINE on rac1
ora.rac2.gsd ONLINE ONLINE on rac2
ora.rac2.ons ONLINE ONLINE on rac2
ora.rac2.rac2.lsnr ONLINE ONLINE on rac2
ora.rac2.vip ONLINE ONLINE on rac2
rac1.respecti.com>pwd
/home/rac
rac1.respecti.com>cd /u01/
rac1.respecti.com>ls
app shared_conf shared_crs shared_data shared_home tmp
rac1.respecti.com>cd shared_crs
rac1.respecti.com>ls
bin diagnostics jlib nls perl slax tg4tera
cdata evm JRE OCR plsql sqlplus VOTE
cfgtoollogs has ldap OPatch precomp srvm xdk
clone install lib opmn racg sysman
crs install.platform lib32 oracore rdbms tg4ifmx
css inventory log oraInst.loc relnotes tg4ingr
cv jdk network oui root.sh tg4sybs
rac1.respecti.com>cd crs
rac1.respecti.com>ls
admin demo lib mesg public template
auth init log profile script trace
rac1.respecti.com>cd trace
rac1.respecti.com>ls
rac1.respecti.com>pwd
/u01/shared_crs/crs/trace
rac1.respecti.com>ls
rac1.respecti.com>ls -lt
total 0
rac1.respecti.com>pwd
/u01/shared_crs/crs/trace
rac1.respecti.com>cd ..
rac1.respecti.com>ls -lt
total 48
drwxr-xr-x 7 root dba 4096 Feb 15 20:31 auth
drwxr-xr-x 2 root dba 4096 Feb 14 20:38 init
drwxr-x--T 2 rac dba 4096 Feb 14 19:22 log
drwxrwxrwt 2 rac dba 4096 Jul 13 2008 public
drwxr-xr-x 2 root dba 4096 May 24 2008 profile
drwxr-x--T 2 rac dba 4096 May 24 2008 trace
drwxr-xr-x 2 root dba 4096 May 24 2008 script
drwxr-xr-x 2 rac dba 4096 May 24 2008 admin
drwxr-xr-x 2 rac dba 4096 May 24 2008 lib
drwxr-xr-x 2 rac dba 4096 May 24 2008 mesg
drwxr-xr-x 3 rac dba 4096 May 24 2008 demo
drwxr-xr-x 2 root dba 4096 May 24 2008 template
rac1.respecti.com>cd log
rac1.respecti.com>ls -lt
total 0
-rw-r----- 1 rac dba 0 Nov 30 13:37 startgmJZrY.stdout
-rw-r----- 1 rac dba 0 Nov 30 13:37 startzJeeIX.stderr
rac1.respecti.com>pwd
/u01/shared_crs/crs/log
rac1.respecti.com>cd ..
rac1.respecti.com>ls
admin demo lib mesg public template
auth init log profile script trace
rac1.respecti.com>pwd
/u01/shared_crs/crs
rac1.respecti.com>cd profile
rac1.respecti.com>ls
rac1.respecti.com>pwd
/u01/shared_crs/crs/profile
rac1.respecti.com>cd ..
rac1.respecti.com>pwd
/u01/shared_crs/crs
rac1.respecti.com>ls -alt
total 56
drwxr-xr-x 7 root dba 4096 Feb 15 20:31 auth
drwxr-xr-x 2 root dba 4096 Feb 14 20:38 init
drwxr-x--T 2 rac dba 4096 Feb 14 19:22 log
drwxrwxrwt 2 rac dba 4096 Jul 13 2008 public
drwxr-xr-x 43 root dba 4096 May 27 2008 ..
drwxr-xr-x 2 root dba 4096 May 24 2008 profile
drwxr-xr-x 14 root dba 4096 May 24 2008 .
drwxr-x--T 2 rac dba 4096 May 24 2008 trace
drwxr-xr-x 2 root dba 4096 May 24 2008 script
drwxr-xr-x 2 rac dba 4096 May 24 2008 admin
drwxr-xr-x 2 rac dba 4096 May 24 2008 lib
drwxr-xr-x 2 rac dba 4096 May 24 2008 mesg
drwxr-xr-x 3 rac dba 4096 May 24 2008 demo
drwxr-xr-x 2 root dba 4096 May 24 2008 template
rac1.respecti.com>pwd
/u01/shared_crs/crs
rac1.respecti.com>cd ..
rac1.respecti.com>ls
bin diagnostics jlib nls perl slax tg4tera
cdata evm JRE OCR plsql sqlplus VOTE
cfgtoollogs has ldap OPatch precomp srvm xdk
clone install lib opmn racg sysman
crs install.platform lib32 oracore rdbms tg4ifmx
css inventory log oraInst.loc relnotes tg4ingr
cv jdk network oui root.sh tg4sybs
rac1.respecti.com>pwd
/u01/shared_crs
rac1.respecti.com>cd log
rac1.respecti.com>ls
crs rac1 rac2
rac1.respecti.com>cd crs
rac1.respecti.com>ls
rac1.respecti.com>cd ../rac1
rac1.respecti.com>ls
admin alertrac1.log client crsd cssd evmd racg
rac1.respecti.com>cd crsd
rac1.respecti.com>ls
crsd.log crsdOUT.log
rac1.respecti.com>ls -lt
total 1424
-rw-r--r-- 1 root dba 1252906 Feb 14 21:29 crsd.log
-rw-r--r-- 1 root dba 193481 Feb 14 20:38 crsdOUT.log
rac1.respecti.com>vi /u01/shared_crs/log/rac1/crsd/crsd.log
2009-02-14 21:13:36.729: [ CRSRES][1484962112] Attempting to start `ora.RAC.RAC1.inst` on member `rac1`
2009-02-14 21:13:38.455: [ OCRUTL][1377945920]u_freem: mem passed is null
2009-02-14 21:29:21.741: [ CRSEVT][1484962112] CAAMonitorHandler :: 0:Could not join /u01/app/product/RAC/bin/racgwrap(start)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2009-02-14 21:29:21.746: [ CRSEVT][1484962112] CAAMonitorHandler :: 0:Action Script /u01/app/product/RAC/bin/racgwrap(start) timed out for ora.RAC.RAC1.inst! (timeout=900)
2009-02-14 21:29:21.754: [ CRSAPP][1484962112] StartResource error for ora.RAC.RAC1.inst error code = -2
2009-02-14 21:29:24.407: [ CRSAPP][1484962112] StopResource error for ora.RAC.RAC1.inst error code = 1
2009-02-14 21:29:24.449: [ CRSRES][1484962112] X_OP_StopResourceFailed : Stop Resource failed
(File: rti.cpp, line: 1839
2009-02-14 21:29:24.451: [ CRSRES][1484962112][ALERT] `ora.RAC.RAC1.inst` on member `rac1` has experienced an unrecoverable failure.
2009-02-14 21:29:24.455: [ CRSRES][1484962112] Human intervention required to resume its availability.
14771,1 Bot
Edited by: yakub21 on Feb 15, 2009 8:54 PM
rac1 node database is accessible, though I would like to know how to resolve the clusterware problem.

Hi Yakub,
is this problem persistent? Does it happen every time you start node1 or is this the status after the last start?
What happened is that Oracle Clusterware got the impression that the RAC instance on node1 was not started according to some tests in the action script that is used to start the instance. Actually, some operations did not return in a timely fashion (hence, the time out in the crsd.log). According to what you said, the instance was however started - I presume a ps -ef would show that and connections against this instance are possible!?
Now, since Oracle Clusterware encountered some time outs, it cannot determine the state of the instance correctly and therefore declares the state of the resource (your rac instance) as UNKNOWN. This means: no monitoring of this resource and hence no corrective action in case of failures of this resource. In other words: for Clusterware, this instance is unmanaged.
What can you do to fix that? Well, "human intervention" is required. My suggestion would be: stop the instance explicitly (preferably using SRVCTL) and restart it using SRVCTL. After stopping the instance using that command, check the state from Clusterware perspective. It should be TARGET=OFFLINE. Make sure, your instance is down. Kill / shutdown abort the running RAC instance explicitly before attempting a restart.
Hope that helps. Thanks,
Markus

11gR2 clusterware installation problem on root.sh script on second node

Hi all,
I wanna install the *11gR2 RAC* on ORA-Linux 5.5 (x86_64) using VMware server but on the second node i get two "*failed*" at the end of root.sh script.
After that i try to install DB but ı can see only one node.What is the problem...
I will send the output, ı need your help.
Thank you all for helping..
Hosts file:(we have no ping problem )
[root@rac2 ~]# cat /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1       localhost.localdomain   localhost
# Public
192.168.2.101   rac1.localdomain        rac1
192.168.2.102   rac2.localdomain        rac2
# Private
192.168.0.101   rac1-priv.localdomain   rac1-priv
192.168.0.102   rac2-priv.localdomain   rac2-priv
# Virtual
192.168.2.111   rac1-vip.localdomain    rac1-vip
192.168.2.112   rac2-vip.localdomain    rac2-vip
# SCAN
192.168.2.201   rac-scan.localdomain rac-scan
[root@rac2 ~]#
FIRST NODE root.sh script output...
[root@rac2 ~]# /u01/app/11.2.0/db_1/root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/11.2.0/db_1
Enter the full pathname of the local bin directory: [/usr/local/bin]:
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2010-12-06 14:45:06: Parsing the host name
2010-12-06 14:45:06: Checking for super user privileges
2010-12-06 14:45:06: User has super user privileges
Using configuration parameter file: /u01/app/11.2.0/db_1/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-2672: Attempting to start 'ora.gipcd' on 'rac2'
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac2'
CRS-2676: Start of 'ora.gipcd' on 'rac2' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac2'
CRS-2676: Start of 'ora.gpnpd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac2'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac2'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac2'
CRS-2676: Start of 'ora.diskmon' on 'rac2' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac2'
CRS-2676: Start of 'ora.ctssd' on 'rac2' succeeded
ASM created and started successfully.
DiskGroup DATA created successfully.
clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-2672: Attempting to start 'ora.crsd' on 'rac2'
CRS-2676: Start of 'ora.crsd' on 'rac2' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 587cc69413ce4fd3bf0c2c2548fb9017.
Successfully replaced voting disk group with +DATA.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE    File Universal Id                File Name Disk group
1. ONLINE   587cc69413ce4fd3bf0c2c2548fb9017 (/dev/oracleasm/disks/DISK1) [DATA]
Located 1 voting disk(s).
CRS-2673: Attempting to stop 'ora.crsd' on 'rac2'
CRS-2677: Stop of 'ora.crsd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac2'
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac2'
CRS-2677: Stop of 'ora.ctssd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'rac2'
CRS-2677: Stop of 'ora.cssdmonitor' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac2'
CRS-2677: Stop of 'ora.cssd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac2'
CRS-2677: Stop of 'ora.gpnpd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac2'
CRS-2677: Stop of 'ora.gipcd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac2'
CRS-2677: Stop of 'ora.mdnsd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac2'
CRS-2676: Start of 'ora.mdnsd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'rac2'
CRS-2676: Start of 'ora.gipcd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac2'
CRS-2676: Start of 'ora.gpnpd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac2'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac2'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac2'
CRS-2676: Start of 'ora.diskmon' on 'rac2' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac2'
CRS-2676: Start of 'ora.ctssd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac2'
CRS-2676: Start of 'ora.asm' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac2'
CRS-2676: Start of 'ora.crsd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'rac2'
CRS-2676: Start of 'ora.evmd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac2'
CRS-2676: Start of 'ora.asm' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.DATA.dg' on 'rac2'
CRS-2676: Start of 'ora.DATA.dg' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.registry.acfs' on 'rac2'
CRS-2676: Start of 'ora.registry.acfs' on 'rac2' succeeded
rac2     2010/12/06 14:52:06     /u01/app/11.2.0/db_1/cdata/rac2/backup_20101206_145206.olr
Configure Oracle Grid Infrastructure for a Cluster ... succeeded
Updating inventory properties for clusterware
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB.   Actual 6847 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /u01/app/oraInventory
'UpdateNodeList' was successful.
[root@rac2 ~]#
SECOND NODE root.sh script output
[root@rac1 db_1]# ./root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/11.2.0/db_1
Enter the full pathname of the local bin directory: [/usr/local/bin]:
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2010-12-06 14:54:11: Parsing the host name
2010-12-06 14:54:11: Checking for super user privileges
2010-12-06 14:54:11: User has super user privileges
Using configuration parameter file: /u01/app/11.2.0/db_1/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'
CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'
CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'
CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'
CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded
ASM created and started successfully.
DiskGroup DATA created successfully.
clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-2672: Attempting to start 'ora.crsd' on 'rac1'
CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded
Successful addition of voting disk 2761ce8d47b44fbabf73462151e3ba1d.
Successfully replaced voting disk group with +DATA.
CRS-4266: Voting file(s) successfully replaced
## STATE    File Universal Id                File Name Disk group
1. ONLINE   2761ce8d47b44fbabf73462151e3ba1d (/dev/oracleasm/disks/DISK1) [DATA]
Located 1 voting disk(s).
CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'
CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'rac1'
CRS-2677: Stop of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'
CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'
CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'
CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'
CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'
CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac1'
CRS-2676: Start of 'ora.asm' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac1'
CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'rac1'
CRS-2676: Start of 'ora.evmd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac1'
CRS-2676: Start of 'ora.asm' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.DATA.dg' on 'rac1'
CRS-2676: Start of 'ora.DATA.dg' on 'rac1' succeeded
PRCR-1079 : *Failed* to start resource ora.scan1.vip
CRS-5005: IP Address: 192.168.2.201 is already in use in the network
CRS-2674: Start of 'ora.scan1.vip' on 'rac1' *failed*
CRS-2632: There are no more servers to try to place resource 'ora.scan1.vip' on that would satisfy its placement policy
start scan ... *failed*
Configure Oracle Grid Infrastructure for a Cluster ... *failed*
Updating inventory properties for clusterware
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB.   Actual 6847 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /u01/app/oraInventory
'UpdateNodeList' was successful.
[root@rac1 db_1]# * "./runcluvfy.sh stage -pre -crsinst -n rac1,rac2 " outputs are same each node....*
[oracle@rac2 grid]$ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2
Performing pre-checks for cluster services setup
Checking node reachability...
Node reachability check passed from node "rac2"
Checking user equivalence...
User equivalence check passed for user "oracle"
Checking node connectivity...
Checking hosts config file...
Verification of the hosts config file successful
Node connectivity passed for subnet "192.168.2.0" with node(s) rac2,rac1
TCP connectivity check passed for subnet "192.168.2.0"
Node connectivity passed for subnet "192.168.122.0" with node(s) rac2,rac1
TCP connectivity check failed for subnet "192.168.122.0"
Node connectivity passed for subnet "192.168.0.0" with node(s) rac2,rac1
TCP connectivity check passed for subnet "192.168.0.0"
Interfaces found on subnet "192.168.2.0" that are likely candidates for VIP are:
rac2 eth0:192.168.2.102 eth0:192.168.2.112 eth0:192.168.2.201
rac1 eth0:192.168.2.101 eth0:192.168.2.111
Interfaces found on subnet "192.168.122.0" that are likely candidates for a private interconnect are:
rac2 virbr0:192.168.122.1
rac1 virbr0:192.168.122.1
Interfaces found on subnet "192.168.0.0" that are likely candidates for a private interconnect are:
rac2 eth1:192.168.0.102
rac1 eth1:192.168.0.101
Node connectivity check passed
Total memory check passed
Available memory check passed
Swap space check passed
Free disk space check passed for "rac2:/tmp"
Free disk space check passed for "rac1:/tmp"
User existence check passed for "oracle"
Group existence check passed for "oinstall"
Group existence check passed for "dba"
Membership check for user "oracle" in group "oinstall" [as Primary] passed
Membership check for user "oracle" in group "dba" passed
Run level check passed
Hard limits check passed for "maximum open file descriptors"
Soft limits check passed for "maximum open file descriptors"
Hard limits check passed for "maximum user processes"
Soft limits check passed for "maximum user processes"
System architecture check passed
Kernel version check passed
Kernel parameter check passed for "semmsl"
Kernel parameter check passed for "semmns"
Kernel parameter check passed for "semopm"
Kernel parameter check passed for "semmni"
Kernel parameter check passed for "shmmax"
Kernel parameter check passed for "shmmni"
Kernel parameter check passed for "shmall"
Kernel parameter check passed for "file-max"
Kernel parameter check passed for "ip_local_port_range"
Kernel parameter check passed for "rmem_default"
Kernel parameter check passed for "rmem_max"
Kernel parameter check passed for "wmem_default"
Kernel parameter check passed for "wmem_max"
Kernel parameter check passed for "aio-max-nr"
Package existence check passed for "make-3.81"
Package existence check passed for "binutils-2.17.50.0.6"
Package existence check passed for "gcc-4.1.2"
Package existence check passed for "libaio-0.3.106 (i386)"
Package existence check passed for "libaio-0.3.106 (x86_64)"
Package existence check passed for "glibc-2.5-24 (i686)"
Package existence check passed for "glibc-2.5-24 (x86_64)"
Package existence check passed for "compat-libstdc++-33-3.2.3 (i386)"
Package existence check passed for "compat-libstdc++-33-3.2.3 (x86_64)"
Package existence check passed for "elfutils-libelf-0.125 (x86_64)"
Package existence check passed for "elfutils-libelf-devel-0.125"
Package existence check passed for "glibc-common-2.5"
Package existence check passed for "glibc-devel-2.5 (i386)"
Package existence check passed for "glibc-devel-2.5 (x86_64)"
Package existence check passed for "glibc-headers-2.5"
Package existence check passed for "gcc-c++-4.1.2"
Package existence check passed for "libaio-devel-0.3.106 (i386)"
Package existence check passed for "libaio-devel-0.3.106 (x86_64)"
Package existence check passed for "libgcc-4.1.2 (i386)"
Package existence check passed for "libgcc-4.1.2 (x86_64)"
Package existence check passed for "libstdc++-4.1.2 (i386)"
Package existence check passed for "libstdc++-4.1.2 (x86_64)"
Package existence check passed for "libstdc++-devel-4.1.2 (x86_64)"
Package existence check passed for "sysstat-7.0.2"
Package existence check passed for "unixODBC-2.2.11 (i386)"
Package existence check passed for "unixODBC-2.2.11 (x86_64)"
Package existence check passed for "unixODBC-devel-2.2.11 (i386)"
Package existence check passed for "unixODBC-devel-2.2.11 (x86_64)"
Package existence check passed for "ksh-20060214"
Check for multiple users with UID value 0 passed
Current group ID check passed
Core file name pattern consistency check passed.
User "oracle" is not part of "root" group. Check passed
Default user file creation mask check passed
Starting Clock synchronization checks using Network Time Protocol(NTP)...
NTP Configuration file check started...
NTP Configuration file check passed
Checking daemon liveness...
Liveness check passed for "ntpd"
NTP daemon slewing option check passed
NTP daemon's boot time configuration check for slewing option passed
NTP common Time Server Check started...
Check of common NTP Time Server passed
Clock time offset check from NTP Time Server started...
Clock time offset check passed
Clock synchronization check using Network Time Protocol(NTP) passed
Pre-check for cluster services setup was successful.
[oracle@rac2 grid]$ I'm confused :)
Edited by: Eren GULERYUZ on 06.Ara.2010 05:57

Hi,
it looks like, that your "shared device" you are using is not really shared.
The second node does "create an ASM diskgroup" and create OCR and Voting disks. If this indeed would be a shared device, he should have recognized, that your disk is shared.
So as a result your VMware configuration must be wrong, and the disk you presented as shared disk is not really shared.
Which VMWare version did you use? It will not work correctly with the workstation or player edition, since shared disks are only really working with the server version.
If you indeed using the server, could you paste your vm configurations?
Furthermore I recommend using Virtual Box. There is a nice how-to:
http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnOEL5UsingVirtualBox.php
Sebastian

The Script root.sh problem - ora.asm and ASM and Clusterware Stack failed

Folks,
Hello. I am installing Oracle 11gR2 RAC using 2 VMs (rac1 and rac2) whose OS are Oracle Linux 5.6 in VMPlayer according to the website http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
I am installing Grid infrastructure. On step 9 of 10 - execute script /u01/app/grid/root.sh for 2 VMs rac1 and rac2.
After run root.sh in rac1 successfully. I run root.sh in rac2 and get an error as below:
[root@rac2 grid]# ./root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= ora11g
ORACLE_HOME= /u01/app/grid
Enter the full pathname of the local bin directory: [usr/local/bin]: /usr/local/bin
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2012-03-05 16:32:52: Parsing the host name
2012-03-05 16:32:52: Checking for super user privileges
2012-03-05 16:32:52: User has super user privileges
Using configuration parameter file: /u01/app/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1, number 1, and is terminating
An active cluster was found during exclusive startup, restarting to join the cluster
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac2'
CRS-2676: Start of 'ora.mdnsd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'rac2'
CRS-2676: Start of 'ora.gipcd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac2'
CRS-2676: Start of 'ora.gpnpd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac2'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac2'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac2'
CRS-2676: Start of 'ora.diskmon' on 'rac2' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac2'
Start action for octssd aborted
CRS-2676: Start of 'ora.ctssd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'rac2'
CRS-2672: Attempting to start 'ora.asm' on 'rac2'
CRS-2676: Start of 'ora.drivers.acfs' on 'rac2' succeeded
CRS-2676: Start of 'ora.asm' on 'rac2' succeeded
CRS-2664: Resource 'ora.ctssd' is already running on 'rac2'
CRS-4000: Command Start failed, or completed with errors.
Command return code of 1 (256) from command: /u01/app/grid/bin/crsctl start resource ora.asm -init
Start of resource "ora.asm -init" failed
Failed to start ASM
Failed to start Oracle Clusterware stack
[root@rac2 grid]#
As we see the output above, at the end of the output
1) Start of resource ora.asm -init failed
2) Failed to start ASM
3) Failed to start Oracle Clusterware stack
The runInstaller is in the first VM rac1. My question is:
Do any folk understand how to solve the script root.sh in rac2 problem ( 3 fails of ora.asm, ASM and Clusterware stack as above) ?
Thanks.

Please check there is no firewall exist:
try this like:
root.sh fails on second node
MOS note:
11gR2 Grid: root.sh Fails to Start the Clusterware on the Second Node Due to Firewall on Private Network [ID 981357.1]
Grid Infrastructure 11.2.0.2 Installation or Upgrade may fail due to Multicasting Requirement [ID 1212703.1] (Most probabily this issue)

Problem removing Listener Service in Clusterware 11g

It appears that I already have a listener service as shown below, and I am having problem removing this service so that I can create another. I know that I can just add a new listener service for each node, though if anyone would share some insight on how I can remove this listener service ofr Oracle 11g Clusterware with two node cluster, I would appreciate your insight. Thanks
rac1.respecti.com>./crs_resources.sh
HA Resource Target State
ora.rac1.gsd ONLINE ONLINE on rac1
ora.rac1.ons ONLINE ONLINE on rac1
ora.rac1.rac1.lsnr ONLINE ONLINE on rac1
ora.rac1.vip ONLINE ONLINE on rac1
ora.rac2.gsd ONLINE ONLINE on rac2
ora.rac2.ons ONLINE ONLINE on rac2
ora.rac2.rac2.lsnr ONLINE ONLINE on rac2
ora.rac2.vip ONLINE ONLINE on rac2
rac1.respecti.com>srvctl remove listener -n rac1 -l rac1
PRKO-2203 : Listener is running on node: rac1
rac1.respecti.com>srvctl stop listener -n rac1
CRS-0210: Could not find resource 'ora.rac1.LISTENER_RAC1.lsnr'.
rac1.respecti.com>

Hi, Is there any tnslsnr process running on the node. To understand the problem better, enable the debug trace for the .lsnr resource. You can enable trace by executing the following command as root.
crsctl debug log res "ora.rac1.LISTENER_RAC1.lsnr:5"
crsctl debug log crs "CRSRTI:1,CRSCOMM:2,OCRSRV:4"
Try to stop the listener.
Examine the log files under CRS_HOME/log/$HOST/crsd/* and CRS_HOME/log/$HOST/racg/*
Thanks & Regards
-Harish Kalra

Frustrated. problem installing clusterware. no response from metalink

i've asked metalink and they haven't replied. i'm hoping that the otn community can help.
can't get vipca to run manually, post failure to run thru OUI when installing clusterware. comes back with an Exception Error, yet all the cluster readiness tests were reported successfully. i have included my tar here but have masked the oracle engineer's name as 'm not interested in shaming him, i just want to fix my system. many thanks in advance, John.
Severity      2      Last Update      04-MAY-07 07:49:19
Product      Oracle Server - Standard Edition      Product Version      10.2
Platform      Microsoft Windows Server 2003 R2 (32-bit)      Detailed Status      Modified via MetaLink
SR Reference      n/a      BUG Reference      n/a
Abstract
AMER4ISC: CONFIGURATION ASSISTANT "VIRTUAL PRIVATE IP CONFIGURATION ASSISTANT"
Resolution History
03-MAY-07 15:59:15 GMT
### PROBLEM STATEMENT ###
i have followed the installation instructions for installing clusterware with ASm as the preferred method for storage as this is
using Oracle Server Std Edition. when the config assistant ran, it succeeded
all steps prior to the following :
Output generated from configuration assistant "Virtual Private IP Configuration Assistant":
Command = C:\WINDOWS\system32\cmd /c call c:\oracle\product\10.2.0\crs/bin/vipca.bat
-silent -nodelist "whdc-wms-srv-1,whdc-wms-srv-2" -nodevips
"whdc-wms-srv-1/whdc-wms-srv-1-vip/255.255.255.0/public 180.120.1.126|public
180.120.1.126,whdc-wms-srv-2/whdc-wms-srv-2-vip/255.255.255.0/public
180.120.1.126|public 180.120.1.126"
Configuration assistant "Virtual Private IP Configuration Assistant" failed
i then tried to run the vipca afterwards and this fails with :
VIPCA FAILS WITH 'EXCEPTION IN THREAD MAIN' AT START
### GENERAL SYSTEM/DATABASE INFORMATION ###
there are no instances yet. this is a new production 2 node cluster on windows 2003 server. it is a production
system.
### RECENT CHANGES ###
new install
### WORKAROUNDS USED ###
none. the system is not running. need a successful installed
### BUSINESS IMPACT ###
the system is unavailable until the cluster can be built
### NUMBER OF INSTANCES/NODES ###
2
### STEPS TO REPRODUCE ###
have tried 3 times to install. on one occasion i even tried to follow the Oracle RAC Install paper by
Philip Newlan, which appears to be endorsed by Oracle as it states, if you have
issues with the document raise a TAR.
### O/S DETAILS ###
windows 2003 server Service Pack 2
### CLUSTERWARE ###
Oracle Clusterware without any vendor clusterware - CRS (10g)
### CLUSTERWARE DETAILS ###
the system does have windows 2003 cluster installed and successfully configured
### DATABASE VERSION/PATCHSET ###
haven't got to the point where the database is installed. the clusterware install is failing.
### CLUSTER INTERCONNECT ###
UDP over Gigabit Ethernet
### CLUSTER INTERCONNECT DETAILS ###
peer to peer (x-over) heartbeat on private subnet
### OCR, VOTING/QUORUM DISK LOCATION ###
Raw Volumes/Partitions
### OCR, VOTING/QUORUM DISK LOCATION DETAILS ###
2 x HP DL380 G5 servers + external scsi array with RAID 1+0
### DATABASE FILE LOCATION ###
ASM
### DATABASE FILE LOCATION DETAILS ###
n/a at this stage although the voting disk, quorum and the 3 4096MB ASM disks are defined.
### CLUVFY USAGE ###
No
### CLUVFY DETAIL ###
can't run CLUVFY. doesn't work
### DIAGNOSTIC DATA COLLECTED? ###
No
Text continued in next action...
03-MAY-07 15:59:19 GMT
Text continued from previous action...
### DIAGNOSTIC DATA COLLECTED ###
n/a
### ORA-600/ORA-7445 ###
n/a
PLEASE NOTE. THE SYSTEM IS NOT LIVE YET. IT IS NOT A CRITICAL PRODUCTION SYSTEM DOWN PRIORITY BUT IS IMPORTANT TO
TREAT AS URGENT.
Can you easily recover from, bypass or work around the problem?
No
Does your system or application continue normally after the problem occurs?
No
Are the standard features of the system or application still available; is the loss of service minor?
No
Contact me via : E-mail -> [email protected]
03-MAY-07 16:11:53 GMT
Hi ,
I have been assigned your SR and am currently reviewing/researching the situation and
will update the TAR / call you as soon as I have relevant information.
Thank you for your patience.
Best regards,
xxxxx
DS - HA Support
03-MAY-07 16:15:04 GMT
UPDATE
=======
Hi John.
How are you invoking VIPCA after the fact?
- From the command linke with the same parameters as above ( the -silent option should be
removed)
or
- from the command line without any parameters?
If you have not tried to invoke vipca.bat without parameters please do so and enter the required i
nformation when prompted.
Regards,
xxxxx
DS - HA Support
@CUS
03-MAY-07 16:15:30 GMT
Email Update button has been pressed: Sending email to [email protected].
04-MAY-07 07:36:08 GMT
New info : [email protected]
hi xxxxx
in a command window, i fo the following :
C:\oracle\product\10.2.0\crs\BIN>cd c:\oracle\product\10.2.0\crs/bin/
C:\oracle\product\10.2.0\crs\BIN>vipca.bat
Exception in thread "main"
java.lang.NoClassDefFoundError:
C:\oracle\product\10.2.0\crs\BIN>
if i execute vipca commands individually, i actually get the following error on the
last line.
C:\oracle\product\10.2.0\crs\BIN>%CACMD%
Exception in thread "main" java.lang.NoClassDefFoundError: %SRVM_PROPERTY_DEFS%
thanks
04-MAY-07 09:24:05 GMT
New info : [email protected]
xxxxx,
in addition :
i do not understand why this is giving me a syntax error.
cluvfy stage -post hwos -n whdc-wms-srv-1,whdc-wms-srv2 -verbose
ERROR:
Invalid command line syntax.
USAGE:
cluvfy stage {-pre|-post} <stage-name> <stage-specific options> [-verbose]
SYNTAX (for Stages):
cluvfy stage -post hwos -n <node_list> [ -s <storageID_list> ] [-verbose]
cluvfy stage -pre cfs -n <node_list> -s <storageID_list> [-verbose]
cluvfy stage -post cfs -n <node_list> -f <file_system> [-verbose]
cluvfy stage -pre crsinst -n <node_list> [-r { 10gR1 | 10gR2 } ]
[ -c <ocr_location> ] [ -q <voting_disk> ] [-verbose]
cluvfy stage -post crsinst -n <node_list> [-verbose]
cluvfy stage -pre dbinst -n <node_list> [-r { 10gR1 | 10gR2 } ] [-verbose]
cluvfy stage -pre dbcfg -n <node_list> -d <oracle_home> [-verbose]
04-MAY-07 10:56:02 GMT
New info : [email protected]
hi xxxxxx
further information. hope this helps.
with each check, got the same result for both nodes
runcluvfy.bat comp nodereach -n whdc-wms-srv-1,whdc-wms-srv-2 -verbose
Verifying node reachability
Checking node reachability...
Check: Node reachability from node "whdc-wms-srv-2"
Destination Node Reachable?
whdc-wms-srv-2 yes
whdc-wms-srv-1 yes
Result: Node reachability check passed from node "whdc-wms-srv-2".
Verification of node reachability was successful.
runcluvfy.bat comp sys -n whdc-wms-srv-1,whdc-wms-srv-2 -p crs
Verifying system requirement
Checking system requirements for 'crs'...
Operating system version check passed.
Total memory check passed.
Swap space check passed.
System architecture check passed.
Free disk space check passed.
System requirement passed for 'crs'
Verification of system requirement was successful.
runcluvfy.bat comp nodecon -n whdc-wms-srv-1,whdc-wms-srv-2 -verbose
Verifying node connectivity
Checking node connectivity...
Interface information for node "whdc-wms-srv-1"
Interface Name IP Address Subnet
public 180.120.1.126 180.120.1.124 180.120.1.0
public 180.120.1.126 180.120.1.126 180.120.1.0
HEARTBEAT 10.10.10.11 10.10.10.10 10.0.0.0
Interface information for node "whdc-wms-srv-2"
Interface Name IP Address Subnet
public 180.120.1.126 180.120.1.127 180.120.1.0
HEARTBEAT 10.10.10.11 10.10.10.11 10.0.0.0
Check: Node connectivity of subnet "180.120.1.0"
Source Destination Connected?
whdc-wms-srv-1:public 180.120.1.126 whdc-wms-srv-1:public 180.120.1.126 yes
whdc-wms-srv-1:public 180.120.1.126 whdc-wms-srv-2:public 180.120.1.126 yes
whdc-wms-srv-1:public 180.120.1.126 whdc-wms-srv-2:public 180.120.1.126 yes
Result: Node connectivity check passed for subnet "180.120.1.0" with node(s) whd
c-wms-srv-1,whdc-wms-srv-2.
Check: Node connectivity of subnet "10.0.0.0"
Source Destination Connected?
whdc-wms-srv-1:HEARTBEAT 10.10.10.11 whdc-wms-srv-2:HEARTBEAT 10.10.10.11 ye
s
Result: Node connectivity check passed for subnet "10.0.0.0" with node(s)
whdc-w
ms-srv-1,whdc-wms-srv-2.
Suitable interfaces for VIP on subnet "180.120.1.0":
whdc-wms-srv-1 public 180.120.1.126:180.120.1.124 public 180.120.1.126:180.120.1
.126
whdc-wms-srv-2 public 180.120.1.126:180.120.1.127
Suitable interfaces for the private interconnect on subnet "10.0.0.0":
whdc-wms-srv-1 HEARTBEAT 10.10.10.11:10.10.10.10
whdc-wms-srv-2 HEARTBEAT 10.10.10.11:10.10.10.11
Result: Node connectivity check passed.
Verification of node connectivity was successful.
Text continued in next action...
04-MAY-07 10:57:03 GMT
Text continued from previous action...
04-MAY-07 12:12:02 GMT
New info : [email protected]
hi xxxxx,
i've also checked the storage and this was the result from both nodes.
runcluvfy.bat comp ssa -n whdc-wms-srv-1,whdc-wms-srv-2
Verifying shared storage accessibility
Checking shared storage accessibility...
Disk Partition Sharing Nodes (2 in count)
VOTEDSK1 whdc-wms-srv-1
whdc-wms-srv-2
Disk Partition Sharing Nodes (2 in count)
OCRCFG whdc-wms-srv-1
whdc-wms-srv-2
Disk Partition Sharing Nodes (2 in count)
\Device\Harddisk2\Partition3 whdc-wms-srv-1
whdc-wms-srv-2
Disk Partition Sharing Nodes (2 in count)
\Device\Harddisk2\Partition4 whdc-wms-srv-1
whdc-wms-srv-2
Disk Partition Sharing Nodes (2 in count)
\Device\Harddisk2\Partition5 whdc-wms-srv-1
whdc-wms-srv-2
Shared storage check was successful on nodes "whdc-wms-srv-1,whdc-wms-srv-2".
Verification of shared storage accessibility was successful.
04-MAY-07 12:23:01 GMT
New info : [email protected]
apologies if this is too much information: but i have also run the Oracle Clusterware Requirements as
follows, and got the same result from each node.
runcluvfy.bat stage -pre crsinst -n whdc-wms-srv-1,whdc-wms-srv-2
Performing pre-checks for cluster services setup
Checking node reachability...
Node reachability check passed from node "whdc-wms-srv-1".
Checking user equivalence...
User equivalence check passed for user "oracle".
Checking administrative privileges...
Checking node connectivity...
Node connectivity check passed for subnet "180.120.1.0" with node(s) whdc-wms-sr
v-1,whdc-wms-srv-2.
Node connectivity check passed for subnet "10.0.0.0" with node(s) whdc-wms-srv-1
,whdc-wms-srv-2.
Suitable interfaces for VIP on subnet "180.120.1.0":
whdc-wms-srv-1 public 180.120.1.126:180.120.1.124 public 180.120.1.126:180.120.1
.126
whdc-wms-srv-2 public 180.120.1.126:180.120.1.127
Suitable interfaces for the private interconnect on subnet "10.0.0.0":
whdc-wms-srv-1 HEARTBEAT 10.10.10.11:10.10.10.10
whdc-wms-srv-2 HEARTBEAT 10.10.10.11:10.10.10.11
Node connectivity check passed.
Checking system requirements for 'crs'...
Operating system version check passed.
Total memory check passed.
Swap space check passed.
System architecture check passed.
Free disk space check passed.
System requirement passed for 'crs'
Pre-check for cluster services setup was successful.
04-MAY-07 12:38:04 GMT
New info : [email protected]
hi
by the way, i am following Part Number B14207-01. Oracle® Database Oracle Clusterware and Oracle Real
Application Clusters Installation Guide
10g Release 2 (10.2) for Microsoft Windows
i am upto section 4 Installing Oracle Clusterware on Windows-Based Systems.
this is where i did as stated, Using Oracle Universal Installer to Install Oracle Clusterware on Windows
then at step 9, When you click Finish, the OUI installs the OCFS and Oracle Clusterware software on the local node and
validates the installation again. The OUI will also create any required OCFS
file systems. After validating the installation, the OUI completes the Oracle
Clusterware software installation and configuration on the remote nodes.
this is where the configuration assistant fails, with the :
Output generated from configuration assistant "Virtual Private IP Configuration Assistant":
Command = C:\WINDOWS\system32\cmd /c call c:\oracle\product\10.2.0\crs/bin/vipca.bat
-silent -nodelist "whdc-wms-srv-1,whdc-wms-srv-2" -nodevips
"whdc-wms-srv-1/whdc-wms-srv-1-vip/255.255.255.0/public 180.120.1.126|public
180.120.1.126,whdc-wms-srv-2/whdc-wms-srv-2-vip/255.255.255.0/public
180.120.1.126|public 180.120.1.126"
Configuration assistant "Virtual Private IP Configuration Assistant" failed
, and then when you try to vipca.bat manually, you get :
C:\oracle\product\10.2.0\crs\BIN>vipca
Exception in thread "main"
04-MAY-07 07:49:19 : CHANGES MADE VIA MetaLink
NOT YET FORWARDED TO OUR INTERNAL SYSTEMS :
New info : [email protected]
hi xxxxxx
also noted that even after the 1st attempt to install clusterware the path is as follows :
PATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem
not sure when there is no change to the path as a result of the oracle install, as there is a JRE and jlib folder under the oracle home : C:\oracle\product\10.2.0\crs\jlib

1st question is you have contradictory statements in your tar. 1) you say no vendor clusterware and the you say you have windows 2003 clusterware installed and configured.
Why are you installing both?
Although I don;t think that is the problem here, I wonder why anyone would want to run 2 independent cluster software on same servers.
Now the output from the installer has whdc-wms-srv-2-vip output from cluvfy shows suitable interface as whdc-wms-srv-1 HEARTBEAT 10.10.10.11:10.10.10.10
whdc-wms-srv-2 HEARTBEAT 10.10.10.11:10.10.10.11
whdc-wms-srv-2-vip what you entered to installer does not match what is available!

PRKC-1021 Problem in the clusterware

I am encountering this error on one of the node:
[oracle@ahsggnd02 ~]$ gsdctl stat
CMCLI WARNING : ReadCommPort: received error=104 on recv()
CMCLI WARNING : ReadCommPort: received error=104 on recv()
CMCLI WARNING : ReadCommPort: received error=104 on recv()
PRKC-1021 : Problem in the clusterware
failed to get list of active nodes in the clusterware
[oracle@ahsggnd02 ~]$ gsdctl start
PRKC-1021 : Problem in the clusterware
failed to get list of active nodes in the clusterware
[oracle@ahsggnd02 ~]$ srvctl status database -d artgprd
PRKC-1021 : Problem in the clusterware
PRK0-2005 : Application Error: Failure in getting cluster database configuration
for: artgprd
[oracle@ahsggnd02 ~]$
checking the alert log in bdump directory does not helped as there are no errors logged in it.
cm.log file is flooded with
CMCLI WARNING : ReadCommPort: received error=104 on recv()
no log folder in srvm directory
oracle product version 9.2.0.8
os : redhat enterprise linux 4 32-bit
opatch version : 1.0.0.0.55
opatch lsinventory shows no interim patches applied.
Please help!!

anybody out there who can help?
not much found on metalink also..

Problems Detecting Disks Clusterware Installation

Hi guys, I need some urgent help!
I'm trying to install a 2 node cluster database on a Windows 2008 R1 64-bit OS for a production environment. For the datafiles I have some shared disks from an emc clariion CX3.
I've prepared the disks enabling automount, disabling write cache, and creating the RAW partitions.
The problems is that during clusterware setup, after getting all cluster verification ok, I can't see any disks in "Cluster Configuration Storage" screen.
I've tried with Oracle Clusterware Release 1 (11.1.0.7.0) and Oracle Clusterware Release 2 (10.2.0.4).
Am I doing something wrong?
What is the best practice regarding the disks scenario. My original idea was leaving the Oracle Homes in the OS disk and put all the database files in an OCFS shared disk.
Thank you
João Almeida

Hi,
I was having this problem as well setting up a test Windows 2008x64 environment for benchmarking and possibly transitioning our production systems
I fixed the issue by creating the drives and partitions using diskpart.exe and not the disk manager gui.
The gui only allowed me to create volumes in my 2008 environment. When extended partitions and logical drives were created at command line (on my third attempt to have the installation 'see' the drives) the Oracle Clusterware software picked up the shared drives available for ASM.
Previously the cluvfy was recognizing the shared storage but the installation software would not.
Let me know if this helps.
Mike

Problem while starting the oracle clusterware

Hi,
In my envirnoment there are two rac nodes. When both systems are shutdown state but when i start the system 1 (node1) the oracle clusterware does not start it give the error while running this command crs_stat -t crs cannot communicate.
But when I start system 2 (node 2) the oracle clusterware starts.
Can anyone help me out regarding this issue?
Thank you for your cooperation.
Regards,
Adnan Hamdus Salam.

Hi,
No that is not the case. My oracle rac clusterware is perfectly working fine.
In case 1 when both nodes are shutdown when I start node 2 the oracle clusterware starts and then I start node 1 the whole oracle rac clusterware up successfull.
in case 2 when both nodes are shutdown when I start node 1 the oracle rac clusterware does not starts and then when I start node 2 the whole oracle rac clusterware up successfully.
Regards,
Adnan Hamdus Salam

Crs processes restart problem after clusterware installation

Hi all,
I successfully installed the Oracle clusterware using two nodes, which are the Linux virtual machines created using VMWare. After reboot, the gsd and ons state on the second node is unknown:
NAME=ora.node2.gsd
TYPE=application
TARGET=ONLINE
STATE=UNKNOWN on node2
NAME=ora.node2.ons
TYPE=application
TARGET=ONLINE
STATE=UNKNOWN on node2
My questions are:
(1) what are the reasons causing this?
(2) how to resolve it so their state can be ONLINE after re-boot?
Thanks!

I'd start by looking for any "interesting" entries in the clusterware logfiles at $ORA_CRS_HOME/log/<node_name>. My guess is that you'll find something in them that will point you to the next step for debugging.
Dan

Installing RAC Problem: Oracle Clusterware 10g is present on remote node

Folks,
Hello.
I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer.
I have been installing Grid Infrastructure using runInstaller in the first VM rac1 from step 1 to step 9 of 10.
On the step 9 of 10 in the Wizard, accidentally, I touch the Mouse, and the Wizard is gone.
The directory for installing Grid in the 2 VMs is the same: /u01
In order to make sure everything is correct, I delete entire directory /u01 in the 2 VMs and install Grid in rac1 again.
But get the error message as follows:
[INS-40915] The Installer has detected the presence of Oracle Clusterware 10g on the remote node rac2.localdomain.
Cause: Oracle Clusterware 10g is present on remote node rac2.localdomain but not on the local node.
Action: To upgrade the Oracle Clusterware 10g Installation to this release, run Installer on a node where Oracle Clusterware 10 installation is located. To create a new cluster, choose a set of nodes that are not part of an existing cluster.
Regarding the above error message, I do not install any Oracle Clusterware 10g in rac2 because it's the first time when I install Grid using rac1 and rac2.
My question is:
Do any folk understand how to remove something in rac2 to solve the above issue so that I can install Grid again ?
Thanks.

Folks,
Hello. Thanks a lot for replying.
The tutorial http://docs.oracle.com/cd/E11882_01/install.112/e22489/rem_orcl.htm#CBHEFHAC is about the regular procedure to deinstall Grid Clusterware and Database.
I have just installed Grid and have not installed the Database. I have removed ORACLE HOME /u01 completely in both VMs. There is no way to follow the regular procedure to deinstall at this time.
I do not install any Oracle Clusterware 10g in the VM rac2 because it's the first time when I install Grid using VM rac1 and rac2.
When install Grid again. I get the error message:
"[INS-40915] The Installer has detected the presence of Oracle Clusterware 10g on the remote node rac2.localdomain."
This is strange! It seems that we need to remove some files in the VM rac2 like /etc/oracle that I am not sure.
My questions are:
First, where is 10g directory to remove ?
Second, what files left on the system to clean up ?
Third, what does " Follow 239998.1" means regarding asanqa's replying to me ?
Thanks.

Problem about use OCFS2 install clusterware

hi,all :
i set two disk use OCFS2, one for OCR, another for voting disk,i format the two disk on rac1 ,and mout on rac1 and rac2
[root@rac2 ocfs2]# mkfs.ocfs2 -b 4K -C 32K -N 2 -L ora_votingdisk /dev/sdb1
[root@rac2 ocfs2]# mkdir /opt/votingdisk
[root@rac2 ocfs2]# chown oracle.oinstall /opt/votingdisk/
[root@rac2 ocfs2]# mount -t ocfs2 /dev/sdb1 /opt/votingdisk/
[root@rac2 votingdisk]# mkfs.ocfs2 -b 4K -C 32K -N 2 -L ora_OCR /dev/sdc1
[root@rac2 votingdisk]# mkdir /opt/OCRfile
[root@rac2 votingdisk]# chown oracle.oinstall /opt/OCRfile
[root@rac2 votingdisk]# mount -t ocfs2 /dev/sdc1 /opt/OCRfile/and i use response file to installl crs
n_storageTypeOCR=2
s_ocrpartitionlocation="/opt/OCRfile"
s_ocrMirrorLocation=""
n_storageTypeVDSK=2
s_votingdisklocation="/opt/votingdisk"and install successed,but when i run root.sh ,both fail on each node,and here is error info,i do not know why?
[root@rac2 opt]# /opt/ora/product/10.2.0/crs_1/root.sh
WARNING: directory '/opt/ora/product/10.2.0' is not owned by root
WARNING: directory '/opt/ora/product' is not owned by root
WARNING: directory '/opt/ora' is not owned by root
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.
Setting the permissions on OCR backup directory
Setting up NS directories
PROT-1: Failed to initialize ocrconfig
Failed to upgrade Oracle Cluster Registry configurationand i checked the log output
[root@rac2 client]# cat ocrconfig_8035.log
Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
2011-07-29 23:26:53.612: [ OCRCONF][5408976]ocrconfig starts...
2011-07-29 23:26:53.613: [ OCRCONF][5408976]Upgrading OCR data
2011-07-29 23:26:53.614: [ OCROSD][5408976]utopen:6'': OCR location /opt/OCRfile configured is not valid storage type. Return code [37].
2011-07-29 23:26:53.614: [ OCRRAW][5408976]proprinit: Could not open raw device
2011-07-29 23:26:53.614: [ default][5408976]a_init:7!: Backend init unsuccessful : [37]
2011-07-29 23:26:53.615: [ OCRCONF][5408976]Exporting OCR data to [OCRUPGRADEFILE]
2011-07-29 23:26:53.615: [ OCRAPI][5408976]a_init:7!: Backend init unsuccessful : [33]
2011-07-29 23:26:53.615: [ OCRCONF][5408976]There was no previous version of OCR. error:[PROC-33: Oracle Cluster Registry is not configured]
2011-07-29 23:26:53.615: [ OCROSD][5408976]utopen:6'': OCR location /opt/OCRfile configured is not valid storage type. Return code [37].
2011-07-29 23:26:53.615: [ OCRRAW][5408976]proprinit: Could not open raw device
2011-07-29 23:26:53.615: [ default][5408976]a_init:7!: Backend init unsuccessful : [37]
2011-07-29 23:26:53.616: [ OCROSD][5408976]utopen:6'': OCR location /opt/OCRfile configured is not valid storage type. Return code [37].
2011-07-29 23:26:53.616: [ OCRRAW][5408976]proprinit: Could not open raw device
2011-07-29 23:26:53.616: [ OCRAPI][5408976]a_init:6b!: Backend init unsuccessful : [37]
2011-07-29 23:26:53.616: [ OCRCONF][5408976]Failed to initialized OCR context. error:[PROC-37: Oracle Cluster Registry does not support the storage type configured]
2011-07-29 23:26:53.617: [ OCRCONF][5408976]Exiting [status=failed]...Edited by: 859340 on 2011-7-29 上午12:59

instead this dot ( . ) on oracle.oinstall
[root@rac2 votingdisk]# chown oracle.oinstall /opt/OCRfileuse colon ( : )
[root@rac2 votingdisk]# chown oracle:oinstall /opt/OCRfile

Clusterware install on HPUX 11.23 on 2node cluster (HP Integrity itanium)

We are trying to configure a two node cluster to host Oracle 10gR2 RAC environment. The servers are HP-Integrity BL-86C servers, each with two Itanium CPUs and HP-UX 11.23. There are two four network ports available, which are connected to a Gigabit virtual connect. One of them is used as the public interface for RAC and second one is used as private interconnect for RAC.
We have EVA3000 SAN. We configured two 1GB LUNs and presented both of them to both the servers. These will be used as shared raw storage for Oracle Clusterware files. On each server, we can see these raw devices under /dev/rdsk/c*. We assigned root as owner for first LUN (which is used for Cluster registry), and oracle as owner on the second LUN (which is used for voting disk). We did this on both the servers.
We set up the ssh user equivalency on both machines so that they can talk to each other using SSH and oracle userid without prompting for password, as per oracle install manual.
When we start the install, it apparently finishes successfully on the first server, but it fails on the second one saying ‘WARNING: clssnmDiskPMT: long disk latency (25031 ms) to voting disk (2//dev/rdsk/c1t1d0)”
Oracle is pointing to this error, and saying that is the disk issue. We are stuck at this point where we need to figure out if the way we are trying to use the sharing of LUNs is correct? Can we present a LUN as raw disk to two servers at the same time as shared raw device?
Also, how can we test the disk latency? I suspect that it is probably not a disk issue but shared storage issue, where first server holds the raw disks and second one can not see them.
Our unix adminstrator talked to the HP EVA specialist to figure out the 'disk latency' problem, and HP doesn't think it is an issue. But if there is anything Oracle wants to check from o/s or hw side, I can check it.
My question is, if it is voting disk issue, why does first node successfully starts all the daemons and formats Crs and voting disks successfully? We can see that in the root.sh output , and in the ocssd.log file on the first node
Is there any utility from oracle, which can check if the shared disks for ocr and vote disks are configured/accessible all right? The runcluvfy.sh which was distributed with the software DVD is buggy and doesn’t work. Oracle tech support was not able to provide any suggestions to make it work.
Please let me know if there is anybody who has done similar install successfully who can shed some light on this problem.
Your help will be greatly appreciated.
Thanks

I should add that the root.sh finishes successfully on the first node.
It fails on the second node.
Following is the output of root.sh on the first node.
WARNING: directory '/u01/oracle10/product/10gR2' is not owned by root
WARNING: directory '/u01/oracle10/product' is not owned by root
WARNING: directory '/u01/oracle10' is not owned by root
Checking to see if Oracle CRS stack is already configured
Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/u01/oracle10/product/10gR2' is not owned by root
WARNING: directory '/u01/oracle10/product' is not owned by root
WARNING: directory '/u01/oracle10' is not owned by root
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: dhiehr08 dhiehr08-priv dhiehr08
node 2: dhiehr14 dhiehr14-priv dhiehr14
Creating OCR keys for user 'root', privgrp 'sys'..
Operation successful.
Now formatting voting device: /dev/rdsk/c5t0d4
Format of 1 voting devices complete.
Startup will be queued to init within 30 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
dhiehr14
CSS is inactive on these nodes.
dhiehr08
Local node checking complete.
Run root.sh on remaining nodes to start CRS daemons.
On the second node, the output is as follows...
WARNING: directory '/u01/oracle10/product/10gR2' is not owned by root
WARNING: directory '/u01/oracle10/product' is not owned by root
WARNING: directory '/u01/oracle10' is not owned by root
Checking to see if Oracle CRS stack is already configured
Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/u01/oracle10/product/10gR2' is not owned by root
WARNING: directory '/u01/oracle10/product' is not owned by root
WARNING: directory '/u01/oracle10' is not owned by root
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: dhiehr08 dhiehr08-priv dhiehr08
node 2: dhiehr14 dhiehr14-priv dhiehr14
clscfg: Arguments check out successfully.
NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.
Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within 30 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
Failure at final check of Oracle CRS stack.
10
The error message I mentioned in my previous post is from ocssd.log on the failed node.
Your help will be greately appreciated. Thanks

Clusterware problem

Similar Messages

Maybe you are looking for