Oracle cluster restart

There is a 2 node RAC database and both nodes reboots yesterday at the same time. We uses OCSF2 for OCRs and voting disks.
Here is the folder structure:
1. /opt/oracle/data/crs1/ - stores 1st OCR and 1st voting disk
2. /opt/oracle/data/crs2/ - stores 2nd OCR and 2nd voting disk
3. /opt/oracle/data/crs3/ - 3rd voting disk
SA told us /opt/oracle/data/crs1/ and /opt/oracle/data/crs2/ disappeared for few minutes due to SAN problem, that mean Oracle CRS did not access both OCR for few mintues. Is it cause the cluster node reboot?
Version:
CRS - 11.1.0.7
ASM - 11.1.0.7
DB - 10.2.0.4
OS - Oracle Linux 2.6.18-128.7.1.0.1.el5
Thanks

Sorry, here is the log:
/var/log/messages in node 1
Dec 8 15:14:38 dc01locs01 kernel: 493 [RAIDarray.mpp]dcsgswsst6140:1:0:2 Cmnd failed-retry the same path. vcmnd SN 18469446 pdev H3:C0:T0:L2 0x02/0x04/0x01 0x08000002 mpp_status:1
Dec 8 15:14:38 dc01locs01 kernel: 493 [RAIDarray.mpp]dcsgswsst6140:1:0:2 Cmnd failed-retry the same path. vcmnd SN 18469448 pdev H3:C0:T0:L2 0x02/0x04/0x01 0x08000002 mpp_status:1
Dec 8 15:17:20 dc01locs01 syslogd 1.4.1: restart.
Dec 8 15:17:20 dc01locs01 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Dec 8 15:17:20 dc01locs01 kernel: Linux version 2.6.18-128.7.1.0.1.el5 ([email protected]) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-44)) #1 SMP Mon Aug 24 14:07:09 EDT 2009
Dec 8 15:17:20 dc01locs01 kernel: Command line: ro root=/dev/vg00/root rhgb quiet crashkernel=128M@16M
Dec 8 15:17:20 dc01locs01 kernel: BIOS-provided physical RAM map:
ocssd.log in node 1
[    CSSD]2009-12-08 15:14:33.467 [1134680384] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(148585637)
[    CSSD]2009-12-08 15:14:33.468 [1134680384] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 1
[    CSSD]2009-12-08 15:19:00.217 >USER: Copyright 2009, Oracle version 11.1.0.7.0
[    CSSD]2009-12-08 15:19:00.217 >USER: CSS daemon log for node dc01locs01, number 1, in cluster ocsprodrac
[ clsdmt]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=dc01locs01DBG_CSSD))
[    CSSD]2009-12-08 15:19:00.235 [1995774848] >TRACE: clssscmain: Cluster GUID is 79db6803afc7df32ffd952110f22702c
[    CSSD]2009-12-08 15:19:00.239 [1995774848] >TRACE: clssscmain: local-only set to false
/var/log/messages in node 2
Dec 8 15:14:38 dc01locs02 kernel: 493 [RAIDarray.mpp]dcsgswsst6140:1:0:2 Cmnd failed-retry the same path. vcmnd SN 18561465 pdev H3:C0:T0:L2 0x02/0x04/0x01 0x08000002 mpp_status:1
Dec 8 15:14:38 dc01locs02 kernel: 493 [RAIDarray.mpp]dcsgswsst6140:1:0:2 Cmnd failed-retry the same path. vcmnd SN 18561463 pdev H3:C0:T0:L2 0x02/0x04/0x01 0x08000002 mpp_status:1
Dec 8 15:17:14 dc01locs02 syslogd 1.4.1: restart.
Dec 8 15:17:14 dc01locs02 kernel: klogd 1.4.1, log source = /proc/kmsg started.
Dec 8 15:17:14 dc01locs02 kernel: Linux version 2.6.18-128.7.1.0.1.el5 ([email protected]) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-44)) #1 SMP Mon Aug 24 14:07:09 EDT 2009
Dec 8 15:17:14 dc01locs02 kernel: Command line: ro root=/dev/vg00/root rhgb quiet crashkernel=128M@16M
Dec 8 15:17:14 dc01locs02 kernel: BIOS-provided physical RAM map:
ocssd.log in node 2
[    CSSD]2009-12-08 15:14:35.450 [1264081216] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x2aaaac065a00), type 1
[    CSSD]2009-12-08 15:14:36.909 [1127713088] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(1) dest(1) size(123) tag(00000000) incarnation(148585637)
[    CSSD]2009-12-08 15:14:36.909 [1127713088] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 1 node 1, birth 0
[    CSSD]2009-12-08 15:18:55.047 >USER: Copyright 2009, Oracle version 11.1.0.7.0
[ clsdmt]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=dc01locs02DBG_CSSD))
[    CSSD]2009-12-08 15:18:55.047 >USER: CSS daemon log for node dc01locs02, number 2, in cluster ocsprodrac
[    CSSD]2009-12-08 15:18:55.071 [3628915584] >TRACE: clssscmain: Cluster GUID is 79db6803afc7df32ffd952110f22702c
[    CSSD]2009-12-08 15:18:55.077 [3628915584] >TRACE: clssscmain: local-only set to false

Similar Messages

Error while checking the status of Oracle Cluster ware

Hi
I was trying to install the database using dbca after setting up the grid and database software on LINUX x86-64 RHEL 5.7 machine. The database software version is 11.2.0.3. It throwing the error regarding the connectivity of clusterware. So I checked the status of clusterware.
-bash-3.2$ ./crsctl stat res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
-bash-3.2$
But when I ran below one:
-bash-3.2$ ./crsctl stat res -t -init
NAME TARGET STATE SERVER STATE_DETAILS
Cluster Resources
ora.asm
1 ONLINE ONLINE sfv9699 Started
ora.cluster_interconnect.haip
1 ONLINE ONLINE sfv9699
ora.crf
1 ONLINE ONLINE sfv9699
ora.crsd
1 ONLINE OFFLINE
ora.cssd
1 ONLINE ONLINE sfv9699
ora.cssdmonitor
1 ONLINE ONLINE sfv9699
ora.ctssd
1 ONLINE ONLINE sfv9699 OBSERVER
ora.diskmon
1 OFFLINE OFFLINE
ora.drivers.acfs
1 ONLINE ONLINE sfv9699
ora.evmd
1 ONLINE INTERMEDIATE sfv9699
ora.gipcd
1 ONLINE ONLINE sfv9699
ora.gpnpd
1 ONLINE ONLINE sfv9699
ora.mdnsd
1 ONLINE ONLINE sfv9699
So i saw that the crsd having some issue. I checked the alert log and crsd log. Below are the output.
Alert <server_name>.log
2012-10-20 15:37:51.408
[ohasd(3694)]CRS-2765:Resource 'ora.crsd' has failed on server 'sfv9699'.
2012-10-20 15:37:52.968
[crsd(5188)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle2/app/11.2.0/grid/log/sfv9699/crsd/crsd.log.
2012-10-20 15:37:52.984
[crsd(5188)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
]. Details at (:CRSD00111:) in /oracle2/app/11.2.0/grid/log/sfv9699/crsd/crsd.log.
2012-10-20 15:37:53.471
[ohasd(3694)]CRS-2765:Resource 'ora.crsd' has failed on server 'sfv9699'.
2012-10-20 15:37:53.472
[ohasd(3694)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
CRSD.log
2012-10-20 15:37:52.456: [ CRSMAIN][3563381328] Checking the OCR device
2012-10-20 15:37:52.457: [ CRSMAIN][3563381328] Sync-up with OCR
2012-10-20 15:37:52.457: [ CRSMAIN][3563381328] Connecting to the CSS Daemon
2012-10-20 15:37:52.457: [ CRSMAIN][3563381328] Getting local node number
2012-10-20 15:37:52.459: [ CRSMAIN][3563381328] Initializing OCR
[   CLWAL][3563381328]clsw_Initialize: OLR initlevel [70000]
2012-10-20 15:37:52.897: [ OCRASM][3563381328]proprasmo: Error in open/create file in dg [DATA]
[ OCRASM][3563381328]SLOS : SLOS: cat=7, opn=kgfoAl06, dep=27140, loc=kgfokge
2012-10-20 15:37:52.898: [ OCRASM][3563381328]ASM Error Stack : ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: kgfoCheckMount returned [7]
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: The ASM instance is down
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: Failed to open [+DATA]. Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: No OCR/OLR devices are usable
2012-10-20 15:37:52.968: [ OCRASM][3563381328]proprasmcl: asmhandle is NULL
2012-10-20 15:37:52.969: [    GIPC][3563381328] gipcCheckInitialization: possible incompatible non-threaded init from [prom.c : 690], original from [clsss.c : 5326]
2012-10-20 15:37:52.975: [ default][3563381328]clsvactversion:4: Retrieving Active Version from local storage.
2012-10-20 15:37:52.978: [ CSSCLNT][3563381328]clssgsgrppubdata: group (ocr_SFV9699-cluster) not found
2012-10-20 15:37:52.978: [ OCRRAW][3563381328]proprio_repairconf: Failed to retrieve the group public data. CSS ret code [20]
2012-10-20 15:37:52.981: [ OCRRAW][3563381328]proprioo: Failed to auto repair the OCR configuration.
2012-10-20 15:37:52.981: [ OCRRAW][3563381328]proprinit: Could not open raw device
2012-10-20 15:37:52.981: [ OCRASM][3563381328]proprasmcl: asmhandle is NULL
2012-10-20 15:37:52.983: [ OCRAPI][3563381328]a_init:16!: Backend init unsuccessful : [26]
2012-10-20 15:37:52.984: [ CRSOCR][3563381328] OCR context init failure. Error: PROC-26: Error while accessing the physical storage
ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.984: [ CRSMAIN][3563381328] Created alert : (:CRSD00111:) : Could not init OCR, error: PROC-26: Error while accessing the physical storage
ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.984: [    CRSD][3563381328][PANIC] CRSD exiting: Could not init OCR, code: 26
2012-10-20 15:37:52.984: [    CRSD][3563381328] Done.
=======================
I see in the above log that saying ASM instance is down and failed to open +DATA .
But the asm instance up and running
SQL> select instance_name,status from v$instance;
INSTANCE_NAME STATUS
+ASM1            STARTED
And we havent created any disk named DATA before the installation. We have created only below two disks
SQL> select name,header_status from v$asm_disk;
NAME HEADER_STATUS
ASM_DATA MEMBER
FLASH_RECOVERY MEMBER
But I am seeing a diskgroup in the v$asm_diskgroup which we havent created.
SQL> select name,state from v$asm_diskgroup;
NAME STATE
DATA MOUNTED
Ya this is a second time installtion. In the first installtion we created the asmdisk as DATA. But later everything (RAW device ) was formatted and this new disks has been created and installtion again started
[root@SFV9699 bin]# oracleasm listdisks
ASM_DATA
FLASH_RECOVERY
Seems like its trying to read the old disk DATA.
we have done asmscanning too with oracleasm scan disks. but no use.
Where I can remove the old entry of DATA disk.
It would be a great if a quick response get.
Thanks
SHIYAS M

The permission looks fine. If it was permission issue then y it is trying to read the DATA disk which I havent created this time at all ( But created in the first installation).
2012-10-20 15:37:52.459: [ CRSMAIN][3563381328] Initializing OCR
[ CLWAL][3563381328]clsw_Initialize: OLR initlevel [70000]
2012-10-20 15:37:52.897: [ OCRASM][3563381328]proprasmo: *Error in open/create file in dg [DATA]*[ OCRASM][3563381328]SLOS : SLOS: cat=7, opn=kgfoAl06, dep=27140, loc=kgfokge
2012-10-20 15:37:52.898: [ OCRASM][3563381328]ASM Error Stack : ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: kgfoCheckMount returned [7]
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: The ASM instance is down
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: *Failed to open [+DATA].* Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: No OCR/OLR devices are usable
2012-10-20 15:37:52.968: [ OCRASM][3563381328]proprasmcl: asmhandle is NULL
The only disks created are
[root@SFV9699 dev]# oracleasm listdisks
ASM_DATA
FLASH_RECOVERY
And these disks are showing part of that group also.. Not quite sure how this happened..
what abt dropping this group.. will anything work.

Oracle Cluster and libnnz10 problem - SOLVED!

Hi to all
I have some machines (XServe) with OSX 10.4.9 and Oracle 10.1.0.3.
In all the machines I follow the instructions find in this forum (the relink libnnz10.dylib trick) and all the databases runs very well.
Now I'm trying to instal two machines in cluster mode.
The node 1 is a clean machine. The node 2 is a machine that has a Oracle single instance running.
All the installation in cluster mode runs smooth and I made the same things that in a single instance (like the relink trick).
With all installed, the CRS daemon is running and the listeners is running (I run NETCA before runnig DBCA).
Using the DBCA works fine until the last step - for the database creation, the last script has a shutdown/startup command to run a full recompile of all packages and procedures in the database.
At this moment the installation fails (with end-of-communication channel). Looking in the logs, this is the _dyld libnnz10.dylib error.
Even after the crash in installation, I quit the DBCA and runs SQLPLUS. I connect in the database, try a startup (that fails with the error mentioned), reconnect again and make two commands : alter database mount; alter database open; (and it works).
I do this in the two nodes and the CRS daemon recognizes the running instances (with crs_stat -t I can see all online) and the database is running and in cluster (what I do in one instance appears in the other and the datafiles are the same), including failover tasks (like simulating a node down - the database still running).
But all tries to run the startup/shutdown commands fails. It fails always when the LMON processes try to start.
I recheck the installation, focusing in the relink trick with the libnnz10. When I use DBCA to install a single instance on node 1 or node 2 in the same ORACLE_HOME of the cluster, it runs fine (including startup/shutdown) - this make me think that all the database relink's are fine.
I try to relink the cluster. In installation it uses 4 makes and I redo this makes without the libnnz10. The makes runs well too, but the error continues (only using startup/shutdown in cluster database).
I'm doing the documentation of the process and will post it, but I want to resolve this issue.
Any ideas ?
Thanks to all
Message was edited by:
alliance01

Hi to all.
I downloaded the 10.1.0.5 as soon I can - thanks to damjanp!
After the download, I follow all the instructions.
I stop the database, all the services and the cluster. Run the installer and it works fine.
When I try to make the post-installation tasks, I cannot startup the database (nor with the error that I was having). I received a Oracle Cluster Configuration Error...
I read all the logs and find 3 errors. I do not know if this occurs because of wrong environment variables.
The commands awk, touch and basename fails - the scripts try to find this commands in /bin (this commands in OSX stay in /usr/bin). I prefer make a link (ln -s) using root :
ln -s /usr/bin/awk /bin/awk
ln -s /usr/bin/touch /bin/touch
ln -s /usr/bin/basename /bin/basename
When I done this, the cluster starts (ocssd.bin, crsd.bin e evmd.bin). But when I try to start the database, it fails (ORA-29702 : error occurred in Cluster Group Service operation) and srvctl gives me PRKH-1010 : Unable to communicate with CRS services. [OCR Error(Native : prsr_initCLSS:[21])].
To resolve this I use localconfig (user root) :
localconfig reset /<ORACLE_HOME>
After this, I shutdown all and restart the CRS services - and for my surprise the CRS automaticaly starts all the services (including the instances).
And the libnnz10 problema was gone!
I read the documentation and found that the "TNS - lost contact" problem in Tiger (yeah - Tiger) was resolved.
I think that 10.1.0.5 can runs on Tiger more easily.
The cluster are running fine now - I shutdown/startup the instance several times to test with no errors.
I will prepare a documentation to post in the Web about this installation. When I finish I post in this forum the link.
Thank's to all.

Oracle resource restart

Could someone clarify my confusion with restarting resources.
I have a 2 node SC 3.2 with a single oracle database.
The customers requirement is that if there is a failure of oracle database or listener then the cluster tries to restated the resource, but doesnt initiate a failover.
The Failover mode for the Oracle server and oracle listener resources are set to RESTART_ONLY.
The Oracle server resource has a retry count= 1 and a retry interval = 300
the listener resource retry count= 3 and a retry interval = 300
What I have found during testing of the listener resource is that it works, as I expect, if I kill the listener process 3 times within 5 minutes then the cluster restarts the service. If I kill it once more the cluster then reports that it has exceeded retry count and doesnt initiate a failover ... All good.
However, at what appears to be 5 minutes after the first restart, with no administrator intervention, the cluster restarts the resource. What is controlling this restart and how can I turn it off ?
Thanks

Hi Tim
I have the same problem for both listener and oracle resources, ie if I repeatedly kill the process the cluster restarts the resource upto the retry count, which is as designed, but then at 5 minutes after first restart the resource is restarted.
Following is the listener log and the listener resource configuration.
I'll work on getting the messages file and setting debugging. Thanks
cat /var/opt/SUNWscor/oracle_listener/message_log.omadb-listener
Feb 27 12:30:59 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: Attempting to restart listener LISTENER_OmaT.
Feb 27 12:31:00 SC[SUNWscor.oracle_listener.monitor_stop]:omadb-rg:omadb-listener: Stopping fault monitor using pmfadm tag ORALSNR_MON_omadb-listener
Feb 27 12:31:01 SC[SUNWscor.oracle_listener.stop]:omadb-rg:omadb-listener: listener LISTENER_OmaT is not running.
Feb 27 12:31:02 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Starting listener LISTENER_OmaT.
Feb 27 12:31:02 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Using method 'run_setuid_prog' to execute start commands
LSNRCTL for Solaris: Version 10.2.0.3.0 - Production on 27-FEB-2008 12:31:02
Copyright (c) 1991, 2006, Oracle. All rights reserved.
Starting /appl/oma-dm/oracle/product/10.2.0.3.64/bin/tnslsnr: please wait...
TNSLSNR for Solaris: Version 10.2.0.3.0 - Production
System parameter file is /var/opt/oracle/listener.ora
Log messages written to /appl/oma-dm/oracle/product/10.2.0.3.64/network/log/listener_omat.log
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.118.52)(PORT=1521)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.193.21)(PORT=1521)))
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=omaT)(PORT=1521)))
STATUS of the LISTENER
Alias LISTENER_OmaT
Version TNSLSNR for Solaris: Version 10.2.0.3.0 - Production
Start Date 27-FEB-2008 12:31:03
Uptime 0 days 0 hr. 0 min. 0 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /var/opt/oracle/listener.ora
Listener Log File /appl/oma-dm/oracle/product/10.2.0.3.64/network/log/listener_omat.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.118.52)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.193.21)(PORT=1521)))
Services Summary...
Service "OmaT" has 1 instance(s).
Instance "OmaT", status UNKNOWN, has 1 handler(s) for this service...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully
Executing command: /opt/SUNWscor/oracle_listener/bin/oracle_listener_manage start
Feb 27 12:31:06 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Listener LISTENER_OmaT started.
Feb 27 12:31:07 SC[SUNWscor.oracle_listener.monitor_start]:omadb-rg:omadb-listener: Starting monitor
Feb 27 12:31:39 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: listener LISTENER_OmaT probe successful.
Feb 27 12:32:09 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: Attempting to restart listener LISTENER_OmaT.
Feb 27 12:32:10 SC[SUNWscor.oracle_listener.monitor_stop]:omadb-rg:omadb-listener: Stopping fault monitor using pmfadm tag ORALSNR_MON_omadb-listener
Feb 27 12:32:11 SC[SUNWscor.oracle_listener.stop]:omadb-rg:omadb-listener: listener LISTENER_OmaT is not running.
Feb 27 12:32:12 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Starting listener LISTENER_OmaT.
Feb 27 12:32:12 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Using method 'run_setuid_prog' to execute start commands
LSNRCTL for Solaris: Version 10.2.0.3.0 - Production on 27-FEB-2008 12:32:12
Copyright (c) 1991, 2006, Oracle. All rights reserved.
Starting /appl/oma-dm/oracle/product/10.2.0.3.64/bin/tnslsnr: please wait...
TNSLSNR for Solaris: Version 10.2.0.3.0 - Production
System parameter file is /var/opt/oracle/listener.ora
Log messages written to /appl/oma-dm/oracle/product/10.2.0.3.64/network/log/listener_omat.log
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.118.52)(PORT=1521)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.193.21)(PORT=1521)))
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=omaT)(PORT=1521)))
STATUS of the LISTENER
Alias LISTENER_OmaT
Version TNSLSNR for Solaris: Version 10.2.0.3.0 - Production
Start Date 27-FEB-2008 12:32:13
Uptime 0 days 0 hr. 0 min. 0 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /var/opt/oracle/listener.ora
Listener Log File /appl/oma-dm/oracle/product/10.2.0.3.64/network/log/listener_omat.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.118.52)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.193.21)(PORT=1521)))
Services Summary...
Service "OmaT" has 1 instance(s).
Instance "OmaT", status UNKNOWN, has 1 handler(s) for this service...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully
Executing command: /opt/SUNWscor/oracle_listener/bin/oracle_listener_manage start
Feb 27 12:32:16 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Listener LISTENER_OmaT started.
Feb 27 12:32:17 SC[SUNWscor.oracle_listener.monitor_start]:omadb-rg:omadb-listener: Starting monitor
Feb 27 12:32:49 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: Attempting to restart listener LISTENER_OmaT.
Feb 27 12:32:49 SC[SUNWscor.oracle_listener.monitor_stop]:omadb-rg:omadb-listener: Stopping fault monitor using pmfadm tag ORALSNR_MON_omadb-listener
Feb 27 12:32:50 SC[SUNWscor.oracle_listener.stop]:omadb-rg:omadb-listener: listener LISTENER_OmaT is not running.
Feb 27 12:32:51 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Starting listener LISTENER_OmaT.
Feb 27 12:32:51 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Using method 'run_setuid_prog' to execute start commands
LSNRCTL for Solaris: Version 10.2.0.3.0 - Production on 27-FEB-2008 12:32:52
Copyright (c) 1991, 2006, Oracle. All rights reserved.
Starting /appl/oma-dm/oracle/product/10.2.0.3.64/bin/tnslsnr: please wait...
TNSLSNR for Solaris: Version 10.2.0.3.0 - Production
System parameter file is /var/opt/oracle/listener.ora
Log messages written to /appl/oma-dm/oracle/product/10.2.0.3.64/network/log/listener_omat.log
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.118.52)(PORT=1521)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.193.21)(PORT=1521)))
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=omaT)(PORT=1521)))
STATUS of the LISTENER
Alias LISTENER_OmaT
Version TNSLSNR for Solaris: Version 10.2.0.3.0 - Production
Start Date 27-FEB-2008 12:32:52
Uptime 0 days 0 hr. 0 min. 0 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /var/opt/oracle/listener.ora
Listener Log File /appl/oma-dm/oracle/product/10.2.0.3.64/network/log/listener_omat.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.118.52)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.193.21)(PORT=1521)))
Services Summary...
Service "OmaT" has 1 instance(s).
Instance "OmaT", status UNKNOWN, has 1 handler(s) for this service...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully
Executing command: /opt/SUNWscor/oracle_listener/bin/oracle_listener_manage start
Feb 27 12:32:56 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Listener LISTENER_OmaT started.
Feb 27 12:32:57 SC[SUNWscor.oracle_listener.monitor_start]:omadb-rg:omadb-listener: Starting monitor
Feb 27 12:33:28 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: The listener LISTENER_OmaT is not running; retry_count <3> exceeded. Attempting to switchover resource group.
Feb 27 12:33:28 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: retry_count <3> exceeded. NUM_RESOURCE_RESTART = 3
Feb 27 12:33:28 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control GIVEOVER failed with error code: 16
Feb 27 12:33:28 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: Attempting to restart listener LISTENER_OmaT.
Feb 27 12:33:28 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control RESOURCE_RESTART failed with error code: 16
Feb 27 12:33:58 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: The listener LISTENER_OmaT is not running; retry_count <3> exceeded. Attempting to switchover resource group.
Feb 27 12:33:58 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: retry_count <3> exceeded. NUM_RESOURCE_RESTART = 3
Feb 27 12:33:59 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control GIVEOVER failed with error code: 16
Feb 27 12:33:59 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: Attempting to restart listener LISTENER_OmaT.
Feb 27 12:33:59 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control RESOURCE_RESTART failed with error code: 16
Feb 27 12:34:29 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: The listener LISTENER_OmaT is not running; retry_count <3> exceeded. Attempting to switchover resource group.
Feb 27 12:34:29 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: retry_count <3> exceeded. NUM_RESOURCE_RESTART = 3
Feb 27 12:34:29 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control GIVEOVER failed with error code: 16
Feb 27 12:34:29 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: Attempting to restart listener LISTENER_OmaT.
Feb 27 12:34:29 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control RESOURCE_RESTART failed with error code: 16
Feb 27 12:35:00 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: The listener LISTENER_OmaT is not running; retry_count <3> exceeded. Attempting to switchover resource group.
Feb 27 12:35:00 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: retry_count <3> exceeded. NUM_RESOURCE_RESTART = 3
Feb 27 12:35:00 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control GIVEOVER failed with error code: 16
Feb 27 12:35:00 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: Attempting to restart listener LISTENER_OmaT.
Feb 27 12:35:00 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control RESOURCE_RESTART failed with error code: 16
Feb 27 12:35:30 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: The listener LISTENER_OmaT is not running; retry_count <3> exceeded. Attempting to switchover resource group.
Feb 27 12:35:30 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: retry_count <3> exceeded. NUM_RESOURCE_RESTART = 3
Feb 27 12:35:30 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control GIVEOVER failed with error code: 16
Feb 27 12:35:30 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: Attempting to restart listener LISTENER_OmaT.
Feb 27 12:35:30 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: scha_control RESOURCE_RESTART failed with error code: 16
Feb 27 12:36:01 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: Attempting to restart listener LISTENER_OmaT.
Feb 27 12:36:01 SC[SUNWscor.oracle_listener.monitor_stop]:omadb-rg:omadb-listener: Stopping fault monitor using pmfadm tag ORALSNR_MON_omadb-listener
Feb 27 12:36:03 SC[SUNWscor.oracle_listener.stop]:omadb-rg:omadb-listener: listener LISTENER_OmaT is not running.
Feb 27 12:36:04 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Starting listener LISTENER_OmaT.
Feb 27 12:36:04 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Using method 'run_setuid_prog' to execute start commands
LSNRCTL for Solaris: Version 10.2.0.3.0 - Production on 27-FEB-2008 12:36:04
Copyright (c) 1991, 2006, Oracle. All rights reserved.
Starting /appl/oma-dm/oracle/product/10.2.0.3.64/bin/tnslsnr: please wait...
TNSLSNR for Solaris: Version 10.2.0.3.0 - Production
System parameter file is /var/opt/oracle/listener.ora
Log messages written to /appl/oma-dm/oracle/product/10.2.0.3.64/network/log/listener_omat.log
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.118.52)(PORT=1521)))
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.193.21)(PORT=1521)))
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=omaT)(PORT=1521)))
STATUS of the LISTENER
Alias LISTENER_OmaT
Version TNSLSNR for Solaris: Version 10.2.0.3.0 - Production
Start Date 27-FEB-2008 12:36:04
Uptime 0 days 0 hr. 0 min. 0 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /var/opt/oracle/listener.ora
Listener Log File /appl/oma-dm/oracle/product/10.2.0.3.64/network/log/listener_omat.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.118.52)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.23.193.21)(PORT=1521)))
Services Summary...
Service "OmaT" has 1 instance(s).
Instance "OmaT", status UNKNOWN, has 1 handler(s) for this service...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully
Executing command: /opt/SUNWscor/oracle_listener/bin/oracle_listener_manage start
Feb 27 12:36:08 SC[SUNWscor.oracle_listener.start]:omadb-rg:omadb-listener: Listener LISTENER_OmaT started.
Feb 27 12:36:09 SC[SUNWscor.oracle_listener.monitor_start]:omadb-rg:omadb-listener: Starting monitor
Feb 27 12:36:40 SC[SUNWscor.oracle_listener.monitor]:omadb-rg:omadb-listener: listener LISTENER_OmaT probe successful.
clrs show -v omadb-listener
=== Resources ===
Resource: omadb-listener
Type: SUNW.oracle_listener:5
Type_version: 5
Group: omadb-rg
R_description:
Resource_project_name: default
Enabled{sf2339}: True
Enabled{sf2340}: True
Monitored{sf2339}: True
Monitored{sf2340}: True
Resource_dependencies: omadb-stor
Resource_dependencies_weak: <NULL>
Resource_dependencies_restart: <NULL>
Resource_dependencies_offline_restart: <NULL>
--- Standard and extension properties ---
Probe_timeout: 180
Class: extension
Description: Timeout value (in seconds) used by monitor to check listener status.
Per-node: False
Type: int
User_env:
Class: extension
Description: File containing environment variables to be set before listener startup/shutdown
Per-node: False
Type: string
Listener_name: LISTENER_OmaT
Class: extension
Description: Oracle listener name
Per-node: False
Type: string
ORACLE_HOME: /appl/oma-dm/oracle/product/10.2.0.3.64
Class: extension
Description: Oracle Home diectory
Per-node: False
Type: string
Thorough_probe_interval: 30
Class: standard
Description: Time between invocations of a high-overhead fault probe of the resource.
Type: int
MONITOR_CHECK_TIMEOUT: 3600
Class: standard
Description: Maximum execution time allowed for Monitor_Check method.
Type: int
MONITOR_STOP_TIMEOUT: 120
Class: standard
Description: Maximum execution time allowed for Monitor_Stop method.
Type: int
MONITOR_START_TIMEOUT: 180
Class: standard
Description: Maximum execution time allowed for Monitor_Start method.
Type: int
BOOT_TIMEOUT: 30
Class: standard
Description: Maximum execution time allowed for Boot method.
Type: int
FINI_TIMEOUT: 30
Class: standard
Description: Maximum execution time allowed for Fini method.
Type: int
INIT_TIMEOUT: 30
Class: standard
Description: Maximum execution time allowed for Init method.
Type: int
UPDATE_TIMEOUT: 300
Class: standard
Description: Maximum execution time allowed for Update method.
Type: int
VALIDATE_TIMEOUT: 120
Class: standard
Description: Maximum execution time allowed for Validate method.
Type: int
STOP_TIMEOUT: 300
Class: standard
Description: Maximum execution time allowed for Stop method.
Type: int
START_TIMEOUT: 300
Class: standard
Description: Maximum execution time allowed for Start method.
Type: int
Retry_count: 3
Class: standard
Description: Indicates the number of times a monitor restarts the resource if it fails.
Type: int
Retry_interval: 300
Class: standard
Description: Time in which monitor attempts to restart a failed resource Retry_count times.
Type: int
Failover_mode: RESTART_ONLY
Class: standard
Description: Modifies recovery actions taken when the resource fails.
Type: enum

Error while installing Oracle Cluster Ready Services Release 1 (10.1.0.2)

Hi all,
I am trying for RAC 10gR1 (10.1.0.2) using two machines with Windows 2000 Server. For this I need to install Oracle Cluster Ready Services Release 1 (10.1.0.2).
Machine details are as follows:-
Node 1:
Computer Name:     RAC1
Windows 2000 IP Configuration
Ethernet adapter Local Area Connection 2: (Used for Public Interface)
Connection-specific DNS Suffix . :
IP Address. . . . . . . . . . . . : 192.168.1.65
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
Ethernet adapter Local Area Connection: (Used for Private Interface between the two nodes)
Connection-specific DNS Suffix . :
IP Address. . . . . . . . . . . . : 10.10.10.11
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
Node 2:
     Computer Name:     RAC2
Windows 2000 IP Configuration
Ethernet adapter Local Area Connection 2: (Used for Public Interface)
Connection-specific DNS Suffix . :
IP Address. . . . . . . . . . . . : 192.168.1.181
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
Ethernet adapter Local Area Connection: (Used for Private Interface between the two nodes)
Connection-specific DNS Suffix . :
IP Address. . . . . . . . . . . . : 10.10.10.12
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
I have made following entries in Hosts file of both the machines:-
192.168.1.65     RAC1
192.168.1.181     RAC2
10.10.10.11     RAC01-PRIV
10.10.10.12     RAC02-PRIV
192.168.1.201     RAC01-VIP
192.168.1.202     RAC02-VIP
I have completed all the pre-installation steps, i.e. configuring the disk for storage, and both the machine are communicating each other through there Private and Public interfaces. Now the problem appears when I am installing Oracle Cluster Ready Services, at the end of Installation following message appears and the auto configuration steps fails.
================================================================================================================
Output generated from configuration assistant "Oracle Cluster Ready Services Configuration Assistant":
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: rac1 rac01-priv rac1
node 2: rac2 rac02-priv rac2
Creating OCR keys for user 'administrator', privgrp ''..
Operation successful.
Now formatting voting device: \\.\votedsk
Successful in setting block0 for voting disk.
Format complete.
Step 1: checking status of CRS cluster
Step 2: configuring OCR repository
Step 3: configuring safe mode for CRS stack
Step 4: Starting up CRS stack on all nodes
RAC1 service OracleCSService in improper PENDING state, err(997)
RAC2 service OracleCSService in improper PENDING state, err(997)
Configuration assistant "Oracle Cluster Ready Services Configuration Assistant" failed
================================================================================================================
Output generated from configuration assistant "Oracle Notification Server Configuration Assistant":
Configuration assistant "Oracle Notification Server Configuration Assistant" failed
================================================================================================================
Output generated from configuration assistant "Oracle Private Interconnect Configuration Assistant":
PRIF-10: failed to initialize the cluster registry
Configuration assistant "Oracle Private Interconnect Configuration Assistant" failed
===============================================================
I would be highly obliged if any one tell me why it is happing like this and what could be the possible remedy.
Waiting for the respone.
With Regards
Dinesh
[email protected]

Hi user478171,
I have the same problem with two nodes in Windows 2003 with RAC 10g R2, but I don't have idea to solve.
Please advice me
Thanks advances
regards,
IvanR

How to Configure Active-Passive oracle cluster in Windows 2008 R2 64bit Server.

How to Configure Active-Passive oracle cluster in Windows 2008 R2 64bit Server With Oracle 11g R2.
How many database will play in this role.
Best,

hello
I was going through your post and i am also doing the same thing here at our organisation for Oracle 10g R2
Can you pls send me any docs u r having for configuration of Oracle in windows clusters .
And, can you pls elaborate on this point
e)Create Oracle Service with the same name in the 2nd node and copy all the files like spfile,tnsnames.ora,listener.ora,password file to Node2.
Pls send me the details at [email protected] or you can contact me at 08054641476.
Thanks in advance.

Oracle cluster installation problem

hi forums
i need experienced one to discuss with me about this problem and help me to put plan
i install oracle cluster ware 10.2 on my lab
first i install VMWare Workstation 6.5-7x
and i install windows server 2003 and do this configuration
-create 4 scsi harad with size 10 G
-create 5 scsi hard with size 1 g ( 3 for voting dist - 2 for OCR)
- enable automount for windows
- disable sense for new Network card
- 2 network card for public and other for private
- identifying network nodes in the host file
- rename this machin by rac1
- colne this machine and rename it to rac2 and change the public and private ip
----- now i have tow machine rac1,rac2
- check from rac1
cluster media\ckuvfy\runcluvfu.bat stage -pre crsinst -n rac1,rac2 -verbose
was successful
cluster media\ckuvfy\runcluvfu.bat comp ssa -n rac1,rac2
was sc\uccessful
and another check ......................
i begin installing oracle cluster ware
no problem
but after installing on creating cluster configuration assistant it was failed
the question is why this error happen ,although i check on any thing before install !?
i reed more and more and i found this problem happen because terminal service
use this commend
mstsc -v:servername /f - console
but i install local not remote
if any exprince with this please show to me why this error happen !?*
and what is the solution ?
for oracle rac in windows what is the best use VMWare or windows alone ?

Hi,
Check the below link to match your steps and verify according:
http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnWindows2003UsingVMware.php
For practise and test purpose VMWARE is definetly a better choice.Check the below link which can help
you why it is better to use VMWARE.
http://blogs.vmware.com/performance/2007/11/ten-reasons-why.html
Best regards,
Rafi.
http://rafioracledba.blogspot.com/

10.2.0.1 RHEL 4.0 - root.sh CRS - Failed to upgrade Oracle Cluster Registry

I am trying to install 10.2.0.1 CRS on a 2 node cluster on RHEL 4.0 Nahant Update 7. I get the following errors when root.sh is run
Failed to upgrade Oracle Cluster Registry configuration._
Due to this reason , none of the clusterware background processes fail to start, following which the Configuration Assistant screen also experiences failure (Oracle Notification Server Configuration Assistant).
I tried to apply the 10.2.0.4 patchset also, still same issue. Did anyone see this issue ?
1) We use LINUX DEVICE MAPPER for multipathing and udev
2) We configured the multipathing device partitions and bound them to raw devices
So /dev/mapper/oradisk1 bound to /dev/raw/raw1 ( OCR disk)
and /dev/mapper/oradisk2 bound to /dev/raw/raw2 (VD)
I am able to perform the dd command successfully.
Any ideas ?
-Srinivas

BTW, we our OS is Linux x86-64 with RHEL 4.0 Nahant Update 7. I also applied the patch 4679769.
Did a complete uninstall and reinstall. But issue persists.
-Srinivas

Does anybody have a WLST script for step-by-step cluster restart?

Does anybody have a WLST script for step-by-step "smart" cluster restart?

Dear SAM,
are you looking for exchange 2013 installation. Please follow below link. I have done the same scenario as yours
1. install first VM - 2012
2. Static IP / loopback as primary DNS
3. install ADDS /DNS (forwarder to ISP)
4. install second VM - Static IP again
5. DNS of second VM to be the IP of first VM
6. this will join the domain
7. installation of exchange will be simple, configuration from this link : http://www.techieshelp.com/exchange-2013-step-by-step-configuration/
MARK AS USEFUL/ANSWER IF IT DID
Thanks
Happiness Always
Jatin

Oracle Clustre, Oracle Cluster with RAC and Oracle 10g

Is there a difference between Oracle Cluster and Oracle Cluster with RAC? Please explain. Do existing database codes run unmodified in Cluster or Cluster with RAC environment? What needs to be modified to make existing SQL codes RAC-aware. How to achieve 'all automatic' in case of failure and resubmission of Queries from failed instance to a running instance?
In 10g environment, do we need to consider licensing of RAC as a separate product? What are additional features one derives in 10g that is not in Cluster +RAC?
Your comments and pointers to comparison study and pictorial clarification will be very helpful.

Oracle cluster like failsafe before or Veritas Cluster or other vendor's cluster is meant for HA (high availability) purpose. Which 2 nodes or more can see a shared disk with 1 active node. Whenever this active node failed through heartbeat other machine will know and will take the database over from there.
Oracle RAC is more for HA and load balance. In Oracle RAC 2 or more nodes are accessing the database at the same time so it spread load across all these nodes.
I believe Oracle 10g RAC still need seperate license for it. But you need to call Oracle or check the production document to verify it.
Oracle 10g besides improvement in RAC. It's main improvement is on the build in management of the database itself. It can monitored and selftune itself to much furthur level then before and give DBA much more information to determine the cause of the problem as well. Plus improvement on lots of utility as well like RMAN , data pump etc... I don't want to get into too much detail on this you can check on their 10g new features for more detail view.
Hope this help. :)

"Oracle Cluster Verification Utility" failed - 10gR2 - VMware - CentOS 4

Hi,
While installing 10g R2 on VMWare with CentOS 4, I am encountering an error:
Command = /u01/crs/oracle/product/10.2.0/crs/bin/cluvfy has failed
INFO: Configuration assistant "Oracle Cluster Verification Utility" failed
*** Starting OUICA ***
Oracle Home set to /u01/crs/oracle/product/10.2.0/crs
Configuration directory is set to /u01/crs/oracle/product/10.2.0/crs/cfgtoollogs. All xml files under the directory will be processed
INFO: The "/u01/crs/oracle/product/10.2.0/crs/cfgtoollogs/configToolFailedCommands" script contains all commands that failed, were skipped or were cancelled. This file may be used to run these configuration assistants outside of OUI. Note that you may have to update this script with passwords (if any) before executing the same.
SEVERE: OUI-25031:Some of the configuration assistants failed. It is strongly recommended that you retry the configuration assistants at this time. Not successfully running any "Recommended" assistants means your system will not be correctly configured.
1. Check the Details panel on the Configuration Assistant Screen to see the errors resulting in the failures.
2. Fix the errors causing these failures.
3. Select the failed assistants and click the 'Retry' button to retry them.
INFO: User Selected: Yes/OK
The logs show me:
COMMAND=/u01/crs/oracle/product/10.2.0/crs/bin/cluvfy stage -post crsinst -n rac1,rac2
Checking the version of OCR...
OCR of correct Version "2" exists.
Checking data integrity of OCR...
ERROR:
OCR integrity results are inconsistent amongst the nodes.
OCR integrity found invalid for nodes: rac2
OCR integrity found valid for nodes: rac1
OCR integrity check failed.
I have replaced "clsfmt.bin" with patch 4679769 to avoid the FAILED TO FORMAT OCR DISK USING CLSFMT error on Node 1.
But still the Oracle Cluster Verification Utility failed with OCR integrity.
Also, have religiously followed the steps mentioned in the below link & didnt have any glitches during the entire process:
http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnCentos4UsingVMware.php
Any Suggestions??

I kinda dont have that timestamp which you requested.
Posting what i have in crsd.log for node 2.
**I wish this site had an attachment section to make the threads more readable.
Anyways...
Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
2011-06-29 17:56:21.189: [ default][3086931648][ENTER]0
Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2004, Oracle. All rights reserved
2011-06-29 17:56:21.189: [ default][3086931648]0CRS Daemon Starting
2011-06-29 17:56:21.190: [ CRSMAIN][3086931648]0Checking the OCR device
2011-06-29 17:56:21.280: [ CRSMAIN][3086931648]0Connecting to the CSS Daemon
2011-06-29 17:56:21.420: [ COMMCRS][66177968]clsc_connect: (0x8655ae0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs))
2011-06-29 17:56:21.420: [ CSSCLNT][3086931648]clsssInitNative: connect failed, rc 9
2011-06-29 17:56:21.422: [ CRSRTI][3086931648]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..
2011-06-29 17:56:22.483: [ COMMCRS][66177968]clsc_connect: (0x8604c10) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs))
2011-06-29 17:56:22.484: [ CSSCLNT][3086931648]clsssInitNative: connect failed, rc 9
2011-06-29 17:56:22.485: [ CRSRTI][3086931648]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..
2011-06-29 17:56:23.537: [ COMMCRS][66177968]clsc_connect: (0x8654e20) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs))
2011-06-29 17:56:23.537: [ CSSCLNT][3086931648]clsssInitNative: connect failed, rc 9
2011-06-29 17:56:23.538: [ CRSRTI][3086931648]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..
2011-06-29 17:56:24.606: [ COMMCRS][66177968]clsc_connect: (0x8655008) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rac2_crs))
2011-06-29 17:56:24.606: [ CSSCLNT][3086931648]clsssInitNative: connect failed, rc 9
2011-06-29 17:56:24.608: [ CRSRTI][3086931648]0CSS is not ready. Received status 3 from CSS. Waiting for good status ..
2011-06-29 17:56:28.445: [    CRSD][3086931648]0Daemon Version: 10.2.0.1.0 Active Version: 10.2.0.1.0
2011-06-29 17:56:28.446: [    CRSD][3086931648]0Active Version and Software Version are same
2011-06-29 17:56:28.446: [ CRSMAIN][3086931648]0Initializing OCR
2011-06-29 17:56:28.479: [ OCRRAW][3086931648]proprioo: for disk 0 (/dev/raw/raw1), id match (1), my id set (1669906634,1028247821) total id sets (1), 1st set (1669906634,1028247821), 2nd set (0,0) my votes (2), total votes (2)
2011-06-29 17:56:28.621: [ CSSCLNT][3051752368]clssgsGroupJoin: CSS has not reached fatal mode.Registration is not yet safe. Retrying
2011-06-29 17:56:29.674: [    CRSD][3086931648]0ENV Logging level for Module: allcomp 0
2011-06-29 17:56:29.680: [    CRSD][3086931648]0ENV Logging level for Module: default 0
2011-06-29 17:56:29.720: [    CRSD][3086931648]0ENV Logging level for Module: COMMCRS 0
2011-06-29 17:56:29.730: [    CRSD][3086931648]0ENV Logging level for Module: COMMNS 0
2011-06-29 17:56:29.746: [    CRSD][3086931648]0ENV Logging level for Module: CRSUI 0
2011-06-29 17:56:29.755: [    CRSD][3086931648]0ENV Logging level for Module: CRSCOMM 0
2011-06-29 17:56:29.760: [    CRSD][3086931648]0ENV Logging level for Module: CRSRTI 0
2011-06-29 17:56:29.770: [    CRSD][3086931648]0ENV Logging level for Module: CRSMAIN 0
2011-06-29 17:56:29.823: [    CRSD][3086931648]0ENV Logging level for Module: CRSPLACE 0
2011-06-29 17:56:29.834: [    CRSD][3086931648]0ENV Logging level for Module: CRSAPP 0
2011-06-29 17:56:29.846: [    CRSD][3086931648]0ENV Logging level for Module: CRSRES 0
2011-06-29 17:56:29.852: [    CRSD][3086931648]0ENV Logging level for Module: CRSOCR 0
2011-06-29 17:56:29.871: [    CRSD][3086931648]0ENV Logging level for Module: CRSTIMER 0
2011-06-29 17:56:29.878: [    CRSD][3086931648]0ENV Logging level for Module: CRSEVT 0
2011-06-29 17:56:29.886: [    CRSD][3086931648]0ENV Logging level for Module: CRSD 0
2011-06-29 17:56:29.904: [    CRSD][3086931648]0ENV Logging level for Module: CLUCLS 0
2011-06-29 17:56:29.916: [    CRSD][3086931648]0ENV Logging level for Module: OCRRAW 0
2011-06-29 17:56:29.928: [    CRSD][3086931648]0ENV Logging level for Module: OCROSD 0
2011-06-29 17:56:29.931: [    CRSD][3086931648]0ENV Logging level for Module: CSSCLNT 0
2011-06-29 17:56:29.936: [    CRSD][3086931648]0ENV Logging level for Module: OCRAPI 0
2011-06-29 17:56:29.939: [    CRSD][3086931648]0ENV Logging level for Module: OCRUTL 0
2011-06-29 17:56:29.942: [    CRSD][3086931648]0ENV Logging level for Module: OCRMSG 0
2011-06-29 17:56:29.945: [    CRSD][3086931648]0ENV Logging level for Module: OCRCLI 0
2011-06-29 17:56:29.948: [    CRSD][3086931648]0ENV Logging level for Module: OCRCAC 0
2011-06-29 17:56:29.951: [    CRSD][3086931648]0ENV Logging level for Module: OCRSRV 0
2011-06-29 17:56:29.954: [    CRSD][3086931648]0ENV Logging level for Module: OCRMAS 0
2011-06-29 17:56:29.954: [ CRSMAIN][3086931648]0Filename is /u01/crs/oracle/product/10.2.0/crs/crs/init/rac2.pid
[ clsdmt][2862934960]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=rac2DBG_CRSD))
2011-06-29 17:56:29.986: [ CRSMAIN][3086931648]0Using Authorizer location: /u01/crs/oracle/product/10.2.0/crs/crs/auth/
2011-06-29 17:56:30.038: [ CRSMAIN][3086931648]0Initializing RTI
2011-06-29 17:56:30.039: [CRSTIMER][2841689008]0Timer Thread Starting.
2011-06-29 17:56:30.042: [ CRSRES][3086931648]0Parameter SECURITY = 1, running in USER Mode
2011-06-29 17:56:30.043: [ CRSMAIN][3086931648]0Initializing EVMMgr
2011-06-29 17:56:30.045: [ COMMCRS][2831199152]clsc_connect: (0x89a02e0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=SYSTEM.evm.acceptor.auth))
2011-06-29 17:56:30.299: [ COMMCRS][2831199152]clsc_connect: (0x89a2ab8) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=SYSTEM.evm.acceptor.auth))
2011-06-29 17:56:31.555: [ CRSMAIN][3086931648]0CRSD locked during state recovery, please wait.
2011-06-29 17:56:31.603: [ CRSMAIN][3086931648]0CRSD recovered, unlocked.
2011-06-29 17:56:31.606: [ CRSMAIN][3086931648]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
2011-06-29 17:56:31.620: [ CRSMAIN][3086931648]0CRSD UI socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=CRSD_UI_SOCKET))
2011-06-29 17:56:31.627: [ CRSMAIN][3086931648]0E2E socket on: (ADDRESS=(PROTOCOL=tcp)(HOST=rac2-priv)(PORT=49896))
2011-06-29 17:56:31.627: [ CRSMAIN][3086931648]0Starting Threads
2011-06-29 17:56:31.628: [ CRSMAIN][3086931648]0CRS Daemon Started.
2011-06-29 18:03:02.066: [ CRSRES][2735582128]0Resource Registered: ora.rac1.vip
2011-06-29 18:03:05.949: [ CRSRES][2735582128]0Resource Registered: ora.rac2.vip
2011-06-29 18:03:09.666: [ CRSRES][2735582128]0Resource Registered: ora.rac1.gsd
2011-06-29 18:03:11.523: [ CRSRES][2735582128]0Resource Registered: ora.rac2.gsd
2011-06-29 18:03:13.329: [ CRSRES][2735582128]0Resource Registered: ora.rac1.ons
2011-06-29 18:03:15.048: [ CRSRES][2735582128]0Resource Registered: ora.rac2.ons
2011-06-29 18:03:15.965: [ CRSRES][2714192816]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:03:30.471: [ CRSRES][2714192816]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:03:31.227: [ CRSRES][2714192816]0startRunnable: setting CLI values
2011-06-29 18:03:31.258: [ CRSRES][2714192816]0Attempting to start `ora.rac2.vip` on member `rac2`
2011-06-29 18:03:44.710: [ CRSRES][2714192816]0Start of `ora.rac2.vip` on member `rac2` succeeded.
2011-06-29 18:03:45.588: [ CRSRES][2714192816]0Attempting to start `ora.rac1.gsd` on member `rac1`
2011-06-29 18:03:45.777: [ CRSRES][2714192816]0Start of `ora.rac1.gsd` on member `rac1` succeeded.
2011-06-29 18:03:46.523: [ CRSRES][2714192816]0startRunnable: setting CLI values
2011-06-29 18:03:46.588: [ CRSRES][2714192816]0Attempting to start `ora.rac2.gsd` on member `rac2`
2011-06-29 18:03:47.220: [ CRSRES][2714192816]0Start of `ora.rac2.gsd` on member `rac2` succeeded.
2011-06-29 18:03:48.077: [ CRSRES][2714192816]0Attempting to start `ora.rac1.ons` on member `rac1`
2011-06-29 18:03:49.727: [ CRSRES][2714192816]0Start of `ora.rac1.ons` on member `rac1` succeeded.
2011-06-29 18:03:50.610: [ CRSRES][2714192816]0startRunnable: setting CLI values
2011-06-29 18:03:50.658: [ CRSRES][2714192816]0Attempting to start `ora.rac2.ons` on member `rac2`
2011-06-29 18:03:52.240: [ CRSRES][2714192816]0Start of `ora.rac2.ons` on member `rac2` succeeded.
2011-06-29 18:07:44.810: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:09:05.613: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:09:05.623: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:09:05.623: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:09:05.624: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:09:05.631: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:09:09.437: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:09:09.438: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:09:09.447: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:09:09.685: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:09:22.340: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:10:21.884: [ CRSAPP][2735582128]0CheckResource error for ora.rac2.vip error code = 1
2011-06-29 18:10:21.892: [ CRSRES][2735582128]0In stateChanged, ora.rac2.vip target is ONLINE
2011-06-29 18:10:21.893: [ CRSRES][2735582128]0ora.rac2.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:10:21.893: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:10:21.910: [ CRSRES][2735582128]0Attempting to stop `ora.rac2.vip` on member `rac2`
2011-06-29 18:10:25.645: [ CRSRES][2735582128]0Stop of `ora.rac2.vip` on member `rac2` succeeded.
2011-06-29 18:10:25.645: [ CRSRES][2735582128]0ora.rac2.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:10:25.657: [ CRSRES][2735582128]0ora.rac2.vip failed on rac2 relocating.
2011-06-29 18:10:25.938: [ CRSRES][2735582128]0Attempting to start `ora.rac2.vip` on member `rac1`
2011-06-29 18:10:39.079: [ CRSRES][2735582128]0Start of `ora.rac2.vip` on member `rac1` succeeded.
2011-06-29 18:11:39.443: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:11:52.836: [ OCRUTL][3009792944]u_freem: mem passed is null
2011-06-29 18:12:59.776: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:12:59.784: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:12:59.784: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:12:59.784: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:12:59.791: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:13:03.395: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:13:03.396: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:13:03.404: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:13:03.678: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:13:16.047: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:15:07.356: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:26:36.393: [ CRSAPP][2735582128]0CheckResource error for ora.rac2.vip error code = 1
2011-06-29 18:26:36.404: [ CRSRES][2735582128]0In stateChanged, ora.rac2.vip target is ONLINE
2011-06-29 18:26:36.404: [ CRSRES][2735582128]0ora.rac2.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:26:36.405: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:26:36.420: [ CRSRES][2735582128]0Attempting to stop `ora.rac2.vip` on member `rac2`
2011-06-29 18:26:40.105: [ CRSRES][2735582128]0Stop of `ora.rac2.vip` on member `rac2` succeeded.
2011-06-29 18:26:40.106: [ CRSRES][2735582128]0ora.rac2.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:26:40.114: [ CRSRES][2735582128]0ora.rac2.vip failed on rac2 relocating.
2011-06-29 18:26:40.411: [ CRSRES][2735582128]0Attempting to start `ora.rac2.vip` on member `rac1`
2011-06-29 18:26:53.678: [ CRSRES][2735582128]0Start of `ora.rac2.vip` on member `rac1` succeeded.
2011-06-29 18:28:03.601: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:28:22.695: [ CRSAPP][2735582128]0StartResource error for ora.rac2.vip error code = 1
2011-06-29 18:28:44.847: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:29:06.589: [ OCRUTL][2946853808]u_freem: mem passed is null
2011-06-29 18:30:13.581: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:30:13.598: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:30:13.599: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:30:13.599: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:30:13.606: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:30:17.227: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:30:17.228: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:30:17.236: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:30:17.563: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:30:31.358: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:33:54.570: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:34:17.302: [ OCRUTL][2988813232]u_freem: mem passed is null
2011-06-29 18:35:24.403: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:35:24.412: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:35:24.412: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:35:24.412: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:35:24.431: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:35:28.186: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:35:28.187: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:35:28.208: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:35:28.510: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:35:52.388: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:39:18.464: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:39:31.876: [ OCRUTL][2988813232]u_freem: mem passed is null
2011-06-29 18:40:38.956: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:40:38.965: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:40:38.966: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:40:38.966: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:40:38.972: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:40:42.583: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:40:42.584: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:40:42.594: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:40:42.977: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:41:08.149: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:42:18.061: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:42:31.531: [ OCRUTL][2988813232]u_freem: mem passed is null
2011-06-29 18:44:45.499: [ CRSAPP][2735582128]0CheckResource error for ora.rac1.vip error code = 1
2011-06-29 18:44:45.507: [ CRSRES][2735582128]0In stateChanged, ora.rac1.vip target is ONLINE
2011-06-29 18:44:45.508: [ CRSRES][2735582128]0ora.rac1.vip on rac2 went OFFLINE unexpectedly
2011-06-29 18:44:45.508: [ CRSRES][2735582128]0StopResource: setting CLI values
2011-06-29 18:44:45.516: [ CRSRES][2735582128]0Attempting to stop `ora.rac1.vip` on member `rac2`
2011-06-29 18:44:49.197: [ CRSRES][2735582128]0Stop of `ora.rac1.vip` on member `rac2` succeeded.
2011-06-29 18:44:49.198: [ CRSRES][2735582128]0ora.rac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-29 18:44:49.209: [ CRSRES][2735582128]0ora.rac1.vip failed on rac2 relocating.
2011-06-29 18:44:49.449: [ CRSRES][2735582128]0Attempting to start `ora.rac1.vip` on member `rac1`
2011-06-29 18:45:13.509: [ CRSRES][2735582128]0Start of `ora.rac1.vip` on member `rac1` succeeded.
2011-06-29 18:47:31.668: [ CRSRES][2735582128]0startRunnable: setting CLI values
2011-06-29 18:47:50.804: [ CRSAPP][2735582128]0StartResource error for ora.rac1.vip error code = 1

Failed to upgrade Oracle Cluster Registry configuration

I'm making a new installation of Oracle RAC environment, the clusterware version is 10 and therefore the RDBMS, I'm using oracle linux 5 update 7, the installation is being performed on only one machine. The problem occurs at the end of the installation when I try to run / u01/app/oracle/product/10.2.0/crs/root.sh the error messages are:
Failed to upgrade Oracle Cluster Registry configuration, which is issued shortly after the execution of root.sh.
And in the log the error message is:
31/10/2011 11:36:36.654: [OCRCONF] [103401184] ocrconfig starts ...
31/10/2011 11:36:36.654: [OCRCONF] [103401184] Upgrading OCR data
31/10/2011 11:36:36.661: [OCRCONF] [103401184] OCR Already in current version.
31/10/2011 11:36:36.669: [OCRCONF] [103401184] Failed to call clsssinit (21)
31/10/2011 11:36:36.670: [OCRCONF] [103401184] Failed to make a backup copy of OCR
31/10/2011 11:36:36.670: [OCRCONF] [103401184] Exiting [status = failed] ...
If anyone has faced this error and won, I'm accepting suggestions.
Att.
Italo Moisés dos Santos.

Hi;
For your issue i suggest close your thread here as changing thread status to answered and move it to Forum Home » Grid Computing » RAC, ASM & Clusterware Installation which you can get more quick response
Regard
Helios

Cannot configure Oracle Cluster File System (OCFS2)

Dears,,
While trying to use ocfs2console to Configure Oracle Cluster File System (OCFS2)
Error appear to me as following:
Could not start cluster stack error.This must be resolved before any OCFS2 filesystem can be mounted.
How can solve this please?
thanks & regards,,

Dear all ,,
My issue solved now . . .
Really , it is strange.
Once , i added /sbin in .bash_profile under ~ Directory as following . . .
export PATH=$ORACLE_HOME/bin:$ORA_CRS_HOME/bin:/bin:/usr/bin:/usr/sbin:/sbin:/usr/local/bin:/usr/X11R6/bin
Then log out then back again.
After this change , i able to run ocfs2console successfully.
Hope this help you.
Thanks for all,,
Best regards,,

Is OCFS(Oracle Cluster File System) a real file system?

Hi all
Is oracle cluster file system something kind of FAT23 or NTFS on Windows, ext3 on Linux ?
We install operating systems on FS , but with OCFS we install Oracle database on it instead of operation system ?
As usual
Applications
OS
File System
Physical Drive
But the ocfs is something like:
Oracle
OCFS
OS
OS's file system
Physical Drive
Is that right ?

Robert Geier wrote:
OCFS is a clustered filesystem. You don't use it for OS partitions (e.g /opt) but only for filesystems that will be shared between servers in a RAC cluster to hold database files.
Are you installing RAC ? If so, then ASM is a better option than OCFS. If not, then you really don't need OCFS.Thanks
I'm studying RAC.
I hear that I can not put all kind of files into ASM but with OCFS I can hold them.
Is that improved with 11g R2 ?

Oracle Cluster Ready Service

Hi
I am using Ora10gR1 and SUSE Linux Enterprise Server 9. I am getting the following message in /var/log/messages
Aug 27 09:48:41 (none) logger: Oracle Cluster Ready Services disabled by corrupt install
Aug 27 09:48:41 (none) logger: Could not access /etc/oracle/scls_scr/ohare/root/crsstart.
I did not install CRS. Can you help?
Thx

Hi,
These don't have any affect on your database. If you want to disable these messages then comment following line in the inittab file
#h1:35:respawn:/etc/init.d/init.cssd run >/dev/null 2>&1 </dev/null
regards

Oracle cluster restart

Similar Messages

Maybe you are looking for