Clusterware prerequsites Failed

Hi all,
os : Windows server 2008 64bit enterprise edition
Oracle : 11gR2 64 BIT
i have administrative privileges for this users but still iam getting the below warning
Could not access or create trace file path "C:\Windows\temp\cvtmphome\cv\log". T
race information could not be collected
Also i have this path in both the nodes
but still iam getting
Path "C:\Windows\temp\" does not exist
D:\Software\win64_11gR2_grid\grid>runcluvfy.bat stage -pre crsinst -n bfcluster1
,bfcluster2
WARNING:
Could not access or create trace file path "C:\Windows\temp\cvtmphome\cv\log". T
race information could not be collected
Performing pre-checks for cluster services setup
Checking node reachability...
Node reachability check passed from node "BFCLUSTER1"
Checking user equivalence...
User equivalence check passed for user "BFLEX1"
ERROR:
Path "C:\Windows\temp\" does not exist and cannot be created on nodes:
        bfcluster1
Verification will proceed with nodes:
        bfcluster2
Checking node connectivity...
Node connectivity passed for subnet "192.68.0.0" with node(s) bfcluster2
TCP connectivity check failed for subnet "192.68.0.0"
Node connectivity passed for subnet "199.63.236.0" with node(s) bfcluster2
TCP connectivity check failed for subnet "199.63.236.0"
Interfaces found on subnet "192.68.0.0" that are likely candidates for VIP are:
bfcluster2 Private:192.68.0.2
Interfaces found on subnet "199.63.236.0" that are likely candidates for VIP are
bfcluster2 Public:199.63.236.131
WARNING:
Could not find a suitable set of interfaces for the private interconnect
Node connectivity check passed
Total memory check passed
Available memory check passed
Swap space check passed
Free disk space check passed for "bfcluster2:C:\Users\bflex1\AppData\Local\Temp\
1\"
System architecture check passed
Checking length of value of environment variable "PATH"
Check for length of value of environment variable "PATH" passed.
Pre-check for cluster services setup was unsuccessful.
Checks did not pass for the following node(s):
        bfcluster1
D:\Software\win64_11gR2_grid\grid>Please provide some inputs

can you check the read& write permissions on this folder and then run again preinstallation check.
Thanks

Similar Messages

  • The Script root.sh problem - ora.asm and ASM and Clusterware Stack failed

    Folks,
    Hello. I am installing Oracle 11gR2 RAC using 2 VMs (rac1 and rac2) whose OS are Oracle Linux 5.6 in VMPlayer according to the website http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
    I am installing Grid infrastructure. On step 9 of 10 - execute script /u01/app/grid/root.sh for 2 VMs rac1 and rac2.
    After run root.sh in rac1 successfully. I run root.sh in rac2 and get an error as below:
    [root@rac2 grid]# ./root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= ora11g
    ORACLE_HOME= /u01/app/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]: /usr/local/bin
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2012-03-05 16:32:52: Parsing the host name
    2012-03-05 16:32:52: Checking for super user privileges
    2012-03-05 16:32:52: User has super user privileges
    Using configuration parameter file: /u01/app/grid/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    Adding daemon to inittab
    CRS-4123: Oracle High Availability Services has been started.
    ohasd is starting
    CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1, number 1, and is terminating
    An active cluster was found during exclusive startup, restarting to join the cluster
    CRS-2672: Attempting to start 'ora.mdnsd' on 'rac2'
    CRS-2676: Start of 'ora.mdnsd' on 'rac2' succeeded
    CRS-2672: Attempting to start 'ora.gipcd' on 'rac2'
    CRS-2676: Start of 'ora.gipcd' on 'rac2' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'rac2'
    CRS-2676: Start of 'ora.gpnpd' on 'rac2' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac2'
    CRS-2676: Start of 'ora.cssdmonitor' on 'rac2' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'rac2'
    CRS-2672: Attempting to start 'ora.diskmon' on 'rac2'
    CRS-2676: Start of 'ora.diskmon' on 'rac2' succeeded
    CRS-2676: Start of 'ora.cssd' on 'rac2' succeeded
    CRS-2672: Attempting to start 'ora.ctssd' on 'rac2'
    Start action for octssd aborted
    CRS-2676: Start of 'ora.ctssd' on 'rac2' succeeded
    CRS-2672: Attempting to start 'ora.drivers.acfs' on 'rac2'
    CRS-2672: Attempting to start 'ora.asm' on 'rac2'
    CRS-2676: Start of 'ora.drivers.acfs' on 'rac2' succeeded
    CRS-2676: Start of 'ora.asm' on 'rac2' succeeded
    CRS-2664: Resource 'ora.ctssd' is already running on 'rac2'
    CRS-4000: Command Start failed, or completed with errors.
    Command return code of 1 (256) from command: /u01/app/grid/bin/crsctl start resource ora.asm -init
    Start of resource "ora.asm -init" failed
    Failed to start ASM
    Failed to start Oracle Clusterware stack
    [root@rac2 grid]#
    As we see the output above, at the end of the output
    1) Start of resource ora.asm -init failed
    2) Failed to start ASM
    3) Failed to start Oracle Clusterware stack
    The runInstaller is in the first VM rac1. My question is:
    Do any folk understand how to solve the script root.sh in rac2 problem ( 3 fails of ora.asm, ASM and Clusterware stack as above) ?
    Thanks.

    Please check there is no firewall exist:
    try this like:
    root.sh fails on second node
    MOS note:
    11gR2 Grid: root.sh Fails to Start the Clusterware on the Second Node Due to Firewall on Private Network [ID 981357.1]
    Grid Infrastructure 11.2.0.2 Installation or Upgrade may fail due to Multicasting Requirement [ID 1212703.1] (Most probabily this issue)

  • Running root.sh during clusterware install fails

    Attempting to set up Clusterware/RAC for the first time. Running into a problem running root.sh after the clusterware installation.
    I get the following output.
    sh root.sh
    WARNING: directory '/u01/app/oracle/product' is not owned by root
    WARNING: directory '/u01/app/oracle' is not owned by root
    WARNING: directory '/u01/app' is not owned by root
    Checking to see if Oracle CRS stack is already configured
    Setting the permissions on OCR backup directory
    Setting up NS directories
    Failed to upgrade Oracle Cluster Registry configuration
    Looking at the log for root.sh, I see the following.
    Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
    2008-05-27 13:35:22.424: [ OCRCONF][2538024640]ocrconfig starts...
    2008-05-27 13:35:22.424: [ OCRCONF][2538024640]Upgrading OCR data
    2008-05-27 13:35:22.426: [ OCRCONF][2538024640]OCR already in current version.
    2008-05-27 13:35:22.429: [ OCRCONF][2538024640]Failed to call clsssinit (21)
    2008-05-27 13:35:22.429: [ OCRCONF][2538024640]Failed to make a backup copy of OCR
    2008-05-27 13:35:22.429: [ OCRCONF][2538024640]Exiting [status=failed]...
    Any ideas on how to fix this?

    Here is the output from running runcluvfy.sh stage -pre crsinst -n linuxdb1,linuxdb2 -verbove
    I X'd out some ipaddresses. I have ran this previously before attempting to install the clusterware software, and all checks say 'passed', but at the bottom, it says it was unsuccessfull. I have been unable to determine was wrong from looking at this output.
    Performing pre-checks for cluster services setup
    Checking node reachability...
    Check: Node reachability from node "linuxdb1"
    Destination Node Reachable?
    linuxdb2 yes
    linuxdb1 yes
    Result: Node reachability check passed from node "linuxdb1".
    Checking user equivalence...
    Check: User equivalence for user "oracle"
    Node Name Comment
    linuxdb1 passed
    linuxdb2 passed
    Result: User equivalence check passed for user "oracle".
    Checking administrative privileges...
    Check: Existence of user "oracle"
    Node Name User Exists Comment
    linuxdb1 yes passed
    linuxdb2 yes passed
    Result: User existence check passed for "oracle".
    Check: Existence of group "oinstall"
    Node Name Status Group ID
    linuxdb1 exists 505
    linuxdb2 exists 505
    Result: Group existence check passed for "oinstall".
    Check: Membership of user "oracle" in group "oinstall" [as Primary]
    Node Name User Exists Group Exists User in Group Primary Comment
    linuxdb1 yes yes yes yes passed
    linuxdb2 yes yes yes yes passed
    Result: Membership check for user "oracle" in group "oinstall" [as Primary] passed.
    Administrative privileges check passed.
    Checking node connectivity...
    Interface information for node "linuxdb1"
    Interface Name IP Address Subnet
    eth0 XXX.XXX.X.XX XXX.XXX.X.XX
    eth1 192.168.3.49 192.168.3.0
    Interface information for node "linuxdb2"
    Interface Name IP Address Subnet
    eth0 XXX.XXX.X.XX XXX.XXX.X.XX
    eth1 192.168.3.81 192.168.3.0
    Check: Node connectivity of subnet "XXX.XXX.X.XX"
    Source Destination Connected?
    linuxdb1:eth0 linuxdb2:eth0 yes
    Result: Node connectivity check passed for subnet "XXX.XXX.X.XXX" with node(s) linuxdb1,linuxdb2.
    Check: Node connectivity of subnet "192.168.3.0"
    Source Destination Connected?
    linuxdb1:eth1 linuxdb2:eth1 yes
    Result: Node connectivity check passed for subnet "192.168.3.0" with node(s) linuxdb1,linuxdb2.
    Suitable interfaces for VIP on subnet "XXX.XXX.X.XX":
    linuxdb1 eth0:XXX.XXX.X.XX
    linuxdb2 eth0:XXX.XXX.X.XX
    Suitable interfaces for the private interconnect on subnet "192.168.3.0":
    linuxdb1 eth1:192.168.3.49
    linuxdb2 eth1:192.168.3.81
    Result: Node connectivity check passed.
    Checking system requirements for 'crs'...
    No checks registered for this product.
    Pre-check for cluster services setup was unsuccessful on all the nodes.

  • Prerequisite "Clusterware version" fail while applying 10.2.0.4 pachset

    I've installed Oracle Clusterware and Oracle RAC 10gR2 on two nodes.
    Now I'd like to apply latest pachset 10.2.0.4 available for Linux 32bit.
    This is the output about my current versions:
    [oracle@node1 ~]$ crsctl query crs activeversion
    CRS active version on the cluster is [10.2.0.1.0]
    [oracle@node1 ~]$ crsctl query crs softwareversion
    CRS software version on node [node1] is [10.2.0.1.0]
    Why am I getting the following prerequisite error ?
    Checking Oracle Clusterware version ...
    Check complete. The overall result of this check is: Failed <<<<
    Problem: The 'active' version of Oracle Clusterware is not 10.2.0.4.0.
    Recommendation: You must upgrade all nodes of the cluster to Oracle Clusterware 10.2.0.4.0. If you have upgraded some but not all of the nodes to use the 10.2.0.4.0 version of Oracle Clusterware, then the 'active' version will not be 10.2.0.4.0. You must upgrade all nodes in the cluster to Oracle Clusterware 10.2.0.4.0 before proceeding with this installation.
    Can I simply check this prerequisite (as User Verified) and continue to upgrade (first) the Oracle Clusterware and then the database ?
    Thanks,
    Marco

    Looks like you are attempting to patch the ORACLE_HOME to 10.2.0.4 before patching the CRS. You have to first patch the CRS home to 10.2.0.4 and then your $OH.
    Or possibly you are really intending to patch the CRS, but apparently you are selecting the destination home as $OH instead of $CRS_HOME.
    HTH
    Thanks
    -Chandra

  • Installation of Oracle Database 11g R2 Grid is failing

    Hi Guys,
    I've been trying to install Oracle Grid Infrastructure 11g R2 (11.2.0.2) for a long time, but, failing every time. This is what I've tried so far:
    Things being used:
    OS: Oracle Enterprise Linux 5.2
    VM Software: VMware Workstation 7.1 and VMware Server 2
    Oracle SW: Oracle Grid Infrastructure 11g R2 - 11.2.0.2
    VMs: Three RAC nodes - rac1, rac2, rac3
    I've tried to follow the link given below to on both VMware Server and VMware Workstation all goes well until it asks us to run two scripts as root.
    http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnOEL5UsingVMwareServer2.php
    The script "/u01/app/grid/11.2.0/root.sh" completes successfully on the first node, rac1, however, it fails on the rest of them with the following error:
    CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1, number 1, and is terminating
    An active cluster was found during exclusive startup, restarting to join the cluster
    Start of resource "ora.crsd" failed
    CRS-2800: Cannot start resource 'ora.asm' as it is already in the INTERMEDIATE state on server 'rac2'
    CRS-4000: Command Start failed, or completed with errors.
    Failed to start Oracle Clusterware stack
    Failed to start Cluster Ready Services at /u01/app/grid/11.2.0/crs/install/crsconfig_lib.pm line 1065.
    /u01/app/grid/11.2.0/perl/bin/perl -I/u01/app/grid/11.2.0/perl/lib -I/u01/app/grid/11.2.0/crs/install /u01/app/grid/11.2.0/crs/install/rootcrs.pl execution failed
    Instead of using shared disk as "independent-persistent" disks I've also used openfiler 2.99 to allocate storage by following below given link. With that the issue was that the iSCSI disks were not persistent and no solution worked to fix that.
    http://www.jobacle.nl/?p=957
    I also tried to use OCFS2 for OCR and VOTING disks, the installation completes successfully, however, the asm instance, registry, and few other services doesn't start. When I tried to reboot all the machines not a single oracle service came up. The crs just died because of OCR and VOTING disks.
    I've tried so many things but nothing works.
    My last installation was as follows:
    ==============================
    VM: rac1, rac2, rac3
    Config of each VM:
    Memory: 4GB
    Processors: 4
    HDD (SCSI): 25GB
    /dev/sda1 > /boot (100M)
    /dev/sda2 > swap (8G)
    /dev/sda3 > / (17G)HDD2 (SCSI): 60GB (Persistent)
    /dev/sdb1 > ocrvot1 (2G)
    /dev/sdb2 > ocrvot2 (2G)
    /dev/sdb3 > ocrvot3 (2G)
    /dev/sdb4 > data1 (10G)
    /dev/sdb5 > data2 (10G)
    /dev/sdb6 > data3 (10G)
    /dev/sdb7 > fast1 (10G)
    /dev/sdb8 > fast2 (10G)HDD3 (SCSI): 60GB (Persistent)
    /dev/sdc1 > ocrvot4 (2G)
    /dev/sdc2 > ocrvot5 (2G)
    /dev/sdc3 > ocrvot6 (2G)
    /dev/sdc4 > data4 (10G)
    /dev/sdc5 > data5 (10G)
    /dev/sdc6 > fast3 (10G)
    /dev/sdc7 > fast4 (10G)
    /dev/sdc8 > fast5 (10G)NIC 1: Bridge
    NIC 2: Bridge
    Pre-requisites completed.
    ASM Disks labeled.
    runcluvfy succeeds for all nodes
    All nodes can see and write to the ASM disks.During the installation of GI 11.2.0.2 at prerequisites test got one error:
    PRVF-5449 : Check of Voting Disk location "ORCL:(ORCL:)" failed
    However, according to Metalink, note ID 1267569.1, its a bug and its going to be fixed in 11.2.0.3. The note gives a workaround which is the manual testing of the ASM disks from all the nodes and as long it succeeds we can ignore the error. Therefore, I just ignored the error and carried on. When prompted I executed the first script, "/u01/app/oraInventory/orainstRoot.sh ", on all the nodes successfully. The second script, "/u01/app/grid/11.2.0/root.sh" completes successfully on rac1, however, fails on the rest of the nodes.
    On rac2 the alertrac2.log contains the following errors:
    CRS-5019:All OCR locations are on ASM disk groups [OCRVOT], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/grid/11.2.0/log/rac2/agent/ohasd/oraagent_oracle/oraagent_oracle.log".and oraagent_oracle.log contains the following errors:
    2011-07-15 22:53:47.748: [ora.asm][1090414912] {0:0:215} [check] checkCrsStat 2 CLSCRS_STAT ret: 1842011-07-15 22:53:47.748: [ora.asm][1090414912] {0:0:215} [check] clsnUtils::error Exception type=2 string=
    2011-07-15 22:53:47.748: [ora.asm][1090414912] {0:0:215} [check] AsmAgent::checkCbk: Exception UserErrorException
    2011-07-15 22:53:47.748: [ora.asm][1090414912] {0:0:215} [check]
    2011-07-15 22:53:47.748: [ora.asm][1090414912] {0:0:215} [check] InstAgent::check checkCounter 0 prev clsagfw_status 1 current clsagfw_status 4
    2011-07-15 22:53:48.599: [    AGFW][1117755712] {0:0:166} Agent received the message: AGENT_HB[Engine] ID 12293:1089
    2011-07-15 22:53:48.755: [ COMMCRS][1128261952]clsc_connect: (0x10c5d5b0) no listener at (ADDRESS=(PROTOCOL=IPC)(KEY=CRSD_UI_SOCKET))
    On rac1:
    ========
    [root@rac1 bin]# ./crsctl status res -t
    NAME TARGET STATE SERVER STATE_DETAILS
    Local Resources
    ora.OCRVOT.dg
    ONLINE ONLINE rac1
    ora.asm
    ONLINE ONLINE rac1 Started
    ora.gsd
    OFFLINE OFFLINE rac1
    ora.net1.network
    ONLINE ONLINE rac1
    ora.ons
    ONLINE ONLINE rac1
    ora.registry.acfs
    ONLINE ONLINE rac1
    Cluster Resources
    ora.LISTENER_SCAN1.lsnr
    1 ONLINE ONLINE rac1
    ora.cvu
    1 ONLINE ONLINE rac1
    ora.oc4j
    1 ONLINE ONLINE rac1
    ora.rac1.vip
    1 ONLINE ONLINE rac1
    ora.scan1.vip
    1 ONLINE ONLINE rac1
    On rac2
    ========
    The alert+ASM2.log has the following errors:
    SQL> ALTER DISKGROUP ALL MOUNT /* asm agent call crs *//* {0:0:215} */
    NOTE: Diskgroup used for Voting files is:
    OCRVOT
    Diskgroup used for OCR is:OCRVOT
    NOTE: cache registered group OCRVOT number=1 incarn=0xee7b8cf5
    NOTE: cache began mount (not first) of group OCRVOT number=1 incarn=0xee7b8cf5
    NOTE: Loaded library: /opt/oracle/extapi/64/asm/orcl/1/libasm.so
    NOTE: Assigning number (1,0) to disk (ORCL:OCRVOT1)
    NOTE: Assigning number (1,1) to disk (ORCL:OCRVOT2)
    NOTE: Assigning number (1,2) to disk (ORCL:OCRVOT3)
    NOTE: Assigning number (1,3) to disk (ORCL:OCRVOT4)
    NOTE: Assigning number (1,4) to disk (ORCL:OCRVOT5)
    NOTE: Assigning number (1,5) to disk (ORCL:OCRVOT6)
    ERROR: no PST quorum in group: required 3, found 0
    NOTE: cache dismounting (clean) group 1/0xEE7B8CF5 (OCRVOT)
    NOTE: dbwr not being msg'd to dismount
    NOTE: lgwr not being msg'd to dismount
    NOTE: cache dismounted group 1/0xEE7B8CF5 (OCRVOT)
    NOTE: cache ending mount (fail) of group OCRVOT number=1 incarn=0xee7b8cf5
    NOTE: cache deleting context for group OCRVOT 1/0xee7b8cf5
    GMON dismounting group 1 at 2 for pid 23, osid 19831
    NOTE: Disk in mode 0x8 marked for de-assignment
    NOTE: Disk in mode 0x8 marked for de-assignment
    NOTE: Disk in mode 0x8 marked for de-assignment
    NOTE: Disk in mode 0x8 marked for de-assignment
    NOTE: Disk in mode 0x8 marked for de-assignment
    NOTE: Disk in mode 0x8 marked for de-assignment
    ERROR: diskgroup OCRVOT was not mounted
    WARNING: Disk Group OCRVOT containing configured OCR is not mounted
    WARNING: Disk Group OCRVOT containing voting files is not mounted
    ORA-15032: not all alterations performed
    ORA-15017: diskgroup "OCRVOT" cannot be mounted
    ORA-15063: ASM discovered an insufficient number of disks for diskgroup "OCRVOT"
    ERROR: ALTER DISKGROUP ALL MOUNT /* asm agent call crs *//* {0:0:215} */
    SQL> ALTER DISKGROUP ALL ENABLE VOLUME ALL /* asm agent *//* {0:0:215} */
    Any help would be appreciated. Thanks.
    Still miss those days when Oracle used to release easy to use and easy to install softwares, but now thats not the case. Grid Infrastructure, Grid Control, and other similar technologies have become so complicated and difficult for us to install on VMs and play with them.
    Kashif.
    Updates:
    Metalink doc, Oracle Grid Infrastructure 11.2.0.2 Installation or Upgrade may fail due to Multicasting Requirement [ID 1212703.1], shows similar errors that I've in my log files. Therefore, I thought Multicast could be the culprit. Nonetheless:
    [oracle@rac3 mcasttest]$ ./mcasttest.pl -n rac1,rac2,rac3 -i eth0,eth1
    ########### Setup for node rac1 ##########
    Checking node access 'rac1'
    Checking node login 'rac1'
    Checking/Creating Directory /tmp/mcasttest for binary on node 'rac1'
    Distributing mcast2 binary to node 'rac1'
    ########### Setup for node rac2 ##########
    Checking node access 'rac2'
    Checking node login 'rac2'
    Checking/Creating Directory /tmp/mcasttest for binary on node 'rac2'
    Distributing mcast2 binary to node 'rac2'
    ########### Setup for node rac3 ##########
    Checking node access 'rac3'
    Checking node login 'rac3'
    Checking/Creating Directory /tmp/mcasttest for binary on node 'rac3'
    Distributing mcast2 binary to node 'rac3'
    ########### testing Multicast on all nodes ##########
    Test for Multicast address 230.0.1.0
    Jul 15 23:57:30 | Multicast Succeeded for eth0 using address 230.0.1.0:42000
    Jul 15 23:57:31 | Multicast Succeeded for eth1 using address 230.0.1.0:42001
    Test for Multicast address 224.0.0.251
    Jul 15 23:57:32 | Multicast Succeeded for eth0 using address 224.0.0.251:42002
    Jul 15 23:57:33 | Multicast Succeeded for eth1 using address 224.0.0.251:42003
    Hence, the issue is not multicast related.
    Kashif.
    Edited by: Kashif Khan on Jul 15, 2011 9:00 PM

    Kashif Khan wrote:
    THE ISSUE HAS BEEN RESOLVED!
    With the same configuration the installation completed successfully on Oracle's Virtual Box. I had a lot of issues while installing Grid Control 11g on VMware, but, that got installed successfully as well on the Virtual Box.
    Hence proved, VMware is no good for Oracle virtualization any more.
    Hi,
    Good if you have it resolved. Now could you please mark the thread as answered to avoid confusion
    Cheers

  • Failed root.sh on 1st Node of 11.2.0.2.0 RAC on HP-UX 11.31 Itanium 64

    Started with 11.2.0.2.0 Grid Installation for 2 Node RAC on HP-UX 11.31 Itanium 64.
    Copying Software to remote node & linking libraries were successfully without any issue (upto 76%). But got issue while executing root.sh on Node1
    sph1erp:/oracle/11.2.0/grid #sh root.sh
    Running Oracle 11g root script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /oracle/11.2.0/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root script.
    Now product-specific root actions will be performed.
    Using configuration parameter file: /oracle/11.2.0/grid/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'sys'..
    Operation successful.
    OLR initialization - successful
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding daemon to inittab
    CRS-2672: Attempting to start 'ora.mdnsd' on 'sph1erp'
    CRS-2676: Start of 'ora.mdnsd' on 'sph1erp' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'sph1erp'
    CRS-2676: Start of 'ora.gpnpd' on 'sph1erp' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'sph1erp'
    CRS-2672: Attempting to start 'ora.gipcd' on 'sph1erp'
    CRS-2676: Start of 'ora.gipcd' on 'sph1erp' succeeded
    CRS-2676: Start of 'ora.cssdmonitor' on 'sph1erp' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'sph1erp'
    CRS-2672: Attempting to start 'ora.diskmon' on 'sph1erp'
    CRS-2676: Start of 'ora.diskmon' on 'sph1erp' succeeded
    CRS-2676: Start of 'ora.cssd' on 'sph1erp' succeeded
    ASM created and started successfully.
    Disk Group OCRVOTE created successfully.
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'sys'..
    Operation successful.
    CRS-4256: Updating the profile
    Successful addition of voting disk ab847ed2b4f04f2dbfb875226d2bb194.
    Successful addition of voting disk 85c05a5b30384f8dbff48cc069de7a7c.
    Successful addition of voting disk 649196fbdd614f9cbf26a9a0e6670a6e.
    Successful addition of voting disk 8815dfcee2e64f64bf00b9c76626ab41.
    Successful addition of voting disk 8ce55fe5534f4f77bfa9f54187592707.
    Successfully replaced voting disk group with +OCRVOTE.
    CRS-4256: Updating the profile
    CRS-4266: Voting file(s) successfully replaced
    ## STATE File Universal Id File Name Disk group
    1. ONLINE ab847ed2b4f04f2dbfb875226d2bb194 (/dev/oracle/ocrvote1) [OCRVOTE]
    2. ONLINE 85c05a5b30384f8dbff48cc069de7a7c (/dev/oracle/ocrvote2) [OCRVOTE]
    3. ONLINE 649196fbdd614f9cbf26a9a0e6670a6e (/dev/oracle/ocrvote3) [OCRVOTE]
    4. ONLINE 8815dfcee2e64f64bf00b9c76626ab41 (/dev/oracle/ocrvote4) [OCRVOTE]
    5. ONLINE 8ce55fe5534f4f77bfa9f54187592707 (/dev/oracle/ocrvote5) [OCRVOTE]
    Located 5 voting disk(s).
    Start of resource "ora.cluster_interconnect.haip" failed
    CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'sph1erp'
    CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
    Start action for HAIP aborted
    CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'sph1erp' failed
    CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'sph1erp'
    CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'sph1erp' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    Failed to start Oracle Clusterware stack
    Failed to start High Availability IP at /oracle/11.2.0/grid/crs/install/crsconfig_lib.pm line 1046.
    */oracle/11.2.0/grid/perl/bin/perl -I/oracle/11.2.0/grid/perl/lib -I/oracle/11.2.0/grid/crs/install /oracle/11.2.0/grid/crs/install/rootcrs.pl execution failed*
    sph1erp:/oracle/11.2.0/grid #
    Last few lines from CRS Log for node 1, where error came
    [ctssd(6467)]CRS-2401:The Cluster Time Synchronization Service started on host sph1erp.
    2011-02-25 23:04:16.491
    [oracle/11.2.0/grid/bin/orarootagent.bin(6423)]CRS-5818:Aborted command 'start for resource: ora.cluster_interconnect.haip 1 1' for resource 'ora.cluster_int
    erconnect.haip'. Details at (:CRSAGF00113:) {0:0:178} in */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
    2011-02-25 23:04:20.521
    [ohasd(5513)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cluster_interconnect.haip'. Details at (:CRSPE00111:) {0:0:178} in
    */oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
    Few lines from */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
    =====================================================================================================
    2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Starting Probe for ip 169.254.74.54
    2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Transitioning to Probe State
    2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} [NetHAMain] thread stopping
    2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} Thread:[NetHAMain]isRunning is reset to false here
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAMain]stop }
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} thread cleaning up
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} pausing thread
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} posting thread
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
    2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} [NetHAWork] thread stopping
    2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} Thread:[NetHAWork]isRunning is reset to false here
    2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
    2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
    2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
    2011-02-25 23:04:17.891: [ora.cluster_interconnect.haip][12] {0:0:178} [start] Start of HAIP aborted
    2011-02-25 23:04:17.892: [ AGENT][12] {0:0:178} UserErrorException: Locale is
    2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsnUtils::error Exception type=2 string=
    CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
    Start action for HAIP aborted
    2011-02-25 23:04:17.893: [ AGFW][12] {0:0:178} sending status msg [CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the foll
    owing error:
    Start action for HAIP aborted
    ] for start for resource: ora.cluster_interconnect.haip 1 1
    2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsn_agent::start }
    2011-02-25 23:04:17.894: [ AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
    2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check {
    2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check } - 0
    2011-02-25 23:04:19.573: [ AGFW][10] {0:0:154} Agent received the message: AGENT_HB[Engine] ID 12293:669
    2011-02-25 23:04:20.510: [ora.cluster_interconnect.haip][18] {0:0:178} [start] got lock
    2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] tryActionLock }
    2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] abort }
    2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] clsn_agent::abort }
    2011-02-25 23:04:20.511: [ AGFW][18] {0:0:178} Command: start for resource: ora.cluster_interconnect.haip 1 1 completed with status: TIMEDOUT
    2011-02-25 23:04:20.512: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init enter {
    2011-02-25 23:04:20.513: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init exit }
    2011-02-25 23:04:20.517: [ AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
    2011-02-25 23:04:20.519: [ USRTHRD][8] {0:0:178} Ocr Context init default level 23886304
    2011-02-25 23:04:20.519: [ default][8]clsvactversion:4: Retrieving Active Version from local storage.
    [ CLWAL][8]clsw_Initialize: OLR initlevel [70000]
    Few lines from */oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
    =====================================================================================================
    2011-02-25 23:04:21.627: [UiServer][30] {0:0:180} Done for ctx=6000000002604ce0
    2011-02-25 23:04:21.642: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:26.139: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:26.139: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    2011-02-25 23:04:26.973: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
    2011-02-25 23:04:26.973: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
    DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
    2011-02-25 23:04:26.992: [UiServer][30] {0:0:181} processMessage called
    2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending message to PE. ctx= 6000000001b440f0
    2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending command to PE: 67
    2011-02-25 23:04:26.994: [ CRSPE][29] {0:0:181} Processing PE command id=173. Description: [Stat Resource : 600000000135f760]
    2011-02-25 23:04:26.997: [UiServer][30] {0:0:181} Done for ctx=6000000001b440f0
    2011-02-25 23:04:27.012: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:31.135: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:31.135: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    2011-02-25 23:04:32.318: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
    2011-02-25 23:04:32.318: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
    DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
    2011-02-25 23:04:32.332: [UiServer][30] {0:0:182} processMessage called
    2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending message to PE. ctx= 6000000001b45ef0
    2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending command to PE: 68
    2011-02-25 23:04:32.334: [ CRSPE][29] {0:0:182} Processing PE command id=174. Description: [Stat Resource : 600000000135f760]
    2011-02-25 23:04:32.338: [UiServer][30] {0:0:182} Done for ctx=6000000001b45ef0
    2011-02-25 23:04:32.352: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:36.155: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:36.155: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    2011-02-25 23:04:37.683: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
    2011-02-25 23:04:37.683: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
    DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
    2011-02-25 23:04:37.702: [UiServer][30] {0:0:183} processMessage called
    2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending message to PE. ctx= 6000000002604ce0
    2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending command to PE: 69
    2011-02-25 23:04:37.704: [ CRSPE][29] {0:0:183} Processing PE command id=175. Description: [Stat Resource : 600000000135f760]
    2011-02-25 23:04:37.708: [UiServer][30] {0:0:183} Done for ctx=6000000002604ce0
    2011-02-25 23:04:37.722: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:41.156: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:41.156: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    What could be the issue ????
    Experts Please help me. Doing setup for the PRoduction Env...
    Do response ASAP...... Thanks
    Regards,
    Manish

    Thanks Sebastian for your input.
    yes. my lan2 is used for Cluster_interconnect which is having subnet 255.255.255.240.
    Below are IPs used for RAC
    Public
    Node1: 10.10.1.173/255.255.240.0
    Node2: 10.10.1.174/255.255.240.0
    Private
    Node1: 10.10.16.50/255.255.255.240
    Node2: 10.10.16.51/255.255.255.240
    Virtual
    Node1: 10.10.1.191/255.255.240.0
    Node2: 10.10.1.192/255.255.240.0
    SCAN (Defined in DNS)
    10.10.1.193/255.255.240.0
    10.10.1.194/255.255.240.0
    10.10.1.195/255.255.240.0
    As you said, I will scrap GI Software again & will try with 255.255.255.0.
    I Believe this Redundant Interconnect and ora.cluster_interconnect.haip present in 11.2.0.2.0 Version.
    Oracle says:
    Redundant Interconnect without any 3rd-party IP failover technology (bond, IPMP or similar) is supported natively by Grid Infrastructure starting from 11.2.0.2. Multiple private network adapters can be defined either during the installation phase or afterward using the oifcfg. Oracle Database, CSS, OCR, CRS, CTSS, and EVM components in 11.2.0.2 employ it automatically.
    Grid Infrastructure can activate a maximum of four private network adapters at a time even if more are defined. The ora.cluster_interconnect.haip resource will start one to four link local HAIP on private network adapters for interconnect communication for Oracle RAC, Oracle ASM, and Oracle ACFS etc.
    Grid automatically picks link local addresses from reserved 169.254.*.* subnet for HAIP, and it will not attempt to use any 169.254.*.* address if it's already in use for another purpose. With HAIP, by default, interconnect traffic will be load balanced across all active interconnect interfaces, and corresponding HAIP address will be failed over transparently to other adapters if one fails or becomes non-communicative. .
    The number of HAIP addresses is decided by how many private network adapters are active when Grid comes up on the first node in the cluster . If there's only one active private network, Grid will create one; if two, Grid will create two; and if more than two, Grid will create four HAIPs. The number of HAIPs won't change even if more private network adapters are activated later, a restart of clusterware on all nodes is required for new adapters to become effective.
    In my Setup, I am having Teaming for NIC's for Public & Private Interface. So I am thinking to break teaming of NICs because HAIP internally searching for next available NIC & not getting as all 4 are already in used with OS level NIC teaming.
    My only Concern is, as I am going to change subnet for the Private IPs, should I change Private IP address ????
    Thanks for the Support...
    Regards,
    Manish

  • Failing all pre-requisite checks for 11.2.0.2.0 RAC on HP-UX Itanium 64

    Hi Guys,
    For Typical OR Advanced Grid Installation (GUI), all pre-requisites are failing on both nodes, like memory, swap, node reachability, groups, user & lot more.....
    But when I try to check Pre-requisite from command line, everything seems to be ok.
    This is what the output...
    $ ./runcluvfy.sh stage -pre crsinst -n sph1erp,sph2erp -fixup -verbose
    Performing pre-checks for cluster services setup
    Checking node reachability...
    Check: Node reachability from node "sph1erp"
    Destination Node Reachable?
    sph1erp yes
    sph2erp yes
    Result: Node reachability check passed from node "sph1erp"
    Checking user equivalence...
    Check: User equivalence for user "oracle"
    Node Name Comment
    sph2erp passed
    sph1erp passed
    Result: User equivalence check passed for user "oracle"
    Checking node connectivity...
    Checking hosts config file...
    Node Name Status Comment
    sph2erp passed
    sph1erp passed
    Verification of the hosts config file successful
    Interface information for node "sph2erp"
    Name IP Address Subnet Gateway Def. Gateway HW Address MTU
    lan2 10.10.16.51 10.10.16.48 10.10.16.51 10.10.1.12 78:AC:C0:8A:07:76 1500
    lan900 10.10.1.174 10.10.0.0 10.10.1.174 10.10.1.12 78:AC:C0:8A:07:6E 1500
    Interface information for node "sph1erp"
    Name IP Address Subnet Gateway Def. Gateway HW Address MTU
    lan2 10.10.16.50 10.10.16.48 10.10.16.50 10.10.1.12 3C:4A:92:48:71:BE 1500
    lan900 10.10.1.173 10.10.0.0 10.10.1.173 10.10.1.12 3C:4A:92:48:71:B6 1500
    Check: Node connectivity of subnet "10.10.16.48"
    Source Destination Connected?
    sph2erp[10.10.16.51] sph1erp[10.10.16.50] yes
    Result: Node connectivity passed for subnet "10.10.16.48" with node(s) sph2erp,sph1erp
    Check: TCP connectivity of subnet "10.10.16.48"
    Source Destination Connected?
    sph1erp:10.10.16.50 sph2erp:10.10.16.51 passed
    Result: TCP connectivity check passed for subnet "10.10.16.48"
    Check: Node connectivity of subnet "10.10.0.0"
    Source Destination Connected?
    sph2erp[10.10.1.174] sph1erp[10.10.1.173] yes
    Result: Node connectivity passed for subnet "10.10.0.0" with node(s) sph2erp,sph1erp
    Check: TCP connectivity of subnet "10.10.0.0"
    Source Destination Connected?
    sph1erp:10.10.1.173 sph2erp:10.10.1.174 passed
    Result: TCP connectivity check passed for subnet "10.10.0.0"
    Interfaces found on subnet "10.10.0.0" that are likely candidates for VIP are:
    sph2erp lan900:10.10.1.174
    sph1erp lan900:10.10.1.173
    Interfaces found on subnet "10.10.16.48" that are likely candidates for a private interconnect are:
    sph2erp lan2:10.10.16.51
    sph1erp lan2:10.10.16.50
    Result: Node connectivity check passed
    Check: Total memory
    Node Name Available Required Comment
    sph2erp 63.9GB (6.7004024E7KB) 4GB (4194304.0KB) passed
    sph1erp 63.9GB (6.7004024E7KB) 4GB (4194304.0KB) passed
    Result: Total memory check passed
    Check: Available memory
    Node Name Available Required Comment
    sph2erp 53.3556GB (5.5947372E7KB) 50MB (51200.0KB) passed
    sph1erp 52.2323GB (5.47695E7KB) 50MB (51200.0KB) passed
    Result: Available memory check passed
    Check: Swap space
    Node Name Available Required Comment
    sph2erp 188.7773GB (1.97947352E8KB) 4GB (4194304.0KB) passed
    sph1erp 188.7773GB (1.97947352E8KB) 4GB (4194304.0KB) passed
    Result: Swap space check passed
    Check: Free disk space for "sph2erp:/var/tmp/"
    Path Node Name Mount point Available Required Comment
    /var/tmp/ sph2erp /var 13.8074GB 1GB passed
    Result: Free disk space check passed for "sph2erp:/var/tmp/"
    Check: Free disk space for "sph1erp:/var/tmp/"
    Path Node Name Mount point Available Required Comment
    /var/tmp/ sph1erp /var 13.8158GB 1GB passed
    Result: Free disk space check passed for "sph1erp:/var/tmp/"
    Check: User existence for "oracle"
    Node Name Status Comment
    sph2erp exists(199) passed
    sph1erp exists(199) passed
    Checking for multiple users with UID value 199
    Result: Check for multiple users with UID value 199 passed
    Result: User existence check passed for "oracle"
    Check: Group existence for "oinstall"
    Node Name Status Comment
    sph2erp exists passed
    sph1erp exists passed
    Result: Group existence check passed for "oinstall"
    Check: Group existence for "dba"
    Node Name Status Comment
    sph2erp exists passed
    sph1erp exists passed
    Result: Group existence check passed for "dba"
    Check: Membership of user "oracle" in group "oinstall" [as Primary]
    Node Name User Exists Group Exists User in Group Primary Comment
    sph2erp yes yes yes yes passed
    sph1erp yes yes yes yes passed
    Result: Membership check for user "oracle" in group "oinstall" [as Primary] passed
    Check: Membership of user "oracle" in group "dba"
    Node Name User Exists Group Exists User in Group Comment
    sph2erp yes yes yes passed
    sph1erp yes yes yes passed
    Result: Membership check for user "oracle" in group "dba" passed
    Check: Run level
    Node Name run level Required Comment
    sph2erp 3 3 passed
    sph1erp 3 3 passed
    Result: Run level check passed
    Check: Hard limits for "maximum open file descriptors"
    Node Name Type Available Required Comment
    sph2erp hard 63488 63488 passed
    sph1erp hard 63488 63488 passed
    Result: Hard limits check passed for "maximum open file descriptors"
    Check: Soft limits for "maximum open file descriptors"
    Node Name Type Available Required Comment
    sph2erp soft 1024 1024 passed
    sph1erp soft 63488 1024 passed
    Result: Soft limits check passed for "maximum open file descriptors"
    Check: Hard limits for "maximum user processes"
    Node Name Type Available Required Comment
    sph2erp hard 3687 3686 passed
    sph1erp hard 3687 3686 passed
    Result: Hard limits check passed for "maximum user processes"
    Check: Soft limits for "maximum user processes"
    Node Name Type Available Required Comment
    sph2erp soft 3687 2047 passed
    sph1erp soft 3687 2047 passed
    Result: Soft limits check passed for "maximum user processes"
    Check: System architecture
    Node Name Available Required Comment
    sph2erp ia64 ia64 passed
    sph1erp ia64 ia64 passed
    Result: System architecture check passed
    Check: Kernel version
    Node Name Available Required Comment
    sph2erp HP-UX B.11.31 B.11.31 passed
    sph1erp HP-UX B.11.31 B.11.31 passed
    Result: Kernel version check passed
    Check: Kernel parameter for "ksi_alloc_max"
    Node Name Configured Required Comment
    sph2erp 32768 32768 passed
    sph1erp 32768 32768 passed
    Result: Kernel parameter check passed for "ksi_alloc_max"
    Check: Kernel parameter for "executable_stack"
    Node Name Configured Required Comment
    sph2erp 0 0 passed
    sph1erp 0 0 passed
    Result: Kernel parameter check passed for "executable_stack"
    Check: Kernel parameter for "max_thread_proc"
    Node Name Configured Required Comment
    sph2erp 1024 1024 passed
    sph1erp 1024 1024 passed
    Result: Kernel parameter check passed for "max_thread_proc"
    Check: Kernel parameter for "maxdsiz"
    Node Name Configured Required Comment
    sph2erp 1073741824 1073741824 passed
    sph1erp 1073741824 1073741824 passed
    Result: Kernel parameter check passed for "maxdsiz"
    Check: Kernel parameter for "maxdsiz_64bit"
    Node Name Configured Required Comment
    sph2erp 2147483648 2147483648 passed
    sph1erp 2147483648 2147483648 passed
    Result: Kernel parameter check passed for "maxdsiz_64bit"
    Check: Kernel parameter for "maxssiz"
    Node Name Configured Required Comment
    sph2erp 134217728 134217728 passed
    sph1erp 134217728 134217728 passed
    Result: Kernel parameter check passed for "maxssiz"
    Check: Kernel parameter for "maxssiz_64bit"
    Node Name Configured Required Comment
    sph2erp 1073741824 1073741824 passed
    sph1erp 1073741824 1073741824 passed
    Result: Kernel parameter check passed for "maxssiz_64bit"
    Check: Kernel parameter for "maxuprc"
    Node Name Configured Required Comment
    sph2erp 3686 3686 passed
    sph1erp 3686 3686 passed
    Result: Kernel parameter check passed for "maxuprc"
    Check: Kernel parameter for "msgmni"
    Node Name Configured Required Comment
    sph2erp 4096 4096 passed
    sph1erp 4096 4096 passed
    Result: Kernel parameter check passed for "msgmni"
    Check: Kernel parameter for "msgtql"
    Node Name Configured Required Comment
    sph2erp 4096 4096 passed
    sph1erp 4096 4096 passed
    Result: Kernel parameter check passed for "msgtql"
    Check: Kernel parameter for "ncsize"
    Node Name Configured Required Comment
    sph2erp 35840 35840 passed
    sph1erp 35840 35840 passed
    Result: Kernel parameter check passed for "ncsize"
    Check: Kernel parameter for "shmmax"
    Node Name Configured Required Comment
    sph2erp 1073741824 1073741824 passed
    sph1erp 1073741824 1073741824 passed
    Result: Kernel parameter check passed for "shmmax"
    Check: Kernel parameter for "shmmni"
    Node Name Configured Required Comment
    sph2erp 4096 4096 passed
    sph1erp 4096 4096 passed
    Result: Kernel parameter check passed for "shmmni"
    Check: Kernel parameter for "shmseg"
    Node Name Configured Required Comment
    sph2erp 512 512 passed
    sph1erp 512 512 passed
    Result: Kernel parameter check passed for "shmseg"
    Check: Kernel parameter for "tcp_smallest_anon_port"
    Node Name Configured Required Comment
    sph2erp 9000 9000 passed
    sph1erp 9000 9000 passed
    Result: Kernel parameter check passed for "tcp_smallest_anon_port"
    Check: Kernel parameter for "tcp_largest_anon_port"
    Node Name Configured Required Comment
    sph2erp 65500 65500 passed
    sph1erp 65500 65500 passed
    Result: Kernel parameter check passed for "tcp_largest_anon_port"
    Check: Kernel parameter for "udp_smallest_anon_port"
    Node Name Configured Required Comment
    sph2erp 9000 9000 passed
    sph1erp 9000 9000 passed
    Result: Kernel parameter check passed for "udp_smallest_anon_port"
    Check: Kernel parameter for "udp_largest_anon_port"
    Node Name Configured Required Comment
    sph2erp 65500 65500 passed
    sph1erp 65500 65500 passed
    Result: Kernel parameter check passed for "udp_largest_anon_port"
    Check: Package existence for "OS-Core-B.11.31( ia64)"
    Node Name Available Required Comment
    sph2erp OS-Core-B.11.31-0 OS-Core-B.11.31( ia64) passed
    sph1erp OS-Core-B.11.31-0 OS-Core-B.11.31( ia64) passed
    Result: Package existence check passed for "OS-Core-B.11.31( ia64)"
    Check: Operating system patch for "Patch PHKL_38938"
    Node Name Applied Required Comment
    sph2erp Patch PHKL_39646 Patch PHKL_38938 passed
    sph1erp Patch PHKL_39646 Patch PHKL_38938 passed
    Result: Operating system patch check passed for "Patch PHKL_38938"
    Check: Operating system patch for "Patch PHKL_39351"
    Node Name Applied Required Comment
    sph2erp Patch PHKL_40207 Patch PHKL_39351 passed
    sph1erp Patch PHKL_40207 Patch PHKL_39351 passed
    Result: Operating system patch check passed for "Patch PHKL_39351"
    Check: Operating system patch for "Patch PHSS_36354"
    Node Name Applied Required Comment
    sph2erp Patch PHSS_40546 Patch PHSS_36354 passed
    sph1erp Patch PHSS_40546 Patch PHSS_36354 passed
    Result: Operating system patch check passed for "Patch PHSS_36354"
    Check: Operating system patch for "Patch PHSS_37042"
    Node Name Applied Required Comment
    sph2erp Patch PHSS_37042 Patch PHSS_37042 passed
    sph1erp Patch PHSS_37042 Patch PHSS_37042 passed
    Result: Operating system patch check passed for "Patch PHSS_37042"
    Check: Operating system patch for "Patch PHSS_37959"
    Node Name Applied Required Comment
    sph2erp Patch PHSS_40804 Patch PHSS_37959 passed
    sph1erp Patch PHSS_40804 Patch PHSS_37959 passed
    Result: Operating system patch check passed for "Patch PHSS_37959"
    Check: Operating system patch for "Patch PHSS_39094"
    Node Name Applied Required Comment
    sph2erp Patch PHSS_40538 Patch PHSS_39094 passed
    sph1erp Patch PHSS_40538 Patch PHSS_39094 passed
    Result: Operating system patch check passed for "Patch PHSS_39094"
    Check: Operating system patch for "Patch PHSS_39100"
    Node Name Applied Required Comment
    sph2erp Patch PHSS_40540 Patch PHSS_39100 passed
    sph1erp Patch PHSS_40540 Patch PHSS_39100 passed
    Result: Operating system patch check passed for "Patch PHSS_39100"
    Check: Operating system patch for "Patch PHSS_39102"
    Node Name Applied Required Comment
    sph2erp Patch PHSS_41496 Patch PHSS_39102 passed
    sph1erp Patch PHSS_41496 Patch PHSS_39102 passed
    Result: Operating system patch check passed for "Patch PHSS_39102"
    Check: Operating system patch for "Patch PHSS_38141"
    Node Name Applied Required Comment
    sph2erp Patch PHSS_38141 Patch PHSS_38141 passed
    sph1erp Patch PHSS_38141 Patch PHSS_38141 passed
    Result: Operating system patch check passed for "Patch PHSS_38141"
    Check: Operating system patch for "Patch PHCO_40381"
    Node Name Applied Required Comment
    sph2erp Patch PHCO_40381 Patch PHCO_40381 passed
    sph1erp Patch PHCO_40381 Patch PHCO_40381 passed
    Result: Operating system patch check passed for "Patch PHCO_40381"
    Check: Operating system patch for "Patch PHKL_38038"
    Node Name Applied Required Comment
    sph2erp Patch PHKL_41005 Patch PHKL_38038 passed
    sph1erp Patch PHKL_41005 Patch PHKL_38038 passed
    Result: Operating system patch check passed for "Patch PHKL_38038"
    Checking for multiple users with UID value 0
    Result: Check for multiple users with UID value 0 passed
    Check: Current group ID
    Result: Current group ID check passed
    Starting Clock synchronization checks using Network Time Protocol(NTP)...
    NTP Configuration file check started...
    Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle Cluster Time Synchronization Service(CTSS) can be used instead of NTP for time synchronization on the cluster nodes
    No NTP Daemons or Services were found to be running
    Result: Clock synchronization check using Network Time Protocol(NTP) passed
    Checking Core file name pattern consistency...
    Core file name pattern consistency check passed.
    Checking to make sure user "oracle" is not in "root" group
    Node Name Status Comment
    sph2erp does not exist passed
    sph1erp does not exist passed
    Result: User "oracle" is not part of "root" group. Check passed
    Check default user file creation mask
    Node Name Available Required Comment
    sph2erp 022 0022 passed
    sph1erp 022 0022 passed
    Result: Default user file creation mask check passed
    Checking consistency of file "/etc/resolv.conf" across nodes
    Node Name Status
    sph2erp passed
    sph1erp passed
    The DNS response time for an unreachable node is within acceptable limit on all nodes
    File "/etc/resolv.conf" is consistent across nodes
    Check: Time zone consistency
    Result: Time zone consistency check passed
    Checking settings of device file "/dev/async"
    Node Name Available Comment
    sph2erp yes failed (incorrect setting for minor number.)
    sph1erp yes failed (incorrect setting for minor number.)
    Result: Check for settings of device file "/dev/async" failed.
    Starting check for The SSH LoginGraceTime setting ...
    WARNING:
    PRVE-0038 : The SSH LoginGraceTime setting on node "sph2erp" may result in users being disconnected before login is completed
    PRVE-0038 : The SSH LoginGraceTime setting on node "sph1erp" may result in users being disconnected before login is completed
    Check for The SSH LoginGraceTime setting passed
    Fixup information has been generated for following node(s):
    sph2erp,sph1erp
    Please run the following script on each node as "root" user to execute the fixups:
    '/tmp/CVU_11.2.0.2.0_oracle/runfixup.sh'
    Pre-check for cluster services setup was unsuccessful on all the nodes.
    What could be the issue ????
    Any help would be appreciated...
    Regards,
    Manish

    Started with Grid Installation. Copying Software to remote node & linking libraries were successfully without any issue (upto 76%). But got issue while executing root.sh on Node1
    sph1erp:/oracle/11.2.0/grid #sh root.sh
    Running Oracle 11g root script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /oracle/11.2.0/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root script.
    Now product-specific root actions will be performed.
    Using configuration parameter file: /oracle/11.2.0/grid/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'sys'..
    Operation successful.
    OLR initialization - successful
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding daemon to inittab
    CRS-2672: Attempting to start 'ora.mdnsd' on 'sph1erp'
    CRS-2676: Start of 'ora.mdnsd' on 'sph1erp' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'sph1erp'
    CRS-2676: Start of 'ora.gpnpd' on 'sph1erp' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'sph1erp'
    CRS-2672: Attempting to start 'ora.gipcd' on 'sph1erp'
    CRS-2676: Start of 'ora.gipcd' on 'sph1erp' succeeded
    CRS-2676: Start of 'ora.cssdmonitor' on 'sph1erp' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'sph1erp'
    CRS-2672: Attempting to start 'ora.diskmon' on 'sph1erp'
    CRS-2676: Start of 'ora.diskmon' on 'sph1erp' succeeded
    CRS-2676: Start of 'ora.cssd' on 'sph1erp' succeeded
    ASM created and started successfully.
    Disk Group OCRVOTE created successfully.
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'sys'..
    Operation successful.
    CRS-4256: Updating the profile
    Successful addition of voting disk ab847ed2b4f04f2dbfb875226d2bb194.
    Successful addition of voting disk 85c05a5b30384f8dbff48cc069de7a7c.
    Successful addition of voting disk 649196fbdd614f9cbf26a9a0e6670a6e.
    Successful addition of voting disk 8815dfcee2e64f64bf00b9c76626ab41.
    Successful addition of voting disk 8ce55fe5534f4f77bfa9f54187592707.
    Successfully replaced voting disk group with +OCRVOTE.
    CRS-4256: Updating the profile
    CRS-4266: Voting file(s) successfully replaced
    ## STATE File Universal Id File Name Disk group
    1. ONLINE ab847ed2b4f04f2dbfb875226d2bb194 (/dev/oracle/ocrvote1) [OCRVOTE]
    2. ONLINE 85c05a5b30384f8dbff48cc069de7a7c (/dev/oracle/ocrvote2) [OCRVOTE]
    3. ONLINE 649196fbdd614f9cbf26a9a0e6670a6e (/dev/oracle/ocrvote3) [OCRVOTE]
    4. ONLINE 8815dfcee2e64f64bf00b9c76626ab41 (/dev/oracle/ocrvote4) [OCRVOTE]
    5. ONLINE 8ce55fe5534f4f77bfa9f54187592707 (/dev/oracle/ocrvote5) [OCRVOTE]
    Located 5 voting disk(s).
    Start of resource "ora.cluster_interconnect.haip" failed
    CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'sph1erp'
    CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
    Start action for HAIP aborted
    CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'sph1erp' failed
    CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'sph1erp'
    CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'sph1erp' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    Failed to start Oracle Clusterware stack
    Failed to start High Availability IP at /oracle/11.2.0/grid/crs/install/crsconfig_lib.pm line 1046.
    /oracle/11.2.0/grid/perl/bin/perl -I/oracle/11.2.0/grid/perl/lib -I/oracle/11.2.0/grid/crs/install /oracle/11.2.0/grid/crs/install/rootcrs.pl execution failed
    sph1erp:/oracle/11.2.0/grid #
    Last few lines from CRS Log for node 1, where error came
    [ctssd(6467)]CRS-2401:The Cluster Time Synchronization Service started on host sph1erp.
    2011-02-25 23:04:16.491
    [oracle/11.2.0/grid/bin/orarootagent.bin(6423)]CRS-5818:Aborted command 'start for resource: ora.cluster_interconnect.haip 1 1' for resource 'ora.cluster_int
    erconnect.haip'. Details at (:CRSAGF00113:) {0:0:178} in */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
    2011-02-25 23:04:20.521
    [ohasd(5513)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cluster_interconnect.haip'. Details at (:CRSPE00111:) {0:0:178} in
    */oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
    Few lines from */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
    =====================================================================================================
    2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Starting Probe for ip 169.254.74.54
    2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Transitioning to Probe State
    2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} [NetHAMain] thread stopping
    2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} Thread:[NetHAMain]isRunning is reset to false here
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAMain]stop }
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} thread cleaning up
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} pausing thread
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} posting thread
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
    2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} [NetHAWork] thread stopping
    2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} Thread:[NetHAWork]isRunning is reset to false here
    2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
    2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
    2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
    2011-02-25 23:04:17.891: [ora.cluster_interconnect.haip][12] {0:0:178} [start] Start of HAIP aborted
    2011-02-25 23:04:17.892: [   AGENT][12] {0:0:178} UserErrorException: Locale is
    2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsnUtils::error Exception type=2 string=
    CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
    Start action for HAIP aborted
    2011-02-25 23:04:17.893: [    AGFW][12] {0:0:178} sending status msg [CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the foll
    owing error:
    Start action for HAIP aborted
    ] for start for resource: ora.cluster_interconnect.haip 1 1
    2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsn_agent::start }
    2011-02-25 23:04:17.894: [    AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
    2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check {
    2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check } - 0
    2011-02-25 23:04:19.573: [    AGFW][10] {0:0:154} Agent received the message: AGENT_HB[Engine] ID 12293:669
    2011-02-25 23:04:20.510: [ora.cluster_interconnect.haip][18] {0:0:178} [start] got lock
    2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] tryActionLock }
    2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] abort }
    2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] clsn_agent::abort }
    2011-02-25 23:04:20.511: [    AGFW][18] {0:0:178} Command: start for resource: ora.cluster_interconnect.haip 1 1 completed with status: TIMEDOUT
    2011-02-25 23:04:20.512: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init enter {
    2011-02-25 23:04:20.513: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init exit }
    2011-02-25 23:04:20.517: [    AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
    2011-02-25 23:04:20.519: [ USRTHRD][8] {0:0:178} Ocr Context init default level 23886304
    2011-02-25 23:04:20.519: [ default][8]clsvactversion:4: Retrieving Active Version from local storage.
    [   CLWAL][8]clsw_Initialize: OLR initlevel [70000]
    Few lines from */oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
    =====================================================================================================
    2011-02-25 23:04:21.627: [UiServer][30] {0:0:180} Done for ctx=6000000002604ce0
    2011-02-25 23:04:21.642: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:26.139: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:26.139: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    2011-02-25 23:04:26.973: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
    2011-02-25 23:04:26.973: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
    DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
    2011-02-25 23:04:26.992: [UiServer][30] {0:0:181} processMessage called
    2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending message to PE. ctx= 6000000001b440f0
    2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending command to PE: 67
    2011-02-25 23:04:26.994: [   CRSPE][29] {0:0:181} Processing PE command id=173. Description: [Stat Resource : 600000000135f760]
    2011-02-25 23:04:26.997: [UiServer][30] {0:0:181} Done for ctx=6000000001b440f0
    2011-02-25 23:04:27.012: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:31.135: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:31.135: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    2011-02-25 23:04:32.318: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
    2011-02-25 23:04:32.318: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
    DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
    2011-02-25 23:04:32.332: [UiServer][30] {0:0:182} processMessage called
    2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending message to PE. ctx= 6000000001b45ef0
    2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending command to PE: 68
    2011-02-25 23:04:32.334: [   CRSPE][29] {0:0:182} Processing PE command id=174. Description: [Stat Resource : 600000000135f760]
    2011-02-25 23:04:32.338: [UiServer][30] {0:0:182} Done for ctx=6000000001b45ef0
    2011-02-25 23:04:32.352: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:36.155: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:36.155: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    2011-02-25 23:04:37.683: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
    2011-02-25 23:04:37.683: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
    DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
    2011-02-25 23:04:37.702: [UiServer][30] {0:0:183} processMessage called
    2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending message to PE. ctx= 6000000002604ce0
    2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending command to PE: 69
    2011-02-25 23:04:37.704: [   CRSPE][29] {0:0:183} Processing PE command id=175. Description: [Stat Resource : 600000000135f760]
    2011-02-25 23:04:37.708: [UiServer][30] {0:0:183} Done for ctx=6000000002604ce0
    2011-02-25 23:04:37.722: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:41.156: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:41.156: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    What could be the issue ????
    Experts Please help me. Doing setup for the PRoduction Env...
    Do response ASAP...... Thanks
    Regards,
    Manish

  • Root.sh is falling in Node2 while clusterware installation

    Hi Friends,
    I am trying to install Oracle 11gr2 cluster ware on Linux RHEl 5..when running root.sh on second node getting with below error.
    [root@uidl1DR-test-02 ~]# /u01/app/11.2.0/grid/root.sh
    Running Oracle 11g root script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/11.2.0/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    The contents of "dbhome" have not changed. No need to overwrite.
    The contents of "oraenv" have not changed. No need to overwrite.
    The contents of "coraenv" have not changed. No need to overwrite.
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root script.
    Now product-specific root actions will be performed.
    Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
    Failed to start Oracle Clusterware stack
    Failed to start Cluster Synchorinisation Service in clustered mode at /u01/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 1016.
    /u01/app/11.2.0/grid/perl/bin/perl -I/u01/app/11.2.0/grid/perl/lib -I/u01/app/11.2.0/grid/crs/install /u01/app/11.2.0/grid/crs/install/rootcrs.pl execution failed
    can you please guide me on this.
    Thanks & Regards
    Prasanth

    Which version is it exactly? 11.2.0.1? 11.2.0.3?
    It makes a huge difference.
    Also you should consult the logfiles, which are written, to see the root cause for this error. With this you may be able to find out more.
    The root.sh just tells you it could not start. But it does not tell you why (the logfiles however will tell you why).
    Also have you looked at MOS? You will find loads of informations on this.
    This could well be a network setup (e.g. firwall, SE Linux, or even switch problem).
    Regards
    Sebastian

  • Runcluvfy.bat comp ssa - Shared storage check failed

    I've run the cluvfy on Windows 2003 64bits on SAN with 3 nodes and found that it's unsuccessful for the shared storage checking. (whereas it's successful on Windows2003 32 bits.)
    C:\Documents and Settings\Administrator>C:\_Ly1\102010_win64_x64_clusterware\clusterware\cluvfy\runcluvfy.bat comp ssa -n rac1,rac2,rac3
    The system cannot find the file specified.
    Verifying shared storage accessibility
    Checking shared storage accessibility...
    Shared storage check failed on nodes "rac2,rac1,rac3".
    Verification of shared storage accessibility was unsuccessful on all the nodes.
    C:\Documents and Settings\Administrator>
    I'm not sure that it may result in the Clusterware Installation fail or not.
    Here, I captured the failure screen :
    http://alkaspace.com/is.php?i=30223&img=clusterware-fai.jpg
    Please help me out. Thank you!!

    I just ran into this myself while building an enterprise system on Win Server 2003. The answers here did not sit well with me and I needed to be sure of the shared storage prior to proceeding further. Researching Metalink did not uncover any relevant information either. I then opened an SR with Oracle and I did get back a satisfactory response which allowed me to verify my shared storage. The entire text of their solution can be found at http://www.webofwood.com/rac/oracle-response-to-shared-storage-check-failed-on-nodes/. Basically, it is a method of using another utility to identify the storage device names used by Windows and then writing and reading to them from each node to verify each node 'sees' what is written by the other node(s). If this check is successful, you can then proceed.

  • Clusterware 10g: what kicks off 3rd-party failover script?

    I am trying to use Oracle Clusterware 10g (installed on two identical Dell Linux boxes,
    OEL 5.2) to failover a 3rd-party application, specifically websphere MQ. I have a ksh
    script that is supposed to start/stop/restart the application.
    Clusterware will fail over the IP address fine to the other box if I yank the primary box's
    cable, but the app itself doesn't fail over. If I knew what (in Clusterware) did the
    "kicking off" of the ksh script I could troubleshoot it more. I used the instructions in:
    http://www.oracle.com/technology/products/database/clusterware/pdf/TWP-Oracle-Clusterware-3rd-party.pdf
    and I'm pretty sure I did it right.
    Any ideas?

    Here is the action script:
    #!/bin/ksh
    LOG="/san1/var/mqm/config/Controlmq.log"
    echo "script started at `date` from `hostname`" >> $LOG
    ############################### func_stopMQ ######################################
    func_stopMQ () {
    QUEUENAME=$1
    while [[ `ps -ef | grep $QUEUENAME | grep -v grep | grep -v Control| awk {'print $2'} | wc -l` -gt 1 ]]
    do
    echo "DEBUG : `ps -ef | grep $QUEUENAME | grep -v grep | grep -v Control` " >> $LOG
    echo "there are `ps -ef | grep $QUEUENAME | grep -v grep | grep -v Control| awk {'print $2'} | wc -l` processes running associated with $QUEUENAME on `hostname`" >> $LOG
    endmqm $QUEUENAME
    endmqlsr -m $QUEUENAME
    ## echo "sleeping for 10 seconds before checking again"
    sleep 10
    done
    ## echo "All set, there are no processes associated with $QUEUENAME "
    echo "stopped $QUEUENAME at `date` from `hostname`" >> $LOG
    return 0
    ################################ func_startMQ ######################################
    func_startMQ () {
    QUEUENAME=$1
    case $QUEUENAME in
    MECM|MEQM)
    PORT=1414
    MEQA|MEQB)
    PORT=5077
    esac
    ## echo "starting $QUEUENAME"
    strmqm $QUEUENAME
    sleep 5
    ## echo "STARTING listener for $QUEUENAME"
    runmqlsr -t tcp -p $PORT -m $QUEUENAME &
    sleep 5
    runmqsc $QUEUENAME < /san1/var/mqm/config/startCH_$QUEUENAME.DEF
    echo "started $QUEUENAME at `date` from `hostname`" >> $LOG
    return 0
    ################################ func_checkMQ ######################################
    func_checkMQ () {
    QUEUENAME=$1
    PROCESSCOUNT=`ps -ef | grep $QUEUENAME | grep -v grep| grep -v Control| awk {'print $2'} | wc -l`
    if [ $PROCESSCOUNT > 1  ]
    then
    echo "there are $PROCESSCOUNT processes associated with $QUEUENAME" >> $LOG
    echo ":::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::" >> $LOG
    echo "Status of $QUEUENAME : " >> $LOG
    runmqsc $QUEUENAME < /san1/var/mqm/config/ChannelStatus.DEFS
    return 0
    else
    echo "there are $PROCESSCOUNT processes associated with $QUEUENAME" >> $LOG
    echo ":::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::" >> $LOG
    echo "Status of $QUEUENAME : " >> $LOG
    runmqsc $QUEUENAME < /san1/var/mqm/config/ChannelStatus.DEFS
    return 1
    fi
    ACTION=$1
    # QUEUENAME=$2
    case $ACTION in
    start)
    ## func_startMQ MECM
    ## func_startMQ MEQA
    func_startMQ MEQM
    func_startMQ MEQB
    stop)
    ## func_stopMQ MECM
    ## func_stopMQ MEQA
    func_stopMQ MEQM
    func_stopMQ MEQB
    check)
    ## func_checkMQ MECM
    ## func_checkMQ MEQA
    func_checkMQ MEQB
    echo "Sorry, the proper usage for this command is ControlMQ.sh start|stop|check"
    exit
    esac

  • During the installation of grid infra(cluster) for Oracle 11.2 RAC one.

    Good Day All, and thanks in advance…
    During the installation of grid infrastructure(cluster) for Oracle 11.2 RAC One Node on AIX6.1 ( PROD) , ASM used. I am getting below errors when executing ./root.sh
    Upon investigation ,I managed to get note: 1068212.1 from the support oracle site ( see below for details) . I might be hitting Unpublished bug 8670579. I also logged Severity 2 SR with Oracle support to get the bug/patch fix and no one has attended the call.
    This might be configuration issue or otherwise , if you have experienced the same issue please assist ? ( if you need more logfiles please feel free to request)….
    I ran the Cluster Verify Check – all passed.
    Many Thanks
    Ezekiel Filane
    /u01/app/11.2.0/grid#./root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME= /u01/app/11.2.0/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]:
    The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]:
    The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]:
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2010-10-19 10:33:11: Parsing the host name
    2010-10-19 10:33:11: Checking for super user privileges
    2010-10-19 10:33:11: User has super user privileges
    Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
    Creating trace directory
    User grid has the required capabilities to run CSSD in realtime mode
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'system'..
    Operation successful.
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding daemon to inittab
    CRS-4123: Oracle High Availability Services has been started.
    ohasd is starting
    CRS-2672: Attempting to start 'ora.gipcd' on 'csgipm'
    CRS-2672: Attempting to start 'ora.mdnsd' on 'csgipm'
    CRS-2676: Start of 'ora.gipcd' on 'csgipm' succeeded
    CRS-2676: Start of 'ora.mdnsd' on 'csgipm' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'csgipm'
    CRS-2676: Start of 'ora.gpnpd' on 'csgipm' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'csgipm'
    CRS-2676: Start of 'ora.cssdmonitor' on 'csgipm' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'csgipm'
    CRS-2672: Attempting to start 'ora.diskmon' on 'csgipm'
    CRS-2676: Start of 'ora.diskmon' on 'csgipm' succeeded
    CRS-2676: Start of 'ora.cssd' on 'csgipm' succeeded
    CRS-2672: Attempting to start 'ora.ctssd' on 'csgipm'
    Start action for daemon aborted
    CRS-2674: Start of 'ora.ctssd' on 'csgipm' failed
    CRS-2679: Attempting to clean 'ora.ctssd' on 'csgipm'
    CRS-2681: Clean of 'ora.ctssd' on 'csgipm' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    Command return code of 1 (256) from command: /u01/app/11.2.0/grid/bin/crsctl start resource ora.ctssd -init
    Start of resource "ora.ctssd -init" failed
    Clusterware exclusive mode start of resource ora.ctssd failed
    CRS-2500: Cannot stop resource 'ora.crsd' as it is not running
    CRS-4000: Command Stop failed, or completed with errors.
    Command return code of 1 (256) from command: /u01/app/11.2.0/grid/bin/crsctl stop resource ora.crsd -init
    Stop of resource "ora.crsd -init" failed
    Failed to stop CRSD
    CRS-2500: Cannot stop resource 'ora.asm' as it is not running
    CRS-4000: Command Stop failed, or completed with errors.
    Command return code of 1 (256) from command: /u01/app/11.2.0/grid/bin/crsctl stop resource ora.asm -init
    Stop of resource "ora.asm -init" failed
    Failed to stop ASM
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'csgipm'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'csgipm' succeeded
    CRS-2673: Attempting to stop 'ora.cssd' on 'csgipm'
    CRS-2677: Stop of 'ora.cssd' on 'csgipm' succeeded
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'csgipm'
    CRS-2677: Stop of 'ora.gpnpd' on 'csgipm' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'csgipm'
    CRS-2677: Stop of 'ora.gipcd' on 'csgipm' succeeded
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'csgipm'
    CRS-2677: Stop of 'ora.mdnsd' on 'csgipm' succeeded
    Initial cluster configuration failed. See /u01/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_csgipm.log for details
    csgipm:/u01/app/11.2.0/grid#ps -ef | grep pmon
    root 6160492 3932160 0 10:54:13 pts/2 0:00 grep pmon
    more /u01/app/11.2.0/grid/log/csgipm/client/ocrconfig_5767204.log
    csgipm:/usr/sbin#more /u01/app/11.2.0/grid/log/csgipm/client/ocrconfig_5767204.log
    2010-10-19 10:33:14.435: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 4
    2010-10-19 10:33:14.435: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 5
    2010-10-19 10:33:14.435: [  OCRRAW][1]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
    2010-10-19 10:33:14.435: [  OCRRAW][1]proprioini: all disks are not OCR/OLR formatted
    2010-10-19 10:33:14.435: [  OCRRAW][1]proprinit: Could not open raw device
    2010-10-19 10:33:14.442: [ default][1]a_init:7!: Backend init unsuccessful : [26]
    2010-10-19 10:33:14.461: [ OCRCONF][1]Exporting OCR data to [OCRUPGRADEFILE]
    2010-10-19 10:33:14.461: [  OCRAPI][1]a_init:7!: Backend init unsuccessful : [33]
    2010-10-19 10:33:14.461: [ OCRCONF][1]There was no previous version of OCR. error:[PROCL-33: Oracle Local Registry is not configured]
    2010-10-19 10:33:14.461: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 0
    2010-10-19 10:33:14.461: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 1
    2010-10-19 10:33:14.462: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 2
    2010-10-19 10:33:14.462: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 3
    2010-10-19 10:33:14.462: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 4
    2010-10-19 10:33:14.462: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 5
    2010-10-19 10:33:14.462: [  OCRRAW][1]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
    2010-10-19 10:33:14.462: [  OCRRAW][1]proprioini: all disks are not OCR/OLR formatted
    2010-10-19 10:33:14.462: [  OCRRAW][1]proprinit: Could not open raw device
    2010-10-19 10:33:14.462: [ default][1]a_init:7!: Backend init unsuccessful : [26]
    2010-10-19 10:33:14.462: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 0
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 1
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 2
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 3
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 4
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 5
    2010-10-19 10:33:14.463: [  OCRRAW][1]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 0
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 1
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 2
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 3
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 4
    2010-10-19 10:33:14.463: [  OCROSD][1]utread:3: Problem reading buffer 104ef000 buflen 4096 retval 0 phy_offset 102400 retry 5
    2010-10-19 10:33:14.483: [  OCRRAW][1]ibctx: Failed to read the whole bootblock. Assumes invalid format.
    2010-10-19 10:33:14.483: [  OCRRAW][1]proprinit:problem reading the bootblock or superbloc 22
    2010-10-19 10:33:14.483: [  OCROSD][1]utread:3: Problem reading buffer 104fe000 buflen 4096 retval 0 phy_offset 102400 retry 0
    2010-10-19 10:33:14.483: [  OCROSD][1]utread:3: Problem reading buffer 104fe000 buflen 4096 retval 0 phy_offset 102400 retry 1
    2010-10-19 10:33:14.483: [  OCROSD][1]utread:3: Problem reading buffer 104fe000 buflen 4096 retval 0 phy_offset 102400 retry 2
    2010-10-19 10:33:14.484: [  OCROSD][1]utread:3: Problem reading buffer 104fe000 buflen 4096 retval 0 phy_offset 102400 retry 3
    2010-10-19 10:33:14.484: [  OCROSD][1]utread:3: Problem reading buffer 104fe000 buflen 4096 retval 0 phy_offset 102400 retry 4
    2010-10-19 10:33:14.484: [  OCROSD][1]utread:3: Problem reading buffer 104fe000 buflen 4096 retval 0 phy_offset 102400 retry 5
    2010-10-19 10:33:14.484: [  OCRRAW][1]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
    2010-10-19 10:33:14.541: [  OCRAPI][1]a_init:6a: Backend init successful
    2010-10-19 10:33:14.646: [ OCRCONF][1]Initialized DATABASE keys
    2010-10-19 10:33:14.650: [ OCRCONF][1]Exiting [status=success]...

    Hi,
    We are also trying to install 11.2.0.2 Grid infrastructure for Oracle RAC One Node on AIX 6.1. We did a POC in our lab environment and after much struggle got that working. Now we are building 4 clusters in the production environment and the first cluster installation failed while running root.sh on node2. We already have a Sev1 ticket open with Oracle Support but have not heard anything.
    Here is root.sh output from node2. The two node names are p01dou416 and p01dou417.
    CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node p01dou416, number 1, and is terminating
    An active cluster was found during exclusive startup, restarting to join the cluster
    Failed to start Oracle Clusterware stack
    Failed to start Cluster Synchorinisation Service in clustered mode at /u01/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 1020.
    /u01/app/11.2.0/grid/perl/bin/perl -I/u01/app/11.2.0/grid/perl/lib -I/u01/app/11.2.0/grid/crs/install /u01/app/11.2.0/grid/crs/install/rootcrs.pl execution failed
    [root@P01DOU417] /u01/app/11.2.0/grid #
    LOG output: /u01/app/11.2.0/grid/cfgtoollogs/crsconfig/ rootcrs_p01dou417.log
    2010-11-13 17:22:14: Successfully started requested Oracle stack daemons
    2010-11-13 17:22:14: Starting CSS in clustered mode
    2010-11-13 17:22:14: Executing cmd: /u01/app/11.2.0/grid/bin/crsctl start resource ora.cssd -init
    2010-11-13 17:32:28: Command output:
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'p01dou417'
    CRS-2672: Attempting to start 'ora.gipcd' on 'p01dou417'
    CRS-2676: Start of 'ora.cssdmonitor' on 'p01dou417' succeeded
    CRS-2676: Start of 'ora.gipcd' on 'p01dou417' succeeded> CRS-2679: Attempting to clean 'ora.cssd' on 'p01dou417'
    CRS-2681: Clean of 'ora.cssd' on 'p01dou417' succeeded
    CRS-2673: Attempting to stop 'ora.diskmon' on 'p01dou417'
    CRS-2677: Stop of 'ora.diskmon' on 'p01dou417' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'p01dou417'
    CRS-2677: Stop of 'ora.gipcd' on 'p01dou417' succeeded
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'p01dou417'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'p01dou417' succeeded
    CRS-5804: Communication error with agent process
    CRS-4000: Command Start failed, or completed with errors.
    End Command output2010-11-13 17:32:28: Executing cmd: /u01/app/11.2.0/grid/bin/crsctl check css
    2010-11-13 17:32:28: Command output:
    CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
    End Command output2010-11-13 17:32:28: Checking the status of css
    2010-11-13 17:32:33: Executing cmd: /u01/app/11.2.0/grid/bin/crsctl check css
    2010-11-13 17:32:33: Command output:
    CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
    End Command output2010-11-13 17:32:33: Checking the status of css
    2010-11-13 17:32:38: CRS-2672: Attempting to start 'ora.cssdmonitor' on 'p01dou417'
    2010-11-13 17:32:38: CRS-2672: Attempting to start 'ora.gipcd' on 'p01dou417'
    2010-11-13 17:32:38: CRS-2676: Start of 'ora.cssdmonitor' on 'p01dou417' succeeded
    2010-11-13 17:32:38: CRS-2676: Start of 'ora.gipcd' on 'p01dou417' succeeded
    2010-11-13 17:32:38: CRS-2672: Attempting to start 'ora.cssd' on 'p01dou417'
    2010-11-13 17:32:38: CRS-2672: Attempting to start 'ora.diskmon' on 'p01dou417'
    2010-11-13 17:32:38: CRS-2676: Start of 'ora.diskmon' on 'p01dou417' succeeded
    2010-11-13 17:32:38: CRS-2674: Start of 'ora.cssd' on 'p01dou417' failed
    2010-11-13 17:32:38: CRS-2679: Attempting to clean 'ora.cssd' on 'p01dou417'
    2010-11-13 17:32:38: CRS-2681: Clean of 'ora.cssd' on 'p01dou417' succeeded
    2010-11-13 17:32:38: CRS-2673: Attempting to stop 'ora.diskmon' on 'p01dou417'
    2010-11-13 17:32:38: CRS-2677: Stop of 'ora.diskmon' on 'p01dou417' succeeded
    2010-11-13 17:32:38: CRS-2673: Attempting to stop 'ora.gipcd' on 'p01dou417'
    2010-11-13 17:32:38: CRS-2677: Stop of 'ora.gipcd' on 'p01dou417' succeeded
    2010-11-13 17:32:38: CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'p01dou417'
    2010-11-13 17:32:38: CRS-2677: Stop of 'ora.cssdmonitor' on 'p01dou417' succeeded
    2010-11-13 17:32:38: CRS-5804: Communication error with agent process
    2010-11-13 17:32:38: CRS-4000: Command Start failed, or completed with errors.
    2010-11-13 17:32:38: Failed to start Oracle Clusterware stack
    2010-11-13 17:32:38: ###### Begin DIE Stack Trace ######
    2010-11-13 17:32:38: Package File Line Calling
    2010-11-13 17:32:38: --------------- -------------------- ---- ----------
    2010-11-13 17:32:38: 1: main rootcrs.pl 324 crsconfig_lib::dietrap
    2010-11-13 17:32:38: 2: crsconfig_lib crsconfig_lib.pm 1020 main::__ANON__
    2010-11-13 17:32:38: 3: crsconfig_lib crsconfig_lib.pm 997 crsconfig_lib::start_cluster
    2010-11-13 17:32:38: 4: main rootcrs.pl 697 crsconfig_lib::perform_start_cluster
    2010-11-13 17:32:38: ####### End DIE Stack Trace #######
    2010-11-13 17:32:38: 'ROOTCRS_STACK' checkpoint has failed
    Any help on this is appreciated.
    Edited by: user12019257 on Nov 17, 2010 1:26 PM

  • RH Linux VIP configuration not working for Oracle 10g RAC installation

    Hi all,
    I am trying to setup my test cluster on Oracle 10gR2 and Red Hat Linux 4. I have the public and private networks working fine and setup. However, after I setup the two VIP addresses, I cannot even ping these two virtual IPs from Linux. CRS install fails during initial run because it cannot communicate with the two VIP IP addresses. Can anyone help me out as to how to go about fixing the two VIPs so that Linux can ping them and CRS will install?
    Thanks

    It sounds like you configured your VIP on Linux in advance, before installing Oracle.
    You are not supposed to do that.
    Decide on an IP that the VIP will use with your network manager, but don't configure it in Linux. So before you start the clusterware install, ifconfig should not show your VIP.
    CRS does not need VIP when you install the clusterware, only the interconnect address.
    VIP is configured using a utility called VIPCA. If Clusterware installation fails and you think it was caused by VIP issues, try running VIPCA manually and let us know what were the results.

  • ORA-12154: Error when connecting to asm instance

    hi all, I am now facing new problem with asm of clusterware, I failed to connect to asm instance, there is how I did it:
    sqlplus /nologSQL*Plus: Release 11.2.0.1.0 Production on Wed Jul 7 04:58:52 2010
    Copyright (c) 1982, 2010, Oracle. All rights reserved.
    SQL> connect sys@+ASM as sysasm
    Enter password:
    ERROR:
    ORA-12154: TNS:could not resolve the connect identifier specified
    I consider listener is correct configed.
    lsnrctl statusLSNRCTL for 64-bit Windows: Version 11.2.0.1.0 - Production on 07-JUL-2010 08:51:49
    Copyright (c) 1991, 2010, Oracle. All rights reserved.
    Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
    STATUS of the LISTENER
    Alias LISTENER
    Version TNSLSNR for 64-bit Windows: Version 11.2.0.1.0 - Produ
    ction
    Start Date 05-JUL-2010 22:12:29
    Uptime 1 days 6 hr. 39 min. 23 sec
    Trace Level off
    Security ON: Local OS Authentication
    SNMP OFF
    Listener Parameter File E:\app\11.2.0\grid\network\admin\listener.ora
    Listener Log File e:\app\11.2.0\grid\log\diag\tnslsnr\rac1\listener\aler
    t\log.xml
    Listening Endpoints Summary...
    (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=\\.\pipe\LISTENERipc)))
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.0.110)(PORT=1521)))
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.0.112)(PORT=1521)))
    Services Summary...
    Service "+ASM" has 1 instance(s).
    Instance "+asm2", status READY, has 1 handler(s) for this service...
    Service "itpub" has 1 instance(s).
    Instance "itpub2", status READY, has 1 handler(s) for this service...
    Service "itpubXDB" has 1 instance(s).
    Instance "itpub2", status READY, has 1 handler(s) for this service...
    The command completed successfully
    How to resolve the promblem? Best regards..

    thank you for you kind.. I forgot it... but after I modify tnsname.ora, Error number changed..
    tnsname.ora:
    # tnsnames.ora Network Configuration File: E:\oracle\product\11.2.0\dbhome_1\network\admin\tnsnames.ora
    # Generated by Oracle configuration tools.
    ITPUB =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = rac-cluster-scan)(PORT = 1521))
    (CONNECT_DATA =
    (SERVER = DEDICATED)
    (SERVICE_NAME = itpub)
    +ASM =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = rac-cluster-scan)(PORT = 1521))
    (CONNECT_DATA =
    (SERVER = DEDICATED)
    (SERVICE_NAME = +ASM)
    *>sqlplus /nolog*
    SQL*Plus: Release 11.2.0.1.0 Production on Wed Jul 7 12:50:07 2010
    Copyright (c) 1982, 2010, Oracle. All rights reserved.
    SQL> connect sys@+asm as sysasm
    Enter password:
    ERROR:
    ORA-12514: TNS:listener does not currently know of service requested in connect
    descriptor
    SQL>
    tnsping +asmTNS Ping Utility for 64-bit Windows: Version 11.2.0.1.0 - Production on 07-JUL-2
    010 12:51:09
    Copyright (c) 1997, 2010, Oracle. All rights reserved.
    Used parameter files:
    E:\oracle\product\11.2.0\dbhome_1\network\admin\sqlnet.ora
    Used TNSNAMES adapter to resolve the alias
    Attempting to contact (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = rac-clus
    ter-scan)(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = +as
    m)))
    OK (20 msec)

  • Multiple install issues for first time user of 10gRelease2

    Despite doc which said 10g Release 2's certification with Windows XP Professional (> SP 1), clusterware install fails with OUI-1-8001 (Error - needs XP ver 5.0 or 5.2). My XP Prof Ver 5.1.2600 apparrently isn't compatable. Error msg suggests upgrading Service Pack.
    Tried to install Personal Edition, but never saw the oppty to selection it after downloading individual zip files (clinet, gateways, clusterware) into separate folders and then running setup.exe's in each folder. Don't know if I'm running Personal Edition.
    This is my first time attempt to install Oracle dB. Appears that my installation of client and gateways went ok, but I'm not doing something right to start SQLPLUS or my clusterware issue is causing a problem.
    When starting SQLPLUS, entered by username (email), passwd, not sure what to enter for host string. Leaving blank, a timeout occured. Do I need a connect identifier? SQLPLUS hangs if I try to then click File.

    user11971328 wrote:
    Despite doc which said 10g Release 2's certification with Windows XP Professional (> SP 1), clusterware install fails with OUI-1-8001 (Error - needs XP ver 5.0 or 5.2). My XP Prof Ver 5.1.2600 apparrently isn't compatable. Error msg suggests upgrading Service Pack.
    Tried to install Personal Edition, but never saw the oppty to selection it after downloading individual zip files (clinet, gateways, clusterware) into separate folders and then running setup.exe's in each folder. Don't know if I'm running Personal Edition.
    This is my first time attempt to install Oracle dB. Appears that my installation of client and gateways went ok, but I'm not doing something right to start SQLPLUS or my clusterware issue is causing a problem.
    When starting SQLPLUS, entered by username (email), passwd, not sure what to enter for host string. Leaving blank, a timeout occured. Do I need a connect identifier? SQLPLUS hangs if I try to then click File.Am curious - which version of Oracle DB 10gR2 did you download? Did you take 10.2.0.1 or did you grab the 10.2.0.3 for Vista or 10.2.090.4 for Win 2008? The questions sound suspiciously like the latter.
    If you have the right one for WIndows, the Personal Edition selection shows up on the very first screen - you select whether you want Enterprise Edition, Standard Edition (which also includes the SE1 variant) and Personal Edition. No selection implies wrong download.
    Under normal circumstances, you ONLY install the database CD. That gives you pretty much all you need for learning, including the SQLPlus. Then if you want more - such as the sample data, because you deliberately did not include it at database install, or the Apache front end - you get the Companion CD and install it after the fact. The Client CD is used for those computers that do not have the database CD. Gateways are used on the database much later, when you want to connect to DB2 or SQL Server and the like. And the clusterware is when you are really advanced ands want to get a high availability cluster operational.
    Edited by: Hans Forbrich on Oct 4, 2009 8:17 AM
    On rereading your question, it sounds like you installed everything instead of just the database CD. You need ONLY the Database download for learning.

  • High Level Contact With Adobe

    Oops ! See other post.

    Hello,
    If you have access to metalink you should following doc for references and search for RAC frequently asked questions. And you give reasoning why should you use Oracle clusterware and not other vendors.
    What would you recomend to customer, Oracle clusterware or Vendor Clusterware (I.E. MC Service Guard, HACMP, Sun Cluster, Veritas etc.) with Oracle
    Database 10g Real Application Clusters?
    You will be installing and using Oracle Clusterware whether or not you use the Vendor Clusterware. The question you need to ask is whether the Vendor
    Clusterware gives you something that Oracle Clusterware does not. Is the RAC database on the same server as the application server? Are there any other
    processes on the same server as the database that you require Vendor Clusterware to fail over to another server in the cluster if the server it is running
    on fails? IF this is the case, you may want the vendor clusterware, if not, why spend the extra money when Oracle Clusterware supplies everything you need to for the clustered database included with your RAC license. Note: With Oracle Database 10g Release 2, Oracle Clusterware can be used to manage application processes in the cluster (start, stop, check, relocate)
    Doc ID: 175465.1 Step-By-Step Installation of 9i RAC on Sun Cluster v3
    Regards

Maybe you are looking for