CRS-1006 : No more members to consider

I am getting the following error..when I am installaling oracle10g clusterware on RHLinux AS4 VMware...after cluster installation when I am installing VIPCA iam geting error:
CRS-1006 : No more members to consider
CRS-0215: Could not start resource "ora-rac1-vip"
please help me to come out this error...
[root@rac2 bin]# ./crs_stat -t
Name Type Target State Host
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE OFFLINE
ora.rac2.gsd application ONLINE ONLINE rac2
ora.rac2.ons application ONLINE OFFLINE
ora.rac2.vip application ONLINE OFFLINE
[root@rac2 bin]# ./oifcfg iflist -p -n
eth0 192.168.1.0 PRIVATE 255.255.255.0 <--- this is my public but its displaying private...
eth1 192.168.0.0 PRIVATE 255.255.255.0
ora.rac1.vip.log:
2011-05-25 15:27:02.300: [    RACG][3086912256] [12150][3086912256][ora.rac1.vip]: checkIf: Default gateway is not defined (host=rac2)
Interface eth0 checked failed (host=rac2)
Invalid parameters, or failed to bring up VIP (host=rac2)

Hi,
that is a known bug in RAC 10g installation. The Universal Installer defines all private networks (to which 192.168... belongs) as private interconnect.
I'm searching My Oracle Support at the moment to find the document in which the solution is explained. I remember that you have to use oifcfg to correct the settings.
As I remember you have to delete the interface which you want to use as public network and recreate it as public again.
I will update this thread after I have found the document id.
that's it:      
10gR2 RAC Install issues on Oracle EL5 or RHEL5 or SLES10 (VIPCA / SRVCTL / OUI Failures) (Doc ID 414163.1)
Can you please use this steps from this node?
example:
<CRS_HOME>/bin # ./oifcfg setif -global eth0/192.168.1.0:public
<CRS_HOME>/bin # ./oifcfg setif -global eth1/10.10.10.0:cluster_interconnect
<CRS_HOME>/bin # ./oifcfg getif
eth0 192.168.1.0 global public
eth1 10.10.10.0 global cluster_interconnectCheers
Jörg
Edited by: Jörg H. on 29.05.2011 23:00

Similar Messages

  • Which is better - Add a dimension or create more members in an existing

    Which is better - Add a dimension or create more members in an existing dimension?
    We are trying to figure out which can give us better performance in terms of calculations and retrieving reports - to add another dimension (entity/country) or add about 500-800 more members in an existing location/division dimension?
    Thank you!

    If you have BSO cube i would recommend to add in the same dimension where as ASO you can add members in a new dimension. Adding a new dimension is like creating a new cube you have to change each and every single calc scripts,report scripts,FR reports,Webforms and your rule files .... all the dependencies has to be changed manually . I think 500 members in the exsting BSO dimension will not impact the calc or retrieval times that much .

  • Assistance with Error - virtualmachinemanager.psd1 module cannot be imported, one or more members are not valid.

    Hello,
    We use Orchestrator, System Center 2012 version 7.1.3022.0.  I have an orchestrator script that reads through a txt file to find unresponsive virtual machines (Windows 2000 VM's cannot have the SCOM agent installed on them) so we can restart any
    machines that are not responding. 
    The step to Get Computer/IP Status runs successfully in that it reports which VM's are running and which are not running.  The next step then is to run a Powershell script that restart the VM's that are down.  Here is my Powershell Script:
    $ErrorActionPreference = "Stop"
    try
    Import-Module 'C:\Program Files\Microsoft System Center 2012\Virtual Machine Manager\bin\psmodules\virtualmachinemanager'
    Get-VMMServer -ComputerName mlivsmsscvmm
    # get vm object
    $vm = get-SCVirtualMachine | where { $_.ComputerName -eq "\`d.T.~Ed/{A255D4D8-BD4D-4FF4-9A51-B1ABA82720B9}.Computer-name\`d.T.~Ed/" }
    # save data to publish for future activities
    $OrigVMMStatus = $vm.StatusString;
    $AlertAdded = "\`d.T.~Ed/{A4B4EC8A-E4F8-40AB-9897-6906EAE139AE}.TimeAdded\`d.T.~Ed/";
    $VMName = $vm.Name;
    # we are at this point because the VM is not responding.
    # Start VM - if VM status is "Running" then Stop the VM first
    if($vm.StatusString -eq "Running")
    { Stop-SCVirtualMachine -vm $vm -force };
    Start-Sleep -s 20;
    if($vm.StatusString -eq "Stopped")
    { Start-SCVirtualMachine -vm $vm
    $VMrestart = "Yes"
    catch
    Throw $_.Exception
    Upon running the Powershell script I receive the following error in Orchestrator Log histry:
    The 'C:\Program Files\Microsoft System Center 2012\Virtual Machine Manager\bin\psmodules\virtualmachinemanager\virtualmachinemanager.psd1' module cannot be
    imported because its manifest contains one or more members that are not valid.
    This script used to run without errors and nothing has been upgraded in our environment with regards to Orchestrator, VMM, SCOM.  How would I find the 'one or more members' that is causing my issue?
    Thank you.

    Hi,
    the thing is that PowerhShell in the "Run .Net Activity" is version 2.0 (http://www.sc-orchestrator.eu/index.php/scoblog/102-running-powershell-30-with-the-run-net-script-activity)
    So, try your script embedded in PowerShell {}
    Regards,
    Stefan
    www.sc-orchestrator.eu ,
    Blog sc-orchestrator.eu

  • CRS Installation error while running vipca

    i'm trying to configure RAC on my laptop using VMWARE SERVER when vipca is running i get error saying that
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource 'ora.rac1.vip'.
    when i check
    on RAC-1(node-1)
    ./crs_stat -t
    Name Type Target State Host
    ora.rac1.gsd application ONLINE ONLINE rac1
    ora.rac1.ons application ONLINE ONLINE rac1
    ora.rac1.vip application ONLINE OFFLINE
    ora.rac2.gsd application ONLINE ONLINE rac2
    ora.rac2.ons application ONLINE ONLINE rac2
    ora.rac2.vip application ONLINE OFFLINE
    on (RAC-2)NODE-2 ./crs_stat -t
    Name Type Target State Host
    ora.rac1.gsd application ONLINE ONLINE rac1
    ora.rac1.ons application ONLINE ONLINE rac1
    ora.rac1.vip application ONLINE OFFLINE
    ora.rac2.gsd application ONLINE ONLINE rac2
    ora.rac2.ons application ONLINE ONLINE rac2
    ora.rac2.vip application ONLINE OFFLINE
    ./srvctl start nodeapps -n rac1
    rac1:ora.rac1.vip:ping to 192.168.2.1 via eth0 failed, rc = 1 (host=rac1.localdomain)
    rac1:ora.rac1.vip:ping to 192.168.2.1 via eth0 failed, rc = 1 (host=rac1.localdomain)
    rac1:ora.rac1.vip:Interface eth0 checked failed (host=rac1.localdomain)
    rac1:ora.rac1.vip:Invalid parameters, or failed to bring up VIP (host=rac1.localdomain)
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource 'ora.rac1.vip'
    ./srvctl start nodeapps -n rac2
    rac2:ora.rac2.vip:ping to 192.168.2.1 via eth0 failed, rc = 1 (host=rac2.localdomain)
    rac2:ora.rac2.vip:ping to 192.168.2.1 via eth0 failed, rc = 1 (host=rac2.localdomain)
    rac2:ora.rac2.vip:Interface eth0 checked failed (host=rac2.localdomain)
    rac2:ora.rac2.vip:Invalid parameters, or failed to bring up VIP (host=rac2.localdomain)
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource 'ora.rac2.vip'.
    /etc/hosts cofiguration
    127.0.0.1 localhost.localdomain localhost
    # Public
    192.168.2.101 rac1.localdomain rac1
    192.168.2.102 rac2.localdomain rac2
    #Private
    192.168.0.101 rac1-priv.localdomain rac1-priv
    192.168.0.102 rac2-priv.localdomain rac2-priv
    #Virtual
    192.168.2.111 rac1-vip.localdomain rac1-vip
    192.168.2.112 rac2-vip.localdomain rac2-vip
    RAC-1
    eth0
    PUBLIC-IP----*192.168.2.101*
    SUBNETMASK--*255.255.255.0*
    DEFAULT GATEWAY ADDRESS-*192.168.2.1*
    hostname----rac1.localdomain
    eth1
    PRIVATE-IP-----*192.168.0.101*
    SUBNETMASK-*255.255.255.0*
    RAC-2
    eth0
    PUBLIC-IP---*192.168.2.102*
    SUBNETMASK---*255.255.255.0*
    DEFAULTGATEWAYADDRESS--*192.168.2.1*
    hostname----rac2.localdomain
    eth1
    PRIVATE-IP---*192.168.0.102*
    SUBNET MASK----*255.255.255.0*
    Please help me to rectify this issue. do i need to configure anything on virtual network editor in host machine(winXP) in VMWARE SERVER?
    Thanks
    Bala

    RAC-1
    # /sbin/ifconfig
    output
    eth0 Link encap:Ethernet HWaddr 00:0C:29:C1:1D:2D
    inet addr:192.168.2.101 Bcast:192.168.2.255 Mask:255.255.255.0
    inet6 addr: fe80::20c:29ff:fec1:1d2d/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:414 errors:0 dropped:0 overruns:0 frame:0
    TX packets:257 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:64347 (62.8 KiB) TX bytes:18169 (17.7 KiB)
    Interrupt:67 Base address:0x2424
    eth1 Link encap:Ethernet HWaddr 00:0C:29:C1:1D:37
    inet addr:192.168.0.101 Bcast:192.168.0.255 Mask:255.255.255.0
    inet6 addr: fe80::20c:29ff:fec1:1d37/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:13320 errors:0 dropped:0 overruns:0 frame:0
    TX packets:11886 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:6681669 (6.3 MiB) TX bytes:4077970 (3.8 MiB)
    Interrupt:75 Base address:0x24a4
    lo Link encap:Local Loopback
    inet addr:127.0.0.1 Mask:255.0.0.0
    inet6 addr: ::1/128 Scope:Host
    UP LOOPBACK RUNNING MTU:16436 Metric:1
    RX packets:10714 errors:0 dropped:0 overruns:0 frame:0
    TX packets:10714 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:0
    RX bytes:4156195 (3.9 MiB) TX bytes:4156195 (3.9 MiB)
    Rac-2
    eth0 Link encap:Ethernet HWaddr 00:0C:29:7C:CA:FD
    inet addr:192.168.2.102 Bcast:192.168.2.255 Mask:255.255.255.0
    inet6 addr: fe80::20c:29ff:fe7c:cafd/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:514 errors:0 dropped:0 overruns:0 frame:0
    TX packets:108 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:58055 (56.6 KiB) TX bytes:11834 (11.5 KiB)
    Interrupt:67 Base address:0x2424
    eth1 Link encap:Ethernet HWaddr 00:0C:29:7C:CA:07
    inet addr:192.168.0.102 Bcast:192.168.0.255 Mask:255.255.255.0
    inet6 addr: fe80::20c:29ff:fe7c:ca07/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:12593 errors:0 dropped:0 overruns:0 frame:0
    TX packets:13048 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:4166279 (3.9 MiB) TX bytes:6670257 (6.3 MiB)
    Interrupt:75 Base address:0x24a4
    lo Link encap:Local Loopback
    inet addr:127.0.0.1 Mask:255.0.0.0
    inet6 addr: ::1/128 Scope:Host
    UP LOOPBACK RUNNING MTU:16436 Metric:1
    RX packets:13546 errors:0 dropped:0 overruns:0 frame:0
    TX packets:13546 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:0
    RX bytes:8087597 (7.7 MiB) TX bytes:8087597 (7.7 MiB)
    [root@rac1 ~]# ping 192.168.2.1
    PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.
    From 192.168.2.101 icmp_seq=2 Destination Host Unreachable
    From 192.168.2.101 icmp_seq=3 Destination Host Unreachable
    From 192.168.2.101 icmp_seq=4 Destination Host Unreachable
    [root@rac2 ~]# ping 192.168.2.1
    PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.
    From 192.168.2.102 icmp_seq=2 Destination Host Unreachable
    From 192.168.2.102 icmp_seq=3 Destination Host Unreachable
    From 192.168.2.102 icmp_seq=4 Destination Host Unreachable

  • CRS .lsnr file tags

    I have a 10.1.0.3 install of CRS which has my node registered, and an instance of the DB installed. when trying to start the listener, I was getting an error that pointed to needing to register a listener. I created a .lsnr.cap file using something I found, as I can't find any real docs on this. It will register just fine, but when trying to start the listener (srvctl start nodeapps -n oraclelap) it gives the following error...
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource ora.oraclelap.LISTENER_ORACLELAP.lsnr.
    Does anybody know what this is implying, or where some good docs on the .lsnr file syntax can be found?
    Thanks,
    Scott

    It seems to me that you have registered your database with an Invalid value/ flags.
    Can you post the comand you used to do the add.
    Also check your VIP configurations with these Metalink documents
    Note.296878.1 Oracle 10g VIP (Virtual IP) changes in Oracle 10g 10.1.0.4
    Note 298891.1 - Configuring Linux for the Oracle 10g VIP

  • Cluster Installation failure on AIX 6.1

    Hi All,
    One of my customers is facing an issue with the RAC installation.
    The issue is being observed as soon as the setup is done and while running the root.sh which tries to bring up the services configure.
    Post which we are not even able to bring up the same manually or using VIPCA.
    Details:
    A status check on nodeapp is resulting the below.
    ./srvctl status nodeapps -n lpar1
    VIP is not running on node: lpar1
    GSD is running on node: lpar1
    PRKO-2016 : Error in checking condition of listener on node: lpar1
    ONS daemon is running on node: lpar1
    Please let me know any thoughts on the same.
    Thanks in advance for your help
    Thanks & Regards,
    Anoop

    Thanks and that very helpful.
    That error got corrected but he hit a new error.
    This time its this error :
    ./srvctl start nodeapps -n lpar1
    Lpar1:ora.lpar1.vip:Invalid parameters, or failed to bring up VIP (host=lpar1)
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource 'ora.lpar1.vip'.
    My guess was that there is something wrong with the etc/hosts which is causing this vip issue:
    The etc host looks like this:
    127.0.0.1          loopback localhost     # loopback (lo0) name/address
    #255.255.255.128     172.21.197.167
    172.21.197.168     lpar1
    172.21.197.163 SPEAIXP5LP11 SPEAIXP5LP11.ad.infosys.com
    172.21.197.171 speaixp5lp51
    172.21.197.166 speaix550-2 speaix550-2.ad.infosys.com
    172.21.197.143 SPEHPPA2 SPEHPPA2.ad.infosys.com
    172.21.197.170 lpar2 lpar2.ad.infosys.com
    172.21.197.172 speaix5501 speaix5501.ad.infosys.com
    172.21.197.169 speaixp5lp41 speaixp5lp41.ad.infosys.com
    172.21.197.246 spe66hp2 spe66hp2.ad.infosys.com
    172.21.197.148 speaix1
    172.21.197.247 spe76hp1 spe76hp1.ad.infosys.com
    172.21.197.180 spesuns4p1 spesuns4p1.ad.infosys.com
    #Virtual IP Address
    172.21.197.228 lpar1-vip
    172.21.197.229 lpar2-vip
    #Interconnect RAC
    10.2.2.3 lpar2-priv
    10.2.2.2 lpar1-priv
    10.66.119.59 TCCSERVER TCCSERVER.ad.infosys.com
    Any pointers will be very helpful.
    Thanks for your help again.
    Thanks in advance
    Thanks & Regards,
    Anoop

  • Is a gateway mandatory for RAC environment?

    Question:
    Is a gateway mandatory for RAC installation, general on RAC environment?
    *..when yes, why?*
    Many thanks
    I make this test with my only one RAC node
    1. Run with gateway:
    [oracle@linux1 ~]$ crs_stat -t
    Name           Type           Target    State     Host       
    ora....SM1.asm application    ONLINE    ONLINE    linux1     
    ora....X1.lsnr application    ONLINE    ONLINE    linux1     
    ora.linux1.gsd application    ONLINE    ONLINE    linux1     
    ora.linux1.ons application    ONLINE    ONLINE    linux1     
    ora.linux1.vip application    ONLINE    ONLINE    linux1     
    ora.orcl.db    application    ONLINE    ONLINE    linux1     
    ora....l1.inst application    ONLINE    ONLINE    linux1     
    ora....test.cs application    ONLINE    ONLINE    linux1     
    ora....cl1.srv application    ONLINE    ONLINE    linux1
    [oracle@linux1 ~]$ srvctl status database -d orcl
    Instance orcl1 is running on node linux1All thing seem correct!
    2. run without gateway (blank setting):
    [oracle@linux1 ~]$ crs_stat -t
    Name           Type           Target    State     Host       
    ora....SM1.asm application    ONLINE    OFFLINE              
    ora....X1.lsnr application    ONLINE    OFFLINE              
    ora.linux1.gsd application    ONLINE    ONLINE    linux1     
    ora.linux1.ons application    ONLINE    ONLINE    linux1     
    ora.linux1.vip application    ONLINE    OFFLINE              
    ora.orcl.db    application    ONLINE    OFFLINE              
    ora....l1.inst application    ONLINE    OFFLINE              
    ora....test.cs application    ONLINE    OFFLINE              
    ora....cl1.srv application    ONLINE    OFFLINE              
    [oracle@linux1 ~]$ srvctl status database -d orcl
    Instance orcl1 is not running on node linux1Something is false!

    By default, the server's default gateway is used as a ping target during the Oracle RAC 10g VIP status check action.
    Upon a ping failure, Oracle will decide that the current interface where the VIP is running has failed, and will initiate
    an interface / internode VIP failover.
    In above case, we used just one node for CRS installation, so the VIP coudn't failover to other nodes and thus reported additional error like :
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource 'ora.dbtest2.vip'.
    Try ->
    A parameter FAIL_WHEN_DEFAULTGW_NOT_FOUND in the file
    $ORA_CRS_HOME/bin/racvip to address this problem.
    The following steps will fix the VIP starting problem for above mentioned scenario.
    1- stop nodeapps
    2- As root,
    vi the script $ORA_CRS_HOME/bin/racgvip and change the value of
    variable FAIL_WHEN_DEFAULTGW_NOT_FOUND=0 .
    3- start nodeapps and you should see the resources ONLINE
    You may proceed with netca and dbca to create a RAC database after this.

  • Not able to install ASM

    Hi ,
    I have installed RAC on AS-4 platform. cluster and database s/w is installed successfully however when i try to install ASM i am getting an following error.
    PKRS-1009 : failed to start ASM instance.
    CRS-1005: failed to get required resources.
    CRS:0223: node 1 has placement erro.
    could you please help me on this?
    Thanks,

    Hi ,
    I have already install oracle s/w and cluster however when i try to install asm through dbca i am getting a following error.
    i am using ORACLE and ASM home same
    please see the output below.
    [oracle@rac2 bin]$./crs_stat -t
    Name Type Target State Host
    ora...SM1.asm application ONLINE OFFLINE
    ora...C1.lsnr application ONLINE OFFLINE
    ora.rac1.gsd application ONLINE ONLINE rac1
    ora.rac1.ons application ONLINE ONLINE rac1
    ora.rac1.vip application ONLINE OFFLINE
    ora...SM2.asm application ONLINE OFFLINE
    ora...C2.lsnr application ONLINE OFFLINE
    ora.rac2.gsd application ONLINE ONLINE rac2
    ora.rac2.ons application ONLINE ONLINE rac2
    ora.rac2.vip application ONLINE OFFLINE
    you can see from the above o/p that vip is not up.
    when i try to stop and start it up.
    [oracle@rac1 bin ]#./crs_stop -f ora.rac1.vip
    Target set to OFFLINE for 'ora.rac1.LISTENER_RAC1.lsnr'
    Target set to OFFLINE for 'ora.rac1.ASM1.asm'
    Target set to OFFLINE for 'ora.rac11.vip'
    [oracle@rac1 bin ]#./crs_start -f ora.rac1.vip
    Attempting to start 'ora.rac1.vip' on member 'rac1'
    start of 'ora.rac1.vip' on member 'rac1' failed.
    Attempting to start 'ora.rac1.vip' on member on 'rac2'
    start of 'ora.rac1.vip' on member 'rac2' failed.
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource 'ora.rac1.vip'.
    where do i ccheck for alert log?
    could you please help me on this?

  • Oracle instances not starting

    So,
    We tried to bring our Oracle 10g RAC cluster back online on Monday and have been having issues getting the instances to come up. Here's what we've seen so far:
    [oracle@db1-dev bin]$ ./crs_stat -t
    Name Type Target State Host
    ora....SM1.asm application ONLINE ONLINE db1-dev
    ora....EV.lsnr application ONLINE ONLINE db1-dev
    ora....dev.gsd application ONLINE ONLINE db1-dev
    ora....dev.ons application ONLINE ONLINE db1-dev
    ora....dev.vip application ONLINE ONLINE db1-dev
    ora....SM2.asm application ONLINE ONLINE db2-dev
    ora....EV.lsnr application ONLINE ONLINE db2-dev
    ora....dev.gsd application ONLINE ONLINE db2-dev
    ora....dev.ons application ONLINE ONLINE db2-dev
    ora....dev.vip application ONLINE ONLINE db2-dev
    ora.orcl.db application ONLINE OFFLINE
    ora....l1.inst application ONLINE OFFLINE
    ora....l2.inst application ONLINE OFFLINE
    [oracle@db1-dev bin]$./crs_start ora.orcl.orcl1.inst
    Attempting to start `ora.orcl.orcl1.inst` on member `db1-dev`
    Start of `ora.orcl.orcl1.inst` on member `db1-dev` failed.
    db2-dev : CRS-1018: Resource ora.db1-dev.vip (application) is already running on db1-dev
    CRS-0215: Could no start resource 'ora.orcl.orcl1.inst'.
    [oracle@db1-dev bin]$ ./srvctl start instance -d orcl -i orcl1
    PRKP-1001 : Error starting instance orcl1 on node db1-dev
    CRS-0215: Could not start resource 'ora.orcl.orcl1.inst'
    [oracle@db1-dev bin]$ ./crsctl check crs
    CSS appears healthy
    CRS appears healthy
    EVM appears healthy
    [oracle@db1-dev bin]$
    We have two nodes in our RAC cluster (db1-dev and db2-dev). Both nodes run on linux as well. I've also tried using the "srvctl" command to remove and add the instances as well as the database. That has not seemed to change our situation.
    Any help would be greatly apprecited.
    Thanks in advance.

    So,
    I attempted to use SQLPlus to start the instances and I received TNS listener errors:
    [oracle@db1-dev bin]$ sqlplu /nolog
    SQL*Plus: Release 10.2.0.1.0 - Production on Fri Oct 12 09:16:20 2007
    Copyright (c) 1982, 2005, Oracle. All rights reserved.
    SQL> CONNECT SYS as SYSDBA
    Enter Password:
    ERROR:
    ORA-12154: TNS:could not resolve the connect identifier specified
    This is bothersome. Especially since the "tnsnames.ora" file has not changed on this box (and it used to work). Ideas on how to fix this?
    I also looked through your blog and discovered that we don't have the cap files for anything but the listeners... so, I created a file that looks like this:
    NAME=ora.orcl.db
    TYPE=application
    ACTION_SCRIPT=/u01/app/oracle/product/crs/bin/racgwrap
    PLACEMENT=balanced
    CHECK_INTERVAL=600
    FAILOVER_DELAY=0
    FAILURE_INTERVAL=60
    FAILURE_THRESHOLD=1
    AUTO_START=1
    ACTIVE_PLACEMENT=0
    OPTIONAL_RESOURCES=
    REQUIRED_RESOURCES=
    RESTART_ATTEMPTS=1
    SCRIPT_TIMEOUT=600
    STOP_TIMEOUT=0
    HOSTING_MEMBERS=
    UPTIME_THRESHOLD=7d
    USR_ORA_ALERT_NAME=
    USR_ORA_CHECK_TIMEOUT=0
    USR_ORA_CONNECT_STR=/ as sysdba
    USR_ORA_DEBUG=0
    USR_ORA_DISCONNECT=false
    USR_ORA_FLAGS=
    USR_ORA_IF=
    USR_ORA_INST_NOT_SHUTDOWN=
    USR_ORA_LANG=
    USR_ORA_NETMASK=
    USR_ORA_OPEN_MODE=
    USR_ORA_OPI=false
    USR_ORA_PFILE=
    USR_ORA_PRECONNECT=none
    USR_ORA_SRV=
    USR_ORA_START_TIMEOUT=0
    USR_ORA_STOP_MODE=immediate
    USR_ORA_STOP_TIMEOUT=0
    USR_ORA_VIP=
    I then did the following to register it:
    [oracle@db1-dev bin]$ ./crs_unregister ora.orcl.db
    [oracle@db1-dev bin]$ ./crs_profile -validate ora.orcl.db
    [oracle@db1-dev bin]$ ./crs_register ora.orcl.db
    [oracle@db1-dev bin]$ ./crs_start ora.orcl.db
    Attempting to start `ora.orcl.db` on member `db1-dev`
    Start of `ora.orcl.db` on member `db1-dev` failed.
    Attempting to start `ora.orcl.db` on member `db2-dev`
    Start of `ora.orcl.db` on member `db2-dev` failed.
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource 'ora.orcl.db'
    Thanks again for the help.

  • VIP kept going OFFLINE

    I freshly installed Oracle Clusterware and database software 10.2.0.1 and upgraded to 10.2.0.4 patch set 3 for HP-UX on 2 nodes.
    After reboot, the services came up without problem. However, VIP went OFFLINE momentarily. It then came up a few times but kept getting dropped. Eventually it remains offline.
    Initially...
    # ./crs_stat -t
    Name Type Target State Host
    ora.apph6.gsd application ONLINE ONLINE apph6
    ora.apph6.ons application ONLINE ONLINE apph6
    ora.apph6.vip application ONLINE ONLINE siebdb6
    ora....db6.gsd application ONLINE ONLINE siebdb6
    ora....db6.ons application ONLINE ONLINE siebdb6
    ora....db6.vip application ONLINE ONLINE apph6
    # ./crsctl check crs
    CSS appears healthy
    CRS appears healthy
    EVM appears healthy
    Moments later...
    ./crs_stat -t -v
    Name Type R/RA F/FT Target State Host
    ora.apph6.gsd application 0/5 0/0 ONLINE ONLINE apph6
    ora.apph6.ons application 0/3 0/0 ONLINE ONLINE apph6
    ora.apph6.vip application 0/0 0/0 ONLINE OFFLINE
    ora....db6.gsd application 0/5 0/0 ONLINE ONLINE siebdb6
    ora....db6.ons application 0/3 0/0 ONLINE ONLINE siebdb6
    ora....db6.vip application 0/0 0/0 ONLINE OFFLINE
    /oracleRAC/CRS/log/siebdb6/crsd/crsd.log shows:
    2009-03-13 14:23:00.077: [CRSTIMER][58] Timer Thread Starting.
    2009-03-13 14:23:00.078: [  CRSRES][1] Parameter SECURITY = 1, running in USER Mode
    2009-03-13 14:23:00.089: [ CRSMAIN][1] Initializing EVMMgr
    2009-03-13 14:23:00.865: [ CRSMAIN][1] CRSD locked during state recovery, please wait.
    2009-03-13 14:23:00.901: [ CRSMAIN][1] CRSD recovered, unlocked.
    2009-03-13 14:23:00.902: [ CRSMAIN][1] QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2009-03-13 14:23:00.902: [ CRSMAIN][1] QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2009-03-13 14:23:00.918: [ CRSMAIN][1] CRSD UI socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=CRSD_UI_SOCKET))
    2009-03-13 14:23:00.920: [ CRSMAIN][1] E2E socket on: (ADDRESS=(PROTOCOL=tcp)(HOST=siebdb6_priv1)(PORT=49896))
    2009-03-13 14:23:00.921: [ CRSMAIN][1] Starting Threads
    2009-03-13 14:23:00.921: [ CRSMAIN][64] Starting runCommandServer for (UI = 1, E2E = 0). 0
    2009-03-13 14:23:00.921: [ CRSMAIN][65] Starting runCommandServer for (UI = 1, E2E = 0). 1
    2009-03-13 14:23:00.921: [ CRSMAIN][1] CRS Daemon Started.
    2009-03-13 14:23:00.944: [  CRSRES][1] startup = 1
    2009-03-13 14:23:00.957: [  CRSRES][1] startup = 1
    2009-03-13 14:23:01.064: [  CRSRES][68] StopResource: setting CLI values
    2009-03-13 14:23:01.086: [  CRSRES][68] Attempting to stop `ora.siebdb6.vip` on member `apph6`
    2009-03-13 14:23:01.459: [  CRSRES][68] Stop of `ora.siebdb6.vip` on member `apph6` succeeded.
    2009-03-13 14:23:01.465: [  CRSRES][68] startRunnable: setting CLI values
    2009-03-13 14:23:01.465: [  CRSRES][68] Attempting to start `ora.siebdb6.vip` on member `siebdb6`
    2009-03-13 14:23:17.517: [  CRSRES][75] startRunnable: setting CLI values
    2009-03-13 14:23:19.359: [  CRSAPP][68] StartResource error for ora.siebdb6.vip error code = 1
    2009-03-13 14:23:20.485: [  CRSRES][68] Start of `ora.siebdb6.vip` on member `siebdb6` failed.
    2009-03-13 14:23:20.496: [  CRSRES][68] CRS-1006: No more members to consider
    2009-03-13 14:23:20.651: [  CRSRES][68] Attempting to start `ora.siebdb6.vip` on member `apph6`
    2009-03-13 14:23:29.508: [  CRSRES][68] Start of `ora.siebdb6.vip` on member `apph6` succeeded.
    2009-03-13 14:23:29.816: [  CRSRES][82] startRunnable: setting CLI values
    2009-03-13 14:23:29.825: [  CRSRES][82] Attempting to start `ora.siebdb6.gsd` on member `siebdb6`
    2009-03-13 14:23:29.828: [  CRSRES][81] startRunnable: setting CLI values
    2009-03-13 14:23:29.832: [  CRSRES][81] Attempting to start `ora.siebdb6.ons` on member `siebdb6`
    2009-03-13 14:23:31.707: [  CRSRES][81] Start of `ora.siebdb6.ons` on member `siebdb6` succeeded.
    2009-03-13 14:23:35.925: [  CRSRES][82] Start of `ora.siebdb6.gsd` on member `siebdb6` succeeded.
    2009-03-13 14:23:58.863: [  CRSAPP][85] CheckResource error for ora.apph6.vip error code = 1
    2009-03-13 14:23:58.867: [  CRSRES][85] In stateChanged, ora.apph6.vip target is ONLINE
    2009-03-13 14:23:58.867: [  CRSRES][85] ora.apph6.vip on siebdb6 went OFFLINE unexpectedly
    2009-03-13 14:23:58.868: [  CRSRES][85] StopResource: setting CLI values
    2009-03-13 14:23:59.075: [  CRSRES][85] Attempting to stop `ora.apph6.vip` on member `siebdb6`
    2009-03-13 14:23:59.518: [  CRSRES][85] Stop of `ora.apph6.vip` on member `siebdb6` succeeded.
    2009-03-13 14:23:59.518: [  CRSRES][85] ora.apph6.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2009-03-13 14:23:59.528: [  CRSRES][85] ora.apph6.vip failed on siebdb6 relocating.
    2009-03-13 14:23:59.551: [  CRSRES][85] Attempting to start `ora.apph6.vip` on member `apph6`
    2009-03-13 14:24:17.064: [  CRSRES][85] Start of `ora.apph6.vip` on member `apph6` failed.
    2009-03-13 14:25:11.976: [  CRSRES][90] startRunnable: setting CLI values
    2009-03-13 14:25:53.204: [  CRSAPP][93] CheckResource error for ora.siebdb6.vip error code = 1
    2009-03-13 14:25:53.207: [  CRSRES][93] In stateChanged, ora.siebdb6.vip target is ONLINE
    2009-03-13 14:25:53.208: [  CRSRES][93] ora.siebdb6.vip on siebdb6 went OFFLINE unexpectedly
    2009-03-13 14:25:53.208: [  CRSRES][93] StopResource: setting CLI values
    2009-03-13 14:25:53.342: [  CRSRES][93] Attempting to stop `ora.siebdb6.vip` on member `siebdb6`
    2009-03-13 14:25:53.866: [  CRSRES][93] Stop of `ora.siebdb6.vip` on member `siebdb6` succeeded.
    2009-03-13 14:25:53.866: [  CRSRES][93] ora.siebdb6.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2009-03-13 14:25:53.869: [  CRSRES][93] ora.siebdb6.vip failed on siebdb6 relocating.
    2009-03-13 14:25:54.039: [  CRSRES][93] Attempting to start `ora.siebdb6.vip` on member `apph6`
    /oracleRAC/CRS/log/siebdb6/racg/ora.siebdb6.vip.log has repeated messages of:
    2009-03-13 14:23:10.864: [    RACG][1] [5124][1][ora.siebdb6.vip]: Interface lan0 checked failed (host=siebdb6)
    Invalid parameters, or failed to bring up VIP (host=siebdb6)
    2009-03-13 14:23:10.879: [    RACG][1] [5124][1][ora.siebdb6.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracleRAC/CRS
    2009-03-13 14:23:10.879: [    RACG][1] [5124][1][ora.siebdb6.vip]: clsrcexecut: cmd = /oracleRAC/CRS/bin/racgeut -e USRO
    RA_DEBUG=0 54 /oracleRAC/CRS/bin/racgvip start siebdb6
    2009-03-13 14:23:10.879: [    RACG][1] [5124][1][ora.siebdb6.vip]: clsrcexecut: rc = 1, time = 8.597s
    # ./runcluvfy.sh comp nodecon -n apph6,siebdb6 -verbose
    Node connectivity check passed.
    Any ideas and help will be greatly appreciated.

    There is no vip trace log, only the /oracleRAC/CRS/log/siebdb6/racg/ora.siebdb6.vip.log show messages of:
    2009-03-16 11:14:27.098: [    RACG][1] [12417][1][ora.siebdb6.vip]: clsrcexecut: rc = 1, time = 4.400s
    2009-03-16 11:14:27.098: [    RACG][1] [12417][1][ora.siebdb6.vip]: end for resource = ora.siebdb6.vip, action = check, status = 1, time = 4.462s
    2009-03-16 11:19:28.237: [    RACG][1] [14299][1][ora.siebdb6.vip]: Interface lan0 checked failed (host=siebdb6)
    Invalid parameters, or failed to bring up VIP (host=siebdb6)
    ./srvctl start nodeapps -n siebdb6 - gives
    [main] [11:18:46:83] [NodeApps.nodeRunning:369] Finding the status of ora.siebdb6.vip on siebdb6
    [main] [11:18:46:83] [LocalCommand.execute:54] LocalCommand.execute: Calling run method
    [main] [11:18:46:83] [HAStatusOperation.run:124] Executing the HA operation /oracleRAC/CRS/bin/crs_statora.siebdb6.vip
    [main] [11:18:46:83] [HAOperationImpl.runCommand:1223] CRS cmd is: /oracleRAC/CRS/bin/crs_stat -u ora.siebdb6.vip
    [main] [11:18:46:84] [RuntimeExec.runCommand:74] Calling Runtime.exec() with the command
    [main] [11:18:46:84] [RuntimeExec.runCommand:76] /oracleRAC/CRS/bin/crs_stat
    [main] [11:18:46:84] [RuntimeExec.runCommand:76] -u
    [main] [11:18:46:84] [RuntimeExec.runCommand:76] ora.siebdb6.vip
    [main] [11:18:46:86] [RuntimeExec.runCommand:131] runCommand: Waiting for the process
    [Thread-3] [11:18:46:86] [StreamReader.run:61] In StreamReader.run
    [Thread-2] [11:18:46:87] [StreamReader.run:61] In StreamReader.run
    [Thread-2] [11:18:46:177] [StreamReader.run:65] OUTPUT>NAME=ora.siebdb6.vip
    [Thread-2] [11:18:46:178] [StreamReader.run:65] OUTPUT>TYPE=application
    [Thread-2] [11:18:46:179] [StreamReader.run:65] OUTPUT>TARGET=ONLINE
    [Thread-2] [11:18:46:179] [StreamReader.run:65] OUTPUT>STATE=OFFLINE
    [Thread-2] [11:18:46:179] [StreamReader.run:65] OUTPUT>
    [main] [11:18:46:180] [RuntimeExec.runCommand:133] runCommand: process returns 0
    [main] [11:18:46:181] [RuntimeExec.runCommand:147] RunTimeExec: output>
    [main] [11:18:46:181] [RuntimeExec.runCommand:150] NAME=ora.siebdb6.vip
    [main] [11:18:46:181] [RuntimeExec.runCommand:150] TYPE=application
    [main] [11:18:46:181] [RuntimeExec.runCommand:150] TARGET=ONLINE
    [main] [11:18:46:181] [RuntimeExec.runCommand:150] STATE=OFFLINE
    [main] [11:18:46:182] [RuntimeExec.runCommand:150]
    [main] [11:18:46:182] [RuntimeExec.runCommand:155] RunTimeExec: error>
    [main] [11:18:46:182] [RuntimeExec.runCommand:175] Returning from RunTimeExec.runCommand
    [main] [11:18:46:182] [HAOperationImpl.runCommand:1232] signed exit value = 0
    [main] [11:18:46:183] [HAOperationImpl.runCommand:1254] set status OK
    [main] [11:18:46:183] [HAStatusOperation.run:127] Returned from executing the HA Operation
    [main] [11:18:46:183] [HAStatusOperation.run:132] OUTPUT> NAME=ora.siebdb6.vip
    [main] [11:18:46:183] [HAStatusOperation.run:132] OUTPUT> TYPE=application
    [main] [11:18:46:183] [HAStatusOperation.run:132] OUTPUT> TARGET=ONLINE
    [main] [11:18:46:184] [HAStatusOperation.run:132] OUTPUT> STATE=OFFLINE
    [main] [11:18:46:184] [HAStatusOperation.run:132] OUTPUT>
    [main] [11:18:46:184] [HAStatusOperation.run:138] ERROR>
    [main] [11:18:46:184] [LocalCommand.execute:56] LocalCommand.execute: Returned from run method
    [main] [11:18:46:184] [HAResourceStatus.parseHAStatusOutput:293] got status: resource=ora.siebdb6.viptarget=ONLINE status=OFFLINE host=null
    [main] [11:18:46:185] [Operation.<init>:63] Setting to be a synchronized operation
    [main] [11:18:46:185] [HASContext.getInstance:200] Module init : 6
    [main] [11:18:46:185] [HASContext.getInstance:223] Local Module init : 0
    [main] [11:18:46:186] [HASContext.getInstance:258] HAS Context Allocated: 6 to oracle.ops.mgmt.has.Util@6e3d60
    [main] [11:18:46:186] [Util.<init>:88] Util Instance created.
    [main] [11:18:46:186] [has.UtilNative.Native] prsr_trace: Native: getCRSHome
    [main] [11:18:46:186] [has.UtilNative.Native] prsr_trace: Native: getCRSHome crs_home=/oracleRAC/CRS(**)
    [main] [11:18:46:187] [HASContext.getCRSHome:479] /oracleRAC/CRS
    [main] [11:18:46:187] [Util.getCRSHome:488] getCRSHome: ret=/oracleRAC/CRS
    [main] [11:18:46:187] [HAOperation.setCRSHome:148] CRS_HOME: /oracleRAC/CRS
    [main] [11:18:46:187] [HAOperation.checkCommandVerb:211] Checking an existence of CRS command
    [main] [11:18:46:188] [NodeApps.start:420] Starting service for ora.siebdb6.vip on siebdb6
    [main] [11:18:46:188] [LocalCommand.execute:54] LocalCommand.execute: Calling run method
    [main] [11:18:46:188] [HAStartOperation.run:81] Executing the HA operation /oracleRAC/CRS/bin/crs_startora.siebdb6.vip
    [main] [11:18:46:188] [HAOperationImpl.runCommand:1223] CRS cmd is: /oracleRAC/CRS/bin/crs_start ora.siebdb6.vip -f
    [main] [11:18:46:188] [RuntimeExec.runCommand:74] Calling Runtime.exec() with the command
    [main] [11:18:46:189] [RuntimeExec.runCommand:76] /oracleRAC/CRS/bin/crs_start
    [main] [11:18:46:189] [RuntimeExec.runCommand:76] ora.siebdb6.vip
    [main] [11:18:46:189] [RuntimeExec.runCommand:76] -f
    [main] [11:18:46:190] [RuntimeExec.runCommand:131] runCommand: Waiting for the process
    [Thread-4] [11:18:46:195] [StreamReader.run:61] In StreamReader.run
    [Thread-5] [11:18:46:198] [StreamReader.run:61] In StreamReader.run
    [Thread-4] [11:18:46:467] [StreamReader.run:65] OUTPUT>Attempting to start `ora.siebdb6.vip` on member `siebdb6`
    [Thread-4] [11:18:53:676] [StreamReader.run:65] OUTPUT>Start of `ora.siebdb6.vip` on member `siebdb6` succeeded.
    [main] [11:18:53:685] [RuntimeExec.runCommand:133] runCommand: process returns 0
    [main] [11:18:53:685] [RuntimeExec.runCommand:147] RunTimeExec: output>
    [main] [11:18:53:686] [RuntimeExec.runCommand:150] Attempting to start `ora.siebdb6.vip` on member `siebdb6`
    [main] [11:18:53:686] [RuntimeExec.runCommand:150] Start of `ora.siebdb6.vip` on member `siebdb6` succeeded.
    [main] [11:18:53:687] [RuntimeExec.runCommand:155] RunTimeExec: error>
    [main] [11:18:53:687] [RuntimeExec.runCommand:175] Returning from RunTimeExec.runCommand
    [main] [11:18:53:687] [HAOperationImpl.runCommand:1232] signed exit value = 0
    [main] [11:18:53:688] [HAOperationImpl.runCommand:1254] set status OK
    [main] [11:18:53:688] [HAStartOperation.run:84] Returned from executing the HA Operation
    [main] [11:18:53:688] [HAStartOperation.run:89] OUTPUT> Attempting to start `ora.siebdb6.vip` on member `siebdb6`
    [main] [11:18:53:688] [HAStartOperation.run:89] OUTPUT> Start of `ora.siebdb6.vip` on member `siebdb6` succeeded.
    [main] [11:18:53:689] [HAStartOperation.run:95] ERROR>
    [main] [11:18:53:689] [LocalCommand.execute:56] LocalCommand.execute: Returned from run method
    [main] [11:18:53:690] [HASContext.getInstance:200] Module init : 16
    [main] [11:18:53:690] [HASContext.getInstance:223] Local Module init : 0
    [main] [11:18:53:691] [HASContext.getInstance:258] HAS Context Allocated: 7 to oracle.ops.mgmt.has.ClusterUtil@17fa65e
    [main] [11:18:53:691] [ClusterUtil.<init>:55] ClusterUtil Instance created
    [main] [11:18:53:691] [ClusterUtil.<init>:58] ClusterUtil m_bSKGXN=true
    [main] [11:18:53:691] [has.ClusterUtilNative.Native] prsr_trace: Native: getHostName
    [main] [11:18:53:692] [has.ClusterUtilNative.Native] prsr_trace: Native: getHostName:hostname length: 64
    [main] [11:18:53:692] [has.ClusterUtilNative.Native] prsr_trace: Native: getHostName:hostname length: 64
    [main] [11:18:53:693] [has.ClusterUtilNative.Native] prsr_trace: Native: getHostName:hostname: siebdb6
    [main] [11:18:53:693] [GetActiveNodes.getHostName:476] hostname = siebdb6
    [main] [11:18:53:693] [Cluster.getHostName:1022] hostname = siebdb6
    [main] [11:18:53:694] [ONS.<init>:100] ONS resource name is ora.siebdb6.ons
    [main] [11:18:53:694] [NodeApps.<init>:115] in constructor with siebdb6
    [main] [11:18:53:694] [ONS.isRunning:147] Checking the status of ONS resource on node: siebdb6
    [main] [11:18:53:694] [Operation.<init>:63] Setting to be a synchronized operation
    [main] [11:18:53:695] [HASContext.getInstance:200] Module init : 6
    [main] [11:18:53:695] [HASContext.getInstance:223] Local Module init : 0
    [main] [11:18:53:695] [HASContext.getInstance:258] HAS Context Allocated: 8 to oracle.ops.mgmt.has.Util@18385e3
    [main] [11:18:53:695] [Util.<init>:88] Util Instance created.
    [main] [11:18:53:696] [has.UtilNative.Native] prsr_trace: Native: getCRSHome
    ... /oracleRAC/CRS/bin/crs_stat -u ora.siebdb6.ons
    ./crs_stat -t
    Name Type Target State Host
    ora.apph6.gsd application ONLINE ONLINE apph6
    ora.apph6.ons application ONLINE ONLINE apph6
    ora.apph6.vip application ONLINE OFFLINE
    ora....db6.gsd application ONLINE ONLINE siebdb6
    ora....db6.ons application ONLINE ONLINE siebdb6
    ora....db6.vip application ONLINE OFFLINE
    # netstat -in
    Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll
    lan3 1500 192.168.1.0 192.168.1.2 506257 0 258306 0 0
    lan2 1500 156.153.116.0 156.153.117.216 4062077 0 4975348 0 0
    lan1 1500 192.168.0.0 192.168.0.2 1012563 0 753060 0 0
    lan0 1500 100.0.0.0 100.0.0.116 30798 0 29895 0 0
    lo0 32808 127.0.0.0 127.0.0.1 1192633 0 1192633 0 0
    100.0.0.116 is the public IP. VIP is set to 100.0.0.1.
    # grep 100 /etc/hosts
    100.0.0.116 siebdb6 siebdb # current
    100.0.0.86 apph6 # CURRENT
    100.0.0.1 apph6_vip
    100.0.0.2 siebdb6_vip
    At the moment that vip was up:
    netstat -inName Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll
    lan0:1 1500 100.0.0.0 100.0.0.2 0 0 0 0 0
    lan3 1500 192.168.1.0 192.168.1.2 3718 0 7081 0 0
    lan2 1500 156.153.116.0 156.153.117.216 148407 0 87260 0 0
    lan1 1500 192.168.0.0 192.168.0.2 11197 0 11646 0 0
    lan0 1500 100.0.0.0 100.0.0.116 902047 0 2187125 0 0
    lo0 32808 127.0.0.0 127.0.0.1 14551 0 14551 0 0
    What else can I check?
    THANKS.

  • Public Interface not responding after second node is started in the cluster

    Hi
    Has anyone ever experienced the public interface not responding between nodes in the cluster (ping, ssh, scp) after the second nodeapps is started in the cluster?
    This is a new install so all I have installed so far is the base release of CRS 10.2.0. This is on Solaris10. The vipca failed during the installation, however I was able to proceed and manually add the nodeapps using srvctl add nodeaps -n -o -A.
    It seems after the second node is started I loose all connectivity to the public interfaces and to my default gateway.
    Also I'm getting the following messages sometimes after I try and stop the nodeapps and start them back up.
    CRS-1006: No more members to consider
    CRS-0215: Could not start resource 'ora.node1.vip'.
    Any suggestions on where I should start troubleshooting?
    Thanks

    Do you have default GW?
    It can connects with GW, can't it?
    Check metalink
    CRS-0215: Could not start resource 'ora..vip' [ID 356535.1]
    CRS-1006: No more members to consider when starting service [ID 465364.1]
    Good Luck

  • Oracle RAC nodeapp 启动报错-vip:IP:192.168.2.200 is already up in the network

    Linux redhat 5 Oracle RAC 10.2.0.5环境
    启动nodeapp报错如下:
    [oracle@rac1 ~]$ srvctl start nodeapps -n rac1
    CRS-0210: Could not find resource ora.rac1.gsd.
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
    crsd.log部分日志如下:
    2012-11-21 20:10:16.831: [  CRSRES][2717907856]0startRunnable: setting CLI values
    2012-11-21 20:10:16.967: [  CRSRES][2717907856]0Attempting to start `ora.rac1.vip` on member `rac1`
    2012-11-21 20:10:44.246: [  CRSAPP][2717907856]0StartResource error for ora.rac1.vip error code = 1
    2012-11-21 20:10:47.007: [  CRSRES][2717907856]0Start of `ora.rac1.vip` on member `rac1` failed.
    2012-11-21 20:10:47.529: [  CRSRES][2717907856]0Attempting to start `ora.rac1.vip` on member `rac2`
    2012-11-21 20:11:18.649: [  CRSRES][2717907856]0Start of `ora.rac1.vip` on member `rac2` failed.
    2012-11-21 20:11:18.897: [  CRSRES][2717907856]0CRS-1006: No more members to consider
    2012-11-21 20:11:20.986: [  CRSRES][2717907856]0startRunnable: setting CLI values
    2012-11-21 20:11:21.190: [  CRSRES][2717907856]0Attempting to start `ora.rac1.vip` on member `rac1`
    2012-11-21 20:11:48.846: [  CRSAPP][2717907856]0StartResource error for ora.rac1.vip error code = 1
    2012-11-21 20:11:51.203: [  CRSRES][2717907856]0Start of `ora.rac1.vip` on member `rac1` failed.
    2012-11-21 20:11:51.492: [  CRSRES][2717907856]0rac2 : CRS-1019: Resource ora.rac1.LISTENER_RAC1.lsnr (application) cannot run on rac2
    请问如何进一步排查“rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)”问题?感谢

    ping信息:
    [oracle@rac1 ~]$ ping 192.168.2.200
    PING 192.168.2.200 (192.168.2.200) 56(84) bytes of data.
    64 bytes from 192.168.2.200: icmp_seq=1 ttl=64 time=0.043 ms
    64 bytes from 192.168.2.200: icmp_seq=2 ttl=64 time=0.126 ms
    64 bytes from 192.168.2.200: icmp_seq=3 ttl=64 time=0.059 ms
    64 bytes from 192.168.2.200: icmp_seq=4 ttl=64 time=0.158 ms
    64 bytes from 192.168.2.200: icmp_seq=5 ttl=64 time=0.643 ms
    64 bytes from 192.168.2.200: icmp_seq=6 ttl=64 time=0.034 ms
    64 bytes from 192.168.2.200: icmp_seq=7 ttl=64 time=0.046 ms
    64 bytes from 192.168.2.200: icmp_seq=8 ttl=64 time=0.043 ms
    64 bytes from 192.168.2.200: icmp_seq=9 ttl=64 time=0.048 ms
    64 bytes from 192.168.2.200: icmp_seq=10 ttl=64 time=0.031 ms
    telnet信息
    [oracle@rac1 ~]$ telnet 192.168.2.200
    Trying 192.168.2.200...
    Connected to 192.168.2.200.
    Escape character is '^]'.
    Red Hat Enterprise Linux Server release 5 (Tikanga)
    Kernel 2.6.18-8.el5xen on an i686
    login:
    ssh信息:
    [oracle@rac1 ~]$ ssh 192.168.2.200
    Last login: Sun Nov 18 13:37:10 2012 from rac2-vip
    ifconfig -a信息:
    [root@rac1 ~]# ifconfig -a
    eth0 Link encap:Ethernet HWaddr 00:0C:29:B6:CE:6B
    inet addr:192.168.2.100 Bcast:192.168.2.255 Mask:255.255.255.0
    inet6 addr: fe80::20c:29ff:feb6:ce6b/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:142396 errors:0 dropped:0 overruns:0 frame:0
    TX packets:172561 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:41403126 (39.4 MiB) TX bytes:96009307 (91.5 MiB)
    Interrupt:18 Base address:0x1480
    eth1 Link encap:Ethernet HWaddr 00:0C:29:B6:CE:75
    inet addr:192.168.2.200 Bcast:192.168.2.255 Mask:255.255.255.0
    inet6 addr: fe80::20c:29ff:feb6:ce75/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:14082 errors:0 dropped:0 overruns:0 frame:0
    TX packets:29 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:9789756 (9.3 MiB) TX bytes:1434 (1.4 KiB)
    Interrupt:19 Base address:0x1800
    eth2 Link encap:Ethernet HWaddr 00:0C:29:B6:CE:7F
    inet addr:192.168.3.100 Bcast:192.168.3.255 Mask:255.255.255.0
    inet6 addr: fe80::20c:29ff:feb6:ce7f/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:12665 errors:0 dropped:0 overruns:0 frame:0
    TX packets:32728 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:6590271 (6.2 MiB) TX bytes:28437643 (27.1 MiB)
    Interrupt:16 Base address:0x1880
    lo Link encap:Local Loopback
    inet addr:127.0.0.1 Mask:255.0.0.0
    inet6 addr: ::1/128 Scope:Host
    UP LOOPBACK RUNNING MTU:16436 Metric:1
    RX packets:30893 errors:0 dropped:0 overruns:0 frame:0
    TX packets:30893 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:0
    RX bytes:9402131 (8.9 MiB) TX bytes:9402131 (8.9 MiB)
    sit0 Link encap:IPv6-in-IPv4
    NOARP MTU:1480 Metric:1
    RX packets:0 errors:0 dropped:0 overruns:0 frame:0
    TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:0
    RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)

  • Vip not started in newly added node in 10gR2

    Hi
    I'm facing a issue while adding third node in 10gR2 env.
    after pre-requisite check has been success, I run $CRS_HOME/oui/bin/addNode.sh script.
    after GUI based installation , I run all the three script , which has been completed successfully,
    Then I run vipca as root user to configure vip , but it thrown error ,CRS-1006, CRS 1028, crs-0215, crs-0223
    I check status of OCR voting and their permission and status on node 3 , all looks good.
    CRS-1006: No more member to consider CRS-0215: could not start resource 'ora.rac3.vip'
    CRS-1028: dependency analysis failed because of CRS-0223 resource 'ora.rac1.gsd' has placement error.
    CRS-1028: dependency analysis failed because of CRS-0223 resource 'ora.rac2.gsd' has placement error.
    CRS-1028: dependency analysis failed because of CRS-0223 resource 'ora.rac1.ons' has placement error.
    CRS-1028: dependency analysis failed because of CRS-0223 resource 'ora.rac2.ons' has placement error.
    Can u please suggest.....
    Regards
    rajeev....

    [oracle@rac1 cluvfy]$ ./runcluvfy.sh stage -post crsinst -n rac1,rac2,rac3 -verbose
    Performing post-checks for cluster services setup
    Checking node reachability...
    Check: Node reachability from node "rac1"
    Destination Node Reachable?
    rac2 yes
    rac1 yes
    rac3 yes
    Result: Node reachability check passed from node "rac1".
    Checking user equivalence...
    Check: User equivalence for user "oracle"
    Node Name Comment
    rac2 passed
    rac1 passed
    rac3 passed
    Result: User equivalence check passed for user "oracle".
    Checking Cluster manager integrity...
    Checking CSS daemon...
    Node Name Status
    rac2 running
    rac1 running
    rac3 running
    Result: Daemon status check passed for "CSS daemon".
    Cluster manager integrity check passed.
    Checking cluster integrity...
    Node Name
    rac1
    rac2
    rac3
    Cluster integrity check passed
    Checking OCR integrity...
    Checking the absence of a non-clustered configuration...
    All nodes free of non-clustered, local-only configurations.
    Uniqueness check for OCR device passed.
    Checking the version of OCR...
    OCR of correct Version "2" exists.
    Checking data integrity of OCR...
    Data integrity check for OCR passed.
    OCR integrity check passed.
    Checking CRS integrity...
    Checking daemon liveness...
    Check: Liveness for "CRS daemon"
    Node Name Running
    rac2 yes
    rac1 yes
    rac3 yes
    Result: Liveness check passed for "CRS daemon".
    Checking daemon liveness...
    Check: Liveness for "CSS daemon"
    Node Name Running
    rac2 yes
    rac1 yes
    rac3 yes
    Result: Liveness check passed for "CSS daemon".
    Checking daemon liveness...
    Check: Liveness for "EVM daemon"
    Node Name Running
    rac2 yes
    rac1 yes
    rac3 yes
    Result: Liveness check passed for "EVM daemon".
    Liveness of all the daemons
    Node Name CRS daemon CSS daemon EVM daemon
    rac2 yes yes yes
    rac1 yes yes yes
    rac3 yes yes yes
    Checking CRS health...
    Check: Health of CRS
    Node Name CRS OK?
    rac2 yes
    rac1 yes
    rac3 yes
    Result: CRS health check passed.
    CRS integrity check passed.
    Checking node application existence...
    Checking existence of VIP node application
    Node Name Required Status Comment
    rac2 yes exists passed
    rac1 yes exists passed
    rac3 yes exists passed
    Result: Check passed.
    Checking existence of ONS node application
    Node Name Required Status Comment
    rac2 no exists passed
    rac1 no exists passed
    rac3 no exists passed
    Result: Check passed.
    Checking existence of GSD node application
    Node Name Required Status Comment
    rac2 no exists passed
    rac1 no exists passed
    rac3 no exists passed
    Result: Check passed.
    Post-check for cluster services setup was successful.

  • Getting Error in starting VIP in 3 NODE RAC Cluster in VMWARE

    hi
    please can some one help me to have solution for why VIPCA is failing to start VIP on RAC Node 3 it gives the ERROR: CRS-1006; CRS-0215 no more members. Network Configuration is like:
    /etc/hosts
    127.0.0.1 localhost.localdomain localhost
    #Public IP
    192.168.2.131 rac1.sun.com rac1
    192.168.2.132 rac2.sun.com rac2
    192.168.2.133 rac3.sun.com rac3
    #Private IP
    10.10.10.31 rac1-priv rac1-priv
    10.10.10.32 rac2-priv rac2-priv
    10.10.10.33 rac3-priv rac3-priv
    #Virtual IP
    192.168.2.131 rac1-vip.sun.com rac1-vip
    192.168.2.132 rac2-vip.sun.com rac2-vip
    192.168.2.133 rac3-vip.sun.com rac3-vip
    /etc/sysconfig/network
    NETWORKING=yes
    HOSTNAME=rac1.sun.com
    GATEWAY=192.168.2.1
    Thanks in Advance

    you should have to user some other new ips for VIP.
    PLEASE CHANGE THE VIP IP's and try again.
    192.168.2.131 rac1-vip.sun.com rac1-vip
    192.168.2.132 rac2-vip.sun.com rac2-vip
    192.168.2.133 rac3-vip.sun.com rac3-vipchange the ips to some other ip not used by any machines.
    sample /etc/hosts file
    127.0.0.1 localhost.localdomain localhost
    # Public
    10.1.10.201 rac1.localdomain rac1
    10.1.10.202 rac2.localdomain rac2
    #Private
    10.1.9.201 rac1-priv.localdomain rac1-priv
    10.1.9.202 rac2-priv.localdomain rac2-priv
    #Virtual
    *10.1.10.203 rac1-vip.localdomain rac1-vip*
    *10.1.10.204 rac2-vip.localdomain rac2-vip*

  • Failure at final check of Oracle CRS stack.10  on the second node

    Hi,
    I am trying to install Oracle Clusterware 10.2.0.1.0 in VM machines (2 nodes config) in Linux (OEL5) using VMware Server (2.0). Everything went very well one the first node upto running the root.sh. Running root.sh ended with Failure at final check of Oracle CRS stack 10 error.
    RAC1 root.sh output
    [root@rac1 crs]# ./root.sh
    WARNING: directory '/u01/crs/oracle/product/10.2.0' is not owned by root
    WARNING: directory '/u01/crs/oracle/product' is not owned by root
    WARNING: directory '/u01/crs/oracle' is not owned by root
    WARNING: directory '/u01/crs' is not owned by root
    WARNING: directory '/u01' is not owned by root
    Checking to see if Oracle CRS stack is already configured
    /etc/oracle does not exist. Creating it now.
    Setting the permissions on OCR backup directory
    Setting up NS directories
    Oracle Cluster Registry configuration upgraded successfully
    WARNING: directory '/u01/crs/oracle/product/10.2.0' is not owned by root
    WARNING: directory '/u01/crs/oracle/product' is not owned by root
    WARNING: directory '/u01/crs/oracle' is not owned by root
    WARNING: directory '/u01/crs' is not owned by root
    WARNING: directory '/u01' is not owned by root
    assigning default hostname rac1 for node 1.
    assigning default hostname rac2 for node 2.
    Successfully accumulated necessary OCR keys.
    Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
    node <nodenumber>: <nodename> <private interconnect name> <hostname>
    node 1: rac1 rac1-priv rac1
    node 2: rac2 rac2-priv rac2
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    Now formatting voting device: /dev/raw/raw2
    Format of 1 voting devices complete.
    Startup will be queued to init within 90 seconds.
    Adding daemons to inittab
    Expecting the CRS daemons to be up within 600 seconds.
    CSS is active on these nodes.
    rac1
    CSS is inactive on these nodes.
    rac2
    Local node checking complete.
    Run root.sh on remaining nodes to start CRS daemons.
    [root@rac1 crs]#
    RAC2 root.sh output
    [root@rac2 crs]# ./root.sh
    WARNING: directory '/u01/crs/oracle/product/10.2.0' is not owned by root
    WARNING: directory '/u01/crs/oracle/product' is not owned by root
    WARNING: directory '/u01/crs/oracle' is not owned by root
    WARNING: directory '/u01/crs' is not owned by root
    WARNING: directory '/u01' is not owned by root
    Checking to see if Oracle CRS stack is already configured
    /etc/oracle does not exist. Creating it now.
    Setting the permissions on OCR backup directory
    Setting up NS directories
    Oracle Cluster Registry configuration upgraded successfully
    WARNING: directory '/u01/crs/oracle/product/10.2.0' is not owned by root
    WARNING: directory '/u01/crs/oracle/product' is not owned by root
    WARNING: directory '/u01/crs/oracle' is not owned by root
    WARNING: directory '/u01/crs' is not owned by root
    WARNING: directory '/u01' is not owned by root
    assigning default hostname rac1 for node 1.
    assigning default hostname rac2 for node 2.
    Successfully accumulated necessary OCR keys.
    Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
    node <nodenumber>: <nodename> <private interconnect name> <hostname>
    node 1: rac1 rac1-priv rac1
    node 2: rac2 rac2-priv rac2
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    Now formatting voting device: /dev/raw/raw2
    Format of 1 voting devices complete.
    Startup will be queued to init within 90 seconds.
    Adding daemons to inittab
    Expecting the CRS daemons to be up within 600 seconds.
    Failure at final check of Oracle CRS stack.
    10
    [root@rac2 crs]#
    Output of alterrac2.log
    [root@rac2 rac2]# more alertrac2.log
    2009-08-14 23:02:44.699
    [client(5935)]CRS-1006:The OCR location /dev/raw/raw1 is inaccessible. Details in /u01/crs/oracle/product/10.2.
    0/crs/log/rac2/client/ocrconfig_5935.log.
    2009-08-14 23:02:44.704
    [client(5935)]CRS-1006:The OCR location /dev/raw/raw1 is inaccessible. Details in /u01/crs/oracle/product/10.2.
    0/crs/log/rac2/client/ocrconfig_5935.log.
    2009-08-14 23:02:44.707
    [client(5935)]CRS-1006:The OCR location /dev/raw/raw1 is inaccessible. Details in /u01/crs/oracle/product/10.2.
    0/crs/log/rac2/client/ocrconfig_5935.log.
    2009-08-14 23:02:44.864
    [client(5935)]CRS-1001:The OCR was formatted using version 2.
    2009-08-14 23:02:50.339
    [client(6004)]CRS-1801:Cluster crs configured with nodes rac1 rac2 .
    2009-08-14 23:05:07.603
    [cssd(6600)]CRS-1605:CSSD voting file is online: /dev/raw/raw2. Details in /u01/crs/oracle/product/10.2.0/crs/l
    og/rac2/cssd/ocssd.log.
    [root@rac2 rac2]#
    Since raw devices are not supported from OEL5, I did do the workaround in *63-oracle-raw.rules file under /etc/udev/rules.d* dir.
    ACTION=="add", KERNEL=="sdb1", RUN+="/bin/raw /dev/raw/raw1 %N"
    ACTION=="add", KERNEL=="sdc1", RUN+="/bin/raw /dev/raw/raw2 %N"
    ACTION=="add", KERNEL=="sdd1", RUN+="/bin/raw /dev/raw/raw3 %N"
    ACTION=="add", KERNEL=="sde1", RUN+="/bin/raw /dev/raw/raw4 %N"
    ACTION=="add", KERNEL=="sdf1", RUN+="/bin/raw /dev/raw/raw5 %N"
    KERNEL=="raw[1-2]*", OWNER="root", GROUP="oinstall", MODE="640"
    KERNEL=="raw[3-5]*", OWNER="oracle", GROUP="oinstall", MODE="640"
    One thing I have noticed after running root.sh on both the nodes is the permissons on raw devices changed from
    Before root.sh
    [root@rac2 crs]# ls -ls /dev/raw*
    0 crw------- 1 root root 162, 0 Aug 14 22:42 /dev/rawctl
    /dev/raw:
    total 0
    0 crw-r----- 1 root oinstall 162, 1 Aug 14 22:42 raw1
    0 crw-r----- 1 root oinstall 162, 2 Aug 14 22:42 raw2
    0 crw-r----- 1 oracle oinstall 162, 3 Aug 14 22:42 raw3
    0 crw-r----- 1 oracle oinstall 162, 4 Aug 14 22:42 raw4
    0 crw-r----- 1 oracle oinstall 162, 5 Aug 14 22:42 raw5
    to
    [root@rac2 crs]# ls -ls /dev/raw*
    0 crw------- 1 root root 162, 0 Aug 14 22:31 /dev/rawctl
    /dev/raw:
    total 0
    0 crw-r----- 1 root oinstall 162, 1 Aug 14 22:56 raw1
    0 crw-r--r-- 1 oracle oinstall 162, 2 Aug 14 23:01 raw2
    0 crw-r----- 1 oracle oinstall 162, 3 Aug 14 22:31 raw3
    0 crw-r----- 1 oracle oinstall 162, 4 Aug 14 22:31 raw4
    0 crw-r----- 1 oracle oinstall 162, 5 Aug 14 22:31 raw5
    [root@rac1 crs]#
    My shared disk listing
    [root@www shared]# ls -ltr
    total 8780
    -rw------- 1 root root 640 Aug 14 22:43 votingdisk.vmdk
    -rw------- 1 root root 598 Aug 14 22:43 ocr.vmdk
    -rw------- 1 root root 604 Aug 14 22:43 asm3.vmdk
    -rw------- 1 root root 604 Aug 14 22:43 asm2.vmdk
    -rw------- 1 root root 604 Aug 14 22:43 asm1.vmdk
    -rw------- 1 root root 65536 Aug 14 22:44 votingdisk-s006.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 votingdisk-s005.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 votingdisk-s004.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 votingdisk-s003.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 votingdisk-s002.vmdk
    -rw------- 1 root root 393216 Aug 14 22:44 votingdisk-s001.vmdk
    -rw------- 1 root root 65536 Aug 14 22:44 ocr-s006.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 ocr-s005.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 ocr-s004.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 ocr-s003.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 ocr-s002.vmdk
    -rw------- 1 root root 393216 Aug 14 22:44 ocr-s001.vmdk
    -rw------- 1 root root 65536 Aug 14 22:44 asm3-s006.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm3-s005.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm3-s004.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm3-s003.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm3-s002.vmdk
    -rw------- 1 root root 393216 Aug 14 22:44 asm3-s001.vmdk
    -rw------- 1 root root 65536 Aug 14 22:44 asm2-s006.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm2-s005.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm2-s004.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm2-s003.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm2-s002.vmdk
    -rw------- 1 root root 393216 Aug 14 22:44 asm2-s001.vmdk
    -rw------- 1 root root 65536 Aug 14 22:44 asm1-s006.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm1-s005.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm1-s004.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm1-s003.vmdk
    -rw------- 1 root root 327680 Aug 14 22:44 asm1-s002.vmdk
    -rw------- 1 root root 393216 Aug 14 22:44 asm1-s001.vmdk
    [root@www shared]#
    I don't know how to fix this problem. I did go through many docs and metalink notes.
    I am new to RAC world. It took 3 days to come to this stage. Please help me.
    Thanks
    Leo

    Hi Surachart,
    Here is my messages output..
    */var/log/messages*
    Aug 20 14:05:01 rac2 avahi-daemon[3627]: Registering new address record for fe80::20c:29ff:fe6b:f9a8 on eth1.
    Aug 20 14:05:01 rac2 avahi-daemon[3627]: Registering new address record for 192.168.1.196 on eth1.
    Aug 20 14:05:01 rac2 avahi-daemon[3627]: Registering new address record for fe80::20c:29ff:fe6b:f99e on eth0.
    Aug 20 14:05:01 rac2 avahi-daemon[3627]: Registering new address record for 192.168.0.196 on eth0.
    Aug 20 14:05:01 rac2 avahi-daemon[3627]: Registering HINFO record with values 'I686'/'LINUX'.
    Aug 20 14:05:02 rac2 avahi-daemon[3627]: Server startup complete. Host name is rac2.local. Local service cookie is 927471131.
    Aug 20 14:05:03 rac2 avahi-daemon[3627]: Service "SFTP File Transfer on rac2" (/services/sftp-ssh.service) successfully established.
    Aug 20 14:05:08 rac2 smartd[3739]: smartd version 5.38 [i686-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen
    Aug 20 14:05:08 rac2 smartd[3739]: Home page is http://smartmontools.sourceforge.net/
    Aug 20 14:05:08 rac2 smartd[3739]: Opened configuration file /etc/smartd.conf
    Aug 20 14:05:08 rac2 smartd[3739]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/hdc, opened
    Aug 20 14:05:08 rac2 kernel: hdc: drive_cmd: status=0x51 { DriveReady SeekComplete Error }
    Aug 20 14:05:08 rac2 kernel: hdc: drive_cmd: error=0x04 { AbortedCommand }
    Aug 20 14:05:08 rac2 kernel: ide: failed opcode was: 0xec
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/hdc, not ATA, no IDENTIFY DEVICE Structure
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/sda, opened
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/sda, IE (SMART) not enabled, skip device Try 'smartctl -s on /dev/sda' to turn on SMART features
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/sdb, opened
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/sdb, IE (SMART) not enabled, skip device Try 'smartctl -s on /dev/sdb' to turn on SMART features
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/sdc, opened
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/sdc, IE (SMART) not enabled, skip device Try 'smartctl -s on /dev/sdc' to turn on SMART features
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/sdd, opened
    Aug 20 14:05:08 rac2 smartd[3739]: Device: /dev/sdd, IE (SMART) not enabled, skip device Try 'smartctl -s on /dev/sdd' to turn on SMART features
    Aug 20 14:05:09 rac2 smartd[3739]: Device: /dev/sde, opened
    Aug 20 14:05:09 rac2 smartd[3739]: Device: /dev/sde, IE (SMART) not enabled, skip device Try 'smartctl -s on /dev/sde' to turn on SMART features
    Aug 20 14:05:10 rac2 smartd[3739]: Device: /dev/sdf, opened
    Aug 20 14:05:10 rac2 smartd[3739]: Device: /dev/sdf, IE (SMART) not enabled, skip device Try 'smartctl -s on /dev/sdf' to turn on SMART features
    Aug 20 14:05:10 rac2 smartd[3739]: Monitoring 0 ATA and 0 SCSI devices
    Aug 20 14:05:10 rac2 smartd[3741]: smartd has fork()ed into background mode. New PID=3741.
    Aug 20 14:05:13 rac2 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
    Aug 20 14:05:13 rac2 last message repeated 3 times
    Aug 20 14:05:27 rac2 gconfd (root-3967): starting (version 2.14.0), pid 3967 user 'root'
    Aug 20 14:05:27 rac2 gconfd (root-3967): Resolved address "xml:readonly:/etc/gconf/gconf.xml.mandatory" to a read-only configuration source at position 0
    Aug 20 14:05:27 rac2 gconfd (root-3967): Resolved address "xml:readwrite:/root/.gconf" to a writable configuration source at position 1
    Aug 20 14:05:27 rac2 gconfd (root-3967): Resolved address "xml:readonly:/etc/gconf/gconf.xml.defaults" to a read-only configuration source at position 2
    Aug 20 14:05:29 rac2 gconfd (root-3967): Resolved address "xml:readwrite:/root/.gconf" to a writable configuration source at position 0
    Aug 20 14:05:29 rac2 hald: mounted /dev/hdc on behalf of uid 0
    Aug 20 14:05:29 rac2 hcid[3311]: Default passkey agent (:1.8, /org/bluez/applet) registered
    Aug 20 14:05:31 rac2 nm-system-settings: Loaded plugin ifcfg-rh: (c) 2007 - 2008 Red Hat, Inc. To report bugs please use the NetworkManager mailing list.
    Aug 20 14:05:31 rac2 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-eth1 ...
    Aug 20 14:05:31 rac2 nm-system-settings: ifcfg-rh: read connection 'System eth1'
    Aug 20 14:05:31 rac2 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-lo ...
    Aug 20 14:05:31 rac2 nm-system-settings: ifcfg-rh: error: Ignoring loopback device config.
    Aug 20 14:05:31 rac2 nm-system-settings: ifcfg-rh: parsing /etc/sysconfig/network-scripts/ifcfg-eth0 ...
    Aug 20 14:05:31 rac2 nm-system-settings: ifcfg-rh: read connection 'System eth0'
    Aug 20 14:05:31 rac2 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found
    Aug 20 14:05:32 rac2 last message repeated 4 times
    Aug 20 14:12:51 rac2 kernel: FS-Cache: Loaded
    Aug 20 14:22:06 rac2 xinetd[3488]: START: shell pid=5193 from=192.168.0.195
    Aug 20 14:22:06 rac2 xinetd[3488]: EXIT: shell status=0 pid=5193 duration=0(sec)
    Aug 20 14:22:07 rac2 xinetd[3488]: START: shell pid=5217 from=192.168.0.195
    Aug 20 14:22:07 rac2 xinetd[3488]: EXIT: shell status=0 pid=5217 duration=0(sec)
    Aug 20 14:22:07 rac2 xinetd[3488]: START: shell pid=5241 from=192.168.0.195
    Aug 20 14:22:07 rac2 xinetd[3488]: EXIT: shell status=0 pid=5241 duration=0(sec)
    Aug 20 14:22:16 rac2 xinetd[3488]: EXIT: shell status=0 pid=6236 duration=0(sec)
    Aug 20 14:22:16 rac2 xinetd[3488]: START: shell pid=6265 from=192.168.0.195
    Aug 20 14:22:16 rac2 xinetd[3488]: EXIT: shell status=0 pid=6265 duration=0(sec)
    Aug 20 14:22:16 rac2 xinetd[3488]: START: shell pid=6291 from=192.168.0.195
    Aug 20 14:22:17 rac2 xinetd[3488]: EXIT: shell status=0 pid=6291 duration=1(sec)
    Aug 20 14:22:17 rac2 xinetd[3488]: START: shell pid=6317 from=192.168.0.195
    Aug 20 14:22:17 rac2 xinetd[3488]: EXIT: shell status=0 pid=6317 duration=0(sec)
    [root@rac2 log]#

Maybe you are looking for