Oracle Grid root.sh is failing onFirstNode configuration failed at /u01/app/grid/11.2.0.4/crs/instal due to ora.oc4j start timeout

We have a 4 node Rac, oracle root.sh is failing on the First Node. when I looked at the logs I found the oc4j is timeout to start on Node1 whereas it is able to start on all other nodes with in 2 mins. this is causing to fail root.sh. Can you please help me what is the issue.
Oracle Rac Node 1 oc4j failed on Node1 due to timeout able to start on other node.
 oracle:]/u01/app/grid/11.2.0.4/bin > ./crsctl start res ora.oc4j -n node1
CRS-2672: Attempting to start 'ora.oc4j' node1
CRS-2674: Start of 'ora.oc4j' on 'node1' failed
CRS-2679: Attempting to clean 'ora.oc4j' on node1
CRS-2681: Clean of 'ora.oc4j' on 'node1' succeeded
CRS-4000: Command Start failed, or completed with errors.  [oracle:]/u01/app/grid/11.2.0.4/bin > ./crsctl start res ora.oc4j -n node2
CRS-2672: Attempting to start 'ora.oc4j' on 'node2'
CRS-2676: Start of 'ora.oc4j' on 'node2' succeeded

Please follow Metalink Note 1050908.1.
This might help
Cheers
FJFranken

Similar Messages

  • RAC - Oracle Grid Infrastructure configure failed

    Hi, am trying to install 2 node RAC on Oracle VMs. Before the installation during the -preinst check there were few issues which were resolved (ex user equivalence). After that during the installation process of the Grid it failed at step "Configure Oracle Grid Infrastructure for a cluster". After it failed at this step, subsequent steps too failed which I asked OUI to ignore and then I ran both the post installation scripts. And then ran post crsinst which failed. Pasting below the output of the root.sh script, post crsinst and other checks.
    [root@bsfrac01 grid]# sh root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/11.2/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2011-02-13 00:11:55: Parsing the host name
    2011-02-13 00:11:55: Checking for super user privileges
    2011-02-13 00:11:55: User has super user privileges
    Using configuration parameter file: /u01/app/11.2/grid/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding daemon to inittab
    CRS-4123: Oracle High Availability Services has been started.
    ohasd is starting
    CRS-2672: Attempting to start 'ora.gipcd' on 'bsfrac01'
    CRS-2672: Attempting to start 'ora.mdnsd' on 'bsfrac01'
    CRS-2676: Start of 'ora.mdnsd' on 'bsfrac01' succeeded
    CRS-2676: Start of 'ora.gipcd' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'bsfrac01'
    CRS-2676: Start of 'ora.gpnpd' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'bsfrac01'
    CRS-2676: Start of 'ora.cssdmonitor' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'bsfrac01'
    CRS-2672: Attempting to start 'ora.diskmon' on 'bsfrac01'
    CRS-2676: Start of 'ora.diskmon' on 'bsfrac01' succeeded
    CRS-2676: Start of 'ora.cssd' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.ctssd' on 'bsfrac01'
    CRS-2676: Start of 'ora.ctssd' on 'bsfrac01' succeeded
    ASM created and started successfully.
    DiskGroup DATA1 created successfully.
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    CRS-2672: Attempting to start 'ora.crsd' on 'bsfrac01'
    CRS-2676: Start of 'ora.crsd' on 'bsfrac01' succeeded
    CRS-4256: Updating the profile
    Successful addition of voting disk 0ea2052d8a714fd7bf46d9d5c785483e.
    Successfully replaced voting disk group with +DATA1.
    CRS-4256: Updating the profile
    CRS-4266: Voting file(s) successfully replaced
    ## STATE File Universal Id File Name Disk group
    1. ONLINE 0ea2052d8a714fd7bf46d9d5c785483e (ORCL:DISK1) [DATA1]
    Located 1 voting disk(s).
    *Failed to rmtcopy "/tmp/filekRIMbG" to "/u01/app/11.2/grid/gpnp/manifest.txt" for nodes {bsfrac01,bsfrac02}, rc=256*
    *Failed to rmtcopy "/u01/app/11.2/grid/gpnp/bsfrac01/profiles/peer/profile.xml" to "/u01/app/11.2/grid/gpnp/profiles/peer/profile.xml" for nodes {bsfrac01,bsfrac02}, rc=256*
    rmtcopy aborted
    Failed to promote local gpnp setup to other cluster nodes
    CRS-2673: Attempting to stop 'ora.crsd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.crsd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.asm' on 'bsfrac01'
    CRS-2677: Stop of 'ora.asm' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.ctssd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.ctssd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'bsfrac01'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.cssd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.cssd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.gpnpd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.gipcd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.mdnsd' on 'bsfrac01' succeeded
    Initial cluster configuration failed. See /u01/app/11.2/grid/cfgtoollogs/crsconfig/rootcrs_bsfrac01.log for details
    [root@bsfrac01 grid]#
    [oracle@bsfrac01 bin]$ ./cluvfy stage -post crsinst -n bsfrac01,bsfrac02 -verbose
    Performing post-checks for cluster services setup
    Checking node reachability...
    Check: Node reachability from node "bsfrac01"
    Destination Node Reachable?
    bsfrac01 yes
    bsfrac02 yes
    Result: Node reachability check passed from node "bsfrac01"
    Checking user equivalence...
    Check: User equivalence for user "oracle"
    Node Name Comment
    bsfrac01 passed
    bsfrac02 passed
    Result: User equivalence check passed for user "oracle"
    ERROR:
    PRKC-1094 : Failed to retrieve the active version of crs: {0}
    Checking time zone consistency...
    Time zone consistency check passed.
    ERROR:
    PRKC-1093 : Failed to retrieve the version of crs software on node "java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
    " : {1}
    ERROR:
    Cluster manager integrity check failed
    PRVF-5434 : Cannot identify the current CRS software version
    UDev attributes check for OCR locations started...
    Result: UDev attributes check passed for OCR locations
    UDev attributes check for Voting Disk locations started...
    ERROR:
    PRVF-5197 : Failed to retrieve voting disk locationsPRKC-1092 : Failed to retrieve the location of votedisks: java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
    Result: UDev attributes check failed for Voting Disk locations
    Check default user file creation mask
    Node Name Available Required Comment
    bsfrac01 0022 0022 passed
    bsfrac02 0022 0022 passed
    Result: Default user file creation mask check passed
    Checking cluster integrity...
    Node Name
    bsfrac01
    Cluster integrity check failed This check did not run on the following node(s):
    bsfrac02
    Checking OCR integrity...
    Checking the absence of a non-clustered configuration...
    All nodes free of non-clustered, local-only configurations
    ERROR:
    PRKC-1094 : Failed to retrieve the active version of crs: {0}
    ERROR:
    PRVF-5300 : Failed to retrieve active version for CRS on this node
    OCR integrity check failed
    Checking CRS integrity...
    ERROR:
    PRKC-1094 : Failed to retrieve the active version of crs: {0}
    ERROR:
    PRVF-5300 : Failed to retrieve active version for CRS on this node
    CRS integrity check failed
    OCR detected on ASM. Running ACFS Integrity checks...
    Starting check to see if ASM is running on all cluster nodes...
    PRVF-5137 : Failure while checking ASM status on node "bsfrac01"
    PRVF-5137 : Failure while checking ASM status on node "bsfrac02"
    Starting Disk Groups check to see if at least one Disk Group configured...
    PRVF-5112 : An Exception occurred while checking for Disk Groups
    PRVF-5114 : Disk Group check failed. No Disk Groups configured
    Task ACFS Integrity check failed
    Checking Oracle Cluster Voting Disk configuration...
    ERROR:
    PRKC-1093 : Failed to retrieve the version of crs software on node "java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
    " : {1}
    ERROR:
    PRVF-5434 : Cannot identify the current CRS software version
    PRVF-5431 : Oracle Cluster Voting Disk configuration check failed
    Checking to make sure user "oracle" is not in "root" group
    Node Name Status Comment
    bsfrac01 does not exist passed
    bsfrac02 does not exist passed
    Result: User "oracle" is not part of "root" group. Check passed
    Post-check for cluster services setup was unsuccessful on all the nodes.
    [oracle@bsfrac01 bin]$ /u01/app/11.2/grid/bin/ocrcheck
    Status of Oracle Cluster Registry is as follows :
    Version : 3
    Total space (kbytes) : 262120
    Used space (kbytes) : 408
    Available space (kbytes) : 261712
    ID : 1671840043
    Device/File Name : +DATA1
    Device/File integrity check succeeded
    Device/File not configured
    Device/File not configured
    Device/File not configured
    Device/File not configured
    Cluster registry integrity check succeeded
    Logical corruption check bypassed due to non-privileged user
    ASM looks to be up and running..
    [oracle@bsfrac01 bin]$ /usr/sbin/oracleasm listdisks
    DISK1
    DISK2
    DISK3
    DISK4
    DISK5
    DISK6
    [oracle@bsfrac01 bin]$ /usr/sbin/oracleasm status
    Checking if ASM is loaded: yes
    Checking if /dev/oracleasm is mounted: yes
    Please help.

    before installation have u configure the private interconnect on both the nodes to same network adapter..
    for example on node 1 if the private interconnect is on eth0 then on the node 2 it should use eth0 only...
    for private interconnect use the hostonly option on both the nodes in the network configuration page of the vmware or virtual box..
    and for public network it can be bridged
    more over if you are installing on the laptop its good to configure the SSH using the OUI.. rather than doing it manually.. as it saves time
    the private and the public networks should not have same range of ip address. like if public address are like 192.168.2.222/255.255.255.0 and private address have to be different like 10.10.1.2/255.0.0.0 (this is just an example)
    have to configured the NTP.
    any ways try installing the oracle rac on virtual box follow the steps given the below website they are pretty straight forward...
    http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnOEL5UsingVirtualBox.php

  • Problem with installation of Oracle Grid Infrastructure failed on Oracle Linux 6.4 x86_64

    Hello!
    I try install Oracle Grid Infrastructure 11.2.0.1. OS - OEL 6.4 x86_64
    But running script  "/u01/app/oracle/product/11.2.0/grid/root.sh" failed:
    [root@localhost grid]# /u01/app/oracle/product/11.2.0/grid/root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
        ORACLE_OWNER= grid
        ORACLE_HOME=  /u01/app/oracle/product/11.2.0/grid
    Enter the full pathname of the local bin directory: [/usr/local/bin]:
       Copying dbhome to /usr/local/bin ...
       Copying oraenv to /usr/local/bin ...
       Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2013-07-03 01:27:08: Checking for super user privileges
    2013-07-03 01:27:08: User has super user privileges
    2013-07-03 01:27:08: Parsing the host name
    Using configuration parameter file: /u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'grid', privgrp 'oinstall'..
    Operation successful.
    CRS-4664: Node localhost successfully pinned.
    Adding daemon to inittab
    CRS-4124: Oracle High Availability Services startup failed.
    CRS-4000: Command Start failed, or completed with errors.
    ohasd failed to start: Inappropriate ioctl for device
    ohasd failed to start: Inappropriate ioctl for device at /u01/app/oracle/product/11.2.0/grid/crs/install/roothas.pl line 296.
    /u01/app/oracle/product/11.2.0/grid/cfgtoollogs/crsconfig/roothas.log:
    2013-07-03 01:27:08: The configuration parameter file /u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params is valid
    2013-07-03 01:27:08: Checking for super user privileges
    2013-07-03 01:27:08: User has super user privileges
    2013-07-03 01:27:08: ### Printing the configuration values from files:
    2013-07-03 01:27:08:    /u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params
    2013-07-03 01:27:08:    /u01/app/oracle/product/11.2.0/grid/crs/install/s_crsconfig_defs
    2013-07-03 01:27:08: ASM_DISCOVERY_STRING=
    2013-07-03 01:27:08: ASM_DISKS=ORCL:ASMDATA01,ORCL:ASMDATA02,ORCL:ASMDATA03,ORCL:ASMDATA04
    2013-07-03 01:27:08: ASM_DISK_GROUP=DATA
    2013-07-03 01:27:08: ASM_REDUNDANCY=NORMAL
    2013-07-03 01:27:08: ASM_SPFILE=
    2013-07-03 01:27:08: ASM_UPGRADE=false
    2013-07-03 01:27:08: CLSCFG_MISSCOUNT=
    2013-07-03 01:27:08: CLUSTER_GUID=
    2013-07-03 01:27:08: CLUSTER_NAME=
    2013-07-03 01:27:08: CRS_NODEVIPS=
    2013-07-03 01:27:08: CRS_STORAGE_OPTION=0
    2013-07-03 01:27:08: CSS_LEASEDURATION=400
    2013-07-03 01:27:08: DIRPREFIX=
    2013-07-03 01:27:08: DISABLE_OPROCD=0
    2013-07-03 01:27:08: EMBASEJAR_NAME=oemlt.jar
    2013-07-03 01:27:08: EWTJAR_NAME=ewt3.jar
    2013-07-03 01:27:08: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
    2013-07-03 01:27:08: GNS_ADDR_LIST=
    2013-07-03 01:27:08: GNS_ALLOW_NET_LIST=
    2013-07-03 01:27:08: GNS_CONF=false
    2013-07-03 01:27:08: GNS_DENY_ITF_LIST=
    2013-07-03 01:27:08: GNS_DENY_NET_LIST=
    2013-07-03 01:27:08: GNS_DOMAIN_LIST=
    2013-07-03 01:27:08: GPNPCONFIGDIR=/u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:08: GPNPGCONFIGDIR=/u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:08: GPNP_PA=
    2013-07-03 01:27:08: HELPJAR_NAME=help4.jar
    2013-07-03 01:27:08: HOST_NAME_LIST=
    2013-07-03 01:27:08: ID=/etc/init.d
    2013-07-03 01:27:08: INIT=/sbin/init
    2013-07-03 01:27:08: IT=/etc/inittab
    2013-07-03 01:27:08: JEWTJAR_NAME=jewt4.jar
    2013-07-03 01:27:08: JLIBDIR=/u01/app/oracle/product/11.2.0/grid/jlib
    2013-07-03 01:27:08: JREDIR=/u01/app/oracle/product/11.2.0/grid/jdk/jre/
    2013-07-03 01:27:08: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
    2013-07-03 01:27:08: MSGFILE=/var/adm/messages
    2013-07-03 01:27:08: NETCFGJAR_NAME=netcfg.jar
    2013-07-03 01:27:08: NETWORKS=
    2013-07-03 01:27:08: NEW_HOST_NAME_LIST=
    2013-07-03 01:27:08: NEW_NODEVIPS=
    2013-07-03 01:27:08: NEW_NODE_NAME_LIST=
    2013-07-03 01:27:08: NEW_PRIVATE_NAME_LIST=
    2013-07-03 01:27:08: NODELIST=
    2013-07-03 01:27:08: NODE_NAME_LIST=
    2013-07-03 01:27:08: OCFS_CONFIG=
    2013-07-03 01:27:08: OCRCONFIG=/etc/oracle/ocr.loc
    2013-07-03 01:27:08: OCRCONFIGDIR=/etc/oracle
    2013-07-03 01:27:08: OCRID=
    2013-07-03 01:27:08: OCRLOC=ocr.loc
    2013-07-03 01:27:08: OCR_LOCATIONS=
    2013-07-03 01:27:08: OLASTGASPDIR=/etc/oracle/lastgasp
    2013-07-03 01:27:08: OLRCONFIG=/etc/oracle/olr.loc
    2013-07-03 01:27:08: OLRCONFIGDIR=/etc/oracle
    2013-07-03 01:27:08: OLRLOC=olr.loc
    2013-07-03 01:27:08: OPROCDCHECKDIR=/etc/oracle/oprocd/check
    2013-07-03 01:27:08: OPROCDDIR=/etc/oracle/oprocd
    2013-07-03 01:27:08: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
    2013-07-03 01:27:08: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
    2013-07-03 01:27:08: ORACLE_BASE=/u01/app/oracle
    2013-07-03 01:27:08: ORACLE_HOME=/u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:08: ORACLE_OWNER=grid
    2013-07-03 01:27:08: ORA_ASM_GROUP=asmadmin
    2013-07-03 01:27:08: ORA_DBA_GROUP=oinstall
    2013-07-03 01:27:08: PRIVATE_NAME_LIST=
    2013-07-03 01:27:08: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
    2013-07-03 01:27:08: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d
    2013-07-03 01:27:08: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
    2013-07-03 01:27:08: RC_KILL=K19
    2013-07-03 01:27:08: RC_KILL_OLD=K96
    2013-07-03 01:27:08: RC_START=S96
    2013-07-03 01:27:08: SCAN_NAME=
    2013-07-03 01:27:08: SCAN_PORT=0
    2013-07-03 01:27:08: SCRBASE=/etc/oracle/scls_scr
    2013-07-03 01:27:08: SHAREJAR_NAME=share.jar
    2013-07-03 01:27:08: SILENT=false
    2013-07-03 01:27:08: SO_EXT=so
    2013-07-03 01:27:08: SRVCFGLOC=srvConfig.loc
    2013-07-03 01:27:08: SRVCONFIG=/var/opt/oracle/srvConfig.loc
    2013-07-03 01:27:08: SRVCONFIGDIR=/var/opt/oracle
    2013-07-03 01:27:08: VNDR_CLUSTER=false
    2013-07-03 01:27:08: VOTING_DISKS=
    2013-07-03 01:27:08: ### Printing other configuration values ###
    2013-07-03 01:27:08: CLSCFG_EXTRA_PARMS=
    2013-07-03 01:27:08: CRSDelete=0
    2013-07-03 01:27:08: HAPatch=0
    2013-07-03 01:27:08: HAS_GROUP=oinstall
    2013-07-03 01:27:08: HAS_USER=grid
    2013-07-03 01:27:08: HOST=localhost
    2013-07-03 01:27:08: IS_SIHA=1
    2013-07-03 01:27:08: OLR_DIRECTORY=/u01/app/oracle/product/11.2.0/grid/cdata/localhost
    2013-07-03 01:27:08: OLR_LOCATION=/u01/app/oracle/product/11.2.0/grid/cdata/localhost/localhost.olr
    2013-07-03 01:27:08: ORA_CRS_HOME=/u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:08: SUPERUSER=root
    2013-07-03 01:27:08: UPGRADE=
    2013-07-03 01:27:08: crscfg_trace=1
    2013-07-03 01:27:08: crscfg_trace_file=/u01/app/oracle/product/11.2.0/grid/cfgtoollogs/crsconfig/roothas.log
    2013-07-03 01:27:08: hahome=
    2013-07-03 01:27:08: hosts=
    2013-07-03 01:27:08: osdfile=/u01/app/oracle/product/11.2.0/grid/crs/install/s_crsconfig_defs
    2013-07-03 01:27:08: parameters_valid=1
    2013-07-03 01:27:08: paramfile=/u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params
    2013-07-03 01:27:08: platform_family=unix
    2013-07-03 01:27:08: srvctl_trc_suff=0
    2013-07-03 01:27:08: user_is_superuser=1
    2013-07-03 01:27:08: ### Printing of configuration values complete ###
    2013-07-03 01:27:08: Oracle CRS stack is not configured yet
    2013-07-03 01:27:08: CRS is not yet configured. Hence, will proceed to configure CRS
    2013-07-03 01:27:10: OLR location = /u01/app/oracle/product/11.2.0/grid/cdata/localhost/localhost.olr
    2013-07-03 01:27:10: Oracle CRS Home = /u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:10: Validating /etc/oracle/olr.loc file for OLR location /u01/app/oracle/product/11.2.0/grid/cdata/localhost/localhost.olr
    2013-07-03 01:27:10: /etc/oracle/olr.loc already exists. Backing up /etc/oracle/olr.loc to /etc/oracle/olr.loc.orig
    2013-07-03 01:27:10: Opening file OCRCONFIG
    2013-07-03 01:27:10: Opening file OCRCONFIG
    2013-07-03 01:27:10: create Local Only OCR...
    2013-07-03 01:27:10: create Local Only OCR on Linux...
    2013-07-03 01:27:10: OCR locations = /u01/app/oracle/product/11.2.0/grid/cdata/localhost/local.ocr
    2013-07-03 01:27:10: Validating OCR locations in /etc/oracle/ocr.loc
    2013-07-03 01:27:10: Checking for existence of /etc/oracle/ocr.loc
    2013-07-03 01:27:10: Backing up /etc/oracle/ocr.loc to /etc/oracle/ocr.loc.orig
    2013-07-03 01:27:10: Setting ocr location /u01/app/oracle/product/11.2.0/grid/cdata/localhost/local.ocr
    2013-07-03 01:27:10: Creating or upgrading Oracle Local Registry (OLR)
    2013-07-03 01:27:10: Running as user grid: /u01/app/oracle/product/11.2.0/grid/bin/ocrconfig -local -upgrade
    2013-07-03 01:27:10:   Invoking "/u01/app/oracle/product/11.2.0/grid/bin/ocrconfig -local -upgrade" as user "grid"
    2013-07-03 01:27:11: OLR successfully created or upgraded
    2013-07-03 01:27:11: /u01/app/oracle/product/11.2.0/grid/bin/clscfg -localadd
    2013-07-03 01:27:11: Running as user grid: /u01/app/oracle/product/11.2.0/grid/bin/clscfg -localadd
    2013-07-03 01:27:11:   Invoking "/u01/app/oracle/product/11.2.0/grid/bin/clscfg -localadd" as user "grid"
    2013-07-03 01:27:11: Keys created in the OLR successfully
    2013-07-03 01:27:12: Creating local-only OCR (/u01/app/oracle/product/11.2.0/grid/bin/crsctl pin css -n localhost) ... succeeded
    2013-07-03 01:27:12: Registering ohasd
    2013-07-03 01:27:12: init file = /u01/app/oracle/product/11.2.0/grid/crs/init/init.ohasd
    2013-07-03 01:27:12: Copying file /u01/app/oracle/product/11.2.0/grid/crs/init/init.ohasd to /etc/init.d directory
    2013-07-03 01:27:12: Setting init.ohasd permission in /etc/init.d directory
    2013-07-03 01:27:12: init file = /u01/app/oracle/product/11.2.0/grid/crs/init/ohasd
    2013-07-03 01:27:12: Copying file /u01/app/oracle/product/11.2.0/grid/crs/init/ohasd to /etc/init.d directory
    2013-07-03 01:27:12: Setting ohasd permission in /etc/init.d directory
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc3.d/S96ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc3.d/S96ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc3.d/S96ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc3.d/S96ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc5.d/S96ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc5.d/S96ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc5.d/S96ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc5.d/S96ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc0.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc0.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc0.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc0.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc1.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc1.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc1.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc1.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc2.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc2.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc2.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc2.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc4.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc4.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc4.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc4.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc6.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc6.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc6.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc6.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: The file ohasd has been successfully linked to the RC directories
    2013-07-03 01:27:12: Starting ohasd
    2013-07-03 01:27:12: itab entries=
    2013-07-03 01:27:18: Created backup /etc/inittab.no_crs
    2013-07-03 01:27:18: Appending to /etc/inittab.tmp:
    2013-07-03 01:27:18: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null
    2013-07-03 01:27:18: Done updating /etc/inittab.tmp
    2013-07-03 01:27:18: Saved /etc/inittab.crs
    2013-07-03 01:27:18: Installed new /etc/inittab
    2013-07-03 01:29:18: ohasd failed to start: Inappropriate ioctl for device
    2013-07-03 01:29:18: ###### Begin DIE Stack Trace ######
    2013-07-03 01:29:18:     Package         File                 Line Calling 
    2013-07-03 01:29:18:     --------------- -------------------- ---- ----------
    2013-07-03 01:29:18:  1: main            roothas.pl            166 crsconfig_lib::dietrap
    2013-07-03 01:29:18:  2: main            roothas.pl            296 main::__ANON__
    2013-07-03 01:29:18: ####### End DIE Stack Trace #######
    selinux and firewall is disabled.

    Hi,
    Refer the below metalink note :- OHASD Failed to Start: Inappropriate ioctl for device [ID 1069182.1]
    Thanks

  • Oracle Grid Infrastructure 11.2.0.2 root.sh hangs in the second node

    Hi,
    I am installing Oracle Grid Infrastructure 11.2.0.2.0 using VM's. Both the virtual machines are running RHEL 5.7 32 bit version.
    Until the point where the installation suggests to run two scripts as root user, everything runs fine.
    root.sh runs successfully on the first node.
    On the second node it hangs at,
    Now product-specific root actions will be performed.
    Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params

    user10193468 wrote:
    Hi,
    Following is the last few lines of the $GRID_HOME/cfgtoollogs/crsconfig/rootcrs_<node>.log file
    2012-03-19 17:20:17: OLR successfully created or upgraded
    2012-03-19 17:20:17: /u01/app/11.2.0/grid/bin/clscfg -localadd
    2012-03-19 17:20:17: Executing /u01/app/11.2.0/grid/bin/clscfg -localadd
    2012-03-19 17:20:17: Executing cmd: /u01/app/11.2.0/grid/bin/clscfg -localadd
    I am using ASM for OCR and Voting Disks.
    Private network is up and running.Please let me know what have you set in asm_diskstring parameter?
    I have find following note from metalink which says that you should not set asm_diskstring to '/dev/' or '/dev/*'. This is not supported
    root.sh Hangs or Reboots Node on Non First Node if ASM Discovery String asm_diskstring is Set to /dev/ or /dev/* [ID 1356567.1]

  • Root.sh script failed

    Hi all,
    I am trying to install Oracle 11g R2 RAC on HP UX 11.3, As part of that installed Grid software. while executing roo.sh script on node 1 getting the following error.
    # ./root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/11.2.0/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    chmod: can't change /u01/app/11.2.0/grid/bin/extjob: Not owner
    chmod: can't change /u01/app/11.2.0/grid/rdbms/admin/externaljob.ora: Not owner
    chmod: can't change /u01/app/11.2.0/grid/bin/jssu: Not owner
    2010-11-02 00:52:38: Parsing the host name
    2010-11-02 00:52:38: Checking for super user privileges
    2010-11-02 00:52:38: User has super user privileges
    Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_p arams
    Creating trace directory
    Can't set permissions on /u01/app/11.2.0/grid/log/lodii017m: Not owner at /u01/a pp/11.2.0/grid/crs/install/crsconfig_lib.pm line 5030.
    Please help. I couldnt able to procede further from this step.
    Thanks,

    Hi rajesh, thanks for the information, it seems my problem is with the permissions. But i have followed the steps which are refered in the installation document.
    Here are the steps which i have done.
    Created the shared folders for grid, oracle_home, shared_config and oradata using root user.
    mkdir /u01/app/11.2.0/grid
    mkdir /u01/app/oracle/product/11.2.0/db_1
    mkdir /u01/oradata
    mkdir /u01/shared_config
    chown -R oracle:oinstall /u01/shared_config
    chown -R oracle:oinstall /u01/app/11.2.0/grid
    chown -R oracle:oinstall /u01/app/oracle/product/11.2.0/db_1
    chown -R oracle:oinstall /u01/oradata
    chmod -R 775 /u01/app /u01/app/oracle /u01/oradata /u01/shared_config
    After executing root.sh on node 1 i have faced the problem.
    Please correct me if i am doing any thing wrong

  • Cant not run root.sh u01/app/oracle/product/10.2.0/crs/install/rootinstall:

    Hello,
    Production machine hardware was failed which caused to reinstall the clusterware after following deinstall steps of metalink doc., but facing problems like "error invoking ntcontab.o" and error in invoking target nnfgt.o and error in invoking target client_sharedlib"
    these errors are raising at reinstall time of clusterware, if I am ignoring installation is going on but finally its showing only root.sh and not not showing the message to execute root102.sh, and even if I am trying to execute root.sh then below is the permission error
    /u01/app/oracle/product/10.2.0/crs/root.sh: line 2: /u01/app/oracle/product/10.2.0/crs/install/rootinstall: Permission denied
    even after that I changed the file permission its further stuck at error can not open libcltsh.so.10.1 file size is too short.
    Does any one have any ides about it, I have raised SR at severity 1 as it is production server but no Reply yet.
    Regards,
    Farrukh Salman,

    Hello,
    Thanks to reply, I have installed RAC 10g R2last month have to redo it coz of SAN connectivity driver failure and cross checked all the required RPMs again its all ok mean time I got a reply by metalink support as under
    As per bug
    Bug 4113186
    Looking at script /oracle/CRSHome/bin/ocrconfig, looks the installer didn't
    create the script properly as ORA_CRS_HOME is left null as below:
    ORA_CRS_HOME=
    ORACLE_HOME=/oracle/CRSHome
    Hence changing ORA_CRS_HOME to point to /oracle/CRSHome resolves this.
    Can you please help me out to understand these lines.
    Regards,

  • Error while installing OIM, during the OC4J Instance Configuration Assistan

    Hi, running RHEL 4 32Bit Linux. There's an installation of the SOA Suite 10.1.3.1 (Release 2) on /u01/app/oracle/OracleAS_1, and I am installing OIM on /u01/app/oracle/OraHome_2
    Near the end of the installation, when it's installing the recommended configuration assistants, I get an error while the OC4J Instance Configuration Assistant piece is running.
    Here's the full readout:
    Launched configuration assistant 'OC4J Instance Configuration Assistant'
    Tool type is: Recommended.
    The command being spawned is: '/u01/app/oracle/OraHome_2/jdk/bin/java -Djava.net.preferIPv4Stack=true -Djava.io.tmpdir=/tmp -mx512M -classpath /u01/app/oracle/OraHome_2/dcm/lib/dcm.jar:/u01/app/oracle/OraHome_2/dcm/lib/oc4j_deploy_tools.jar:/u01/app/oracle/OraHome_2/opmn/lib/opmnplugin.jar -Doracle.ias.sysmgmt.logging.logdir=/u01/app/oracle/OraHome_2/j2ee/home/log oracle.j2ee.tools.deploy.Oc4jDeploy -oraclehome /u01/app/oracle/OraHome_2 -verbose -inifile /u01/app/oracle/OraHome_2/j2ee/deploy.ini '
    Start output from spawned process:
    Reading ini file - '/u01/app/oracle/OraHome_2/j2ee/deploy.ini'
    Adding web-app 'wirelesssso-web.war' for app 'wirelesssso'.
    Adding web-app 'web.war' for app 'sso'.
    Adding web-app 'ssohelp.war' for app 'sso'.
    Adding web-app 'pls.war' for app 'sso'.
    OC4J instance 'OC4J_SECURITY': Adding java stop command line option '-server'
    OC4J instance 'OC4J_SECURITY': Adding java command line option '-Xmx512m'
    OC4J instance 'OC4J_SECURITY': Adding Environment variable 'LD_LIBRARY_PATH' with value '/u01/app/oracle/OraHome_2/lib32:/u01/app/oracle/OraHome_2/lib'
    OC4J instance 'OC4J_SECURITY': Adding Environment variable 'DISPLAY' with value 'oracleb.djl.com:0.0'
    Adding web-app 'ui.war' for app 'oiddas'.
    OC4J instance 'OC4J_SECURITY': Adding java stop command line option '-Xss1M'
    Ignoring jvm command-line option '-Xmx512m'. Larger heap already specified with '-Xmx512m'
    OC4J instance 'OC4J_SECURITY': Env Option 'LD_LIBRARY_PATH' already exists with value '/u01/app/oracle/OraHome_2/lib32:/u01/app/oracle/OraHome_2/lib'
    Initializing DCM...done.
    Creating OC4J instance 'OC4J_SECURITY' (protected)...done.
    Adding dependent libraries for application 'default'...done.
    Calling SMI to save changes.
    SMISession.saveChanges succeeded.
    Starting OC4J instance 'OC4J_SECURITY'...done.
    Deploying application 'wirelesssso' to OC4J instance 'OC4J_SECURITY'.
    Notification ==> Application Deployer for wirelesssso STARTS [ 2006-11-27T17:20:23.691EST ]
    Notification ==> Undeploy previous deployment
    Notification ==> Removing files for app file:/u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/wirelesssso.ear
    Notification ==> Copy the archive to /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/wirelesssso.ear
    Notification ==> Unpack wirelesssso.ear begins...
    Notification ==> Unpack wirelesssso.ear ends...
    Notification ==> Initialize wirelesssso.ear begins...
    Notification ==> Initialize wirelesssso.ear ends...
    Notification ==> Initialize wirelesssso-web begins...
    Notification ==> Initialize wirelesssso-web ends...
    Notification ==> deleting: /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/wirelesssso.ear
    Notification ==> deleting: /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/wirelesssso/wirelesssso-web.war
    Notification ==> Application Deployer for wirelesssso COMPLETES [ 2006-11-27T17:20:24.193EST ]
    Deploying application 'oiddas' to OC4J instance 'OC4J_SECURITY'.
    Notification ==> Application Deployer for oiddas STARTS [ 2006-11-27T17:20:24.246EST ]
    Notification ==> Undeploy previous deployment
    Notification ==> Removing files for app file:/u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/oiddas.ear
    Notification ==> Copy the archive to /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/oiddas.ear
    Notification ==> Unpack oiddas.ear begins...
    Notification ==> Unpack oiddas.ear ends...
    Notification ==> Initialize oiddas.ear begins...
    Notification ==> Initialize oiddas.ear ends...
    Notification ==> Initialize ui begins...
    Notification ==> Initialize ui ends...
    Notification ==> deleting: /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/oiddas.ear
    Notification ==> deleting: /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/oiddas/ui.war
    Notification ==> Application Deployer for oiddas COMPLETES [ 2006-11-27T17:20:28.312EST ]
    Deploying application 'sso' to OC4J instance 'OC4J_SECURITY'.
    Notification ==> Application Deployer for sso STARTS [ 2006-11-27T17:20:28.351EST ]
    Notification ==> Undeploy previous deployment
    Notification ==> Removing files for app file:/u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/sso.ear
    Notification ==> Copy the archive to /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/sso.ear
    Notification ==> Unpack sso.ear begins...
    Notification ==> Unpack sso.ear ends...
    Notification ==> Initialize sso.ear begins...
    Notification ==> Initialize sso.ear ends...
    Notification ==> Initialize web begins...
    Notification ==> Initialize web ends...
    Notification ==> Initialize ssohelp begins...
    Notification ==> Initialize ssohelp ends...
    Notification ==> Initialize pls begins...
    Notification ==> Initialize pls ends...
    Notification ==> deleting: /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/sso.ear
    Notification ==> deleting: /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/sso/web.war
    Notification ==> deleting: /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/sso/ssohelp.war
    Notification ==> deleting: /u01/app/oracle/OraHome_2/j2ee/OC4J_SECURITY/applications/sso/pls.war
    Notification ==> Application Deployer for sso COMPLETES [ 2006-11-27T17:20:29.806EST ]
    Calling updateConfig to notify DCM of new deployments...done.
    Adding OC4J mount points for application 'wirelesssso'...done.
    Adding OC4J mount points for application 'oiddas'...done.
    Adding dependent libraries for application 'sso'...done.
    Adding OC4J mount points for application 'sso'...done.
    Calling SMI to save changes.
    SMISession.saveChanges succeeded.
    Binding web app 'wirelesssso-web' to default-web-site for application 'wirelesssso' in OC4J instance 'OC4J_SECURITY'
    Web app 'wirelesssso-web' bound successfully.
    Binding web app 'ui' to default-web-site for application 'oiddas' in OC4J instance 'OC4J_SECURITY'
    Web app 'ui' bound successfully.
    Binding web app 'web' to default-web-site for application 'sso' in OC4J instance 'OC4J_SECURITY'
    ERROR: Caught exception while binding web app 'web' to default-web-site:
    Calling updateConfig to notify DCM of new web-bindings...java.lang.reflect.InvocationTargetException
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at oracle.j2ee.tools.deploy.Oc4jDeploy.doDeploy(Unknown Source)
         at oracle.j2ee.tools.deploy.Oc4jDeploy.execute(Unknown Source)
         at oracle.j2ee.tools.deploy.Oc4jDeploy.deploy(Unknown Source)
         at oracle.j2ee.tools.deploy.Oc4jDeploy.main(Unknown Source)
    Caused by: com.evermind.client.orion.AdminCommandException: Disconnected: RMIConnection Disconnected
         at com.evermind.client.orion.BindWebAppCommand.execute(BindWebAppCommand.java:31)
         at com.evermind.client.orion.Oc4jAdminConsole.executeCommand(Oc4jAdminConsole.java:139)
         ... 8 more
    Caused by: com.evermind.server.rmi.OrionRemoteException: Disconnected: RMIConnection Disconnected
         at com.evermind.server.rmi.RMIConnection.EXCEPTION_ORIGINATES_FROM_THE_REMOTE_SERVER(RMIConnection.java:1621)
         at com.evermind.server.rmi.RMIConnection.invokeMethod(RMIConnection.java:1572)
         at com.evermind.server.rmi.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:55)
         at com.evermind.server.rmi.RecoverableRemoteInvocationHandler.invoke(RecoverableRemoteInvocationHandler.java:22)
         at __Proxy0.bindWebApp(Unknown Source)
         at com.evermind.client.orion.BindWebAppCommand.execute(BindWebAppCommand.java:28)
         ... 9 more
    done.
    Adding application 'wirelesssso' to the DCM repository...done.
    Application 'wirelesssso' deployed successfully.
    Adding application 'oiddas' to the DCM repository...done.
    Application 'oiddas' deployed successfully.
    Undeploying application 'sso' from OC4J instance 'OC4J_SECURITY'.
    java.lang.reflect.InvocationTargetException
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at oracle.j2ee.tools.deploy.Oc4jDeploy.doDeploy(Unknown Source)
         at oracle.j2ee.tools.deploy.Oc4jDeploy.execute(Unknown Source)
         at oracle.j2ee.tools.deploy.Oc4jDeploy.deploy(Unknown Source)
         at oracle.j2ee.tools.deploy.Oc4jDeploy.main(Unknown Source)
    Caused by: com.evermind.client.orion.AdminCommandException: IOException communicating with the remote server: Connection reset
         at com.evermind.client.orion.Oc4jAdminConsole.executeCommand(Oc4jAdminConsole.java:121)
         ... 8 more
    Caused by: java.net.SocketException: Connection reset
         at java.net.SocketInputStream.read(SocketInputStream.java:168)
         at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
         at java.io.BufferedInputStream.read(BufferedInputStream.java:201)
         at com.evermind.server.rmi.RMIConnection.connect(RMIConnection.java:2508)
         at com.evermind.server.rmi.RMIConnection.connect(RMIConnection.java:2361)
         at com.evermind.server.rmi.RMIConnection.lookup(RMIConnection.java:1800)
         at com.evermind.server.rmi.RMIServer.lookup(RMIServer.java:725)
         at com.evermind.server.rmi.RMIContext.lookup(RMIContext.java:149)
         at com.evermind.client.orion.Oc4jAdminConsole.executeCommand(Oc4jAdminConsole.java:106)
         ... 8 more
    FAILED!
    ERROR: Caught exception while undeploying 'sso' from 'OC4J_SECURITY':
    Removing OC4J mount points for application 'sso'...done.
    Calling SMI to save changes.
    SMISession.saveChanges succeeded.
    Calling updateConfig to notify DCM of undeployments...done.
    Stopping OC4J instance 'OC4J_SECURITY'...done.
    Calling SMI to retry init of failed plugins...done.
    Terminating DCM...done.
    Copying /u01/app/oracle/OraHome_2/j2ee/deploy.ini to /u01/app/oracle/OraHome_2/j2ee/deploy.ini.1164667126315.bak.
    Writing any undeployed entries back to /u01/app/oracle/OraHome_2/j2ee/deploy.ini.
    Oc4jDeploy tool completed, but with errors.
    End output from spawned process.
    Any help is appreciated, thanks!

    Hi, did you ever resolve this problem? We've got the same error.
    Cheers,
    Eystein

  • EM Configuration issue. /u01/.../node01_node01 not found

    Hi,
    am new to troubleshooting enterprise manager. twas working perfectly before. http://192.168.50.161:1158/em.
    now it is not working and when I checked via the console: $ emctl --help it returns:
    EM Configuration issue. /u01/app/oracle/product/11.1.0/db_1/node01_node01 not found.
    any tips on how to fix this problem?
    please help.
    thanks.

    I resolved the issue by creating soft links to the directory...
    Let's say your original hostname was as01.corp.purisma.com, and your new hostname is as01. My SID is as01 in this example.
    So, you need to change it in two places:
    If your ORACLE_HOME is /d0/oracle/product/10.2.0/db_1, then:
    Under: /d0/oracle/product/10.2.0/db_1
    ln -s as01.corp.purisma.com_as01 as01_as01
    Under: /d0/oracle/product/10.2.0/db_1/oc4j/j2ee
    ln -s OC4J_DBConsole_as01.corp.purisma.com_as01 OC4J_DBConsole_as01_as01
    I was then able to start the enterprise manager by issuing the standard 'emctl start dbconsole' command.

  • Issue while running page OC4J start up failed.

    Hi,
    I am working on two instances one is Local and another is in abroad.
    Now when I am running simple Hello World Page by giving Local Instance connections The page is loading quickly and running fine.
    Now when I am running the same Hello World Page by giving Abroad Instance connections The page load is taking almost 9-10 mins and running fine.
    In the above cases what might be the issue with Abroad Instances for loading page.
    1) Is it the Network Issue?
    2) Is it the OC4J Issue?
    Can anyone breif this senario and how to over come this issue.
    And one more Issue is
    Took the remote desktop of the Abroad Machine Installed JDeveloper in it and while running the Hello World page the Message OC4J start up failed is getting popedup in the Message.
    In which cases we will get OC4J start up failed error.
    Thanks,
    Krishna
    Edited by: user1000 on Feb 7, 2011 5:29 AM

    I am working on two instances one is Local and another is in abroad.What is your application release?
    In the above cases what might be the issue with Abroad Instances for loading page.
    1) Is it the Network Issue?Could be one or more.
    Can you reproduce the issue with other Self-Service pages? Any performance issues with forms?
    2) Is it the OC4J Issue?What about local users who access the same page from the same network, do they encounter the same performance issues?
    Can anyone breif this senario and how to over come this issue.Before investigating the performance issues with the instance/server (which are discussed many times in the forum, so just search old threads for performance tuning and you will get many hits), I would suggest you answer the above two questions to determine whether this is a network issue or an instance/server issue.
    And one more Issue is
    Took the remote desktop of the Abroad Machine Installed JDeveloper in it and while running the Hello World page the Message OC4J start up failed is getting popedup in the Message.
    In which cases we will get OC4J start up failed error.What is the error?
    Thanks,
    Hussein

  • Installing Oracle Grid control 10G fails at OMS configuration on Windows XP

    I am trying to install Oracle 10G Grid control and it fails at OMS configuration. The log file under cfgttool logs shows failed command as
    Oracle.sysman.emcp.oms.Omsplugin -ConfigureOms.
    I tried to run command manually like the following:
    C:\OracleHomes\oms10g -force Oracle.sysman.emcp.oms.Omsplugin -ConfigureOms.
    Whe I run this command nothing happens. How should I got about it. Thanks in advance.
    Venkat

    oracle.sysman.top.oms_<timestamp>log
    has the following error messages and warnings.
    [24-01-2011 13:45:21] Analyzing header for: C:/OracleHomes/oms10g/sysman/admin/emdrep/sql/core/latest/util/util_pkgdefs.sql
    [24-01-2011 13:45:21]      Header: <create type="pkgdefs" pos="ip/webapps/ip_webapp_pkgdef.sql+"/>
    [24-01-2011 13:45:21]      WARNING: Bad pos attribute in repmgr header.
    [24-01-2011 13:45:21]      WARNING: Either there is a non-existent file: "ip/webapps/ip_webapp_pkgdef.sql" in position attribute: "ip/webapps/ip_webapp_pkgdef.sql+"
    [24-01-2011 13:45:21]      WARNING: OR there is a bad repmgr header/no repmgr header in file: "ip/webapps/ip_webapp_pkgdef.sql"
    At the end of the file:
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stderr:
    'Enter Enterprise Manager Root Password :
    ************Enter Agent Registration password :
    ************Unable to connect to opmn.
    Opmn may not be up.
    ================================================================================
    opmn id=test-hv-ms2003e:6201
    5 of 6 processes started.
    ias-instance id=EnterpriseManager0.test-hv-ms2003e.teamqsi.com
    ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
    ias-component/process-type/process-set:
    HTTP_Server/HTTP_Server/HTTP_Server
    Error
    --> Process (pid=2476)
    failed to start a managed process after the maximum retry limit
    Log:
    C:\OracleHomes\oms10g\opmn\logs\HTTP_Server~1
    INFO: oracle.sysman.top.oms:setOmsSecure:OMS Service command=secure oms -secure_port 1159:returned:
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Performing Command=CMD /C C:\OracleHomes\oms10g\bin\emctl.bat secure lock
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:CMD /C C:\OracleHomes\oms10g\bin\emctl.bat secure lock have completed with exitCode=0
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stdout:
    'Oracle Enterprise Manager 10g Release 10.2.0.2.0
    Copyright (c) 1996, 2006 Oracle Corporation. All rights reserved.
    Checking the security status of the OMS... Done.
    Updating HTTPS Virtual Host for Enterprise Manager OMS... Done.
    OMS Locked. Agents must be Secure and upload over HTTPS Port 1159.
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stderr:
    INFO: oracle.sysman.top.oms:setOmsLocked:OMS Service command=secure lock:returned:
    INFO: oracle.sysman.top.oms:configureOmsService:Oms Secure Configuration done.
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Performing Command=CMD /C C:\OracleHomes\oms10g\perl\5.6.1\bin\MSWin32-x86\perl.exe C:\OracleHomes\oms10g\sysman\install\precompilejsp.pl C:\OracleHomes\oms10g\j2ee\OC4J_EM\config\global-web-application.xml
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:CMD /C C:\OracleHomes\oms10g\perl\5.6.1\bin\MSWin32-x86\perl.exe C:\OracleHomes\oms10g\sysman\install\precompilejsp.pl C:\OracleHomes\oms10g\j2ee\OC4J_EM\config\global-web-application.xml have completed with exitCode=0
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stdout:
    'precompiling the JSPs
    precompiling the JSPs done
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stderr:
    INFO: oracle.sysman.top.oms:configureOmsService:Precompile Jsps done.
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Performing Command=CMD /C C:\OracleHomes\oms10g\jdk\bin\java.exe -jar C:\OracleHomes\oms10g\sysman\jlib\emclikit.jar client -install_dir=C:\OracleHomes\oms10g\bin
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:CMD /C C:\OracleHomes\oms10g\jdk\bin\java.exe -jar C:\OracleHomes\oms10g\sysman\jlib\emclikit.jar client -install_dir=C:\OracleHomes\oms10g\bin have completed with exitCode=0
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stdout:
    'Oracle Enterprise Manager 10g Release 10.2.0.2.0.
    Copyright (c) 1996, 2006 Oracle Corporation. All rights reserved.
    EM CLI client-side install completed successfully.
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stderr:
    INFO: oracle.sysman.top.oms:configureOmsService:installAdditionalServices for 'client' completed=true
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Performing Command=CMD /C C:\OracleHomes\oms10g\bin\emctl.bat config agent updateTZ
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:CMD /C C:\OracleHomes\oms10g\bin\emctl.bat config agent updateTZ have completed with exitCode=0
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stdout:
    'Oracle Enterprise Manager 10g Release 10.2.0.2.0
    Copyright (c) 1996, 2006 Oracle Corporation. All rights reserved.
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stderr:
    INFO: oracle.sysman.top.oms:configureOmsService:fixTimeZone completed=true
    INFO: oracle.sysman.top.oms:OmsPlugIn:Requested Configuration Step 4 have been completed with status=true
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Performing Command=CMD /C C:\OracleHomes\oms10g\opmn\bin\opmnctl stopall
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:CMD /C C:\OracleHomes\oms10g\opmn\bin\opmnctl stopall have completed with exitCode=0
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stdout:
    'opmnctl: stopping opmn and all managed processes...
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stderr:
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Performing Command=CMD /C C:\OracleHomes\oms10g\opmn\bin\opmnctl startall
    INFO: oracle.sysman.top.oms:Start Opmn Error = CMD /C C:\OracleHomes\oms10g\opmn\bin\opmnctl startall
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:CMD /C C:\OracleHomes\oms10g\opmn\bin\opmnctl startall have completed with exitCode=206
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stdout:
    'opmnctl: starting opmn and all managed processes...
    INFO: oracle.sysman.top.oms:PerformSecureCommand:runCmd:Command Output stderr:
    '================================================================================
    opmn id=test-hv-ms2003e:6201
    5 of 6 processes started.
    ias-instance id=EnterpriseManager0.test-hv-ms2003e.teamqsi.com
    ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
    ias-component/process-type/process-set:
    HTTP_Server/HTTP_Server/HTTP_Server
    Error
    --> Process (pid=2992)
    failed to start a managed process after the maximum retry limit
    Log:
    C:\OracleHomes\oms10g\opmn\logs\HTTP_Server~1
    INFO: oracle.sysman.top.oms:OmsPlugIn:Requested Configuration Step 5 have been completed with status=false
    INFO: oracle.sysman.top.oms:EmcpPlug:invoke:Completed EmcpPlug invoke method on an aggregate=oracle.sysman.top.oms for Action=configuration in step=2:microstep=0
    INFO: oracle.sysman.top.oms:The plug-in OMS Configuration has failed its perform method

  • Root.sh failed throws error when installing Oracle Grid Infrastructure 11.2

    Hi,
    root.sh failed with the following error when installing / configuring the oracle grid infrastructure version 11.2.0.1 for standalone on RHEL 6
    Now product-specific root actions will be performed.
    2011-10-10 11:46:55: Checking for super user privileges
    2011-10-10 11:46:55: User has super user privileges
    2011-10-10 11:46:55: Parsing the host name
    Using configuration parameter file: /apps/opt/oracle_infra/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'oracle', privgrp 'oinstall'..
    Operation successful.
    CRS-4664: Node vmhost1 successfully pinned.
    Adding daemon to inittab
    CRS-4124: Oracle High Availability Services startup failed.
    CRS-4000: Command Start failed, or completed with errors.
    ohasd failed to start: Inappropriate ioctl for device
    ohasd failed to start: Inappropriate ioctl for device at /apps/opt/oracle_infra/crs/install/roothas.pl line 296.
    I followed the steps / solution provided in the ID 1069182.1. But no use.
    Are there any workaround?
    Thanks
    -KarthicK
    Edited by: user11984375 on Oct 10, 2011 7:06 AM

    Check the logfiles under $GRID_HOME/log/<node_name>/cssd/
    I had seen the same problem and the following resolved the problem for me.
    [root@rac1 ~]# rm -f /usr/tmp/.oracle/* /tmp/.oracle/* /var/tmp/.oracle/*
    [root@rac1 ~]# > $ORA_CRS_HOME/log/<node_name>/cssd/<node_name>.pid
    HTH,
    Raj Mareddi
    http://www.freeoraclehelp.com

  • Root.sh failed at second node OUL 6.3 Oracle GRID 11.2.0.3

    Hi, im installing a two node cluster mounted on Oracle Linux 6.3 with Oracle DB 11.2.0.3, the installation went smooth up until the execution of the root.sh script on the second node.
    THe script return this final lines:
    CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node nodo1, number 1, and is terminating
    An active cluster was found during exclusive startup, restarting to join the cluster
    Start of resource "ora.crsd" failed
    CRS-2800: Cannot start resource 'ora.asm' as it is already in the INTERMEDIATE state on server 'nodo2'
    CRS-4000: Command Start failed, or completed with errors.
    Failed to start Oracle Grid Infrastructure stack
    Failed to start Cluster Ready Services at /u01/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 1286.
    /u01/app/11.2.0/grid/perl/bin/perl -I/u01/app/11.2.0/grid/perl/lib -I/u01/app/11.2.0/grid/crs/install /u01/app/11.2.0/grid/crs/install/rootcrs.pl execution failed
    In $GRID_HOME/log/node2/alertnode.log It appears to be a Cluster Time Synchronization Service issue, (i didn't synchronyze the nodes..) however the CTSS is running in observer mode, wich i believe it shouldn't affect the installation process. After that i lost it...there's an entry CRS-5018 indicating that an unused HAIP route was removed... and then, out of the blue: CRS-5818:Aborted command 'start' for resource 'ora.asm'. Some clarification will be deeply apreciated.
    Here's the complete log:
    2013-04-01 13:39:35.358
    [client(12163)]CRS-2101:The OLR was formatted using version 3.
    2013-04-01 19:40:19.597
    [ohasd(12338)]CRS-2112:The OLR service started on node nodo2.
    2013-04-01 19:40:19.657
    [ohasd(12338)]CRS-1301:Oracle High Availability Service started on node nodo2.
    [client(12526)]CRS-10001:01-Apr-13 13:41 ACFS-9459: ADVM/ACFS is not supported on this OS version: '2.6.39-400.17.2.el6uek.i686'
    [client(12528)]CRS-10001:01-Apr-13 13:41 ACFS-9201: Not Supported
    [client(12603)]CRS-10001:01-Apr-13 13:41 ACFS-9459: ADVM/ACFS is not supported on this OS version: '2.6.39-400.17.2.el6uek.i686'
    2013-04-01 19:41:17.509
    [ohasd(12338)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2013-04-01 19:41:17.618
    [gpnpd(12695)]CRS-2328:GPNPD started on node nodo2.
    2013-04-01 19:41:21.363
    [cssd(12755)]CRS-1713:CSSD daemon is started in exclusive mode
    2013-04-01 19:41:23.194
    [ohasd(12338)]CRS-2767:Resource state recovery not attempted for 'ora.diskmon' as its target state is OFFLINE
    2013-04-01 19:41:56.144
    [cssd(12755)]CRS-1707:Lease acquisition for node nodo2 number 2 completed
    2013-04-01 19:41:57.545
    [cssd(12755)]CRS-1605:CSSD voting file is online: /dev/oracleasm/disks/ASM_DISK_1; details in /u01/app/11.2.0/grid/log/nodo2/cssd/ocssd.log.
    [cssd(12755)]CRS-1636:The CSS daemon was started in exclusive mode but found an active CSS daemon on node nodo1 and is terminating; details at (:CSSNM00006:) in /u01/app/11.2.0/grid/log/nodo2/cssd/ocssd.log
    2013-04-01 19:41:58.549
    [ohasd(12338)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'nodo2'.
    2013-04-01 19:42:10.025
    [gpnpd(12695)]CRS-2329:GPNPD on node nodo2 shutdown.
    2013-04-01 19:42:11.407
    [mdnsd(12685)]CRS-5602:mDNS service stopping by request.
    2013-04-01 19:42:29.642
    [gpnpd(12947)]CRS-2328:GPNPD started on node nodo2.
    2013-04-01 19:42:33.241
    [cssd(13012)]CRS-1713:CSSD daemon is started in clustered mode
    2013-04-01 19:42:35.104
    [ohasd(12338)]CRS-2767:Resource state recovery not attempted for 'ora.diskmon' as its target state is OFFLINE
    2013-04-01 19:42:44.065
    [cssd(13012)]CRS-1707:Lease acquisition for node nodo2 number 2 completed
    2013-04-01 19:42:45.484
    [cssd(13012)]CRS-1605:CSSD voting file is online: /dev/oracleasm/disks/ASM_DISK_1; details in /u01/app/11.2.0/grid/log/nodo2/cssd/ocssd.log.
    2013-04-01 19:42:52.138
    [cssd(13012)]CRS-1601:CSSD Reconfiguration complete. Active nodes are nodo1 nodo2 .
    2013-04-01 19:42:55.081
    [ctssd(13076)]CRS-2403:The Cluster Time Synchronization Service on host nodo2 is in observer mode.
    2013-04-01 19:42:55.581
    [ctssd(13076)]CRS-2401:The Cluster Time Synchronization Service started on host nodo2.
    2013-04-01 19:42:55.581
    [ctssd(13076)]CRS-2407:The new Cluster Time Synchronization Service reference node is host nodo1.
    2013-04-01 19:43:08.875
    [ctssd(13076)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/app/11.2.0/grid/log/nodo2/ctssd/octssd.log.
    2013-04-01 19:43:08.876
    [ctssd(13076)]CRS-2409:The clock on host nodo2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2013-04-01 19:43:13.565
    [u01/app/11.2.0/grid/bin/orarootagent.bin(13064)]CRS-5018:(:CLSN00037:) Removed unused HAIP route: 169.254.0.0 / 255.255.0.0 / 0.0.0.0 / eth0
    2013-04-01 19:53:09.800
    [u01/app/11.2.0/grid/bin/oraagent.bin(12922)]CRS-5818:Aborted command 'start' for resource 'ora.asm'. Details at (:CRSAGF00113:) {0:0:223} in /u01/app/11.2.0/grid/log/nodo2/agent/ohasd/oraagent_oracle/oraagent_oracle.log.
    2013-04-01 19:53:11.827
    [ohasd(12338)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.asm'. Details at (:CRSPE00111:) {0:0:223} in /u01/app/11.2.0/grid/log/nodo2/ohasd/ohasd.log.
    2013-04-01 19:53:12.779
    [u01/app/11.2.0/grid/bin/oraagent.bin(12922)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/11.2.0/grid/log/nodo2/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
    2013-04-01 19:53:13.892
    [u01/app/11.2.0/grid/bin/oraagent.bin(12922)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/11.2.0/grid/log/nodo2/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
    2013-04-01 19:53:43.877
    [u01/app/11.2.0/grid/bin/oraagent.bin(12922)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/11.2.0/grid/log/nodo2/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
    2013-04-01 19:54:13.891
    [u01/app/11.2.0/grid/bin/oraagent.bin(12922)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/11.2.0/grid/log/nodo2/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
    2013-04-01 19:54:43.906
    [u01/app/11.2.0/grid/bin/oraagent.bin(12922)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/11.2.0/grid/log/nodo2/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
    2013-04-01 19:55:13.914
    [u01/app/11.2.0/grid/bin/oraagent.bin(12922)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/11.2.0/grid/log/nodo2/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
    2013-04-01 19:55:43.918
    [u01/app/11.2.0/grid/bin/oraagent.bin(12922)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/11.2.0/grid/log/nodo2/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
    2013-04-01 19:56:13.922
    [u01/app/11.2.0/grid/bin/oraagent.bin(12922)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/11.2.0/grid/log/nodo2/agent/ohasd/oraagent_oracle/oraagent_oracle.log".
    2013-04-01 19:56:53.209
    [crsd(13741)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 20:07:01.128
    [crsd(13741)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 20:07:01.278
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 20:07:08.689
    [crsd(15248)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 20:13:10.138
    [ctssd(13076)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/app/11.2.0/grid/log/nodo2/ctssd/octssd.log.
    2013-04-01 20:17:13.024
    [crsd(15248)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 20:17:13.171
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 20:17:20.826
    [crsd(16746)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 20:27:25.020
    [crsd(16746)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 20:27:25.176
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 20:27:31.591
    [crsd(18266)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 20:37:35.668
    [crsd(18266)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 20:37:35.808
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 20:37:43.209
    [crsd(19762)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 20:43:11.160
    [ctssd(13076)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/app/11.2.0/grid/log/nodo2/ctssd/octssd.log.
    2013-04-01 20:47:47.487
    [crsd(19762)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 20:47:47.637
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 20:47:55.086
    [crsd(21242)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 20:57:59.343
    [crsd(21242)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 20:57:59.492
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 20:58:06.996
    [crsd(22744)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 21:08:11.046
    [crsd(22744)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 21:08:11.192
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 21:08:18.726
    [crsd(24260)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 21:13:12.000
    [ctssd(13076)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/app/11.2.0/grid/log/nodo2/ctssd/octssd.log.
    2013-04-01 21:18:22.262
    [crsd(24260)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 21:18:22.411
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 21:18:29.927
    [crsd(25759)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 21:28:34.467
    [crsd(25759)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 21:28:34.616
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 21:28:41.990
    [crsd(27291)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 21:38:45.012
    [crsd(27291)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 21:38:45.160
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 21:38:52.790
    [crsd(28784)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 21:43:12.378
    [ctssd(13076)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/app/11.2.0/grid/log/nodo2/ctssd/octssd.log.
    2013-04-01 21:48:56.285
    [crsd(28784)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 21:48:56.435
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 21:49:04.421
    [crsd(30272)]CRS-1012:The OCR service started on node nodo2.
    2013-04-01 21:59:08.183
    [crsd(30272)]CRS-0810:Cluster Ready Service aborted due to failure to communicate with Event Management Service with error [1]. Details at (:CRSD00120:) in /u01/app/11.2.0/grid/log/nodo2/crsd/crsd.log.
    2013-04-01 21:59:08.318
    [ohasd(12338)]CRS-2765:Resource 'ora.crsd' has failed on server 'nodo2'.
    2013-04-01 21:59:15.860
    [crsd(31772)]CRS-1012:The OCR service started on node nodo2.

    Hi santysharma, thanks for the reply, i have two ethernet interfaces: eth0 (public network 192.168.1.0) and eth1 (private network 10.5.3.0), there is no device using that ip range, here's the output of route command:
    (Sorry for the alignment, i tried to tab it but the editor trims it again)
    Kernel IP routing table
    Destination Gateway Genmask Flags Metric Ref Use Iface
    default 192.168.1.1 0.0.0.0 UG 0 0 0 eth0
    private * 255.255.255.0 U 0 0 0 eth1
    link-local * 255.255.0.0 U 1002 0 0 eth0
    link-local * 255.255.0.0 U 1003 0 0 eth1
    public * 255.255.255.0 U 0 0 0 eth0
    And the /etc/hosts file
    127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
    ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
    10.5.3.1 nodo1.cluster nodo1
    10.5.3.2 nodo2.cluster nodo2
    192.168.1.13 cluster-scan
    192.168.1.14 nodo1-vip
    192.168.1.15 nodo2-vip
    And the ifconfig -a
    eth0 Link encap:Ethernet HWaddr C8:3A:35:D9:C6:2B
    inet addr:192.168.1.12 Bcast:192.168.1.255 Mask:255.255.255.0
    inet6 addr: fe80::ca3a:35ff:fed9:c62b/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:34708 errors:0 dropped:18 overruns:0 frame:0
    TX packets:24693 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:48545969 (46.2 MiB) TX bytes:1994381 (1.9 MiB)
    eth1 Link encap:Ethernet HWaddr 00:0D:87:D0:A3:8E
    inet addr:10.5.3.2 Bcast:10.5.3.255 Mask:255.255.255.0
    inet6 addr: fe80::20d:87ff:fed0:a38e/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:0 errors:0 dropped:0 overruns:0 frame:0
    TX packets:44 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:0 (0.0 b) TX bytes:5344 (5.2 KiB)
    Interrupt:23 Base address:0x6000
    lo Link encap:Local Loopback
    inet addr:127.0.0.1 Mask:255.0.0.0
    inet6 addr: ::1/128 Scope:Host
    UP LOOPBACK RUNNING MTU:16436 Metric:1
    RX packets:20 errors:0 dropped:0 overruns:0 frame:0
    TX packets:20 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:0
    RX bytes:1320 (1.2 KiB) TX bytes:1320 (1.2 KiB)
    Now that i'm thinking i've read somewhere that ipv6 was no supported...yet there's no relation with the 169.254.x.x ip range.

  • Root.sh script failed to run after 11gR2 grid installation

    Hi,
    I am trying to install 11gR2 on RHEL 5.3 . however I have problems running th post install script on both nodes.
    here is the output of the root.sh script on the first node :
    [root@rac1 grid]# ./root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/11.2.0/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    Can't locate auto/DynaLoader/dl_findfile.al in @INC (@INC contains: /u01/app/11.2.0/grid/perl/lib/5.10.0/x86_64-linux-thread-multi /u01/app/11.2.0/grid/perl/lib/5.10.0 /u01/app/11.2.0/grid/perl/lib /u01/app/11.2.0/grid/crs/install /u01/app/11.2.0/grid/perl/lib/5.10.0/x86_64-linux-thread-multi /u01/app/11.2.0/grid/perl/lib/5.10.0 /u01/app/11.2.0/grid/perl/lib/site_perl/5.10.0/x86_64-linux-thread-multi /u01/app/11.2.0/grid/perl/lib/site_perl/5.10.0 /u01/app/11.2.0/grid/perl/lib/5.10.0/x86_64-linux-thread-multi /u01/app/11.2.0/grid/perl/lib/5.10.0/x86_64-linux-thread-multi /u01/app/11.2.0/grid/perl/lib/5.10.0 /u01/app/11.2.0/grid/perl/lib/site_perl/5.10.0/x86_64-linux-thread-multi /u01/app/11.2.0/grid/perl/lib/site_perl/5.10.0 /u01/app/11.2.0/grid/perl/lib/site_perl . /u01/app/11.2.0/grid/crs/install) at /u01/app/11.2.0/grid/perl/lib/5.10.0/x86_64-linux-thread-multi/DynaLoader.pm line 171
    BEGIN failed--compilation aborted at /u01/app/11.2.0/grid/perl/lib/5.10.0/x86_64-linux-thread-multi/Fcntl.pm line 216.
    Compilation failed in require at /u01/app/11.2.0/grid/perl/lib/5.10.0/Net/Ping.pm line 10.
    BEGIN failed--compilation aborted at /u01/app/11.2.0/grid/perl/lib/5.10.0/Net/Ping.pm line 10.
    Compilation failed in require at /u01/app/11.2.0/grid/crs/install/rootcrs.pl line 218.
    BEGIN failed--compilation aborted at /u01/app/11.2.0/grid/crs/install/rootcrs.pl line 218.
    I found the required auto/DynaLoader/dl_findfile.al file :
    [root@rac1 grid]# find /. -name dl_findfile.al
    /./orainst/app/crs/perl/lib/5.8.3/x86_64-linux-thread-multi/auto/DynaLoader/dl_findfile.al
    /./usr/lib64/perl5/5.8.8/x86_64-linux-thread-multi/auto/DynaLoader/dl_findfile.al
    but I don't know how or where to change the perl include libraries.
    Please Advise

    Hi,
    no I don't have PERL5LIB environment set to some value for root.
    I added the path in the root.sh file to the system perl-5.8.8 include file and change the perlbin to use the system /usr/bin/perl executable and then the root.sh file did run and finished succesfully.
    However other utilities have the same problems . like running asmcmd.
    Do you have any idea how to fix it globally?
    Thanks

  • 11gR2 - ACMCA needs Oracle grid infrastructure to configure ASM

    Hi
    I am installing single instance oracle 11gR2 on linux redhat 5
    I have problem with 11gr2 ASMCA.
    I successfully installed 11gR2 oracle grid home.
    Than i wanted to create the ASM diskgroup using asmca
    The disks was succssefully discavered , but the creatation failed on the following error messages:
    Oracle Grid infrastructure is not configured properly
    ACMCA needs Oracle grid infrastructure to configure ASMI think it maight be related to root.sh problem.
    1. where i can find the root.sh log output ?
    2. Is it "safe" to rerun the root.sh once again ?
    3. Could you please suggest what to check ?
    Thanks

    Hi There
    You need to run root.sh script once again as root user. The script can be found immediately under the GRID home
    for eg:/opt/11.2.0/grid/root.sh
    upon running this script it will then ask u to run another script for Standalone servers
    /opt/11.2.0/grid/perl/bin/perl -I/opt/11.2.0/grid/perl/lib -I/opt/11.2.0/grid/crs/install /opt/11.2.0/grid/crs/install/roothas.pl
    You need to run this again as root user
    This will configure the GRID infrastructure for a Standalone env.
    After this you should be able to run ASMCA without any issues
    Regards
    vgt

  • ASMCA needs Oracle Grid Infrastructure to configure ASM

    Hi,
    I am trying to install ASM 11gR2 on RHEL5. I am using VMWare Workstation for this.
    I have already installed Oracle database software and Grid Infrastructure on this machine.While installing Grid Infrastructure, I chose install Grid Infrastructure software only.
    Once this was successfull I am trying to create ASM instance using asmca.
    Regarding the disks, I am using raw devices. I created a virtual disk which I have partitioned but haven't formatted it. Done this to create raw device
    [root@localhost sysconfig]# /bin/raw /dev/raw/raw1 /dev/sdb
    /dev/raw/raw1: bound to major 8, minor 16
    and have added
    ACTION=="add",KERNEL=="sdb",RUN+="/bin/raw /dev/raw/raw1 %N"
    to /etc/udev/rules.d/60-raw.rules
    Then I tried creating the disk but it failed. So I did the following steps to fix it
    [root@dhcppc2 Softwares]# /etc/init.d/oracleasm createdisk VOL1 /dev/sdb
    Marking disk "VOL1" as an ASM disk: [FAILED]
    [oracle@oracle11gR2 grid]$ tail -f /var/log/oracleasm
    Device "/dev/sdb" is not a partition
    To fix this
    [root@localhost ~]# /usr/sbin/asmtool -C -l /dev/oracleasm -n VOL1 -s /dev/sdb -a force=yes
    asmtool: Device "/dev/sdb" is not a partition
    asmtool: Continuing anyway
    Now I am able to view the asmdisk through listdisks option.
    Have set following environment variables before running asmca
    [oracle@oracle11gR2 ~]$ export ORACLE_HOME=/u01/app/oracle/product/11.2.0/Grid
    [oracle@oracle11gR2 ~]$ export PATH=/u01/app/oracle/product/11.2.0/Grid/bin:/usr/sbin:/usr/kerberos/bin:/usr/local/bin:/usr/bin:/bin:/usr/X11R6/bin:/home/oracle/bin
    When I am running ASMCA I am facing this error - Oralce Grid Infrastrcture is not configured properly. ASMCA needs Oracle Grid Infrastructure to configure ASM
    Any thoughts?

    Hi Aman,
    Thanks for the reply.
    Is it possible to configure 11gR2 ASM on single instance databases ? I have done the config with 10g but I am struggling with the Grid Infrastructure. For eg: when I do deinstall of Grid Infrstructure
    +[oracle@oracle11gR2 deinstall]$ ./deinstall -home /u01/app/oracle/product/11.2.0/Grid+
    ORACLE_HOME = /u01/app/oracle/product/11.2.0/Grid
    Location of logs /u01/Softwares/oracle11gR2/deinstall/logs/
    +############ ORACLE DEINSTALL & DECONFIG TOOL START ############+
    +######################## CHECK OPERATION START ########################+
    Install check configuration START
    Checking for existence of the Oracle home location /u01/app/oracle/product/11.2.0/Grid
    Oracle Home type selected for de-install is: SIHA
    Oracle Base selected for de-install is: /u01/app/oracle
    Checking for existence of central inventory location /u01/app/oraInventory
    Checking for existence of the Oracle Grid Infrastructure home
    Install check configuration END
    Traces log file: /u01/Softwares/oracle11gR2/deinstall/logs//crsdc.log
    Network Configuration check config START
    Network de-configuration trace file location: /u01/Softwares/oracle11gR2/deinstall/logs/netdc_check42401.log
    Network Configuration check config END
    Asm Check Configuration START
    ASM de-configuration trace file location: /u01/Softwares/oracle11gR2/deinstall/logs/asmcadc_check42402.log
    +ASM configuration was not detected in this Oracle home. Was ASM configured in this Oracle home (y|n) [n]:+
    ASM was not detected in the Oracle Home
    +######################### CHECK OPERATION END #########################+
    +####################### CHECK OPERATION SUMMARY #######################+
    Oracle Grid Infrastructure Home is:
    The cluster node(s) on which the Oracle home exists are: (Please input nodes seperated by ",", eg: node1,node2,...)null
    Oracle Home selected for de-install is: /u01/app/oracle/product/11.2.0/Grid
    Inventory Location where the Oracle home registered is: /u01/app/oraInventory
    ASM was not detected in the Oracle Home
    +Do you want to continue (y - yes, n - no)? [n]: y+
    A log of this session will be written to: '/u01/Softwares/oracle11gR2/deinstall/logs/deinstall_deconfig2010-08-07_01-31-49-PM.out'
    Any error messages from this session will be written to: '/u01/Softwares/oracle11gR2/deinstall/logs/deinstall_deconfig2010-08-07_01-31-49-PM.err'
    +######################## CLEAN OPERATION START ########################+
    ASM de-configuration trace file location: /u01/Softwares/oracle11gR2/deinstall/logs/asmcadc_clean42403.log
    ASM Clean Configuration END
    Network Configuration clean config START
    Network de-configuration trace file location: /u01/Softwares/oracle11gR2/deinstall/logs/netdc_clean42404.log
    De-configuring backup files...
    Backup files de-configured successfully.
    The network configuration has been cleaned up successfully.
    Network Configuration clean config END
    ---------------------------------------->
    Press Enter after you finish running the above commands
    +<----------------------------------------+
    I don't see any commands to run but the deinstall blindly says that
    "Press Enter after you finish running the above commands"
    and while looking at the net I found out it might be something similar to this
    /u01/Softwares/oracle11gR2/deinstall/perl/bin/perl -I/u01/Softwares/oracle11gR2/deinstall/perl/lib -I/u01/Softwares/oracle11gR2/deinstall/crs/install /u01/Softwares/oracle11gR2/deinstall/crs/install/rootcrs.pl -force -delete -paramfile /u01/Softwares/oracle11gR2/deinstall/response/deinstall_Ora11g_gridinfrahome1.rsp
    Should I run the previous command as root.
    Am I doing things in the right way or am I missing something here?

Maybe you are looking for