Root.sh failure on node1 during Grid Infra installation

I’m installing 11.2.0.3 Grid Infrastructure on two AIX 7.1 nodes. Root.sh script fails at ora.cssd startup. I’m using manual network configuration with DNS and hosts file. Cluvfy output looks good but root.sh fails. Any ideas?

Cluvfy output indicates overall passed minus some ignorable errors. Also, I verified interconnect and asm disks and they appear all good. I have some concernes about these (bellow), should I worry about them at this stage?
Network parameter - ipqmaxlen - Checks if the network parameter is set correctly on the system
Check Failed on Nodes: [donner02,  donner01]
Verification result of failed node: donner02
Expected Value
: 512
Actual Value
: en1=
Details:
PRVE-0273 : The value of network parameter "ipqmaxlen" for interface "en1" is not configured to the expected value on node "donner02".[Expected="512"; Found="en1="] - Cause: - Action:
Back to Top
Verification result of failed node: donner01
Expected Value
: 512
Actual Value
: en1=
Details:
PRVE-0273 : The value of network parameter "ipqmaxlen" for interface "en1" is not configured to the expected value on node "donner01".[Expected="512"; Found="en1="] - Cause: - Action:
Network parameter - sb_max - Checks if the network parameter is set correctly on the system
Check Failed on Nodes: [donner02,  donner01]
Verification result of failed node: donner02
Expected Value
: 4194304
Actual Value
: en1=
Details:
PRVE-0273 : The value of network parameter "sb_max" for interface "en1" is not configured to the expected value on node "donner02".[Expected="4194304"; Found="en1="] - Cause: - Action:
Back to Top
Verification result of failed node: donner01
Expected Value
: 4194304
Actual Value
: en1=
Details:
PRVE-0273 : The value of network parameter "sb_max" for interface "en1" is not configured to the expected value on node "donner01".[Expected="4194304"; Found="en1="] - Cause: - Action:
Network parameter - tcp_sendspace - Checks if the network parameter is set correctly on the system
Check Failed on Nodes: [donner02,  donner01]
Verification result of failed node: donner02
Expected Value
: 65536
Actual Value
: en1=131072
Details:
PRVE-0273 : The value of network parameter "tcp_sendspace" for interface "en1" is not configured to the expected value on node "donner02".[Expected="65536"; Found="en1=131072"] - Cause: - Action:
Back to Top
Verification result of failed node: donner01
Expected Value
: 65536
Actual Value
: en1=131072
Details:
PRVE-0273 : The value of network parameter "tcp_sendspace" for interface "en1" is not configured to the expected value on node "donner01".[Expected="65536"; Found="en1=131072"] - Cause: - Action:
Network parameter - udp_sendspace - Checks if the network parameter is set correctly on the system
Check Failed on Nodes: [donner02,  donner01]
Verification result of failed node: donner02
Expected Value
: 65536
Actual Value
: en1=
Details:
PRVE-0273 : The value of network parameter "udp_sendspace" for interface "en1" is not configured to the expected value on node "donner02".[Expected="65536"; Found="en1="] - Cause: - Action:
Back to Top
Verification result of failed node: donner01
Expected Value
: 65536
Actual Value
: en1=
Details:
PRVE-0273 : The value of network parameter "udp_sendspace" for interface "en1" is not configured to the expected value on node "donner01".[Expected="65536"; Found="en1="] - Cause: - Action:
Network parameter - udp_recvspace - Checks if the network parameter is set correctly on the system
Check Failed on Nodes: [donner02,  donner01]
Verification result of failed node: donner02
Expected Value
: 655360
Actual Value
: en1=
Details:
PRVE-0273 : The value of network parameter "udp_recvspace" for interface "en1" is not configured to the expected value on node "donner02".[Expected="655360"; Found="en1="] - Cause: - Action:
Back to Top
Verification result of failed node: donner01
Expected Value
: 655360
Actual Value
: en1=
Details:
PRVE-0273 : The value of network parameter "udp_recvspace" for interface "en1" is not configured to the expected value on node "donner01".[Expected="655360"; Found="en1="] - Cause: - Action:

Similar Messages

  • Command return code of 255 (65280) during Grid Infrastructure Installation

    I am trying to create a 2-node RAC 11gR2. I am using OEL 5 Update 4. I am using NFS as shared storage. The time on both node is same. Both nodes have 4GB RAM each. Following is my IP settings from /etc/hosts on both nodes:
    [oracle@vis ~]$ cat /etc/hosts
    # Do not remove the following line, or various programs
    # that require network functionality will fail.
    127.0.0.1 localhost.localdomain localhost
    # Public
    10.8.5.191 vis.awc.com vis
    10.8.5.192 vsstest.awc.com vsstest
    #Private
    192.168.0.101 vis-priv.awc.com vis-priv
    192.168.0.102 vsstest-priv.awc.com vsstest-priv
    #Virtual
    10.8.5.166 vis-vip.awc.com vis-vip
    10.8.5.170 vsstest-vip.awc.com vsstest-vip
    # SCAN
    10.8.5.182 rac-scan.awc.com rac-scan
    #NAS
    192.168.0.101 nas1.awc.com nas1
    I am getting error during the Grid Infrastructure installation, when I run the root.sh script through root. Following is the logfile showing the error (/u01/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_vis.log):
    2010-02-02 11:58:05: The configuration parameter file /u01/app/11.2.0/grid/crs/install/crsconfig_params is valid
    2010-02-02 11:58:05: Checking for super user privileges
    2010-02-02 11:58:05: User has super user privileges
    2010-02-02 11:58:05: ### Printing the configuration values from files:
    2010-02-02 11:58:05: /u01/app/11.2.0/grid/crs/install/crsconfig_params
    2010-02-02 11:58:05: /u01/app/11.2.0/grid/crs/install/s_crsconfig_defs
    2010-02-02 11:58:05: ASM_DISCOVERY_STRING=
    2010-02-02 11:58:05: ASM_DISKS=
    2010-02-02 11:58:05: ASM_DISK_GROUP=
    2010-02-02 11:58:05: ASM_REDUNDANCY=
    2010-02-02 11:58:05: ASM_SPFILE=
    2010-02-02 11:58:05: ASM_UPGRADE=false
    2010-02-02 11:58:05: CLSCFG_MISSCOUNT=
    2010-02-02 11:58:05: CLUSTER_GUID=
    2010-02-02 11:58:05: CLUSTER_NAME=rac-scan
    2010-02-02 11:58:05: CRS_NODEVIPS='vis-vip/255.248.0.0/eth0,vsstest-vip/255.248.0.0/eth0'
    2010-02-02 11:58:05: CRS_STORAGE_OPTION=2
    2010-02-02 11:58:05: CSS_LEASEDURATION=400
    2010-02-02 11:58:05: DIRPREFIX=
    2010-02-02 11:58:05: DISABLE_OPROCD=0
    2010-02-02 11:58:05: EMBASEJAR_NAME=oemlt.jar
    2010-02-02 11:58:05: EWTJAR_NAME=ewt3.jar
    2010-02-02 11:58:05: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
    2010-02-02 11:58:05: GNS_ADDR_LIST=
    2010-02-02 11:58:05: GNS_ALLOW_NET_LIST=
    2010-02-02 11:58:05: GNS_CONF=false
    2010-02-02 11:58:05: GNS_DENY_ITF_LIST=
    2010-02-02 11:58:05: GNS_DENY_NET_LIST=
    2010-02-02 11:58:05: GNS_DOMAIN_LIST=
    2010-02-02 11:58:05: GPNPCONFIGDIR=/u01/app/11.2.0/grid
    2010-02-02 11:58:05: GPNPGCONFIGDIR=/u01/app/11.2.0/grid
    2010-02-02 11:58:05: GPNP_PA=
    2010-02-02 11:58:05: HELPJAR_NAME=help4.jar
    2010-02-02 11:58:05: HOST_NAME_LIST=vis,vsstest
    2010-02-02 11:58:05: ID=/etc/init.d
    2010-02-02 11:58:05: INIT=/sbin/init
    2010-02-02 11:58:05: IT=/etc/inittab
    2010-02-02 11:58:05: JEWTJAR_NAME=jewt4.jar
    2010-02-02 11:58:05: JLIBDIR=/u01/app/11.2.0/grid/jlib
    2010-02-02 11:58:05: JREDIR=/u01/app/11.2.0/grid/jdk/jre/
    2010-02-02 11:58:06: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
    2010-02-02 11:58:06: MSGFILE=/var/adm/messages
    2010-02-02 11:58:06: NETCFGJAR_NAME=netcfg.jar
    2010-02-02 11:58:06: NETWORKS="eth0"/10.8.0.0:public,"eth1"/192.168.0.0:cluster_interconnect
    2010-02-02 11:58:06: NEW_HOST_NAME_LIST=
    2010-02-02 11:58:06: NEW_NODEVIPS='vis-vip/255.248.0.0/eth0,vsstest-vip/255.248.0.0/eth0'
    2010-02-02 11:58:06: NEW_NODE_NAME_LIST=
    2010-02-02 11:58:06: NEW_PRIVATE_NAME_LIST=
    2010-02-02 11:58:06: NODELIST=vis,vsstest
    2010-02-02 11:58:06: NODE_NAME_LIST=vis,vsstest
    2010-02-02 11:58:06: OCFS_CONFIG=
    2010-02-02 11:58:06: OCRCONFIG=/etc/oracle/ocr.loc
    2010-02-02 11:58:06: OCRCONFIGDIR=/etc/oracle
    2010-02-02 11:58:06: OCRID=
    2010-02-02 11:58:06: OCRLOC=ocr.loc
    2010-02-02 11:58:06: OCR_LOCATIONS=/u01/shared_config/ocr_configuration
    2010-02-02 11:58:06: OLASTGASPDIR=/etc/oracle/lastgasp
    2010-02-02 11:58:06: OLRCONFIG=/etc/oracle/olr.loc
    2010-02-02 11:58:06: OLRCONFIGDIR=/etc/oracle
    2010-02-02 11:58:06: OLRLOC=olr.loc
    2010-02-02 11:58:06: OPROCDCHECKDIR=/etc/oracle/oprocd/check
    2010-02-02 11:58:06: OPROCDDIR=/etc/oracle/oprocd
    2010-02-02 11:58:06: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
    2010-02-02 11:58:06: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
    2010-02-02 11:58:06: ORACLE_BASE=/u01/app/oracle
    2010-02-02 11:58:06: ORACLE_HOME=/u01/app/11.2.0/grid
    2010-02-02 11:58:06: ORACLE_OWNER=oracle
    2010-02-02 11:58:06: ORA_ASM_GROUP=dba
    2010-02-02 11:58:06: ORA_DBA_GROUP=oinstall
    2010-02-02 11:58:06: PRIVATE_NAME_LIST=
    2010-02-02 11:58:06: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
    2010-02-02 11:58:06: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d
    2010-02-02 11:58:06: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
    2010-02-02 11:58:06: RC_KILL=K19
    2010-02-02 11:58:06: RC_KILL_OLD=K96
    2010-02-02 11:58:06: RC_START=S96
    2010-02-02 11:58:06: SCAN_NAME=rac-scan.awc.com
    2010-02-02 11:58:06: SCAN_PORT=1521
    2010-02-02 11:58:06: SCRBASE=/etc/oracle/scls_scr
    2010-02-02 11:58:06: SHAREJAR_NAME=share.jar
    2010-02-02 11:58:06: SILENT=false
    2010-02-02 11:58:06: SO_EXT=so
    2010-02-02 11:58:06: SRVCFGLOC=srvConfig.loc
    2010-02-02 11:58:06: SRVCONFIG=/var/opt/oracle/srvConfig.loc
    2010-02-02 11:58:06: SRVCONFIGDIR=/var/opt/oracle
    2010-02-02 11:58:06: VNDR_CLUSTER=false
    2010-02-02 11:58:06: VOTING_DISKS=/u01/shared_config/voting_disk
    2010-02-02 11:58:06: ### Printing other configuration values ###
    2010-02-02 11:58:06: CLSCFG_EXTRA_PARMS=
    2010-02-02 11:58:06: CRSDelete=0
    2010-02-02 11:58:06: CRSPatch=0
    2010-02-02 11:58:06: DEBUG=
    2010-02-02 11:58:06: DOWNGRADE=
    2010-02-02 11:58:06: HAS_GROUP=oinstall
    2010-02-02 11:58:06: HAS_USER=root
    2010-02-02 11:58:06: HOST=vis
    2010-02-02 11:58:07: IS_SIHA=0
    2010-02-02 11:58:07: OLR_DIRECTORY=/u01/app/11.2.0/grid/cdata
    2010-02-02 11:58:07: OLR_LOCATION=/u01/app/11.2.0/grid/cdata/vis.olr
    2010-02-02 11:58:07: ORA_CRS_HOME=/u01/app/11.2.0/grid
    2010-02-02 11:58:07: SUPERUSER=root
    2010-02-02 11:58:07: UPGRADE=
    2010-02-02 11:58:07: VF_DISCOVERY_STRING=/u01/shared_config/voting_disk
    2010-02-02 11:58:07: addfile=/u01/app/11.2.0/grid/crs/install/crsconfig_addparams
    2010-02-02 11:58:07: crscfg_trace=1
    2010-02-02 11:58:07: crscfg_trace_file=/u01/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_vis.log
    2010-02-02 11:58:07: hosts=
    2010-02-02 11:58:07: oldcrshome=
    2010-02-02 11:58:07: oldcrsver=
    2010-02-02 11:58:07: osdfile=/u01/app/11.2.0/grid/crs/install/s_crsconfig_defs
    2010-02-02 11:58:07: parameters_valid=1
    2010-02-02 11:58:07: paramfile=/u01/app/11.2.0/grid/crs/install/crsconfig_params
    2010-02-02 11:58:07: platform_family=unix
    2010-02-02 11:58:07: srvctl_trc_suff=0
    2010-02-02 11:58:07: unlock_crshome=
    2010-02-02 11:58:07: user_is_superuser=1
    2010-02-02 11:58:07: ### Printing of configuration values complete ###
    2010-02-02 11:58:07: Oracle CRS stack is not configured yet
    2010-02-02 11:58:07: CRS is not yet configured. Hence, will proceed to configure CRS
    2010-02-02 11:58:07: Cluster-wide one-time actions... Done!
    2010-02-02 11:58:17: set owner/group of OCR path
    2010-02-02 11:58:17: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:17: Host name = vis
    2010-02-02 11:58:17: CRS user = oracle
    2010-02-02 11:58:17: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:17: GPnP host = vis
    2010-02-02 11:58:17: Oracle GPnP home = /u01/app/11.2.0/grid/gpnp
    2010-02-02 11:58:17: Oracle GPnP local home = /u01/app/11.2.0/grid/gpnp/vis
    2010-02-02 11:58:17: GPnP directories verified.
    2010-02-02 11:58:17: Checking to see if Oracle CRS stack is already configured
    2010-02-02 11:58:17: Oracle CRS stack is not configured yet
    2010-02-02 11:58:17: ---Checking local gpnp setup...
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" does not exist
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cwallet.sso" does not exist
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr/cwallet.sso" does not exist
    2010-02-02 11:58:18: chk gpnphome /u01/app/11.2.0/grid/gpnp/vis: profile_ok 0 wallet_ok 0 r/o_wallet_ok 0
    2010-02-02 11:58:18: chk gpnphome /u01/app/11.2.0/grid/gpnp/vis: INVALID (bad profile/wallet)
    2010-02-02 11:58:18: ---Checking cluster-wide gpnp setup...
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/profiles/peer/profile.xml" does not exist
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/wallets/peer/cwallet.sso" does not exist
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/wallets/prdr/cwallet.sso" does not exist
    2010-02-02 11:58:18: chk gpnphome /u01/app/11.2.0/grid/gpnp: profile_ok 0 wallet_ok 0 r/o_wallet_ok 0
    2010-02-02 11:58:18: chk gpnphome /u01/app/11.2.0/grid/gpnp: INVALID (bad profile/wallet)
    2010-02-02 11:58:18: gpnp setup checked: local valid? 0 cluster-wide valid? 0
    2010-02-02 11:58:18: gpnp setup: NONE
    2010-02-02 11:58:18: GPNP configuration required
    2010-02-02 11:58:18: Validating for SI-CSS configuration
    2010-02-02 11:58:18: Retrieving OCR main disk location
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc
    2010-02-02 11:58:18: Unable to retrieve ocr disk info
    2010-02-02 11:58:18: Checking to see if any 9i GSD is up
    2010-02-02 11:58:18: libskgxnBase_lib = /etc/ORCLcluster/oracm/lib/libskgxn2.so
    2010-02-02 11:58:18: libskgxn_lib = /opt/ORCLcluster/lib/libskgxn2.so
    2010-02-02 11:58:18: SKGXN library file does not exists
    2010-02-02 11:58:18: OLR location = /u01/app/11.2.0/grid/cdata/vis.olr
    2010-02-02 11:58:18: Oracle CRS Home = /u01/app/11.2.0/grid
    2010-02-02 11:58:18: Validating /etc/oracle/olr.loc file for OLR location /u01/app/11.2.0/grid/cdata/vis.olr
    2010-02-02 11:58:18: /etc/oracle/olr.loc already exists. Backing up /etc/oracle/olr.loc to /etc/oracle/olr.loc.orig
    2010-02-02 11:58:18: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:18: Oracle cluster name = rac-scan
    2010-02-02 11:58:18: OCR locations = /u01/shared_config/ocr_configuration
    2010-02-02 11:58:18: Validating OCR
    2010-02-02 11:58:18: Retrieving OCR location used by previous installations
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrmirrorconfig_loc
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc3
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc4
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc5
    2010-02-02 11:58:18: Checking if OCR sync file exists
    2010-02-02 11:58:18: No need to sync OCR file
    2010-02-02 11:58:18: OCR_LOCATION=/u01/shared_config/ocr_configuration
    2010-02-02 11:58:18: OCR_MIRROR_LOCATION=
    2010-02-02 11:58:18: OCR_MIRROR_LOC3=
    2010-02-02 11:58:18: OCR_MIRROR_LOC4=
    2010-02-02 11:58:19: OCR_MIRROR_LOC5=
    2010-02-02 11:58:19: Current OCR location=
    2010-02-02 11:58:19: Current OCR mirror location=
    2010-02-02 11:58:19: Current OCR mirror loc3=
    2010-02-02 11:58:19: Current OCR mirror loc4=
    2010-02-02 11:58:19: Current OCR mirror loc5=
    2010-02-02 11:58:19: Verifying current OCR settings with user entered values
    2010-02-02 11:58:19: Setting OCR locations in /etc/oracle/ocr.loc
    2010-02-02 11:58:19: Validating OCR locations in /etc/oracle/ocr.loc
    2010-02-02 11:58:19: Checking for existence of /etc/oracle/ocr.loc
    2010-02-02 11:58:19: Backing up /etc/oracle/ocr.loc to /etc/oracle/ocr.loc.orig
    2010-02-02 11:58:19: Setting ocr location /u01/shared_config/ocr_configuration
    2010-02-02 11:58:19: Creating or upgrading Oracle Local Registry (OLR)
    2010-02-02 11:58:20: OLR successfully created or upgraded
    2010-02-02 11:58:20: /u01/app/11.2.0/grid/bin/clscfg -localadd
    2010-02-02 11:58:21: Keys created in the OLR successfully
    2010-02-02 11:58:21: GPnP setup state: none
    2010-02-02 11:58:21: Creating local GPnP setup for clustered node...
    2010-02-02 11:58:21: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:21: Oracle GPnP wallets home = /u01/app/11.2.0/grid/gpnp/vis/wallets
    2010-02-02 11:58:21: Checking if GPnP setup exists
    2010-02-02 11:58:21: /u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cwallet.sso wallet must be created
    2010-02-02 11:58:21: Removing old wallets/certificates, if any
    2010-02-02 11:58:21: Creating GPnP Root Wallet...
    2010-02-02 11:58:21: /u01/app/11.2.0/grid/bin/orapki wallet create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -nologo
    2010-02-02 11:58:22: Creating GPnP Root Certificate...
    2010-02-02 11:58:22: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -self_signed -dn "CN=GPnP_root" -keysize 1024 -validity 9999 -nologo
    2010-02-02 11:58:24: Exporting GPnP Root Certificate...
    2010-02-02 11:58:24: /u01/app/11.2.0/grid/bin/orapki wallet export -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -dn "CN=GPnP_root" -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/root/b64certificate.txt" -nologo
    2010-02-02 11:58:25: Creating GPnP Peer Wallet...
    2010-02-02 11:58:25: /u01/app/11.2.0/grid/bin/orapki wallet create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -auto_login -nologo
    2010-02-02 11:58:25: Creating GPnP Profile Reader Wallet...
    2010-02-02 11:58:25: /u01/app/11.2.0/grid/bin/orapki wallet create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr" -pwd gpnp_wallet1 -auto_login -nologo
    2010-02-02 11:58:26: Creating GPnP PA Wallet...
    2010-02-02 11:58:26: /u01/app/11.2.0/grid/bin/orapki wallet create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -auto_login -nologo
    2010-02-02 11:58:27: Adding private key to GPnP Peer Wallet...
    2010-02-02 11:58:27: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -dn "CN=GPnP_peer" -keysize 1024 -nologo
    2010-02-02 11:58:28: Adding private key to GPnP PA Wallet...
    2010-02-02 11:58:28: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -dn "CN=GPnP_pa" -keysize 1024 -nologo
    2010-02-02 11:58:29: Creating certificate request for GPnP Peer Wallet...
    2010-02-02 11:58:29: /u01/app/11.2.0/grid/bin/orapki wallet export -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -dn "CN=GPnP_peer" -request "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/certreq.txt" -nologo
    2010-02-02 11:58:30: Creating certificate request for GPnP PA Wallet...
    2010-02-02 11:58:30: /u01/app/11.2.0/grid/bin/orapki wallet export -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -dn "CN=GPnP_pa" -request "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/certreq.txt" -nologo
    2010-02-02 11:58:31: Creating certificate for GPnP Peer Wallet...
    2010-02-02 11:58:31: /u01/app/11.2.0/grid/bin/orapki cert create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -request "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/certreq.txt" -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cert.txt" -validity 9999 -nologo
    2010-02-02 11:58:32: Creating certificate for GPnP PA Wallet...
    2010-02-02 11:58:32: /u01/app/11.2.0/grid/bin/orapki cert create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -request "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/certreq.txt" -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/cert.txt" -validity 9999 -nologo
    2010-02-02 11:58:33: Adding Root Certificate TP to GPnP Peer Wallet...
    2010-02-02 11:58:33: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/root/b64certificate.txt" -nologo
    2010-02-02 11:58:34: Adding Root Certificate TP to GPnP Profile Reader Wallet...
    2010-02-02 11:58:34: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/root/b64certificate.txt" -nologo
    2010-02-02 11:58:34: Adding Root Certificate TP to GPnP PA Wallet...
    2010-02-02 11:58:34: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/root/b64certificate.txt" -nologo
    2010-02-02 11:58:35: Adding PA Certificate as a TP into a GPnP Peer Wallet...
    2010-02-02 11:58:35: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/cert.txt" -nologo
    2010-02-02 11:58:36: Adding peer Certificate as a TP into a GPnP PA Wallet...
    2010-02-02 11:58:36: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cert.txt" -nologo
    2010-02-02 11:58:37: Adding PA Certificate as a TP into a GPnP Profile Reader Wallet...
    2010-02-02 11:58:37: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/cert.txt" -nologo
    2010-02-02 11:58:38: Adding peer Certificate as a TP into a GPnP Profile Reader Wallet...
    2010-02-02 11:58:38: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cert.txt" -nologo
    2010-02-02 11:58:39: Adding PA Certificate as a TP into a GPnP Peer Wallet...
    2010-02-02 11:58:39: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -user_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cert.txt" -nologo
    2010-02-02 11:58:40: Adding peer Certificate as a TP into a GPnP PA Wallet...
    2010-02-02 11:58:40: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -user_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/cert.txt" -nologo
    2010-02-02 11:58:41: GPnP Wallets ownership/permissions successfully set.
    2010-02-02 11:58:41: GPnP Wallets successfully created.
    2010-02-02 11:58:41: <--- GPnP wallets successfully created
    2010-02-02 11:58:41: Creating GPnP peer profile --->
    2010-02-02 11:58:41: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:41: Oracle GPnP profiles home = /u01/app/11.2.0/grid/gpnp/vis/profiles
    2010-02-02 11:58:41: Oracle GPnP profiles parameters:
    2010-02-02 11:58:41: paloc==
    2010-02-02 11:58:41: cname=rac-scan=
    2010-02-02 11:58:41: cssdisco=/u01/shared_config/voting_disk=
    2010-02-02 11:58:41: cssld=400=
    2010-02-02 11:58:41: asmdisco==
    2010-02-02 11:58:41: asmspf==
    2010-02-02 11:58:41: netlst="eth0"/10.8.0.0:public,"eth1"/192.168.0.0:cluster_interconnect=
    2010-02-02 11:58:41: ocrid==
    2010-02-02 11:58:41: clusterguid==
    2010-02-02 11:58:41: Checking if GPnP setup exists
    2010-02-02 11:58:41: /u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml profile must be created
    2010-02-02 11:58:41: OCRID is not available, hence not set in GPnP Profile
    2010-02-02 11:58:42: ClusterGUID is not available, hence not set in GPnP Profile
    2010-02-02 11:58:42: gpnptool: run /u01/app/11.2.0/grid/bin/gpnptool create -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -prf -prf_sq=1 -prf_cn=rac-scan -prf_pa="" -hnet=gen -gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.8.0.0" -net1:net_ada="eth0" -net1:net_use="public" -gen:net=net2 -net2:net_ip="192.168.0.0" -net2:net_ada="eth1" -net2:net_use="cluster_interconnect" -css=css -css:css_dis="/u01/shared_config/voting_disk" -css:css_ld=400 -asm=asm -asm:asm_dis="++no-value-at-profile-creation--never-updated-through-ASM++" -asm:asm_spf=""
    2010-02-02 11:58:42: Running as user oracle: /u01/app/11.2.0/grid/bin/gpnptool create -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -prf -prf_sq=1 -prf_cn=rac-scan -prf_pa="" -hnet=gen -gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.8.0.0" -net1:net_ada="eth0" -net1:net_use="public" -gen:net=net2 -net2:net_ip="192.168.0.0" -net2:net_ada="eth1" -net2:net_use="cluster_interconnect" -css=css -css:css_dis="/u01/shared_config/voting_disk" -css:css_ld=400 -asm=asm -asm:asm_dis="++no-value-at-profile-creation--never-updated-through-ASM++" -asm:asm_spf=""
    2010-02-02 11:58:42: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/11.2.0/grid/bin/gpnptool create -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -prf -prf_sq=1 -prf_cn=rac-scan -prf_pa="" -hnet=gen -gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.8.0.0" -net1:net_ada="eth0" -net1:net_use="public" -gen:net=net2 -net2:net_ip="192.168.0.0" -net2:net_ada="eth1" -net2:net_use="cluster_interconnect" -css=css -css:css_dis="/u01/shared_config/voting_disk" -css:css_ld=400 -asm=asm -asm:asm_dis="++no-value-at-profile-creation--never-updated-through-ASM++" -asm:asm_spf="" '
    2010-02-02 11:58:42: Removing file /tmp/fileXUKYkK
    2010-02-02 11:58:42: Successfully removed file: /tmp/fileXUKYkK
    2010-02-02 11:58:42: /bin/su successfully executed
    2010-02-02 11:58:42: gpnptool: rc=0
    2010-02-02 11:58:42: gpnptool output:
    Resulting profile written to "/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml".
    Success.
    2010-02-02 11:58:42: gpnptool: run /u01/app/11.2.0/grid/bin/gpnptool sign -p="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -w="file:/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -rmws
    2010-02-02 11:58:42: Running as user oracle: /u01/app/11.2.0/grid/bin/gpnptool sign -p="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -w="file:/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -rmws
    2010-02-02 11:58:42: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/11.2.0/grid/bin/gpnptool sign -p="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -w="file:/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -rmws '
    2010-02-02 11:58:43: Removing file /tmp/file4E7Vnj
    2010-02-02 11:58:43: Successfully removed file: /tmp/file4E7Vnj
    2010-02-02 11:58:43: /bin/su successfully executed
    2010-02-02 11:58:43: gpnptool: rc=0
    2010-02-02 11:58:43: gpnptool output:
    Resulting profile written to "/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml".
    Success.
    2010-02-02 11:58:43: GPnP peer profile create successfully completed.
    2010-02-02 11:58:43: <--- GPnP peer profile successfully created
    2010-02-02 11:58:43: GPnP local setup successfully created
    2010-02-02 11:58:43: Registering ohasd
    2010-02-02 11:58:43: init file = /u01/app/11.2.0/grid/crs/init/init.ohasd
    2010-02-02 11:58:43: Copying file /u01/app/11.2.0/grid/crs/init/init.ohasd to /etc/init.d directory
    2010-02-02 11:58:43: Setting init.ohasd permission in /etc/init.d directory
    2010-02-02 11:58:43: init file = /u01/app/11.2.0/grid/crs/init/ohasd
    2010-02-02 11:58:43: Copying file /u01/app/11.2.0/grid/crs/init/ohasd to /etc/init.d directory
    2010-02-02 11:58:43: Setting ohasd permission in /etc/init.d directory
    2010-02-02 11:58:43: Removing "/etc/rc.d/rc3.d/S96ohasd"
    2010-02-02 11:58:43: Removing file /etc/rc.d/rc3.d/S96ohasd
    2010-02-02 11:58:43: Failure with return code 1 from command rm /etc/rc.d/rc3.d/S96ohasd
    2010-02-02 11:58:43: Failed to remove file:
    2010-02-02 11:58:43: Creating a link "/etc/rc.d/rc3.d/S96ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:43: Removing "/etc/rc.d/rc5.d/S96ohasd"
    2010-02-02 11:58:43: Removing file /etc/rc.d/rc5.d/S96ohasd
    2010-02-02 11:58:43: Failure with return code 1 from command rm /etc/rc.d/rc5.d/S96ohasd
    2010-02-02 11:58:43: Failed to remove file:
    2010-02-02 11:58:43: Creating a link "/etc/rc.d/rc5.d/S96ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:43: Removing "/etc/rc.d/rc0.d/K19ohasd"
    2010-02-02 11:58:43: Removing file /etc/rc.d/rc0.d/K19ohasd
    2010-02-02 11:58:43: Failure with return code 1 from command rm /etc/rc.d/rc0.d/K19ohasd
    2010-02-02 11:58:43: Failed to remove file:
    2010-02-02 11:58:43: Creating a link "/etc/rc.d/rc0.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:43: Removing "/etc/rc.d/rc1.d/K19ohasd"
    2010-02-02 11:58:43: Removing file /etc/rc.d/rc1.d/K19ohasd
    2010-02-02 11:58:43: Failure with return code 1 from command rm /etc/rc.d/rc1.d/K19ohasd
    2010-02-02 11:58:44: Failed to remove file:
    2010-02-02 11:58:44: Creating a link "/etc/rc.d/rc1.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:44: Removing "/etc/rc.d/rc2.d/K19ohasd"
    2010-02-02 11:58:44: Removing file /etc/rc.d/rc2.d/K19ohasd
    2010-02-02 11:58:44: Failure with return code 1 from command rm /etc/rc.d/rc2.d/K19ohasd
    2010-02-02 11:58:44: Failed to remove file:
    2010-02-02 11:58:44: Creating a link "/etc/rc.d/rc2.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:44: Removing "/etc/rc.d/rc4.d/K19ohasd"
    2010-02-02 11:58:44: Removing file /etc/rc.d/rc4.d/K19ohasd
    2010-02-02 11:58:44: Failure with return code 1 from command rm /etc/rc.d/rc4.d/K19ohasd
    2010-02-02 11:58:44: Failed to remove file:
    2010-02-02 11:58:44: Creating a link "/etc/rc.d/rc4.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:44: Removing "/etc/rc.d/rc6.d/K19ohasd"
    2010-02-02 11:58:44: Removing file /etc/rc.d/rc6.d/K19ohasd
    2010-02-02 11:58:44: Failure with return code 1 from command rm /etc/rc.d/rc6.d/K19ohasd
    2010-02-02 11:58:44: Failed to remove file:
    2010-02-02 11:58:44: Creating a link "/etc/rc.d/rc6.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:44: The file ohasd has been successfully linked to the RC directories
    2010-02-02 11:58:44: Starting ohasd
    2010-02-02 11:58:44: itab entries=
    2010-02-02 11:58:49: Created backup /etc/inittab.no_crs
    2010-02-02 11:58:49: Appending to /etc/inittab.tmp:
    2010-02-02 11:58:50: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null
    2010-02-02 11:58:50: Done updating /etc/inittab.tmp
    2010-02-02 11:58:50: Saved /etc/inittab.crs
    2010-02-02 11:58:50: Installed new /etc/inittab
    2010-02-02 11:58:55: ohasd is starting
    2010-02-02 11:58:55: Checking ohasd
    2010-02-02 11:58:55: ohasd started successfully
    2010-02-02 11:58:55: Creating CRS resources and dependencies
    2010-02-02 11:58:55: Configuring HASD
    2010-02-02 11:58:55: Registering type ora.daemon.type
    2010-02-02 11:58:59: Registering type ora.mdns.type
    2010-02-02 11:59:00: Registering type ora.gpnp.type
    2010-02-02 11:59:01: Registering type ora.gipc.type
    2010-02-02 11:59:02: Registering type ora.cssd.type
    2010-02-02 11:59:04: Registering type ora.cssdmonitor.type
    2010-02-02 11:59:07: Registering type ora.crs.type
    2010-02-02 11:59:08: Registering type ora.evm.type
    2010-02-02 11:59:09: Registering type ora.ctss.type
    2010-02-02 11:59:10: Registering type ora.asm.type
    2010-02-02 11:59:13: Registering type ora.drivers.acfs.type
    2010-02-02 11:59:14: Registering type ora.diskmon.type
    2010-02-02 11:59:34: ADVM/ACFS is configured
    2010-02-02 11:59:35: Successfully created CRS resources for cluster daemon and ASM
    2010-02-02 11:59:35: Checking if initial configuration has been performed
    2010-02-02 11:59:35: Starting CSS in exclusive mode
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.gipcd' on 'vis'
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.mdnsd' on 'vis'
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.gipcd' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.mdnsd' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.gpnpd' on 'vis'
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.gpnpd' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.cssdmonitor' on 'vis'
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.cssdmonitor' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.cssd' on 'vis'
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.diskmon' on 'vis'
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.diskmon' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.cssd' on 'vis' succeeded
    2010-02-02 12:00:04: Querying for existing CSS voting disks
    2010-02-02 12:00:04: Performing initial configuration for cluster
    2010-02-02 12:00:51: Start of resource "ora.ctssd -init" Succeeded
    2010-02-02 12:00:51: Creating or upgrading OCR keys
    2010-02-02 12:00:51: Command return code of 255 (65280) from command: /u01/app/11.2.0/grid/bin/ocrconfig -upgrade oracle oinstall
    2010-02-02 12:00:51: Failed to create Oracle Cluster Registry configuration, rc 255
    2010-02-02 12:00:51: Exiting exclusive mode
    2010-02-02 12:00:51: Command return code of 1 (256) from command: /u01/app/11.2.0/grid/bin/crsctl stop resource ora.crsd -init
    2010-02-02 12:00:51: Stop of resource "ora.crsd -init" failed
    2010-02-02 12:00:51: Failed to stop CRSD
    2010-02-02 12:01:20: Initial cluster configuration failed. See /u01/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_vis.log for details

    Hi,
    I am trying to setup Oracle 11gR2 RAC setup on RHEL 5.4 64-bit machine, during grid installation i am also getting the same error.
    2010-07-12 03:12:42: Removing file /etc/rc.d/rc6.d/K19ohasd
    2010-07-12 03:12:42: Failure with return code 1 from command rm /etc/rc.d/rc6.d/K19ohasd
    2010-07-12 03:12:42: Failed to remove file:
    2010-07-12 03:12:42: Creating a link "/etc/rc.d/rc6.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-07-12 03:12:42: The file ohasd has been successfully linked to the RC directories
    2010-07-12 03:12:42: Starting ohasd
    2010-07-12 03:12:42: itab entries=
    2010-07-12 03:12:47: Created backup /etc/inittab.no_crs
    2010-07-12 03:12:47: Appending to /etc/inittab.tmp:
    2010-07-12 03:12:47: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null
    2010-07-12 03:12:47: Done updating /etc/inittab.tmp
    2010-07-12 03:12:47: Saved /etc/inittab.crs
    2010-07-12 03:12:47: Installed new /etc/inittab
    2010-07-12 03:13:03: ohasd is starting
    2010-07-12 03:13:03: Checking ohasd
    2010-07-12 03:13:03: ohasd started successfully
    2010-07-12 03:13:03: Creating CRS resources and dependencies
    2010-07-12 03:13:03: Configuring HASD
    2010-07-12 03:13:03: Registering type ora.daemon.type
    2010-07-12 03:13:04: Registering type ora.mdns.type
    2010-07-12 03:13:04: Registering type ora.gpnp.type
    2010-07-12 03:13:04: Registering type ora.gipc.type
    2010-07-12 03:13:05: Registering type ora.cssd.type
    2010-07-12 03:13:05: Registering type ora.cssdmonitor.type
    2010-07-12 03:13:06: Registering type ora.crs.type
    2010-07-12 03:13:06: Registering type ora.evm.type
    2010-07-12 03:13:07: Registering type ora.ctss.type
    2010-07-12 03:13:07: Registering type ora.asm.type
    2010-07-12 03:13:08: Registering type ora.drivers.acfs.type
    2010-07-12 03:13:08: Registering type ora.diskmon.type
    2010-07-12 03:13:35: ADVM/ACFS is configured
    2010-07-12 03:13:35: Successfully created CRS resources for cluster daemon and ASM
    2010-07-12 03:13:35: Checking if initial configuration has been performed
    2010-07-12 03:13:35: Starting CSS in exclusive mode
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.gipcd' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.mdnsd' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.mdnsd' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.gipcd' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.gpnpd' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.gpnpd' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.cssdmonitor' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.cssdmonitor' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.cssd' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.diskmon' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.diskmon' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.cssd' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: Querying for existing CSS voting disks
    2010-07-12 03:14:05: Performing initial configuration for cluster
    2010-07-12 03:14:06: Start of resource "ora.ctssd -init" Succeeded
    2010-07-12 03:14:06: Creating or upgrading OCR keys
    2010-07-12 03:14:06: Command return code of 255 (65280) from command: /u01/app/11.2.0/grid/bin/ocrconfig -upgrade oracle oinstall
    2010-07-12 03:14:06: Failed to create Oracle Cluster Registry configuration, rc 255
    2010-07-12 03:14:06: Exiting exclusive mode
    2010-07-12 03:14:06: Command return code of 1 (256) from command: /u01/app/11.2.0/grid/bin/crsctl stop resource ora.crsd -init
    2010-07-12 03:14:06: Stop of resource "ora.crsd -init" failed
    2010-07-12 03:14:06: Failed to stop CRSD
    2010-07-12 03:14:34: Initial cluster configuration failed. See /u01/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_lodvmrhn3.log for details
    Please hel me to resole the issue.
    I have followed exact steps mentioned in the http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnLinuxUsingNFS.php

  • Root.sh failing at node2 during 10g rac installation on vmware

    Hi All,
    I'm very new to Oracle RAC. I was trying to install 10gr2 rac on vmware. But while running root.sh script at node 2 I'm getting error like "Failure at check of Final Oracle Stack" . For the same I tried a lot to find the solution from this forum and also from other sources but did not get any proper solution. So any help from you experts is highly appreciable. Let me tell you how I'm getting this error.
    1.Install vmware and RHEL 4 as guest OS.
    2.Create a virtual machine as RAC1 and configured shared storage by adding 5 virtual disks(1-ocr,1-voting,3-asm)
    3.Then clone RAC1 to a new virtual machine RAC2.
    4.After binding and assigning permissions all raw devices(raw1,raw2,raw3,raw4,raw5) are available in both the virtual machines.
    5. Then create user equivalence for both the system and each node is reach from other node also.
    6. Now when I tried to install Oracle 10gr2 clusterware it got completed at RAC1 and I ran the required scripts but while running root.sh on RAC2 I got the above mentioned error.
    I did OCR check at both the nodes and found both are different. Also the cssd.log gives error message like OCR mismatch.
    Now here my question is as Firewal is disabled and all the configurations are proper though I'm getting the same error.
    Can anyboy provide some suggestion on resolving this issue.
    Thanks

    /dev/raw/raw1 /dev/sdb1
    /dev/raw/raw2 /dev/sdc1
    /dev/raw/raw3 /dev/sdd1
    /dev/raw/raw4 /dev/sde1
    /dev/raw/raw5 /dev/sdf1
    The 1st one is for OCR and the next one is for Voting Disk and the rest are for asm. Also the permission are same across the two virtual machines.
    root:oinstall /dev/raw/raw1
    oracle:oinstall /dev/raw/raw2
    oracle:oinstall /dev/raw/raw3
    oracle:oinstall /dev/raw/raw4
    oracle:oinstall /dev/raw/raw5
    Thanks

  • 11gR2.0.3 Grid Infra Installation

    As I have started configuring DNS, DHCP and GNS got the following error:
    Result: Default user file creation mask check passed
    Checking consistency of file "/etc/resolv.conf" acros
    Checking the file "/etc/resolv.conf" to make sure onl
    File "/etc/resolv.conf" does not have both domain and
    Checking if domain entry in file "/etc/resolv.conf" i
    domain entry in file "/etc/resolv.conf" is consistent
    Checking if search entry in file "/etc/resolv.conf" i
    search entry in file "/etc/resolv.conf" is consistent
    Checking file "/etc/resolv.conf" to make sure that on
    All nodes have one search entry defined in file "/etc
    Checking all nodes to make sure that search entry is
    All nodes of the cluster have same value for 'search'
    Checking DNS response time for an unreachable node
    Node Name Status
    macrac2 failed
    macrac1 failed
    PRVF-5636 : The DNS response time for an unreachable node exceeded "15000" ms on following nodes: macrac2,macrac1
    File "/etc/resolv.conf" is not consistent across nodes
    Check: Time zone consistency
    Result: Time zone consistency check passed

    As I’m dying with this stuff for few days I will be grateful for someone who can really drilled down to the configurations and helps me to overcome the following problems
    My DNS configuration
    Glossary:
    Vbox host name     Full name     Eth0 (public)     Eth1(private)     Eth2 (private)     Eth2 (private)
    macrac1 (a RAC node)     macrac1.amil.com     192.168.2.112     192.168.3.112     192.168.4.112     192.168.5.112
    macrac1 (another RAC node)     macrac1.amil.com     192.168.2.113     192.168.3.113     192.168.4.113     192.168.5.113
    macnam (DNS server)     macnam.amil.com     192.168.2.111     192.168.3.111     192.168.4.111     192.168.5.111
    Gateway: 192.168.2.1     (This is the IP of main windows machine)
    Sub domain: cluster01.amil.com
    MACRAC2 machine configuration and MACRAC1 machine configurations are almost same so I’ve only queried MACRAC2 machine
    [root@macrac2 ~]# cat /etc/resolv.conf
    # Generated by NetworkManager
    search cluster01.amil.com amil.com
    nameserver 192.168.2.111
    [root@macrac2 ~]# cat /etc/hosts
    127.0.0.1 localhost.localdomain localhost
    # Public
    192.168.2.113 macrac2.amil.com macrac2
    192.168.2.112 macrac1.amil.com macrac1
    192.168.2.111 macnam.amil.com macnam
    # Private
    192.168.3.113 macrac2-priv2.amil.com macrac2-priv1
    192.168.4.113 macrac2-priv2.amil.com macrac2-priv2
    192.168.5.113 macrac2-priv3.amil.com macrac2-priv3
    [root@macrac2 ~]# cat /etc/sysconfig/network-scripts/ifcfg-eth0
    DEVICE="eth0"
    NM_CONTROLLED="yes"
    ONBOOT=yes
    TYPE=Ethernet
    BOOTPROTO=none
    IPADDR=192.168.2.113
    PREFIX=24
    NETWORK=192.168.2.0
    GATEWAY=192.168.2.1
    DNS1=192.168.2.111
    DEFROUTE=yes
    IPV4_FAILURE_FATAL=yes
    IPV6INIT=no
    NAME="System eth0"
    UUID=5fb06bd0-0bb0-7ffb-45f1-d6edd65f3e03
    USERCTL=no
    IPV6INIT=no
    DOMAIN="cluster01.amil.com amil.com"
    HWADDR=08:00:27:85:C0:26
    MTU=1500
    [root@macrac2 ~]# cat /etc/sysconfig/network-scripts/ifcfg-eth1
    DEVICE="eth1"
    NM_CONTROLLED="yes"
    ONBOOT=yes
    TYPE=Ethernet
    BOOTPROTO=none
    IPADDR=192.168.3.113
    PREFIX=24
    GATEWAY=192.168.2.1
    DNS1=192.168.2.111
    DEFROUTE=yes
    IPV4_FAILURE_FATAL=yes
    IPV6INIT=no
    NAME="System eth1"
    UUID=9c92fad9-6ecb-3e6c-eb4d-8a47c6f50c04
    USERCTL=no
    IPV6INIT=no
    NETWORK=192.168.2.0
    DOMAIN="cluster01.amil.com amil.com"
    HWADDR=08:00:27:D1:7A:D1
    MTU=1500
    eth2 and eth3 as accordingly.     
    Name server configurations as follow:
    ########################Result################
    [root@macnam named]# cat /etc/hosts
    127.0.0.1 localhost.localdomain localhost
    192.168.2.111 macmac.amil.com macnam
    [root@macnam named]# cat /etc/sysconfig/network-scripts/ifcfg-eth0
    DEVICE="eth0"
    NM_CONTROLLED="yes"
    ONBOOT=yes
    TYPE=Ethernet
    BOOTPROTO=none
    IPADDR=192.168.2.111
    PREFIX=24
    NETWORK=192.168.2.0
    GATEWAY=192.168.2.1
    DNS1=192.168.2.111
    DEFROUTE=yes
    IPV4_FAILURE_FATAL=yes
    IPV6INIT=no
    NAME="System eth0"
    UUID=5fb06bd0-0bb0-7ffb-45f1-d6edd65f3e03
    USERCTL=no
    IPV6INIT=no
    DOMAIN="cluster01.amil.com amil.com"
    HWADDR=08:00:27:F8:22:67
    MTU=1500
    [root@macnam named]# cat /etc/sysconfig/network-scripts/ifcfg-eth1
    DEVICE="eth1"
    NM_CONTROLLED="yes"
    ONBOOT=yes
    TYPE=Ethernet
    BOOTPROTO=none
    IPADDR=192.168.3.111
    PREFIX=24
    GATEWAY=192.168.2.1
    DNS1=192.168.2.111
    DEFROUTE=yes
    IPV4_FAILURE_FATAL=yes
    IPV6INIT=no
    NAME="System eth1"
    UUID=9c92fad9-6ecb-3e6c-eb4d-8a47c6f50c04
    USERCTL=no
    IPV6INIT=no
    NETWORK=192.168.2.0
    DOMAIN="cluster01.amil.com amil.com"
    HWADDR=08:00:27:B4:78:40
    MTU=1500
    eth2 and eth3 as accordingly.     
    vi /etc/resolv.conf
    [root@macnam named]# cat /etc/resolv.conf
    # Generated by NetworkManager
    search cluster01.amil.com amil.com
    nameserver 192.168.2.111
    named.conf
    options {
    listen-on port 53 { any; };
    //# listen-on-v6 port 53 { ::1; };
    directory "/var/named";
    dump-file "/var/named/data/cache_dump.db";
    statistics-file "/var/named/data/named_stats.txt";
    memstatistics-file "/var/named/data/named_mem_stats.txt";
    // allow-query { localhost; };
    recursion yes;
    dnssec-enable yes;
    dnssec-validation yes;
    dnssec-lookaside auto;
    /* Path to ISC DLV key */
    bindkeys-file "/etc/named.iscdlv.key";
    managed-keys-directory "/var/named/dynamic";
    logging {
    channel default_debug {
    file "data/named.run";
    severity dynamic;
    zone "2.168.192.in-addr.arpa" IN {
    type master;
    file "amil.com.reverse";
    allow-update { none; };
    zone "3.168.192.in-addr.arpa" IN {
    type master;
    file "priv.cloud.reverse";
    allow-update { none; };
    zone "4.168.192.in-addr.arpa" IN {
    type master;
    file "priv2.cloud.reverse";
    allow-update { none; };
    zone "5.168.192.in-addr.arpa" IN {
    type master;
    file "priv3.cloud.reverse";
    allow-update { none; };
    zone "amil.com." IN {
    type master;
    file "amil.com.zone";
    notify no;
    zone "." IN {
    type hint;
    file "named.ca";
    include "/etc/named.rfc1912.zones";
    include "/etc/named.root.key";
    These are the files that I’ve created:
    This is my /var/named/ directory
    [root@macnam named]# ls
    amil.com.reverse named.empty priv3.cloud.reverse
    amil.com.zone data named.localhost priv.cloud.reverse
    amil.com.zone~ dynamic named.loopback slaves
    chroot named.ca priv2.cloud.reverse
    Forward zone file
    [root@macnam named]# cat amil.com.zone
    $TTL 1H ; Time to live
    $ORIGIN amil.com.
    @ IN SOA macnam root.amil.com. ( 0 ; serial
    3H ; refresh
    1H ; retry
    1W ; expire
    1D) ; minimum
    A 192.168.2.111
    NS macnam ; name server for amil.com
    macnam A 192.168.2.111
    cluster01-gns A 192.168.2.115 ; A record for the GNS
    macrac1 IN A 192.168.2.112
    macrac2 IN A 192.168.2.113
    macrac1-priv1 IN A 192.168.3.112
    macrac2-priv1 IN A 192.168.3.113
    macrac1-priv2 IN A 192.168.4.112
    macrac2-priv2 IN A 192.168.4.113
    macrac1-priv3 IN A 192.168.5.112
    macrac2-priv3 IN A 192.168.5.113
    ;sub-domain(cluster01.amil.com.) definitions
    $ORIGIN cluster01.amil.com.
    @ IN NS cluster01-gns.amil.com. ; name server for the cluster01-gns.amil.com
     Actually I’m not a Linux networking guy and don’t know why I add these entries as I was following a guide 
    Revers zone files
    This is for eth0
    [root@macnam named]# cat amil.com.reverse
    $ORIGIN 2.168.192.in-addr.arpa.
    $TTL 1H
    @ IN SOA macnam.amil.com. root (
    0 ; serial
    3H ; refresh
    1H ; retry
    1W ; expire
    1H ) ; minimum
    2.168.192.in-addr.arpa. IN NS macnam.amil.com.
    IN NS macnam.amil.com.
    111 IN PTR macnam.amil.com.
    112 IN PTR macrac1.amil.com.
    113 IN PTR macrac2.amil.com.
    115 IN PTR cluster01-gns.amil.com.
    This is for eth1
    [root@macnam named]# cat priv.cloud.reverse
    $ORIGIN 3.168.192.in-addr.arpa.
    $TTL 1H
    @ IN SOA macnam.amil.com. root (
    0 ; serial
    3H ; refresh
    1H ; retry
    1W ; expire
    1H ) ; minimum
    3.168.192.in-addr.arpa. IN NS macnam.amil.com.
    IN NS macnam.amil.com.
    111 IN PTR macnam-priv1.amil.com.
    112 IN PTR macrac1-priv1.amil.com.
    113 IN PTR macrac2-priv1.amil.com.
    This is for eth2
    [root@macnam named]# cat priv2.cloud.reverse
    $ORIGIN 4.168.192.in-addr.arpa.
    $TTL 1H
    @ IN SOA macnam.amil.com. root (
    0 ; serial
    3H ; refresh
    1H ; retry
    1W ; expire
    1H ) ; minimum
    4.168.192.in-addr.arpa. IN NS macnam.amil.com.
    IN NS macnam.amil.com.
    111 IN PTR macnam-priv2.amil.com.
    112 IN PTR macrac1-priv2.amil.com.
    113 IN PTR macrac2-priv2.amil.com.
    This is for eth3
    [root@macnam named]# cat priv3.cloud.reverse
    $ORIGIN 5.168.192.in-addr.arpa.
    $TTL 1H
    @ IN SOA macnam.amil.com. root (
    0 ; serial
    3H ; refresh
    1H ; retry
    1W ; expire
    1H ) ; minimum
    5.168.192.in-addr.arpa. IN NS macnam.amil.com.
    IN NS macnam.amil.com.
    111 IN PTR macnam-priv3.amil.com.
    112 IN PTR macrac1-priv3.amil.com.
    113 IN PTR macrac2-priv3.amil.com.
    Finally this is my dhcp configuration file:
    dhcpd.conf
    [root@macnam named]# cat /etc/dhcp/dhcpd.conf
    # DHCP Server Configuration file.
    # see /usr/share/doc/dhcp*/dhcpd.conf.sample
    # see 'man 5 dhcpd.conf'
    ddns-update-style interim;
    ignore client-updates;
    subnet 192.168.2.0 netmask 255.255.255.0 {
    option routers 192.168.2.1;
    option subnet-mask 255.255.255.0;
    option domain-name "cluster01.amil.com";
    option domain-name-servers 192.168.2.111;
    option time-offset -18000; # Eastern Standard Time
    range 192.168.2.200 192.168.2.240;
    default-lease-time 86400;
    As I have the above configuration I’m getting an error when trying to configure my database and I got the following situations as well:
    [root@macrac2 ~]# dig cluster01-gns.amil.com
    ; <<>> DiG 9.7.3-P3-RedHat-9.7.3-8.P3.el6 <<>> cluster01-gns.amil.com
    ;; global options: +cmd
    ;; Got answer:
    ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 43795
    ;; flags: qr aa rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 1, ADDITIONAL: 1
    ;; QUESTION SECTION:
    ;cluster01-gns.amil.com. IN A
    ;; ANSWER SECTION:
    cluster01-gns.amil.com. 3600 IN A 192.168.2.115
    ;; AUTHORITY SECTION:
    amil.com. 3600 IN NS macnam.amil.com.
    ;; ADDITIONAL SECTION:
    macnam.amil.com. 3600 IN A 192.168.2.111
    ;; Query time: 5 msec
    ;; SERVER: 192.168.2.111#53(192.168.2.111)
    ;; WHEN: Fri Aug 24 08:11:36 2012
    ;; MSG SIZE rcvd: 93
    [root@macrac2 ~]# dig cluster01.amil.com
    ; <<>> DiG 9.7.3-P3-RedHat-9.7.3-8.P3.el6 <<>> cluster01.amil.com
    ;; global options: +cmd
    ;; Got answer:
    ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 7288
    ;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
    ;; QUESTION SECTION:
    ;cluster01.amil.com. IN A
    ;; Query time: 3 msec
    ;; SERVER: 192.168.2.111#53(192.168.2.111)
    ;; WHEN: Fri Aug 24 08:13:31 2012
    ;; MSG SIZE rcvd: 36
    [root@macrac2 ~]# dig sky-scan.cluster01-gns.amil.com
    ; <<>> DiG 9.7.3-P3-RedHat-9.7.3-8.P3.el6 <<>> sky-scan.cluster01-gns.amil.com
    ;; global options: +cmd
    ;; Got answer:
    ;; ->>HEADER<<- opcode: QUERY, status: NXDOMAIN, id: 4932
    ;; flags: qr aa rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 0
    ;; QUESTION SECTION:
    ;sky-scan.cluster01-gns.amil.com. IN A
    ;; AUTHORITY SECTION:
    amil.com. 3600 IN SOA macnam.amil.com. root.amil.com. 0 10800 3600 604800 86400
    ;; Query time: 2 msec
    ;; SERVER: 192.168.2.111#53(192.168.2.111)
    ;; WHEN: Fri Aug 24 08:14:34 2012
    ;; MSG SIZE rcvd: 97
    ########################### BUT ##########################
    [root@macrac2 ~]# su - grid
    [grid@macrac2 ~]$ srvctl config scan
    SCAN name: sky-scan.cluster01.amil.com, Network: 1/192.168.2.0/255.255.255.0/eth0
    SCAN VIP name: scan1, IP: /sky-scan.cluster01.amil.com/192.168.2.201
    SCAN VIP name: scan2, IP: /sky-scan.cluster01.amil.com/192.168.2.202
    SCAN VIP name: scan3, IP: /sky-scan.cluster01.amil.com/192.168.2.203
    [grid@macrac2 ~]$ nslookup macnam.amil.com
    Server: 192.168.2.111
    Address: 192.168.2.111#53
    Name: macnam.amil.com
    Address: 192.168.2.111
    [grid@macrac2 ~]$ nslookup macrac1.amil.com
    Server: 192.168.2.111
    Address: 192.168.2.111#53
    Name: macrac1.amil.com
    Address: 192.168.2.112
    [grid@macrac2 ~]$ nslookup cluster01-gns.amil.com
    Server: 192.168.2.111
    Address: 192.168.2.111#53
    Name: cluster01-gns.amil.com
    Address: 192.168.2.115
    [grid@macrac2 ~]$ nslookup cluster01.amil.com
    Server: 192.168.2.111
    Address: 192.168.2.111#53
    ** server can't find cluster01.amil.com: NXDOMAIN
    [grid@macrac2 ~]$
    Edited by: Ora_Bunny on Aug 23, 2012 7:57 PM

  • Errors in Oracle 11g R2 Grid Infra Installation

    Hi all,
    I went through the steps to install Oracle 11g R2 Infrastructure on RHEL 5.2 (32-bit) in a couple of Vmware machines.
    - As I relied on the Vmwaretool for time sync, I didn't configure SNP.
    - As I don't have a DNS server, I configured the scan-rac in /etc/hosts.
    I know in production this is wrong, but for this testing env it is Ok (according to http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnOEL5UsingVMwareServer2.php)
    All the configuration went Ok and the OUI went on successfully till
    it reached to the last step: "Oracle Cluster Verification Utility" which, as expected, failed.
    It generates the following long and complicated log: http://www.ahmedbaraka.com/temp/installActions.txt
    My question is: Did all the errors in the log result only from the SNP and SCAN issues? Is there any other discovered issues?
    Thanks in advance.

    this could be just from ntp.
    The following note might be of assistance:
    CTSSD Runs in Observer Mode Even Though No Time Sync Software is Running [ID 1054006.1]

  • Root.sh failure during Grid install - segmentation fault for clscfg

    Hi anyone got any idea how to resolve the following error during execution of root.sh on second node of a RAC installation. I see there is a failure when clscfg -localadd is run - perhaps this is the start of the issue. I have no idea what this command is doing
    Any help appreciated
    Installing verison 11.2.0.2 on RHEL 5
    ntpd was NOT running - I ignored this during the pre-reqs at the end of the runInstaller - perhaps this is the issue and i need to start fresh and make sure its running before running root.sh ?
    root.sh....
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root script.
    Now product-specific root actions will be performed.
    Using configuration parameter file: /opt/app/11.2.0/grid/crs/install/crsconfig_params
    Failure with signal 11 from command: 1 /opt/app/11.2.0/grid/bin/clscfg -localadd
    OLR initialization - successful
    Adding daemon to inittab
    ACFS-9200: Supported
    ACFS-9300: ADVM/ACFS distribution files found.
    ACFS-9307: Installing requested ADVM/ACFS software.
    ACFS-9308: Loading installed ADVM/ACFS drivers.
    ACFS-9321: Creating udev for ADVM/ACFS.
    ACFS-9323: Creating module dependencies - this may take some time.
    ACFS-9327: Verifying ADVM/ACFS devices.
    ACFS-9309: ADVM/ACFS installation correctness verified.
    CRS-2672: Attempting to start 'ora.mdnsd' on 'coden-ota-odc'
    CRS-2676: Start of 'ora.mdnsd' on 'coden-ota-odc' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'coden-ota-odc'
    CRS-2676: Start of 'ora.gpnpd' on 'coden-ota-odc' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'coden-ota-odc'
    CRS-2672: Attempting to start 'ora.gipcd' on 'coden-ota-odc'
    CRS-2676: Start of 'ora.cssdmonitor' on 'coden-ota-odc' succeeded
    CRS-2676: Start of 'ora.gipcd' on 'coden-ota-odc' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'coden-ota-odc'
    CRS-2672: Attempting to start 'ora.diskmon' on 'coden-ota-odc'
    CRS-2676: Start of 'ora.diskmon' on 'coden-ota-odc' succeeded
    CRS-2676: Start of 'ora.cssd' on 'coden-ota-odc' succeeded
    Start of resource "ora.ctssd" failed
    CRS-2672: Attempting to start 'ora.ctssd' on 'coden-ota-odc'
    CRS-2674: Start of 'ora.ctssd' on 'coden-ota-odc' failed
    CRS-4000: Command Start failed, or completed with errors.
    Cluster Time Synchronisation Service start in exclusive mode failed at /opt/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 6455.
    /opt/app/11.2.0/grid/perl/bin/perl -I/opt/app/11.2.0/grid/perl/lib -I/opt/app/11.2.0/grid/crs/install /opt/app/11.2.0/grid/crs/install/rootcrs.pl execution failed
    I executed the /opt/app/11.2.0/grid/bin/clscfg to see what the result was and it returns a Segmentation Fault to std err
    Edited by: 787789 on Nov 10, 2010 6:58 AM

    Hi,
    here is one document you can go for work around but it is on windows platform but similar error as you posted *CRS Installation Failed with "failed to configure Oracle Cluster Registry with CLSCFG, ret 9" [ID 851742.1]*
    Thanks

  • PASSWORDLESS SSH SETUP fails during Grid installation

    Hello,
    OS and VM setup:
    There are 2 base physical Oracle servers ( Model # Oracle SPARC T4-2 , Solaris 11.1 ). On both machine “Oracle VM for SPARC “ software is installed and logical domains are configured with Solaris 11.1. Oracle RAC 2 node cluster is being setup between the Logical Domain in each servers.
    Objective:
    We are planning to install and configure Oracle RAC 11g R2 (11.2.0.4) on two Oracle VM machines. Pre-installation check script (runcluvfy.sh) on RAC node is completed without errors/warning.
    Issue:
    During oracle grid infrastructure installation, SSH setup failing and on shell prompt is showing JVM CRASH AT LIB.....
    I am not able to proceed with RAC setup due to this issue. 
    Your suggestions/assistance will be greatly appreciated.
    Thanks.

    Hello,
    Thanks for your reponse. Please find below OUI log:
    -------------------------------------------------------- OUI Log ---------------------------------------------------------
    Using paramFile: /u01/Stage/grid/install/oraparam.ini
    Checking Temp space: must be greater than 180 MB.   Actual 190266 MB    Passed
    Checking swap space: must be greater than 150 MB.   Actual 196682 MB    Passed
    Checking monitor: must be configured to display at least 256 colors    Failed <<<<
        >>> Could not execute /usr/bin/xdpyinfo
    Some requirement checks failed. You must fulfill these requirements before
    continuing with the installation,Continue? (y/n) [n]
    >>> Ignoring required pre-requisite failures. Continuing...
    The commandline for unzip:
    /u01/Stage/grid/install/unzip -qqqo ../stage/Components/oracle.jdk/1.5.0.51.10/1/DataFiles/\*.jar -d /tmp/OraInstall2013-10-30_10-00-46AM
    Using the umask value '022' available from oraparam.ini
    Execvp of the child jre : the cmdline is /tmp/OraInstall2013-10-30_10-00-46AM/jdk/jre/bin/java, and the argv is
    /tmp/OraInstall2013-10-30_10-00-46AM/jdk/jre/bin/java
    -Doracle.installer.library_loc=/tmp/OraInstall2013-10-30_10-00-46AM/oui/lib/solaris
    -Doracle.installer.oui_loc=/tmp/OraInstall2013-10-30_10-00-46AM/oui
    -Doracle.installer.bootstrap=TRUE
    -Doracle.installer.startup_location=/u01/Stage/grid/install
    -Doracle.installer.jre_loc=/tmp/OraInstall2013-10-30_10-00-46AM/jdk/jre
    -Doracle.installer.nlsEnabled="TRUE"
    -Doracle.installer.prereqConfigLoc=
    -Doracle.installer.unixVersion=5.11
    -Doracle.install.setup.workDir=/u01/Stage/grid
    -Dawt.toolkit=sun.awt.X11.XToolkit
    -d64
    -mx150m
    -cp
    /tmp/OraInstall2013-10-30_10-00-46AM::/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/remoteinterfaces.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/instcommon.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/instcrs.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/ssh.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/installcommons_1.0.0b.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/cvu.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/OraPrereq.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/jsch.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/ojdbc5.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/OraPrereqChecks.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/prov_fixup.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/orai18n-mapping.jar:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/orai18n-utility.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/OraInstaller.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/oneclick.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/xmlparserv2.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/share.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/OraInstallerNet.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/emCfg.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/emocmutl.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/OraPrereq.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/jsch.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/ssh.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/remoteinterfaces.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/http_client.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/OraSuiteInstaller.jar:../stage/Components/oracle.swd.opatch/11.2.0.4.0/1/DataFiles/jlib/opatch.jar:../stage/Components/oracle.swd.opatch/11.2.0.4.0/1/DataFiles/jlib/opatchactions.jar:../stage/Components/oracle.swd.opatch/11.2.0.4.0/1/DataFiles/jlib/opatchprereq.jar:../stage/Components/oracle.swd.opatch/11.2.0.4.0/1/DataFiles/jlib/opatchutil.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/OraCheckPoint.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstImages.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp_de.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp_es.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp_fr.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp_it.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp_ja.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp_ko.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp_pt_BR.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp_zh_CN.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/InstHelp_zh_TW.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/oracle_ice.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/help4.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/help4-nls.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/ewt3.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/ewt3-swingaccess.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/ewt3-nls.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/swingaccess.jar::/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/jewt4.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/jewt4-nls.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/orai18n-collation.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/orai18n-mapping.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/ojmisc.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/xml.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/srvm.jar:/tmp/OraInstall2013-10-30_10-00-46AM/oui/jlib/srvmasm.jar
    oracle.install.ivw.crs.driver.CRSInstaller
    -scratchPath
    /tmp/OraInstall2013-10-30_10-00-46AM
    -sourceLoc
    /u01/Stage/grid/install/../stage/products.xml
    -sourceType
    network
    -timestamp
    2013-10-30_10-00-46AM
    -formCluster
    INFO: Loading data from: jar:file:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/installcommons_1.0.0b.jar!/oracle/install/driver/oui/resource/ConfigCommandMappings.xml
    INFO: Loading beanstore from jar:file:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/installcommons_1.0.0b.jar!/oracle/install/driver/oui/resource/ConfigCommandMappings.xml
    INFO: Restoring class oracle.install.driver.oui.ConfigCmdMappings from jar:file:/tmp/OraInstall2013-10-30_10-00-46AM/ext/jlib/installcommons_1.0.0b.jar!/oracle/install/driver/oui/resource/ConfigCommandMappings.xml
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:config-data]
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:id in the bean:configcmd
    INFO: Setting value for the property:platformcmdmap in the bean:configcmd
    INFO: Setting value for the property:configcmds in the bean:configcmdmappings
    INFO: Inventory exists: false
    INFO: Registering setup bean
    INFO: Building Flow
    INFO: Loading condition class oracle.install.commons.flow.condition.SystemPropertyCondition
    INFO: Building the flow graph
    INFO: Loaded state AutoUpdatesOptionsUI
    INFO: Loaded state UpdatesListUI
    INFO: Loaded state finishupdates
    INFO: Building the flow graph
    INFO: Loaded state init
    INFO: Loaded state autoupdatesDecider
    INFO: Loaded state AutoUpdatesOptionsUI
    INFO: Loaded state UpdatesListUI
    INFO: Loaded state supportedOSCheck
    INFO: Loaded state ClusterInfoUI
    INFO: Loaded state InstallOptionsUI
    INFO: Loaded state ChecklistUI
    INFO: Loaded state InstallTypeUI
    INFO: Loaded state QuickInstallUI
    INFO: Loaded state productLanguage
    INFO: Loaded state flowDecider
    INFO: Loaded state CRSNodeSelectionUI
    INFO: Loaded state SCANInformationUI
    INFO: Loaded state getASMSNMPPassword
    INFO: Loaded state GridPlugPlayInfoUI
    INFO: Loaded state CRSNodeInformationUI
    INFO: Loaded state getSubnetInformation
    INFO: Loaded state ConfigWizard
    INFO: Loaded state NetworkInterfaceUI
    INFO: Loaded state StorageOptionUI
    INFO: Loaded state ASMDiskGroupOption
    INFO: Loaded state CreateASMDiskGroup
    INFO: Loaded state ASMInstanceCredentialsGUI
    INFO: Loaded state OCRStorageUI
    INFO: Loaded state VDSKStorageUI
    INFO: Loaded state FailureIsolationUI
    INFO: Loaded state getPrivilegedOSGroups
    INFO: Loaded state preInstallLocation
    INFO: Loaded state InstallLocationUI
    INFO: Loaded state CRSInstallLocationUI
    INFO: Loaded state inventory
    INFO: Loaded state prereqExecutionDecider
    INFO: Loaded state performChecks
    INFO: Loaded state showSummary
    INFO: Loaded state setup
    INFO: Loaded state finish
    INFO: Linking states
    INFO: State[ASMDiskGroupOption]: route=createdg; to=CreateASMDiskGroup
    INFO: State[ASMDiskGroupOption]: route=nocreatedg; to=ASMInstanceCredentialsGUI
    INFO: Condition of state[ASMDiskGroupOption]: route=mismatched; to=CreateASMDiskGroup
    INFO: State[ASMInstanceCredentialsGUI]: route=FRESH_HA_INSTALL; to=getPrivilegedOSGroups
    INFO: State[ASMInstanceCredentialsGUI]: route=IPMI_SUPPORTED; to=FailureIsolationUI
    INFO: State[ASMInstanceCredentialsGUI]: route=IPMI_UNSUPPORTED; to=getPrivilegedOSGroups
    INFO: Condition of state[ASMInstanceCredentialsGUI]: route=inventory; to=inventory
    INFO: Condition of state[ASMInstanceCredentialsGUI]: route=prereq; to=prereqExecutionDecider
    INFO: State[AutoUpdatesOptionsUI]: route=NO_AUTO_UPDATES; to=supportedOSCheck
    INFO: State[AutoUpdatesOptionsUI]: route=success; to=UpdatesListUI
    INFO: State[CRSInstallLocationUI]: route=INVENTORY_ABSENT; to=inventory
    INFO: State[CRSInstallLocationUI]: route=success; to=prereqExecutionDecider
    INFO: Condition of state[CRSInstallLocationUI]: route=matched; to=prereqExecutionDecider
    INFO: State[CRSNodeInformationUI]: route=success; to=getSubnetInformation
    INFO: State[CRSNodeSelectionUI]: route=GI_HOME_UPGRADE; to=getPrivilegedOSGroups
    INFO: State[CRSNodeSelectionUI]: route=NON_GI_HOME_UPGRADE; to=SCANInformationUI
    INFO: State[CRSNodeSelectionUI]: route=wizard; to=ConfigWizard
    INFO: State[ChecklistUI]: route=success; to=InstallTypeUI
    INFO: State[ClusterInfoUI]: route=success; to=QuickInstallUI
    INFO: State[ConfigWizard]: route=config; to=NetworkInterfaceUI
    INFO: State[ConfigWizard]: route=giupgrade; to=prereqExecutionDecider
    INFO: State[ConfigWizard]: route=upgrade; to=SCANInformationUI
    INFO: State[CreateASMDiskGroup]: route=success; to=ASMInstanceCredentialsGUI
    INFO: State[FailureIsolationUI]: route=success; to=getPrivilegedOSGroups
    INFO: State[GridPlugPlayInfoUI]: route=success; to=CRSNodeInformationUI
    INFO: State[InstallLocationUI]: route=INVENTORY_ABSENT; to=inventory
    INFO: State[InstallLocationUI]: route=success; to=prereqExecutionDecider
    INFO: State[InstallOptionsUI]: route=crs; to=InstallTypeUI
    INFO: State[InstallOptionsUI]: route=success; to=productLanguage
    INFO: State[InstallTypeUI]: route=advanced; to=productLanguage
    INFO: State[InstallTypeUI]: route=typical; to=ClusterInfoUI
    INFO: Condition of state[InstallTypeUI]: route=matched; to=productLanguage
    INFO: State[NetworkInterfaceUI]: route=success; to=StorageOptionUI
    INFO: State[OCRStorageUI]: route=success; to=VDSKStorageUI
    INFO: State[QuickInstallUI]: route=ASM; to=CreateASMDiskGroup
    INFO: State[QuickInstallUI]: route=inventory; to=inventory
    INFO: State[QuickInstallUI]: route=prereq; to=prereqExecutionDecider
    INFO: State[SCANInformationUI]: route=noupgradeASM; to=getPrivilegedOSGroups
    INFO: State[SCANInformationUI]: route=upgradeASM; to=getASMSNMPPassword
    INFO: State[StorageOptionUI]: route=ASM; to=ASMDiskGroupOption
    INFO: State[StorageOptionUI]: route=SHARED_FILE_SYSTEM; to=OCRStorageUI
    INFO: State[UpdatesListUI]: route=success; to=supportedOSCheck
    INFO: State[VDSKStorageUI]: route=IPMI_SUPPORTED; to=FailureIsolationUI
    INFO: State[VDSKStorageUI]: route=IPMI_UNSUPPORTED; to=getPrivilegedOSGroups
    INFO: State[autoupdatesDecider]: route=AUTO_UPDATES_DISABLE; to=supportedOSCheck
    INFO: State[autoupdatesDecider]: route=AUTO_UPDATES_STATE_SKIP; to=supportedOSCheck
    INFO: State[autoupdatesDecider]: route=success; to=AutoUpdatesOptionsUI
    INFO: Condition of state[autoupdatesDecider]: route=matched; to=InstallOptionsUI
    INFO: State[flowDecider]: route=FRESH_CRS_INSTALL; to=GridPlugPlayInfoUI
    INFO: State[flowDecider]: route=FRESH_HA_INSTALL; to=CreateASMDiskGroup
    INFO: State[flowDecider]: route=SWONLY_INSTALL; to=getPrivilegedOSGroups
    INFO: State[flowDecider]: route=UPGRADE_CRS; to=CRSNodeSelectionUI
    INFO: State[flowDecider]: route=UPGRADE_HA; to=getASMSNMPPassword
    INFO: State[flowDecider]: route=UPGRADE_HA_NO_ASM_PASS; to=getPrivilegedOSGroups
    INFO: State[getASMSNMPPassword]: route=success; to=getPrivilegedOSGroups
    INFO: State[getPrivilegedOSGroups]: route=success; to=preInstallLocation
    INFO: Condition of state[getPrivilegedOSGroups]: route=matched; to=preInstallLocation
    INFO: State[getSubnetInformation]: route=success; to=NetworkInterfaceUI
    INFO: State[getSubnetInformation]: route=wizard; to=ConfigWizard
    INFO: State[init]: route=DOWNLOAD_UPDATES_ONLY; to=AutoUpdatesOptionsUI
    INFO: State[init]: route=success; to=autoupdatesDecider
    INFO: State[inventory]: route=success; to=prereqExecutionDecider
    INFO: State[performChecks]: route=success; to=showSummary
    INFO: State[preInstallLocation]: route=CRS_NO; to=InstallLocationUI
    INFO: State[preInstallLocation]: route=CRS_YES; to=CRSInstallLocationUI
    INFO: Condition of state[preInstallLocation]: route=matched; to=CRSInstallLocationUI
    INFO: State[prereqExecutionDecider]: route=executeprereqs; to=performChecks
    INFO: State[prereqExecutionDecider]: route=ignoreprereqs; to=showSummary
    INFO: State[productLanguage]: route=productlanguage_yes; to=flowDecider
    INFO: Condition of state[productLanguage]: route=matched; to=flowDecider
    INFO: State[setup]: route=success; to=finish
    INFO: State[showSummary]: route=success; to=setup
    INFO: State[supportedOSCheck]: route=success; to=InstallOptionsUI
    INFO: State[AutoUpdatesOptionsUI]: route=NO_AUTO_UPDATES; to=finishupdates
    INFO: State[AutoUpdatesOptionsUI]: route=success; to=UpdatesListUI
    INFO: State[UpdatesListUI]: route=DOWNLOAD_UPDATES_FINISHED; to=finishupdates
    INFO: Successfully built the flow
    INFO: Opening bean stores from which the beans can be loaded
    INFO: Loading beanstore from a given input stream
    INFO: Translating external format into raw format
    INFO: Loading flow data beans
    INFO: Loading beans from Properties Bean Store. [BeanStoreName:beanstore]
    INFO: Setting value for the property:oracle_install_crs_ClusterNodeList in the bean:CRSInstallSettings
    INFO: Setting value for the property:ORACLE_HOME in the bean:CRSInstallSettings
    INFO: Setting value for the property:ORACLE_BASE in the bean:CRSInstallSettings
    INFO: Setting value for the property:CRSInstallSettings in the bean:CRSSetupBean
    INFO: Setting value for the property:oracle_install_asm_DiskGroup in the bean:ASMSettings
    INFO: Setting value for the property:ASMSettings in the bean:CRSSetupBean
    INFO: Setting value for the property:ORACLE_HOME in the bean:HAInstallSettings
    INFO: Setting value for the property:ORACLE_BASE in the bean:HAInstallSettings
    INFO: Setting value for the property:HAInstallSettings in the bean:CRSSetupBean
    INFO: Setting value for the property:CentralInventorySettings in the bean:CRSSetupBean
    INFO: Setting value for the property:oracle_install_autoupdates_myOracleSupportCredentials in the bean:AutoUpdatesInstallSettings
    INFO: Setting value for the property:oracle_install_autoupdates_httpProxySettings in the bean:AutoUpdatesInstallSettings
    INFO: Setting value for the property:AutoUpdatesInstallSettings in the bean:CRSSetupBean
    INFO: Setting value for the property:OCMSettings in the bean:CRSSetupBean
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:beanstore]
    INFO: Setting value for the property:oracle_install_crs_ClusterNodeList in the bean:CRSInstallSettings
    INFO: Setting value for the property:oracle_install_crs_SCANPortNumber in the bean:CRSInstallSettings
    INFO: Setting value for the property:oracle_install_crs_VotingDiskRedundancy in the bean:CRSInstallSettings
    INFO: Setting value for the property:oracle_install_crs_OCRRedundancy in the bean:CRSInstallSettings
    INFO: Setting value for the property:ORACLE_HOME in the bean:CRSInstallSettings
    INFO: Setting value for the property:ORACLE_BASE in the bean:CRSInstallSettings
    INFO: Setting value for the property:CRSInstallSettings in the bean:CRSSetupBean
    INFO: Setting value for the property:oracle_install_asm_DiskGroupAUSize in the bean:oracle_install_asm_DiskGroup
    INFO: Setting value for the property:oracle_install_asm_DiskGroup in the bean:ASMSettings
    INFO: Setting value for the property:ASMSettings in the bean:CRSSetupBean
    INFO: Setting value for the property:ORACLE_HOME in the bean:HAInstallSettings
    INFO: Setting value for the property:ORACLE_BASE in the bean:HAInstallSettings
    INFO: Setting value for the property:HAInstallSettings in the bean:CRSSetupBean
    INFO: Setting value for the property:CentralInventorySettings in the bean:CRSSetupBean
    INFO: Setting value for the property:oracle_install_autoupdates_myOracleSupportCredentials in the bean:AutoUpdatesInstallSettings
    INFO: Setting value for the property:oracle_install_autoupdates_httpProxySettings in the bean:AutoUpdatesInstallSettings
    INFO: Setting value for the property:AutoUpdatesInstallSettings in the bean:CRSSetupBean
    INFO: Set value for bean CRSSetupBean
    INFO: Loading beans from Properties Bean Store. [BeanStoreName:beanstore]
    INFO: Setting value for the property:ORACLE_HOME in the bean:HAInstallSettings
    INFO: Setting value for the property:ORACLE_BASE in the bean:HAInstallSettings
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Properties Bean Store. [BeanStoreName:beanstore]
    INFO: Setting value for the property:oracle_install_crs_ClusterNodeList in the bean:CRSInstallSettings
    INFO: Setting value for the property:ORACLE_HOME in the bean:CRSInstallSettings
    INFO: Setting value for the property:ORACLE_BASE in the bean:CRSInstallSettings
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Properties Bean Store. [BeanStoreName:beanstore]
    INFO: Setting value for the property:oracle_install_autoupdates_myOracleSupportCredentials in the bean:AutoUpdatesInstallSettings
    INFO: Setting value for the property:oracle_install_autoupdates_httpProxySettings in the bean:AutoUpdatesInstallSettings
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Properties Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Properties Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Properties Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Properties Bean Store. [BeanStoreName:beanstore]
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:beanstore]
    INFO: Closing bean stores from which the beans can be loaded
    INFO: Registering the flow views
    INFO: Adding View[type: oracle.install.commons.base.interview.common.view.PrereqGUI viewId: null uiType: null]
    INFO: oracle.install.commons.base.interview.common.view.PrereqGUI added to View Type Registry with the key as [PrereqUI]
    INFO: Adding View[type: oracle.install.commons.base.interview.common.view.SummaryGUI viewId: null uiType: null]
    INFO: oracle.install.commons.base.interview.common.view.SummaryGUI added to View Type Registry with the key as [SummaryUI]
    INFO: Adding View[type: oracle.install.commons.base.interview.common.view.SetupGUI viewId: null uiType: null]
    INFO: oracle.install.commons.base.interview.common.view.SetupGUI added to View Type Registry with the key as [SetupUI]
    INFO: Adding View[type: oracle.install.ivw.common.view.InventoryUI viewId: null uiType: null]
    INFO: oracle.install.ivw.common.view.InventoryUI added to View Type Registry with the key as [InventoryUI]
    INFO: Adding View[type: oracle.install.ivw.common.view.ProductLanguageGUI viewId: ProductLanguageUI uiType: null]
    INFO: oracle.install.ivw.common.view.ProductLanguageGUI added to View Type Registry with the key as [ProductLanguageUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.FinishGUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.FinishGUI added to View Type Registry with the key as [FinishUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.InstallOptionsUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.InstallOptionsUI added to View Type Registry with the key as [InstallOptionsUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.ChecklistGUI viewId: ChecklistUI uiType: null]
    INFO: oracle.install.ivw.crs.view.ChecklistGUI added to View Type Registry with the key as [ChecklistUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.InstallTypeGUI viewId: InstallTypeUI uiType: null]
    INFO: oracle.install.ivw.crs.view.InstallTypeGUI added to View Type Registry with the key as [InstallTypeUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.QuickInstallGUI viewId: QuickInstallUI uiType: null]
    INFO: oracle.install.ivw.crs.view.QuickInstallGUI added to View Type Registry with the key as [QuickInstallUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.InstallLocationUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.InstallLocationUI added to View Type Registry with the key as [InstallLocationUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.CRSInstallLocationGUI viewId: CRSInstallLocationUI uiType: null]
    INFO: oracle.install.ivw.crs.view.CRSInstallLocationGUI added to View Type Registry with the key as [CRSInstallLocationUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.GridPlugPlayInfoUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.GridPlugPlayInfoUI added to View Type Registry with the key as [GridPlugPlayInfoUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.ClusterConfigGUI viewId: ClusterConfigUI uiType: null]
    INFO: oracle.install.ivw.crs.view.ClusterConfigGUI added to View Type Registry with the key as [ClusterConfigUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.NetworkInterfaceUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.NetworkInterfaceUI added to View Type Registry with the key as [NetworkInterfaceUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.StorageOptionUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.StorageOptionUI added to View Type Registry with the key as [StorageOptionUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.ASMDiskGroupCreationGUI viewId: ASMDiskGroupCreationUI uiType: null]
    INFO: oracle.install.ivw.crs.view.ASMDiskGroupCreationGUI added to View Type Registry with the key as [ASMDiskGroupCreationUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.OCRStorageUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.OCRStorageUI added to View Type Registry with the key as [OCRStorageUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.VDSKStorageUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.VDSKStorageUI added to View Type Registry with the key as [VDSKStorageUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.FailureIsolationUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.FailureIsolationUI added to View Type Registry with the key as [FailureIsolationUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.ASMInstanceCredentialsGUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.ASMInstanceCredentialsGUI added to View Type Registry with the key as [ASMInstanceCredentialsGUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.CRSNodeSelectionUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.CRSNodeSelectionUI added to View Type Registry with the key as [CRSNodeSelectionUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.SCANInformationUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.SCANInformationUI added to View Type Registry with the key as [SCANInformationUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.PrivilegedOSGroupsGUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.PrivilegedOSGroupsGUI added to View Type Registry with the key as [PrivilegedOSGroupsUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.ClusterInfoUI viewId: ClusterInfoUI uiType: null]
    INFO: oracle.install.ivw.crs.view.ClusterInfoUI added to View Type Registry with the key as [ClusterInfoUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.ASMSNMPPasswordGUI viewId: ASMSNMPPasswordGUI uiType: null]
    INFO: oracle.install.ivw.crs.view.ASMSNMPPasswordGUI added to View Type Registry with the key as [ASMSNMPPasswordGUI]
    INFO: Adding View[type: oracle.install.ivw.common.view.AutoUpdatesOptionsUI viewId: AutoUpdatesOptionsUI uiType: null]
    INFO: oracle.install.ivw.common.view.AutoUpdatesOptionsUI added to View Type Registry with the key as [AutoUpdatesOptionsUI]
    INFO: Adding View[type: oracle.install.ivw.common.view.UpdatesListUI viewId: UpdatesListUI uiType: null]
    INFO: oracle.install.ivw.common.view.UpdatesListUI added to View Type Registry with the key as [UpdatesListUI]
    INFO: Adding View[type: oracle.install.ivw.common.view.FinishUpdatesUI viewId: FinishUpdatesUI uiType: null]
    INFO: oracle.install.ivw.common.view.FinishUpdatesUI added to View Type Registry with the key as [FinishUpdatesUI]
    INFO: Adding View[type: oracle.install.ivw.crs.view.ASMDiskGroupOptionGUI viewId: null uiType: null]
    INFO: oracle.install.ivw.crs.view.ASMDiskGroupOptionGUI added to View Type Registry with the key as [ASMDiskGroupOptionUI]
    INFO: Initial values of Setup Properties :
    PROPERTY                                               VALUE                                     
    ASMSettings                                            oracle.install.asm.bean.ASMSettings@6124e9
                                                            35                                        
    AutoUpdatesInstallSettings                             oracle.install.ivw.common.bean.AutoUpdates
                                                            InstallSettings@3c03dfcb                  
    COLLECTOR_IGNORE_CONFIGURATION                         false                                     
    COLLECTOR_IGNORE_FAILURES                              false                                     
    COLLECTOR_RESPONSE_FILE                                                                          
    CRSInstallSettings                                     oracle.install.ivw.crs.bean.CRSInstallSett
                                                            ings@1fbbc779                             
    CentralInventorySettings                               oracle.install.ivw.common.bean.CentralInve
                                                            ntorySettings@3435ec9                     
    ClusterNodes                                           {}                                        
    ClusterwareType                                        UNKNOWN                                   
    DECLINE_SECURITY_UPDATES                               false                                     
    FROM_LOCATION                                          /u01/Stage/grid/install/../stage/products.
                                                            xml                                       
    HAInstallSettings                                      oracle.install.ivw.ha.bean.HAInstallSettin
                                                            gs@1faac07d                               
    MYORACLESUPPORT_PASSWORD                               *Protected value, not to be logged*       
    MYORACLESUPPORT_USERNAME                                                                         
    OCMSettings                                            oracle.install.ivw.common.bean.OCMSettings
                                                            @411b1d80                                 
    ORACLE_BASE                                            /u01/app/oracle/product/11.2.0.4/base     
    ORACLE_HOME                                            /u01/app/oracle/product/11.2.0.4/grid     
    ORACLE_HOSTNAME                                        oradbracvm1.mrmwr.gov.om                  
    PROXY_HOST                                                                                       
    PROXY_PORT                                                                                       
    PROXY_PWD                                              *Protected value, not to be logged*       
    PROXY_USER                                                                                       
    SECURITY_UPDATES_VIA_MYORACLESUPPORT                   true                                      
    SELECTED_LANGUAGES                                     {"en"}                                    
    oracle_install_WindowsSystemDirectory                                                            
    oracle_install_asm_DiskGroup                           oracle.install.asm.bean.DiskGroupSettings@
                                                            3e4ac866                                  
    oracle_install_asm_DiskGroupAUSize                     1                                         
    oracle_install_asm_MigrateASM                          false                                     
    oracle_install_asm_UseExistingDG                       false                                     
    oracle_install_autoupdates_httpProxyPort               0                                         
    oracle_install_autoupdates_httpProxySettings           oracle.install.ivw.common.bean.HttpProxySe
                                                            ttings@2bf09a31                           
    oracle_install_autoupdates_myOracleSupportCredentials  oracle.install.ivw.common.bean.MyOracleSup
                                                            portSettings@2259a735                     
    oracle_install_autoupdates_selected                    false                                     
    oracle_install_crs_AdvancedInstall                     false                                     
    oracle_install_crs_AutoConfig                          false                                     
    oracle_install_crs_ClusterName                                                                   
    oracle_install_crs_ClusterNodeList                                                               
    oracle_install_crs_ConfigureGNS                        true                                      
    oracle_install_crs_LaunchASMCA                         false                                     
    oracle_install_crs_LaunchCRSInst                       false                                     
    oracle_install_crs_LaunchCRSUpgrd                      false                                     
    oracle_install_crs_LaunchCluvfy                        false                                     
    oracle_install_crs_LaunchRootBat                       false                                     
    oracle_install_crs_LaunchUpdateNodeList                false                                     
    oracle_install_crs_OCRLocations                        {}                                        
    oracle_install_crs_OCRRedundancy                       2                                         
    oracle_install_crs_SCANName                                                                      
    oracle_install_crs_SCANPortNumber                      0                                         
    oracle_install_crs_StorageOption                       0                                         
    oracle_install_crs_UseIPMI                             false                                     
    oracle_install_crs_VotingDiskLocations                 {}                                        
    oracle_install_crs_VotingDiskRedundancy                2                                         
    oracle_install_crs_isConfigWizard                      false                                     
    oracle_install_crs_isRolling                           true                                      
    INFO: Launching Oracle Grid Infrastructure
    INFO: Started executing the flow in INTERACTIVE mode
    INFO: Waiting for completion of background operations
    INFO: Finishing all forked tasks at state init
    INFO: Waiting for completion all forked tasks at state init
    INFO: All forked task are completed at state init
    INFO: Completed background operations
    INFO: Executing action at state init
    INFO: Completed executing action at state <init>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <init>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Validating view at state <init>
    INFO: Completed validating view at state <init>
    INFO: Validating state <init>
    WARNING: Validation disabled for the state init
    INFO: Completed validating state <init>
    INFO: Verifying route success
    INFO: Checking condition at state <autoupdatesDecider>
    INFO: Successfully checked condition at state <autoupdatesDecider>
    INFO: Checking condition at state <InstallTypeUI>
    INFO: Successfully checked condition at state <InstallTypeUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Executing action at state autoupdatesDecider
    INFO: Completed executing action at state <autoupdatesDecider>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <autoupdatesDecider>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Validating view at state <autoupdatesDecider>
    INFO: Completed validating view at state <autoupdatesDecider>
    INFO: Validating state <autoupdatesDecider>
    WARNING: Validation disabled for the state autoupdatesDecider
    INFO: Completed validating state <autoupdatesDecider>
    INFO: Reading shiphome metadata from /u01/Stage/grid/install/../stage/shiphomeproperties.xml
    INFO: Loading beanstore from file:/u01/Stage/grid/install/../stage/shiphomeproperties.xml
    INFO: Translating external format into raw format
    INFO: Restoring class oracle.install.driver.oui.ShiphomeMetadata from file:/u01/Stage/grid/install/../stage/shiphomeproperties.xml
    INFO: Loading beans from Xml Bean Store. [BeanStoreName:shiphome-metadata]
    INFO: Setting value for the property:properties in the bean:shiphome-metadata
    INFO: Verifying route success
    INFO: Get view named [AutoUpdatesOptionsUI]
    INFO: View for [AutoUpdatesOptionsUI] is oracle.install.ivw.common.view.AutoUpdatesOptionsUI[,0,0,0x0,invalid,layout=java.awt.FlowLayout,alignmentX=0.0,alignmentY=0.0,border=,flags=9,maximumSize=,minimumSize=,preferredSize=]
    INFO: Initializing view <AutoUpdatesOptionsUI> at state <AutoUpdatesOptionsUI>
    INFO: Completed initializing view <AutoUpdatesOptionsUI> at state <AutoUpdatesOptionsUI>
    INFO: Displaying view <AutoUpdatesOptionsUI> at state <AutoUpdatesOptionsUI>
    INFO: Completed displaying view <AutoUpdatesOptionsUI> at state <AutoUpdatesOptionsUI>
    INFO: Loading view <AutoUpdatesOptionsUI> at state <AutoUpdatesOptionsUI>
    INFO: Completed loading view <AutoUpdatesOptionsUI> at state <AutoUpdatesOptionsUI>
    INFO: Localizing view <AutoUpdatesOptionsUI> at state <AutoUpdatesOptionsUI>
    INFO: Completed localizing view <AutoUpdatesOptionsUI> at state <AutoUpdatesOptionsUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Executing action at state AutoUpdatesOptionsUI
    INFO: Completed executing action at state <AutoUpdatesOptionsUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <AutoUpdatesOptionsUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Validating view at state <AutoUpdatesOptionsUI>
    INFO: Completed validating view at state <AutoUpdatesOptionsUI>
    INFO: Validating state <AutoUpdatesOptionsUI>
    INFO: Completed validating state <AutoUpdatesOptionsUI>
    INFO: No updates will be downloaded or applied
    INFO: Checking condition at state <InstallTypeUI>
    INFO: Successfully checked condition at state <InstallTypeUI>
    INFO: Verifying route NO_AUTO_UPDATES
    INFO: Checking condition at state <InstallTypeUI>
    INFO: Successfully checked condition at state <InstallTypeUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Executing action at state supportedOSCheck
    INFO: Completed executing action at state <supportedOSCheck>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <supportedOSCheck>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Validating view at state <supportedOSCheck>
    INFO: Completed validating view at state <supportedOSCheck>
    INFO: Validating state <supportedOSCheck>
    INFO: Verifying target environment...
    INFO: Checking whether the IP address of the localhost could be determined...
    INFO: Completed verification of target environment.
    INFO: Verifying setup for installer validations
    INFO: Completed validating state <supportedOSCheck>
    INFO: Verifying route success
    INFO: Checking condition at state <InstallTypeUI>
    INFO: Successfully checked condition at state <InstallTypeUI>
    INFO: Get view named [InstallOptionsUI]
    INFO: View for [InstallOptionsUI] is oracle.install.ivw.crs.view.InstallOptionsUI@144683c2
    INFO: Initializing view <InstallOptionsUI> at state <InstallOptionsUI>
    INFO: Is CRS Installed false
    INFO: Completed initializing view <InstallOptionsUI> at state <InstallOptionsUI>
    INFO: Displaying view <InstallOptionsUI> at state <InstallOptionsUI>
    INFO: Completed displaying view <InstallOptionsUI> at state <InstallOptionsUI>
    INFO: Loading view <InstallOptionsUI> at state <InstallOptionsUI>
    INFO: Completed loading view <InstallOptionsUI> at state <InstallOptionsUI>
    INFO: Localizing view <InstallOptionsUI> at state <InstallOptionsUI>
    INFO: Completed localizing view <InstallOptionsUI> at state <InstallOptionsUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Executing action at state InstallOptionsUI
    INFO: InstallOption Action Entering and Exiting execute
    INFO: Completed executing action at state <InstallOptionsUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <InstallOptionsUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: CRS config selected
    INFO: Validating view at state <InstallOptionsUI>
    INFO: Completed validating view at state <InstallOptionsUI>
    INFO: Validating state <InstallOptionsUI>
    INFO: getInstallOption: CRS_CONFIG
    INFO: Is CRS Installed false
    INFO: isCRSInstalled: false
    INFO: isHAInstalled: false
    INFO: isCRSConfigured: false
    INFO: isHAConfigured: false
    INFO: isLocalCSSConfigured: false
    INFO: existingCRSOrLocalCSSVersion: null
    INFO: Completed validating state <InstallOptionsUI>
    INFO: Detecting system information
    INFO: InstallOptionsAction Actions.transition called
    INFO: Verifying route crs
    INFO: Checking condition at state <InstallTypeUI>
    INFO: Successfully checked condition at state <InstallTypeUI>
    INFO: Get view named [InstallTypeUI]
    INFO: View for [InstallTypeUI] is oracle.install.ivw.crs.view.InstallTypeGUI[,0,0,0x0,invalid,layout=java.awt.GridBagLayout,alignmentX=0.0,alignmentY=0.0,border=,flags=9,maximumSize=,minimumSize=,preferredSize=]
    INFO: Initializing view <InstallTypeUI> at state <InstallTypeUI>
    INFO: Completed initializing view <InstallTypeUI> at state <InstallTypeUI>
    INFO: Displaying view <InstallTypeUI> at state <InstallTypeUI>
    INFO: Completed displaying view <InstallTypeUI> at state <InstallTypeUI>
    INFO: checking for 92 RAC existence
    INFO: Loading view <InstallTypeUI> at state <InstallTypeUI>
    INFO: Completed loading view <InstallTypeUI> at state <InstallTypeUI>
    INFO: Localizing view <InstallTypeUI> at state <InstallTypeUI>
    INFO: Gathering system details...
    INFO: Completed localizing view <InstallTypeUI> at state <InstallTypeUI>
    INFO: Waiting for completion of background operations
    INFO: Finishing all forked tasks at state InstallTypeUI
    INFO: Waiting for completion all forked tasks at state InstallTypeUI
    INFO: All forked task are completed at state InstallTypeUI
    INFO: Completed background operations
    INFO: Executing action at state InstallTypeUI
    INFO: Completed executing action at state <InstallTypeUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <InstallTypeUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Validating view at state <InstallTypeUI>
    INFO: Completed validating view at state <InstallTypeUI>
    INFO: Validating state <InstallTypeUI>
    INFO: Completed validating state <InstallTypeUI>
    INFO: Verifying route advanced
    INFO: Checking condition at state <productLanguage>
    INFO: Successfully checked condition at state <productLanguage>
    INFO: Checking condition at state <getPrivilegedOSGroups>
    INFO: Successfully checked condition at state <getPrivilegedOSGroups>
    INFO: Checking condition at state <preInstallLocation>
    INFO: Successfully checked condition at state <preInstallLocation>
    INFO: Checking condition at state <CRSInstallLocationUI>
    INFO: Successfully checked condition at state <CRSInstallLocationUI>
    INFO: Get view named [ProductLanguageUI]
    INFO: View for [ProductLanguageUI] is oracle.install.ivw.common.view.ProductLanguageGUI@3ff5d699
    INFO: Initializing view <ProductLanguageUI> at state <productLanguage>
    INFO: Completed initializing view <ProductLanguageUI> at state <productLanguage>
    INFO: Displaying view <ProductLanguageUI> at state <productLanguage>
    INFO: Fetching Available Languages...
    INFO: Completed displaying view <ProductLanguageUI> at state <productLanguage>
    INFO: Loading view <ProductLanguageUI> at state <productLanguage>
    INFO: Completed loading view <ProductLanguageUI> at state <productLanguage>
    INFO: Localizing view <ProductLanguageUI> at state <productLanguage>
    INFO: Completed localizing view <ProductLanguageUI> at state <productLanguage>
    INFO: Waiting for completion of background operations
    INFO: Finishing all forked tasks at state productLanguage
    INFO: Waiting for completion all forked tasks at state productLanguage
    INFO: All forked task are completed at state productLanguage
    INFO: Completed background operations
    INFO: Executing action at state productLanguage
    INFO: Completed executing action at state <productLanguage>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <productLanguage>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: The languages in which the product will be installed are [ar, en]
    INFO: Validating view at state <productLanguage>
    INFO: Completed validating view at state <productLanguage>
    INFO: Validating state <productLanguage>
    INFO: Using default Validator configured in the Action class oracle.install.ivw.common.action.ProductLanguageAction
    INFO: Completed validating state <productLanguage>
    INFO: Verifying route productlanguage_yes
    INFO: Checking condition at state <getPrivilegedOSGroups>
    INFO: Successfully checked condition at state <getPrivilegedOSGroups>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Executing action at state flowDecider
    INFO: Completed executing action at state <flowDecider>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <flowDecider>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Validating view at state <flowDecider>
    INFO: Completed validating view at state <flowDecider>
    INFO: Validating state <flowDecider>
    WARNING: Validation disabled for the state flowDecider
    INFO: Completed validating state <flowDecider>
    INFO: Verifying route FRESH_CRS_INSTALL
    INFO: Checking condition at state <getPrivilegedOSGroups>
    INFO: Successfully checked condition at state <getPrivilegedOSGroups>
    INFO: Checking condition at state <preInstallLocation>
    INFO: Successfully checked condition at state <preInstallLocation>
    INFO: Checking condition at state <CRSInstallLocationUI>
    INFO: Successfully checked condition at state <CRSInstallLocationUI>
    INFO: Get view named [GridPlugPlayInfoUI]
    INFO: View for [GridPlugPlayInfoUI] is oracle.install.ivw.crs.view.GridPlugPlayInfoUI@42293b53
    INFO: Initializing view <GridPlugPlayInfoUI> at state <GridPlugPlayInfoUI>
    INFO: GridPlugPlayInfoUI entering onEvent
    INFO: Gathering system details...
    INFO: Gathering system details...
    INFO: Gathering system details...
    INFO: Gathering system details...
    INFO: Gathering system details...
    INFO: checking for 92 RAC existence
    INFO: Gathering system details...
    INFO: Completed initializing view <GridPlugPlayInfoUI> at state <GridPlugPlayInfoUI>
    INFO: Displaying view <GridPlugPlayInfoUI> at state <GridPlugPlayInfoUI>
    INFO: Completed displaying view <GridPlugPlayInfoUI> at state <GridPlugPlayInfoUI>
    INFO: Loading view <GridPlugPlayInfoUI> at state <GridPlugPlayInfoUI>
    INFO: GridPlugPlayInfoUI entering onEvent
    INFO: Completed loading view <GridPlugPlayInfoUI> at state <GridPlugPlayInfoUI>
    INFO: Localizing view <GridPlugPlayInfoUI> at state <GridPlugPlayInfoUI>
    INFO: Completed localizing view <GridPlugPlayInfoUI> at state <GridPlugPlayInfoUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Executing action at state GridPlugPlayInfoUI
    INFO: Completed executing action at state <GridPlugPlayInfoUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <GridPlugPlayInfoUI>
    INFO: Bad Chars Found :_
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: GridPlugPlayInfoUI entering processInput
    INFO: Validating view at state <GridPlugPlayInfoUI>
    INFO: Completed validating view at state <GridPlugPlayInfoUI>
    INFO: Validating state <GridPlugPlayInfoUI>
    INFO: Validating Cluster Name
    INFO: Validating SCAN Information
    INFO: validating SCAN name for emptiness and bad chars
    INFO: validating SCAN port for emptiness
    INFO: validating SCAN port for bad characters
    INFO: checking for 92 RAC existence
    INFO: Gathering system details...
    INFO: Environment variable SKIP_ALL_SCAN_VIP_VALIDATION is not set.
    INFO: Validating SCAN VIP
    INFO: Completed validating state <GridPlugPlayInfoUI>
    INFO: Verifying route success
    INFO: GridPlugPlayInfoUI entering onEvent
    INFO: Get view named [ClusterConfigUI]
    INFO: View for [ClusterConfigUI] is oracle.install.ivw.crs.view.ClusterConfigGUI@2a134eca
    INFO: Initializing view <ClusterConfigUI> at state <CRSNodeInformationUI>
    INFO: Completed initializing view <ClusterConfigUI> at state <CRSNodeInformationUI>
    INFO: Displaying view <ClusterConfigUI> at state <CRSNodeInformationUI>
    INFO: Completed displaying view <ClusterConfigUI> at state <CRSNodeInformationUI>
    INFO: Loading view <ClusterConfigUI> at state <CRSNodeInformationUI>
    INFO: Completed loading view <ClusterConfigUI> at state <CRSNodeInformationUI>
    INFO: Localizing view <ClusterConfigUI> at state <CRSNodeInformationUI>
    INFO: Completed localizing view <ClusterConfigUI> at state <CRSNodeInformationUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Executing action at state CRSNodeInformationUI
    INFO: Checking cluster configuration details
    INFO: checking for 92 RAC existence
    INFO: Gathering system details...
    INFO: Gathering system details...
    INFO: Completed executing action at state <CRSNodeInformationUI>
    INFO: Waiting for completion of background operations
    INFO: Completed background operations
    INFO: Moved to state <CRSNodeInformationUI>
    INFO: SSH Support Manager logs will be written to /tmp/OraInstall2013-10-30_10-00-46AM/sshsetup1_2013-10-30_10-00-46AM.log
    INFO: Establishing SSH connectivity between the selected nodes. This may take several minutes. Please wait...
    INFO: SSH Setup policy used: BIDIRECTIONAL
    ------------------------------------------------------------ End OUI Logs -----------------------------------------------------------------------------------
    Thanks.

  • 11g R2 RAC - Grid Infrastructure installation - "root.sh" fails on node#2

    Hi there,
    I am trying to create a two node 11g R2 RAC on OEL 5.5 (32-bit) using VMWare virtual machines. I have correctly configured both nodes. Cluster Verification utility returns on following error \[which I believe can be ignored]:
    Checking daemon liveness...
    Liveness check failed for "ntpd"
    Check failed on nodes:
    rac2,rac1
    PRVF-5415 : Check to see if NTP daemon is running failed
    Clock synchronization check using Network Time Protocol(NTP) failed
    Pre-check for cluster services setup was unsuccessful on all the nodes.
    While Grid Infrastructure installation (for a Cluster option), things go very smooth until I run "root.sh" on node# 2. orainstRoot.sh ran OK on both. "root.sh" run OK on node# 1 and ends with:
    Checking swap space: must be greater than 500 MB.   Actual 1967 MB    Passed
    The inventory pointer is located at /etc/oraInst.loc
    The inventory is located at /u01/app/oraInventory
    *'UpdateNodeList' was successful.*
    *[root@rac1 ~]#*
    "root.sh" fails on rac2 (2nd node) with following error:
    CRS-2672: Attempting to start 'ora.evmd' on 'rac2'
    CRS-2676: Start of 'ora.evmd' on 'rac2' succeeded
    Timed out waiting for the CRS stack to start.
    *[root@rac2 ~]#*
    I know this info may not be enough to figure out what the problem may be. Please let me know what should I look for to find the issue and fix it. Its been like almost two weeks now :-(
    Regards
    Amer

    Hi Zheng,
    ocssd.log is HUGE. So I am putting few of the last lines in the log file hoping they may give some clue:
    2011-07-04 19:49:24.007: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 2180 > margin 1500  cur_ms 36118424 lastalive 36116244
    2011-07-04 19:49:26.005: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 4150 > margin 1500 cur_ms 36120424 lastalive 36116274
    2011-07-04 19:49:26.006: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 4180 > margin 1500  cur_ms 36120424 lastalive 36116244
    2011-07-04 19:49:27.997: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:27.997: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:33.001: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:33.001: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:37.996: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:37.996: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:43.000: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:43.000: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:48.004: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:48.005: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:12.003: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:12.008: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1660 > margin 1500 cur_ms 36166424 lastalive 36164764
    2011-07-04 19:50:12.009: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1660 > margin 1500  cur_ms 36166424 lastalive 36164764
    2011-07-04 19:50:15.796: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 2130 > margin 1500  cur_ms 36170214 lastalive 36168084
    2011-07-04 19:50:16.996: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:16.996: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:17.826: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1540 > margin 1500 cur_ms 36172244 lastalive 36170704
    2011-07-04 19:50:17.826: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1570 > margin 1500  cur_ms 36172244 lastalive 36170674
    2011-07-04 19:50:21.999: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:21.999: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:26.011: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1740 > margin 1500 cur_ms 36180424 lastalive 36178684
    2011-07-04 19:50:26.011: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1620 > margin 1500  cur_ms 36180424 lastalive 36178804
    2011-07-04 19:50:27.004: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:27.004: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:28.002: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1700 > margin 1500 cur_ms 36182414 lastalive 36180714
    2011-07-04 19:50:28.002: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1790 > margin 1500  cur_ms 36182414 lastalive 36180624
    2011-07-04 19:50:31.998: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:31.998: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:37.001: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:37.002: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    *<end of log file>*And the alertrac2.log contains:
    *[root@rac2 rac2]# cat alertrac2.log*
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2011-07-02 16:43:51.571
    [client(16134)]CRS-2106:The OLR location /u01/grid/oracle/product/11.2.0/grid/cdata/rac2.olr is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/client/ocrconfig_16134.log.
    2011-07-02 16:43:57.125
    [client(16134)]CRS-2101:The OLR was formatted using version 3.
    2011-07-02 16:44:43.214
    [ohasd(16188)]CRS-2112:The OLR service started on node rac2.
    2011-07-02 16:45:06.446
    [ohasd(16188)]CRS-2772:Server 'rac2' has been assigned to pool 'Free'.
    2011-07-02 16:53:30.061
    [ohasd(16188)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-02 16:53:55.042
    [cssd(17674)]CRS-1713:CSSD daemon is started in exclusive mode
    2011-07-02 16:54:38.334
    [cssd(17674)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    [cssd(17674)]CRS-1636:The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1 and is terminating; details at (:CSSNM00006:) in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log
    2011-07-02 16:54:38.464
    [cssd(17674)]CRS-1603:CSSD on node rac2 shutdown by user.
    2011-07-02 16:54:39.174
    [ohasd(16188)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'rac2'.
    2011-07-02 16:55:43.430
    [cssd(17945)]CRS-1713:CSSD daemon is started in clustered mode
    2011-07-02 16:56:02.852
    [cssd(17945)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    2011-07-02 16:56:04.061
    [cssd(17945)]CRS-1605:CSSD voting file is online: ORCL:DATA; details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log.
    2011-07-02 16:56:18.350
    [cssd(17945)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
    2011-07-02 16:56:29.283
    [ctssd(18020)]CRS-2403:The Cluster Time Synchronization Service on host rac2 is in observer mode.
    2011-07-02 16:56:29.551
    [ctssd(18020)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac1.
    2011-07-02 16:56:29.615
    [ctssd(18020)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 16:56:29.616
    [ctssd(18020)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 16:56:29.641
    [ctssd(18020)]CRS-2401:The Cluster Time Synchronization Service started on host rac2.
    [client(18052)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(18056)]CRS-10001:ACFS-9322: done.
    2011-07-02 17:01:40.963
    [ohasd(16188)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.asm'. Details at (:CRSPE00111:) in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ohasd/ohasd.log.
    [client(18590)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(18594)]CRS-10001:ACFS-9322: done.
    2011-07-02 17:27:46.385
    [ctssd(18020)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 17:27:46.385
    [ctssd(18020)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 17:46:48.717
    [crsd(22519)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:49.641
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:51.459
    [crsd(22553)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:51.776
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:53.928
    [crsd(22574)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:53.956
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:55.834
    [crsd(22592)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:56.273
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:57.762
    [crsd(22610)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:58.631
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:00.259
    [crsd(22628)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:00.968
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:02.513
    [crsd(22645)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:03.309
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:05.081
    [crsd(22663)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:05.770
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:07.796
    [crsd(22681)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:08.257
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:10.733
    [crsd(22699)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:11.739
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:13.547
    [crsd(22732)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:14.111
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:14.112
    [ohasd(16188)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
    2011-07-02 17:58:18.459
    [ctssd(18020)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 17:58:18.459
    [ctssd(18020)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    [client(26883)]CRS-10001:ACFS-9200: Supported
    2011-07-02 18:13:34.627
    [ctssd(18020)]CRS-2405:The Cluster Time Synchronization Service on host rac2 is shutdown by user
    2011-07-02 18:13:42.368
    [cssd(17945)]CRS-1603:CSSD on node rac2 shutdown by user.
    2011-07-02 18:15:13.877
    [client(27222)]CRS-2106:The OLR location /u01/grid/oracle/product/11.2.0/grid/cdata/rac2.olr is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/client/ocrconfig_27222.log.
    2011-07-02 18:15:14.011
    [client(27222)]CRS-2101:The OLR was formatted using version 3.
    2011-07-02 18:15:23.226
    [ohasd(27261)]CRS-2112:The OLR service started on node rac2.
    2011-07-02 18:15:23.688
    [ohasd(27261)]CRS-8017:location: /etc/oracle/lastgasp has 2 reboot advisory log files, 0 were announced and 0 errors occurred
    2011-07-02 18:15:24.064
    [ohasd(27261)]CRS-2772:Server 'rac2' has been assigned to pool 'Free'.
    2011-07-02 18:16:29.761
    [ohasd(27261)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-02 18:16:30.190
    [gpnpd(28498)]CRS-2328:GPNPD started on node rac2.
    2011-07-02 18:16:41.561
    [cssd(28562)]CRS-1713:CSSD daemon is started in exclusive mode
    2011-07-02 18:16:49.111
    [cssd(28562)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    2011-07-02 18:16:49.166
    [cssd(28562)]CRS-1605:CSSD voting file is online: ORCL:DATA; details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log.
    [cssd(28562)]CRS-1636:The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1 and is terminating; details at (:CSSNM00006:) in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log
    2011-07-02 18:17:01.122
    [cssd(28562)]CRS-1603:CSSD on node rac2 shutdown by user.
    2011-07-02 18:17:06.917
    [ohasd(27261)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'rac2'.
    2011-07-02 18:17:23.602
    [mdnsd(28485)]CRS-5602:mDNS service stopping by request.
    2011-07-02 18:17:36.217
    [gpnpd(28732)]CRS-2328:GPNPD started on node rac2.
    2011-07-02 18:17:43.673
    [cssd(28794)]CRS-1713:CSSD daemon is started in clustered mode
    2011-07-02 18:17:49.826
    [cssd(28794)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    2011-07-02 18:17:49.865
    [cssd(28794)]CRS-1605:CSSD voting file is online: ORCL:DATA; details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log.
    2011-07-02 18:18:03.049
    [cssd(28794)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
    2011-07-02 18:18:06.160
    [ctssd(28861)]CRS-2403:The Cluster Time Synchronization Service on host rac2 is in observer mode.
    2011-07-02 18:18:06.220
    [ctssd(28861)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac1.
    2011-07-02 18:18:06.238
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 18:18:06.239
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 18:18:06.794
    [ctssd(28861)]CRS-2401:The Cluster Time Synchronization Service started on host rac2.
    [client(28891)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(28895)]CRS-10001:ACFS-9322: done.
    2011-07-02 18:18:33.465
    [crsd(29020)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:33.575
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:35.757
    [crsd(29051)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:36.129
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:38.596
    [crsd(29066)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:39.146
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:41.058
    [crsd(29085)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:41.435
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:44.255
    [crsd(29101)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:45.165
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:47.013
    [crsd(29121)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:47.409
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:50.071
    [crsd(29136)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:50.118
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:51.843
    [crsd(29156)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:52.373
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:54.361
    [crsd(29171)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:54.772
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:56.620
    [crsd(29202)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:57.104
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:58.997
    [crsd(29218)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:59.301
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:59.302
    [ohasd(27261)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
    2011-07-02 18:49:58.070
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 18:49:58.070
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 19:21:33.362
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 19:21:33.362
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 19:52:05.271
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 19:52:05.271
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 20:22:53.696
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 20:22:53.696
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 20:53:43.949
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 20:53:43.949
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 21:24:32.990
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 21:24:32.990
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 21:55:21.907
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 21:55:21.908
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 22:26:45.752
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 22:26:45.752
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 22:57:54.682
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 22:57:54.683
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 23:07:28.603
    [cssd(28794)]CRS-1612:Network communication with node rac1 (1) missing for 50% of timeout interval.  Removal of this node from cluster in 14.020 seconds
    2011-07-02 23:07:35.621
    [cssd(28794)]CRS-1611:Network communication with node rac1 (1) missing for 75% of timeout interval.  Removal of this node from cluster in 7.010 seconds
    2011-07-02 23:07:39.629
    [cssd(28794)]CRS-1610:Network communication with node rac1 (1) missing for 90% of timeout interval.  Removal of this node from cluster in 3.000 seconds
    2011-07-02 23:07:42.641
    [cssd(28794)]CRS-1632:Node rac1 is being removed from the cluster in cluster incarnation 205080558
    2011-07-02 23:07:44.751
    [cssd(28794)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac2 .
    2011-07-02 23:07:45.326
    [ctssd(28861)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac2.
    2011-07-04 19:46:26.008
    [ohasd(27261)]CRS-8011:reboot advisory message from host: rac1, component: mo155738, with time stamp: L-2011-07-04-19:44:43.318
    [ohasd(27261)]CRS-8013:reboot advisory message text: clsnomon_status: need to reboot, unexpected failure 8 received from CSS
    *[root@rac2 rac2]#* This log file start with complaint that OLR is not accessible. Here is what I see (rca2):
    -rw------- 1 root oinstall 272756736 Jul  2 18:18 /u01/grid/oracle/product/11.2.0/grid/cdata/rac2.olrAnd I guess rest of the problems start with this.

  • Installation grid infra 11g r2  error

    OEL 5.4
    11R2 Grid Infra for Standalone
    when starting 'Automatic Storage Managment Configuration Assistant' i get error INS-20802 (during installation)
    INFO: Command /opt/u02/app/product/11.2.0/dbhome_1/bin/asmca -silent -oui_internal -configureASM -diskString /dev/oracleasm/disks -diskGroupName DATA -diskLi
    INFO: ... GenericInternalPlugIn.handleProcess() entered.
    INFO: ... GenericInternalPlugIn: getting configAssistantParmas.
    INFO: ... GenericInternalPlugIn: checking secretArguments.
    INFO: ... GenericInternalPlugIn: starting read loop.
    INFO: Read: SYS_PASSWORD_PROMPT
    INFO: Processing: SYS_PASSWORD_PROMPT for argument tag -sysAsmPassword
    INFO: Read: ASMSNMP_PASSWORD_PROMPT
    INFO: Processing: ASMSNMP_PASSWORD_PROMPT for argument tag -asmMonitorPassword
    INFO: End of argument passing to stdin
    INFO: Read:
    INFO: Read: Configuring ASM failed with the following message:
    INFO: Read: Adding Monitor user failed. The following error occured:
    INFO: Read: ORA-00922: missing or invalid option
    INFO: Read:
    INFO: Read:
    INFO: Completed Plugin named: Automatic Storage Management Configuration Assistant
    have idea ?

    Hi,
    the error doesn't tell me anything but I can tell you how I am used to do it. My open source tool kit is installing Grid Infrastructure with a command like:
    /var/opt/oracle/repository/11.2.0/distribution/grid/runInstaller -silent \
      -responseFile /opt/oracle/otk/1.0/conf/installManager/response/11_2_0_1_GRID.rsp \
      FROM_LOCATION=/var/opt/oracle/repository/11.2.0/distribution/grid/stage/products.xml \
      -ignoreSysPrereqs -logLevel info oracle.install.asm.diskGroup.name=DATA01 \
      oracle.install.asm.diskGroup.redundancy=EXTERNAL \
      oracle.install.asm.diskGroup.disks=ORCL:DISK01 \
      oracle.install.asm.diskGroup.diskDiscoveryString=ORCL:*response file is available at:
    http://oratoolkit.cvs.sourceforge.net/viewvc/*checkout*/oratoolkit/core/x.y/conf/installManager/response/11_2_0_1_GRID.rsp?revision=1.2
    maybe this helps.
    Furthermore see the following blog:
    http://brianbontrager.blogspot.com/
    since Grid Infrastructure is not working out of the box. ;)
    Cheers,
    David
    OCP 9i
    http://www.oratoolkit.ch/otn.php

  • VIP is not failed over to surviving nodes in oracle 11.2.0.2 grid infra

    Hi ,
    It is a 8 node 11.2.0.2 grid infra.
    While pulling both cables from public nic the VIP is not failed over to surviving nodes in 2 nodes but remainng nodes VIP is failed over to surviving node in the same cluster. Please help me on this.
    If we will remove the power from these servers VIP is failed over to surviving nodes
    Public nic's are in bonding.
    grdoradr105:/apps/grid/grdhome/sh:+ASM5> ./crsstat.sh |grep -i vip |grep -i 101
    ora.grdoradr101.vip ONLINE OFFLINE
    grdoradr101:/apps/grid/grdhome:+ASM1> cat /proc/net/bonding/bond0
    Ethernet Channel Bonding Driver: v3.4.0-1 (October 7, 2008)
    Bonding Mode: fault-tolerance (active-backup)
    Primary Slave: None
    Currently Active Slave: eth0
    MII Status: up
    MII Polling Interval (ms): 100
    Up Delay (ms): 0
    Down Delay (ms): 0
    Slave Interface: eth0
    MII Status: up
    Speed: 100 Mbps
    Duplex: full
    Link Failure Count: 0
    Permanent HW addr: 84:2b:2b:51:3f:1e
    Slave Interface: eth1
    MII Status: up
    Speed: 100 Mbps
    Duplex: full
    Link Failure Count: 0
    Permanent HW addr: 84:2b:2b:51:3f:20
    Thanks
    Bala

    Please check below MOS note for this issue.
    1276737.1
    HTH
    Edited by: krishan on Jul 28, 2011 2:49 AM

  • Grid infra 11gR2 installation help required

    sir
    i have some problem.do not know how to solve it?
    i need to install grid infrastructure advanced installation.
    scenario and question:
    i have a raw(74GB) device under ASM on 192.168.1.13.but how to put it into the cluster its not under OCFS2,what to do(under OEL5.4)?
    and in another machine(with ip 192.168.1.30) i want to load 11gR2 grid as well as 11gR2 db but how to qualify it to the cluster-aware ASM-ocfs2 disk??i had a a partition /dev/sda3 as LVM group with two mounted partion /ASM1 and /ASM2 as empty ext3 in this machine.what to do?
    regards

    I guess this will help-- http://blog.ronnyegner-consulting.de/2009/09/14/oracle-11g-release-2-install-guide-%e2%80%93-grid-infrastructure-installation/
    -- http://husnusensoy.wordpress.com/2009/10/30/how-to-install-oracle-11g-release-2-on-oel-5-4-on-virtualbox-installing-grid-infrastructure/
    To identify the storage requirements for using Automatic Storage Management, you must determine the number of devices and the amount of free disk space that you require. To complete this task:
    1.     Determine whether you want to use Automatic Storage Management for Oracle Database files, recovery files, or both.
    Note:
    You do not have to use the same storage mechanism for , Oracle Database files, and recovery files. You can use a file system for one file type and Automatic Storage Management for the other.
    If you choose to enable automated backups and you do not have a shared file system available, then you must choose Automatic Storage Management for recovery file storage.
    If you plan to enable automated backups during the installation, then you can choose Automatic Storage Management as the storage mechanism for recovery files by specifying an Automatic Storage Management disk group for the fast recovery area. Depending on how you choose to create a database during the installation, you have the following options:
    o     If you select an installation method that runs Oracle Automatic Storage Management Configuration Assistant in interactive mode, then you can decide whether you want to use the same Automatic Storage Management disk group for database files and recovery files, or you can choose to use different disk groups for each file type. Ideally, you should create separate Automatic Storage Management disk groups for data files and for recovery files.
    The same choice is available to you if you use Oracle Database Configuration Assistant after the installation to create a database.
    o     If you select an installation type that runs Oracle Automatic Storage Management Configuration Assistant in silent or response file mode, then you must use the same Automatic Storage Management disk group for data files and recovery files.
    2.     Choose the Automatic Storage Management redundancy level that you want to use for each Automatic Storage Management disk group that you create.
    The redundancy level that you choose for the Automatic Storage Management disk group determines how Automatic Storage Management mirrors files in the disk group and determines the number of disks and amount of disk space that you require, as follows:
    o     External redundancy
    This option does not allow Automatic Storage Management to mirror the contents of the disk group. Oracle recommends that you select this redundancy level either when the disk group contains devices, such as RAID devices, that provide their own data protection or when the database does not require an uninterrupted access to data.
    o     Normal redundancy
    To optimize performance and reliability in a normal redundancy disk group, Automatic Storage Management uses two-way mirroring for data files and three-way mirroring for control files, by default. In addition, you can choose the mirroring characteristics for individual files in a disk group. Alternatively, you can use two-way mirroring or no mirroring.
    A normal redundancy disk group requires a minimum of two failure groups (or two disk devices) if you are using two-way mirroring. The effective disk space in a normal redundancy disk group is half the sum of the disk space in all of its devices.
    For most installations, Oracle recommends that you use normal redundancy disk groups.
    o     High redundancy
    The contents of the disk group are three-way mirrored by default. To create a disk group with high redundancy, you must specify at least three failure groups (a minimum of 3 devices).
    Although high-redundancy disk groups provide a high level of data protection, you must consider the higher cost of additional storage devices before deciding to use this redundancy level.
    3.     Determine the total amount of disk space that you require for the database files and recovery files.
    If an Automatic Storage Management instance is already running on the system, then you can use an existing disk group to meet these storage requirements. If necessary, you can add disks to an existing disk group during the installation.
    Use the following table to determine the minimum number of disks and the minimum disk space requirements for the installation:
    Redundancy Level     Minimum Number of Disks     Data Files     Recovery Files     Both File Types
    External     1     1.8 GB     3.6 GB     5.4 GB
    Normal     2     3.6 GB     7.2 GB     10.8 GB
    High     3     5.4 GB     10.8 GB     16.2 GB
    4.     Optionally, identify failure groups for the Automatic Storage Management disk group devices.
    If you intend to use a normal or high redundancy disk group, then you can further protect the database against hardware failure by associating a set of disk devices in a custom failure group. By default, each device comprises its failure group. However, if two disk devices in a normal redundancy disk group are attached to the same SCSI controller, then the disk group becomes unavailable if the controller fails. The controller in this example is a single point of failure.
    To avoid failures of this type, you can use two SCSI controllers, each with two disks, and define a failure group for the disks attached to each controller. This configuration would enable the disk group to tolerate the failure of one SCSI controller.
    Note:
    If you define custom failure groups, then you must specify a minimum of two failure groups for normal redundancy disk groups and three failure groups for high redundancy disk groups.
    5.     If you are sure that a suitable disk group does not exist on the system, then install or identify appropriate disk devices to add to a new disk group. Apply the following guidelines when identifying appropriate disk devices:
    o     The disk devices must be owned by the user performing the grid installation.
    o     All the devices in an Automatic Storage Management disk group should be the same size and have the same performance characteristics.
    o     Do not specify multiple partitions on a single physical disk as a disk group device. Automatic Storage Management expects each disk group device to be on a separate physical disk.
    o     Oracle does not recommend the use of a logical volume as a device in Automatic Storage Management because the logical volume is capable of hiding the physical disk architecture which prevents Automatic Storage Management from optimizing I/O across physical devices.

  • Configuration Assistant failed during OEM 10g Grid control installation

    Hi i got an error while installing OEM 10g Grid control 10.2.0.2.1 on Windows 2008 32bit server.
    Installation of OEM 10g was successfull but during configuration im getting an error "ORA-12560: TNS: protocol adaptor error". hence configuration assistant get failed to create emrep database. i stopped the TNSListener service and started db creation using DBCA again i got the same error. please find the below logs from db10g/cfgtoollogs/cfgfw
    INFO: oracle.assistants.dbca:About to execute plug-in Oracle Database Configuration Assistant
    INFO: oracle.assistants.dbca:The plug-in Oracle Database Configuration Assistant is running
    INFO: oracle.assistants.dbca:Launching CmdExec
    INFO: oracle.assistants.dbca:ExitCode=1
    INFO: oracle.assistants.dbca:The plug-in Oracle Database Configuration Assistant executed as attached=true in separate process with exitcode=1
    INFO: oracle.assistants.dbca:The plug-in Oracle Database Configuration Assistant has failed its perform method
    Note: i got one more error during installation which is "Failed to initialize OCR" and "OS error in starting service OracleCSService"
    INFO: Calling Action ntServicesActions10.2.0.3.0 ntStartService
         selectedNodes = null
         serviceName = OracleCSService
    INFO: Exception thrown from action: ntStartService
    Exception Name: StartIndeterminate_OS_ErrorException
    Exception String: OS error in starting service OracleCSService
    Exception Severity: 0
    please provide me the solution.

    [http://download.oracle.com/docs/cd/B16240_01/doc/install.102/e10953/toc.htm]
    [Enterprise Manager Grid Control Installation and Basic Configuration|http://download-uk.oracle.com/docs/html/B12012_03/toc.htm]
    http://blogs.oracle.com/AlejandroVargas/gems/GridControl10gR2Install.pdf
    HTH
    Anantha

  • #550 4.4.7 QUEUE.Expired; message expired ## With LastError "A storage transient failure has occurred during content conversion." In submission Queue. (Exchange 2013)

    Greetings,
    We seem to be having a problem with some users who are attempting to send e-mails from within the organisation to an external domain. Not all users are affected, and not all outgoing e-mails have this issue.
    Some e-mails get stuck in the submission queue. This is the error message in Last Error : "A storage transient failure has occurred during content conversion."
    Days later, the internal user who send the message gets a #550 4.4.7 QUEUE.Expired; message expired ## NDR.
    We did have some initial configuration issues, but these were fixed more than a week ago :
    - The external FQDN during EHLO was set to the wrong address, now pointing to the correct one.
    - SPF record was updated with new IP adress.
    Here is some additional information on the issue :
    - Not on any blacklists - checked using dnsbl.info
    - Telnet to remote servers works from exchange server, connections are accepted and can send mail.
    - Outbound SMTP test ran using Microsoft Remote Connectivity Analyser : Passed with both External (Static) and Smarthost IP.
    - This seems to happen only with emails that have an attachment and that are transfered, but only for the affected users. 
    - If content from these e-mails is manually copied over to a new email, email is sent to destination without problem.
    Configuration information :
    - Exchange 2013 running on Windows 2012 Datacenter with all latest updates.
    - Outgoing e-mail is sent via smarthost. Only one outbound transport rule is active.
    - Using internal DNS server.
    - There is only one mailbox database.
    Thank you for taking the time to read this!

    On Wed, 16 Jan 2013 15:31:14 +0000, Ipigi wrote:
    >Sorry, I often get some terms mixed up when I explain things as our users use the French version of outlook.
    >
    >E-mails are not transferred, but forwarded manually from their outlook. Message format in outlook is set to HTML and not Rich Text when they foward the e-mail.
    Do they forward the message as an attachment?
    >When forwarded internally, this is in the internet headers :
    >
    >Content-Type: application/ms-tnef; name="winmail.dat" Content-Transfer-Encoding: binary
    Within your organization I'm prety sure that messages will use TNEF.
    What does the message contain at the external recipient's side?
    >It really seems to me that Exchange is not converting RTF to Plain Text. The first link you provided states in it's final paragraph that Exchange should be doing this conversion.
    If you can, try creating a mail-enabed Contact for one of the external
    recipients and set the message format on that.
    >If I disabled TNEF as that link suggests, offending messages will get stuck in the submission queue again.
    >
    >I thank you for your help so far. This is not an issue I've had with any previous installations/migrations of Exchange that I have done.
    >
    >Please let me know if you need any additional information.
    Have you tried UNsetting TNEF on the remote domain?
    Set-RemoteDomain Default -TNEFEnabled $null
    That should leave it up to the client to determine the format. It's
    probably not what you're after, but see it makes a difference in the
    format.
    Rich Matheisen
    MCSE+I, Exchange MVP
    --- Rich Matheisen MCSE+I, Exchange MVP

  • A storage transient failure has occurred during content conversion

    Hi,
    I have Exchange 2010 SP3 installed on Windows server 2012.
    External invites are not processing, and return with Source Contex "StorageTransientFailureDuringContentConversion".
    This is cause a great problem in our enviroment...
    Some suggests?
    Att
    Paulo Nunes

    What version of Exchange 2010 SP3 do you have?  RU4 for Exchange 2010 SP3 has been released -
    KB2905616 .
    RU3 is supposed to fix this particular issue, RU4 includes that fix as well. 
    Previous support forum question on this -
    http://social.technet.microsoft.com/Forums/en-US/fd7ef80e-f80b-47ed-883b-a34511c6233c/a-storage-transient-failure-has-occurred-during-content-conversion?forum=exchangesvrsecuremessaginglegacy
    JAUCG - Please remeber to mark replies as helpful if they were or as answered if I provided a solution.

  • Where to download 11gr2 Grid infra structure for Windows

    Hi,
    I am not seeing the software of Oracle 11gR2 grid infra structure for Windows. Please let me know the link to download the grid infra structure for Windows.
    Thanks,
    Mahipal

    AFAIK there is no software for windows 32-bit. but it is there for 64-bit. you can download from here
    http://www.oracle.com/technetwork/database/enterprise-edition/downloads/112010-win64soft-094461.html

Maybe you are looking for

  • Looking for app to either print or save text messages in windows

    I saw a couple of posts for this feature but it was for mac. does anyone know if printing or saving text messages is possible? thanks

  • Jrockit with oracle weblogic 12c

    We have Oracle Weblogic 12c and I followed this thread and update the start up files mentioned here, but still couldn't connect. http://jdeveloperfaq.blogspot.com/2011/03/faq-32-how-to-get-started-with-jrockit.html Has anyone been able to get the JRO

  • Cleaning up downloadsoes

    Everytime I download something the downloads box appears and then sits there forever telling me its "cleaning up the files". I never goes away and the X option to stop it is greyed out. Anyone else have this issue?

  • Accessing itunes library from two separate systems (10.4.9 and 10.6.5)

    Hey all I searched and searched for the answer to this question but couldn't find it. Perhaps it's a little unusual. I am running two separate operating systems on a mac pro. The first is my trusty old 10.4.9 (and probably itunes 7?) on an internal d

  • Different Master of Height to match the corresponding page?

    In my website I have multiple pages with different height. Should I create alot of Masters with different height to match the corresponding page?