Pre-installation cluvfy check fails on local nodes

I am setting up a RAC cluster in Oracle 11.2.0.3 on two Windows 2008R2 nodes.
I have completed all the pre-installation tasks (I hope) and would like to verify this by running:
cluvfy comp sys -p database -n all
using the standalone download of cluvfy - I haven't installed any Oracle software as yet.
This completes successfully on the remote node but fails on the local node (whichever one I run it from).
There is a lot of output but these seem to be the key problems:
[1852@PRDAT217] [Worker 3] [ 2013-10-01 14:44:45.190 BST ] [WindowsSystem.deleteService:876]  _WS_ deleteService2: node PRDAT217 Service OracleRemExecService result: 0|Access is denied.
[1852@PRDAT217] [Worker 3] [ 2013-10-01 14:44:45.190 BST ] [NativeResult.<init>:91]  NativeResult: The String obtained is0|Access is denied.
[1852@PRDAT217] [Worker 3] [ 2013-10-01 14:44:45.190 BST ] [NativeResult.<init>:99]  The status string is: 0
[1852@PRDAT217] [Worker 3] [ 2013-10-01 14:44:45.190 BST ] [NativeResult.<init>:112]  The result string is: Access is denied. 1
[1852@PRDAT217] [Worker 3] [ 2013-10-01 14:44:45.190 BST ] [WindowsSystem.startRemoteExecServer:2156]  _WS_ Failed to delete Service OracleRemExecService on PRDAT217
[1852@PRDAT217] [Worker 3] [ 2013-10-01 14:44:45.206 BST ] [RemoteExecCommand.setupRemoteExecService:748]  Start remoteExecServer failed with Execptionoracle.ops.mgmt.nativesystem.NativeException: PRKN-1016 : Failed to create service "OracleRemExecService" on node "PRDAT217", Error: "Access is denied.".
[1852@PRDAT217] [Worker 3] [ 2013-10-01 14:44:45.206 BST ] [RemoteExecCommand.execute:421]  NativeException occured while setting up RemoteExecService. err msg:PRKN-1016 : Failed to create service "OracleRemExecService" on node "PRDAT217", Error: "Access is denied.
However, there is a folder in the temporary destination call oraremservice and there are DLL files and the RemoteExecService.exe in there.
In the temp directory there are a number of log files called e.g. sprvmcli_9885533.log (the number is generated uniquely each time),
When running against the local node, these contain the following:
10/01/13 14:44:42 Trying to open a named pipe
10/01/13 14:44:42 About to open pipe
10/01/13 14:44:42 calling create file
10/01/13 14:44:42 Error opening the pipe 5
10/01/13 14:44:42 sprvcli: retval = 7
When the cluvfy runs successfully against the remote node, this has much more information in, and the errors do not occur.
Am I using the cluvfy utility incorrectly for this stage of the operation, or is there something wrong with my setup?

first Confirm the connectivity between all of the nodes:
Cluvfy comp nodecon –n all –verbose
Thanks,
gssdba.wordpress.com

Similar Messages

  • Free diskspace check failed foe ecah node

    Hi all
    I am tring to install oracle RAC in Windows 2003 srver.I have creared 2 virtual pc.I follwed every step correctly coz the clusterware software installs upto vipca.After that i sudelny see a blue screen stating that the hardware failure .Now i am trng eith 2 virtual pcs.when i run runcluvfy.bat stage -pre crsinst -n RAC1,RAC2 -verbose
    The error is
    Free disk space in
    Check: Free disk space in "C:\DOCUME~1\ADMINI~1.RAC\LOCALS~1\Temp" dir
    Node Name Available Required Comment
    RAC2 unknown 400MB (409600KB) failed
    RAC1 10.79GB (11313436KB) 400MB (409600KB) passed
    Result: Free disk space check failed.
    System requirement failed for 'crs'.
    what should i do.Thanks
    Edited by: user12119634(bobs) on Dec 13, 2009 9:02 PM

    Define virtual PCs. Provide full description of the technology, vendor, and version number. If this is another attempt to use unsupported technology like VMWare then you are going against what Oracle recommends and you are on your own.
    Since you do not have a valid clusterware installation as indicated by the cluster verify tool this is a really good time to stop the installation and think through these two questions:
    1. What is your shared storage solution? With Windows you only have a couple of possible choices none of which you have mentioned.
    2. What is your cache fusion interconnect strategy?
    If you don't get these right you are wasting your time.
    SB ... I have no idea why you think this question is in the wrong forum. Can you explain?

  • Pre-install system check fails in Oracle apps R12i

    Hi,
    I am trying to install Oracle apps 12i on a fresh Windows 2003 system with suitable hardware (1.5 GB ram & 250 GB HD)
    I am recieving the error :
    System Utilities
    command: cmd.exe /c D:\downloads\OracleAppsR12I\Extract\startCD\Disk1\rapidwiz\bin\adchkutl.cmd C:\cygwin\bin d:\Tools\MSVC\VC98
    D:\downloads\OracleAppsR12I\Extract\startCD\Disk1\rapidwiz>echo off
    /cygdrive/c/WINDOWS/system32/cmd
    'which' command is available.
    /usr/bin/gnumake
    'gnumake' is available.
    'cl' is not available.
    ERRORCODE = 1 ERRORCODE_ENDThe system cannot find the path specified.
    cl: Command not found.
    RW-50011: Error: - System Utilities Availability test has returned an error: 1
    This is the setup I have done :
    Installed Visual C++ express edition in the direcory :
    D:\Tools\MSVC
    Installed cygwin in directory :
    C:\cygwin\bin
    From Command prompt things seem to be OK :
    D:\>which cl
    /cygdrive/d/Tools/MSVC/VC98/VC/bin/cl
    D:\>echo %path%
    C:\Perl\site\bin;C:\Perl\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\
    Wbem;C:\cygwin\bin;D:\Tools\MSVC\VC98\VC\bin;D:\Tools\MSVC\VC98\Common7\IDE
    D:\>which gnumake
    /usr/bin/gnumake
    gnumake.exe is located in directory C:\cygwin\bin
    I followed steps from forum that describes installation of Oracle apps 11i :
    http://forums.oracle.com/forums/thread.jspa?messageID=1566573
    I would appreciate if anybody can advise what are the possible causes of the above problem
    Regards
    AK

    I am able to install oracle ebs successfully, but not able to open the home page. Error coming is "ip address not found".Can you ping the IP address, hostname.domainname?
    According to me the issue is that my server is on workgroup and not on any domain. I have given the domain name When installer was asking for domain name. I have also modified the host file for the same.Could you please post the contents of the hosts file here (you may edit the hostname/domainname values to something different as we need to see the format of the entries).
    Now i have two options:
    1. If i put the server on the domain which is passed to installer when asked.
    2. Now, what all i can do to login on application with keeping the server on workgroup.You do not have to join any domain, and you can simply set this from:
    - Right click on 'My Computer' > Properties > 'Computer Name' > Change
    - Set 'Computer Name' to <hostname>
    - Click on More
    - Set a 'Primary DNS Suffix of this Computer' to <domainname.com>
    thanks for your prompt reply to my previous post. I really admire your work on forums.You are welcome :)
    Thanks,
    Hussein

  • RAC 11gR2 cluster installation: root.sh failed on the 1st node

    Hi,
    Does anybody know why is possible when I run the root.sh on the 1st node, during the Oracle 11gR2 RAC installation (cluster installation) to get the following error?
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /oracle/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y
    Copying dbhome to /usr/local/bin ...
    The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y
    Copying oraenv to /usr/local/bin ...
    The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y
    Copying coraenv to /usr/local/bin ...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2010-06-29 14:17:43: Parsing the host name
    2010-06-29 14:17:43: Checking for super user privileges
    2010-06-29 14:17:43: User has super user privileges
    Using configuration parameter file: /oracle/grid/crs/install/crsconfig_params
    Creating trace directory
    User oracle has the required capabilities to run CSSD in realtime mode
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'system'..
    Operation successful.
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding daemon to inittab
    CRS-4123: Oracle High Availability Services has been started.
    ohasd is starting
    CRS-2672: Attempting to start 'ora.gipcd' on 'trz1test_rac'
    CRS-2672: Attempting to start 'ora.mdnsd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.gipcd' on 'trz1test_rac' succeeded
    CRS-2676: Start of 'ora.mdnsd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.gpnpd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'trz1test_rac'
    CRS-2676: Start of 'ora.cssdmonitor' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'trz1test_rac'
    CRS-2672: Attempting to start 'ora.diskmon' on 'trz1test_rac'
    CRS-2676: Start of 'ora.diskmon' on 'trz1test_rac' succeeded
    CRS-2676: Start of 'ora.cssd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.ctssd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.ctssd' on 'trz1test_rac' succeeded
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'system'..
    Operation successful.
    CRS-2672: Attempting to start 'ora.crsd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.crsd' on 'trz1test_rac' succeeded
    Now formatting voting disk: /data_gpfs/oracle/crs/vdsk.
    CRS-4603: Successful addition of voting disk /data_gpfs/oracle/crs/vdsk.
    ## STATE File Universal Id File Name Disk group
    1. ONLINE 653624f2aa1f4f83bf774e8052889a32 (/data_gpfs/oracle/crs/vdsk) []
    Located 1 voting disk(s).
    CRS-2673: Attempting to stop 'ora.crsd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.crsd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.ctssd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.ctssd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.cssd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.cssd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.gpnpd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.gipcd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.mdnsd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.mdnsd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.mdnsd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.gipcd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.gipcd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.gpnpd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'trz1test_rac'
    CRS-2676: Start of 'ora.cssdmonitor' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'trz1test_rac'
    CRS-2672: Attempting to start 'ora.diskmon' on 'trz1test_rac'
    CRS-2676: Start of 'ora.diskmon' on 'trz1test_rac' succeeded
    CRS-2676: Start of 'ora.cssd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.ctssd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.ctssd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.crsd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.crsd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.evmd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.evmd' on 'trz1test_rac' succeeded
    */oracle/grid/bin/srvctl start nodeapps -n trz1test_rac ... failed*
    Configure Oracle Grid Infrastructure for a Cluster ... failed
    This is because ora.eONS daemon is not starting. There is a Metalink note that we MIGHT start this daemon manually ... but this is not working.
    *./srvctl status nodeapps -n trz1test_rac*
    -n <node_name> option has been deprecated.
    VIP trz1test_rac_vip is enabled
    VIP trz1test_rac_vip is running on node: trz1test_rac
    Network is enabled
    Network is running on node: trz1test_rac
    GSD is disabled
    GSD is not running on node: trz1test_rac
    ONS is enabled
    ONS daemon is running on node: trz1test_rac
    eONS is enabled
    eONS daemon is not running on node: trz1test_rac

    I run my clusterware/DB on AIX 5.3
    When I run runcluvfy.sh here are the things which are not passing:
    Check: Node connectivity of subnet "192.168.1.0"
    Source Destination Connected?
    trz2test_rac:en5 trz2test_rac:en5 yes
    trz2test_rac:en5 trz1test_rac:en5 yes
    trz2test_rac:en5 trz1test_rac:en5 yes
    trz2test_rac:en5 trz1test_rac:en5 yes
    trz2test_rac:en5 trz1test_rac:en5 yes
    trz1test_rac:en5 trz1test_rac:en5 yes
    Result: Node connectivity passed for subnet "192.168.1.0" with node(s) trz2test_rac,trz1test_rac
    Check: TCP connectivity of subnet "192.168.1.0"
    Source Destination Connected?
    trz1test_rac:192.168.1.140 trz2test_rac:192.168.1.142 failed
    trz1test_rac:192.168.1.140 trz2test_rac:192.168.1.142 failed
    Result: TCP connectivity check failed for subnet "192.168.1.0"
    NTP daemon slewing option check failed on some nodes
    PRVF-5436 : The NTP daemon running on one or more nodes lacks the slewing option "-x"
    Result: Clock synchronization check using Network Time Protocol(NTP) failed
    NTP mustn't be a problem I guess as the date are identical on the 2 nodes.
    I have no idea how to fix the TCP connectivity issue with the subnet "192.168.1.0". Some posts wrote that could be a firewall issue. Are there any other causes ?
    Thanks to all,
    Paul

  • AppContainers_test fails with error during pre-test configuration checks

    Hello,
    AppContainers_test fails with error during pre-test configuration checks:
    "[FAIL] The machine is not properly configured for testing: the test directory "C:\Windows\SYSTEM32\" is not ACL'd to allow execute permission for "APPLICATION PACKAGE AUTHORITY\ALL APPLICATION PACKAGES"
    But that kind of permission for APPLICATION PACKAGE AUTHORITY\ALL APPLICATION PACKAGES was allowed, also i tried to allow full access, but error was the same.
    In the test WindowsFilteringPlatform_Tests, the same requirement "REQ - Wfp-based products must not block App Container apps operating within their declared network intentions by default" was checked successfully.
    How can i pass successfully AppContainers_test? 
    I installed lastest versions of QFE and filters on my server, but it didn't help.

    Hi M'Alerter,
    I have the same issue, have you found a solution to your problem ? 
    Cheers,
    Ghalem

  • Oracle 11GR2 installation Prerequsite check - IZ42940 failed

    Oracle 11GR2 installation Prerequisite check fails with the following:
    OS PATCH : IZ42940 failed
    OS PATCH : IZ49516 failed
    OS PATCH : IZ52331 failed
    I have AIX 5.3 level with the patch level as below:-
    oslevel -s
    5300-12-02-1036
    If I check at OS , I get
    /usr/sbin/instfix -i -k "IZ42940 IZ49516 IZ52331"
    there was no data for IZ42940 in the fix database
    there was no data for IZ49516 in the fix database
    there was no data for IZ52331 in the  fix database
    I have checked the latest AIX patch in media, which I am using, doesnu2019t contain these fixes IZ42940 , IZ49516 and IZ52331.
    I am just wondering how do I install these fixes IZ42940 , IZ49516 and IZ52331,
    Please help,

    Hello Abu,
    I am just wondering how do I install these fixes IZ42940 , IZ49516 and IZ52331
    The fix-numbers are only valid for one AIX TL - this means if the installer was released with TL 05 (for example) .. you will get this message if you are using TL 12 now, because of the fix numbers have changed.
    The only way to verify it is to go to the following IBM page and check the fix numbers for your TL.
    In your cases:
    IZ42940 - https://www-304.ibm.com/support/docview.wss?uid=isg1fixinfo110763
    IZ49516 - https://www-304.ibm.com/support/docview.wss?uid=isg1fixinfo112964
    IZ52331- https://www-304.ibm.com/support/docview.wss?uid=isg1fixinfo115020
    If your AIX TL level is not mentioned in these pages ... just take the previous TL Fix number and check for this.
    Regards
    Stefan

  • Problem on Oracle11g2 RAC -- PRVF-5424 : Clock time offset check failed

    I have a lot of file core wrrote every 6 hour and the same time of alert"node".log file show error about PRVF-5424 : Clock time offset check failed.
    Yesterday I use this:
    [root@hostname2 ~]# service ntpd stop
    [root@hostname2 ~]# ntpdate
    [root@hostname2 ~]# service ntpd start
    in order to resolve but today the problem re-begin?
    2013-04-17 20:23:06.063
    CRS-10051:CVU found following errors with Clusterware setup : PRVF-5424 : Clock time offset check failed
    PRVF-5413 : Node "" has a time offset of 69695.6 that is beyond permissible limit of 1000.0 from NTP Time Server "******"
    PRVF-5413 : Node "" has a time offset of 69940.6 that is beyond permissible limit of 1000.0 from NTP Time Server "**
    2013-04-18 02:23:08.973
    CRS-10051:CVU found following errors with Clusterware setup : PRVF-5424 : Clock time offset check failed
    PRVF-5413 : Node "" has a time offset of -1826.9 that is beyond permissible limit of 1000.0 from NTP Time Server "1***
    PRVF-5413 : Node "" has a time offset of -1364.2 that is beyond permissible limit of 1000.0 from NTP Time Server "1**
    2013-04-18 08:23:16.093
    CRS-10051:CVU found following errors with Clusterware setup : PRVF-5424 : Clock time offset check failed
    PRVF-5413 : Node "" has a time offset of -2698.5 that is beyond permissible limit of 1000.0 from NTP Time Server "1***
    PRVF-5413 : Node "" has a time offset of -1998.7 that is beyond permissible limit of 1000.0 from NTP Time Server "1***

    What is your OS name and version ?
    In general you can solve these issues by configuring NTP service running on your cluster nodes to be synchronized with other NTP servers. For example on Linux please read "Oracle RAC and NTP" in http://www.oracle-base.com/articles/linux/linux-ntp-configuration.php#oracle-rac-and-ntp.
    Edited by: P. Forstmann on 18 avr. 2013 13:35

  • Cluvfy pre dbconfiguration check fails

    hello friends
    I am installing RAC 10g database using a 2 node cluster
    I have successfully installed the Oracle Clusterware, Oracle Database software, Oracle Companion CD software, and also configured listeners on both nodes ( viz.linux1, linux2) on both the nodes.
    when I run the cluvfy utility as oracle user who is member of the oinstall and dba groups:
    ./runcluvfy.sh stage -pre dbcfg -n linux1,linux2 -d ${ORACLE_HOME} -verbose
    it returns
    oracle home {u01/app/oracle/product/10.2.0/db_1} does not exist
    Administrative Privileges check failed
    all the cluvfy checks for all previous stages ran ok
    what is the problem here
    please respond. also tell me of any more infornmation that I should provide
    Regards
    Kuber

    oracle home {u01/app/oracle/product/10.2.0/db_1} does not existCan you confirm your ORACLE_HOME path?
    Thanks

  • Shared storage check failed on nodes

    hi friends,
    I am installing rac 10g on vmware and os is OEL4.i completed all the prerequisites but when i run the below command
    ./runclufy stage -post hwos -n rac1,rac2, i am facing below error.
    node connectivity check failed.
    Checking shared storage accessibility...
    WARNING:
    Unable to determine the sharedness of /dev/sde on nodes:
    rac2,rac2,rac2,rac2,rac2,rac1,rac1,rac1,rac1,rac1
    Shared storage check failed on nodes "rac2,rac1"
    please help me anyone ,it's urgent
    Thanks,
    poorna.
    Edited by: 958010 on 3 Oct, 2012 9:47 PM

    Hello,
    It seems that your storage is not accessible from both the nodes. If you want you can follow these steps to configure 10g RAC on VMware.
    Steps to configure Two Node 10 RAC on RHEL-4
    Remark-1: H/W requirement for RAC
    a) 4 Machines
    1. Node1
    2. Node2
    3. storage
    4. Grid Control
    b) 2 switchs
    c) 6 straight cables
    Remark-2: S/W requirement for RAC
    a) 10g cluserware
    b) 10g database
    Both must have the same version like (10.2.0.1.0)
    Remark-3: RPMs requirement for RAC
    a) all 10g rpms (Better to use RHEL-4 and choose everything option to install all the rpms)
    b) 4 new rpms are required for installations
    1. compat-gcc-7.3-2.96.128.i386.rpm
    2. compat-gcc-c++-7.3-2.96.128.i386.rpm
    3. compat-libstdc++-7.3-2.96.128.i386.rpm
    4. compat-libstdc++-devel-7.3-2.96.128.i386.rpm
    ------------ Start Machine Preparation --------------------
    1. Prepare 3 machines
    i. node1.oracle.com
    etho (192.9.201.183) - for public network
    eht1 (10.0.0.1) - for private n/w
    gateway (192.9.201.1)
    subnet (255.255.255.0)
    ii. node2.oracle.com
    etho (192.9.201.187) - for public network
    eht1 (10.0.0.2) - for private n/w
    gateway (192.9.201.1)
    subnet (255.255.255.0)
    iii. openfiler.oracle.com
    etho (192.9.201.182) - for public network
    gateway (192.9.201.1)
    subnet (255.255.255.0)
    NOTE:-
    -- Here eth0 of all the nodes should be connected by Public N/W using SWITCH-1
    -- eth1 of all the nodes should be connected by Private N/W using SWITCH-2
    2. network Configuration
    #vim /etc/host
    192.9.201.183 node1.oracle.com node1
    192.9.201.187 node2.oracle.com node2
    192.9.201.182 openfiler.oracle.com openfiler
    10.0.0.1 node1-priv.oracle.com node1
    10.0.0.2 node2-priv.oracle.com node2-priv
    192.9.201.184 node1-vip.oracle.com node1-vip
    192.9.201.188 node2-vip.oracle.com node2-vip
    2. Prepare Both the nodes for installation
    a. Set Kernel Parameters (/etc/sysctl.conf)
    kernel.shmall = 2097152
    kernel.shmmax = 2147483648
    kernel.shmmni = 4096
    kernel.sem = 250 32000 100 128
    fs.file-max = 65536
    net.ipv4.ip_local_port_range = 1024 65000
    net.core.rmem_default = 262144
    net.core.rmem_max = 262144
    net.core.wmem_default = 262144
    net.core.wmem_max = 262144
    b. Configure /etc/security/limits.conf file
    oracle soft nproc 2047
    oracle hard nproc 16384
    oracle soft nofile 1024
    oracle hard nofile 65536
    c. Configure /etc/pam.d/login file
    session required /lib/security/pam_limits.so
    d. Create user and groups on both nodes
    # groupadd oinstall
    # groupadd dba
    # groupadd oper
    # useradd -g oinstall -G dba oracle
    # passwd oracle
    e. Create required directories and set the ownership and permission.
    # mkdir –p /u01/crs1020
    # mkdir –p /u01/app/oracle/product/10.2.0/asm
    # mkdir –p /u01/app/oracle/product/10.2.0/db_1
    # chown –R oracle:oinstall /u01/
    # chmod –R 755 /u01/
    f. Set the environment variables
    $ vi .bash_profile
    ORACLE_BASE=/u01/app/oracle/; export ORACLE_BASE
    ORA_CRS_HOME=/u01/crs1020; export ORA_CRS_HOME
    #LD_ASSUME_KERNEL=2.4.19; export LD_ASSUME_KERNEL
    #LANG=”en_US”; export LANG
    3. storage configuration
    PART-A Open-filer Set-up
    Install openfiler on a machine (Leave 60GB free space on the hdd)
    a) Login to root user
    b) Start iSCSI target service
    # service iscsi-target start
    # chkconfig –level 345 iscsi-target on
    PART –B Configuring Storage on openfiler
    a) From any client machine open the browser and access openfiler console (446 ports).
    https://192.9.201.182:446/
    b) Open system tab and update the local N/W configuration for both nodes with netmask (255.255.255.255).
    c) From the Volume tab click "create a new physical volume group".
    d) From "block Device managemrnt" click on "(/dev/sda)" option under 'edit disk' option.
    e) Under "Create a partition in /dev/sda" section create physical Volume with full size and then click on 'CREATE'.
    f) Then go to the "Volume Section" on the right hand side tab and then click on "Volume groups"
    g) Then under the "Create a new Volume Group" specify the name of the volume group (ex- racvgrp) and click on the check box and then click on "Add Volume Group".
    h) Then go to the "Volume Section" on the right hand side tab and then click on "Add Volumes" and then specify the Volume name (ex- racvol1) and use all space and specify the "Filesytem/Volume type" as ISCSI and then click on CREATE.
    i) Then go to the "Volume Section" on the right hand side tab and then click on "iSCSI Targets" and then click on ADD button to add your Target IQN.
    j) then goto the 'LUN Mapping" and click on "MAP".
    k) then goto the "Network ACL" and allow both node from there and click on UPDATE.
    Note:- To create multiple volumes with openfiler we need to use Multipathing that is quite complex that’s why here we are going for a single volume. Edit the property of each volume and change access to allow.
    f) install iscsi-initiator rpm on both nodes to acces iscsi disk
    #rpm -ivh iscsi-initiator-utils-----------
    g) Make entry in iscsi.conf file about openfiler on both nodes.
    #vim /etc/iscsi.conf (in RHEL-4)
    and in this file you will get a line "#DiscoveryAddress=192.168.1.2" remove comment and specify your storage ip address here.
    OR
    #vim /etc/iscsi/iscsi.conf (in RHEL-5)
    and in this file you will get a line "#ins.address = 192.168.1.2" remove comment and specify your storage ip address here.
    g) #service iscsi restart (on both nodes)
    h) From both Nodes fire this command to access volume of openfiler-
    # iscsiadm -m discovery -t sendtargets -p 192.2.201.182
    i) #service iscsi restart (on both nodes)
    j) #chkconfig –level 345 iscsi on (on both nodes)
    k) make the partition 3 primary and 1 extended and within extended make 11 logical partition
    A. Prepare partitions
    1. #fdisk /dev/sdb
    :e (extended)
    Part No. 1
    First Cylinder:
    Last Cylinder:
    :p
    :n
    :l
    First Cylinder:
    Last Cylinder: +1024M
    2. Note the /dev/sdb* names.
    3. #partprobe
    4. Login as root user on node2 and run partprobe
    B. On node1 login as root user and create following raw devices
    # raw /dev/raw/raw5 /dev/sdb5
    #raw /dev/raw/taw6 /dev/sdb6
    # raw /dev/raw/raw12 /dev/sdb12
    Run ls –l /dev/sdb* and ls –l /dev/raw/raw* to confirm the above
    -Repeat the same thing on node2
    C. On node1 as root user
    # vi .etc/sysconfig/rawdevices
    /dev/raw/raw5 /dev/sdb5
    /dev/raw/raw6 /dev/sdb6
    /dev/raw/raw7 /dev/sdb7
    /dev/raw/raw8 /dev/sdb8
    /dev/raw/raw9 /dev/sdb9
    /dev/raw/raw10 /dev/sdb10
    /dev/raw/raw11 /dev/sdb11
    /dev/raw/raw12 /dev/sdb12
    /dev/raw/raw13 /dev/sdb13
    /dev/raw/raw14 /dev/sdb14
    /dev/raw/raw15 /dev/sdb15
    D. Restart the raw service (# service rawdevices restart)
    #service rawdevices restart
    Assigning devices:
    /dev/raw/raw5 --> /dev/sdb5
    /dev/raw/raw5: bound to major 8, minor 21
    /dev/raw/raw6 --> /dev/sdb6
    /dev/raw/raw6: bound to major 8, minor 22
    /dev/raw/raw7 --> /dev/sdb7
    /dev/raw/raw7: bound to major 8, minor 23
    /dev/raw/raw8 --> /dev/sdb8
    /dev/raw/raw8: bound to major 8, minor 24
    /dev/raw/raw9 --> /dev/sdb9
    /dev/raw/raw9: bound to major 8, minor 25
    /dev/raw/raw10 --> /dev/sdb10
    /dev/raw/raw10: bound to major 8, minor 26
    /dev/raw/raw11 --> /dev/sdb11
    /dev/raw/raw11: bound to major 8, minor 27
    /dev/raw/raw12 --> /dev/sdb12
    /dev/raw/raw12: bound to major 8, minor 28
    /dev/raw/raw13 --> /dev/sdb13
    /dev/raw/raw13: bound to major 8, minor 29
    /dev/raw/raw14 --> /dev/sdb14
    /dev/raw/raw14: bound to major 8, minor 30
    /dev/raw/raw15 --> /dev/sdb15
    /dev/raw/raw15: bound to major 8, minor 31
    done
    E. Repeat the same thing on node2 also
    F. To make these partitions accessible to oracle user fire these commands from both Nodes.
    # chown –R oracle:oinstall /dev/raw/raw*
    # chmod –R 755 /dev/raw/raw*
    F. To make these partitions accessible after restart make these entry on both nodes
    # vi /etc/rc.local
    Chown –R oracle:oinstall /dev/raw/raw*
    Chmod –R 755 /dev/raw/raw*
    4. SSH configuration (User quivalence)
    On node1:- $ssh-keygen –t rsa
    $ssh-keygen –t dsa
    On node2:- $ssh-keygen –t rsa
    $ssh-keygen –t dsa
    On node1:- $cd .ssh
    $cat *.pub>>node1
    On node2:- $cd .ssh
    $cat *.pub>>node2
    On node1:- $scp node1 node2:/home/oracle/.ssh
    On node2:- $scp node2 node2:/home/oracle/.ssh
    On node1:- $cat node*>>authowized_keys
    On node2:- $cat node*>>authowized_keys
    Now test the ssh configuration from both nodes
    $ vim a.sh
    ssh node1 hostname
    ssh node2 hostname
    ssh node1-priv hostname
    ssh node2-priv hostname
    $ chmod +x a.sh
    $./a.sh
    first time you'll have to give the password then it never ask for password
    5. To run cluster verifier
    On node1 :-$cd /…/stage…/cluster…/cluvfy
    $./runcluvfy stage –pre crsinst –n node1,node2
    First time it will ask for four New RPMs but remember install these rpms by double clicking because of dependancy. So better to install these rpms in this order (rpm-3, rpm-4, rpm-1, rpm-2)
    1. compat-gcc-7.3-2.96.128.i386.rpm
    2. compat-gcc-c++-7.3-2.96.128.i386.rpm
    3. compat-libstdc++-7.3-2.96.128.i386.rpm
    4. compat-libstdc++-devel-7.3-2.96.128.i386.rpm
    And again run cluvfy and check that "It should given a clean cheat" then start clusterware installation.

  • 11g R2 RAC - Grid Infrastructure installation - "root.sh" fails on node#2

    Hi there,
    I am trying to create a two node 11g R2 RAC on OEL 5.5 (32-bit) using VMWare virtual machines. I have correctly configured both nodes. Cluster Verification utility returns on following error \[which I believe can be ignored]:
    Checking daemon liveness...
    Liveness check failed for "ntpd"
    Check failed on nodes:
    rac2,rac1
    PRVF-5415 : Check to see if NTP daemon is running failed
    Clock synchronization check using Network Time Protocol(NTP) failed
    Pre-check for cluster services setup was unsuccessful on all the nodes.
    While Grid Infrastructure installation (for a Cluster option), things go very smooth until I run "root.sh" on node# 2. orainstRoot.sh ran OK on both. "root.sh" run OK on node# 1 and ends with:
    Checking swap space: must be greater than 500 MB.   Actual 1967 MB    Passed
    The inventory pointer is located at /etc/oraInst.loc
    The inventory is located at /u01/app/oraInventory
    *'UpdateNodeList' was successful.*
    *[root@rac1 ~]#*
    "root.sh" fails on rac2 (2nd node) with following error:
    CRS-2672: Attempting to start 'ora.evmd' on 'rac2'
    CRS-2676: Start of 'ora.evmd' on 'rac2' succeeded
    Timed out waiting for the CRS stack to start.
    *[root@rac2 ~]#*
    I know this info may not be enough to figure out what the problem may be. Please let me know what should I look for to find the issue and fix it. Its been like almost two weeks now :-(
    Regards
    Amer

    Hi Zheng,
    ocssd.log is HUGE. So I am putting few of the last lines in the log file hoping they may give some clue:
    2011-07-04 19:49:24.007: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 2180 > margin 1500  cur_ms 36118424 lastalive 36116244
    2011-07-04 19:49:26.005: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 4150 > margin 1500 cur_ms 36120424 lastalive 36116274
    2011-07-04 19:49:26.006: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 4180 > margin 1500  cur_ms 36120424 lastalive 36116244
    2011-07-04 19:49:27.997: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:27.997: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:33.001: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:33.001: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:37.996: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:37.996: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:43.000: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:43.000: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:48.004: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:48.005: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:12.003: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:12.008: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1660 > margin 1500 cur_ms 36166424 lastalive 36164764
    2011-07-04 19:50:12.009: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1660 > margin 1500  cur_ms 36166424 lastalive 36164764
    2011-07-04 19:50:15.796: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 2130 > margin 1500  cur_ms 36170214 lastalive 36168084
    2011-07-04 19:50:16.996: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:16.996: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:17.826: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1540 > margin 1500 cur_ms 36172244 lastalive 36170704
    2011-07-04 19:50:17.826: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1570 > margin 1500  cur_ms 36172244 lastalive 36170674
    2011-07-04 19:50:21.999: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:21.999: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:26.011: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1740 > margin 1500 cur_ms 36180424 lastalive 36178684
    2011-07-04 19:50:26.011: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1620 > margin 1500  cur_ms 36180424 lastalive 36178804
    2011-07-04 19:50:27.004: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:27.004: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:28.002: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1700 > margin 1500 cur_ms 36182414 lastalive 36180714
    2011-07-04 19:50:28.002: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1790 > margin 1500  cur_ms 36182414 lastalive 36180624
    2011-07-04 19:50:31.998: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:31.998: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:37.001: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:37.002: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    *<end of log file>*And the alertrac2.log contains:
    *[root@rac2 rac2]# cat alertrac2.log*
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2011-07-02 16:43:51.571
    [client(16134)]CRS-2106:The OLR location /u01/grid/oracle/product/11.2.0/grid/cdata/rac2.olr is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/client/ocrconfig_16134.log.
    2011-07-02 16:43:57.125
    [client(16134)]CRS-2101:The OLR was formatted using version 3.
    2011-07-02 16:44:43.214
    [ohasd(16188)]CRS-2112:The OLR service started on node rac2.
    2011-07-02 16:45:06.446
    [ohasd(16188)]CRS-2772:Server 'rac2' has been assigned to pool 'Free'.
    2011-07-02 16:53:30.061
    [ohasd(16188)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-02 16:53:55.042
    [cssd(17674)]CRS-1713:CSSD daemon is started in exclusive mode
    2011-07-02 16:54:38.334
    [cssd(17674)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    [cssd(17674)]CRS-1636:The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1 and is terminating; details at (:CSSNM00006:) in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log
    2011-07-02 16:54:38.464
    [cssd(17674)]CRS-1603:CSSD on node rac2 shutdown by user.
    2011-07-02 16:54:39.174
    [ohasd(16188)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'rac2'.
    2011-07-02 16:55:43.430
    [cssd(17945)]CRS-1713:CSSD daemon is started in clustered mode
    2011-07-02 16:56:02.852
    [cssd(17945)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    2011-07-02 16:56:04.061
    [cssd(17945)]CRS-1605:CSSD voting file is online: ORCL:DATA; details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log.
    2011-07-02 16:56:18.350
    [cssd(17945)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
    2011-07-02 16:56:29.283
    [ctssd(18020)]CRS-2403:The Cluster Time Synchronization Service on host rac2 is in observer mode.
    2011-07-02 16:56:29.551
    [ctssd(18020)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac1.
    2011-07-02 16:56:29.615
    [ctssd(18020)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 16:56:29.616
    [ctssd(18020)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 16:56:29.641
    [ctssd(18020)]CRS-2401:The Cluster Time Synchronization Service started on host rac2.
    [client(18052)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(18056)]CRS-10001:ACFS-9322: done.
    2011-07-02 17:01:40.963
    [ohasd(16188)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.asm'. Details at (:CRSPE00111:) in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ohasd/ohasd.log.
    [client(18590)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(18594)]CRS-10001:ACFS-9322: done.
    2011-07-02 17:27:46.385
    [ctssd(18020)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 17:27:46.385
    [ctssd(18020)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 17:46:48.717
    [crsd(22519)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:49.641
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:51.459
    [crsd(22553)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:51.776
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:53.928
    [crsd(22574)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:53.956
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:55.834
    [crsd(22592)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:56.273
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:57.762
    [crsd(22610)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:58.631
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:00.259
    [crsd(22628)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:00.968
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:02.513
    [crsd(22645)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:03.309
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:05.081
    [crsd(22663)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:05.770
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:07.796
    [crsd(22681)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:08.257
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:10.733
    [crsd(22699)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:11.739
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:13.547
    [crsd(22732)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:14.111
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:14.112
    [ohasd(16188)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
    2011-07-02 17:58:18.459
    [ctssd(18020)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 17:58:18.459
    [ctssd(18020)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    [client(26883)]CRS-10001:ACFS-9200: Supported
    2011-07-02 18:13:34.627
    [ctssd(18020)]CRS-2405:The Cluster Time Synchronization Service on host rac2 is shutdown by user
    2011-07-02 18:13:42.368
    [cssd(17945)]CRS-1603:CSSD on node rac2 shutdown by user.
    2011-07-02 18:15:13.877
    [client(27222)]CRS-2106:The OLR location /u01/grid/oracle/product/11.2.0/grid/cdata/rac2.olr is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/client/ocrconfig_27222.log.
    2011-07-02 18:15:14.011
    [client(27222)]CRS-2101:The OLR was formatted using version 3.
    2011-07-02 18:15:23.226
    [ohasd(27261)]CRS-2112:The OLR service started on node rac2.
    2011-07-02 18:15:23.688
    [ohasd(27261)]CRS-8017:location: /etc/oracle/lastgasp has 2 reboot advisory log files, 0 were announced and 0 errors occurred
    2011-07-02 18:15:24.064
    [ohasd(27261)]CRS-2772:Server 'rac2' has been assigned to pool 'Free'.
    2011-07-02 18:16:29.761
    [ohasd(27261)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-02 18:16:30.190
    [gpnpd(28498)]CRS-2328:GPNPD started on node rac2.
    2011-07-02 18:16:41.561
    [cssd(28562)]CRS-1713:CSSD daemon is started in exclusive mode
    2011-07-02 18:16:49.111
    [cssd(28562)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    2011-07-02 18:16:49.166
    [cssd(28562)]CRS-1605:CSSD voting file is online: ORCL:DATA; details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log.
    [cssd(28562)]CRS-1636:The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1 and is terminating; details at (:CSSNM00006:) in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log
    2011-07-02 18:17:01.122
    [cssd(28562)]CRS-1603:CSSD on node rac2 shutdown by user.
    2011-07-02 18:17:06.917
    [ohasd(27261)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'rac2'.
    2011-07-02 18:17:23.602
    [mdnsd(28485)]CRS-5602:mDNS service stopping by request.
    2011-07-02 18:17:36.217
    [gpnpd(28732)]CRS-2328:GPNPD started on node rac2.
    2011-07-02 18:17:43.673
    [cssd(28794)]CRS-1713:CSSD daemon is started in clustered mode
    2011-07-02 18:17:49.826
    [cssd(28794)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    2011-07-02 18:17:49.865
    [cssd(28794)]CRS-1605:CSSD voting file is online: ORCL:DATA; details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log.
    2011-07-02 18:18:03.049
    [cssd(28794)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
    2011-07-02 18:18:06.160
    [ctssd(28861)]CRS-2403:The Cluster Time Synchronization Service on host rac2 is in observer mode.
    2011-07-02 18:18:06.220
    [ctssd(28861)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac1.
    2011-07-02 18:18:06.238
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 18:18:06.239
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 18:18:06.794
    [ctssd(28861)]CRS-2401:The Cluster Time Synchronization Service started on host rac2.
    [client(28891)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(28895)]CRS-10001:ACFS-9322: done.
    2011-07-02 18:18:33.465
    [crsd(29020)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:33.575
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:35.757
    [crsd(29051)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:36.129
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:38.596
    [crsd(29066)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:39.146
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:41.058
    [crsd(29085)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:41.435
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:44.255
    [crsd(29101)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:45.165
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:47.013
    [crsd(29121)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:47.409
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:50.071
    [crsd(29136)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:50.118
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:51.843
    [crsd(29156)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:52.373
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:54.361
    [crsd(29171)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:54.772
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:56.620
    [crsd(29202)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:57.104
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:58.997
    [crsd(29218)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:59.301
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:59.302
    [ohasd(27261)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
    2011-07-02 18:49:58.070
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 18:49:58.070
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 19:21:33.362
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 19:21:33.362
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 19:52:05.271
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 19:52:05.271
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 20:22:53.696
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 20:22:53.696
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 20:53:43.949
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 20:53:43.949
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 21:24:32.990
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 21:24:32.990
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 21:55:21.907
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 21:55:21.908
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 22:26:45.752
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 22:26:45.752
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 22:57:54.682
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 22:57:54.683
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 23:07:28.603
    [cssd(28794)]CRS-1612:Network communication with node rac1 (1) missing for 50% of timeout interval.  Removal of this node from cluster in 14.020 seconds
    2011-07-02 23:07:35.621
    [cssd(28794)]CRS-1611:Network communication with node rac1 (1) missing for 75% of timeout interval.  Removal of this node from cluster in 7.010 seconds
    2011-07-02 23:07:39.629
    [cssd(28794)]CRS-1610:Network communication with node rac1 (1) missing for 90% of timeout interval.  Removal of this node from cluster in 3.000 seconds
    2011-07-02 23:07:42.641
    [cssd(28794)]CRS-1632:Node rac1 is being removed from the cluster in cluster incarnation 205080558
    2011-07-02 23:07:44.751
    [cssd(28794)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac2 .
    2011-07-02 23:07:45.326
    [ctssd(28861)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac2.
    2011-07-04 19:46:26.008
    [ohasd(27261)]CRS-8011:reboot advisory message from host: rac1, component: mo155738, with time stamp: L-2011-07-04-19:44:43.318
    [ohasd(27261)]CRS-8013:reboot advisory message text: clsnomon_status: need to reboot, unexpected failure 8 received from CSS
    *[root@rac2 rac2]#* This log file start with complaint that OLR is not accessible. Here is what I see (rca2):
    -rw------- 1 root oinstall 272756736 Jul  2 18:18 /u01/grid/oracle/product/11.2.0/grid/cdata/rac2.olrAnd I guess rest of the problems start with this.

  • User equivalence check failed for user "oracle" while running cluvfy

    Hi All,
    I am getting User equivalence error as follows while executing cluvfy. I want to install CRS on this server.
    oracle@node200$ ./runcluvfy.sh stage -pre crsinst -n node200,node201,node202
    Performing pre-checks for cluster services setup
    Checking node reachability...
    Node reachability check passed from node "node200".
    Checking user equivalence...
    User equivalence check failed for user "oracle".
    Check failed on nodes:
    node202,node201,node200
    ERROR:
    User equivalence unavailable on all the nodes.
    Verification cannot proceed.
    Pre-check for cluster services setup was unsuccessful on all the nodes.
    I have sucessfully configured ssh and able to do ssh from all the nodes without prompting for the password. Also oracle uid and gid on all the servers are same.
    I also checked in .kshrc file and there is no tty entry in that file. and I have also setup /etc/hosts.equiv file on all the node.
    I still get the user equivalance error. Can anybody help me in this ?
    Regards,
    Raj.

    Hi,
    thanks.
    i need some more help because first time i am working on RAC,
    i am also having User equivalence check failed for user "oracle"
    i got two machines, one is IBM machine and one is DELL machine installed with solais 10 (AIX installation). both machines are not connected by private network now. and no shared external HDD available now. it will take one week time to set up the HW. the user equivalence check depends the above two factors?
    now public network is available and node reachability test "passed"
    could you please tell me what may be the reason for the user equivalence check in my case. details are given below
    i have oracle user in both machine. user creation done through SMC. home directory is /export/home/oracle
    the following are the details.
    1) $ ssh pc000905 id -a oracle
    Enter passphrase for key '/home/oracle/.ssh/id_rsa':
    uid=100(oracle) gid=300(oinstall) groups=301(dba)
    $ ssh pc026376 id -a oracle
    Enter passphrase for key '/home/oracle/.ssh/id_rsa':
    uid=100(oracle) gid=300(oinstall) groups=301(dba)
    2) user nobody exists.
    3) all files n .ssh directory have same permissions.
    4) ssh and scp is working with out password(rsa and dsa keys generated).
    5) oracle user is using bourne shell
    6)soft link of /usr/bin/ssh and /usr/bin/scp are created to /export/home/oracle/bin
    7)ForwardX11 is "yes" in sshd_config
    8) created a config file in .ssh directory and ForwardX11 is "no" in that file
    8) umask =022 in both nodes.
    error displaying is
    $/export/gome/cluvfy/runcluvfy.sh stage -pre crsinst -n pc026376,pc000905
    Performing pre-checks for cluster services setup
    Checking node reachability...
    Node reachability check passed from node "PC026376".
    Checking user equivalence...
    User equivalence check failed for user "oracle".
    Check failed on nodes:
    pc026376,pc000905
    ERROR:
    User equivalence unavailable on all the nodes.
    Verification cannot proceed.
    Pre-check for cluster services setup was unsuccessful on all the nodes.
    $

  • System architecture check failed while adding a New Node in RAC

    Hi Friends,
    Environment:SUN Solris 10
    Cluster Version:10.2.0.3
    database Version:10.2.0.3.0
    Due to H/W failure one of our RAC node(prod1) got formatted.
    We have deleted the node(prod1) from RAC successfully.
    But When i am again trying to add the node and checking prerequistes i am facing the below issue.
    $ cd /software/oracle/product/crs/bin
    $ ./cluvfy stage -pre crsinst -n prod1,prod2
    Check: System architecture
      Node Name     Available                 Required                  Comment
      prod2        unknown                   64-bit                    failed
      prod1        64-bit                    64-bit                    passed
    Result: System architecture check failed.But issue is that prod2 is my active(running node), so how to resolve this issue?
    please suggest..
    Regards
    Umesh

    Resolved..
    Thanks...

  • CLUVFY failing with 'User Equivalence check failed for...'

    New 2 node RAC configuration. Oracle 10gR2, Linux RHEL 5 x64. I'm at the post hardware config, pre install clusterware stage.
    Running the cluster verification utility command:
    cluvfy comp sys -n node-01,node-02 -p crs -verboseReturns the following error:
    Verifying system requirement
    ERROR:
    User equivalence unavailable on all the nodes.
    Verification cannot proceed.
    Verification of system requirement was unsuccessful on all the nodes.I've verified the following:
    1) RSA keys correctly configured on both nodes and I can ssh between without a password
    2) ping ip and private work correctly to and from both nodes.
    3) user, group ids are identical on both systems.
    I also ran cluvfy stage -post hwos -n node-01,node-02 -verbose and received the following output. This output is from node-01. node-02's is identical, except with equivalence to itself failing.
    Checking node reachability...
    Check: Node reachability from node "node-01"
      Destination Node                      Reachable?
      node-02                       yes
      node-01                       yes
    Result: Node reachability check passed from node "node-01".
    Checking user equivalence...
    Check: User equivalence for user "oracle"
      Node Name                             Comment
      node-02                       passed
      node-01                       failed
    Result: User equivalence check failed for user "oracle".
    WARNING:
    User equivalence is not set for nodes:
            node-01
    Verification will proceed with nodes:
            node-02
    Checking node connectivity...I get the same behavior on both nodes. Not quite sure what else to check. Any thoughts or suggestions? Thanks.

    No, no banners. And I followed note 300548.1 to the letter. Several times :-)
    However, I believe my issue has to do with a CVUHOME/cv/admin/cvu_config.
    According to the documentation:
    CV_XCHK_FOR_SSH_ENABLED—If set to TRUE, it enables the X-Windows check for verifying user equivalence with ssh. By default, this entry is commented out and X-Windows check is disabledIt was not, unfortunately, disabled by default - once I set it to false, everything succeeded. I still need to figure out why XCHK itself is failing, but I think I can troll through the log to figure that out.

  • Installation error: Pre Deployment of EM failed.

    Grateful of any help to install Grid Control with the following config:
    Windows 7 Enterprise Edition 64-bit
    Oracle Database 11.2.0.1.0 64-bit EE
    Oracle Weblogic Server 10.3.2.0 plus patch WDJ7 although downloaded smart update patch described on here https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=1072763.1 from here https://updates.oracle.com/ARULink/PatchDetails/process_form?patch_num=9438213 but it only included 4D53, NIXN and XLXA. No WDJ7, although it’s referred to as “SU Patch [WDJ7]: Mandatory Patch required on WLS 10.3.2 for Oracle Grid Control (GC) 11.1 install Product Oracle WebLogic Server”. So I assume that’s correct?
    Enterprise Manager 11g Grid Control Release 1 (11.1.0.1.0)
    Error in Installer:
    Running Configuration assistant "OMS Configuration"
    Executing the OMSCA command...
    Check the OMS Configuration Assistant logs at: C:\Oracle\Middleware2\oms11g\cfgtoollogs\omsca
    Configuration assistant "OMS Configuration" Failed
    Contents of log files:
    Connecting to Node Manager ...
    <Aug 19, 2011 11:12:42 AM CDT> <Notice> <Security> <BEA-090898> <Ignoring the trusted CA certificate "CN=T-TeleSec GlobalRoot Class 3,OU=T-Systems Trust Center,O=T-Systems Enterprise Services GmbH,C=DE". The loading of the trusted certificate list raised a certificate parsing exception PKIX: Unsupported OID in the AlgorithmIdentifier object: 1.2.840.113549.1.1.11.>
    <Aug 19, 2011 11:12:42 AM CDT> <Notice> <Security> <BEA-090898> <Ignoring the trusted CA certificate "CN=T-TeleSec GlobalRoot Class 2,OU=T-Systems Trust Center,O=T-Systems Enterprise Services GmbH,C=DE". The loading of the trusted certificate list raised a certificate parsing exception PKIX: Unsupported OID in the AlgorithmIdentifier object: 1.2.840.113549.1.1.11.>
    Successfully Connected to Node Manager.
    RUNNING
    Killing server EMGC_OMS1 ...
    Successfully killed server EMGC_OMS1 ...
    Fri Aug 19 11:12:57 CDT 2011
    stopManagedServer: Stopping the Managed server
    Already connected to a Node Manager
    RUNNING
    Killing server EMGC_ADMINSERVER ...
    Successfully killed server EMGC_ADMINSERVER ...
    Already connected to a Node Manager
    Stopped NodeManager successfully
    Aug 19, 2011 11:12:57 AM oracle.sysman.omsca.util.CoreOMSConfigAssistantUtil execCommand
    INFO: error messages of the command :
    Aug 19, 2011 11:12:57 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter adapterDeleteOMS
    FINE: Done Executing the command...0
    Aug 19, 2011 11:12:57 AM oracle.sysman.omsca.framework.OMSGenericAdapter deleteAddOnInventory
    INFO: Invoking deleteAddOnInventory for oms EMGC_OMS1
    Aug 19, 2011 11:12:57 AM oracle.sysman.omsca.framework.OMSGenericAdapter deleteAddOnInventory
    INFO: Deleting plugin inventory for GCDomain_EMGC_OMS1
    Aug 19, 2011 11:12:58 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter adapterDeleteOMS
    FINE: Stopping WebTier
    Aug 19, 2011 11:12:58 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter adapterDeleteOMS
    FINE: Stopping WebTier failed. Ignoring.
    Aug 19, 2011 11:12:58 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter deleteEMService
    FINE: Trying to delete the EM service
    Aug 19, 2011 11:12:58 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter adapterDeleteOMS
    FINE: Cleaning up instance directory: C:\Oracle\gc_inst\user_projects
    Aug 19, 2011 11:12:59 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter adapterDeleteOMS
    FINE: Cleaning up instance home directory: C:\Oracle\gc_inst\em
    Aug 19, 2011 11:12:59 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter adapterDeleteOMS
    FINE: Succesfully deleted the oms
    Aug 19, 2011 11:12:59 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter adapterCleanup
    FINE: The value of infra setup completion is :true
    Aug 19, 2011 11:12:59 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter adapterCleanup
    FINE: Cleaning the OMS from the repository
    Aug 19, 2011 11:12:59 AM oracle.sysman.omsca.adapter.wls.OMSWLSAdapter adapterCleanup
    FINE: Got the Host URL as: null
    Aug 19, 2011 11:12:59 AM oracle.sysman.omsca.framework.OMSCAFreshInstall execute
    SEVERE: Pre Deployment of EM failed.
    Aug 19, 2011 11:12:59 AM oracle.sysman.omsca.framework.OMSConfigAssistantDriver main
    FINE: Got resultfalse

    My database was working fine until one day I recieved
    the following error: ora-12638 credential retrieval
    failed,Wow, that was long since... This error used to bump the install of 8.1.7 on Windows machines. The sqlnet.ora had NTS set for autenthication service, which did not work in non-windows network setup.
    You said this error just appeared one day, but you may want to check up on the sqlnet.ora file.

  • Cluvfy : Time zone consistency check failed

    Hello All,
    Env: 112.0.3 on Linux 5.8
    Single node RAC
    I 'am trying to add another node to my cluster.
    When i run the cluvfy it shows
    cluvfy stage -pre nodeadd -n a0002 -fixup -verbose
    o/p trimmed
    Oracle Cluster Voting Disk configuration check passed
    Check: Time zone consistency
    Result: Time zone consistency check failed
    The `date` on both the servers shows UTC as the timezone and they sync
    a0001:oracle(ps1) ~ % ssh a0002 date;date
    Thu Oct  3 06:28:13 UTC 2013
    Thu Oct  3 06:28:13 UTC 2013
    cat /u01/app/11.2.0/grid/crs/install/s_crsconfig_a0001_env.txt
    TZ=UTC
    NLS_LANG=AMERICAN_AMERICA.AL32UTF8
    TNS_ADMIN=
    ORACLE_BASE=
    Where does the script check for this?
    TIA,
    John

    Thx Anar for stepping by..
    rm -rf /tmp/cvutrace
    mkdir /tmp/cvutrace
    export CV_TRACELOC=/tmp/cvutrace
    export SRVM_TRACE=true
    export SRVM_TRACE_LEVEL=1
    <STAGE_AREA>/runcluvfy.sh stage -pre crsinst -n <node1>,<node2> -verbose
    i enabled tracing on cluvfy and found that on Node2's .bash_profile of oracle, i had some interactive session env settings script which required a user input (like, select 1 for ThisDB, select 2 for ThatDB). The cluvfy script internally waited for such input while logging as oracle user to node2 and eventually failed (kind of timeout). I removed that entry and it did good.
    and found that on Node2's .bash_profile of oracle, i had some interactive session env settings script which required a user input (like, select 1 for ThisDB, select 2 for ThatDB). The cluvfy script internally waited for such input while logging as oracle user to node2 and eventually failed (kind of timeout). I removed that entry and it did good.

Maybe you are looking for

  • Cannot Find Photos on External Hard Drive Using iPhoto and Time Machine

    Hi everyone, This is my first time posting on this forum and am really hoping for some help! I have a 2006 PowerBook G4 that is running iPhoto and Time Machine, and I've used an external hard drive to backup everything on the computer via Time Machin

  • Can't get Express to join established Extreme network

    My Extreme base works fine connected via ethernet to an eMac without an AirPort card. My roaming MacBook finds the network, and everything is just swell. Both computers are running 10.4.10. THE PROBLEM OCCURS when I try to set up a wireless delivery

  • Using document attribute of caf in web dynpro

    Hie Experts, could somebody give me some information how to use the document attribute of caf in my web dynpro model? I have created some application and entity services with simple attributes and document attributes. I imported the model into the co

  • Simple

    Hello: I have a required validation on a inputText field. If I submit without having inserted a char or a number there, it notifies the error and does not commit. And thats all ok and what I want to have. My problem is if I want to cancel (go back to

  • Cannot open documents in new pages for iPad

    cannot open any documents in new pages for iPad