Oracle grid infrastructure installation take long time on step 15 (perform prerequisite checks )

Oracle grid infrastructure installation take long time on step 15 (perform prerequisite checks ) 
I'm starting install and configure Oracle RAC 11gR2 on redhat 6.3 , when i reached step 15 (perform prerequisite checks ) it's taking long time more than 10 hours and still checking .... i closed it and start installation again it's same still waiting in perform prerequisite checks 75% complete
it is normal ?? what should i do ?? how i can monitoring installation steps and why this step take all this time please help .

Pl identify which exact version of 11gR2 - currently only 11.2.0.3 is certified/supported on Linux 6.x - Oracle® Database - if you are using 11.2.0.1 or 11.2.0.2, then you will need to use Linux 5.x
HTH
Srini

Similar Messages

  • How do I define 2 disk groups for ocr and voting disks at the oracle grid infrastructure installation window

    Hello,
    It may sound too easy to someone but I need to ask it anyway.
    I am in the middle of building Oracle RAC 11.2.0.3 on Linux. I have 2 storage and I created three LUNs in each of storage so 6 LUNs in total look in both of servers. If I choose NORMAL as a redundancy level, is it right to choose my 6 disks those are created for OCR_VOTE at the grid installation? Or should I choose only 3 of them and configure mirroring at latter stage?
    The reason why I am asking this is that I didn't find any place to create asm disk group for ocr and voting disks at the oracle grid infrastructure installation window. In fact, I would to like to create two disk groups in which one of groups contains three disks those were brought from storage 1 and the second one contains rest three 3 disk that come from the last storage.
    I believe that you will understand the manner and help me on choosing proper way.
    Thank you.

    Hi,
    You have 2 Storage H/W.
    You will need to configure a Quorum ASMDisk to store a Voting Disk.
    Because if you lose 1/2 or more of all of your voting disks, then nodes get evicted from the cluster, or nodes kick themselves out of the cluster.
    You must have the odd number of voting disk (i.e 1,3 or 5)  one voting disk per ASM DISK, So 1 Storage will hold more voting disk than another storage.
    (e.g 3 Voting Disk - 2 voting stored in stg-A and 1 voting disk store in stg-B)
    If fail the storage that hold the major number of  Voting disk the whole cluster (all nodes) goes down. Does not matter if you have a other storage online.
    It will happen:
    https://forums.oracle.com/message/9681811#9681811
    You must configure your Clusterware same as RAC extended
    Check this link:
    http://www.oracle.com/technetwork/database/clusterware/overview/grid-infra-thirdvoteonnfs-131158.pdf
    Explaining: How to store OCR, Voting disks and ASM SPFILE on ASM Diskgroup (RAC or RAC Extended) | Levi Pereira | Oracl…

  • Oracle Grid infrastructure installation tutorial

    Dear friends who can help me by providing some link for Oracle Grid infrastructure installation
    tutorial. I need installation procedure description with GNS, SCAN as well as DNS and DHCP
    configuration for Grid Infra. I already searched in NET and can't found same exhaustive instructions.
    I just want to compare my and others installations ways.
    I hope see your comments soon.
    thanks in advance

    ora_tech wrote:
    Hi,
    Refer blog post by Guenadi Jilevski:
    http://gjilevski.wordpress.com/2011/10/05/build-two-node-oracle-rac-11gr2-11-2-0-3-with-gns-dns-dhcp-and-haip/
    This might be helpful :)
    thanks,
    X A H E E Rthanks for quick answer :)

  • App-V 5 Full Infrastructure Apps take long time to stream to the client

    Hi was wondering if anyone has the same issue as i am or knows a fix for this, below is my problem and the troubleshooting i have done.
    Overview of problem
    App-V 5 apps delivered via App-V 5 full infrastructure take a long time to stream to the client and this means the user has to wait if they try and run an application before it has streamed to the client. Users sometimes have to
    wait 2 or 3 minutes for an application to stream and this is about 40 times slower than basic SMB and HTTP transfer tests show the system is capable of (see performance results below).
    App-V 4.6 apps delivered via App-V 4.6 full infrastructure and HTTP streaming are fine.
    Overview of environment
    App-V 5.0 SP1 Full Infrastructure.
    App-V servers are running Server 2012 on Hyper-V 3 or ESX 5.1 with 2 x vCPU and 4GB RAM.
    SQL servers are a SQL 2012 cluster.
    Separate servers for SQL, management, publishing, content and reporting.
    Management, Publishing and Content servers have two servers per role and NLB to provide load balancing. So 7 servers (2 x Man, 2 x Pub, 2 x Content, 1 x Reporting)
    Two further sites with 2 x Pub and 2 x Content each. All publishing servers pointed at the load balance address for management.
    Content delivered via HTTP
    Clients are physical desktops and laptops running Windows 7 SP1 x86 and Windows 8 x86
    App-V client is 5.0SP1
    Clients are pointed at their nearest publishing server NLB via a script which looks up the client IP address and uses PowerShell to configure the publishing server
    Content is streamed from the nearest content server NLB by setting the PackageSourceRoot to the nearest content NLB (via the same PowerShell script above).
    App-V apps delivered per-user via AD group. One AD group per application. Approximately 200 App-V apps published so far - will eventually reach 400 as we sequence more. About 9000 users.
    Analysis performed so far
    Servers not heavily loaded. CPU averages 5%. Lots of RAM free. Very low disk IO. Problem also occurs out-of-hours so we are 99.9% certain that server resources are not a cause.
    Streaming performance is the same from all 6 content servers and all 3 NLB addresses (tested by changing the value of PackageSourceRoot). Wireshark used to confirm packages are really streaming from the correct location, enforcing
    our belief that the problem isn't at the server end (unless all 6 servers are affected).
    Streaming via both HTTP and SMB2.1 is approximately the same (tested by changing the value of PackageSourceRoot between http://xxxx and \\server\AppVContent).
    Wireshark used to confirm we really are using the protocol we think we are using.
    All clients exhibit the same behaviour. Issue reported by many users. 5 test PCs chosen at random at all 3 sites confirmed to have the slow streaming problem.
    Slow streaming from both Hyper-V and VMware ESX servers.
    Client not heavily loaded.
    Affects all App-V apps although it obviously affects the larger ones more.
    All App-V apps have a Feature Block 1 setup.
    If we copy the ".appv" file from the server to the client via either HTTP or SMB then it's reasonably quick (up to 480Mb/s). So we don't believe the network or servers are at fault. For example:
    We can copy a 149MB .appv file via SMB from the content server to the client in 5 seconds.
    We copy HTTP download the .appv file from the content server using IE on the client in 5 seconds.
    But if you ask the App-V 5 client to fully download the sequence then it takes 2 - 3 minutes.
    The App-V 4.6 client takes about 8 - 10 seconds to fully download a similar sized application.
    App-V 5 publishing works fine - when a new user logs on they get their list of application straight away, it's just the streaming which is slow.
    Once the App-V app has streamed locally it runs fine and with a decent performance.
    Looking at a Wireshark trace of the streaming you can see that the slow performance is due to the transfer stopping and starting a lot. You only notice this when you zoom into the performance graph a fair bit.
    Each time the HTTP server stops sending traffic, it doesn't start again until the client sends a "TCP Window update". Each "stop" is of a different length, but just taking a few from the middle I get 0.06s, 0.11s,
    0.13s wasted etc.
    I can see that it's the client stopping the transfer by reducing its advertised TCP Window Size. I'll provide an example:
    Server sends 9 x 1514 bytes. Client responds with an ACK and a Window size of 54016 bytes (256x211)
    Server sends 11 x 1514 bytes. Client responds with an ACK and a Window size of 37888 bytes (256x148)
    Server sends 10 x 1514 bytes. Client responds with an ACK and a Window size of 23296 bytes (256x91)
    Server sends 15 x 1514 bytes. Client responds with an ACK and a Window size of 1280 bytes (5 x 256)
    Server stops sending (I'm guessing because the client advertised Window size was less than a single packet's worth of bytes)
    <0.1 seconds passes>
    Client sends a "TCP Window Update" re-advertising a TCP window size of 65536 (256x256).
    Server starts transmitting again
    So the way I see this is that the App-V 5 client is controlling the transfer speed by utilising TCP Window flow control. The trace was taken at the client end so there's no room for anything on the network to be fiddling with flow
    control (and we've confirmed there are no traffic shapers in the loop).
    We've also tried streaming directly from the local client by copying some App-V 5 apps down to the client, creating a SMB share on the client and changing PackageSourceRoot to \\localhost\AppVContent (i.e. so we are streaming directly
    from the client to the client - to remove the network from the equation) and there is only an improvement of 5 to 10 seconds. So we know it's nothing to do with the network or the servers.
    We've tried turning off TCP auto-tuning on the client with:
    netsh interface tcp set global autotuninglevel=disabled
    and turning off TCP chimney offloading (which is off anyway because the NIC doesn't support it and Netstat -t output shows "InHost" for offload state for all connections) with:
    netsh int tcp set global chimney=disabled
    and nothing has improved.
    So we've now focussed on the extraction of the .appv (ZIP) file on the client.
    Using Windows Explorer it takes 75 seconds to extract the ZIP file
    Using 7ZIP it takes 9 seconds to extract the ZIP file
    Yeah we've always known that the Explorer ZIP engine is terrible. That's why we use 7ZIP or WinRAR on our clients.
    So we've started to wonder if the problem with the slow App-V 5 streaming is because the client is downloading the .appv file and extracting it as it goes along in a single thread. If the App-V 5 client is using the same terrible
    ZIP engine that Explorer does then that would explain the slow performance. The "download" appears to take a long time because the client is using TCP flow control to slow the transfer since it's extracting the .appv file using a very slow ZIP engine
    and it's all in a single thread.

    Guys,
    Just wanted to give you a brief update basically close this thread as Answered.
    We had submitted 4 App-V 5 Bugs to Microsoft and these were reproducible and an explanation was given on work around to them. Microsoft
    sent down a App-v developer to have a look at our problems. They said they will try and include the Bug fixes in SP2 which should be out in a few weeks or they will definitely be included in SP3.
    In regards to the slow streaming it all came down to the Disk IO.
    We found that you could simply enable "Turn off
    Windows write-cache buffer flushing on the device", then start streaming the app and then disable "Turn
    off Windows write-cache buffer flushing on the device" immediately after
    (we don't want to leave it on) and that basically fixed the issue.
    But a normal user would not have permissions to do
    this, so a code was written to enable and disable this option.
    Apology for not going in detail, like my opening thread, its very late. 
    but if you would like a detailed analysis please message me.
    I would like to Thank the Talented Consultant who designed and implemented are App-V infrastructure who found the bugs and created all
    the work around and who also emailed the detailed analysis of the problems to Microsoft that got them interested.
    Simon Bond from Ultima Business Solutions.
    Thank you

  • Oracle Grid Infrastructure installation on Windows  2008 SRV R2

    Hi
    There are many problems to configure and install grid infrastructure in windows 2008 server. is there any step by step documentation for this case?
    how can i configure the storage for OCFS, ACFS is not supported on Windows 2008 server. How can i manage OUI setup masks exactly.
    Thank you for your helping hand.

    Have you looked at the instructions in the documentation? http://download.oracle.com/docs/cd/E11882_01/install.112/e10817/toc.htm
    If these steps are not adequate, could you explain what is missing?

  • Oracle SQL Select query takes long time than expected.

    Hi,
    I am facing a problem in SQL select query statement. There is a long time taken in select query from the Database.
    The query is as follows.
    select /*+rule */ f1.id,f1.fdn,p1.attr_name,p1.attr_value from fdnmappingtable f1,parametertable p1 where p1.id = f1.id and ((f1.object_type ='ne_sub_type.780' )) and ( (f1.id in(select id from fdnmappingtable where fdn like '0=#1#/14=#S0058-3#/17=#S0058-3#/18=#1#/780=#5#%')))order by f1.id asc
    This query is taking more than 4 seconds to get the results in a system where the DB is running for more than 1 month.
    The same query is taking very few milliseconds (50-100ms) in a system where the DB is freshly installed and the data in the tables are same in both the systems.
    Kindly advice what is going wrong??
    Regards,
    Purushotham

    SQL> @/alcatel/omc1/data/query.sql
    2 ;
    9 rows selected.
    Execution Plan
    Plan hash value: 3745571015
    | Id | Operation | Name |
    | 0 | SELECT STATEMENT | |
    | 1 | SORT ORDER BY | |
    | 2 | NESTED LOOPS | |
    | 3 | NESTED LOOPS | |
    | 4 | TABLE ACCESS FULL | PARAMETERTABLE |
    |* 5 | TABLE ACCESS BY INDEX ROWID| FDNMAPPINGTABLE |
    |* 6 | INDEX UNIQUE SCAN | PRIMARY_KY_FDNMAPPINGTABLE |
    |* 7 | TABLE ACCESS BY INDEX ROWID | FDNMAPPINGTABLE |
    |* 8 | INDEX UNIQUE SCAN | PRIMARY_KY_FDNMAPPINGTABLE |
    Predicate Information (identified by operation id):
    5 - filter("F1"."OBJECT_TYPE"='ne_sub_type.780')
    6 - access("P1"."ID"="F1"."ID")
    7 - filter("FDN" LIKE '0=#1#/14=#S0058-3#/17=#S0058-3#/18=#1#/780=#5#
    8 - access("F1"."ID"="ID")
    Note
    - rule based optimizer used (consider using cbo)
    Statistics
    0 recursive calls
    0 db block gets
    0 consistent gets
    0 physical reads
    0 redo size
    0 bytes sent via SQL*Net to client
    0 bytes received via SQL*Net from client
    0 SQL*Net roundtrips to/from client
    0 sorts (memory)
    0 sorts (disk)
    9 rows processed
    SQL>

  • Adobe form take long time for Check/Send at portal

    Hi Experts
    We have a form at Portal, which take long time when we click on Check to validate the form, its taking around 3 mins.
    where as other forms are not taking this much time. Can anyone help us on this issue.
    Thanks
    Sajal

    Hi Sajal,
    did you already contact your basis-guys to trace the performance of the ADS itself?
    Sounds to me, that the connection of the portal is not that good and maybe this is one of the problems.
    Also check on the interface to the form. what takes the time... the driver-program fetching the data or even the form itself.
    Additional to that you should have a look inside the form and see how much scripting is inside. Sometimes there is a lot of unnecessary source inside and out of that, you didn't share the form (if it is a SAP-delivery) I cannot get more in detail with my answer here.
    Hope it gives you a clue where to start with your journey.
    ~Florian
    PS: If you use the search with keywords "ADS + trace" you find a lot of useful information.

  • Oracle report formatting takes long time

    hi
    i am using oracle 10g Application Server 9.0.4.0.0 on Red hat linux AS 3
    oracle reports are run thru JSP's
    some reports take long time to execute though query in it if executed on sql plus are fast.
    it is fond that that formatting is going on for those reports
    what might be the reason for this??
    is the data fetched first and then formatting takes place as per data??
    waiting for reply
    Avinash

    hi
    i am using oracle 10g Application Server 9.0.4.0.0 on Red hat linux AS 3
    oracle reports are run thru JSP's
    some reports take long time to execute though query in it if executed on sql plus are fast.
    it is fond that that formatting is going on for those reports
    what might be the reason for this??
    is the data fetched first and then formatting takes place as per data??
    waiting for reply
    Avinash

  • Grid Infrastructure installable for Oracle Restart only (No ASM)?

    Hello,
    Can Oracle Grid Infrastructure be installed for its Oracle Restart functionality only? i.e., No ASM,; this box uses local RAID 5 filesystems only.
    This is a standalone 32-bit RHEL 5 system with Oracle Database 10gR2 already installed that I intend to upgrade to 11gR2. Just experimenting with installing Grid Infrastructure for only its restart capability. There isn't anything out there I've found that addresses this other than the Oracle doc stating that the Infrastructure must be installed if I want to use ASM or Oracle Restart.
    I'm currently in the installer in a Software Only installation waiting for my SysAdmin to run the root.sh script, but in looking at this script, it looks like it might try to do things with CRS, voting files and the like, which do not exist.
    Thank you!
    -Jon

    Hi Erik,
    Can Oracle Grid Infrastructure be installed for its Oracle Restart functionality only? Yes ... you can do that installing Software Only
    I'm currently in the installer in a Software Only installation waiting for my SysAdmin to run the root.sh script, but in looking at this script, it looks like it might try to do things with CRS, voting files and the like, which do not exist.Don't worry about that ... at the end of the execution of the root.sh script will report a proceedings to configure only Oracle Restart.
    Only this resource "ora.evmd" will appear online.
    Regards,
    Levi Pereira

  • Oracle documentation for Installation for Oracle Grid Infrastructure

    Hi
    I want to install 11g Release 2 "Oracle Grid Infrastrucure" on Aix system without Cluster/RAC option. The requirement is to configure ASM on an Standalone system without any Cluster and RAC. Is there any documentation available for this installation.
    I have already checked the below link which provide information on Installation for Oracle Grid Infrastructure for a Cluster.
    http://download.oracle.com/docs/cd/E11882_01/install.112/e10814/toc.htm
    Please let know if there is any documentation for Installation for Oracle Grid Infrastructure for a standalone system.

    Hi there. Well, the installation of Grid Infrastructure would ask you that what kind of installation you want to do, single instance or cluster? If you would choose single instance installation, it would not be much different from doing any other oracle installation. The key factor to do it and why its mandatory is because from 11.2 onwards, ASM can't be managed from DBCA but from its own tool only, ASMCA and that runs from Grid Home. So I don't think that not finding the docs should be a show stopper for you. I haven't done it on AIX so I am not sure that I can be of some help about it. I have done it on OEL 5 and it didn't throw any issues for me.
    HTH
    Aman....

  • Problem with installation of Oracle Grid Infrastructure failed on Oracle Linux 6.4 x86_64

    Hello!
    I try install Oracle Grid Infrastructure 11.2.0.1. OS - OEL 6.4 x86_64
    But running script  "/u01/app/oracle/product/11.2.0/grid/root.sh" failed:
    [root@localhost grid]# /u01/app/oracle/product/11.2.0/grid/root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
        ORACLE_OWNER= grid
        ORACLE_HOME=  /u01/app/oracle/product/11.2.0/grid
    Enter the full pathname of the local bin directory: [/usr/local/bin]:
       Copying dbhome to /usr/local/bin ...
       Copying oraenv to /usr/local/bin ...
       Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2013-07-03 01:27:08: Checking for super user privileges
    2013-07-03 01:27:08: User has super user privileges
    2013-07-03 01:27:08: Parsing the host name
    Using configuration parameter file: /u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'grid', privgrp 'oinstall'..
    Operation successful.
    CRS-4664: Node localhost successfully pinned.
    Adding daemon to inittab
    CRS-4124: Oracle High Availability Services startup failed.
    CRS-4000: Command Start failed, or completed with errors.
    ohasd failed to start: Inappropriate ioctl for device
    ohasd failed to start: Inappropriate ioctl for device at /u01/app/oracle/product/11.2.0/grid/crs/install/roothas.pl line 296.
    /u01/app/oracle/product/11.2.0/grid/cfgtoollogs/crsconfig/roothas.log:
    2013-07-03 01:27:08: The configuration parameter file /u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params is valid
    2013-07-03 01:27:08: Checking for super user privileges
    2013-07-03 01:27:08: User has super user privileges
    2013-07-03 01:27:08: ### Printing the configuration values from files:
    2013-07-03 01:27:08:    /u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params
    2013-07-03 01:27:08:    /u01/app/oracle/product/11.2.0/grid/crs/install/s_crsconfig_defs
    2013-07-03 01:27:08: ASM_DISCOVERY_STRING=
    2013-07-03 01:27:08: ASM_DISKS=ORCL:ASMDATA01,ORCL:ASMDATA02,ORCL:ASMDATA03,ORCL:ASMDATA04
    2013-07-03 01:27:08: ASM_DISK_GROUP=DATA
    2013-07-03 01:27:08: ASM_REDUNDANCY=NORMAL
    2013-07-03 01:27:08: ASM_SPFILE=
    2013-07-03 01:27:08: ASM_UPGRADE=false
    2013-07-03 01:27:08: CLSCFG_MISSCOUNT=
    2013-07-03 01:27:08: CLUSTER_GUID=
    2013-07-03 01:27:08: CLUSTER_NAME=
    2013-07-03 01:27:08: CRS_NODEVIPS=
    2013-07-03 01:27:08: CRS_STORAGE_OPTION=0
    2013-07-03 01:27:08: CSS_LEASEDURATION=400
    2013-07-03 01:27:08: DIRPREFIX=
    2013-07-03 01:27:08: DISABLE_OPROCD=0
    2013-07-03 01:27:08: EMBASEJAR_NAME=oemlt.jar
    2013-07-03 01:27:08: EWTJAR_NAME=ewt3.jar
    2013-07-03 01:27:08: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
    2013-07-03 01:27:08: GNS_ADDR_LIST=
    2013-07-03 01:27:08: GNS_ALLOW_NET_LIST=
    2013-07-03 01:27:08: GNS_CONF=false
    2013-07-03 01:27:08: GNS_DENY_ITF_LIST=
    2013-07-03 01:27:08: GNS_DENY_NET_LIST=
    2013-07-03 01:27:08: GNS_DOMAIN_LIST=
    2013-07-03 01:27:08: GPNPCONFIGDIR=/u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:08: GPNPGCONFIGDIR=/u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:08: GPNP_PA=
    2013-07-03 01:27:08: HELPJAR_NAME=help4.jar
    2013-07-03 01:27:08: HOST_NAME_LIST=
    2013-07-03 01:27:08: ID=/etc/init.d
    2013-07-03 01:27:08: INIT=/sbin/init
    2013-07-03 01:27:08: IT=/etc/inittab
    2013-07-03 01:27:08: JEWTJAR_NAME=jewt4.jar
    2013-07-03 01:27:08: JLIBDIR=/u01/app/oracle/product/11.2.0/grid/jlib
    2013-07-03 01:27:08: JREDIR=/u01/app/oracle/product/11.2.0/grid/jdk/jre/
    2013-07-03 01:27:08: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
    2013-07-03 01:27:08: MSGFILE=/var/adm/messages
    2013-07-03 01:27:08: NETCFGJAR_NAME=netcfg.jar
    2013-07-03 01:27:08: NETWORKS=
    2013-07-03 01:27:08: NEW_HOST_NAME_LIST=
    2013-07-03 01:27:08: NEW_NODEVIPS=
    2013-07-03 01:27:08: NEW_NODE_NAME_LIST=
    2013-07-03 01:27:08: NEW_PRIVATE_NAME_LIST=
    2013-07-03 01:27:08: NODELIST=
    2013-07-03 01:27:08: NODE_NAME_LIST=
    2013-07-03 01:27:08: OCFS_CONFIG=
    2013-07-03 01:27:08: OCRCONFIG=/etc/oracle/ocr.loc
    2013-07-03 01:27:08: OCRCONFIGDIR=/etc/oracle
    2013-07-03 01:27:08: OCRID=
    2013-07-03 01:27:08: OCRLOC=ocr.loc
    2013-07-03 01:27:08: OCR_LOCATIONS=
    2013-07-03 01:27:08: OLASTGASPDIR=/etc/oracle/lastgasp
    2013-07-03 01:27:08: OLRCONFIG=/etc/oracle/olr.loc
    2013-07-03 01:27:08: OLRCONFIGDIR=/etc/oracle
    2013-07-03 01:27:08: OLRLOC=olr.loc
    2013-07-03 01:27:08: OPROCDCHECKDIR=/etc/oracle/oprocd/check
    2013-07-03 01:27:08: OPROCDDIR=/etc/oracle/oprocd
    2013-07-03 01:27:08: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
    2013-07-03 01:27:08: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
    2013-07-03 01:27:08: ORACLE_BASE=/u01/app/oracle
    2013-07-03 01:27:08: ORACLE_HOME=/u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:08: ORACLE_OWNER=grid
    2013-07-03 01:27:08: ORA_ASM_GROUP=asmadmin
    2013-07-03 01:27:08: ORA_DBA_GROUP=oinstall
    2013-07-03 01:27:08: PRIVATE_NAME_LIST=
    2013-07-03 01:27:08: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
    2013-07-03 01:27:08: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d
    2013-07-03 01:27:08: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
    2013-07-03 01:27:08: RC_KILL=K19
    2013-07-03 01:27:08: RC_KILL_OLD=K96
    2013-07-03 01:27:08: RC_START=S96
    2013-07-03 01:27:08: SCAN_NAME=
    2013-07-03 01:27:08: SCAN_PORT=0
    2013-07-03 01:27:08: SCRBASE=/etc/oracle/scls_scr
    2013-07-03 01:27:08: SHAREJAR_NAME=share.jar
    2013-07-03 01:27:08: SILENT=false
    2013-07-03 01:27:08: SO_EXT=so
    2013-07-03 01:27:08: SRVCFGLOC=srvConfig.loc
    2013-07-03 01:27:08: SRVCONFIG=/var/opt/oracle/srvConfig.loc
    2013-07-03 01:27:08: SRVCONFIGDIR=/var/opt/oracle
    2013-07-03 01:27:08: VNDR_CLUSTER=false
    2013-07-03 01:27:08: VOTING_DISKS=
    2013-07-03 01:27:08: ### Printing other configuration values ###
    2013-07-03 01:27:08: CLSCFG_EXTRA_PARMS=
    2013-07-03 01:27:08: CRSDelete=0
    2013-07-03 01:27:08: HAPatch=0
    2013-07-03 01:27:08: HAS_GROUP=oinstall
    2013-07-03 01:27:08: HAS_USER=grid
    2013-07-03 01:27:08: HOST=localhost
    2013-07-03 01:27:08: IS_SIHA=1
    2013-07-03 01:27:08: OLR_DIRECTORY=/u01/app/oracle/product/11.2.0/grid/cdata/localhost
    2013-07-03 01:27:08: OLR_LOCATION=/u01/app/oracle/product/11.2.0/grid/cdata/localhost/localhost.olr
    2013-07-03 01:27:08: ORA_CRS_HOME=/u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:08: SUPERUSER=root
    2013-07-03 01:27:08: UPGRADE=
    2013-07-03 01:27:08: crscfg_trace=1
    2013-07-03 01:27:08: crscfg_trace_file=/u01/app/oracle/product/11.2.0/grid/cfgtoollogs/crsconfig/roothas.log
    2013-07-03 01:27:08: hahome=
    2013-07-03 01:27:08: hosts=
    2013-07-03 01:27:08: osdfile=/u01/app/oracle/product/11.2.0/grid/crs/install/s_crsconfig_defs
    2013-07-03 01:27:08: parameters_valid=1
    2013-07-03 01:27:08: paramfile=/u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params
    2013-07-03 01:27:08: platform_family=unix
    2013-07-03 01:27:08: srvctl_trc_suff=0
    2013-07-03 01:27:08: user_is_superuser=1
    2013-07-03 01:27:08: ### Printing of configuration values complete ###
    2013-07-03 01:27:08: Oracle CRS stack is not configured yet
    2013-07-03 01:27:08: CRS is not yet configured. Hence, will proceed to configure CRS
    2013-07-03 01:27:10: OLR location = /u01/app/oracle/product/11.2.0/grid/cdata/localhost/localhost.olr
    2013-07-03 01:27:10: Oracle CRS Home = /u01/app/oracle/product/11.2.0/grid
    2013-07-03 01:27:10: Validating /etc/oracle/olr.loc file for OLR location /u01/app/oracle/product/11.2.0/grid/cdata/localhost/localhost.olr
    2013-07-03 01:27:10: /etc/oracle/olr.loc already exists. Backing up /etc/oracle/olr.loc to /etc/oracle/olr.loc.orig
    2013-07-03 01:27:10: Opening file OCRCONFIG
    2013-07-03 01:27:10: Opening file OCRCONFIG
    2013-07-03 01:27:10: create Local Only OCR...
    2013-07-03 01:27:10: create Local Only OCR on Linux...
    2013-07-03 01:27:10: OCR locations = /u01/app/oracle/product/11.2.0/grid/cdata/localhost/local.ocr
    2013-07-03 01:27:10: Validating OCR locations in /etc/oracle/ocr.loc
    2013-07-03 01:27:10: Checking for existence of /etc/oracle/ocr.loc
    2013-07-03 01:27:10: Backing up /etc/oracle/ocr.loc to /etc/oracle/ocr.loc.orig
    2013-07-03 01:27:10: Setting ocr location /u01/app/oracle/product/11.2.0/grid/cdata/localhost/local.ocr
    2013-07-03 01:27:10: Creating or upgrading Oracle Local Registry (OLR)
    2013-07-03 01:27:10: Running as user grid: /u01/app/oracle/product/11.2.0/grid/bin/ocrconfig -local -upgrade
    2013-07-03 01:27:10:   Invoking "/u01/app/oracle/product/11.2.0/grid/bin/ocrconfig -local -upgrade" as user "grid"
    2013-07-03 01:27:11: OLR successfully created or upgraded
    2013-07-03 01:27:11: /u01/app/oracle/product/11.2.0/grid/bin/clscfg -localadd
    2013-07-03 01:27:11: Running as user grid: /u01/app/oracle/product/11.2.0/grid/bin/clscfg -localadd
    2013-07-03 01:27:11:   Invoking "/u01/app/oracle/product/11.2.0/grid/bin/clscfg -localadd" as user "grid"
    2013-07-03 01:27:11: Keys created in the OLR successfully
    2013-07-03 01:27:12: Creating local-only OCR (/u01/app/oracle/product/11.2.0/grid/bin/crsctl pin css -n localhost) ... succeeded
    2013-07-03 01:27:12: Registering ohasd
    2013-07-03 01:27:12: init file = /u01/app/oracle/product/11.2.0/grid/crs/init/init.ohasd
    2013-07-03 01:27:12: Copying file /u01/app/oracle/product/11.2.0/grid/crs/init/init.ohasd to /etc/init.d directory
    2013-07-03 01:27:12: Setting init.ohasd permission in /etc/init.d directory
    2013-07-03 01:27:12: init file = /u01/app/oracle/product/11.2.0/grid/crs/init/ohasd
    2013-07-03 01:27:12: Copying file /u01/app/oracle/product/11.2.0/grid/crs/init/ohasd to /etc/init.d directory
    2013-07-03 01:27:12: Setting ohasd permission in /etc/init.d directory
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc3.d/S96ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc3.d/S96ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc3.d/S96ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc3.d/S96ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc5.d/S96ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc5.d/S96ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc5.d/S96ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc5.d/S96ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc0.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc0.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc0.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc0.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc1.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc1.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc1.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc1.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc2.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc2.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc2.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc2.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc4.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc4.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc4.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc4.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: Removing "/etc/rc.d/rc6.d/K19ohasd"
    2013-07-03 01:27:12: Removing file /etc/rc.d/rc6.d/K19ohasd
    2013-07-03 01:27:12: Failure with return code 1 from command rm /etc/rc.d/rc6.d/K19ohasd
    2013-07-03 01:27:12: Failed to remove file:
    2013-07-03 01:27:12: Creating a link "/etc/rc.d/rc6.d/K19ohasd" pointing to /etc/init.d/ohasd
    2013-07-03 01:27:12: The file ohasd has been successfully linked to the RC directories
    2013-07-03 01:27:12: Starting ohasd
    2013-07-03 01:27:12: itab entries=
    2013-07-03 01:27:18: Created backup /etc/inittab.no_crs
    2013-07-03 01:27:18: Appending to /etc/inittab.tmp:
    2013-07-03 01:27:18: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null
    2013-07-03 01:27:18: Done updating /etc/inittab.tmp
    2013-07-03 01:27:18: Saved /etc/inittab.crs
    2013-07-03 01:27:18: Installed new /etc/inittab
    2013-07-03 01:29:18: ohasd failed to start: Inappropriate ioctl for device
    2013-07-03 01:29:18: ###### Begin DIE Stack Trace ######
    2013-07-03 01:29:18:     Package         File                 Line Calling 
    2013-07-03 01:29:18:     --------------- -------------------- ---- ----------
    2013-07-03 01:29:18:  1: main            roothas.pl            166 crsconfig_lib::dietrap
    2013-07-03 01:29:18:  2: main            roothas.pl            296 main::__ANON__
    2013-07-03 01:29:18: ####### End DIE Stack Trace #######
    selinux and firewall is disabled.

    Hi,
    Refer the below metalink note :- OHASD Failed to Start: Inappropriate ioctl for device [ID 1069182.1]
    Thanks

  • Command return code of 255 (65280) during Grid Infrastructure Installation

    I am trying to create a 2-node RAC 11gR2. I am using OEL 5 Update 4. I am using NFS as shared storage. The time on both node is same. Both nodes have 4GB RAM each. Following is my IP settings from /etc/hosts on both nodes:
    [oracle@vis ~]$ cat /etc/hosts
    # Do not remove the following line, or various programs
    # that require network functionality will fail.
    127.0.0.1 localhost.localdomain localhost
    # Public
    10.8.5.191 vis.awc.com vis
    10.8.5.192 vsstest.awc.com vsstest
    #Private
    192.168.0.101 vis-priv.awc.com vis-priv
    192.168.0.102 vsstest-priv.awc.com vsstest-priv
    #Virtual
    10.8.5.166 vis-vip.awc.com vis-vip
    10.8.5.170 vsstest-vip.awc.com vsstest-vip
    # SCAN
    10.8.5.182 rac-scan.awc.com rac-scan
    #NAS
    192.168.0.101 nas1.awc.com nas1
    I am getting error during the Grid Infrastructure installation, when I run the root.sh script through root. Following is the logfile showing the error (/u01/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_vis.log):
    2010-02-02 11:58:05: The configuration parameter file /u01/app/11.2.0/grid/crs/install/crsconfig_params is valid
    2010-02-02 11:58:05: Checking for super user privileges
    2010-02-02 11:58:05: User has super user privileges
    2010-02-02 11:58:05: ### Printing the configuration values from files:
    2010-02-02 11:58:05: /u01/app/11.2.0/grid/crs/install/crsconfig_params
    2010-02-02 11:58:05: /u01/app/11.2.0/grid/crs/install/s_crsconfig_defs
    2010-02-02 11:58:05: ASM_DISCOVERY_STRING=
    2010-02-02 11:58:05: ASM_DISKS=
    2010-02-02 11:58:05: ASM_DISK_GROUP=
    2010-02-02 11:58:05: ASM_REDUNDANCY=
    2010-02-02 11:58:05: ASM_SPFILE=
    2010-02-02 11:58:05: ASM_UPGRADE=false
    2010-02-02 11:58:05: CLSCFG_MISSCOUNT=
    2010-02-02 11:58:05: CLUSTER_GUID=
    2010-02-02 11:58:05: CLUSTER_NAME=rac-scan
    2010-02-02 11:58:05: CRS_NODEVIPS='vis-vip/255.248.0.0/eth0,vsstest-vip/255.248.0.0/eth0'
    2010-02-02 11:58:05: CRS_STORAGE_OPTION=2
    2010-02-02 11:58:05: CSS_LEASEDURATION=400
    2010-02-02 11:58:05: DIRPREFIX=
    2010-02-02 11:58:05: DISABLE_OPROCD=0
    2010-02-02 11:58:05: EMBASEJAR_NAME=oemlt.jar
    2010-02-02 11:58:05: EWTJAR_NAME=ewt3.jar
    2010-02-02 11:58:05: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
    2010-02-02 11:58:05: GNS_ADDR_LIST=
    2010-02-02 11:58:05: GNS_ALLOW_NET_LIST=
    2010-02-02 11:58:05: GNS_CONF=false
    2010-02-02 11:58:05: GNS_DENY_ITF_LIST=
    2010-02-02 11:58:05: GNS_DENY_NET_LIST=
    2010-02-02 11:58:05: GNS_DOMAIN_LIST=
    2010-02-02 11:58:05: GPNPCONFIGDIR=/u01/app/11.2.0/grid
    2010-02-02 11:58:05: GPNPGCONFIGDIR=/u01/app/11.2.0/grid
    2010-02-02 11:58:05: GPNP_PA=
    2010-02-02 11:58:05: HELPJAR_NAME=help4.jar
    2010-02-02 11:58:05: HOST_NAME_LIST=vis,vsstest
    2010-02-02 11:58:05: ID=/etc/init.d
    2010-02-02 11:58:05: INIT=/sbin/init
    2010-02-02 11:58:05: IT=/etc/inittab
    2010-02-02 11:58:05: JEWTJAR_NAME=jewt4.jar
    2010-02-02 11:58:05: JLIBDIR=/u01/app/11.2.0/grid/jlib
    2010-02-02 11:58:05: JREDIR=/u01/app/11.2.0/grid/jdk/jre/
    2010-02-02 11:58:06: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
    2010-02-02 11:58:06: MSGFILE=/var/adm/messages
    2010-02-02 11:58:06: NETCFGJAR_NAME=netcfg.jar
    2010-02-02 11:58:06: NETWORKS="eth0"/10.8.0.0:public,"eth1"/192.168.0.0:cluster_interconnect
    2010-02-02 11:58:06: NEW_HOST_NAME_LIST=
    2010-02-02 11:58:06: NEW_NODEVIPS='vis-vip/255.248.0.0/eth0,vsstest-vip/255.248.0.0/eth0'
    2010-02-02 11:58:06: NEW_NODE_NAME_LIST=
    2010-02-02 11:58:06: NEW_PRIVATE_NAME_LIST=
    2010-02-02 11:58:06: NODELIST=vis,vsstest
    2010-02-02 11:58:06: NODE_NAME_LIST=vis,vsstest
    2010-02-02 11:58:06: OCFS_CONFIG=
    2010-02-02 11:58:06: OCRCONFIG=/etc/oracle/ocr.loc
    2010-02-02 11:58:06: OCRCONFIGDIR=/etc/oracle
    2010-02-02 11:58:06: OCRID=
    2010-02-02 11:58:06: OCRLOC=ocr.loc
    2010-02-02 11:58:06: OCR_LOCATIONS=/u01/shared_config/ocr_configuration
    2010-02-02 11:58:06: OLASTGASPDIR=/etc/oracle/lastgasp
    2010-02-02 11:58:06: OLRCONFIG=/etc/oracle/olr.loc
    2010-02-02 11:58:06: OLRCONFIGDIR=/etc/oracle
    2010-02-02 11:58:06: OLRLOC=olr.loc
    2010-02-02 11:58:06: OPROCDCHECKDIR=/etc/oracle/oprocd/check
    2010-02-02 11:58:06: OPROCDDIR=/etc/oracle/oprocd
    2010-02-02 11:58:06: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
    2010-02-02 11:58:06: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
    2010-02-02 11:58:06: ORACLE_BASE=/u01/app/oracle
    2010-02-02 11:58:06: ORACLE_HOME=/u01/app/11.2.0/grid
    2010-02-02 11:58:06: ORACLE_OWNER=oracle
    2010-02-02 11:58:06: ORA_ASM_GROUP=dba
    2010-02-02 11:58:06: ORA_DBA_GROUP=oinstall
    2010-02-02 11:58:06: PRIVATE_NAME_LIST=
    2010-02-02 11:58:06: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
    2010-02-02 11:58:06: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d
    2010-02-02 11:58:06: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
    2010-02-02 11:58:06: RC_KILL=K19
    2010-02-02 11:58:06: RC_KILL_OLD=K96
    2010-02-02 11:58:06: RC_START=S96
    2010-02-02 11:58:06: SCAN_NAME=rac-scan.awc.com
    2010-02-02 11:58:06: SCAN_PORT=1521
    2010-02-02 11:58:06: SCRBASE=/etc/oracle/scls_scr
    2010-02-02 11:58:06: SHAREJAR_NAME=share.jar
    2010-02-02 11:58:06: SILENT=false
    2010-02-02 11:58:06: SO_EXT=so
    2010-02-02 11:58:06: SRVCFGLOC=srvConfig.loc
    2010-02-02 11:58:06: SRVCONFIG=/var/opt/oracle/srvConfig.loc
    2010-02-02 11:58:06: SRVCONFIGDIR=/var/opt/oracle
    2010-02-02 11:58:06: VNDR_CLUSTER=false
    2010-02-02 11:58:06: VOTING_DISKS=/u01/shared_config/voting_disk
    2010-02-02 11:58:06: ### Printing other configuration values ###
    2010-02-02 11:58:06: CLSCFG_EXTRA_PARMS=
    2010-02-02 11:58:06: CRSDelete=0
    2010-02-02 11:58:06: CRSPatch=0
    2010-02-02 11:58:06: DEBUG=
    2010-02-02 11:58:06: DOWNGRADE=
    2010-02-02 11:58:06: HAS_GROUP=oinstall
    2010-02-02 11:58:06: HAS_USER=root
    2010-02-02 11:58:06: HOST=vis
    2010-02-02 11:58:07: IS_SIHA=0
    2010-02-02 11:58:07: OLR_DIRECTORY=/u01/app/11.2.0/grid/cdata
    2010-02-02 11:58:07: OLR_LOCATION=/u01/app/11.2.0/grid/cdata/vis.olr
    2010-02-02 11:58:07: ORA_CRS_HOME=/u01/app/11.2.0/grid
    2010-02-02 11:58:07: SUPERUSER=root
    2010-02-02 11:58:07: UPGRADE=
    2010-02-02 11:58:07: VF_DISCOVERY_STRING=/u01/shared_config/voting_disk
    2010-02-02 11:58:07: addfile=/u01/app/11.2.0/grid/crs/install/crsconfig_addparams
    2010-02-02 11:58:07: crscfg_trace=1
    2010-02-02 11:58:07: crscfg_trace_file=/u01/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_vis.log
    2010-02-02 11:58:07: hosts=
    2010-02-02 11:58:07: oldcrshome=
    2010-02-02 11:58:07: oldcrsver=
    2010-02-02 11:58:07: osdfile=/u01/app/11.2.0/grid/crs/install/s_crsconfig_defs
    2010-02-02 11:58:07: parameters_valid=1
    2010-02-02 11:58:07: paramfile=/u01/app/11.2.0/grid/crs/install/crsconfig_params
    2010-02-02 11:58:07: platform_family=unix
    2010-02-02 11:58:07: srvctl_trc_suff=0
    2010-02-02 11:58:07: unlock_crshome=
    2010-02-02 11:58:07: user_is_superuser=1
    2010-02-02 11:58:07: ### Printing of configuration values complete ###
    2010-02-02 11:58:07: Oracle CRS stack is not configured yet
    2010-02-02 11:58:07: CRS is not yet configured. Hence, will proceed to configure CRS
    2010-02-02 11:58:07: Cluster-wide one-time actions... Done!
    2010-02-02 11:58:17: set owner/group of OCR path
    2010-02-02 11:58:17: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:17: Host name = vis
    2010-02-02 11:58:17: CRS user = oracle
    2010-02-02 11:58:17: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:17: GPnP host = vis
    2010-02-02 11:58:17: Oracle GPnP home = /u01/app/11.2.0/grid/gpnp
    2010-02-02 11:58:17: Oracle GPnP local home = /u01/app/11.2.0/grid/gpnp/vis
    2010-02-02 11:58:17: GPnP directories verified.
    2010-02-02 11:58:17: Checking to see if Oracle CRS stack is already configured
    2010-02-02 11:58:17: Oracle CRS stack is not configured yet
    2010-02-02 11:58:17: ---Checking local gpnp setup...
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" does not exist
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cwallet.sso" does not exist
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr/cwallet.sso" does not exist
    2010-02-02 11:58:18: chk gpnphome /u01/app/11.2.0/grid/gpnp/vis: profile_ok 0 wallet_ok 0 r/o_wallet_ok 0
    2010-02-02 11:58:18: chk gpnphome /u01/app/11.2.0/grid/gpnp/vis: INVALID (bad profile/wallet)
    2010-02-02 11:58:18: ---Checking cluster-wide gpnp setup...
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/profiles/peer/profile.xml" does not exist
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/wallets/peer/cwallet.sso" does not exist
    2010-02-02 11:58:18: The setup file "/u01/app/11.2.0/grid/gpnp/wallets/prdr/cwallet.sso" does not exist
    2010-02-02 11:58:18: chk gpnphome /u01/app/11.2.0/grid/gpnp: profile_ok 0 wallet_ok 0 r/o_wallet_ok 0
    2010-02-02 11:58:18: chk gpnphome /u01/app/11.2.0/grid/gpnp: INVALID (bad profile/wallet)
    2010-02-02 11:58:18: gpnp setup checked: local valid? 0 cluster-wide valid? 0
    2010-02-02 11:58:18: gpnp setup: NONE
    2010-02-02 11:58:18: GPNP configuration required
    2010-02-02 11:58:18: Validating for SI-CSS configuration
    2010-02-02 11:58:18: Retrieving OCR main disk location
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc
    2010-02-02 11:58:18: Unable to retrieve ocr disk info
    2010-02-02 11:58:18: Checking to see if any 9i GSD is up
    2010-02-02 11:58:18: libskgxnBase_lib = /etc/ORCLcluster/oracm/lib/libskgxn2.so
    2010-02-02 11:58:18: libskgxn_lib = /opt/ORCLcluster/lib/libskgxn2.so
    2010-02-02 11:58:18: SKGXN library file does not exists
    2010-02-02 11:58:18: OLR location = /u01/app/11.2.0/grid/cdata/vis.olr
    2010-02-02 11:58:18: Oracle CRS Home = /u01/app/11.2.0/grid
    2010-02-02 11:58:18: Validating /etc/oracle/olr.loc file for OLR location /u01/app/11.2.0/grid/cdata/vis.olr
    2010-02-02 11:58:18: /etc/oracle/olr.loc already exists. Backing up /etc/oracle/olr.loc to /etc/oracle/olr.loc.orig
    2010-02-02 11:58:18: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:18: Oracle cluster name = rac-scan
    2010-02-02 11:58:18: OCR locations = /u01/shared_config/ocr_configuration
    2010-02-02 11:58:18: Validating OCR
    2010-02-02 11:58:18: Retrieving OCR location used by previous installations
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrmirrorconfig_loc
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc3
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc4
    2010-02-02 11:58:18: Opening file OCRCONFIG
    2010-02-02 11:58:18: Value () is set for key=ocrconfig_loc5
    2010-02-02 11:58:18: Checking if OCR sync file exists
    2010-02-02 11:58:18: No need to sync OCR file
    2010-02-02 11:58:18: OCR_LOCATION=/u01/shared_config/ocr_configuration
    2010-02-02 11:58:18: OCR_MIRROR_LOCATION=
    2010-02-02 11:58:18: OCR_MIRROR_LOC3=
    2010-02-02 11:58:18: OCR_MIRROR_LOC4=
    2010-02-02 11:58:19: OCR_MIRROR_LOC5=
    2010-02-02 11:58:19: Current OCR location=
    2010-02-02 11:58:19: Current OCR mirror location=
    2010-02-02 11:58:19: Current OCR mirror loc3=
    2010-02-02 11:58:19: Current OCR mirror loc4=
    2010-02-02 11:58:19: Current OCR mirror loc5=
    2010-02-02 11:58:19: Verifying current OCR settings with user entered values
    2010-02-02 11:58:19: Setting OCR locations in /etc/oracle/ocr.loc
    2010-02-02 11:58:19: Validating OCR locations in /etc/oracle/ocr.loc
    2010-02-02 11:58:19: Checking for existence of /etc/oracle/ocr.loc
    2010-02-02 11:58:19: Backing up /etc/oracle/ocr.loc to /etc/oracle/ocr.loc.orig
    2010-02-02 11:58:19: Setting ocr location /u01/shared_config/ocr_configuration
    2010-02-02 11:58:19: Creating or upgrading Oracle Local Registry (OLR)
    2010-02-02 11:58:20: OLR successfully created or upgraded
    2010-02-02 11:58:20: /u01/app/11.2.0/grid/bin/clscfg -localadd
    2010-02-02 11:58:21: Keys created in the OLR successfully
    2010-02-02 11:58:21: GPnP setup state: none
    2010-02-02 11:58:21: Creating local GPnP setup for clustered node...
    2010-02-02 11:58:21: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:21: Oracle GPnP wallets home = /u01/app/11.2.0/grid/gpnp/vis/wallets
    2010-02-02 11:58:21: Checking if GPnP setup exists
    2010-02-02 11:58:21: /u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cwallet.sso wallet must be created
    2010-02-02 11:58:21: Removing old wallets/certificates, if any
    2010-02-02 11:58:21: Creating GPnP Root Wallet...
    2010-02-02 11:58:21: /u01/app/11.2.0/grid/bin/orapki wallet create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -nologo
    2010-02-02 11:58:22: Creating GPnP Root Certificate...
    2010-02-02 11:58:22: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -self_signed -dn "CN=GPnP_root" -keysize 1024 -validity 9999 -nologo
    2010-02-02 11:58:24: Exporting GPnP Root Certificate...
    2010-02-02 11:58:24: /u01/app/11.2.0/grid/bin/orapki wallet export -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -dn "CN=GPnP_root" -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/root/b64certificate.txt" -nologo
    2010-02-02 11:58:25: Creating GPnP Peer Wallet...
    2010-02-02 11:58:25: /u01/app/11.2.0/grid/bin/orapki wallet create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -auto_login -nologo
    2010-02-02 11:58:25: Creating GPnP Profile Reader Wallet...
    2010-02-02 11:58:25: /u01/app/11.2.0/grid/bin/orapki wallet create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr" -pwd gpnp_wallet1 -auto_login -nologo
    2010-02-02 11:58:26: Creating GPnP PA Wallet...
    2010-02-02 11:58:26: /u01/app/11.2.0/grid/bin/orapki wallet create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -auto_login -nologo
    2010-02-02 11:58:27: Adding private key to GPnP Peer Wallet...
    2010-02-02 11:58:27: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -dn "CN=GPnP_peer" -keysize 1024 -nologo
    2010-02-02 11:58:28: Adding private key to GPnP PA Wallet...
    2010-02-02 11:58:28: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -dn "CN=GPnP_pa" -keysize 1024 -nologo
    2010-02-02 11:58:29: Creating certificate request for GPnP Peer Wallet...
    2010-02-02 11:58:29: /u01/app/11.2.0/grid/bin/orapki wallet export -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -dn "CN=GPnP_peer" -request "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/certreq.txt" -nologo
    2010-02-02 11:58:30: Creating certificate request for GPnP PA Wallet...
    2010-02-02 11:58:30: /u01/app/11.2.0/grid/bin/orapki wallet export -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -dn "CN=GPnP_pa" -request "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/certreq.txt" -nologo
    2010-02-02 11:58:31: Creating certificate for GPnP Peer Wallet...
    2010-02-02 11:58:31: /u01/app/11.2.0/grid/bin/orapki cert create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -request "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/certreq.txt" -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cert.txt" -validity 9999 -nologo
    2010-02-02 11:58:32: Creating certificate for GPnP PA Wallet...
    2010-02-02 11:58:32: /u01/app/11.2.0/grid/bin/orapki cert create -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/root" -pwd gpnp_wallet1 -request "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/certreq.txt" -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/cert.txt" -validity 9999 -nologo
    2010-02-02 11:58:33: Adding Root Certificate TP to GPnP Peer Wallet...
    2010-02-02 11:58:33: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/root/b64certificate.txt" -nologo
    2010-02-02 11:58:34: Adding Root Certificate TP to GPnP Profile Reader Wallet...
    2010-02-02 11:58:34: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/root/b64certificate.txt" -nologo
    2010-02-02 11:58:34: Adding Root Certificate TP to GPnP PA Wallet...
    2010-02-02 11:58:34: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/root/b64certificate.txt" -nologo
    2010-02-02 11:58:35: Adding PA Certificate as a TP into a GPnP Peer Wallet...
    2010-02-02 11:58:35: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/cert.txt" -nologo
    2010-02-02 11:58:36: Adding peer Certificate as a TP into a GPnP PA Wallet...
    2010-02-02 11:58:36: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cert.txt" -nologo
    2010-02-02 11:58:37: Adding PA Certificate as a TP into a GPnP Profile Reader Wallet...
    2010-02-02 11:58:37: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/cert.txt" -nologo
    2010-02-02 11:58:38: Adding peer Certificate as a TP into a GPnP Profile Reader Wallet...
    2010-02-02 11:58:38: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/prdr" -pwd gpnp_wallet1 -trusted_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cert.txt" -nologo
    2010-02-02 11:58:39: Adding PA Certificate as a TP into a GPnP Peer Wallet...
    2010-02-02 11:58:39: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -pwd gpnp_wallet1 -user_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/peer/cert.txt" -nologo
    2010-02-02 11:58:40: Adding peer Certificate as a TP into a GPnP PA Wallet...
    2010-02-02 11:58:40: /u01/app/11.2.0/grid/bin/orapki wallet add -wallet "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa" -pwd gpnp_wallet1 -user_cert -cert "/u01/app/11.2.0/grid/gpnp/vis/wallets/pa/cert.txt" -nologo
    2010-02-02 11:58:41: GPnP Wallets ownership/permissions successfully set.
    2010-02-02 11:58:41: GPnP Wallets successfully created.
    2010-02-02 11:58:41: <--- GPnP wallets successfully created
    2010-02-02 11:58:41: Creating GPnP peer profile --->
    2010-02-02 11:58:41: Oracle CRS home = /u01/app/11.2.0/grid
    2010-02-02 11:58:41: Oracle GPnP profiles home = /u01/app/11.2.0/grid/gpnp/vis/profiles
    2010-02-02 11:58:41: Oracle GPnP profiles parameters:
    2010-02-02 11:58:41: paloc==
    2010-02-02 11:58:41: cname=rac-scan=
    2010-02-02 11:58:41: cssdisco=/u01/shared_config/voting_disk=
    2010-02-02 11:58:41: cssld=400=
    2010-02-02 11:58:41: asmdisco==
    2010-02-02 11:58:41: asmspf==
    2010-02-02 11:58:41: netlst="eth0"/10.8.0.0:public,"eth1"/192.168.0.0:cluster_interconnect=
    2010-02-02 11:58:41: ocrid==
    2010-02-02 11:58:41: clusterguid==
    2010-02-02 11:58:41: Checking if GPnP setup exists
    2010-02-02 11:58:41: /u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml profile must be created
    2010-02-02 11:58:41: OCRID is not available, hence not set in GPnP Profile
    2010-02-02 11:58:42: ClusterGUID is not available, hence not set in GPnP Profile
    2010-02-02 11:58:42: gpnptool: run /u01/app/11.2.0/grid/bin/gpnptool create -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -prf -prf_sq=1 -prf_cn=rac-scan -prf_pa="" -hnet=gen -gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.8.0.0" -net1:net_ada="eth0" -net1:net_use="public" -gen:net=net2 -net2:net_ip="192.168.0.0" -net2:net_ada="eth1" -net2:net_use="cluster_interconnect" -css=css -css:css_dis="/u01/shared_config/voting_disk" -css:css_ld=400 -asm=asm -asm:asm_dis="++no-value-at-profile-creation--never-updated-through-ASM++" -asm:asm_spf=""
    2010-02-02 11:58:42: Running as user oracle: /u01/app/11.2.0/grid/bin/gpnptool create -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -prf -prf_sq=1 -prf_cn=rac-scan -prf_pa="" -hnet=gen -gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.8.0.0" -net1:net_ada="eth0" -net1:net_use="public" -gen:net=net2 -net2:net_ip="192.168.0.0" -net2:net_ada="eth1" -net2:net_use="cluster_interconnect" -css=css -css:css_dis="/u01/shared_config/voting_disk" -css:css_ld=400 -asm=asm -asm:asm_dis="++no-value-at-profile-creation--never-updated-through-ASM++" -asm:asm_spf=""
    2010-02-02 11:58:42: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/11.2.0/grid/bin/gpnptool create -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -prf -prf_sq=1 -prf_cn=rac-scan -prf_pa="" -hnet=gen -gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.8.0.0" -net1:net_ada="eth0" -net1:net_use="public" -gen:net=net2 -net2:net_ip="192.168.0.0" -net2:net_ada="eth1" -net2:net_use="cluster_interconnect" -css=css -css:css_dis="/u01/shared_config/voting_disk" -css:css_ld=400 -asm=asm -asm:asm_dis="++no-value-at-profile-creation--never-updated-through-ASM++" -asm:asm_spf="" '
    2010-02-02 11:58:42: Removing file /tmp/fileXUKYkK
    2010-02-02 11:58:42: Successfully removed file: /tmp/fileXUKYkK
    2010-02-02 11:58:42: /bin/su successfully executed
    2010-02-02 11:58:42: gpnptool: rc=0
    2010-02-02 11:58:42: gpnptool output:
    Resulting profile written to "/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml".
    Success.
    2010-02-02 11:58:42: gpnptool: run /u01/app/11.2.0/grid/bin/gpnptool sign -p="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -w="file:/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -rmws
    2010-02-02 11:58:42: Running as user oracle: /u01/app/11.2.0/grid/bin/gpnptool sign -p="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -w="file:/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -rmws
    2010-02-02 11:58:42: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/11.2.0/grid/bin/gpnptool sign -p="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -o="/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml" -ovr -w="file:/u01/app/11.2.0/grid/gpnp/vis/wallets/peer" -rmws '
    2010-02-02 11:58:43: Removing file /tmp/file4E7Vnj
    2010-02-02 11:58:43: Successfully removed file: /tmp/file4E7Vnj
    2010-02-02 11:58:43: /bin/su successfully executed
    2010-02-02 11:58:43: gpnptool: rc=0
    2010-02-02 11:58:43: gpnptool output:
    Resulting profile written to "/u01/app/11.2.0/grid/gpnp/vis/profiles/peer/profile.xml".
    Success.
    2010-02-02 11:58:43: GPnP peer profile create successfully completed.
    2010-02-02 11:58:43: <--- GPnP peer profile successfully created
    2010-02-02 11:58:43: GPnP local setup successfully created
    2010-02-02 11:58:43: Registering ohasd
    2010-02-02 11:58:43: init file = /u01/app/11.2.0/grid/crs/init/init.ohasd
    2010-02-02 11:58:43: Copying file /u01/app/11.2.0/grid/crs/init/init.ohasd to /etc/init.d directory
    2010-02-02 11:58:43: Setting init.ohasd permission in /etc/init.d directory
    2010-02-02 11:58:43: init file = /u01/app/11.2.0/grid/crs/init/ohasd
    2010-02-02 11:58:43: Copying file /u01/app/11.2.0/grid/crs/init/ohasd to /etc/init.d directory
    2010-02-02 11:58:43: Setting ohasd permission in /etc/init.d directory
    2010-02-02 11:58:43: Removing "/etc/rc.d/rc3.d/S96ohasd"
    2010-02-02 11:58:43: Removing file /etc/rc.d/rc3.d/S96ohasd
    2010-02-02 11:58:43: Failure with return code 1 from command rm /etc/rc.d/rc3.d/S96ohasd
    2010-02-02 11:58:43: Failed to remove file:
    2010-02-02 11:58:43: Creating a link "/etc/rc.d/rc3.d/S96ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:43: Removing "/etc/rc.d/rc5.d/S96ohasd"
    2010-02-02 11:58:43: Removing file /etc/rc.d/rc5.d/S96ohasd
    2010-02-02 11:58:43: Failure with return code 1 from command rm /etc/rc.d/rc5.d/S96ohasd
    2010-02-02 11:58:43: Failed to remove file:
    2010-02-02 11:58:43: Creating a link "/etc/rc.d/rc5.d/S96ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:43: Removing "/etc/rc.d/rc0.d/K19ohasd"
    2010-02-02 11:58:43: Removing file /etc/rc.d/rc0.d/K19ohasd
    2010-02-02 11:58:43: Failure with return code 1 from command rm /etc/rc.d/rc0.d/K19ohasd
    2010-02-02 11:58:43: Failed to remove file:
    2010-02-02 11:58:43: Creating a link "/etc/rc.d/rc0.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:43: Removing "/etc/rc.d/rc1.d/K19ohasd"
    2010-02-02 11:58:43: Removing file /etc/rc.d/rc1.d/K19ohasd
    2010-02-02 11:58:43: Failure with return code 1 from command rm /etc/rc.d/rc1.d/K19ohasd
    2010-02-02 11:58:44: Failed to remove file:
    2010-02-02 11:58:44: Creating a link "/etc/rc.d/rc1.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:44: Removing "/etc/rc.d/rc2.d/K19ohasd"
    2010-02-02 11:58:44: Removing file /etc/rc.d/rc2.d/K19ohasd
    2010-02-02 11:58:44: Failure with return code 1 from command rm /etc/rc.d/rc2.d/K19ohasd
    2010-02-02 11:58:44: Failed to remove file:
    2010-02-02 11:58:44: Creating a link "/etc/rc.d/rc2.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:44: Removing "/etc/rc.d/rc4.d/K19ohasd"
    2010-02-02 11:58:44: Removing file /etc/rc.d/rc4.d/K19ohasd
    2010-02-02 11:58:44: Failure with return code 1 from command rm /etc/rc.d/rc4.d/K19ohasd
    2010-02-02 11:58:44: Failed to remove file:
    2010-02-02 11:58:44: Creating a link "/etc/rc.d/rc4.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:44: Removing "/etc/rc.d/rc6.d/K19ohasd"
    2010-02-02 11:58:44: Removing file /etc/rc.d/rc6.d/K19ohasd
    2010-02-02 11:58:44: Failure with return code 1 from command rm /etc/rc.d/rc6.d/K19ohasd
    2010-02-02 11:58:44: Failed to remove file:
    2010-02-02 11:58:44: Creating a link "/etc/rc.d/rc6.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-02-02 11:58:44: The file ohasd has been successfully linked to the RC directories
    2010-02-02 11:58:44: Starting ohasd
    2010-02-02 11:58:44: itab entries=
    2010-02-02 11:58:49: Created backup /etc/inittab.no_crs
    2010-02-02 11:58:49: Appending to /etc/inittab.tmp:
    2010-02-02 11:58:50: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null
    2010-02-02 11:58:50: Done updating /etc/inittab.tmp
    2010-02-02 11:58:50: Saved /etc/inittab.crs
    2010-02-02 11:58:50: Installed new /etc/inittab
    2010-02-02 11:58:55: ohasd is starting
    2010-02-02 11:58:55: Checking ohasd
    2010-02-02 11:58:55: ohasd started successfully
    2010-02-02 11:58:55: Creating CRS resources and dependencies
    2010-02-02 11:58:55: Configuring HASD
    2010-02-02 11:58:55: Registering type ora.daemon.type
    2010-02-02 11:58:59: Registering type ora.mdns.type
    2010-02-02 11:59:00: Registering type ora.gpnp.type
    2010-02-02 11:59:01: Registering type ora.gipc.type
    2010-02-02 11:59:02: Registering type ora.cssd.type
    2010-02-02 11:59:04: Registering type ora.cssdmonitor.type
    2010-02-02 11:59:07: Registering type ora.crs.type
    2010-02-02 11:59:08: Registering type ora.evm.type
    2010-02-02 11:59:09: Registering type ora.ctss.type
    2010-02-02 11:59:10: Registering type ora.asm.type
    2010-02-02 11:59:13: Registering type ora.drivers.acfs.type
    2010-02-02 11:59:14: Registering type ora.diskmon.type
    2010-02-02 11:59:34: ADVM/ACFS is configured
    2010-02-02 11:59:35: Successfully created CRS resources for cluster daemon and ASM
    2010-02-02 11:59:35: Checking if initial configuration has been performed
    2010-02-02 11:59:35: Starting CSS in exclusive mode
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.gipcd' on 'vis'
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.mdnsd' on 'vis'
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.gipcd' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.mdnsd' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.gpnpd' on 'vis'
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.gpnpd' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.cssdmonitor' on 'vis'
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.cssdmonitor' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.cssd' on 'vis'
    2010-02-02 12:00:04: CRS-2672: Attempting to start 'ora.diskmon' on 'vis'
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.diskmon' on 'vis' succeeded
    2010-02-02 12:00:04: CRS-2676: Start of 'ora.cssd' on 'vis' succeeded
    2010-02-02 12:00:04: Querying for existing CSS voting disks
    2010-02-02 12:00:04: Performing initial configuration for cluster
    2010-02-02 12:00:51: Start of resource "ora.ctssd -init" Succeeded
    2010-02-02 12:00:51: Creating or upgrading OCR keys
    2010-02-02 12:00:51: Command return code of 255 (65280) from command: /u01/app/11.2.0/grid/bin/ocrconfig -upgrade oracle oinstall
    2010-02-02 12:00:51: Failed to create Oracle Cluster Registry configuration, rc 255
    2010-02-02 12:00:51: Exiting exclusive mode
    2010-02-02 12:00:51: Command return code of 1 (256) from command: /u01/app/11.2.0/grid/bin/crsctl stop resource ora.crsd -init
    2010-02-02 12:00:51: Stop of resource "ora.crsd -init" failed
    2010-02-02 12:00:51: Failed to stop CRSD
    2010-02-02 12:01:20: Initial cluster configuration failed. See /u01/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_vis.log for details

    Hi,
    I am trying to setup Oracle 11gR2 RAC setup on RHEL 5.4 64-bit machine, during grid installation i am also getting the same error.
    2010-07-12 03:12:42: Removing file /etc/rc.d/rc6.d/K19ohasd
    2010-07-12 03:12:42: Failure with return code 1 from command rm /etc/rc.d/rc6.d/K19ohasd
    2010-07-12 03:12:42: Failed to remove file:
    2010-07-12 03:12:42: Creating a link "/etc/rc.d/rc6.d/K19ohasd" pointing to /etc/init.d/ohasd
    2010-07-12 03:12:42: The file ohasd has been successfully linked to the RC directories
    2010-07-12 03:12:42: Starting ohasd
    2010-07-12 03:12:42: itab entries=
    2010-07-12 03:12:47: Created backup /etc/inittab.no_crs
    2010-07-12 03:12:47: Appending to /etc/inittab.tmp:
    2010-07-12 03:12:47: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null
    2010-07-12 03:12:47: Done updating /etc/inittab.tmp
    2010-07-12 03:12:47: Saved /etc/inittab.crs
    2010-07-12 03:12:47: Installed new /etc/inittab
    2010-07-12 03:13:03: ohasd is starting
    2010-07-12 03:13:03: Checking ohasd
    2010-07-12 03:13:03: ohasd started successfully
    2010-07-12 03:13:03: Creating CRS resources and dependencies
    2010-07-12 03:13:03: Configuring HASD
    2010-07-12 03:13:03: Registering type ora.daemon.type
    2010-07-12 03:13:04: Registering type ora.mdns.type
    2010-07-12 03:13:04: Registering type ora.gpnp.type
    2010-07-12 03:13:04: Registering type ora.gipc.type
    2010-07-12 03:13:05: Registering type ora.cssd.type
    2010-07-12 03:13:05: Registering type ora.cssdmonitor.type
    2010-07-12 03:13:06: Registering type ora.crs.type
    2010-07-12 03:13:06: Registering type ora.evm.type
    2010-07-12 03:13:07: Registering type ora.ctss.type
    2010-07-12 03:13:07: Registering type ora.asm.type
    2010-07-12 03:13:08: Registering type ora.drivers.acfs.type
    2010-07-12 03:13:08: Registering type ora.diskmon.type
    2010-07-12 03:13:35: ADVM/ACFS is configured
    2010-07-12 03:13:35: Successfully created CRS resources for cluster daemon and ASM
    2010-07-12 03:13:35: Checking if initial configuration has been performed
    2010-07-12 03:13:35: Starting CSS in exclusive mode
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.gipcd' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.mdnsd' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.mdnsd' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.gipcd' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.gpnpd' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.gpnpd' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.cssdmonitor' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.cssdmonitor' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.cssd' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2672: Attempting to start 'ora.diskmon' on 'lodvmrhn3'
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.diskmon' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: CRS-2676: Start of 'ora.cssd' on 'lodvmrhn3' succeeded
    2010-07-12 03:14:04: Querying for existing CSS voting disks
    2010-07-12 03:14:05: Performing initial configuration for cluster
    2010-07-12 03:14:06: Start of resource "ora.ctssd -init" Succeeded
    2010-07-12 03:14:06: Creating or upgrading OCR keys
    2010-07-12 03:14:06: Command return code of 255 (65280) from command: /u01/app/11.2.0/grid/bin/ocrconfig -upgrade oracle oinstall
    2010-07-12 03:14:06: Failed to create Oracle Cluster Registry configuration, rc 255
    2010-07-12 03:14:06: Exiting exclusive mode
    2010-07-12 03:14:06: Command return code of 1 (256) from command: /u01/app/11.2.0/grid/bin/crsctl stop resource ora.crsd -init
    2010-07-12 03:14:06: Stop of resource "ora.crsd -init" failed
    2010-07-12 03:14:06: Failed to stop CRSD
    2010-07-12 03:14:34: Initial cluster configuration failed. See /u01/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_lodvmrhn3.log for details
    Please hel me to resole the issue.
    I have followed exact steps mentioned in the http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnLinuxUsingNFS.php

  • RAC - Oracle Grid Infrastructure configure failed

    Hi, am trying to install 2 node RAC on Oracle VMs. Before the installation during the -preinst check there were few issues which were resolved (ex user equivalence). After that during the installation process of the Grid it failed at step "Configure Oracle Grid Infrastructure for a cluster". After it failed at this step, subsequent steps too failed which I asked OUI to ignore and then I ran both the post installation scripts. And then ran post crsinst which failed. Pasting below the output of the root.sh script, post crsinst and other checks.
    [root@bsfrac01 grid]# sh root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/11.2/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2011-02-13 00:11:55: Parsing the host name
    2011-02-13 00:11:55: Checking for super user privileges
    2011-02-13 00:11:55: User has super user privileges
    Using configuration parameter file: /u01/app/11.2/grid/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding daemon to inittab
    CRS-4123: Oracle High Availability Services has been started.
    ohasd is starting
    CRS-2672: Attempting to start 'ora.gipcd' on 'bsfrac01'
    CRS-2672: Attempting to start 'ora.mdnsd' on 'bsfrac01'
    CRS-2676: Start of 'ora.mdnsd' on 'bsfrac01' succeeded
    CRS-2676: Start of 'ora.gipcd' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'bsfrac01'
    CRS-2676: Start of 'ora.gpnpd' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'bsfrac01'
    CRS-2676: Start of 'ora.cssdmonitor' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'bsfrac01'
    CRS-2672: Attempting to start 'ora.diskmon' on 'bsfrac01'
    CRS-2676: Start of 'ora.diskmon' on 'bsfrac01' succeeded
    CRS-2676: Start of 'ora.cssd' on 'bsfrac01' succeeded
    CRS-2672: Attempting to start 'ora.ctssd' on 'bsfrac01'
    CRS-2676: Start of 'ora.ctssd' on 'bsfrac01' succeeded
    ASM created and started successfully.
    DiskGroup DATA1 created successfully.
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    CRS-2672: Attempting to start 'ora.crsd' on 'bsfrac01'
    CRS-2676: Start of 'ora.crsd' on 'bsfrac01' succeeded
    CRS-4256: Updating the profile
    Successful addition of voting disk 0ea2052d8a714fd7bf46d9d5c785483e.
    Successfully replaced voting disk group with +DATA1.
    CRS-4256: Updating the profile
    CRS-4266: Voting file(s) successfully replaced
    ## STATE File Universal Id File Name Disk group
    1. ONLINE 0ea2052d8a714fd7bf46d9d5c785483e (ORCL:DISK1) [DATA1]
    Located 1 voting disk(s).
    *Failed to rmtcopy "/tmp/filekRIMbG" to "/u01/app/11.2/grid/gpnp/manifest.txt" for nodes {bsfrac01,bsfrac02}, rc=256*
    *Failed to rmtcopy "/u01/app/11.2/grid/gpnp/bsfrac01/profiles/peer/profile.xml" to "/u01/app/11.2/grid/gpnp/profiles/peer/profile.xml" for nodes {bsfrac01,bsfrac02}, rc=256*
    rmtcopy aborted
    Failed to promote local gpnp setup to other cluster nodes
    CRS-2673: Attempting to stop 'ora.crsd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.crsd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.asm' on 'bsfrac01'
    CRS-2677: Stop of 'ora.asm' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.ctssd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.ctssd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'bsfrac01'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.cssd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.cssd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.gpnpd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.gipcd' on 'bsfrac01' succeeded
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'bsfrac01'
    CRS-2677: Stop of 'ora.mdnsd' on 'bsfrac01' succeeded
    Initial cluster configuration failed. See /u01/app/11.2/grid/cfgtoollogs/crsconfig/rootcrs_bsfrac01.log for details
    [root@bsfrac01 grid]#
    [oracle@bsfrac01 bin]$ ./cluvfy stage -post crsinst -n bsfrac01,bsfrac02 -verbose
    Performing post-checks for cluster services setup
    Checking node reachability...
    Check: Node reachability from node "bsfrac01"
    Destination Node Reachable?
    bsfrac01 yes
    bsfrac02 yes
    Result: Node reachability check passed from node "bsfrac01"
    Checking user equivalence...
    Check: User equivalence for user "oracle"
    Node Name Comment
    bsfrac01 passed
    bsfrac02 passed
    Result: User equivalence check passed for user "oracle"
    ERROR:
    PRKC-1094 : Failed to retrieve the active version of crs: {0}
    Checking time zone consistency...
    Time zone consistency check passed.
    ERROR:
    PRKC-1093 : Failed to retrieve the version of crs software on node "java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
    " : {1}
    ERROR:
    Cluster manager integrity check failed
    PRVF-5434 : Cannot identify the current CRS software version
    UDev attributes check for OCR locations started...
    Result: UDev attributes check passed for OCR locations
    UDev attributes check for Voting Disk locations started...
    ERROR:
    PRVF-5197 : Failed to retrieve voting disk locationsPRKC-1092 : Failed to retrieve the location of votedisks: java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
    Result: UDev attributes check failed for Voting Disk locations
    Check default user file creation mask
    Node Name Available Required Comment
    bsfrac01 0022 0022 passed
    bsfrac02 0022 0022 passed
    Result: Default user file creation mask check passed
    Checking cluster integrity...
    Node Name
    bsfrac01
    Cluster integrity check failed This check did not run on the following node(s):
    bsfrac02
    Checking OCR integrity...
    Checking the absence of a non-clustered configuration...
    All nodes free of non-clustered, local-only configurations
    ERROR:
    PRKC-1094 : Failed to retrieve the active version of crs: {0}
    ERROR:
    PRVF-5300 : Failed to retrieve active version for CRS on this node
    OCR integrity check failed
    Checking CRS integrity...
    ERROR:
    PRKC-1094 : Failed to retrieve the active version of crs: {0}
    ERROR:
    PRVF-5300 : Failed to retrieve active version for CRS on this node
    CRS integrity check failed
    OCR detected on ASM. Running ACFS Integrity checks...
    Starting check to see if ASM is running on all cluster nodes...
    PRVF-5137 : Failure while checking ASM status on node "bsfrac01"
    PRVF-5137 : Failure while checking ASM status on node "bsfrac02"
    Starting Disk Groups check to see if at least one Disk Group configured...
    PRVF-5112 : An Exception occurred while checking for Disk Groups
    PRVF-5114 : Disk Group check failed. No Disk Groups configured
    Task ACFS Integrity check failed
    Checking Oracle Cluster Voting Disk configuration...
    ERROR:
    PRKC-1093 : Failed to retrieve the version of crs software on node "java.io.IOException: /u01/app/11.2.0/grid/bin/crsctl: not found
    " : {1}
    ERROR:
    PRVF-5434 : Cannot identify the current CRS software version
    PRVF-5431 : Oracle Cluster Voting Disk configuration check failed
    Checking to make sure user "oracle" is not in "root" group
    Node Name Status Comment
    bsfrac01 does not exist passed
    bsfrac02 does not exist passed
    Result: User "oracle" is not part of "root" group. Check passed
    Post-check for cluster services setup was unsuccessful on all the nodes.
    [oracle@bsfrac01 bin]$ /u01/app/11.2/grid/bin/ocrcheck
    Status of Oracle Cluster Registry is as follows :
    Version : 3
    Total space (kbytes) : 262120
    Used space (kbytes) : 408
    Available space (kbytes) : 261712
    ID : 1671840043
    Device/File Name : +DATA1
    Device/File integrity check succeeded
    Device/File not configured
    Device/File not configured
    Device/File not configured
    Device/File not configured
    Cluster registry integrity check succeeded
    Logical corruption check bypassed due to non-privileged user
    ASM looks to be up and running..
    [oracle@bsfrac01 bin]$ /usr/sbin/oracleasm listdisks
    DISK1
    DISK2
    DISK3
    DISK4
    DISK5
    DISK6
    [oracle@bsfrac01 bin]$ /usr/sbin/oracleasm status
    Checking if ASM is loaded: yes
    Checking if /dev/oracleasm is mounted: yes
    Please help.

    before installation have u configure the private interconnect on both the nodes to same network adapter..
    for example on node 1 if the private interconnect is on eth0 then on the node 2 it should use eth0 only...
    for private interconnect use the hostonly option on both the nodes in the network configuration page of the vmware or virtual box..
    and for public network it can be bridged
    more over if you are installing on the laptop its good to configure the SSH using the OUI.. rather than doing it manually.. as it saves time
    the private and the public networks should not have same range of ip address. like if public address are like 192.168.2.222/255.255.255.0 and private address have to be different like 10.10.1.2/255.0.0.0 (this is just an example)
    have to configured the NTP.
    any ways try installing the oracle rac on virtual box follow the steps given the below website they are pretty straight forward...
    http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnOEL5UsingVirtualBox.php

  • 11g R2 RAC - Grid Infrastructure installation - "root.sh" fails on node#2

    Hi there,
    I am trying to create a two node 11g R2 RAC on OEL 5.5 (32-bit) using VMWare virtual machines. I have correctly configured both nodes. Cluster Verification utility returns on following error \[which I believe can be ignored]:
    Checking daemon liveness...
    Liveness check failed for "ntpd"
    Check failed on nodes:
    rac2,rac1
    PRVF-5415 : Check to see if NTP daemon is running failed
    Clock synchronization check using Network Time Protocol(NTP) failed
    Pre-check for cluster services setup was unsuccessful on all the nodes.
    While Grid Infrastructure installation (for a Cluster option), things go very smooth until I run "root.sh" on node# 2. orainstRoot.sh ran OK on both. "root.sh" run OK on node# 1 and ends with:
    Checking swap space: must be greater than 500 MB.   Actual 1967 MB    Passed
    The inventory pointer is located at /etc/oraInst.loc
    The inventory is located at /u01/app/oraInventory
    *'UpdateNodeList' was successful.*
    *[root@rac1 ~]#*
    "root.sh" fails on rac2 (2nd node) with following error:
    CRS-2672: Attempting to start 'ora.evmd' on 'rac2'
    CRS-2676: Start of 'ora.evmd' on 'rac2' succeeded
    Timed out waiting for the CRS stack to start.
    *[root@rac2 ~]#*
    I know this info may not be enough to figure out what the problem may be. Please let me know what should I look for to find the issue and fix it. Its been like almost two weeks now :-(
    Regards
    Amer

    Hi Zheng,
    ocssd.log is HUGE. So I am putting few of the last lines in the log file hoping they may give some clue:
    2011-07-04 19:49:24.007: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 2180 > margin 1500  cur_ms 36118424 lastalive 36116244
    2011-07-04 19:49:26.005: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 4150 > margin 1500 cur_ms 36120424 lastalive 36116274
    2011-07-04 19:49:26.006: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 4180 > margin 1500  cur_ms 36120424 lastalive 36116244
    2011-07-04 19:49:27.997: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:27.997: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:33.001: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:33.001: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:37.996: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:37.996: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:43.000: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:43.000: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:49:48.004: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:49:48.005: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:12.003: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:12.008: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1660 > margin 1500 cur_ms 36166424 lastalive 36164764
    2011-07-04 19:50:12.009: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1660 > margin 1500  cur_ms 36166424 lastalive 36164764
    2011-07-04 19:50:15.796: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 2130 > margin 1500  cur_ms 36170214 lastalive 36168084
    2011-07-04 19:50:16.996: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:16.996: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:17.826: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1540 > margin 1500 cur_ms 36172244 lastalive 36170704
    2011-07-04 19:50:17.826: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1570 > margin 1500  cur_ms 36172244 lastalive 36170674
    2011-07-04 19:50:21.999: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:21.999: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:26.011: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1740 > margin 1500 cur_ms 36180424 lastalive 36178684
    2011-07-04 19:50:26.011: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1620 > margin 1500  cur_ms 36180424 lastalive 36178804
    2011-07-04 19:50:27.004: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:27.004: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:28.002: [    CSSD][2997803920]clssnmvSchedDiskThreads: DiskPingThread for voting file ORCL:DATA sched delay 1700 > margin 1500 cur_ms 36182414 lastalive 36180714
    2011-07-04 19:50:28.002: [    CSSD][2997803920]clssnmvSchedDiskThreads: KillBlockThread for voting file ORCL:DATA sched delay 1790 > margin 1500  cur_ms 36182414 lastalive 36180624
    2011-07-04 19:50:31.998: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:31.998: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    2011-07-04 19:50:37.001: [    CSSD][2901298064]clssnmSendingThread: sending status msg to all nodes
    2011-07-04 19:50:37.002: [    CSSD][2901298064]clssnmSendingThread: sent 5 status msgs to all nodes
    *<end of log file>*And the alertrac2.log contains:
    *[root@rac2 rac2]# cat alertrac2.log*
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2011-07-02 16:43:51.571
    [client(16134)]CRS-2106:The OLR location /u01/grid/oracle/product/11.2.0/grid/cdata/rac2.olr is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/client/ocrconfig_16134.log.
    2011-07-02 16:43:57.125
    [client(16134)]CRS-2101:The OLR was formatted using version 3.
    2011-07-02 16:44:43.214
    [ohasd(16188)]CRS-2112:The OLR service started on node rac2.
    2011-07-02 16:45:06.446
    [ohasd(16188)]CRS-2772:Server 'rac2' has been assigned to pool 'Free'.
    2011-07-02 16:53:30.061
    [ohasd(16188)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-02 16:53:55.042
    [cssd(17674)]CRS-1713:CSSD daemon is started in exclusive mode
    2011-07-02 16:54:38.334
    [cssd(17674)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    [cssd(17674)]CRS-1636:The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1 and is terminating; details at (:CSSNM00006:) in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log
    2011-07-02 16:54:38.464
    [cssd(17674)]CRS-1603:CSSD on node rac2 shutdown by user.
    2011-07-02 16:54:39.174
    [ohasd(16188)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'rac2'.
    2011-07-02 16:55:43.430
    [cssd(17945)]CRS-1713:CSSD daemon is started in clustered mode
    2011-07-02 16:56:02.852
    [cssd(17945)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    2011-07-02 16:56:04.061
    [cssd(17945)]CRS-1605:CSSD voting file is online: ORCL:DATA; details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log.
    2011-07-02 16:56:18.350
    [cssd(17945)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
    2011-07-02 16:56:29.283
    [ctssd(18020)]CRS-2403:The Cluster Time Synchronization Service on host rac2 is in observer mode.
    2011-07-02 16:56:29.551
    [ctssd(18020)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac1.
    2011-07-02 16:56:29.615
    [ctssd(18020)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 16:56:29.616
    [ctssd(18020)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 16:56:29.641
    [ctssd(18020)]CRS-2401:The Cluster Time Synchronization Service started on host rac2.
    [client(18052)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(18056)]CRS-10001:ACFS-9322: done.
    2011-07-02 17:01:40.963
    [ohasd(16188)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.asm'. Details at (:CRSPE00111:) in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ohasd/ohasd.log.
    [client(18590)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(18594)]CRS-10001:ACFS-9322: done.
    2011-07-02 17:27:46.385
    [ctssd(18020)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 17:27:46.385
    [ctssd(18020)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 17:46:48.717
    [crsd(22519)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:49.641
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:51.459
    [crsd(22553)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:51.776
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:53.928
    [crsd(22574)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:53.956
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:55.834
    [crsd(22592)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:56.273
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:46:57.762
    [crsd(22610)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:46:58.631
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:00.259
    [crsd(22628)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:00.968
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:02.513
    [crsd(22645)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:03.309
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:05.081
    [crsd(22663)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:05.770
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:07.796
    [crsd(22681)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:08.257
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:10.733
    [crsd(22699)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:11.739
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:13.547
    [crsd(22732)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 17:47:14.111
    [ohasd(16188)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 17:47:14.112
    [ohasd(16188)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
    2011-07-02 17:58:18.459
    [ctssd(18020)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 17:58:18.459
    [ctssd(18020)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    [client(26883)]CRS-10001:ACFS-9200: Supported
    2011-07-02 18:13:34.627
    [ctssd(18020)]CRS-2405:The Cluster Time Synchronization Service on host rac2 is shutdown by user
    2011-07-02 18:13:42.368
    [cssd(17945)]CRS-1603:CSSD on node rac2 shutdown by user.
    2011-07-02 18:15:13.877
    [client(27222)]CRS-2106:The OLR location /u01/grid/oracle/product/11.2.0/grid/cdata/rac2.olr is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/client/ocrconfig_27222.log.
    2011-07-02 18:15:14.011
    [client(27222)]CRS-2101:The OLR was formatted using version 3.
    2011-07-02 18:15:23.226
    [ohasd(27261)]CRS-2112:The OLR service started on node rac2.
    2011-07-02 18:15:23.688
    [ohasd(27261)]CRS-8017:location: /etc/oracle/lastgasp has 2 reboot advisory log files, 0 were announced and 0 errors occurred
    2011-07-02 18:15:24.064
    [ohasd(27261)]CRS-2772:Server 'rac2' has been assigned to pool 'Free'.
    2011-07-02 18:16:29.761
    [ohasd(27261)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-02 18:16:30.190
    [gpnpd(28498)]CRS-2328:GPNPD started on node rac2.
    2011-07-02 18:16:41.561
    [cssd(28562)]CRS-1713:CSSD daemon is started in exclusive mode
    2011-07-02 18:16:49.111
    [cssd(28562)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    2011-07-02 18:16:49.166
    [cssd(28562)]CRS-1605:CSSD voting file is online: ORCL:DATA; details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log.
    [cssd(28562)]CRS-1636:The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1 and is terminating; details at (:CSSNM00006:) in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log
    2011-07-02 18:17:01.122
    [cssd(28562)]CRS-1603:CSSD on node rac2 shutdown by user.
    2011-07-02 18:17:06.917
    [ohasd(27261)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'rac2'.
    2011-07-02 18:17:23.602
    [mdnsd(28485)]CRS-5602:mDNS service stopping by request.
    2011-07-02 18:17:36.217
    [gpnpd(28732)]CRS-2328:GPNPD started on node rac2.
    2011-07-02 18:17:43.673
    [cssd(28794)]CRS-1713:CSSD daemon is started in clustered mode
    2011-07-02 18:17:49.826
    [cssd(28794)]CRS-1707:Lease acquisition for node rac2 number 2 completed
    2011-07-02 18:17:49.865
    [cssd(28794)]CRS-1605:CSSD voting file is online: ORCL:DATA; details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/cssd/ocssd.log.
    2011-07-02 18:18:03.049
    [cssd(28794)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
    2011-07-02 18:18:06.160
    [ctssd(28861)]CRS-2403:The Cluster Time Synchronization Service on host rac2 is in observer mode.
    2011-07-02 18:18:06.220
    [ctssd(28861)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac1.
    2011-07-02 18:18:06.238
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 18:18:06.239
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 18:18:06.794
    [ctssd(28861)]CRS-2401:The Cluster Time Synchronization Service started on host rac2.
    [client(28891)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(28895)]CRS-10001:ACFS-9322: done.
    2011-07-02 18:18:33.465
    [crsd(29020)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:33.575
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:35.757
    [crsd(29051)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:36.129
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:38.596
    [crsd(29066)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:39.146
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:41.058
    [crsd(29085)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:41.435
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:44.255
    [crsd(29101)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:45.165
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:47.013
    [crsd(29121)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:47.409
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:50.071
    [crsd(29136)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:50.118
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:51.843
    [crsd(29156)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:52.373
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:54.361
    [crsd(29171)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:54.772
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:56.620
    [crsd(29202)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:57.104
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:58.997
    [crsd(29218)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/crsd/crsd.log.
    2011-07-02 18:18:59.301
    [ohasd(27261)]CRS-2765:Resource 'ora.crsd' has failed on server 'rac2'.
    2011-07-02 18:18:59.302
    [ohasd(27261)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
    2011-07-02 18:49:58.070
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 18:49:58.070
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 19:21:33.362
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 19:21:33.362
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 19:52:05.271
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 19:52:05.271
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 20:22:53.696
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 20:22:53.696
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 20:53:43.949
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 20:53:43.949
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 21:24:32.990
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 21:24:32.990
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 21:55:21.907
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 21:55:21.908
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 22:26:45.752
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 22:26:45.752
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 22:57:54.682
    [ctssd(28861)]CRS-2412:The Cluster Time Synchronization Service detects that the local time is significantly different from the mean cluster time. Details in /u01/grid/oracle/product/11.2.0/grid/log/rac2/ctssd/octssd.log.
    2011-07-02 22:57:54.683
    [ctssd(28861)]CRS-2409:The clock on host rac2 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2011-07-02 23:07:28.603
    [cssd(28794)]CRS-1612:Network communication with node rac1 (1) missing for 50% of timeout interval.  Removal of this node from cluster in 14.020 seconds
    2011-07-02 23:07:35.621
    [cssd(28794)]CRS-1611:Network communication with node rac1 (1) missing for 75% of timeout interval.  Removal of this node from cluster in 7.010 seconds
    2011-07-02 23:07:39.629
    [cssd(28794)]CRS-1610:Network communication with node rac1 (1) missing for 90% of timeout interval.  Removal of this node from cluster in 3.000 seconds
    2011-07-02 23:07:42.641
    [cssd(28794)]CRS-1632:Node rac1 is being removed from the cluster in cluster incarnation 205080558
    2011-07-02 23:07:44.751
    [cssd(28794)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac2 .
    2011-07-02 23:07:45.326
    [ctssd(28861)]CRS-2407:The new Cluster Time Synchronization Service reference node is host rac2.
    2011-07-04 19:46:26.008
    [ohasd(27261)]CRS-8011:reboot advisory message from host: rac1, component: mo155738, with time stamp: L-2011-07-04-19:44:43.318
    [ohasd(27261)]CRS-8013:reboot advisory message text: clsnomon_status: need to reboot, unexpected failure 8 received from CSS
    *[root@rac2 rac2]#* This log file start with complaint that OLR is not accessible. Here is what I see (rca2):
    -rw------- 1 root oinstall 272756736 Jul  2 18:18 /u01/grid/oracle/product/11.2.0/grid/cdata/rac2.olrAnd I guess rest of the problems start with this.

  • Troubles with Grid Infrastructure Installation

    Hello everybody
    Enviroment:
    O.S: SLES SP1 x64
    Oracle 11g R2 Update 3
    I want to install this product and make a RAC of tow nodes. Since some days ago I have a problem with the installation process. When I perform ssh connectivity setup, this errors appears at ssh log configuration:
    INFO: [rac2.mydomain.com]
    INFO: /bin/mkdir -p "/opt/oracle/.ssh"
    INFO: Exit-status: 0
    INFO: Error:
    INFO:
    INFO:
    INFO: [rac2.mydomain.com]
    INFO: /bin/rm -f "/opt/oracle/.ssh/id_rsa.pubrac2.mydomain.com"
    INFO: Exit-status: 0
    INFO: Error:
    INFO:
    INFO:
    INFO: Copy localfile: /opt/oracle/.ssh/id_rsa.pub to remotefile: "/opt/oracle/.ssh/id_rsa.pubrac2.mydomain.com"
    INFO: [rac2.mydomain.com]
    INFO: /bin/cp -p "/opt/oracle/.ssh/authorized_keys" "/opt/oracle/.ssh/authorized_keys.ri.bak"
    INFO: Exit-status: 1
    INFO: Error: /bin/cp: cannot stat `/opt/oracle/.ssh/authorized_keys': No such file or directory
    INFO: Creating keys on remote Host rac1.mydomain.com
    INFO: to setup SSH on Host rac1.mydomain.com
    INFO: [rac1.mydomain.com]
    INFO: /bin/rm /opt/oracle/.ssh/identity.pub
    INFO: Exit-status: 1
    INFO: Error: /bin/rm: cannot remove `/opt/oracle/.ssh/identity.pub': No such file or directory
    INFO:
    INFO:
    INFO: [rac1.mydomain.com]
    INFO: /bin/rm /opt/oracle/.ssh/identity
    INFO: Exit-status: 1
    INFO: Error: /bin/rm: cannot remove `/opt/oracle/.ssh/identity': No such file or directory
    NFO:
    INFO: Creating keys on remote Host rac2.mydomain.com
    INFO: to setup SSH on Host rac2.mydomain.com
    INFO: [rac2.mydomain.com]
    INFO: /bin/rm /opt/oracle/.ssh/identity.pub
    INFO: Exit-status: 1
    INFO: Error: /bin/rm: cannot remove `/opt/oracle/.ssh/identity.pub': No such file or directory
    INFO:
    INFO:
    INFO: [rac2.mydomain.com]
    INFO: /bin/rm /opt/oracle/.ssh/identity
    INFO: Exit-status: 1
    INFO: Error: /bin/rm: cannot remove `/opt/oracle/.ssh/identity': No such file or directory
    At installation logs, these lines appear:
    INFO: SSH Setup policy used: BIDIRECTIONAL
    INFO: Preparing to check passwordless SSH Connectivity between nodes: [rac1, rac2]
    INFO: Testing passwordless SSH connectivity between the selected nodes. This may take several minutes, please wait...
    INFO: OverallStatus of User Equivalence check using CVU is SUCCESSFUL
    INFO: Finding passwordless SSH connectivity setup on remote nodes
    INFO: Preparing remote commands to check passwordless SSH connectivity setup on remote nodes
    INFO: Total number of remote commands to be executed is 2
    WARNING: Failed while executing remote commands to check SSH connectivity to other nodes..
    Refer associated stacktrace #oracle.install.driver.oui.OUISSHSupportManager:887
    INFO: Source Node: rac2 Target Node: rac1
    INFO: Exception: null
    INFO: Status log: oracle.install.driver.oui.OUISSHSupportManager$SSHSetupVerificationCommand: 0|Permission denied (publickey,keyboard-interac
    tive). :failed
    INFO: Source Node: rac2 Target Node: rac2
    INFO: Exception: null
    INFO: Status log: oracle.install.driver.oui.OUISSHSupportManager$SSHSetupVerificationCommand: 0|Permission denied (publickey,keyboard-interac
    tive). :failed
    INFO: Remote node(s) not configured for passwordless SSH connectivity : [rac2]
    INFO: Details about the list of remote node(s), not configured for passwordless SSH connectivity
    NODE REMOTE NODES
    rac2 [rac1, rac2]
    INFO: Pause Oracle Grid Infrastructure
    INFO: Resume Oracle Grid Infrastructure
    INFO: Adding ExitStatus USER_CANCELLED_INSTALL to the exit status set
    INFO: Finding the most appropriate exit status for the current application
    INFO: Exit Status is 4
    INFO: Shutdown Oracle Grid Infrastructure
    INFO: Unloading Setup Driver
    To confirm that everything is going wrong, when I click in Test button, this error appears:
    [INS_06006] Passwordless SSH connectivity not set up between the following node(s): [rac2]
    I can do ssh from rac1 to rac2 without password, but I can´t from rac2 to rac1
    I run cluvfy.sh and everything is ok.
    I hope for helping.
    Thanks a lot

    The problem begins when on remote node It can´t perform a several operations as logs appears.
    INFO: [rac2.mydomain.com]
    INFO: /bin/cp -p "/opt/oracle/.ssh/authorized_keys" "/opt/oracle/.ssh/authorized_keys.ri.bak"
    INFO: Exit-status: 1
    INFO: Error: /bin/cp: cannot stat `/opt/oracle/.ssh/authorized_keys': No such file or directory
    INFO: Creating keys on remote Host rac1.mydomain.com
    INFO: to setup SSH on Host rac1.mydomain.com
    INFO: [rac1.mydomain.com]
    INFO: /bin/rm /opt/oracle/.ssh/identity.pub
    INFO: Exit-status: 1
    INFO: Error: /bin/rm: cannot remove `/opt/oracle/.ssh/identity.pub': No such file or directory
    INFO:
    INFO:
    INFO: [rac1.mydomain.com]
    INFO: /bin/rm /opt/oracle/.ssh/identity
    INFO: Exit-status: 1
    INFO: Error: /bin/rm: cannot remove `/opt/oracle/.ssh/identity': No such file or directory
    NFO:
    INFO: Creating keys on remote Host rac2.mydomain.com
    INFO: to setup SSH on Host rac2.mydomain.com
    INFO: [rac2.mydomain.com]
    INFO: /bin/rm /opt/oracle/.ssh/identity.pub
    INFO: Exit-status: 1
    INFO: Error: /bin/rm: cannot remove `/opt/oracle/.ssh/identity.pub': No such file or directory
    INFO:
    INFO:
    INFO: [rac2.mydomain.com]
    INFO: /bin/rm /opt/oracle/.ssh/identity
    INFO: Exit-status: 1
    INFO: Error: /bin/rm: cannot remove `/opt/oracle/.ssh/identity': No such file or directory

Maybe you are looking for

  • Outlook not syncing with icloud on iphone

    outlook not syncing with icloud on iphone?

  • Payment Advcie - EDI 823 (Lockbox  - Incoming Payment)

    Hello, In process of testing EDI 823(Lockbox u2013 Incoming Payments) using testtool, Idocs are been successfully processing when an attempt is made to post the incoming customeru2019s payment for an open invoice (Basic type u2013 FINSTA01, Message t

  • Table for existing PO/Sch.Agg pricing condition types

    Hi Experts, Which table will have PO / Sch.Aggrement  - pricing condition types with values as maintained in PO (like freight / P&F etc). I have the input of PO/Sch.Agg ref, plant, vendor & material. We have created Z condition types for freight/ P&F

  • Reservation and Pur Req

    Hi, System is creating reservation for stock item and purchase req for non stock item. Anybody tell me where is the setting( other than network profile). Regards, KP

  • Configuring for different GR/IR accounts for WRX T/E Key

    Hi , I am in a strange situation. I have to configure the automatic postings for MM, in transaction event key WRX. for the rule Valuation class activated, with following example of settings Chart of Accounts -- INT Transaction key -- WRX Valuation Cl