Oracle 11gR2 RAC Root.sh Failed On The Second Node

Hello,
When i installing Oracle 11gR2 RAC on AIX 7.1 , root.sh succeeds on first node but fails on the second node:
I get error "Root.sh Failed On The Second Node With Error ORA-15018 ORA-15031 ORA-15025 ORA-27041 [ID 1459711.1]" within Oracle installation.
Applies to:
Oracle Server - 11gR2 RAC
EMC VNX 500
IBM AIX on POWER Systems (64-bit)
in /dev/rhdiskpower0 does not show in kfod output on second node. It is an EMC multipath disk device.
But the disk can be found with AIX command.
any help!!
Thanks

the soluation that uninstall "EMC solutitons enabler" but in the machine i just find "EMC migration enabler" and conn't remove without remove EMC Powerpath.

Similar Messages

  • Why root.sh fails in the second node?

    Hi
    After successful install of oracle11 grid in 2 nodes and running root.sh on
    node1, root.sh on node2 fails:
    [root@vmorarac2 dev]#
    /u01/app/product/11.2.0/oracle/root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:
        ORACLE_OWNER= oracle
        ORACLE_HOME=  /u01/app/product/11.2.0/oracle
    Enter the full pathname of the local bin directory:
    [/usr/local/bin]:
    The file "dbhome" already exists in /usr/local/bin. 
    Overwrite it? (y/n)
    [n]: y
       Copying dbhome to /usr/local/bin ...
    The file "oraenv" already exists in /usr/local/bin. 
    Overwrite it? (y/n)
    [n]: y
       Copying oraenv to /usr/local/bin ...
    The file "coraenv" already exists in /usr/local/bin. 
    Overwrite it? (y/n)
    [n]: y
       Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed
    by
    Database Configuration Assistant when a database is
    created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2013-07-17 08:37:10: Parsing the host name
    2013-07-17 08:37:10: Checking for super user
    privileges
    2013-07-17 08:37:10: User has super user privileges
    Using configuration parameter file:
    /u01/app/product/11.2.0/oracle/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    Adding daemon to inittab
    CRS-4123: Oracle High Availability Services has been
    started.
    ohasd is starting
    CRS-4402: The CSS daemon was started in exclusive mode but
    found an active CSS daemon on node vmorarac1, number 1, and is terminating
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on
    'vmorarac2'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'vmorarac2'
    succeeded
    An active cluster was found during exclusive startup,
    restarting to join the cluster
    CRS-2672: Attempting to start 'ora.mdnsd' on
    'vmorarac2'
    CRS-2676: Start of 'ora.mdnsd' on 'vmorarac2'
    succeeded
    CRS-2672: Attempting to start 'ora.gipcd' on
    'vmorarac2'
    CRS-2676: Start of 'ora.gipcd' on 'vmorarac2'
    succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on
    'vmorarac2'
    CRS-2676: Start of 'ora.gpnpd' on 'vmorarac2'
    succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on
    'vmorarac2'
    CRS-2676: Start of 'ora.cssdmonitor' on 'vmorarac2'
    succeeded
    CRS-2672: Attempting to start 'ora.cssd' on
    'vmorarac2'
    CRS-2672: Attempting to start 'ora.diskmon' on
    'vmorarac2'
    CRS-2676: Start of 'ora.diskmon' on 'vmorarac2'
    succeeded
    CRS-2674: Start of 'ora.cssd' on 'vmorarac2' failed
    CRS-2679: Attempting to clean 'ora.cssd' on
    'vmorarac2'
    CRS-2681: Clean of 'ora.cssd' on 'vmorarac2' succeeded
    CRS-2673: Attempting to stop 'ora.diskmon' on
    'vmorarac2'
    CRS-2677: Stop of 'ora.diskmon' on 'vmorarac2'
    succeeded
    CRS-4000: Command Start failed, or completed with
    errors.
    CRS-2672: Attempting to start 'ora.cssd' on
    'vmorarac2'
    CRS-2672: Attempting to start 'ora.diskmon' on
    'vmorarac2'
    CRS-2674: Start of 'ora.diskmon' on 'vmorarac2' failed
    CRS-2679: Attempting to clean 'ora.diskmon' on
    'vmorarac2'
    CRS-5016: Process
    "/u01/app/product/11.2.0/oracle/bin/diskmon" spawned by agent
    "/u01/app/product/11.2.0/oracle/bin/orarootagent.bin" for action "clean" failed:
    details at "(:CLSN00010:)" in
    "/u01/app/product/11.2.0/oracle/log/vmorarac2/agent/ohasd/orarootagent_root/orarootagent_root.log"
    CRS-2681: Clean of 'ora.diskmon' on 'vmorarac2'
    succeeded
    CRS-2674: Start of 'ora.cssd' on 'vmorarac2' failed
    CRS-2679: Attempting to clean 'ora.cssd' on
    'vmorarac2'
    CRS-2681: Clean of 'ora.cssd' on 'vmorarac2' succeeded
    CRS-4000: Command Start failed, or completed with
    errors.
    Command return code of 1 (256) from command:
    /u01/app/product/11.2.0/oracle/bin/crsctl start resource ora.ctssd -init -env
    USR_ORA_ENV=CTSS_REBOOT=TRUE
    Start of resource "ora.ctssd -init -env
    USR_ORA_ENV=CTSS_REBOOT=TRUE" failed
    Failed to start CTSS
    Failed to start Oracle Clusterware stack
    [root@vmorarac2 dev]#
    [root@vmorarac2 dev]#
    try again:
    [root@vmorarac2 bin]# ./crsctl start resource ora.ctssd
    -init -env USR_ORA_ENV=CTSS_REBOOT=TRUE
    CRS-2672: Attempting to start 'ora.cssd' on
    'vmorarac2'
    CRS-2672: Attempting to start 'ora.diskmon' on
    'vmorarac2'
    CRS-2674: Start of 'ora.diskmon' on 'vmorarac2' failed
    CRS-2679: Attempting to clean 'ora.diskmon' on
    'vmorarac2'
    CRS-5016: Process
    "/u01/app/product/11.2.0/oracle/bin/diskmon" spawned by agent
    "/u01/app/product/11.2.0/oracle/bin/orarootagent.bin" for action "clean" failed:
    details at "(:CLSN00010:)" in
    "/u01/app/product/11.2.0/oracle/log/vmorarac2/agent/ohasd/orarootagent_root/orarootagent_root.log"
    CRS-2681: Clean of 'ora.diskmon' on 'vmorarac2'
    succeeded
    CRS-2674: Start of 'ora.cssd' on 'vmorarac2' failed
    CRS-2679: Attempting to clean 'ora.cssd' on
    'vmorarac2'
    CRS-2681: Clean of 'ora.cssd' on 'vmorarac2' succeeded
    CRS-4000: Command Start failed, or completed with
    errors.
    [root@vmorarac2 bin]# ps -ef | grep u01
    root      8913     1  0 08:37 ?        00:00:06
    /u01/app/product/11.2.0/oracle/bin/ohasd.bin reboot
    oracle   10507     1  0 08:39 ?        00:00:02
    /u01/app/product/11.2.0/oracle/bin/oraagent.bin
    oracle   10522     1  0 08:39 ?        00:00:00
    /u01/app/product/11.2.0/oracle/bin/mdnsd.bin
    oracle   10534     1  0 08:39 ?        00:00:00
    /u01/app/product/11.2.0/oracle/bin/gipcd.bin
    oracle   10548     1  0 08:39 ?        00:00:39
    /u01/app/product/11.2.0/oracle/bin/gpnpd.bin
    root     11723     1  0 11:00 ?        00:00:03
    /u01/app/product/11.2.0/oracle/bin/cssdmonitor
    [oracle@vmorarac2 bin]$ ./crsctl check crs
    CRS-4638: Oracle High Availability Services is online
    CRS-4535: Cannot communicate with Cluster Ready
    Services
    CRS-4530: Communications failure contacting Cluster
    Synchronization Services daemon
    CRS-4534: Cannot communicate with Event Manager

    log:
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2013-07-17 08:38:04.485: [    AGFW][3481860944] Starting the agent: /u01/app/product/11.2.0/oracle/log/vmorarac2/agent/ohasd/orarootagent_root/
    2013-07-17 08:38:04.485: [   AGENT][3481860944] Agent framework initialized, Process Id = 10319
    2013-07-17 08:38:04.487: [ USRTHRD][3481860944] Utils::getCrsHome crsHome /u01/app/product/11.2.0/oracle
    2013-07-17 08:38:04.487: [ USRTHRD][3481860944] Process::convertPidToString pid = 10319
    2013-07-17 08:38:04.488: [    AGFW][3481860944] SERVER IPC CONNECT STR: (ADDRESS=(PROTOCOL=IPC)(KEY=OHASD_IPC_SOCKET_11))
    2013-07-17 08:38:04.488: [CLSFRAME][3481860944] Inited lsf context 0x317e9e0
    2013-07-17 08:38:04.488: [CLSFRAME][3481860944] Initing CLS Framework messaging
    2013-07-17 08:38:04.488: [CLSFRAME][3481860944] New Framework state: 2
    2013-07-17 08:38:04.488: [CLSFRAME][3481860944] M2M is starting...
    2013-07-17 08:38:04.490: [ CRSCOMM][3481860944] m_pClscCtx=0x31d1bd0m_pUgblm=0x31d5720
    2013-07-17 08:38:04.490: [ CRSCOMM][3481860944] Starting send thread
    2013-07-17 08:38:04.490: [ CRSCOMM][1119435072] clsIpc: sendWork thread started.
    2013-07-17 08:38:04.491: [ CRSCOMM][1129924928] IPC Client thread started listening
    2013-07-17 08:38:04.491: [ CRSCOMM][1129924928] init data sent from server
    2013-07-17 08:38:04.491: [CLSFRAME][3481860944] New IPC Member:{Relative|Node:0|Process:0|Type:2}:OHASD:vmorarac2
    2013-07-17 08:38:04.491: [CLSFRAME][3481860944] New process connected to us ID:{Relative|Node:0|Process:0|Type:2} Info:OHASD:vmorarac2
    2013-07-17 08:38:04.492: [CLSFRAME][3481860944] Starting thread model named: MultiThread
    2013-07-17 08:38:04.492: [CLSFRAME][3481860944] Starting thread model named: SingleThread
    2013-07-17 08:38:04.492: [CLSFRAME][3481860944] Starting thread model named: SingleThreadT
    2013-07-17 08:38:04.492: [CLSFRAME][3481860944] New Framework state: 3
    2013-07-17 08:38:04.493: [    AGFW][3481860944] Agent Framework started successfully
    2013-07-17 08:38:04.493: [    AGFW][1182374208] Agfw engine module has enabled...
    2013-07-17 08:38:04.493: [CLSFRAME][1182374208] Module Enabling is complete
    2013-07-17 08:38:04.493: [CLSFRAME][1182374208] New Framework state: 6
    2013-07-17 08:38:04.493: [    AGFW][1182374208] Agent is started with userid: root , expected user: root
    2013-07-17 08:38:04.493: [    AGFW][1182374208] Agent sending message to PE: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2013-07-17 08:38:04.505: [    AGFW][1182374208] Agent received the message: RESTYPE_ADD[ora.crs.type] ID 8196:358
    2013-07-17 08:38:04.506: [    AGFW][1182374208] Added new restype: ora.crs.type
    2013-07-17 08:38:04.506: [    AGFW][1182374208] Agent sending last reply for: RESTYPE_ADD[ora.crs.type] ID 8196:358
    2013-07-17 08:38:04.506: [    AGFW][1182374208] Agent received the message: RESTYPE_ADD[ora.ctss.type] ID 8196:360
    2013-07-17 08:38:04.506: [    AGFW][1182374208] Added new restype: ora.ctss.type
    2013-07-17 08:38:04.507: [    AGFW][1182374208] Agent sending last reply for: RESTYPE_ADD[ora.ctss.type] ID 8196:360
    2013-07-17 08:38:04.516: [    AGFW][1182374208] Agent received the message: RESTYPE_ADD[ora.diskmon.type] ID 8196:362
    2013-07-17 08:38:04.516: [    AGFW][1182374208] Added new restype: ora.diskmon.type
    2013-07-17 08:38:04.517: [    AGFW][1182374208] Agent sending last reply for: RESTYPE_ADD[ora.diskmon.type] ID 8196:362
    2013-07-17 08:38:04.519: [    AGFW][1182374208] Agent received the message: RESTYPE_ADD[ora.drivers.acfs.type] ID 8196:364
    2013-07-17 08:38:04.520: [    AGFW][1182374208] Added new restype: ora.drivers.acfs.type
    2013-07-17 08:38:04.520: [    AGFW][1182374208] Agent sending last reply for: RESTYPE_ADD[ora.drivers.acfs.type] ID 8196:364
    2013-07-17 08:38:04.521: [    AGFW][1182374208] Agent received the message: RESOURCE_ADD[ora.diskmon 1 1] ID 4356:366
    2013-07-17 08:38:04.521: [    AGFW][1182374208] Added new resource: ora.diskmon 1 1 to the agfw
    2013-07-17 08:38:04.522: [    AGFW][1182374208] Agent sending last reply for: RESOURCE_ADD[ora.diskmon 1 1] ID 4356:366
    2013-07-17 08:38:04.522: [    AGFW][1182374208] Agent received the message: RESOURCE_START[ora.diskmon 1 1] ID 4098:367
    2013-07-17 08:38:04.522: [    AGFW][1182374208] Preparing START command for: ora.diskmon 1 1
    2013-07-17 08:38:04.522: [    AGFW][1182374208] ora.diskmon 1 1 state changed from: UNKNOWN to: STARTING
    2013-07-17 08:38:04.526: [    AGFW][1161394496] Executing command: start for resource: ora.diskmon 1 1
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] clsn_agent::start {
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] DaemonAgent{
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] }DaemonAgent
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] DiskmonAgent::DiskmonAgent {
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] InitAttrs {
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] __IS_HASD_AGENT=TRUE
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] }InitAttrs
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] DiskmonAgent::DiskmonAgent }
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] DiskmonAgent::start {
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] Arg Value = -d
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] Arg Value = -f
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] Total Count of Environment Variables = 3
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] Adding Environment Variables __IS_HASD_AGENT=
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] Adding Environment variable from USR_ORA_ENV ORACLE_USER=oracle
    2013-07-17 08:38:04.527: [ora.diskmon][1161394496] [start] Utils:execCmd action = 1 flags = 5 ohome = (null) cmdname = diskmon.
    2013-07-17 08:38:04.528: [ora.diskmon][1161394496] [start] getOracleHomeAttrib: oracle_home = /u01/app/product/11.2.0/oracle
    2013-07-17 08:38:04.528: [ora.diskmon][1161394496] [start] Utils:execCmd Running the binary from /u01/app/product/11.2.0/oracle/bin/diskmon
    2013-07-17 08:38:04.531: [CRSTIMER][1091324224] Timer Thread Starting.
    2013-07-17 08:38:04.533: [ora.diskmon][1161394496] [start] execCmd ret = 0
    2013-07-17 08:38:04.533: [ora.diskmon][1161394496] [start] }DaemonAgent::start
    2013-07-17 08:38:10.534: [ora.diskmon][1161394496] [start] DiskmonAgent::connect {
    2013-07-17 08:38:10.534: [ora.diskmon][1161394496] [start] Process::convertPidToString pid = 10319
    2013-07-17 08:38:10.535: [ora.diskmon][1161394496] [start] DiskmonAgent::connect }
    2013-07-17 08:38:10.535: [ora.diskmon][1161394496] [start] DiskmonAgent::start }
    2013-07-17 08:38:10.535: [ora.diskmon][1161394496] [start] clsn_agent::start }
    2013-07-17 08:38:10.535: [    AGFW][1161394496] Command: start for resource: ora.diskmon 1 1 completed with status: SUCCESS
    2013-07-17 08:38:10.535: [    AGFW][1182374208] Agent sending reply for: RESOURCE_START[ora.diskmon 1 1] ID 4098:367
    2013-07-17 08:38:10.537: [    AGFW][1161394496] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:38:10.538: [ora.diskmon][1161394496] [check] DiskmonAgent::check {
    2013-07-17 08:38:10.538: [ora.diskmon][1161394496] [check] DiskmonAgent::check } 0
    2013-07-17 08:38:10.538: [    AGFW][1161394496] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:38:10.538: [    AGFW][1182374208] ora.diskmon 1 1 state changed from: STARTING to: ONLINE
    2013-07-17 08:38:10.538: [    AGFW][1182374208] Started implicit monitor for:ora.diskmon 1 1
    2013-07-17 08:38:10.538: [    AGFW][1182374208] Agent sending last reply for: RESOURCE_START[ora.diskmon 1 1] ID 4098:367
    2013-07-17 08:38:30.543: [    AGFW][1182374208] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:38:30.544: [    AGFW][1161394496] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:38:30.544: [ora.diskmon][1161394496] [check] DiskmonAgent::check {
    2013-07-17 08:38:30.544: [ora.diskmon][1161394496] [check] DiskmonAgent::check } 0
    2013-07-17 08:38:30.545: [    AGFW][1161394496] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:38:50.550: [    AGFW][1182374208] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:38:50.551: [    AGFW][1161394496] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:38:50.551: [ora.diskmon][1161394496] [check] DiskmonAgent::check {
    2013-07-17 08:38:50.551: [ora.diskmon][1161394496] [check] DiskmonAgent::check } 0
    2013-07-17 08:38:50.551: [    AGFW][1161394496] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:39:02.782: [    AGFW][1182374208] Agent received the message: RESOURCE_STOP[ora.diskmon 1 1] ID 4099:547
    2013-07-17 08:39:02.782: [    AGFW][1182374208] Preparing STOP command for: ora.diskmon 1 1
    2013-07-17 08:39:02.782: [    AGFW][1182374208] ora.diskmon 1 1 state changed from: ONLINE to: STOPPING
    2013-07-17 08:39:02.783: [    AGFW][1161394496] Executing command: stop for resource: ora.diskmon 1 1
    2013-07-17 08:39:02.783: [ora.diskmon][1161394496] [stop] clsn_agent::stop {
    2013-07-17 08:39:02.783: [ora.diskmon][1161394496] [stop] DiskmonAgent::stop {
    2013-07-17 08:39:02.783: [ora.diskmon][1161394496] [stop] DiskmonAgent::stop }
    2013-07-17 08:39:02.783: [ora.diskmon][1161394496] [stop] clsn_agent::stop }
    2013-07-17 08:39:02.783: [    AGFW][1161394496] Command: stop for resource: ora.diskmon 1 1 completed with status: SUCCESS
    2013-07-17 08:39:02.784: [    AGFW][1161394496] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:39:02.784: [ora.diskmon][1161394496] [check] DiskmonAgent::check {
    2013-07-17 08:39:02.784: [ora.diskmon][1161394496] [check] DiskmonAgent::check } 2
    2013-07-17 08:39:02.784: [    AGFW][1161394496] check for resource: ora.diskmon 1 1 completed with status: PLANNED_OFFLINE
    2013-07-17 08:39:02.784: [    AGFW][1182374208] Agent sending reply for: RESOURCE_STOP[ora.diskmon 1 1] ID 4099:547
    2013-07-17 08:39:02.785: [    AGFW][1182374208] ora.diskmon 1 1 state changed from: STOPPING to: PLANNED_OFFLINE
    2013-07-17 08:39:02.785: [    AGFW][1182374208] Agent sending last reply for: RESOURCE_STOP[ora.diskmon 1 1] ID 4099:547
    2013-07-17 08:39:02.785: [    AGFW][1182374208] Agent has no resources to be monitored.Sending suicide request.
    2013-07-17 08:39:02.786: [    AGFW][1182374208] Agent sending message to PE: AGENT_SUICIDE[Proxy] ID 20486:72
    2013-07-17 08:39:02.789: [    AGFW][1182374208] Agent is commiting suicide.
    2013-07-17 08:39:02.790: [    AGFW][1182374208] Agent is exiting with exit code: 1
    2013-07-17 08:39:12.176: [    AGFW][1664629584] Starting the agent: /u01/app/product/11.2.0/oracle/log/vmorarac2/agent/ohasd/orarootagent_root/
    2013-07-17 08:39:12.176: [   AGENT][1664629584] Agent framework initialized, Process Id = 10581
    2013-07-17 08:39:12.178: [ USRTHRD][1664629584] Utils::getCrsHome crsHome /u01/app/product/11.2.0/oracle
    2013-07-17 08:39:12.178: [ USRTHRD][1664629584] Process::convertPidToString pid = 10581
    2013-07-17 08:39:12.178: [    AGFW][1664629584] SERVER IPC CONNECT STR: (ADDRESS=(PROTOCOL=IPC)(KEY=OHASD_IPC_SOCKET_11))
    2013-07-17 08:39:12.178: [CLSFRAME][1664629584] Inited lsf context 0xd9309e0
    2013-07-17 08:39:12.179: [CLSFRAME][1664629584] Initing CLS Framework messaging
    2013-07-17 08:39:12.179: [CLSFRAME][1664629584] New Framework state: 2
    2013-07-17 08:39:12.179: [CLSFRAME][1664629584] M2M is starting...
    2013-07-17 08:39:12.180: [ CRSCOMM][1664629584] m_pClscCtx=0xd983bd0m_pUgblm=0xd987720
    2013-07-17 08:39:12.180: [ CRSCOMM][1664629584] Starting send thread
    2013-07-17 08:39:12.181: [ CRSCOMM][1115052352] clsIpc: sendWork thread started.
    2013-07-17 08:39:12.181: [ CRSCOMM][1125542208] IPC Client thread started listening
    2013-07-17 08:39:12.181: [ CRSCOMM][1125542208] init data sent from server
    2013-07-17 08:39:12.181: [CLSFRAME][1664629584] New IPC Member:{Relative|Node:0|Process:0|Type:2}:OHASD:vmorarac2
    2013-07-17 08:39:12.181: [CLSFRAME][1664629584] New process connected to us ID:{Relative|Node:0|Process:0|Type:2} Info:OHASD:vmorarac2
    2013-07-17 08:39:12.182: [CLSFRAME][1664629584] Starting thread model named: MultiThread
    2013-07-17 08:39:12.182: [CLSFRAME][1664629584] Starting thread model named: SingleThread
    2013-07-17 08:39:12.182: [CLSFRAME][1664629584] Starting thread model named: SingleThreadT
    2013-07-17 08:39:12.182: [CLSFRAME][1664629584] New Framework state: 3
    2013-07-17 08:39:12.182: [    AGFW][1664629584] Agent Framework started successfully
    2013-07-17 08:39:12.182: [    AGFW][1177991488] Agfw engine module has enabled...
    2013-07-17 08:39:12.183: [CLSFRAME][1177991488] Module Enabling is complete
    2013-07-17 08:39:12.183: [CLSFRAME][1177991488] New Framework state: 6
    2013-07-17 08:39:12.183: [    AGFW][1177991488] Agent is started with userid: root , expected user: root
    2013-07-17 08:39:12.183: [    AGFW][1177991488] Agent sending message to PE: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2013-07-17 08:39:12.192: [    AGFW][1177991488] Agent received the message: RESTYPE_ADD[ora.crs.type] ID 8196:886
    2013-07-17 08:39:12.192: [    AGFW][1177991488] Added new restype: ora.crs.type
    2013-07-17 08:39:12.192: [    AGFW][1177991488] Agent sending last reply for: RESTYPE_ADD[ora.crs.type] ID 8196:886
    2013-07-17 08:39:12.198: [    AGFW][1177991488] Agent received the message: RESTYPE_ADD[ora.ctss.type] ID 8196:888
    2013-07-17 08:39:12.198: [    AGFW][1177991488] Added new restype: ora.ctss.type
    2013-07-17 08:39:12.199: [    AGFW][1177991488] Agent sending last reply for: RESTYPE_ADD[ora.ctss.type] ID 8196:888
    2013-07-17 08:39:12.204: [    AGFW][1177991488] Agent received the message: RESTYPE_ADD[ora.diskmon.type] ID 8196:890
    2013-07-17 08:39:12.204: [    AGFW][1177991488] Added new restype: ora.diskmon.type
    2013-07-17 08:39:12.204: [    AGFW][1177991488] Agent sending last reply for: RESTYPE_ADD[ora.diskmon.type] ID 8196:890
    2013-07-17 08:39:12.209: [    AGFW][1177991488] Agent received the message: RESTYPE_ADD[ora.drivers.acfs.type] ID 8196:892
    2013-07-17 08:39:12.209: [    AGFW][1177991488] Added new restype: ora.drivers.acfs.type
    2013-07-17 08:39:12.210: [    AGFW][1177991488] Agent sending last reply for: RESTYPE_ADD[ora.drivers.acfs.type] ID 8196:892
    2013-07-17 08:39:12.210: [    AGFW][1177991488] Agent received the message: RESOURCE_ADD[ora.diskmon 1 1] ID 4356:894
    2013-07-17 08:39:12.210: [    AGFW][1177991488] Added new resource: ora.diskmon 1 1 to the agfw
    2013-07-17 08:39:12.210: [    AGFW][1177991488] Agent sending last reply for: RESOURCE_ADD[ora.diskmon 1 1] ID 4356:894
    2013-07-17 08:39:12.210: [    AGFW][1177991488] Agent received the message: RESOURCE_START[ora.diskmon 1 1] ID 4098:895
    2013-07-17 08:39:12.211: [    AGFW][1177991488] Preparing START command for: ora.diskmon 1 1
    2013-07-17 08:39:12.211: [    AGFW][1177991488] ora.diskmon 1 1 state changed from: UNKNOWN to: STARTING
    2013-07-17 08:39:12.216: [    AGFW][1167501632] Executing command: start for resource: ora.diskmon 1 1
    2013-07-17 08:39:12.216: [ora.diskmon][1167501632] [start] clsn_agent::start {
    2013-07-17 08:39:12.216: [ora.diskmon][1167501632] [start] DaemonAgent{
    2013-07-17 08:39:12.216: [ora.diskmon][1167501632] [start] }DaemonAgent
    2013-07-17 08:39:12.216: [ora.diskmon][1167501632] [start] DiskmonAgent::DiskmonAgent {
    2013-07-17 08:39:12.216: [ora.diskmon][1167501632] [start] InitAttrs {
    2013-07-17 08:39:12.216: [ora.diskmon][1167501632] [start] __IS_HASD_AGENT=TRUE
    2013-07-17 08:39:12.216: [ora.diskmon][1167501632] [start] }InitAttrs
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] DiskmonAgent::DiskmonAgent }
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] DiskmonAgent::start {
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] Arg Value = -d
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] Arg Value = -f
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] Total Count of Environment Variables = 3
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] Adding Environment Variables _ORA_AGENT_ACTION=TRUE
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] Adding Environment Variables __IS_HASD_AGENT=
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] Adding Environment variable from USR_ORA_ENV ORACLE_USER=oracle
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] Utils:execCmd action = 1 flags = 5 ohome = (null) cmdname = diskmon.
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] getOracleHomeAttrib: oracle_home = /u01/app/product/11.2.0/oracle
    2013-07-17 08:39:12.217: [ora.diskmon][1167501632] [start] Utils:execCmd Running the binary from /u01/app/product/11.2.0/oracle/bin/diskmon
    2013-07-17 08:39:12.220: [CRSTIMER][1198971200] Timer Thread Starting.
    2013-07-17 08:39:12.220: [ora.diskmon][1167501632] [start] execCmd ret = 0
    2013-07-17 08:39:12.220: [ora.diskmon][1167501632] [start] }DaemonAgent::start
    2013-07-17 08:39:18.222: [ora.diskmon][1167501632] [start] DiskmonAgent::connect {
    2013-07-17 08:39:18.222: [ora.diskmon][1167501632] [start] Process::convertPidToString pid = 10581
    2013-07-17 08:39:18.222: [ora.diskmon][1167501632] [start] DiskmonAgent::connect }
    2013-07-17 08:39:18.222: [ora.diskmon][1167501632] [start] DiskmonAgent::start }
    2013-07-17 08:39:18.222: [ora.diskmon][1167501632] [start] clsn_agent::start }
    2013-07-17 08:39:18.222: [    AGFW][1167501632] Command: start for resource: ora.diskmon 1 1 completed with status: SUCCESS
    2013-07-17 08:39:18.223: [    AGFW][1177991488] Agent sending reply for: RESOURCE_START[ora.diskmon 1 1] ID 4098:895
    2013-07-17 08:39:18.223: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:39:18.223: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:39:18.224: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:39:18.224: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:39:18.225: [    AGFW][1177991488] ora.diskmon 1 1 state changed from: STARTING to: ONLINE
    2013-07-17 08:39:18.225: [    AGFW][1177991488] Started implicit monitor for:ora.diskmon 1 1
    2013-07-17 08:39:18.225: [    AGFW][1177991488] Agent sending last reply for: RESOURCE_START[ora.diskmon 1 1] ID 4098:895
    2013-07-17 08:39:38.231: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:39:38.232: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:39:38.232: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:39:38.232: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:39:38.232: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:39:58.237: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:39:58.238: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:39:58.238: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:39:58.238: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:39:58.238: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:40:12.107: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:966
    2013-07-17 08:40:18.243: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:40:18.244: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:40:18.244: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:40:18.244: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:40:18.244: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:40:38.250: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:40:38.251: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:40:38.251: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:40:38.251: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:40:38.251: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:40:42.116: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:982
    2013-07-17 08:40:58.245: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:40:58.246: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:40:58.247: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:40:58.247: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:40:58.247: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:41:12.125: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:998
    2013-07-17 08:41:18.252: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:41:18.252: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:41:18.253: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:41:18.253: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:41:18.253: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:41:38.259: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:41:38.260: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:41:38.260: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:41:38.260: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:41:38.260: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:41:58.255: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:41:58.256: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:41:58.256: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:41:58.256: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:41:58.256: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:42:12.134: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1026
    2013-07-17 08:42:18.261: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:42:18.262: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:42:18.262: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:42:18.262: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:42:18.262: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:42:38.268: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:42:38.269: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:42:38.269: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:42:38.269: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:42:38.269: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:42:58.265: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:42:58.266: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:42:58.266: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:42:58.267: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:42:58.267: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:43:12.144: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1054
    2013-07-17 08:43:18.272: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:43:18.272: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:43:18.273: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:43:18.273: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:43:18.273: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:43:38.278: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:43:38.278: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:43:38.279: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:43:38.279: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:43:38.279: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:43:42.154: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1070
    2013-07-17 08:43:58.284: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:43:58.285: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:43:58.285: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:43:58.285: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:43:58.285: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:44:12.154: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1086
    2013-07-17 08:44:18.291: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:44:18.292: [    AGFW][1167501632] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:44:18.292: [ora.diskmon][1167501632] [check] DiskmonAgent::check {
    2013-07-17 08:44:18.292: [ora.diskmon][1167501632] [check] DiskmonAgent::check } 0
    2013-07-17 08:44:18.292: [    AGFW][1167501632] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:44:38.296: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:44:38.297: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:44:38.297: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:44:38.297: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:44:38.297: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:44:42.163: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1102
    2013-07-17 08:44:58.302: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:44:58.303: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:44:58.303: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:44:58.304: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:44:58.304: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:45:12.174: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1118
    2013-07-17 08:45:18.309: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:45:18.309: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:45:18.310: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:45:18.310: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:45:18.310: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:45:38.315: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:45:38.316: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:45:38.316: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:45:38.316: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:45:38.316: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:45:42.183: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1134
    2013-07-17 08:45:58.312: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:45:58.313: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:45:58.313: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:45:58.313: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:45:58.313: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:46:12.192: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1150
    2013-07-17 08:46:18.318: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:46:18.319: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:46:18.319: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:46:18.319: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:46:18.319: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:46:38.325: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:46:38.326: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:46:38.326: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:46:38.326: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:46:38.326: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:46:42.203: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1166
    2013-07-17 08:46:58.332: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:46:58.333: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:46:58.333: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:46:58.333: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:46:58.333: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:47:12.203: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1182
    2013-07-17 08:47:18.338: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:47:18.339: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:47:18.339: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:47:18.339: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:47:18.340: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:47:38.345: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:47:38.345: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:47:38.346: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:47:38.346: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:47:38.346: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:47:42.211: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1198
    2013-07-17 08:47:58.351: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:47:58.352: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:47:58.352: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:47:58.352: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:47:58.352: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:48:12.220: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1214
    2013-07-17 08:48:18.358: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:48:18.359: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:48:18.359: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:48:18.359: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:48:18.359: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:48:38.365: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:48:38.366: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:48:38.366: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:48:38.366: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:48:38.366: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:48:42.230: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1230
    2013-07-17 08:48:58.370: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:48:58.371: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:48:58.371: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:48:58.371: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:48:58.371: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:49:12.238: [    AGFW][1177991488] Agent received the message: AGENT_HB[Engine] ID 12293:1246
    2013-07-17 08:49:18.377: [    AGFW][1177991488] CHECK initiated by timer for: ora.diskmon 1 1
    2013-07-17 08:49:18.378: [    AGFW][1157011776] Executing command: check for resource: ora.diskmon 1 1
    2013-07-17 08:49:18.378: [ora.diskmon][1157011776] [check] DiskmonAgent::check {
    2013-07-17 08:49:18.379: [ora.diskmon][1157011776] [check] DiskmonAgent::check } 0
    2013-07-17 08:49:18.379: [    AGFW][1157011776] check for resource: ora.diskmon 1 1 completed with status: ONLINE
    2013-07-17 08:49:23.262: [    AGFW][1177991488] Agent received the message: RESOURCE_STOP[ora.diskmon 1 1] ID 4099:1310
    2013-07-17 0

  • RAC 11gR2 cluster installation: root.sh failed on the 1st node

    Hi,
    Does anybody know why is possible when I run the root.sh on the 1st node, during the Oracle 11gR2 RAC installation (cluster installation) to get the following error?
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /oracle/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y
    Copying dbhome to /usr/local/bin ...
    The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y
    Copying oraenv to /usr/local/bin ...
    The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: y
    Copying coraenv to /usr/local/bin ...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2010-06-29 14:17:43: Parsing the host name
    2010-06-29 14:17:43: Checking for super user privileges
    2010-06-29 14:17:43: User has super user privileges
    Using configuration parameter file: /oracle/grid/crs/install/crsconfig_params
    Creating trace directory
    User oracle has the required capabilities to run CSSD in realtime mode
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'system'..
    Operation successful.
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding daemon to inittab
    CRS-4123: Oracle High Availability Services has been started.
    ohasd is starting
    CRS-2672: Attempting to start 'ora.gipcd' on 'trz1test_rac'
    CRS-2672: Attempting to start 'ora.mdnsd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.gipcd' on 'trz1test_rac' succeeded
    CRS-2676: Start of 'ora.mdnsd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.gpnpd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'trz1test_rac'
    CRS-2676: Start of 'ora.cssdmonitor' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'trz1test_rac'
    CRS-2672: Attempting to start 'ora.diskmon' on 'trz1test_rac'
    CRS-2676: Start of 'ora.diskmon' on 'trz1test_rac' succeeded
    CRS-2676: Start of 'ora.cssd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.ctssd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.ctssd' on 'trz1test_rac' succeeded
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'system'..
    Operation successful.
    CRS-2672: Attempting to start 'ora.crsd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.crsd' on 'trz1test_rac' succeeded
    Now formatting voting disk: /data_gpfs/oracle/crs/vdsk.
    CRS-4603: Successful addition of voting disk /data_gpfs/oracle/crs/vdsk.
    ## STATE File Universal Id File Name Disk group
    1. ONLINE 653624f2aa1f4f83bf774e8052889a32 (/data_gpfs/oracle/crs/vdsk) []
    Located 1 voting disk(s).
    CRS-2673: Attempting to stop 'ora.crsd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.crsd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.ctssd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.ctssd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.cssd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.cssd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.gpnpd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.gipcd' on 'trz1test_rac' succeeded
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'trz1test_rac'
    CRS-2677: Stop of 'ora.mdnsd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.mdnsd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.mdnsd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.gipcd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.gipcd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.gpnpd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'trz1test_rac'
    CRS-2676: Start of 'ora.cssdmonitor' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'trz1test_rac'
    CRS-2672: Attempting to start 'ora.diskmon' on 'trz1test_rac'
    CRS-2676: Start of 'ora.diskmon' on 'trz1test_rac' succeeded
    CRS-2676: Start of 'ora.cssd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.ctssd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.ctssd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.crsd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.crsd' on 'trz1test_rac' succeeded
    CRS-2672: Attempting to start 'ora.evmd' on 'trz1test_rac'
    CRS-2676: Start of 'ora.evmd' on 'trz1test_rac' succeeded
    */oracle/grid/bin/srvctl start nodeapps -n trz1test_rac ... failed*
    Configure Oracle Grid Infrastructure for a Cluster ... failed
    This is because ora.eONS daemon is not starting. There is a Metalink note that we MIGHT start this daemon manually ... but this is not working.
    *./srvctl status nodeapps -n trz1test_rac*
    -n <node_name> option has been deprecated.
    VIP trz1test_rac_vip is enabled
    VIP trz1test_rac_vip is running on node: trz1test_rac
    Network is enabled
    Network is running on node: trz1test_rac
    GSD is disabled
    GSD is not running on node: trz1test_rac
    ONS is enabled
    ONS daemon is running on node: trz1test_rac
    eONS is enabled
    eONS daemon is not running on node: trz1test_rac

    I run my clusterware/DB on AIX 5.3
    When I run runcluvfy.sh here are the things which are not passing:
    Check: Node connectivity of subnet "192.168.1.0"
    Source Destination Connected?
    trz2test_rac:en5 trz2test_rac:en5 yes
    trz2test_rac:en5 trz1test_rac:en5 yes
    trz2test_rac:en5 trz1test_rac:en5 yes
    trz2test_rac:en5 trz1test_rac:en5 yes
    trz2test_rac:en5 trz1test_rac:en5 yes
    trz1test_rac:en5 trz1test_rac:en5 yes
    Result: Node connectivity passed for subnet "192.168.1.0" with node(s) trz2test_rac,trz1test_rac
    Check: TCP connectivity of subnet "192.168.1.0"
    Source Destination Connected?
    trz1test_rac:192.168.1.140 trz2test_rac:192.168.1.142 failed
    trz1test_rac:192.168.1.140 trz2test_rac:192.168.1.142 failed
    Result: TCP connectivity check failed for subnet "192.168.1.0"
    NTP daemon slewing option check failed on some nodes
    PRVF-5436 : The NTP daemon running on one or more nodes lacks the slewing option "-x"
    Result: Clock synchronization check using Network Time Protocol(NTP) failed
    NTP mustn't be a problem I guess as the date are identical on the 2 nodes.
    I have no idea how to fix the TCP connectivity issue with the subnet "192.168.1.0". Some posts wrote that could be a firewall issue. Are there any other causes ?
    Thanks to all,
    Paul

  • Oracle Grid Infrastructure 11.2.0.2 root.sh hangs in the second node

    Hi,
    I am installing Oracle Grid Infrastructure 11.2.0.2.0 using VM's. Both the virtual machines are running RHEL 5.7 32 bit version.
    Until the point where the installation suggests to run two scripts as root user, everything runs fine.
    root.sh runs successfully on the first node.
    On the second node it hangs at,
    Now product-specific root actions will be performed.
    Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params

    user10193468 wrote:
    Hi,
    Following is the last few lines of the $GRID_HOME/cfgtoollogs/crsconfig/rootcrs_<node>.log file
    2012-03-19 17:20:17: OLR successfully created or upgraded
    2012-03-19 17:20:17: /u01/app/11.2.0/grid/bin/clscfg -localadd
    2012-03-19 17:20:17: Executing /u01/app/11.2.0/grid/bin/clscfg -localadd
    2012-03-19 17:20:17: Executing cmd: /u01/app/11.2.0/grid/bin/clscfg -localadd
    I am using ASM for OCR and Voting Disks.
    Private network is up and running.Please let me know what have you set in asm_diskstring parameter?
    I have find following note from metalink which says that you should not set asm_diskstring to '/dev/' or '/dev/*'. This is not supported
    root.sh Hangs or Reboots Node on Non First Node if ASM Discovery String asm_diskstring is Set to /dev/ or /dev/* [ID 1356567.1]

  • Grid installation: root.sh failed on the first node on Solaris cluster 4.1

    Hi all,
    I'm trying to install the Grid (11.2.0.3.0) on the 2 node-clusters (OSC 4.1).
    When I run the root.sh on the first node, I got the out put as follow:
    xha239080-root-5.11# root.sh
    Performing root user operation for Oracle 11g
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /Grid/CRShome
    Enter the full pathname of the local bin directory: [/usr/local/bin]:
    /usr/local/bin is read only. Continue without copy (y/n) or retry (r)? [y]:
    Warning: /usr/local/bin is read only. No files will be copied.
    Creating /var/opt/oracle/oratab file...
    Entries will be added to the /var/opt/oracle/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root script.
    Now product-specific root actions will be performed.
    Using configuration parameter file: /Grid/CRShome/crs/install/crsconfig_params
    Creating trace directory
    User ignored Prerequisites during installation
    OLR initialization - successful
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding Clusterware entries to inittab
    CRS-2672: Attempting to start 'ora.mdnsd' on 'xha239080'
    CRS-2676: Start of 'ora.mdnsd' on 'xha239080' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'xha239080'
    CRS-2676: Start of 'ora.gpnpd' on 'xha239080' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'xha239080'
    CRS-2672: Attempting to start 'ora.gipcd' on 'xha239080'
    CRS-2676: Start of 'ora.cssdmonitor' on 'xha239080' succeeded
    CRS-2676: Start of 'ora.gipcd' on 'xha239080' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'xha239080'
    CRS-2672: Attempting to start 'ora.diskmon' on 'xha239080'
    CRS-2676: Start of 'ora.diskmon' on 'xha239080' succeeded
    CRS-2676: Start of 'ora.cssd' on 'xha239080' succeeded
    ASM created and started successfully.
    Disk Group DATA created successfully.
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    CRS-4256: Updating the profile
    Successful addition of voting disk 9cdb938773bc4f16bf332edac499fd06.
    Successful addition of voting disk 842907db11f74f59bf65247138d6e8f5.
    Successful addition of voting disk 748852d2a5c84f72bfcd50d60f65654d.
    Successfully replaced voting disk group with +DATA.
    CRS-4256: Updating the profile
    CRS-4266: Voting file(s) successfully replaced
    ## STATE File Universal Id File Name Disk group
    1. ONLINE 9cdb938773bc4f16bf332edac499fd06 (/dev/did/rdsk/d10s6) [DATA]
    2. ONLINE 842907db11f74f59bf65247138d6e8f5 (/dev/did/rdsk/d8s6) [DATA]
    3. ONLINE 748852d2a5c84f72bfcd50d60f65654d (/dev/did/rdsk/d9s6) [DATA]
    Located 3 voting disk(s).
    Start of resource "ora.cssd" failed
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'xha239080'
    CRS-2672: Attempting to start 'ora.gipcd' on 'xha239080'
    CRS-2676: Start of 'ora.cssdmonitor' on 'xha239080' succeeded
    CRS-2676: Start of 'ora.gipcd' on 'xha239080' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'xha239080'
    CRS-2672: Attempting to start 'ora.diskmon' on 'xha239080'
    CRS-2676: Start of 'ora.diskmon' on 'xha239080' succeeded
    CRS-2674: Start of 'ora.cssd' on 'xha239080' failed
    CRS-2679: Attempting to clean 'ora.cssd' on 'xha239080'
    CRS-2681: Clean of 'ora.cssd' on 'xha239080' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'xha239080'
    CRS-2677: Stop of 'ora.gipcd' on 'xha239080' succeeded
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'xha239080'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'xha239080' succeeded
    CRS-5804: Communication error with agent process
    CRS-4000: Command Start failed, or completed with errors.
    Failed to start Oracle Grid Infrastructure stack
    Failed to start Cluster Synchorinisation Service in clustered mode at /Grid/CRShome/crs/install/crsconfig_lib.pm line 1211.
    /Grid/CRShome/perl/bin/perl -I/Grid/CRShome/perl/lib -I/Grid/CRShome/crs/install /Grid/CRShome/crs/install/rootcrs.pl execution failed
    xha239080-root-5.11# history
    checking the ocssd.log, I see some thing as follow:
    2013-09-16 18:46:24.238: [    CSSD][1]clssscmain: Starting CSS daemon, version 11.2.0.3.0, in (clustered) mode with uniqueness value 1379371584
    2013-09-16 18:46:24.239: [    CSSD][1]clssscmain: Environment is production
    2013-09-16 18:46:24.239: [    CSSD][1]clssscmain: Core file size limit extended
    2013-09-16 18:46:24.248: [    CSSD][1]clssscmain: GIPCHA down 1
    2013-09-16 18:46:24.249: [    CSSD][1]clssscGetParameterOLR: OLR fetch for parameter logsize (8) failed with rc 21
    2013-09-16 18:46:24.250: [    CSSD][1]clssscExtendLimits: The current soft limit for file descriptors is 65536, hard limit is 65536
    2013-09-16 18:46:24.250: [    CSSD][1]clssscExtendLimits: The current soft limit for locked memory is 4294967293, hard limit is 4294967293
    2013-09-16 18:46:24.250: [    CSSD][1]clssscGetParameterOLR: OLR fetch for parameter priority (15) failed with rc 21
    2013-09-16 18:46:24.250: [    CSSD][1]clssscSetPrivEnv: Setting priority to 4
    2013-09-16 18:46:24.253: [    CSSD][1]clssscSetPrivEnv: unable to set priority to 4
    2013-09-16 18:46:24.253: [    CSSD][1]SLOS: cat=-2, opn=scls_mem_lockdown, dep=11, loc=mlockall
    unable to lock memory
    2013-09-16 18:46:24.253: [    CSSD][1](:CSSSC00011:)clssscExit: A fatal error occurred during initialization
    Do anyone have any idea what going on and how can I fix it ?

    Hi,
    solaris has several issues with DISM, e.g.:
    Solaris 10 and Solaris 11 Shared Memory Locking May Fail (Doc ID 1590151.1)
    Sounds like Solaris Cluster  has a similar bug. A "workaround" is to reboot the (cluster) zone, that "fixes" the mlock error. This bug was introduced with updates in september, atleast to our environment (Solaris 11.1). Prior i did not have the issue and now i have to restart the entire zone, whenever i stop crs.
    With 11.2.0.3 the root.sh script can be rerun without prior cleaning up, so you should be able to continue installation at that point after the reboot. After the root.sh completes some configuration assistants need to be run, to complete the installation. You need to execute this manually as you wipe your oui session
    Kind Regards
    Thomas

  • Oracle 11gR2 RAC clusterware not picking up ASM diskgroups

    Hello: I had to deinstall a failed oracle 11gR2 rac cuslterware. But, not the asm disks are not in the OUI pick list. How can I resolve that?
    The storage is on SAN partitions.

    Probably the install already put something on the disks.
    Clean them with dd if=/dev/zero of=<your asm disks> bs=1M count=10
    Regards
    Sebastian

  • Oracle 11gr2 RAC hardware

    Hello experts,
    how to install oracle 11gR2 RAC on Laptop.what are the basic requirements.
    RAM 6GB
    i7 processer, 500GB Hard Disk
    Thanks in Advance.

    Hi,
    Also two more articles on the same portal with regards to 11gR2 RAC installations
    []http://www.oracle-base.com/articles/11g/oracle-db-11gr2-rac-installation-on-linux-using-nfs.php[]
    []http://www.oracle-base.com/articles/11g/oracle-db-11gr2-rac-installation-on-windows-2008-using-virtualbox.php[]
    Regards,

  • Oracle 11gR2 RAC: Running the script root.sh problem

    Folks,
    Hello. I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer and according to the tutorial
    http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
    I have been installing Grid Infrastructure using runInstaller from step 1 to step 9 of 10 in both VM rac1 and rac2.
    Now, I am running the script root.sh in VM rac1 and rac2 as below:
    [root@rac1 /]# /u01/app/grid/root.sh
    Output:
    CRS-4123: ohasd is starting
    FATAL: Module oracleoks not found
    FATAL: Module oracleadvm not found
    FATAL: Module oracleacfs not found
    ACFS-9121: Failed to detect /dev/asm/.asm_ctl_spec
    ACFS-9310: ADVM/ACFS installation failed.
    ACFS-9311: not all components were detected after installation
    'UpdateNodeList' was successful.
    [root@rac1 /]#
    [root@rac2 /]# /u01/app/grid/root.sh
    Output:
    CRS-4123: ohasd is starting
    FATAL: Module oracleoks not found
    FATAL: Module oracleadvm not found
    FATAL: Module oracleacfs not found
    ACFS-9121: Failed to detect /dev/asm/.asm_ctl_spec
    ACFS-9310: ADVM/ACFS installation failed.
    ACFS-9311: not all components were detected after installation
    Start of resource "ora.asm_init" failed.
    Failed to start ASM.
    Failed to start Oracle Clusterware Stack.
    [root@rac2 /]#
    As we see the output above, rac1 and rac2 get the same problems. in addition, rac2 fails to start ASM and Clusterware stack. Thus, I have 2 questions:
    First, the common problem for rac1 and rac2 :
    1)Module "oracleoks, oracleadvm, oracleacfs" not found
    2)/dev/asm/.asm_ctl_spec not detected
    3)ADVM/ACFS installation failed
    Do the above 3 factors affect Grid and DataBase Installation later ? If yes, how to solve these problems ?
    Second, how to start ASM and Clusterware stack in rac2 ?
    Thanks.

    you have 2 options:
    1. OEL 5.6 comes with 2 kernels, the original Red Hat, and Oracle UEK, you can choose not to use UEK
    or the one i would recommend:
    2. Upgrade Grid Infrastructure,
    *11.2.0.3.1* (patch 13348650, released about a 1 month ago) supports ACFS on UEK (starting with 2.6.32.200 IIRC)

  • Oracle 11gR2 RAC: how to solve "user profile creation mask failed" ?

    Folks,
    Hello.
    I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer.
    I am using Cluster Verification Utility (CVU) to test the 2 nodes for Grid installation as follows:
    [ora11g@rac1 grid] $ ./runcluvfy.sh stage -pre crsinst -n all -r 11gR2 -orainv ora11g -fixup -fixupdir /mydir -verbose
    All items for rac2 are passed. There is only one item for rac1 is not passed as follows:
    Check default user profile creation mask:
    Node Name: rac1
    Available: 0002
    Required: 0022
    Comment: failed
    There are 3 ways to solve this issue:
    1) In the file /etc/bashrc, change the line "umask 0002" to "umask 0022".
    2) In the file /etc/profile, add line "umask 0022" at the end of the file.
    3) In the file /etc/csh.cshrc, change the line "umask 002" to "umask 0022".
    In rac2, I got the same issue in the past. I just change the line "umask 0002" to "umask 0022" in the file /etc/bashrc and the issue is solved.
    But in rac1, I have tried each of the 3 options and also combined 1) and 2), 1) and 3), 2) and 3), 1) and 2) and 3). Totally, that's 7 options. But all of 7 options cannot solve the issue.
    The script runcluvfy.sh still tests rac1 user profile creation mask failed. My question is:
    Do any folk understand how to solve VM rac1 user profile creation mask problem ?
    Thanks.

    Folks,
    Hello. I follow the document "Oracle Grid Infrastructure Installation Guide 11g Release 2 (11.2) for Linux E22489-04" and do the following:
    [root@rac1 /]#echo $SHELL
    Output: /bin/bash
    This means we need to edit Bash shell file .bash_profile.
    [ora11g@rac1 ~]$vi /home/ora11g/.bash_profile
    Add this line: umask 022
    Then I save the file .bash_profile and reboot OS.
    Then I run the following command:
    [ora11g@rac1 grid] $ ./runcluvfy.sh stage -pre crsinst -n all -r 11gR2 -orainv ora11g -fixup -fixupdir /mydir -verbose
    But the reusult is the same. The issue is not solved as follows:
    Check default user profile creation mask:
    Node Name: rac1
    Available: 0002
    Required: 0022
    Comment: failed
    Do any folk understand how to solve VM rac1 user profile creation mask problem ?
    Thanks.

  • The best option to create  a shared storage for Oracle 11gR2 RAC in OEL 5?

    Hello,
    Could you please tell me the best option to create a shared storage for Oracle 11gR2 RAC in Oracel Enterprise Linux 5? in production environment? And could you help to create shared storage? Because there is no additional step in Oracle installation guide. There are steps for only asm disk creation.
    Thank you.

    Here are names of partitions and permissions. Partitions which have 146 GB, 438 GB, 438 GB of capacity are my storage. Two of three disks which are 438 GB were configured as RAID 5 and remaining disk was configured as RAID 0. My storage is Dell MD 3000i and connected to nodes through ethernet.
    Node 1
    [root@rac1 home]# ll /dev/sd*
    brw-r----- 1 root disk 8, 0 Aug 8 17:39 /dev/sda
    brw-r----- 1 root disk 8, 1 Aug 8 17:40 /dev/sda1
    brw-r----- 1 root disk 8, 16 Aug 8 17:39 /dev/sdb
    brw-r----- 1 root disk 8, 17 Aug 8 17:39 /dev/sdb1
    brw-r----- 1 root disk 8, 32 Aug 8 17:40 /dev/sdc
    brw-r----- 1 root disk 8, 48 Aug 8 17:41 /dev/sdd
    brw-r----- 1 root disk 8, 64 Aug 8 18:26 /dev/sde
    brw-r----- 1 root disk 8, 65 Aug 8 18:43 /dev/sde1
    brw-r----- 1 root disk 8, 80 Aug 8 18:34 /dev/sdf
    brw-r----- 1 root disk 8, 81 Aug 8 18:43 /dev/sdf1
    brw-r----- 1 root disk 8, 96 Aug 8 18:34 /dev/sdg
    brw-r----- 1 root disk 8, 97 Aug 8 18:43 /dev/sdg1
    [root@rac1 home]# fdisk -l
    Disk /dev/sda: 72.7 GB, 72746008576 bytes
    255 heads, 63 sectors/track, 8844 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Device Boot Start End Blocks Id System
    /dev/sda1 * 1 8844 71039398+ 83 Linux
    Disk /dev/sdb: 72.7 GB, 72746008576 bytes
    255 heads, 63 sectors/track, 8844 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Device Boot Start End Blocks Id System
    /dev/sdb1 * 1 4079 32764536 82 Linux swap / Solaris
    Disk /dev/sdd: 20 MB, 20971520 bytes
    1 heads, 40 sectors/track, 1024 cylinders
    Units = cylinders of 40 * 512 = 20480 bytes
    Device Boot Start End Blocks Id System
    Disk /dev/sde: 146.2 GB, 146278449152 bytes
    255 heads, 63 sectors/track, 17784 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Device Boot Start End Blocks Id System
    /dev/sde1 1 17784 142849948+ 83 Linux
    Disk /dev/sdf: 438.8 GB, 438835347456 bytes
    255 heads, 63 sectors/track, 53352 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Device Boot Start End Blocks Id System
    /dev/sdf1 1 53352 428549908+ 83 Linux
    Disk /dev/sdg: 438.8 GB, 438835347456 bytes
    255 heads, 63 sectors/track, 53352 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Device Boot Start End Blocks Id System
    /dev/sdg1 1 53352 428549908+ 83 Linux
    Node 2
    [root@rac2 ~]# ll /dev/sd*
    brw-r----- 1 root disk 8, 0 Aug 8 17:50 /dev/sda
    brw-r----- 1 root disk 8, 1 Aug 8 17:51 /dev/sda1
    brw-r----- 1 root disk 8, 2 Aug 8 17:50 /dev/sda2
    brw-r----- 1 root disk 8, 16 Aug 8 17:51 /dev/sdb
    brw-r----- 1 root disk 8, 32 Aug 8 17:52 /dev/sdc
    brw-r----- 1 root disk 8, 33 Aug 8 18:54 /dev/sdc1
    brw-r----- 1 root disk 8, 48 Aug 8 17:52 /dev/sdd
    brw-r----- 1 root disk 8, 64 Aug 8 17:52 /dev/sde
    brw-r----- 1 root disk 8, 65 Aug 8 18:54 /dev/sde1
    brw-r----- 1 root disk 8, 80 Aug 8 17:52 /dev/sdf
    brw-r----- 1 root disk 8, 81 Aug 8 18:54 /dev/sdf1
    [root@rac2 ~]# fdisk -l
    Disk /dev/sda: 145.4 GB, 145492017152 bytes
    255 heads, 63 sectors/track, 17688 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Device Boot Start End Blocks Id System
    /dev/sda1 * 1 8796 70653838+ 83 Linux
    /dev/sda2 8797 12875 32764567+ 82 Linux swap / Solaris
    Disk /dev/sdc: 146.2 GB, 146278449152 bytes
    255 heads, 63 sectors/track, 17784 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Device Boot Start End Blocks Id System
    /dev/sdc1 1 17784 142849948+ 83 Linux
    Disk /dev/sdd: 20 MB, 20971520 bytes
    1 heads, 40 sectors/track, 1024 cylinders
    Units = cylinders of 40 * 512 = 20480 bytes
    Device Boot Start End Blocks Id System
    Disk /dev/sde: 438.8 GB, 438835347456 bytes
    255 heads, 63 sectors/track, 53352 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Device Boot Start End Blocks Id System
    /dev/sde1 1 53352 428549908+ 83 Linux
    Disk /dev/sdf: 438.8 GB, 438835347456 bytes
    255 heads, 63 sectors/track, 53352 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
    Device Boot Start End Blocks Id System
    /dev/sdf1 1 53352 428549908+ 83 Linux
    [root@rac2 ~]#
    Thank you.
    Edited by: user12144220 on Aug 10, 2011 1:10 AM
    Edited by: user12144220 on Aug 10, 2011 1:11 AM
    Edited by: user12144220 on Aug 10, 2011 1:13 AM

  • Oracle 11gR2 RAC - Recover Crashed node

    We have Oracle 11gR2 (11.2.0.3) RAC (2-node) on RHEL5.
    One of the node in this cluster has been crashed, and we will have to rebuilt that server from the scratch, we don't have other choice. All our instances are running on node-1.
    In this case how do we rebuilt the second node and instances without affecting the database in node-1. Any input would be appreciated.
    Edited by: MR139 on May 23, 2012 11:44 AM

    Balazs
    I followed the doc (http://docs.oracle.com/cd/E11882_01/rac.112/e16794/adddelclusterware.htm#CHDFIAIE) to add node to the cluster. And it was successful. In the last step when i ran root.sh script on the new node I got the problem. Its again creating +ASM1 instance and it saying cannot create a diskgroup.
    [root@hublpr2 11.2.0.3]# ./root.sh
    Performing root user operation for Oracle 11g
    The following environment variables are set as:
        ORACLE_OWNER= grid
        ORACLE_HOME=  /app/grid/product/11.2.0.3
    Enter the full pathname of the local bin directory: [/usr/local/bin]:
    The contents of "dbhome" have not changed. No need to overwrite.
    The contents of "oraenv" have not changed. No need to overwrite.
    The contents of "coraenv" have not changed. No need to overwrite.
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root script.
    Now product-specific root actions will be performed.
    Using configuration parameter file: /app/grid/product/11.2.0.3/crs/install/crsconfig_params
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'hublpr2'
    CRS-2676: Start of 'ora.cssdmonitor' on 'hublpr2' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'hublpr2'
    CRS-2672: Attempting to start 'ora.diskmon' on 'hublpr2'
    CRS-2676: Start of 'ora.diskmon' on 'hublpr2' succeeded
    CRS-2676: Start of 'ora.cssd' on 'hublpr2' succeeded
    Disk Group MDMPVTD01 creation failed with the following message:
    ORA-15018: diskgroup cannot be created
    ORA-15031: disk specification 'ORCL:MDMPVDT03' matches no disks
    ORA-15031: disk specification 'ORCL:MDMPVDT02' matches no disks
    ORA-15031: disk specification 'ORCL:MDMPVDT01' matches no disks
    Configuration of ASM ... failed
    see asmca logs at /app/oracle/cfgtoollogs/asmca for details
    Did not succssfully configure and start ASM at /app/grid/product/11.2.0.3/crs/install/crsconfig_lib.pm line 6763.
    /app/grid/product/11.2.0.3/perl/bin/perl -I/app/grid/product/11.2.0.3/perl/lib -I/app/grid/product/11.2.0.3/crs/install /app/grid/product/11.2.0.3/crs/install/rootcrs.pl execution failed

  • Installing Oracle 11gR2 RAC Problem: ASM disks

    Folks,
    Hello. I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer and according to the tutorial
    http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
    At the first time, I create VM rac1. While its OS Oracle Linux 5.6 is booting, initializing ASMLib Driver OK. I create 5 ASM disks successfully using the command:
    [root@rac1 /]# /etc/init.d/oracleasm createdisk ASMDISK1 /dev/sdb1
    Output: Marking disk "ASMDISK1" as an ASM disk: OK
    Because the hard disk space of rac1 is not enough to install Database, I create VM rac1 again with bigger hard disk space (30GB). I do everything the same with that at the first time. But this time, While OS Oracle Linux 5.6 is booting, initializing ASMLib Driver failed. I create 5 ASM disks using the same command:
    [root@rac1 /]# /etc/init.d/oracleasm createdisk ASMDISK1 /dev/sdb1
    Output: Marking disk "ASMDISK1" as an ASM disk: failed
    But when I use the command:
    [root@rac1 /]# /etc/init.d/oracleasm listdisks
    Output: ASMDISK1 ASMDISK2 ASMDISK3 ASMDISK4 ASMDISK5
    My questions are:
    First, can the 5 disks "ASMDISK1 ASMDISK2 ASMDISK3 ASMDISK4 ASMDISK5" be used correctly in spite of Marking disk "ASMDISK1(2 3 4 5)" as an ASM disk failed ?
    Second, how to fix OS Oracle Linux 5.6 so that initializing ASMLib Driver OK while booting ?
    Thanks.

    Folks,
    Hello. The issue is solved by myself. Thanks.

  • Install Oracle 11gR2 RAC : Cannot remove directory bootstrap under /tmp

    Folks,
    Hello. I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer and according to the tutorial
    http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
    I am installing Grid infrastructure. I am on step 7 of 10 (verify Grid installation enviroment) and get this error:
    "Free Space: Rac2: /tmp
    Cause: Could not determine mount point for location specified.
    Action: Ensure location specified is available.
    Expected value: n/a
    Actual value: n/a "
    In order to fix the above error, I run "cluster verification utility" according to
    http://docs.oracle.com/cd/E14072_01/rac.112/e10717/cvu.htm I run the following command:
    [ora11g@rac1 \]$ /home_grid/runcluvfy.sh stage -pre crsinst -n rac1,rac2 -verbose
    Output:
    /bin/rm: cannot remove directory '/tmp/bootstrap': Operation not permitted
    ./runcluvfy.sh:line 99:/tmp/bootstrap/ouibootstrap.log: permission denied
    From the above output, we can see the directory bootstrap under /tmp causes the problem. The solution is to remove the directory bootstrap. I run the 2 commands:
    [ora11g@rac1 tmp]$ rmdir bootstrap
    Output: Operation not permitted
    [ora11g@rac1 tmp]$ rm -rf bootstrap
    Output: cannot remove bootstrap: Operation not permitted.
    [ora11g@rac2 tmp]$ ls
    Output: there is no 'bootstrap' directory.
    My questions are:
    First, does "cannot remove boostrap in rac1" cause that /tmp in rac2 could not be determine mount point ?
    Second, can any folk help to remove the directory bootstrap under /tmp ?
    Thanks.

    Folks,
    Hello. Thanks a lot for replying. I have just run the 2 commands:
    [root@rac2 \]# chown -R ora11g:dba /u01
    [root@rac2 \]# chmod -R 775 /u01
    ora11g is the user who installs the Grid and /u01 is the directory where Grid is installed and dba is the group.
    I go back to Grid Installer Step 7 of 10 in rac1 and check again and see as below:
    Free Space: Rac2 : /tmp
    Cause: Could not determine mount point for location specified.
    Action: Ensure location specified is available
    Expected Value: n/a
    Actual Value: n/a
    The problem is not solved after run the above 2 commands in rac2.
    In addition, I have run Cluster Verification Utility using the command:
    [ora11g@rac1 grid]./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -r 11gR2 -orainv ora11g -verbose
    Output: All of items for rac2 are passed. There is only one item for rac1 is failed as below:
    Check default user file creation mask:
    NodeName: rac1
    Available: 0002
    Required: 0022
    Comment: failed
    As we see above, the result of CVU command is not the same with Grid Installer step 7 of 10 (Installation Environment Verification):
    CVU command doesn't find /tmp mount point problem for rac2 that Grid Installer does.
    Grid Installer step 7 of 10 doesn't find user file creation mask problem for rac1 that CVU command does.
    I have tried to find out whether creation mask failed for rac1 causes /tmp problem for rac2. I have changed the line "umask 002" to "umask 0022" for rac1 in each of the 3 files below and run CVU command each time for each file:
    rac1:
    /etc/bashrc
    /etc/profile
    /etc/csh.cshrc
    But chang the line "umask 002" to "umask 0022" for rac1 in each of the above 3 files does not solve the problem.
    My questions are:
    First, why is the result of CVU command not the same with that of Grid Installer step 7 of 10 ?
    Second, why change the line "umask 002" to "umask 0022" in 3 files can't solve creation mask problem for rac1 ?
    Third, how to solve /tmp problem for rac2 and creation mask problem for rac1 ?
    Thanks.

  • Oracle 11gR2 RAC in LDOM Network issue

    Hi, Requesting your expert advise regarding this configuration.
    We are implementing LDOM 2.2 on two SPARC T4-4 for Oracle 11gR2 RAC; Solaris 10 U10 on both control and guest domain. The setup for each primary/control domain is: Two 10g links aggregated and have four VLAN trunked on the aggregate. vSwitch created using the aggr as the device as following per T4-4:
    NOTE: VLAN 1501 is for data connection and VLAN 10 is for heartbeat for one RAC cluster and VL 1601 and 11 is for another RAC. all together four LDOMS.
    ldm add-vswitch vid=1501,1601,10,11 net-dev=aggr1 primary-vsw0 primary
    ldm add-vnet pvid=1501 vnetprod primary-vsw0 guest1
    ldm add-vnet pvid=10 vnethb primary-vsw0 guest1
    ldm add-vnet pvid=1601 vnetprod primary-vsw0 guest2
    ldm add-vnet pvid=11 vnethb primary-vsw0 guest2
    vnet inside the LDOM are not tagged:
    vnet1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3
    inet 10.220.128.20 netmask ffffff80 broadcast 10.220.128.127
    ether 0:14:4f:f9:ec:7f
    vnet2: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 4
    inet 192.168.2.11 netmask ffffff80 broadcast 192.168.2.127
    ether 0:14:4f:fb:2b:8f
    Here is the whole configuration:
    root@gp-cpu-suh004 # ldm -V
    Logical Domains Manager (v 2.2.0.0)
    Hypervisor control protocol v 1.9
    Using Hypervisor MD v 1.4
    System PROM:
    Hostconfig v. 1.2.0. @(#)Hostconfig 1.2.0.a 2012/05/11 07:34
    Hypervisor v. 1.11.0. @(#)Hypervisor 1.11.0.a 2012/05/11 05:28
    OpenBoot v. 4.34.0 @(#)OpenBoot 4.34.0 2012/04/30 14:26
    root@gp-cpu-suh004 # ldm ls
    NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
    primary active -n-cv- UART 32 16G 2.5% 48m
    oidrac1 active -n---- 5000 32 16G 0.0% 27m
    root@gp-cpu-suh004 # ldm ls -l
    NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
    primary active -n-cv- UART 32 16G 3.1% 48m
    SOFTSTATE
    Solaris running
    UUID
    e73421fe-7003-e748-be7e-801fee5bfcc7
    MAC
    00:21:28:f1:95:26
    HOSTID
    0x85f19526
    CONTROL
    failure-policy=ignore
    extended-mapin-space=off
    cpu-arch=native
    DEPENDENCY
    master=
    CORE
    VCPU
    MEMORY
    RA PA SIZE
    0x20000000 0x20000000 16G
    CONSTRAINT
    threading=max-throughput
    VARIABLES
    auto-boot-on-error?=true
    auto-boot?=true
    boot-device=/pci@400/pci@1/pci@0/pci@0/LSI,sas@0/disk@w5000cca0251e7a29,0:a
    keyboard-layout=US-English
    nvramrc=." ChassisSerialNumber 1207BDYFFE " cr
    use-nvramrc?=true
    IO
    DEVICE PSEUDONYM OPTIONS
    VCC
    NAME PORT-RANGE
    primary-vcc0 5000-5100
    VSW
    NAME MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
    primary-vsw-mgmt 00:14:4f:fb:75:c0 igb1 0 switch@0 1 1 1500 on
    primary-vsw0 00:14:4f:fa:33:8b aggr1 1 switch@1 1 1 1501,1601,10,11 1500 on
    VDS
    NAME VOLUME OPTIONS MPGROUP DEVICE
    primary-vds0 rootoid /dev/dsk/c14t50060E8005BFAA04d1s2
    data_oid /dev/dsk/c14t50060E8005BFAA04d2s2
    ocr_oid /dev/dsk/c14t50060E8005BFAA04d3s2
    VCONS
    NAME SERVICE PORT
    UART
    NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
    oidrac1 active -n---- 5000 32 16G 0.0% 27m
    SOFTSTATE
    Solaris running
    UUID
    0fcbbf21-14a2-eb21-f544-d4424212f3ef
    MAC
    00:14:4f:f9:1b:d4
    HOSTID
    0x84f91bd4
    CONTROL
    failure-policy=ignore
    extended-mapin-space=off
    cpu-arch=native
    DEPENDENCY
    master=
    CORE
    CID CPUSET
    VCPU
    VID PID CID UTIL STRAND
    MEMORY
    RA PA SIZE
    0x20000000 0x420000000 16G
    CONSTRAINT
    threading=max-throughput
    VARIABLES
    auto-boot?=true
    boot-device=disk:a
    keyboard-layout=US-English
    NETWORK
    NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
    vnet1 primary-vsw-mgmt@primary 0 network@0 00:14:4f:fa:61:77 1 1500
    vnetprod primary-vsw0@primary 1 network@1 00:14:4f:f9:ec:7f 1501 1500
    vnethb primary-vsw0@primary 2 network@2 00:14:4f:fb:2b:8f 10 1500
    DISK
    NAME VOLUME TOUT ID DEVICE SERVER MPGROUP
    oneidrootdisk rootoid@primary-vds0 0 disk@0 primary
    oid_data data_oid@primary-vds0 1 disk@1 primary
    oid_ocr ocr_oid@primary-vds0 2 disk@2 primary
    VCONS
    NAME SERVICE PORT
    oidrac1 primary-vcc0@primary 5000
    root@gp-cpu-suh004 # ldm ls-services
    VCC
    NAME LDOM PORT-RANGE
    primary-vcc0 primary 5000-5100
    VSW
    NAME LDOM MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
    primary-vsw-mgmt primary 00:14:4f:fb:75:c0 igb1 0 switch@0 1 1 1500 on
    primary-vsw0 primary 00:14:4f:fa:33:8b aggr1 1 switch@1 1 1 1501,1601,10,11 1500 on
    VDS
    NAME LDOM VOLUME OPTIONS MPGROUP DEVICE
    primary-vds0 primary rootoid /dev/dsk/c14t50060E8005BFAA04d1s2
    data_oid /dev/dsk/c14t50060E8005BFAA04d2s2
    ocr_oid /dev/dsk/c14t50060E8005BFAA04d3s2
    root@gp-cpu-suh004 # dladm show-link
    vsw0 type: non-vlan mtu: 1500 device: vsw0
    vsw1 type: non-vlan mtu: 1500 device: vsw1
    vsw1501001 type: vlan 1501 mtu: 1500 device: vsw1
    igb0 type: non-vlan mtu: 1500 device: igb0
    igb1 type: non-vlan mtu: 1500 device: igb1
    qlge0 type: non-vlan mtu: 1500 device: qlge0
    qlge1 type: non-vlan mtu: 1500 device: qlge1
    qlge2 type: non-vlan mtu: 1500 device: qlge2
    qlge3 type: non-vlan mtu: 1500 device: qlge3
    aggr1 type: non-vlan mtu: 1500 aggregation: key 1
    root@gp-cpu-suh004 # ifconfig -a
    lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
    inet 127.0.0.1 netmask ff000000
    igb0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2
    inet 10.223.12.14 netmask ffffff00 broadcast 10.223.12.255
    ether 0:21:28:f1:95:26
    vsw1501001: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 3
    inet 10.220.128.9 netmask ffffff80 broadcast 10.220.128.127
    ether 0:14:4f:fa:33:8b
    root@gp-cpu-suh004 # netstat -nr
    Routing Table: IPv4
    Destination Gateway Flags Ref Use Interface
    default 10.220.128.1 UG 1 7
    10.220.128.0 10.220.128.9 U 1 5 vsw1501001
    10.223.0.0 10.223.12.1 UG 1 2
    10.223.12.0 10.223.12.14 U 1 1 igb0
    224.0.0.0 10.220.128.9 U 1 0 vsw1501001
    127.0.0.1 127.0.0.1 UH 8 261 lo0

    Yes, I can connect to the vswitch interface on the control domain. I didn't specify any PVID because my understanding is that PVID will tag any frame with the PVID VLAN by default. basically the PVID for this interface is 1.
    Here's the VNET config for the other LDOM in the RAC cluster:
    VSW
    NAME MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
    primary-vsw-mgmt 00:14:4f:f9:91:fa igb1 0 switch@0 1 1 1500 on
    primary-vsw0 00:14:4f:fa:8e:cf aggr1 1 switch@1 1 1 1501,1601,10,11 1500 on
    NETWORK
    NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
    vnet1 primary-vsw-mgmt 0 00:14:4f:fb:65:6d 1
    vnetprod primary-vsw0 1 00:14:4f:fa:2b:02 1501
    vnethb primary-vsw0 2 00:14:4f:f8:12:c1 10
    Thanks for reviewing my configuration.

  • Oracle 11gR2 RAC with Sun clsuter 3.3 clsetup not showing  ASMDiskGroup RS

    Hello,
    I am installing Oracle 11gR2 RAC on Solaris cluster 3.3 with hardware RAID and ASM
    I was able to register rac-famework-rg and crs-framework-rg.
    Oracle RAC is up and running (confirmed from crs_stat -t -v)
    However, while creating option 5. Automatic Storage Management (ASM) on clsetup, I was getting ERROR: ASM is either not installed or the installation is invalid!
    I have created the asm-inst-rg with resource asm-inst-rs and asm-dg-rg with resources asm-dg-fra, asm-dg-data and asm-dg-crs using CLI. Please find the complete clrg and clrs status output below:
    root@rac1 # clrg status
    === Cluster Resource Groups ===
    Group Name Node Name Suspended Status
    rac-framework-rg rac1 No Online
    rac2 No Online
    asm-inst-rg rac1 No Online
    rac2 No Online
    asm-dg-rg rac1 No Online
    rac2 No Online
    root@rac1 # clrs status
    === Cluster Resources ===
    Resource Name Node Name State Status Message
    crs_framework-rs rac1 Online Online
    rac2 Online Online
    rac-udlm-rs rac1 Online Online
    rac2 Online Online
    rac-framework-rs rac1 Online Online
    rac2 Online Online
    asm-inst-rs rac1 Online Online - +ASM1 is UP and ENABLED
    rac2 Online Online - +ASM2 is UP and ENABLED
    asm-dg-fra rac1 Online Online - Mounted: FRA
    rac2 Online Online - Mounted: FRA
    asm-dg-crs rac1 Online Online - Mounted: CRS
    rac2 Online Online - Mounted: CRS
    asm-dg-data rac1 Online Online - Mounted: DATA
    rac2 Online Online - Mounted: DATA
    Once I reach clsetup option 6: Resources for Oracle Real Application Clusters Database Instances, I was able to select cluster db name, oracle home, SID for both nodes, and it listed the asm-inst-rg and asm-inst-rs for selection of "Specify Oracle ASM Instance Resource".
    The problem is the the next selection which is "Specify Oracle ASM Disk Group Resources" which does NOT list any asm-dg-rg or asm-dg-fra or anything, instead, it throws error "No existing disk-group resources available for selection. Run ASM subwizard create new resource(s) and come back to this panel for the selection."
    Kindly guide me to create Resources for Oracle Real Application Clusters Database Instances either in CLI or clsetup
    Thanks and Regards
    Ushas Symon

    Solaris Cluster 3.3 u1 solved the issue.
    The problem right now I am facing is IPMP on the public interface.
    When I remove the cable on the bge0, the ip on bge0 and the SCAN IP's are plumbed to bge1 which is in sc_ipmp0, but NOT the virtual IP!!! and the listeners on both nodes go offiline!!!
    any inputs on the configuration will be highly appreciated..
    Thanks and Regards
    Ushas Symon

Maybe you are looking for