Oracle11g r2 Grid/RAC  VIP failover instead of SCAN VIP failover

Dear Experts and Gurus
Our Platform: 2-Node ORACLE11G r2 RAC/GRID 11.2.0.1.0
ReadHat Enterprise Linux5.3 64 bit
We have not available the DNS Server for used to SCAN feature of Oracle11g r2 GRID/RAC.
we have successfully deployed the the setup using scan-vip in /etc/host in our production site.
we want to used the Oracle11g r2 Grid/RAC as Oracle10g r2 RAC/Oracle11g r1 RAC(VIP Failover)
plz find the default configurations of my setup.
cat /etc/hosts
#public
xxx.xxx.0.1 xyz-ch-aaadb-01
xxx.xxx.0.2 xyzl-ch-aaadb-02
#Virtual
xxx.xxx.0.3 xyz-ch-aaadb-01-vip
xxx.xxx.0.4 xyz-ch-aaadb-02-vip
#Private
10.10.0.1 xyz-ch-aaadb-01-priv
10.10.0.2 xyz-ch-aaadb-01-priv
#Scan
xxx.xxx.0.5 rac-scan
cat listener.ora
listener.ora in both the RAC nodes
LISTENER=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER)))) # line added by Agent
LISTENER_SCAN1=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN1)))) # line added by Agent
ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER_SCAN1=ON # line added by Agent
ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER=ON # line added by Agent
cat tnsnames.ora.
AAADB =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = rac-scan)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = aaadb)
aaadb2 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = xyz-ch-aaadb-02-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = aaadb)
(INSTANCE_NAME = aaadb2)
aaadb1 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = xyz-ch-aaadb-01-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = aaadb)
(INSTANCE_NAME = aaadb1)
listener parameters
RAC-NODE1
SQL> show parameter listener
NAME TYPE VALUE
listener_networks string
local_listener string (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=xyz-ch-aaadb-01-vip)(PORT=1521))))
remote_listener string rac-scan:1521
RAC-NODE2
SQL> show parameter listener
NAME TYPE VALUE
listener_networks string
local_listener string (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=xyz-ch-aaadb-02-vip)(PORT=1521))))
remote_listener string rac-scan:1521
listener status
RAC Node-1
[oracle@aaarac1 ~]$ lsnrctl status
LSNRCTL for Linux: Version 11.2.0.1.0 - Production on 30-AUG-2011 23:43:50
Copyright (c) 1991, 2009, Oracle. All rights reserved.
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
STATUS of the LISTENER
Alias LISTENER
Version TNSLSNR for Linux: Version 11.2.0.1.0 - Production
Start Date 30-AUG-2011 22:31:34
Uptime 0 days 1 hr. 12 min. 15 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /u01/app/11.2.0/grid/network/admin/listener.ora
Listener Log File /u01/app/oracle/diag/tnslsnr/aaarac1/listener/alert/log.xml
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=xyz-ch-aaadb-01-vip)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=xxx.xxx.0.1)(PORT=1521)))
Services Summary...
Service "+ASM" has 1 instance(s).
Instance "+ASM1", status READY, has 1 handler(s) for this service...
Service "aaadb" has 1 instance(s).
Instance "aaadb1", status READY, has 1 handler(s) for this service...
Service "aaadbXDB" has 1 instance(s).
Instance "aaadb1", status READY, has 1 handler(s) for this service...
The command completed successfully
RAC Node-2
[oracle@aaarac2 ~]$ lsnrctl status
LSNRCTL for Linux: Version 11.2.0.1.0 - Production on 30-AUG-2011 23:44:27
Copyright (c) 1991, 2009, Oracle. All rights reserved.
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
STATUS of the LISTENER
Alias LISTENER
Version TNSLSNR for Linux: Version 11.2.0.1.0 - Production
Start Date 30-AUG-2011 22:08:45
Uptime 0 days 1 hr. 35 min. 42 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /u01/app/11.2.0/grid/network/admin/listener.ora
Listener Log File /u01/app/oracle/diag/tnslsnr/aaarac2/listener/alert/log.xml
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=xyz-ch-aaadb-02-vip)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=xxx.xxx.0.2)(PORT=1521)))
Services Summary...
Service "+ASM" has 1 instance(s).
Instance "+ASM2", status READY, has 1 handler(s) for this service...
Service "aaadb" has 1 instance(s).
Instance "aaadb2", status READY, has 1 handler(s) for this service...
Service "aaadbXDB" has 1 instance(s).
Instance "aaadb2", status READY, has 1 handler(s) for this service...
The command completed successfully
plz suggest the provide the step to configure the listener.ora and tnsnames.ora for use the Oracle11g r2 Grid/RAC to use as
VIP failover instead of SCAN-VIP failover.
Regards
Hitgon
Edited by: hitgon on Aug 31, 2011 12:14 AM

hitgon wrote:
Dear Experts and Gurus
plz suggest the provide the step to configure the listener.ora and tnsnames.ora for use the Oracle11g r2 Grid/RAC to use as
VIP failover instead of SCAN-VIP failover.
Regards
Hitgon
Hi,
Have a read http://download.oracle.com/docs/cd/E11882_01/network.112/e10836/advcfg.htm#NETAG348
Hope it helps
CHeers

Similar Messages

  • Dynamic Logging level control in a grid/rac system

    How is the logging level in a grid/rac configured Weblogic system dynamically configured? I would like to control the logging level in grid/rac configured system dymaically via a GUI. What are the steps to controlling the level, or please direct to the appropriate documention.

    You would do it the same way you would with a tank of any shape. The only difference is that you are dealing with the volume of a sphere rather than a cylinder or rectangle. Hence the amount of fluid required to raise the level by X is non-linear in that it varies with how much stuff is already in the tank - which is a function of the volume of a sphere (actually the volume of a partial sphere).
    Mike...
    Certified Professional Instructor
    Certified LabVIEW Architect
    LabVIEW Champion
    "... after all, He's not a tame lion..."
    Be thinking ahead and mark your dance card for NI Week 2015 now: TS 6139 - Object Oriented First Steps

  • RAC DB failover from one Datacenter to Standby site

    Hi,
    I have 2 node 10gR2 RAC cluster running on Linux with ASM and E-business suite is configured with this 10gR2 RAC DB. Would like to setup standby site with single instance and not go with RAC for now until we procure additional hardware. Also no plans in setting up DG as solution. Does anyone has similar setup? During failover we have the capability to migrate the VIP's (names) to the failed DC but the IP's will change since there is no L2 extension b/w DC's to retain the same IP. Synchronous replication is setup at disk level using EMC SRDF
    Question:
    1) Will i be able to bring up the RAC DB in single instance node at second DC using non-rac code tree? IF so can anyone share whitepaper/docs on how to bring up RAC db as non-RAC environment. Logically i think it should work if i have right spfile with no RAC specific parameters.. Would like to hear from experts.
    2) Wanted to minimize the configuration changes at the E-business suite level since we plan to bring the VIP's over to failed DC.
    3) Does the crs registry manages information about VIP name to IP address? since my IP address will change when i migrate the VIP name from one DC to other DC. Will it be relevant at all since we plan to bring up the db in single instance mode at the failed over DC?
    Any help is appreciated
    Thanks

    1) When you say you want to have it in a non-RAC mode. what do you mean, your current DR is a RAC however during disaster you want it to be in a non-RAC mode. Yes it would be possible, you can turn off the CLUSTER_DATABASE parameter to FALSE and bring the database as a single instance database. with this option you still will have the RAC features such as dictionaries etc however not used. the other option of completely turning of the RAC feature and getting it back to a single instance configuration may require additional steps.
    which ever method you pick, you should consider the workload, will this single instance be able to handle the entire workload that originally existed on a RAC configuration.
    2) VIPs dont failover outside the RAC cluster. the method normally followed is to have a database service configured on the primary and as part of a database startup trigger ensure that the database service is enabled on the DC site. There is a paper on OTN on how to do this.
    3) Yes, the VIP information is stored in the OCR file.

  • Oracle Forms 10g runtime handling during RAC node failover.

    Hi,
    Forms version 10g R2 (10.1.2.0.2)
    Oracle DB version 10g R2 RAC with 3 nodes.
    If the RAC DB node that the user is connected to goes down, the user gets FRM-40733 and ORA-03114 error messages and the client forms application gets locked down/ goes in a loop with the error messages. The user has to close the browser to get out of the loop. I understand that this is the expected behaviour, but I'm wondering whether we can trap the error ORA-03114 and fire the "key-exit" trigger to get out of the application.
    Have any one implemented a clean way to exit the Forms application when the RAC DB node goes down..?
    I'm looking for some suggestions or an elegant way to handle the above failure.
    Thank you in advance.
    Sudhakar

    Glen,
    I haven't solve this one yet.I have been playing around with the following:
    In my environment, I am still using 6i (not web) forms/reports.
    My clients are XP, NT, 2000.
    I have the forms/report runtime installed on their PCs.
    Their TNSNAMES.ORA will be pointing to PRIMARY ( PDB)
    If a SWITCHOVER or FAILOVER happens to the physical standby (SDB), I want a trigger to kick a batch file that will manipulate the TNSNAME.ORA on each clients stations.
    On the standby
    CREATE OR REPLACE TRIGGER change_tns
    AFTER DB_ROLE_CHANGE ON DATABASE
    DECLARE
    role VARCHAR2(30);
    dbname varchar2(100);
    BEGIN
    SELECT
    DATABASE_ROLE,
    DB_UNIQUE_NAME
    INTO
    role,
    dbname
    FROM
    V$DATABASE;
    IF role = 'PRIMARY' and dbname='SDB' THEN
    dbms_scheduler.create_job(
    job_name=>'move_sqlnet',
    job_type=>'executable',
    job_action=>'c:\temp\movetns.cmd',
    enabled=TRUE
    ELSE
    -- if the standby >was< PRIMARY,
    -- but the primary comes BACK on line,
    -- need to reverse the step above.
    END IF;
    END;
    As for the movetns.cmd
    something like
    rem -- attach to the workstation,
    net use m: \\station name\share name
    rem -- stdb_tnsname.ora would be pointing to STANDBY
    copy stdb_tnsname.ora m:\orant\net80\tnsname.ora
    net use m: /delete
    rem -- need to do that for all workstations..
    As you can see, there could be lots of problems with this procedure.
    Client doesn't know about the failover, starts a RE-BOOT on the pc, therefore, the new tnsnames.ora will not get to client.. what to do for that client? Do i re-run the batch ...every hour?
    tell me if you come up with an answer..
    p-

  • Problem with Oracle 10g RAC VIP network setting at Solaris 9

    Dear All,
    I have tried to set up a Oracle 10g RAC Release 2.
    With OS solaris 9, and 2 nodes.
    The nodes setting as the following:
    nodes 1:
    Public address: 172.16.0.121
    Private address: 192.168.0.121, 192.168.1.121 (dual path for heart beat)
    nodes 2:
    Public address: 172.16.0.122
    Private address: 192.168.0.122, 192.168.1.122
    And i have assigned two IP adress 172.16.0.131, 172.16.0.132 as the VIP address for the
    RAC.
    And the following is the /etc/hosts file:
    root@shk01 # cat /etc/hosts
    # Internet host table
    127.0.0.1 localhost
    # public address
    172.16.0.121 shk01 loghost
    172.16.0.122 shk02
    # heart beat
    192.168.0.121 shk01-priv1
    192.168.1.121 shk01-priv2
    192.168.0.122 shk02-priv1
    192.168.1.122 shk02-priv2
    # VIP address
    172.16.1.131 vip-shk01
    172.16.1.132 vip-shk02
    But when i run the command "$ ./runcluvfy.sh comp nodecon -n shk01,shk02 -verbose"
    it shows the error:
    ERROR:
    Could not find a suitable set of interfaces for VIPs.
    Result: Node connectivity check failed.
    I did try to add the VIP address on bge0:1, as i using bge0 for the public address.
    Both nodes i did using the same interface name for it.
    Anyone have idea for me to check out the error?
    Also, I have other question about the raw device.
    As there is option for setting for ASM or raw device. If choosing raw device, does it mean that it just need to
    format the storage disk but without newfs it? And then the Oracle program will able to handle it?
    Thanks,
    Xentar

    You don't seem to state categorically that you are using Solaris Cluster, so I'll assume it since this is mainly a forum about Solaris Cluster (and IMHO, Solaris Cluster with Clusterware is better than Clusterware on its own).
    Clusterware has to see the same device names from all cluster nodes. This is why Solaris Cluster (SC) is a positive benefit over Clusterware because SC provides an automatically managed, consistent name space. Clusterware on its own forces you to manage either the symbolic links (or worse mknods) to create a consistent namespace!
    So, given the SC consistent namespace you simple add the raw devices into the ASM configuration, i.e. /dev/did/rdsk/dXsY. If you are using Solaris Volume Manager, you would use /dev/md/<setname>/rdsk/dXXX and if you were using CVM/VxVM you would use /dev/vx/rdsk/<dg_name>/<dev_name>.
    Of course, if you genuinely are using Clusterware on its own, then you have somewhat of a management issue! ... time to think about installing SC?
    Tim
    ---

  • Oracle RAC installation failover

    Hi,
    I have an Oracle RAC installation with 2 nodes with the data stored on a shared OCFS partition. I had a client test the connection using jdbc string for RAC failover. I tried shutting down one of the nodes on the RAC installation and the client could not connect to the oracle cluster database for the next 5 to 10mins.
    I understand that the client would failover to the next available listener (On the next retry connection) if the node it is currently listening to has failed. Is there any configuration i should make to increase the failover efficiency?
    Thanks for any advice.

    Hi,
    Server side failover is arranged by setting the remote_listener parameter.
    Client side failover is set by using T(ransparent) A(pplication) F(ailover) (9i and higher)
    or F(ast)C(onnection)F(ailover). Both are documented in the Net administrators manual for the version you didn't care to mention.
    As far as I know, both TAF and FCF are not supported by the JDBC thin driver.
    Sybrand Bakker
    Senior Oracle DBA

  • Best practice of 11G release 2 Grid & RAC installation on Solaris 10

    Hi Experts,
    Please share 11g Release 2 Grid infrastructure and RAC installation experiennce on Sun SPARC.
    Appreciate if you can provide documentation which provde complete information from server setup to database setup(other than oracle documentaion)
    Also please let me know which is the best storage option( NFS , ASM,...) and pros and cons
    Regards,
    Rasin M

    Hi,
    Appreciate if you can provide documentation which provde complete information from server setup to database setup(other than oracle documentaion)Check this in MOS:
    RAC Assurance Support Team: RAC Starter Kit and Best Practices (Solaris)
    https://support.oracle.com/CSP/main/article?cmd=show&id=811280.1&type=NOT
    Regards,
    Levi Pereira
    http://levipereira.wordpress.com

  • Oracle 10.2.0.4 RAC vip故障漂移导致监听关闭.

    环境：oracle 10.2.0.4 RAC+ASM
    故障现象：vip漂移至另一节点导致监听关闭，vip漂移现象随机在2个节点中出现，数据库实例正常，只是vip漂移至另一节点，同时监听offline。
    # su - oracle
    $ crs_stat -t
    Name Type Target State Host
    ora....SM1.asm application ONLINE ONLINE p770db1
    ora....B1.lsnr application ONLINE OFFLINE
    ora....db1.gsd application ONLINE ONLINE p770db1
    ora....db1.ons application ONLINE ONLINE p770db1
    ora....db1.vip application ONLINE ONLINE p770db2
    ora....SM2.asm application ONLINE ONLINE p770db2
    ora....B2.lsnr application ONLINE ONLINE p770db2
    ora....db2.gsd application ONLINE ONLINE p770db2
    ora....db2.ons application ONLINE ONLINE p770db2
    ora....db2.vip application ONLINE ONLINE p770db2
    ora.zjhorcl.db application ONLINE ONLINE p770db1
    ora....orcl.cs application ONLINE ONLINE p770db1
    ora....cl1.srv application ONLINE OFFLINE
    ora....cl2.srv application ONLINE ONLINE p770db2
    ora....l1.inst application ONLINE ONLINE p770db1
    ora....l2.inst application ONLINE ONLINE p770db2
    然后要用crs_start -all重启后来能恢复，如下：
    $ crs_start -all
    p770db1 : CRS-1018: Resource ora.p770db1.vip (application) is already running on p770db2
    p770db2 : CRS-1019: Resource ora.p770db1.LISTENER_P770DB1.lsnr (application) cannot run on p770db2
    Attempting to start `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1`
    Start of `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1` succeeded.
    CRS-0223: Resource 'ora.p770db1.LISTENER_P770DB1.lsnr' has placement error.
    ========================================================================================
    2012-10-11 06:56:21.830: [  CRSRES][11110]32startRunnable: setting CLI values
    2012-10-12 13:47:28.205: [  CRSRES][11471]32p770db1 : CRS-1019: Resource ora.p770db2.LISTENER_P770DB2.lsnr (application) cannot run
    on p770db1
    p770db2 : CRS-1018: Resource ora.p770db2.vip (application) is already running on p770db1
    2012-10-12 13:47:28.247: [  CRSRES][11728]32Attempting to start `ora.zjhorcl.orcl.zjhorcl2.srv` on member `p770db2`
    2012-10-12 13:47:28.656: [  CRSRES][11986]32StopResource: setting CLI values
    2012-10-12 13:47:31.709: [  CRSRES][11728]32Start of `ora.zjhorcl.orcl.zjhorcl2.srv` on member `p770db2` succeeded.
    2012-10-12 15:34:14.228: [  CRSAPP][11192]32CheckResource error for ora.p770db1.vip error code = 1
    2012-10-12 15:34:14.234: [  CRSRES][11192]32In stateChanged, ora.p770db1.vip target is ONLINE
    2012-10-12 15:34:14.235: [  CRSRES][11192]32ora.p770db1.vip on p770db1 went OFFLINE unexpectedly
    2012-10-12 15:34:14.235: [  CRSRES][11192]32StopResource: setting CLI values
    2012-10-12 15:34:14.238: [  CRSRES][11192]32Attempting to stop `ora.p770db1.vip` on member `p770db1`
    2012-10-12 15:34:14.602: [  CRSRES][11709]32In stateChanged, ora.zjhorcl.orcl.zjhorcl1.srv target is ONLINE
    2012-10-12 15:34:14.602: [  CRSRES][11709]32ora.zjhorcl.orcl.zjhorcl1.srv on p770db1 went OFFLINE unexpectedly
    2012-10-12 15:34:14.603: [  CRSRES][11709]32StopResource: setting CLI values
    2012-10-12 15:34:14.628: [  CRSRES][11709]32Attempting to stop `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1`
    2012-10-12 15:34:14.716: [  CRSRES][11192]32Stop of `ora.p770db1.vip` on member `p770db1` succeeded.
    2012-10-12 15:34:14.717: [  CRSRES][11192]32ora.p770db1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2012-10-12 15:34:14.722: [  CRSRES][11192]32ora.p770db1.vip failed on p770db1 relocating.
    2012-10-12 15:34:14.750: [  CRSRES][11192]32StopResource: setting CLI values
    2012-10-12 15:34:14.754: [  CRSRES][11192]32Attempting to stop `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
    2012-10-12 15:34:15.011: [  CRSRES][11709]32Stop of `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1` succeeded.
    2012-10-12 15:34:15.011: [  CRSRES][11709]32ora.zjhorcl.orcl.zjhorcl1.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2012-10-12 15:34:15.019: [  CRSRES][11709]32ora.zjhorcl.orcl.zjhorcl1.srv failed on p770db1 relocating.
    2012-10-12 15:34:15.115: [  CRSRES][11709]32Cannot relocate ora.zjhorcl.orcl.zjhorcl1.srvStopping dependents
    2012-10-12 15:34:15.321: [  CRSRES][11709]32StopResource: setting CLI values
    2012-10-12 15:35:32.118: [  CRSRES][11192]32Stop of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
    2012-10-12 15:35:32.181: [  CRSRES][11192]32Attempting to start `ora.p770db1.vip` on member `p770db2`
    2012-10-12 15:35:33.824: [  CRSRES][11192]32Start of `ora.p770db1.vip` on member `p770db2` succeeded.
    2012-10-13 03:09:02.433: [  CRSEVT][11049]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_2/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-13 03:09:02.433: [  CRSEVT][11049]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_2/bin/racgwrap(check) tim
    ed out for ora.zjhorcl.orcl.cs! (timeout=600)
    2012-10-13 03:09:02.433: [  CRSAPP][11049]32CheckResource error for ora.zjhorcl.orcl.cs error code = -2
    2012-10-13 03:09:10.452: [  CRSEVT][11562]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_2/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-13 03:09:10.453: [  CRSEVT][11562]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_2/bin/racgwrap(check) tim
    ed out for ora.p770db1.ASM1.asm! (timeout=600)
    2012-10-13 03:09:10.453: [  CRSAPP][11562]32CheckResource error for ora.p770db1.ASM1.asm error code = -2
    2012-10-13 03:09:10.583: [  CRSEVT][11819]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_2/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-13 03:09:10.583: [  CRSEVT][11819]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_2/bin/racgwrap(check) tim
    ed out for ora.zjhorcl.zjhorcl1.inst! (timeout=600)
    2012-10-13 03:09:10.583: [  CRSAPP][11819]32CheckResource error for ora.zjhorcl.zjhorcl1.inst error code = -2
    2012-10-13 03:09:14.032: [  CRSEVT][12332]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-13 03:09:14.033: [  CRSEVT][12332]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db1.ons! (timeout=600)
    2012-10-13 03:09:14.033: [  CRSAPP][12332]32CheckResource error for ora.p770db1.ons error code = -2
    2012-10-14 19:32:02.637: [  CRSRES][11089]32startRunnable: setting CLI values
    2012-10-14 19:32:03.342: [  CRSRES][11603]32StopResource: setting CLI values
    2012-10-14 19:32:03.353: [  CRSRES][11603]32Attempting to stop `ora.p770db1.vip` on member `p770db2`
    2012-10-14 19:32:03.792: [  CRSRES][11603]32Stop of `ora.p770db1.vip` on member `p770db2` succeeded.
    2012-10-14 19:32:03.799: [  CRSRES][11603]32startRunnable: setting CLI values
    2012-10-14 19:32:03.799: [  CRSRES][11603]32Attempting to start `ora.p770db1.vip` on member `p770db1`
    2012-10-14 19:32:05.520: [  CRSRES][11603]32Start of `ora.p770db1.vip` on member `p770db1` succeeded.
    2012-10-14 19:32:05.688: [  CRSRES][11864]32startRunnable: setting CLI values
    2012-10-14 19:32:05.696: [  CRSRES][11864]32Attempting to start `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
    2012-10-14 19:32:06.273: [  CRSRES][12386]32CRS-1002: Resource 'ora.zjhorcl.orcl.cs' is already running on member 'p770db1'
    2012-10-14 19:32:06.576: [  CRSRES][11864]32Start of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
    2012-10-21 10:29:19.051: [  CRSAPP][11054]32CheckResource error for ora.p770db1.vip error code = 1
    2012-10-21 10:29:19.059: [  CRSRES][11054]32In stateChanged, ora.p770db1.vip target is ONLINE
    2012-10-21 10:29:19.060: [  CRSRES][11054]32ora.p770db1.vip on p770db1 went OFFLINE unexpectedly
    2012-10-21 10:29:19.060: [  CRSRES][11054]32StopResource: setting CLI values
    2012-10-21 10:29:19.070: [  CRSRES][11054]32Attempting to stop `ora.p770db1.vip` on member `p770db1`
    2012-10-21 10:29:19.526: [  CRSRES][11828]32In stateChanged, ora.zjhorcl.orcl.zjhorcl1.srv target is ONLINE
    2012-10-21 10:29:19.526: [  CRSRES][11828]32ora.zjhorcl.orcl.zjhorcl1.srv on p770db1 went OFFLINE unexpectedly
    2012-10-21 10:29:19.527: [  CRSRES][11828]32StopResource: setting CLI values
    2012-10-21 10:29:19.575: [  CRSRES][11828]32Attempting to stop `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1`
    2012-10-21 10:29:19.673: [  CRSRES][11054]32Stop of `ora.p770db1.vip` on member `p770db1` succeeded.
    2012-10-21 10:29:19.674: [  CRSRES][11054]32ora.p770db1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2012-10-21 10:29:19.684: [  CRSRES][11054]32ora.p770db1.vip failed on p770db1 relocating.
    2012-10-21 10:29:19.718: [  CRSRES][11054]32StopResource: setting CLI values
    2012-10-21 10:29:19.733: [  CRSRES][11054]32Attempting to stop `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
    2012-10-21 10:29:19.932: [  CRSRES][11828]32Stop of `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1` succeeded.
    2012-10-21 10:29:19.933: [  CRSRES][11828]32ora.zjhorcl.orcl.zjhorcl1.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2012-10-21 10:29:19.941: [  CRSRES][11828]32ora.zjhorcl.orcl.zjhorcl1.srv failed on p770db1 relocating.
    2012-10-21 10:29:20.116: [  CRSRES][11828]32Cannot relocate ora.zjhorcl.orcl.zjhorcl1.srvStopping dependents
    2012-10-21 10:29:20.154: [  CRSRES][11828]32StopResource: setting CLI values
    2012-10-21 10:30:36.095: [  CRSRES][11054]32Stop of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
    2012-10-21 10:30:36.280: [  CRSRES][11054]32Attempting to start `ora.p770db1.vip` on member `p770db2`
    2012-10-21 10:30:37.942: [  CRSRES][11054]32Start of `ora.p770db1.vip` on member `p770db2` succeeded.
    2012-10-21 10:30:38.289: [  CRSRES][11932]32CRS-1002: Resource 'ora.p770db1.vip' is already running on member 'p770db2'
    2012-10-22 10:51:43.580: [  CRSRES][11262]32startRunnable: setting CLI values
    2012-10-22 10:51:44.110: [  CRSRES][11777]32StopResource: setting CLI values
    2012-10-22 10:51:44.217: [  CRSRES][11777]32Attempting to stop `ora.p770db1.vip` on member `p770db2`
    2012-10-22 10:51:44.976: [  CRSRES][11777]32Stop of `ora.p770db1.vip` on member `p770db2` succeeded.
    2012-10-22 10:51:44.984: [  CRSRES][11777]32startRunnable: setting CLI values
    2012-10-22 10:51:44.984: [  CRSRES][11777]32Attempting to start `ora.p770db1.vip` on member `p770db1`
    2012-10-22 10:51:46.757: [  CRSRES][11777]32Start of `ora.p770db1.vip` on member `p770db1` succeeded.
    2012-10-22 10:51:46.988: [  CRSRES][11534]32startRunnable: setting CLI values
    2012-10-22 10:51:47.006: [  CRSRES][11534]32Attempting to start `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
    2012-10-22 10:51:47.217: [  CRSRES][12304]32CRS-1002: Resource 'ora.zjhorcl.orcl.cs' is already running on member 'p770db1'
    2012-10-22 10:51:47.763: [  CRSRES][11534]32Start of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
    2012-10-23 04:23:21.417: [  CRSAPP][11219]32CheckResource error for ora.p770db1.vip error code = 1
    2012-10-23 04:23:21.425: [  CRSRES][11219]32In stateChanged, ora.p770db1.vip target is ONLINE
    2012-10-23 04:23:21.425: [  CRSRES][11219]32ora.p770db1.vip on p770db1 went OFFLINE unexpectedly
    2012-10-23 04:23:21.425: [  CRSRES][11219]32StopResource: setting CLI values
    2012-10-23 04:23:21.435: [  CRSRES][11219]32Attempting to stop `ora.p770db1.vip` on member `p770db1`
    2012-10-23 04:23:21.876: [  CRSRES][11993]32In stateChanged, ora.zjhorcl.orcl.zjhorcl1.srv target is ONLINE
    2012-10-23 04:23:21.877: [  CRSRES][11993]32ora.zjhorcl.orcl.zjhorcl1.srv on p770db1 went OFFLINE unexpectedly
    2012-10-23 04:23:21.877: [  CRSRES][11993]32StopResource: setting CLI values
    2012-10-23 04:23:21.888: [  CRSRES][11993]32Attempting to stop `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1`
    2012-10-23 04:23:22.067: [  CRSRES][11219]32Stop of `ora.p770db1.vip` on member `p770db1` succeeded.
    2012-10-23 04:23:22.067: [  CRSRES][11219]32ora.p770db1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2012-10-23 04:23:22.074: [  CRSRES][11219]32ora.p770db1.vip failed on p770db1 relocating.
    2012-10-23 04:23:22.133: [  CRSRES][11219]32StopResource: setting CLI values
    2012-10-23 04:23:22.157: [  CRSRES][11219]32Attempting to stop `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
    2012-10-23 04:23:22.295: [  CRSRES][11993]32Stop of `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1` succeeded.
    2012-10-23 04:23:22.296: [  CRSRES][11993]32ora.zjhorcl.orcl.zjhorcl1.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2012-10-23 04:23:22.309: [  CRSRES][11993]32ora.zjhorcl.orcl.zjhorcl1.srv failed on p770db1 relocating.
    2012-10-23 04:23:22.344: [  CRSRES][11993]32Cannot relocate ora.zjhorcl.orcl.zjhorcl1.srvStopping dependents
    2012-10-23 04:23:22.388: [  CRSRES][11993]32StopResource: setting CLI values
    2012-10-23 04:24:38.655: [  CRSRES][11219]32Stop of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
    2012-10-23 04:24:38.734: [  CRSRES][11219]32Attempting to start `ora.p770db1.vip` on member `p770db2`
    2012-10-23 04:24:40.474: [  CRSRES][11219]32Start of `ora.p770db1.vip` on member `p770db2` succeeded.
    2012-10-23 13:50:39.656: [  CRSRES][11257]32startRunnable: setting CLI values
    2012-10-23 13:50:40.032: [  CRSRES][11771]32StopResource: setting CLI values
    2012-10-23 13:50:40.042: [  CRSRES][11771]32Attempting to stop `ora.p770db1.vip` on member `p770db2`
    2012-10-23 13:50:40.607: [  CRSRES][11771]32Stop of `ora.p770db1.vip` on member `p770db2` succeeded.
    2012-10-23 13:50:40.614: [  CRSRES][11771]32startRunnable: setting CLI values
    2012-10-23 13:50:40.614: [  CRSRES][11771]32Attempting to start `ora.p770db1.vip` on member `p770db1`
    2012-10-23 13:50:42.336: [  CRSRES][11771]32Start of `ora.p770db1.vip` on member `p770db1` succeeded.
    2012-10-23 13:50:42.508: [  CRSRES][11776]32startRunnable: setting CLI values
    2012-10-23 13:50:42.517: [  CRSRES][11776]32Attempting to start `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
    2012-10-23 13:50:43.251: [  CRSRES][12298]32CRS-1002: Resource 'ora.zjhorcl.orcl.cs' is already running on member 'p770db1'
    2012-10-23 13:50:43.517: [  CRSRES][11776]32Start of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
    $
    $ more ora.p770db1.vip.log
    Oracle Database 10g CRS Release 10.2.0.4.0 Production Copyright 1996, 2008 Oracle. All rights reserved.
    2012-08-23 15:07:17.902: [    RACG][1] [15466872][1][ora.p770db1.vip]:
    entstat: 0909-004 Unable to get statistics on device en0, errno = 69
    Invalid parameters, or failed to bring up VIP (host=p770db1)
    2012-08-23 15:07:17.903: [    RACG][1] [15466872][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db
    _1
    2012-08-23 15:07:17.903: [    RACG][1] [15466872][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
    USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
    2012-08-23 15:07:17.903: [    RACG][1] [15466872][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 0.509s
    2012-08-23 15:07:17.903: [    RACG][1] [15466872][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status =
    1, time = 0.685s
    2012-09-23 10:43:34.433: [    RACG][1] [6815926][1][ora.p770db1.vip]: Invalid parameters, or failed to bring up VIP (host=p770db1)
    2012-09-23 10:43:34.442: [    RACG][1] [6815926][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db_
    1
    2012-09-23 10:43:34.442: [    RACG][1] [6815926][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
    USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
    2012-09-23 10:43:34.442: [    RACG][1] [6815926][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 4.682s
    2012-09-23 10:43:34.442: [    RACG][1] [6815926][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status = 1
    , time = 5.068s
    2012-10-12 15:34:14.222: [    RACG][1] [18809030][1][ora.p770db1.vip]:
    entstat: 0909-004 Unable to get statistics on device en0, errno = 69
    Invalid parameters, or failed to bring up VIP (host=p770db1)
    2012-10-12 15:34:14.222: [    RACG][1] [18809030][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db
    _1
    2012-10-12 15:34:14.222: [    RACG][1] [18809030][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
    USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
    2012-10-12 15:34:14.222: [    RACG][1] [18809030][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 0.564s
    2012-10-12 15:34:14.222: [    RACG][1] [18809030][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status =
    1, time = 0.712s
    2012-10-21 10:29:19.043: [    RACG][1] [18546790][1][ora.p770db1.vip]:
    entstat: 0909-004 Unable to get statistics on device en0, errno = 69
    Invalid parameters, or failed to bring up VIP (host=p770db1)
    2012-10-21 10:29:19.043: [    RACG][1] [18546790][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db
    _1
    2012-10-21 10:29:19.043: [    RACG][1] [18546790][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
    USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
    2012-10-21 10:29:19.043: [    RACG][1] [18546790][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 0.541s
    2012-10-21 10:29:19.044: [    RACG][1] [18546790][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status =
    1, time = 0.716s
    2012-10-23 04:23:21.410: [    RACG][1] [18415718][1][ora.p770db1.vip]:
    entstat: 0909-004 Unable to get statistics on device en0, errno = 69
    Invalid parameters, or failed to bring up VIP (host=p770db1)
    2012-10-23 04:23:21.410: [    RACG][1] [18415718][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db
    _1
    2012-10-23 04:23:21.410: [    RACG][1] [18415718][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
    USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
    2012-10-23 04:23:21.410: [    RACG][1] [18415718][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 0.595s
    2012-10-23 04:23:21.410: [    RACG][1] [18415718][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status =
    1, time = 0.751s
    ===================================================================================================
    2012-09-26 07:45:11.000: [  CRSEVT][11666]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-09-26 07:45:11.000: [  CRSEVT][11666]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-09-26 07:45:11.000: [  CRSAPP][11666]32CheckResource error for ora.p770db2.vip error code = -2
    2012-09-26 07:46:44.036: [  CRSEVT][11668]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-09-26 07:46:44.036: [  CRSEVT][11668]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-09-26 07:46:44.036: [  CRSAPP][11668]32CheckResource error for ora.p770db2.vip error code = -2
    2012-09-26 07:48:17.067: [  CRSEVT][11670]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-09-26 07:48:17.067: [  CRSEVT][11670]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-09-26 07:48:17.067: [  CRSAPP][11670]32CheckResource error for ora.p770db2.vip error code = -2
    2012-09-26 21:27:23.866: [  CRSEVT][11581]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-09-26 21:27:23.866: [  CRSEVT][11581]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-09-26 21:27:23.866: [  CRSAPP][11581]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-03 23:26:47.076: [  CRSEVT][11737]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-03 23:26:47.076: [  CRSEVT][11737]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-03 23:26:47.076: [  CRSAPP][11737]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-03 23:28:20.116: [  CRSEVT][11739]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-03 23:28:20.116: [  CRSEVT][11739]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-03 23:28:20.116: [  CRSAPP][11739]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-03 23:29:53.146: [  CRSEVT][11743]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-03 23:29:53.146: [  CRSEVT][11743]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-03 23:29:53.146: [  CRSAPP][11743]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-03 23:31:26.182: [  CRSEVT][11745]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-03 23:31:26.182: [  CRSEVT][11745]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-03 23:31:26.182: [  CRSAPP][11745]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-03 23:32:59.221: [  CRSEVT][11748]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-03 23:32:59.222: [  CRSEVT][11748]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-03 23:32:59.222: [  CRSAPP][11748]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-03 23:34:32.255: [  CRSEVT][11751]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-03 23:34:32.255: [  CRSEVT][11751]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-03 23:34:32.255: [  CRSAPP][11751]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-06 06:07:13.137: [  CRSEVT][11639]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-06 06:07:13.137: [  CRSEVT][11639]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-06 06:07:13.138: [  CRSAPP][11639]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-06 06:08:46.175: [  CRSEVT][11641]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-06 06:08:46.175: [  CRSEVT][11641]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-06 06:08:46.176: [  CRSAPP][11641]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-06 06:10:19.207: [  CRSEVT][11644]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-06 06:10:19.207: [  CRSEVT][11644]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-06 06:10:19.207: [  CRSAPP][11644]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-06 06:11:52.236: [  CRSEVT][11648]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-06 06:11:52.236: [  CRSEVT][11648]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-06 06:11:52.236: [  CRSAPP][11648]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-06 06:13:25.268: [  CRSEVT][11652]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-06 06:13:25.269: [  CRSEVT][11652]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-06 06:13:25.269: [  CRSAPP][11652]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-06 06:14:58.307: [  CRSEVT][11654]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
    category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
    2012-10-06 06:14:58.307: [  CRSEVT][11654]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
    ed out for ora.p770db2.vip! (timeout=60)
    2012-10-06 06:14:58.307: [  CRSAPP][11654]32CheckResource error for ora.p770db2.vip error code = -2
    2012-10-11 06:55:01.756: [  CRSAPP][11628]32CheckResource error for ora.p770db2.vip error code = 1
    2012-10-11 06:55:01.761: [  CRSRES][11628]32In stateChanged, ora.p770db2.vip target is ONLINE
    2012-10-11 06:55:01.761: [  CRSRES][11628]32ora.p770db2.vip on p770db2 went OFFLINE unexpectedly
    2012-10-11 06:55:01.761: [  CRSRES][11628]32StopResource: setting CLI values
    2012-10-11 06:55:01.765: [  CRSRES][11628]32Attempting to stop `ora.p770db2.vip` on member `p770db2`
    2012-10-11 06:55:02.390: [  CRSRES][11889]32In stateChanged, ora.zjhorcl.orcl.zjhorcl2.srv target is ONLINE
    2012-10-11 06:55:02.390: [  CRSRES][11889]32ora.zjhorcl.orcl.zjhorcl2.srv on p770db2 went OFFLINE unexpectedly
    2012-10-11 06:55:02.391: [  CRSRES][11889]32StopResource: setting CLI values
    2012-10-11 06:55:02.416: [  CRSRES][11889]32Attempting to stop `ora.zjhorcl.orcl.zjhorcl2.srv` on member `p770db2`
    2012-10-11 06:55:02.532: [  CRSRES][11628]32Stop of `ora.p770db2.vip` on member `p770db2` succeeded.
    2012-10-11 06:55:02.543: [  CRSRES][11628]32ora.p770db2.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2012-10-11 06:55:02.605: [  CRSRES][11628]32ora.p770db2.vip failed on p770db2 relocating.
    2012-10-11 06:55:02.680: [  CRSRES][11628]32StopResource: setting CLI values
    2012-10-11 06:55:02.684: [  CRSRES][11628]32Attempting to stop `ora.p770db2.LISTENER_P770DB2.lsnr` on member `p770db2`
    2012-10-11 06:55:03.613: [  CRSRES][11889]32Stop of `ora.zjhorcl.orcl.zjhorcl2.srv` on member `p770db2` succeeded.
    2012-10-11 06:55:03.614: [  CRSRES][11889]32ora.zjhorcl.orcl.zjhorcl2.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
    2012-10-11 06:55:03.658: [  CRSRES][11889]32ora.zjhorcl.orcl.zjhorcl2.srv failed on p770db2 relocating.
    2012-10-11 06:55:03.684: [  CRSRES][11889]32Cannot relocate ora.zjhorcl.orcl.zjhorcl2.srvStopping dependents
    2012-10-11 06:55:03.698: [  CRSRES][11889]32StopResource: setting CLI values
    2012-10-11 06:56:19.120: [  CRSRES][11628]32Stop of `ora.p770db2.LISTENER_P770DB2.lsnr` on member `p770db2` succeeded.
    2012-10-11 06:56:19.160: [  CRSRES][11628]32Attempting to start `ora.p770db2.vip` on member `p770db1`
    2012-10-11 06:56:20.894: [  CRSRES][11628]32Start of `ora.p770db2.vip` on member `p770db1` succeeded.
    2012-10-12 13:47:25.650: [  CRSRES][11649]32startRunnable: setting CLI values
    2012-10-12 13:47:26.054: [  CRSRES][11907]32StopResource: setting CLI values
    2012-10-12 13:47:26.068: [  CRSRES][11907]32Attempting to stop `ora.p770db2.vip` on member `p770db1`
    2012-10-12 13:47:26.508: [  CRSRES][11907]32Stop of `ora.p770db2.vip` on member `p770db1` succeeded.
    2012

    vip日志中显示：
    2012-08-23 15:07:17.902: [ RACG][1] [15466872][1][ora.p770db1.vip]:
    entstat: 0909-004 Unable to get statistics on device en0, errno = 69
    Invalid parameters, or failed to bring up VIP (host=p770db1)
    这网卡是否有问题，还有防火墙是否做过切换端口等操作？
    是aix的系统吗？http://www-01.ibm.com/support/docview.wss?uid=isg1IV22840 找到个描述你看看符合不
    Edited by: 小电工II on 2012-10-24 下午11:54

  • RAC -process failover at node crash

    Hi,
    how to prevent running process(transaction) from termination in RAC while a node crashes ..
    Ex: if there is a process running on node 1 and if it suddenly crashes in RAC how does we make node2 or node3 to pick it up and process or start the transaction again??
    Thanks,

    Hello,
    Look at your tnsnames.ora entry and see if it configured to benefit from FAILOVER, you can aslo explore other available options options
    http://stanford.edu/dept/itss/docs/oracle/10g/network.101/b10776/tnsnames.htm
    myservice=
    (DESCRIPTION=
       (SOURCE_ROUTE=yes)
       (ADDRESS=(PROTOCOL=tcp)(HOST=host1)(PORT=1630))    # <-- hop 1
       (ADDRESS_LIST= 
         (FAILOVER=on)
         (LOAD_BALANCE=off)                                #  <--- hop 2
         (ADDRESS=(PROTOCOL=tcp)(HOST=host2a)(PORT=1532))
         (ADDRESS=(PROTOCOL=tcp)(HOST=host2b)(PORT=1521)))
       (ADDRESS=(PROTOCOL=tcp)(HOST=host3)(PORT=1521))    #  <--  hop 3
       (CONNECT_DATA=(SERVICE_NAME=myservice)))Another Example
    MYSERVICE =
      (DESCRIPTION = 
      (ADDRESS_LIST= 
         (FAILOVER = on)
         (LOAD_BALANCE = on) 
         (ADDRESS= (PROTOCOL = TCP)(HOST = server1)(PORT = 1521))
         (ADDRESS= (PROTOCOL = TCP)(HOST = server2)(PORT = 1521))
         (ADDRESS= (PROTOCOL = TCP)(HOST = server3)(PORT = 1521))
      (CONNECT_DATA=
         (SERVICE_NAME =MYSERVICE)
         (FAILOVER_MODE = 
             (BACKUP=server2)
             (TYPE=select)
             (METHOD=preconnect)
             (RETRIES=20)
             (DELAY=3)
    ) Regards
    OrionNet
    Edited by: OrionNet on Dec 18, 2008 3:12 PM

  • Rac loadbalancing/failover - services

    I have seen some DBA’s creating 2 services for every rac database for example in a 2 node rac they would have.
    Svcprd1 prefered node: node 1 available node:node2
    Svcprd2 prefered node: node2 available node:node1
    What’s the difference between above and having one service with both nodes as preferred nodes?
    Does the first method provide better HA ? or extra flexibility ?

    I'm not sure what the two services are used for, but if one is for oltp and the other is for batch, then the services separate the two activities so they don't consume resources ram/cpu on the same none. The alternate node serves as a failover if the primary node goes down.

  • Paging grid using query attribute instead

    is it possible to have the look and feel of a binded grid but
    for a queried grid instead... in another words,
    to display <cfgrid name="grid" query="query"...> just
    like <cfgrid name="grid" bind="cfc:bind({xxx}...)"
    ...>

    Hi steven,
    Are these examples in chap.5 & 6 of Building Oracle XML Applications contain code for Generating Database column as Attribute ?
    I have tried using xsu 2.0.1 beta and '@dbColumn' Technique, to convert my Database column in Attribute of 'ROW' Element Generated by OracleXMLQuery object,but it is still Giving me null pointer Exception while I USE XMLDOM TO convert into HTML using Method
    ProcessXSL(XSLStylesheet,XMLDocument,response.getWriter()).
    Regards,
    chirag oza
    null

  • Question about 11gR2 Grid, RAC, /dev/shm and Automatic Memory Management

    Hello,
    i've recently installed grid and rdbms software 11.2.0.2 on a two node Oracle Linux cluster with 128gb ram each node.
    I'm using ASM to store data and ocr and I'm testing Automatic Memory Management.
    When I finished Grid+RDBMS installation I've seen that /dev/shm size is 64gb (half of my total RAM).
    I've created a database with dbca and when I was asked to choose if I wanted to use AMM I've noticed that I could
    allocate only about 60gb for Oracle. If I chose more than 90gb I got an error saying:
    Using Automatic Memory Management requires 60gb available in my two nodes.
    The current available space in the two nodes is only 30gb and 30gb.
    If you want to use AMM you should either free up some space in /dev/shm
    or reduce the memory allocated to Oracle
    I was wondering when (during the installation or the settings of kernel parameters) did I define the space of /dev/shm ?
    Since I have 128gb of RAM wouldn't it be better to use more than 64gb of ram for my /dev/shm tmpfs partition ?
    Is there a limit or a ratio for best practice for my RAM and the /dev/shm ?
    thanks in advance.

    user9051299 wrote:
    Is the "half of the RAM size" a kernel's default value or Oracle's ? Neither. There are a number of unique factors that determine the best memory size and fit for Oracle - including just how much memory is effectively available (i.e. how much is needed for other services and processes).
    And from what I understand i don't "break" any Oracle's best practice by increasing the /dev/shm right ?Correct. (at least none that I'm aware of, and none that I have read in Oracle's RAC Starter Kit documentation).

  • 10g Grid (RAC) on Linux with ASM and OCR?

    I was trying to install 10g on Linux with ASM. The docs are not terribly clear on this, but I'd like to have the Oracle Cluster Registry (OCR) on one of my four ASM disks, rather than dedicate space to OCFS. I have 4 18.2 GB drives setup with ASM now. Is there a way to do this?
    I guess the other thing I could do is to cut the ASM disks into two partitions. One, say 200MB and the other the rest. I'd put OCFS for OCR on the 200MB partition on one of the disks. The large partition on each of the rest of the disks would be dedicated to ASM.
    What am I missing? I feel it must be something obvious. I'd rather have the OCR on the ASM, so that I don't have to deal with it...
    Thanks!
    Jeff

    Hi.
    There shouldn't be a problem with this provided you use a 32-bit OS on the 64 bit machine. RAC doesn't care about the chipset, so long as the same OS is used, but I don't thinkit will support one node on 32 bit and one on 64 bit, since they are actually separate distributions.
    Of course, I've never tried it so I can't be sure :)
    Cheers
    Tim...

  • How to connect to RAC with failover enabled?

    I want to use instant client to connect to a RAC database. How can I accomplish that without tnsnames.ora file?

    Not sure about RAC specifically. But you can always connect to an Oracle instance/listener without tnsname.ora, simply use the connection string which is the part to the right of "=" in each tnsname.ora entry.

  • Websphere 6.1 error messages during RAC service failover

    Team,
    We have a 11.2.0.3 CRS and database. Application is using websphere 6.1. We have performed below...
    1. Apps running on node 1
    2. Force moved the services from node 1 to ndoe 2
    3. At this time we dont see the apps session on node 2
    4. Data source connection also tested fine from the apps server. We can see many apps connections on node 2
    4. BUt apps login page is not coming up. " Website not available"
    Error messages :
    [5/15/12 17:10:42:030 CDT] 00000036 ConnectionEve A J2CA0056I: The Connection Manager received a fatal connection error from the Resource Adapter for resource jdbc/IFDataSource. The exception which was received is com.ibm.websphere.ce.cm.StaleConnectionException: No more data to read from socket:java.sql.SQLException: No more data to read from socket
    [5/15/12 17:10:42:052 CDT] 00000036 WebApp E [Servlet Error]-[springapp]: org.springframework.orm.jpa.JpaSystemException: org.hibernate.exception.JDBCConnectionException: could not execute query; nested exception is javax.persistence.PersistenceException: org.hibernate.exception.JDBCConnectionException: could not execute query
    Caused by: javax.persistence.PersistenceException: org.hibernate.exception.JDBCConnectionException: could not execute query
    Seached in the forums, but could not able to find a good match with this issue.
    Please advise..
    Thanks & Regards,
    Rakesh

    Oracleappsdba wrote:
    Team,
    We have a 11.2.0.3 CRS and database. Application is using websphere 6.1. We have performed below...
    1. Apps running on node 1
    2. Force moved the services from node 1 to ndoe 2
    3. At this time we dont see the apps session on node 2
    4. Data source connection also tested fine from the apps server. We can see many apps connections on node 2
    4. BUt apps login page is not coming up. " Website not available"
    Error messages :
    [5/15/12 17:10:42:030 CDT] 00000036 ConnectionEve A J2CA0056I: The Connection Manager received a fatal connection error from the Resource Adapter for resource jdbc/IFDataSource. The exception which was received is com.ibm.websphere.ce.cm.StaleConnectionException: No more data to read from socket:java.sql.SQLException: No more data to read from socket
    [5/15/12 17:10:42:052 CDT] 00000036 WebApp E [Servlet Error]-[springapp]: org.springframework.orm.jpa.JpaSystemException: org.hibernate.exception.JDBCConnectionException: could not execute query; nested exception is javax.persistence.PersistenceException: org.hibernate.exception.JDBCConnectionException: could not execute query
    Caused by: javax.persistence.PersistenceException: org.hibernate.exception.JDBCConnectionException: could not execute query
    Seached in the forums, but could not able to find a good match with this issue.
    Please advise..
    Thanks & Regards,
    Rakeshposted messages do not originate from Oracle RDBMS

Maybe you are looking for

  • Automatic ROW Processing error after changing Schema

    Hello all, I have an APEX 3.0 application referencing tables on a different schema from the parsing schema. Workspace A -> using parsing schema A1 Application A -> installed in Workspace A Application A -> access tables in schema A2 from schema A1, t

  • *****output File format

    Hi all, Instead of Time stamp in the out put file ,we require the out put file format as xyz_a.txt,xyz_b.txt....... eg:file name sample.txt out put required is sample_a,sample_b,sample_c...... is it possible in Xi? Thanks, Srinivasa

  • [BO XI 3.0] view document instances count is wrong

    If a user does not have the "View document instances" right and there are schedules set up for a particular report to go to other users then the count showing in InfoView is not zero, it counts all the recurring and successful instances even though t

  • Where's the Digital Booklet for Sweeney Todd soundtrack?

    I bought the Sweeney Todd soundtrack from the Tim Burton movie, and didn't receive the Digital Booklet promised. What happened? Why didn't I receive it? How can I get it without buying the album again?

  • How can I remove the values of two MessageTextInputFields?

    Hi all, I have two MessageTextInput fields in which user have to enter two unique values. With CO extension I have thrown a message "This code combination is already used" after some validation checks which is working fine. My issue is -- if user ent