Ora db vip
Hi,
Plz go through it.....
C:\>crs_stat -t
Name Type Target State Host
ora....B1.inst application ONLINE OFFLINE
ora....B2.inst application ONLINE ONLINE dhndb2
ora....DB1.srv application ONLINE OFFLINE
ora....DB2.srv application ONLINE ONLINE dhndb2
ora...._SVC.cs application ONLINE ONLINE dhndb2
ora.DHNDB.db application ONLINE ONLINE dhndb2
ora....SM1.asm application ONLINE OFFLINE
ora....B1.lsnr application ONLINE OFFLINE
ora.dhndb1.gsd application ONLINE ONLINE dhndb1
ora.dhndb1.ons application ONLINE ONLINE dhndb1
ora.dhndb1.vip application ONLINE UNKNOWN dhndb2
ora....SM2.asm application ONLINE ONLINE dhndb2
ora....B2.lsnr application ONLINE ONLINE dhndb2
ora.dhndb2.gsd application ONLINE ONLINE dhndb2
ora.dhndb2.ons application ONLINE ONLINE dhndb2
ora.dhndb2.vip application ONLINE ONLINE dhndb2
C:\>crs_start -all
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.dhndb1.vip'
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.dhndb1.vip'
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.dhndb1.vip'
Attempting to start `ora.DHNDB.DHNDB_SVC.DHNDB1.srv` on member `dhndb1`
Start of `ora.DHNDB.DHNDB_SVC.DHNDB1.srv` on member `dhndb1` failed.
dhndb2 : CRS-1019: Resource ora.DHNDB.DHNDB_SVC.DHNDB1.srv (application) cannot
run on dhndb2
CRS-0223: Resource 'ora.DHNDB.DHNDB1.inst' has placement error.
CRS-0215: Could not start resource 'ora.DHNDB.DHNDB_SVC.DHNDB1.srv'.
CRS-0223: Resource 'ora.dhndb1.ASM1.asm' has placement error.
CRS-0223: Resource 'ora.dhndb1.LISTENER_DHNDB1.lsnr' has placement error.
C:\>sqlplus /nolog
SQL*Plus: Release 10.2.0.1.0 - Production on Sun Sep 13 18:04:47 2009
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL> conn /as sysdba
Connected to an idle instance.
SQL> startup;
ORA-01078: failure in processing system parameters
ORA-01565: error in identifying file '+ORADATA/DHNDB/spfileDHNDB.ora'
ORA-17503: ksfdopn:2 Failed to open file +ORADATA/DHNDB/spfileDHNDB.ora
ORA-15077: could not locate ASM instance serving a required diskgroup
SQL>
Os-win server:2003/orcl-10g.
Edited by: oh#see#a on Sep 13, 2009 11:27 PM
orawarebyte wrote:
Yours diskgroup is not mounted Which is potentially a result of the cluster services (including VIP) not working.. It is usually not a good idea to start components (like ASM) manually via sqlplus. Rather do it via srvctl.
More questions to add to the list of Justin's..
.. what shared storage is used?
.. what Interconnect technology is used?
.. how are the OCR and Voting Disks defined?
In my experience, most CRS startup failures are due to either the Interconnect not working, or the Voting/OCR disks not being available.
Similar Messages
-
Could not find resource 'ora.node2.vip'
During the extention of node,I get message to run three scipts on nodes:
1 /opt/u01/app/oracle/oraInventory/orainstRoot.sh node2
2 /opt/u01/app/oracle/product/10.2.0/crs_1/install/rootaddnode.sh node3
3 /opt/u01/app/oracle/product/10.2.0/crs_1/root.sh node2
When I run the 2nd script /opt/u01/app/oracle/product/10.2.0/crs_1/install/rootaddnode.sh on node3,get the following error:
[root@node3 ~]# /opt/u01/app/oracle/product/10.2.0/crs_1/install/rootaddnode.sh
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Attempting to add 1 new nodes to the configuration
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 5: node2 node2-priv node2
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
/opt/u01/app/oracle/product/10.2.0/crs_1/bin/srvctl add nodeapps -n node2 -A node2-vip/255.255.255.0/eth0 -o /opt/u01/app/oracle/product/10.2.0/crs_1
CRS-0210: Could not find resource 'ora.node2.vip'.
Any idea?Have you run cluvfy before the node addition?
The VIP should be resolvable, but not pingable until added to the oracle clusterware.
Try nslookup and ping of the node2-vip and let us know the results. -
CRS-0210: Could not find resource 'ora.qlxdgalc001.vip'.
Hi All,
I am in a situation where I was not able to add the vip. This is the scenario:
I recently deleted one of the nodes from a 4 node cluster as some of the h/w maintenance is required for node1. after the maintenance window, I am adding the node back to the cluster. When I add the node back, I am not able to register the vip of the node with the cluster. The command and the error that I am getting are as follows:
[root@qlx001 ~]# srvctl add nodeapps -n qlxdgalc001 -o $ORACLE_HOME -A qlxd001-vip.abc.com/255.255.255.128/bond0
CRS-0210: Could not find resource 'ora.qlxd001.vip'.
Your suggestions are highly appreciated.
Thanks,
Sai.Any replies are highly appreciated.
-
VIP Failed:CheckResource error for ora.nrac1.vip error code = 1
Hi all, the VIP on node1 Fail-over to node2 and the VIP log like this:
CRSAPP][191] CheckResource error for ora.nrac1.vip error code = 1
CRSRES][191] In stateChanged, ora.nrac1.vip target is ONLINE
CRSRES][191] ora.nrac1.vip on nrac1 went OFFLINE unexpectedly
CRSRES][191] StopResource: setting CLI values
CRSRES][191] Attempting to stop `ora.nrac1.vip` on member `nrac1`
CRSRES][191] Stop of `ora.nrac1.vip` on member `nrac1` succeeded.
CRSRES][191] ora.nrac1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
CRSRES][191] ora.nrac1.vip failed on nrac1 relocating.
CRSRES][191] Attempting to start `ora.nrac1.vip` on member `nrac2`
CRSRES][191] Start of `ora.nrac1.vip` on member `nrac2` succeeded.
and how to fix it? the ce0 seems work right.1.use crt_stat -v find OFFLINE name
2.use crs_start name -
Root.sh fails on 11.2.0.3 clusterware while starting 'ora.asm' resource
Dear all,
I am trying to install clean Oracle 11.2.0.3 grid infrastructure on a two node cluster running on Solaris 5.10.
- Cluster verification was successfully on both nodes; No warning or issues;
- I am using 2 network cards for the public and 2 for the private interconnect;
- OCR is stored on ASM
- Firewall is disabled on both nodes
- SCAN is being configured on the DNS (not added in /etc/hosts)
- GNS is not used
- hosts file is identical (except the primary hostname)
The problem: root.sh fails on the 2nd (remote) node, because it fails to start the "ora.asm" resource. However, the root.sh has completed successfully on the 1st node.. Somehow, root.sh doesn't create +ASM2 instance on the remote (host2) node.
root.sh was executed first on the local node (host1) and after the successful execution was started on the remote (host2) node.
Output from host1 (working):
===================
Adding Clusterware entries to inittab
CRS-2672: Attempting to start 'ora.mdnsd' on 'host1'
CRS-2676: Start of 'ora.mdnsd' on 'host1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'host1'
CRS-2676: Start of 'ora.gpnpd' on 'host1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'host1'
CRS-2672: Attempting to start 'ora.gipcd' on 'host1'
CRS-2676: Start of 'ora.cssdmonitor' on 'host1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'host1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'host1'
CRS-2672: Attempting to start 'ora.diskmon' on 'host1'
CRS-2676: Start of 'ora.diskmon' on 'host1' succeeded
CRS-2676: Start of 'ora.cssd' on 'host1' succeeded
ASM created and started successfully.
Disk Group CRS created successfully.
clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-4256: Updating the profile
Successful addition of voting disk 4373be34efab4f01bf79f6c5362acfd3.
Successful addition of voting disk 7fd725fa4d904f07bf76cecf96791547.
Successful addition of voting disk a9c85297bdd74f3abfd86899205aaf17.
Successfully replaced voting disk group with +CRS.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
1. ONLINE 4373be34efab4f01bf79f6c5362acfd3 (/dev/rdsk/c4t600A0B80006E2CC40000C6674E82AA57d0s4) [CRS]
2. ONLINE 7fd725fa4d904f07bf76cecf96791547 (/dev/rdsk/c4t600A0B80006E2CC40000C6694E82AADDd0s4) [CRS]
3. ONLINE a9c85297bdd74f3abfd86899205aaf17 (/dev/rdsk/c4t600A0B80006E2F100000C7744E82AC7Ad0s4) [CRS]
Located 3 voting disk(s).
CRS-2672: Attempting to start 'ora.asm' on 'host1'
CRS-2676: Start of 'ora.asm' on 'host1' succeeded
CRS-2672: Attempting to start 'ora.CRS.dg' on 'host1'
CRS-2676: Start of 'ora.CRS.dg' on 'host1' succeeded
CRS-2672: Attempting to start 'ora.registry.acfs' on 'host1'
CRS-2676: Start of 'ora.registry.acfs' on 'host1' succeeded
Configure Oracle Grid Infrastructure for a Cluster ... succeeded
Name Type Target State Host
ora.CRS.dg ora....up.type ONLINE ONLINE host1
ora....ER.lsnr ora....er.type ONLINE ONLINE host1
ora....N1.lsnr ora....er.type ONLINE ONLINE host1
ora....N2.lsnr ora....er.type ONLINE ONLINE host1
ora....N3.lsnr ora....er.type ONLINE ONLINE host1
ora.asm ora.asm.type ONLINE ONLINE host1
ora....SM1.asm application ONLINE ONLINE host1
ora....B1.lsnr application ONLINE ONLINE host1
ora....db1.gsd application OFFLINE OFFLINE
ora....db1.ons application ONLINE ONLINE host1
ora....db1.vip ora....t1.type ONLINE ONLINE host1
ora.cvu ora.cvu.type ONLINE ONLINE host1
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE host1
ora.oc4j ora.oc4j.type ONLINE ONLINE host1
ora.ons ora.ons.type ONLINE ONLINE host1
ora....ry.acfs ora....fs.type ONLINE ONLINE host1
ora.scan1.vip ora....ip.type ONLINE ONLINE host1
ora.scan2.vip ora....ip.type ONLINE ONLINE host1
ora.scan3.vip ora....ip.type ONLINE ONLINE host1
Output from host2 (failing):
===================
OLR initialization - successful
Adding Clusterware entries to inittab
CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node billdb1, number 1, and is terminating
An active cluster was found during exclusive startup, restarting to join the cluster
Start of resource "ora.asm" failed
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'host2'
CRS-2676: Start of 'ora.drivers.acfs' on 'host2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'host2'
CRS-5017: The resource action "ora.asm start" encountered the following error:
ORA-03113: end-of-file on communication channel
Process ID: 0
Session ID: 0 Serial number: 0
*. For details refer to "(:CLSN00107:)" in "/u01/11.2.0/grid/log/host2/agent/ohasd/oraagent_grid/oraagent_grid.log".*
CRS-2674: Start of 'ora.asm' on 'host2' failed
CRS-2679: Attempting to clean 'ora.asm' on 'host2'
CRS-2681: Clean of 'ora.asm' on 'host2' succeeded
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'host2'
CRS-2677: Stop of 'ora.drivers.acfs' on 'host2' succeeded
CRS-4000: Command Start failed, or completed with errors.
Failed to start Oracle Grid Infrastructure stack
Failed to start ASM at /u01/11.2.0/grid/crs/install/crsconfig_lib.pm line 1272.
/u01/11.2.0/grid/perl/bin/perl -I/u01/11.2.0/grid/perl/lib -I/u01/11.2.0/grid/crs/install /u01/11.2.0/grid/crs/install/rootcrs.pl execution failed
Contents of "/u01/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_host2.log"
=============================================
CRS-2672: Attempting to start 'ora.asm' on 'host2'
CRS-5017: The resource action "ora.asm start" encountered the following error:
ORA-03113: end-of-file on communication channel
Process ID: 0
Session ID: 0 Serial number: 0
. For details refer to "(:CLSN00107:)" in "/u01/11.2.0/grid/log/host2/agent/ohasd/oraagent_grid/oraagent_grid.log".
CRS-2674: Start of 'ora.asm' on 'host2' failed
CRS-2679: Attempting to clean 'ora.asm' on 'host2'
CRS-2681: Clean of 'ora.asm' on 'host2' succeeded
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'host2'
CRS-2677: Stop of 'ora.drivers.acfs' on 'host2' succeeded
CRS-4000: Command Start failed, or completed with errors.
2011-10-24 19:36:54: Failed to start Oracle Grid Infrastructure stack
2011-10-24 19:36:54: ###### Begin DIE Stack Trace ######
2011-10-24 19:36:54: Package File Line Calling
2011-10-24 19:36:54: --------------- -------------------- ---- ----------
2011-10-24 19:36:54: 1: main rootcrs.pl 375 crsconfig_lib::dietrap
2011-10-24 19:36:54: 2: crsconfig_lib crsconfig_lib.pm 1272 main::__ANON__
2011-10-24 19:36:54: 3: crsconfig_lib crsconfig_lib.pm 1171 crsconfig_lib::start_cluster
2011-10-24 19:36:54: 4: main rootcrs.pl 803 crsconfig_lib::perform_start_cluster
2011-10-24 19:36:54: ####### End DIE Stack Trace #######
Shortened output from "/u01/11.2.0/grid/log/host2/agent/ohasd/oraagent_grid/oraagent_grid.log"
2011-10-24 19:35:48.726: [ora.asm][9] {0:0:224} [start] clean {
2011-10-24 19:35:48.726: [ora.asm][9] {0:0:224} [start] InstAgent::stop_option stop mode immediate option 1
2011-10-24 19:35:48.726: [ora.asm][9] {0:0:224} [start] InstAgent::stop {
2011-10-24 19:35:48.727: [ora.asm][9] {0:0:224} [start] InstAgent::stop original reason system do shutdown abort
2011-10-24 19:35:48.727: [ora.asm][9] {0:0:224} [start] ConnectionPool::resetConnection s_statusOfConnectionMap 00ab1948
2011-10-24 19:35:48.727: [ora.asm][9] {0:0:224} [start] ConnectionPool::resetConnection sid +ASM2 status 2
2011-10-24 19:35:48.728: [ora.asm][9] {0:0:224} [start] Gimh::check OH /u01/11.2.0/grid SID +ASM2
2011-10-24 19:35:48.728: [ora.asm][9] {0:0:224} [start] Gimh::check condition changes to (GIMH_NEXT_NUM) 0,1,7 exists
2011-10-24 19:35:48.729: [ora.asm][9] {0:0:224} [start] (:CLSN00006:)AsmAgent::check failed gimh state 0
2011-10-24 19:35:48.729: [ora.asm][9] {0:0:224} [start] AsmAgent::check ocrCheck 1 m_OcrOnline 0 m_OcrTimer 0
2011-10-24 19:35:48.729: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet { entry
2011-10-24 19:35:48.730: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet procr_get_conf: retval [0] configured [1] local only [0] error buffer []
2011-10-24 19:35:48.730: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet procr_get_conf: OCR loc [0], Disk Group : [+CRS]
2011-10-24 19:35:48.730: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet m_ocrDgpSet 015fba90 dgName CRS
2011-10-24 19:35:48.731: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet ocrret 0 found 1
2011-10-24 19:35:48.731: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet ocrDgpSet CRS
2011-10-24 19:35:48.731: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet exit }
2011-10-24 19:35:48.731: [ora.asm][9] {0:0:224} [start] DgpAgent::ocrDgCheck Entry {
2011-10-24 19:35:48.732: [ora.asm][9] {0:0:224} [start] DgpAgent::getConnxn new pool
2011-10-24 19:35:48.732: [ora.asm][9] {0:0:224} [start] DgpAgent::getConnxn new pool m_oracleHome:/u01/11.2.0/grid m_oracleSid:+ASM2 m_usrOraEnv:
2011-10-24 19:35:48.732: [ora.asm][9] {0:0:224} [start] ConnectionPool::ConnectionPool 2 m_oracleHome:/u01/11.2.0/grid, m_oracleSid:+ASM2, m_usrOraEnv:
2011-10-24 19:35:48.733: [ora.asm][9] {0:0:224} [start] ConnectionPool::addConnection m_oracleHome:/u01/11.2.0/grid m_oracleSid:+ASM2 m_usrOraEnv: pConnxn:
01fcdf10
2011-10-24 19:35:48.733: [ora.asm][9] {0:0:224} [start] Utils::getCrsHome crsHome /u01/11.2.0/grid
2011-10-24 19:35:51.969: [ora.asm][14] {0:0:224} [check] makeConnectStr = (DESCRIPTION=(ADDRESS=(PROTOCOL=beq)(PROGRAM=/u01/11.2.0/grid/bin/oracle)(ARGV0=o
racle+ASM2)(ENVS='ORACLE_HOME=/u01/11.2.0/grid,ORACLE_SID=+ASM2')(ARGS='(DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))'))(CONNECT_DATA=(SID=+ASM2)))
2011-10-24 19:35:51.971: [ora.asm][14] {0:0:224} [check] ConnectionPool::getConnection 260 pConnxn 013e40a0
2011-10-24 19:35:51.971: [ora.asm][14] {0:0:224} [check] DgpAgent::getConnxn connected
2011-10-24 19:35:51.971: [ora.asm][14] {0:0:224} [check] InstConnection::connectInt: server not attached
2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] ORA-01034: ORACLE not available
ORA-27101: shared memory realm does not exist
SVR4 Error: 2: No such file or directory
Process ID: 0
Session ID: 0 Serial number: 0
2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] InstConnection::connectInt (2) Exception OCIException
2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] InstConnection:connect:excp OCIException OCI error 1034
2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] DgpAgent::queryDgStatus excp ORA-01034: ORACLE not available
ORA-27101: shared memory realm does not exist
SVR4 Error: 2: No such file or directory
Process ID: 0
Session ID: 0 Serial number: 0
2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] DgpAgent::queryDgStatus asm inst is down or going down
2011-10-24 19:35:52.191: [ora.asm][14] {0:0:224} [check] DgpAgent::queryDgStatus dgName CRS ret 1
2011-10-24 19:35:52.191: [ora.asm][14] {0:0:224} [check] (:CLSN00100:)DgpAgent::ocrDgCheck OCR dgName CRS state 1
2011-10-24 19:35:52.192: [ora.asm][14] {0:0:224} [check] ConnectionPool::releaseConnection InstConnection 013e40a0
2011-10-24 19:35:52.192: [ora.asm][14] {0:0:224} [check] AsmAgent::check ocrCheck 2 m_OcrOnline 0 m_OcrTimer 0
2011-10-24 19:35:52.193: [ora.asm][14] {0:0:224} [check] CrsCmd::ClscrsCmdData::stat entity 1 statflag 32 useFilter 0
2011-10-24 19:35:52.197: [ COMMCRS][23]clsc_connect: (1020d39d0) no listener at (ADDRESS=(PROTOCOL=IPC)(KEY=CRSD_UI_SOCKET))
Please advice for any workaround or a metalink note.
Thanks in advance!Thanks for the fast reply!
- Yes, the shared storage is accessible.
- The alert log for the +ASM2 clearly shows that ASM instance has started normally using default parameters and at one point PMON process dumped.
- The system logs just shows that there is an error executing "crswrapexece.pl"
System Log
===================
*Oct 24 19:25:03 host2 root: [ID 702911 user.error] exec /u01/11.2.0/grid/perl/bin/perl -I/u01/11.2.0/grid/perl/lib /u01/11.2.0/grid/bin/crswrapexece.pl /*
u01/11.2.0/grid/crs/install/s_crsconfig_host2_env.txt /u01/11.2.0/grid/bin/ohasd.bin "reboot"
Oct 24 19:26:33 host2 oracleoks: [ID 902884 kern.notice] [Oracle OKS] mallocing log buffer, size=10485760
Oct 24 19:26:33 host2 oracleoks: [ID 714332 kern.notice] [Oracle OKS] log buffer = 0x301780fcb50, size 10485760
Oct 24 19:26:33 host2 oracleoks: [ID 400061 kern.notice] NOTICE: [Oracle OKS] ODLM hash size 16384
Oct 24 19:26:33 host2 oracleoks: [ID 160659 kern.notice] NOTICE: OKSK-00004: Module load succeeded. Build information: (LOW DEBUG) USM_11.2.0.3.0_SOLAR
IS.SPARC64_110803.1 2011/08/11 02:38:30
Oct 24 19:26:33 host2 pseudo: [ID 129642 kern.info] pseudo-device: oracleadvm0
Oct 24 19:26:33 host2 genunix: [ID 936769 kern.info] oracleadvm0 is /pseudo/oracleadvm@0
Oct 24 19:26:33 host2 oracleoks: [ID 141287 kern.notice] NOTICE: ADVMK-00001: Module load succeeded. Build information: (LOW DEBUG) - USM_11.2.0.3.0_SOL
ARIS.SPARC64_110803.1 built on 2011/08/11 02:40:17.
Oct 24 19:26:33 host2 oracleacfs: [ID 202941 kern.notice] NOTICE: [Oracle ACFS] FCB hash size 16384
Oct 24 19:26:33 host2 oracleacfs: [ID 671725 kern.notice] NOTICE: [Oracle ACFS] buffer cache size 511MB (79884 buckets)
Oct 24 19:26:33 host2 oracleacfs: [ID 730054 kern.notice] NOTICE: [Oracle ACFS] DLM hash size 16384
Oct 24 19:26:33 host2 oracleoks: [ID 617314 kern.notice] NOTICE: ACFSK-0037: Module load succeeded. Build information: (LOW DEBUG) USM_11.2.0.3.0_SOLAR
IS.SPARC64_110803.1 2011/08/11 02:42:45
Oct 24 19:26:33 host2 pseudo: [ID 129642 kern.info] pseudo-device: oracleacfs0
Oct 24 19:26:33 host2 genunix: [ID 936769 kern.info] oracleacfs0 is /pseudo/oracleacfs@0
Oct 24 19:26:36 host2 oracleoks: [ID 621795 kern.notice] NOTICE: OKSK-00010: Persistent OKS log opened at /u01/11.2.0/grid/log/host2/acfs/acfs.log.0.
Oct 24 19:31:37 host2 last message repeated 1 time
Oct 24 19:33:05 host2 CLSD: [ID 770310 daemon.notice] The clock on host host2 has been updated by the Cluster Time Synchronization Service to be synchr
onous with the mean cluster time.
ASM alert log
====================================================================
<msg time='2011-10-24T19:35:48.776+01:00' org_id='oracle' comp_id='asm'
client_id='' type='UNKNOWN' level='16'
host_id='host2' host_addr='10.172.16.200' module=''
pid='26406'>
<txt>System state dump requested by (instance=2, osid=26396 (PMON)), summary=[abnormal instance termination].
</txt>
</msg>
<msg time='2011-10-24T19:35:48.778+01:00' org_id='oracle' comp_id='asm'
client_id='' type='UNKNOWN' level='16'
host_id='host2' host_addr='10.172.16.200' module=''
pid='26406'>
<txt>System State dumped to trace file /u01/app/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_diag_26406.trc
</txt>
</msg>
<msg time='2011-10-24T19:35:48.927+01:00' org_id='oracle' comp_id='asm'
type='UNKNOWN' level='16' host_id='host2'
host_addr='10.172.16.200' pid='26470'>
<txt>ORA-1092 : opitsk aborting process
</txt>
</msg>
<msg time='2011-10-24T19:35:49.128+01:00' org_id='oracle' comp_id='asm'
type='UNKNOWN' level='16' host_id='host2'
host_addr='10.172.16.200' pid='26472'>
<txt>ORA-1092 : opitsk aborting process
</txt>
</msg>
Output from "/u01/app/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_diag_26406.trc"
REQUEST:system state dump at level 10, requested by (instance=2, osid=26396 (PMON)), summary=[abnormal instance termination].
kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).
===================================================
SYSTEM STATE (level=10)
Orapids on dead process list: [count = 0]
PROCESS 1:
SO: 0x3df098b50, type: 2, owner: 0x0, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
proc=0x3df098b50, name=process, file=ksu.h LINE:12616 ID:, pg=0
(process) Oracle pid:1, ser:0, calls cur/top: 0x0/0x0
flags : (0x20) PSEUDO
flags2: (0x0), flags3: (0x10)
intr error: 0, call error: 0, sess error: 0, txn error 0
intr queue: empty
ksudlp FALSE at location: 0
(post info) last post received: 0 0 0
last post received-location: No post
last process to post me: none
last post sent: 0 0 0
last post sent-location: No post
last process posted by me: none
(latch info) wait_event=0 bits=0
O/S info: user: , term: , ospid: (DEAD)
OSD pid info: Unix process pid: 0, image: PSEUDO
SO: 0x38000cef0, type: 5, owner: 0x3df098b50, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
proc=0x0, name=kss parent, file=kss2.h LINE:138 ID:, pg=0
PSO child state object changes :
Dump of memory from 0x00000003DF722AC0 to 0x00000003DF722CC8
3DF722AC0 00000000 00000000 00000000 00000000 [................]
Repeat 31 times
3DF722CC0 00000000 00000000 [........]
PROCESS 2: PMON
SO: 0x3df099bf8, type: 2, owner: 0x0, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
proc=0x3df099bf8, name=process, file=ksu.h LINE:12616 ID:, pg=0
(process) Oracle pid:2, ser:1, calls cur/top: 0x3db6c8d30/0x3db6c8d30
flags : (0xe) SYSTEM
flags2: (0x0), flags3: (0x10)
intr error: 0, call error: 0, sess error: 0, txn error 0
intr queue: empty
ksudlp FALSE at location: 0
(post info) last post received: 0 0 136
last post received-location: kjm.h LINE:1228 ID:kjmdmi: pmon to attach
last process to post me: 3df0a2138 1 6
last post sent: 0 0 137
last post sent-location: kjm.h LINE:1230 ID:kjiath: pmon attached
last process posted by me: 3df0a2138 1 6
(latch info) wait_event=0 bits=0
Process Group: DEFAULT, pseudo proc: 0x3debbbf40
O/S info: user: grid, term: UNKNOWN, ospid: 26396
OSD pid info: Unix process pid: 26396, image: oracle@host2 (PMON)
SO: 0x3d8800c18, type: 30, owner: 0x3df099bf8, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
proc=0x3df099bf8, name=ges process, file=kji.h LINE:3669 ID:, pg=0
GES MSG BUFFERS: st=emp chunk=0x0 hdr=0x0 lnk=0x0 flags=0x0 inc=0
outq=0 sndq=0 opid=0 prmb=0x0
mbg=(0 0) mbg=(0 0) mbg[r]=(0 0)
fmq=(0 0) fmq=(0 0) fmq[r]=(0 0)
mop[s]=0 mop[q]=0 pendq=0 zmbq=0
nonksxp_recvs=0
------------process 3d8800c18--------------------
proc version : 0
Local inst : 2
pid : 26396
lkp_inst : 2
svr_mode : 0
proc state : KJP_FROZEN
Last drm hb acked : 0
flags : x50
ast_rcvd_svrmod : 0
current lock op : 0
Total accesses : 1
Imm. accesses : 0
Locks on ASTQ : 0
Locks Pending AST : 0
Granted locks : 0
AST_Q:
PENDING_Q:
GRANTED_Q:
SO: 0x3d9835198, type: 14, owner: 0x3df099bf8, flag: INIT/-/-/0x00 if: 0x1 c: 0x1
proc=0x3df099bf8, name=channel handle, file=ksr2.h LINE:367 ID:, pg=0
(broadcast handle) 3d9835198 flag: (2) ACTIVE SUBSCRIBER,
owner: 3df099bf8 - ospid: 26396
event: 1, last message event: 1,
last message waited event: 1,
next message: 0(0), messages read: 0
channel: (3d9934df8) PMON actions channel [name: 2]
scope: 7, event: 1, last mesage event: 0,
publishers/subscribers: 0/1,
messages published: 0
heuristic msg queue length: 0
SO: 0x3d9835008, type: 14, owner: 0x3df099bf8, flag: INIT/-/-/0x00 if: 0x1 c: 0x1
proc=0x3df099bf8, name=channel handle, file=ksr2.h LINE:367 ID:, pg=0
(broadcast handle) 3d9835008 flag: (2) ACTIVE SUBSCRIBER,
owner: 3df099bf8 - ospid: 26396
event: 1, last message event: 1,
last message waited event: 1,
next message: 0(0), messages read: 0
channel: (3d9941e40) scumnt mount lock [name: 157]
scope: 1, event: 12, last mesage event: 0,
publishers/subscribers: 0/12,
messages published: 0
heuristic msg queue length: 0
SO: 0x3de4a2b80, type: 4, owner: 0x3df099bf8, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
proc=0x3df099bf8, name=session, file=ksu.h LINE:12624 ID:, pg=0
(session) sid: 33 ser: 1 trans: 0x0, creator: 0x3df099bf8
flags: (0x51) USR/- flags_idl: (0x1) BSY/-/-/-/-/-
flags2: (0x409) -/-/INC
DID: , short-term DID:
txn branch: 0x0
oct: 0, prv: 0, sql: 0x0, psql: 0x0, user: 0/SYS
ksuxds FALSE at location: 0
service name: SYS$BACKGROUND
Current Wait Stack:
Not in wait; last wait ended 0.666415 sec ago
Wait State:
fixed_waits=0 flags=0x21 boundary=0x0/-1
Session Wait History:
elapsed time of 0.666593 sec since last wait
0: waited for 'pmon timer'
duration=0x12c, =0x0, =0x0
wait_id=63 seq_num=64 snap_id=1
wait times: snap=3.000089 sec, exc=3.000089 sec, total=3.000089 sec
wait times: max=3.000000 sec
wait counts: calls=1 os=1
occurred after 0.002067 sec of elapsed time
1: waited for 'pmon timer'
duration=0x12c, =0x0, =0x0
wait_id=62 seq_num=63 snap_id=1
wait times: snap=3.010111 sec, exc=3.010111 sec, total=3.010111 sec
wait times: max=3.000000 sec
wait counts: calls=1 os=1
occurred after 0.001926 sec of elapsed time
2: waited for 'pmon timer'
duration=0x12c, =0x0, =0x0
wait_id=61 seq_num=62 snap_id=1
wait times: snap=3.125286 sec, exc=3.125286 sec, total=3.125286 sec
wait times: max=3.000000 sec
wait counts: calls=1 os=1
occurred after 0.003361 sec of elapsed time
3: waited for 'pmon timer'
duration=0x12c, =0x0, =0x0
wait_id=60 seq_num=61 snap_id=1
wait times: snap=3.000081 sec, exc=3.000081 sec, total=3.000081 sec
wait times: max=3.000000 sec
wait counts: calls=1 os=1
occurred after 0.002102 sec of elapsed time
4: waited for 'pmon timer'
duration=0x12c, =0x0, =0x0 -
Oracle RAC nodeapp 启动报错-vip:IP:192.168.2.200 is already up in the network
Linux redhat 5 Oracle RAC 10.2.0.5环境
启动nodeapp报错如下：
[oracle@rac1 ~]$ srvctl start nodeapps -n rac1
CRS-0210: Could not find resource ora.rac1.gsd.
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
crsd.log部分日志如下：
2012-11-21 20:10:16.831: [ CRSRES][2717907856]0startRunnable: setting CLI values
2012-11-21 20:10:16.967: [ CRSRES][2717907856]0Attempting to start `ora.rac1.vip` on member `rac1`
2012-11-21 20:10:44.246: [ CRSAPP][2717907856]0StartResource error for ora.rac1.vip error code = 1
2012-11-21 20:10:47.007: [ CRSRES][2717907856]0Start of `ora.rac1.vip` on member `rac1` failed.
2012-11-21 20:10:47.529: [ CRSRES][2717907856]0Attempting to start `ora.rac1.vip` on member `rac2`
2012-11-21 20:11:18.649: [ CRSRES][2717907856]0Start of `ora.rac1.vip` on member `rac2` failed.
2012-11-21 20:11:18.897: [ CRSRES][2717907856]0CRS-1006: No more members to consider
2012-11-21 20:11:20.986: [ CRSRES][2717907856]0startRunnable: setting CLI values
2012-11-21 20:11:21.190: [ CRSRES][2717907856]0Attempting to start `ora.rac1.vip` on member `rac1`
2012-11-21 20:11:48.846: [ CRSAPP][2717907856]0StartResource error for ora.rac1.vip error code = 1
2012-11-21 20:11:51.203: [ CRSRES][2717907856]0Start of `ora.rac1.vip` on member `rac1` failed.
2012-11-21 20:11:51.492: [ CRSRES][2717907856]0rac2 : CRS-1019: Resource ora.rac1.LISTENER_RAC1.lsnr (application) cannot run on rac2
请问如何进一步排查“rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)”问题？感谢ping信息：
[oracle@rac1 ~]$ ping 192.168.2.200
PING 192.168.2.200 (192.168.2.200) 56(84) bytes of data.
64 bytes from 192.168.2.200: icmp_seq=1 ttl=64 time=0.043 ms
64 bytes from 192.168.2.200: icmp_seq=2 ttl=64 time=0.126 ms
64 bytes from 192.168.2.200: icmp_seq=3 ttl=64 time=0.059 ms
64 bytes from 192.168.2.200: icmp_seq=4 ttl=64 time=0.158 ms
64 bytes from 192.168.2.200: icmp_seq=5 ttl=64 time=0.643 ms
64 bytes from 192.168.2.200: icmp_seq=6 ttl=64 time=0.034 ms
64 bytes from 192.168.2.200: icmp_seq=7 ttl=64 time=0.046 ms
64 bytes from 192.168.2.200: icmp_seq=8 ttl=64 time=0.043 ms
64 bytes from 192.168.2.200: icmp_seq=9 ttl=64 time=0.048 ms
64 bytes from 192.168.2.200: icmp_seq=10 ttl=64 time=0.031 ms
telnet信息
[oracle@rac1 ~]$ telnet 192.168.2.200
Trying 192.168.2.200...
Connected to 192.168.2.200.
Escape character is '^]'.
Red Hat Enterprise Linux Server release 5 (Tikanga)
Kernel 2.6.18-8.el5xen on an i686
login:
ssh信息：
[oracle@rac1 ~]$ ssh 192.168.2.200
Last login: Sun Nov 18 13:37:10 2012 from rac2-vip
ifconfig -a信息：
[root@rac1 ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:0C:29:B6:CE:6B
inet addr:192.168.2.100 Bcast:192.168.2.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:ce6b/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:142396 errors:0 dropped:0 overruns:0 frame:0
TX packets:172561 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:41403126 (39.4 MiB) TX bytes:96009307 (91.5 MiB)
Interrupt:18 Base address:0x1480
eth1 Link encap:Ethernet HWaddr 00:0C:29:B6:CE:75
inet addr:192.168.2.200 Bcast:192.168.2.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:ce75/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:14082 errors:0 dropped:0 overruns:0 frame:0
TX packets:29 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:9789756 (9.3 MiB) TX bytes:1434 (1.4 KiB)
Interrupt:19 Base address:0x1800
eth2 Link encap:Ethernet HWaddr 00:0C:29:B6:CE:7F
inet addr:192.168.3.100 Bcast:192.168.3.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:ce7f/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:12665 errors:0 dropped:0 overruns:0 frame:0
TX packets:32728 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:6590271 (6.2 MiB) TX bytes:28437643 (27.1 MiB)
Interrupt:16 Base address:0x1880
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:30893 errors:0 dropped:0 overruns:0 frame:0
TX packets:30893 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:9402131 (8.9 MiB) TX bytes:9402131 (8.9 MiB)
sit0 Link encap:IPv6-in-IPv4
NOARP MTU:1480 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) -
Oracle 11g clusterware VIP failover failed
I installed Oracle 11g Clusterware succesfully, without any errors as per link:
http://www.oracle-base.com/articles/11g/OracleDB11gR1RACInstallationOnRHEL5UsingVMwareESXAndNFS.php
After that,I did vip failover test
I rebooted the node-2
Before reboot,
[root@advansrac1 bin]# ./crs_stat -t
Name Type Target State Host
ora....ac1.gsd application ONLINE ONLINE rac1
ora....ac1.ons application ONLINE ONLINE rac1
ora....ac1.vip application ONLINE ONLINE rac1
ora....ac2.gsd application ONLINE ONLINE rac2
ora....ac2.ons application ONLINE ONLINE rac2
ora....ac2.vip application ONLINE ONLINE rac2
After reboot,
Name Type Target State Host
ora....ac1.gsd application ONLINE ONLINE rac1
ora....ac1.ons application ONLINE ONLINE rac1
ora....ac1.vip application ONLINE ONLINE rac1
ora....ac2.gsd application ONLINE ONLINE rac2
ora....ac2.ons application ONLINE ONLINE rac2
ora....ac2.vip application ONLINE UNKNOWN rac1
[root@rac1 bin]# ./crs_stop ora.rac2.vip
Attempting to stop `ora.rac2.vip` on member `advansrac1`
Stop of `ora.rac2.vip` on member `advansrac1` succeeded.
[root@rac1 bin]# ./crs_stat -t
Name Type Target State Host
ora....ac1.gsd application ONLINE ONLINE rac1
ora....ac1.ons application ONLINE ONLINE rac1
ora....ac1.vip application ONLINE ONLINE rac1
ora....ac2.gsd application ONLINE ONLINE rac2
ora....ac2.ons application ONLINE ONLINE rac2
ora....ac2.vip application OFFLINE OFFLINE
[root@rac1 bin]# ./crs_start ora.rac2.vip
Attempting to start `ora.rac2.vip` on member `rac2`
Start of `ora.rac2.vip` on member `rac2` succeeded.
[root@rac1 bin]# ./crs_stat -t
Name Type Target State Host
ora....ac1.gsd application ONLINE ONLINE rac1
ora....ac1.ons application ONLINE ONLINE rac1
ora....ac1.vip application ONLINE ONLINE rac1
ora....ac2.gsd application ONLINE ONLINE rac2
ora....ac2.ons application ONLINE ONLINE rac2
ora....ac2.vip application ONLINE ONLINE rac2
I have only 1.5G on each node
Here the issue is,
1. Actual Result: # During failover why it is showing UNKNOWN state for ora.rac2.vip on member rac1
Expected Result: # During failover,it have to be ONLINE state for ora.rac2.vip on member rac1
2. I have to start ora.rac2.vip manually, when node-2 is up.I want VIP fail over have to happen automatically when node-2 is up to normal online state.
Help me out from this issueVMware is unsupported but that is likely not your issue.
1. Run cluster verify and report the results
2. Did you create a failover service? How?
3. Post your TNSNAMES.ORA -
Should SCAN VIP and Listener jump among Nodes?
Oracle (GI and DB): 11.2.0.3 SE
OS: RHEL 5.6
I remember when I first tried scan several years ago (most likely with 11.2.0.1 EE), the SCAN VIP and Listeners jumps from node to node whenever a DB connection was established.
Recently, in a newly installed 2 node cluster running 11.2.0.3 SE, it seems the SCAN VIP and Listener stick to a single node unless during failover or requested with a command. As a result, a SCAN VIP and Listeners end up running on a single node after some failover testing.
Which is the designed behaviour? I understand they can direct connection requests to DB instance on other node. Just want to know whether they are supposed to jump?Hi,
I have not tried it myself, but if you look at the crs profile on how SCANs are defined, they are set to DISPERSION.
# crsctl stat res ora.scan1.vip -p
NAME=ora.scan1.vip
TYPE=ora.scan_vip.type
START_DEPENDENCIES=hard(ora.net1.network) dispersion:active(type:ora.scan_vip.type) pullup(ora.net1.network)
...So they should not/never run on the same node, since the dispersion policy tells them differently.
However this dependency is checked at startup time, and not always during runtime. So if you do a lot of test, your szenario is possible.
Have you tried waiting a while, if this resolves the issue?
If they stay on the same node, I would open an SR, because then it does not follow the dispersion policy.
Regards
Sebastian -
Vip not started in newly added node in 10gR2
Hi
I'm facing a issue while adding third node in 10gR2 env.
after pre-requisite check has been success, I run $CRS_HOME/oui/bin/addNode.sh script.
after GUI based installation , I run all the three script , which has been completed successfully,
Then I run vipca as root user to configure vip , but it thrown error ,CRS-1006, CRS 1028, crs-0215, crs-0223
I check status of OCR voting and their permission and status on node 3 , all looks good.
CRS-1006: No more member to consider CRS-0215: could not start resource 'ora.rac3.vip'
CRS-1028: dependency analysis failed because of CRS-0223 resource 'ora.rac1.gsd' has placement error.
CRS-1028: dependency analysis failed because of CRS-0223 resource 'ora.rac2.gsd' has placement error.
CRS-1028: dependency analysis failed because of CRS-0223 resource 'ora.rac1.ons' has placement error.
CRS-1028: dependency analysis failed because of CRS-0223 resource 'ora.rac2.ons' has placement error.
Can u please suggest.....
Regards
rajeev....[oracle@rac1 cluvfy]$ ./runcluvfy.sh stage -post crsinst -n rac1,rac2,rac3 -verbose
Performing post-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node "rac1"
Destination Node Reachable?
rac2 yes
rac1 yes
rac3 yes
Result: Node reachability check passed from node "rac1".
Checking user equivalence...
Check: User equivalence for user "oracle"
Node Name Comment
rac2 passed
rac1 passed
rac3 passed
Result: User equivalence check passed for user "oracle".
Checking Cluster manager integrity...
Checking CSS daemon...
Node Name Status
rac2 running
rac1 running
rac3 running
Result: Daemon status check passed for "CSS daemon".
Cluster manager integrity check passed.
Checking cluster integrity...
Node Name
rac1
rac2
rac3
Cluster integrity check passed
Checking OCR integrity...
Checking the absence of a non-clustered configuration...
All nodes free of non-clustered, local-only configurations.
Uniqueness check for OCR device passed.
Checking the version of OCR...
OCR of correct Version "2" exists.
Checking data integrity of OCR...
Data integrity check for OCR passed.
OCR integrity check passed.
Checking CRS integrity...
Checking daemon liveness...
Check: Liveness for "CRS daemon"
Node Name Running
rac2 yes
rac1 yes
rac3 yes
Result: Liveness check passed for "CRS daemon".
Checking daemon liveness...
Check: Liveness for "CSS daemon"
Node Name Running
rac2 yes
rac1 yes
rac3 yes
Result: Liveness check passed for "CSS daemon".
Checking daemon liveness...
Check: Liveness for "EVM daemon"
Node Name Running
rac2 yes
rac1 yes
rac3 yes
Result: Liveness check passed for "EVM daemon".
Liveness of all the daemons
Node Name CRS daemon CSS daemon EVM daemon
rac2 yes yes yes
rac1 yes yes yes
rac3 yes yes yes
Checking CRS health...
Check: Health of CRS
Node Name CRS OK?
rac2 yes
rac1 yes
rac3 yes
Result: CRS health check passed.
CRS integrity check passed.
Checking node application existence...
Checking existence of VIP node application
Node Name Required Status Comment
rac2 yes exists passed
rac1 yes exists passed
rac3 yes exists passed
Result: Check passed.
Checking existence of ONS node application
Node Name Required Status Comment
rac2 no exists passed
rac1 no exists passed
rac3 no exists passed
Result: Check passed.
Checking existence of GSD node application
Node Name Required Status Comment
rac2 no exists passed
rac1 no exists passed
rac3 no exists passed
Result: Check passed.
Post-check for cluster services setup was successful. -
VIP is not failed over to surviving nodes in oracle 11.2.0.2 grid infra
Hi ,
It is a 8 node 11.2.0.2 grid infra.
While pulling both cables from public nic the VIP is not failed over to surviving nodes in 2 nodes but remainng nodes VIP is failed over to surviving node in the same cluster. Please help me on this.
If we will remove the power from these servers VIP is failed over to surviving nodes
Public nic's are in bonding.
grdoradr105:/apps/grid/grdhome/sh:+ASM5> ./crsstat.sh |grep -i vip |grep -i 101
ora.grdoradr101.vip ONLINE OFFLINE
grdoradr101:/apps/grid/grdhome:+ASM1> cat /proc/net/bonding/bond0
Ethernet Channel Bonding Driver: v3.4.0-1 (October 7, 2008)
Bonding Mode: fault-tolerance (active-backup)
Primary Slave: None
Currently Active Slave: eth0
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Slave Interface: eth0
MII Status: up
Speed: 100 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 84:2b:2b:51:3f:1e
Slave Interface: eth1
MII Status: up
Speed: 100 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 84:2b:2b:51:3f:20
Thanks
BalaPlease check below MOS note for this issue.
1276737.1
HTH
Edited by: krishan on Jul 28, 2011 2:49 AM -
Oracle 10.2.0.4 RAC vip故障漂移导致监听关闭.
环境：oracle 10.2.0.4 RAC+ASM
故障现象：vip漂移至另一节点导致监听关闭，vip漂移现象随机在2个节点中出现，数据库实例正常，只是vip漂移至另一节点，同时监听offline。
# su - oracle
$ crs_stat -t
Name Type Target State Host
ora....SM1.asm application ONLINE ONLINE p770db1
ora....B1.lsnr application ONLINE OFFLINE
ora....db1.gsd application ONLINE ONLINE p770db1
ora....db1.ons application ONLINE ONLINE p770db1
ora....db1.vip application ONLINE ONLINE p770db2
ora....SM2.asm application ONLINE ONLINE p770db2
ora....B2.lsnr application ONLINE ONLINE p770db2
ora....db2.gsd application ONLINE ONLINE p770db2
ora....db2.ons application ONLINE ONLINE p770db2
ora....db2.vip application ONLINE ONLINE p770db2
ora.zjhorcl.db application ONLINE ONLINE p770db1
ora....orcl.cs application ONLINE ONLINE p770db1
ora....cl1.srv application ONLINE OFFLINE
ora....cl2.srv application ONLINE ONLINE p770db2
ora....l1.inst application ONLINE ONLINE p770db1
ora....l2.inst application ONLINE ONLINE p770db2
然后要用crs_start -all重启后来能恢复，如下：
$ crs_start -all
p770db1 : CRS-1018: Resource ora.p770db1.vip (application) is already running on p770db2
p770db2 : CRS-1019: Resource ora.p770db1.LISTENER_P770DB1.lsnr (application) cannot run on p770db2
Attempting to start `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1`
Start of `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1` succeeded.
CRS-0223: Resource 'ora.p770db1.LISTENER_P770DB1.lsnr' has placement error.
========================================================================================
2012-10-11 06:56:21.830: [ CRSRES][11110]32startRunnable: setting CLI values
2012-10-12 13:47:28.205: [ CRSRES][11471]32p770db1 : CRS-1019: Resource ora.p770db2.LISTENER_P770DB2.lsnr (application) cannot run
on p770db1
p770db2 : CRS-1018: Resource ora.p770db2.vip (application) is already running on p770db1
2012-10-12 13:47:28.247: [ CRSRES][11728]32Attempting to start `ora.zjhorcl.orcl.zjhorcl2.srv` on member `p770db2`
2012-10-12 13:47:28.656: [ CRSRES][11986]32StopResource: setting CLI values
2012-10-12 13:47:31.709: [ CRSRES][11728]32Start of `ora.zjhorcl.orcl.zjhorcl2.srv` on member `p770db2` succeeded.
2012-10-12 15:34:14.228: [ CRSAPP][11192]32CheckResource error for ora.p770db1.vip error code = 1
2012-10-12 15:34:14.234: [ CRSRES][11192]32In stateChanged, ora.p770db1.vip target is ONLINE
2012-10-12 15:34:14.235: [ CRSRES][11192]32ora.p770db1.vip on p770db1 went OFFLINE unexpectedly
2012-10-12 15:34:14.235: [ CRSRES][11192]32StopResource: setting CLI values
2012-10-12 15:34:14.238: [ CRSRES][11192]32Attempting to stop `ora.p770db1.vip` on member `p770db1`
2012-10-12 15:34:14.602: [ CRSRES][11709]32In stateChanged, ora.zjhorcl.orcl.zjhorcl1.srv target is ONLINE
2012-10-12 15:34:14.602: [ CRSRES][11709]32ora.zjhorcl.orcl.zjhorcl1.srv on p770db1 went OFFLINE unexpectedly
2012-10-12 15:34:14.603: [ CRSRES][11709]32StopResource: setting CLI values
2012-10-12 15:34:14.628: [ CRSRES][11709]32Attempting to stop `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1`
2012-10-12 15:34:14.716: [ CRSRES][11192]32Stop of `ora.p770db1.vip` on member `p770db1` succeeded.
2012-10-12 15:34:14.717: [ CRSRES][11192]32ora.p770db1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2012-10-12 15:34:14.722: [ CRSRES][11192]32ora.p770db1.vip failed on p770db1 relocating.
2012-10-12 15:34:14.750: [ CRSRES][11192]32StopResource: setting CLI values
2012-10-12 15:34:14.754: [ CRSRES][11192]32Attempting to stop `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
2012-10-12 15:34:15.011: [ CRSRES][11709]32Stop of `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1` succeeded.
2012-10-12 15:34:15.011: [ CRSRES][11709]32ora.zjhorcl.orcl.zjhorcl1.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
2012-10-12 15:34:15.019: [ CRSRES][11709]32ora.zjhorcl.orcl.zjhorcl1.srv failed on p770db1 relocating.
2012-10-12 15:34:15.115: [ CRSRES][11709]32Cannot relocate ora.zjhorcl.orcl.zjhorcl1.srvStopping dependents
2012-10-12 15:34:15.321: [ CRSRES][11709]32StopResource: setting CLI values
2012-10-12 15:35:32.118: [ CRSRES][11192]32Stop of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
2012-10-12 15:35:32.181: [ CRSRES][11192]32Attempting to start `ora.p770db1.vip` on member `p770db2`
2012-10-12 15:35:33.824: [ CRSRES][11192]32Start of `ora.p770db1.vip` on member `p770db2` succeeded.
2012-10-13 03:09:02.433: [ CRSEVT][11049]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_2/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-13 03:09:02.433: [ CRSEVT][11049]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_2/bin/racgwrap(check) tim
ed out for ora.zjhorcl.orcl.cs! (timeout=600)
2012-10-13 03:09:02.433: [ CRSAPP][11049]32CheckResource error for ora.zjhorcl.orcl.cs error code = -2
2012-10-13 03:09:10.452: [ CRSEVT][11562]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_2/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-13 03:09:10.453: [ CRSEVT][11562]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_2/bin/racgwrap(check) tim
ed out for ora.p770db1.ASM1.asm! (timeout=600)
2012-10-13 03:09:10.453: [ CRSAPP][11562]32CheckResource error for ora.p770db1.ASM1.asm error code = -2
2012-10-13 03:09:10.583: [ CRSEVT][11819]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_2/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-13 03:09:10.583: [ CRSEVT][11819]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_2/bin/racgwrap(check) tim
ed out for ora.zjhorcl.zjhorcl1.inst! (timeout=600)
2012-10-13 03:09:10.583: [ CRSAPP][11819]32CheckResource error for ora.zjhorcl.zjhorcl1.inst error code = -2
2012-10-13 03:09:14.032: [ CRSEVT][12332]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-13 03:09:14.033: [ CRSEVT][12332]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db1.ons! (timeout=600)
2012-10-13 03:09:14.033: [ CRSAPP][12332]32CheckResource error for ora.p770db1.ons error code = -2
2012-10-14 19:32:02.637: [ CRSRES][11089]32startRunnable: setting CLI values
2012-10-14 19:32:03.342: [ CRSRES][11603]32StopResource: setting CLI values
2012-10-14 19:32:03.353: [ CRSRES][11603]32Attempting to stop `ora.p770db1.vip` on member `p770db2`
2012-10-14 19:32:03.792: [ CRSRES][11603]32Stop of `ora.p770db1.vip` on member `p770db2` succeeded.
2012-10-14 19:32:03.799: [ CRSRES][11603]32startRunnable: setting CLI values
2012-10-14 19:32:03.799: [ CRSRES][11603]32Attempting to start `ora.p770db1.vip` on member `p770db1`
2012-10-14 19:32:05.520: [ CRSRES][11603]32Start of `ora.p770db1.vip` on member `p770db1` succeeded.
2012-10-14 19:32:05.688: [ CRSRES][11864]32startRunnable: setting CLI values
2012-10-14 19:32:05.696: [ CRSRES][11864]32Attempting to start `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
2012-10-14 19:32:06.273: [ CRSRES][12386]32CRS-1002: Resource 'ora.zjhorcl.orcl.cs' is already running on member 'p770db1'
2012-10-14 19:32:06.576: [ CRSRES][11864]32Start of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
2012-10-21 10:29:19.051: [ CRSAPP][11054]32CheckResource error for ora.p770db1.vip error code = 1
2012-10-21 10:29:19.059: [ CRSRES][11054]32In stateChanged, ora.p770db1.vip target is ONLINE
2012-10-21 10:29:19.060: [ CRSRES][11054]32ora.p770db1.vip on p770db1 went OFFLINE unexpectedly
2012-10-21 10:29:19.060: [ CRSRES][11054]32StopResource: setting CLI values
2012-10-21 10:29:19.070: [ CRSRES][11054]32Attempting to stop `ora.p770db1.vip` on member `p770db1`
2012-10-21 10:29:19.526: [ CRSRES][11828]32In stateChanged, ora.zjhorcl.orcl.zjhorcl1.srv target is ONLINE
2012-10-21 10:29:19.526: [ CRSRES][11828]32ora.zjhorcl.orcl.zjhorcl1.srv on p770db1 went OFFLINE unexpectedly
2012-10-21 10:29:19.527: [ CRSRES][11828]32StopResource: setting CLI values
2012-10-21 10:29:19.575: [ CRSRES][11828]32Attempting to stop `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1`
2012-10-21 10:29:19.673: [ CRSRES][11054]32Stop of `ora.p770db1.vip` on member `p770db1` succeeded.
2012-10-21 10:29:19.674: [ CRSRES][11054]32ora.p770db1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2012-10-21 10:29:19.684: [ CRSRES][11054]32ora.p770db1.vip failed on p770db1 relocating.
2012-10-21 10:29:19.718: [ CRSRES][11054]32StopResource: setting CLI values
2012-10-21 10:29:19.733: [ CRSRES][11054]32Attempting to stop `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
2012-10-21 10:29:19.932: [ CRSRES][11828]32Stop of `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1` succeeded.
2012-10-21 10:29:19.933: [ CRSRES][11828]32ora.zjhorcl.orcl.zjhorcl1.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
2012-10-21 10:29:19.941: [ CRSRES][11828]32ora.zjhorcl.orcl.zjhorcl1.srv failed on p770db1 relocating.
2012-10-21 10:29:20.116: [ CRSRES][11828]32Cannot relocate ora.zjhorcl.orcl.zjhorcl1.srvStopping dependents
2012-10-21 10:29:20.154: [ CRSRES][11828]32StopResource: setting CLI values
2012-10-21 10:30:36.095: [ CRSRES][11054]32Stop of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
2012-10-21 10:30:36.280: [ CRSRES][11054]32Attempting to start `ora.p770db1.vip` on member `p770db2`
2012-10-21 10:30:37.942: [ CRSRES][11054]32Start of `ora.p770db1.vip` on member `p770db2` succeeded.
2012-10-21 10:30:38.289: [ CRSRES][11932]32CRS-1002: Resource 'ora.p770db1.vip' is already running on member 'p770db2'
2012-10-22 10:51:43.580: [ CRSRES][11262]32startRunnable: setting CLI values
2012-10-22 10:51:44.110: [ CRSRES][11777]32StopResource: setting CLI values
2012-10-22 10:51:44.217: [ CRSRES][11777]32Attempting to stop `ora.p770db1.vip` on member `p770db2`
2012-10-22 10:51:44.976: [ CRSRES][11777]32Stop of `ora.p770db1.vip` on member `p770db2` succeeded.
2012-10-22 10:51:44.984: [ CRSRES][11777]32startRunnable: setting CLI values
2012-10-22 10:51:44.984: [ CRSRES][11777]32Attempting to start `ora.p770db1.vip` on member `p770db1`
2012-10-22 10:51:46.757: [ CRSRES][11777]32Start of `ora.p770db1.vip` on member `p770db1` succeeded.
2012-10-22 10:51:46.988: [ CRSRES][11534]32startRunnable: setting CLI values
2012-10-22 10:51:47.006: [ CRSRES][11534]32Attempting to start `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
2012-10-22 10:51:47.217: [ CRSRES][12304]32CRS-1002: Resource 'ora.zjhorcl.orcl.cs' is already running on member 'p770db1'
2012-10-22 10:51:47.763: [ CRSRES][11534]32Start of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
2012-10-23 04:23:21.417: [ CRSAPP][11219]32CheckResource error for ora.p770db1.vip error code = 1
2012-10-23 04:23:21.425: [ CRSRES][11219]32In stateChanged, ora.p770db1.vip target is ONLINE
2012-10-23 04:23:21.425: [ CRSRES][11219]32ora.p770db1.vip on p770db1 went OFFLINE unexpectedly
2012-10-23 04:23:21.425: [ CRSRES][11219]32StopResource: setting CLI values
2012-10-23 04:23:21.435: [ CRSRES][11219]32Attempting to stop `ora.p770db1.vip` on member `p770db1`
2012-10-23 04:23:21.876: [ CRSRES][11993]32In stateChanged, ora.zjhorcl.orcl.zjhorcl1.srv target is ONLINE
2012-10-23 04:23:21.877: [ CRSRES][11993]32ora.zjhorcl.orcl.zjhorcl1.srv on p770db1 went OFFLINE unexpectedly
2012-10-23 04:23:21.877: [ CRSRES][11993]32StopResource: setting CLI values
2012-10-23 04:23:21.888: [ CRSRES][11993]32Attempting to stop `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1`
2012-10-23 04:23:22.067: [ CRSRES][11219]32Stop of `ora.p770db1.vip` on member `p770db1` succeeded.
2012-10-23 04:23:22.067: [ CRSRES][11219]32ora.p770db1.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2012-10-23 04:23:22.074: [ CRSRES][11219]32ora.p770db1.vip failed on p770db1 relocating.
2012-10-23 04:23:22.133: [ CRSRES][11219]32StopResource: setting CLI values
2012-10-23 04:23:22.157: [ CRSRES][11219]32Attempting to stop `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
2012-10-23 04:23:22.295: [ CRSRES][11993]32Stop of `ora.zjhorcl.orcl.zjhorcl1.srv` on member `p770db1` succeeded.
2012-10-23 04:23:22.296: [ CRSRES][11993]32ora.zjhorcl.orcl.zjhorcl1.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
2012-10-23 04:23:22.309: [ CRSRES][11993]32ora.zjhorcl.orcl.zjhorcl1.srv failed on p770db1 relocating.
2012-10-23 04:23:22.344: [ CRSRES][11993]32Cannot relocate ora.zjhorcl.orcl.zjhorcl1.srvStopping dependents
2012-10-23 04:23:22.388: [ CRSRES][11993]32StopResource: setting CLI values
2012-10-23 04:24:38.655: [ CRSRES][11219]32Stop of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
2012-10-23 04:24:38.734: [ CRSRES][11219]32Attempting to start `ora.p770db1.vip` on member `p770db2`
2012-10-23 04:24:40.474: [ CRSRES][11219]32Start of `ora.p770db1.vip` on member `p770db2` succeeded.
2012-10-23 13:50:39.656: [ CRSRES][11257]32startRunnable: setting CLI values
2012-10-23 13:50:40.032: [ CRSRES][11771]32StopResource: setting CLI values
2012-10-23 13:50:40.042: [ CRSRES][11771]32Attempting to stop `ora.p770db1.vip` on member `p770db2`
2012-10-23 13:50:40.607: [ CRSRES][11771]32Stop of `ora.p770db1.vip` on member `p770db2` succeeded.
2012-10-23 13:50:40.614: [ CRSRES][11771]32startRunnable: setting CLI values
2012-10-23 13:50:40.614: [ CRSRES][11771]32Attempting to start `ora.p770db1.vip` on member `p770db1`
2012-10-23 13:50:42.336: [ CRSRES][11771]32Start of `ora.p770db1.vip` on member `p770db1` succeeded.
2012-10-23 13:50:42.508: [ CRSRES][11776]32startRunnable: setting CLI values
2012-10-23 13:50:42.517: [ CRSRES][11776]32Attempting to start `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1`
2012-10-23 13:50:43.251: [ CRSRES][12298]32CRS-1002: Resource 'ora.zjhorcl.orcl.cs' is already running on member 'p770db1'
2012-10-23 13:50:43.517: [ CRSRES][11776]32Start of `ora.p770db1.LISTENER_P770DB1.lsnr` on member `p770db1` succeeded.
$
$ more ora.p770db1.vip.log
Oracle Database 10g CRS Release 10.2.0.4.0 Production Copyright 1996, 2008 Oracle. All rights reserved.
2012-08-23 15:07:17.902: [ RACG][1] [15466872][1][ora.p770db1.vip]:
entstat: 0909-004 Unable to get statistics on device en0, errno = 69
Invalid parameters, or failed to bring up VIP (host=p770db1)
2012-08-23 15:07:17.903: [ RACG][1] [15466872][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db
_1
2012-08-23 15:07:17.903: [ RACG][1] [15466872][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
2012-08-23 15:07:17.903: [ RACG][1] [15466872][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 0.509s
2012-08-23 15:07:17.903: [ RACG][1] [15466872][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status =
1, time = 0.685s
2012-09-23 10:43:34.433: [ RACG][1] [6815926][1][ora.p770db1.vip]: Invalid parameters, or failed to bring up VIP (host=p770db1)
2012-09-23 10:43:34.442: [ RACG][1] [6815926][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db_
1
2012-09-23 10:43:34.442: [ RACG][1] [6815926][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
2012-09-23 10:43:34.442: [ RACG][1] [6815926][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 4.682s
2012-09-23 10:43:34.442: [ RACG][1] [6815926][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status = 1
, time = 5.068s
2012-10-12 15:34:14.222: [ RACG][1] [18809030][1][ora.p770db1.vip]:
entstat: 0909-004 Unable to get statistics on device en0, errno = 69
Invalid parameters, or failed to bring up VIP (host=p770db1)
2012-10-12 15:34:14.222: [ RACG][1] [18809030][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db
_1
2012-10-12 15:34:14.222: [ RACG][1] [18809030][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
2012-10-12 15:34:14.222: [ RACG][1] [18809030][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 0.564s
2012-10-12 15:34:14.222: [ RACG][1] [18809030][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status =
1, time = 0.712s
2012-10-21 10:29:19.043: [ RACG][1] [18546790][1][ora.p770db1.vip]:
entstat: 0909-004 Unable to get statistics on device en0, errno = 69
Invalid parameters, or failed to bring up VIP (host=p770db1)
2012-10-21 10:29:19.043: [ RACG][1] [18546790][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db
_1
2012-10-21 10:29:19.043: [ RACG][1] [18546790][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
2012-10-21 10:29:19.043: [ RACG][1] [18546790][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 0.541s
2012-10-21 10:29:19.044: [ RACG][1] [18546790][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status =
1, time = 0.716s
2012-10-23 04:23:21.410: [ RACG][1] [18415718][1][ora.p770db1.vip]:
entstat: 0909-004 Unable to get statistics on device en0, errno = 69
Invalid parameters, or failed to bring up VIP (host=p770db1)
2012-10-23 04:23:21.410: [ RACG][1] [18415718][1][ora.p770db1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/db
_1
2012-10-23 04:23:21.410: [ RACG][1] [18415718][1][ora.p770db1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/db_1/bin/racgeut -e
USRORA_DEBUG=0 54 /oracle/product/10.2.0/db_1/bin/racgvip check p770db1
2012-10-23 04:23:21.410: [ RACG][1] [18415718][1][ora.p770db1.vip]: clsrcexecut: rc = 1, time = 0.595s
2012-10-23 04:23:21.410: [ RACG][1] [18415718][1][ora.p770db1.vip]: end for resource = ora.p770db1.vip, action = check, status =
1, time = 0.751s
===================================================================================================
2012-09-26 07:45:11.000: [ CRSEVT][11666]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-09-26 07:45:11.000: [ CRSEVT][11666]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-09-26 07:45:11.000: [ CRSAPP][11666]32CheckResource error for ora.p770db2.vip error code = -2
2012-09-26 07:46:44.036: [ CRSEVT][11668]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-09-26 07:46:44.036: [ CRSEVT][11668]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-09-26 07:46:44.036: [ CRSAPP][11668]32CheckResource error for ora.p770db2.vip error code = -2
2012-09-26 07:48:17.067: [ CRSEVT][11670]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-09-26 07:48:17.067: [ CRSEVT][11670]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-09-26 07:48:17.067: [ CRSAPP][11670]32CheckResource error for ora.p770db2.vip error code = -2
2012-09-26 21:27:23.866: [ CRSEVT][11581]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-09-26 21:27:23.866: [ CRSEVT][11581]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-09-26 21:27:23.866: [ CRSAPP][11581]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-03 23:26:47.076: [ CRSEVT][11737]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-03 23:26:47.076: [ CRSEVT][11737]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-03 23:26:47.076: [ CRSAPP][11737]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-03 23:28:20.116: [ CRSEVT][11739]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-03 23:28:20.116: [ CRSEVT][11739]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-03 23:28:20.116: [ CRSAPP][11739]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-03 23:29:53.146: [ CRSEVT][11743]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-03 23:29:53.146: [ CRSEVT][11743]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-03 23:29:53.146: [ CRSAPP][11743]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-03 23:31:26.182: [ CRSEVT][11745]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-03 23:31:26.182: [ CRSEVT][11745]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-03 23:31:26.182: [ CRSAPP][11745]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-03 23:32:59.221: [ CRSEVT][11748]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-03 23:32:59.222: [ CRSEVT][11748]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-03 23:32:59.222: [ CRSAPP][11748]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-03 23:34:32.255: [ CRSEVT][11751]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-03 23:34:32.255: [ CRSEVT][11751]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-03 23:34:32.255: [ CRSAPP][11751]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-06 06:07:13.137: [ CRSEVT][11639]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-06 06:07:13.137: [ CRSEVT][11639]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-06 06:07:13.138: [ CRSAPP][11639]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-06 06:08:46.175: [ CRSEVT][11641]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-06 06:08:46.175: [ CRSEVT][11641]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-06 06:08:46.176: [ CRSAPP][11641]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-06 06:10:19.207: [ CRSEVT][11644]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-06 06:10:19.207: [ CRSEVT][11644]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-06 06:10:19.207: [ CRSAPP][11644]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-06 06:11:52.236: [ CRSEVT][11648]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-06 06:11:52.236: [ CRSEVT][11648]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-06 06:11:52.236: [ CRSAPP][11648]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-06 06:13:25.268: [ CRSEVT][11652]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-06 06:13:25.269: [ CRSEVT][11652]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-06 06:13:25.269: [ CRSAPP][11652]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-06 06:14:58.307: [ CRSEVT][11654]32CAAMonitorHandler :: 0:Could not join /oracle/product/10.2.0/db_1/bin/racgwrap(check)
category: 1234, operation: scls_process_join, loc: childcrash, OS error: 0, other: Abnormal termination of the child
2012-10-06 06:14:58.307: [ CRSEVT][11654]32CAAMonitorHandler :: 0:Action Script /oracle/product/10.2.0/db_1/bin/racgwrap(check) tim
ed out for ora.p770db2.vip! (timeout=60)
2012-10-06 06:14:58.307: [ CRSAPP][11654]32CheckResource error for ora.p770db2.vip error code = -2
2012-10-11 06:55:01.756: [ CRSAPP][11628]32CheckResource error for ora.p770db2.vip error code = 1
2012-10-11 06:55:01.761: [ CRSRES][11628]32In stateChanged, ora.p770db2.vip target is ONLINE
2012-10-11 06:55:01.761: [ CRSRES][11628]32ora.p770db2.vip on p770db2 went OFFLINE unexpectedly
2012-10-11 06:55:01.761: [ CRSRES][11628]32StopResource: setting CLI values
2012-10-11 06:55:01.765: [ CRSRES][11628]32Attempting to stop `ora.p770db2.vip` on member `p770db2`
2012-10-11 06:55:02.390: [ CRSRES][11889]32In stateChanged, ora.zjhorcl.orcl.zjhorcl2.srv target is ONLINE
2012-10-11 06:55:02.390: [ CRSRES][11889]32ora.zjhorcl.orcl.zjhorcl2.srv on p770db2 went OFFLINE unexpectedly
2012-10-11 06:55:02.391: [ CRSRES][11889]32StopResource: setting CLI values
2012-10-11 06:55:02.416: [ CRSRES][11889]32Attempting to stop `ora.zjhorcl.orcl.zjhorcl2.srv` on member `p770db2`
2012-10-11 06:55:02.532: [ CRSRES][11628]32Stop of `ora.p770db2.vip` on member `p770db2` succeeded.
2012-10-11 06:55:02.543: [ CRSRES][11628]32ora.p770db2.vip RESTART_COUNT=0 RESTART_ATTEMPTS=0
2012-10-11 06:55:02.605: [ CRSRES][11628]32ora.p770db2.vip failed on p770db2 relocating.
2012-10-11 06:55:02.680: [ CRSRES][11628]32StopResource: setting CLI values
2012-10-11 06:55:02.684: [ CRSRES][11628]32Attempting to stop `ora.p770db2.LISTENER_P770DB2.lsnr` on member `p770db2`
2012-10-11 06:55:03.613: [ CRSRES][11889]32Stop of `ora.zjhorcl.orcl.zjhorcl2.srv` on member `p770db2` succeeded.
2012-10-11 06:55:03.614: [ CRSRES][11889]32ora.zjhorcl.orcl.zjhorcl2.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
2012-10-11 06:55:03.658: [ CRSRES][11889]32ora.zjhorcl.orcl.zjhorcl2.srv failed on p770db2 relocating.
2012-10-11 06:55:03.684: [ CRSRES][11889]32Cannot relocate ora.zjhorcl.orcl.zjhorcl2.srvStopping dependents
2012-10-11 06:55:03.698: [ CRSRES][11889]32StopResource: setting CLI values
2012-10-11 06:56:19.120: [ CRSRES][11628]32Stop of `ora.p770db2.LISTENER_P770DB2.lsnr` on member `p770db2` succeeded.
2012-10-11 06:56:19.160: [ CRSRES][11628]32Attempting to start `ora.p770db2.vip` on member `p770db1`
2012-10-11 06:56:20.894: [ CRSRES][11628]32Start of `ora.p770db2.vip` on member `p770db1` succeeded.
2012-10-12 13:47:25.650: [ CRSRES][11649]32startRunnable: setting CLI values
2012-10-12 13:47:26.054: [ CRSRES][11907]32StopResource: setting CLI values
2012-10-12 13:47:26.068: [ CRSRES][11907]32Attempting to stop `ora.p770db2.vip` on member `p770db1`
2012-10-12 13:47:26.508: [ CRSRES][11907]32Stop of `ora.p770db2.vip` on member `p770db1` succeeded.
2012vip日志中显示：
2012-08-23 15:07:17.902: [ RACG][1] [15466872][1][ora.p770db1.vip]:
entstat: 0909-004 Unable to get statistics on device en0, errno = 69
Invalid parameters, or failed to bring up VIP (host=p770db1)
这网卡是否有问题，还有防火墙是否做过切换端口等操作？
是aix的系统吗？http://www-01.ibm.com/support/docview.wss?uid=isg1IV22840 找到个描述你看看符合不
Edited by: 小电工II on 2012-10-24 下午11:54 -
Srvctl start service/stop throwing error ORA-01031: insufficient privileges
Hi Gurus,
When i try to start/stop the service getting below error.Please help me troubleshoot it.
AIX-6.1
11.2.0.1
Plato1:/u01/app/11.2.0/grid/network/admin>srvctl start service -d maxcv
PRCR-1079 : Failed to start resource ora.maxcv.maxcv.svc
CRS-2680: Clean of 'ora.maxcvuat.svc' on 'Plato1' failed
CRS-5807: Agent failed to process the message
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
CRS-2680: Clean of 'ora.maxcvuat.svc' on 'Plato1' failed
ThanksSQL> execute dbms_service.start_service('maxcvuat');PL/SQL procedure successfully completed.
Output from alert.log
EMNC started with pid=32, OS id=1384660
2011-09-09 09:32:09.820000 -04:00
Starting background process CJQ0
CJQ0 started with pid=53, OS id=1429756
2011-09-09 09:37:00.698000 -04:00
Starting background process SMCO
SMCO started with pid=33, OS id=1687726
2011-09-09 09:52:59.212000 -04:00
ALTER SYSTEM SET service_names='maxcvuat' SCOPE=MEMORY SID='maxcv2';
~crsctl stat output:
plato2:/home/grid>crsctl stat res -t
NAME TARGET STATE SERVER STATE_DETAILS
Local Resources
ora.CRS.dg
OFFLINE OFFLINE plato1
OFFLINE OFFLINE plato2
ora.CRS_DATA.dg
ONLINE OFFLINE plato1
ONLINE ONLINE plato2
ora.CRS_DATA1.dg
ONLINE OFFLINE plato1
ONLINE ONLINE plato2
ora.CRS_VDISK.dg
OFFLINE OFFLINE plato1
ONLINE ONLINE plato2
ora.LISTENER.lsnr
ONLINE ONLINE plato1
ONLINE ONLINE plato2
ora.maxcv_DATA.dg
ONLINE INTERMEDIATE plato1
ONLINE ONLINE plato2
ora.maxcv_REC.dg
ONLINE INTERMEDIATE plato1
ONLINE ONLINE plato2
ora.asm
ONLINE OFFLINE plato1
ONLINE ONLINE plato2
ora.eons
ONLINE ONLINE plato1
ONLINE ONLINE plato2
ora.gsd
OFFLINE OFFLINE plato1
OFFLINE OFFLINE plato2
ora.net1.network
ONLINE ONLINE plato1
ONLINE ONLINE plato2
ora.ons
ONLINE ONLINE plato1
ONLINE ONLINE plato2
Cluster Resources
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE plato2
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE plato1
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE plato1
ora.plato1.vip
1 ONLINE ONLINE plato1
ora.plato2.vip
1 ONLINE ONLINE plato2
ora.maxcv.db
1 ONLINE ONLINE plato2 Open
2 ONLINE ONLINE plato1 Open
ora.maxcv.maxcvuat.svc
1 OFFLINE UNKNOWN plato1
2 OFFLINE UNKNOWN plato1
ora.coscv.db
1 ONLINE ONLINE plato1 Open
2 ONLINE ONLINE plato2 Open
ora.coscv.coscvuat.svc
1 ONLINE UNKNOWN plato1
2 ONLINE UNKNOWN plato1
ora.oc4j
1 OFFLINE OFFLINE
ora.scan1.vip
1 ONLINE ONLINE plato2
ora.scan2.vip
1 ONLINE ONLINE plato1
ora.scan3.vip
1 ONLINE ONLINE plato1
plato2:/home/grid>Stopping of database:
plato2:/home/oracle>srvctl stop database -d maxcv
PRCD-1124 : Failed to stop database maxcv and its services
PRCR-1065 : Failed to stop resource (((((NAME STARTS_WITH ora.maxcv.) && (NAME ENDS_WITH .svc)) && (TYPE == ora.service.type)) && ((STATE != OFFLINE) || (TARGET != OFFLINE))) || (((NAME == ora.maxcv.db) && (TYPE == ora.database.type)) && (STATE != OFFLINE)))
CRS-2680: Clean of 'ora.maxcv.maxcvuat.svc' on 'plato1' failed
CRS-5807: Agent failed to process the message
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
CRS-2680: Clean of 'ora.maxcv.maxcvuat.svc' on 'plato1' failed
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
CRS-2675: Stop of 'ora.maxcv.db' on 'plato1' failed
CRS-2680: Clean of 'ora.maxcv.maxcvuat.svc' on 'plato1' failed
CRS-5807: Agent failed to process the message
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
CRS-2680: Clean of 'ora.maxcv.maxcvuat.svc' on 'plato1' failed
ORA-01031: insufficient privileges
ORA-01031: insufficient privileges
CRS-2675: Stop of 'ora.maxcv.db' on 'plato1' failed
plato2:/home/oracle>ps -ef |grep pmon
oracle 892946 1818664 0 09:30:35 pts/0 0:00 grep pmon
grid 1360080 1 0 Sep 06 - 1:23 asm_pmon_+ASM2
oracle 1376428 1 0 Sep 06 - 1:42 ora_pmon_coscv2
plato2:/home/oracle>Thanks -
I have a two-node RAC 10gR2 (10.2.0.3) running on SUN Solaris 9 SPARC on two SUN V440 servers with shared SCSI storage (SUN SE 3320) using Oracle Clusterware 10.2.0.3
The issue here is that the VIP resources on the two nodes dies repeatedly and restarted, it continues to go down then up within minutes.
The $CRS_HOME/log/node/racg folder have the VIP log files showing:
[1749][ora.node.vip]: created new logical interface ce1:1
[25428][1][ora.node.vip]: clsrcstartorp: Error with malloc
..... : failed to check interface ce1:1
Since the listener is listenning on the VIP and the client tnsnames.ora is using the VIP , the connection is not possible.
Any ideas if there is a patch or a setup issue?
also the file containsHi
Could you describe the commando you use to correct the gateway problem?
Thank you -
What is ora.oc4j service,why does my ora.oc4j service was OFFLINE
Hi,
Install oracle11g R2 RAC to window2008 64bit
The present situation,all of services was online,but target and status of ora.oc4j was OFFLINE
What is ora.oc4j service and how can I resolve this issue.
thank you.Hi all,
We have 11.2.0.2 set up running on AIX servers and we dont have exadata installed still its showing ORA.OC4J ONLINE ?
Can anyone please explain. Below is the output :
fcsprt@HBFCPRDDB1:/home/fcsprt/scripts$
fcsprt@HBFCPRDDB1:/home/fcsprt/scripts$ uname -a
AIX HBFCPRDDB1 1 6 00F62D884C00
fcsprt@HBFCPRDDB1:/home/fcsprt/scripts$
fcsprt@HBFCPRDDB1:/home/fcsprt/scripts$ crsctl stat res -t
NAME TARGET STATE SERVER STATE_DETAILS
Local Resources
ora.ARCHDG.dg
ONLINE ONLINE hbfcprddb1
ONLINE ONLINE hbfcprddb2
ora.DATADG.dg
ONLINE ONLINE hbfcprddb1
ONLINE ONLINE hbfcprddb2
ora.FLASHDG.dg
ONLINE ONLINE hbfcprddb1
ONLINE ONLINE hbfcprddb2
ora.LISTENER.lsnr
ONLINE ONLINE hbfcprddb1
ONLINE ONLINE hbfcprddb2
ora.OCRDG.dg
ONLINE ONLINE hbfcprddb1
ONLINE ONLINE hbfcprddb2
ora.asm
ONLINE ONLINE hbfcprddb1
ONLINE ONLINE hbfcprddb2 Started
ora.gsd
OFFLINE OFFLINE hbfcprddb1
OFFLINE OFFLINE hbfcprddb2
ora.net1.network
ONLINE ONLINE hbfcprddb1
ONLINE ONLINE hbfcprddb2
ora.ons
ONLINE ONLINE hbfcprddb1
ONLINE ONLINE hbfcprddb2
Cluster Resources
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE hbfcprddb1
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE hbfcprddb2
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE hbfcprddb2
ora.cvu
1 ONLINE ONLINE hbfcprddb2
ora.fcprdfcr.db
1 ONLINE ONLINE hbfcprddb1 Open
2 ONLINE ONLINE hbfcprddb2 Open
ora.fcprdfcr.fcprodnode1.svc
1 ONLINE ONLINE hbfcprddb1
ora.fcprdfcr.fcprodnode2.svc
1 ONLINE ONLINE hbfcprddb2
ora.hbfcprddb1.vip
1 ONLINE ONLINE hbfcprddb1
ora.hbfcprddb2.vip
1 ONLINE ONLINE hbfcprddb2
ora.oc4j
1 ONLINE ONLINE hbfcprddb2
ora.scan1.vip
1 ONLINE ONLINE hbfcprddb1
ora.scan2.vip
1 ONLINE ONLINE hbfcprddb2
ora.scan3.vip
1 ONLINE ONLINE hbfcprddb2
fcsprt@HBFCPRDDB1:/home/fcsprt/scripts$ -
All rac resource status is unknown only vip and asm is running fine
i have just install oracle 10g clusterware and oracle software on RHEL 5
only asm and vip is working fine ..rest of the resource not working status is unknown
[oracle@rac1 bin]$ ./crs_stat -t
Name Type Target State Host
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE UNKNOWN rac1
ora.rac1.gsd application ONLINE UNKNOWN rac1
ora.rac1.ons application ONLINE UNKNOWN rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE UNKNOWN rac2
ora.rac2.gsd application ONLINE UNKNOWN rac2
ora.rac2.ons application ONLINE UNKNOWN rac2
ora.rac2.vip application ONLINE ONLINE rac2
i tried to start is manually but its return error like this
[oracle@rac1 bin]$ ./crs_stop ora.rac1.LISTENER_RAC1.lsnr -f
Attempting to stop `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
Stop of `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` succeeded.
[oracle@rac1 bin]$ ./crs_start ora.rac1.LISTENER_RAC1.lsnr -f
Attempting to start `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
`ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
CRS-0215: Could not start resource 'ora.rac1.LISTENER_RAC1.lsnr'.
[oracle@rac1 bin]$ ./crs_start ora.rac1.LISTENER_RAC1.lsnr -f
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rac1.LISTENER_RAC1.lsnr'
CRS-0223: Resource 'ora.rac1.LISTENER_RAC1.lsnr' has placement error.
[oracle@rac1 bin]$ ./crs_start ora.rac2.LISTENER_RAC2.lsnr -f
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rac2.LISTENER_RAC2.lsnr'
CRS-0223: Resource 'ora.rac2.LISTENER_RAC2.lsnr' has placement error.
i reboot the system 3 times but problem is same plz help me to solve this problem...
Edited by: 969752 on 18-Dec-2012 00:33Hi
Using the srvctl cannot start/stop the resources ?
Please see:
CRS: Resource in UNKNOWN state [ID 845709.1]
Maybe you are looking for
-
Unable to establish connection with SQLServer from Java Application
Dear All, I am facing the issue of establishing connection with SQL Server from Java project developed in NWDS. I am writing a jaas plug-in, as a part of that I am writing a login module to authenticate a web application through jaas, and I got need
-
Packaging and distribution of EJBs - your opinion, please
Hello everyone, I am working on an EJB-based commercial product. When done, it will be deployable on a number of application servers that use different XML descriptor files, with different content. Initially, these will be JBoss, WebLogic and Sun ONE
-
Icons disappear in Cover Flow when window resized...
I created a custom folder icon for my Pixelmator projects, applied it to the folder, and all looked to be perfect. However, I later discovered that when I resized the Finder window and the icon grows larger in Coverflow, my icon disappears! This seem
-
CM Events not getting to a JDeveloper Application
Hi, I'm using the IFS/CM sdk on our site so that we may be notified of changes to files given certain conditions. I want to use waitServer() to wait on given conditions. We set up a demo on a Solaris box which works fine. The Solaris box is also wher
-
Best way to handle when Production XI is in outrage/down
Hi All, My production box is running smoothly now.If we want to go for any outrage and still we will be receiving many messages through internet from many partners. So we are expecting how to receive the messages when production XI is in outrage. My