Database starting on one node.

Hi All,
After reboot of server and ssh key gen. My RAC instance is running only on one node.
What can be problem?
Thanks.

Only you know what can be problem, because only you have valuable inforamation. :)
- Have you checked CRS-related logs?
- Have you checked Oracle alert log and related background process trace files?
If anything interesting found, post and let us know.

Similar Messages

  • Database instance on one node

    Hi
    Suppose i have two nodes in my RAC.
    Is it possible to have two differents instances of database in one of my node ?
    I mean for example, one instance for the test schema and one for the production schema ??
    Thanks for answer

    Hi
    I agree with you except that for the moment, we don't know if we can handle to buy one production RAC and one test RAC.
    So do u think having a production RAC and further dedicated test server can be a solution ?
    Sometimes, we have to put test data to the same level than production data.
    Today, we use snapshots with our bay, so it's very easy to populate a test server with fresh data.
    But rac means to use OCFS, Raw devices or ASM. And our test database don't use any of this storage type. It's just simple datafiles on JFS file system.
    So i asking myself how it is possible to save all objects of an instance cluster and duplicate it to our test database server ??

  • Oracle RAC 10g: ASM can't start in one node.

    Hi all,
    I succesfully installed RAC in Enterprise Linux. Node1 starts correctly (ASM and DB) but Node2 doesn´t. This is the error in Node2 when I try to startup de ASM instance:
    SQL> startup
    ASM instance started
    Total System Global Area 92274688 bytes
    Fixed Size 1217884 bytes
    Variable Size 65890980 bytes
    ASM Cache 25165824 bytes
    ORA-15032: not all alterations performed
    ORA-15130: diskgroup "DG1" is being dismounted
    ORA-15066: offlining disk "VOL1" may result in a data loss
    Any ideas?
    Thanks!

    Hi, you will must check the configuration of your shared storage, maybe the problem is there, you can verify the some log information in the clusterware layer, and you can find more information in the bdump directory of ASM Instance.
    Please paste here the alert logfile of ASM Instance.
    Luck.
    Have a good day.

  • Rac One Node on Rac Servers

    Hi Xperts
    We have this environment:
    2 Rac Nodes 11.2.0.3 Enterprise on Oracle Linux 5.9 . 
    We have one production Database on this Rac and the users ask to create two single instance on each node, something like this:
    Node1 -> Rac Prod1,  Single Test
    Node2-> Rac Prod2,  Single Dev
    I want to create Rac One node for those Database (Dev, Test) and create New Diskgroups for ech database.
    Can I install a Rac One node on those Server  with DBCA?
    Do I nedd to Install new Database Software ?
    Does the installed Rac have some affectation ?
    I just want to be sure about this procedure, before to do anything.
    Thank you
    J.A.

    Hi J.A.
    Yes you can! However you need to install Grid Infrastructure (GI) in cluster on both nodes, then install database software. Either during software installation or after that, DBCA would allow you to create 1) Single instance, 2) RAC database, 3) RAC One Node database. Keep in mind that RAC One Node is an option (additional license) to the Enterprise Edition of Oracle Database.
    I've talked on that topic at the Bulgarian Oracle Users Group at 2011, here is the link to the presentation, you may find it useful. I might upload the videos as well if you need to have something like a proof of concept of just for your own:
    http://sve.to/download/1112/
    Also I would go with one disk group for both databases, as long as they share the same physical disks I don't see the point of doing that ? Having one diskgroup would allow you to utilize better you disk/space resources.
    The procedure would be:
    1. Install GI in cluster.
    2. Install software libraries.
    3. Patch up to 11.2.0.4.
    4. Create RAC One Node database using either command line or using Custom Template of DBCA.
    At the end of the day, if you have standard edition license you can still install GI in cluster and create single instance databases on each server. The downside of doing that is that you need to manually failover the database to remaining node in case of disaster.
    Regards,
    Sve

  • Details regarding Oracle RAC One node.

    Hi
    I am trying to google regarding the Oracle RAC one node. But I couldnt get an exact details of it. I even tried in Metallink too. Could you guys please provide the link or Notes ID for this Oracle RAC one node which includes what is it ? How to set up this one node RAC etc etc !
    Thanks

    There are couple of notes ,
    http://www.oracle.com/us/products/database/options/rac-one-node/overview/index.html
    http://www.oracle.com/technetwork/products/clustering/overview/ds-rac-one-node-11gr2-185089.pdf
    http://download.oracle.com/docs/cd/E11882_01/rac.112/e16795/onenode.htm#BABGAJGH
    http://download.oracle.com/docs/cd/E11882_01/install.112/e17214/racinstl.htm#CIHGGAAE
    http://download.oracle.com/docs/cd/E11882_01/server.112/e17157/architectures.htm#CJAJEAGH
    Aman....

  • !! ORACM always FAILS one node - Oracle 9i rac -Sles9 - 9.2.0.8 ORACM

    Hi,
    I really need help with this. I applied all the patches possible. I tried sharing the quorum.dbf as a nfs device, raw device, iscsi lun ... i patched the ORACM to 9.2.0.5, 9.2.0.6, and now 9.2.0.8. The setup has two hp dl360 with sles9 sp2, x86_64 and oracle 9.2 rac...
    The problem is the cluster manager starts on one node. and when i run ./ocmstart.sh on the other node, it always fails. The CM.LOG file is pasted below. I get the same errors at all the patch levels. The quorum.dbf is setup as an iscsi lun on a netapp filer, which is then bounded to a raw device on the host. Whichever node i start the oracle cluster manager first, works and the other node always fails with the errors shown below.
    It also keeps complaining about InitializeCM: query_module() failed about the hangcheck timer. The hangcheck timer is already loaded and i can see it in /sbin/lsmod
    I would really appreciate help on this. This is my master's project at school and i cant graduate if this doesnt work. Please provide some guidance.
    thanks
    vishal
    CM.LOG
    tweedledum:/u01/app/oracle/product/920/oracm/log # cat cm.log
    oracm, version[ 9.2.0.8.0.01 ] started {Tue Feb 13 00:56:16 2007 }
    KernelModuleName is hangcheck-timer {Tue Feb 13 00:56:16 2007 }
    OemNodeConfig(): Network Address of node0: 1.1.1.3 (port 9998)
    {Tue Feb 13 00:56:16 2007 }
    OemNodeConfig(): Network Address of node1: 1.1.1.4 (port 9998)
    {Tue Feb 13 00:56:16 2007 }
    WARNING: OemInit2: Opened file(/oradata/quorum.dbf 6), tid = main:182900764192 file = oem.c, line = 503 {Tue Feb 13 00:56:16 2007 }InitializeCM: ModuleName = hangcheck-timer {Tue Feb 13 00:56:16 2007 }
    ClusterListener: Spawned with tid 0x4080e960 pid: 19662 {Tue Feb 13 00:56:16 2007 }
    ERROR: InitializeCM: query_module() failed, tid = main:182900764192 file = cmstartup.c, line = 341 {Tue Feb 13 00:56:16 2007 }Debug Hang : ClusterListener (PID=19662) Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    Debug Hang :StartNMMon (PID=19662) Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    Debug Hang : CmConnectListener (PID=19662):Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    CreateLocalEndpoint(): Network Address: 1.1.1.4
    {Tue Feb 13 00:56:16 2007 }
    PollingThread: Spawned with tid 0x40c10960. pid: 19662 {Tue Feb 13 00:56:16 2007 }
    Debug Hang :PollingThread (PID=19662): Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    SendingThread: Spawned with tid 0x41012960, 0x41012960. pid: 19662 {Tue Feb 13 00:56:16 2007 }
    DiskPingThread: Spawned with tid 0x40e11960. pid: 19662 {Tue Feb 13 00:56:16 2007 }
    Debug Hang : DiskPingThread (PID=19662): Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    Debug Hang :SendingThread (PID=19662): Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    UpdateNodeState(): node(1) added udpated {Tue Feb 13 00:56:19 2007 }
    HandleUpdate(): SYNC(1) from node(0) completed {Tue Feb 13 00:56:19 2007 }
    HandleUpdate(): NODE(0) IS ACTIVE MEMBER OF CLUSTER, INCARNATION(1) {Tue Feb 13 00:56:19 2007 }
    HandleUpdate(): NODE(1) IS ACTIVE MEMBER OF CLUSTER, INCARNATION(2) {Tue Feb 13 00:56:19 2007 }
    --- DUMP GROUP STATE DB ---
    --- END OF GROUP STATE DUMP ---
    --- Begin Dump ---
    oracm, version[ 9.2.0.8.0.01 ] started {Tue Feb 13 00:56:16 2007 }
    TRACE: LogListener: Spawned with tid 0x4060d960., tid = LogListener:1080088928 file = logging.c, line = 116 {Tue Feb 13 00:56:16 2007 }
    TRACE: Can't read registry value for HeartBeat, tid = main:182900764192 file = unixinc.c, line = 1080 {Tue Feb 13 00:56:16 2007 }
    TRACE: Can't read registry value for PollInterval, tid = main:182900764192 file = unixinc.c, line = 1080 {Tue Feb 13 00:56:16 2007 }
    TRACE: Can't read registry value for WatchdogTimerMargin, tid = main:182900764192 file = unixinc.c, line = 1080 {Tue Feb 13 00:56:16 2007 }
    TRACE: Can't read registry value for WatchdogSafetyMargin, tid = main:182900764192 file = unixinc.c, line = 1080 {Tue Feb 13 00:56:16 2007 }KernelModuleName is hangcheck-timer {Tue Feb 13 00:56:16 2007 }
    TRACE: Can't read registry value for ClientTimeout, tid = main:182900764192 file = unixinc.c, line = 1080 {Tue Feb 13 00:56:16 2007 }
    TRACE: InitNMInfo: setting clientTimeout to 140s based on MissCount 210 and PollInterval 1000ms, tid = main:182900764192 file = nmconfig.c, line = 138 {Tue Feb 13 00:56:16 2007 }
    TRACE: InitClusterDb(): getservbyname on CMSrvr failed - 0 : assigning 9998, tid = main:182900764192 file = nmconfig.c, line = 208 {Tue Feb 13 00:56:16 2007 }OemNodeConfig(): Network Address of node0: 1.1.1.3 (port 9998)
    {Tue Feb 13 00:56:16 2007 }
    OemNodeConfig(): Network Address of node1: 1.1.1.4 (port 9998)
    {Tue Feb 13 00:56:16 2007 }
    TRACE: OemCreateListenPort: bound at 9998, tid = main:182900764192 file = oem.c, line = 907 {Tue Feb 13 00:56:16 2007 }
    TRACE: InitClusterDb(): found my node info at 1 name tweedledum, priv int-dum, port 3623, tid = main:182900764192 file = nmconfig.c, line = 261 {Tue Feb 13 00:56:16 2007 }
    TRACE: InitClusterDb(): Local Node(1) NodeName[int-dum], tid = main:182900764192 file = nmconfig.c, line = 279 {Tue Feb 13 00:56:16 2007 }
    TRACE: InitClusterDb(): Cluster(Oracle) with (2) Defined Nodes, tid = main:182900764192 file = nmconfig.c, line = 282 {Tue Feb 13 00:56:16 2007 }
    TRACE: OEMInits(): CM Disk File (/oradata/quorum.dbf), tid = main:182900764192 file = oem.c, line = 248 {Tue Feb 13 00:56:16 2007 }
    WARNING: OemInit2: Opened file(/oradata/quorum.dbf 6), tid = main:182900764192 file = oem.c, line = 503 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(0) rcfg(1) wrtcnt(1171356979) lastcnt(0) alive(1171356979), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(1) rcfg(1) wrtcnt(180) lastcnt(0) alive(1), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(2) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(3) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(4) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(5) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(6) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(7) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(8) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(9) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(10) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(11) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(12) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(13) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(14) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(15) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(16) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(17) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(18) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(19) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(20) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(21) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(22) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(23) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(24) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(25) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(26) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(27) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(28) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(29) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(30) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(31) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(32) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(33) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(34) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(35) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(36) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(37) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(38) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(39) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(40) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(41) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(42) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(43) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(44) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(45) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(46) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(47) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(48) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(49) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(50) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(51) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(52) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(53) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(54) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(55) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(56) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(57) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(58) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(59) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(60) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(61) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(62) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }
    TRACE: ReadOthersDskInfo(): node(63) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:182900764192 file = oem.c, line = 1491 {Tue Feb 13 00:56:16 2007 }InitializeCM: ModuleName = hangcheck-timer {Tue Feb 13 00:56:16 2007 }
    ClusterListener: Spawned with tid 0x4080e960 pid: 19662 {Tue Feb 13 00:56:16 2007 }
    ERROR: InitializeCM: query_module() failed, tid = main:182900764192 file = cmstartup.c, line = 341 {Tue Feb 13 00:56:16 2007 }Debug Hang : ClusterListener (PID=19662) Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    TRACE: ClusterListener (pid=19662, tid=1082190176): Registered with watchdog daemon., tid = ClusterListener:1082190176 file = nmlistener.c, line = 76 {Tue Feb 13 00:56:16 2007 }
    TRACE: CmConnectListener: Spawned with tid 0x40a0f960., tid = CMConnectListerner:1084291424 file = cmclient.c, line = 216 {Tue Feb 13 00:56:16 2007 }Debug Hang :StartNMMon (PID=19662) Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    TRACE: StartNMMon (pid=19662, tid=-1782829536): Registered with watchdog daemon., tid = main:182900764192 file = cmnodemon.c, line = 254 {Tue Feb 13 00:56:16 2007 }Debug Hang : CmConnectListener (PID=19662):Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    TRACE: CmConnectListener (pid=19662, tid=1084291424): Registered with watchdog daemon., tid = CMConnectListerner:1084291424 file = cmclient.c, line = 247 {Tue Feb 13 00:56:16 2007 }CreateLocalEndpoint(): Network Address: 1.1.1.4
    {Tue Feb 13 00:56:16 2007 }
    TRACE: StartClusterJoin(): clusterState(0) nodeState(0), tid = main:182900764192 file = nmmember.c, line = 282 {Tue Feb 13 00:56:16 2007 }PollingThread: Spawned with tid 0x40c10960. pid: 19662 {Tue Feb 13 00:56:16 2007 }
    Debug Hang :PollingThread (PID=19662): Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    TRACE: PollingThread (pid=19662, tid=1086392672): Registered with watchdog daemon., tid = PollingThread:1086392672 file = nmmember.c, line = 765 {Tue Feb 13 00:56:16 2007 }SendingThread: Spawned with tid 0x41012960, 0x41012960. pid: 19662 {Tue Feb 13 00:56:16 2007 }
    DiskPingThread: Spawned with tid 0x40e11960. pid: 19662 {Tue Feb 13 00:56:16 2007 }
    Debug Hang : DiskPingThread (PID=19662): Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    TRACE: DiskPingThread (pid=19662, tid=1088493920): Registered with watchdog daemon., tid = DiskPingThread:1088493920 file = nmmember.c, line = 1083 {Tue Feb 13 00:56:16 2007 }Debug Hang :SendingThread (PID=19662): Registered with ORACM. {Tue Feb 13 00:56:16 2007 }
    TRACE: SendingThread (pid=19662, tid=1090595168): Registered with watchdog daemon., tid = SendingThread:1090595168 file = nmmember.c, line = 581 {Tue Feb 13 00:56:16 2007 }
    TRACE: HandleJoin(): src[1] dest[1] dom[0] seq[1] sync[0], tid = ClusterListener:1082190176 file = nmlisten.c, line = 346 {Tue Feb 13 00:56:16 2007 }
    TRACE: HandleJoin(): JOIN from node(1)->(1), tid = ClusterListener:1082190176 file = nmlisten.c, line = 362 {Tue Feb 13 00:56:16 2007 }
    TRACE: HandleStatus(): node(0) UNKNOWN, tid = ClusterListener:1082190176 file = nmlisten.c, line = 404 {Tue Feb 13 00:56:17 2007 }
    TRACE: HandleStatus(): src[0] dest[1] dom[0] seq[6] sync[1], tid = ClusterListener:1082190176 file = nmlisten.c, line = 415 {Tue Feb 13 00:56:17 2007 }
    TRACE: HandleSync(): src[0] dest[1] dom[0] seq[7] sync[1], tid = ClusterListener:1082190176 file = nmlisten.c, line = 506 {Tue Feb 13 00:56:17 2007 }
    TRACE: SendAck(): node(0) domain(0) syncSeqNo(1) type(11), tid = ClusterListener:1082190176 file = nmmember.c, line = 1922 {Tue Feb 13 00:56:17 2007 }
    TRACE: HandleVote(): src[0] dest[1] dom[0] seq[8] sync[1], tid = ClusterListener:1082190176 file = nmlisten.c, line = 643 {Tue Feb 13 00:56:18 2007 }
    TRACE: SendVoteInfo(): node(0) domain(0) syncSeqNo(1), tid = ClusterListener:1082190176 file = nmmember.c, line = 1736 {Tue Feb 13 00:56:18 2007 }
    TRACE: HandleUpdate(): src[0] dest[1] dom[0] seq[9] sync[1], tid = ClusterListener:1082190176 file = nmlisten.c, line = 849 {Tue Feb 13 00:56:19 2007 }
    TRACE: UpdateNodeState(): nodeNum 0, newState 2, tid = ClusterListener:1082190176 file = nmlisten.c, line = 1153 {Tue Feb 13 00:56:19 2007 }
    TRACE: UpdateNodeState(): nodeNum 1, newState 2, tid = ClusterListener:1082190176 file = nmlisten.c, line = 1153 {Tue Feb 13 00:56:19 2007 }UpdateNodeState(): node(1) added udpated {Tue Feb 13 00:56:19 2007 }
    TRACE: SendAck(): node(0) domain(0) syncSeqNo(1) type(15), tid = ClusterListener:1082190176 file = nmmember.c, line = 1922 {Tue Feb 13 00:56:19 2007 }
    TRACE: HandleUpdate(): about to QueueClientEvent 0, 1, tid = ClusterListener:1082190176 file = nmlisten.c, line = 960 {Tue Feb 13 00:56:19 2007 }
    TRACE: QueueClientEvent(): Sending Event(1) , tid = ClusterListener:1082190176 file = nmlisten.c, line = 1386 {Tue Feb 13 00:56:19 2007 }
    TRACE: QueueClientEvent: Node[0] state = 2, tid = ClusterListener:1082190176 file = nmlisten.c, line = 1390 {Tue Feb 13 00:56:19 2007 }
    TRACE: QueueClientEvent: Node[1] state = 2, tid = ClusterListener:1082190176 file = nmlisten.c, line = 1390 {Tue Feb 13 00:56:19 2007 }HandleUpdate(): SYNC(1) from node(0) completed {Tue Feb 13 00:56:19 2007 }
    TRACE: HandleUpdate: saving incarnation value as 2, tid = ClusterListener:1082190176 file = nmlisten.c, line = 983 {Tue Feb 13 00:56:19 2007 }
    HandleUpdate(): NODE(0) IS ACTIVE MEMBER OF CLUSTER, INCARNATION(1) {Tue Feb 13 00:56:19 2007 }
    HandleUpdate(): NODE(1) IS ACTIVE MEMBER OF CLUSTER, INCARNATION(2) {Tue Feb 13 00:56:19 2007 }
    TRACE: HandleStatus(): src[1] dest[1] dom[0] seq[2] sync[2], tid = ClusterListener:1082190176 file = nmlisten.c, line = 415 {Tue Feb 13 00:56:19 2007 }
    TRACE: StartNMMon(): attached as node 1, tid = main:182900764192 file = cmnodemon.c, line = 288 {Tue Feb 13 00:56:19 2007 }
    TRACE: StartNMMon: starting reconfig(2), tid = main:182900764192 file = cmnodemon.c, line = 395 {Tue Feb 13 00:56:19 2007 }
    TRACE: UpdateEventValue: *(bfffe1f0) = (1, 1), tid = main:182900764192 file = unixinc.c, line = 336 {Tue Feb 13 00:56:19 2007 }
    TRACE: UpdateEventValue: *(401bbeb0) = (3, 1), tid = main:182900764192 file = unixinc.c, line = 336 {Tue Feb 13 00:56:19 2007 }
    TRACE: ReconfigThread: started for reconfig (2), tid = Reconfig Thread:1092696416 file = cmnodemon.c, line = 180 {Tue Feb 13 00:56:19 2007 }NMEVENT_RECONFIG [00][00][00][00][00][00][00][03] {Tue Feb 13 00:56:19 2007 }
    TRACE: CleanupNodeContexts(): cleaning up nodes, rcfg(2), tid = Reconfig Thread:1092696416 file = cmnodemon.c, line = 671 {Tue Feb 13 00:56:19 2007 }
    TRACE: DisconnectNode(): about to disconnect 0, tid = Reconfig Thread:1092696416 file = cmipc.c, line = 851 {Tue Feb 13 00:56:19 2007 }
    TRACE: DisconnectNode(): waiting for 0 listeners to terminate, tid = Reconfig Thread:1092696416 file = cmipc.c, line = 874 {Tue Feb 13 00:56:19 2007 }
    TRACE: UpdateEventValue: *(401be778) = (0, 1), tid = Reconfig Thread:1092696416 file = unixinc.c, line = 336 {Tue Feb 13 00:56:19 2007 }
    TRACE: CleanupNodeContexts(): successful cleanup of nodes rcfg(2), tid = Reconfig Thread:1092696416 file = cmnodemon.c, line = 690 {Tue Feb 13 00:56:19 2007 }
    TRACE: EstablishMasterNode(): MASTER is node(0) reconfigs(2), tid = Reconfig Thread:1092696416 file = cmnodemon.c, line = 832 {Tue Feb 13 00:56:19 2007 }
    TRACE: IncrementEventValue: *(401b97c0) = (1, 1), tid = Reconfig Thread:1092696416 file = unixinc.c, line = 365 {Tue Feb 13 00:56:19 2007 }
    TRACE: PrepareForConnectsX: still waiting at (0), tid = PrepareForConnectsX:1094797664 file = cmipc.c, line = 279 {Tue Feb 13 00:56:19 2007 }
    TRACE: IncrementEventValue: *(401b97c0) = (2, 2), tid = PrepareForConnectsX:1094797664 file = unixinc.c, line = 365 {Tue Feb 13 00:56:19 2007 }--- End Dump ---

    Set the LD_ASSUME_KERNEL before starting the cluster manager:
    export LD_ASSUME_KERNEL=2.4.19
    export ORACLE_HOME=/oracle/app/oracle/product/9.2.0
    rm -f /oracle/app/oracle/product/9.2.0/oracm/log/cm.log
    rm -f /oracle/app/oracle/product/9.2.0/oracm/log/ocmstart.ts
    $ORACLE_HOME/oracm/bin/ocmstart.sh
    tail -f /oracle/app/oracle/product/9.2.0/oracm/log/cm.log

  • Trying out RAC one node on Windows

    Hi all,
    I have the Grid infrastructure software installed on a 64 bit windows server (standalone - not clustered). Was trying to install an 11g RAC enabled database on said server and it won't install as complains it is not a cluster.
    Is it possible to install a RAC enabled Database on a One node grid server that is not clustered to another node?
    Any help would be much appreciated as trying to get knowledge with GRID and RAC enabled instances.
    Edited by: user13735858 on 10-Feb-2011 06:26

    Hi,
    Thanks I installed "Real Application Clusters without Oracle Clusterware" for single standalone server - and it installed without issues.Have you installed Oracle RAC without Clusterware?
    There is some misunderstanding or you did not install Oracle RAC because Oracle Clusterware is a requirement for using Oracle RAC and it is the only clusterware that you need for most platforms on which Oracle RAC operates.
    Although Oracle RAC continues to support select third-party clusterware products on specific platforms, you must also install and use Oracle Clusterware.
    Oracle grid infrastructure for a standalone server does not support RAC.
    GI Standalone Server is intended to use feature Oracle Restart and Automatic Storage Management (ASM).
    The Oracle grid infrastructure for a standalone server is the Oracle software that provides system support for an Oracle database including volume management, file system, and automatic restart capabilities. If you plan to use Oracle Restart or Automatic Storage Management, you must install the grid infrastructure before installing your database.
    The grid infrastructure for a standalone server is the software that includes Oracle Restart and Automatic Storage Management. Oracle combined the two infrastructure products into a single set of binaries that is installed as the grid infrastructure home. The grid infrastructure should be installed before installing Oracle Database 11g Release 2.
    My question is does the server for one node have to be part of a cluster before you can install a RAC instance, even if you intend the instance to remain as one node RAC?1- You must Install and Configure Oracle Clusterware, even if it is only one node.
    2 - Install Oracle Software Database (RAC)
    3 - Create your RAC Database.
    RAC or RAC One Node must be configured on Oracle Clusterware.
    Regards,
    Levi Pereira
    Edited by: Levi Pereira on Feb 11, 2011 1:15 PM

  • Using RAC One Node as a primary database in a Data Guard configuration

    Is it possible to use RAC One Node as a primary database in a Data Guard configuration ?
    Oracle doc states: "Supports Oracle Data Guard such that you can run physical or logical standby databases on it or even we can NOT run primary databases on it either if the primary databases have DG"
    I guess it is not possible but can you folks confirm?
    Alessio

    Hmmm.... still unclear.
    I've submitted a comment which the documentation team should pick up :
    "+This sentence : "Supports Oracle Data Guard such that you can run physical or logical standby databases on it or even we can NOT run primary databases on it either if the primary databases have DG"+
    +is not very clear.+
    +I can understand it upto the words "on it" but the second part of the sentence, beginning with "or even we can NOT ..." seems mangled and unclear.+
    +Can you clarify whether RAC One Node can be used as :+
    +a. A Primary in a DataGuard configuration+
    +b. A Standby in a DataGuard configuration ?+"
    Hemant K Chitale

  • HPUX RAC ASM database crashed after pulling all FC cables on one node.

    On the node without any FC cables, syslog shows "rebooting host for integrity". On the good node:
    Wed Mar 31 13:42:47 2010
    Errors in file /opt/oracle/admin/asmdb/bdump/asmdb2_p000_7175.trc:
    ORA-00600: internal error code, arguments: [kclchkrcv_2], [0], [6796576], [], []
    Wed Mar 31 13:42:49 2010
    Errors in file /opt/oracle/admin/asmdb/bdump/asmdb2_p000_7175.trc:
    ORA-01578: ORACLE data block corrupted (file # 2, block # 89)
    ORA-01110: data file 2: '+MYDG1/asmdb/datafile/undotbs1.262.714408035'
    ORA-10564: tablespace UNDOTBS1
    ORA-01110: data file 2: '+MYDG1/asmdb/datafile/undotbs1.262.714408035'
    ORA-10560: block type 'KTU SMU HEADER BLOCK'
    ORA-00600: internal error code, arguments: [kclchkrcv_2], [0], [6796576], [], []
    Wed Mar 31 13:42:49 2010
    Errors in file /opt/oracle/admin/asmdb/bdump/asmdb2_dbw0_5108.trc:
    ORA-00600: internal error code, arguments: [kclrdone_4], [0], [6796576], [], [],
    Wed Mar 31 13:42:51 2010
    Errors in file /opt/oracle/admin/asmdb/bdump/asmdb2_dbw0_5108.trc:
    ORA-00600: internal error code, arguments: [kclrdone_4], [0], [6796576], [], [],
    Wed Mar 31 13:42:51 2010
    DBW0: terminating instance due to error 471
    Wed Mar 31 13:42:51 2010
    Errors in file /opt/oracle/admin/asmdb/bdump/asmdb2_lms0_5097.trc:
    ORA-00471: DBWR process terminated with error
    Wed Mar 31 13:42:51 2010
    Errors in file /opt/oracle/admin/asmdb/bdump/asmdb2_lms1_5099.trc:
    ORA-00471: DBWR process terminated with error
    Wed Mar 31 13:42:51 2010
    Errors in file /opt/oracle/admin/asmdb/bdump/asmdb2_lmon_5093.trc:
    ORA-00471: DBWR process terminated with error
    Instance terminated by DBW0, pid = 5108
    Wed Mar 31 13:43:15 2010

    The loss of one node from the cluster, should not impact another node. Pulling the FC cables on one node, should have no bearing and no impact at all on the other nodes in that RAC.
    Unless by that action, the FC gateway/switch somehow goes pear shape as a result - and starts to push gunk and not the actual data from the storage system.

  • One node is up but when we start the crs on node 2 then ASM instance killed.

    Hi Friends
    i am facing below strange problem
    one node is up but when we start the crs on node 2 then ASM instance killed. i found that one ip 169.254.98.19 is binding with private interconnect IP rathter than assigned IP.
    Please help me

    Hi Pradeep ,
    Oracle S/W verstion is 11.2.0.3. Actually , we start the CRS and DB on node 1 but when we try to start on node 2 , getting below error.
    [gpnpd(18284748)]CRS-2328:GPNPD started on node ggnetp04.
    2013-09-03 19:48:29.162
    [cssd(17694820)]CRS-1713:CSSD daemon is started in clustered mode
    2013-09-03 19:48:30.557
    [ohasd(13697160)]CRS-2767:Resource state recovery not attempted for 'ora.diskmon' as its target state is OFFLINE
    2013-09-03 19:48:41.013
    [cssd(17694820)]CRS-1707:Lease acquisition for node ggnetp04 number 2 completed
    2013-09-03 19:48:42.490
    [cssd(17694820)]CRS-1605:CSSD voting file is online: /dev/rhdiskpower0; details in /opt/app/11.2.0.3/grid/log/ggnetp04/cssd/ocssd.log.
    2013-09-03 19:48:45.483
    [cssd(17694820)]CRS-1601:CSSD Reconfiguration complete. Active nodes are ggnetp03 ggnetp04 .
    2013-09-03 19:48:47.257
    [ctssd(18022612)]CRS-2403:The Cluster Time Synchronization Service on host ggnetp04 is in observer mode.
    2013-09-03 19:48:47.632
    [ctssd(18022612)]CRS-2407:The new Cluster Time Synchronization Service reference node is host ggnetp03.
    2013-09-03 19:48:47.633
    [ctssd(18022612)]CRS-2401:The Cluster Time Synchronization Service started on host ggnetp04.
    [client(16056466)]CRS-10001:03-Sep-13 19:48 ACFS-9391: Checking for existing ADVM/ACFS installation.
    [client(16056468)]CRS-10001:03-Sep-13 19:48 ACFS-9392: Validating ADVM/ACFS installation files for operating system.
    [client(16056470)]CRS-10001:03-Sep-13 19:48 ACFS-9393: Verifying ASM Administrator setup.
    [client(16056472)]CRS-10001:03-Sep-13 19:48 ACFS-9308: Loading installed ADVM/ACFS drivers.
    [client(16056478)]CRS-10001:03-Sep-13 19:48 ACFS-9154: Loading 'oracleadvm.ext' driver.
    [client(16056486)]CRS-10001:03-Sep-13 19:48 ACFS-9154: Loading 'oracleacfs.ext' driver.
    [client(16056494)]CRS-10001:03-Sep-13 19:48 ACFS-9327: Verifying ADVM/ACFS devices.
    [client(16056498)]CRS-10001:03-Sep-13 19:48 ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'.
    [client(16056504)]CRS-10001:03-Sep-13 19:48 ACFS-9156: Detecting control device '/dev/ofsctl'.
    [client(16056508)]CRS-10001:03-Sep-13 19:48 ACFS-9322: completed
    2013-09-03 19:48:59.667
    [ctssd(18022612)]CRS-2409:The clock on host ggnetp04 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
    2013-09-03 19:50:53.936
    [cssd(17694820)]CRS-1662:Member kill requested by node ggnetp03 for member number 1, group DB+ASM
    2013-09-03 19:50:57.493
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:50:57.494
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log"
    2013-09-03 19:50:58.828
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:50:58.943
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:50:59.235
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:53:00.252
    [cssd(17694820)]CRS-1662:Member kill requested by node ggnetp03 for member number 1, group DB+ASM
    2013-09-03 19:53:03.101
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:53:03.102
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log"
    2013-09-03 19:53:05.430
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:53:05.539
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:53:05.815
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:55:07.436
    [cssd(17694820)]CRS-1662:Member kill requested by node ggnetp03 for member number 1, group DB+ASM
    2013-09-03 19:55:09.673
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:55:09.674
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5011:Check of resource "+ASM" failed: details at "(:CLSN00006:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log"
    2013-09-03 19:55:12.007
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:55:12.115
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:55:12.389
    [/opt/app/11.2.0.3/grid/bin/oraagent.bin(16777322)]CRS-5019:All OCR locations are on ASM disk groups [DATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/opt/app/11.2.0.3/grid/log/ggnetp04/agent/ohasd/oraagent_grid/oraagent_grid.log".
    2013-09-03 19:55:12.405
    [ohasd(13697160)]CRS-2807:Resource 'ora.asm' failed to start automatically.
    2013-09-03 19:55:12.405
    [ohasd(13697160)]CRS-2807:Resource 'ora.crsd' failed to start automatically.
    2013-09-03 20:23:32.040
    [ctssd(18022612)]CRS-2409:The clock on host ggnetp04 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.

  • Ocmstart.sh is not starting in one RAC node

    I am having a trouble starting "oracm" on one node. I can see it is working on second node but not on first node. Is there any one haveing the same issue.

    Hi Chandra Sorry for the delay, I got the output from cm.out file during restart of ocmstart.sh script
    =========================================================
    TRACE: HandleJoin(): JOIN from node(1)->(1), tid = ClusterListener:3076 file = nmlisten.c, line = 362 {Thu Apr 10 21:39:10 2003 }
    TRACE: HandleStatus(): node(0) UNKNOWN, tid = ClusterListener:3076 file = nmlisten.c, line = 404 {Thu Apr 10 21:39:11 2003 }
    TRACE: HandleStatus(): src[0] dest[1] dom[0] seq[33] sync[10], tid = ClusterListener:3076 file = nmlisten.c, line = 415 {Thu Apr 10 21:39:11 2003 }
    TRACE: HandleSync(): src[0] dest[1] dom[0] seq[34] sync[10], tid = ClusterListener:3076 file = nmlisten.c, line = 506 {Thu Apr 10 21:39:11 2003 }
    TRACE: SendAck(): node(0) domain(0) syncSeqNo(10) type(11), tid = ClusterListener:3076 file = nmmember.c, line = 1913 {Thu Apr 10 21:39:11 2003 }
    TRACE: HandleVote(): src[0] dest[1] dom[0] seq[35] sync[10], tid = ClusterListener:3076 file = nmlisten.c, line = 643 {Thu Apr 10 21:39:12 2003 }
    TRACE: SendVoteInfo(): node(0) domain(0) syncSeqNo(10), tid = ClusterListener:3076 file = nmmember.c, line = 1727 {Thu Apr 10 21:39:12 2003 }
    TRACE: HandleShutdown(): src[0] dest[1] dom[0] seq[0] sync[10] type[4], tid = ClusterListener:3076 file = nmlisten.c, line = 1087 {Thu Apr 10 21:39:13 2003 }
    TRACE: IncrementEventValue: *(80f2920) = (1, 1), tid = ClusterListener:3076 file = unixinc.c, line = 253 {Thu Apr 10 21:39:13 2003 }--- End Dump ---
    oracm, version[ 9.2.0.2.0.47 ] started {Thu Apr 10 21:40:07 2003 }
    KernelModuleName is hangcheck-timer {Thu Apr 10 21:40:07 2003 }
    OemNodeConfig(): Network Address of node0: 192.168.0.50 (port 9998)
    {Thu Apr 10 21:40:07 2003 }
    OemNodeConfig(): Network Address of node1: 192.168.0.51 (port 9998)
    {Thu Apr 10 21:40:07 2003 }
    WARNING: OemInit2: Opened file(/var/opt/oracle/oradata/orcl/CMQuorumFile 8), tid = main:1024 file = oem.c, line = 491 {Thu Apr 10 21:40:07 2003 }Debug Hang : ClusterListener (PID=2541) Registered withwatchdog daemon. {Thu Apr 10 21:40:09 2003 }
    InitializeCM: ModuleName = hangcheck-timer {Thu Apr 10 21:40:09 2003 }
    InitializeCM: Kernel module hangcheck-timer is already loaded {Thu Apr 10 21:40:09 2003 }
    Debug Hang : CmConnectListener (PID=2542):Registered with watchdog daemon. {Thu Apr 10 21:40:09 2003 }
    Debug Hang :StartNMMon (PID=2536) Registered with watchdog daemon. {Thu Apr 10 21:40:09 2003 }
    CreateLocalEndpoint(): Network Address: 192.168.0.51
    {Thu Apr 10 21:40:09 2003 }
    Debug Hang :PollingThread (PID=135159169): Registered with {Thu Apr 10 21:40:09 2003 }
    Debug Hang : DiskPingThread (PID=135159169): Registered with {Thu Apr 10 21:40:09 2003 }
    Debug Hang :SendingThread (PID=135159169): Registered with {Thu Apr 10 21:40:09 2003 }
    --- DUMP GROUP STATE DB ---
    --- END OF GROUP STATE DUMP ---
    --- Begin Dump ---
    TRACE: LogListener: Spawned with tid 0x803., tid = 2051 file = logging.c, line = 116 {Thu Apr 10 21:40:07 2003 }oracm, version[ 9.2.0.2.0.47 ] started {Thu Apr 10 21:40:07 2003 }
    TRACE: Can't read registry value for WatchdogTimerMargin, tid = main:1024 file = unixinc.c, line = 1011 {Thu Apr 10 21:40:07 2003 }
    TRACE: Can't read registry value for WatchdogSafetyMargin, tid = main:1024 file = unixinc.c, line = 1011 {Thu Apr 10 21:40:07 2003 }KernelModuleName is hangcheck-timer {Thu Apr 10 21:40:07 2003 }
    TRACE: Can't read registry value for ClientTimeout, tid = main:1024 file = unixinc.c, line = 1011 {Thu Apr 10 21:40:07 2003 }
    TRACE: InitNMInfo: setting clientTimeout to 215s based on MissCount 215 and PollInterval 1000ms, tid = main:1024 file = nmconfig.c, line = 137 {Thu Apr 10 21:40:07 2003 }
    TRACE: InitClusterDb(): getservbyname on CMSrvr failed - 22 : assigning 9998, tid = main:1024 file = nmconfig.c, line = 212 {Thu Apr 10 21:40:07 2003 }OemNodeConfig(): Network Address of node0: 192.168.0.50 (port 9998)
    {Thu Apr 10 21:40:07 2003 }
    OemNodeConfig(): Network Address of node1: 192.168.0.51 (port 9998)
    {Thu Apr 10 21:40:07 2003 }
    TRACE: OemCreateListenPort: bound at 9998, tid = main:1024 file = oem.c, line = 858 {Thu Apr 10 21:40:07 2003 }
    TRACE: InitClusterDb(): found my node info at 1 name rac2, priv rac2priv, port 3623, tid = main:1024 file = nmconfig.c, line = 265 {Thu Apr 10 21:40:07 2003 }
    TRACE: InitClusterDb(): Local Node(1) NodeName[rac2], tid = main:1024 file = nmconfig.c, line = 283 {Thu Apr 10 21:40:07 2003 }
    TRACE: InitClusterDb(): Cluster(Oracle) with (2) Defined Nodes, tid = main:1024 file = nmconfig.c, line = 286 {Thu Apr 10 21:40:07 2003 }
    TRACE: OEMInits(): CM Disk File (/var/opt/oracle/oradata/orcl/CMQuorumFile), tid = main:1024 file = oem.c, line = 243 {Thu Apr 10 21:40:07 2003 }
    WARNING: OemInit2: Opened file(/var/opt/oracle/oradata/orcl/CMQuorumFile 8), tid = main:1024 file = oem.c, line = 491 {Thu Apr 10 21:40:07 2003 }
    TRACE: ReadOthersDskInfo(): node(0) rcfg(11) wrtcnt(1052) lastcnt(0) alive(1052), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(1) rcfg(10) wrtcnt(2) lastcnt(0) alive(1), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(2) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(3) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(4) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(5) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(6) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(7) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(8) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(9) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(10) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(11) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(12) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(13) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(14) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(15) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(16) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(17) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(18) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(19) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(20) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(21) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(22) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(23) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(24) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(25) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(26) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(27) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(28) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(29) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(30) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(31) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(32) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(33) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(34) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(35) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(36) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(37) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(38) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(39) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(40) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(41) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(42) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(43) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(44) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(45) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(46) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(47) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(48) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(49) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(50) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(51) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(52) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(53) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(54) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(55) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(56) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(57) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(58) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(59) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(60) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(61) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(62) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ReadOthersDskInfo(): node(63) rcfg(0) wrtcnt(0) lastcnt(0) alive(0), tid = main:1024 file = oem.c, line = 1442 {Thu Apr 10 21:40:09 2003 }
    TRACE: ClusterListener: Spawned with tid 0xc04., tid = 3076 file = nmlistener.c, line = 53 {Thu Apr 10 21:40:09 2003 }Debug Hang : ClusterListener (PID=2541) Registered withwatchdog daemon. {Thu Apr 10 21:40:09 2003 }
    TRACE: ClusterListener (pid=2541, tid=3076): Registered with watchdog daemon., tid = 3076 file = nmlistener.c, line = 75 {Thu Apr 10 21:40:09 2003 }InitializeCM: ModuleName = hangcheck-timer {Thu Apr 10 21:40:09 2003 }
    InitializeCM: Kernel module hangcheck-timer is already loaded {Thu Apr 10 21:40:09 2003 }
    TRACE: CmConnectListener: Spawned with tid 0x1005., tid = 4101 file = cmclient.c, line = 215 {Thu Apr 10 21:40:09 2003 }Debug Hang : CmConnectListener (PID=2542):Registered with watchdog daemon. {Thu Apr 10 21:40:09 2003 }
    TRACE: CmConnectListener (pid=2542, tid=4101): Registered with watchdog daemon., tid = 4101 file = cmclient.c, line = 246 {Thu Apr 10 21:40:09 2003 }Debug Hang :StartNMMon (PID=2536) Registered with watchdog daemon. {Thu Apr 10 21:40:09 2003 }
    TRACE: StartNMMon (pid=2536, tid=1024): Registered with watchdog daemon., tid = main:1024 file = cmnodemon.c, line = 251 {Thu Apr 10 21:40:09 2003 }CreateLocalEndpoint(): Network Address: 192.168.0.51
    {Thu Apr 10 21:40:09 2003 }
    TRACE: StartClusterJoin(): clusterState(0) nodeState(0), tid = main:1024 file = nmmember.c, line = 277 {Thu Apr 10 21:40:09 2003 }
    TRACE: PollingThread: Spawned with tid 0x1406., tid = 5126 file = nmmember.c, line = 742 {Thu Apr 10 21:40:09 2003 }Debug Hang :PollingThread (PID=135159169): Registered with {Thu Apr 10 21:40:09 2003 }
    TRACE: PollingThread (pid=2543, tid=5126): Registered with watchdog daemon., tid = 5126 file = nmmember.c, line = 760 {Thu Apr 10 21:40:09 2003 }
    TRACE: DiskPingThread: Spawned with tid 0x1807., tid = 6151 file = nmmember.c, line = 1050 {Thu Apr 10 21:40:09 2003 }Debug Hang : DiskPingThread (PID=135159169): Registered with {Thu Apr 10 21:40:09 2003 }
    TRACE: DiskPingThread (pid=2544, tid=6151): Registered with watchdog daemon., tid = 6151 file = nmmember.c, line = 1074 {Thu Apr 10 21:40:09 2003 }
    TRACE: SendingThread: Spawned with tid 0x1c08, 0x0., tid = 7176 file = nmmember.c, line = 511 {Thu Apr 10 21:40:09 2003 }Debug Hang :SendingThread (PID=135159169): Registered with {Thu Apr 10 21:40:09 2003 }
    TRACE: SendingThread (pid=2545, tid=7176): Registered with watchdog daemon., tid = 7176 file = nmmember.c, line = 576 {Thu Apr 10 21:40:09 2003 }
    TRACE: HandleJoin(): src[1] dest[1] dom[0] seq[1] sync[0], tid = ClusterListener:3076 file = nmlisten.c, line = 346 {Thu Apr 10 21:40:09 2003 }
    TRACE: HandleJoin(): JOIN from node(1)->(1), tid = ClusterListener:3076 file = nmlisten.c, line = 362 {Thu Apr 10 21:40:09 2003 }
    TRACE: HandleStatus(): node(0) UNKNOWN, tid = ClusterListener:3076 file = nmlisten.c, line = 404 {Thu Apr 10 21:40:10 2003 }
    TRACE: HandleStatus(): src[0] dest[1] dom[0] seq[36] sync[11], tid = ClusterListener:3076 file = nmlisten.c, line = 415 {Thu Apr 10 21:40:10 2003 }
    TRACE: HandleSync(): src[0] dest[1] dom[0] seq[37] sync[11], tid = ClusterListener:3076 file = nmlisten.c, line = 506 {Thu Apr 10 21:40:10 2003 }
    TRACE: SendAck(): node(0) domain(0) syncSeqNo(11) type(11), tid = ClusterListener:3076 file = nmmember.c, line = 1913 {Thu Apr 10 21:40:10 2003 }
    TRACE: HandleVote(): src[0] dest[1] dom[0] seq[38] sync[11], tid = ClusterListener:3076 file = nmlisten.c, line = 643 {Thu Apr 10 21:40:11 2003 }
    TRACE: SendVoteInfo(): node(0) domain(0) syncSeqNo(11), tid = ClusterListener:3076 file = nmmember.c, line = 1727 {Thu Apr 10 21:40:11 2003 }
    TRACE: HandleShutdown(): src[0] dest[1] dom[0] seq[0] sync[11] type[4], tid = ClusterListener:3076 file = nmlisten.c, line = 1087 {Thu Apr 10 21:40:12 2003 }
    TRACE: IncrementEventValue: *(80f2920) = (1, 1), tid = ClusterListener:3076 file = unixinc.c, line = 253 {Thu Apr 10 21:40:12 2003 }--- End Dump ---
    =========================================================

  • Oracle 10gR2 RAC EE 10.2.0.5 problem with one node.

    Hi, I have an Oracle Rac 10gR2 10.2.0.5 EE on SLES 10 on ibm ppc. My problem is that in crs don't appear that database is start in one instance. However the database is start when I use srvctl or sqlplus
    crsctl query crs softwareversion
    CRS active version on the cluster is [10.2.0.5.0]
    crsctl query crs activeversion
    CRS active version on the cluster is [10.2.0.5.0]
    oracle@agripa:/u01/oracle/app/product/102_64/crs/bin> ./srvctl config database
    ELIO3
    oracle@agripa:/u01/oracle/app/product/102_64/crs/bin> ./srvctl status database -d ELIO3
    La instancia ELIO32 se está ejecutando en el nodo julia
    La instancia ELIO31 no se está ejecutando en el nodo agripa
    agripa:/u01/oracle/app/product/102_64/crs/bin # ./crs_stat -t
    Nombre         Tipo           Destino   Estado    Host
    ora....31.inst application    ONLINE    OFFLINE
    ora....32.inst application    ONLINE    ONLINE    julia
    ora.ELIO3.db   application    ONLINE    ONLINE    julia
    ora....PA.lsnr application    ONLINE    OFFLINE
    ora....PA.lsnr application    ONLINE    OFFLINE
    ora.agripa.gsd application    ONLINE    OFFLINE
    ora.agripa.ons application    ONLINE    OFFLINE
    ora.agripa.vip application    ONLINE    ONLINE    agripa
    ora....IA.lsnr application    ONLINE    ONLINE    julia
    ora.julia.gsd  application    ONLINE    ONLINE    julia
    ora.julia.ons  application    ONLINE    ONLINE    julia
    ora.julia.vip  application    ONLINE    ONLINE    julia
    oracle@agripa:/u01/oracle/app/product/102_64/app/bin> ./srvctl start instance -d ELIO3 -i ELIO31
    PRKP-1001 : Error al iniciar la instancia ELIO31 en el nodo agripaThis command show an error, however the database is up.
    oracle@agripa:/u01/oracle/app/product/102_64/app/bin> sqlplus / as sysdba
    SQL*Plus: Release 10.2.0.5.0 - Production on Mié Sep 26 09:32:25 2012
    Copyright (c) 1982, 2010, Oracle.  All Rights Reserved.
    Conectado a:
    Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - Production
    With the Partitioning, Real Application Clusters, OLAP, Data Mining
    and Real Application Testing options
    SQL> select * from v$active_instances;
    INST_NUMBER INST_NAME
              2 julia:ELIO32
              4 agripa:ELIO31
    SQL>But crs, don't show it.
    agripa:/u01/oracle/app/product/102_64/crs/bin # ./crs_stat -t
    Nombre         Tipo           Destino   Estado    Host
    ora....31.inst application    ONLINE    OFFLINE
    ora....32.inst application    ONLINE    ONLINE    julia
    ora.ELIO3.db   application    ONLINE    ONLINE    julia
    ora....PA.lsnr application    ONLINE    OFFLINE
    ora....PA.lsnr application    ONLINE    OFFLINE
    ora.agripa.gsd application    ONLINE    OFFLINE
    ora.agripa.ons application    ONLINE    OFFLINE
    ora.agripa.vip application    ONLINE    ONLINE    agripa
    ora....IA.lsnr application    ONLINE    ONLINE    julia
    ora.julia.gsd  application    ONLINE    ONLINE    julia
    ora.julia.ons  application    ONLINE    ONLINE    julia
    ora.julia.vip  application    ONLINE    ONLINE    juliaSome logs...
    oracle@agripa:/u01/oracle/app/product/102_64/app/log/agripa/racg> cat ora.ELIO3.ELIO31.inst.log
    2012-09-26 09:35:45.108: [ COMMCRS][53473856]clsc_connect: (0x40002a0a6c0) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2012-09-26 09:36:15.150: [    RACG][173648] [2346][173648][ora.ELIO3.ELIO31.inst]: end for resource = ora.ELIO3.ELIO31.inst, action = rundetach, status = -1, time = 300.600s
    agripa:/u01/oracle/app/product/102_64/crs/bin # ls -ltrach /var/tmp/.oracle/
    total 512
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 08:28 sagripaDBG_CSSD
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 08:28 sOracle_CSS_LclLstnr_crs_3
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 08:28 sOCSSD_LL_agripa_crs
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 08:28 sagripaDBG_EVMD
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 08:28 sCagripa_crs_evm
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 08:28 sAagripa_crs_evm
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 09:46 s#3633.2
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 09:46 s#3633.1
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 10:00 s#11308.1
    srwxrwxrwx 1 oracle oinstall   0 2012-09-24 10:03 s#11308.2
    drwxrwxrwt 8 root   root     232 2012-09-26 09:24 ..
    srwxrwxrwx 1 oracle oinstall   0 2012-09-26 09:30 sora_racg_ELIO3_agripa
    srwxrwxrwx 1 oracle oinstall   0 2012-09-26 09:35 sSYSTEM.evm.acceptor.auth
    srwxrwxrwx 1 root   root       0 2012-09-26 09:35 sagripaDBG_CRSD
    srwxrwxrwx 1 root   root       0 2012-09-26 09:40 sCRSD_UI_SOCKET
    srwxrwxrwx 1 root   root       0 2012-09-26 09:45 sora_crsqs
    srwxrwxrwx 1 root   root       0 2012-09-26 09:45 sprocr_local_conn_0_PROC
    srwxrwxrwx 1 oracle oinstall   0 2012-09-26 09:45 sOCSSD_LL_agripa_
    drwxrwxrwt 2 root   root     640 2012-09-26 09:45 .
    oracle@agripa:/u01/oracle/app/product/102_64/app/log/agripa/racg> cat imon_ELIO3.log
    2012-09-26 09:30:41.047: [    RACG][173648] [1100][173648][ora.ELIO3.ELIO31.inst]: racgimon started
    2012-09-26 09:31:06.174: [    RACG][70660672] [1100][70660672][ora.ELIO3.ELIO31.inst]:
    SQL*Plus: Release 10.2.0.5.0 - Production on Wed Sep 26 09:30:42 2012
    Copyright (c) 1982, 2010, Oracle.  All Rights Reserved.
    Enter user-name: Connected to an idle instance.
    SQL> ORACLE instance started.
    Total System Global Area 8589934592 bytes
    2012-09-26 09:31:06.174: [    RACG][70660672] [1100][70660672][ora.ELIO3.ELIO31.inst]: Fixed Size                   2109992 bytes
    Variable Size            1358958040 bytes
    Database Buffers         7214202880 bytes
    Redo Buffers               14663680 bytes
    Base de datos montada.
    Base de datos abierta.
    2012-09-26 09:31:06.174: [    RACG][70660672] [1100][70660672][ora.ELIO3.ELIO31.inst]: SQL> Desconectado de Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - Production
    With the Partitioning, Real Application Clusters, OLAP, Data Mining
    and Real Application Testing options
    2012-09-26 09:31:06.404: [    RACG][70660672] [1100][70660672][ora.ELIO3.ELIO31.inst]: clsrcexecut: env _USR_ORA_PFILE=/u01/oracle/app/product/102_64/crs/racg/tmp/ora.ELIO3.ELIO31.inst.ora
    2012-09-26 09:31:06.404: [    RACG][70660672] [1100][70660672][ora.ELIO3.ELIO31.inst]: clsrcexecut: cmd = /u01/oracle/app/product/102_64/app/bin/racgeut -e _USR_ORA_DEBUG=0 -e ORACLE_SID=ELIO31 540 /u01/oracle/app/product/102_64/app/bin/racgmdb -q
    2012-09-26 09:31:06.404: [    RACG][70660672] [1100][70660672][ora.ELIO3.ELIO31.inst]: clsrcexecut: rc = 3, time = 0.230s
    2012-09-26 09:31:07.196: [  OCRMSG][70660672]prom_rpc: CLSC send failure..ret code 11
    2012-09-26 09:31:07.196: [  OCRMSG][70660672]prom_rpc: possible OCR retry scenario
    2012-09-26 09:31:07.254: [  OCRAPI][70660672]procr_open: Node Failure. Attempting retry #0
    2012-09-26 09:31:07.528: [  OCRCLI][70660672]oac_reconnect_server: Could not connect to server. clsc ret 9
    2012-09-26 09:31:07.584: [  OCRAPI][70660672]procr_open: Node Failure. Attempting retry #1
    2012-09-26 09:31:07.847: [  OCRCLI][70660672]oac_reconnect_server: Could not connect to server. clsc ret 9
    2012-09-26 09:31:07.904: [  OCRAPI][70660672]procr_open: Node Failure. Attempting retry #2
    2012-09-26 09:31:08.178: [  OCRCLI][70660672]oac_reconnect_server: Could not connect to server. clsc ret 9
    2012-09-26 09:31:08.235: [  OCRAPI][70660672]procr_open: Node Failure. Attempting retry #3
    2012-09-26 09:31:08.488: [  OCRCLI][70660672]oac_reconnect_server: Could not connect to server. clsc ret 9
    2012-09-26 09:31:08.544: [  OCRAPI][70660672]procr_open: Node Failure. Attempting retry #4
    2012-09-26 09:31:08.808: [  OCRCLI][70660672]oac_reconnect_server: Could not connect to server. clsc ret 9
    2012-09-26 09:31:08.865: [  OCRAPI][70660672]procr_open: Node Failure. Attempting retry #5
    2012-09-26 09:31:08.971: [    RACG][70660672] [1100][70660672][ora.ELIO3.ELIO31.inst]: clsrcsetenvvar: set env var 'ORACLE_CONFIG_HOME' to be '/u01/oracle/app/product/102_64/crs/'
    2012-09-26 09:31:09.767: [    RACG][70660672] [1100][70660672][ora.ELIO3.ELIO31.inst]: clsrcqryapi: crs_qstat error
    2012-09-26 09:36:14.709: [  OCRMSG][148804160]prom_rpc: CLSC send failure..ret code 11
    2012-09-26 09:36:14.709: [  OCRMSG][148804160]prom_rpc: possible OCR retry scenario
    2012-09-26 09:36:14.768: [  OCRAPI][148804160]procr_open: Node Failure. Attempting retry #0
    agripa:/u01/oracle/app/product/102_64/crs/bin # ./crs_getperm ora.ELIO3.ELIO32.inst
    Nombre: ora.ELIO3.ELIO32.inst
    owner:oracle:rwx,pgrp:oinstall:rwx,other::r--,
    agripa:/u01/oracle/app/product/102_64/crs/bin # ./crs_getperm ora.ELIO3.ELIO31.inst
    Nombre: ora.ELIO3.ELIO31.inst
    owner:oracle:rwx,pgrp:oinstall:rwx,other::r--,I try to stop instance with srvctl but instance don't stop.
    oracle@agripa:/u01/oracle/app/product/102_64/app/bin> ./srvctl stop instance -d ELIO3 -i ELIO31
    oracle@agripa:/u01/oracle/app/product/102_64/app/bin> sqlplus / as sysdba
    SQL*Plus: Release 10.2.0.5.0 - Production on Mié Sep 26 09:42:24 2012
    Copyright (c) 1982, 2010, Oracle.  All Rights Reserved.
    Conectado a:
    Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - Production
    With the Partitioning, Real Application Clusters, OLAP, Data Mining
    and Real Application Testing options
    SQL>How can I fix it?
    How can I do to srvctl works fine and crs show that database is start??
    Thanks you very much!!!

    My database in another node (julia) was started with sqlplus
    sqlplus / as sysdba
    startup open;The crsd.log appears the follow
    2012-09-24 11:36:56.798: [ CRSMAIN][174064]0CRS Daemon Started.
    2012-09-24 11:36:56.798: [ CRSMAIN][363782720]0Starting runCommandServer for (UI = 1, E2E = 0). 0
    2012-09-24 11:36:56.798: [ CRSMAIN][365879872]0Starting runCommandServer for (UI = 1, E2E = 0). 1
    2012-09-26 09:30:40.776: [  CRSRES][380703296]0startRunnable: setting CLI values
    2012-09-26 09:30:40.814: [  CRSRES][380703296]0Attempting to start `ora.ELIO3.ELIO31.inst` on member `agripa`
    2012-09-26 09:30:54.931: [ default][174064][ENTER]0
    Oracle Database 10g CRS Release 10.2.0.5.0 Production Copyright 1996, 2004, Oracle.  All rights reserved
    2012-09-26 09:30:54.931: [ default][174064]0CRS Daemon Starting
    2012-09-26 09:30:54.932: [ CRSMAIN][174064]0Checking the OCR device
    2012-09-26 09:30:54.935: [ CRSMAIN][174064]0Connecting to the CSS Daemon
    2012-09-26 09:30:55.238: [  CLSVER][174064]0Active Version from OCR:10.2.0.5.0
    2012-09-26 09:30:55.238: [  CLSVER][174064]0Active Version and Software Version are same
    2012-09-26 09:30:55.238: [ CRSMAIN][174064]0Initializing OCR
    2012-09-26 09:30:55.254: [  OCRRAW][174064]proprioo: for disk 0 (/u01/oracle/1020_64/voting1/ocr), id match (1), my id set (1616921495,1352295226) total id sets (1), 1st set (1616921495,1352295226), 2nd set (0,0) my votes (1), total votes (2)
    2012-09-26 09:30:55.254: [  OCRRAW][174064]proprioo: for disk 1 (/u01/oracle/1020_64/voting2/ocr), id match (1), my id set (1616921495,1352295226) total id sets (1), 1st set (1616921495,1352295226), 2nd set (0,0) my votes (1), total votes (2)
    2012-09-26 09:30:55.286: [    CRSD][174064]0ENV Logging level for Module: allcomp  0
    2012-09-26 09:30:55.289: [    CRSD][174064]0ENV Logging level for Module: default  0
    2012-09-26 09:30:55.292: [    CRSD][174064]0ENV Logging level for Module: COMMCRS  0
    2012-09-26 09:30:55.294: [    CRSD][174064]0ENV Logging level for Module: COMMNS  0
    2012-09-26 09:30:55.297: [    CRSD][174064]0ENV Logging level for Module: CRSUI  0
    2012-09-26 09:30:55.300: [    CRSD][174064]0ENV Logging level for Module: CRSCOMM  0
    2012-09-26 09:30:55.303: [    CRSD][174064]0ENV Logging level for Module: CRSRTI  0
    2012-09-26 09:30:55.306: [    CRSD][174064]0ENV Logging level for Module: CRSMAIN  0
    2012-09-26 09:30:55.309: [    CRSD][174064]0ENV Logging level for Module: CRSPLACE  0
    2012-09-26 09:30:55.312: [    CRSD][174064]0ENV Logging level for Module: CRSAPP  0
    2012-09-26 09:30:55.315: [    CRSD][174064]0ENV Logging level for Module: CRSRES  0
    2012-09-26 09:30:55.317: [    CRSD][174064]0ENV Logging level for Module: CRSOCR  0
    2012-09-26 09:30:55.320: [    CRSD][174064]0ENV Logging level for Module: CRSTIMER  0
    2012-09-26 09:30:55.323: [    CRSD][174064]0ENV Logging level for Module: CRSEVT  0
    2012-09-26 09:30:55.326: [    CRSD][174064]0ENV Logging level for Module: CRSD  0
    2012-09-26 09:30:55.329: [    CRSD][174064]0ENV Logging level for Module: CLUCLS  0
    2012-09-26 09:30:55.332: [    CRSD][174064]0ENV Logging level for Module: CLSVER  0
    2012-09-26 09:30:55.335: [    CRSD][174064]0ENV Logging level for Module: OCRRAW  0
    2012-09-26 09:30:55.338: [    CRSD][174064]0ENV Logging level for Module: OCROSD  0
    2012-09-26 09:30:55.341: [    CRSD][174064]0ENV Logging level for Module: CSSCLNT  0
    2012-09-26 09:30:55.343: [    CRSD][174064]0ENV Logging level for Module: OCRAPI  0
    2012-09-26 09:30:55.346: [    CRSD][174064]0ENV Logging level for Module: OCRUTL  0
    2012-09-26 09:30:55.349: [    CRSD][174064]0ENV Logging level for Module: OCRMSG  0
    2012-09-26 09:30:55.352: [    CRSD][174064]0ENV Logging level for Module: OCRCLI  0
    2012-09-26 09:30:55.355: [    CRSD][174064]0ENV Logging level for Module: OCRCAC  0
    2012-09-26 09:30:55.358: [    CRSD][174064]0ENV Logging level for Module: OCRSRV  0
    2012-09-26 09:30:55.360: [    CRSD][174064]0ENV Logging level for Module: OCRMAS  0
    2012-09-26 09:30:55.360: [ CRSMAIN][174064]0Filename is /u01/oracle/app/product/102_64/crs/crs/init/agripa.pid
    [  clsdmt][299713088]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=agripaDBG_CRSD))
    2012-09-26 09:30:55.383: [ CRSMAIN][174064]0Using Authorizer location: /u01/oracle/app/product/102_64/crs/crs/auth/
    2012-09-26 09:30:55.401: [ CRSMAIN][174064]0Initializing RTI
    2012-09-26 09:30:55.436: [CRSTIMER][316899904]0Timer Thread Starting.
    2012-09-26 09:30:55.438: [  CRSRES][174064]0Parameter SECURITY = 1, running in USER Mode
    2012-09-26 09:30:55.438: [ CRSMAIN][174064]0Initializing EVMMgr
    2012-09-26 09:30:55.526: [ CRSMAIN][174064]0CRSD locked during state recovery, please wait.
    2012-09-26 09:30:56.003: [  CRSRES][174064]0ora.agripa.vip check shows ONLINE
    2012-09-26 09:30:56.121: [ CRSMAIN][174064]0CRSD recovered, unlocked.
    2012-09-26 09:30:56.122: [ CRSMAIN][174064]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2012-09-26 09:30:56.122: [ CRSMAIN][174064]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2012-09-26 09:30:56.130: [ CRSMAIN][174064]0CRSD UI socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=CRSD_UI_SOCKET))
    2012-09-26 09:30:56.133: [ CRSMAIN][174064]0E2E socket on: (ADDRESS=(PROTOCOL=tcp)(HOST=agripa-priv)(PORT=49896))
    2012-09-26 09:30:56.133: [ CRSMAIN][174064]0Starting Threads
    2012-09-26 09:30:56.134: [ CRSMAIN][174064]0CRS Daemon Started.
    2012-09-26 09:30:56.134: [ CRSMAIN][362721856]0Starting runCommandServer for (UI = 1, E2E = 0). 0
    2012-09-26 09:30:56.134: [ CRSMAIN][364819008]0Starting runCommandServer for (UI = 1, E2E = 0). 1
    2012-09-26 09:31:08.582: [ default][174064][ENTER]0
    Oracle Database 10g CRS Release 10.2.0.5.0 Production Copyright 1996, 2004, Oracle.  All rights reserved
    2012-09-26 09:31:08.582: [ default][174064]0CRS Daemon Starting
    2012-09-26 09:31:08.583: [ CRSMAIN][174064]0Checking the OCR device
    2012-09-26 09:31:08.585: [ CRSMAIN][174064]0Connecting to the CSS Daemon
    2012-09-26 09:31:08.885: [  CLSVER][174064]0Active Version from OCR:10.2.0.5.0
    2012-09-26 09:31:08.885: [  CLSVER][174064]0Active Version and Software Version are same
    2012-09-26 09:31:08.885: [ CRSMAIN][174064]0Initializing OCR
    2012-09-26 09:31:08.891: [  OCRRAW][174064]proprioo: for disk 0 (/u01/oracle/1020_64/voting1/ocr), id match (1), my id set (1616921495,1352295226) total id sets (1), 1st set (1616921495,1352295226), 2nd set (0,0) my votes (1), total votes (2)
    2012-09-26 09:31:08.891: [  OCRRAW][174064]proprioo: for disk 1 (/u01/oracle/1020_64/voting2/ocr), id match (1), my id set (1616921495,1352295226) total id sets (1), 1st set (1616921495,1352295226), 2nd set (0,0) my votes (1), total votes (2)
    2012-09-26 09:31:08.934: [    CRSD][174064]0ENV Logging level for Module: allcomp  0
    2012-09-26 09:31:08.937: [    CRSD][174064]0ENV Logging level for Module: default  0
    2012-09-26 09:31:08.940: [    CRSD][174064]0ENV Logging level for Module: COMMCRS  0
    2012-09-26 09:31:08.942: [    CRSD][174064]0ENV Logging level for Module: COMMNS  0
    2012-09-26 09:31:08.945: [    CRSD][174064]0ENV Logging level for Module: CRSUI  0
    2012-09-26 09:31:08.948: [    CRSD][174064]0ENV Logging level for Module: CRSCOMM  0
    2012-09-26 09:31:08.964: [    CRSD][174064]0ENV Logging level for Module: CRSRTI  0
    2012-09-26 09:31:08.970: [    CRSD][174064]0ENV Logging level for Module: CRSMAIN  0
    2012-09-26 09:31:08.973: [    CRSD][174064]0ENV Logging level for Module: CRSPLACE  0
    2012-09-26 09:31:08.976: [    CRSD][174064]0ENV Logging level for Module: CRSAPP  0
    2012-09-26 09:31:08.979: [    CRSD][174064]0ENV Logging level for Module: CRSRES  0
    2012-09-26 09:31:08.982: [    CRSD][174064]0ENV Logging level for Module: CRSOCR  0
    2012-09-26 09:31:08.985: [    CRSD][174064]0ENV Logging level for Module: CRSTIMER  0
    2012-09-26 09:31:08.988: [    CRSD][174064]0ENV Logging level for Module: CRSEVT  0
    2012-09-26 09:31:08.991: [    CRSD][174064]0ENV Logging level for Module: CRSD  0
    2012-09-26 09:31:08.994: [    CRSD][174064]0ENV Logging level for Module: CLUCLS  0
    2012-09-26 09:31:08.997: [    CRSD][174064]0ENV Logging level for Module: CLSVER  0
    2012-09-26 09:31:08.999: [    CRSD][174064]0ENV Logging level for Module: OCRRAW  0
    2012-09-26 09:31:09.002: [    CRSD][174064]0ENV Logging level for Module: OCROSD  0
    2012-09-26 09:31:09.005: [    CRSD][174064]0ENV Logging level for Module: CSSCLNT  0
    2012-09-26 09:31:09.008: [    CRSD][174064]0ENV Logging level for Module: OCRAPI  0
    2012-09-26 09:31:09.011: [    CRSD][174064]0ENV Logging level for Module: OCRUTL  0
    2012-09-26 09:31:09.014: [    CRSD][174064]0ENV Logging level for Module: OCRMSG  0
    2012-09-26 09:31:09.017: [    CRSD][174064]0ENV Logging level for Module: OCRCLI  0
    2012-09-26 09:31:09.020: [    CRSD][174064]0ENV Logging level for Module: OCRCAC  0
    2012-09-26 09:31:09.023: [    CRSD][174064]0ENV Logging level for Module: OCRSRV  0
    2012-09-26 09:31:09.026: [    CRSD][174064]0ENV Logging level for Module: OCRMAS  0
    2012-09-26 09:31:09.026: [ CRSMAIN][174064]0Filename is /u01/oracle/app/product/102_64/crs/crs/init/agripa.pid
    [  clsdmt][303034944]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=agripaDBG_CRSD))
    2012-09-26 09:31:09.057: [ CRSMAIN][174064]0Using Authorizer location: /u01/oracle/app/product/102_64/crs/crs/auth/
    2012-09-26 09:31:09.072: [ CRSMAIN][174064]0Initializing RTI
    2012-09-26 09:31:09.094: [CRSTIMER][319812160]0Timer Thread Starting.
    2012-09-26 09:31:09.096: [  CRSRES][174064]0Parameter SECURITY = 1, running in USER Mode
    2012-09-26 09:31:09.096: [ CRSMAIN][174064]0Initializing EVMMgr
    2012-09-26 09:31:09.198: [ CRSMAIN][174064]0CRSD locked during state recovery, please wait.
    2012-09-26 09:31:09.728: [  CRSRES][174064]0ora.agripa.vip check shows ONLINE
    2012-09-26 09:31:09.846: [ CRSMAIN][174064]0CRSD recovered, unlocked.
    2012-09-26 09:31:09.847: [ CRSMAIN][174064]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2012-09-26 09:31:09.847: [ CRSMAIN][174064]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2012-09-26 09:31:09.855: [ CRSMAIN][174064]0CRSD UI socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=CRSD_UI_SOCKET))
    2012-09-26 09:31:09.858: [ CRSMAIN][174064]0E2E socket on: (ADDRESS=(PROTOCOL=tcp)(HOST=agripa-priv)(PORT=49896))
    2012-09-26 09:31:09.859: [ CRSMAIN][174064]0Starting Threads
    2012-09-26 09:31:09.859: [ CRSMAIN][174064]0CRS Daemon Started.
    2012-09-26 09:31:09.859: [ CRSMAIN][364917312]0Starting runCommandServer for (UI = 1, E2E = 0). 0
    2012-09-26 09:31:09.859: [ CRSMAIN][367014464]0Starting runCommandServer for (UI = 1, E2E = 0). 1
    2012-09-26 09:35:44.874: [ default][174064][ENTER]0
    Oracle Database 10g CRS Release 10.2.0.5.0 Production Copyright 1996, 2004, Oracle.  All rights reserved
    2012-09-26 09:35:44.874: [ default][174064]0CRS Daemon Starting
    2012-09-26 09:35:44.875: [ CRSMAIN][174064]0Checking the OCR device
    2012-09-26 09:35:44.877: [ CRSMAIN][174064]0Connecting to the CSS Daemon
    2012-09-26 09:35:45.186: [  CLSVER][174064]0Active Version from OCR:10.2.0.5.0
    2012-09-26 09:35:45.186: [  CLSVER][174064]0Active Version and Software Version are same
    2012-09-26 09:35:45.186: [ CRSMAIN][174064]0Initializing OCR
    2012-09-26 09:35:45.201: [  OCRRAW][174064]proprioo: for disk 0 (/u01/oracle/1020_64/voting1/ocr), id match (1), my id set (1616921495,1352295226) total id sets (1), 1st set (1616921495,1352295226), 2nd set (0,0) my votes (1), total votes (2)
    2012-09-26 09:35:45.202: [  OCRRAW][174064]proprioo: for disk 1 (/u01/oracle/1020_64/voting2/ocr), id match (1), my id set (1616921495,1352295226) total id sets (1), 1st set (1616921495,1352295226), 2nd set (0,0) my votes (1), total votes (2)
    2012-09-26 09:35:45.236: [    CRSD][174064]0ENV Logging level for Module: allcomp  0
    2012-09-26 09:35:45.242: [    CRSD][174064]0ENV Logging level for Module: default  0
    2012-09-26 09:35:45.245: [    CRSD][174064]0ENV Logging level for Module: COMMCRS  0
    2012-09-26 09:35:45.247: [    CRSD][174064]0ENV Logging level for Module: COMMNS  0
    2012-09-26 09:35:45.250: [    CRSD][174064]0ENV Logging level for Module: CRSUI  0
    2012-09-26 09:35:45.253: [    CRSD][174064]0ENV Logging level for Module: CRSCOMM  0
    2012-09-26 09:35:45.256: [    CRSD][174064]0ENV Logging level for Module: CRSRTI  0
    2012-09-26 09:35:45.259: [    CRSD][174064]0ENV Logging level for Module: CRSMAIN  0
    2012-09-26 09:35:45.262: [    CRSD][174064]0ENV Logging level for Module: CRSPLACE  0
    2012-09-26 09:35:45.265: [    CRSD][174064]0ENV Logging level for Module: CRSAPP  0
    2012-09-26 09:35:45.269: [    CRSD][174064]0ENV Logging level for Module: CRSRES  0
    2012-09-26 09:35:45.273: [    CRSD][174064]0ENV Logging level for Module: CRSOCR  0
    2012-09-26 09:35:45.276: [    CRSD][174064]0ENV Logging level for Module: CRSTIMER  0
    2012-09-26 09:35:45.279: [    CRSD][174064]0ENV Logging level for Module: CRSEVT  0
    2012-09-26 09:35:45.282: [    CRSD][174064]0ENV Logging level for Module: CRSD  0
    2012-09-26 09:35:45.285: [    CRSD][174064]0ENV Logging level for Module: CLUCLS  0
    2012-09-26 09:35:45.288: [    CRSD][174064]0ENV Logging level for Module: CLSVER  0
    2012-09-26 09:35:45.291: [    CRSD][174064]0ENV Logging level for Module: OCRRAW  0
    2012-09-26 09:35:45.293: [    CRSD][174064]0ENV Logging level for Module: OCROSD  0
    2012-09-26 09:35:45.297: [    CRSD][174064]0ENV Logging level for Module: CSSCLNT  0
    2012-09-26 09:35:45.300: [    CRSD][174064]0ENV Logging level for Module: OCRAPI  0
    2012-09-26 09:35:45.302: [    CRSD][174064]0ENV Logging level for Module: OCRUTL  0
    2012-09-26 09:35:45.305: [    CRSD][174064]0ENV Logging level for Module: OCRMSG  0
    2012-09-26 09:35:45.308: [    CRSD][174064]0ENV Logging level for Module: OCRCLI  0
    2012-09-26 09:35:45.311: [    CRSD][174064]0ENV Logging level for Module: OCRCAC  0
    2012-09-26 09:35:45.314: [    CRSD][174064]0ENV Logging level for Module: OCRSRV  0
    2012-09-26 09:35:45.318: [    CRSD][174064]0ENV Logging level for Module: OCRMAS  0
    2012-09-26 09:35:45.318: [ CRSMAIN][174064]0Filename is /u01/oracle/app/product/102_64/crs/crs/init/agripa.pid
    [  clsdmt][303034944]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=agripaDBG_CRSD))
    2012-09-26 09:35:45.341: [ CRSMAIN][174064]0Using Authorizer location: /u01/oracle/app/product/102_64/crs/crs/auth/
    2012-09-26 09:35:45.361: [ CRSMAIN][174064]0Initializing RTI
    2012-09-26 09:35:45.391: [CRSTIMER][319812160]0Timer Thread Starting.
    2012-09-26 09:35:45.393: [  CRSRES][174064]0Parameter SECURITY = 1, running in USER Mode
    2012-09-26 09:35:45.393: [ CRSMAIN][174064]0Initializing EVMMgr
    2012-09-26 09:35:45.481: [ CRSMAIN][174064]0CRSD locked during state recovery, please wait.
    2012-09-26 09:35:45.956: [  CRSRES][174064]0ora.agripa.vip check shows ONLINE
    2012-09-26 09:35:46.097: [ CRSMAIN][174064]0CRSD recovered, unlocked.
    2012-09-26 09:35:46.098: [ CRSMAIN][174064]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2012-09-26 09:35:46.098: [ CRSMAIN][174064]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2012-09-26 09:35:46.105: [ CRSMAIN][174064]0CRSD UI socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=CRSD_UI_SOCKET))
    2012-09-26 09:35:46.109: [ CRSMAIN][174064]0E2E socket on: (ADDRESS=(PROTOCOL=tcp)(HOST=agripa-priv)(PORT=49896))
    2012-09-26 09:35:46.109: [ CRSMAIN][174064]0Starting Threads
    2012-09-26 09:35:46.109: [ CRSMAIN][174064]0CRS Daemon Started.
    2012-09-26 09:35:46.109: [ CRSMAIN][364896832]0Starting runCommandServer for (UI = 1, E2E = 0). 0
    2012-09-26 09:35:46.109: [ CRSMAIN][366993984]0Starting runCommandServer for (UI = 1, E2E = 0). 1
    2012-09-26 09:36:09.889: [  CRSRES][381674048]0CRS-1002: Resource 'ora.ELIO3.db' is already running on member 'julia'
    2012-09-26 09:47:41.288: [  CRSRES][379576896]0ora.ELIO3.ELIO31.inst target set to OFFLINE before stop action
    2012-09-26 09:47:41.288: [  CRSRES][379576896]0StopResource: setting CLI values
    2012-09-26 09:47:41.355: [  CRSRES][379576896]0Target set to OFFLINE for `ora.ELIO3.ELIO31.inst`
    2012-09-26 09:47:42.266: [  CRSRES][379576896]0`ora.ELIO3.ELIO31.inst` is already OFFLINE.
    2012-09-26 09:47:43.278: [  CRSRES][379576896]0`ora.ELIO3.ELIO31.inst` is already OFFLINE.
    2012-09-26 09:47:44.286: [  CRSRES][379576896]0`ora.ELIO3.ELIO31.inst` is already OFFLINE.
    2012-09-26 09:47:45.298: [  CRSRES][379576896]0`ora.ELIO3.ELIO31.inst` is already OFFLINE.PD: Excuseme for the long text about crsd.log, but I don't know how can I attach a file.
    Thanks you very much!!.

  • One node RAC pause/hang/block on other node shutdown

    Hi,
    We have a Java application running on Linux servers connecting to a 10.2.0.1 RAC cluster, also Linux. When the application starts it opens up a pool of connections to the databsae, and these are used throughout the life time of the application. One server connects to one RAC node.
    AppA - DBA
    AppB - DBB
    When we shutdown one node, the application connecting to that node stops, which is what we would expect in this configuration.
    What is strange is that the other application blocks for 63 seconds and then continues. So it is like the database is blocking, or the database connections are blocking.
    We are not using TAF, FAN, FCN, LB, VIPs or any special features, just simple lightweight JDBC from one server to one database. In fact I do not thing we are unwittingly using any of these features, we have them switched off.
    john

    user1788323 wrote:
    What is strange is that the other application blocks for 63 seconds and then continues. So it is like the database is blocking, or the database connections are blocking.How have you determined/diagnosed the 63s blocking? (more details in this regard may shed some light on the problem)
    Assuming that the block is server side, then two basic reasons comes to mind.
    Networking issue - the CRS on the surviving node has to perform certain functions, like switching the VIP of the node that left the cluster to a surviving cluster node. The listener may need to re-register services. A local firewall may need to be dynamically reconfigured for supporting the new failed-over VIP. Etc.
    Thus these could result in some kind of delay or issue in the network layer that you are seeing from the client side.
    Infrastructure issue. If the actual client request via JDBC reaches the server process, and it is slow in responding, then that is not a network issue - instead some underlying service or s/w layer that the server process needs to use to perform the client request is busy for those 63s.
    This could be related to the Interconnect, the shared I/O storage layer or something along those lines. For example, how does the Interconnect and/or SAN switch re-act when a server node is powered down or rebooted?
    There's not really sufficient information to make anything but a guesses.. You will need to isolate the problem with further testing.
    I have seen similar problems with 10.1.0.3 CRS and RAC when a node is evicted from the cluster. In this case the "hung" period was in excess of 15 minutes and only for new connections (Listener unable to hand off to dedicated servers or dispatchers). Existing connections worked fine however and were unaware of any problems. But part of the issue in this case was a poor (outdated) driver layer - and also the last time we used proprietary binary drivers (kernel modules) from 3rd party vendors that results in a tainted (and very fixed and rigid) Linux kernel. Today we're sticking with an OpenSource driver layer only for Linux.

  • When one node reboot other node in RAC

    Hi Friends,
    I faced one situation where one node of RAC cluster had been rebooted by other node. This happen due to network interconnect link fluctuation.
    Sep 13 16:23:48 kkvs1a su: [ID 810491 auth.crit] 'su admin' failed for wipro1 on /dev/pts/3
    Sep 14 00:22:17 kkvs1a ixgbe: [ID 611667 kern.info] NOTICE: ixgbe3: link down
    Sep 14 00:22:21 kkvs1a ixgbe: [ID 611667 kern.info] NOTICE: ixgbe3: link up, , full duplex
    Sep 14 00:22:31 kkvs1a ixgbe: [ID 611667 kern.info] NOTICE: ixgbe1: link down
    Sep 14 00:22:31 kkvs1a ixgbe: [ID 611667 kern.info] NOTICE: ixgbe3: link down
    /opt/oracle/product/10.2.0/crs/log/node1/alertkk1a.log
    ==============================================
    2013-09-14 00:22:05.180
    [cssd(12561)]CRS-1612:node kk1b (2) at 50% heartbeat fatal, eviction in 14.251 seconds
    2013-09-14 00:22:12.180
    [cssd(12561)]CRS-1611:node kk1b (2) at 75% heartbeat fatal, eviction in 7.251 seconds
    2013-09-14 00:22:13.180
    [cssd(12561)]CRS-1611:node kk1b (2) at 75% heartbeat fatal, eviction in 6.251 seconds
    2013-09-14 00:22:17.179
    [cssd(12561)]CRS-1610:node kk1b (2) at 90% heartbeat fatal, eviction in 2.251 seconds
    2013-09-14 00:22:18.180
    [cssd(12561)]CRS-1610:node kkvs1b (2) at 90% heartbeat fatal, eviction in 1.251 seconds
    This clearly shows CSSD of node kkvs1a has given node eviction message to kkvs1b node.
    I got following messages on the instance which got rebooted:
    ASM alert log:
    Sat Sep 14 00:22:25 IST 2013
    Error: KGXGN aborts the instance (6)
    Sat Sep 14 00:22:25 IST 2013
    Errors in file /opt/oracle/admin/+ASM/bdump/+asm2_lmon_8527.trc:
    ORA-29702: error occurred in Cluster Group Service operation
    LMON: terminating instance due to error 29702
    A network fluctuation shouldn't give reboot like this. Then why oracle design like this way? Is this a bug? My oracle version is: 10.2.0.5.0
    Could you tell me the other possible situations when 1 RC instance reboots other RAC instacne.

    What you are describing is the expected behaviour: if your interconnect fails, you will have a node eviction. Releases < 11.2.0.2 evict a node by reboot, which can fix the problem: the NIC may come up correctly when the machine re-starts. Releases >= 11.2.0.2 can often evict without a re-boot. But either way, if your interconnect goes down, a node must be evicted to prevent uncoordinated disc writes.
    If you are interested, you can find some discussion and demos of this in a series of webcasts I've recorded,
    Free Oracle Database Tutorials for Administration and Developers
    If you really don't like this behaviour and the problems are transient, you can try 'raising the CSS MISSCOUNT parameter.
    John Watson
    Oracle Certified Master DBA

  • Wrong Listener setting in 11.2.0.2 Grid with 11.2.0.2 ONE NODE(win 2008 R2)

    Hello,
    the listener on the second node doesn't use its endpoint-Entries and doesn't register the database or shows the running ASM-Instanz. No connection is possible on that node.
    In Log of Listeners always:
    TNS-12502: TNS:listener received no CONNECT_DATA from client
    I installed RAC one Node on 2 Servers, first installed and configured grid for both nodes with SCAN. After it I installed the rdbms and created a ONE NODE Database. The grid infrastructure is running nicely and even the swich of the instanz/database to the second node is working.
    BUT: on the second node the listener doesn't know the instance. Nor does ist know its asm-Instance. Registration (Alter system register) even doesnt't work.
    In 11.2.0.2 the lsiteners are starteet from grid-home before database creation.
    On the 1. node everthing is fine, as long as I don't switchover/failover.
    On the second server there has been a second listener from RDBMS_HOME created by ? . I stopped it. Th Listener from GRID_HOME ist configured the same way as node 1, but doesn't uses its endpoint-Entries and doesn't register the database or shows the running ASM-Instanz.
    listener.ora:
    LISTENER=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER)))) # line added by Agent
    LISTENER_SCAN3=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN3)))) # line added by Agent
    LISTENER_SCAN2=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN2)))) # line added by Agent
    LISTENER_SCAN1=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN1)))) # line added by Agent
    ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER_SCAN1=ON # line added by Agent
    ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER_SCAN2=ON # line added by Agent
    ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER_SCAN3=ON # line added by Agent
    ENABLE_GLOBAL_DYNAMIC_ENDPOINT_LISTENER=ON # line added by Agent
    lsnrctl status (if: lsnrctl services even no services)
    Instanz +asm2  onenode_2 are running and I can connect with / as sysdba
    LSNRCTL for 64-bit Windows: Version 11.2.0.2.0 - Production on 25-JAN-2011 15:52:05
    Copyright (c) 1991, 2010, Oracle. All rights reserved.
    Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER)))
    STATUS of the LISTENER
    Alias LISTENER
    Version TNSLSNR for 64-bit Windows: Version 11.2.0.2.0 - Production
    Start Date 25-JAN-2011 15:49:46
    Uptime 0 days 0 hr. 2 min. 22 sec
    Trace Level off
    Security ON: Local OS Authentication
    SNMP OFF
    Listener Parameter File C:\11.2.0\grid\network\admin\listener.ora
    Listener Log File C:\11.2.0\grid\log\diag\tnslsnr\VSLWMU022\listener\alert\log.xml
    Listening Endpoints Summary...
    (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=\\.\pipe\LISTENERipc)))
    The listener supports no services
    The command completed successfully
    I think, I have problems with the listener.ora and the environment settings, tha lsnrctl uses.
    When i change listener settings, I get the message:
    Failed to open service <OracleOraDb11g_home1TNSListenerLISTENER_DG> - this is the wron HOME!
    I don't find an entry in the registry wher I can change listener-Settings.
    Whe I try to change the settings (add entries like SID_LIST_LISTENER for a dataguard Konfiguration)on node 1, it behave like node 2: no more services/sid and endpoints.

    Hello folks,
    I found the bugs (2 independent annotations) and settings we need!
    1. Aus: http://download.oracle.com/docs/cd/E11882_01/relnotes.112/e16777.pdf 5.3.9 (write name and public IP in etc\hosts)
    2. http://download.oracle.com/docs/cd/E11882_01/relnotes.112/e16777/toc.htm#CJAHIGJE
    I changed the wrong entry in HKEY_LOCAL_MACHINE\SOFTWARE\ORACLE\OracleMTSRecoveryService\Protid_0 and rebooted the server.
    Suddenly the listener knows its IPs and its servces.
    Take care about yout local_listener setting in the instance: show parameter local_listener. This IP/name must be reachable. Sometimes I have had instance_2 running on node_1 with the vip_ip of 2 => this doesn not work.
    alter system set local_listener='(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER))' scope=both sid='*';
    I am still not sure, if this values changes to (ADDRESS=(PROTOCOL=TCP)(HOST=+host+-vip)(PORT=1521)).
    Check the IPS, that the listener ist running on: lsrnctl status
    ..Listening Endpoints Summary...
    (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(PIPENAME=\\.\pipe\LISTENERipc)))
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.20.121)(PORT=1521)))
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.20.124)(PORT=1521)))...
    Hopefully this will help you (and will be found in Windows-Documentation soon).
    By
    Marion

Maybe you are looking for

  • Watermark Disappears when Opened in Acrobat 9

    I created a watermark using (mac) Acrobat X Pro. The watermark can be viewed perfectly on my mac. My co-worker can also view it perfectly using (windows) Acrobat X. However, when I open it in Adobe Reader 9, the watermark disappears. I have tried thi

  • Problems in viewer

    I have problems in viewing my clips in continuous mode in the viewer. The first two seconds work, but after that its all jagged until video stops after 5-6 seconds and only audio continues!

  • Can't print wireless from mp620

    I recently moved and have a new internet provider. I cannot figure out how to get my Canon MP620 all in one to function wirelessly. I've checked the communities archives and there was a similar question and answer but when I tried to follow the answe

  • JAVA CODE Restricting users from entering Fractional numbers in Data forms

    Hi, is there anyone who can help me with the Java Script code of ValidateData.js file?? I am very novice in scripting and find it very difficult to write a proper javascript code to restrict the users from entering fractional numbers to HEADCOUNT cel

  • Problem with Raise keyword

    exception when others then dbms_output.put_line('xxxxxx'); dbms_output.put_line('xxxxx'); raise; end; What is the use of Raise here, pls help, what does it do uin the exception part???