Oracle RAC nodeapp 启动报错-vip:IP:192.168.2.200 is already up in the network

Linux redhat 5 Oracle RAC 10.2.0.5环境
启动nodeapp报错如下:
[oracle@rac1 ~]$ srvctl start nodeapps -n rac1
CRS-0210: Could not find resource ora.rac1.gsd.
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)
crsd.log部分日志如下:
2012-11-21 20:10:16.831: [  CRSRES][2717907856]0startRunnable: setting CLI values
2012-11-21 20:10:16.967: [  CRSRES][2717907856]0Attempting to start `ora.rac1.vip` on member `rac1`
2012-11-21 20:10:44.246: [  CRSAPP][2717907856]0StartResource error for ora.rac1.vip error code = 1
2012-11-21 20:10:47.007: [  CRSRES][2717907856]0Start of `ora.rac1.vip` on member `rac1` failed.
2012-11-21 20:10:47.529: [  CRSRES][2717907856]0Attempting to start `ora.rac1.vip` on member `rac2`
2012-11-21 20:11:18.649: [  CRSRES][2717907856]0Start of `ora.rac1.vip` on member `rac2` failed.
2012-11-21 20:11:18.897: [  CRSRES][2717907856]0CRS-1006: No more members to consider
2012-11-21 20:11:20.986: [  CRSRES][2717907856]0startRunnable: setting CLI values
2012-11-21 20:11:21.190: [  CRSRES][2717907856]0Attempting to start `ora.rac1.vip` on member `rac1`
2012-11-21 20:11:48.846: [  CRSAPP][2717907856]0StartResource error for ora.rac1.vip error code = 1
2012-11-21 20:11:51.203: [  CRSRES][2717907856]0Start of `ora.rac1.vip` on member `rac1` failed.
2012-11-21 20:11:51.492: [  CRSRES][2717907856]0rac2 : CRS-1019: Resource ora.rac1.LISTENER_RAC1.lsnr (application) cannot run on rac2
请问如何进一步排查“rac1:ora.rac1.vip:IP:192.168.2.200 is already up in the network (host=rac1)”问题?感谢

ping信息:
[oracle@rac1 ~]$ ping 192.168.2.200
PING 192.168.2.200 (192.168.2.200) 56(84) bytes of data.
64 bytes from 192.168.2.200: icmp_seq=1 ttl=64 time=0.043 ms
64 bytes from 192.168.2.200: icmp_seq=2 ttl=64 time=0.126 ms
64 bytes from 192.168.2.200: icmp_seq=3 ttl=64 time=0.059 ms
64 bytes from 192.168.2.200: icmp_seq=4 ttl=64 time=0.158 ms
64 bytes from 192.168.2.200: icmp_seq=5 ttl=64 time=0.643 ms
64 bytes from 192.168.2.200: icmp_seq=6 ttl=64 time=0.034 ms
64 bytes from 192.168.2.200: icmp_seq=7 ttl=64 time=0.046 ms
64 bytes from 192.168.2.200: icmp_seq=8 ttl=64 time=0.043 ms
64 bytes from 192.168.2.200: icmp_seq=9 ttl=64 time=0.048 ms
64 bytes from 192.168.2.200: icmp_seq=10 ttl=64 time=0.031 ms
telnet信息
[oracle@rac1 ~]$ telnet 192.168.2.200
Trying 192.168.2.200...
Connected to 192.168.2.200.
Escape character is '^]'.
Red Hat Enterprise Linux Server release 5 (Tikanga)
Kernel 2.6.18-8.el5xen on an i686
login:
ssh信息:
[oracle@rac1 ~]$ ssh 192.168.2.200
Last login: Sun Nov 18 13:37:10 2012 from rac2-vip
ifconfig -a信息:
[root@rac1 ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:0C:29:B6:CE:6B
inet addr:192.168.2.100 Bcast:192.168.2.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:ce6b/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:142396 errors:0 dropped:0 overruns:0 frame:0
TX packets:172561 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:41403126 (39.4 MiB) TX bytes:96009307 (91.5 MiB)
Interrupt:18 Base address:0x1480
eth1 Link encap:Ethernet HWaddr 00:0C:29:B6:CE:75
inet addr:192.168.2.200 Bcast:192.168.2.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:ce75/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:14082 errors:0 dropped:0 overruns:0 frame:0
TX packets:29 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:9789756 (9.3 MiB) TX bytes:1434 (1.4 KiB)
Interrupt:19 Base address:0x1800
eth2 Link encap:Ethernet HWaddr 00:0C:29:B6:CE:7F
inet addr:192.168.3.100 Bcast:192.168.3.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:feb6:ce7f/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:12665 errors:0 dropped:0 overruns:0 frame:0
TX packets:32728 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:6590271 (6.2 MiB) TX bytes:28437643 (27.1 MiB)
Interrupt:16 Base address:0x1880
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:30893 errors:0 dropped:0 overruns:0 frame:0
TX packets:30893 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:9402131 (8.9 MiB) TX bytes:9402131 (8.9 MiB)
sit0 Link encap:IPv6-in-IPv4
NOARP MTU:1480 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)

Similar Messages

  • In our enterprise MPLS network we are using 192.168.20.0/24 subnet, in this subnet we have not assigned the IP 192.168.20.200/30 & 204/30, But still these subnets are reachable . Are these NNI IP ...Please explain.

    In our enterprise MPLS network we are using 192.168.20.0/24 subnet, in this subnet we have not assigned the IP 192.168.20.200/30 & 204/30, But still these subnets are reachable . Are these NNI IP ...Please explain.

    I have checked with ISP, there response is like below:
    Those are the NNI to GBNET IPs for Dominican Republic. They are Network IPs. You should be able to ping them-that means they are working.
    WANRT01#show  ip route | include 192.168.20.20
    B        192.168.20.200/30 [20/0] via 192.168.20.226, 02:18:29
    B        192.168.20.204/30 [20/0] via 192.168.20.226, 02:18:29
    Here its shows from any of our MPLS site we are able to trace the IP and it seems like, 192.168.20.204/30 is one more site but in actual its not.
    INMUMWANRT01#ping 192.168.20.205
    Type escape sequence to abort.
    Sending 5, 100-byte ICMP Echos to 192.168.20.205, timeout is 2 seconds:
    Success rate is 100 percent (5/5), round-trip min/avg/max = 224/232/260 ms
    INMUMWANRT01#trace              
    INMUMWANRT01#traceroute 192.168.20.205
    Type escape sequence to abort.
    Tracing the route to 192.168.20.205
    VRF info: (vrf in name/id, vrf out name/id)
      1 192.168.20.226 24 msec 24 msec 24 msec
      2 192.168.20.206 [AS 8035] 232 msec 232 msec 252 msec
      3 192.168.20.205 [AS 8035] 224 msec 224 msec *

  • Oracle RAC 11g

    Hi expert,
    a question about VIP on Oracle RAC 11g. I have 2 server RAC1 and RAC2, I must be have:
    - Public interface that will be used for client communication
    - Virtual IP address (VIP) that will be bind by Oracle Clusterware to the public interface
    - Private interface that will be used for inter-cluster traffic. There are four major categories of inter-
    cluster traffic
    this is my hypothetical configuration:
    >
    RAC1:
    * hostname: rac1.localdomain
    * IP Address eth0: 192.168.2.101 (public address)
    * Default Gateway eth0: 192.168.2.1 (public address)
    * IP Address eth1: 192.168.0.101 (private address)
    * Default Gateway eth1: none
    RAC2:
    * hostname: rac2.localdomain
    * IP Address eth0: 192.168.2.102 (public address)
    * Default Gateway eth0: 192.168.2.1 (public address)
    * IP Address eth1: 192.168.0.102 (private address)
    * Default Gateway eth1: none
    RAC1:
    127.0.0.1 localhost.localdomain localhost
    # Public
    192.168.2.101 rac1.localdomain rac1
    192.168.2.102 rac2.localdomain rac2
    #Private
    192.168.0.101 rac1-priv.localdomain rac1-priv
    192.168.0.102 rac2-priv.localdomain rac2-priv
    #Virtual
    192.168.2.111 rac1-vip.localdomain rac1-vip
    192.168.2.112 rac2-vip.localdomain rac2-vip
    #NAS
    192.168.2.101 nas1.localdomain nas1
    LISTENER_RAC2 =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS_LIST =
    (ADDRESS = (PROTOCOL = TCP)(HOST = rac2-vip)(PORT = 1521)(IP = FIRST))
    (ADDRESS_LIST =
    (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.2.102)(PORT = 1521)(IP = FIRST))
    (ADDRESS_LIST =
    (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))
    LISTENER_RAC1 =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS_LIST =
    (ADDRESS = (PROTOCOL = TCP)(HOST = rac1-vip)(PORT = 1521)(IP = FIRST))
    (ADDRESS_LIST =
    (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.2.101)(PORT = 1521)(IP = FIRST))
    (ADDRESS_LIST =
    (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))
    >
    I don't undestand when and where I can configure on my servers these IPs:
    192.168.2.111 rac1-vip.localdomain rac1-vip
    192.168.2.112 rac2-vip.localdomain rac2-vip
    on the single server, for example, RAC1 I will configure this ip:
    RAC1:
        * hostname: rac1.localdomain
        * IP Address eth0: 192.168.2.101 (public address)
        * Default Gateway eth0: 192.168.2.1 (public address)
        * IP Address eth1: 192.168.0.101 (private address)
        * Default Gateway eth1: nonebut I don't undestand where I can configure this entry:
    192.168.2.111   rac1-vip.localdomain    rac1-vipmany thanks,
    Lain

    Hi Lain;
    Firstly i suggest its better to move your issue on Forum Home » Grid Computing » RAC, ASM & Clusterware Installation
    Secondly please check below links they have very good explanation about Rac settings and installation *
    RAC for 11gR2 Database
    RAC for 11gR2 Database
    guide to install Oracle RAC at home
    Re: guide to install Oracle RAC at home
    Regard
    Helios

  • Oracle RAC 11g each listner correlated to a different IP

    Hi expert,
    a question about Oracle RAC 11g. I have 2 server RAC1 and RAC2, I must be have:
    - Public interface that will be used for client communication
    - Virtual IP address (VIP) that will be bind by Oracle Clusterware to the public interface
    - Private interface that will be used for inter-cluster traffic. There are four major categories of inter-cluster traffic
    this is my ipotetic configuration:
    RAC1:
        * hostname: rac1.localdomain
        * IP Address eth0: 192.168.2.101 (public address)
        * Default Gateway eth0: 192.168.2.1 (public address)
        * IP Address eth1: 192.168.0.101 (private address)
        * Default Gateway eth1: none
    RAC2:
        * hostname: rac2.localdomain
        * IP Address eth0: 192.168.2.102 (public address)
        * Default Gateway eth0: 192.168.2.1 (public address)
        * IP Address eth1: 192.168.0.102 (private address)
        * Default Gateway eth1: none
    RAC1:
    127.0.0.1       localhost.localdomain   localhost
    # Public
    192.168.2.101   rac1.localdomain        rac1
    192.168.2.102   rac2.localdomain        rac2
    #Private
    192.168.0.101   rac1-priv.localdomain   rac1-priv
    192.168.0.102   rac2-priv.localdomain   rac2-priv
    #Virtual
    192.168.2.111   rac1-vip.localdomain    rac1-vip
    192.168.2.112   rac2-vip.localdomain    rac2-vip
    #NAS
    192.168.2.101   nas1.localdomain        nas1
    LISTENER_RAC2 =
      (DESCRIPTION_LIST =
        (DESCRIPTION =
          (ADDRESS_LIST =
            (ADDRESS = (PROTOCOL = TCP)(HOST = rac2-vip)(PORT = 1521)(IP = FIRST))
          (ADDRESS_LIST =
            (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.2.102)(PORT = 1521)(IP = FIRST))
          (ADDRESS_LIST =
            (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))
    LISTENER_RAC1 =
      (DESCRIPTION_LIST =
        (DESCRIPTION =
          (ADDRESS_LIST =
            (ADDRESS = (PROTOCOL = TCP)(HOST = rac1-vip)(PORT = 1521)(IP = FIRST))
          (ADDRESS_LIST =
            (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.2.101)(PORT = 1521)(IP = FIRST))
          (ADDRESS_LIST =
            (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))
      )on the single server, for example, RAC1 I can configure another ethx for this VIP IP?
    192.168.2.111 rac1-vip.localdomain rac1-vipor Oracle create a virtual interfaces? (for example eth0:1)
    One more question. I want configure 2 listner with 2 different port, the first on 1521 and the second on 1522. Each listner correlated to a different IP
    Should I configure for each server these IP?
    2 VIP
    2 Public
    1 Private
    like this, for example:
    (ADDRESS = (PROTOCOL = TCP)(HOST = rac1a-vip)(PORT = 1521)(IP = FIRST))
    (ADDRESS = (PROTOCOL = TCP)(HOST = rac1b-vip)(PORT = 1522)(IP = FIRST))
    (ADDRESS = (PROTOCOL = TCP)(HOST = rac2a-vip)(PORT = 1521)(IP = FIRST))
    (ADDRESS = (PROTOCOL = TCP)(HOST = rac2b-vip)(PORT = 1522)(IP = FIRST))
    many thanks for all suggest,
    Lain

    No matter how many number of listeners that you run ... You need only 1 public ip,1 vip, 1 private ip for each node of the cluster.
    All the listeners on that node use the same vip but listens only on different port numbers that you choose ...
    Thanks
    Sreekanth

  • Oracle RAC 11.2.0.3 installation on OEL 6.3 HAIP error

    Hi friends
    i have these big problem, i tried to install RAC on these two virtual machines before i do the production enviroment and here are the problems i am facing
    =========================
    Operating system OEL 6.3
    GRID 11.2.0.3
    DB 11.2.0.3
    ===========================
    1. during pre requset test /etc/resolv.vonf failed saying PRVF-5636 : The DNS response time for an unreachable node can not be found . . .. but i cheked everything
    [root@ubsrac1 /]# nslookup ubsrac1
    Server: 192.168.0.100
    Address: 192.168.0.100#53
    Name: ubsrac1.kifiya.com
    Address: 192.168.0.117
    [root@ubsrac1 /]# nslookup ubsrac1-vip
    Server: 192.168.0.100
    Address: 192.168.0.100#53
    Name: ubsrac1-vip.kifiya.com
    Address: 192.168.0.119
    [root@ubsrac1 /]# nslookup ubsrac2
    Server: 192.168.0.100
    Address: 192.168.0.100#53
    Name: ubsrac2.kifiya.com
    Address: 192.168.0.118
    [root@ubsrac1 /]# nslookup ubsrac2-vip
    Server: 192.168.0.100
    Address: 192.168.0.100#53
    Name: ubsrac2-vip.kifiya.com
    Address: 192.168.0.120
    [root@ubsrac1 /]# nslookup ubsrac-scan
    Server: 192.168.0.100
    Address: 192.168.0.100#53
    Name: ubsrac-scan.kifiya.com
    Address: 192.168.0.139
    Name: ubsrac-scan.kifiya.com
    Address: 192.168.0.136
    Name: ubsrac-scan.kifiya.com
    Address: 192.168.0.138
    ====================================
    And for unknow host here is the output
    [root@ubsrac1 /]# time nslookup unknown-not-reachable-node
    Server: 192.168.0.100
    Address: 192.168.0.100#53
    ** server can't find unknown-not-reachable-node: SERVFAIL
    real 0m0.019s
    user 0m0.003s
    sys 0m0.008s
    [root@ubsrac1 /]#
    =====================================
    Everything is ok on both the nodes........... but still i get the PRVF-5636 : The DNS response time
    ==========================
    output of /etc/hosts
    [root@ubsrac1 /]# cat /etc/hosts
    127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
    ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
    #Network configuration for ubsrac1
    192.168.0.117 ubsrac1 ubsrac1.kifiya.com
    192.168.0.119 ubsrac1-vip ubsrac1-vip.kifiya.com
    172.16.1.17 ubsrac1-priv ubsrac1-priv.kifiya.com
    #Network configuration for ubsrac2
    192.168.0.118 ubsrac2 ubsrac2.kifiya.com
    192.168.0.120 ubsrac2-vip ubsrac2-vip.kifiya.com
    172.16.1.18 ubsrac2-priv ubsrac2-priv.kifiya.com
    =============================================
    and i ignored and went with installation and excuted root.sh on the first node and here is the last output where i get the HAIP error
    Adding Clusterware entries to upstart
    CRS-2672: Attempting to start 'ora.mdnsd' on 'ubsrac1'
    CRS-2676: Start of 'ora.mdnsd' on 'ubsrac1' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'ubsrac1'
    CRS-2676: Start of 'ora.gpnpd' on 'ubsrac1' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ubsrac1'
    CRS-2672: Attempting to start 'ora.gipcd' on 'ubsrac1'
    CRS-2676: Start of 'ora.cssdmonitor' on 'ubsrac1' succeeded
    CRS-2676: Start of 'ora.gipcd' on 'ubsrac1' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'ubsrac1'
    CRS-2672: Attempting to start 'ora.diskmon' on 'ubsrac1'
    CRS-2676: Start of 'ora.diskmon' on 'ubsrac1' succeeded
    CRS-2676: Start of 'ora.cssd' on 'ubsrac1' succeeded
    ASM created and started successfully.
    Disk Group DATA created successfully.
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    CRS-4256: Updating the profile
    Successful addition of voting disk a745c85386eb4f4fbfa0f3b25c48a1e9.
    Successful addition of voting disk 146d859894f64f0cbf8172ecabd0e40a.
    Successful addition of voting disk 7c41353b913b4f6dbf1b5c56f9661e28.
    Successful addition of voting disk 5364b3e4d2f14fe9bf69207f38af44c5.
    Successful addition of voting disk 6376684a593a4fd1bf50e89459820d8c.
    Successfully replaced voting disk group with +DATA.
    CRS-4256: Updating the profile
    CRS-4266: Voting file(s) successfully replaced
    ## STATE File Universal Id File Name Disk group
    1. ONLINE a745c85386eb4f4fbfa0f3b25c48a1e9 (ORCL:CRSVOL1) [DATA]
    2. ONLINE 146d859894f64f0cbf8172ecabd0e40a (ORCL:CRSVOL2) [DATA]
    3. ONLINE 7c41353b913b4f6dbf1b5c56f9661e28 (ORCL:CRSVOL3) [DATA]
    4. ONLINE 5364b3e4d2f14fe9bf69207f38af44c5 (ORCL:CRSVOL4) [DATA]
    5. ONLINE 6376684a593a4fd1bf50e89459820d8c (ORCL:CRSVOL5) [DATA]
    Located 5 voting disk(s).
    Start of resource "ora.cluster_interconnect.haip" failed
    CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'ubsrac1'
    CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
    Start action for HAIP aborted. For details refer to "(:CLSN00107:)" in "/oragi/11.2.0.3/grid/log/ubsrac1/agent/ohasd/orarootagent_root/orarootagent_root.log".
    CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'ubsrac1' failed
    CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'ubsrac1'
    CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'ubsrac1' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    HAIP startup failure considered fatal, terminating at /oragi/11.2.0.3/grid/crs/install/crsconfig_lib.pm line 1263.
    /oragi/11.2.0.3/grid/perl/bin/perl -I/oragi/11.2.0.3/grid/perl/lib -I/oragi/11.2.0.3/grid/crs/install /oragi/11.2.0.3/grid/crs/install/rootcrs.pl execution failed
    ======================================================
    final out out is as follows
    [grid@ubsrac1 bin]$ ./crsctl stat res -t -init
    NAME TARGET STATE SERVER STATE_DETAILS
    Cluster Resources
    ora.asm
    1 OFFLINE OFFLINE Instance Shutdown
    ora.cluster_interconnect.haip
    1 ONLINE OFFLINE
    ora.crf
    1 ONLINE ONLINE ubsrac1
    ora.crsd
    1 OFFLINE OFFLINE EXCLUSIVE
    ora.cssd
    1 ONLINE ONLINE ubsrac1
    ora.cssdmonitor
    1 ONLINE ONLINE ubsrac1
    ora.ctssd
    1 ONLINE ONLINE ubsrac1 ACTIVE:0
    ora.diskmon
    1 OFFLINE OFFLINE
    ora.evmd
    1 OFFLINE OFFLINE
    ora.gipcd
    1 ONLINE ONLINE ubsrac1
    ora.gpnpd
    1 ONLINE ONLINE ubsrac1
    ora.mdnsd
    1 ONLINE ONLINE ubsrac1
    [grid@ubsrac1 bin]$
    please i need help . . .. i am stuck here i searched the web and tried things for days and i seem to run out of ideas and solutions
    any help will be greaatley aperciated ............
    Thanks in advance
    Regards
    Rediet

    hi damorgan
    here is the out put sir, . ................
    ================================================
    tail -200 /oragi/11.2.0.3/grid/log/ubsrac1/agent/ohasd/orarootagent_root/orarootagent_root.log
    2012-10-22 08:22:33.539: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:22:33.539: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:23:00.074: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23943
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5520
    2012-10-22 08:23:02.528: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5520], buflen=8
    2012-10-22 08:23:02.528: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5520]: mode[0xcc] offset[0 ms].
    2012-10-22 08:23:03.542: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:23:03.542: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5520
    2012-10-22 08:23:32.526: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5520], buflen=8
    2012-10-22 08:23:32.526: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5520]: mode[0xcc] offset[0 ms].
    2012-10-22 08:23:33.550: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:23:33.550: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:24:00.077: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23947
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5520
    2012-10-22 08:24:02.530: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5520], buflen=8
    2012-10-22 08:24:02.530: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5520]: mode[0xcc] offset[0 ms].
    2012-10-22 08:24:02.531: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 3. Current # is 2
    2012-10-22 08:24:03.554: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:24:03.554: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:24:30.088: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23951
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:24:32.542: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:24:32.542: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:24:33.553: [    AGFW][3097618208] Recvd request to shed the threads
    2012-10-22 08:24:33.553: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 2. Current # is 3
    2012-10-22 08:24:33.553: [CLSFRAME][3074782976] {0:11:5628} Worker thread is exiting in TM [MultiThread] to meet the desired count of 2. New count is 2
    2012-10-22 08:24:33.557: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:24:33.557: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:25:02.551: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:25:02.551: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:25:03.565: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:25:03.565: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:25:30.091: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23955
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:25:32.554: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:25:32.554: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:25:33.567: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:25:33.567: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:26:00.103: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23959
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:26:02.556: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:26:02.556: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:26:03.569: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:26:03.569: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:26:32.562: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:26:32.562: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:26:32.563: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 3. Current # is 2
    2012-10-22 08:26:33.576: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:26:33.576: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:27:00.106: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23963
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5440
    2012-10-22 08:27:02.569: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5440], buflen=8
    2012-10-22 08:27:02.570: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5440]: mode[0xcc] offset[0 ms].
    2012-10-22 08:27:03.581: [    AGFW][3097618208] Recvd request to shed the threads
    2012-10-22 08:27:03.581: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 2. Current # is 3
    2012-10-22 08:27:03.581: [CLSFRAME][3076884224] {0:11:5630} Worker thread is exiting in TM [MultiThread] to meet the desired count of 2. New count is 2
    2012-10-22 08:27:03.583: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:27:03.583: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:27:30.117: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23967
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5440
    2012-10-22 08:27:32.570: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5440], buflen=8
    2012-10-22 08:27:32.570: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5440]: mode[0xcc] offset[0 ms].
    2012-10-22 08:27:33.584: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:27:33.585: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:27:33.585: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 3. Current # is 2
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5440
    2012-10-22 08:28:02.580: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5440], buflen=8
    2012-10-22 08:28:02.580: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5440]: mode[0xcc] offset[0 ms].
    2012-10-22 08:28:03.593: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:28:03.595: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:28:30.120: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23971
    2012-10-22 08:28:32.581: [    AGFW][3097618208] Recvd request to shed the threads
    2012-10-22 08:28:32.581: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 2. Current # is 3
    2012-10-22 08:28:32.581: [CLSFRAME][3074782976] {0:11:5632} Worker thread is exiting in TM [MultiThread] to meet the desired count of 2. New count is 2
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:28:32.584: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:28:32.584: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:28:33.598: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:28:33.598: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:28:33.600: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 3. Current # is 2
    2012-10-22 08:29:00.132: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23975
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:29:02.585: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:29:02.585: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:29:03.600: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:29:03.600: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:29:30.145: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23977
    2012-10-22 08:29:32.586: [    AGFW][3097618208] Recvd request to shed the threads
    2012-10-22 08:29:32.586: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 2. Current # is 3
    2012-10-22 08:29:32.586: [CLSFRAME][3076884224] {0:11:5634} Worker thread is exiting in TM [MultiThread] to meet the desired count of 2. New count is 2
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5520
    2012-10-22 08:29:32.589: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5520], buflen=8
    2012-10-22 08:29:32.589: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5520]: mode[0xcc] offset[0 ms].
    2012-10-22 08:29:32.590: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 3. Current # is 2
    2012-10-22 08:29:33.603: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:29:33.603: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:30:02.596: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:30:02.597: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:30:03.608: [    AGFW][3097618208] Recvd request to shed the threads
    2012-10-22 08:30:03.608: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 2. Current # is 3
    2012-10-22 08:30:03.608: [CLSFRAME][3074782976] {0:11:5636} Worker thread is exiting in TM [MultiThread] to meet the desired count of 2. New count is 2
    2012-10-22 08:30:03.612: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:30:03.612: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:30:30.147: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23983
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:30:32.601: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:30:32.601: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:30:33.615: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:30:33.616: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:31:00.158: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23987
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:31:02.601: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:31:02.601: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:31:03.616: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:31:03.616: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:31:32.610: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:31:32.610: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:31:33.625: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:31:33.625: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:32:00.160: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23991
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:32:02.613: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:32:02.613: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:32:03.628: [ora.crf][3076884224] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:32:03.628: [ora.crf][3076884224] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:32:03.628: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 3. Current # is 2
    2012-10-22 08:32:30.173: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23995
    [  clsdmc][3076884224]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=A4000930
    2012-10-22 08:32:32.616: [ora.ctssd][3076884224] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9ba4000930], buflen=8
    2012-10-22 08:32:32.616: [ora.ctssd][3076884224] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9ba4000930]: mode[0xcc] offset[0 ms].
    2012-10-22 08:32:33.630: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:32:33.630: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:33:02.622: [    AGFW][3097618208] Recvd request to shed the threads
    2012-10-22 08:33:02.622: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 2. Current # is 3
    2012-10-22 08:33:02.622: [CLSFRAME][3076884224] {0:11:5638} Worker thread is exiting in TM [MultiThread] to meet the desired count of 2. New count is 2
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5520
    2012-10-22 08:33:02.625: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5520], buflen=8
    2012-10-22 08:33:02.625: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5520]: mode[0xcc] offset[0 ms].
    2012-10-22 08:33:03.639: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:33:03.639: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:33:30.177: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:23999
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5520
    2012-10-22 08:33:32.631: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5520], buflen=8
    2012-10-22 08:33:32.631: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5520]: mode[0xcc] offset[0 ms].
    2012-10-22 08:33:33.635: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:33:33.635: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:34:00.177: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:24003
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5520
    2012-10-22 08:34:02.631: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5520], buflen=8
    2012-10-22 08:34:02.631: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5520]: mode[0xcc] offset[0 ms].
    2012-10-22 08:34:03.646: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:34:03.646: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:34:30.184: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:24007
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5520
    2012-10-22 08:34:32.637: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5520], buflen=8
    2012-10-22 08:34:32.637: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5520]: mode[0xcc] offset[0 ms].
    2012-10-22 08:34:33.651: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:34:33.651: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    2012-10-22 08:35:00.188: [    AGFW][3072681728] {0:0:185} Agent received the message: AGENT_HB[Engine] ID 12293:24009
    [  clsdmc][3074782976]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=B00D5520
    2012-10-22 08:35:02.641: [ora.ctssd][3074782976] {0:0:185} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x7f9bb00d5520], buflen=8
    2012-10-22 08:35:02.642: [ora.ctssd][3074782976] {0:0:185} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x7f9bb00d5520]: mode[0xcc] offset[0 ms].
    2012-10-22 08:35:02.642: [CLSFRAME][3097618208] TM [MultiThread] is changing desired thread # to 3. Current # is 2
    2012-10-22 08:35:03.656: [ora.crf][3074782976] {0:0:193} [check] clsdmc_respget return: status=0, ecode=0
    2012-10-22 08:35:03.656: [ora.crf][3074782976] {0:0:193} [check] Check return = 0, state detail = NULL
    [root@ubsrac1 ~]#
    ================================
    please take a look at it
    Thanks in advance
    Edited by: Red8 on Oct 22, 2012 5:50 AM

  • Oracle RAC Private Connection fail. what is the preferable node?

    Hello Everyone! I need all your helps about Oracle RAC.
    I would like to know that when the private network in oracle rac down, which is the preferable node in the cluster (cluster of 2 nodes) to takeover the cluster.
    Can I set/get the failover policy to point to one node in the cluster?
    Thank you in advance.

    Hi,
    Base on my testing environment, I use VMware to build the oracle rac.
    Because ifdown command reacts differently, now I use vmware feature on Network interface "disconnect" as pulling out the link from network interface.
    Please, kindly have a look on the actions, I have done. Correct me if I am wrong.
    I have two nodes which are node1 "rac1" and node2 "rac2".
    1. I start crs on node2 "rac2" so that node2 have the role to write to OCR
    2. After node2 start completely, I start crs on node1 "rac1" to join cluster.
    3. I use disconnect network link from private network on node1, and I also check using ethtool to check link detected:
    [root@rac1 ~]# ethtool eth1 | grep Link
    Link detected: no
    [root@rac1 ~]# ifconfig eth1
    eth1 Link encap:Ethernet HWaddr 00:0C:29:6A:73:20
    inet addr:192.168.2.231 Bcast:192.168.2.255 Mask:255.255.255.0
    UP BROADCAST MULTICAST MTU:1500 Metric:1
    RX packets:2658671 errors:0 dropped:0 overruns:0 frame:0
    TX packets:2069398 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:1615768514 (1.5 GiB) TX bytes:985464556 (939.8 MiB)
    4. After some seconds, I checked the log file
    [cssd(9517)]CRS-1612:Network communication with node rac2 (2) missing for 50% of timeout interval. Removal of this node from cluster in 14.620 seconds
    2013-02-12 04:12:30.419
    [cssd(9517)]CRS-1611:Network communication with node rac2 (2) missing for 75% of timeout interval. Removal of this node from cluster in 6.610 seconds
    2013-02-12 04:12:34.436
    [cssd(9517)]CRS-1610:Network communication with node rac2 (2) missing for 90% of timeout interval. Removal of this node from cluster in 2.590 seconds
    2013-02-12 04:12:37.036
    [cssd(9517)]CRS-1607:Node rac2 is being evicted in cluster incarnation 251972986; details at (:CSSNM00007:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log.
    2013-02-12 04:12:39.136
    [cssd(9517)]CRS-1625:Node rac2, number 2, was manually shut down
    2013-02-12 04:12:39.140
    [cssd(9517)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 .
    2013-02-12 04:12:39.157
    [crsd(9957)]CRS-5504:Node down event reported for node 'rac2'.
    2013-02-12 04:12:45.519
    [crsd(9957)]CRS-2773:Server 'rac2' has been removed from pool 'Generic'.
    2013-02-12 04:12:45.519
    [crsd(9957)]CRS-2773:Server 'rac2' has been removed from pool 'ora.oradb'
    5. I check the status resource of cluster and I see that Node1 "rac1" is the survived node.
    Please help me to analyze it.
    Thanks,
    Edited by: 985243 on Feb 12, 2013 1:53 AM

  • Linux Oracle RAC Issues with CRS

    Using the Linux Oracle RAC install guide - I've finally installed my install on Linux for the Oracle RAC. Just one problem - now after 10 mins or so - one of my nodes loses communication which barks out a PRKH-1010 error after trying to run a status check on my nodes using the srvctl status nodeapps -n <servername> command.
    any clues or ways to diagnose?

    Hi!
    The gsd relies on some files residing in /tmp/.oracle
    Are they still there?
    GSD is known to stop if they are absent.
    cu
    Andreas

  • I have problems with my 7510 holding a wireless network ip address 192.168 etc It says 169. etc

    My HP Photosmart all in one (which is only a few months old) stopped comunicating with my Netgear DGN1000 Adsl router a few days before Xmas.
    Instead of the 192.168.0.9 ip address that it used before I powered off the router, iit came back with an address of 169.254.249.128; "Configuration source" = "Auto ip"; a subnet mask of 255.255.0.0; and Default gateway of 0.0.0.0; I know these are wrong, so I tried a fixed ip address of 192.168.0.201, a SM of 255.255.255.0; and a DG of 192.168.0.1; This was OK, but overnight, it all went back to the auto ip settings.
    I eventually managed to contact HP, and the guy spent 75 minutes with me trying to reset things, and eventually he reckoned that the Netgear router was not allowing the printer access via some ports (which he emailed me a list of) and something he said I needed to tell my isp (Virgin media) “FLOOD DETECTION SET TO OFF” & “SP1 FIREWALL SET TO OFF”
    On contacting VM, they were insistant that their router was not at fault - they could open the 12 or so ports, at a cost to me of £60! (I declined this)
    HP had told me how to set up for Ad Hoc printing (by-passing the router) which had worked during our testing.
    VM had been into my settings for the router, via a remote access device, and checked a few settings, but the only one I saw them alter was changing from CH10 to CH11.
    I certainly could not get the printer to accept the 192.168.1.201 after this anyway.
    Following this, I reset the printers Network Defaults, and reconfigured the wireless settings. It did seem OK, and running on 192.168.0.9
    I have now reset the IP address to Manual on the printer, entering the 192.168.0.9 and 255.255.255.0; and 192.168.0.1;
    Touch wood it has held up for a few days, but I havn't switched anything off (but overnight before it went awry!)
    I'm not convinced I have got a fix here, and would welcome any suggestions as to what I can still do.
    Maybe I have already done some, as I have "completely uninstalled, and reinstalled the HP7510 software on my Desktop PC.
    Incidently the printer is set up on 3 PC's in the house - a desktop running W7 HP 64 bit, a Notebook (same OS variant) and a Laptop running W7 HP, but 32 bit.
    All were unable to print when I was having issues.
    I would welcome any suggestions to get a more permanat fix. (I would rather have found a definite fault) I have other routers I could try, or I could open ports, but my question is - If I needed these ports open, and other settings altered (Flood detection etc) why did the printer work for the first few weeks I had it set up, and why did powering off the router cause such issues? (suppose I need to power off the router again in the future - it does happen)
    Thanks
    Dave
    This question was solved.
    View Solution.

    Hey Dave,
    Great post with good information.
    As you mentioned, the printer came back with a 169.xxx.xxx.xxx style IP address. This is normally produced when the device is not able to get a complete connection with the router, thus the router gives it a temporary internal IP address.
    The normal suggestion when a printer stops maintaining a connection is to set a Static IP. This is done by using the manual IP feature you mentioned using. This locks the device to those network settings and even when the network is restarted the information is retained. This should be the fix to the issue.
    Hope this helps.
    -------------How do I give Kudos? | How do I mark a post as Solved? --------------------------------------------------------
    I am not an HP employee.

  • Gig Ethernet V/S  SCI as Cluster Private Interconnect for Oracle RAC

    Hello Gurus
    Can any one pls confirm if it's possible to configure 2 or more Gigabit Ethernet interconnects ( Sun Cluster 3.1 Private Interconnects) on a E6900 cluster ?
    It's for a High Availability requirement of Oracle 9i RAC. i need to know ,
    1) can i use gigabit ethernet as Private cluster interconnect for Deploying Oracle RAC on E6900 ?
    2) What is the recommended Private Cluster Interconnect for Oracle RAC ? GiG ethernet or SCI with RSM ?
    3) How about the scenarios where one can have say 3 X Gig Ethernet V/S 2 X SCI , as their cluster's Private Interconnects ?
    4) How the Interconnect traffic gets distributed amongest the multiple GigaBit ethernet Interconnects ( For oracle RAC) , & is anything required to be done at oracle Rac Level to enable Oracle to recognise that there are multiple interconnect cards it needs to start utilizing all of the GigaBit ethernet Interfaces for transfering packets ?
    5) what would happen to Oracle RAC if one of the Gigabit ethernet private interconnects fails
    Have tried searching for this info but could not locate any doc that can precisely clarify these doubts that i have .........
    thanks for the patience
    Regards,
    Nilesh

    Answers inline...
    Tim
    Can any one pls confirm if it's possible to configure
    2 or more Gigabit Ethernet interconnects ( Sun
    Cluster 3.1 Private Interconnects) on a E6900
    cluster ?Yes, absolutely. You can configure up to 6 NICs for the private networks. Traffic is automatically striped across them if you specify clprivnet0 to Oracle RAC (9i or 10g). That is TCP connections and UDP messages.
    It's for a High Availability requirement of Oracle
    9i RAC. i need to know ,
    1) can i use gigabit ethernet as Private cluster
    interconnect for Deploying Oracle RAC on E6900 ? Yes, definitely.
    2) What is the recommended Private Cluster
    Interconnect for Oracle RAC ? GiG ethernet or SCI
    with RSM ? SCI is or is in the process of being EOL'ed. Gigabit is usually sufficient. Longer term you may want to consider Infiniband or 10 Gigabit ethernet with RDS.
    3) How about the scenarios where one can have say 3 X
    Gig Ethernet V/S 2 X SCI , as their cluster's
    Private Interconnects ? I would still go for 3 x GbE because it is usually cheaper and will probably work just as well. The latency and bandwidth differences are often masked by the performance of the software higher up the stack. In short, unless you tuned the heck out of your application and just about everything else, don't worry too much about the difference between GbE and SCI.
    4) How the Interconnect traffic gets distributed
    amongest the multiple GigaBit ethernet Interconnects
    ( For oracle RAC) , & is anything required to be done
    at oracle Rac Level to enable Oracle to recognise
    that there are multiple interconnect cards it needs
    to start utilizing all of the GigaBit ethernet
    Interfaces for transfering packets ?You don't need to do anything at the Oracle level. That's the beauty of using Oracle RAC with Sun Cluster as opposed to RAC on its own. The striping takes place automatically and transparently behind the scenes.
    5) what would happen to Oracle RAC if one of the
    Gigabit ethernet private interconnects fails It's completely transparent. Oracle will never see the failure.
    Have tried searching for this info but could not
    locate any doc that can precisely clarify these
    doubts that i have .........This is all covered in a paper that I have just completed and should be published after Christmas. Unfortunately, I cannot give out the paper yet.
    thanks for the patience
    Regards,
    Nilesh

  • Oracle RAC one node

    why Oracle introduced Oracle RAC one node in 11gR2?
    I have gone through oracle documents on oracle rac one node, but i couldn't find much added advantage than instance failover. We have already some technologies like datagaurd and some third party softwares for instance failover.
    Then why oracle introduced this RAC one node in the new release i.e 11gR2?
    What exactly oracle wants to provide from oracle RAC one node?
    Thanks...
    Bharath

    Why RAC one node?
    Oracle RAC one node is a single instance of Oracle RAC that runs on the node in a cluster. The benefit of the RAC one node option is that it allows you to consolidate many databases into one cluster without a lot of overhead, while also providing high availbilty benefits of failover protection, as well as for Online rolling patch application and rolling upgrades for the Oracle clusterware.
    Another aspect of RAC one node allows you to limit th CPU utilization of individual database instances within the cluster through a feature called resource manager instance caging, which gives you the ability to dynamilcally change the limit as required.
    Furhtermore , with RAC one node there is no limitation for server scalabilty such that if applications outgrow the current resources than a single node can supply, you can then upgrade the applications online to Oracle RAC.
    In tthe event that the node which is runnig Oracle RAc one node becomes saturated and out of resources, you can migrate the instance to another node in the cluster using Oracle rac one node and another new utilty called OMOTION feature.OMOTION feature for Oracle RAC 11g R2 rac allows you to migrate a running instance to another server without downtime or distrubtion in service for your enviornment.
    Hope you're understand.

  • Oracle RAC 10g and drivers

    Hello,
    I'm configuring a WLP cluster to use a Oracle 10g RAC instance. [url http://e-generation.beasys.com/wlp/docs92/db/oracle.html]This document seems like a very good starting point. My question is: the document only specifies using Oracle Thin drivers when creating datasource for Oracle RAC. Is there any issue in using the Bea Oracle jdbc drivers to connect to an Oracle Rac instance?
    Thanks
    Luciano

    Luciano Fiandesio wrote:
    Hello,
    I'm configuring a WLP cluster to use a Oracle 10g RAC instance.
    [url http://e-generation.beasys.com/wlp/docs92/db/oracle.html]
    This document seems like a very good starting point. Myquestion is: the document only specifies using Oracle Thin
    drivers when creating datasource for Oracle RAC. Is there any
    issue in using the Bea Oracle jdbc drivers to connect to an
    Oracle Rac instance?
    Thanks
    Luciano
    Theoretically, there should be zero problem using the BEA-branded
    Oracle driver to talk to RAC. Our recommended configuration for
    MultiPools, and RAC use the driver in only the simplest way.
    However, for complete and least-confusing support, you should
    use the thin driver for RAC. This is because the RAC testing is so
    involved that we chose only to test one driver, the thin driver,
    so WLP is only certified with the thin driver. However, I would
    expect the BEA driver to work as well or better.
    Joe

  • How to change permissions on shared storage to install Oracle RAC on vmware

    Hello:
    - I am trying to install Oracle RAC using vmware.
    - But when I try to change permissions for the shared storage,
    the owner and group of the shared storage does not change.
    - Has some else installed Oracle RAC onto vmware ?
    - I am using Oracle RAC 10.2.0, solaris 5.10 x86
    Thanks
    Jlem

    I have successfully installed RAC on vmware following this article, maybe you can give it a try,
    Oracle 10g RAC On Linux Using VMware Server
    http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnCentos4UsingVMware.php

  • Can't configure Airport Extreme with IP 192.168.0.1 after software update

    Hi there,
    after updating my ax with utility software 5.3.1 and firmware 7.3.1. The software didn't allow the dhcp configuration to stay at IP range from 192.168.0.40 to 192.168.0.200
    The message said that this is not a valid IP.
    The configuration was working before without any problem.
    After several tries I changed to 192.168.1.40 and 192.168.1.200. Now I was able to save the changes. And the airport is working well.
    But I can't go back to 192.168.0
    But I need to use 192.168.0 for a tunnel to connect to my wifes company.
    Configuration:
    Seperate Modem with DSL.
    Connecting over PPPoE
    Activeted WLan
    Connected computers over Lan and Wlan
    Can anybody help?
    Thanx
    Stephan

    by-feet, Welcome to the discussion area!
    AFAIK the AirPort Extreme base station (AEBS) has always forced the 3rd digit to be a 1 (one), as in x.y.1.z.
    Could it be that you previously had the AEBS to operate as a bridge and your "modem" was actually suppling the IP addresses?

  • Browser 192.168.1.1 Password and Username aren't working.

    I'm trying to access all of the router options so I can open some ports up but no matter what combination I try for the User Name and Password, nothing works.  My router's model number is WRT54G2 and I am wired to it, not wireless.  I haven't messed with any of the settings so the deafults should work...but they don't.  I don't know what else to do.

    Your User Name should be left blank, and the Password should be "admin"  (with no quotes).   If this does not work, and you do not remember setting any different password, then you will need to reset your router to factory defaults, and setup the router again from scratch.  If you saved a router configuration file, DO NOT use it.
    To reset your router to factory defaults, use the following procedure:
    1) Power down all computers, the router, and the modem, and unplug them from the wall.
    2) Disconnect all wires from the router.
    3) Power up the router and allow it to fully boot (1-2 minutes).
    4) Press and hold the reset button for 30 seconds, then release it, then let the router reset and reboot (2-3 minutes).
    5) Power down the router.
    6) Connect one computer by wire to port 1 on the router (NOT to the internet port).
    7) Power up the router and allow it to fully boot (1-2 minutes).
    8) Power up the computer (if the computer has a wireless card, make sure it is off).
    9) Try to ping the router. To do this, click the "Start" button > All Programs > Accessories > Command Prompt. A black DOS box will appear. Enter the following: "ping 192.168.1.1" (no quotes), and hit the Enter key. You will see 3 or 4 lines that start either with "Reply from ... " or "Request timed out." If you see "Reply from ...", your computer has found your router.
    10) Open your browser and point it to 192.168.1.1. This will take you to your router's login page. Leave the user name blank, and in the password field, enter "admin" (with no quotes). This will take you to your router setup page. Note the version number of your firmware (usually listed near upper right corner of screen). Exit your browser.
    If you get this far without problems, try the setup disk (or setup the router manually, if you prefer), and see if you can get your router setup and working.
    If you cannot get "Reply from ..." in step 9 above, your router is likely dead.  Report back with this problem.
    If you get a reply in step 9, but cannot complete step 10, then either your router is dead or the firmware is corrupt.  Report back with this problem. 
    If you need additional help, please state your ISP, the make and model of your modem, your router's firmware version, and the results of steps 9 and 10. Also, if you get any error messages, copy them exactly and report back.
    Please let me know how things turn out for you.
    P.S.  Have you been running your router with no wireless encryption?  If so, then perhaps your neighbor wirelessly connected to your router (intentionally or unintentionally) and changed your password.
    Message Edited by toomanydonuts on 04-26-2009 06:09 AM

  • Regarding Hangcheck timer configuration in Oracle RAC 10g r2 installation

    Hi,
    Is it necessary to configure hangcheck timer in Oracle RAC 10g R2 installation .
    Can somebody guide when we should install the hangcheck timer in Linux oracle 10g R2.
    Best Regards
    Gupteswar Prasad Mishra
    Edited by: Gupteswar on Jan 25, 2010 8:42 PM

    yes, its recommended to configure hangcheck timer in RAC configuration
    Configure the Hangcheck Timer
    The hang-check timer is loaded into the Linux kernel and checks if the system hangs. It will set a timer and check the timer after a certain amount of time. There is a configurable threshold to hang-check that, if exceeded will reboot the machine. Although the hangcheck-timer module is not required for Oracle Clusterware (Cluster Manager) operation, it is highly recommended by Oracle.
    cat /etc/rc.local
    modprobe hangcheck-timer hangcheck_tick=1 hangcheck_margin=10 hangcheck_reboot=1

Maybe you are looking for

  • Windows Phone 8.1 can't install "Windows Phone App Studio certificate"

    I try to install the certificates from provided on appstudio.windowsphone.com/Home/HowTo choose "Open" device go to "Add workplace account"  I choose "add"  nothing happen and can't install my app in next step thank you

  • Is there an Adobe-sanctioned utility to certify a valid PDF file?

    Is there an Adobe-sanctioned utility to certify a valid PDF file? ...other than Acrobat, that is. I am gathering enough courage to start modifying and creating something that hopefully will resemble a valid PDF file. I already did this years ago, wit

  • STMP problem : check email settings

    Hello, I am trying to use the smtp demo to send email through my work account how ever i am encountering this error SMTP SEND FAILED: Command: MAIL FROM:<DSSOUTBOUND@DSSopen1> RetCode: 551 Response: 551 Sender address is not valid for your login. Che

  • Adobe CS3 - No record of purchase, how do I re-download?

    This is so crazy, I don't even know where to start.  I'll try in a nutshell: 1)  I have InDesign CS on disc. 2)  I upgraded to CS2.  I have record of all of that, and Adobe has my record of that purchase.  (Although I can no longer download from thei

  • OBI - Migration between environments

    Does anyone have a best practice document or even a document on how to migrate reports from OBI 10.1.3.4 between a dev to prod environment? Can't seem to find anything on the Oracle website.