Redundant Interconnect Usage

Hello everyone,
This is regarding configuring Redundant Interconnect Usage on 11gr2 RAC on linux.
The RAC is already installed and so I think that I've to use "oifcfg" to configure the same. However, I've few questions regarding the same.
oifcfg iflist -p -n
eth0 10.1.1.0 PRIVATE 255.255.255.0
eth0  169.254.0.0  UNKNOWN  255.255.0.0*
eth2 172.16.2.0 PRIVATE 255.255.254.0
My questions are:
- The eth3 is the new interface provided by system admins. So I think below command will work for me
- oifcfg setif -global eth3/169.254.0.0:clusster_interconnect
- 169.254.0.0 is chosen as the same is current subnet used by cluster interconnect as mentioned above.
- Also, just like eth0 does have a IP statically assigned and there is another IP given again to it by oracle for "redundant interconnect usage", I guess eth3 too needs a IP on each node statically assigned and there will be another IP assigned and managed by CRS for RIU. Am I correct ?
thanks

jjk wrote:
This is regarding configuring Redundant Interconnect Usage on 11gr2 RAC on linux.Why not use bonding? 2 interfaces. Each cabled to a separate private switch. Switches connected to one another. Bond the 2 interface as a single interface. Use the bonded interface as private Interconnect interface.
With this config you can loose a cable or an entire switch - but the Interconnect will still function.
This is a much more robust method than using 2 separate interfaces individually. A network socket on a bonded interface survives an underlying infrastructure failure as the logical bonded interface does not fail.
Using 2 interfaces means that a network socket on the failed interface, also fails. And the s/w needs to be intelligent enough to perform a (potentially complex) failover to the 2nd interface, re-establish communication, handshake and then resume the conversation from where it failed. This is a lot more moving parts than using a bonded interface running on top of redundant paths and hardware.

Similar Messages

  • Redundant Interconnect Usage - interfaces requirements

    Hi All,
    I'm supporting a customer just installing a GI 11.2.0.3.3 on Aix 6.1, I was asked for HAIP requirements in order to properly set up the IC interfaces and network.
    Can you confirm me that all statement shown below are true?
    [as an example: we have 2 physical interfaces per machine to be user for IC]
    - all interfaces on different subnets
    - all interfaces have to communicate with each other
    in other words, in order to let all interfaces to communicate with each other (even if they are on different subnets) we must implement such a routing network
    configuration (layer 3) ... layer 2 network configuration is not enough.
    Thank you, regards.

    Hi,
    read the following MOS Note:
    11gR2 Grid Infrastructure Redundant Interconnect and ora.cluster_interconnect.haip (Doc ID 1210883.1)
    That should clarify all your questions. Especially this extract:
    NOTE: If using the 11.2.0.2 (and above) Redundant Interconnect/HAIP feature (as documented in CASE 2 below) - At present it is REQUIRED that all interconnect interfaces be placed on separate subnets. If the interfaces are all on the same subnet and the cable is pulled from the first NIC in the routing table a rebootless-restart or node reboot will occur.
    Regards
    Sebastian
    Edited by: Sebastian Solbach (DBA Community) on Oct 8, 2012 6:50 AM

  • How to setup Redundant Interconnects ?

    I am planning to install 11.2.0.3 Grid Infrastructure on a Solaris platform , We used to do IPMP before for High availability interconnect.
    since 11.2.0.2 Oracle seems to address it this by itself but I am having a hard time finding documentation,
    I am trying to figure out what I need to request the network admin and SA to be able to start the install.
    We use VLAN for interconnects, so for HAIP I need multiple VLANS and have interfaces created for those by the SA's so that I can use at the "Network Interface Usage" stage of GI install ?
    I found following online about this but kind of confused, it talk about having 2 interfaces , This example shows eth1 and eth2 using a 192.168.0.* subnet. But shouldn't they supposed to be on different subnets , rather then same subnet ?
    http://en.community.dell.com/techcenter/enterprise-solutions/w/oracle_solutions/2-4-1-how-do-i-setup-the-new-redundant-interconnect-feature-in-oracle-11gr2.aspx

    Oracle MoS:
    *Solaris IPMP and Trunking for the cluster interconnect in Oracle Grid Infrastructure 11g Rel. 2 [ID 1069584.1]*
    11.2.0.2 and above
    Started from 11.2.0.2, as Redundant Interconnect is supported natively by Oracle Clusterware, it's not recommended to configure IPMP for cluster interconnect anymore; please refer to note 1210883.1 for more details.
    But the note *1210883.1* have a huge list of bug, you must be aware of list of bug of HAIP before choose this option:
    11gR2 Grid Infrastructure Redundant Interconnect and ora.cluster_interconnect.haip [ID 1210883.1]
    I never used HAIP, then I'm suspect to give my opinion. I always use bound of interface at OS level I consider more simple to manage and is more mature.

  • What is Multicasting?

    Grid Version: 11.2
    OS : AIX 6.1
    I come across articles on RAC on AIX where the term Multicasting is frequently referenced. (For eg: thread like below)
    NICs for Private Interconnect redundancy
    When I googled it , i found articles like below which hasn't got anything to do with RAC networking at all
    http://en.wikipedia.org/wiki/Multicast
    Any idea what Multicasting is and how it is related to RAC?

    Hi,
    IP multicast is a technique for one-to-many communication over an IP infrastructure in a network. It scales to a larger receiver population by not requiring prior knowledge of who or how many receivers there are. Multicast uses network infrastructure efficiently by requiring the source to send a packet only once, even if it needs to be delivered to a large number of receivers. The nodes in the network take care of replicating the packet to reach multiple receivers only when necessary.
    The most common transport layer protocol to use multicast addressing is User Datagram Protocol (UDP). By its nature, UDP is not reliable—messages may be lost or delivered out of order. Reliable multicast protocols such as Pragmatic General Multicast (PGM) have been developed to add loss detection and retransmission on top of IP multicast.
    The multicast addresses are in the range 224.0.0.0 through 239.255.255.255. The range of addresses between 224.0.0.0 and 224.0.0.255, inclusive, is reserved for the use of routing protocols and other low-level topology discovery or maintenance protocols, such as gateway discovery and group membership reporting. Multicast routers should not forward
    any multicast datagram with destination addresses in this range, regardless of its TTL.
    http://www.iana.org/assignments/multicast-addresses/multicast-addresses.xml
    Oracle Grid Infrastructure 11.2.0.2 introduces a new feature called "Redundant Interconnect Usage", which provides an Oracle internal mechanism to make use of physically redundant network interfaces for the Oracle (private) interconnect.
    As part of this new feature, multicast based communication on the private interconnect is utilized to establish communication with peers in the cluster on each startup of the stack on a node.
    Once the connection with the peers in the cluster has been established, the communication is switched back to unicast. Per default, the 230.0.1.0 address (port 42424) on the private interconnect network is used for multicasting. Another IP can be enabled using the patch mentioned below, if it is determined that using the 230.0.1.0 IP causes the multicast communication to fail. Multicasting on either of these IPs and the respective port must, however, be enabled and functioning across the network and on each node meant to be part of the cluster. If multicasting is not enabled as required, nodes will fail to join the cluster with the symptoms discussed.
    Regards,
    Levi Pereira
    Edited by: Levi Pereira on May 31, 2012 2:20 PM

  • Can any one say that list of hardware for 11gr2 2node rac installation?  thank in advance

    can any one say that list of hardware for 11gr2 2node rac installation?  thank in advance

    Hi ,
    Hardware Requirements
    Physical memory (at least 1.5 gigabyte (GB) of RAM)
    An amount of swap space equal to the amount of RAM
    Temporary space (at least 1 GB) available in /tmp
    A processor type (CPU) that is certified with the release of the Oracle software being installed
    A minimum of 1024 x 786 display resolution, so that Oracle Universal Installer (OUI) displays correctly
    All servers that are used in the cluster must have the same chip architecture, for example, all 32-bit processors or all 64-bit processors
    Adequate disk space in the software installation locations to store the Oracle software
    You need at least 5.5 GB of available disk space for the Grid home directory, which includes both the binary files for Oracle Clusterware and Oracle Automatic Storage Management (Oracle ASM) and their associated log files, and at least 4 GB of available disk space for the Oracle Database home directory, or Oracle home directory.
    About Shared Storage
    These Oracle Clusterware components require the following disk space on a shared file system:
    Three Oracle Clusterware Registry (OCR) files, 300 MB each, or 900 MB total disk space
    Three voting disk files, 300 MB each, or 900 MB total disk space
    If you are not using Oracle ASM for storing Oracle Clusterware files, then for best performance and protection, you should use multiple disks, each using a different disk controller for voting disk file placement. Ensure that each voting disk is configured so that it does not have share any hardware device or have a single point of failure.
    Network Hardware Requirements
    When you configure the network for Oracle RAC and Oracle Clusterware, each node in the cluster must meet the following requirements:
    Each node must have at least two network interface cards (NIC), or network adapters. One adapter is for the public network interface and the other adapter is for the private network interface (the interconnect). Install additional network adapters on a node if that node meets either of the following conditions:
    Does not have at least two network adapters
    Has two network interface cards but is using network attached storage (NAS). You should have a separate network adapter for NAS.
    Has two network cards, but you want to use redundant interconnectsIn previous releases, to make use of redundant networks for the interconnect, bonding, trunking, teaming, or similar technology was required. Oracle Grid Infrastructure for a cluster and Oracle RAC can now make use of redundant network interconnects, without the use of other network technology, to enhance optimal communication in the cluster. This functionality is available starting with Oracle Database 11g Release 2 (11.2.0.2).Redundant Interconnect Usage enables load-balancing and high availability across multiple (up to 4) private networks (also known as interconnects).
    However, When you install Oracle software, Oracle Universal Installer (OUI) automatically performs hardware prerequisite checks and notifies you if they are not met.
    Regards,
    Pradeep. V

  • NICs for Private Interconnect redundancy

    DB/Grid version : 11.2.0.2
    Platform : AIX 6.1
    We are going to install a 2-node RAC on AIX (that thing which is almost good as Solaris )
    Our primary private interconnect is
    ### Primary Private Interconnect
    169.21.204.1      scnuprd186-privt1.mvtrs.net  scnuprd186-privt1
    169.21.204.4      scnuprd187-privt1.mvtrs.net  scnuprd187-privt1For Cluster inteconnect's redundancy , Unix team has attached an extra NIC for each node with an extra Gigabit-ethernet switch for these NICs.
    ###Redundant Private Interconnect attached to the server
    169.21.204.2      scnuprd186-privt2.mvtrs.net  scnuprd186-privt2  # Node1's newly attached redundant NIC
    169.21.204.5      scnuprd187-privt2.mvtrs.net  scnuprd187-privt2  # Node2's newly attached redundant NICExample borrowed from citizen2's post
    Apparently I have 2 ways to implement cluster inteconnect's redundancy
    Option1. NIC bonding at OS level
    Option2. Let grid software do it
    Question1. Which is better : Option 1 or 2 ?
    Question2.
    Regarding Option2.
    From googling and OTN , i gather that , during grid installation you just provide 169.21.204.0 for cluster inteconnect and grid will identify the redundant NIC and switch. And if something goes wrong with the Primary Interconnect setup (shown above) , grid will automatically re-route interconnect traffic using the redundant NIC setup. Is this correct ?
    Question 3.
    My colleague tells me , for the redundant Switch (Gigabit) Unless I configure some Multicasting (AIX specific), I could get errors during installation. He doesn't clearly what it was ? Anyone faced Multicasting related issue on this ?

    Hi,
    My recommendation is to you use the AIX EtherChannel.
    The EtherCannel of AIX is much more powerfull and stable compared with HAIP.
    See how setup AIX EtherChannel on 10 Gigabit Ethernet interfaces
    http://levipereira.wordpress.com/2011/01/26/setting-up-ibm-power-systems-10-gigabit-ethernet-ports-and-aix-6-1-etherchannel-for-oracle-rac-private-interconnectivity/
    If you choose use HAIP I recommend you read this note, and find all notes about bugs of HAIP on AIX.
    11gR2 Grid Infrastructure Redundant Interconnect and ora.cluster_interconnect.haip [ID 1210883.1]
    ASM Crashes as HAIP Does not Failover When Two or More Private Network Fails [ID 1323995.1]
    About Multicasting read it:
    Grid Infrastructure 11.2.0.2 Installation or Upgrade may fail due to Multicasting Requirement [ID 1212703.1]
    Regards,
    Levi Pereira

  • RAC connection problem with interconnect NIC failure

    We have an 11g 2-node test RAC setup on RHEL 4 that is configured to have no load balancing (client or server), with Node2 existing as a failover node only. Connection and vip failover works fine in most situations (public interface fail, node fail, cable pull, node 2 interconnect fail, interconnect switch fail etc etc).
    When the node1 interconnect card failure is emulated (ifdown eth1):
    node2 gets evicted and reboots
    failover of existing connections occurs
    VIP from node2 is relocated to node1
    However new connection attempts from clients and the server receive a ORA-12541: TNS:no listener message.
    The basis of this is the issue that in the event of an interconnect failure, the lowest number node is supposed to survive - it looks like this includes the situation where the lowest number node has a failed interconnect NIC; ie it has a hardware fault.
    I checked this with Oracle via an iTAR quite some time ago (under 10g) and they eventually confirmed that this eviction of the healthy 2nd node is correct behaviour. In 10g, this situation would result in the remaining instance failing due to the unavailable NIC, however I did not get the chance to fully test and resolve this with Oracle.
    In 11g, the alert log continuously reports the NIC's unavailability. The instance remains up, but new connections cannot be established. If the NIC is re-enabled then new connections are able to be established. At all times, srvctl status nodeapps on the surviving node and lsnrtcl show that the listener is functional.
    The alert log reports the following, regarding a failed W000 or M000 process:
    ospid 13165: network interface with IP address 192.168.1.1 no longer operational
    requested interface 19.2.168.1.1 not found. Check output from ifconfig command
    ORA-603 : opidrv aborting process W000 ospid (16474_2083223480)
    Process W000 died, see its trace file
    The W000 trace file refers to an Invalid IP Address 192.168.1.1 (the interconnect ip address) obviously the source of the process dying.
    Finally, if I restart the remaining instance via srvctl stop/start instance with the NIC still unavailable, the instance will allow new connections and does not report the failures of the W000/M000 process or appear to care about the failed NIC.
    Before I go down the iTAR path or start posting details of the configuration, has anyone else experienced/resolved this, or can anyone else test it out?
    Thanks for any input,
    Gavin
    Listener.ora is:
    SID_LIST_LISTENER_NODE1=
    (SID_LIST=
    (SID_DESC=
    (ORACLE_HOME=/u01/app/oracle/product/11.1.0/db_1)
    (SID_NAME=RAC_INST)
    (SID_DESC=
    (ORACLE_HOME=/u01/app/oracle/product/11.1.0/db_1)
    (SID_NAME=RAC_INST1)
    (SID_DESC=
    (ORACLE_HOME=/u01/app/oracle/product/11.1.0/db_1)
    (SID_NAME=RAC_INST2)
    SID_LIST_LISTENER_NODE2=
    (SID_LIST=
    (SID_DESC=
    (ORACLE_HOME=/u01/app/oracle/product/11.1.0/db_1)
    (SID_NAME=RAC_INST)
    (SID_DESC=
    (ORACLE_HOME=/u01/app/oracle/product/11.1.0/db_1)
    (SID_NAME=RAC_INST2)
    (SID_DESC=
    (ORACLE_HOME=/u01/app/oracle/product/11.1.0/db_1)
    (SID_NAME=RAC_INST1)
    LISTENER_NODE1 =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL=TCP)(HOST=vip-NODE1)(PORT=1521)(IP=FIRST))
    (ADDRESS = (PROTOCOL=TCP)(HOST=NODE1)(PORT=1521)(IP=FIRST))
    LISTENER_NODE2 =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL=TCP)(HOST=vip-NODE2)(PORT=1521)(IP=FIRST))
    (ADDRESS = (PROTOCOL=TCP)(HOST=NODE2)(PORT=1521)(IP=FIRST))
    )

    Thanks for your reply.
    There is no NIC bonding - the interconnect is a single, dedicated Gigabit link connected via a dedicated switch: plenty of bandwidth.
    I know that providing interconnect NIC redundancy would provide a fallback position on this (although how far do you go: redundant interconnect switches as well?), and that remains an option.
    However that's not the point. RAC does not require a redundant interconnect - as a high-availability solution it should inherently provide a failover position that continues to provide an available instance, as it does for all other component failures.
    Unless I've made a mistake in the configuration (which is very possible, but all the other successful failover scenarios suggest I haven't), then this could be a scenario that renders a 2-node cluster unavailable to new connections.
    Gavin

  • Camera roll is empty, but usage claims space is being used

    Hi all. I hope someone can help me with this.
    My camera roll contains no items. I upload all new pictures and videos to OneDrive and then delete them from the camera roll to save the hassle of connecting my iPhone 5s to my Mac to copy them.
    I've never lost items using this technique; that's not the issue here. The issue is when I go to Settings>General>Usage>Photos & Camera the camera roll is apparently using 63.4MB of storage space on my device.
    This also happened after I migrated from my 4s to my 5s. My camera roll was empty but was allegedly using over 700MB of storage. I attempted to resolve this by using an iCloud backup and omitting the camera roll, which resolved the issue but caused more serious problems, one of which was preventing me from syncing music to my device.
    I have a 64GB device so I'm not very short on storage, but I don't like the idea of something taking space on my device for no good reason (that's why I don't use Photo Stream anymore, by the way). Besides, 700MB was far too much to lose for something that was, for all intents and purposes, empty.
    I eventually decided to reset my 5s entirely and set it up as a new device. This thankfully reset the camera roll back to zero bytes, but it's once again started culminating seemingly redundant storage usage. Thanks to iCloud most of my apps have retained their data, so I'm not too bothered about having to do this, but I'd rather not have to make it a habit every time my empty camera roll takes up close to a gigabyte of storage.
    Has anyone else come across this issue? Can anything be done about it?

    I tried to do this:
    Settings > General > Usage > Photos & Camera > swipe on Camera Roll and tap Delete. 
    But it does not give me an option to delete - no Edit button, no swiping Delete button. Is that a glitch or am I missing something?
    Also, I read about iExplorer and tried a demo - there were quite a few files under a folder labeled DMIV or something...tried to delete but they wanted me to buy the software before I could. Don't know if this is a scam or if there are hidden photo files which is what it seems like.

  • Multiple Interconnects on SC 3.x

    Upon reading the publicly available SC documentation at docs.sun.com I gathered a few things.. each node can have upto 8 interconnects and Sun Cluster stripes traffic across the interconnects..
    I would imagine that the cluster internal traffic (ie. membership information, resouce group configuration changes, etc..) would make use of this stripped interconnect .
    what about data service like Oracle RAC? do data services transparently use the stripped interconnect?
    Am I on the right track or completly off base here?

    No. The applications should not be using the cluster
    interconnects to transfer any data. Cluster
    interconnects are for cluster information only.This really isn't the case. But I'll grant that the terminology
    is not optimal to describe this properly. There are quite
    a few applications which do use the cluster interconnect.
    The most popular is Oracle RAC.
    For Sun Cluster, the interconnects have relatively low
    utlization. If you are using the global file service
    (HAStorage resource type) then there may be more
    interconnect usage. But the normal cluster needs are
    what I consider a null load.
    In the latest Sun Cluster releases, we provide
    striping of user-level traffic across the interconnect.
    This is useful for Oracle RAC, but comes in handy for
    other things too.
    In case you have a cluster in which one of the nodes
    is not directly connected to the disks then the
    information is transfered via the interconnect by the
    cluster software.For shared disk resources, I would recommend using
    HAStoragePlus which is more of a traditional failover
    file system service. This will dramatically reduce the
    interconnect use over HAStorage.
    Although technically you can configure the
    applications to use the interconnects it is NOT
    recommended.What we worry about is missing some important cluster
    related packets due to high network utilization. Unless
    you are using ancient hardware and 10 Mbit/s ethernet,
    then this risk is really quite small.
    If your goal is to have a high bandwidth interconnect
    between cluster nodes, you can also setup a "public"
    network which would accomplish this. As we move
    forward to 10Gbit/s ethernet, we will have plenty of
    bandwidth for most applications.
    -- richard

  • Interconnect vs teaming

    hi
    Oracle 11.2 RAC Std @ 2 nodes of Windows 2008 R2 Std
    each server/node has 4 ETHs, where one of them is linked to LAN (3 are spare)
    2 redundant interconnect switches
    the teaming made of 2 interfaces at each node (1 is spare now)
    I wonder if I can use "3-lines" teaming, where 2 interfaces go to IC switch 1 and the 3rd one - to IC switch 2.
    Probably it will work, but I am afraid of latencies caused by not equal load.
    How do you view it?

    I've found in vendor (HP) manual that it depends on teaming method, so in example in TLB mode it is possible.
    If anyone has more/other experience please give some hints.

  • Public Interface configuration - Bonding Yes / No ?

    Hey, during my setup of my rac, I configured two nics for public usage and two nics for private (interconnect) usage.
    While running raccheck utility - it states that no bonding has been configured for public interface.
    In a course in oracle university they told us to configure the public interfaces as I did.
    Question: Is my configuration incorrect ? Do I need to have a bonding interface for my public network ?
    Chris

    Please use the SEARCH feature before posting - this is thread# 3 or 4 for this same question.
    If you only have 2 NICs it was configured correctly according to your "university", However, your university configuration is WRONG and it is NOT a supported configuration.
    See my response to thread: Re: Production site RAC redundant architecture deployment

  • Failed root.sh on 1st Node of 11.2.0.2.0 RAC on HP-UX 11.31 Itanium 64

    Started with 11.2.0.2.0 Grid Installation for 2 Node RAC on HP-UX 11.31 Itanium 64.
    Copying Software to remote node & linking libraries were successfully without any issue (upto 76%). But got issue while executing root.sh on Node1
    sph1erp:/oracle/11.2.0/grid #sh root.sh
    Running Oracle 11g root script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /oracle/11.2.0/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root script.
    Now product-specific root actions will be performed.
    Using configuration parameter file: /oracle/11.2.0/grid/crs/install/crsconfig_params
    Creating trace directory
    LOCAL ADD MODE
    Creating OCR keys for user 'root', privgrp 'sys'..
    Operation successful.
    OLR initialization - successful
    root wallet
    root wallet cert
    root cert export
    peer wallet
    profile reader wallet
    pa wallet
    peer wallet keys
    pa wallet keys
    peer cert request
    pa cert request
    peer cert
    pa cert
    peer root cert TP
    profile reader root cert TP
    pa root cert TP
    peer pa cert TP
    pa peer cert TP
    profile reader pa cert TP
    profile reader peer cert TP
    peer user cert
    pa user cert
    Adding daemon to inittab
    CRS-2672: Attempting to start 'ora.mdnsd' on 'sph1erp'
    CRS-2676: Start of 'ora.mdnsd' on 'sph1erp' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'sph1erp'
    CRS-2676: Start of 'ora.gpnpd' on 'sph1erp' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'sph1erp'
    CRS-2672: Attempting to start 'ora.gipcd' on 'sph1erp'
    CRS-2676: Start of 'ora.gipcd' on 'sph1erp' succeeded
    CRS-2676: Start of 'ora.cssdmonitor' on 'sph1erp' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'sph1erp'
    CRS-2672: Attempting to start 'ora.diskmon' on 'sph1erp'
    CRS-2676: Start of 'ora.diskmon' on 'sph1erp' succeeded
    CRS-2676: Start of 'ora.cssd' on 'sph1erp' succeeded
    ASM created and started successfully.
    Disk Group OCRVOTE created successfully.
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'sys'..
    Operation successful.
    CRS-4256: Updating the profile
    Successful addition of voting disk ab847ed2b4f04f2dbfb875226d2bb194.
    Successful addition of voting disk 85c05a5b30384f8dbff48cc069de7a7c.
    Successful addition of voting disk 649196fbdd614f9cbf26a9a0e6670a6e.
    Successful addition of voting disk 8815dfcee2e64f64bf00b9c76626ab41.
    Successful addition of voting disk 8ce55fe5534f4f77bfa9f54187592707.
    Successfully replaced voting disk group with +OCRVOTE.
    CRS-4256: Updating the profile
    CRS-4266: Voting file(s) successfully replaced
    ## STATE File Universal Id File Name Disk group
    1. ONLINE ab847ed2b4f04f2dbfb875226d2bb194 (/dev/oracle/ocrvote1) [OCRVOTE]
    2. ONLINE 85c05a5b30384f8dbff48cc069de7a7c (/dev/oracle/ocrvote2) [OCRVOTE]
    3. ONLINE 649196fbdd614f9cbf26a9a0e6670a6e (/dev/oracle/ocrvote3) [OCRVOTE]
    4. ONLINE 8815dfcee2e64f64bf00b9c76626ab41 (/dev/oracle/ocrvote4) [OCRVOTE]
    5. ONLINE 8ce55fe5534f4f77bfa9f54187592707 (/dev/oracle/ocrvote5) [OCRVOTE]
    Located 5 voting disk(s).
    Start of resource "ora.cluster_interconnect.haip" failed
    CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'sph1erp'
    CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
    Start action for HAIP aborted
    CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'sph1erp' failed
    CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'sph1erp'
    CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'sph1erp' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    Failed to start Oracle Clusterware stack
    Failed to start High Availability IP at /oracle/11.2.0/grid/crs/install/crsconfig_lib.pm line 1046.
    */oracle/11.2.0/grid/perl/bin/perl -I/oracle/11.2.0/grid/perl/lib -I/oracle/11.2.0/grid/crs/install /oracle/11.2.0/grid/crs/install/rootcrs.pl execution failed*
    sph1erp:/oracle/11.2.0/grid #
    Last few lines from CRS Log for node 1, where error came
    [ctssd(6467)]CRS-2401:The Cluster Time Synchronization Service started on host sph1erp.
    2011-02-25 23:04:16.491
    [oracle/11.2.0/grid/bin/orarootagent.bin(6423)]CRS-5818:Aborted command 'start for resource: ora.cluster_interconnect.haip 1 1' for resource 'ora.cluster_int
    erconnect.haip'. Details at (:CRSAGF00113:) {0:0:178} in */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
    2011-02-25 23:04:20.521
    [ohasd(5513)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cluster_interconnect.haip'. Details at (:CRSPE00111:) {0:0:178} in
    */oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
    Few lines from */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
    =====================================================================================================
    2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Starting Probe for ip 169.254.74.54
    2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Transitioning to Probe State
    2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} [NetHAMain] thread stopping
    2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} Thread:[NetHAMain]isRunning is reset to false here
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAMain]stop }
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} thread cleaning up
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} pausing thread
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} posting thread
    2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
    2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} [NetHAWork] thread stopping
    2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} Thread:[NetHAWork]isRunning is reset to false here
    2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
    2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
    2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
    2011-02-25 23:04:17.891: [ora.cluster_interconnect.haip][12] {0:0:178} [start] Start of HAIP aborted
    2011-02-25 23:04:17.892: [ AGENT][12] {0:0:178} UserErrorException: Locale is
    2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsnUtils::error Exception type=2 string=
    CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
    Start action for HAIP aborted
    2011-02-25 23:04:17.893: [ AGFW][12] {0:0:178} sending status msg [CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the foll
    owing error:
    Start action for HAIP aborted
    ] for start for resource: ora.cluster_interconnect.haip 1 1
    2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsn_agent::start }
    2011-02-25 23:04:17.894: [ AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
    2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check {
    2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check } - 0
    2011-02-25 23:04:19.573: [ AGFW][10] {0:0:154} Agent received the message: AGENT_HB[Engine] ID 12293:669
    2011-02-25 23:04:20.510: [ora.cluster_interconnect.haip][18] {0:0:178} [start] got lock
    2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] tryActionLock }
    2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] abort }
    2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] clsn_agent::abort }
    2011-02-25 23:04:20.511: [ AGFW][18] {0:0:178} Command: start for resource: ora.cluster_interconnect.haip 1 1 completed with status: TIMEDOUT
    2011-02-25 23:04:20.512: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init enter {
    2011-02-25 23:04:20.513: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init exit }
    2011-02-25 23:04:20.517: [ AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
    2011-02-25 23:04:20.519: [ USRTHRD][8] {0:0:178} Ocr Context init default level 23886304
    2011-02-25 23:04:20.519: [ default][8]clsvactversion:4: Retrieving Active Version from local storage.
    [ CLWAL][8]clsw_Initialize: OLR initlevel [70000]
    Few lines from */oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
    =====================================================================================================
    2011-02-25 23:04:21.627: [UiServer][30] {0:0:180} Done for ctx=6000000002604ce0
    2011-02-25 23:04:21.642: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:26.139: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:26.139: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    2011-02-25 23:04:26.973: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
    2011-02-25 23:04:26.973: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
    DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
    2011-02-25 23:04:26.992: [UiServer][30] {0:0:181} processMessage called
    2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending message to PE. ctx= 6000000001b440f0
    2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending command to PE: 67
    2011-02-25 23:04:26.994: [ CRSPE][29] {0:0:181} Processing PE command id=173. Description: [Stat Resource : 600000000135f760]
    2011-02-25 23:04:26.997: [UiServer][30] {0:0:181} Done for ctx=6000000001b440f0
    2011-02-25 23:04:27.012: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:31.135: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:31.135: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    2011-02-25 23:04:32.318: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
    2011-02-25 23:04:32.318: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
    DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
    2011-02-25 23:04:32.332: [UiServer][30] {0:0:182} processMessage called
    2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending message to PE. ctx= 6000000001b45ef0
    2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending command to PE: 68
    2011-02-25 23:04:32.334: [ CRSPE][29] {0:0:182} Processing PE command id=174. Description: [Stat Resource : 600000000135f760]
    2011-02-25 23:04:32.338: [UiServer][30] {0:0:182} Done for ctx=6000000001b45ef0
    2011-02-25 23:04:32.352: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:36.155: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:36.155: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    2011-02-25 23:04:37.683: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
    2011-02-25 23:04:37.683: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
    DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
    2011-02-25 23:04:37.702: [UiServer][30] {0:0:183} processMessage called
    2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending message to PE. ctx= 6000000002604ce0
    2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending command to PE: 69
    2011-02-25 23:04:37.704: [ CRSPE][29] {0:0:183} Processing PE command id=175. Description: [Stat Resource : 600000000135f760]
    2011-02-25 23:04:37.708: [UiServer][30] {0:0:183} Done for ctx=6000000002604ce0
    2011-02-25 23:04:37.722: [UiServer][31] Closed: remote end failed/disc.
    2011-02-25 23:04:41.156: [ CLSINET][33]Returning NETDATA: 1 interfaces
    2011-02-25 23:04:41.156: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
    erconnect'
    What could be the issue ????
    Experts Please help me. Doing setup for the PRoduction Env...
    Do response ASAP...... Thanks
    Regards,
    Manish

    Thanks Sebastian for your input.
    yes. my lan2 is used for Cluster_interconnect which is having subnet 255.255.255.240.
    Below are IPs used for RAC
    Public
    Node1: 10.10.1.173/255.255.240.0
    Node2: 10.10.1.174/255.255.240.0
    Private
    Node1: 10.10.16.50/255.255.255.240
    Node2: 10.10.16.51/255.255.255.240
    Virtual
    Node1: 10.10.1.191/255.255.240.0
    Node2: 10.10.1.192/255.255.240.0
    SCAN (Defined in DNS)
    10.10.1.193/255.255.240.0
    10.10.1.194/255.255.240.0
    10.10.1.195/255.255.240.0
    As you said, I will scrap GI Software again & will try with 255.255.255.0.
    I Believe this Redundant Interconnect and ora.cluster_interconnect.haip present in 11.2.0.2.0 Version.
    Oracle says:
    Redundant Interconnect without any 3rd-party IP failover technology (bond, IPMP or similar) is supported natively by Grid Infrastructure starting from 11.2.0.2. Multiple private network adapters can be defined either during the installation phase or afterward using the oifcfg. Oracle Database, CSS, OCR, CRS, CTSS, and EVM components in 11.2.0.2 employ it automatically.
    Grid Infrastructure can activate a maximum of four private network adapters at a time even if more are defined. The ora.cluster_interconnect.haip resource will start one to four link local HAIP on private network adapters for interconnect communication for Oracle RAC, Oracle ASM, and Oracle ACFS etc.
    Grid automatically picks link local addresses from reserved 169.254.*.* subnet for HAIP, and it will not attempt to use any 169.254.*.* address if it's already in use for another purpose. With HAIP, by default, interconnect traffic will be load balanced across all active interconnect interfaces, and corresponding HAIP address will be failed over transparently to other adapters if one fails or becomes non-communicative. .
    The number of HAIP addresses is decided by how many private network adapters are active when Grid comes up on the first node in the cluster . If there's only one active private network, Grid will create one; if two, Grid will create two; and if more than two, Grid will create four HAIPs. The number of HAIPs won't change even if more private network adapters are activated later, a restart of clusterware on all nodes is required for new adapters to become effective.
    In my Setup, I am having Teaming for NIC's for Public & Private Interface. So I am thinking to break teaming of NICs because HAIP internally searching for next available NIC & not getting as all 4 are already in used with OS level NIC teaming.
    My only Concern is, as I am going to change subnet for the Private IPs, should I change Private IP address ????
    Thanks for the Support...
    Regards,
    Manish

  • Data Persistence for images

    Hey,
    I'm currently doing a little iPhone-App, that allows the user to load images from his library into
    UIImageViews. And I would like to save these images, so that after quitting and relaunching the app,
    the images are still there.
    How can I do this? Can I somehow retrieve the path for the image and save it via archiving?
    UIImages don't conform to NSCoding, but I could maybe save the path as a String. But how
    do I get the path? Or is there a better way?
    Can someone please help me with this?
    Thanks a lot!

    Hi Shinichi -
    Shinichi wrote:
    But how do I get the path?
    How did you find the image in order to load it into a UIImageView? If this is an image that was pulled up by UIImagePickerController I don't think you can access it directly even if you could obtain a path or key.
    UIImages don't conform to NSCoding
    Images are intended to be stored in a standard file format. For example use [UIImagePNGRepresentation|http://developer.apple.com/iPhone/library/documentati on/UIKit/Reference/UIKitFunctionReference/Reference/reference.html#//apple_ref/d oc/uid/TP40006894-CH3-SW10] to save a UIImage in a png file.
    So for example, if you've copied an image in [imagePickerController:didFinishPickingMediaWithInfo:|http://developer.apple.co m/iphone/library/documentation/UIKit/Reference/UIImagePickerControllerDelegateProtocol/UIImagePickerControllerDelegate/UIImagePickerControllerDelegate.html#// appleref/doc/uid/TP40007069-CH3-SW8], you can certainly save it in a png file, then store the path to that file in a plist (e.g. NSUserDefaults) or database. But I don't think there's any way to save the redundant disk usage by storing a reference to the original (see also: [http://developer.apple.com/iphone/library/qa/qa2009/qa1622.html] and [http://www.iphonedevsdk.com/forum/iphone-sdk-development/17319-how-get-iphone- photo-library-path.html]).
    \- Ray

  • Oracle RAC HAIP vs network interface bonding

    Hi,
    Oracle intruduced new feature called HAIP (11gR2 Grid Infrastructure Redundant Interconnect and ora.cluster_interconnect.haip [ID 1210883.1] ) in Oracle 11.2.0.2 or later. Oracle GI natively supports HAIP so that user does not need to configure Interconnect network interface bonding anymore.
    It seems to me that HAIP will provide better performance than network bonding. Using HAIP, you can have up to four interconnect at work at same time whereas bonding really present as one interconnect IP (ofcause you can have two bondings configured, but still is 1/2 of what HAIP can potentially up to).
    Any thought on this?

    I have implemented this at my site on a two node RAC.
    We did test the same by bringing the newly added interfaces down and the failover did happen as expected.
    I personally think that OS bonding will be better considering the number of bugs we run into as when the complexity and involvement of Oracle features increases.
    Not saying that Oracle is unreliable, but just a personal opinion.
    There is already a situation, you may face, wherein after the failover (and failback following the failover) the IPs returned are not correct due to ARP caching if the IPs fall under same network.
    This can be avoided by using proven OS bonding (not that I'm aware of any issues with OS bonding :) ).

  • RAC database software silent installation

    Hello,
    Could you please share an example of response file content for an Oracle RAC 11gR2 database software installation using ASM (Redhat Linux) ?
    thank you,
    S

    Hi,
    have you checked the Doc Id :Grid Infrastructure Redundant Interconnect and ora.cluster_interconnect.haip (Doc ID 1210883.1)

Maybe you are looking for

  • Change fan speeds on Lenovo G560?

    Hey there, I'm wondering, is it possible to manually change the fan speeds on this laptop? When I'm rendering a video in Sony Vegas it heats up my laptop and I'm just wondering is there a solution other than laptop cooling pads?

  • Opening a new browser window in APEX

    Hi. I am trying to open a new browser window in APEX (v2.1) for a new Navigation Bar Entry. What I did is the following: 1) Created the new Navigation Bar Entry 2) On the properties of this entry I put the Target Type: "URL" and on the Target: javasc

  • Case Statement in Where Condition

    Dear All, In my table Fields are EmpId TranYear TranMonth ApprovedBy ApprovedYear ApprovedMonth My Input parameters are 1. TranYear 2. TranMonth 3. Tag1 4. Tag2 My requirement is Tag1 Input are 0,1,2 Tag2 Inputs are 0,1,2 If Tag1 is 0 then checking T

  • Java RichText

    I need a text box that handles subscripts and superscripts along with symbols. Unfortunately all I have found is a JTextPane with rich text editor kit. It works with the buttons I have made but my question lies with how can I extract the text into a

  • Mission control error when starting

    I receive error below when I start mission control. Can someone assist? $ export JAVA_HOME=/usr/java/jrockit $ export PATH=$JAVA_HOME/bin:$PATH $ /usr/java/jrockit/bin/jrmc Jun 15, 2008 12:14:00 PM com.jrockit.console.model.ConsoleModel initializeSet