RAC services failback to preferred nodes

Dear Experts,
RDBMS Version - 11.1.0.7, 4 node RAC on AIX.
I have a need to relocate services to same node after a node failure. For this, I'm trying to build a script that detects node failure and runs srvctl to relocate services to same node (failback) to preferred node instead of available nodes.
For instance, service 'srv1' has nodes - n1, n2 as preferred and n3, n4 as available. As per Design, if n1 crashes, srv1 gets relocated to n3 which is available. Instead, I want to relocate the service to what was originally preferred node - n1. Oracle suggests using callouts to implement such a thing, not too familiar with it.
Appreciate your help.
Thanks..

One way might be using gv$session table inst_id column.
There you can find instance id when you start new session.
And with that id you know which instance that session was using.
That view shows you all RAC nodes sessions.
Other possibility is use srvctl services but with it you are restricted into those instances you give to service.
So you cannot have secondary instances only preferred ones. (and it does not understand automatic failback).
Here is more info about this:
http://docs.oracle.com/cd/B28359_01/rac.111/b28254/srvctladmin.htm#autoId14

Similar Messages

  • Maximum number of RAC services in a Node

    DB, Grid Version: 11.2.0.3/RHEL 5.4
    My question is on the preferred node for a RAC service.
    What is the maximum number of RAC services that can created in a node ?

    Hi,
    You can add maximum 145 service different default services.
    It is not documented information.
    Thanks
    Mahir M. Quluzade
    p.s. It is myself test result.

  • Oracle RAC Private Connection fail. what is the preferable node?

    Hello Everyone! I need all your helps about Oracle RAC.
    I would like to know that when the private network in oracle rac down, which is the preferable node in the cluster (cluster of 2 nodes) to takeover the cluster.
    Can I set/get the failover policy to point to one node in the cluster?
    Thank you in advance.

    Hi,
    Base on my testing environment, I use VMware to build the oracle rac.
    Because ifdown command reacts differently, now I use vmware feature on Network interface "disconnect" as pulling out the link from network interface.
    Please, kindly have a look on the actions, I have done. Correct me if I am wrong.
    I have two nodes which are node1 "rac1" and node2 "rac2".
    1. I start crs on node2 "rac2" so that node2 have the role to write to OCR
    2. After node2 start completely, I start crs on node1 "rac1" to join cluster.
    3. I use disconnect network link from private network on node1, and I also check using ethtool to check link detected:
    [root@rac1 ~]# ethtool eth1 | grep Link
    Link detected: no
    [root@rac1 ~]# ifconfig eth1
    eth1 Link encap:Ethernet HWaddr 00:0C:29:6A:73:20
    inet addr:192.168.2.231 Bcast:192.168.2.255 Mask:255.255.255.0
    UP BROADCAST MULTICAST MTU:1500 Metric:1
    RX packets:2658671 errors:0 dropped:0 overruns:0 frame:0
    TX packets:2069398 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:1615768514 (1.5 GiB) TX bytes:985464556 (939.8 MiB)
    4. After some seconds, I checked the log file
    [cssd(9517)]CRS-1612:Network communication with node rac2 (2) missing for 50% of timeout interval. Removal of this node from cluster in 14.620 seconds
    2013-02-12 04:12:30.419
    [cssd(9517)]CRS-1611:Network communication with node rac2 (2) missing for 75% of timeout interval. Removal of this node from cluster in 6.610 seconds
    2013-02-12 04:12:34.436
    [cssd(9517)]CRS-1610:Network communication with node rac2 (2) missing for 90% of timeout interval. Removal of this node from cluster in 2.590 seconds
    2013-02-12 04:12:37.036
    [cssd(9517)]CRS-1607:Node rac2 is being evicted in cluster incarnation 251972986; details at (:CSSNM00007:) in /u01/app/11.2.0/grid/log/rac1/cssd/ocssd.log.
    2013-02-12 04:12:39.136
    [cssd(9517)]CRS-1625:Node rac2, number 2, was manually shut down
    2013-02-12 04:12:39.140
    [cssd(9517)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 .
    2013-02-12 04:12:39.157
    [crsd(9957)]CRS-5504:Node down event reported for node 'rac2'.
    2013-02-12 04:12:45.519
    [crsd(9957)]CRS-2773:Server 'rac2' has been removed from pool 'Generic'.
    2013-02-12 04:12:45.519
    [crsd(9957)]CRS-2773:Server 'rac2' has been removed from pool 'ora.oradb'
    5. I check the status resource of cluster and I see that Node1 "rac1" is the survived node.
    Please help me to analyze it.
    Thanks,
    Edited by: 985243 on Feb 12, 2013 1:53 AM

  • Running OWB on 6 RAC databases on 4 shared nodes

    Hi everyone!
    I was wondering if anyone can help with a question I have around multiple OWB installations on RAC?
    Background:
    We are migrating 6 independent data warehouses / data marts onto one Exadata box. This machine has got 4 nodes, across which we will run 6 separate databases using RAC. Each database will span across all 4 nodes, and each of the databases will contain one of the independent data mart / data warehouses.
    We understand that we will probably need to run 6 separate control center services on each node, and that there may need to be some fiddling around with log file names to get them all to start properly.
    However; the question is where to install the OWB binaries!?
    In our understanding, we need one set of OWB binaries per database, i.e. 6 in total. The actual databases will be run from just one set of local Oracle Database binaries on each RAC node, which means only four database binaries in total will be used to run 6 RAC databases across our 4 nodes.
    Problem is, this means that there won't be enough OWB binaries to go around!! (6-4 = 2 missing!)
    One alternative is to have 6 Oracle homes on each RAC node, i.e. one home per RAC database. I'm not a RAC expert - maybe this is even the preferred way of setting up the databases, regardless if we use OWB or not?
    Comments / suggestions would be much appreciated!
    Cheers
    Edited by: 817871 on 03-Dec-2010 03:25

    Hi,
    We also have a 6 node rac where we settes up owb.
    We went through a whole lot of problems but got it running finally(with service failover).
    Basically you will need the binaries on all 4 of your physical nodes.
    For the first node you can run through the normal installation (repository setu).
    Thab you need to start the repository assistant on all other nodes in ordr to register them.
    There are a lot of pitfalls with that installation and a lack od docunentation.
    We've written an onstallation guide for an OWB rac setup where with we have now setted up 9 OWB repositories spreaded over 2 racs.
    Just let me know if you require detailed information - maybe we can share our guide.

  • RAC services (TAF)

    Hi All,
    I'm planning to implement the load balance thru RAC services.
    suppose I have 2node RAC database with 10 schemas , first 5 schemas need to connect to the node1 and the rest 5 schemas connect to the node2 .
    Is there any way to implement like this thru services(TAF)? ( client side tns entry with diff service name will be difficult )
    Please give some suggestion or steps for this case.
    Regards,
    Thomas.

    You should use Oracle Cluster Services (it has nothing to do with TAF) and you will have to configure two services with one node as preferred and another one as available (think about it as failover).
    On the client side you will provide two descriptors - they will have to be different only in SERVICE_NAME but both contain 2 IP's. You use case is an exact fit for this feature and you should overcome difficulties of two distinct connection strings.
    If connections are using different usernames anyway, you could as well specify different connection string - how more difficult is that?
    You can also create 10 services and name them the same way as your schemas and create appropriate connection descriptors. This way it's easier to manage - just use username for both. This also has advantage of dynamically manipulating of which users connect to which node.
    Anyway, I think you example my be too abstract. Why don't you tell us your real requirements?

  • Oracle 11g RAC on CentOS 5.2 - Node isnt working after hardware failure

    Hi,
    We have a 2-node Oracle RAC 11g running on identical nodes with Centos 5.2 as operating system.
    Due to a drive failure and a reboot yesterday, the ASM disk, which is onnected via iSCSI, changed from sdd to sdc in name - (the faulty raid drive was removed, thus the change).
    The oracle services didnt start, which appeard perfectly logical at the time, given that the ASM disk suddenly wasnt where it was supposed to be, but even today after a replacement disk was inserted, the RAID rebuilt + with the ASM disk back to its original naming in /dev/; the node doesnt seem to work properly. Some of the oracle services are running, but there seems to be a problem with the listener, which might also explain why the node does not set it's virtual ip after starting up.
    Luckily, the other one is unaffected and is working perfectly fine..
    I'm far from having a clue about oracle, it was sheer luck (that, and the very usable documentation by oracle) that i managed to get that cluster running in the first place... I know my way around linux, so if it's a operating system related problem i'll be able to fix it, but i cant figure out what the problem with oracle is.
    The listener doesnt seem to be running
    [oracle@serv-211 ~]$ lsnrctl status
    LSNRCTL for Linux: Version 11.1.0.6.0 - Production on 08-JUN-2010 11:12:00
    Copyright (c) 1991, 2007, Oracle. All rights reserved.
    Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
    TNS-12541: TNS:no listener
    TNS-12560: TNS:protocol adapter error
    TNS-00511: No listener
    Linux Error: 111: Connection refused
    Manual starting works, but not with the result i hoped for
    [root@serv-211 oracle]# lsnrctl status
    LSNRCTL for Linux: Version 11.1.0.6.0 - Production on 08-JUN-2010 11:32:16
    Copyright (c) 1991, 2007, Oracle. All rights reserved.
    Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
    STATUS of the LISTENER
    Alias LISTENER
    Version TNSLSNR for Linux: Version 11.1.0.6.0 - Production
    Start Date 08-JUN-2010 11:30:42
    Uptime 0 days 0 hr. 1 min. 34 sec
    Trace Level support
    Security ON: Local OS Authentication
    SNMP OFF
    Listener Log File /opt/oracle/11g/diag/tnslsnr/serv-211/listener/alert/log.xml
    Listener Trace File /opt/oracle/11g/diag/tnslsnr/serv-211/listener/trace/ora_22694_140227439994592.trc
    Listening Endpoints Summary...
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=serv-211)(PORT=1521)))
    The listener supports no services
    The command completed successfully
    [root@serv-211 oracle]#
    While other services appear to be fine
    [oracle@serv-211 ~]$ crsctl check crs
    Cluster Synchronization Services appears healthy
    Cluster Ready Services appears healthy
    Event Manager appears healthy
    I feel a little lost in the vast amount of logfiles, a point in the right direction might actually be enough. I cant image it can be that serious.
    Please assist
    Regards
    Edited by: user9134821 on 08.06.2010 02:39

    Hi,
    As usual, as soon as i post a problem in some board, i find the solution myself.
    Although this way isnt really "linuxy", deleting the listener with the netCA tool and adding a new one solved it.
    Regards.

  • How to monitor RAC services and nodeapps in Grid Control

    Hi,
    I have created a number of RAC service names such as GL on a 2-node RAC and would like to use Grid control 10.2.0.2 to monitor the availability of those services and nodeapps. I was not able to find anything in Grid Control that would allow me to configure that. What are being monitored now are the listeners, database instances and nodes. Would it be possible to monitor more than just the RAC listeners, instances and nodes?
    thanks.

    I don´t think that there is an out-of-the-box metric. However, CRS monitors your services and Grid Control monitors CRS errors. If you need more granular monitoring, I have 2 suggestions:
    1) user callouts:
    [http://download.oracle.com/docs/cd/B28359_01/rac.111/b28254/hafeats.htm#RACAD7133]
    2) extending oracle enterprise manager
    I have written a paper on how to extend oem at [http://www.ora-solutions.net/web/papers/]
    "Extending Oracle Enterprise Manager to collect HP-UX glance data"
    You can follow the instructions to build a new target type called "RAC_SERVICE" and add your serivces as targets, e.g. S_BATCH, S_ONLINE, S_HR.
    Best regards,
    Martin Decker
    www.ora-solutions.net
    Edited by: mdecker on Jan 2, 2009 10:57 AM
    Edited by: mdecker on Jan 2, 2009 10:59 AM

  • RAC service can't start after upgrading to 10.2.0.4

    Hi All,
    After upgrading to 10.2.0.4 from 10.2.01 (linux32 with 2 nodes), I am experiencing the following:
    1. The rac service (created after the database was created, not the default service) can not start after the database started with "prkp-1030" error.
    2.The service somehow is online and available from the "lsnrctl status" command. Further verified that the users could connect to the rac via that service.
    3. The "crs_stat -t" command and the "srvctl status service..." also show the service is not running.
    Have anyone seen this problem before? what is need to be done to make it consistent.
    Thanks,
    TN

    I found something that might cause this problem.
    When I shut down everything (service, db, asm, nodeapps), and start them back on one by one in the opposite order (nodeapps, asm, database). I found out that the service is somehow get restarted when I start the database (when I have yet started the service itself). the lsnrctl status shows that the service is up. but the crs_stat shows the service is down.
    My question is that why the service is tied up with the database startup (using srvctl start database -d database_name)?

  • RAC services vs listener

    Hi,
    1. What is the difference between oracle RAC services and listeners and do we need both?
    2. Regarding OCR and Voting disks..
    we need to have 2 OCR's and 3 voting disks, Just assume that in case of 6 node RAC, do we still need 2 OCR and 3 voting dissk formula?

    Hi;
    Please move your thread to related forum site :
    Forum Home >> Grid Computing
    Regard
    Helios

  • How to find out which RAC service a user is using.

    Hi,
    Our RAC database uses clustering services.
    How do I find out to which RAC service a database user is setup for?
    I know how to check what it is currently using by looking at GV$SESSION. But i want to check what service a user was originally setup?
    I cant seem to find the info i need on the following views:
    GV$ACTIVE_SERVICES
    DBA_SERVICES
    GV$SESSION
    am i missing out something?
    thanks,

    There is a service_name column in gv$session that should show what service is being used by a connection.
    Sorry...reread and see that you know about gv$session...I'm not really sure what you mean by originally setup or how long ago you are trying to look for but in v$active_session_history there is a column that is service_hash that will join to dba_services column name_hash..so if you can find some old session from that user and get the service_hash you can get the service name from dba_services.
    Edited by: DBA_Mike on Mar 24, 2009 6:48 AM

  • Services in a two node installation

    Hi,
    we have 2 node installation of R12.1.1
    Node A: Database & Batch Processing
    Node B: Application Services(Root service, web entry point services, web application services & other services)
    One thing i need to clarify
    Should i have to select root services in primary application node(node A)
    if selecting root services at primary application node then i have to select web entry point services and web applicatio services compulsory at node A
    Please explain
    Thanks,
    Jak
    Edited by: user12257829 on Nov 22, 2009 9:53 PM

    Hi,
    According to your configuration, root services should be enabled on (Node B). In addition to "Oracle Applications Installation" manual, please see (Note: 406558.1 - Configuring Applications Node Services in Oracle E-Business Suite Release 12) for details.
    Regards,
    Hussein

  • How to clone a 2-node ASM RAC db to a 3-node ASM RAC db by RMAN?

    We need to clone a 2-node ASM RAC db to a 3-node ASM RAC db by RMAN. I would think this will be about the same as a regular single db procedure by RMAN mostly. However, in 3 node RAC, there will be additional instance thread in redo (thread 1,2, and 3). Questions will be
    1. Should I use CRSCTL to add new instance (3rd)? -- I guess yes
    2. Should I create additional online redo group for thread 3? -- I guess yes
    3. Should I create addition undo tablespace? -- I guess yes
    Can any body provide a procedure of cloning the DB?
    Thanks!

    Not just easy as next, next, next
    version depenedencies and etc.
    [from Oracle DOC|http://download.oracle.com/docs/cd/B19306_01/rac.102/b14197/adddelunix.htm#BEICADHD]
    AND
    [Doc ID:      270512.1: Adding a Node to a 10g RAC Cluster|https://metalink.oracle.com/CSP/ui/flash.html#tab=KBHome%28page=KBHome&id=%28%29%29,%28page=KBNavigator&id=%28bmDocID=270512.1&from=BOOKMARK&bmDocType=BULLETIN&bmDocDsrc=KB&bmDocTitle=%3Cb%3EAdding%3C/b%3E%20a%20%3Cb%3ENode%3C/b%3E%20to%20a%2010g%20%3Cb%3ERAC%3C/b%3E%20Cluster&viewingMode=1143%29%29]

  • Clone multi-node RAC and ASM to single node

    Hi everyone.
    I need clone system with 3 application server and 2 oracle database RAC and ASM to single-node. The operating system is RHEL 5.
    I see some metalink notes, but we can't found nothing. I find notes with multi-node to single-node, but nothing with RAC to non-RAC.
    The eBS version is 11.5.10.2 and database version is 10.2.0.3
    Is possible this clone?
    Thanks very much.

    Hi User;
    Please follow below and see its helpful:
    EBS R12 with RAC and non-RAC
    Re: RAC to single instance ebs R12
    Re: Clone Oracle Apps 11.5.10.2 RacDB to Non-RAC DB
    Re: CLONING R12 RAC to NON RAC CLONING giving error RMAN-05517 temporary file
    [b]Migrating the DB-Tier (DB and CM) to Two node non RAC cluster[/b]
    Also check:
    http://www.oracle.com/technology/pub/articles/chan_sing2rac_install.html
    Regard
    Helios

  • Oracle RAC with more then two nodes?

    Hello,
    knows anybody a reference client project that use Oracle RAC with more then two nodes on a Linux environment?
    Many thnaks!
    Norman Bock

    Hello Norman,
    XioTech is a SAN company that has a project called "THE TENS". They configured and ran a 10 node RH Linux Oralce 9i RAC. I understand they want to see if 32 are possible. I am sure if you ask them, they would be happy to give you the details.
    http://www.xiotech.com/
    Cheers

  • Http service unavailable on this node

    Hi All,
    Just a question for anyone who has seen this at all.
    (Might be staring me in the eyes!)
    I http to Fabric Interconnect (A) and java works fine. Type in the uname and password and log in to UCSM
    I http to FI(B) and java work also fine prompting me for a uname and password. Once done I get an error message saying
    "Http service unabailable on this node"
    So then I log into the cluster address, log in to UCSM and check out the admin settings for http. They are bot enabled.
    I then putty into each FI and do a status of http and https for both FI's. THey show as enabled.
    If http is enabled on both FI's why is it that I can log into UCSM on one and not the other?
    gd

    UCSM will only allow you to log into the Virtual IP when setup in a cluster configuraiton.  Though you can SSH to either FI directly, you should only ever access UCSM from the Cluster IP.
    Robert

Maybe you are looking for