10g R2 RAC on Solaris 10 with EMC Storage

We are in the process of setting up 3/4 node RAC with the following components:
Oracle 10g R2 RAC
Oracle Clusterware / Sun Cluster / Veritas Cluster
Sun Solaris 10
EMC storage
ASM/Cluster FS
I would appreciate if some one can through some light on:
* ) Veritas cluster / Sun Cluster is must component or Can I use Oracle clusterware ? what are the advantages and disadvantages of using Oracl clusterware compare with varitas cluster or sun cluster
* ) Is cluster filesystem a compulsory component or Can I use ASM instead of Cluster File system.
* ) If I don't use cluster filesystem where to put CRS repository and voting disk ?
* ) What is best option for Oracle_Home, is it shared oracle home or sepereate oracle_home on each node ?
* ) Are there any known risks invovled in using ASM. How is the I/O performance with ASM on EMC with Solaris ? Are there any best practices
* ) Is GigE okay for interconnect or do I need to go for Infiniband ?
* ) Is there any notes on Best practices for the above components
*) Do I need to consider fail over option for NIC's (interconnect and public), if yes, how to do that ?
*) Are there any other risks do I need to consider ?
Thanks
G

Hi,
I see lot of good input. I have done few RAC installs on sun/solaris/emc ...
Here are few things to consider.
* ) Veritas cluster / Sun Cluster is must component or Can I use Oracle clusterware ? what are the advantages and disadvantages of using Oracl clusterware compare with varitas cluster or sun cluster
Just stay with Oracle Clusterware. If there are any issues then you only have to deal with one vendor and there will be no finger pointing. In any case Oracle Clusterware is needed even if you install Veritas/Sun.
* ) Is cluster filesystem a compulsory component or Can I use ASM instead of Cluster File system.
For the database you can use ASM. The only time I have considered a cluster filesystem is if external tables were in use.
When you use ASM you need to partition the disk with 1 meg offset or start at cyclinder 1.
* ) If I don't use cluster filesystem where to put CRS repository and voting disk ?
OCR and Voting Disk go on raw devices.
* ) What is best option for Oracle_Home, is it shared oracle home or sepereate oracle_home on each node ?
Install ORACLE_HOME, ASM_HOME and CRS_HOME locally on each server.
* ) Are there any known risks invovled in using ASM. How is the I/O performance with ASM on EMC with Solaris ? Are there any best practices
http://www.oracle.com/technology/products/database/asm/pdf/asm-on-emc-5_3.pdf
We have always installed 2 HBAs and used powerpath.
* ) Is GigE okay for interconnect or do I need to go for Infiniband ?
For a majority of cases gigE is sufficient.
* ) Is there any notes on Best practices for the above components
Have redundancy at each level.
*) Do I need to consider fail over option for NIC's (interconnect and public), if yes, how to do that ?
You can use IPMP. Use large send/receive buffers. Enable Jumbo Frames.
We had to apply some patches.
5128575 - RAC install of 10.2.0.2 does not update libknlopt.a on all nodes
4769197 - WHILE ONE NODE OF RAC IS DOWN, CONNECTIONS FROM CLIENT HANG
patch 5749953
Thanks
G

Similar Messages

  • 10g R2 RAC on Solaris 10 error when running root.sh

    hi, I am installing Oracle 10g rac on Solaris 10 with two nodes. In the end of the installation of RAC when a run root.sh I get the error bellow.
    # /opt/crs/oracle/product/10.2.0/crs/root.sh
    Checking to see if Oracle CRS stack is already configured
    Setting the permissions on OCR backup directory
    Setting up NS directories
    Failed to upgrade Oracle Cluster Registry configuration

    I have done this install using a pair of T2000's and a 65XX SAN. The install doco is not straight forward. I had to compile a number of Metalink notes to eventually get the disk partitions sorted. Of particular help was Note:271621.1.
    Since I am not a Solaris admin, the next bit is caveated as "This is how I did it" and maybe not how anyone else would have done it. These things were not explicitly noted, but gleaned through a bit of reading:
    1) you need to throw away the first cylinder of each LUN. I did this by creating the first partition as a single cylinder.
    2)then create s4 (or whichever slice you desire) as the rest of the space allocated to that LUN.
    3) Repeat this for each LUN presented
    4) I created a directory /san under which I then created the character mode (raw) interface for each of ocr, vote.
    5) For asm, and for no other reason than being self documenting, I created /san/asm and created character mode interfaces to each of the LUN's for datadg and fradg
    6) repeat steps 1-5 on the other box
    I took quite some time (2 days) to extract all this and assemble it to a working system. But has always been stable.
    Regards,
    Kevin Crowley
    Principal Consultant
    Pacific DBMS P/L

  • Database upgrade - Oracle 10g r2 ,RAC(2 Nodes with ASM) upgrade from HP-UX to RHEL 5.9

    Hi All
    I am planning to upgrade our RAC database 2 nodes with ASM from HP-UX to RHEL 5.9.
    Following is our setup
    Current setup:
    Oracle Database 10g r2 (10.2.0.5.0) RAC database.
    Nodes: 2
    Storage: ASM
    OS: HP-UX ia64
    Database Size: 1.2 TB
    New Setup:
    Oracle Database 10g r2(10.2.0.5.0) RAC database
    Nodes: 2
    Storage: ASM
    OS: RHEL 5.9 x86 64
    Since we are moving from a big endian format to a small endian format(HP-UX to RHEL 5.9) the same ASM cannot be used.
    Kindly help me with process and other important documents to be followed.
    Thanks.

    Hi...
    If it was a standlone database concepts like transportable tablespaces, rman would have been convenient.
    Since we are using a RAC database with ASM as storage how do we use these techniques specified in NOTE:733205.1
    Due to endianness issue we cannot use the same ASM instance.
    Along with the new RAC node install a new ASM instance would have to be created.
    Kindly help me with migration for RAC with existing ASM to new Hardware
    Thanks and Regards

  • 10g Grid (RAC) on Linux with ASM and OCR?

    I was trying to install 10g on Linux with ASM. The docs are not terribly clear on this, but I'd like to have the Oracle Cluster Registry (OCR) on one of my four ASM disks, rather than dedicate space to OCFS. I have 4 18.2 GB drives setup with ASM now. Is there a way to do this?
    I guess the other thing I could do is to cut the ASM disks into two partitions. One, say 200MB and the other the rest. I'd put OCFS for OCR on the 200MB partition on one of the disks. The large partition on each of the rest of the disks would be dedicated to ASM.
    What am I missing? I feel it must be something obvious. I'd rather have the OCR on the ASM, so that I don't have to deal with it...
    Thanks!
    Jeff

    Hi.
    There shouldn't be a problem with this provided you use a 32-bit OS on the 64 bit machine. RAC doesn't care about the chipset, so long as the same OS is used, but I don't thinkit will support one node on 32 bit and one on 64 bit, since they are actually separate distributions.
    Of course, I've never tried it so I can't be sure :)
    Cheers
    Tim...

  • HOW TO CONFIGURE ORACLE RAC USING EMC STORAGE MULTIPATHING

    Dear Team,0
    Am in process of installation of ORACLE RAC 10.2.0.3 using cluvfy 10.2.0.3 with EMC storage (multipathing)
    need ur help..i had done with following things...
    1)i had done with prerequisite steps..
    2)user equivalence .
    3)cluvfy checks...
    4)in process to install ORACLE RAC but the storage assign to server is EMC Clarion but the disk assign is having same name but diffferent
    major number minor number...
    pls let me know..
    1)major number minor number with repect to voting ,ocr and asm disk..
    2)while configuring EMC storage how same mojor and minor number are assign(if possible compltee steps)
    Thanks
    Upendra
    9820011875

    Hi buddy,
    You should start reading the installation guide for Your plataform. it's well explained there.
    Regards,
    Cerreia

  • 2 node RAC on solaris

    Hello all,
    can you point me to some cookbook for instalation of
    11g 2node RAC on Solaris with ASM ?
    Also, can I use raw disks for ASM or i must first configure some filesystem , zfs for example, and then on top of that place asm ?

    dbca doesnt allow the use of raw devices on oracle 11gr2. its good to have asm. if you decide to use the shared file systems oracle supports nas,san das etc please read the documentation..
    there are lot of materials on the internet that can help you install rac on solaris.. if you are insstalling on a production system then its better to see the relevant docs in the metalink...

  • 10g rac on solaris

    Dear all,
    We are in the process of installtion of 10g RAC on solaris.
    As far as i studied,
    OCFS cannot be used in Solaris
    Only 3rd party cluster file system can be used
    if no 3 party cluster file system can be used,we have to use ASM
    Is there any other options for this ?
    Please guide
    Kai

    pls, i need an help urgently with installation of RAC on Solaris Using VMware.
    i recieved the following error: PRIF-12:failed to initialize cluster support services
    Pls, can u mail([email protected]) or make available the content in this location...someone in the forum
    refer someone having almost the same difficulties to this location :
    https://metalink2.oracle.com/metalink/plsql/ml2_documents.showDocument?p_database_id=NOT&p_id=395697.1
    thanks a zillon for your assistance.

  • 10g RAC on SOLARIS 10

    Hi,
    What is the best CLUSTER I can use for my 10g RAC on SOLARIS 10.
    Regards
    MMU

    I am going to install Oracle 10g RAC (standard Edition) on Solaris 10 (sparc 64bit).I am using Oracle Clustware only.I need step by step document for this installation.I have gone through Oracle documents and many others.I have failed many times in this installation so I need some good document.
    Plz tell me what directories I need to create and permission for this directories.
    I am creating these directories before starting CRS installation.
    mkdir -p /opt/oracle/product/10.2.0/crs
    chown -R root:oinstall /opt/oracle/product/10.2.0/crs
    chmod -R 775 /opt/oracle/product/10.2.0/crs
    mkdir -p /opt/oracle/product/10.2.0/db_1
    chown -R root:oinstall /opt/oracle/product/10.2.0/db_1
    chmod -R 775 /opt/oracle/product/10.2.0/db_1
    mkdir -p /opt/oracle/admin
    chown -R root:oinstall /opt/oracle/admin
    chmod -R 775 /opt/oracle/admin
    mkdir -p /var/tmp/.oracle
    mkdir -p /tmp/.oracle
    mkdir -p /var/opt/oracle
    chown -R oracle:oinstall /var/tmp/.oracle
    chown -R oracle:oinstall /tmp/.oracle
    chown -R oracle:oinstall /var/opt/oracle

  • Oracle Database 11gr2 rac on solaris 10 using ACFS and asm as storage

    Can i get any step by step document to install 11gr2 rac on solaris 10.
    My database is two node rac. I am using ASM as storage. So i need a document which should very easy to understand.
    thanks in advance

    Hi,
    Can i get any step by step document to install 11gr2 rac on solaris 10.
    My database is two node rac. I am using ASM as storage. So i need a document which should very easy to understand.Refer below link:
    http://www.oraclemasters.in/?p=961
    Configure storage as per your requirement.
    thanks,
    X A H E E R

  • 11i Rapid Clone Not Certified With 10g/11g RAC???

    Metalink document 230672.1, "Cloning Oracle Applications Release 11i with Rapid Clone" was updated Feb. 2009 with the following:
    February 04, 2009
    - Added 11i/10g/11g RAC clarification on Section 4 Steps 6 and 7.
    - Corrected incorrect format statements.
    The clarification?
    Attention: The following steps apply only for 9i RAC Clusters. Rapid Clone is not certified for Cloning 11i with 10g or 11g RAC Systems at this time.
    10g RAC support for EBS has existed for quite a while, what's up with this? I'm in the middle of upgrading my 11i EBS on 9i RAC environments to 10gR2 RAC.
    Anyone cloning 11i with 10g/11g RAC? How are you doing it?
    Disgusted,
    Jerry

    Take a look Doc ID: 230672.1 on Metalink Section 6 talks about Cloning a RAC system
    If you're trying to search for anything on EBS look for Applications 11i, because most docs refer to it as Applications 11i more often then EBS.
    Cloning Oracle Applications Release 11i
    with Rapid Clone

  • 10g Extended RAC with Symantec/Veritas

    Hi,
    Do you know any solution for an active-active 10g extended RAC using Symantec/Veritas Storage Foundation ?
    I've seen some active-pasive solutions using Veritas/Symantec GCO and VVR but we would want that the extended node can be online and do some workload.
    Thanks in advance
    Regards
    Jose

    You might take campus cluster into your consideration. (2 SFRAC clusters + VxVM Mirror)
    Or you can also consitder : 2 SFRAC clusters + GCO + Logical Oracle dataguard.
    Thanks.

  • Issues while installing ORACLE 10g R2 RAC on RHEL 5.3

    i am installing oracle 10g R2 RAC on RHEL 5.3 in a test environment. my aim was to install using ASM.
    i went through the pre-requisites ok before beginning with the installation.
    since RHEL 5.3 doesnt support raw devices i used
    http://www.idevelopment.info/data/Unix/Linux/LINUX_ConnectingToAniSCSITargetWithOpen-iSCSIInitiatorUsingLinux.shtml#Configure%20iSCSI%20Initiator%20and%20New%20Volume
    udev to configure shared storage. my storage is on openfiler as a iSCSI target.
    fdisk -l on both nodes shows the shared drives.
    [root@node1 ~]# fdisk -l
    Disk /dev/sda: 21.4 GB, 21474836480 bytes
    255 heads, 63 sectors/track, 2610 cylinders
    Units = cylinders of 16065 * 512 = 8225280 bytes
       Device Boot      Start         End      Blocks   Id  System
    /dev/sda1   *           1          13      104391   83  Linux
    /dev/sda2              14        2053    16386300   8e  Linux LVM
    /dev/sda3            2054        2372     2562367+  82  Linux swap / Solaris
    Disk /dev/sdd: 10.5 GB, 10502537216 bytes
    64 heads, 32 sectors/track, 10016 cylinders
    Units = cylinders of 2048 * 512 = 1048576 bytes
       Device Boot      Start         End      Blocks   Id  System
    /dev/sdd1               1       10016    10256368   83  Linux
    Disk /dev/sdb: 10.5 GB, 10536091648 bytes
    64 heads, 32 sectors/track, 10048 cylinders
    Units = cylinders of 2048 * 512 = 1048576 bytes
       Device Boot      Start         End      Blocks   Id  System
    /dev/sdb1               1       10048    10289136   83  Linux
    Disk /dev/sdc: 10.5 GB, 10536091648 bytes
    64 heads, 32 sectors/track, 10048 cylinders
    Units = cylinders of 2048 * 512 = 1048576 bytes
       Device Boot      Start         End      Blocks   Id  System
    /dev/sdc1               1       10048    10289136   83  Linux
    Disk /dev/sdf: 10.5 GB, 10569646080 bytes
    64 heads, 32 sectors/track, 10080 cylinders
    Units = cylinders of 2048 * 512 = 1048576 bytes
       Device Boot      Start         End      Blocks   Id  System
    /dev/sdf1               1       10080    10321904   83  Linux
    Disk /dev/sde: 10.5 GB, 10502537216 bytes
    64 heads, 32 sectors/track, 10016 cylinders
    Units = cylinders of 2048 * 512 = 1048576 bytes
       Device Boot      Start         End      Blocks   Id  System
    /dev/sde1               1       10016    10256368   83  Linux
    [root@node1 ~]# ls -l /dev/iscsi/arpl*
    /dev/iscsi/arpl1:
    total 0
    lrwxrwxrwx 1 oracle oinstall  9 Jun 30 12:58 part -> ../../sde
    lrwxrwxrwx 1 oracle oinstall 10 Jun 30 12:58 part1 -> ../../sde1
    /dev/iscsi/arpl2:
    total 0
    lrwxrwxrwx 1 oracle oinstall  9 Jun 30 12:58 part -> ../../sdd
    lrwxrwxrwx 1 oracle oinstall 10 Jun 30 12:58 part1 -> ../../sdd1
    /dev/iscsi/arpl3:
    total 0
    lrwxrwxrwx 1 oracle oinstall  9 Jun 30 12:58 part -> ../../sdb
    lrwxrwxrwx 1 oracle oinstall 10 Jun 30 12:58 part1 -> ../../sdb1
    /dev/iscsi/arpl4:
    total 0
    lrwxrwxrwx 1 oracle oinstall  9 Jun 30 12:58 part -> ../../sdc
    lrwxrwxrwx 1 oracle oinstall 10 Jun 30 12:58 part1 -> ../../sdc1
    /dev/iscsi/arpl5:
    total 0
    lrwxrwxrwx 1 oracle oinstall  9 Jun 30 12:58 part -> ../../sdf
    lrwxrwxrwx 1 oracle oinstall 10 Jun 30 12:58 part1 -> ../../sdf1
    [root@node1 ~]# configuring udev results in the drives being mapped to persistent drive names eg. /dev/iscsi/arpl1/part1
    still when i enter the name of the raw device which i have created i get the following error. please help
    Image: !http://img91.imageshack.us/img91/7448/oracle.png!

    did you check this
    http://download-west.oracle.com/docs/cd/B19306_01/install.102/b14203/storage.htm#BABBHECD
    http://download.oracle.com/docs/cd/B28359_01/install.111/b28263/storage.htm#CDEBFDEH
    also before you do what is suggested on the url posted by Mufalani,
    it seems that you should do the following:
    Check existence of udev raw mapping rule file /etc/udev/rules.d/60-raw.rules
    On RH/EL5, udev raw mapping rule file /etc/udev/rules.d/60-raw.rules should exist by default as part of the util-linux package, for example:
    # ls /etc/udev/rules.d/60-raw.rules
    /etc/udev/rules.d/60-raw.rulesCreate a custom udev raw mapping rule file, /etc/udev/rules.d/61-oracleraw.rules say, for example:
    # touch /etc/udev/rules.d/61-oracleraw.rules3b. Add udev raw binding rules to /etc/udev/rules.d/61-oracleraw.rules file
    Add the udev raw binding rules to the /etc/udev/rules.d/61-oracleraw.rules file, for example:
    # cat /etc/udev/rules.d/61-oracleraw.rules
    # Raw bind to Oracle Clusterware devices
    ACTION=="add", KERNEL=="sd*", PROGRAM=="/sbin/scsi_id", RESULT=="360a98000686f6959684a453333524174", RUN+="/bin/raw /dev/raw/raw1 %N"
    ACTION=="add", KERNEL=="sd*", PROGRAM=="/sbin/scsi_id", RESULT=="360a98000686f6959684a453333524179", RUN+="/bin/raw /dev/raw/raw2 %N"If migrating to RHEL5/OEL5 from an earlier Linux version that relied on /etc/sysconfig/rawdevices file for persistent raw device bindings, the following script can be used as a basis for generating your RHEL5/OEL5 udev rules. Note, the script does not factor device name persistency.
    #!/bin/bash
    grep -v "^ *#" /etc/sysconfig/rawdevices | grep -v "^$" | while read dev major minor ; do
    if [ -z "$minor" ]; then
    echo "ACTION==\"add\", KERNEL==\"${major##/dev/}\", RUN+=\"/bin/raw $dev %N\""
    else
    echo "ACTION==\"add\", ENV{MAJOR}==\"$major\", ENV{MINOR}==\"$minor\", RUN+=\"/bin/raw $dev %M %m\""
    fi
    done

  • How to upgade Oracle from 9.2 on SUN to Oracle 10g R2 RAC on Oracle EL4

    Hi all,
    I have production database Oracle 9i EE Release 9.2.0.5.0 - 64bit on SunOS 5.9 cca 100GB. I would like to upgrade Oracle 10g Relase2 RAC with 2 nodes on Oracle Enterprise Linux. Database availability is 24x7 and system breakdown must be minimal. Upgrade could be done in several independent steps. What is the best form of upgrade realisation?
    Thx for some idea
    Libor Veverka
    [email protected]

    My 2 cents:
    1. de-RAC 9i on solaris
    2. upgrade to 10g on solaris (why? take advantage of datapump, much faster than exp/imp)
    3. expdp from 10g solaris
    4. create single instance 10g on linux
    5. impdp on linux
    Please note there are a number of issues with 9ir2.10gr2 upgrade (check metalink for details).
    HTH,
    [email protected]

  • Install Oracle 11g RAC on Solaris 10

    Hello,
    I'm new joined DBA in my organization.
    There is a requirement from a client to install Oracle 11g RAC on Solaris 10 env.
    Can anybody please guide me with some doc or pdf for the steps.
    Till now, i've install Oracle 11g DB on Solaris, but i'm pretty new to RAC env.
    Note:
    I've to do installation via commands, No GUI.
    Thanks for your help.
    Regards,
    Gags

    Hi,
    Q) Can Oracle 11g Release 2 RAC be installed on Solaris (x86)??yes, you can Install it on Solaris X86
    Q) Can the links of Oracle RAC installation over Unix and Linux be taken as base?? As i haven't seen any doc for installing 11g RAC on Solaris, where as it was provided in Oracle 10g.yes, you need to consider Oracle RAC installation over Unix and Linux be taken as base as base document.
    http://download.oracle.com/docs/cd/E11882_01/install.112/e17214/toc.htm
    In addition Refer:
    http://www.oraclemasters.in/?p=963
    thanks,
    X A H E E R

  • Cisco Twinax Cables Compatibiltiy with EMC VNX/VNXe

    Hi,
    I would like to know about Cisco Twinax Cables Compatibiltiy with EMC VNX/VNXe series storage - for connectivity between UCS Fabric Interconnect and EMC VNX/VNXe.
    Are the following Cisco Twinax Cables compatible with EMC's VNX and VNXe serie platforms:
    SFP-H10GB-CU1M= 1-m 10G SFP+ Twinax cable assembly, passive
    SFP-H10GB-CU3M= 3-m 10G SFP+ Twinax cable assembly, passive
    SFP-H10GB-CU5M= 5-m 10G SFP+ Twinax cable assembly, passive
    SFP-H10GB-ACU7M= 7-m 10G SFP+ Twinax cable assembly, active
    SFP-H10GB-ACU10M= 10-m 10G SFP+ Twinax cable assembly, active
    Kindly advice. Thanks.

    Hi,
    I'd like to confirm you, that passive assembly is supported. Haven't tried the actives one yet.
    I'm using UCS-B200 M3, and EMC VNX 5300.
    the EMC VNX5300 (Block Level) connected using 2 type of media. Copper (SFP-H10GB-CU5M= 5-m 10G SFP+ Twinax cable assembly, passive) and Fiber Channel 8 GB directly info Fabric Interconnect 6248 ports.
    For old server the connection is via iSCSI 10GB Copper. and for UCS-B200 M3 is via FC 8GB.
    All my configuration is running well.
    Hope thats helped.
    Thanks,
    Pieter

Maybe you are looking for

  • I can't transfer songs purchased on my iphone 3gs through itunes to my windows 7 pc. I've done it in the past, but now I can't. What should I do?

    I have a iPhone 3gs and I purchased 30 songs and an audio book on my iphone through itunes.  I manage my own songs on my PC's itunes.  I tried to drag and drop my legally purchased songs and audiobook onto the itunes library on my PC.  It will not al

  • Routing headphone mix direct to amp?

    Hi, Was RTFM (imagine that) trying to figure out how to best get a heaphone mix with the least possible latency and came across this quote from the docs: "Input monitoring always involves a little latency. In certain configurations, you may be best s

  • Sort on Characteristic with numbers

    Hi, I wish to sort on a characteristic in BEx when the field is a number, in numerical order, and when a character, in character order.  EG., for Size we could have shoe sizes and shirt sizes respectively; 1, 1.5, 2, 2.5...10, 10.5, etc. and S, M, L,

  • Delete Automatic e-mail adresses

    Hello, When you type in a mail adress and you use it again, mail automatically saves the password and completes the form for you the next time you want to use this e-mail adress. How can I delete those automatically saved passwords? Thanks in advance

  • Questions about RAC

    I was reading the article about installing the RAC. My conclussion , I can have till 127 instaces of a Oracle 10G database, working simultane. That is good really good and powerfull. My questions 1º). ¿Can I have , by example, 3 , or any other number