ASM disks in RAC need to be shared disks?

Hi all,
sorry for the very basic question but I'm getting a lot of confusion...
I have clusterware installed on node1 and node2 and I'm going to create ASM instances on both nodes.
Does the ASM disks need to be physically shared among the two nodes?
Many thanks for help
aldo

...I've brutally tried both ways and found the answer. Yes the disks need to be physically shared
aòdp

Similar Messages

  • Want to move datafiles, controlfiles, redolog on new ASM Disks (11gR2 RAC)

    Hi Guys,
    Setup: Two Node 11gR2 (11.2.0.1) RAC on RHEL 5.4
    Existing disks are from Old SAN & New Disks are from New SAN.
    Can I move all datafiles (+DATA), controlfiles (+CTRL), redolog (+REDO) on new ASM Disks by adding disks in is same Diskgroup & dropping older disks from existing Diskgroup taking advantage of ASM Re-balancing Feature.
    1) add required disks in the DATA Diskgroups,
    ALTER DISKGROUP DATA ADD DISK
    '/dev/oracleasm/disks/NEWDATA3' NAME NEWDATA_0003,
    '/dev/oracleasm/disks/NEWDATA4' NAME NEWDATA_0004,
    '/dev/oracleasm/disks/NEWDATA5' NAME NEWDATA_0005
    REBALANCE POWER 11;
    Check rebalance status from v$ASM_OPERATION.
    2) When rebalance completes, drop the old disks.
    ALTER DISKGROUP DATA DROP DISK
    NEWDATA_0000,
    NEWDATA_0001
    REBALANCE POWER 11;
    Check rebalance status from v$ASM_OPERATION.
    3) Do it same for Redo log groups & Controlfile Diskgroups.
    I hope, I could do this Activity, even if database is Up. is there possibility of Database block Corruption ??? (or is it necessary to perform above steps when database is down)
    Would be appreciated, your quick responses on the same.
    It's an urgent requirement. Thanks.
    Regards,
    Manish

    Manish Nashikkar wrote:
    Hi Guys,
    Setup: Two Node 11gR2 (11.2.0.1) RAC on RHEL 5.4
    Existing disks are from Old SAN & New Disks are from New SAN.
    Can I move all datafiles (+DATA), controlfiles (+CTRL), redolog (+REDO) on new ASM Disks by adding disks in is same Diskgroup & dropping older disks from existing Diskgroup taking advantage of ASM Re-balancing Feature.
    1) add required disks in the DATA Diskgroups,
    ALTER DISKGROUP DATA ADD DISK
    '/dev/oracleasm/disks/NEWDATA3' NAME NEWDATA_0003,
    '/dev/oracleasm/disks/NEWDATA4' NAME NEWDATA_0004,
    '/dev/oracleasm/disks/NEWDATA5' NAME NEWDATA_0005
    REBALANCE POWER 11;
    Check rebalance status from v$ASM_OPERATION.
    2) When rebalance completes, drop the old disks.
    ALTER DISKGROUP DATA DROP DISK
    NEWDATA_0000,
    NEWDATA_0001
    REBALANCE POWER 11;
    Check rebalance status from v$ASM_OPERATION.
    3) Do it same for Redo log groups & Controlfile Diskgroups.
    I hope, I could do this Activity, even if database is Up. is there possibility of Database block Corruption ??? (or is it necessary to perform above steps when database is down)
    Would be appreciated, your quick responses on the same.
    It's an urgent requirement. Thanks.
    Regards,
    Manish
    Hi Manish,
    Yes you can do that by adding new disk to existing diskgroup and delete old diskgroup. The good thing is this can be done online however you need to make sure the rebalance power is meet your business time, higher rebalance power is faster to rebalance to complete however it also will consume more resources
    Cheers

  • Reinstalling Oracle 11gR2 RAC Grid Problem - ASM Disks Group

    Folks,
    Hello.
    I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer.
    I have been installing Grid Infrastructure using runInstaller in the first VM rac1 from step 1 to step 9 of 10.
    On the step 9 of 10 in the Wizard, accidentally, I touch the Mouse, and the Wizard is gone.
    The directory for installing Grid in the 2 VMs is the same: /u01
    In order to make sure everything is correct, I delete entire directory /u01 in the 2 VMs and install Grid in rac1 again.
    I have understood it's not the right way to delete /u01. The right way is to follow the tutorial
    http://docs.oracle.com/cd/E11882_01/install.112/e22489/rem_orcl.htm#CBHEFHAC
    But I have deleted /u01 and need to fix one by one. I install Grid again and get the error message on step 5 of 9 as follows:
    [INS - 30516] Please specify unique disk groups.
    [INS-3050] Empty ASM disk group.
    Cause - Installer has detected the disk group name provided already exists on the system.
    Action - Specify different disk group.
    In Wizard, the previous Disk Group name is "DATA" and its Candidate disks (5 ASMDISKs) are gone. I try to use a different name "DATA2", but no ASMDISKs come up under "Candidate disks". For "ALL Disks", all ASMDISKs cannot be selected.
    I want to use the same ASM disk group "DATA" and don't want to create a new disk group.
    My question is:
    How to have the previous ASM disks and its group "DATA" come up under "Candidate Disks" so that can use it again ?
    Thanks.

    Hi, in case this helps anyone else. I got this INS-30516 error too was stumped for little while. I have 2 x 2-node RAC which are hitting same SAN. The first-built RAC has a DATA diskgroup. When went to build second RAC on new ASM disk new DIskgroup (but same diskgroup name DATA) got INS-30516 about diskgroup name already in use etc. Finally figured out all that was required was to restrict diskstring using button in installer to only retrieve the LUNS for this RAC (this was quick and dirty - all LUNS for both RAC being presented to both RAC). Once diskstring only searched for the LUNS required for this RAC only, e.g.
    ORCL:DATA_P* (for DATA_PD and FRA_PD)
    the error went away.
    I also have DATA_DR and FRA_DR presenting to both RAC. Apparently it scans the header and if it finds a diskgroup name that is already in use based on the diskstring scan it will not allow reuse of the diskgroup name since it has no way of knowing that the other ASM disks are for a different RAC.
    HTH

  • Can 1 ASM Disk group serve multiple RAC DBs?

    DB version: 11gR2
    Platform : Sun OS 5.10
    Number of Nodes : 2
    We currently have a 2 node RAC DB called PMDB1 running with a Disk group called DG1_DATA of 1 Tera Byte.
    We would like to add another Database in this cluster.
    Can this DB use the same Disk Group (DG1_DATA) which PMDB1 use?

    Hi Haiti
    Can this DB use the same Disk Group (DG1_DATA) which PMDB1 use?Yes. No problem.
    One ASM instance in RAC can be associated with several DBs' instances. Right?Right
    Regards,
    Levi Pereira

  • Add ASM disk in RAC

    Hello everyone,
    We are on 10gR2 ASM.
    The system admin has provided one disk as follows:
    On node-1 (tphsmsd1)
    /dev/rdisk/disk83 CANDIDATE
    On node-2 (tphsmsd2)
    /dev/rdisk/disk77 CANDIDATE
    I've read that paths of ASM disks in RAC may be different.
    When I give "ls -l /dev/rdisk/disk83" gives no such files and vice-versa for disk on node2.
    I don't understand how ASM handles this ? If I add disk (disk83) on node 1 how it's going to get to that disk on node 2 ?
    thanks
    Jitu Keshwani

    Jitu Keshwani wrote:
    I've read that paths of ASM disks in RAC may be different.
    When I give "ls -l /dev/rdisk/disk83" gives no such files and vice-versa for disk on node2.
    I don't understand how ASM handles this ? If I add disk (disk83) on node 1 how it's going to get to that disk on node 2 ?The header label of the disk, identifies the ASM disk name and diskgroup it belongs to. You can hexdump or octaldump the 1st 128 bytes of the device as ascii chars to view the label. The string "+ORCLDISK+" in the header identifies it as an ASM disk. This is then followed by the ASM diskname and then the AM diskgroup it belongs to.
    But there's no reason for not having a consistent and static device name layer across all cluster nodes. Each scsi device has a WWID (World Wide ID)- a unique identifier. This means that the kernel (and kernel drivers) can uniquely identify a device.
    On Linux, Multipath is used to map a logical device name to a WWID - and using the same +/etc/multipath.conf+ configuration file on all cluster nodes, ensures that the same device names are used across the cluster.
    But from the the device file entry you listed, you're likely not running Linux? In that case, depending on the Unix flavour used and the type of cluster storage, there can be similar options to Linux's Multipath. One such option is EMC's PowerPath - but that of course is specific to EMC SANs and requires additional licensing fees.

  • Installing Oracle 11gR2 RAC Problem: ASM disks

    Folks,
    Hello. I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer and according to the tutorial
    http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
    At the first time, I create VM rac1. While its OS Oracle Linux 5.6 is booting, initializing ASMLib Driver OK. I create 5 ASM disks successfully using the command:
    [root@rac1 /]# /etc/init.d/oracleasm createdisk ASMDISK1 /dev/sdb1
    Output: Marking disk "ASMDISK1" as an ASM disk: OK
    Because the hard disk space of rac1 is not enough to install Database, I create VM rac1 again with bigger hard disk space (30GB). I do everything the same with that at the first time. But this time, While OS Oracle Linux 5.6 is booting, initializing ASMLib Driver failed. I create 5 ASM disks using the same command:
    [root@rac1 /]# /etc/init.d/oracleasm createdisk ASMDISK1 /dev/sdb1
    Output: Marking disk "ASMDISK1" as an ASM disk: failed
    But when I use the command:
    [root@rac1 /]# /etc/init.d/oracleasm listdisks
    Output: ASMDISK1 ASMDISK2 ASMDISK3 ASMDISK4 ASMDISK5
    My questions are:
    First, can the 5 disks "ASMDISK1 ASMDISK2 ASMDISK3 ASMDISK4 ASMDISK5" be used correctly in spite of Marking disk "ASMDISK1(2 3 4 5)" as an ASM disk failed ?
    Second, how to fix OS Oracle Linux 5.6 so that initializing ASMLib Driver OK while booting ?
    Thanks.

    Folks,
    Hello. The issue is solved by myself. Thanks.

  • How to open RAC node2 usng spfile which will stay in ASM disk?

    Hi,
    I have installed oracle 11g r2 rac with asm in two nodes. OS is hp-Unix.
    I have installed oracle11g Active Data Guard using Single alone Database.
    Both RAc and Active Data Guard works fine.
    I have not configure Data Guard Broker.
    N.B Rac node1 is running using spfile which is in ASM disk (+DATA/spfiledcpdb.ora) but node2 is running using pfile.
    Question: how to open node 2 using spfile which will stay in ASM disk like node 1?
    Thanks
    Solaiman
    Edited by: 876149 on Apr 1, 2013 10:08 AM

    Modify your PFILE to specify only IFILE='location_of_spfile'
    OR
    use STARTUP PFILE='location_of_spfile'
    Ensure that the spfile does have the 2nd instance specific parameters defined correctly.
    Hemant K Chitale

  • Backup and Restore OCR,Voting Disk and ASM Disks in new SAN-10g RAC

    Dear Friends,
    I am using 10g R2 RAC serup on Linux
    My OCR,Voting Disk and ASM Disk for DBF Files are on a SAN box
    Now i am reorganising SAN by scrapping the entire SAN and cretaing new LUN's (It's a must)
    so pleae let me know
    1) how do i take backup of OCR and Voting Disk from existing SAN and how do i restore it in new LUN's after SAN reorganisation
    2) how do i take backup of existing Database's from existing SAN and how do i restore it in new LUN's after SAN reorganisation.
    I will be doing it in Planned downtime only
    Regards,
    DB

    For step 1 you should following metalink doc.
    For step 2 here is simple backup command script.
    I have done this in windows for you.
    D:\app\ranjit\product\11.2.0\dbhome_1\BIN>rman target /
    Recovery Manager: Release 11.2.0.1.0 - Production on Wed Feb 8 21:48:47 2012
    Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
    connected to target database: ORCL (DBID=1299593730)
    RMAN> run
    +{+
    allocate channel c1 device type disk format 'D:\app\ranjit\rman\%U';
    allocate channel c2 device type disk format 'D:\app\ranjit\rman\%U';
    backup database;
    backup current controlfile format 'D:\app\ranjit\rman\%U';
    +}+
    Regards

  • Wheather ASM Disk need to be configured before Oracle 11gR2 Grid software

    Hi All,
    I have a confusion regarding ASM Disk configuration. Whether this need to be done before the grid software installation or shall we do it after grid software installation.
    Kindly Advice over the same

    vk82 wrote:
    Hi All,
    I have a confusion regarding ASM Disk configuration. Whether this need to be done before the grid software installation or shall we do it after grid software installation.
    Kindly Advice over the same
    ASM is going to be a storage option. The storage that would be used by the ASM instance must be available already. The installation of the GI would be on the file system of the node.
    HTH
    Aman....

  • ASM Disk preparation for Datafiles and FRA in Oracle 10g RAC Inst

    Dear Friends,
    Please clarify wheteher the below method is correct to confiure ASM disks for Datafiles and FRA
    Partitions provided by IT team for OCR and Voting Disk
    /dev/sda1 - 150 GB (For +DATA)
    /dev/sda2 - 100 GB (For +FRA)
    OS     : RHEL 5.6 (64 Bit)
    kernel version = 2.6.18-238.el5
    Steps:(Node1)
    1) Install the RPM's for ASM
    rpm -Uvh oracleasm-support-2.1.7-1.el5.x86_64.rpm
    rpm -Uvh oracleasm-2.6.18-238.el5-2.0.5-1.el5.x86_64.rpm
    rpm -Uvh oracleasmlib-2.0.4-1.el5.x86_64.rpm
    2) Configure ASM
    /etc/init.d/oracleasm configure
    Default user to own the driver interface []: oracle
    Default group to own the driver interface []: dba
    Start Oracle ASM library driver on boot (y/n) [n]: y
    Scan for Oracle ASM disks on boot (y/n) [y]:
    Writing Oracle ASM library driver configuration: done
    Initializing the Oracle ASMLib driver: [  OK  ]
    Scanning the system for Oracle ASMLib disks: [  OK  ]
    3) Cretae ASM Disk
    /etc/init.d/oracleasm createdisk DISK1 /dev/sda1
    /etc/init.d/oracleasm createdisk DISK2 /dev/sda2
    4)/etc/init.d/oracleasm status
    5)/etc/init.d/oracleasm scandisks
    6)/etc/init.d/oracleasm listdisks
    7) Nothing to perform on Node2
    8) In dbca choose ASM and map the DISK1 for datafiles and DISK2 for FRA
    Please confirm the above steps are right?if not please clarify
    If DBCA ->ASM doesn't discover my disk then what should be the Discovery path i have to give?
    Please refer any document / Metalink ID for the above complete process
    Can i have ASM and oracle DB binary in the same home
    Regards,
    DB

    user564706 wrote:
    If DBCA ->ASM doesn't discover my disk then what should be the Discovery path i have to give?for asm disk created with oracleasm discovery path variable is ORCL:*
    Please refer any document / Metalink ID for the above complete processhttp://docs.oracle.com/cd/B19306_01/install.102/b14203/storage.htm#BABIFHAB
    Can i have ASM and oracle DB binary in the same homeyes. unless you want job role seperation or plan to run multiple versions of oracle homes
    >
    Regards,
    DB

  • How to configure ASM of 11gR2 RAC on Solaris 10

    Hi all,
    I have the first time to install the RAC on Solaris 10. I have stuck on the ASM disk group step in the Grid Infrastructure.
    Our Configuration
    2 Sun Server in Solaris 10 with same configure (which we are not using shared drive)
    250GB Local Hard Disk
    1100 GB Raw Disk (which at SAN)
    3GB x 3 Raw Disk (which at SAN) for voting disk
    When I install Grid Infrastructure, I select first option: Install and Confgure Grid in Cluster (I can't remember the exact name) and also select the Typical Installation. The previous steps are successful before the ASM Disk Group. At ASM Disk Group, no disk are display for selection.
    So, how to fix the missing disk in this ASM Disk Group creation?
    Please help!
    Sunny Yip

    952832 wrote:
    Hi all,
    I have the first time to install the RAC on Solaris 10. I have stuck on the ASM disk group step in the Grid Infrastructure.
    Our Configuration
    2 Sun Server in Solaris 10 with same configure (which we are not using shared drive)
    250GB Local Hard Disk
    1100 GB Raw Disk (which at SAN)
    3GB x 3 Raw Disk (which at SAN) for voting disk separate voting disks in 11gR2 are not necessary.
    I would break the 1100G into 11@100G devices and use EXTERNAL redundancy (RAID on the SAN side). You will get much better performance. (Configured/managed a 250TB 3node cluster on Sun 6900s however my LUNs were 1.5TB in size)
    >
    When I install Grid Infrastructure, I select first option: Install and Confgure Grid in Cluster (I can't remember the exact name) and also select the Typical Installation. The previous steps are successful before the ASM Disk Group. At ASM Disk Group, no disk are display for selection.
    So, how to fix the missing disk in this ASM Disk Group creation?
    Please help!
    Sunny YipAgain using a single 1.1TB device will not get you better performance and should you need to add additional devices, they too will need to be 1.1TB. Sometimes smaller is better.
    Make sure you use a partition that starts at cylinder 1 or 2
    Make sure you set the correct permissions (660) and ownership (gridowner:oinstall) on those devices and make sure the oracle user is a member of that group.

  • Share an ASM disk group among multiple nodes

    According to Oracle documentation:
    *“To share an ASM disk group among multiple nodes, you must install Oracle Cluster ware on all of the nodes, regardless of whether you install Oracle RAC on the nodes”.*
    And if I understand it right to share the same ASM storage group from multiple nodes from separate RACs or multiple non-RAC nodes ASM instances in those nodes need to communicate to synchronize ASM related metadata using same technique like cache fusions.
    My question is how this ASM communication take place among different ASM instances located in different RACs and standalone servers. Do we have to have some kind of Interconnect settings among the nodes?

    Hi,
    ASM and database instances require shared access to the disks in a disk group. ASM instances manage the metadata of the disk group and provide file layout information to the database instances.
    ASM instances can be clustered using Oracle Clusterware; there is one ASM instance for each cluster node. If there are several database instances for different databases on the same node, then the database instances share the same single ASM instance on that node.
    If the ASM instance on a node fails, then all of the database instances on that node also fail. Unlike a file system failure, an ASM instance failure does not require restarting the operating system. In an Oracle RAC environment, the ASM and database instances on the surviving nodes automatically recover from an ASM instance failure on a node.
    see this link
    http://download.oracle.com/docs/cd/B28359_01/server.111/b31107/asmcon.htm :)

  • ASM Disk

      What types of disks are supported and needed for the oracle ASM
      we are using SAN for shared storage
      can we use a " disk partition " for asm do we require all the disks need to be partitioned with primary partition ty type
      can we use a single disk worth 800 GB partition and divide it into 3 primary and 1 extended partition and on extended create logical partitions and use it for oracle asm
    Can any body Please provide an accurate minimal disk group recommendation for installing an oracle rac 11. 2.0.2.0  standard edition- 64bit with  RHEL- 6 Host

    Oracle documentation says
        create an Oracle ASM disk group using one of the following storage resources:
    Disk PartitionA disk partition can be the entire disk drive or a section of a disk drive. However, the Oracle ASM disk cannot be in a partition that includes the partition table because the partition table would be overwritten.
    Logical Unit Number (LUN)A LUN is a disk presented to a computer system by a storage array. Oracle recommends that you use hardware RAID functionality to create LUNs. Storage hardware RAID 0+1 or RAID5, and other RAID configurations, can be provided to Oracle ASM as Oracle ASM disks.
    Logical VolumeA logical volume is supported in less complicated configurations where a logical volume is mapped to a LUN, or a logical volume uses disks or raw partitions. Logical volume configurations are not recommended by Oracle because they create a duplication of functionality. Oracle also does not recommended using logical volume managers for mirroring because Oracle ASM provides mirroring.
    Network File System (NFS)An Oracle ASM disk group can be created from NFS files, including Oracle Direct NFS (dNFS), as well as whole disks, partitions, and LUNs. The NFS files that are provisioned to a disk group may be from multiple NFS servers to provide better load balancing and flexible capacity planning.Direct NFS can be used to store data files, but is not supported for Oracle Clusterware files. To install Oracle Real Application Clusters (Oracle RAC) on Windows using Direct NFS, you must also have access to a shared storage method other than NFS for Oracle Clusterware files.

  • ASM Disks not appearing

    I am installing Oracle RAC 10.2 on an EM64-T box, RedHat Linux 4, using a shared MSA1000 SAN for the shared storage.
    I have installed CSS (and it is running correctly), and have downloaded and installed the ASM libraries and Oracle.
    From the command line I can do an "oracleasm createdisk VOL1 /dev/sda2", then do a "listdisks" and see the device (VOL1) on BOTH nodes in my RAC cluster.
    Using DBCA, however, when I try to manage ASM it does not show the device (VOL1). I have confirmed that my Discovery path is ORCL:*.
    Any thoughts?

    hi,
    We face the same problem while setting up Oracle ASM on 10R2 RAC on RHEL4. you need to specify the disk path instead of string 'ORCL:'. specify string '/dev/oracleasm/disks/*' and then see, DBCA will show you all the ASM disks you have created.
    cheers
    Raj

  • ASM disks are not found at node2 on vmware

    Hi All,
    I'm very new to Oracle RAC. I was tring to install 10g rac in my desktop using vmware workstation. Also I configured the shared storage. Here i'hv rac1 and rac2 two virtual machines. while I created asm disks (ASM1,ASM2,ASM3) on rac1. While listing the asm disks at rac1 display the correct result but rac2 not returning anything.
    Can anybody suggest on this. B'coz I tried several times rac installation and but it failed bcoz of mismatch ocr id.
    Thanks

    Does rac2's operating system see the disks? Assuming Linux for the remainder of this post:
    Run "fdisk -l | more" on each node and compare the output. If you know the names of the devices (maybe something like: /dev/sdb /dev/sdc /dev/sdd), you can do an "ls -la /dev/sdb* " on each node and compare the file permissions and ownership. What is the ASM disk discovery string? Chances are rac2 has not picked up the new partitions created on rac1, which could be corrected by running "/sbin/partprobe /dev/sdb". If the device ownership is wrong, simply changing it as the root user won't persist across reboots: you will need to setup udev rules to re-apply permissions and ownership for each boot.
    Only when the operating system device files are present, and owned by the correct user ("grid" or "oracle", depending on your installation), then you will be able to scan for the devices in ASM. In the case of RAC, you'll also need to ensure the device files are named identically between nodes. ASMLIB can help, but something like device mapper (/etc/multipath.conf, can be configured even to manage a single path as is the case when using a vmware's vmdk virtual disk) is usually a more robust solution in my opinion.
    Some folks incorrectly assume that ASM will eliminate the system administration tasks entirely. The only thing it eliminates is managing devices after they've been successfully configured for use by ASM. LUN creation, zoning, masking, OS provisioning to include HBA bindings et al, and lastly OS permissions are all still very much required.
    If still having problems, paste the above mentioned utility outputs and we will try to help you spot the issue.

Maybe you are looking for