10g ASM on Logical Volumes vs. Raw devices and SAN Virtualization

We are looking at setting up our standards for Oracle 10g non-rac systems. We are looking at the value of Oracle ASM in our environment.
As per the official Oracle documentation, raw devices are preferred to using Logical Volumes when using ASM.
From here: http://download.oracle.com/docs/cd/B19306_01/server.102/b15658/appa_aix.htm#sthr
ef723
"Note: Do not add logical volumes to Automatic Storage Management disk groups. Automatic Storage Management works best when you add raw disk devices to disk groups. If you are using Automatic Storage Management, then do not use LVM for striping. Automatic Storage Management implements striping and mirroring."
Also, as per Metalink note 452924.1:
"10) Avoid using a Logical Volume Manager (LVM) because an LVM would be redundant."
The issue is: if we use raw disk devices presented to ASM, the disks don't show up as used in the unix/AIX system tools (i.e. smit, lspv, etc.). Hence, when looking for raw devices on the system to add to filesystems/volume groups/etc., it's highly possible that a UNIX admin will grab a raw device that is already in use by Oracle ASM.
Additionally, we are using a an IBM DS8300 SAN with IBM SAN Volume Controller (SVC) in front of it. Hence, we already have storage virtualization and I/O balancing at the SAN/hardware level.
I'm looking for a little clarification to the following questions, as my understanding of their responses seem to confict:
QUESTION #1: Can anyone clarify/provide additional detail as to why Logical volumes are not preferred when using Oracle ASM? Does the argument still hold in a SAN Virtualized environment?
QUESTION #2: Does virtualization at the software level (ASM) make sense in our environment? As we already have I/O balancing provided at the hardware level via our SVC, what do we gain by adding yet another level of I/O balancing at the ASM level? Or as in the
arguments the Oracle documentation makes against using Lvm, is this an unnecessary redundant striping (double-striped or in our case triple-striped/plaid)?
QUESTION #3: So does SAN Virtualization conflict or compliment the virtualization provided by ASM?

After more research/discussions/SR's, I've come to the following conclusion.
Basically, in an intelligent storage environment (i.e. SVC), you're not getting a 100% bang for the buck by using ASM. Which is the cat's meow in a commodity hardware/unintelligent storage environment.
Using ASM in a SVC environment potentially wastes CPU cycles having ASM balance i/o that is already balanced on the backend (sure if you shuffle a deck of cards that are already shuffled you're not doing any harm, but if they're already shuffled - then why are you shuffling them again??).
That being said, there may still be some value for using ASM from the standpoint of storage management for multiple instances on a server. For example, one could better minimize space wastage by being able to share a "pool" of storage between mulitiple instances, rather than having to manage space on an instance-by-instance (or filesystem by filesystem) level.
Also, in the case of having a unfriendly OS where one is unable to dynamically grow a filesystem (i.e. database outage required), there would be a definite benefit provided by ASM in being able to dynamically allocate disks to the "pool". Of course, with most higher-end end systems, dynamic filesystem growth is pretty much a given.
In the case of RAC, regardless of the backend, ASM with raw is a no-brainer.
In the case of a standalone instance, it's a judgement call. My vote in the case of intelligent storage where one could dynamically grow filesystems, would be to keep ASM out of the picture.
Your vote may be different....just make sure you're putting in a solution to a problem and not a solution that's looking for a problem(s).
And there's the whole culture of IT thing as well (i.e. do your storage guys know what you're doing and vice versa).....which can destroy any technological solution, regardless of how great it is.

Similar Messages

  • Raw Device and ASM configuration

    Can any body send me steps/commands to configrue Raw device and then ASM on top of it for RAC?

    Try this:
    http://download-east.oracle.com/docs/cd/B19306_01/server.102/b14231/storeman.htm#i1021337
    And this for installing 10g RAC on RH:
    http://www.puschitz.com/InstallingOracle10gRAC.shtml
    Daljit Singh

  • Question(s) related to ASM, Raw devices and performance

    Good morning,
    I was recently getting acquainted with ASM. Since I was doing this in "play" VM boxes, it was not possible to draw any conclusions about any performance improvements.
    I'd like to know what performance improvements forum members may have experienced after migrating a production environment from a non-ASM setup to an ASM setup.
    It would seem that since ASM is a "form" of raw device access that the increase in performance should be noticeable. Was that the case for those who migrated to it ? Was the performance improvement worth it or did it only make managing the database easier ?
    Thank you for your contributions on the subject,
    John.

    ASM uses disk groups to store datafiles; an ASM disk group is a collection of disks that ASM manages as a unit. Within a disk group, ASM exposes a file system interface for Oracle database files. The content of files that are stored in a disk group are evenly distributed, or striped, to eliminate hot spots and to provide uniform performance across the disks. The performance is comparable to the performance of raw devices.
    You can add or remove disks from a disk group while a database continues to access files from the disk group. When you add or remove disks from a disk group, ASM automatically redistributes the file contents and eliminates the need for downtime when redistributing the content.
    I hope the links below will helps you.
    refer the links:
    http://download.oracle.com/docs/cd/B28359_01/server.111/b31107/asmcon.htm
    http://oracleinstance.blogspot.com/2009/12/rac-file-system-options-basic-concept.html
    http://www.dbasupport.com/oracle/ora10g/ASM01.shtml
    also you will get more information from book:
    Oracle Automatic Storage Management: Under-the-Hood & Practical Deployment Guide (Osborne ORACLE Press Series)
    Nitin Vengurlekar (Author), Murali Vallath (Author), Rich Long (Author)
    http://www.amazon.com/Oracle-Automatic-Storage-Management-Under/dp/0071496076

  • Difference between raw device and a block device

    Platform : Unix, Unix-like
    What is the difference between a raw device and a Block device? I found the following URL by googling. But, posts seem to be mutually contradictory
    http://forums11.itrc.hp.com/service/forums/questionanswer.do?admit=109447626+1291798907338+28353475&threadId=583811

    a raw device is a special kind of block device file that allows accessing a storage device such as a hard drive directly, bypassing the operating system's caches and buffers (although the hardware caches might still be used). Applications like a Database management system(Oracle ) can use raw devices directly, enabling them to manage how data is cached, rather than deferring this task to the operating system.
    block devices correspond to devices through which the system moves data in the form of blocks. These device nodes often represent addressable devices such as hard disks, CD-ROM drives, or memory-regions.
    Also Check :
    http://forums11.itrc.hp.com/service/forums/questionanswer.do?admit=109447626+1291806443666+28353475&threadId=987277
    Regards
    Rajesh

  • Raw device and Oracle

    Hi,
    did anybody successfully test Stephen Tweedy3s raw device against
    Oracle? I testet also against Sybase but could not get it to run.
    Stephen checked straces and stuff but there seems to be no error!
    Look at ftp.uk.linux.org/pub/linux/sct/fs
    This patch is against Linux 2.2.9.
    Please people, test it and tell me if it works for you
    Cheers
    Marcus
    null

    Marcus Ruehmann (guest) wrote:
    : Hi,
    : did anybody successfully test Stephen Tweedy3s raw device
    against
    : Oracle? I testet also against Sybase but could not get it to
    run.
    : Stephen checked straces and stuff but there seems to be no
    error!
    : Look at ftp.uk.linux.org/pub/linux/sct/fs
    : This patch is against Linux 2.2.9.
    : Please people, test it and tell me if it works for you
    : Cheers
    : Marcus
    Hi Marcis,
    I tested raw device with Oracle but in AIX with Oracle 7.3 and
    it worked perfectly. While I'm waiting for Oracle8i on Linux and
    would test it with raw device, I don't think there would be too
    much different.
    Brdgs,
    Quoc Trung
    null

  • Raw devices and cluster file system

    what is difference between raw and cluster file system

    See to this thread if this can help
    http://asktom.oracle.com/pls/asktom/f?p=100:11:3285616048047775::::P11_QUESTION_ID:7931107631402

  • ASMlib raw device mapping

    We're using ASMlib here, and I'm trying to figure out which raw devices were mapped to which ASM disks. From the installation instructions, our disks must have been created using the "/etc/init.d/oracleasm createdisk VOL1 /dev/sdg1
    " command mentioned on Oracle's main site. However the commands to query disks don't seem to provide that link.
    For instance the following command:
    /etc/init.d/oracleasm querydisk /dev/sdg1
    Will tell you if that device is indeed and ASM disk, but it won't tell you which label it maps to. Similarly
    /etc/init.d/oracleasm querydisk VOL1
    will tell you that the disk with that label is an ASM disk, but won't tell you which raw device it maps to. The reason I'm asking about this is myself and the sysadmins are trying to map our ASM disks back to the raw devices and from there back to the luns. This obviously wasn't documented at the time the disks were created, long before I started working at my current company. We can go from databases to disk groups and from disk groups to ASM devices, but we can't get from ASM device labels to the raw device names which would allow us to go backwards to the luns.
    Thanks!

    me too...
    #/etc/init.d/oracleasm querydisk /dev/sdc5
    Disk "/dev/sdc5" is marked an ASM disk with the label "VOL1"
    I still find device name from major and minor:
    #/etc/init.d/oracleasm querydisk VOL1
    Disk "VOL1" is a valid ASM disk on device \[8, 37\]
    #ls -l /dev/* | grep 8, | grep 37
    brw-rw---- 1 root disk 8, 37 Jul 31 17:48 /dev/sdc5
    Script:
    #!/bin/sh
    if \[ $# -ne 1 \]
    then
    echo "Please Check arguments."
    echo
    echo "./getasmlib \[label\]"
    echo
    echo " ./getasmlib VOL01"
    exit 0
    fi
    LABEL=$1
    C=`/etc/init.d/oracleasm querydisk ${LABEL} |grep valid |wc -l`
    if \[ ${C} -eq 0 \]
    then
    echo "Don't Found ${LABEL} Disk in ASMLIB"
    exit 0
    fi
    M=`/etc/init.d/oracleasm querydisk ${LABEL} | awk -F [ '{print $2 }' | awk '{print $1}'`
    N=`/etc/init.d/oracleasm querydisk ${LABEL} | awk -F , '{print $2 }' | awk -F ] '{print $1}'`
    for x in ` ls -l /dev/* | grep ${M} | grep ${N} | awk '{print $10}' `
    do
    /etc/init.d/oracleasm querydisk $x |grep ${LABEL}
    done
    # ./getasmlib VOL1
    Disk "/dev/sdc5" is marked an ASM disk with the label "VOL1"
    Good Luck

  • How to check space on asm and raw device?

    Hi All,
    I want to know how to check the space on asm device.
    we are using asm device which is on raw partition.
    Our archive gets full.I need to check the space on asm archve partiotion.
    how can i check the archive destination space?
    we are using raw device partition for crs and voting device.
    how can we check the space on raw device and how can we know which device is in use and which are not in use
    Thanks in advance

    4 - 5 raw partitions...
    What oracle version?
    Install OCR + VOTE in raw device better than OCFS2. if you use 10g to 11gR1.
    If use 11gR2,keep OCR + VOTE in ASM Disk Group.
    you can check which raw device OCR:
    $ ocrcheck
    VOTEDISK:
    $ crsctl query css votedisk
    On 10g if use raw device for OCR + votedisk: recommend 1 file = 250M
    11g recommend 1 file = 512M
    Good Luck

  • ASM cannot find the raw devices nor ASM drives

    Hi,
    We are trying to use ASM on linux. The kernel version is
    2.6.9-42.0.10.0.1.ELsmp x86_64.
    We tried both raw devices and ASM drives. But after all the tries, the installer simply will not list the disks.
    Anybody can help? Thanks.

    "I had installed ASM initially on the same CRS, but due to some error during the installation"
    This statement means: I had installed ASM on the clusterware, but due to time synchronization error, it didn't got copied on to the 2nd node, and hence I had to uninstall the ASM software.
    But the clusterware is still up and running.
    Amit.

  • Oracle ASM installation and raw device options

    I am looking to install Oracle ASM on Linux Red Hat AS 4 (ia64) using Oracle 10.2.0.3.
    A general question I have regarding prerequisites for ASM using raw devices. It appears there are 2 options for dealing with RAW devices.
    1. Use the ASM library driver
    or
    2. simply bind the devices to raw devices (and then install a new $OH with an ASM instance)
    Is there a recommendation from Oracle, industry best practices, expert opinions on which way to go?
    If I understand correctly it sounds like option 2 will require an ASM $OH and instance. Is that right or do both option require this?
    Can someone provide guidance as to which option I should use, an Oracle whitepaper, a recommendation, instructions or something.
    Any help or insight is provided as to which option I should use.
    Thank you.
    echardrd

    OK. Perhaps I am a little condused then. From what I read Oracle ASM recommends the use of RAW devices for ASM storage devices. What I have is a new LUN presented to my database server from the SAN. I assumed that the LUN needs to be mounted in some fashion on the server, but my SA tells me in order to mount it, would require the use of a filesystem. If we put a filesystem(NTFS, ext, etc) on the LUN prior to mounting it, will ASM be able to use it? If ASM can use a device that has a filesystem on it will this add unneccessary overhead (I/O)?
    I guess my question is for ASM should I
    1. use a RAW partition or a filesystem? Does it matter?
    2. Will RAW have better I/O performance?
    3. How do i make the LUN presentation from the SAN a usable RAW device to my database server? Any steps or guidance would be helpful since my SA and I can not seem to bridge this gap.
    Thanks.

  • Using raw device

    Good morning,
    I would like to make some i/o test with a database version 10g, actually I have the redo log on standard zfs filesystem (cooked), I would like to
    migrate this redo log on raw device without recreating the database, is this possible ?
    Thanks for your help
    Fabrice Chapuis

    One more question, in case of node failure , redo on raw device are more critical for a recover than if they were on a filesystem ?More critical? Or more difficult?
    Redo is critical, period. Does not matter whether you use a cooked file system or a raw device.
    As for difficulty - that depends on what you are attempting to do. If you want to treat the raw device as a file system, that will be difficult as it it not a file system. (which kind of begs the question as to treat it like a file system when it is not?)
    From a RMAN perspective - a device is a device. RMAN does not care.
    From a DB perspective - that is why ASM exist. To remove the complexities of using raw devices, and eliminate the requirement of needing to use an external Volume Manager. And provide the DBA with a familiar SQL*Plus interface and SQL commands to administer ASM.
    It may seem difficult at first - but anything that needs a learning curve to go through, tends to seem difficult in the beginning. All you need to do is learn the basics and grasp the concepts.. and that +"difficulty"+ disappears.

  • Database Data files on RAW Devices

    Hi,
    I'm creating a database and wish to locate the tablespaces on a raw device.
    How do I specify the datafiles for the tablespaces on the raw device.

    > Any reason for moving to raw device?
    I actually prefer raw devices and ASM over using cooked file systems.
    By default RAW devices eliminate the "interference" of the kernel. It does not manage a file system on the device. There are no other foreign processes that can use that raw device (as is often the case with cooked devices). There is no o/s file system cache for that device. A physical I/O on the Oracle side means a dinkum physical I/O and not a maybe-logical-I/O-from-the-file-system-o/s-cache.
    There is no need for me as DBA to manage that file system according to OFA standards (ASM does it for me). There is no need for me to go through the learning curve of using a 3rd party volume manager. I have features like automated load balancing while the instance is up and running.
    Yes, there is an argument to be made for just how much of a performance improvement in I/O one can get from a raw device versus a cooked file system. But I/O performance is not the only consideration.

  • How do I map Hitachi SAN LUNs to Solaris 10 and Oracle 10g ASM?

    Hi all,
    I am working on an Oracle 10g RAC and ASM installation with Sun E6900 servers attached to a Hitachi SAN for shared storage with Sun Solaris 10 as the server OS. We are using Oracle 10g Release 2 (10.2.0.3) RAC clusterware
    for the clustering software and raw devices for shared storage and Veritas VxFs 4.1 filesystem.
    My question is this:
    How do I map the raw devices and LUNs on the Hitachi SAN to Solaris 10 OS and Oracle 10g RAC ASM?
    I am aware that with an Oracle 10g RAC and ASM instance, one needs to configure the ASM instance initialization parameter file to set the asm_diskstring setting to recognize the LUNs that are presented to the host.
    I know that Sun Solaris 10 uses /dev/rdsk/CwTxDySz naming convention at the OS level for disks. However, how would I map this to Oracle 10g ASM settings?
    I cannot find this critical piece of information ANYWHERE!!!!
    Thanks for your help!

    Yes that is correct however due to use of Solaris 10 MPxIO multipathing software that we are using with the Hitachi SAN it does present an extra layer of complexity and issues with ASM configuration. Which means that ASM may get confused when it attempts to find the new LUNs from the Hitachi SAN at the Solaris OS level. Oracle Metalink note 396015.1 states this issue.
    So my question is this: how to configure the ASM instance initialization parameter asm_diskstring to recognize the new Hitachi LUNs presented to the Solaris 10 host?
    Lets say that I have the following new LUNs:
    /dev/rdsk/c7t1d1s6
    /dev/rdsk/c7t1d2s6
    /dev/rdsk/c7t1d3s6
    /dev/rdsk/c7t1d4s6
    Would I set the ASM initialization parameter for asm_diskstring to /dev/rdsk/c7t1d*s6
    as correct setting so that the ASM instance recognizes my new Hitachi LUNs? Solaris needs to map these LUNs using pseudo devices in the Solaris OS for ASM to recognize the new disks.
    How would I set this up in Solaris 10 with Sun multipathing (MPxIO) and Oracle 10g RAC ASM?
    I want to get this right to avoid the dreaded ORA-15072 errors when creating a diskgroup with external redundancy for the Oracle 10g RAC ASM installation process.

  • Oracle 10g ASM and RAC configuration

    Hi all,
    I want to ask to everybody something about Oracle 10g RAC and ASm configuration. We plan to migrate to Oracle 10g from 9i, and we will begin configuring oracle but we have to decide which configuration are the best.
    Our materials are bellow:
    Hardware: RP 3440 (HP)
    OS : HPUX 11i Ver 1
    Storage: EVA 4000 (eva disk group)
    The problem is:
    Our supplier recommand us to use HP serviguard + HP serviceguard extension for RAC+ RAc and Raw device as configuration.
    But we want to use Oracekl Clusterware + RAC + ASM
    My question is if anybody know what is the best configuration, we want to use ASm.
    Can HP serviguard use ASM.
    Some documentations or link explain oracle RAC and ASM configuration will be appreciate.
    Thanks for your help.
    Regards.
    raitsarevo

    Hi,
    I want to use RAC for clustering. My shared disk is a NetApp Filer FS250 that can only be mounted throught NFS. RAW devices have to be excluded, alsi OCFS i think works similar to raw devices and need to see phisical disk to create partition. ASM instead can work on an NFS mount?
    Ste
    Visit http://www.stefanocislaghi.it/

  • Extend the logical volume

    Hi Everybody
    I my current project no Unix administrator.
    Here system is Oracle Parallel Server in HP-UX environment
    (oracle 8.1.6) and database is created in the RAW devices.
    For the RAW devices volume group is vgoracle. In the volume
    group (vgoracle) all oracle datafiles logical volumes were
    created.
    The problem is, for the system datafile the logical volume name
    is orasystem and the size is 300 MB. I need to increase this the
    orasystem logical volume from 300MB to 1.5GB or 1GB.
    After shutdown the database can I increase the logical volume by
    using the following unix command
    lvextend -L 1500 /dev/vgoracle/orasystem
    If I increase the logical volume is there any possibility of
    database crush. Now the situation is I should not re-create the
    database.
    Regards
    Michael Selvam

    It is related to both because there are oracle datafiles on those raw devices.
    While looking around I found that it seems possible to extend logical volumes on the fly but if there is a file system based on it the file system must support this feature.
    In my case I don't have any file systems on the logical volumes but datafiles,redologs,spfile and control files of an oracle RDMS so the question may regard Oracle as well.
    I post this question here because I imagine that there should be at least one other oracle dba that experienced the same problem.
    For example you've experienced this problem but in a different platform. It seems good to know that its is possible to extend a logical volume in AIX without corrupting the datafiles on it on fly.
    One more thing then. Could you please tell me if adding a disk to a volume group ( the action I should do before extending the logical volume of that group ) is safe like extending a logical volume.
    Thanks
    Bye Alessandro

Maybe you are looking for

  • Windows 7 32-bit or 64-bit for CS5?

    I'm planning to buy a new PC with Windows 7 (my current PC is 4 yrs old, Win XP, slowing to a crawl). I will be running CS4 Design Premium on it at first, and later upgrade to CS5. Would it be advantageous to get a 64-bit system w/ 64-bit Windows 7,

  • Business partner in SAP HR

    Dear Friends, May I request you to provide information on my below queries please: 1. What is the significance of a Bussiness Partner in SAP, why do we have to implement this when we use Talent management. 2. In what way is it related with CP. 3. wha

  • How to erase photos from the iPad?

    Hi, I'm trying to erase my photos from the iPad 2 but they are still there, even after I delete them. they are not in the albums but they are in the photos. How can I get rid of them?

  • Cannot install Reader 9 or Acrobat Pro 9 - help!!!!!

    I have just clean installed Vista. It has SP1 on it but not a load of software. When I try to install Reader 9, setup unpacks up to 99.90% then I get an error message -Setup has stopped working. A problem caused the program to close unexpectedly. I g

  • Text size and slide heading

    Hi, Is there a way to change the text size of the size panel, I'm talking about Diapo 1 - Diapo 2 Diapo 3... I can change the size of everything else except that... Plus, does anyone know how to change the color of the slide heading ? I can't read it