Choice of shared storage for Oralce VM clustering feature

Hi,
I would like to experiment the Oracle VM clustering feature over multiple OVM servers. One requirement is the shared storage which can be provided by iSCSI/FC SAN, or NFS. These types of external storage are usually very expensive. For testing purpose, what other options of shared storage can be used? Can someone share your experience?

You don't need to purchase an expensive SAN storage array for this. A regular PC running Linux or Solaris will do just fine to act as an iSCSI target or to provide NFS shares via TCP/IP. Googling for "linux iscsi target howto" reveals a number of hits like this one: "RHEL5 iSCSI Target/Initiator" - http://blog.hamzahkhan.com/?p=55
For Solaris, this book might be useful: "Configuring Oracle Solaris iSCSI Targets and Initiators (Tasks)" - http://download.oracle.com/docs/cd/E18752_01/html/817-5093/fmvcd.html

Similar Messages

Considering shared storage for Oracle RAC 10g

Hi, guys!
My Oracle RAC will be run on VMware ESXI 5.5. So, both 2 nodes and shared storage are on VM. Don't blame for this, I dont have another choice.
I am choosing shared storage for Oracle RAC. I am choosing between NFS and ISCSI server, both can be done in RedHat linux or FreeNAS.
Can u, guys, help me to do the choise?
RedHat or FreeNAS
ISCSI or NFS
Any help will be appreciated.

JohnWatson написал(а):
NFS is really easy. Create your zero-filled files, set the ownership and access modes, and point your asm_diskstring at them. Much simpler than configuring an iSCSI target and initiators, and then messing about with ASMlib or udev.
I recorded a public lecture that (if I remember correctly) describes it here, Oracle ASM Free Tutorial
I will be using OCFS2 as cluster FS. Does it make any difference for NFS vs ISCSI?

In the old Mobile me storage I had shared storage for my family and all of our devices. How do I breakup the 55GB across my apple accounts now that iCloud is by device by user?

In the old Mobile me storage I had shared storage for my family and all of our devices. How do I breakup the 55GB across my apple accounts now that iCloud is by device by user? Anyone else have this issue. I am also in need of correcting the storage from my work where I do not have Safari or I can not down load iCould to my desk top.

That storage moves to master account. Since there are no accounts like that in Icloud, people in your family will enjoy complimentary 5 gigs from Apple and they will let you know if they need anymore. You will not be able to manage storage from windows desktop

The best option to create a shared storage for Oracle 11gR2 RAC in OEL 5?

Hello,
Could you please tell me the best option to create a shared storage for Oracle 11gR2 RAC in Oracel Enterprise Linux 5? in production environment? And could you help to create shared storage? Because there is no additional step in Oracle installation guide. There are steps for only asm disk creation.
Thank you.

Here are names of partitions and permissions. Partitions which have 146 GB, 438 GB, 438 GB of capacity are my storage. Two of three disks which are 438 GB were configured as RAID 5 and remaining disk was configured as RAID 0. My storage is Dell MD 3000i and connected to nodes through ethernet.
Node 1
[root@rac1 home]# ll /dev/sd*
brw-r----- 1 root disk 8, 0 Aug 8 17:39 /dev/sda
brw-r----- 1 root disk 8, 1 Aug 8 17:40 /dev/sda1
brw-r----- 1 root disk 8, 16 Aug 8 17:39 /dev/sdb
brw-r----- 1 root disk 8, 17 Aug 8 17:39 /dev/sdb1
brw-r----- 1 root disk 8, 32 Aug 8 17:40 /dev/sdc
brw-r----- 1 root disk 8, 48 Aug 8 17:41 /dev/sdd
brw-r----- 1 root disk 8, 64 Aug 8 18:26 /dev/sde
brw-r----- 1 root disk 8, 65 Aug 8 18:43 /dev/sde1
brw-r----- 1 root disk 8, 80 Aug 8 18:34 /dev/sdf
brw-r----- 1 root disk 8, 81 Aug 8 18:43 /dev/sdf1
brw-r----- 1 root disk 8, 96 Aug 8 18:34 /dev/sdg
brw-r----- 1 root disk 8, 97 Aug 8 18:43 /dev/sdg1
[root@rac1 home]# fdisk -l
Disk /dev/sda: 72.7 GB, 72746008576 bytes
255 heads, 63 sectors/track, 8844 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 8844 71039398+ 83 Linux
Disk /dev/sdb: 72.7 GB, 72746008576 bytes
255 heads, 63 sectors/track, 8844 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 * 1 4079 32764536 82 Linux swap / Solaris
Disk /dev/sdd: 20 MB, 20971520 bytes
1 heads, 40 sectors/track, 1024 cylinders
Units = cylinders of 40 * 512 = 20480 bytes
Device Boot Start End Blocks Id System
Disk /dev/sde: 146.2 GB, 146278449152 bytes
255 heads, 63 sectors/track, 17784 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sde1 1 17784 142849948+ 83 Linux
Disk /dev/sdf: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdf1 1 53352 428549908+ 83 Linux
Disk /dev/sdg: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdg1 1 53352 428549908+ 83 Linux
Node 2
[root@rac2 ~]# ll /dev/sd*
brw-r----- 1 root disk 8, 0 Aug 8 17:50 /dev/sda
brw-r----- 1 root disk 8, 1 Aug 8 17:51 /dev/sda1
brw-r----- 1 root disk 8, 2 Aug 8 17:50 /dev/sda2
brw-r----- 1 root disk 8, 16 Aug 8 17:51 /dev/sdb
brw-r----- 1 root disk 8, 32 Aug 8 17:52 /dev/sdc
brw-r----- 1 root disk 8, 33 Aug 8 18:54 /dev/sdc1
brw-r----- 1 root disk 8, 48 Aug 8 17:52 /dev/sdd
brw-r----- 1 root disk 8, 64 Aug 8 17:52 /dev/sde
brw-r----- 1 root disk 8, 65 Aug 8 18:54 /dev/sde1
brw-r----- 1 root disk 8, 80 Aug 8 17:52 /dev/sdf
brw-r----- 1 root disk 8, 81 Aug 8 18:54 /dev/sdf1
[root@rac2 ~]# fdisk -l
Disk /dev/sda: 145.4 GB, 145492017152 bytes
255 heads, 63 sectors/track, 17688 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 8796 70653838+ 83 Linux
/dev/sda2 8797 12875 32764567+ 82 Linux swap / Solaris
Disk /dev/sdc: 146.2 GB, 146278449152 bytes
255 heads, 63 sectors/track, 17784 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdc1 1 17784 142849948+ 83 Linux
Disk /dev/sdd: 20 MB, 20971520 bytes
1 heads, 40 sectors/track, 1024 cylinders
Units = cylinders of 40 * 512 = 20480 bytes
Device Boot Start End Blocks Id System
Disk /dev/sde: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sde1 1 53352 428549908+ 83 Linux
Disk /dev/sdf: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdf1 1 53352 428549908+ 83 Linux
[root@rac2 ~]#
Thank you.
Edited by: user12144220 on Aug 10, 2011 1:10 AM
Edited by: user12144220 on Aug 10, 2011 1:11 AM
Edited by: user12144220 on Aug 10, 2011 1:13 AM

To use NFS mount as shared storage for calendar

hi all,
Colocated IM deployment <<To ensure high availbility, Oracle Calendar Server is placed on Cold Failover Cluster. Cold Failover Cluster installation requires shared storage for ORACLE_HOME and oraInventory.
Q: can NFS mount be used as the shared storage? has anyone tried it? thanks

Hi Arnaud!
This is of course a test environment on my laptop. I WOULD NEVER do this in production or even mention this to a customer :-)
In this environment I do not care for performance but it is not slow.
cu
Andreas

Do I have to have Shared Storage for Vm 3.0 ??

Hi
i used Oracle vm 2.2 .
where I can install vm by using Server's Storage .
Example
Server A has Vm 2.2 installed and it has 2Tb Storage .
From From Oracle Vm manager 2.2. I can create vm in Server A by using those 2Tb storage.
does this rules apply to Vm 3.0 ??
or for vm 3.0, you have to have Shared storage like Sun or something to hold vm's files ???
Please let me know ..
thanks

Hi
From last 8 hours I am trying to figured it how use Local storage for vm
"The choice is yours to use the local disks either to provision logical storage volumes as disks for virtual machines or to install a storage repository. If you place a storage repository on the local disk, an OCFS2 file system is installed."
I have configured 2 Server for test
Server A : partition type
[root@ov2 vm]# df -T
Filesystem Type 1K-blocks Used Available Use% Mounted on
/dev/sda2 ext3 3050092 575588 2317068 20% /
/dev/sdb1 ocfs2 937496576 3124224 934372352 1% /vm
/dev/sda1 ext3 101086 37328 58539 39% /boot
tmpfs tmpfs 323728 6644 317084 3% /dev/shm
none tmpfs 318720 40 318680 1% /var/lib/xenstored
So accordin to document : "f you place a storage repository on the local disk, an OCFS2 file system is installed.""
Becauyse /dev/sdb1 is a ocfs2 file sytem i should be able to put this one in to Storage Repository .. but i cant ..
Server B :
fdisk -l /dev/sdb
WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted.
WARNING: The size of this disk is 3.0 TB (2996997980160 bytes).
DOS partition table format can not be used on drives for volumes
larger than 2.2 TB (2199023255040 bytes). Use parted(1) and GUID
partition table format (GPT).
Disk /dev/sdb: 2996.9 GB, 2996997980160 bytes
255 heads, 63 sectors/track, 364364 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 267350 2147483647+ ee EFI GPT
This is unpartition..
so accordign to document : " The choice is yours to use the local disks either to provision logical storage volumes as disks for virtual machines "
now when i add this one into hardware ..
3600605b00380680015dd0ed432ef8876 Local Storage Volume Group Generic Local Storage Array @ ov1.domain.lan SAN None 2791.17 0.0 ov1.domain.lan
its can see but its General local Storage Array ..
and i cant do anythign with this.
can any one please give me some advise to create vm in any of this server with this local Storage ...
i would really apprecaite your help ..
thanks

Cheap shared storage for test RAC

Hi All,
Is there cheap shared storage device is available to create test environment RAC. I used to create RAC with vmware but environment is not much stable.
Regards

Two options:
The Oracle VM templates can be used to build clusters of any number of nodes using Oracle Database 11g Release 2, which includes Oracle 11g Rel. 2 Clusterware, Oracle 11g Rel. 2 Database, and Oracle Automatic Storage Management (ASM) 11g Rel. 2, patched to the latest, recommended patches.
This is supported for Production.
http://www.oracle.com/technetwork/server-storage/vm/rac-template-11grel2-166623.html
Learn how to set up and configure an Oracle RAC 11g Release 2 development cluster on Oracle Linux for less than US$2,700.
The information in this guide below is not validated by Oracle, is not supported by Oracle, and should only be used at your own risk; it is for educational purposes only.
http://www.oracle.com/technetwork/articles/hunter-rac11gr2-iscsi-088677.html
Regards,
Levi Pereira
Edited by: Levi Pereira on Dec 10, 2012 10:59 AM

Shared Storage for RAC

Dear All,
what is the best options for shared storage system for Oracle RAC 10g R2 on windows operating system.
How to share disk in windows so that it can be available in all RAC nodes in Dynamic mode.
Need help from people who have configured RAC on windows operating system and have used shared disk option.
Regards,
Imran

In production, the only realistic options are to turn to certified SAN or NAS vendors.
The issue is simplel - even though many types of shared storage allows you to have multiple machines connected to the same disk, certified shared storage allows these machines to write to the same disk sector and block. Most storage solutions have built-in protection to stop that from happening.
For a small shop, I certainly recommend NetApp NAS.

DFSr supported cluster configurations - replication between shared storage

I have a very specific configuration for DFSr that appears to be suffering severe performance issues when hosted on a cluster, as part of a DFS replication group.
My configuration:
3 Physical machines (blades) within a physical quadrant.
3 Physical machines (blades) hosted within a separate physical quadrant
Both quadrants are extremely well connected, local, 10GBit/s fibre.
There is local storage in each quadrant, no storage replication takes place.
The 3 machines in the first quadrant are MS clustered with shared storage LUNs on a 3PAR filer.
The 3 machines in the second quadrant are also clustered with shared storage, but on a separate 3PAR device.
8 shared LUNs are presented to the cluster in the first quadrant, and an identical storage layout is connected in the second quadrant. Each LUN has an associated HAFS application associated with it which can fail-over onto any machine in the local cluster.
DFS replication groups have been set up for each LUN and data is replicated from an "Active" cluster node entry point, to a "Passive" cluster node that provides no entry point to the data via DFSn and a Read-Only copy on it's shared cluster
storage.
For the sake of argument, assume that all HAFS application instances in the first quadrant are "Active" in a read/write configuration, and all "Passive" instances of the HAFS applications in the other quadrants are Read-Only.
This guide: http://blogs.technet.com/b/filecab/archive/2009/06/29/deploying-dfs-replication-on-a-windows-failover-cluster-part-i.aspx defines
how to add a clustered service to a replication group. It clearly shows using "Shared storage" for the cluster, which is common sense otherwise there effectively is no application fail-over possible and removes the entire point of using a resilient
cluster.
This article: http://technet.microsoft.com/en-us/library/cc773238(v=ws.10).aspx#BKMK_061 defines the following:
DFS Replication in Windows Server 2012 and Windows Server 2008 R2 includes the ability to add a failover cluster
as a member of a replication group. The DFS Replication service on versions of Windows prior to Windows Server 2008 R2
is not designed to coordinate with a failover cluster, and the service will not fail over to another node.
It then goes on to state, quite incredibly: DFS Replication does not support replicating files on Cluster Shared Volumes.
Stating quite simply that DFSr does not support Cluster Shared Volumes makes absolutely no sense at all after stating clusters
are supported in replication groups and a technet guide is provided to setup and configure this configuration. What possible use is a clustered HAFS solution that has no shared storage between the clustered nodes - none at all.
My question: I need some clarification, is the text meant to read "between" Clustered
Shared Volumes?
The storage configuration must to be shared in order to form a clustered service in the first place. What
we am seeing from experience is a serious degradation of
performance when attempting to replicate / write data between two clusters running a HAFS configuration, in a DFS replication group.
If for instance, as a test, local / logical storage is mounted to a physical machine the performance of a DFS replication group between the unshared, logical storage on the physical nodes is approaching 15k small files per minute on initial write and even high
for file amendments. When replicating between two nodes in a cluster, with shared clustered storage the solution manages a weak 2,500 files per minute on initial write and only 260 files per minute when attempting to update data / amend files.
By testing various configurations we have effectively ruled out the SAN, the storage, drivers, firmware, DFSr configuration, replication group configuration - the only factor left that makes any difference is replicating from shared clustered storage, to another
shared clustered storage LUN.
So in summary:
Logical Volume ---> Logical Volume = Fast
Logical Volume ---> Clustered Shared Volume = ??
Clusted Shared Volume ---> Clustered Shared Volume = Pitifully slow
Can anyone explain why this might be?
The guidance in the article is in clear conflict with all other evidence provided around DFSr and clustering, however it seems to lean towards why we may be seeing a real issue with replication performance.
Many thanks for your time and any help/replies that may be received.
Paul

Hello Shaon Shan,
I am also having the same scenario at one of my customer place.
We have two FileServers running on Hyper-V 2012 R2 as guest VM using Cluster Shared Volume. Even the data partition drive also a part of CSV.
It's really confusing whether the DFS replication on CSV are supported or not, then what would be consequence if using.
In my knowledge we have some customers they are using Hyper-V 2008 R2 and DFS is configured and running fine on CSV since more than 4 years without any issue.
Appreciate if you can please elaborate and explain in details about the limitations on using CSV.
Thanks in advance,
Abul

How to Create Shared Storage using VM-Server 2.1 Red Hat Enterprise Linux 5

Thanks in advance.
Describe in sequence how to create shared storage for a two guest/node Red Hat Linux Enterprise using Oracle 2.1 VM Server on Red Hat Linux Enterprise 5 using command line or appropriate interface.
How to create Shared Storage using Oracle 2.1 VM Server?
How to configure Network for two node cluster (oracle clusterware)?

Hi Suresh Kumar,
Oracle Application Server 10g Release 2, Patch Set 3 (10.1.2.3) is required to be fully certified on OEL 5.x or RHEL 5.x.
Oracle Application Server 10g Release 2 10.1.2.0.0 or 10.1.2.0.1 versions are not supported with Oracle Enterprise Linux (OEL) 5.0 or Red Hat Enterprise Linux (RHEL) 5.0. It is recommended that version 10.1.2.0.2 be obtained and installed.
Which implies Oracle AS 10.1.2.x is some what certified on RHEL 5.x
I think it would be better if you get in touch with Oracle Support regarding this .
Sorry , I am not aware of any document on migration from Sun Solaris to RH Linux 5.2 .
Thanks,
Sutirtha

Shared Storage RAC

Hello,
This is my Oracle RAC 11gR2 real world installation, I need to configure the shared storage for RAC 2 nodes on redhat enterprise linux 5.
could please send me a step by step how to do it? I want to use Device Mapper Multipath for that and ASM for Storage.
Thank you

899660 wrote:
Hello,
This is my Oracle RAC 11gR2 real world installation, I need to configure the shared storage for RAC 2 nodes on redhat enterprise linux 5.
could please send me a step by step how to do it? I want to use Device Mapper Multipath for that and ASM for Storage.
Thank youHi,
Shared storage is a hardware device, which cant be created by you. Ofcourse you can use that shared device to configure ASM.
Check the below links
http://martincarstenbach.wordpress.com/2010/11/16/configuration-device-mapper-multipath-on-oel5-update-5/
http://www.oracle.com/technetwork/database/device-mapper-udev-crs-asm.pdf

10g RAC on varitas Cluster Software and Shared storage

1. Install oracle binaries and patches (RAC install)
2. Configure Cluster control interface (shared storage) for Oracle
3. Create instances of oracle
These are 3 things i am wondering how to handle, I did all these on Oracle Clusterware , but never on Veritas Cluster ware ...all these 3 steps are the same or different. In someone can help..

How we can do this while using varitas cluster software
1. Install oracle binaries and patches (RAC install)
2. Configure Cluster control interface (shared storage) for Oracle
3. Create instances of oracle
If we install RDBMS 10.2.0.1 with standard installer it will catch the vcs and when we will be running dbca it will ask for RAC db option?
what is Configure Cluster control interface (shared storage) for Oracle??

RAC with OCFS2 shared storage

Hi all
I wont to create RAC env in oracle VM 2.2 (one server) , with lokal disk's which I used to create LVM for ocr in in guest:
- two quest with Oracle enterprise linux 5
- both have ocfs2 rpm instaled
when I wont to create shared storage for ocr I configure cluster.conf
- service o2cb configure -> all ok -> on both nodes
- service o2cb enable -> ok -> on both nodes
- then mkfs.ocfs2 in node1
- mount -t ocfs2 in node1
- mount -t ocfs2 in node 2:
[root@lin2 ~]# mount -t ocfs2 /dev/sde1 /ocr
mount.ocfs2: Transport endpoint is not connected while mounting /dev/sde1 on /ocr. Check 'dmesg' for more information on this error.
Jun 27 22:57:23 lin2 kernel: (o2net,1454,0):o2net_connect_expired:1664 ERROR: no connection established with node 0 after 30.0 seconds, giving up and returning errors.
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):dlm_request_join:1036 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):dlm_try_to_join_domain:1210 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):dlm_join_domain:1488 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):dlm_register_domain:1754 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):ocfs2_dlm_init:2808 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):ocfs2_mount_volume:1447 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: ocfs2: Unmounting device (8,65) on (node 1)
can You help me where I doing mistake
thank You Brano

Please find the answer in the below link
http://wiki.oracle.com/page/Oracle+VM+Server+Configuration-usingOCFS2+in+a+group+of+VM+hosts+to+share+block+storage

RAC and Shared Storage

Hi,
I am trying to build a two-node RAC on windows 2003. I have two nodes, RAC1 and RAC2. I have completed the network configuration and now intend to implement shared storage. On RAC1, i have two hard disks.
Is it possible if I create 5 logial partitions on one disk with out formatting and without any drive letter, and consider it a shared storage?
Please guide in this regard.
regards,

Hi, you need a shared storage (for OCR, voting disk and databases files) so DAS disk on one node is not correct.
Regards

Shared Disks For RAC

Hi,
I plan to use shared disks to create Oracle RAC using ASM. What options do I have? OCFS2? or any other option?
Can some one lead me to a documnet on how can I use the shared disks for RAC?
Thanks.

javed555 wrote:
I plan to use shared disks to create Oracle RAC using ASM. What options do I have? You have two options:
1. Create shared virtual, i.e. file-backed disks. These files will be stored in /OVS/sharedDisk/ and made available to each guest
2. Expose physical devices directly to each guest, e.g. an LVM partition or a multipath LUN.
With both options, the disks show up as devices in the guests and you would then provision them with ASM, exactly the same way as if your RAC nodes were physical.
OCFS2 or NFS are required to create shared storage for Oracle VM Servers. This is to ensure the /OVS mount point is shared between multiple Oracle VM Servers.

Choice of shared storage for Oralce VM clustering feature

Similar Messages

Maybe you are looking for