Shared Storage RAC

Hello,
This is my Oracle RAC 11gR2 real world installation, I need to configure the shared storage for RAC 2 nodes on redhat enterprise linux 5.
could please send me a step by step how to do it? I want to use Device Mapper Multipath for that and ASM for Storage.
Thank you

899660 wrote:
Hello,
This is my Oracle RAC 11gR2 real world installation, I need to configure the shared storage for RAC 2 nodes on redhat enterprise linux 5.
could please send me a step by step how to do it? I want to use Device Mapper Multipath for that and ASM for Storage.
Thank youHi,
Shared storage is a hardware device, which cant be created by you. Ofcourse you can use that shared device to configure ASM.
Check the below links
http://martincarstenbach.wordpress.com/2010/11/16/configuration-device-mapper-multipath-on-oel5-update-5/
http://www.oracle.com/technetwork/database/device-mapper-udev-crs-asm.pdf

Similar Messages

Configure shared storage (RAC setup in Windows)

Hi,
Can I use mapped drive instead of direct connect to the external drive while configuring the shared storage?
My problem is:
I have a LaCie Group SA LaCie Big Disk Extreme LUN 0 IEEE 1394 SBP2 Device (500g). It can only be directly attached to one node because there is only one FW400 port. When I use switch and tried to connect both nodes directly to the device by switch, only one node show it as a disk drive. On another node, the device is utomatically stopped by windows and unaccessible.
Then I tried to map it, but the shared storage test failed.
Any idea?
Thanks
Laura

Hi.
I struggled with this problem, but then I gave up and used VMware to solve the problem:
http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnWindows2003UsingVMware.php
http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnCentos4UsingVMware.php
Howard Rogers has some stuff that might give you a clue also:
http://www.dizwell.com/oracle/articles/laptop_rac.html
Cheers
Tim...

The best option to create a shared storage for Oracle 11gR2 RAC in OEL 5?

Hello,
Could you please tell me the best option to create a shared storage for Oracle 11gR2 RAC in Oracel Enterprise Linux 5? in production environment? And could you help to create shared storage? Because there is no additional step in Oracle installation guide. There are steps for only asm disk creation.
Thank you.

Here are names of partitions and permissions. Partitions which have 146 GB, 438 GB, 438 GB of capacity are my storage. Two of three disks which are 438 GB were configured as RAID 5 and remaining disk was configured as RAID 0. My storage is Dell MD 3000i and connected to nodes through ethernet.
Node 1
[root@rac1 home]# ll /dev/sd*
brw-r----- 1 root disk 8, 0 Aug 8 17:39 /dev/sda
brw-r----- 1 root disk 8, 1 Aug 8 17:40 /dev/sda1
brw-r----- 1 root disk 8, 16 Aug 8 17:39 /dev/sdb
brw-r----- 1 root disk 8, 17 Aug 8 17:39 /dev/sdb1
brw-r----- 1 root disk 8, 32 Aug 8 17:40 /dev/sdc
brw-r----- 1 root disk 8, 48 Aug 8 17:41 /dev/sdd
brw-r----- 1 root disk 8, 64 Aug 8 18:26 /dev/sde
brw-r----- 1 root disk 8, 65 Aug 8 18:43 /dev/sde1
brw-r----- 1 root disk 8, 80 Aug 8 18:34 /dev/sdf
brw-r----- 1 root disk 8, 81 Aug 8 18:43 /dev/sdf1
brw-r----- 1 root disk 8, 96 Aug 8 18:34 /dev/sdg
brw-r----- 1 root disk 8, 97 Aug 8 18:43 /dev/sdg1
[root@rac1 home]# fdisk -l
Disk /dev/sda: 72.7 GB, 72746008576 bytes
255 heads, 63 sectors/track, 8844 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 8844 71039398+ 83 Linux
Disk /dev/sdb: 72.7 GB, 72746008576 bytes
255 heads, 63 sectors/track, 8844 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 * 1 4079 32764536 82 Linux swap / Solaris
Disk /dev/sdd: 20 MB, 20971520 bytes
1 heads, 40 sectors/track, 1024 cylinders
Units = cylinders of 40 * 512 = 20480 bytes
Device Boot Start End Blocks Id System
Disk /dev/sde: 146.2 GB, 146278449152 bytes
255 heads, 63 sectors/track, 17784 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sde1 1 17784 142849948+ 83 Linux
Disk /dev/sdf: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdf1 1 53352 428549908+ 83 Linux
Disk /dev/sdg: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdg1 1 53352 428549908+ 83 Linux
Node 2
[root@rac2 ~]# ll /dev/sd*
brw-r----- 1 root disk 8, 0 Aug 8 17:50 /dev/sda
brw-r----- 1 root disk 8, 1 Aug 8 17:51 /dev/sda1
brw-r----- 1 root disk 8, 2 Aug 8 17:50 /dev/sda2
brw-r----- 1 root disk 8, 16 Aug 8 17:51 /dev/sdb
brw-r----- 1 root disk 8, 32 Aug 8 17:52 /dev/sdc
brw-r----- 1 root disk 8, 33 Aug 8 18:54 /dev/sdc1
brw-r----- 1 root disk 8, 48 Aug 8 17:52 /dev/sdd
brw-r----- 1 root disk 8, 64 Aug 8 17:52 /dev/sde
brw-r----- 1 root disk 8, 65 Aug 8 18:54 /dev/sde1
brw-r----- 1 root disk 8, 80 Aug 8 17:52 /dev/sdf
brw-r----- 1 root disk 8, 81 Aug 8 18:54 /dev/sdf1
[root@rac2 ~]# fdisk -l
Disk /dev/sda: 145.4 GB, 145492017152 bytes
255 heads, 63 sectors/track, 17688 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 8796 70653838+ 83 Linux
/dev/sda2 8797 12875 32764567+ 82 Linux swap / Solaris
Disk /dev/sdc: 146.2 GB, 146278449152 bytes
255 heads, 63 sectors/track, 17784 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdc1 1 17784 142849948+ 83 Linux
Disk /dev/sdd: 20 MB, 20971520 bytes
1 heads, 40 sectors/track, 1024 cylinders
Units = cylinders of 40 * 512 = 20480 bytes
Device Boot Start End Blocks Id System
Disk /dev/sde: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sde1 1 53352 428549908+ 83 Linux
Disk /dev/sdf: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdf1 1 53352 428549908+ 83 Linux
[root@rac2 ~]#
Thank you.
Edited by: user12144220 on Aug 10, 2011 1:10 AM
Edited by: user12144220 on Aug 10, 2011 1:11 AM
Edited by: user12144220 on Aug 10, 2011 1:13 AM

Oracle RAC with QFS shared storage going down when one disk fails

Hello,
I have an oracle RAC on my testing environment. The configuration follows
nodes: V210
Shared Storage: A5200
#clrg status
Group Name Node Name Suspended Status
rac-framework-rg host1 No Online
host2 No Online
scal-racdg-rg host1 No Online
host2 No Online
scal-racfs-rg host1 No Online
host2 No Online
qfs-meta-rg host1 No Online
host2 No Offline
rac_server_proxy-rg host1 No Online
host2 No Online
#metastat -s racdg
racdg/d200: Concat/Stripe
Size: 143237376 blocks (68 GB)
Stripe 0:
Device Start Block Dbase Reloc
d3s0 0 No No
racdg/d100: Concat/Stripe
Size: 143237376 blocks (68 GB)
Stripe 0:
Device Start Block Dbase Reloc
d2s0 0 No No
#more /etc/opt/SUNWsamfs/mcf
racfs 10 ma racfs - shared
/dev/md/racdg/dsk/d100 11 mm racfs -
/dev/md/racdg/dsk/d200 12 mr racfs -
When the disk /dev/did/dsk/d2 failed (I have failed it by removing from the array), the oracle RAC went offline on both nodes, and then both nodes paniced and rebooted. Now the #clrg status shows below output.
Group Name Node Name Suspended Status
rac-framework-rg host1 No Pending online blocked
host2 No Pending online blocked
scal-racdg-rg host1 No Online
host2 No Online
scal-racfs-rg host1 No Online
host2 No Pending online blocked
qfs-meta-rg host1 No Offline
host2 No Offline
rac_server_proxy-rg host1 No Pending online blocked
host2 No Pending online blocked
crs is not started in any of the nodes. I would like to know if anybody faced this kind of a problem when using QFS on diskgroup. When one disk is failed, the oracle is not supposed to go offline as the other disk is working, and also my qfs configuration is to mirror these two disks !!!!!!!!!!!!!!
Many thanks in advance
Ushas Symon

I'm not sure why you say QFS is mirroring these disks!?!? Shared QFS has no inherent mirroring capability. It relies on the underlying volume manager (VM) or array to do that for it. If you need to mirror you storage, you do it at the VM level by creating a mirrored metadevice.
Tim
---

Pointing existing RAC nodes to a fresh Shared Storage discarding old one

Hi,
I have a RAC Setup with the Primary Database on Oracle 10gR2.
For this setup, there is a Physical Standby Database Setup (using DataGuard configuration) also with 30min delay.
Assume that the "Shared Storage" of the Primary DB fails completely.
In the above scenario, my plan is to refresh a "fresh" shared storage device using Physical Standby Database Setup and then "point" the RAC nodes to the new "Shared Storage".
Is this possible?
Simply put, how can I refresh the Primary database using the Standby Database?
Please help with the utilities (RMAN, DatGuard, other non-Oracle products etc.) that can be used to do this.
Regards

Does following Shared Device configuration is fine for 10g RAC on Windows 2003?
. 1 SCSI drive
• Two PCI network adapters on each node in the cluster.
• Storage cables to attach the shared storage device to all computers.
regard.

How to change permissions on shared storage to install Oracle RAC on vmware

Hello:
- I am trying to install Oracle RAC using vmware.
- But when I try to change permissions for the shared storage,
the owner and group of the shared storage does not change.
- Has some else installed Oracle RAC onto vmware ?
- I am using Oracle RAC 10.2.0, solaris 5.10 x86
Thanks
Jlem

I have successfully installed RAC on vmware following this article, maybe you can give it a try,
Oracle 10g RAC On Linux Using VMware Server
http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnCentos4UsingVMware.php

Shared Storage for RAC

Dear All,
what is the best options for shared storage system for Oracle RAC 10g R2 on windows operating system.
How to share disk in windows so that it can be available in all RAC nodes in Dynamic mode.
Need help from people who have configured RAC on windows operating system and have used shared disk option.
Regards,
Imran

In production, the only realistic options are to turn to certified SAN or NAS vendors.
The issue is simplel - even though many types of shared storage allows you to have multiple machines connected to the same disk, certified shared storage allows these machines to write to the same disk sector and block. Most storage solutions have built-in protection to stop that from happening.
For a small shop, I certainly recommend NetApp NAS.

Problem of using OCFS2 as shared storage to install RAC 10g on VMware

Hi, all
I am installing a RAC 10g cluster with two linux nodes on VMware. I created a shared 5G disk for the two nodes as shared storage partition. By using OCFS2 tools, i formatted this shared storage partition and successfully auto mounted it on both nodes.
Before installing, i use the command "runcluvfy.sh stage -pre crsinst -n node1,node2" to determine the installation prerequisites. Everything is ok except an error "Could not find a suitable set of interfaces for VIPs.". By searching the web, i found this error could be safely ignored.
The OCFS2 works well on both nodes, i formatted the shared partition as ocfs2 file system and configure o2bc to auto start ocfs service. I mounted the shared disk on both nodes at /ocfs directory. By adding an entry into both nodes' /etc/fstab, this partition can be auto mounted at system boots. I could access files in shared partition on both nodes.
My problem is that, when installing clusterware, at the stage "Specify Oracle Cluster Registry", I enter "/ocfs/OCRFILE" for Specify OCR Location and "/ocfs/OCRFILE_Mirror" for Specify OCR Mirror Location. But got an error as following:
----- Error Message ----
The location /ocfs/OCRFILE, entered for the Oracle Cluster Registry(OCR) is not shared across all the nodes in the cluster. Specify a shared raw partition or cluster file system that is visible by the same name on all nodes of the cluster.
------ Error Message ---
I don't know why the OUI can't recognize /ocfs as shared partition. On both nodes, using command "mounted.ocfs2 -f", i can get the result:
Device FS Nodes
/dev/sdb1 ocfs2 node1, node2
What's the possible wrong? Any help is appreciated!
Addition information:
1) uname -r
2.6.9-42.0.0.0.1.EL
2) Permission of shared partition
$ls -ld /ocfs/
drwxrwxr-x 6 oracle dba 4096 Aug 3 18:22 /ocfs/

Hello
I am not sure how far this following solution is relevant to your problem (regardless when it was originally posted - may help someone who is reading this thread), here is what I faced and here is how I fixed it:
I was setting up RAC using VMWare. I prepared rac1 [installed OS, configured disks, users, etc] and the made a copy of it as rac2. So far so good. When, as per the guide I was following for RAC configuration, I started OCFS2 configuration, faced the following error on RAC2 when I tried to mount the /dev/adb1:
===================================================
[Root @ *rac2* ~] # mount - t ocfs2 - o datavolume, nointr / dev / sdb1 / ocfs
ocfs2_hb_ctl: OCFS2 DIRECTORY corrupted WHILE reading uuid ocfs2_hb_ctl: OCFS2 DIRECTORY corrupted WHILE reading uuid
mount.ocfs2: Error WHEN attempting TO run / sbin / ocfs2_hb_ctl: "Operation not permitted" mount.ocfs2: Error WHEN attempting TO run / sbin / ocfs2_hb_ctl: "Operation not permitted"
===================================================
After a lot of "googling around", I finally bumped into a page, the kind person who posted the solution said [in my words below and more detailed ]:
o shutdown both rac1 and rac2
o in VMWare, "edit virtual machine settings" for rac1
o remove the disk [make sure you drop the correct one]
o recreate it and select *"allocate all disk space now"* [with same name and in the same directory where it was before]
o start rac1 and login as *"root"* and *"fdisk /dev/sdb"* [or whichever is/was your disk where you r installing ocfs2]
Once done, repeat the steps for configuring OCFS2. I was successfully able to mount the disk on both machines.
All this problem was apparently caused by not choosing "allocate all disk space now" option while creating the disk to be used for OCFS2.
If you still have any questions or problem, email me at [email protected] and I'll try to get back to you at my earliest.
Good luck!
Muhammad Amer
[email protected]

Oracle rac raw device as shared storage

Hi,
i m new to oracle rac,
and i wish to instlall 11g r1 RAC on my laptop having linux 4 as platform (on vmware) ,
for that i prepare 4 partition for that (on node1)
/dev/sdb1 - for ocr
/dev/sdb2 - for voting disk
/dev/sdb3 - for asmdisk group
/dev/sda5 - fro asmdisk group
by assuming external redundacy for ocr and voting disk i kept only one disk
and i configured following in /etc/sysconfig/rawdevices
/dev/raw/raw1 /dev/sdb1 -- ocr
/dev/raw/raw2 /dev/sdb2 -- voting disk
/dev/raw/raw3 /dev/sdb3 -- asmdisk group
/dev/raw/raw4 /dev/sdb5 -- asmdisk group
and my question is how node2 can understat these raw device as shared storage?
thanks for any support

hi thanks for your suggestion ,
this may be ok for VMware , but what about for non-VMWare environment?
how can i make raw device as shared storage?
one more, all the docs that i followed on net , configured node1 partitions as shared storage.
please help me in this regards

How to implement RAC with no shared storage available...

Hello Guys,
I have installed, configured single node RAC R2 with 2 database instances on windows 2000 platform with the help of vmware software. Installation was successfull.
I just meet my boss to explain him my acheivements and to get permission to go for prodcution environment where we will be developing 3 nodes RAC on linux platform.
I asked him that we need a shared stroage system that can be achieved by SAN or NAS or firewire disks... but he refuses to buy any additioan hardware as we have already spend a lot on servers. He wants to me have another computer with a large size Hard Disk Drive to be used as shared storage.
I just want to know can we configure 3 nodes RAC using HDD of an other computer as sommon shared storage...
Please guide me. I really want to implement RAC in our production environment.
Regards,
Imran

Yeah, but would openfiler work? Has any one
implemented RAC using open filer or software
configured shared storage.
Any other better solution as i have to implement it
in production environment and have to seek better
backup facilities.Are you looking for a production environment, or an evaluation environment?
For an evaluation environment OpenFiler works. I occasionally teach RAC classes using that. It works but it is not as fast or as robust as I'd like in production.
For a production environment, plan to pay some money. The least expensive commercial shared stored I have found is from NetApp - any NetApp F8xx or FAS2xx files with iSCSI or even NFS license will do for RAC.
Message was edited by:
Hans Forbrich

10g RAC on varitas Cluster Software and Shared storage

1. Install oracle binaries and patches (RAC install)
2. Configure Cluster control interface (shared storage) for Oracle
3. Create instances of oracle
These are 3 things i am wondering how to handle, I did all these on Oracle Clusterware , but never on Veritas Cluster ware ...all these 3 steps are the same or different. In someone can help..

How we can do this while using varitas cluster software
1. Install oracle binaries and patches (RAC install)
2. Configure Cluster control interface (shared storage) for Oracle
3. Create instances of oracle
If we install RDBMS 10.2.0.1 with standard installer it will catch the vcs and when we will be running dbca it will ask for RAC db option?
what is Configure Cluster control interface (shared storage) for Oracle??

RAC with OCFS2 shared storage

Hi all
I wont to create RAC env in oracle VM 2.2 (one server) , with lokal disk's which I used to create LVM for ocr in in guest:
- two quest with Oracle enterprise linux 5
- both have ocfs2 rpm instaled
when I wont to create shared storage for ocr I configure cluster.conf
- service o2cb configure -> all ok -> on both nodes
- service o2cb enable -> ok -> on both nodes
- then mkfs.ocfs2 in node1
- mount -t ocfs2 in node1
- mount -t ocfs2 in node 2:
[root@lin2 ~]# mount -t ocfs2 /dev/sde1 /ocr
mount.ocfs2: Transport endpoint is not connected while mounting /dev/sde1 on /ocr. Check 'dmesg' for more information on this error.
Jun 27 22:57:23 lin2 kernel: (o2net,1454,0):o2net_connect_expired:1664 ERROR: no connection established with node 0 after 30.0 seconds, giving up and returning errors.
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):dlm_request_join:1036 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):dlm_try_to_join_domain:1210 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):dlm_join_domain:1488 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):dlm_register_domain:1754 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):ocfs2_dlm_init:2808 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: (mount.ocfs2,9327,0):ocfs2_mount_volume:1447 ERROR: status = -107
Jun 27 22:57:23 lin2 kernel: ocfs2: Unmounting device (8,65) on (node 1)
can You help me where I doing mistake
thank You Brano

Please find the answer in the below link
http://wiki.oracle.com/page/Oracle+VM+Server+Configuration-usingOCFS2+in+a+group+of+VM+hosts+to+share+block+storage

RAC and Shared Storage

Hi,
I am trying to build a two-node RAC on windows 2003. I have two nodes, RAC1 and RAC2. I have completed the network configuration and now intend to implement shared storage. On RAC1, i have two hard disks.
Is it possible if I create 5 logial partitions on one disk with out formatting and without any drive letter, and consider it a shared storage?
Please guide in this regard.
regards,

Hi, you need a shared storage (for OCR, voting disk and databases files) so DAS disk on one node is not correct.
Regards

RAC shared storage

Hi,
I am trying to build a two-node RAC on windows 2003. I have two nodes, RAC1 and RAC2. I have completed the network configuration and now intend to implement shared storage. On RAC1, i have two hard disks.
Is it possible if I create 5 logial partitions on one disk with out formatting and without any drive letter, and consider it a shared storage?
Please guide in this regard.
regards,

Does following Shared Device configuration is fine for 10g RAC on Windows 2003?
. 1 SCSI drive
• Two PCI network adapters on each node in the cluster.
• Storage cables to attach the shared storage device to all computers.
regard.

No Shared Storage Available (RAC Installation)

Hello Guys,
I am in process of installing RAC 10G R2 on windows 2000 operating system. Well i am going for 2 node clustering. The problem is that we dont have any shared storage system like SAN. Is it possible that we can use any other computer's HDD for stroing data files? All other files can be stored in different drives of the 2 nodes.... OR is it possible to store datafiles on these nodes?
Please guide me... and what type of storage it will be called... obviously not ASM but it would be OCFS?
Please help.
Regards,
Imran

Well we are doing it for testing purpose... when we will go for production installation then obviouly we will keep our data files on a shared storage....
I have read the document but it is not clear to me... can we keep data files on any one of the node?
Regards,
Imran

Shared Storage RAC

Similar Messages

Maybe you are looking for