OVM disks for RAC implementation

Dear All
is there any guide available on how can you create the disks for RAC ASM in OVM 3.3.1 using a fiber channel block level storage?
Thanks
George

You are right, you can't use virtual disks for RAC configuration. Have a look here (especially page 18):
http://www.oracle.com/technetwork/products/clustering/oracle-rac-in-oracle-vm-environment-131948.pdf
Using physical disks means that you create LUNs on your storage array connected to Oracle VM Servers by fabric channel. You map these LUNs to all servers in the pool or all standalone servers where you are going to install your virtual machines being Clusterware nodes. Then you rediscover storage in Oracle VM Manager, mark these LUNs as "shared" in OVMM and add them to your virtual machines as "Physical disks" (by editing guest properties in OVMM).
Alternatively you can directly map iSCSI or NFS storage to your guests. By "directly" I mean you use IP addresses and software in your guests as iSCSI initiator or NFS client - without engaging Oracle VM in the middle.
Regards,
Michal

Similar Messages

How Prepare Disks for RAC installation

How configure disks for RAC instalation for Windows Enterprise Server 2003

Best resource for RAC on Windows:
www.jobcestbon.com/oracle/RacOnWindows.pdf
HTH
Thanks
-Chandra PabbaI read it, but i unable to configure Shared Memory accourding to this link. Please guide me how i can configure shared Memory for RAC in Windows Server Enterprise 2003.
Thanks

Shared Disks For RAC

Hi,
I plan to use shared disks to create Oracle RAC using ASM. What options do I have? OCFS2? or any other option?
Can some one lead me to a documnet on how can I use the shared disks for RAC?
Thanks.

javed555 wrote:
I plan to use shared disks to create Oracle RAC using ASM. What options do I have? You have two options:
1. Create shared virtual, i.e. file-backed disks. These files will be stored in /OVS/sharedDisk/ and made available to each guest
2. Expose physical devices directly to each guest, e.g. an LVM partition or a multipath LUN.
With both options, the disks show up as devices in the guests and you would then provision them with ASM, exactly the same way as if your RAC nodes were physical.
OCFS2 or NFS are required to create shared storage for Oracle VM Servers. This is to ensure the /OVS mount point is shared between multiple Oracle VM Servers.

Redo log groups/files on the local disk for RAC DB

Whether is it possible/supported to place redo log files/groups on the local disk for a RAC databases ?
Thank you,

Hi Mufalani,
are you sure about this one? I'd think that this only works as long as the nodes don't restart/crash. I can imagine this like this:
The nodes store redo logs on local disks which are NFS-exported to the other node. Everything should be fine. But when one node crashes/reboots, the other one has to perform crash recovery for the crashed instance but this won't work when the NFS mount (with redo logs) is unaccessible. So I would not want to do this.
Bjoern

Doubts about shared disk for RAC

Hi All,
I am really new to RAC.Even after reading various documents,I still have many doubts regarding shared storage and file systems needed for RAC.
1.Clusterware has to be installed on a shared file system like OCFS2.Which type of hard drive is required to install OCFS2 so that it can be accessed from all nodes??
It has to be an external hard drive???Or we can use any simple hard disk for shared storage??
If we use external hard drive then does it need to be connected to a seperate server alltogether or can it be connected to any one of the nodes in the cluster???
Apart from this shared drives,approximately what size of hard disk is required for all nodes(for just a testing environment).
Sincerely appreciate a reply!!
Thanks in advance.

Clusterware has to be installed on shared storage. RAC also requires shared storage for the database.
Shared storage can be managed via many methods.
1. Some sites using Linux or UNIX-based OSes choose to use RAW disk devices. This method is not frequently used due to the unpleasant management overhead and long-term manageability for RAW devices.
2. Many sites use cluster filesystems. On Linux and Windows, Oracle offers OCFS2 as one (free) cluster filesystem. Other vendors also offer add-on products for some OSes that provide supported cluster filesystems (like GFS, GPFS, VxFS, and others). Supported cluster filesystems may be used for Clusterware files (OCR and voting disks) as well as database files. Check Metalink for a list of supported cluster filesystems.
3. ASM can be used to manage shared storage used for database files. Unfortunately, due to architecture decisions made by Oracle, ASM cannot currently be used for Clusterware files (OCR and voting disks). It is relatively common to see ASM used for DB files and either RAW or a cluster filesystem used for Clusterware files. In other words, ASM and cluster filesystems and RAW are not mutually exclusive.
As for hardware--I have not seen any hardware capable of easily connecting multiple servers to internal storage. So, shared storage is always (in my experience) housed externally. You can find some articles on OTN and other sites (search Google for them) that use firewire drives or a third computer running openfiler to provide the shared storage in test environments. In production environments, SAN devices are commonly employed to provide concurrent access to storage from multiple servers.
Hope this helps!
Message was edited by:
Dan_Norris

VMWare Fusion & Shared Disks for RAC install

Does anyone have any advice on how best to install a 2 node RAC 10G on a Macbook Pro. I've searched the forums here and haven't found much on this subject.
I'm having problems setting up the shared disks to be used for the voting disk and ASM.
Cheers,
Mike

This link might help you in what you are looking for.
http://www.apple.com/itpro/profiles/rotech/
Good luck,
--MM

Which external disk for RAC at home?

Dear Experts,
Years ago, I tried installing RAC at home on Linux 2.1.
With 2 Dell machines and a firewire external disk.
I was only partially successful.
Today, with Oracle 11, what would be a good external harddisk
to use? A small external NAS, or SAN through the router,
with Oracle Clusterware? Something else?
Multiple VMs with a single internal disk?
This detail is important!
Thanks a lot!

You can go the external shared disk route or you can even go the nfs mounts way. Here is the virtualization route:
http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnCentos4UsingVMware.php
Perhaps virtualization is the cost effective way (although it is no where the production grade)
Good Luck

OCR and VOTING DISK for RAC Database on ASMLib env

Can i use raw device for OCR and Voting Disk while installing Clusterware, i am planning to use ASM with ASMlib,
i know i can configure asm with dbca when i am using raw devices (to be user for ASM), How i can configure diskgroups when i use ASMlib, Can i configure ASM diskgroup with dbca , if yes plz forward me some metalink notes to study or any other help.

Hi,
Can i use raw device for OCR and Voting Disk while installing ClusterwareYes:
http://www.oracle.com/technology/pub/notes/technote_singh_crs.html
"Step 3: Create Raw Devices for the OCR and Voting Disk Before we start the installation"
plz forward me some metalink notes to study or any other help. I like Madhu Tumma's examples with raw devices because it has step-by-step examples:
http://www.rampant-books.com/book_2004_1_10g_grid.htm
Hope this helps . . .
Donald K. Burleson
http://www.dba-oracle.com

CRS and Voting Disk for RAC

Hi Friends,
How much disk space size should be allocated for CRS and Voting Disk?
Thanks a lot

Hi,
Is it ok if i put them into one LUN ? say /u02 200M under it are directory CRS and Voting, or it is
better to separate them into two LUNS /u02 /u03.
Thanks a lot

RAM for RAC implementation

Dear All,
It is not a core requirement of RAC that the RAM in both machines has to be exactly the same?
I have 2 linux machines with 16 GB and 14 GB RAM respectively.
After installation the RAM might be updated to 16 GB in both machines.
Regards,
Imran

misterimran wrote:
Dear All,
It is not a core requirement of RAC that the RAM in both machines has to be exactly the same?
I have 2 linux machines with 16 GB and 14 GB RAM respectively.
After installation the RAM might be updated to 16 GB in both machines.
Regards,
Imran
Hi,
It doesn't have to be match in term of memory but all nodes must meet minimum memory requirement
Cheers

Oracle 11gR2 (2 node) RAC Architecture requirements for ASM implementation

My architect is the following:
* RAC1 server of Red Hat Linux Enterprise 5.5 64bit
* RAC2 server of Red Hat Linux Enterprise 5.5 64bit
* NFS Server (SAN) with Red Hat Linux Enterprise 5.5 64bit
- Exported files systems for Shared Data, OCR and Voting Disks to nodes RAC1 and RAC2
I've installed the ASM packages on to my NFS Server (SAN) and then realized that I still need a way to share the storage. It is my understanding that Oracle ASM for Red Hat Linux Enterprise 5.5 64bit DOES NOT PROVIDE Shared Storage to the other nodes (RAC1 and RAC2). It seems that I need something else???
I've implemented Oracle RAC 11gR2 using NFS and wanted to try building Oracle RAC using ASM in my playground (home server's).
Does anyone have any ideas on how I might be able to use ASM with out having a true network shared storage. I'm using NFS because it is part of the Red Hat Enterprise 5.5.
Any ideas are appreciated !!!

Hi,
I would't recommend NFS for RAC in a enterprise solution. However if you are doing this for your playpan, then this is what you can do.
Once the NFS shares are presented to the servers, you need to mount your filesystems on the RAC servers to access the NFS shares.
e.g, If the the following NFS shares are presented to rac nodes:
/mnt/disk1
/mnt/disk2
And let say you want to have your ocr and voting disks on /mnt/disk1 and database on /mnt/disk2.
Firstly, you need to mount the shared on one of the rac nodes as follows. I will mount /mnt/disk1 as /u01/shared for my ocr and voting disks and /mnt/disk2 as /u01/asmdata by updating my fstab file as follows:
nfs_server:/mnt/DISK1 /u01/shared nfs rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,noac,vers=3,timeo=600 0 0
nfs_server:/mnt/DISK2 /u01/asmdata nfs rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,actimeo=0,vers=3,timeo=600 0 0
Mount the FS on both servers and then create the block devices into each filesystem. You don't need to run oracleasm to create disks on it but rather change your ASM discovery path to the location where you have the block devices created and mount your asm diskgroups.
That is how I got my 11g RAC setup.
Hope that helps.
Pranilesh

Restoration of ASM/RAC database to another clustered set of servers for DataGuard implementation

Hi all,
I've been working with single instance Oracle DBs for several years and we're now looking into RAC. I'm trying to gather as much info as possible in areas I think may be challenging if/when we implement RAC.
Can someone please help me with some info with regards to the scenarion below:
Assuming I already have a 2 node RAC database running and I want to set-up a failover RAC database, would the following steps be correct(assuming 11g):
Configure hardware, networking and O/S for 2 node RAC cluster (I know there's a lot in this single line, but let's just assume that's all done)
Configure disks for ASM
Clusterware installation
Oracle ASM software installation
Oracle11g software installation with RAC option
Database creation
***I'm not sure of the steps after database creation:
Export primary database up to a specific SCN (data pump gives the ability to specify scn)
Import into failover database
Switch on dataguard and sync failover starting from scn specified at export.
Please, help correct these steps and any useful link where this process is treated thoroughly would be highly appreciated.

This is a very high level overview of the steps, but here are some additions/amendments I can make:
Clusterware installation
Oracle ASM software installation
-- The above 2 steps are done at the same time. In 11g, the Oracle 11g Grid Infrastructure includes both the Clusterware and ASM installation and configuration.
Oracle11g software installation with RAC option
Database creation
***I'm not sure of the steps after database creation:
Export primary database up to a specific SCN (data pump gives the ability to specify scn)
Import into failover database
Switch on dataguard and sync failover starting from scn specified at export.
Will you be using Data Guard for a physical standby? If so, using RMAN would be the correct method in creating the standby database. The general steps would be:
- Oracle 11g software installation
- Backup Primary Database
- Configure Data Guard Parameters on Primary
- Duplicate Primary to Standby RAC using RMAN (can be done manually or through the RMAN DUPLICATE command)
- Enable log transport from primary, enable managed recovery on standby, and verify log transport and apply is working as intended.
Again this is a very general overview on the entire process, there are other factors that you'll have to take into consideration when planning such a project:
- Which protection mode will you be using? Maximum Performance, Availability, or Protection? The business' recovery goals and SLAs will be able to determine which mode you will choose.
- Will the standby be used for reporting purposes?
- Recommended to have your standby site have the same hardware configuration as the primary.
- Do you have an EM site already set-up? Data Guard Broker should be considered in the configuration of the Data Guard environment.
This is just a few things quickly off the top of my head. What OS do you have/plan on using? I don't have the link handy on me at the moment, but the official Oracle documentation should provide detailed guidance.
EDIT:
At a bare minimum, read the 2 Day RAC Guide. There is more detailed information in the RAC Admin and Deployment Guide, as well as the Data Guard Concepts and Admin Guide. Also here's a step-by-step guide provided by Oracle. You can also find several blogs that provide a more concise step-by-step guide, such as here, here, and here. RACSIG also has a number of very useful whitepapers, but something seems to be wrong with their search function and I can't link anything at the moment. However, I would highly recommend reading through the official documentation as this has more comprehensive information, especially if you are deploying on a production system.
Regards,
Oscar

Oracle 10g RAC implementation running out of space

I have an Oracle RAC implementation setup on a Sun Storagetek 6140 for storage. I have allocated 100gb of space to Oracle but am constantly running out of space during operations. I know that i can allocate additional disk space using Common Array Manager for the Storagetek. How do i get ASM to recognize the fact that there is additional space available to it?

Hi buddy,
How do i get ASM to recognize the fact that there is additional space available to it?You have two options:
1- The first one is create a new LUN, configure it at the OS level and add the disk to disk group.
alter diskgroup add disk '<DISK_DEVICE_PATH>';
2- The second one is increasing the LUN size (if possible, of course) and resize the disk.
alter diskgroup <DISK_GROUP_NAME> resize disk '<DISK_NAME>' <NEW_SIZE>;
Hope it helps,
Cerreia

Solutions for access as ROOT for RAC DBA duties

Our Networking Team and Applications Team are going through some growing pains. We are trying to resolve what permissions should be given to a RAC DBA. Our RAC DBA is responsible for Oracle Clusterware, Oracle Automatic Storage
Management and Oracle RDBMS software. The OS, Server and Storage Subsystem are the responsibility of the System Administrator. We have the following Environment:
Production and Test (RAC)
Oracle Enterprise Linux 5 update 2
Oracle Clusterware 11.2.0.2 -- Grid Infrastructure
Oracle ASM 11.2.0.2
Oracle Database 11.2.0.2 EE
Development (Single Instance)
Oracle Enterprise Linux 5 update 2
Oracle ASM 11.2.0.2 -- Grid Infrastructure
Oracle Database 11.2.0.2 EE
As the RAC DBA, I have identified the following areas that require ROOT for RAC and Single Instance DB's; however, I understand there may be more:
diagcollection.pl
- diagnostic tool for Oracle Clusterware and may be requested by Oracle Support
ocrconfig
- to repair ocr configuration issue (add, replace and remove requires root)
srvctl modify
- required root to change ip address
tar
- TAR Grid Infrastructure Directory structure preserving files with ROOT ownership
cluvfy
- cluvfy fix it scripts need to run as ROOT
- some cluvfy commands under 11gr1 would only run properly for -post cfs check as ROOT in our last installation
ASM Libraries
- ROOT required to install and configure ASM libraries
fdisk - l
- this is used to see disks attached which is relevant when ASM disks are not mounted
/etc/sysconfig/oracleasm
- oracleasm loading configuration file
/usr/sbin/oracleasm
- to make disks available to ASMLIB (scandisks etc.)
/usr/sbin/asmtool
- asm config tool due to bug
asm cluster file system
- some commands require ROOT (mounting etc.)
- acfsutil
/var/log/messages
- loading errors ohas and oracleasm would be logged here
cvuqdisk
- needs to be loaded for new install
root.sh
- script needed to run at install, upgrades and patching
oraInstRoot.sh
- script needed to run at install
rootupgrade.sh
- upgrade script
roothas.pl
- upgrade script
ocrcheck
- check for ocr corruption
- corrupt check portion requires ROOT
- oracle local registry
Grid Infrstructure
- .runInstaller from Grid Infrastructure
- includes upgrades
asm configuration assistant (asmca)
- configuration of asm diskgroups
- vol mgr for asm disks
ocrconfig
- ocr configuration tool
- ocr import
- ocr export
- oracle local registry
ocrdump
- used to check ocr backup file
- oracle local registry
opatch
- patching grid control requires ROOT
crsctl
- Startup and Shutdown Oracle Clusterware, Oracle ASM and Database/Instance
- restore voting disk
- restore ocr
- set log for dynamic debugging
- check install periodically
srvctl
- modify nodeapps (ex. ip address change)
- add filesystem (acfs)
What solutions have people found so that RAC DBA can perform responsibilites yet not have ROOT password?

In all the environments I've worked in, I either had direct su access with knowledge of the root password or used sudo. I really can't imagine an environment that would require something other than either of those two options.
In places with stricter auditing requirements we used sudo in conjunction with the sudosh shell wrapper to log all activities to syslog, but this was used by everyone and not just the DBA
Is SUDO the only solutuion? Every command need to be entered into SUDO config files that necessitates ROOT access.
As I demonstrated in the other thread, giving the oracle user sudo access to files that are writable by the oracle user (eg. root.sh) gives them the ability to access to a root shell. It is good to implement a "minimum privileges necessary" policy in your organization but it has to be within reason. The minimum privilege necessary for running and maintaining CRS is root.
Edited by: AllYourDataBase on Apr 18, 2011 1:44 PM

Error for rman for RAC db

Copyright (c) 1982, 2007, Oracle. All rights reserved.
connected to target database: TEST (DBID=485988764) connected to recovery catalog database
RMAN> run {
2> resync catalog;
3> allocate channel oem_backup_disk1 type disk
4> format '/misc/OraBackup/TEST/%d_ARCH_%T_%t_%s';
5> allocate channel oem_backup_disk2 type disk
6> format '/misc/OraBackup/TEST/%d_ARCH_%T_%t_%s';
7> backup as COMPRESSED BACKUPSET tag=Nov100921
8> archivelog all not backed up 2 times;
9> release channel oem_backup_disk1;
10> release channel oem_backup_disk2;
11> }
12>
starting full resync of recovery catalog full resync complete
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of allocate command at 11/10/2009 09:22:07
RMAN-06004: ORACLE error from recovery catalog database:
ORACLE error from recovery catalog database:
This is the error for RAC database. This error is because if i include recovery catalog in the script. if there is no recovery catalog then it is working fine.

run {
allocate channel oem_backup_disk1 type disk format '/misc/OraBackup/TEST/%d_ARCH_%T_%t_%s';
backup as COMPRESSED BACKUPSET tag=Nov100921 archivelog all not backed up 2 times;
release channel oem_backup_disk1;
it worked successfully.
if i run like this keeping it in script
run {
resync catalog;
allocate channel oem_backup_disk1 type disk
format '/misc/OraBackup/${3}/%d_ARCH_%T_%t_%s';
allocate channel oem_backup_disk2 type disk
format '/misc/OraBackup/${3}/%d_ARCH_%T_%t_%s';
backup as COMPRESSED BACKUPSET tag=$TAG
archivelog all not backed up 2 times;
release channel oem_backup_disk1;
release channel oem_backup_disk2;
then i will get the error
Copyright (c) 1982, 2007, Oracle. All rights reserved.
connected to target database: TEST (DBID=485988764) connected to recovery catalog database
RMAN> run {
2> resync catalog;
3> allocate channel oem_backup_disk1 type disk
4> format '/misc/OraBackup/TEST/%d_ARCH_%T_%t_%s';
5> allocate channel oem_backup_disk2 type disk
6> format '/misc/OraBackup/TEST/%d_ARCH_%T_%t_%s';
7> backup as COMPRESSED BACKUPSET tag=Nov100921
8> archivelog all not backed up 2 times;
9> release channel oem_backup_disk1;
10> release channel oem_backup_disk2;
11> }
12>
starting full resync of recovery catalog full resync complete
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of allocate command at 11/10/2009 09:22:07
RMAN-06004: ORACLE error from recovery catalog database:
ORACLE error from recovery catalog database:

OVM disks for RAC implementation

Similar Messages

Maybe you are looking for