Move OCR and Vote Disk to a new SAN

Hi,
Can you guys help me with some links/documents for moving OCR and Vote disk files from old SAN to new SAN.
Both SAN will have ocfs2 formatted 3 partitions on which ocr and votedisk will be placed (normal redundancy).
Oracle version 11g R2,
OS linux 5.5
RAC nodes : 2
Datafiles on ASM
OCR/Votedisk on ocfs2
Regards,
Ajay

user7443016 wrote:
Thanks for the reply, but all the examples were showing either ocfs2 to ASM or raw to ocfs2. could you just point out the high level steps for moving 3 ocr & votedisk files from one san to another(ocfs to ocfs).
Hi Ajay,
Steps will be same . It doesnt matter whether it is raw to ocfs2 or ocfs to ocfs.
There will be change only how do you assign storage for OCR/voting disk.
I have another doubt that, i already have 3 ocr files, can i add more ocr files pointing to another mount point? the same goes with votedisk.
You can use replace option so there is no need to add 4th OCR disk.
i found steps in one of the website: i have few doubts in it, could any one clarify it...All the steps seems to be fine.
Moving OCR
1) create mount point(new san - /u05) in all nodes
2) precreate ocr files in new mount points (i am not sure how to do it? is it just touch and filename, its a ocfs2 file system)on ocfs you need to create file as below :
dd if=/dev/zero of=/ocfs/OCR/ocrnew.dbf bs=1M count=128
Also I would suggest to have a look at :
'ocrconfig -replace ocr' Fails With PROT-16 [ID 444757.1]
RAC Assurance Support Team: RAC Starter Kit and Best Practices (Linux) [ID 811306.1]
Regards
Rajesh

Similar Messages

About OCR and Vote Disk size

Hallo,
I have a simple question about OCR and Vote Disk in a 10g/11g RAC setup:
official documentation speaks about sizing OCR and Vote Disk about 280 MB, but do they mean each OCR and Vote disk LUN ?
In other words, for 2 OCR and 3 Vote disk I need 280*5 MB ( in multiple o single LUN)
Is it so?
thx in advance

ottocolori wrote:
Hallo,
I have a simple question about OCR and Vote Disk in a 10g/11g RAC setup:
official documentation speaks about sizing OCR and Vote Disk about 280 MB, but do they mean each OCR and Vote disk LUN ?
In other words, for 2 OCR and 3 Vote disk I need 280*5 MB ( in multiple o single LUN)
Is it so?
thx in advanceYes. Also see Re: Reduce size of OCR file

OCR and vote disk Allocation for shared raw storage with Solaris 10 questio

Hi all,
Current environment is Solaris 10 SPARC 64 bit OS with Hitachi SAN for shared storage and Sun E6900 servers.
For Oracle 10g RAC (10.2) and ASM, I am setting up the vote disk and OCR files on shared raw storage area network.
Assume that I have a 35Gb LUN carved out on raw device for the vote disk and OCR for a 2-node Oracle 10g RAC cluster and since the vote disk and OCR only require 120MB of storage, is there a way to use only a 120MB slice from the LUN or do I need to allocate the entire LUN/raw device to the vote disk?
I am looking for a way to avoid wasting space for the OCR and vote disk with my 10g RAC cluster and we are using raw devices and Oracle 10g RAC Clusterware with Veritas filesystem for the disk management. Can I have several slices on Solaris 10 with raw shared storage (Hitachi) to triple mirror my OCR and vote disk files?
It seems odd to have to use an entire 35GB LUN just for 2 small files: vote disk and OCR. Is there a way to partition a 120MB slice on one of the devices and allocate the rest to ASM?

Hi
In our RAC env.
we have 1GB LUN for OCR and Voting Disk and 100GB LUN for ASM disk. we have 4 Node RAC env on AIX with 2 SAN storage on Hitachi system for our Application.
we keept 1st Voting diks on SAN-1 2nd Voting Disk on SAN-2 and third voting on SAN-3.
OCR disk on SAN1 and OCR_MIRROR Disk on SAN-2.
we have ASM DIsk with Normal Redundancy . Failure Group 1 on SAN-1 and
Failure Group 2 on SAN-2
Regards
Bharat

Recover OCR and VOTE disk after complete corruption of ASM disk groups.

Hi Gurus,
I am simulating a recovery situation to perform recover of OCR and Vote files after complete corruption of ASM related disks and diskgroups. I have setup my environment as follows:\
Environment: RAC
OS: OEL 5.5 32-bit
GI Version: 11.2.0.2.0
ASM Disk groups: +OCR, +DATA
OCR, Vote Files location: +OCR
ASM Redundancy: External
ASM Disks: /dev/asm-disk1, /dev/asm-disk2
/dev/asm-disk1 - mapped on +OCR
/dev/asm-disk2 - mapped on +DATA
With the above configuration in place I have manually corrupted +OCR, +DATA diskgroups with dd command. I used this command to completely corrupt +OCR disk group.
dd if=/dev/zero of=/dev/asm-disk1. I have manual backups as well as automatic backups of OCR and Vote disk. I am not using ASMLib.
I followed this link:
http://docs.oracle.com/cd/E11882_01/rac.112/e17264/adminoc.htm#TDPRC237
When I tried to recover OCR file, I could not do so as there is no such diskgroup which ASM can restore the OCR, Voting disk to. I could not Re-create OCR and DATA diskgroups as I cannot connect to ASM instance. If you have a solution or workaround for my situation please describe it. That will be greatly appreciated.
Thanks and Regards,
Suresh.

Please go through the following document which have the detailed steps to restore the OCR
How to restore ASM based OCR after complete loss of the CRS diskgroup on Linux/Unix systems [ID 1062983.1]

OCR and Voting Disk Migration to new media

Hello,
We need to move OCR,voting disk and ASM from one storage media to another .I think ASM related files are very easy to move/re map but how OCR and Voting Disk files will be migrated to the new storage media?
Thanks,
S.Mann

Hi,
when you said:
"Move Voting Disk : run as root.
crsctl query css votedisk
crsctl add css votedisk new_backup_san_device
crsctl query css votedisk - Make sure the new device is added
crsctl delete css votedisk current_san_device_to_be_encrypted
crsctl query css votedisk - Make sure that the old one is removed "
I supose the new_backup_san_device could be a raw device??
In my system I have a 2 nodes cluster, oracle 10gR2, RAC and ASM
the ocr and voting disk are stored in /dev/raw/raw1 and /dev/raw/raw2
thoses 2 raw devices are mapped with LUNS in the first storade media.
We are about to change it..
So what must I do at this step? What are the logical steps I must done?
add the new LUNS in the nodes and map it as raw devices?
I have this at the moment:
crw-r----- 1 root oinstall 162, 1 Feb 8 17:33 /dev/raw/raw1
crw-r----- 1 root oinstall 162, 2 Feb 8 17:33 /dev/raw/raw2
crw-r----- 1 oracle oinstall 162, 3 Feb 8 17:33 /dev/raw/raw3
in the case of migration, I must add 3 new row devices?
as this?
crw-r----- 1 root oinstall 162, 1 Feb 8 17:33 /dev/raw/raw1
crw-r----- 1 root oinstall 162, 2 Feb 8 17:33 /dev/raw/raw2
crw-r----- 1 oracle oinstall 162, 3 Feb 8 17:33 /dev/raw/raw3
crw-r----- 1 root oinstall 162, 1 Feb 8 17:33 /dev/raw/raw4
crw-r----- 1 root oinstall 162, 2 Feb 8 17:33 /dev/raw/raw5
crw-r----- 1 oracle oinstall 162, 3 Feb 8 17:33 /dev/raw/raw6
That's it?
Thanks to help

Help needed : How to move OCR and Voting Disk

Hi all experts...
I am Mahesh. Working in DXB as DBA. We have serveral RAC installed clients. Among those one major client wants their OCR and Voting Disk to be moved from existing SAN to a new SAN which will be configured. Only OCR and Voting Disks needs to be moved.
Details:
=====
Oracle Clusterware,ASM and DB version 10.2.0.3.0
Windows 2003 Server Enterprise Edition
2-Node RAC
OCR and Voting disks are on RAW devices (not on CFS or NFS)
I have read the clusterware administration document and also Metalink Note 428681.1 for the same.
But it does not contain information how to move it to another new RAW in a new SAN device. (we need to keep it in raw device itself)
How to identify the new disk path from windows operating system ? Then only we can move the OCR and VD right ???
Help me for the same please...
Thanks & regards,
Mahesh.

Hi Mashes,
Could you list out the steps you did after you create the link on the new SAN using GUIObjectManager.exe?
I tried on my VM and also in customer's test environment but I only successful using the following steps
1. shutdown asm service, database service, listener service, CRS, EVM and CSS
2. Object Manager Service is kept running
3. from both nodes I issued the following command
ocrconfig -repair \\.\OCRPRIMARY
ocrconfig -repair \\.\OCRMIRROR
4. according to metalink id 428681.1, I should do the following
ocrconfig -overwrite
However I was not successful because that command returns an error message (PROT-1: Failed to initialize ocr config).
Therefore, I ran the following command
ocrconfig -restore D:\oracle\1020\CRS\cdata\crs\backup00.ocr
5. after that command, ocrcheck giving me the result and the ocr primary and mirror have been moved to the new partition.
6. start the whole services starting from CSS, EVM, CRS, ASM, Listerner and Database service.
Although what I experienced seems a bit weird and not the same as what was written in metalink, the RAC is running fine until now.
What I would like to know is your experience on this. May be you can share it here.
Thank you,
Adhika

OCR and VOT disk, in the same asm disk or different disks ?! and how ?!

What Oracle recommends regarding the OCR and Voting disks in Rac 11gR2 on ASM ?!
Making them under the same disk or different disks ?!
and how ?!
Thanks a lot,
Regards,
Gehad.

Best practice is that OCR/Voting should be under ASM. Making them under the same disk or different disks depends upon the ASM diskgroup. If we want to keep it on seperate failover groups then we should create muliple failover group.
For external : 1 ; Normal : 3 and higher : 5 asm diskgroups.
I hope i would be clear ith my answers.
Regards,
Dheeraj Vaish

OCR and voting disks on ASM, problems in case of fail-over instances

Hi everybody
in case at your site you :
- have an 11.2 fail-over cluster using Grid Infrastructure (CRS, OCR, voting disks),
where you have yourself created additional CRS resources to handle single-node db instances,
their listener, their disks and so on (which are started only on one node at a time,
can fail from that node and restart to another);
- have put OCR and voting disks into an ASM diskgroup (as strongly suggested by Oracle);
then you might have problems (as we had) because you might:
- reach max number of diskgroups handled by an ASM instance (63 only, above which you get ORA-15068);
- experiment delays (especially in case of multipath), find fake CRS resources, etc.
whenever you dismount disks from one node and mount to another;
So (if both conditions are true) you might be interested in this story,
then please keep reading on for the boring details.
One step backward (I'll try to keep it simple).
Oracle Grid Infrastructure is mainly used by RAC db instances,
which means that any db you create usually has one instance started on each node,
and all instances access read / write the same disks from each node.
So, ASM instance on each node will mount diskgroups in Shared Mode,
because the same diskgroups are mounted also by other ASM instances on the other nodes.
ASM instances have a spfile parameter CLUSTER_DATABASE=true (and this parameter implies
that every diskgroup is mounted in Shared Mode, among other things).
In this context, it is quite obvious that Oracle strongly recommends to put OCR and voting disks
inside ASM: this (usually called CRS_DATA) will become diskgroup number 1
and ASM instances will mount it before CRS starts.
Then, additional diskgroup will be added by users, for DATA, REDO, FRA etc of each RAC db,
and will be mounted later when a RAC db instance starts on the specific node.
In case of fail-over cluster, where instances are not RAC type and there is
only one instance running (on one of the nodes) at any time for each db, it is different.
All diskgroups of db instances don't need to be mounted in Shared Mode,
because they are used by one instance only at a time
(on the contrary, they should be mounted in Exclusive Mode).
Yet, if you follow Oracle advice and put OCR and voting inside ASM, then:
- at installation OUI will start ASM instance on each node with CLUSTER_DATABASE=true;
- the first diskgroup, which contains OCR and votings, will be mounted Shared Mode;
- all other diskgroups, used by each db instance, will be mounted Shared Mode, too,
even if you'll take care that they'll be mounted by one ASM instance at a time.
At our site, for our three-nodes cluster, this fact has two consequences.
One conseguence is that we hit ORA-15068 limit (max 63 diskgroups) earlier than expected:
- none ot the instances on this cluster are Production (only Test, Dev, etc);
- we planned to have usually 10 instances on each node, each of them with 3 diskgroups (DATA, REDO, FRA),
so 30 diskgroups each node, for a total of 90 diskgroups (30 instances) on the cluster;
- in case one node failed, surviving two should get resources of the failing node,
in the worst case: one node with 60 diskgroups (20 instances), the other one with 30 diskgroups (10 instances)
- in case two nodes failed, the only node survived should not be able to mount additional diskgroups
(because of limit of max 63 diskgroup mounted by an ASM instance), so all other would remain unmounted
and their db instances stopped (they are not Production instances);
But it didn't worked, since ASM has parameter CLUSTER_DATABASE=true, so you cannot mount 90 diskgroups,
you can mount 62 globally (once a diskgroup is mounted on one node, it is given a number between 2 and 63,
and other diskgroups mounted on other nodes cannot reuse that number).
So as a matter of fact we can mount only 21 diskgroups (about 7 instances) on each node.
The second conseguence is that, every time our CRS handmade scripts dismount diskgroups
from one node and mount it to another, there are delays in the range of seconds (especially with multipath).
Also we found inside CRS log that, whenever we mounted diskgroups (on one node only), then
behind the scenes were created on the fly additional fake resources
of type ora*.dg, maybe to accomodate the fact that on other nodes those diskgroups were left unmounted
(once again, instances are single-node here, and not RAC type).
That's all.
Did anyone go into similar problems?
We opened a SR to Oracle asking about what options do we have here, and we are disappointed by their answer.
Regards
Oscar

Hi Klaas-Jan
- best practises require that also online redolog files are in a separate diskgroup, in case of ASM logical corruption (we are a little bit paranoid): in case DATA dg gets corrupted, you can restore Full backup plus Archived RedoLog plus Online Redolog (otherwise you will stop at the latest Archived).
So we have 3 diskgroups for each db instance: DATA, REDO, FRA.
- in case of fail-over cluster (active-passive), Oracle provide some templates of CRS scripts (in $CRS_HOME/crs/crs/public) that you edit and change at your will, also you might create additionale scripts in case of additional resources you might need (Oracle Agents, backups agent, file systems, monitoring tools, etc)
About our problem, the only solution is to move OCR and voting disks from ASM and change pfile af all ASM instance (parameter CLUSTER_DATABASE from true to false ).
Oracle aswers were a litlle bit odd:
- first they told us to use Grid Standalone (without CRS, OCR, voting at all), but we told them that we needed a Fail-over solution
- then they told us to use RAC Single Node, which actually has some better features, in csae of planned fail-over it might be able to migreate
client sessions without causing a reconnect (for SELECTs only, not in case of a running transaction), but we already have a few fail-over cluster, we cannot change them all
So we plan to move OCR and voting disks into block devices (we think that the other solution, which needs a Shared File System, will take longer).
Thanks Marko for pointing us to OCFS2 pros / cons.
We asked Oracle a confirmation that it supported, they said yes but it is discouraged (and also, doesn't work with OUI nor ASMCA).
Anyway that's the simplest approach, this is a non-Prod cluster, we'll start here and if everthing is fine, after a while we'll do it also on Prod ones.
- Note 605828.1, paragraph 5, Configuring non-raw multipath devices for Oracle Clusterware 11g (11.1.0, 11.2.0) on RHEL5/OL5
- Note 428681.1: OCR / Vote disk Maintenance Operations: (ADD/REMOVE/REPLACE/MOVE)
-"Grid Infrastructure Install on Linux", paragraph 3.1.6, Table 3-2
Oscar

SAN for ocr and vote file for Linux RAC

Hi Experts,
Based on Oracle document, i have to create 2 devices for the OCR and 3 for the VOTE in RAC.
However, my boss think SAN maybe mirroe OCR and Vote file. It is enough for 1 location in SAN storage. It does not matter how many driver sidplay for user.
Actually it is only one SAN in back side.
Any Explain for OCR/VOTE file in SAN?
Thnaks
JIm

The idea to have these multiplex copy is to reduce the single point of failure, non the less, that's reason you build RAC in the first place isn't?
So if it's possible you'd better have redundancy on physical disk level (LUN etc) then logic level (volume, partition etc) then file level.
Well I agree modern SAN are pretty reliable and had built in redundancy on physical and logic level, but if you only have single vote disk and OCR, your RAC is going to fail right away when vote disk and OCR has problem. The chances are if your OCR and Vote disk has logical corruption, the corruption is going to populated to your mirrors. Even if your mirror is good you still need to get mirror copy to replace working copy and restart cluster during the time your RAC is offline.
With more than one OCR and voting disk, your RAC is likely to survive single OCR/vote disk failure, so you can fix the problem while RAC online.

OCR and Voting Disk Mirror

Hi,
We have oracle 10.2.0.4 RAC database. Now we are planning to mirror the OCR and Voting disk. Currently we are using SAN mirror copy. SAN admin assures that we don't need mirror copy as it is being mirrored at the disk level. Can any one please suggest me if we need any mirror copy of these. If so what advantages I get from the regular SAN copy.

You use SAN or High Availability Storage + RAID. You don't need to mirror OCR/VOTING .
Anyway , If you can do it... Mirror OCR + Multi VOTING... , that's good thing oracle recommend.
By the way, If you can not mirror OCR + multi VOTE on 10g, You should backup VOTE File ("dd" linux command) after setup completed/add node/delete node.
http://download.oracle.com/docs/cd/B19306_01/rac.102/b28759/adminoc.htm#sthref148
And Check OCR file automatic backup:
$ ocrconfig -showbackup
http://download.oracle.com/docs/cd/B19306_01/rac.102/b14197/ocrsyntax.htm

AIX 6.1 - Do we need HACMP to store the OCR and Voting Disks on Raw Logical

We are planning to install 11G r1 rac on AIX 6.1. We will use clusterware and ASM. We would like to avoid GPFS and HACMP.
We plan to put the Clusterware OCR and Voting Disks on Raw Logical Volumes.
I do not believe we need HACMP. see the passage below from doc:
Oracle® Clusterware
Installation Guide
11g Release 1 (11.1) for AIX Based Systems
B28258-05
Configuring Raw Disk Devices for Oracle Clusterware Without HACMP or GPFS
If you are installing Oracle RAC on an AIX cluster without HACMP or GPFS, then you
must use shared raw disk devices for the Oracle Clusterware files. You can also use
shared raw disk devices for database file storage. However, Oracle recommends that
you use Automatic Storage Management to store database files in this situation.
This section describes how to configure the shared raw disk devices for Oracle
Clusterware files (Oracle Cluster Registry and Oracle Clusterware voting disk). It also
describes how to configure shared raw devices for Oracle ASM and for Database files,
if you intend to install Oracle Database, and you need to create new disk devices.
Question:
Do we need HACMP to store the OCR and Voting Disks on Raw Logical Volumes? According to the passage above we do not.

You can archive log either in shared location or separate location associated with each instance. Oracle recommends using a shared location for all the instances in a RAC configuration. Check the topic "Location of Archived Logs for the Cluster File System Archiving Scheme" in Clusters Administration and Deployment Guide

OCR and voting disk location

Hi all,
I'm testing to install an Oracle RAC database (11g) on linux RHE 5 with a shared storage DELL Equallogic SCSI SAN.
I will setup a 2 nodes and i will use ASM for the database storage. I'm new in RAC database and i'm checking some docs and find that for the installation should have 3 volumes.
1- volumes for OCR and voting disk
2- volume for Database file (ASM)
3- volume for flash Recovery area and archive log file (ASM)
My question is which file system i will use for OCR and voting disk volume as i know for Datafiles and flash recovery area i will use ASM, but for voting disk i cannot use ASM because the system will access first OCR before starting ASm instance.
If i will use other file system how can i do ?
Thank you.

Hi
Thank you all for your help, actually i'm again facing problem in installing ASMlib, i cannot find ASMlib package for my OS even Raw device service is also not present.
My OS is CentOS 6 and Oracle 11g R2 RAC then installation type.
[root@Etopup-srv01 ~]# cat /etc/redhat-release
CentOS release 6.4 (Final)
Would you please help me what can i do to configure my ASM disk group ?
Thank you.

Advantage of having OCR and Voting disk on ASM

What are advantages of putting OCR and Voting disk on ASM from 11g

well, other than the sharing thing, you dont have to go RAIDing an additional shared disk either. If you have properly configured ASM, redundancy should be built in as well, either soft or hard.
not sure what other advantages you may need. Theres the IO thing with ASM, buit thats not really an advantage persay with ocr and vote. I may be contradicted by others but Ive never seen performance hit of any kind attributed to ocr and vote on non-ASM disk.

Where to put OCR and Voting disks?

Hi,
I will be installing Clusterware 11.2.0.2 on a 2 node cluster. I have read several whitepapers where a third asm disk group DATA, FRA, and CRS was created to hold the OCR and Voting disks. In the interest of keeping things simple can I just put the OCR and Voting disks in the DATA DG? I am using external SAN storage.
Thanks
Tom Cullen

Hi,
yes that is absolutely possible.
There are several best practices. Some recommend a separate diskgroup, some recommend to put OCR and Voting in the same diskgroup like your data.
So if there is no special use case it is absolutely valid to only use 2 diskgroups. 1 DATA (including OCR and Vote) and 1 FRA (Fast Recovery Area for Database Backups/Archivelogs/1 Controlfile/1 RedologMember and a second copy of OCR).
Regards
Sebastian

How do I define 2 disk groups for ocr and voting disks at the oracle grid infrastructure installation window

Hello,
It may sound too easy to someone but I need to ask it anyway.
I am in the middle of building Oracle RAC 11.2.0.3 on Linux. I have 2 storage and I created three LUNs in each of storage so 6 LUNs in total look in both of servers. If I choose NORMAL as a redundancy level, is it right to choose my 6 disks those are created for OCR_VOTE at the grid installation? Or should I choose only 3 of them and configure mirroring at latter stage?
The reason why I am asking this is that I didn't find any place to create asm disk group for ocr and voting disks at the oracle grid infrastructure installation window. In fact, I would to like to create two disk groups in which one of groups contains three disks those were brought from storage 1 and the second one contains rest three 3 disk that come from the last storage.
I believe that you will understand the manner and help me on choosing proper way.
Thank you.

Hi,
You have 2 Storage H/W.
You will need to configure a Quorum ASMDisk to store a Voting Disk.
Because if you lose 1/2 or more of all of your voting disks, then nodes get evicted from the cluster, or nodes kick themselves out of the cluster.
You must have the odd number of voting disk (i.e 1,3 or 5) one voting disk per ASM DISK, So 1 Storage will hold more voting disk than another storage.
(e.g 3 Voting Disk - 2 voting stored in stg-A and 1 voting disk store in stg-B)
If fail the storage that hold the major number of Voting disk the whole cluster (all nodes) goes down. Does not matter if you have a other storage online.
It will happen:
https://forums.oracle.com/message/9681811#9681811
You must configure your Clusterware same as RAC extended
Check this link:
http://www.oracle.com/technetwork/database/clusterware/overview/grid-infra-thirdvoteonnfs-131158.pdf
Explaining: How to store OCR, Voting disks and ASM SPFILE on ASM Diskgroup (RAC or RAC Extended) | Levi Pereira | Oracl…

Move OCR and Vote Disk to a new SAN

Similar Messages

Maybe you are looking for