OCR and Votinging Disk File Permissions for NFS 2 node RAC cluster

This is a fresh reinstall of Oracle 11gR2 Clusterware on Red Hat Enterprise Linux 64bit and I'm using NFS as my shared storage.
I've create three file systems /ocrVote01 /ocrVote02 and /ocrVote03 as NFS share and exported them to two nodes that will use them as shared OCR and Voting Disk. Currently I'm getting errors when I run root.sh
I've done the following:
chown rac:dba -R /ocrVote01 /ocrVote02 /ocrVote03
It appears that the root.sh script is trying to create a directory /ocrVote01/storage and getting permissions denied.
Any idea why Root can not create this directory?
root.sh is also getting error permission denied at /u01/gridinfra/11.2.0/GI/crs/install/crsconfiglib.pm at line 4478
Any Ideas on what file permissions should be set for /ocrVote01 /ocrVote02 and /ocrVote03 ?
Thanks
32352 close(3) = 0
32352 write(2, "mkdir /ocrVote01/storage/: Permi"..., 112) = 112
| 00000 6d 6b 64 69 72 20 2f 6f 63 72 56 6f 74 65 30 31 **mkdir /o crVote01** |
| 00010 2f 73 74 6f 72 61 67 65 2f 3a 20 50 65 72 6d 69 /storage /: Permi |
| 00020 73 73 69 6f 6e 20 64 65 6e 69 65 64 20 61 74 20 ssion de nied at |
| 00030 2f 75 30 31 2f 67 72 69 64 69 6e 66 72 61 2f 31 /u01/gri dinfra/1 |
| 00040 31 2e 32 2e 30 2f 47 49 2f 63 72 73 2f 69 6e 73 1.2.0/GI /crs/ins |
| 00050 74 61 6c 6c 2f 63 72 73 63 6f 6e 66 69 67 5f 6c tall/crs config_l |
| 00060 69 62 2e 70 6d 20 6c 69 6e 65 20 34 34 37 38 0a ib.pm li ne 4478. |
32352 exit_group(25) = ?

After reading OTN feedback, which is very much appreciated. I decided to look deeper into my NFS configuration and found that the /etc/exports had the incorrect configuration for shared disk where in root can make appropriate changes to voting disk and crs files. The correct configuration for /etc/fstab using NFS for shared storage for voting disk and CRS:
192.168.1.21:/ocrVote01 /ocrVote01 nfs rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,vers=3,timeo=600,actimeo=0 1 2
192.168.1.21:/ocrVote02 /ocrVote02 nfs rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,vers=3,timeo=600,actimeo=0 1 2
192.168.1.21:/ocrVote03 /ocrVote03 nfs rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,vers=3,timeo=600,actimeo=0 1 2

Similar Messages

OCR and vote disk Allocation for shared raw storage with Solaris 10 questio

Hi all,
Current environment is Solaris 10 SPARC 64 bit OS with Hitachi SAN for shared storage and Sun E6900 servers.
For Oracle 10g RAC (10.2) and ASM, I am setting up the vote disk and OCR files on shared raw storage area network.
Assume that I have a 35Gb LUN carved out on raw device for the vote disk and OCR for a 2-node Oracle 10g RAC cluster and since the vote disk and OCR only require 120MB of storage, is there a way to use only a 120MB slice from the LUN or do I need to allocate the entire LUN/raw device to the vote disk?
I am looking for a way to avoid wasting space for the OCR and vote disk with my 10g RAC cluster and we are using raw devices and Oracle 10g RAC Clusterware with Veritas filesystem for the disk management. Can I have several slices on Solaris 10 with raw shared storage (Hitachi) to triple mirror my OCR and vote disk files?
It seems odd to have to use an entire 35GB LUN just for 2 small files: vote disk and OCR. Is there a way to partition a 120MB slice on one of the devices and allocate the rest to ASM?

Hi
In our RAC env.
we have 1GB LUN for OCR and Voting Disk and 100GB LUN for ASM disk. we have 4 Node RAC env on AIX with 2 SAN storage on Hitachi system for our Application.
we keept 1st Voting diks on SAN-1 2nd Voting Disk on SAN-2 and third voting on SAN-3.
OCR disk on SAN1 and OCR_MIRROR Disk on SAN-2.
we have ASM DIsk with Normal Redundancy . Failure Group 1 on SAN-1 and
Failure Group 2 on SAN-2
Regards
Bharat

Move OCR and Vote Disk to a new SAN

Hi,
Can you guys help me with some links/documents for moving OCR and Vote disk files from old SAN to new SAN.
Both SAN will have ocfs2 formatted 3 partitions on which ocr and votedisk will be placed (normal redundancy).
Oracle version 11g R2,
OS linux 5.5
RAC nodes : 2
Datafiles on ASM
OCR/Votedisk on ocfs2
Regards,
Ajay

user7443016 wrote:
Thanks for the reply, but all the examples were showing either ocfs2 to ASM or raw to ocfs2. could you just point out the high level steps for moving 3 ocr & votedisk files from one san to another(ocfs to ocfs).
Hi Ajay,
Steps will be same . It doesnt matter whether it is raw to ocfs2 or ocfs to ocfs.
There will be change only how do you assign storage for OCR/voting disk.
I have another doubt that, i already have 3 ocr files, can i add more ocr files pointing to another mount point? the same goes with votedisk.
You can use replace option so there is no need to add 4th OCR disk.
i found steps in one of the website: i have few doubts in it, could any one clarify it...All the steps seems to be fine.
Moving OCR
1) create mount point(new san - /u05) in all nodes
2) precreate ocr files in new mount points (i am not sure how to do it? is it just touch and filename, its a ocfs2 file system)on ocfs you need to create file as below :
dd if=/dev/zero of=/ocfs/OCR/ocrnew.dbf bs=1M count=128
Also I would suggest to have a look at :
'ocrconfig -replace ocr' Fails With PROT-16 [ID 444757.1]
RAC Assurance Support Team: RAC Starter Kit and Best Practices (Linux) [ID 811306.1]
Regards
Rajesh

OCR and voting disk location

Hi all,
I'm testing to install an Oracle RAC database (11g) on linux RHE 5 with a shared storage DELL Equallogic SCSI SAN.
I will setup a 2 nodes and i will use ASM for the database storage. I'm new in RAC database and i'm checking some docs and find that for the installation should have 3 volumes.
1- volumes for OCR and voting disk
2- volume for Database file (ASM)
3- volume for flash Recovery area and archive log file (ASM)
My question is which file system i will use for OCR and voting disk volume as i know for Datafiles and flash recovery area i will use ASM, but for voting disk i cannot use ASM because the system will access first OCR before starting ASm instance.
If i will use other file system how can i do ?
Thank you.

Hi
Thank you all for your help, actually i'm again facing problem in installing ASMlib, i cannot find ASMlib package for my OS even Raw device service is also not present.
My OS is CentOS 6 and Oracle 11g R2 RAC then installation type.
[root@Etopup-srv01 ~]# cat /etc/redhat-release
CentOS release 6.4 (Final)
Would you please help me what can i do to configure my ASM disk group ?
Thank you.

OCR and Voting Disk Migration to new media

Hello,
We need to move OCR,voting disk and ASM from one storage media to another .I think ASM related files are very easy to move/re map but how OCR and Voting Disk files will be migrated to the new storage media?
Thanks,
S.Mann

Hi,
when you said:
"Move Voting Disk : run as root.
crsctl query css votedisk
crsctl add css votedisk new_backup_san_device
crsctl query css votedisk - Make sure the new device is added
crsctl delete css votedisk current_san_device_to_be_encrypted
crsctl query css votedisk - Make sure that the old one is removed "
I supose the new_backup_san_device could be a raw device??
In my system I have a 2 nodes cluster, oracle 10gR2, RAC and ASM
the ocr and voting disk are stored in /dev/raw/raw1 and /dev/raw/raw2
thoses 2 raw devices are mapped with LUNS in the first storade media.
We are about to change it..
So what must I do at this step? What are the logical steps I must done?
add the new LUNS in the nodes and map it as raw devices?
I have this at the moment:
crw-r----- 1 root oinstall 162, 1 Feb 8 17:33 /dev/raw/raw1
crw-r----- 1 root oinstall 162, 2 Feb 8 17:33 /dev/raw/raw2
crw-r----- 1 oracle oinstall 162, 3 Feb 8 17:33 /dev/raw/raw3
in the case of migration, I must add 3 new row devices?
as this?
crw-r----- 1 root oinstall 162, 1 Feb 8 17:33 /dev/raw/raw1
crw-r----- 1 root oinstall 162, 2 Feb 8 17:33 /dev/raw/raw2
crw-r----- 1 oracle oinstall 162, 3 Feb 8 17:33 /dev/raw/raw3
crw-r----- 1 root oinstall 162, 1 Feb 8 17:33 /dev/raw/raw4
crw-r----- 1 root oinstall 162, 2 Feb 8 17:33 /dev/raw/raw5
crw-r----- 1 oracle oinstall 162, 3 Feb 8 17:33 /dev/raw/raw6
That's it?
Thanks to help

Shared file system recomended for OCR and voting Disk in 10g R2

Dear Friends,
For Oracle 10g R2 (10.2.0.5) 64 bit which shared file system is recomended for OCR and voting Disk (NFS / raw devices / OCFS2)
For Datafiles and FRA i planned to use ASM
Regards,
DB

Hi,
If your using standard edition then you got no choice but raw devices
http://docs.oracle.com/cd/B19306_01/license.102/b14199/options.htm#CJAHAGJE
for ocfs2 you need to take extra care
Heartbeat/Voting/Quorum Related Timeout Configuration for Linux, OCFS2, RAC Stack to Avoid Unnecessary Node Fencing, Panic and Reboot [ID 395878.1]

Confusion with OCFS2 File system for OCR and Voting disk RHEL 5, Oracle11g,

Dear all,
I am in the process of installing Oracle 11g 3 Node RAC database
The environment on which i have to do this implementation is as follows:
Oracle 11g.
Red Hat Linux 5 x86
Oracle Clusterware
ASM
EMC Storage
250 Gb of Storage drive.
SAN
As of now i am in the process of installing Oracle Clusterware on the 3 nodes.
I have performed these tasks for the cluster installs.
1. Configure Kernel Parameters
2. Configure User Limits
3. Modify the /etc/pam.d/login file
4. Configure Operating System Users and Groups for Oracle Clusterware
5. Configure Oracle Clusterware Owner Environment
6. Install CVUQDISK rpm package
7. Configure the Hosts file
8. Verify the Network Setup
9. Configure the SSH on all Cluster Nodes (User Equivalence)
9. Enable the SSH on all Cluster Nodes (User Equivalence)
10. Install Oracle Cluster File System (OCFS2)
11.Verify the Installation of Oracle Cluster File System (OCFS2)
12. Configure the OCFS2 (/etc/ocfs2/cluster.conf)
13. Configure the O2CB Cluster Stack for OCFS2
BUT, here after i am a little bit confused on how to proceed further. The next step is to Format the disk and mount the OCFS2, Create Software Directories... so and so forth.
I asked my system admin to provide me two partitions so that i could format them with OCFS2 file system.
He wrote back to me saying.
*"Is what you want before I do it??*
*/dev/emcpowera1 is 3GB and formatted OCFS2.*
*/dev/emcpowera2 is 3GB and formatted OCFS2.*
*Are those big enough for you? If not, I can re-size and re-format them*
*before I mount them on the servers.*
*the SAN is shared storage. /dev/emcpowera is one of three LUNs on*
*the shared storage, and it's 214GB. Right now there are only two*
*partitions on it- the ones I listed below. I can repartition the LUN any*
*way you want it.*
*Where do you want these mounted at:*
*/dev/emcpowera1*
*/dev/emcpowera2*
*I was thinking if this mounting techique would work like so:*
*emcpowera1: /u01/shared_config/OCR_config*
*emcpowera2: /u01/shared_config/voting_disk*
*Let me know how you'd like them mounted."*
Please recommend me what i should convey to him so that i can ask him to the exact same thing.
My second question is, as we are using ASM, for which i am gonna configure ASM after clusterware installation, should i install Openfiler??
Pls refer the enviroment information i provided above and make recommendations.
As of now i am using Jeffery Hunters guide to install the entire setup. You think the entire install guide goes well with my enviroment??
http://www.oracle.com/technology/pub/articles/hunter_rac11gr1_iscsi.html?rssid=rss_otn_articles
Kind regards
MK

Thanks for ur reply Mufalani,
You have managed to solve half part of my query. But still i am stuck with what kind of mount point i should ask the system admin to create for OCR and Voting disk. Should i go with the mount point he is mentioning??
Let me put forth few more questions here.
1. Is 280 MB ok for OCR and voting disks respectively??
2. Should i ask the system admin to create 4 voting disk mount points and two for ocr??
3. As mentioned by the system admin.
*/u01/shared_config/OCR_config*
*/u01/shared_config/voting_disk*
Is this ok for creating the ocr and voting disks?
4. Can i use OCFS2 file system for formating the disk instead of using them as RAW device!!?
5. As u mentioned that Openfiler is not needed for Configuring ASM... Could you provide me the links which will guide me to create partition disks, voting disks and ocr disks!! I could not locate them on the doc or else were. I did find a couple of them, but was unable to identify a suitable one for my envoirement.
Regards
MK

Raw partition creation on RHEL5 for OCR and Voting disk

Hi all,
I want to create MAp raw device for block device to use for installing OCR and Voting disk. As i see fro mmetalonk note 465001.1 we can creaet rules to do that but when i follow the steps given in that note, nothing is changed see bellow:
[root@cdr-analysis01 ~]# /sbin/scsi_id -g -s /block/sdae/sdae1
360014380024d178600005000006c0000
[root@cdr-analysis01 ~]# /sbin/scsi_id -g -s /block/sdaf/sdaf1
360014380024d178600005000006f0000
Create udev naming rule file /etc/udev/rules.d/55-oracle-naming.rules
# Configure persistent, user-defined Oracle Clusterware device file names
KERNEL=="/dev/sdae1", BUS=="scsi", PROGRAM=="/sbin/scsi_id", RESULT=="360014380024d178600005000006c0000", NAME="ocr1", OWNER="root", GROUP="oinstall", MODE="0640"
KERNEL=="/dev/sdaf1", BUS=="scsi", PROGRAM=="/sbin/scsi_id", RESULT=="360014380024d178600005000006f0000", NAME="vote1", OWNER="oracle", GROUP="oinstall", MODE="0640"
[root@cdr-analysis01 ~]# udevtest /block/sdae/sdae1
main: looking at device '/block/sdae/sdae1' from subsystem 'block'
udev_rules_get_name: add symlink 'disk/by-id/scsi-360014380024d178600005000006c0000-part1'
udev_rules_get_name: add symlink 'disk/by-path/pci-0000:10:00.1-fc-0x50014380025ae47d:0x0007000000000000-part1'
run_program: '/lib/udev/vol_id --export /dev/.tmp-65-225'
run_program: '/lib/udev/vol_id' returned with status 4
run_program: '/sbin/scsi_id'
run_program: '/sbin/scsi_id' returned with status 1
udev_rules_get_name: no node name set, will use kernel name 'sdae1'
udev_device_event: device '/block/sdae/sdae1' already in database, validate currently present symlinks
udev_node_add: creating device node '/dev/sdae1', major = '65', minor = '225', mode = '0640', uid = '0', gid = '6'
udev_node_add: creating symlink '/dev/disk/by-id/scsi-360014380024d178600005000006c0000-part1' to '../../sdae1'
udev_node_add: creating symlink '/dev/disk/by-path/pci-0000:10:00.1-fc-0x50014380025ae47d:0x0007000000000000-part1' to '../../sdae1'
main: run: 'socket:/org/kernel/udev/monitor'
main: run: '/lib/udev/udev_run_devd'
main: run: 'socket:/org/freedesktop/hal/udev_event'
main: run: '/sbin/pam_console_apply /dev/sdae1 /dev/disk/by-id/scsi-360014380024d178600005000006c0000-part1 /dev/disk/by-path/pci-0000:10:00.1-fc-0x50014380025ae47d:0x0007000000000000-part1'
The name is not changed and the raw partition is not created
Could you help
Please
Raitsarevo

raitsarevo wrote:
I want to create MAp raw device for block device to use for installing OCR and Voting disk. Why not define it as a raw devices (despite raw devices being deprecated in the current Linux kernel, it is still available for backwards compatibility)? Quite easy to configure.
Do the install and then when done, rename the disks from block devices back to character devices - there's a Metalink note that covers how to do that. Sorry - not in the office and do not have the Metalink note at hand. However, have used this approach successfully with 3 RAC installation (RHEL4 and RHEL5) in recent months.

How do I define 2 disk groups for ocr and voting disks at the oracle grid infrastructure installation window

Hello,
It may sound too easy to someone but I need to ask it anyway.
I am in the middle of building Oracle RAC 11.2.0.3 on Linux. I have 2 storage and I created three LUNs in each of storage so 6 LUNs in total look in both of servers. If I choose NORMAL as a redundancy level, is it right to choose my 6 disks those are created for OCR_VOTE at the grid installation? Or should I choose only 3 of them and configure mirroring at latter stage?
The reason why I am asking this is that I didn't find any place to create asm disk group for ocr and voting disks at the oracle grid infrastructure installation window. In fact, I would to like to create two disk groups in which one of groups contains three disks those were brought from storage 1 and the second one contains rest three 3 disk that come from the last storage.
I believe that you will understand the manner and help me on choosing proper way.
Thank you.

Hi,
You have 2 Storage H/W.
You will need to configure a Quorum ASMDisk to store a Voting Disk.
Because if you lose 1/2 or more of all of your voting disks, then nodes get evicted from the cluster, or nodes kick themselves out of the cluster.
You must have the odd number of voting disk (i.e 1,3 or 5) one voting disk per ASM DISK, So 1 Storage will hold more voting disk than another storage.
(e.g 3 Voting Disk - 2 voting stored in stg-A and 1 voting disk store in stg-B)
If fail the storage that hold the major number of Voting disk the whole cluster (all nodes) goes down. Does not matter if you have a other storage online.
It will happen:
https://forums.oracle.com/message/9681811#9681811
You must configure your Clusterware same as RAC extended
Check this link:
http://www.oracle.com/technetwork/database/clusterware/overview/grid-infra-thirdvoteonnfs-131158.pdf
Explaining: How to store OCR, Voting disks and ASM SPFILE on ASM Diskgroup (RAC or RAC Extended) | Levi Pereira | Oracl…

OCR and VOTING DISK for RAC Database on ASMLib env

Can i use raw device for OCR and Voting Disk while installing Clusterware, i am planning to use ASM with ASMlib,
i know i can configure asm with dbca when i am using raw devices (to be user for ASM), How i can configure diskgroups when i use ASMlib, Can i configure ASM diskgroup with dbca , if yes plz forward me some metalink notes to study or any other help.

Hi,
Can i use raw device for OCR and Voting Disk while installing ClusterwareYes:
http://www.oracle.com/technology/pub/notes/technote_singh_crs.html
"Step 3: Create Raw Devices for the OCR and Voting Disk Before we start the installation"
plz forward me some metalink notes to study or any other help. I like Madhu Tumma's examples with raw devices because it has step-by-step examples:
http://www.rampant-books.com/book_2004_1_10g_grid.htm
Hope this helps . . .
Donald K. Burleson
http://www.dba-oracle.com

OCR and voting disks on ASM, problems in case of fail-over instances

Hi everybody
in case at your site you :
- have an 11.2 fail-over cluster using Grid Infrastructure (CRS, OCR, voting disks),
where you have yourself created additional CRS resources to handle single-node db instances,
their listener, their disks and so on (which are started only on one node at a time,
can fail from that node and restart to another);
- have put OCR and voting disks into an ASM diskgroup (as strongly suggested by Oracle);
then you might have problems (as we had) because you might:
- reach max number of diskgroups handled by an ASM instance (63 only, above which you get ORA-15068);
- experiment delays (especially in case of multipath), find fake CRS resources, etc.
whenever you dismount disks from one node and mount to another;
So (if both conditions are true) you might be interested in this story,
then please keep reading on for the boring details.
One step backward (I'll try to keep it simple).
Oracle Grid Infrastructure is mainly used by RAC db instances,
which means that any db you create usually has one instance started on each node,
and all instances access read / write the same disks from each node.
So, ASM instance on each node will mount diskgroups in Shared Mode,
because the same diskgroups are mounted also by other ASM instances on the other nodes.
ASM instances have a spfile parameter CLUSTER_DATABASE=true (and this parameter implies
that every diskgroup is mounted in Shared Mode, among other things).
In this context, it is quite obvious that Oracle strongly recommends to put OCR and voting disks
inside ASM: this (usually called CRS_DATA) will become diskgroup number 1
and ASM instances will mount it before CRS starts.
Then, additional diskgroup will be added by users, for DATA, REDO, FRA etc of each RAC db,
and will be mounted later when a RAC db instance starts on the specific node.
In case of fail-over cluster, where instances are not RAC type and there is
only one instance running (on one of the nodes) at any time for each db, it is different.
All diskgroups of db instances don't need to be mounted in Shared Mode,
because they are used by one instance only at a time
(on the contrary, they should be mounted in Exclusive Mode).
Yet, if you follow Oracle advice and put OCR and voting inside ASM, then:
- at installation OUI will start ASM instance on each node with CLUSTER_DATABASE=true;
- the first diskgroup, which contains OCR and votings, will be mounted Shared Mode;
- all other diskgroups, used by each db instance, will be mounted Shared Mode, too,
even if you'll take care that they'll be mounted by one ASM instance at a time.
At our site, for our three-nodes cluster, this fact has two consequences.
One conseguence is that we hit ORA-15068 limit (max 63 diskgroups) earlier than expected:
- none ot the instances on this cluster are Production (only Test, Dev, etc);
- we planned to have usually 10 instances on each node, each of them with 3 diskgroups (DATA, REDO, FRA),
so 30 diskgroups each node, for a total of 90 diskgroups (30 instances) on the cluster;
- in case one node failed, surviving two should get resources of the failing node,
in the worst case: one node with 60 diskgroups (20 instances), the other one with 30 diskgroups (10 instances)
- in case two nodes failed, the only node survived should not be able to mount additional diskgroups
(because of limit of max 63 diskgroup mounted by an ASM instance), so all other would remain unmounted
and their db instances stopped (they are not Production instances);
But it didn't worked, since ASM has parameter CLUSTER_DATABASE=true, so you cannot mount 90 diskgroups,
you can mount 62 globally (once a diskgroup is mounted on one node, it is given a number between 2 and 63,
and other diskgroups mounted on other nodes cannot reuse that number).
So as a matter of fact we can mount only 21 diskgroups (about 7 instances) on each node.
The second conseguence is that, every time our CRS handmade scripts dismount diskgroups
from one node and mount it to another, there are delays in the range of seconds (especially with multipath).
Also we found inside CRS log that, whenever we mounted diskgroups (on one node only), then
behind the scenes were created on the fly additional fake resources
of type ora*.dg, maybe to accomodate the fact that on other nodes those diskgroups were left unmounted
(once again, instances are single-node here, and not RAC type).
That's all.
Did anyone go into similar problems?
We opened a SR to Oracle asking about what options do we have here, and we are disappointed by their answer.
Regards
Oscar

Hi Klaas-Jan
- best practises require that also online redolog files are in a separate diskgroup, in case of ASM logical corruption (we are a little bit paranoid): in case DATA dg gets corrupted, you can restore Full backup plus Archived RedoLog plus Online Redolog (otherwise you will stop at the latest Archived).
So we have 3 diskgroups for each db instance: DATA, REDO, FRA.
- in case of fail-over cluster (active-passive), Oracle provide some templates of CRS scripts (in $CRS_HOME/crs/crs/public) that you edit and change at your will, also you might create additionale scripts in case of additional resources you might need (Oracle Agents, backups agent, file systems, monitoring tools, etc)
About our problem, the only solution is to move OCR and voting disks from ASM and change pfile af all ASM instance (parameter CLUSTER_DATABASE from true to false ).
Oracle aswers were a litlle bit odd:
- first they told us to use Grid Standalone (without CRS, OCR, voting at all), but we told them that we needed a Fail-over solution
- then they told us to use RAC Single Node, which actually has some better features, in csae of planned fail-over it might be able to migreate
client sessions without causing a reconnect (for SELECTs only, not in case of a running transaction), but we already have a few fail-over cluster, we cannot change them all
So we plan to move OCR and voting disks into block devices (we think that the other solution, which needs a Shared File System, will take longer).
Thanks Marko for pointing us to OCFS2 pros / cons.
We asked Oracle a confirmation that it supported, they said yes but it is discouraged (and also, doesn't work with OUI nor ASMCA).
Anyway that's the simplest approach, this is a non-Prod cluster, we'll start here and if everthing is fine, after a while we'll do it also on Prod ones.
- Note 605828.1, paragraph 5, Configuring non-raw multipath devices for Oracle Clusterware 11g (11.1.0, 11.2.0) on RHEL5/OL5
- Note 428681.1: OCR / Vote disk Maintenance Operations: (ADD/REMOVE/REPLACE/MOVE)
-"Grid Infrastructure Install on Linux", paragraph 3.1.6, Table 3-2
Oscar

OCR and voting disk locations

How to check the location of the OCR and voting disk?
How to know if they are on OCFS2? On Raw?

The OCRCHECK utility displays the version of the OCR's block format, total space available and used space, OCRID, and the OCR locations that you have configured. OCRCHECK performs a block-by-block checksum operation for all of the blocks in all of the OCRs that you have configured. It also returns an individual status for each file as well as a result for the overall OCR integrity check. The following is a sample of the OCRCHECK output:
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 262144
Used space (kbytes) : 16256
Available space (kbytes) : 245888
ID : 1918913332
Device/File Name : /dev/raw/raw1
Device/File integrity check succeeded
Device/File Name : /oradata/mirror.ocr
Device/File integrity check succeeded
Cluster registry integrity check succeeded

Ocr and voting disk recreate

Hi,
I'm recreating ocr and voting disk as for a lab test on RHEL4(10gr2),for server side ons configuration for racgons ,what should be my port? below is the output from ons.config file .Should it be 6200 or 6101 for both nodes?Please let me know .
cat ons.config
localport=6101
remoteport=6200
loglevel=3
useocr=on
CRS_home/bin/racgons add_config hostname1:port hostname2:port
Thanks

Hi
You may run this command with user root
root@yourracnode1# $CRS_HOME/bin/racgons add_config yourracnode1:6200 yourracnode2:6200
After run,this command helps you to ping your ons
root@yourracnode1# $ORA_CRS_HOME/bin/onsctl ping
I hope this helps you
BR,
Hasan

AIX 6.1 - Do we need HACMP to store the OCR and Voting Disks on Raw Logical

We are planning to install 11G r1 rac on AIX 6.1. We will use clusterware and ASM. We would like to avoid GPFS and HACMP.
We plan to put the Clusterware OCR and Voting Disks on Raw Logical Volumes.
I do not believe we need HACMP. see the passage below from doc:
Oracle® Clusterware
Installation Guide
11g Release 1 (11.1) for AIX Based Systems
B28258-05
Configuring Raw Disk Devices for Oracle Clusterware Without HACMP or GPFS
If you are installing Oracle RAC on an AIX cluster without HACMP or GPFS, then you
must use shared raw disk devices for the Oracle Clusterware files. You can also use
shared raw disk devices for database file storage. However, Oracle recommends that
you use Automatic Storage Management to store database files in this situation.
This section describes how to configure the shared raw disk devices for Oracle
Clusterware files (Oracle Cluster Registry and Oracle Clusterware voting disk). It also
describes how to configure shared raw devices for Oracle ASM and for Database files,
if you intend to install Oracle Database, and you need to create new disk devices.
Question:
Do we need HACMP to store the OCR and Voting Disks on Raw Logical Volumes? According to the passage above we do not.

You can archive log either in shared location or separate location associated with each instance. Oracle recommends using a shared location for all the instances in a RAC configuration. Check the topic "Location of Archived Logs for the Cluster File System Archiving Scheme" in Clusters Administration and Deployment Guide

Recover OCR and VOTE disk after complete corruption of ASM disk groups.

Hi Gurus,
I am simulating a recovery situation to perform recover of OCR and Vote files after complete corruption of ASM related disks and diskgroups. I have setup my environment as follows:\
Environment: RAC
OS: OEL 5.5 32-bit
GI Version: 11.2.0.2.0
ASM Disk groups: +OCR, +DATA
OCR, Vote Files location: +OCR
ASM Redundancy: External
ASM Disks: /dev/asm-disk1, /dev/asm-disk2
/dev/asm-disk1 - mapped on +OCR
/dev/asm-disk2 - mapped on +DATA
With the above configuration in place I have manually corrupted +OCR, +DATA diskgroups with dd command. I used this command to completely corrupt +OCR disk group.
dd if=/dev/zero of=/dev/asm-disk1. I have manual backups as well as automatic backups of OCR and Vote disk. I am not using ASMLib.
I followed this link:
http://docs.oracle.com/cd/E11882_01/rac.112/e17264/adminoc.htm#TDPRC237
When I tried to recover OCR file, I could not do so as there is no such diskgroup which ASM can restore the OCR, Voting disk to. I could not Re-create OCR and DATA diskgroups as I cannot connect to ASM instance. If you have a solution or workaround for my situation please describe it. That will be greatly appreciated.
Thanks and Regards,
Suresh.

Please go through the following document which have the detailed steps to restore the OCR
How to restore ASM based OCR after complete loss of the CRS diskgroup on Linux/Unix systems [ID 1062983.1]

OCR and Votinging Disk File Permissions for NFS 2 node RAC cluster

Similar Messages

Maybe you are looking for