10 G clusterware voting,ocr disk on ocfs2 vol ?

I'm trying to use 2 ocfs2 vols as the voting,ocr disk's during a 10.2.01 clusterware install(RHEL 4) .
the status from o2cb on both systems says everything is fine but the ora installer says
The location /dev/sdb1 entered for teh Oracle Cluster Registry (OCR) is not shared across all the nodes in the cluster .
?

You should format /dev/sdb1 with ocfs and then mount it. You only have to format it from one node, but you have to mount it on all nodes. After you have mounted it on all nodes then supply the mount point for the voting and ocr files location.

Similar Messages

Voting disk and OCR disk in RAC

Can anyone explain me in basic terms ...
For what Voting and OCR disk are used in RAC.

Hi Francisco,
Thanks for the information.
But i am having lot of doubts in Voting disk and types of heart-beats present in Oracle 10g RAC.
As Oracle says css uses two heart beats 1. Network heart-beat 2. Disk heart-beat
My doubts:
1. How Oracle uses voting disk to avoid split-brain syndrome? OR what is the role of voting disk in split-brain syndrome?
2. How Oracle monitors remote node health?
3. Oracle says there is one more heart-beat where ckpt process keep on writing to control file for every 3 seconds and if it fails lmon process will evict the node....Is it true?
5. Oracle Clusterware will send messages (via a special ping operation) to all nodes configured in the cluster, often called the "heartbeat." If the heartbeat fails for any of the nodes, it checks with the Oracle Clusterware configuration files (Voting disk) to distinguish between a real node failure and a network failure......Is it true? If true then what about the two heart beats(Network and Disk)...why these heart-beats are present or useful?
If possible please clear my doubts by giving some simple examples....
Awaiting for your reply and too much eager to learn and expertise in Oracle RAC architecture before administering it.
Regards,
Yasser.

Ocr/voting RAW Disk sequence number change

Dear Gurus,
We are planning to upgrade IBM AIX 5.3 OS technology level upgrade ... and also we are changing the device driver from rdac to sddpcm .
If we do this activity these are the possible changes may occur.......
According to IBM there could be a possibility of RHDISK number , MAJOR and MINOR number changes LIKE /dev/rhdisk0 to /dev/rhdisk1 in this case
Whether this RHDISK number , MAJOR and MINOR number changes will cause any issues on Oracle RAC database particularly on OCR and VOTING disks........
for example currently our OCR LOCATION IS IN : Device/File Name : /dev/rhdisk23 this may change to /dev/rhdisk<25>
Please help mee...
Regards,
Vamsi...

Dear Gurus,
From OCR and VOTING point of view :
currently we have OCR LOCATION :
/dev/rhdisk23------------->Might change to /dev/rhdisk29
currently we have VOTING LOCATION :
/dev/rhdisk24-------------->Might change to /dev/rhdisk30
In this case how oracle will trace new OCR/VOTING raw disk path........How we have to make oracle to understand OCR/VOTING LOCATION is in “/dev/rhdisk29 , /dev/rhdisk30”.....when cluster starts it will go and look in /dev/rhdisk23 for OCR and /dev/rhdisk24 for VOTING .Since it was not there it will fail .
Without OCR/VOTING disk CLUSTER will not start .....
OCR/VOTING disks are safe in "/dev/rhdisk29 , /dev/rhdisk30".......
Even if we take backup of OCR/VOTING disk .....no need to import it in "/dev/rhdisk29 , /dev/rhdisk30".......because OCR/VOTING content was safe...only disk number changes........
In this Scenario
What are the exact commands and steps we need to follow.........Please help me ...
Regards,
Vamsi....

OCR Disk - change from external to normal redundancy

Hey, I am using grid 11.2.0.3
I have one +OCR Disk in ASM configured. unfortunately with external redundancy.
I have two storages - each storage is representing 2 disks á 500 MB
But I think that my cluster will break down, in a case of a storage failure. Is that right ?
Can I switch to normal redundancy ? If not, how to modify the configuration.
I could create two new disks, and could create a new diskgroup for OCR. But how to switch ?
Is it the ocrconfig replace command ? Or with a backup ?
ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3032
Available space (kbytes) : 259088
ID : 419542868
Device/File Name : +OCR
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
ocrconfig -showbackup
2011/11/04 05:48:57 /crs/cdata/bfkoe/backup00.ocr
2011/11/04 01:48:57 /crs/cdata/bfkoe/backup01.ocr
2011/11/03 21:48:57 /crs/cdata/bfkoe/backup02.ocr
2011/11/03 17:48:56 /crs/cdata/bfkoe/day.ocr
2011/11/03 17:48:56 /crs/cdata/bfkoe/week.ocr
PROT-25: Manual backups for the Oracle Cluster Registry are not available

Christian wrote:
Hi, would this the way to replace my diskgroup
srvctl stop database -d <database>
ocrconfig -manualbackup
ocrconfig -showbackup manual
crsctl stop crs [-f] on all nodes
ocrconfig -delete +OCR
#Remove ASM Diskgroup
oracleasm deletedisk OCR1
oracleasm deletedisk OCR2
oracleasm deletedisk OCR3
oracleasm deletedisk OCR4
#Remove ASM Header
dd if=/dev/zero of=/dev/mapper/vot1_agg01_part1 bs=1024k count=200
dd if=/dev/zero of=/dev/mapper/vot3_agg01_part1 bs=1024k count=200
dd if=/dev/zero of=/dev/mapper/vot2_agg02_part1 bs=1024k count=200
dd if=/dev/zero of=/dev/mapper/vot4_agg02_part1 bs=1024k count=200
#Re-Create ASM Diskgroup
oracleasm createdisk OCR1 /dev/mapper/vot1_agg01_part1
oracleasm createdisk OCR2 /dev/mapper/vot3_agg01_part1
oracleasm createdisk OCR3 /dev/mapper/vot2_agg02_part1
oracleasm createdisk OCR4 /dev/mapper/vot4_agg02_part1
Recreate +OCR Diskgroup via asmca with normal redundancy and mount diskgroup on all nodes
ON node 1:
crsctl start crs -excl -nocrs
ocrconfig -add +OCR
ocrconfig -restore <file_name>
ocrcheck
On node1:
crsctl stop crs -f
On node2:
ocrconfig -repair -replace
On node1+node2
crsctl start crs
cluvfy comp ocr -n all -verbose
Does this look right ?
Christian
Looks complicated, I would suggest have a read http://download.oracle.com/docs/cd/E11882_01/rac.112/e16794/votocr.htm#CWADD91099
Cheers

OCR installation using ocfs2 for voting

I'm trying to install OCR however it fails with the following error:
The Location /u02/oracle/ocfs/ocr1, entered for the Oracle Cluster Registor (OCR) is not shared across all the nodes in the cluster. Specify a shared RAW partition or cluster file system file that is visible by the same name on all nodes of the cluster.
(1) I have created a ocfs2 filesystem under /ocfs
(2) I have created a subdirectory named "/ocfs/clusterware"
(3) I have changed the permissions chown -R oracle:dba /ocfs
(4) I checked ssh - it is working without passwords between both nodes.
When I create a file inside /ocfs on one node i can see and read and remove the file on the other node - so the clustered filesystem is working
However when installing OCR and specifiying a path (in the installer) of /ocfs/clusterware/ocr it claims that the storage specified is not shared accross all nodes?!?
Did anyone come across this problem - is is a problem using ocfs2 with ocr?
Thanks,
Walter

I was facing similar problem and the following helped me.
1. Ensure that you are logged on as 'oracle' in both nodes. Do not logon as root and then 'su' to 'oracle'
2. Run 'xhost +' on both nodes as oracle user before starting your installation.
I was stuck at the same point as you guys were and the above two actions helped me to proceed further. These tips were taken from Oracle 10g RAC install- OPEN FAIL ON DEV
Cheers !!!
Ashish

How To Identify the OCR-disk,Voting Disk

Hi Champ,
There is one confusion for the OCR and Voting Disk.
In case my RAC is up and Running and There are 3 RAW partitions for the OCR as well.
and I dont know which partition is for which purpose?? how to Identify the partions which are for the OCR,Voting disk?
Regards,
Shitesh Shukla

hi,
try to use this:
crsctl query css votedisk
and
OCRCHECK
OCRCONFIG

Voting and OCR disk mirroring

Hi all,
I my trying to create mirror of OCR and Voting disk in Oracle RAC 10gR2 on windows 2003.How to recoganize the location/path of raw file system to place my OCR/Voting disk.
Thanks and Regard's
Awanish Kumar

Hi Awanish,
You can use diskpart utility to build new raw partitions.
To show location from your OCR search a key on Windows registry
[HKEY_LOCAL_MACHINE\SOFTWARE\ORACLE\Ocr]
To show location from Voting Disks use
%CRS_HOME%\bin\crsctl query css votedisk
To mirror these important files use ocrconfig and crsctl utilities.
Regards,
Rodrigo Mufalani
http://mufalani.blogspot.com

OCR disk creation

Dear Guru's
I'm very beginner for Oracle Grid installation. I don't know how to create disk need for Grid installation. Please help me and guide me sir...
I'm installing Oracle 11.2.0.1.0 on windows 2003 server without vmware.. Please sir...
Thank you for your kind help and guidance...

Hi,
To install Oracle Rac, need to have shared disks/partition (SAN , NAS ) for (1) Voting disk and OCR. size few HundredS MB (2) for database files or ASM (size depend on u r db size and redundancy. again u can use external redundancy i.e.hardware level mirroring).
as per my understanding ,
Now for windows oracle has given OCFS (Oracle Cluster file system). format the shared partition using ocfs and give that location OCR , voting disk while Oracle Clusterware installtion.
for ASM use shared raw disks of same size.
please correct if i am wrong.
Edited by: Rajesh.Rathod on Sep 18, 2012 1:08 AM

Cannot create repository OVM 3.3.1, have shared physical disk with OCFS2

I installed OVM 3.3.1 servers on hp blades, give 20GB LUN from FC array to each.
Give one 600GB LUN from FC to both.
Using OVM 3.3 Manager created serverpool of the two VM Servers
In the Storage tab under SAN servers-Unmanaged FC Storage Arrays-FibreChannel Volume group I can see
- both 20GB disk on OVM servers
- the 600GB disk (shown for 1 server only, but display Servers Using this disk shows both)
I check ovs-agent is runnig on both OVM servers (I restarted it on both to be sure)
There is an OCFS2 filesystem on the 600GB disk created.
When I open the Repositories Tab in OVM Manager I am not able to create repository.
Thank for any help.
Jiri Rohlicek
============================================================================
OVM server 1 - ovma1
[root@ovma1 ~]# mount
/dev/mapper/360002ac0000000000000006500005340p2 on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/mapper/360002ac0000000000000006500005340p1 on /boot type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
xenfs on /proc/xen type xenfs (rw)
none on /var/lib/xenstored type tmpfs (rw)
nodev on /sys/kernel/debug type debugfs (rw)
configfs on /sys/kernel/config type configfs (rw)
ocfs2_dlmfs on /dlm type ocfs2_dlmfs (rw)
/dev/mapper/360002ac0000000000000006600005340 on /poolfsmnt/0004fb00000500004d14aab4675db242 type ocfs2 (rw,_netdev,heartbeat=global)
[root@ovma1 ~]# service ovs-agent status
log server (pid 3402) is running...
notificationserver server (pid 3418) is running...
remaster server (pid 3425) is running...
monitor server (pid 3427) is running...
ha server (pid 3429) is running...
stats server (pid 3430) is running...
xmlrpc server (pid 3432) is running...
OVM server 2 - ovma2
[root@ovma2 ~]# mount
/dev/mapper/360002ac0000000000000006400005340p2 on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/mapper/360002ac0000000000000006400005340p1 on /boot type ext4 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
xenfs on /proc/xen type xenfs (rw)
none on /var/lib/xenstored type tmpfs (rw)
nodev on /sys/kernel/debug type debugfs (rw)
configfs on /sys/kernel/config type configfs (rw)
ocfs2_dlmfs on /dlm type ocfs2_dlmfs (rw)
/dev/mapper/360002ac0000000000000006600005340 on /poolfsmnt/0004fb00000500004d14aab4675db242 type ocfs2 (rw,_netdev,heartbeat=global)
[root@ovma2 ~]# service ovs-agent status
log server (pid 3308) is running...
notificationserver server (pid 3323) is running...
remaster server (pid 3330) is running...
monitor server (pid 3332) is running...
ha server (pid 3334) is running...
stats server (pid 3336) is running...
xmlrpc server (pid 3337) is running...

Hi,
OVMM will refuse to create a storage repository on any disk that already contains an OCFS2 file system. Either you got something mixed up or you got an old OCFS2 LUN. Either way, since creating a SR requires to wipe the LUN, rsp. formatting it with OCFS2, there musn't be an OCFS2 volume on it.
Cheers,
budy

How to Install Multipath Raw Device for Voting/OCR IN RHEL5 U1

Dear all,
Setup
Two Node RAC Cluster with IBM disk Array DS4700
OS- RHEL 5 Update1 (2.6.18-53.el5)
Oracle- 10.2.0.1
Failover Driver- RDAC Driver (Linux MPP Driver Version: 09.02.C5.16)
I am trying to follow Metalink Note-564580.1
But when i am configuring Multipathing and Verify Multipath Devices.
I am not getting any output when i am issuing the following command
#multipath -ll
I checked the service mulipath
[root@db1 dev]# service multipathd status
multipathd (pid 3845) is running...
[root@db1 dev]#
Please let me know, if you have solution.
Rgds
Sumit
Bangalore,India

[root@wmcdb2 ~]# service multipathd restart
Stopping multipathd daemon: [ OK ]
Starting multipathd daemon: [ OK ]
[root@wmcdb2 ~]#
==========================================================
==========================================================
[root@wmcdb2 ~]# fdisk -l
Disk /dev/sda: 146.5 GB, 146578341888 bytes
255 heads, 63 sectors/track, 17820 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 131 1052226 83 Linux
/dev/sda2 132 7143 56323890 83 Linux
/dev/sda3 7144 8187 8385930 82 Linux swap / Solaris
/dev/sda4 8188 17820 77377072+ 5 Extended
/dev/sda5 8188 17820 77377041 83 Linux
Disk /dev/sdb: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 1009 2095662 83 Linux
Disk /dev/sdc: 1073 MB, 1073741824 bytes
34 heads, 61 sectors/track, 1011 cylinders
Units = cylinders of 2074 * 512 = 1061888 bytes
Device Boot Start End Blocks Id System
/dev/sdc1 1 1011 1048376+ 83 Linux
Disk /dev/sdd: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdd doesn't contain a valid partition table
Disk /dev/sde: 108.0 GB, 108005425152 bytes
255 heads, 63 sectors/track, 13130 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sde doesn't contain a valid partition table
Disk /dev/sdf: 48.3 GB, 48318382080 bytes
64 heads, 32 sectors/track, 46080 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdf doesn't contain a valid partition table
Disk /dev/sdg: 24.5 GB, 24551358464 bytes
64 heads, 32 sectors/track, 23414 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdg doesn't contain a valid partition table
===============================================
===============================================
[root@wmcdb2 ~]# multipath -ll
mpath2 (3600a0b80002ab33400000893489f7c76) dm-2 IBM,VirtualDisk
[size=100G][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 5:0:0:3 sdd 8:48 [active][ready]
mpath1 (3600a0b8000501e1600000897489f7f52) dm-1 IBM,VirtualDisk
[size=1.0G][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 5:0:0:2 sdc 8:32 [active][ready]
mpath0 (3600a0b80002ab33400000890489f7c34) dm-0 IBM,VirtualDisk
[size=2.0G][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 5:0:0:1 sdb 8:16 [active][ready]
mpath5 (3600a0b8000501e160000089b489f7fd2) dm-5 IBM,VirtualDisk
[size=23G][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 5:0:0:6 sdg 8:96 [active][ready]
mpath4 (3600a0b80002ab33400000895489f7cb9) dm-4 IBM,VirtualDisk
[size=45G][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 5:0:0:5 sdf 8:80 [active][ready]
mpath3 (3600a0b8000501e1600000899489f7f7f) dm-3 IBM,VirtualDisk
[size=101G][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 5:0:0:4 sde 8:64 [active][ready]
[root@wmcdb2 ~]#
=====================================================
=====================================================
[root@wmcdb2 ~]# cat /proc/partitions
major minor #blocks name
8 0 143142912 sda
8 1 1052226 sda1
8 2 56323890 sda2
8 3 8385930 sda3
8 4 1 sda4
8 5 77377041 sda5
8 16 2097152 sdb
8 17 2095662 sdb1
8 32 1048576 sdc
8 33 1048376 sdc1
8 48 104857600 sdd
8 64 105474048 sde
8 80 47185920 sdf
8 96 23975936 sdg
=============================================
============================================
[root@wmcdb2 ~]# cat /etc/multipath.conf
defaults {
user_friendly_names yes
defaults {
udev_dir /dev
polling_interval 10
selector "round-robin 0"
path_grouping_policy failover
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
prio_callout /bin/true
path_checker readsector0
rr_min_io 100
rr_weight priorities
failback immediate
# no_path_retry fail
user_friendly_name yes
devnode_blacklist {
&n sp; devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
d vnode "^hd[a-z]"
devnode "^sda"
nbsp; devnode "^cciss!c[0-9]d[0-9]*"
multipaths {
nbsp; multipath {
& bsp; wwid 3600a0b80002ab33400000890489f7c34
alias ocr1
multipath {
wwid 3600a0b8000501e1600000897489f7f52
alias voting1
[root@wmcdb2 ~]#
===================================================

How to replace oracle OCR disks commands are notworking in cun solaris

Hi
in our datacentre we are configuring new storage
in ORACLE 10g rac system with sun solaris system
if i type the commands at root
# ./ocrconfig - replace ocr /dev/did/rdsk/d10s6
it is giving the optinns list
if i type
#./crsctl add css votedisk /dev/did/rdsk/d23s6
giving error:Unknown parameter: add
ho to solve this problem

Hello,
By default, the Oracle Inventory directory is not installed under the Oracle Base directory.
This is because all Oracle software installations share a common Oracle Inventory,
...The Oracle Inventory should be shared by all Oracle installations on the Server. So its location is unique.
However, you may have several Oracle Base directories.
Oracle Base is the root directory of the Oracle installation and may change from one major release to another one. However, the same Oracle Base may be used for several installations:
http://download.oracle.com/docs/cd/E11882_01/install.112/e17163/glossary.htm#g998168
Also, by default OUI suggest you the Oracle Base directory. In general you have something like "/u01/app/oracle". But you are free to set the Oracle Base directory you prefer.
Hope this help.
Best regards,
Jean-Valentin

Can not mount disk on OCFS2 file

I try to install 2 nodes RAC in Linux 2.6.9.-22.EL by using Jeffery Hunter’s paper. I am getting problem to mount the ocfs2 file system. The following is mount command error output:
[root@b30-rh1 ~]# mount -t ocfs2 /dev/sda2 /u02
mount.ocfs2: No such file or directory while mounting /dev/sda2 on /u02. Check 'dmesg' for more information on this error.
I can not get any error msg from dmesg or syslog.
Please help and thanks in advance.
[root@b30-rh1 init.d]# uname -a
Linux b30-rh1.ameripride.org 2.6.9-22.EL #1 Sat Oct 8 17:48:27 CDT 2005 i686 i686 i386 GNU/Linux
[root@b30-rh2 Desktop]# rpm -Uvh ocfs2-2.6.9-22.EL-1.2.4-2.i686.rpm \
ocfs2console-1.2.3-1.i386.rpm \
ocfs2-tools-1.2.3-1.i386.rpm \
ocfs2-tools-debuginfo-1.2.3-1.i386.rpm[root@b30-rh1 init.d]# mkfs.ocfs2 -b 4k -C 32K -L "oracle_home" -N 4 /dev/sda1
mkfs.ocfs2 1.2.3
Overwriting existing ocfs2 partition.
Proceed (y/N): y
Filesystem label=oracle_home
Block size=4096 (bits=12)
Cluster size=32768 (bits=15)
Volume size=10248650752 (312764 clusters) (2502112 blocks)
10 cluster groups (tail covers 22460 clusters, rest cover 32256 clusters)
Journal size=67108864
Initial number of node slots: 4
Creating bitmaps: done
Initializing superblock: done
Writing system files: done
Writing superblock: done
Writing backup superblock: 2 block(s)
Formatting Journals: done
Writing lost+found: done
mkfs.ocfs2 successful
[root@b30-rh1 init.d]# mounted.ocfs2 -d
Device FS UUID Label
/dev/sda1 ocfs2 29b7d72e-6636-4c08-b074-457088efc329 oracle_home
/dev/sda2 ocfs2 6ba41200-7ebd-45ef-ad9f-dac33999ce64 oradatafiles
[root@b30-rh1 init.d]# mount -t ocfs2 -o datavolume,nointr /dev/sda1 /u01
mount.ocfs2: No such file or directory while mounting /dev/sda1 on /u01. Check 'dmesg' for more information on this error.
[root@b30-rh1 init.d]# dmesg
Linux version 2.6.9-22.EL ([email protected]) (gcc version 3.4.4 200
50721 (Red Hat 3.4.4-2)) #1 Sat Oct 8 17:48:27 CDT 2005
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
<snap ..>
OCFS2 DLM 1.2.4 Thu Feb 1 15:42:23 PST 2007 (build 02079ab041256f2bdb27c5ee8984ff64)
OCFS2 DLMFS 1.2.4 Thu Feb 1 15:42:23 PST 2007 (build 02079ab041256f2bdb27c5ee8984ff64)
OCFS2 User DLM kernel interface loaded
ocfs2_dlm: Nodes in domain ("78899A7D35324B8F99E71F259F5E1876"): 0
ocfs2_dlm: Nodes in domain ("A37DF093FE3A48DF818061DF3BCE3F4F"): 0
[root@b30-rh1 init.d]# /etc/init.d/o2cb status
Module "configfs": Loaded
Filesystem "configfs": Mounted
Module "ocfs2_nodemanager": Loaded
Module "ocfs2_dlm": Loaded
Module "ocfs2_dlmfs": Loaded
Filesystem "ocfs2_dlmfs": Mounted
Checking O2CB cluster ocfs2: Online
Checking O2CB heartbeat: Not active

Dears,
I face the same problem an solved with me as deatiled below(may help you)
/u02 directory is already created.
Problem solved with me once i removed / as below
[root@b30-rh1 ~]# mount -t ocfs2 /dev/sda2 u02
It successed
Regards,,

Split Brain Thinking

We are designing a RAC environment for our ERP system and have run into an interesting problem. First, I'll give you the design, then ask the question that we are puzzled over.
We have two campuses. There will be 4 nodes in the cluster, 2 per campus. We have two NetApp FAS 3070's, one per campus. Each NetApp will export voting/ocr disk, an ASM disk, and redo/archivelog locations.
Each node will use ASM's normal redundancy for fault tolerance. The nodes will see a single disk for ASM from campus A, and a single storage disk for ASM from campus B. ASM will mirror the data between the two campuses.
Each node will use normal redundancy for the voting disk and OCR.
The thought here is that we could lose an entire datacenter--2 nodes, a FAS3070, server switch--everything--and still be up on the other campus. However, here's the question: What happens when the inter-campus network links fail? In this situation, nodes 1 and 2 on campus A can still see all storage, voting disk, and ocr on its campus from its 3070, but they cannot see nodes 3 and 4, or the storage on the other campus. Nodes 3 and 4 can still see all of its storage, voting disk, and ocr on campus B, but they cannot see nodes 1 and 2 or the storage on campus A. Basically, each set of nodes (1 and 2 on campus A, and 3 and 4 on campus B) can operate independently from the other campus' nodes. Does anyone know how clusterware would handle such a situation?
Thanks for any input!

Here is what will be the final production configuration:
Definitions:
Campus A (NetApp A), and Campus B (NetApp B) will be the two sites.
We have 4 filers, two on each campus. There exists mirrored and unmirrored storage (so that we can do failovers in the case of a campus/site outage). We will be using unmirrored storage as to not duplicate data 4 times. The disks will be configured on one NetApp from each campus to use the RAID-DP feature provided by the filer, but the other campus will not do NetApp/Filer level mirroring. All mirroring will be done by Oracle's ASM. Basically, when I say "mirrored" or "unmirrored", I'm referring to filer-level mirroring, not ASM-level or Oracle "normal redundancy" mirroring. Here's how the exports look:
NA-A will export one 500GB volume for datafile storage, unmirrored.
NA-A will export one 500GB volume for archivelog storage, unmirrored.
NA-A will export one 50GB volume for redo log storage, unmirrored.
NA-A will export one 1GB volume for OCR and voting disk storage, unmirrored
NA-A will export one 1GB volume for voting disk storage, MIRRORED. This is so that if an entire site fails, and that site contains the majority of the voting disks, we can failover the mirrored voting disk volume to the other campus and bring that side up. This allows for the smallest amount of downtime.
NA-B will export one 500GB volume for datafile storage, unmirrored.
NA-B will export one 500GB volume for archivelog storage, unmirrored.
NA-B will export one 50GB volume for redo log storage, unmirrored.
NA-B will export 1GB volume for OCR and voting disk storage, unmirrored.
$ORACLE_HOME will be local to the node. We want to be able to do rolling upgrades.
Each node will have a public, private, and storage interface, all on different VLANs.
ASM will mirror the two 500GB volumes, one from each side. Oracle will use internal mechanisms to mirror the OCR disks and Voting Disks. At this point, we will remain completely online should the campus with the single voting disk fail, and be offline for a very short amount of time if the campus with two voting disks fail. Downtime length will be the time it takes for a SysAdmin to login to the filer and take over the other filer's disks. This happens very quickly, typically less than a minute.
Any other questions, feel free to ask.

Ora db vip

Hi,
Plz go through it.....
C:\>crs_stat -t
Name Type Target State Host
ora....B1.inst application ONLINE OFFLINE
ora....B2.inst application ONLINE ONLINE dhndb2
ora....DB1.srv application ONLINE OFFLINE
ora....DB2.srv application ONLINE ONLINE dhndb2
ora...._SVC.cs application ONLINE ONLINE dhndb2
ora.DHNDB.db application ONLINE ONLINE dhndb2
ora....SM1.asm application ONLINE OFFLINE
ora....B1.lsnr application ONLINE OFFLINE
ora.dhndb1.gsd application ONLINE ONLINE dhndb1
ora.dhndb1.ons application ONLINE ONLINE dhndb1
ora.dhndb1.vip application ONLINE UNKNOWN dhndb2
ora....SM2.asm application ONLINE ONLINE dhndb2
ora....B2.lsnr application ONLINE ONLINE dhndb2
ora.dhndb2.gsd application ONLINE ONLINE dhndb2
ora.dhndb2.ons application ONLINE ONLINE dhndb2
ora.dhndb2.vip application ONLINE ONLINE dhndb2
C:\>crs_start -all
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.dhndb1.vip'
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.dhndb1.vip'
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.dhndb1.vip'
Attempting to start `ora.DHNDB.DHNDB_SVC.DHNDB1.srv` on member `dhndb1`
Start of `ora.DHNDB.DHNDB_SVC.DHNDB1.srv` on member `dhndb1` failed.
dhndb2 : CRS-1019: Resource ora.DHNDB.DHNDB_SVC.DHNDB1.srv (application) cannot
run on dhndb2
CRS-0223: Resource 'ora.DHNDB.DHNDB1.inst' has placement error.
CRS-0215: Could not start resource 'ora.DHNDB.DHNDB_SVC.DHNDB1.srv'.
CRS-0223: Resource 'ora.dhndb1.ASM1.asm' has placement error.
CRS-0223: Resource 'ora.dhndb1.LISTENER_DHNDB1.lsnr' has placement error.
C:\>sqlplus /nolog
SQL*Plus: Release 10.2.0.1.0 - Production on Sun Sep 13 18:04:47 2009
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL> conn /as sysdba
Connected to an idle instance.
SQL> startup;
ORA-01078: failure in processing system parameters
ORA-01565: error in identifying file '+ORADATA/DHNDB/spfileDHNDB.ora'
ORA-17503: ksfdopn:2 Failed to open file +ORADATA/DHNDB/spfileDHNDB.ora
ORA-15077: could not locate ASM instance serving a required diskgroup
SQL>
Os-win server:2003/orcl-10g.
Edited by: oh#see#a on Sep 13, 2009 11:27 PM

orawarebyte wrote:
Yours diskgroup is not mounted Which is potentially a result of the cluster services (including VIP) not working.. It is usually not a good idea to start components (like ASM) manually via sqlplus. Rather do it via srvctl.
More questions to add to the list of Justin's..
.. what shared storage is used?
.. what Interconnect technology is used?
.. how are the OCR and Voting Disks defined?
In my experience, most CRS startup failures are due to either the Interconnect not working, or the Voting/OCR disks not being available.

Confusion with OCFS2 File system for OCR and Voting disk RHEL 5, Oracle11g,

Dear all,
I am in the process of installing Oracle 11g 3 Node RAC database
The environment on which i have to do this implementation is as follows:
Oracle 11g.
Red Hat Linux 5 x86
Oracle Clusterware
ASM
EMC Storage
250 Gb of Storage drive.
SAN
As of now i am in the process of installing Oracle Clusterware on the 3 nodes.
I have performed these tasks for the cluster installs.
1. Configure Kernel Parameters
2. Configure User Limits
3. Modify the /etc/pam.d/login file
4. Configure Operating System Users and Groups for Oracle Clusterware
5. Configure Oracle Clusterware Owner Environment
6. Install CVUQDISK rpm package
7. Configure the Hosts file
8. Verify the Network Setup
9. Configure the SSH on all Cluster Nodes (User Equivalence)
9. Enable the SSH on all Cluster Nodes (User Equivalence)
10. Install Oracle Cluster File System (OCFS2)
11.Verify the Installation of Oracle Cluster File System (OCFS2)
12. Configure the OCFS2 (/etc/ocfs2/cluster.conf)
13. Configure the O2CB Cluster Stack for OCFS2
BUT, here after i am a little bit confused on how to proceed further. The next step is to Format the disk and mount the OCFS2, Create Software Directories... so and so forth.
I asked my system admin to provide me two partitions so that i could format them with OCFS2 file system.
He wrote back to me saying.
*"Is what you want before I do it??*
*/dev/emcpowera1 is 3GB and formatted OCFS2.*
*/dev/emcpowera2 is 3GB and formatted OCFS2.*
*Are those big enough for you? If not, I can re-size and re-format them*
*before I mount them on the servers.*
*the SAN is shared storage. /dev/emcpowera is one of three LUNs on*
*the shared storage, and it's 214GB. Right now there are only two*
*partitions on it- the ones I listed below. I can repartition the LUN any*
*way you want it.*
*Where do you want these mounted at:*
*/dev/emcpowera1*
*/dev/emcpowera2*
*I was thinking if this mounting techique would work like so:*
*emcpowera1: /u01/shared_config/OCR_config*
*emcpowera2: /u01/shared_config/voting_disk*
*Let me know how you'd like them mounted."*
Please recommend me what i should convey to him so that i can ask him to the exact same thing.
My second question is, as we are using ASM, for which i am gonna configure ASM after clusterware installation, should i install Openfiler??
Pls refer the enviroment information i provided above and make recommendations.
As of now i am using Jeffery Hunters guide to install the entire setup. You think the entire install guide goes well with my enviroment??
http://www.oracle.com/technology/pub/articles/hunter_rac11gr1_iscsi.html?rssid=rss_otn_articles
Kind regards
MK

Thanks for ur reply Mufalani,
You have managed to solve half part of my query. But still i am stuck with what kind of mount point i should ask the system admin to create for OCR and Voting disk. Should i go with the mount point he is mentioning??
Let me put forth few more questions here.
1. Is 280 MB ok for OCR and voting disks respectively??
2. Should i ask the system admin to create 4 voting disk mount points and two for ocr??
3. As mentioned by the system admin.
*/u01/shared_config/OCR_config*
*/u01/shared_config/voting_disk*
Is this ok for creating the ocr and voting disks?
4. Can i use OCFS2 file system for formating the disk instead of using them as RAW device!!?
5. As u mentioned that Openfiler is not needed for Configuring ASM... Could you provide me the links which will guide me to create partition disks, voting disks and ocr disks!! I could not locate them on the doc or else were. I did find a couple of them, but was unable to identify a suitable one for my envoirement.
Regards
MK

10 G clusterware voting,ocr disk on ocfs2 vol ?

Similar Messages

Maybe you are looking for