Regarding Voting disk recovery scenarios

Hi,
For years i have read about RAC and Voting disk and it is said that each node should access more than half of the voting disks but never got a chance to work on the below scnerios which i have mentioned, if some one has practical done the below scenarios or have good knowledge do let me know.
1) If i have 5 voting disks and out of which 2 got corrupted or deleted will the cluster keep working properly? If i boot my system or restart the cluster will it still work fine or not?
2) The above scenario with 3 voting disk deleted or got corrupted what will happen?
3) If i have 2 OCR and i got deleted or corrupted will the system run fine?

Aman,
During startup the clusterware requires the majority of votes to start the CSS Daemon.
The majority is counted on how many was configured, not how many remain alive.
Below test using 3 Votedisk (11.2.0.3)
alert.log
[cssd(26233)]CRS-1705:Found 1 configured voting files but 2 voting files are required, terminating to ensure data integrity; details at (:CSSN                     M00021:) in /u01/app/11.2.0/grid/log/node11g02/cssd/ocssd.log
ocssd.log
2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmvDiskVerify: Successful discovery of 1 disks
2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmCompleteVFDiscovery: Completing voting file discovery
2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmvDiskStateChange: state from discovered to pending disk /dev/asm-ocr-vote01
2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmvDiskStateChange: state from pending to configured disk /dev/asm-ocr-vote01
2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmvVerifyCommittedConfigVFs: Insufficient voting files found, found 1 of 3 configured, needed 2 voting files
With 2 voting files online, no problem, clusterware start with warning on logs.
Ps. If was configured a diskgroup (OCR_VOTE) with high redundancy (5 asmdisk each in your onw failgroup), even diskgroup can hold 3 asmdisk failure. The diskgroup goes down and if there is only one OCR (no mirror) on that Diskgroup the whole clusterware goes down.

Similar Messages

Cluster continues with less than half voting disks

I wanted to try voting disk recovery. I have voting file on a diskgroup with normal redundancy. I corrupted two of the disks containing the voting disk using dd command. I was expecting clusterware to be down as only 1 voting disk ( < half of total(3)) was available but surprisingly clusterware kept running. I even waited for quite some time but to no avail. I did not have any messages in alert log /ocssd log. I would be thankful if experts can give more input on this.
Regards

Hi You can check the metalink notes
OCR / Vote disk Maintenance Operations: (ADD/REMOVE/REPLACE/MOVE) [ID 428681.1]
it says
For 11.2+, it is no longer required to back up the voting disk. The voting disk data is automatically backed up in OCR as part of any configuration change.
The voting disk files are backed up automatically by Oracle Clusterware if the contents of the files have changed in the following ways:
1.Configuration parameters, for example misscount, have been added or modified
2.After performing voting disk add or delete operations The voting disk contents are restored from a backup automatically when a new voting disk is added or replaced.

Recovery scenario - Voting disk does not match with the cluster guid

Hi all,
Think of you can not start your guest VMs just because it has a corrupted system.img root image. And assume it contains 5 physical disk( which are all created by the RAC template) hence ASM on them.
What is the simplest recovery scneario of the guest vms (RAC)?
Can it be a feasible scenario for recover of the availablity? (Assume both of the RAC system images are corrupted and we prefer not a system level recovery rather than backup / restore)
1. Create 2 RAC instances using the same networking and hostname details as the ones that are corrupted. - Use 5 different new disks.
2 Shutdown the newly created instances. Drop the disks from the newly created instances using VM manager.
3. Add the old disks whose system image is failing to be recoverd but ASM disks are still in use (from the newly created instances using VM manager.) to the newly created instances.
4. Open the newly created instances
Can we expect the ASM and CRS could be initialized and be opened without a problem?
When I try this scenario I get the folllowing error from the cssd/crsd .
- Cluster guid 9112ddc0824fefd5ff2b7f9f7be8f048 found in voting disk does not match with the cluster guid a3eec66a2854ff0bffe784260856f92a obtained from the GPnP profile.
- Found 0 configured voting files but 1 voting files are required, terminating to ensure data integrity.
What could be the simplest way of recovery of a virtual machine that has healthy ASM disks but corrupted system image?
Thank you

Hi,
you have a similar problem, when trying to clone databases with 11.2.
The problem is that a cluster is uniquely identified, and this information is hold in the OCR and the Voting disks. So exactly these 2 are not to be cloned.
To achieve what you want, simply setup your system in that way, that you have a separate diskgroup for OCR and Voting (and ASM spfile), which is not to be restored in this case of szeanrio.
Only all database files in ASM will then be exchanged later.
Then what you want can be achieved.
However I am not sure that the RAC templates have the option to install OCR and Voting into a separated diskgroup.
Regards
Sebastian

Voting disk external redundancy

Hey,
question:
I´ve got an database which I haven´t installed myself.
A query for the votedisk shows only one configured votedisk for my 2 node rac cluster.
So I presume, that external redundancy was setup during installation of clusterware.
A few weeks ago I hit an unpublished error, where oracle sends a message that the voting disk are corrupted - which is a false message.
But anyway, what is happening, when I hit this error in my new scenarion (apart of applying the crs bundle patch - which I cant apply...)
How can make sure, that a new voting disk is added with external redundancy as well (crsctl add css votedisk /dev/raw/raw#)
or would this give back an error, because only one voting disk is configurable ?

Hi Christian,
How can make sure, that a new voting disk is added with external redundancy as well (crsctl add css votedisk /dev/raw/raw#) or would this give back an error, because only one voting disk is configurable ?I will assume you are using version 11.1 or earlier.
What determines whether your voting disk is with external redundancy or normal redudancy the amount of voting is that your environment has.
If you have only one voting disk you have external redundancy (The customers guarantees the recovery of the voting disk in case of failure. At least Oracle thinks so).
If you more than 2 (because you need to get an odd number) voting disk you are using normal redundancy. *## Edited by: Levi Pereira on Feb 7, 2011 12:09 PM*
Then you can add more voting disk in your environment without worrying about external redudancy previously configured.
External Redundancy or Normal Redundancy is nominated only by the amount from voting disk you have, there is no configuration to change External Redundancy to Normal Redundancy. As I have said is only the amount from voting that you have configured in your environment.
Make sure you have a fresh backup of your voting disk.
Warning: The voting disk backup is performed manually in the environment UNIX/Linux with the dd command.
Regards,
Levi Pereira
Edited by: Levi Pereira on Feb 7, 2011 12:09 PM

Backup and Restore OCR,Voting Disk and ASM Disks in new SAN-10g RAC

Dear Friends,
I am using 10g R2 RAC serup on Linux
My OCR,Voting Disk and ASM Disk for DBF Files are on a SAN box
Now i am reorganising SAN by scrapping the entire SAN and cretaing new LUN's (It's a must)
so pleae let me know
1) how do i take backup of OCR and Voting Disk from existing SAN and how do i restore it in new LUN's after SAN reorganisation
2) how do i take backup of existing Database's from existing SAN and how do i restore it in new LUN's after SAN reorganisation.
I will be doing it in Planned downtime only
Regards,
DB

For step 1 you should following metalink doc.
For step 2 here is simple backup command script.
I have done this in windows for you.
D:\app\ranjit\product\11.2.0\dbhome_1\BIN>rman target /
Recovery Manager: Release 11.2.0.1.0 - Production on Wed Feb 8 21:48:47 2012
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database: ORCL (DBID=1299593730)
RMAN> run
+{+
allocate channel c1 device type disk format 'D:\app\ranjit\rman\%U';
allocate channel c2 device type disk format 'D:\app\ranjit\rman\%U';
backup database;
backup current controlfile format 'D:\app\ranjit\rman\%U';
+}+
Regards

Where to put OCR and Voting disks?

Hi,
I will be installing Clusterware 11.2.0.2 on a 2 node cluster. I have read several whitepapers where a third asm disk group DATA, FRA, and CRS was created to hold the OCR and Voting disks. In the interest of keeping things simple can I just put the OCR and Voting disks in the DATA DG? I am using external SAN storage.
Thanks
Tom Cullen

Hi,
yes that is absolutely possible.
There are several best practices. Some recommend a separate diskgroup, some recommend to put OCR and Voting in the same diskgroup like your data.
So if there is no special use case it is absolutely valid to only use 2 diskgroups. 1 DATA (including OCR and Vote) and 1 FRA (Fast Recovery Area for Database Backups/Archivelogs/1 Controlfile/1 RedologMember and a second copy of OCR).
Regards
Sebastian

OCR and voting disks on ASM, problems in case of fail-over instances

Hi everybody
in case at your site you :
- have an 11.2 fail-over cluster using Grid Infrastructure (CRS, OCR, voting disks),
where you have yourself created additional CRS resources to handle single-node db instances,
their listener, their disks and so on (which are started only on one node at a time,
can fail from that node and restart to another);
- have put OCR and voting disks into an ASM diskgroup (as strongly suggested by Oracle);
then you might have problems (as we had) because you might:
- reach max number of diskgroups handled by an ASM instance (63 only, above which you get ORA-15068);
- experiment delays (especially in case of multipath), find fake CRS resources, etc.
whenever you dismount disks from one node and mount to another;
So (if both conditions are true) you might be interested in this story,
then please keep reading on for the boring details.
One step backward (I'll try to keep it simple).
Oracle Grid Infrastructure is mainly used by RAC db instances,
which means that any db you create usually has one instance started on each node,
and all instances access read / write the same disks from each node.
So, ASM instance on each node will mount diskgroups in Shared Mode,
because the same diskgroups are mounted also by other ASM instances on the other nodes.
ASM instances have a spfile parameter CLUSTER_DATABASE=true (and this parameter implies
that every diskgroup is mounted in Shared Mode, among other things).
In this context, it is quite obvious that Oracle strongly recommends to put OCR and voting disks
inside ASM: this (usually called CRS_DATA) will become diskgroup number 1
and ASM instances will mount it before CRS starts.
Then, additional diskgroup will be added by users, for DATA, REDO, FRA etc of each RAC db,
and will be mounted later when a RAC db instance starts on the specific node.
In case of fail-over cluster, where instances are not RAC type and there is
only one instance running (on one of the nodes) at any time for each db, it is different.
All diskgroups of db instances don't need to be mounted in Shared Mode,
because they are used by one instance only at a time
(on the contrary, they should be mounted in Exclusive Mode).
Yet, if you follow Oracle advice and put OCR and voting inside ASM, then:
- at installation OUI will start ASM instance on each node with CLUSTER_DATABASE=true;
- the first diskgroup, which contains OCR and votings, will be mounted Shared Mode;
- all other diskgroups, used by each db instance, will be mounted Shared Mode, too,
even if you'll take care that they'll be mounted by one ASM instance at a time.
At our site, for our three-nodes cluster, this fact has two consequences.
One conseguence is that we hit ORA-15068 limit (max 63 diskgroups) earlier than expected:
- none ot the instances on this cluster are Production (only Test, Dev, etc);
- we planned to have usually 10 instances on each node, each of them with 3 diskgroups (DATA, REDO, FRA),
so 30 diskgroups each node, for a total of 90 diskgroups (30 instances) on the cluster;
- in case one node failed, surviving two should get resources of the failing node,
in the worst case: one node with 60 diskgroups (20 instances), the other one with 30 diskgroups (10 instances)
- in case two nodes failed, the only node survived should not be able to mount additional diskgroups
(because of limit of max 63 diskgroup mounted by an ASM instance), so all other would remain unmounted
and their db instances stopped (they are not Production instances);
But it didn't worked, since ASM has parameter CLUSTER_DATABASE=true, so you cannot mount 90 diskgroups,
you can mount 62 globally (once a diskgroup is mounted on one node, it is given a number between 2 and 63,
and other diskgroups mounted on other nodes cannot reuse that number).
So as a matter of fact we can mount only 21 diskgroups (about 7 instances) on each node.
The second conseguence is that, every time our CRS handmade scripts dismount diskgroups
from one node and mount it to another, there are delays in the range of seconds (especially with multipath).
Also we found inside CRS log that, whenever we mounted diskgroups (on one node only), then
behind the scenes were created on the fly additional fake resources
of type ora*.dg, maybe to accomodate the fact that on other nodes those diskgroups were left unmounted
(once again, instances are single-node here, and not RAC type).
That's all.
Did anyone go into similar problems?
We opened a SR to Oracle asking about what options do we have here, and we are disappointed by their answer.
Regards
Oscar

Hi Klaas-Jan
- best practises require that also online redolog files are in a separate diskgroup, in case of ASM logical corruption (we are a little bit paranoid): in case DATA dg gets corrupted, you can restore Full backup plus Archived RedoLog plus Online Redolog (otherwise you will stop at the latest Archived).
So we have 3 diskgroups for each db instance: DATA, REDO, FRA.
- in case of fail-over cluster (active-passive), Oracle provide some templates of CRS scripts (in $CRS_HOME/crs/crs/public) that you edit and change at your will, also you might create additionale scripts in case of additional resources you might need (Oracle Agents, backups agent, file systems, monitoring tools, etc)
About our problem, the only solution is to move OCR and voting disks from ASM and change pfile af all ASM instance (parameter CLUSTER_DATABASE from true to false ).
Oracle aswers were a litlle bit odd:
- first they told us to use Grid Standalone (without CRS, OCR, voting at all), but we told them that we needed a Fail-over solution
- then they told us to use RAC Single Node, which actually has some better features, in csae of planned fail-over it might be able to migreate
client sessions without causing a reconnect (for SELECTs only, not in case of a running transaction), but we already have a few fail-over cluster, we cannot change them all
So we plan to move OCR and voting disks into block devices (we think that the other solution, which needs a Shared File System, will take longer).
Thanks Marko for pointing us to OCFS2 pros / cons.
We asked Oracle a confirmation that it supported, they said yes but it is discouraged (and also, doesn't work with OUI nor ASMCA).
Anyway that's the simplest approach, this is a non-Prod cluster, we'll start here and if everthing is fine, after a while we'll do it also on Prod ones.
- Note 605828.1, paragraph 5, Configuring non-raw multipath devices for Oracle Clusterware 11g (11.1.0, 11.2.0) on RHEL5/OL5
- Note 428681.1: OCR / Vote disk Maintenance Operations: (ADD/REMOVE/REPLACE/MOVE)
-"Grid Infrastructure Install on Linux", paragraph 3.1.6, Table 3-2
Oscar

After Patch 10.2.0.4, got "voting disk corrupted" error.

Dear all,
My setting is:
OS:RHEL4.8 U8 x86
DB:10.2.0.1
CRS:10.2.0.1
After I installed Patchset 10.2.0.4 and execute $CRS_HOME/install/root102.sh, I could't start clusterware anymore. After checking ocssd.log, I found some messages like this:
[    CSSD]2010-01-07 15:53:06.519 [3086919360] >TRACE: clssscmain: local-only set to false
[    CSSD]2010-01-07 15:53:06.562 [3086919360] >TRACE: clssnmReadNodeInfo: added node 1 (x101) to cluster
[    CSSD]2010-01-07 15:53:06.578 [3086919360] >TRACE: clssnmReadNodeInfo: added node 2 (x102) to cluster
[    CSSD]2010-01-07 15:53:06.580 [3086919360] >TRACE: clssnmInitNMInfo: Initialized with unique 1262850786
[    CSSD]2010-01-07 15:53:06.586 [3086919360] >TRACE: clssNMInitialize: Initializing with OCR id (33483723)
[    CSSD]2010-01-07 15:53:06.650 [84294560] >TRACE: clssnm_skgxninit: Compatible vendor clusterware not in use
[    CSSD]2010-01-07 15:53:06.650 [84294560] >TRACE: clssnm_skgxnmon: skgxn init failed
[    CSSD]2010-01-07 15:53:06.657 [3086919360] >TRACE: clssnmNMInitialize: misscount set to (60), impending reconfig threshold set to (56000)
[    CSSD]2010-01-07 15:53:06.659 [3086919360] >TRACE: clssnmNMInitialize: Network heartbeat thresholds are: impending reconfig 30000 ms, reconfig start (misscount) 60000 ms
[    CSSD]2010-01-07 15:53:06.669 [3086919360] >TRACE: clssnmDiskStateChange: state from 1 to 2 disk (0//ocfs/voting)
[    CSSD]2010-01-07 15:53:06.669 [84294560] >TRACE: clssnmvDPT: spawned for disk 0 (/ocfs/voting)
[    CSSD]2010-01-07 15:53:08.755 [84294560] >TRACE: clssnmDiskStateChange: state from 2 to 4 disk (0//ocfs/voting)
[    CSSD]2010-01-07 15:53:08.821 [113339296] >TRACE: clssnmvKillBlockThread: spawned for disk 0 (/ocfs/voting) initial sleep interval (1000)ms
[    CSSD]2010-01-07 15:53:08.889 [3086919360] >TRACE: clssnmFatalInit: fatal mode enabled
[    CSSD]2010-01-07 15:53:08.999 [94784416] >TRACE: clssnmClusterListener: Spawned
[    CSSD]2010-01-07 15:53:09.002 [94784416] >TRACE: clssnmClusterListener: Listening on (ADDRESS=(PROTOCOL=tcp)(HOST=x102-priv)(PORT=49895))
[    CSSD]2010-01-07 15:53:09.002 [94784416] >TRACE: clssnmconnect: connecting to node(1), con(0x81bc480), flags 0x0003
[    CSSD]2010-01-07 15:53:09.069 [3083459488] >TRACE: clssgmclientlsnr: Spawned
[    CSSD]2010-01-07 15:53:09.072 [113339296] >ERROR: clssnmvDiskKillCheck: voting disk corrupted (0x00000000,0x00000000) (0//ocfs/voting)
[    CSSD]2010-01-07 15:53:09.072 [113339296] >TRACE: clssnmDiskStateChange: state from 4 to 3 disk (0//ocfs/voting)
[    CSSD]2010-01-07 15:53:09.072 [130767776] >TRACE: clssnmDiskPMT: disk offline (0//ocfs/voting)
[    CSSD]2010-01-07 15:53:09.072 [130767776] >ERROR: clssnmDiskPMT: Aborting, 1 of 1 voting disks unavailable
[    CSSD]2010-01-07 15:53:09.072 [130767776] >ERROR: ###################################
[    CSSD]2010-01-07 15:53:09.072 [130767776] >ERROR: clssscExit: CSSD aborting
[    CSSD]2010-01-07 15:53:09.072 [130767776] >ERROR: ###################################
[    CSSD]--- DUMP GROCK STATE DB ---
I tried to recreate my voting disk like this:
$CRS_HOME/bin/crsctl add css votedisk /ocfs/voting1 -force
$CRS_HOME/bin/crsctl delete css votedisk /ocfs/voting -force
$CRS_HOME/bin/crsctl add css votedisk /ocfs/voting -force
$CRS_HOME/bin/crsctl delete css votedisk /ocfs/voting1 -force
Then run root102.sh again but still got the same error message about "voting disk corrupted".
I was totally confused and don't know how to fix it.
Please, any suggestion would be appreciated.

Hello,
Did u try restore the OCR?
http://download-west.oracle.com/docs/cd/B19306_01/rac.102/b14197/votocr.htm#i1012456
The steps to apply RAC patch were followed correctly?
See a patchset roadmap at http://mufalani.blogspot.com/2009/06/applying-10204-patch-on-rac-systems.html
Best Regards,
Rodrigo Mufalani
http://www.mrdba.com.br/mufalani

Root.sh hangs at formatting voting disk on OEL32 11gR2 RAC with ocfs2

Hi,
Am trying to bring up Oracle11gR2 RAC on Enterprise Linux x86 (32bit) version 5.6. I am using Ocfs2 1.4 as my cluster file share. Everything went fine till the root.sh and it hangs with a message "now formatting voting disk <vdsk path>
The logs are mentioned below.
Checked the alert log:
{quote}
cssd(9506)]CRS-1601:CSSD Reconfiguration complete. Active nodes are oel32rac1 .
2011-08-04 15:58:55.356
[ctssd(9552)]CRS-2407:The new Cluster Time Synchronization Service reference node is host oel32rac1.
2011-08-04 15:58:55.917
[ctssd(9552)]CRS-2401:The Cluster Time Synchronization Service started on host oel32rac1.
2011-08-04 15:58:56.213
[client(9567)]CRS-1006:The OCR location /u02/storage/ocr is inaccessible. Details in /u01/app/11.2.0/grid/log/oel32rac1/client/ocrconfig_9567.log.
2011-08-04 15:58:56.365
[client(9567)]CRS-1001:The OCR was formatted using version 3.
2011-08-04 15:58:59.977
[crsd(9579)]CRS-1012:The OCR service started on node oel32rac1.
{quote}
crsctl.log:
{quote}
2011-08-04 15:59:00.246: [ CRSCTL][3046184656]crsctl_vformat: obtain cssmode 1
2011-08-04 15:59:00.247: [ CRSCTL][3046184656]crsctl_vformat: obtain VFListSZ 0
2011-08-04 15:59:00.258: [ CRSCTL][3046184656]crsctl_vformat: Fails to obtain backuped Lease from CSSD with error code 16
2011-08-04 15:59:01.857: [ CRSCTL][3046184656]crsctl_vformat: to do clsscfg fmt with lease sz 0
2011-08-04 15:59:01.910: [   SKGFD][3046184656]NOTE: No asm libraries found in the system
2011-08-04 15:59:01.910: [    CLSF][3046184656]Allocated CLSF context
2011-08-04 15:59:01.910: [   SKGFD][3046184656]Discovery with str:/u02/storage/vdsk:
2011-08-04 15:59:01.910: [   SKGFD][3046184656]UFS discovery with :/u02/storage/vdsk:
2011-08-04 15:59:01.910: [   SKGFD][3046184656]Fetching UFS disk :/u02/storage/vdsk:
2011-08-04 15:59:01.911: [   SKGFD][3046184656]OSS discovery with :/u02/storage/vdsk:
2011-08-04 15:59:01.911: [   SKGFD][3046184656]Handle 0xa6c19f8 from lib :UFS:: for disk :/u02/storage/vdsk:
2011-08-04 17:10:37.522: [   SKGFD][3046184656]WARNING:io_getevents timed out 618 sec
2011-08-04 17:10:37.526: [   SKGFD][3046184656]WARNING:io_getevents timed out 618 sec
{quote}
ocrconfig log:
{quote}
2011-08-04 15:58:56.214: [ OCRRAW][3046991552]ibctx: Failed to read the whole bootblock. Assumes invalid format.
2011-08-04 15:58:56.214: [ OCRRAW][3046991552]proprinit:problem reading the bootblock or superbloc 22
2011-08-04 15:58:56.214: [ OCROSD][3046991552]utread:3: Problem reading buffer 8532000 buflen 4096 retval 0 phy_offset 102400 retry 0
2011-08-04 15:58:56.214: [ OCROSD][3046991552]utread:3: Problem reading buffer 8532000 buflen 4096 retval 0 phy_offset 102400 retry 1
2011-08-04 15:58:56.214: [ OCROSD][3046991552]utread:3: Problem reading buffer 8532000 buflen 4096 retval 0 phy_offset 102400 retry 2
2011-08-04 15:58:56.214: [ OCROSD][3046991552]utread:3: Problem reading buffer 8532000 buflen 4096 retval 0 phy_offset 102400 retry 3
2011-08-04 15:58:56.214: [ OCROSD][3046991552]utread:3: Problem reading buffer 8532000 buflen 4096 retval 0 phy_offset 102400 retry 4
2011-08-04 15:58:56.214: [ OCROSD][3046991552]utread:3: Problem reading buffer 8532000 buflen 4096 retval 0 phy_offset 102400 retry 5
2011-08-04 15:58:56.214: [ OCRRAW][3046991552]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
2011-08-04 15:58:56.365: [ OCRRAW][3046991552]iniconfig:No 92 configuration
2011-08-04 15:58:56.365: [ OCRAPI][3046991552]a_init:6a: Backend init successful
2011-08-04 15:58:56.390: [ OCRCONF][3046991552]Initialized DATABASE keys
2011-08-04 15:58:56.564: [ OCRCONF][3046991552]csetskgfrblock0: output from clsmft: [clsfmt: successfully initialized file /u02/storage/ocr
2011-08-04 15:58:56.577: [ OCRCONF][3046991552]Successfully set skgfr block 0
2011-08-04 15:58:56.578: [ OCRCONF][3046991552]Exiting [status=success]...
{quote}
ocssd.log:
{quote}
2011-08-04 15:59:00.140: [    CSSD][2963602320]clssgmFreeRPCIndex: freeing rpc 23
2011-08-04 15:59:00.228: [    CSSD][2996054928]clssgmExecuteClientRequest: CONFIG recvd from proc 6 (0xb35f7438)
2011-08-04 15:59:00.228: [    CSSD][2996054928]clssgmConfig: type(1)
2011-08-04 15:59:00.234: [    CSSD][2996054928]clssgmExecuteClientRequest: VOTEDISKQUERY recvd from proc 6 (0xb35f7438)
2011-08-04 15:59:00.247: [    CSSD][2996054928]clssgmExecuteClientRequest: CONFIG recvd from proc 6 (0xb35f7438)
2011-08-04 15:59:00.247: [    CSSD][2996054928]clssgmConfig: type(1)
2011-08-04 15:59:03.039: [    CSSD][2942622608]clssnmSendingThread: sending status msg to all nodes
2011-08-04 15:59:03.039: [    CSSD][2942622608]clssnmSendingThread: sent 4 status msgs to all nodes
2011-08-04 15:59:07.047: [    CSSD][2942622608]clssnmSendingThread: sending status msg to all nodes
2011-08-04 15:59:07.047: [    CSSD][2942622608]clssnmSendingThread: sent 4 status msgs to all nodes
2011-08-04 15:59:11.057: [    CSSD][2942622608]clssnmSendingThread: sending status msg to all nodes
2011-08-04 15:59:11.057: [    CSSD][2942622608]clssnmSendingThread: sent 4 status msgs to all nodes
2011-08-04 15:59:16.068: [    CSSD][2942622608]clssnmSendingThread: sending status msg to all nodes
2011-08-04 15:59:16.068: [    CSSD][2942622608]clssnmSendingThread: sent 5 status msgs to all nodes
2011-08-04 15:59:21.079: [    CSSD][2942622608]clssnmSendingThread: sending status msg to all nodes
2011-08-04 15:59:21.079: [    CSSD][2942622608]clssnmSendingThread: sent 5 status msgs to all nodes
{quote}
Any help here is appreciated.
Regards
Amith R
Edited by: Mithzz on Aug 4, 2011 4:58 AM

Did an lsof on vdisk and it showed
>
COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME
crsctl.bi 9589 root 26u REG 8,17 21004288 102980 /u02/storage/vdsk
[root@oel32rac1 ~]# ps -ef |grep crsctl
root 9589 7583 0 15:58 pts/1 00:00:00 [crsctl.bin] <defunct>
>
Could this be a permission issue ?
--Amith

Confusion with OCFS2 File system for OCR and Voting disk RHEL 5, Oracle11g,

Dear all,
I am in the process of installing Oracle 11g 3 Node RAC database
The environment on which i have to do this implementation is as follows:
Oracle 11g.
Red Hat Linux 5 x86
Oracle Clusterware
ASM
EMC Storage
250 Gb of Storage drive.
SAN
As of now i am in the process of installing Oracle Clusterware on the 3 nodes.
I have performed these tasks for the cluster installs.
1. Configure Kernel Parameters
2. Configure User Limits
3. Modify the /etc/pam.d/login file
4. Configure Operating System Users and Groups for Oracle Clusterware
5. Configure Oracle Clusterware Owner Environment
6. Install CVUQDISK rpm package
7. Configure the Hosts file
8. Verify the Network Setup
9. Configure the SSH on all Cluster Nodes (User Equivalence)
9. Enable the SSH on all Cluster Nodes (User Equivalence)
10. Install Oracle Cluster File System (OCFS2)
11.Verify the Installation of Oracle Cluster File System (OCFS2)
12. Configure the OCFS2 (/etc/ocfs2/cluster.conf)
13. Configure the O2CB Cluster Stack for OCFS2
BUT, here after i am a little bit confused on how to proceed further. The next step is to Format the disk and mount the OCFS2, Create Software Directories... so and so forth.
I asked my system admin to provide me two partitions so that i could format them with OCFS2 file system.
He wrote back to me saying.
*"Is what you want before I do it??*
*/dev/emcpowera1 is 3GB and formatted OCFS2.*
*/dev/emcpowera2 is 3GB and formatted OCFS2.*
*Are those big enough for you? If not, I can re-size and re-format them*
*before I mount them on the servers.*
*the SAN is shared storage. /dev/emcpowera is one of three LUNs on*
*the shared storage, and it's 214GB. Right now there are only two*
*partitions on it- the ones I listed below. I can repartition the LUN any*
*way you want it.*
*Where do you want these mounted at:*
*/dev/emcpowera1*
*/dev/emcpowera2*
*I was thinking if this mounting techique would work like so:*
*emcpowera1: /u01/shared_config/OCR_config*
*emcpowera2: /u01/shared_config/voting_disk*
*Let me know how you'd like them mounted."*
Please recommend me what i should convey to him so that i can ask him to the exact same thing.
My second question is, as we are using ASM, for which i am gonna configure ASM after clusterware installation, should i install Openfiler??
Pls refer the enviroment information i provided above and make recommendations.
As of now i am using Jeffery Hunters guide to install the entire setup. You think the entire install guide goes well with my enviroment??
http://www.oracle.com/technology/pub/articles/hunter_rac11gr1_iscsi.html?rssid=rss_otn_articles
Kind regards
MK

Thanks for ur reply Mufalani,
You have managed to solve half part of my query. But still i am stuck with what kind of mount point i should ask the system admin to create for OCR and Voting disk. Should i go with the mount point he is mentioning??
Let me put forth few more questions here.
1. Is 280 MB ok for OCR and voting disks respectively??
2. Should i ask the system admin to create 4 voting disk mount points and two for ocr??
3. As mentioned by the system admin.
*/u01/shared_config/OCR_config*
*/u01/shared_config/voting_disk*
Is this ok for creating the ocr and voting disks?
4. Can i use OCFS2 file system for formating the disk instead of using them as RAW device!!?
5. As u mentioned that Openfiler is not needed for Configuring ASM... Could you provide me the links which will guide me to create partition disks, voting disks and ocr disks!! I could not locate them on the doc or else were. I did find a couple of them, but was unable to identify a suitable one for my envoirement.
Regards
MK

A RMAN RECOVERY SCENARIO

hellow,
I am working on a rman recovery scenario as follows:
---I have a full backup on sunday
---My database in archivelog mode
---now I lost one of table on Monday 7:20PM
---then I lost another table on same day at 7:40PM
---I came to know about this(both table drop incident) at 7:45PM same day
---Now I have to recover both the tables
---I have catalog database configured
please tell me step by step, how the recovery should be done?
And I also want to know where I can find such scenarios on which I can work any book or web resource?

This is an abstract of http://download.oracle.com/docs/cd/B19306_01/backup.102/b14192/flashptr006.htm#sthref651
DBPITR within the current incarnation is performed using the current control file. When performing DBPITR, you can avoid errors by using the SET UNTIL command to set the target time at the beginning of the process, rather than specifying the UNTIL clause on the RESTORE and RECOVER commands individually. This ensures that the datafiles restored from backup will have timestamps early enough to be used in the subsequent RECOVER operation.
The steps required for DBPITR are as follows:
Connect RMAN to the target database and, if applicable, the recovery catalog database. Bring the database to a MOUNT state:
SHUTDOWN IMMEDIATE;
STARTUP MOUNT;
Perform the following operations within a RUN block:
Use SET UNTIL to specify the target time, restore point, SCN, or log sequence number for DBPITR. If specifying a time, then use the date format specified in the NLS_LANG and NLS_DATE_FORMAT environment variables.
If automatic channels are not configured, then manually allocate disk and tape channels as needed.
Restore and recover the database.
The following example performs DBPITR on the target database until SCN 1000:
RUN
SET UNTIL SCN 1000;
# Alternatives:
# SET UNTIL TIME 'Nov 15 2004 09:00:00';
# SET UNTIL SEQUENCE 9923;
RESTORE DATABASE;
RECOVER DATABASE;
Note:
You can also use time expressions, restore points, or log sequence numbers to specify the SET UNTIL time:
SET UNTIL TIME 'Nov 15 2004 09:00:00';
SET UNTIL SEQUENCE 9923;
SET UNTIL RESTORE POINT before_update;
If the operation completes without errors, then your DBPITR has succeeded. You can open the database read-only and perform queries as needed to ensure that the effects of the logical corruption have been reversed. If not, you may have chosen the wrong target SCN. In such a case, investigate the unwanted change further and determine a new target SCN, then repeat the DBPITR process.
7.6.4.1 Using a Time Expression for Database Point-in-Time Recovery
You can use a time expression instead of the SCN in the SET UNTIL statement, as shown in the preceding example. However, note that if you use SET UNTIL TIME to specify the target time for point-in-time recovery, some times that you can specify may not be in the current incarnation. The database may have been in an ancestor incarnation, or even in a sibling incarnation, at the target time. If your target time is not in the current incarnation, then see "Point-in-Time Recovery to an Ancestor Incarnation" for more information on DBPITR to ancestor incarnations, and Oracle Database Backup and Recovery Advanced User's Guide for more information on DBPITR to incarnations that are not ancestors of the current incarnation.
7.6.5 Options After Database Point-in-Time Recovery
After a successful DBPITR, your choices are:
Export one or more objects from your database using an Oracle export utility such as Data Pump Export. You can then recover the database to the current point in time and re-import the exported objects, as a way to return these objects to their state prior to the unwanted change without abandoning all other changes.
Open your database for read-write, abandoning all changes after the target SCN. In such a case, you must open the database with the RESETLOGS option, as shown here:
RMAN> ALTER DATABASE OPEN RESETLOGS;
The current online redo logs are archived, the log sequence number is reset to 1, and the online redo logs are given a new time stamp and SCN. Identifying redo log files with a new log sequence number and incarnation eliminates the possibility of corrupting datafiles by the application of obsolete archived redo logs.
The OPEN RESETLOGS operation will fail if a datafile is off-line, unless the datafile went offline normally or is read-only. You can bring files in read-only or offline normal tablespaces online after the RESETLOGS because they do not need any redo.
Sybrand Bakker
Senior Oracle DBA

Shared file system recomended for OCR and voting Disk in 10g R2

Dear Friends,
For Oracle 10g R2 (10.2.0.5) 64 bit which shared file system is recomended for OCR and voting Disk (NFS / raw devices / OCFS2)
For Datafiles and FRA i planned to use ASM
Regards,
DB

Hi,
If your using standard edition then you got no choice but raw devices
http://docs.oracle.com/cd/B19306_01/license.102/b14199/options.htm#CJAHAGJE
for ocfs2 you need to take extra care
Heartbeat/Voting/Quorum Related Timeout Configuration for Linux, OCFS2, RAC Stack to Avoid Unnecessary Node Fencing, Panic and Reboot [ID 395878.1]

OCR and voting disk location

Hi all,
I'm testing to install an Oracle RAC database (11g) on linux RHE 5 with a shared storage DELL Equallogic SCSI SAN.
I will setup a 2 nodes and i will use ASM for the database storage. I'm new in RAC database and i'm checking some docs and find that for the installation should have 3 volumes.
1- volumes for OCR and voting disk
2- volume for Database file (ASM)
3- volume for flash Recovery area and archive log file (ASM)
My question is which file system i will use for OCR and voting disk volume as i know for Datafiles and flash recovery area i will use ASM, but for voting disk i cannot use ASM because the system will access first OCR before starting ASm instance.
If i will use other file system how can i do ?
Thank you.

Hi
Thank you all for your help, actually i'm again facing problem in installing ASMlib, i cannot find ASMlib package for my OS even Raw device service is also not present.
My OS is CentOS 6 and Oracle 11g R2 RAC then installation type.
[root@Etopup-srv01 ~]# cat /etc/redhat-release
CentOS release 6.4 (Final)
Would you please help me what can i do to configure my ASM disk group ?
Thank you.

Help needed : How to move OCR and Voting Disk

Hi all experts...
I am Mahesh. Working in DXB as DBA. We have serveral RAC installed clients. Among those one major client wants their OCR and Voting Disk to be moved from existing SAN to a new SAN which will be configured. Only OCR and Voting Disks needs to be moved.
Details:
=====
Oracle Clusterware,ASM and DB version 10.2.0.3.0
Windows 2003 Server Enterprise Edition
2-Node RAC
OCR and Voting disks are on RAW devices (not on CFS or NFS)
I have read the clusterware administration document and also Metalink Note 428681.1 for the same.
But it does not contain information how to move it to another new RAW in a new SAN device. (we need to keep it in raw device itself)
How to identify the new disk path from windows operating system ? Then only we can move the OCR and VD right ???
Help me for the same please...
Thanks & regards,
Mahesh.

Hi Mashes,
Could you list out the steps you did after you create the link on the new SAN using GUIObjectManager.exe?
I tried on my VM and also in customer's test environment but I only successful using the following steps
1. shutdown asm service, database service, listener service, CRS, EVM and CSS
2. Object Manager Service is kept running
3. from both nodes I issued the following command
ocrconfig -repair \\.\OCRPRIMARY
ocrconfig -repair \\.\OCRMIRROR
4. according to metalink id 428681.1, I should do the following
ocrconfig -overwrite
However I was not successful because that command returns an error message (PROT-1: Failed to initialize ocr config).
Therefore, I ran the following command
ocrconfig -restore D:\oracle\1020\CRS\cdata\crs\backup00.ocr
5. after that command, ocrcheck giving me the result and the ocr primary and mirror have been moved to the new partition.
6. start the whole services starting from CSS, EVM, CRS, ASM, Listerner and Database service.
Although what I experienced seems a bit weird and not the same as what was written in metalink, the RAC is running fine until now.
What I would like to know is your experience on this. May be you can share it here.
Thank you,
Adhika

How To Identify the OCR-disk,Voting Disk

Hi Champ,
There is one confusion for the OCR and Voting Disk.
In case my RAC is up and Running and There are 3 RAW partitions for the OCR as well.
and I dont know which partition is for which purpose?? how to Identify the partions which are for the OCR,Voting disk?
Regards,
Shitesh Shukla

hi,
try to use this:
crsctl query css votedisk
and
OCRCHECK
OCRCONFIG

Regarding Voting disk recovery scenarios

Similar Messages

Maybe you are looking for