ASM中OCR存储文件疑问

OS: READHAT 5.8
DB: 11.2.0.3
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       2908
         Available space (kbytes) :     259212
         ID                       :  917958684
         Device/File Name         :     +OCRDG
                                    Device/File integrity check succeeded
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
         Cluster registry integrity check succeeded
         Logical corruption check succeeded
[grid@rac1 ~]$ asmcmd -p
ASMCMD [+] > cd OCRDG
ASMCMD [+OCRDG] > ls
rac-cluster/
ASMCMD [+OCRDG] > ls
rac-cluster/
ASMCMD [+OCRDG] > cd rac*
ASMCMD [+OCRDG/rac-cluster] > ls
ASMPARAMETERFILE/
OCRFILE/
ASMCMD [+OCRDG/rac-cluster] > cd ocrfile
ASMCMD [+OCRDG/rac-cluster/ocrfile] > ls
REGISTRY.255.800015219
ASMCMD [+OCRDG/rac-cluster/ocrfile] > OCR存储在ASM中,使用ocrcheck,查找所在磁盘组,asmcmd 下进入磁盘组,未发现具体OCR文件,只有asm spfile
而在共享文件系统如ocfs下存储的OCR可以找到具体文件(如下)
[oracle@bfsty1 ~]$ ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          2
         Total space (kbytes)     :     262144
         Used space (kbytes)      :       3272
         Available space (kbytes) :     258872
         ID                       : 1699483969
         Device/File Name         : /ocfs_data1/crs/ocr.dbf
                                    Device/File integrity check succeeded
         Device/File Name         : /ocfs_data2/crs/ocr2.dbf
                                    Device/File integrity check succeeded
         Cluster registry integrity check succeeded是否在ASM中是无法找到具体文件的?

FYI
grid@vrh1 ~]$ asmcmd dsget
parameter:/dev/asm*
profile:/dev/asm*
[grid@vrh1 ~]$ gpnptool get
Warning: some command line parameters were defaulted. Resulting command line:
         /g01/11.2.0/grid/bin/gpnptool.bin get -o-
<?xml version="1.0" encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0" xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:gpnp="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd" ProfileSequence="32" ClusterUId="58a8249042c37f94bf844767ea0ae255" ClusterName="vrh-cluster" PALocation=""><gpnp:Network-Profile><gpnp:HostNetwork id="gen" HostName="*"><gpnp:Network id="net1" IP="192.168.1.0" Adapter="eth0" Use="public"/><gpnp:Network id="net2" IP="172.168.1.0" Adapter="eth1" Use="cluster_interconnect"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="/dev/asm*" SPFile="/g01/11.2.0/grid/dbs/spfile+ASM1.ora"/><ds:Signature xmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethod Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethod Algorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:Reference URI=""><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:Transform Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"> <InclusiveNamespaces xmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnp orcl xsi"/></ds:Transform></ds:Transforms><ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>4QgZH9s7FcMwoqnxGtKyG67K2tE=</ds:DigestValue></ds:Reference></ds:SignedInfo><ds:SignatureValue>GEUFGg6x2X4uVWDj9aBIW9pAmO/GRccSdHcrWNF1tDwsVMa8a7hdr2mKSn1k88lxzY55DgzsfGQ3h7e1ftpF/0zBLwWQMDME9msJ1wa+r6mNtin2dxOIqKZrcZAASe9/zhY24mnNeQnoCRC4at0UkgZiE6KfZdskyHSff2nC8Yo=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>
Success.
[grid@vrh1 ~]$ ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       3164
         Available space (kbytes) :     258956
         ID                       : 1238458014
         Device/File Name         :  +systemdg
                                    Device/File integrity check succeeded
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
         Cluster registry integrity check succeeded
         Logical corruption check bypassed due to non-privileged user
[grid@vrh1 ~]$ cat /etc/oracle/ocr.loc
ocrconfig_loc=+systemdg
local_only=FALSE
SQL> set lines 120
SQL> set pages 100
SQL> column name format a40 wra
SQL> column type format a10 tru
SQL> select af.group_number, af.file_number, aa.name, af.type, af.redundancy
  2  from v$asm_file af, v$asm_alias aa
  3  where aa.file_number = af.file_number and
  4  aa.group_number=af.group_number and af.type = 'OCRFILE' ;
GROUP_NUMBER FILE_NUMBER NAME                                     TYPE       REDUND
           3         255 REGISTRY.255.790835859                   OCRFILE    HIGH
select NUMBER_KFFXP, XNUM_KFFXP, DISK_KFFXP, AU_KFFXP from X$KFFXP
where NUMBER_KFFXP = 255;
NUMBER_KFFXP XNUM_KFFXP DISK_KFFXP   AU_KFFXP
         255          0          0         38
         255          0          2         35
         255          0          4         36
         255          1          2         36
         255          1          4         37
         255          1          1         37
         255          2          4         38
         255          2          1         38
         255          2          3         35
         255          3          1         39
         255          3          4         39
         255          3          0         39
         255          4          3         36
         255          4          0         40
         255          4          1         40
[grid@vrh1 ~]$ asmcmd
ASMCMD> ls
BACKUPDG/
DATA/
SYSTEMDG/
ASMCMD> cd systemdg
ASMCMD> ls
vrh-cluster/
ASMCMD> cd vrh*
ASMCMD> ls
OCRFILE/
ASMCMD> cd OCRFILE
ASMCMD> ls -l
Type     Redund  Striped  Time             Sys  Name
OCRFILE  HIGH    COARSE   NOV 23 10:00:00  Y    REGISTRY.255.790835859     
REGISTRY.255.790835859     => 就是OCR
ASM 的spfile是放在+SYSTEMDG/maclean-cluster/asmparameterfile 下的     

Similar Messages

  • Move OCR and Vote Disk to a new SAN

    Hi,
    Can you guys help me with some links/documents for moving OCR and Vote disk files from old SAN to new SAN.
    Both SAN will have ocfs2 formatted 3 partitions on which ocr and votedisk will be placed (normal redundancy).
    Oracle version 11g R2,
    OS linux 5.5
    RAC nodes : 2
    Datafiles on ASM
    OCR/Votedisk on ocfs2
    Regards,
    Ajay

    user7443016 wrote:
    Thanks for the reply, but all the examples were showing either ocfs2 to ASM or raw to ocfs2. could you just point out the high level steps for moving 3 ocr & votedisk files from one san to another(ocfs to ocfs).
    Hi Ajay,
    Steps will be same . It doesnt matter whether it is raw to ocfs2 or ocfs to ocfs.
    There will be change only how do you assign storage for OCR/voting disk.
    I have another doubt that, i already have 3 ocr files, can i add more ocr files pointing to another mount point? the same goes with votedisk.
    You can use replace option so there is no need to add 4th OCR disk.
    i found steps in one of the website: i have few doubts in it, could any one clarify it...All the steps seems to be fine.
    Moving OCR
    1) create mount point(new san - /u05) in all nodes
    2) precreate ocr files in new mount points (i am not sure how to do it? is it just touch and filename, its a ocfs2 file system)on ocfs you need to create file as below :
    dd if=/dev/zero of=/ocfs/OCR/ocrnew.dbf bs=1M count=128
    Also I would suggest to have a look at :
    'ocrconfig -replace ocr' Fails With PROT-16 [ID 444757.1]
    RAC Assurance Support Team: RAC Starter Kit and Best Practices (Linux) [ID 811306.1]
    Regards
    Rajesh

  • Asm createdisk error in root.sh

    I get the following error in root.sh during RAC install
    DiskGroup OCR creation failed with the following message:
    ORA-15018: diskgroup cannot be created
    ORA-15072: command requires at least 1 regular failure groups, discovered only 0
    Configuration of ASM failed, see logs for details
    Did not succssfully configure and start ASM
    CRS-2500: Cannot stop resource 'ora.crsd' as it is not running
    CRS-4000: Command Stop failed, or completed with errors.
    Command return code of 1 (256) from command: /opt/app/11.2.0/grid/bin/crsctl stop resource ora.crsd -init
    Stop of resource "ora.crsd -init" failed
    In /opt/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_gaalt-ota-odc.log ....
    2010-07-02 06:31:21: Successfully created CRS resources for cluster daemon and ASM
    2010-07-02 06:31:21: Checking if initial configuration has been performed
    2010-07-02 06:31:21: Starting CSS in exclusive mode
    2010-07-02 06:31:47: CRS-2672: Attempting to start 'ora.gipcd' on 'gaalt-ota-odc'
    2010-07-02 06:31:47: CRS-2672: Attempting to start 'ora.mdnsd' on 'gaalt-ota-odc'
    2010-07-02 06:31:47: CRS-2676: Start of 'ora.gipcd' on 'gaalt-ota-odc' succeeded
    2010-07-02 06:31:47: CRS-2676: Start of 'ora.mdnsd' on 'gaalt-ota-odc' succeeded
    2010-07-02 06:31:47: CRS-2672: Attempting to start 'ora.gpnpd' on 'gaalt-ota-odc'
    2010-07-02 06:31:47: CRS-2676: Start of 'ora.gpnpd' on 'gaalt-ota-odc' succeeded
    2010-07-02 06:31:47: CRS-2672: Attempting to start 'ora.cssdmonitor' on 'gaalt-ota-odc'
    2010-07-02 06:31:47: CRS-2676: Start of 'ora.cssdmonitor' on 'gaalt-ota-odc' succeeded
    2010-07-02 06:31:47: CRS-2672: Attempting to start 'ora.cssd' on 'gaalt-ota-odc'
    2010-07-02 06:31:47: CRS-2672: Attempting to start 'ora.diskmon' on 'gaalt-ota-odc'
    2010-07-02 06:31:47: CRS-2676: Start of 'ora.diskmon' on 'gaalt-ota-odc' succeeded
    2010-07-02 06:31:47: CRS-2676: Start of 'ora.cssd' on 'gaalt-ota-odc' succeeded
    2010-07-02 06:31:47: Querying for existing CSS voting disks
    2010-07-02 06:31:47: Performing initial configuration for cluster
    2010-07-02 06:31:48: Start of resource "ora.ctssd -init" Succeeded
    2010-07-02 06:31:48: Configuring ASM via ASMCA
    2010-07-02 06:31:48: Executing as grid: /opt/app/11.2.0/grid/bin/asmca -silent -diskGroupName OCR -diskList ORCL:OCR -redundancy EXTERNAL -configureLocalASM
    2010-07-02 06:31:48: Running as user grid: /opt/app/11.2.0/grid/bin/asmca -silent -diskGroupName OCR -diskList ORCL:OCR -redundancy EXTERNAL -configureLocalASM
    2010-07-02 06:31:48: Invoking "/opt/app/11.2.0/grid/bin/asmca -silent -diskGroupName OCR -diskList ORCL:OCR -redundancy EXTERNAL -configureLocalASM" as user "grid"
    2010-07-02 06:31:56: Configuration of ASM failed, see logs for details
    2010-07-02 06:31:56: Did not succssfully configure and start ASM
    2010-07-02 06:31:56: Exiting exclusive mode
    2010-07-02 06:31:57: Command return code of 1 (256) from command: /opt/app/11.2.0/grid/bin/crsctl stop resource ora.crsd -init
    2010-07-02 06:31:57: Stop of resource "ora.crsd -init" failed
    2010-07-02 06:31:57: Failed to stop CRSD
    2010-07-02 06:32:32: Initial cluster configuration failed. See /opt/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_gaalt-ota-odc.log for details
    [root@GAALT-OTA-ODC oracledisks]#
    So I tried the command manually , first I started CSS in exclusive mode and then ran the command from the logs above.....
    crsctl start resource ora.cssd -init -env CSSD_MODE=-X
    Then....
    [grid@GAALT-OTA-ODC ~]$ /opt/app/11.2.0/grid/bin/asmca -silent -diskGroupName OCR -diskList ORCL:OCR -redundancy EXTERNAL -configureLocalASM
    Error...
    DiskGroup OCR creation failed with the following message:
    ORA-15018: diskgroup cannot be created
    ORA-15072: command requires at least 1 regular failure groups, discovered only 0
    I think the issue lies somewhere in my oracleasm OCR disk creation step. The create command during root.sh works when I delete the disk and use oracleasm to recreate it locally . But then the create fails on the other node. In other words the node that uses oracleasm scandisks to pick up OCR will always fail with the error above
    In other words, if I run "/usr/sbin/oracleasm createdisk OCR /dev/asm/OCR " on node1, root.sh wll fail with the above error on node2. Even though scandisks detects the OCR on node2
    If I run this command on node2 first, root.sh will fail on node1 . Even though scandisks detects the OCR on node1
    This is a nightmare would appreciate some advice on diagnosing where the problem is with my configuration of ASM before I roll back the root.sh again !
    Thanks

    Thanks Sebastian
    I tried this but I also needed to recreate the OCR disk as root.sh throws an error that it is already created, so i ran a dd on the device , then deleted OCR using oraclasm
    Then I tried to recreate on first node and got
    /usr/sbin/oracleasm createdisk OCR /dev/mapper/mpath3
    Unable to open device "/dev/mapper/mpath3": Device or resource busy
    Tried it on other node and it worked
    I rolled back root.sh and then ran it again and it thows the following error
    DiskGroup OCR creation failed with the following message:
    ORA-15018: diskgroup cannot be created
    ORA-15017: diskgroup "OCR" cannot be mounted
    ORA-15003: diskgroup "OCR" already mounted in another lock name space
    I decided to reboot the machines to get around the busy device. Once rebooted I was able to run oracleasm createdisk without any errors. root.sh also did not throw errors but I am not 100% confident that the root.sh was ok on the second node. Anyway I have lost my install GUI during reboot so could not complete the install anyway
    So now I will deinstall everything and start again , and I will update the forum to if there was no issue and problem resolved
    Thanks a lot for the pointers and your time

  • Online move voting disc & ocr

    Hello
    RAC 10gR2, ASM, OCR and voting disk on raw disks. We are using IPStor.
    We are migrating from one storage to another. ASM migration can be done online (adding new disc, waiting for rebalancing, dropping old disks).
    Is it true that voting disk and OCR can be moved online from one storage to another (via IPStor Tools)? From the host view, the disks won't be unavailable.
    Regards Casimir

    refer the link:-
    http://download.oracle.com/docs/cd/B19306_01/rac.102/b14197/votocr.htm#BABGEEEJ

  • Oracle RAC Nodes getting reboot in case of preferred controller failed

    When we are disconnecting both Fiber cable from preferred Controller A or plugging out Controller A card from Disk Array(IBM DS 4300), After 90 seconds both the servers are rebooting.
    In this time complete RAC network is going out of service for approx 5 minutes.After reboot both servers are coming with both instances without any manual intervention
    It’s a critical issue for us because we are loosing High Availability, Let us know how we can resolve this critical issue.
    Detail of Network:
    1. Software- Oracle 10g Release2
    2. OS- Redhat Linux 3 (Kernel Version-2.4.21-27.ELsmp)
    3. Shared Storage- IBM DS 4300.
    4. Multipathing Driver - RDAC (rdac-LINUX-09.00 A5.13)
    4. Nodes- IBM 346
    5. Databse on ASM
    6. ASM,OCR & Voting Disk Preferred controller is A.
    7. Hangcheck timer value is 210 seconds.
    8. Both Server available with 2 HBA port . I HBA port is connected with Controller A and Seconfd HBA port is connected with Controller B of SAN Disk Array.
    As per my understanding,
    Voting disk resides in Disk Array and Controller A is preferred owner of Voting Disk LUN.. When i am disconnecting both fiber cable from preferred controller A , then Both Nodes Clusterware software trying to contact with Voting Disk, When they are unable to contact with Voting disk in specfic time period, they are going for reboot.
    I tested Controller failure testing with Oracle RAC software as well without Oracle. Without Oracle its working fine and reason behind, in that time Disk Array is waiting for approx 300 seconds for changing preferred controlller from A to B.
    But With Oracle, Clusterware Software reboot both nodes before Controller can shift from A to B.
    So if i conclude,the tech who has good understanding of Oracle Clusterware on Linux OS & IBM RDAC multipath driver can help me.
    when we install Oracle RAC on Linux, it is required to configure hangcheck timer.
    Oracle recomends 180 second.
    It means if one of node is hanging, then second node will wait for 180 seconds, if within 180 seconds ,it is not able to resolve this situation then it will reboot hung node.
    I think Hangcheck timer configuration reuired only with Linux OS.
    Configuration File
    cat >> /etc/rc.d/rc.local << EOF
    modprobe hangcheck-timer hangcheck_tick=15 hangcheck_margin=60

    Sorry
    Hangcheck timer is
    Configuration File
    cat >> /etc/rc.d/rc.local << EOF
    modprobe hangcheck-timer hangcheck_tick=30 hangcheck_margin=180

  • Unexpected behavior on disk loss.

    I’ve installed a cluster with the following soft- and hardware:
    Software
    Oracle Enterprise Linux 5 (2.6.18-194.0.0.0.3.el5 … x86_64)
    Oracle Clusterware 11.1.0.7
    Oracle ASM 11.1.0.7
    Oracle Database 11.1.0.7
    Hardware
    Servers:
    2 * HP BL460c Intel Xeon 5160
    Storages:
    HP EVA 8100
    HP EVA 6000
    NetApp FAS3040
    ASM, OCR and votingdisks are placed on the three storages above. (The third votingdisk is placed on the netapp storage.) The whole cluster works fine until I start doing some testing. If I disconnect one OCR or ASM disk (I unpresent them on the storagesystems), the system starts getting some serious problems. Of course this test shouldn’t affect the cluster because I have two OCR disks and for every diskgroup two ASM disks.
    The symptoms are:
    - Lack of disk doesn’t get logged. (Not sure if this is normal but the loss of a votingdisk gets logged perfectly.)
    - Tools that try to access the unavailable disk (e.g. ocrcheck) get blocked.
    - The Linux kernel recognizes the problem and prints the following message:
    INFO : task oracleasm -read -:30433 blocked for more than 120 seconds
    " echo 0 > / proc /sys/ kernel / hung_task_timeout_secs " disables this message .
    oracleasm -rea D ffff81012abc07e0 0 30433 30431 ( NOTLB )
    ffff8101058f1cb8 0000000000000086 0000000000000400
    ffffffff8001c211
    0000000000000282 0000000000000001 ffff8100c5f7a860
    ffff81012abc07e0
    000037 b037830e15 00000000000706 f8 ffff8100c5f7aa48
    0000000200000003
    Call Trace :
    [< ffffffff8001c211 >] generic_make_request +0 x211 /0 x228
    [< ffffffff8006f20d >] do_gettimeofday +0 x40 /0 x90
    [< ffffffff8005adc4 >] getnstimeofday +0 x10 /0 x28
    [< ffffffff800647ea >] io_schedule +0 x3f /0 x67
    [< ffffffff800f5905 >] __blockdev_direct_IO +0 x8da /0 xa80
    [< ffffffff800e693a >] blkdev_direct_IO +0 x32 /0 x37
    [< ffffffff800e6872 >] blkdev_get_blocks +0 x0 /0 x96
    [< ffffffff8000c514 >] __generic_file_aio_read +0 xb8 /0 x198
    [< ffffffff800c7954 >] generic_file_read +0 xac /0 xc5
    [< ffffffff800a1bfd >] autoremove_wake_function +0 x0 /0 x2e
    [< ffffffff8002a6d0 >] __vma_link +0 x42 /0 x4b
    [< ffffffff8001cca6 >] vma_link +0 x70 /0 xfd
    [< ffffffff800b87e5 >] audit_syscall_entry +0 x180 /0 x1b3
    [< ffffffff8000b6b0 >] vfs_read +0 xcb /0 x171
    [< ffffffff80013626 >] sys_pread64 +0 x50 /0 x70
    [< ffffffff8005e229 >] tracesys +0 x71 /0 xe0
    [< ffffffff8005e28d >] tracesys +0 xd5 /0 xe0
    Also after some time the database that uses the ASM disk, stops working.
    Does anyone know how to solve this problem, so that I can keep up operation of the cluster even if one OCR or ASM disk is missing?
    Thanks in advance.
    Regards

    Hi,
    You can try to add an new ocr disk an start a restore via ocrconfig.
    May be you don't get answer from ocrcheck. follow next step.
    ocrcheck
    Status of Oracle Cluster Registry is as follows :
    Version : 2
    Total space (kbytes) : 1043916
    Used space (kbytes) : 5120
    Available space (kbytes) : 1038796
    ID : 143918616
    Device/File Name : /dev/raw/raw1
    Device/File integrity check succeeded
    Device/File Name : /dev/raw/raw2
    Device/File integrity check succeeded
    Cluster registry integrity check succeeded
    If this doesn't work overwrite with dd the ocr disk
    dd if=/dev/zero of=/dev/..... bs=4096 count=256
    After this do an restore form the automatic backup
    ocrconfig -restore /oracle/app/oracle/product/crs-11.1/cdata/RAC/backup00.ocr
    regards
    SPA2

  • Regarding Voting disk recovery scenarios

    Hi,
    For years i have read about RAC and Voting disk and it is said that each node should access more than half of the voting disks but never got a chance to work on the below scnerios which i have mentioned, if some one has practical done the below scenarios or have good knowledge do let me know.
    1) If i have 5 voting disks and out of which 2 got corrupted or deleted will the cluster keep working properly? If i boot my system or restart the cluster will it still work fine or not?
    2) The above scenario with 3 voting disk deleted or got corrupted  what will happen?
    3) If i have 2 OCR and i got deleted or corrupted will the system run fine?

    Aman,
    During startup the clusterware requires the majority of votes to start the CSS Daemon.
    The majority is counted on how many was configured, not how many remain alive.
    Below test using 3 Votedisk (11.2.0.3)
    alert.log
    [cssd(26233)]CRS-1705:Found 1 configured voting files but 2 voting files are required, terminating to ensure data integrity; details at (:CSSN                     M00021:) in /u01/app/11.2.0/grid/log/node11g02/cssd/ocssd.log
    ocssd.log
    2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmvDiskVerify: Successful discovery of 1 disks
    2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmCompleteInitVFDiscovery: Completing initial voting file discovery
    2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmCompleteVFDiscovery: Completing voting file discovery
    2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmvDiskStateChange: state from discovered to pending disk /dev/asm-ocr-vote01
    2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmvDiskStateChange: state from pending to configured disk /dev/asm-ocr-vote01
    2014-11-14 05:20:05.126: [    CSSD][3021551360]clssnmvVerifyCommittedConfigVFs: Insufficient voting files found, found 1 of 3 configured, needed 2 voting files
    With 2 voting files online, no problem, clusterware start with warning on logs.
    Ps. If was configured a diskgroup (OCR_VOTE) with high redundancy (5 asmdisk each in your onw failgroup), even diskgroup can hold 3 asmdisk failure. The diskgroup goes down and if there is only one OCR (no mirror) on that Diskgroup the whole clusterware goes down.

  • Wrongly issued #localconfig reset  on RAC node1

    Hello,
    I wrongly issued on node1 the command:
    #localconfig reset
    After that the OCR was moved on a local file, instead on shared raw storage: /u01/oracle/product/10gr2/db/cdata/localhost/local.ocr
    How can I revert back to the configuration with two nodes?
    Configuration is RAC 10g with 2 nodes, having ASM, OCR, VotDisk of shared raw devices.
    ORACLE_BASE=/u01/oracle
    ORACLE_HOME=/u01/oracle/product/10gr2/db
    ORA_CRS_HOME=/u01/oracle/product/10gr2/crs
    Thanks alot.

    Cannot execute #localconfig all
    Is Oracle 10g and the only options available are:
    node1:root$ /u01/oracle/product/10gr2/crs/bin//localconfig all
    Usage:/u01/oracle/product/10gr2/crs/bin//localconfig [add] [delete] [ reset <destination Oracle home> ] [-silent] [-paramfile <Complete path of file specifying parameter values>]

  • Recovery After OS failed upgrade

    We will be upgrading our OS from Oracle Linux 5 update 2 to Oracle Linux 5 update 9. I want to ensure we can recovery if anything goes wrong. We have a three node RAC with the following setup:
    Oracle Linux 5 update 2
    Oracle Grid Infrastructure 11.2.0.2
    Oracle Database 11.2.0.2
    Backup Software: Netbackup
    Disks
    OS and Oracle Software Installations on Mirrored Disk (ext3)
    DATA Diskgroup on RAID10 (ASM)
    FRA Diskgroup on RAID10 (ASM)
    GRID Diskgroup on Mirrored Disk (ASM) -- OCR/Voting Disks/ASMParameterfile
    SCENARIO: OS upgrade fails and we need to recovery to backup. Have OS/Oracle Software partition file-based backup. We have RMAN database backup.
    Questions
    * SysAdmin says he can only perform file-based backup of OS/Oracle Software partition. Is a file-based backup sufficent or is a image (bare-metal) backup required?
    * ASMLib packages will be upgraded. Will this affect ASM Disk or data on ASM disks?
    * What additional steps should be performed to ensure successful restoration?
    * Any recommended steps that may not be required?
    Thanks in advance.

    Filebased backup will be sufficient in my experience.
    1. make sure GI is copied as root
    2. to copy central inventory
    3. /etc and Local Cluster Registry
    4. make sure you do it at one node per time
    5 .Even oracle os backup fails, the GI and DB homes can be copied and cloned over from other survived nodes
    Regards
    Ed Rudans
    http://erudans.blogspot.com

  • 10g Grid (RAC) on Linux with ASM and OCR?

    I was trying to install 10g on Linux with ASM. The docs are not terribly clear on this, but I'd like to have the Oracle Cluster Registry (OCR) on one of my four ASM disks, rather than dedicate space to OCFS. I have 4 18.2 GB drives setup with ASM now. Is there a way to do this?
    I guess the other thing I could do is to cut the ASM disks into two partitions. One, say 200MB and the other the rest. I'd put OCFS for OCR on the 200MB partition on one of the disks. The large partition on each of the rest of the disks would be dedicated to ASM.
    What am I missing? I feel it must be something obvious. I'd rather have the OCR on the ASM, so that I don't have to deal with it...
    Thanks!
    Jeff

    Hi.
    There shouldn't be a problem with this provided you use a 32-bit OS on the 64 bit machine. RAC doesn't care about the chipset, so long as the same OS is used, but I don't thinkit will support one node on 32 bit and one on 64 bit, since they are actually separate distributions.
    Of course, I've never tried it so I can't be sure :)
    Cheers
    Tim...

  • OCR and voting disks on ASM, problems in case of fail-over instances

    Hi everybody
    in case at your site you :
    - have an 11.2 fail-over cluster using Grid Infrastructure (CRS, OCR, voting disks),
    where you have yourself created additional CRS resources to handle single-node db instances,
    their listener, their disks and so on (which are started only on one node at a time,
    can fail from that node and restart to another);
    - have put OCR and voting disks into an ASM diskgroup (as strongly suggested by Oracle);
    then you might have problems (as we had) because you might:
    - reach max number of diskgroups handled by an ASM instance (63 only, above which you get ORA-15068);
    - experiment delays (especially in case of multipath), find fake CRS resources, etc.
    whenever you dismount disks from one node and mount to another;
    So (if both conditions are true) you might be interested in this story,
    then please keep reading on for the boring details.
    One step backward (I'll try to keep it simple).
    Oracle Grid Infrastructure is mainly used by RAC db instances,
    which means that any db you create usually has one instance started on each node,
    and all instances access read / write the same disks from each node.
    So, ASM instance on each node will mount diskgroups in Shared Mode,
    because the same diskgroups are mounted also by other ASM instances on the other nodes.
    ASM instances have a spfile parameter CLUSTER_DATABASE=true (and this parameter implies
    that every diskgroup is mounted in Shared Mode, among other things).
    In this context, it is quite obvious that Oracle strongly recommends to put OCR and voting disks
    inside ASM: this (usually called CRS_DATA) will become diskgroup number 1
    and ASM instances will mount it before CRS starts.
    Then, additional diskgroup will be added by users, for DATA, REDO, FRA etc of each RAC db,
    and will be mounted later when a RAC db instance starts on the specific node.
    In case of fail-over cluster, where instances are not RAC type and there is
    only one instance running (on one of the nodes) at any time for each db, it is different.
    All diskgroups of db instances don't need to be mounted in Shared Mode,
    because they are used by one instance only at a time
    (on the contrary, they should be mounted in Exclusive Mode).
    Yet, if you follow Oracle advice and put OCR and voting inside ASM, then:
    - at installation OUI will start ASM instance on each node with CLUSTER_DATABASE=true;
    - the first diskgroup, which contains OCR and votings, will be mounted Shared Mode;
    - all other diskgroups, used by each db instance, will be mounted Shared Mode, too,
    even if you'll take care that they'll be mounted by one ASM instance at a time.
    At our site, for our three-nodes cluster, this fact has two consequences.
    One conseguence is that we hit ORA-15068 limit (max 63 diskgroups) earlier than expected:
    - none ot the instances on this cluster are Production (only Test, Dev, etc);
    - we planned to have usually 10 instances on each node, each of them with 3 diskgroups (DATA, REDO, FRA),
    so 30 diskgroups each node, for a total of 90 diskgroups (30 instances) on the cluster;
    - in case one node failed, surviving two should get resources of the failing node,
    in the worst case: one node with 60 diskgroups (20 instances), the other one with 30 diskgroups (10 instances)
    - in case two nodes failed, the only node survived should not be able to mount additional diskgroups
    (because of limit of max 63 diskgroup mounted by an ASM instance), so all other would remain unmounted
    and their db instances stopped (they are not Production instances);
    But it didn't worked, since ASM has parameter CLUSTER_DATABASE=true, so you cannot mount 90 diskgroups,
    you can mount 62 globally (once a diskgroup is mounted on one node, it is given a number between 2 and 63,
    and other diskgroups mounted on other nodes cannot reuse that number).
    So as a matter of fact we can mount only 21 diskgroups (about 7 instances) on each node.
    The second conseguence is that, every time our CRS handmade scripts dismount diskgroups
    from one node and mount it to another, there are delays in the range of seconds (especially with multipath).
    Also we found inside CRS log that, whenever we mounted diskgroups (on one node only), then
    behind the scenes were created on the fly additional fake resources
    of type ora*.dg, maybe to accomodate the fact that on other nodes those diskgroups were left unmounted
    (once again, instances are single-node here, and not RAC type).
    That's all.
    Did anyone go into similar problems?
    We opened a SR to Oracle asking about what options do we have here, and we are disappointed by their answer.
    Regards
    Oscar

    Hi Klaas-Jan
    - best practises require that also online redolog files are in a separate diskgroup, in case of ASM logical corruption (we are a little bit paranoid): in case DATA dg gets corrupted, you can restore Full backup plus Archived RedoLog plus Online Redolog (otherwise you will stop at the latest Archived).
    So we have 3 diskgroups for each db instance: DATA, REDO, FRA.
    - in case of fail-over cluster (active-passive), Oracle provide some templates of CRS scripts (in $CRS_HOME/crs/crs/public) that you edit and change at your will, also you might create additionale scripts in case of additional resources you might need (Oracle Agents, backups agent, file systems, monitoring tools, etc)
    About our problem, the only solution is to move OCR and voting disks from ASM and change pfile af all ASM instance (parameter CLUSTER_DATABASE from true to false ).
    Oracle aswers were a litlle bit odd:
    - first they told us to use Grid Standalone (without CRS, OCR, voting at all), but we told them that we needed a Fail-over solution
    - then they told us to use RAC Single Node, which actually has some better features, in csae of planned fail-over it might be able to migreate
    client sessions without causing a reconnect (for SELECTs only, not in case of a running transaction), but we already have a few fail-over cluster, we cannot change them all
    So we plan to move OCR and voting disks into block devices (we think that the other solution, which needs a Shared File System, will take longer).
    Thanks Marko for pointing us to OCFS2 pros / cons.
    We asked Oracle a confirmation that it supported, they said yes but it is discouraged (and also, doesn't work with OUI nor ASMCA).
    Anyway that's the simplest approach, this is a non-Prod cluster, we'll start here and if everthing is fine, after a while we'll do it also on Prod ones.
    - Note 605828.1, paragraph 5, Configuring non-raw multipath devices for Oracle Clusterware 11g (11.1.0, 11.2.0) on RHEL5/OL5
    - Note 428681.1: OCR / Vote disk Maintenance Operations: (ADD/REMOVE/REPLACE/MOVE)
    -"Grid Infrastructure Install on Linux", paragraph 3.1.6, Table 3-2
    Oscar

  • How to restore ASM based OCR after complete loss of the CRS diskgroup (Doc

    Hello, I'm testing Metalink doc id 1062983.1.
    I have rac 11.2.0 with asm on Hp-Ux. I have an CRS diskgroup with external redundancy. The Unix System administrator dropped crs disk:
    GRID user:           oradb
    GRID home:           /oracle/product/11.2.0/grid ($CRS_HOME)
    ASM disk group name for OCR:      CRS
    ASM/ASMLIB disk name:      CRS_0000
    Linux device name for ASM disk:      /dev/rdisk/disk27
    Cluster name:           crs_desa
    Nodes:                rx2
    I've checked backups
    rx2:/oracle/product/11.2.0/grid/cdata/crs_desa $ ls -ltr
    total 89384
    -rw------- 1 root sys 6537216 Dec 7 20:34 week.ocr
    -rw------- 1 root sys 6537216 Dec 8 00:34 day.ocr
    -rw------- 1 root sys 6537216 Dec 9 00:35 backup02.ocr
    -rw------- 1 root sys 6537216 Dec 9 00:35 day_.ocr
    -rw------- 1 root sys 6537216 Dec 9 04:35 backup01.ocr
    -rw------- 1 root sys 6537216 Dec 9 08:35 backup00.ocr
    But I can't start CRS stack in exclusive mode. I've tried crsctl start crs -excl as root but I've got
    rx2:/oracle/product/11.2.0/grid/bin # crsctl start crs -excl
    CRS-4640: Oracle High Availability Services is already active
    CRS-4000: Command Start failed, or completed with errors.
    can anyone help me please?
    Thanks in advance!
    Edited by: user13398689 on 09-dic-2010 10:02

    You need to first stop the crs stack on all the nodes and then start the CRS stack on one node in exclusive mode.

  • ASM Instance down in Solaris due to missing ocr.loc file

    We had to restart our solaris machine due to a hardware failure.
    When i tried to start to ASM instance, i got the error.
    SQL> startup mount;
    ORA-29701: unable to connect to Cluster Manager
    The css daemons were not started. I checked it using
    $ ps -ef | grep css
    After logging in as ROOT and setting Oracle's bin directory in its path, i tried to run
    #./localconfig . But i didn't succeed.
    Then I came to know that you can start css by executing init.cssd script in ($ORACLE_HOME/css/admin)
    /u01/oracle/10g/css/admin
    $ ./init.cssd start
    ./init.cssd: /var/opt/oracle/ocr.loc: cannot open
    There is no such file called ocr.loc in this location. I confirmed it by
    So I looked for /var/opt/oracle/ocr.loc
    $ file /var/opt/oracle/ocr.loc
    /var/opt/oracle/ocr.loc: cannot open: No such file or directory
    What do i do?

    Boutet,
    Before you go ahead and restore the OCR, for that matter even to restore it successfully, you would need to restore/recreate the file /var/opt/oracle/ocr.loc. This file has the location of the OCR file, without this file, you will not be able to restore the OCR.
    The contents of the ocr.loc file would be something like this (I am including this information so that you may like to use it to recreate the file, in case you lost the original one).
    cat /etc/oracle/ocr.loc
    ocrconfig_loc=/<path>/cdata/localhost/local.ocr
    local_only=TRUE
    Hope this help.
    Thanks
    Chandra Pabba

  • OCR and ASM dependancy in 11.2

    Grid Version: 11.2.0.2
    Platform : Solaris 10
    Question1.
    Since ASM's configuration information is stored in OCR , if OCR is lost (for eg: due to a corrupt LUN in OCR's Disk group) , will ASM instance crash ?
    Question2.
    If ASM instance crashes (for eg: someone accidently killed an ASM mandatory process) , will OCR be accessible as OCR is stored in an ASM disk group ?
    Question3.
    What are the precautions I can take to protect OCR from failures ?

    Tom wrote:
    Hi Levi, Kuljeet
    Because of OLR (Oracle local registry) , I was under the impression that ASM won't crash even if OCR is lost.
    http://www.linkedin.com/groups/How-restore-OCR-in-11gR2-3156190.S.93908910
    Hi Tom,
    When Clusterware starts three files are involved.
    OLR - Is the first to be read and opened. This file is local and this file contains information where is stored voting disk, and information to startup the ASM. (e.g ASM DiscoveryString)
    VOTING DISK - This is the second file to be opened and read, to read the voting file only depend on the OLR be accessible. ASM start after CSSD or ASM does not start if CSSD is offline (i.e voting file missing)
    OCR - Finally the ASM Instance starts and mount all Diskgroups, then Clusterware Deamon (CRSD) open and read the OCR which is stored on Diskgroup.
    So, if ASM already started, ASM does not depend on OCR or OLR to be online. ASM depend on CSSD (Votedisk) to be online.
    There is a exclusive mode to start ASM without CSSD (but it's to restore OCR or VOTE purposes)
    Regards,
    Levi Pereira

  • OCR and VOT disk, in the same asm disk or different disks ?! and how ?!

    What Oracle recommends regarding the OCR and Voting disks in Rac 11gR2 on ASM ?!
    Making them under the same disk or different disks ?!
    and how ?!
    Thanks a lot,
    Regards,
    Gehad.

    Best practice is that OCR/Voting should be under ASM. Making them under the same disk or different disks depends upon the ASM diskgroup. If we want to keep it on seperate failover groups then we should create muliple failover group.
    For external : 1 ; Normal : 3 and higher : 5 asm diskgroups.
    I hope i would be clear ith my answers.
    Regards,
    Dheeraj Vaish

Maybe you are looking for

  • Error Downloading KickStart File

    Folks, I am trying to install OEL5 using KickStart. 1. I have kickstart file on my USB 2. I boot HP 580 system from CD Room 3. On booted first screen I have typed following commands, a. linux ks=hd:/dev/sda1:/ks.cfg b. linux ks =hd:sda1/ks.cfg c. lin

  • Connect LDAP service to local domain

    Is there anyone who can tell me if it's possible to connect form the LDAP service to a local domain? I have made a new local domain with some groups and users in the Domain management in LC ES admin module. Now I want to retrieve those users to my pr

  • Installing EM agents with multiple oracle owners

    Hi I am planning to install and configure EM Grid Control in my environment. How many agents do I need to configure if I have several oracle software owners on a server e.g. server1: - oracle9 for Oracle 9i database - oracle10 for Oracle 10gR1 databa

  • Strange behavior in Mail

    Reply to a message in mail. Hit Send. (Do not exit the current message) As the message is transmitting, and BEFORE you hear the mail-sent sound, press the home button. Relaunch the Mail application icon in the dock. Mail then opens with a duplicate o

  • Problem writing metadata to Jpegs originating from Macs

    Everything works great when trying to write metadata to a JPEG that originates from a PC. But since my company runs a website, we have to be able to handle JPEGs that come from Macs. I've run across an issue where trying to write metadata to a Mac-JE