ASM alert ORA-15173

Hi all,
I am getting this alert in ASM alert log.
There are so many database and file system. The alert log and trace file is not giving info regarding which db it is coming from.
==========
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
*** 2010-10-12 12:37:11.553
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
*** 2010-10-12 12:37:22.541
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
*** 2010-10-12 12:37:33.144
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
ORA-15173: entry 'thread_5_seq_9631.2209.732197917' does not exist in directory '2010_10_12'
==========
please advise the solution.

In this case, I am getting alert in alert_+ASM.log file, so not able to understand where it is coming from.                                                                                                                                                                                                                       

Similar Messages

  • Oracle Alert - ORA-1652 Unable to extend the Temp Segment

    Hi Team,
    During our DB Reorg we have received the Oracle Alert - ORA-1652 Unable to extend the Temp Segment by 15485 in tablespace :PSAPBTABI.
    Our DBReorg got cancelled..
    We would like to know how we can resolve the above error so that we can reschedule the DB Reorg activity..
    Regds,
    Satyanarayana N

    Hi,
    If you are using UNIX OS, the temp files are created as sparse file due to the OS functionality.
    Altough you have assigned 49 GB the actual size will be very very less.
    You can check the actula file size with du or df command. To remove these sparse condition you will need to perform certain steps.
    Read this note and execute the steps given and then see the file size difference.
    548221 - Temporary Files are created as sparse files
    Do update the message if the OS is different.
    Regards,
    Nilesh

  • ASM init.ora

    Can you provide me a ASM init.ora config - Best Practice for 11.2.0.2

    Hi,
    The following parameters for ASM.ora
    ASM_DISKGROUPS
    ASM_DISKSTRING
    ASM_POWER_LIMIT
    ASM_PREFERRED_READ_FAILURE_GROUPS
    DB_CACHE_SIZE
    DIAGNOSTIC_DEST
    INSTANCE_TYPE
    LARGE_POOL_SIZE
    PROCESSES
    REMOTE_LOGIN_PASSWORDFILE
    SHARED_POOL_SIZE
    see this link
    http://download.oracle.com/docs/cd/B28359_01/server.111/b31107/asminst.htm#BHCCEIDI :)

  • ASM issue ORA-00020: maximum number of processes (%s) exceeded (DBD ERROR)

    Hi All,
    i am running 10.2.0.3 with ASM (10.2.0.3) on SunOS (solaris 5.9)
    +ASM1> ps -ef | grep pmon
    oraunity  6174     1   0   Jan 01 ?         298:37 ora_pmon_UNITYQ1
    oraunity  6480     1   0   Dec 31 ?          84:21 asm_pmon_+ASM1
    oraunity  6085     1   0   Mar 09 ?         127:05 ora_pmon_UNIINFQ1
    oraunity 11442     1   0   Jan 01 ?         253:54 ora_pmon_UNIDWHQ1One of rdbms instanace UNIINFQ1 got some failuer due to archival error 'ORA-00257:Archiver error:connect internal only:until freed.'
    To drill down that, i tried to log in to +ASM1 instance to see space utilization under ARCH destination
    SQL> show parameter db_name
    NAME                                 TYPE        VALUE
    db_name                              string      UNIINFQ1
    log_archive_dest                     string      +UNITY_DG1/UNIINFQ1/archi tried following to log in to +ASM1
    UNITYQ1> export ORACLE_SID=+ASM1
    +ASM1> echo $ORACLE_SID
    +ASM1
    +ASM1> export ORACLE_HOME=/unity-rc001-q/ora01/app/oracle/product/10.2.0/asm10g
    +ASM1> echo $ORACLE_HOME
    /unity-rc001-q/ora01/app/oracle/product/10.2.0/asm10g
    +ASM1> sqlplus / as sysdba
    SQL*Plus: Release 10.2.0.3.0 - Production on Wed Jun 10 00:44:35 2009
    Copyright (c) 1982, 2006, Oracle.  All Rights Reserved.
    Connected.
    SQL> select * from v$instance;
    select * from v$instance
    ERROR at line 1:
    ORA-01012: not logged onthen i did following
    +ASM1> asmcmd
    ORA-00020: maximum number of processes (%s) exceeded (DBD ERROR: OCISessionBegin)
    [oraunity] mhs-clust5-qa:/unity-rc001-q/ora01/app/oracle/admin/UNIINFQ1/bdump:i have also noticed high number of BEQUETH connections to +ASM1 instance
    +ASM1> ps -ef | grep +ASM1
    oraunity  6486     1   0   Dec 31 ?         193:20 asm_lmon_+ASM1
    oraunity  6533     1   0   Dec 31 ?          11:49 asm_ckpt_+ASM1
    oraunity  6482     1   0   Dec 31 ?         108:29 asm_diag_+ASM1
    oraunity  6527     1   0   Dec 31 ?           9:28 asm_mman_+ASM1
    oraunity  6210     1   0   Mar 09 ?           8:03 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity  6484     1   0   Dec 31 ?           7:40 asm_psp0_+ASM1
    oraunity  6488     1   0   Dec 31 ?         221:17 asm_lmd0_+ASM1
    oraunity  6480     1   0   Dec 31 ?          84:21 asm_pmon_+ASM1
    oraunity  6529     1   0   Dec 31 ?           8:42 asm_dbw0_+ASM1
    oraunity  6535     1   0   Dec 31 ?           6:45 asm_smon_+ASM1
    oraunity  6523     1   0   Dec 31 ?         241:24 asm_lms0_+ASM1
    oraunity  6531     1   0   Dec 31 ?           9:22 asm_lgwr_+ASM1
    oraunity  6537     1   0   Dec 31 ?           9:03 asm_rbal_+ASM1
    oraunity  6539     1   0   Dec 31 ?          14:36 asm_gmon_+ASM1
    oraunity  6575     1   0   Dec 31 ?          45:59 asm_lck0_+ASM1
    oraunity  6328     1   0   Jan 01 ?          15:08 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity  7866     1   0 16:09:10 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity  6941     1   0 16:24:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 11553     1   0   Jan 01 ?          42:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity  5010     1   0 16:23:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity  1171     1   0 16:21:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 26147     1   0 16:18:49 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 17948     1   0 16:14:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 16097     1   0 16:13:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 19867     1   0 16:15:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 14221     1   0 16:12:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 25640  4784   0 02:36:15 pts/4       0:00 grep +ASM1
    oraunity  8513     1   0 16:09:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 23732     1   0 16:17:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity  7864     1   0 16:09:09 ?           0:19 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity  3109     1   0 16:22:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 27439     1   0 16:19:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 10400     1   0 16:10:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity  5588     1   0 16:23:49 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 16667     1   0 16:13:48 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 21832     1   0 16:16:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 12308     1   0 16:11:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 29330     1   0 16:20:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))
    oraunity 25581     1   0 16:18:30 ?           0:00 oracle+ASM1 (DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))Can anyone help me to solve this issue without shutting down +ASM1. (this instance is used by rest 3 databases as well..so down time is not feasible)
    Regards,
    Bhavik Desai

    You should check alert log file on database like Alex told you.
    And please post Error ;)
    But If You can access +ASM, Or ...by the way... if you stop database ... try to check ASM diskgroup.
    $ export ORACLE_SID=+ASM1
    $ sqlplus / as sysdba
    SQL> set lines 130
    SQL> set pages 10000
    SQL> select NAME, TOTAL_MB, FREE_MB from v$asm_diskgroup;
    If your DISKGROUPs for archivelog on DB full... backup or delete them
    (please start database mount mode)
    $ export ORACLE_SID=DB1
    $ sqlplus / as sysdba
    SQL> startup mount;
    SQL> show parameter log_archive_dest
    backup archivelog
    $ rman target /
    RMAN> backup ARCHIVELOG ALL DELETE INPUT format 'ARCH_%d_%U' ;
    or delete
    $ rman target /
    RMAN> delete ARCHIVELOG ALL ;
    After that ...
    $ sqlplus / as sysdba
    SQL> alter database open
    This justs my suggestion, if your database has the problem with ASM diskgroup full ... because archvielog...
    By the way... please post your result from ASM query and alert log file
    Good Luck

  • RMAN 恢复至ASM DISKGROUP 报错 ORA 19870 19504 15045 17502 15081

    问题简单描述：
    AIX 6, ORACLE 11.2
    1.替换原来存储，也就是说用新存储B 把原来的A 存储替换掉， 数据库原来是跑到A 存储上的。
    2.我把数据库shutdown 然后 startup mount 后做一致备份到本地磁盘/oracle/rman_bak1201/
    3.删除原来的ASM DISKGROUP ，然后删除磁盘（踢掉旧存储）
    4.新存储映射磁盘到主机，然后重新建立ASM DISKGROUP DATA 成功 （原来的DISKGROUP 名字也是 DATA, 所以新diskgroup_name 与旧 diskgroup_name 相同 。曾尝试建立数据库test 成功，查看diskgroup 状态为mounted 也正常）
    存储替换完毕
    5.把先前的备份尝试恢复到新建的 ASM DISKGROUP DATA
    6.用startup nomount pfile='/oracle/rman_bak1201/abc.ora' 启动，尝试恢复时报错 （pfile 是我从原库 create pfile='xxxx' from spfile 备份的）
    RMAN> restore controlfile from '/oracle/rman_bak1201/c_0jnrov15_1_1';
    Starting restore at 01-DEC-12
    using channel ORA_DISK_1     
    channel ORA_DISK_1: restoring control file
    RMAN-00571: ========================================================
    RMAN-00569: ==========ERROR MESSAGE STACK FOLLOWS===================
    RMAN-00571: ========================================================
    RMAN-03002: failure of restore command at 12/01/2012 17:50:54
    ORA-19870: error while restoring backup piece /oracle/rman_bak1201/c_0jnrov15_1_1
    ORA-19504: failed to create file "+DATA"
    ORA-15045: ASM file name '+DATA' is not in reference form
    ORA-17502: ksfdcre:5 Failed to create file +DATA
    ORA-15081: failed to submit an I/O operation to a disk
    网上搜了下说是rhdisk权限问题, 但我新的diskgroup 用DBCA 建库都正常，所以不解，请支招谢谢。

    问题解决，诊断思路是tail -f alert*.log，然后从新尝试restore controlfile 发现有关于/dev/rhdisk* permission deny ，故问题就是rhdisk* 权限的问题，修改权限后重启+ASM 实例后顺利恢复。
    后来我把rhdisk* 权限改成了 666 oracle dba 重启就好了（在此说明当初实施的人规划的grid和oracle用户同时属于oinstall 和dba组，两个用户其实是相同的权限，看样子比较混乱，我也没心思从头整理了简单666 解决）
    但现在还有个疑问就是：
    1. 为什么我设置跟人家原来的授权 crw-rw---- grid dba rhidk2 却不能恢复？ 但是通过dbca 用oracle 用户建立新库一点问题都没有。

  • Unable to Create ASM Diskgroup ORA-15020 and ORA-15018

    Hello Team,
    Unable to create ASM diskgroup with following error:
    SQL> create diskgroup data_asm1 external redundancy disk '/dev/sdf*';
    create diskgroup data_asm1 external redundancy disk '/dev/sdf*'
    ERROR at line 1:
    ORA-15018: diskgroup cannot be created
    ORA-15020: discovered duplicate ASM disk "DATA_ASM1_0000"
    ASM Diskstring
    SQL> show parameter asm_diskstring
    NAME                                 TYPE        VALUE
    asm_diskstring                       string      /dev/oracleasm/disks/DISK*, /dev/sd*
    Please let me know how to i solve this issue
    Regards,

    Hi Tobi,
    I checked the status of the res GRID.dg ... it was offline on second node. Logged on second node and checked the status of it viz:v$asm_diskgroup, it was dismount. I mounted it and then try to add the newly added diskgroup(+GRID) with OCR and viola it worked....
    ========================================================
    ora.GRID.dg
                   ONLINE  ONLINE       rac3                                       
                   OFFLINE OFFLINE      rac4                                       
    SQL> select group_number,name,state,type from v$asm_diskgroup;
    GROUP_NUMBER NAME                           STATE       TYPE
               1 DATA                           MOUNTED     EXTERN
               0 GRID                           DISMOUNTED
    SQL> alter diskgroup grid mount;
    Diskgroup altered.
    SQL>  select group_number,name,state,type from v$asm_diskgroup;
    GROUP_NUMBER NAME                           STATE       TYPE
               1 DATA                           MOUNTED     EXTERN
               2 GRID                           MOUNTED     EXTERN
    ==============================================
    ora.GRID.dg
                   ONLINE  ONLINE       rac3                                       
                   ONLINE  ONLINE       rac4                                       
    ===============================================
    [root@rac3 bin]# ./ocrcheck
    Status of Oracle Cluster Registry is as follows :
             Version                  :          3
             Total space (kbytes)     :     262120
             Used space (kbytes)      :       2804
             Available space (kbytes) :     259316
             ID                       :   48011651
             Device/File Name         :      +DATA
                                        Device/File integrity check succeeded
             Device/File Name         :      +grid
                                        Device/File integrity check succeeded
                                        Device/File not configured
                                        Device/File not configured
                                        Device/File not configured
             Cluster registry integrity check succeeded
             Logical corruption check succeeded
    ==========================================================================================
    ASMCMD> lsdg
    State    Type    Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
    MOUNTED  EXTERN  N         512   4096  1048576     20472    16263                0           16263              0             N  DATA/
    MOUNTED  EXTERN  N         512   4096  1048576      5114     4751                0            4751              0             N  GRID/
    ======================================================================================================
    Thank you very much, appreciated..
    Thank you Aritra .
    Guys you rock.
    Regards,

  • How to clear Error alerts ORA-01219 on standby databases

    Hello all
    I'm using EM 10.1.0.5. Some weeks ago, we did an upgrade of our standby databases to 10.2.0.4. At that moment, we got many alerts of type Error: ORA-0219: database not open, queries allowed on fixed tables/views only. That's right, these databases are not open. Now I'm getting tired of seeing these 130 messages every day, I would like to delete them. But I cannot ! I removed several alerts of type Warning by setting the threshold value of the metric to NULL and then back again. This works fine. But I cannot use the same procedure for Error alerts, because I do not find these metrics. Example: the metric Streams Capture Message Statistics is displayed on the All Metrics page, but NOT on the Metric and Policy Settings page (selecting All Metrics in the drop down list). Apart from upgrading the EM to 10.2.0.4, is there a way to remove these Error alerts ?
    Thank you for any advice
    pher

    I have checked my 10.2.0.4 OMS and the "Streams Capture Message Statistics" metrics are not displayed on the Metric and Policy Settings page either. This looks like it could be a bug. You might bnefit from raising an SR with Oracle support. In the meantime I will continue to seek a resolution.

  • Database Control Alerts ORA-01034

    Why am I getting these alerts on email every day (I have Oracle Standard Edition 11.2.0.3 on Linux 64bit) :
    Target Name=db.myserver.com
    Target Type=Database Instance
    Host=srv.myserver.com
    Metric=Status
    Metric Value=0
    Timestamp=Jun 3, 2012 3:10:16 AM EDT
    Severity=Critical
    Message=Failed to connect to database instance: ORA-01034: ORACLE not available.
    Notification Rule Name=Failed Backups
    Notification Rule Owner=SYS
    Notification Count=1
    Target Name=db.myserver.com
    Target Type=Database Instance
    Host=srv.myserver.com
    Metric=Status
    Metric Value=0
    Timestamp=Jun 3, 2012 3:10:16 AM EDT
    Severity=Critical
    Message=Failed to connect to database instance: ORA-01034: ORACLE not available.
    Notification Rule Name=Database Availability and Critical States
    Notification Rule Owner=SYSMAN
    Notification Count=1
    Edited by: CommitMan on Jun 3, 2012 7:48 PM
    Edited by: CommitMan on Jun 3, 2012 7:49 PM

    The notification rules,"Failed Backups" and "Database Availability and Critical States", triggered the mail notifications. Verify whether database instance was down around Jun 3, 2012 3:10:16 AM EDT. The database's alert log file should tell you when the database was stopped and started.
    To view notification rules: go to Preferences > (Notification) Rules.
    Hope this helps.
    - Loc

  • Root.sh fails on 11.2.0.3 clusterware while starting 'ora.asm' resource

    Dear all,
    I am trying to install clean Oracle 11.2.0.3 grid infrastructure on a two node cluster running on Solaris 5.10.
    - Cluster verification was successfully on both nodes; No warning or issues;
    - I am using 2 network cards for the public and 2 for the private interconnect;
    - OCR is stored on ASM
    - Firewall is disabled on both nodes
    - SCAN is being configured on the DNS (not added in /etc/hosts)
    - GNS is not used
    - hosts file is identical (except the primary hostname)
    The problem: root.sh fails on the 2nd (remote) node, because it fails to start the "ora.asm" resource. However, the root.sh has completed successfully on the 1st node.. Somehow, root.sh doesn't create +ASM2 instance on the remote (host2) node.
    root.sh was executed first on the local node (host1) and after the successful execution was started on the remote (host2) node.
    Output from host1 (working):
    ===================
    Adding Clusterware entries to inittab
    CRS-2672: Attempting to start 'ora.mdnsd' on 'host1'
    CRS-2676: Start of 'ora.mdnsd' on 'host1' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'host1'
    CRS-2676: Start of 'ora.gpnpd' on 'host1' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'host1'
    CRS-2672: Attempting to start 'ora.gipcd' on 'host1'
    CRS-2676: Start of 'ora.cssdmonitor' on 'host1' succeeded
    CRS-2676: Start of 'ora.gipcd' on 'host1' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'host1'
    CRS-2672: Attempting to start 'ora.diskmon' on 'host1'
    CRS-2676: Start of 'ora.diskmon' on 'host1' succeeded
    CRS-2676: Start of 'ora.cssd' on 'host1' succeeded
    ASM created and started successfully.
    Disk Group CRS created successfully.
    clscfg: -install mode specified
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    CRS-4256: Updating the profile
    Successful addition of voting disk 4373be34efab4f01bf79f6c5362acfd3.
    Successful addition of voting disk 7fd725fa4d904f07bf76cecf96791547.
    Successful addition of voting disk a9c85297bdd74f3abfd86899205aaf17.
    Successfully replaced voting disk group with +CRS.
    CRS-4256: Updating the profile
    CRS-4266: Voting file(s) successfully replaced
    ## STATE File Universal Id File Name Disk group
    1. ONLINE 4373be34efab4f01bf79f6c5362acfd3 (/dev/rdsk/c4t600A0B80006E2CC40000C6674E82AA57d0s4) [CRS]
    2. ONLINE 7fd725fa4d904f07bf76cecf96791547 (/dev/rdsk/c4t600A0B80006E2CC40000C6694E82AADDd0s4) [CRS]
    3. ONLINE a9c85297bdd74f3abfd86899205aaf17 (/dev/rdsk/c4t600A0B80006E2F100000C7744E82AC7Ad0s4) [CRS]
    Located 3 voting disk(s).
    CRS-2672: Attempting to start 'ora.asm' on 'host1'
    CRS-2676: Start of 'ora.asm' on 'host1' succeeded
    CRS-2672: Attempting to start 'ora.CRS.dg' on 'host1'
    CRS-2676: Start of 'ora.CRS.dg' on 'host1' succeeded
    CRS-2672: Attempting to start 'ora.registry.acfs' on 'host1'
    CRS-2676: Start of 'ora.registry.acfs' on 'host1' succeeded
    Configure Oracle Grid Infrastructure for a Cluster ... succeeded
    Name Type Target State Host
    ora.CRS.dg ora....up.type ONLINE ONLINE host1
    ora....ER.lsnr ora....er.type ONLINE ONLINE host1
    ora....N1.lsnr ora....er.type ONLINE ONLINE host1
    ora....N2.lsnr ora....er.type ONLINE ONLINE host1
    ora....N3.lsnr ora....er.type ONLINE ONLINE host1
    ora.asm ora.asm.type ONLINE ONLINE host1
    ora....SM1.asm application ONLINE ONLINE host1
    ora....B1.lsnr application ONLINE ONLINE host1
    ora....db1.gsd application OFFLINE OFFLINE
    ora....db1.ons application ONLINE ONLINE host1
    ora....db1.vip ora....t1.type ONLINE ONLINE host1
    ora.cvu ora.cvu.type ONLINE ONLINE host1
    ora.gsd ora.gsd.type OFFLINE OFFLINE
    ora....network ora....rk.type ONLINE ONLINE host1
    ora.oc4j ora.oc4j.type ONLINE ONLINE host1
    ora.ons ora.ons.type ONLINE ONLINE host1
    ora....ry.acfs ora....fs.type ONLINE ONLINE host1
    ora.scan1.vip ora....ip.type ONLINE ONLINE host1
    ora.scan2.vip ora....ip.type ONLINE ONLINE host1
    ora.scan3.vip ora....ip.type ONLINE ONLINE host1
    Output from host2 (failing):
    ===================
    OLR initialization - successful
    Adding Clusterware entries to inittab
    CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node billdb1, number 1, and is terminating
    An active cluster was found during exclusive startup, restarting to join the cluster
    Start of resource "ora.asm" failed
    CRS-2672: Attempting to start 'ora.drivers.acfs' on 'host2'
    CRS-2676: Start of 'ora.drivers.acfs' on 'host2' succeeded
    CRS-2672: Attempting to start 'ora.asm' on 'host2'
    CRS-5017: The resource action "ora.asm start" encountered the following error:
    ORA-03113: end-of-file on communication channel
    Process ID: 0
    Session ID: 0 Serial number: 0
    *. For details refer to "(:CLSN00107:)" in "/u01/11.2.0/grid/log/host2/agent/ohasd/oraagent_grid/oraagent_grid.log".*
    CRS-2674: Start of 'ora.asm' on 'host2' failed
    CRS-2679: Attempting to clean 'ora.asm' on 'host2'
    CRS-2681: Clean of 'ora.asm' on 'host2' succeeded
    CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'host2'
    CRS-2677: Stop of 'ora.drivers.acfs' on 'host2' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    Failed to start Oracle Grid Infrastructure stack
    Failed to start ASM at /u01/11.2.0/grid/crs/install/crsconfig_lib.pm line 1272.
    /u01/11.2.0/grid/perl/bin/perl -I/u01/11.2.0/grid/perl/lib -I/u01/11.2.0/grid/crs/install /u01/11.2.0/grid/crs/install/rootcrs.pl execution failed
    Contents of "/u01/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_host2.log"
    =============================================
    CRS-2672: Attempting to start 'ora.asm' on 'host2'
    CRS-5017: The resource action "ora.asm start" encountered the following error:
    ORA-03113: end-of-file on communication channel
    Process ID: 0
    Session ID: 0 Serial number: 0
    . For details refer to "(:CLSN00107:)" in "/u01/11.2.0/grid/log/host2/agent/ohasd/oraagent_grid/oraagent_grid.log".
    CRS-2674: Start of 'ora.asm' on 'host2' failed
    CRS-2679: Attempting to clean 'ora.asm' on 'host2'
    CRS-2681: Clean of 'ora.asm' on 'host2' succeeded
    CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'host2'
    CRS-2677: Stop of 'ora.drivers.acfs' on 'host2' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    2011-10-24 19:36:54: Failed to start Oracle Grid Infrastructure stack
    2011-10-24 19:36:54: ###### Begin DIE Stack Trace ######
    2011-10-24 19:36:54: Package File Line Calling
    2011-10-24 19:36:54: --------------- -------------------- ---- ----------
    2011-10-24 19:36:54: 1: main rootcrs.pl 375 crsconfig_lib::dietrap
    2011-10-24 19:36:54: 2: crsconfig_lib crsconfig_lib.pm 1272 main::__ANON__
    2011-10-24 19:36:54: 3: crsconfig_lib crsconfig_lib.pm 1171 crsconfig_lib::start_cluster
    2011-10-24 19:36:54: 4: main rootcrs.pl 803 crsconfig_lib::perform_start_cluster
    2011-10-24 19:36:54: ####### End DIE Stack Trace #######
    Shortened output from "/u01/11.2.0/grid/log/host2/agent/ohasd/oraagent_grid/oraagent_grid.log"
    2011-10-24 19:35:48.726: [ora.asm][9] {0:0:224} [start] clean {
    2011-10-24 19:35:48.726: [ora.asm][9] {0:0:224} [start] InstAgent::stop_option stop mode immediate option 1
    2011-10-24 19:35:48.726: [ora.asm][9] {0:0:224} [start] InstAgent::stop {
    2011-10-24 19:35:48.727: [ora.asm][9] {0:0:224} [start] InstAgent::stop original reason system do shutdown abort
    2011-10-24 19:35:48.727: [ora.asm][9] {0:0:224} [start] ConnectionPool::resetConnection s_statusOfConnectionMap 00ab1948
    2011-10-24 19:35:48.727: [ora.asm][9] {0:0:224} [start] ConnectionPool::resetConnection sid +ASM2 status  2
    2011-10-24 19:35:48.728: [ora.asm][9] {0:0:224} [start] Gimh::check OH /u01/11.2.0/grid SID +ASM2
    2011-10-24 19:35:48.728: [ora.asm][9] {0:0:224} [start] Gimh::check condition changes to (GIMH_NEXT_NUM) 0,1,7 exists
    2011-10-24 19:35:48.729: [ora.asm][9] {0:0:224} [start] (:CLSN00006:)AsmAgent::check failed gimh state 0
    2011-10-24 19:35:48.729: [ora.asm][9] {0:0:224} [start] AsmAgent::check ocrCheck 1 m_OcrOnline 0 m_OcrTimer 0
    2011-10-24 19:35:48.729: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet { entry
    2011-10-24 19:35:48.730: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet procr_get_conf: retval [0] configured [1] local only [0] error buffer []
    2011-10-24 19:35:48.730: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet procr_get_conf: OCR loc [0], Disk Group : [+CRS]
    2011-10-24 19:35:48.730: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet m_ocrDgpSet 015fba90 dgName CRS
    2011-10-24 19:35:48.731: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet ocrret 0 found 1
    2011-10-24 19:35:48.731: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet ocrDgpSet CRS
    2011-10-24 19:35:48.731: [ora.asm][9] {0:0:224} [start] DgpAgent::initOcrDgpSet exit }
    2011-10-24 19:35:48.731: [ora.asm][9] {0:0:224} [start] DgpAgent::ocrDgCheck Entry {
    2011-10-24 19:35:48.732: [ora.asm][9] {0:0:224} [start] DgpAgent::getConnxn new pool
    2011-10-24 19:35:48.732: [ora.asm][9] {0:0:224} [start] DgpAgent::getConnxn new pool m_oracleHome:/u01/11.2.0/grid m_oracleSid:+ASM2 m_usrOraEnv:
    2011-10-24 19:35:48.732: [ora.asm][9] {0:0:224} [start] ConnectionPool::ConnectionPool 2 m_oracleHome:/u01/11.2.0/grid, m_oracleSid:+ASM2, m_usrOraEnv:
    2011-10-24 19:35:48.733: [ora.asm][9] {0:0:224} [start] ConnectionPool::addConnection m_oracleHome:/u01/11.2.0/grid m_oracleSid:+ASM2 m_usrOraEnv: pConnxn:
    01fcdf10
    2011-10-24 19:35:48.733: [ora.asm][9] {0:0:224} [start] Utils::getCrsHome crsHome /u01/11.2.0/grid
    2011-10-24 19:35:51.969: [ora.asm][14] {0:0:224} [check] makeConnectStr = (DESCRIPTION=(ADDRESS=(PROTOCOL=beq)(PROGRAM=/u01/11.2.0/grid/bin/oracle)(ARGV0=o
    racle+ASM2)(ENVS='ORACLE_HOME=/u01/11.2.0/grid,ORACLE_SID=+ASM2')(ARGS='(DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))'))(CONNECT_DATA=(SID=+ASM2)))
    2011-10-24 19:35:51.971: [ora.asm][14] {0:0:224} [check] ConnectionPool::getConnection 260 pConnxn 013e40a0
    2011-10-24 19:35:51.971: [ora.asm][14] {0:0:224} [check] DgpAgent::getConnxn connected
    2011-10-24 19:35:51.971: [ora.asm][14] {0:0:224} [check] InstConnection::connectInt: server not attached
    2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] ORA-01034: ORACLE not available
    ORA-27101: shared memory realm does not exist
    SVR4 Error: 2: No such file or directory
    Process ID: 0
    Session ID: 0 Serial number: 0
    2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] InstConnection::connectInt (2) Exception OCIException
    2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] InstConnection:connect:excp OCIException OCI error 1034
    2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] DgpAgent::queryDgStatus excp ORA-01034: ORACLE not available
    ORA-27101: shared memory realm does not exist
    SVR4 Error: 2: No such file or directory
    Process ID: 0
    Session ID: 0 Serial number: 0
    2011-10-24 19:35:52.190: [ora.asm][14] {0:0:224} [check] DgpAgent::queryDgStatus asm inst is down or going down
    2011-10-24 19:35:52.191: [ora.asm][14] {0:0:224} [check] DgpAgent::queryDgStatus dgName CRS ret 1
    2011-10-24 19:35:52.191: [ora.asm][14] {0:0:224} [check] (:CLSN00100:)DgpAgent::ocrDgCheck OCR dgName CRS state 1
    2011-10-24 19:35:52.192: [ora.asm][14] {0:0:224} [check] ConnectionPool::releaseConnection InstConnection 013e40a0
    2011-10-24 19:35:52.192: [ora.asm][14] {0:0:224} [check] AsmAgent::check ocrCheck 2 m_OcrOnline 0 m_OcrTimer 0
    2011-10-24 19:35:52.193: [ora.asm][14] {0:0:224} [check] CrsCmd::ClscrsCmdData::stat entity 1 statflag 32 useFilter 0
    2011-10-24 19:35:52.197: [ COMMCRS][23]clsc_connect: (1020d39d0) no listener at (ADDRESS=(PROTOCOL=IPC)(KEY=CRSD_UI_SOCKET))
    Please advice for any workaround or a metalink note.
    Thanks in advance!

    Thanks for the fast reply!
    - Yes, the shared storage is accessible.
    - The alert log for the +ASM2 clearly shows that ASM instance has started normally using default parameters and at one point PMON process dumped.
    - The system logs just shows that there is an error executing "crswrapexece.pl"
    System Log
    ===================
    *Oct 24 19:25:03 host2 root: [ID 702911 user.error] exec /u01/11.2.0/grid/perl/bin/perl -I/u01/11.2.0/grid/perl/lib /u01/11.2.0/grid/bin/crswrapexece.pl /*
    u01/11.2.0/grid/crs/install/s_crsconfig_host2_env.txt /u01/11.2.0/grid/bin/ohasd.bin "reboot"
    Oct 24 19:26:33 host2 oracleoks: [ID 902884 kern.notice] [Oracle OKS] mallocing log buffer, size=10485760
    Oct 24 19:26:33 host2 oracleoks: [ID 714332 kern.notice] [Oracle OKS] log buffer = 0x301780fcb50, size 10485760
    Oct 24 19:26:33 host2 oracleoks: [ID 400061 kern.notice] NOTICE: [Oracle OKS] ODLM hash size 16384
    Oct 24 19:26:33 host2 oracleoks: [ID 160659 kern.notice] NOTICE: OKSK-00004: Module load succeeded. Build information: (LOW DEBUG) USM_11.2.0.3.0_SOLAR
    IS.SPARC64_110803.1 2011/08/11 02:38:30
    Oct 24 19:26:33 host2 pseudo: [ID 129642 kern.info] pseudo-device: oracleadvm0
    Oct 24 19:26:33 host2 genunix: [ID 936769 kern.info] oracleadvm0 is /pseudo/oracleadvm@0
    Oct 24 19:26:33 host2 oracleoks: [ID 141287 kern.notice] NOTICE: ADVMK-00001: Module load succeeded. Build information: (LOW DEBUG) - USM_11.2.0.3.0_SOL
    ARIS.SPARC64_110803.1 built on 2011/08/11 02:40:17.
    Oct 24 19:26:33 host2 oracleacfs: [ID 202941 kern.notice] NOTICE: [Oracle ACFS] FCB hash size 16384
    Oct 24 19:26:33 host2 oracleacfs: [ID 671725 kern.notice] NOTICE: [Oracle ACFS] buffer cache size 511MB (79884 buckets)
    Oct 24 19:26:33 host2 oracleacfs: [ID 730054 kern.notice] NOTICE: [Oracle ACFS] DLM hash size 16384
    Oct 24 19:26:33 host2 oracleoks: [ID 617314 kern.notice] NOTICE: ACFSK-0037: Module load succeeded. Build information: (LOW DEBUG) USM_11.2.0.3.0_SOLAR
    IS.SPARC64_110803.1 2011/08/11 02:42:45
    Oct 24 19:26:33 host2 pseudo: [ID 129642 kern.info] pseudo-device: oracleacfs0
    Oct 24 19:26:33 host2 genunix: [ID 936769 kern.info] oracleacfs0 is /pseudo/oracleacfs@0
    Oct 24 19:26:36 host2 oracleoks: [ID 621795 kern.notice] NOTICE: OKSK-00010: Persistent OKS log opened at /u01/11.2.0/grid/log/host2/acfs/acfs.log.0.
    Oct 24 19:31:37 host2 last message repeated 1 time
    Oct 24 19:33:05 host2 CLSD: [ID 770310 daemon.notice] The clock on host host2 has been updated by the Cluster Time Synchronization Service to be synchr
    onous with the mean cluster time.
    ASM alert log
    ====================================================================
    <msg time='2011-10-24T19:35:48.776+01:00' org_id='oracle' comp_id='asm'
    client_id='' type='UNKNOWN' level='16'
    host_id='host2' host_addr='10.172.16.200' module=''
    pid='26406'>
    <txt>System state dump requested by (instance=2, osid=26396 (PMON)), summary=[abnormal instance termination].
    </txt>
    </msg>
    <msg time='2011-10-24T19:35:48.778+01:00' org_id='oracle' comp_id='asm'
    client_id='' type='UNKNOWN' level='16'
    host_id='host2' host_addr='10.172.16.200' module=''
    pid='26406'>
    <txt>System State dumped to trace file /u01/app/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_diag_26406.trc
    </txt>
    </msg>
    <msg time='2011-10-24T19:35:48.927+01:00' org_id='oracle' comp_id='asm'
    type='UNKNOWN' level='16' host_id='host2'
    host_addr='10.172.16.200' pid='26470'>
    <txt>ORA-1092 : opitsk aborting process
    </txt>
    </msg>
    <msg time='2011-10-24T19:35:49.128+01:00' org_id='oracle' comp_id='asm'
    type='UNKNOWN' level='16' host_id='host2'
    host_addr='10.172.16.200' pid='26472'>
    <txt>ORA-1092 : opitsk aborting process
    </txt>
    </msg>
    Output from "/u01/app/oracle/diag/asm/+asm/+ASM2/trace/+ASM2_diag_26406.trc"
    REQUEST:system state dump at level 10, requested by (instance=2, osid=26396 (PMON)), summary=[abnormal instance termination].
    kjzdattdlm: Can not attach to DLM (LMON up=[TRUE], DB mounted=[FALSE]).
    ===================================================
    SYSTEM STATE (level=10)
    Orapids on dead process list: [count = 0]
    PROCESS 1:
    SO: 0x3df098b50, type: 2, owner: 0x0, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
    proc=0x3df098b50, name=process, file=ksu.h LINE:12616 ID:, pg=0
    (process) Oracle pid:1, ser:0, calls cur/top: 0x0/0x0
    flags : (0x20) PSEUDO
    flags2: (0x0), flags3: (0x10)
    intr error: 0, call error: 0, sess error: 0, txn error 0
    intr queue: empty
    ksudlp FALSE at location: 0
    (post info) last post received: 0 0 0
    last post received-location: No post
    last process to post me: none
    last post sent: 0 0 0
    last post sent-location: No post
    last process posted by me: none
    (latch info) wait_event=0 bits=0
    O/S info: user: , term: , ospid: (DEAD)
    OSD pid info: Unix process pid: 0, image: PSEUDO
    SO: 0x38000cef0, type: 5, owner: 0x3df098b50, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
    proc=0x0, name=kss parent, file=kss2.h LINE:138 ID:, pg=0
    PSO child state object changes :
    Dump of memory from 0x00000003DF722AC0 to 0x00000003DF722CC8
    3DF722AC0 00000000 00000000 00000000 00000000 [................]
    Repeat 31 times
    3DF722CC0 00000000 00000000 [........]
    PROCESS 2: PMON
    SO: 0x3df099bf8, type: 2, owner: 0x0, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
    proc=0x3df099bf8, name=process, file=ksu.h LINE:12616 ID:, pg=0
    (process) Oracle pid:2, ser:1, calls cur/top: 0x3db6c8d30/0x3db6c8d30
    flags : (0xe) SYSTEM
    flags2: (0x0), flags3: (0x10)
    intr error: 0, call error: 0, sess error: 0, txn error 0
    intr queue: empty
    ksudlp FALSE at location: 0
    (post info) last post received: 0 0 136
    last post received-location: kjm.h LINE:1228 ID:kjmdmi: pmon to attach
    last process to post me: 3df0a2138 1 6
    last post sent: 0 0 137
    last post sent-location: kjm.h LINE:1230 ID:kjiath: pmon attached
    last process posted by me: 3df0a2138 1 6
    (latch info) wait_event=0 bits=0
    Process Group: DEFAULT, pseudo proc: 0x3debbbf40
    O/S info: user: grid, term: UNKNOWN, ospid: 26396
    OSD pid info: Unix process pid: 26396, image: oracle@host2 (PMON)
    SO: 0x3d8800c18, type: 30, owner: 0x3df099bf8, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
    proc=0x3df099bf8, name=ges process, file=kji.h LINE:3669 ID:, pg=0
    GES MSG BUFFERS: st=emp chunk=0x0 hdr=0x0 lnk=0x0 flags=0x0 inc=0
    outq=0 sndq=0 opid=0 prmb=0x0
    mbg=(0 0) mbg=(0 0) mbg[r]=(0 0)
    fmq=(0 0) fmq=(0 0) fmq[r]=(0 0)
    mop[s]=0 mop[q]=0 pendq=0 zmbq=0
    nonksxp_recvs=0
    ------------process 3d8800c18--------------------
    proc version : 0
    Local inst : 2
    pid : 26396
    lkp_inst : 2
    svr_mode : 0
    proc state : KJP_FROZEN
    Last drm hb acked : 0
    flags : x50
    ast_rcvd_svrmod : 0
    current lock op : 0
    Total accesses : 1
    Imm. accesses : 0
    Locks on ASTQ : 0
    Locks Pending AST : 0
    Granted locks : 0
    AST_Q:
    PENDING_Q:
    GRANTED_Q:
    SO: 0x3d9835198, type: 14, owner: 0x3df099bf8, flag: INIT/-/-/0x00 if: 0x1 c: 0x1
    proc=0x3df099bf8, name=channel handle, file=ksr2.h LINE:367 ID:, pg=0
    (broadcast handle) 3d9835198 flag: (2) ACTIVE SUBSCRIBER,
    owner: 3df099bf8 - ospid: 26396
    event: 1, last message event: 1,
    last message waited event: 1,
    next message: 0(0), messages read: 0
    channel: (3d9934df8) PMON actions channel [name: 2]
    scope: 7, event: 1, last mesage event: 0,
    publishers/subscribers: 0/1,
    messages published: 0
    heuristic msg queue length: 0
    SO: 0x3d9835008, type: 14, owner: 0x3df099bf8, flag: INIT/-/-/0x00 if: 0x1 c: 0x1
    proc=0x3df099bf8, name=channel handle, file=ksr2.h LINE:367 ID:, pg=0
    (broadcast handle) 3d9835008 flag: (2) ACTIVE SUBSCRIBER,
    owner: 3df099bf8 - ospid: 26396
    event: 1, last message event: 1,
    last message waited event: 1,
    next message: 0(0), messages read: 0
    channel: (3d9941e40) scumnt mount lock [name: 157]
    scope: 1, event: 12, last mesage event: 0,
    publishers/subscribers: 0/12,
    messages published: 0
    heuristic msg queue length: 0
    SO: 0x3de4a2b80, type: 4, owner: 0x3df099bf8, flag: INIT/-/-/0x00 if: 0x3 c: 0x3
    proc=0x3df099bf8, name=session, file=ksu.h LINE:12624 ID:, pg=0
    (session) sid: 33 ser: 1 trans: 0x0, creator: 0x3df099bf8
    flags: (0x51) USR/- flags_idl: (0x1) BSY/-/-/-/-/-
    flags2: (0x409) -/-/INC
    DID: , short-term DID:
    txn branch: 0x0
    oct: 0, prv: 0, sql: 0x0, psql: 0x0, user: 0/SYS
    ksuxds FALSE at location: 0
    service name: SYS$BACKGROUND
    Current Wait Stack:
    Not in wait; last wait ended 0.666415 sec ago
    Wait State:
    fixed_waits=0 flags=0x21 boundary=0x0/-1
    Session Wait History:
    elapsed time of 0.666593 sec since last wait
    0: waited for 'pmon timer'
    duration=0x12c, =0x0, =0x0
    wait_id=63 seq_num=64 snap_id=1
    wait times: snap=3.000089 sec, exc=3.000089 sec, total=3.000089 sec
    wait times: max=3.000000 sec
    wait counts: calls=1 os=1
    occurred after 0.002067 sec of elapsed time
    1: waited for 'pmon timer'
    duration=0x12c, =0x0, =0x0
    wait_id=62 seq_num=63 snap_id=1
    wait times: snap=3.010111 sec, exc=3.010111 sec, total=3.010111 sec
    wait times: max=3.000000 sec
    wait counts: calls=1 os=1
    occurred after 0.001926 sec of elapsed time
    2: waited for 'pmon timer'
    duration=0x12c, =0x0, =0x0
    wait_id=61 seq_num=62 snap_id=1
    wait times: snap=3.125286 sec, exc=3.125286 sec, total=3.125286 sec
    wait times: max=3.000000 sec
    wait counts: calls=1 os=1
    occurred after 0.003361 sec of elapsed time
    3: waited for 'pmon timer'
    duration=0x12c, =0x0, =0x0
    wait_id=60 seq_num=61 snap_id=1
    wait times: snap=3.000081 sec, exc=3.000081 sec, total=3.000081 sec
    wait times: max=3.000000 sec
    wait counts: calls=1 os=1
    occurred after 0.002102 sec of elapsed time
    4: waited for 'pmon timer'
    duration=0x12c, =0x0, =0x0

  • ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating pr

    I'm running Oracle 11gR2 with ASM configuration on LINUX 5 and I noticed the following errors in the alert log. Any ideas.
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30988
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30572
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 32040
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 32179
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 29693
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30350
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30483
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30963
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 29907
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 29962
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 31000
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 29988
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30983
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 31900
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 32171
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 29901
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30456
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30475
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30069
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30899
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30403
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30540
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 29650
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30550
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30236
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 29673
    Tue Oct 18 14:10:51 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30888
    Tue Oct 18 14:10:52 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 30090
    Tue Oct 18 14:10:52 2011
    ERROR: unrecoverable error ORA-15032 raised in ASM I/O path; terminating process 29638

    this is what i'm getting in the asm alert.log
    Tue Oct 18 15:34:05 2011
    Errors in file /opt/bsaitmod/oracle/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_ora_6938.trc:
    ORA-27070: async read/write failed
    WARNING: IO Failed. group:0 disk(number.incarnation):7.0xe96844c9 disk_path:/dev/random
    AU:0 disk_offset(bytes):0 io_size:4096 operation:Read type:asynchronous
    result:I/O error process_id:6938
    Tue Oct 18 22:08:15 2011
    Errors in file /opt/bsaitmod/oracle/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_ora_18992.trc:
    ORA-27070: async read/write failed
    WARNING: IO Failed. group:0 disk(number.incarnation):7.0xe96844c9 disk_path:/dev/random
    AU:0 disk_offset(bytes):0 io_size:4096 operation:Read type:asynchronous
    result:I/O error process_id:18992
    Tue Oct 18 22:08:15 2011
    Errors in file /opt/bsaitmod/oracle/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_ora_18994.trc:
    ORA-27070: async read/write failed
    WARNING: IO Failed. group:0 disk(number.incarnation):7.0xe96844c9 disk_path:/dev/random
    AU:0 disk_offset(bytes):0 io_size:4096 operation:Read type:asynchronous
    result:I/O error process_id:18994
    Tue Oct 18 22:08:16 2011
    Errors in file /opt/bsaitmod/oracle/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_ora_18998.trc:
    ORA-27070: async read/write failed
    WARNING: IO Failed. group:0 disk(number.incarnation):7.0xe96844c9 disk_path:/dev/random
    AU:0 disk_offset(bytes):0 io_size:4096 operation:Read type:asynchronous
    result:I/O error process_id:18998
    Tue Oct 18 22:08:18 2011
    Errors in file /opt/bsaitmod/oracle/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_ora_19002.trc:
    ORA-27070: async read/write failed
    WARNING: IO Failed. group:0 disk(number.incarnation):7.0xe96844c9 disk_path:/dev/random
    AU:0 disk_offset(bytes):0 io_size:4096 operation:Read type:asynchronous
    result:I/O error process_id:19002
    Wed Oct 19 09:28:54 2011
    Errors in file /opt/bsaitmod/oracle/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_ora_8389.trc:
    ORA-27070: async read/write failed
    WARNING: IO Failed. group:0 disk(number.incarnation):7.0xe96844c9 disk_path:/dev/random
    AU:0 disk_offset(bytes):0 io_size:4096 operation:Read type:asynchronous
    result:I/O error process_id:8389
    Wed Oct 19 09:41:31 2011
    Errors in file /opt/bsaitmod/oracle/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_ora_9608.trc:
    ORA-27070: async read/write failed
    WARNING: IO Failed. group:0 disk(number.incarnation):7.0xe96844c9 disk_path:/dev/random
    AU:0 disk_offset(bytes):0 io_size:4096 operation:Read type:asynchronous
    result:I/O error process_id:9608
    Wed Oct 19 09:46:05 2011
    Errors in file /opt/bsaitmod/oracle/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_ora_9608.trc:
    ORA-27070: async read/write failed
    WARNING: IO Failed. group:0 disk(number.incarnation):7.0xe96844c9 disk_path:/dev/random
    AU:0 disk_offset(bytes):0 io_size:4096 operation:Read type:asynchronous
    result:I/O error process_id:9608
    Wed Oct 19 09:46:17 2011
    Errors in file /opt/bsaitmod/oracle/app/oracle/diag/asm/+asm/+ASM/trace/+ASM_ora_9608.trc:
    ORA-27070: async read/write failed
    WARNING: IO Failed. group:0 disk(number.incarnation):7.0xe96844c9 disk_path:/dev/random
    AU:0 disk_offset(bytes):0 io_size:4096 operation:Read type:asynchronous
    result:I/O error process_id:9608

  • ORA-00205: error in identifying control file,-Startup ASM db in PFA mode

    Is there any oracle restriction for ASM database in PFA mode?
    *[oracle@aveo:~]>cd $ORACLE_HOME/dbs*
    *[oracle@aveo:~]>orapwd file=orapwQ102ASMA password=sys entries=10 force=y*
    oracle@aveo:~]>sq
    SQL*Plus: Release 10.2.0.1.0 - Production on Fri Sep 3 12:49:15 2010
    Copyright (c) 1982, 2005, Oracle. All rights reserved.
    Connected to:
    Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - 64bit Production
    With the Partitioning, OLAP and Data Mining options
    SQL> select file_name from dba_data_files;
    FILE_NAME
    +OBTDG1/q102asma/datafile/system01.dbf
    7 rows selected.
    SQL> show parameter pass
    NAME_COL_PLUS_SHOW_PARAM
    TYPE
    VALUE_COL_PLUS_SHOW_PARAM
    remote_login_passwordfile
    string
    EXCLUSIVE
    SQL> select from v$pwfile_users;*
    USERNAME SYSDB SYSOP
    SYS TRUE TRUE
    SQL> shutdown immediate
    Database closed.
    Database dismounted.
    ORACLE instance shut down.
    SQL> exit
    Now made changes in sqlnet.ora file.
    oracle@aveo:admin]>pwd
    /oracle/10.2.0/product/network/admin
    *[oracle@aveo:admin]>cat sqlnet.ora*
    sqlnet.authentication_services=(none)
    *=oracle@aveo:admin]>sqlplus sys/sys as sysdba*
    SQL*Plus: Release 10.2.0.1.0 - Production on Fri Sep 3 13:28:29 2010
    Copyright (c) 1982, 2005, Oracle. All rights reserved.
    Connected to an idle instance.
    SQL> startup
    ORACLE instance started.
    Total System Global Area 272629760 bytes
    Fixed Size 2005736 bytes
    Variable Size 184550680 bytes
    Database Buffers 83886080 bytes
    Redo Buffers 2187264 bytes
    ORA-00205: error in identifying control file, check alert log for more info
    It thows ORA-00205: error in identifying control file,
    Edited by: user2015671 on 3 Sep, 2010 8:09 AM

    In alert log it show below error message.
    ===================================================================
    Sat Sep 4 13:06:38 2010
    Starting ORACLE instance (normal)
    LICENSE_MAX_SESSION = 0
    LICENSE_SESSIONS_WARNING = 0
    Picked latch-free SCN scheme 1
    Autotune of undo retention is turned on.
    IMODE=BR
    ILAT =10
    LICENSE_MAX_USERS = 0
    SYS auditing is disabled
    ksdpec: called for event 13740 prior to event group initialization
    Starting up ORACLE RDBMS Version: 10.2.0.1.0.
    System parameters with non-default values:
    processes = 50
    shared_pool_size = 155189248
    large_pool_size = 4194304
    java_pool_size = 25165824
    resource_manager_plan = SYSTEM_PLAN
    control_files = OBTDG1/q102asma/controlfile/control01.ctl, OBTDG1/q102asma/controlfile/control02.ctl, +OBTDG1/q102asma/controlfile/control03.ctl
    db_block_size = 8192
    db_cache_size = 67108864
    db_2k_cache_size = 8388608
    db_4k_cache_size = 8388608
    compatible = 10.0.0.0.0
    log_archive_dest = +OBTDG1
    log_archive_format = %t_%s_%r.log
    log_buffer = 2152448
    fast_start_mttr_target = 300
    undo_management = AUTO
    undo_tablespace = rbs
    remote_login_passwordfile= EXCLUSIVE
    instance_name = Q102ASMA
    background_dump_dest = /qa/data/obt/Q102ASMA/admin/bdump
    user_dump_dest = /qa/data/obt/Q102ASMA/admin/udump
    core_dump_dest = /qa/data/obt/Q102ASMA/admin/cdump
    sort_area_size = 524288
    db_name = Q102ASMA
    open_cursors = 300
    ifile = /qa/data/obt/Q102ASMA/admin/pfile/configQ102ASMA.ora
    PMON started with pid=2, OS id=29642
    PSP0 started with pid=3, OS id=29644
    MMAN started with pid=4, OS id=29646
    DBW0 started with pid=5, OS id=29648
    LGWR started with pid=6, OS id=29650
    CKPT started with pid=7, OS id=29652
    SMON started with pid=8, OS id=29654
    RECO started with pid=9, OS id=29656
    MMON started with pid=10, OS id=29658
    MMNL started with pid=11, OS id=29660
    Sat Sep 4 13:06:40 2010
    ALTER DATABASE MOUNT
    Sat Sep 4 13:06:40 2010
    Starting background process ASMB
    ASMB started with pid=13, OS id=29663
    Sat Sep 4 13:06:40 2010
    ORA-00202: control file: '+OBTDG1/q102asma/controlfile/control01.ctl'
    ORA-17503: ksfdopn:2 Failed to open file +OBTDG1/q102asma/controlfile/control01.ctl
    ORA-15001: diskgroup "OBTDG1" does not exist or is not mounted
    ORA-15055: unable to connect to ASM instance
    ORA-01031: insufficient privileges
    Sat Sep 4 13:06:40 2010
    ORA-205 signalled during: ALTER DATABASE MOUNT...
    ===================================================================
    ASMCMD> pwd
    +OBTDG1/Q102ASMA/controlfile
    ASMCMD>
    ASMCMD> ls -ltr
    Type Redund Striped Time Sys Name
    N control01.ctl => +OBTDG1/Q102ASMA/CONTROLFILE/Current.283.728141849
    N control02.ctl => +OBTDG1/Q102ASMA/CONTROLFILE/current.292.728141859
    N control03.ctl => +OBTDG1/Q102ASMA/CONTROLFILE/current.299.728141861
    CONTROLFILE UNPROT FINE SEP 04 13:00:00 Y Current.283.728141849
    CONTROLFILE UNPROT FINE SEP 04 13:00:00 Y current.292.728141859
    CONTROLFILE UNPROT FINE SEP 04 13:00:00 Y current.299.728141861
    ===================================================================
    I tried without Password file authentication then i am not getting error during database startup.
    Why it is giving error for Password file authentication?
    Thanks,

  • ORA-15196: invalid ASM block header

    asm alert shows:
    WARNNING: cache read a corrupted block group=1(CRSDG) dsk=0 blk=2 from disk 0(CRSVOL)
    Errors in file /u01/app/11.2.0/grid/log/diag/asm/+asm/+ASM1/trace/+ASM1_rbal_16585.trc:
    ORA-15196: invalid ASM block header [kfc.c:25578] [endian_kfbh] [2147483648] [2] [0 != 1]
    ORA-15196: invalid ASM block header [kfc.c:25427] [endian_kfbh] [2147483648] [2] [0 != 1]
    Here are my challenges to the answer providers and I am going to number my questions. You are welcome to answer any question listed below, just please quota my question number first. Thanks.
    1) "cache read a corrupted block group" , what exactly is the "cache" here?
    2) "group=1(CRSDG) dsk=0 blk=2 from disk 0(CRSVOL)" we know that ASM is stored in AUs, here only gives dsk=0, blk=2, but without knowing the AU number, how can I use kfed to read the proper block?
    3) "kfc.c:25578" what is kfc.c? I can find explanation about kfbh.<>, kfdhdb.<>, but have no clue about what kfc.c is.
    4) "[endian_kfbh] [2147483648] [2] [0 != 1]" I know endian_kfbh is about the platform's Endian, but what is 2147483648 referring to here?
    5)  "[endian_kfbh] [2147483648] [2] [0 != 1]" I am guessing [2] refers to block number 2, is this correct?
    6) overall, is all it is trying to tell me is "the plaform should be in small endian (1), but now it is marked as big endian(2) at some header place"?
    7) of course, I would appreciate your solutions very much. you solution is ...?
    8) Is there any good article reference about these stuff?
    lisingt every single questions of mine is my favorite seeking help style.  Doing this help learn better. I am expecting your contributions.
    Thanks in advance!

    1) "cache read a corrupted block group" , what exactly is the "cache" here?
    I think I need not ask this question. Cache here simply means reading the block from disk to the cache.
    However, questions 2 ~ 7 are still valid.

  • ORA-15000 when Connect to ASM with ASMSNMP

    With ASM of 11g2 on Redhat 5, I tried to connect the instance with ASMSNMP but failed[grid@cchordrdb admin]$ sqlplus / as sysasm
    SQL> conn asmsnmp/asmsnmp@ASM
    ERROR:
    ORA-15000: command disallowed by current instance typeIs this a problme or normai?

    Normal/expected,
    You have 2 options. Or via OS autentication (I guess in your case login as grid user and sqlplus / as sysasm) or via password file (connect usu/pwd@inst as sysasm).
    Regards,
    Cerreia

  • RAC, ASM failed to start up on second node , ORA-03113: end-of-file on comm

    i'm installing an RAC with 2 nodes on top of ASM
    when creating ASM Diskgroup , it failed and reported error CRS-0215 failed to start asm on node2
    Oracle 10.2.0.1
    linux CentOs 4.x
    u01/app/oracle/product/10.2.0/db_1/bin/dbca  -progress_only   -configureASM -templateName NO_VALUE -gdbName NO -sid NO      -emConf
    iguration NONE    -diskList /dev/raw/raw2,/dev/raw/raw3  -diskGroupName DATA -datafileJarLocation /u01/app/oracle/product/10.2.0/db_
    1/assistants/dbca/templates  -responseFile NO_VALUE  -nodeinfo node1,node2    -obfuscatedPasswords true   -oratabLocation /u01/app/o
    racle/product/10.2.0/db_1/install/oratab   -asmSysPassword 05dbb0be38ecf8cca822cf3cf99e675448  -redundancy EXTERNA
    [oracle@node2 bin]$ ./crs_stat -t -v
    Name           Type           R/RA   F/FT   Target    State     Host       
    ora....SM1.asm application    0/5    0/0    ONLINE    ONLINE    node1      
    ora....E1.lsnr application    0/5    0/0    ONLINE    ONLINE    node1      
    ora.node1.gsd  application    0/5    0/0    ONLINE    ONLINE    node1      
    ora.node1.ons  application    0/3    0/0    ONLINE    ONLINE    node1      
    ora.node1.vip  application    0/0    0/0    ONLINE    ONLINE    node1      
    ora....SM2.asm application    0/5    0/0    OFFLINE   OFFLINE              
    ora....E2.lsnr application    0/5    0/0    ONLINE    ONLINE    node2      
    ora.node2.gsd  application    0/5    0/0    ONLINE    ONLINE    node2      
    ora.node2.ons  application    0/3    0/0    ONLINE    ONLINE    node2      
    ora.node2.vip  application    0/0    0/0    ONLINE    ONLINE    node2  
    i checked the status , asm is able to start on both nodes if not at the same time ,
    when trying to start the second node , with srvctl or sqlplus , each give the error 03113
    can anyone suggest me of how to bring up both instances ,
    thanks~
    [oracle@node2 bin]$ srvctl stop asm -n node1
    [oracle@node2 bin]$ srvctl start asm -n node1
    [oracle@node2 bin]$ srvctl start asm -n node2
    PRKS-1009 : Failed to start ASM instance "+ASM2" on node "node2", [PRKS-1009 : Failed to start ASM instance "+ASM2" on node "node2", [node2:ora.node2.ASM2.asm:
    node2:ora.node2.ASM2.asm:SQL*Plus: Release 10.2.0.1.0 - Production on Wed May 27 16:14:50 2009
    node2:ora.node2.ASM2.asm:
    node2:ora.node2.ASM2.asm:Copyright (c) 1982, 2005, Oracle.  All rights reserved.
    node2:ora.node2.ASM2.asm:
    node2:ora.node2.ASM2.asm:Enter user-name: Connected to an idle instance.
    node2:ora.node2.ASM2.asm:
    node2:ora.node2.ASM2.asm:SQL> ORA-03113: end-of-file on communication channel
    node2:ora.node2.ASM2.asm:SQL> Disconnected
    node2:ora.node2.ASM2.asm:
    [code/]
    Edited by: zs_hzh on May 27, 2009 1:25 AM                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   

    Is it possible to start ASM on second node with SQL*Plus in NOMOUNT state?

  • Errors in Standby Alert Log

    Dear All,
    We have 10gR2 RAC with Physical Data Guard environment using ASM and both have same disk group names. Lets say the primary database name is prim and stand by database name is stdby. We are getting the following errors in alert log file of standby:
    Clearing online redo logfile 9 +DG_DATAFILES_AND_FB/prim/onlinelog/group9_2a.rdo
    Clearing online log 9 of thread 2 sequence number 0
    Errors in file c:\oracle\product\10.2.0\admin\stdby\bdump\stdby1_mrp0_4288.trc:
    ORA-00313: Message 313 not found; No message file for product=RDBMS, facility=ORA; arguments: [9] [2]
    ORA-00312: Message 312 not found; No message file for product=RDBMS, facility=ORA; arguments: [9] [2] [+DG_DATAFILES_AND_FB/prim/onlinelog/group9_2a.rdo]
    ORA-17503: Message 17503 not found; No message file for product=RDBMS, facility=ORA; arguments: [2] [+DG_DATAFILES_AND_FB/prim/onlinelog/group9_2a.rdo]
    ORA-15173: entry 'prim does not exist in directory '/'
    Errors in file c:\oracle\product\10.2.0\admin\stdby\bdump\stdby1_mrp0_4288.trc:
    ORA-00344: Message 344 not found; No message file for product=RDBMS, facility=ORA; arguments: [+DG_DATAFILES_AND_FB/prim/onlinelog/group9_2a.rdo]
    ORA-17502: Message 17502 not found; No message file for product=RDBMS, facility=ORA; arguments: [4] [+DG_DATAFILES_AND_FB/prim/onlinelog/group9_2a.rdo]
    ORA-15173: entry 'prim' does not exist in directory '/'The errors show that the standby is trying to find files in directory +DG_DATAFILES_AND_FB/prim/onlinelog which apparently doesn’t exist on standby. Below is the result of query for redo logs on standby:
    SQL> SELECT group#, status, member FROM v$logfile where member like '%prim/%'
        GROUP#   STATUS         MEMEBER
             9                            +DG_DATAFILES_AND_FB/prim/onlinelog/group9_2a.rdo
             1                            +DG_DATAFILES_AND_FB/prim/standbylogs/sredo1.rdo
            10                           +DG_DATAFILES_AND_FB/prim/onlinelog/group10_1a.rdo
             2                            +DG_DATAFILES_AND_FB/prim/standbylogs/sredo2.rdo
             3                            +DG_DATAFILES_AND_FB/prim/standbylogs/sredo3.rdo
             4                            +DG_DATAFILES_AND_FB/prim/standbylogs/sredo4.rdo
            11                           +DG_DATAFILES_AND_FB/prim/onlinelog/group11_1a.rdo
            12                           +DG_DATAFILES_AND_FB/prim/onlinelog/group12_2a.rdo
    8 rows selected.  How we can get rid of this error?
    Best regards,

    Generally when we setup standby, are these directories created automatically (i mean '+DG_DATAFILES_AND_FB/prim and '+DG_DATAFILES_AND_FB/stdby) on standby? My understanding is that by default only '+DG_DATAFILES_AND_FB/stdby is created.
    What if i want to put all logs (that are in stdby and prim) in +DG_DATAFILES_AND_FB/stdby?What is the value of DB_CREATE_FILE_DEST and you also set DB_CREATE_ONLINE_LOG_DEST_<> value?
    Also i don't know whether it is relevant or not, but we performed a roll forward for standby using metalink doc id: 836986.1 (Steps to perform for Rolling forward a standby database using RMAN incremental backup when primary and standby are in ASM filesystem). But i am not sure whether the error started coming after that or not.
    But in the beginning for sure, there were no such errors. Just trying to put as much information as i can.Even though you are using same disk groups, But the sub directory names such as "prim","stby" are different,
    After you changed the values of DB_FILE_NAME_CONVERT/LOG_FILE_NAME_CONVERT have you bounced database ? They are static parameters.
    Bounce it and then start MRP, initally errors are expected even it happens during RMAN duplicate.
    logfile member shows in database but not on physical disk, not match
    if you haven't used RMAN duplicate then drop and create redo logs, this can be done at any time.

Maybe you are looking for

  • Change Column Heading in ALV Report

    Hi, I have developed a ALV Report, showing correct output. Problem is that Column Heading is not showing correct...means it is showing as per field name. But We want to change as per our understand. i.e. One column heading is like Unrestricted Stock

  • Project Management and Financial Management

    Hello, Our Federal client uses WBS for Inter-Agency Agreements, They use a simple structure to collect costs and define budget availability at the WBS level.  They also have a need for a Project Management tool, with milestones, resource tracking, et

  • Clicking on padlock icon will not progress to asking for passcode

    unable to unlock the padlock to make changes;  it will not allow me to enter my passcode...it just "flutters" when clicking on the padlock icon....any ideas of what's going on?

  • Utl_http.request for https site

    Hello I am running the following using sqlplus login in as sys as sysdba (also tried login as the end user) SELECT utl_http.request('https://www.accestochina.com', 'null', 'file:C:\wallets', 'XXX - Password has been entered here - XXX') FROM dual; ER

  • TtStats in 11.2.2.7.0 - there's a limit to snapshot reporting

    If you are testing for a specific workload and want to determine database statistics related to that workload you may wish to use just the raw statistics, we tried using snapshots and there is a limit, even pulling 5 minute snapshots on a modern 2 so