ORA-27061: waiting for async I/Os failed

Hi Techies
In order to sync. prod. system with DR system  we are copying
archive logs on DR server & applying archive logs.
I am getting following error.
RA-00283: recovery session canceled due to errors
ORA-12801: error signaled in parallel query server P000
ORA-27061: waiting for async I/Os failed
IBM AIX RISC System/6000 Error: 22: Invalid argument
ORA-27061: waiting for async I/Os failed
IBM AIX RISC System/6000 Error: 22: Invalid argument
SAP--ECC 6.0
DB--Oracle 10g
OS--AIX 5.3
Thanks in advance
Vijay

Hello Vijay,
your given information is a little bit moderate, but it seems like the problem, that is described in metalink note #464768.1.
This problem is known with the following aix packages:
bos.rte.aio fileset at the 5.3.0.60 or 5.3.0.61 level
Fix it with installing the APAR IZ03260. (http://www-01.ibm.com/support/docview.wss?uid=isg1fixinfo105422)
Regards
Stefan

Similar Messages

  • DG端不定期报waiting for async I/Os failed错误

    大家好，我这边数据库主库是RAC，物理DG端也是RAC，都采用的ASM，存储，DG端最近总是时不时的报错：
    Errors in file /u01/oracle/diag/rdbms/racstandby/rac1/trace/rac1_arcr_11381.trc:
    ORA-27061: waiting for async I/Os failed
    Linux-x86_64 Error: 5: Input/output error
    Additional information: -1
    Additional information: 1048576
    WARNING: Read Failed. group:2 disk:0 AU:247 offset:0 size:1048576
    WARNING: failed to read mirror side 1 of virtual extent 19 logical extent 0 of file 277 in group [2.1197980967] from disk DATA_0000 allocation unit 247 reason error; if possible, will try another mirror side
    Errors in file /u01/oracle/diag/rdbms/racstandby/rac1/trace/rac1_arcr_11381.trc:
    ORA-00333: redo log read error block 38912 count 2048
    ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
    ORA-15081: failed to submit an I/O operation to a disk
    ORA-15081: failed to submit an I/O operation to a disk
    有时就报一两次，有时一下报一天，但看DG进程还都在，数据也都实时追着，不知道有什么影响，甚至有一次MRP0自己DOWN掉不知道和这个有没有关系，实际去ASM中查看文件可以访问，检测坏块也没有，删掉重建redo仍有此问题，删掉整个库从新做主从仍然有此问题，希望大家帮看看，感激
    TRACE文件内容：
    Trace file /u01/oracle/diag/rdbms/racstandby/rac1/trace/rac1_arcr_11381.trc
    Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
    With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
    Data Mining and Real Application Testing options
    ORACLE_HOME = /u01/oracle/11.2.0.3/product
    System name: Linux
    Node name: racstandby1
    Release: 2.6.18-274.el5
    Version: #1 SMP Fri Jul 22 04:43:29 EDT 2011
    Machine: x86_64
    Instance name: rac1
    Redo thread mounted by this instance: 1
    Oracle process number: 62
    Unix process pid: 11381, image: oracle@racstandby1 (ARCR)
    *** 2012-10-24 22:00:56.861
    *** SESSION ID:(1714.1) 2012-10-24 22:00:56.861
    *** CLIENT ID:() 2012-10-24 22:00:56.861
    *** SERVICE NAME:(SYS$BACKGROUND) 2012-10-24 22:00:56.861
    *** MODULE NAME:() 2012-10-24 22:00:56.861
    *** ACTION NAME:() 2012-10-24 22:00:56.861
    Initial buffer sizes: read 1024K, overflow 832K, change 805K
    ORA-27061: waiting for async I/Os failed
    *** 2012-10-25 10:04:19.253
    Linux-x86_64 Error: 5: Input/output error
    Additional information: -1
    Additional information: 1048576
    WARNING: Read Failed. group:2 disk:0 AU:247 offset:0 size:1048576
    path:/dev/oracleasm/disks/VOL_DATA1
    incarnation:0xefd74ddb asynchronous result:'I/O error'
    subsys:System iop:0x2b3b7a33e780 bufp:0x2b3b7b42d000 osderr:0x0 osderr1:0x0
    WARNING: failed to read mirror side 1 of virtual extent 19 logical extent 0 of file 277 in group [2.1197980967] from disk DATA_0000 allocation unit 247 reason error; if possible, will try another mirror side
    DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
    ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
    ORA-15081: failed to submit an I/O operation to a disk
    ORA-15081: failed to submit an I/O operation to a disk
    ORA-00333: redo log read error block 38912 count 2048
    ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
    ORA-15081: failed to submit an I/O operation to a disk
    ORA-15081: failed to submit an I/O operation to a disk
    ORA-27072: File I/O error
    Linux-x86_64 Error: 5: Input/output error
    Additional information: 4
    Additional information: 505856
    Additional information: -1
    WARNING: Read Failed. group:2 disk:0 AU:247 offset:0 size:1048576
    path:/dev/oracleasm/disks/VOL_DATA1
    incarnation:0xefd74ddb synchronous result:'I/O error'
    subsys:System iop:0x2b3b7a33e780 bufp:0x2b3b7b42d000 osderr:0x0 osderr1:0x0
    WARNING: failed to read mirror side 1 of virtual extent 19 logical extent 0 of file 277 in group [2.1197980967] from disk DATA_0000 allocation unit 247 reason error; if possible, will try another mirror side
    DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
    ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
    ORA-15081: failed to submit an I/O operation to a disk
    ORA-00333: redo log read error block 38912 count 2048
    ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
    ORA-15081: failed to submit an I/O operation to a disk
    Incomplete read from log member '+DATA/racstandby/onlinelog/group_7.277.797513635'. Trying next member.
    ORA-27072: File I/O error
    Linux-x86_64 Error: 5: Input/output error
    Additional information: 4
    Additional information: 251904
    Additional information: -1
    WARNING: Read Failed. group:3 disk:0 AU:123 offset:0 size:1048576
    path:/dev/oracleasm/disks/VOL_FRA1
    incarnation:0xefd74ddd synchronous result:'I/O error'
    subsys:System iop:0x2b3b7a33e780 bufp:0x2b3b7b42d000 osderr:0x0 osderr1:0x0
    WARNING: failed to read mirror side 1 of virtual extent 19 logical extent 0 of file 325 in group [3.1197980968] from disk FRA_0000 allocation unit 123 reason error; if possible, will try another mirror side
    DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
    ORA-00312: online log 7 thread 1: '+FRA/racstandby/onlinelog/group_7.325.797513637'
    ORA-15081: failed to submit an I/O operation to a disk
    ORA-00333: redo log read error block 38912 count 2048
    ORA-00312: online log 7 thread 1: '+FRA/racstandby/onlinelog/group_7.325.797513637'
    ORA-15081: failed to submit an I/O operation to a disk
    Incomplete read from log member '+FRA/racstandby/onlinelog/group_7.325.797513637'. Trying next member.
    *** 2012-10-25 10:04:19.372 4320 krsh.c
    ARCr: All Archive destinations made inactive due to error 333
    *** 2012-10-25 10:04:19.398 2932 krsi.c
    krsi_dst_fail: dest:1 err:333 force:0 blast:1
    ORA-27061: waiting for async I/Os failed
    Linux-x86_64 Error: 5: Input/output error
    Additional information: -1
    Additional information: 1048576
    WARNING: Read Failed. group:2 disk:0 AU:248 offset:0 size:1048576
    path:/dev/oracleasm/disks/VOL_DATA1
    incarnation:0xefd74ddb asynchronous result:'I/O error'
    subsys:System iop:0x2b3b7a33e500 bufp:0x2b3b7b53d000 osderr:0x0 osderr1:0x0
    WARNING: failed to read mirror side 1 of virtual extent 20 logical extent 0 of file 277 in group [2.1197980967] from disk DATA_0000 allocation unit 248 reason error; if possible, will try another mirror side
    DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
    ORA-00312: online log 7 thread 1: '+FRA/racstandby/onlinelog/group_7.325.797513637'
    DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
    ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
    ORA-00312: online log 7 thread 1: '+FRA/racstandby/onlinelog/group_7.325.797513637'
    *** 2012-10-25 10:04:19.546 4481 kcrr.c

    ORA-15081: failed to submit an I/O operation to a disk
    ORA-15081: failed to submit an I/O operation to a disk
    ORA-27072: File I/O error
    Linux-x86_64 Error: 5: Input/output error
    Additional information: 4
    Additional information: 505856
    15081, 00000, "failed to submit an I/O operation to a disk"
    // *Cause:   A submission of an I/O operation to a disk has failed.
    // *Action:  Make sure that all the disks are operational.
    ORA-15081一般与 存储磁盘有关， 请把/var/log/messages、dmesg日志发给我
    在11gR2中ORA-15081 可能导致instance crash
    有问题请去OTN中文论坛开个帖子 我会回复 地址：http://www.otncn.org
    如果需要发送附件，可以直接发邮件到 [email protected]

  • Update query is waiting for async descriptor resize

    Hi All,
    One of the update query which was completing in 1-2 mins. Suddenly today it started taking more than 3-4 hours and still it is running.
    Below is the query, I can see the explain plain. I can see the query is waiting for async descriptor resize wait event
    UPDATE AP_INVOICE_DISTRIBUTIONS SET POSTED_FLAG = 'N' WHERE POST
    ED_FLAG = 'S' AND (ACCOUNTING_DATE >= :B2 OR :B2 IS NULL) AND (A
    CCOUNTING_DATE <= :B1 OR :B1 IS NULL)
    when i checked the P1text, P2text columns of v$session, it is showing outstanding #aio,current ai0 limit respectively.
    Explan plan
    CODEPLAN_TABLE_OUTPUT
    | Id  | Operation                      | Name                         | Rows  | Bytes | Cost (%CPU)| Time     |
    |   0 | UPDATE STATEMENT               |                              |       |       |   250 (100)|          |
    |   1 |  UPDATE                        | AP_INVOICE_DISTRIBUTIONS_ALL |       |       |            |          |
    |   2 |   NESTED LOOPS                 |                              |       |       |            |          |
    |   3 |    NESTED LOOPS                |                              |    39 | 12480 |   250   (0)| 05:14:02 |
    |*  4 |     TABLE ACCESS BY INDEX ROWID| AP_ACCOUNTING_EVENTS_ALL     |    39 |   624 |   145   (0)| 03:02:09 |
    |*  5 |      INDEX RANGE SCAN          | AP_ACCOUNTING_EVENTS_N2      |  3954 |       |    14   (0)| 00:17:36 |
    |*  6 |     INDEX RANGE SCAN           | AP_INVOICE_DISTRIBUTIONS_N18 |     4 |       |     2   (0)| 00:02:31 |
    PLAN_TABLE_OUTPUT
    |*  7 |    TABLE ACCESS BY INDEX ROWID | AP_INVOICE_DISTRIBUTIONS_ALL |     1 |   304 |     4   (0)| 00:05:02 |
    CODE
    Please help me on this.
    Env Details --
    DB version -- 11.2.0.1
    OS - IBM AIX.
    Thanks in advance...

    This could be this bug
    Bug 9829397 - Excessive CPU and many "asynch descriptor resize" waits for SQL using Async IO (Doc ID 9829397.8)

  • TS4062 ipad frozen, tried reset from rec. mode, usb cable showing on screen, waiting for ipad, then ipad fails to respond. what can i do?

    ipad mini froze when charging, have tried all restore options, when i get to waiting for ipad in itunes when restoring in recovery mode the usb cable disappears from the screen, the apple logo appears then the recovery line beneath logo, then there is no further response from ipad. have been trying to resolve this issue for couple days now very frustrated. can anyone help please?

    Use the charger that came with the iPad or a name brand charger of equal or greater capacity. Plug that into a known good wall outlet. Then wait at least an hour. While the iPad is still plugged in to the charger reset your iPad. Press and hold the Home and Sleep buttons simultaneously until the Apple logo appears. Let go of the buttons and let the device restart.
    If the iPad restarts continue to charge it until the battery is at 100%
    If the iPad does not start Make an appointment at an Apple Store to have your device examined by a technician. Or contact Apple Support.

  • ORA-1503   ORA-27061

    Hi,
    when creating a 9.2.0.6 DB on AIX 5l 64bits, in alertlog I have :
    ORA-1503 signalled during: CREATE CONTROLFILE REUSE SET DATABASE "P13DSMS"
    LO...
    Thu Mar 29 10:07:53 2007
    Errors in file /exec/products/oracle/v9.2.0/ora13dsms/p13dsmsdb/9.2.0/admin/P13DSMS_op13ddb/udump/p13dsms_ora_569578.trc:
    ORA-27061: skgfospo: waiting for async I/Os failed
    IBM AIX RISC System/6000 Error: 109: Function not implemented
    ORA-27061: skgfospo: waiting for async I/Os failed
    IBM AIX RISC System/6000 Error: 109: Function not implemented
    ORA-01503: CREATE CONTROLFILE failed
    Any idea or help ?
    Many thanks.

    Try posting your problem in the Database forum.

  • How to fix:  facetime waiting for activation

    Iphone 4 on ATT network. My facetime used to work OK before. Recently I noticed that the facetime icon disappeared when in a call, and from the contacts. I found out that in the Settings facetime was off. However, whenever I try to toggle to ON, it stays on waiting for activation, then it fails. Any suggestions will be greatly appreciated.(MMS and SMS work with no problem).
    Thanks

    wifi is fine, apple servers r to busy to effectively use facetime and imessages right now is all. and activation error is due to high server traffic as well. keep trying or wait, thats it

  • IMessage & SMS 'waiting for activation' ??

    Ok so what is the go cannot send any text or iMessage it's always stuck on 'waiting for activation' and always fails after half an hour or do anyway ?
    Used to be able to send SMS on my iPhone 4 but bought iPhone 4s first day it came out with ios 5 no luck with text messaging what's wrong ?

    I live in Costa Rica, I have an iPhone 5, updated to iOs 8, deactivated iMessage to enable sms on Yosemite.  Anyway, reactivated iMessage and it just says Waiting for activation, and I get strange international SMS's every 1-3 hours.  Seems like the iPhone doesn't recognize these activation SMS's.  Tried everything I have found: resetting, restoring, etc.   Please help.

  • NetworkManager : stuck at "waiting for authorization"

    Hi!
    Installed Arch on my Thinkpad Edge E125 and now having a little problem with NetworkManager in KDE.
    I'm certain I've installed pretty much everything needed to make wireless connection possible, the command
    iwlist wlan0 scan
    is able to produce a list of wireless routers.
    But trying to connect to my home wireless router always stuck at "waiting for authorization" and eventually failed.
    I have WEP encryption and double check it to be correct. Wireless worked in other distros.
    Any suggestion you might have?  Thank you.

    Ecky wrote:Did you go into Manage Connections in kde networkmanager and enter your wep key in the Wireless Security tab for your connection?
    Yes I did. Tried entering dozens of time actually.  Thank you anyway.
    Now moved to Opensuse and now despite having the correct modules being loaded, my network interface is invisible to the OS!!!
    Might return to Ubuntu, where everything just works or cave in to Windows 7 if my patience run out.
    For months struggling with one form or another problems with Linux, I just miss more and more of the days where I could could simply get stuff done.
    Sad but true.

  • Database error"ORA-00060: deadlock detected while waiting for resource"

    Hi All,
    I got dump as
    Database error text........: "ORA-00060: deadlock detected while waiting for
      resource"
    Internal call code.........: "[RSQL/RDUP/NRIV ]"
    Please check the entries in the system log (Transaction SM21).
    An exception occurred that is explained in detail below.
    The exception, which is assigned to class 'CX_SY_OPEN_SQL_DB', was not caught
    in
    procedure "READ_NRIV" "(FORM)", nor was it propagated by a RAISING clause.
    Can u ppl tell me how to get correct this?
    Edited by: Bala Chandar on Jul 20, 2009 11:01 AM

    Hi Bala,
    Same type of dump we got when we trigger the DTP which in process chain to load data from DSO to Info cube. And the load had processed with 225 data package and at 164th data package we got this error and except 164th data package all data package processed successfully
    And the request was red. So we had done processed manually by clicking the icon. So all its been green and successfully loaded.
    So when you do process manual the particular data package which got failed will be process successfully  

  • ORA-02049: timeout: distributed transaction waiting for lock

    Hi,
    My name is Guneet and I'm working on an application running on BEA Weblogic Server 9.2 running on a Red Hat Linux box using Oracle 10g as the database. My problem is that recently our code started getting the following exception while updating a database table.
    java.sql.SQLException: [BEA][Oracle JDBC Driver][Oracle]ORA-02049: timeout: distributed transaction waiting for lock
    Application Details
    * Using Stateless Session EJB
    * Only one Business method in this EJB with transaction attribute set to "required"
    * This method executes two select queries & one update query
    * We are using JDBC to access the database.
    * We have configured a Data Source & are using it to get a database connection.
    * Weblogic's Oracle Driver is being used.
    More details
    * The application has been running well since a month.
    * Two days ago,the update query failed with the above error.
    * At that time, a single client was accessing the system.
    * Once this problem occurs, it starts appearing frequently.
    * Eventually a request to get a connection from the Data Source times out & the exception copied at the end is thrown
    * At this stage the application gets stuck and all requests trying to get a connection end up with this exception.
    * Fortunately, Restarting the Weblogic Server gets us out of this problem and transactions resume normally.
    Now my questions are
    # Why is this error happening & what does it mean?
    # It looks like the second exception (unable to get a connection from ds) is an after effect of the first problem (ORA-02049) once it appears for a couple of times. Can somebody validate this?
    # Though I don't understand JTA well but I don't think this application needs distributed transactions so, I'm thinking of modifying the driver type to non-XA oracle driver. Any advise/pointers/comments on this front is welcome !!!!!!!!
    Thanks
    Guneet Sahai
    Exception Trace
    Dec 27, 2006 4:47:50 PM | com.gisil.themis.db | SEVERE | Unable to load merchant DEL = 911168900164. Reason - java.sql.SQLException: Unexpected exception while enlisting XAConnection java.sql.SQLException: XA error: XAResource.XAER_RMERR start() failed on resource 'themis-ds': XAER_RMERR : A resource manager error has occured in the transaction branch
    javax.transaction.xa.XAException: Unexpected error during start for XAResource 'themis-ds': Transaction timed out after 29 seconds
    BEA1-252DE51AC930078CA638
    at weblogic.jdbc.wrapper.XA.createException(XA.java:103)
    at weblogic.jdbc.jta.DataSource.start(DataSource.java:753)
    at weblogic.transaction.internal.XAServerResourceInfo.start(XAServerResourceInfo.java:1182)
    at weblogic.transaction.internal.XAServerResourceInfo.xaStart(XAServerResourceInfo.java:1115)
    at weblogic.transaction.internal.XAServerResourceInfo.enlist(XAServerResourceInfo.java:274)
    at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:497)
    at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:429)
    at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1408)
    at weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1332)
    at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:440)
    at weblogic.jdbc.jta.DataSource.connect(DataSource.java:396)
    at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:359)
    at com.gisil.themis.db.impl1.DbManagerImpl.isPinValid(DbManagerImpl.java:872)
    at com.gisil.themis.ejb.ThemisBean.isPinValid(ThemisBean.java:185)
    at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl.isPinValid(Themis_aqqc4k_EOImpl.java:207)
    at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl_WLSkel.invoke(Unknown Source)
    at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:517)
    at weblogic.rmi.cluster.ClusterableServerRef.invoke(ClusterableServerRef.java:224)
    at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:407)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
    at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:403)
    at weblogic.rmi.internal.BasicServerRef.access$300(BasicServerRef.java:56)
    at weblogic.rmi.internal.BasicServerRef$BasicExecuteRequest.run(BasicServerRef.java:934)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1413)
    at weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1332)
    at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:440)
    at weblogic.jdbc.jta.DataSource.connect(DataSource.java:396)
    at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:359)
    at com.gisil.themis.db.impl1.DbManagerImpl.isPinValid(DbManagerImpl.java:872)
    at com.gisil.themis.ejb.ThemisBean.isPinValid(ThemisBean.java:185)
    at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl.isPinValid(Themis_aqqc4k_EOImpl.java:207)
    at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl_WLSkel.invoke(Unknown Source)
    at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:517)
    at weblogic.rmi.cluster.ClusterableServerRef.invoke(ClusterableServerRef.java:224)
    at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:407)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
    at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:403)
    at weblogic.rmi.internal.BasicServerRef.access$300(BasicServerRef.java:56)
    at weblogic.rmi.internal.BasicServerRef$BasicExecuteRequest.run(BasicServerRef.java:934)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)

    guneet sahai wrote:
    Hi,
    My name is Guneet and I'm working on an application running on BEA Weblogic Server 9.2 running on a Red Hat Linux box using Oracle 10g as the database. My problem is that recently our code started getting the following exception while updating a database table.
    java.sql.SQLException: [BEA][Oracle JDBC Driver][Oracle]ORA-02049: timeout: distributed transaction waiting for lock
    Application Details
    * Using Stateless Session EJB
    * Only one Business method in this EJB with transaction attribute set to "required"
    * This method executes two select queries & one update query
    * We are using JDBC to access the database.
    * We have configured a Data Source & are using it to get a database connection.
    * Weblogic's Oracle Driver is being used.
    More details
    * The application has been running well since a month.
    * Two days ago,the update query failed with the above error.
    * At that time, a single client was accessing the system.
    * Once this problem occurs, it starts appearing frequently.
    * Eventually a request to get a connection from the Data Source times out & the exception copied at the end is thrown
    * At this stage the application gets stuck and all requests trying to get a connection end up with this exception.
    * Fortunately, Restarting the Weblogic Server gets us out of this problem and transactions resume normally.
    Now my questions are
    # Why is this error happening & what does it mean?
    # It looks like the second exception (unable to get a connection from ds) is an after effect of the first problem (ORA-02049) once it appears for a couple of times. Can somebody validate this?
    # Though I don't understand JTA well but I don't think this application needs distributed transactions so, I'm thinking of modifying the driver type to non-XA oracle driver. Any advise/pointers/comments on this front is welcome !!!!!!!!
    Thanks
    Guneet SahaiHi Guneet. If you want to debug the JTA issue, I suggest opening an official
    support case. They will lead you through producing the JTA debug information.
    However, I believe you are correct that the transaction you describe is
    completely doable with a simple local transaction, so if you were to alter
    your pool to use the non-XA driver, it would probably be faster, simpler,
    and just work.
    Let me know...
    Joe
    >
    Exception Trace
    Dec 27, 2006 4:47:50 PM | com.gisil.themis.db | SEVERE | Unable to load merchant DEL = 911168900164. Reason - java.sql.SQLException: Unexpected exception while enlisting XAConnection java.sql.SQLException: XA error: XAResource.XAER_RMERR start() failed on resource 'themis-ds': XAER_RMERR : A resource manager error has occured in the transaction branch
    javax.transaction.xa.XAException: Unexpected error during start for XAResource 'themis-ds': Transaction timed out after 29 seconds
    BEA1-252DE51AC930078CA638
    at weblogic.jdbc.wrapper.XA.createException(XA.java:103)
    at weblogic.jdbc.jta.DataSource.start(DataSource.java:753)
    at weblogic.transaction.internal.XAServerResourceInfo.start(XAServerResourceInfo.java:1182)
    at weblogic.transaction.internal.XAServerResourceInfo.xaStart(XAServerResourceInfo.java:1115)
    at weblogic.transaction.internal.XAServerResourceInfo.enlist(XAServerResourceInfo.java:274)
    at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:497)
    at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:429)
    at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1408)
    at weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1332)
    at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:440)
    at weblogic.jdbc.jta.DataSource.connect(DataSource.java:396)
    at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:359)
    at com.gisil.themis.db.impl1.DbManagerImpl.isPinValid(DbManagerImpl.java:872)
    at com.gisil.themis.ejb.ThemisBean.isPinValid(ThemisBean.java:185)
    at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl.isPinValid(Themis_aqqc4k_EOImpl.java:207)
    at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl_WLSkel.invoke(Unknown Source)
    at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:517)
    at weblogic.rmi.cluster.ClusterableServerRef.invoke(ClusterableServerRef.java:224)
    at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:407)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
    at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:403)
    at weblogic.rmi.internal.BasicServerRef.access$300(BasicServerRef.java:56)
    at weblogic.rmi.internal.BasicServerRef$BasicExecuteRequest.run(BasicServerRef.java:934)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
    at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1413)
    at weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1332)
    at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:440)
    at weblogic.jdbc.jta.DataSource.connect(DataSource.java:396)
    at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:359)
    at com.gisil.themis.db.impl1.DbManagerImpl.isPinValid(DbManagerImpl.java:872)
    at com.gisil.themis.ejb.ThemisBean.isPinValid(ThemisBean.java:185)
    at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl.isPinValid(Themis_aqqc4k_EOImpl.java:207)
    at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl_WLSkel.invoke(Unknown Source)
    at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:517)
    at weblogic.rmi.cluster.ClusterableServerRef.invoke(ClusterableServerRef.java:224)
    at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:407)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
    at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:403)
    at weblogic.rmi.internal.BasicServerRef.access$300(BasicServerRef.java:56)
    at weblogic.rmi.internal.BasicServerRef$BasicExecuteRequest.run(BasicServerRef.java:934)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)

  • OWB9.0.4-- ORA-02049: timeout: distributed transaction waiting for lock

    I'm running a simple mapping that copies all columns of data (using a filter on date for just current records) from one table in SQL Server into a staging table on my Oracle DW schema. It's using a dblink with transparent gateway for SQL Server, which works fine from SQL*plus.
    The map is in default mode (bulk-failoverto-row) with bulk size and commit frequency = 1000.
    The audit details show the first 1000 rows selected on the source, with an error on both the source and target tables:
    Target--
    ORA-02049: timeout: distributed transaction waiting for lock
    Source--
    ORA-01002: fetch out of sequence ORA-02063: preceding line from INTERGRATION@JXNSQL01
    (INTERGRATION@JXNSQL01 is the dblink name)
    Any ideas on how I can clear this up?
    Thanks,
    Paul

    Hi,
    After having upgraded to 9.0.4 (from 9.0.3) I'm running into exactly the same problems with some of my mappings. Actually I don't get any rows transferred from the mappings that fail.
    Out of 7 mappings, 3 worked just liked before while the 4 others just keep on running until I cancel them and I then see the BUSY/ORA-02049 in the Audit Browser.
    When comparing the mappings I see that the 3 that works all use some custom Procedures I have made.
    The 4 that doesn't work are all very simple - one of them just loads all the content from a table with two columns in my source to another table with two columns in my target! Two of the other mappings that doesn't work includes some simple CASE-expressions.
    Both my source and my target resides in a Oracle 9.2.0.3 database (not the same).
    Regards,
    Bent Madsen

  • ORA-27070: async read/write failed

    Hi,
    We have a 2 node RAC on AIX 5.3 TL10 with CRS & ASM on 11.1.0.7
    The DB is running on 10.2.0.4
    The servers use VIO-server connection to SAN & LAN
    This morning the flashbackrecovery diskgroup got unmounted because of a
    ORA-27070: async read/write failed
    WARNING: IO Failed. subsys:System dg:2, diskname:/dev/asmreco3 disk:0x2.0x93e51c34 au:895
    iop:0x110b7bbc0 bufp:0x700000006190000 offset(bytes):938913792 iosz:4096 operation:2(Write) synchronous:0
    result: 4 osderr:0x0 osderr1:0x0 pid:11739286
    NOTE: cache initiating offline of disk 2 group 2
    WARNING: initiating offline of disk 2.2481265716 (FB01_0002) with mask 0x7e
    NOTE: initiating PST update: grp = 2, dsk = 2, mode = 0x15
    kfdp_updateDsk(): 7
    Thu Dec 31 08:58:13 2009
    kfdp_updateDskBg(): 7
    ERROR: too many offline disks in PST (grp 2)
    NOTE: halting all I/Os to diskgroup FB01
    Thu Dec 31 08:58:13 2009
    SQL> alter diskgroup FB01 dismount force
    NOTE: active pin found: 0x70000000ddfe530
    NOTE: active pin found: 0x70000000ddfe110
    NOTE: active pin found: 0x70000000ddfe428
    NOTE: active pin found: 0x70000000ddfe320
    NOTE: active pin found: 0x70000000ddfe740
    NOTE: active pin found: 0x70000000ddfe218
    NOTE: active pin found: 0x70000000ddfe638
    NOTE: active pin found: 0x70000000ddfe530
    NOTE: active pin found: 0x70000000ddfe110
    NOTE: active pin found: 0x70000000ddfe428
    NOTE: active pin found: 0x70000000ddfe320
    NOTE: active pin found: 0x70000000ddfe740
    NOTE: active pin found: 0x70000000ddfe218
    NOTE: active pin found: 0x70000000ddfe638
    NOTE: cache dismounting group 2/0xCD55ECD5 (FB01)
    Thu Dec 31 08:58:14 2009
    kjbdomdet send to node 1
    detach from dom 2, sending detach message to node 1
    Thu Dec 31 08:58:14 2009
    Dirty detach reconfiguration started (old inc 24, new inc 24)
    List of nodes:
    0 1
    Global Resource Directory partially frozen for dirty detach
    * dirty detach - domain 2 invalid = TRUE
    2617 GCS resources traversed, 1 cancelled
    Dirty Detach Reconfiguration complete
    Thu Dec 31 08:58:15 2009
    WARNING: dirty detached from domain 2
    NOTE: cache dismounted group 2/0xCD55ECD5 (FB01)
    kfdp_dismount(): 8
    kfdp_dismountBg(): 8
    NOTE: De-assigning number (2,0) from disk (/dev/asmreco1)
    NOTE: De-assigning number (2,1) from disk (/dev/asmreco2)
    NOTE: De-assigning number (2,2) from disk (/dev/asmreco3)
    SUCCESS: diskgroup FB01 was dismounted
    There are however no errors on the OS level
    Any hints are welcome

    All has been checked, and rechecked.
    We now have a very strange situation:
    We testen failover by manually turning of one LPAR at a time.
    After this reboot, the Async I/O error seem to have gone.
    That is, they haven't appeared now for two days
    Why they occurred and why they don't occur anymore is not found/explained
    There I'll close this thread.

  • ORA-00060: deadlock detected while waiting for resource CLOSE cursor

    Hi,
    I am a new member of this forum. I am working with a problem we got a few weeks ago. It is from a Pro C batch executable running on 10 threads dealing with >800 data accessed from multiple tables. The error as reported came from a package.function call.
    This is the error I encountered:
    process_item~G****, D***~-60~ORA-00060: deadlock detected while waiting for resource~PACKAGE ERROR = CLOSE cursor C_***** in package R***.I*** 7641
    The cursor is a simple SELECT cursor without Table or Record locking.
    My questions are:
    *Upon the occurrence of this error, is the execution already at the CLOSE cursor line or did the error occurred between the OPEN cursor and the CLOSE cursor? There are several lines of code in between OPEN and CLOSE:
    - one that calls for a package.function that simply stores parameter values to a variable
    - another one which fetches the cursor. The group that holds the cursor values is only used by a single function in the package
    *Is it possible for this CLOSE cursor to cause a deadlock? What could have caused this?
    *From what I know, Oracle deals with deadlocks by aborting the deadlocking process while others continue, but this deadlock caused our program to hang. How is this possible? Could the root cause of the deadlock be from our threading program? This is a rare occurrence and happened only twice this year.
    Thanks,
    Raf

    Raf Serrano wrote:
    Hi,
    I am a new member of this forum. I am working with a problem we got a few weeks ago. It is from a Pro C batch executable running on 10 threads dealing with >800 data accessed from multiple tables. The error as reported came from a package.function call.
    This is the error I encountered:
    process_item~G****, D***~-60~ORA-00060: deadlock detected while waiting for resource~PACKAGE ERROR = CLOSE cursor C_***** in package R***.I*** 7641
    The cursor is a simple SELECT cursor without Table or Record locking.
    My questions are:
    *Upon the occurrence of this error, is the execution already at the CLOSE cursor line or did the error occurred between the OPEN cursor and the CLOSE cursor? There are several lines of code in between OPEN and CLOSE:
    - one that calls for a package.function that simply stores parameter values to a variable
    - another one which fetches the cursor. The group that holds the cursor values is only used by a single function in the package
    *Is it possible for this CLOSE cursor to cause a deadlock? What could have caused this?
    *From what I know, Oracle deals with deadlocks by aborting the deadlocking process while others continue, but this deadlock caused our program to hang. How is this possible? Could the root cause of the deadlock be from our threading program? This is a rare occurrence and happened only twice this year.
    Thanks,
    RafSELECT (without FOR UPDATE) statements are never involved in ORA-00060.
    only DML statements throw ORA-00060 error

  • Sqlldr- ORA-00060: deadlock detected while waiting for resource

    Hi Team,
    My database version is 11.1.0.7.0. I am loading the data using sqlldr. I am getting the error ORA-00060: deadlock detected while waiting for resource. once dead lock detected ,whether data will be rejected after commit point reached(Rows=100000). FYI information only sqllder is running on the database,it is getting completed withing 5-10min. please help me whether any other lock happening on this due to sqllder.
    sqlldr userid=orcl/orcle control=".$controlfile." log=".$logfile.".log data=".$datafile." bad=".$badfile." discard=".$discardfile." Bindsize=19000000 Rows=100000 Readsize=20000000 Errors=1000000";
    Thanks in advance

    user9256814 wrote:
    Hi Team,
    My database version is 11.1.0.7.0. I am loading the data using sqlldr. I am getting the error ORA-00060: deadlock detected while waiting for resource. once dead lock detected ,whether data will be rejected after commit point reached(Rows=100000). FYI information only sqllder is running on the database,it is getting completed withing 5-10min. please help me whether any other lock happening on this due to sqllder.
    sqlldr userid=orcl/orcle control=".$controlfile." log=".$logfile.".log data=".$datafile." bad=".$badfile." discard=".$discardfile." Bindsize=19000000 Rows=100000 Readsize=20000000 Errors=1000000";
    Thanks in advanceadditional clues will exist within alert_SID.ora file & subsequent trace file.

  • ORA-00060: deadlock detected while waiting for resource with Tbs Read-only

    Hi all,
    We're using Oracle 10.2.0.1 and 9.2.0.4.
    I'm testing the performing of a procedure that inserts, like this:
    CREATE OR REPLACE PROCEDURE P$TAD_TEST
    IS
    TYPE T_T1_C1          IS TABLE OF T1.C1%TYPE INDEX BY PLS_INTEGER;
    TYPE T_T1_DT           IS TABLE OF T1.DT%TYPE INDEX BY PLS_INTEGER;
    P_C1 T_T1_C1;
    P_DT T_T1_DT;
    P_RESULT NUMBER;
    BEGIN
    FOR j IN 1..4032 LOOP
    P_C1(j) := j;
    P_DT(j) := SYSDATE + (j/24/60);
    END LOOP;
    FORALL i IN P_C1.FIRST..P_C1.LAST SAVE EXCEPTIONS
    INSERT INTO T1 VALUES (P_C1(i), P_DT(i));
    EXCEPTION
    WHEN OTHERS THEN
    P_RESULT := SQLCODE;
    END;
    The table T1 is partitioned across 10 tablespaces. The test consist to take
    these tablespace read-only and perform the procedure, and analyze the results,
    like erros.
    but when I perform the procedure, The alert.log indicates the error
    ORA-00060: deadlock detected while waiting for resource.
    Why this occurs only the tablespaces are read-only?
    thank you!!!!

    Hi,
    yesterday we got this error again(in fact twice) and we were able to get the trace file. It says this is NOT oracle error. i was wrong in suspecting Oracle. This is the trace file details. i dont know how to debug this. Any help appreciated.
    *** 2010-06-15 16:24:29.243
    *** ACTION NAME:() 2010-06-15 16:24:29.231
    *** MODULE NAME:(JDBC Thin Client) 2010-06-15 16:24:29.231
    *** SERVICE NAME: 2010-06-15 16:24:29.231
    *** SESSION ID:(482.4266) 2010-06-15 16:24:29.231
    DEADLOCK DETECTED ( ORA-00060 )
    [Transaction Deadlock]
    The following deadlock is not an ORACLE error. It is a
    deadlock due to user error in the design of an application
    or from issuing incorrect ad-hoc SQL. The following
    information may aid in determining the deadlock:
    Deadlock graph:
    ---------Blocker(s)-------- ---------Waiter(s)---------
    Resource Name process session holds waits process session holds waits
    TX-00300021-0000b52d 209 482 X 247 474 S
    TX-002a0009-00011b24 247 474 X 209 482 S
    session 482: DID 0001-00D1-0000000A session 474: DID 0001-00F7-00000008
    session 474: DID 0001-00F7-00000008 session 482: DID 0001-00D1-0000000A
    Rows waited on:
    Session 474: obj - rowid = 0000CED4 - AAAM7UAAxAAAVgSAAA
    (dictionary objn - 52948, file - 49, block - 88082, slot - 0)
    Session 482: obj - rowid = 0000D8BF - AAANi/AAuAAB+z/AAA
    (dictionary objn - 55487, file - 46, block - 519423, slot - 0)
    Information on the OTHER waiting sessions:
    Session 474:
    pid=247 serial=31796 audsid=25502259 user: 62/USER
    O/S info: ....
    program: JDBC Thin Client
    application name: JDBC Thin Client, hash value=2546894660
    Current SQL Statement:
    INSERT QUERY1
    End of information on OTHER waiting sessions.
    Current SQL statement for this session:
    INSERT QUERY2
    Thanks,
    AK

Maybe you are looking for