DG端不定期报waiting for async I/Os failed错误

大家好，我这边数据库主库是RAC，物理DG端也是RAC，都采用的ASM，存储，DG端最近总是时不时的报错：
Errors in file /u01/oracle/diag/rdbms/racstandby/rac1/trace/rac1_arcr_11381.trc:
ORA-27061: waiting for async I/Os failed
Linux-x86_64 Error: 5: Input/output error
Additional information: -1
Additional information: 1048576
WARNING: Read Failed. group:2 disk:0 AU:247 offset:0 size:1048576
WARNING: failed to read mirror side 1 of virtual extent 19 logical extent 0 of file 277 in group [2.1197980967] from disk DATA_0000 allocation unit 247 reason error; if possible, will try another mirror side
Errors in file /u01/oracle/diag/rdbms/racstandby/rac1/trace/rac1_arcr_11381.trc:
ORA-00333: redo log read error block 38912 count 2048
ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
ORA-15081: failed to submit an I/O operation to a disk
ORA-15081: failed to submit an I/O operation to a disk
有时就报一两次，有时一下报一天，但看DG进程还都在，数据也都实时追着，不知道有什么影响，甚至有一次MRP0自己DOWN掉不知道和这个有没有关系，实际去ASM中查看文件可以访问，检测坏块也没有，删掉重建redo仍有此问题，删掉整个库从新做主从仍然有此问题，希望大家帮看看，感激
TRACE文件内容：
Trace file /u01/oracle/diag/rdbms/racstandby/rac1/trace/rac1_arcr_11381.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
ORACLE_HOME = /u01/oracle/11.2.0.3/product
System name: Linux
Node name: racstandby1
Release: 2.6.18-274.el5
Version: #1 SMP Fri Jul 22 04:43:29 EDT 2011
Machine: x86_64
Instance name: rac1
Redo thread mounted by this instance: 1
Oracle process number: 62
Unix process pid: 11381, image: oracle@racstandby1 (ARCR)
*** 2012-10-24 22:00:56.861
*** SESSION ID:(1714.1) 2012-10-24 22:00:56.861
*** CLIENT ID:() 2012-10-24 22:00:56.861
*** SERVICE NAME:(SYS$BACKGROUND) 2012-10-24 22:00:56.861
*** MODULE NAME:() 2012-10-24 22:00:56.861
*** ACTION NAME:() 2012-10-24 22:00:56.861
Initial buffer sizes: read 1024K, overflow 832K, change 805K
ORA-27061: waiting for async I/Os failed
*** 2012-10-25 10:04:19.253
Linux-x86_64 Error: 5: Input/output error
Additional information: -1
Additional information: 1048576
WARNING: Read Failed. group:2 disk:0 AU:247 offset:0 size:1048576
path:/dev/oracleasm/disks/VOL_DATA1
incarnation:0xefd74ddb asynchronous result:'I/O error'
subsys:System iop:0x2b3b7a33e780 bufp:0x2b3b7b42d000 osderr:0x0 osderr1:0x0
WARNING: failed to read mirror side 1 of virtual extent 19 logical extent 0 of file 277 in group [2.1197980967] from disk DATA_0000 allocation unit 247 reason error; if possible, will try another mirror side
DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
ORA-15081: failed to submit an I/O operation to a disk
ORA-15081: failed to submit an I/O operation to a disk
ORA-00333: redo log read error block 38912 count 2048
ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
ORA-15081: failed to submit an I/O operation to a disk
ORA-15081: failed to submit an I/O operation to a disk
ORA-27072: File I/O error
Linux-x86_64 Error: 5: Input/output error
Additional information: 4
Additional information: 505856
Additional information: -1
WARNING: Read Failed. group:2 disk:0 AU:247 offset:0 size:1048576
path:/dev/oracleasm/disks/VOL_DATA1
incarnation:0xefd74ddb synchronous result:'I/O error'
subsys:System iop:0x2b3b7a33e780 bufp:0x2b3b7b42d000 osderr:0x0 osderr1:0x0
WARNING: failed to read mirror side 1 of virtual extent 19 logical extent 0 of file 277 in group [2.1197980967] from disk DATA_0000 allocation unit 247 reason error; if possible, will try another mirror side
DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
ORA-15081: failed to submit an I/O operation to a disk
ORA-00333: redo log read error block 38912 count 2048
ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
ORA-15081: failed to submit an I/O operation to a disk
Incomplete read from log member '+DATA/racstandby/onlinelog/group_7.277.797513635'. Trying next member.
ORA-27072: File I/O error
Linux-x86_64 Error: 5: Input/output error
Additional information: 4
Additional information: 251904
Additional information: -1
WARNING: Read Failed. group:3 disk:0 AU:123 offset:0 size:1048576
path:/dev/oracleasm/disks/VOL_FRA1
incarnation:0xefd74ddd synchronous result:'I/O error'
subsys:System iop:0x2b3b7a33e780 bufp:0x2b3b7b42d000 osderr:0x0 osderr1:0x0
WARNING: failed to read mirror side 1 of virtual extent 19 logical extent 0 of file 325 in group [3.1197980968] from disk FRA_0000 allocation unit 123 reason error; if possible, will try another mirror side
DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
ORA-00312: online log 7 thread 1: '+FRA/racstandby/onlinelog/group_7.325.797513637'
ORA-15081: failed to submit an I/O operation to a disk
ORA-00333: redo log read error block 38912 count 2048
ORA-00312: online log 7 thread 1: '+FRA/racstandby/onlinelog/group_7.325.797513637'
ORA-15081: failed to submit an I/O operation to a disk
Incomplete read from log member '+FRA/racstandby/onlinelog/group_7.325.797513637'. Trying next member.
*** 2012-10-25 10:04:19.372 4320 krsh.c
ARCr: All Archive destinations made inactive due to error 333
*** 2012-10-25 10:04:19.398 2932 krsi.c
krsi_dst_fail: dest:1 err:333 force:0 blast:1
ORA-27061: waiting for async I/Os failed
Linux-x86_64 Error: 5: Input/output error
Additional information: -1
Additional information: 1048576
WARNING: Read Failed. group:2 disk:0 AU:248 offset:0 size:1048576
path:/dev/oracleasm/disks/VOL_DATA1
incarnation:0xefd74ddb asynchronous result:'I/O error'
subsys:System iop:0x2b3b7a33e500 bufp:0x2b3b7b53d000 osderr:0x0 osderr1:0x0
WARNING: failed to read mirror side 1 of virtual extent 20 logical extent 0 of file 277 in group [2.1197980967] from disk DATA_0000 allocation unit 248 reason error; if possible, will try another mirror side
DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
ORA-00312: online log 7 thread 1: '+FRA/racstandby/onlinelog/group_7.325.797513637'
DDE: Problem Key 'ORA 312' was flood controlled (0x1) (no incident)
ORA-00312: online log 7 thread 1: '+DATA/racstandby/onlinelog/group_7.277.797513635'
ORA-00312: online log 7 thread 1: '+FRA/racstandby/onlinelog/group_7.325.797513637'
*** 2012-10-25 10:04:19.546 4481 kcrr.c

ORA-15081: failed to submit an I/O operation to a disk
ORA-15081: failed to submit an I/O operation to a disk
ORA-27072: File I/O error
Linux-x86_64 Error: 5: Input/output error
Additional information: 4
Additional information: 505856
15081, 00000, "failed to submit an I/O operation to a disk"
// *Cause: A submission of an I/O operation to a disk has failed.
// *Action: Make sure that all the disks are operational.
ORA-15081一般与存储磁盘有关，请把/var/log/messages、dmesg日志发给我
在11gR2中ORA-15081 可能导致instance crash
有问题请去OTN中文论坛开个帖子我会回复地址：http://www.otncn.org
如果需要发送附件，可以直接发邮件到 [email protected]

Similar Messages

ORA-27061: waiting for async I/Os failed

Hi Techies
In order to sync. prod. system with DR system we are copying
archive logs on DR server & applying archive logs.
I am getting following error.
RA-00283: recovery session canceled due to errors
ORA-12801: error signaled in parallel query server P000
ORA-27061: waiting for async I/Os failed
IBM AIX RISC System/6000 Error: 22: Invalid argument
ORA-27061: waiting for async I/Os failed
IBM AIX RISC System/6000 Error: 22: Invalid argument
SAP--ECC 6.0
DB--Oracle 10g
OS--AIX 5.3
Thanks in advance
Vijay

Hello Vijay,
your given information is a little bit moderate, but it seems like the problem, that is described in metalink note #464768.1.
This problem is known with the following aix packages:
bos.rte.aio fileset at the 5.3.0.60 or 5.3.0.61 level
Fix it with installing the APAR IZ03260. (http://www-01.ibm.com/support/docview.wss?uid=isg1fixinfo105422)
Regards
Stefan

Update query is waiting for async descriptor resize

Hi All,
One of the update query which was completing in 1-2 mins. Suddenly today it started taking more than 3-4 hours and still it is running.
Below is the query, I can see the explain plain. I can see the query is waiting for async descriptor resize wait event
UPDATE AP_INVOICE_DISTRIBUTIONS SET POSTED_FLAG = 'N' WHERE POST
ED_FLAG = 'S' AND (ACCOUNTING_DATE >= :B2 OR :B2 IS NULL) AND (A
CCOUNTING_DATE <= :B1 OR :B1 IS NULL)
when i checked the P1text, P2text columns of v$session, it is showing outstanding #aio,current ai0 limit respectively.
Explan plan
CODEPLAN_TABLE_OUTPUT
| Id | Operation                      | Name                         | Rows | Bytes | Cost (%CPU)| Time     |
|   0 | UPDATE STATEMENT               |                              |       |       |   250 (100)|          |
|   1 | UPDATE                        | AP_INVOICE_DISTRIBUTIONS_ALL |       |       |            |          |
|   2 |   NESTED LOOPS                 |                              |       |       |            |          |
|   3 |    NESTED LOOPS                |                              |    39 | 12480 |   250   (0)| 05:14:02 |
|* 4 |     TABLE ACCESS BY INDEX ROWID| AP_ACCOUNTING_EVENTS_ALL     |    39 |   624 |   145   (0)| 03:02:09 |
|* 5 |      INDEX RANGE SCAN          | AP_ACCOUNTING_EVENTS_N2      | 3954 |       |    14   (0)| 00:17:36 |
|* 6 |     INDEX RANGE SCAN           | AP_INVOICE_DISTRIBUTIONS_N18 |     4 |       |     2   (0)| 00:02:31 |
PLAN_TABLE_OUTPUT
|* 7 |    TABLE ACCESS BY INDEX ROWID | AP_INVOICE_DISTRIBUTIONS_ALL |     1 |   304 |     4   (0)| 00:05:02 |
CODE
Please help me on this.
Env Details --
DB version -- 11.2.0.1
OS - IBM AIX.
Thanks in advance...

This could be this bug
Bug 9829397 - Excessive CPU and many "asynch descriptor resize" waits for SQL using Async IO (Doc ID 9829397.8)

TS4062 ipad frozen, tried reset from rec. mode, usb cable showing on screen, waiting for ipad, then ipad fails to respond. what can i do?

ipad mini froze when charging, have tried all restore options, when i get to waiting for ipad in itunes when restoring in recovery mode the usb cable disappears from the screen, the apple logo appears then the recovery line beneath logo, then there is no further response from ipad. have been trying to resolve this issue for couple days now very frustrated. can anyone help please?

Use the charger that came with the iPad or a name brand charger of equal or greater capacity. Plug that into a known good wall outlet. Then wait at least an hour. While the iPad is still plugged in to the charger reset your iPad. Press and hold the Home and Sleep buttons simultaneously until the Apple logo appears. Let go of the buttons and let the device restart.
If the iPad restarts continue to charge it until the battery is at 100%
If the iPad does not start Make an appointment at an Apple Store to have your device examined by a technician. Or contact Apple Support.

How to fix: facetime waiting for activation

Iphone 4 on ATT network. My facetime used to work OK before. Recently I noticed that the facetime icon disappeared when in a call, and from the contacts. I found out that in the Settings facetime was off. However, whenever I try to toggle to ON, it stays on waiting for activation, then it fails. Any suggestions will be greatly appreciated.(MMS and SMS work with no problem).
Thanks

wifi is fine, apple servers r to busy to effectively use facetime and imessages right now is all. and activation error is due to high server traffic as well. keep trying or wait, thats it

IMessage & SMS 'waiting for activation' ??

Ok so what is the go cannot send any text or iMessage it's always stuck on 'waiting for activation' and always fails after half an hour or do anyway ?
Used to be able to send SMS on my iPhone 4 but bought iPhone 4s first day it came out with ios 5 no luck with text messaging what's wrong ?

I live in Costa Rica, I have an iPhone 5, updated to iOs 8, deactivated iMessage to enable sms on Yosemite. Anyway, reactivated iMessage and it just says Waiting for activation, and I get strange international SMS's every 1-3 hours. Seems like the iPhone doesn't recognize these activation SMS's. Tried everything I have found: resetting, restoring, etc. Please help.

NetworkManager : stuck at "waiting for authorization"

Hi!
Installed Arch on my Thinkpad Edge E125 and now having a little problem with NetworkManager in KDE.
I'm certain I've installed pretty much everything needed to make wireless connection possible, the command
iwlist wlan0 scan
is able to produce a list of wireless routers.
But trying to connect to my home wireless router always stuck at "waiting for authorization" and eventually failed.
I have WEP encryption and double check it to be correct. Wireless worked in other distros.
Any suggestion you might have? Thank you.

Ecky wrote:Did you go into Manage Connections in kde networkmanager and enter your wep key in the Wireless Security tab for your connection?
Yes I did. Tried entering dozens of time actually. Thank you anyway.
Now moved to Opensuse and now despite having the correct modules being loaded, my network interface is invisible to the OS!!!
Might return to Ubuntu, where everything just works or cave in to Windows 7 if my patience run out.
For months struggling with one form or another problems with Linux, I just miss more and more of the days where I could could simply get stuff done.
Sad but true.

When I try to sync my ipod touch, itunes v11, displays waiting for sync to start, then a meesage appears saying sync failes as device timed out.

when i try to sync my ipod, itunes v11 says "waiting for sync to start" then a message appears "sync failed, device timed out.

Have you looked at the previous discussions listed on the right side of this page under the heading "More Like This"?

When i was waiting for an hour for itunes to grading my 2nd generation ipod touch to a 4.2.1 and it was about done, it suddenly said the network connection timed out and that made the upgrading a fail. Why does it do that? and what does it mean?

When i was waiting for an hour for itunes to grading my 2nd generation ipod touch to a 4.2.1 and it was about done, it suddenly said the network connection timed out and that made the upgrading a fail. Why does it do that? and what does it mean?

Error -3259 is a network timeout error, usually. This article might help:
http://support.apple.com/kb/TS2799

Using Async to wait for a specific event

I've simplified the creation and deletion calls and used a generic item. In my before method, I call Async.handleEvent to wait for PropertyChangeEvents, but this only waits for the first one. My problem lies in the fact that ItemManager is an IEventDispatcher that sends multiple property change events, but I need to wait for the specific event with the property "item". However, when I call Async inside the handler, it does not keep the Test method from running, Before assumes that it's Async responsibilities have been fulfilled and launches the next stage of tests. How can I keep Before from moving on until an event with a specific property has been received?
public class Test
        private static const TIME_OUT:int = 3000;
        [Before(async)]
        public function runBeforeEveryTest() : void
            // Create a new item
            item.create(); // This is an asynchronous creation that sends many Property Change events
            //Wait for the item to be created before continuing tests.
            Async.handleEvent( this, ItemManager.instance, PropertyChangeEvent.PROPERTY_CHANGE, handlePropertyChangeForItem, TIME_OUT);
        [After]
        public function runAfterEveryTest() : void
            // Delete the Item
            item.delete();
        [Test(async)]
        public function itemExists() : void
                  Assert.assertTrue( item.exists() );
       private function handlePropertyChangeForItem(evt:PropertyChangeEvent, eventObject:Object) : void
             if (evt.property == "item")
                 // Now that the item has been created, we can start the tests.
                 return;
             else
                 // Keep waiting.
                 Async.handleEvent( this, ItemManager.instance, PropertyChangeEvent.PROPERTY_CHANGE, handlePropertyChangeForItem, TIME_OUT);
Thanks in advance, it's greatly appreciated!

I can't reproduce this issue. All seems to be working fine with multiple deferred Async calls. I am pasting my code in. Since I did not have your manager, I tried to repiicate this with a timer. If you could look at my code and see if it differs from yours in a significant way, I can take another shot, but it seems to be working as expected.
package
import flash.events.TimerEvent;
import flash.utils.Timer;
import mx.events.PropertyChangeEvent;
import org.flexunit.Assert;
import org.flexunit.async.Async;
public class NestedAsync {
private static const TIME_OUT:int = 3000;
private var timer:Timer;
Before(async)]
public function runBeforeEveryTest() : void { timer =
new Timer( 1000, 5 );
Async.handleEvent(this, timer, TimerEvent.TIMER, handleTimerTick, TIME_OUT);timer.start();}
[After]
public function runAfterEveryTest() : void { timer.stop();
timer =
null;}
Test(async)]
public function itemExists() : void {Assert.assertTrue(
true );}
private function handleTimerTick(evt:TimerEvent, eventObject:Object) : void {
if ( timer.currentCount == 5 ) {
    // Now that the item has been created, we can start the tests.
    return; }
else {
    // Keep waiting.    Async.handleEvent(
this, timer, TimerEvent.TIMER, handlePropertyChangeForItem, TIME_OUT);
suite.cases {

HT1386 I SUDDENLY GET THE MESSAGE "WAITING FOR SYNC TO START" AND THEN SEVERAL MINUTES LATER A MESSAGE SAYING SYNC HAS FAILED BECUASE IT DIDN'T START!

I SUDDENLY GET THE MESSAGE "WAITING FOR SYNC TO START" AND THEN SEVERAL MINUTES LATER A MESSAGE SAYING SYNC HAS FAILED BECAuSE IT DIDN'T START!

Se if this previous discussion helps:
Sync Session Failed to Start iTouch iOS5: Apple Support Communities

Failed to wait for process condition: errno(22).

Hello,
I am experiencing some failures with FMS 3.5.1.
Searched the logs and it appears the following error repeats itself more than 20 times per second in the admin logs:
Failed to wait for process condition: errno(22).
Can anyone offer some info on this error ?
Thanks

check that:
http://kb2.adobe.com/cps/407/kb407245.html

My Ipod would not sync to the itunes at all, Help? Itunes shows waiting for sync to start. then get a message saying that it failed to start. I restored the ipod but the problem still occured.

I have already updated all my itunes software and everything else.
recently, when I connect my ipod itouch to my itunes, it shows waiting for sync to start.
Then a message saying that it failed to start.
I have restored my itouch but it still fails to sync.
Any suggestions how to resolve it?

Se if this previous discussion helps:
Sync Session Failed to Start iTouch iOS5: Apple Support Communities

Streaming Failed with WAITING FOR A SUBSCRIBER TO BE ADDED

Hi, Gurus
Our Environment
Oracle11g r2 Version 11.2.0.1.0
Linux RHEL 5.5 64bit
We had Setup and Configured the Oracle Bi-directional Streaming which is working successfully for week and yesterday for some reason we have reboot the
both the Locations Servers in same time and after the reboot Our Oracle streaming processes status is ok on both the end but we shown that
V$STREAMS_CAPTURE view shown the state something like "WAITING FOR A SUBSCRIBER TO BE ADDED".
We had tested and got that our streaming is not more working?
Please guide for resolved the problem?
Any suggestions and help is appreciated.
Regards
Hitgon
Edited by: hitgon on Jan 27, 2012 10:33 PM
Edited by: hitgon on Jan 27, 2012 10:34 PM

Hi All,
Please refer the Metalink document
State of Streams Capture Showing 'WAITING FOR A SUBSCRIBER TO BE ADDED' [ID 1189244.1]
Unpublished bug 9115882 has been fixed on RDBMS release 12.1 and patchset 11.2.0.2.
So On wards 11.2.0.2.0. same issue is not longer happen.
We should go with 11.2.0.2.0. for resolved the issue.
Thanks
Hitesh Gondalia

Mac to iPad sync fails, "waiting for changes to be applied"

Wifi itunes sync of one-week-old iPad to Mac running recent Lion, iTunes hung with message on "Step 6" saying "waiting for changes to be applied."
I've seen lots of users report this, but this was with a pure Apple-to-Apple configuration, with an iPad 2 literally only a week old.

Try this previous discussion:
"Waiting for changes to be applied": Apple Support Communities

DG端不定期报waiting for async I/Os failed错误

Similar Messages

Maybe you are looking for