ORA-19502, ORA-27601, async_io fails, Linux RHEL5 Update 2, Oracle 10.2.0.4

We have encountered the disk I/O errors noted elsewhere and in Metalink 395350.1 but are not using Veritas and do not want to set disk_asynch_io=false and filesystemio_options=none. We are using ASM with a corporate SAN, Oracle oracleasm libraries but the problem occurs only at the local RAID which is Linux filesystem not ASM.
Linux Redhat version is 2.6.18-92.e15xen x86-64
Oracle version 10.2.0.4.0
Server is Dell R900
Any help would be appreciated.
Peter

Frits, many thanks for your effort on this. Unfortunately, I will not have access to the system until Jan 5.
I had looked for OS error messages under /var/log/message and found empty files for aio. As for aio timeout, when last the instance hung, a log file sync session (LGWR) was blocking everything else for over an hour.
We could not kill any processes even using kill -9. And /sbin/shutdown -r now would NOT shutdown the server. Shutdown abort of the instance did nothing. I shutdown the ASM instance normally and then found the db instance still running.
I understand what you are saying about aio-max-nr and aio-nr; that the resource starvation, if indeed that is the fault, is not due to the aio configuration.
you wrote:
I still think the database issued an AIO call which got an error back from the operating system, because of parameters which were invalid according to the O/S.
This error looks remarkably much like the veritas error message, which was a issue because of IO size
if db parameters are invalid according to O/S then why is this error so intermittent? I recall the veritas error had Linux error 26 and my problem has Linux error 5. But in any case, how can a faulty configuration result in a) very intermittent errors and b) no errors in a Development environment that is identical in configuration and activity related to redo and archive?
I will set the event=27601 on Monday and report back; but why not set event=19502 instead?
Again, many thanks for your insight and time
Peter

Similar Messages

  • ORA-19502, ORA-27601, async_io fails

    I have posted the following on the Linux forum as well. After reading posts on this forum please note we are not running out of disk space and permissions are ok. We have other servers identically configured with no errors. One hypothesis is that it may have to do with Netbackup 6 client being installed. Our normal configuration is with disk_asynch_io=true and filesystemio_options=setall. We have temporarily set these 2 params to false and none to see if this intermittent problem stops.
    We have encountered the disk I/O errors noted elsewhere and in Metalink 395350.1 but are not using
    Veritas and do not want to set disk_asynch_io=false and filesystemio_options=none. We are using ASM with
    a corporate SAN, Oracle oracleasm libraries but the problem occurs only at the local RAID which is Linux ext2
    filesystem not ASM.
    Linux Redhat version is 2.6.18-92.e15xen x86-64
    Oracle version 10.2.0.4.0
    Server is Dell R900
    Any help would be appreciated.
    Peter

    Can you post the error message?
    I guess the error ORA-27601 is incorrect. I see the following Metalink note 396057.1- ORA-19502 ORA-27061 Warning:Oracle Process Running Out Of Os Kernel I/O Resources.
    its a Bug 5609038.
    Edited by: Anantha on Dec 30, 2008 10:30 AM
    Edited by: Anantha on Dec 30, 2008 10:31 AM

  • ORA-19502 & ORA-19502 when try to backup using rman

    I'm trying to backup database to a specific folder but it's failing:
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03009: failure of backup command on ORA_DISK_1 channel at 04/11/2013 22:41:59
    ORA-19502: write error on file "/home/backup/rmanbackup/bak_11_1_812500536_test", block number 3520128 (block size=8192)
    ORA-27072: File I/O error
    Linux-x86_64 Error: 11: Resource temporarily unavailable
    Additional information: 4
    Additional information: 3520128
    Additional information: 274432
    command for backup is following:
    backup database format '/home/backup/rmanbackup/bak_%s_%p_%t_test';
    Can you help me to solve the problem.

    Levi Pereira wrote:
    When asking a question always provide your database and OS version (e.g. Oracle 11.2.0.3)OS: SUSE Linux Enterprise Server 10 (x86_64). Oracle Version: 11.1.0.7.0
    >
    Are you using local or network filesystem (such as NFS)?Local
    Edited by: 996454 on Apr 14, 2013 2:06 AM

  • ORA-19870 ORA-19502 ORA-27072 RMAN

    ORA-19870: error reading backup piece......
    ORA-19502 write error on file blah/blah/blah/datafile, blockno 5361 (blocksize=8192)
    ORA-27072: File I/O error
    Linux-x86_64 Error: 9: Bad file descriptor
    Additional information: 4
    Additional information: 5361
    Additional information: 69632
    ....it started out fine, did about 9 datafiles and then the rest of them started failing with the above string.
    Any ideas on what the scoop is?
    thanks!

    Linux-x86_64 Error: 9: Bad file descriptor
    Additional information: 4OS error; not Oracle.
    post results from following as in below
    df -h
    bcm@bcm-laptop:~$ df -h
    Filesystem            Size  Used Avail Use% Mounted on
    /dev/sda1             108G   17G   86G  17% /
    udev                  497M  256K  497M   1% /dev
    none                  497M  856K  496M   1% /dev/shm
    none                  497M   80K  497M   1% /var/run
    none                  497M     0  497M   0% /var/lock
    none                  497M     0  497M   0% /lib/init/rw

  • RMAN-3002 ORA-19502 ORA-27072

    I'm doing restore and recover of the db using the following command:
    RMAN>
    run{
    set newname for datafile 6 to '/u01/app/oracle/oradata/orcl/tbsad01.dbf';
    restore database;
    recover database;
    I get the following errors during restore command
    RMAN-03002: failure of restore command(...)
    ORA-19502: write error on file "/u01/app/oracle/oradata/orcl/tbsad01.dbf", block no 6016(blocksize=8192)
    ORA-27072: File I/O error
    Linux Error: 2: No such file or directory
    But the directory exists. It's 10.2 database running on Linux.
    Thx,
    A.

    check space at this new mount point '/u01/app/oracle/oradata/orcl/' where you want to restore the file tbsad01.dbf.
    moreever restore only concerned tablespace rather alls tablespace i.e
    run{
    set newname for datafile 1 to
    '$HOME/ORADATA/u04/users01.dbf';
    restore tablespace users;
    switch datafile all;
    recover tablespace users;
    }Khurram

  • Ora 19502, ora 27072

    hi all
    Db is running 10g
    when I checked v$log on of the redo log member is invalid so I did alter database clear log file ..group <number> at the inactive state
    now my alert logs say 19502,27072 so i checked archiver value in v$instance it says "failed".
    But at the same time when I checked archive log list it says it is in arhive enable mode.
    please help me on this....

    Have you read NOTE:465562.1 on Metalink? Is it yours?
    It's about Samba restriction.

  • ORA-19502

    Hi,
    Db :11.2
    We got the below error when take archive backup.Next archive backup was completed,We didn't do anything.
    channel ORA_DISK_3 disabled, job failed on it will be run on another channel
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03009: failure of backup command on ORA_DISK_4 channel at 12/11/2013 04:01:49
    ORA-19502: write error on file "/BKUP/I092/backupset/gmor7d99_1_1", block number 12289 (block size=512)
    ORA-27072: File I/O error
    Additional information: 4
    Additional information: 12289
    Additional information: 3584
    Does it mean due to space issue? or  corruption at filesystem level
    Br,
    Raj

    Hi,
    Please check Oracle support id :
    RMAN Backup Fails: ORA-19502 ORA-27072[Article ID 358535.1]
    ORA-19502 ORA-27072 During RMAN Backup[Article ID 422530.1]
    Thank you

  • Database won't start!  ORA-12578: TNS:wallet open failed...HELP!

    I went to "bounce" (shutdown immediate -> startup)a database because something had pegged the cpu at 100% and no users were active and got tyhe following errors...
    SQL*Plus: Release 11.2.0.1.0 Production on Wed Oct 26 13:35:53 2011
    Copyright (c) 1982, 2010, Oracle. All rights reserved.
    Enter user-name: sys as sysdba
    Enter password:
    Connected to an idle instance.
    SQL> startup
    ORACLE instance started.
    Total System Global Area 778387456 bytes
    Fixed Size 1374808 bytes
    Variable Size 503317928 bytes
    Database Buffers 260046848 bytes
    Redo Buffers 13647872 bytes
    Database mounted.
    ORA-01092: ORACLE instance terminated. Disconnection forced
    ORA-12578: TNS:wallet open failed
    Process ID: 4756
    Session ID: 1 Serial number: 5
    SQL>
    In Alert.log:
    Starting ORACLE instance (normal)
    Wed Oct 26 09:17:31 2011
    LICENSE_MAX_SESSION = 0
    LICENSE_SESSIONS_WARNING = 0
    Picked latch-free SCN scheme 2
    Using LOG_ARCHIVE_DEST_1 parameter default value as USE_DB_RECOVERY_FILE_DEST
    Autotune of undo retention is turned on.
    IMODE=BR
    ILAT =84
    LICENSE_MAX_USERS = 0
    SYS auditing is disabled
    Starting up:
    Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production
    With the Partitioning, OLAP, Data Mining and Real Application Testing options.
    Using parameter settings in server-side spfile E:\ORACLE\PRODUCT\11.2.0\DBHOME_1\DATABASE\SPFILEORCL.ORA
    System parameters with non-default values:
    processes = 500
    memory_target = 1232M
    control_files = "E:\ORACLE\ORADATA\ORCL\CONTROL01.CTL"
    control_files = "E:\ORACLE\FLASH_RECOVERY_AREA\ORCL\CONTROL02.CTL"
    db_block_size = 8192
    compatible = "11.2.0.0.0"
    log_buffer = 10485760
    db_recovery_file_dest = "E:\Oracle\flash_recovery_area"
    db_recovery_file_dest_size= 3852M
    undo_tablespace = "UNDOTBS1"
    remote_login_passwordfile= "EXCLUSIVE"
    db_domain = "accounts.cdcr.ca.gov"
    dispatchers = "(PROTOCOL=TCP) (SERVICE=orclXDB)"
    local_listener = "LISTENER_ORCL"
    session_cached_cursors = 200
    job_queue_processes = 1000
    audit_file_dest = "E:\ORACLE\ADMIN\ORCL\ADUMP"
    audit_trail = "DB"
    db_name = "orcl"
    open_cursors = 300
    diagnostic_dest = "E:\ORACLE"
    Wed Oct 26 09:17:40 2011
    PMON started with pid=2, OS id=3108
    Wed Oct 26 09:17:40 2011
    VKTM started with pid=3, OS id=3112 at elevated priority
    VKTM running at (10)millisec precision with DBRM quantum (100)ms
    Wed Oct 26 09:17:40 2011
    GEN0 started with pid=4, OS id=3116
    Wed Oct 26 09:17:40 2011
    DIAG started with pid=5, OS id=3128
    Wed Oct 26 09:17:40 2011
    DBRM started with pid=6, OS id=3136
    Wed Oct 26 09:17:41 2011
    PSP0 started with pid=7, OS id=3140
    Wed Oct 26 09:17:41 2011
    DIA0 started with pid=8, OS id=3144
    Wed Oct 26 09:17:41 2011
    MMAN started with pid=9, OS id=3148
    Wed Oct 26 09:17:41 2011
    DBW0 started with pid=10, OS id=3160
    Wed Oct 26 09:17:41 2011
    LGWR started with pid=11, OS id=3168
    Wed Oct 26 09:17:41 2011
    CKPT started with pid=12, OS id=3176
    Wed Oct 26 09:17:41 2011
    SMON started with pid=13, OS id=3184
    Wed Oct 26 09:17:41 2011
    RECO started with pid=14, OS id=3192
    Wed Oct 26 09:17:42 2011
    MMON started with pid=15, OS id=3196
    Wed Oct 26 09:17:42 2011
    starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
    Wed Oct 26 09:17:42 2011
    MMNL started with pid=16, OS id=3200
    starting up 1 shared server(s) ...
    ORACLE_BASE from environment = E:\Oracle
    Wed Oct 26 09:17:45 2011
    alter database mount exclusive
    Wed Oct 26 09:17:53 2011
    Successful mount of redo thread 1, with mount id 1293322043
    Database mounted in Exclusive Mode
    Lost write protection disabled
    Wed Oct 26 09:17:55 2011
    Completed: alter database mount exclusive
    alter database open
    Beginning crash recovery of 1 threads
    Started redo scan
    Completed redo scan
    read 0 KB redo, 0 data blocks need recovery
    Started redo application at
    Thread 1: logseq 1019, block 2, scn 15641501
    Recovery of Online Redo Log: Thread 1 Group 2 Seq 1019 Reading mem 0
    Mem# 0: E:\ORACLE\ORADATA\ORCL\REDO02.LOG
    Completed redo application of 0.00MB
    Completed crash recovery at
    Thread 1: logseq 1019, block 3, scn 15661503
    0 data blocks read, 0 data blocks written, 0 redo k-bytes read
    Wed Oct 26 09:18:06 2011
    Thread 1 advanced to log sequence 1020 (thread open)
    Thread 1 opened at log sequence 1020
    Current log# 3 seq# 1020 mem# 0: E:\ORACLE\ORADATA\ORCL\REDO03.LOG
    Successful open of redo thread 1
    Wed Oct 26 09:18:08 2011
    MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
    Wed Oct 26 09:18:08 2011
    SMON: enabling cache recovery
    Errors in file e:\oracle\diag\rdbms\orcl\orcl\trace\orcl_ora_3276.trc:
    ORA-12578: TNS:wallet open failed
    Errors in file e:\oracle\diag\rdbms\orcl\orcl\trace\orcl_ora_3276.trc:
    ORA-12578: TNS:wallet open failed
    Error 12578 happened during db open, shutting down database
    USER (ospid: 3276): terminating the instance due to error 12578
    Instance terminated by USER, pid = 3276
    ORA-1092 signalled during: alter database open...
    opiodr aborting process unknown ospid (3276) as a result of ORA-1092
    Wed Oct 26 09:18:13 2011
    ORA-1092 : opitsk aborting process
    In the trace file:
    Trace file e:\oracle\diag\rdbms\orcl\orcl\trace\orcl_ora_3276.trc
    Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production
    With the Partitioning, OLAP, Data Mining and Real Application Testing options
    Windows NT Version V6.0 Service Pack 1
    CPU : 1 - type 586, 1 Physical Cores
    Process Affinity : 0x0x00000000
    Memory (Avail/Total): Ph:5079M/6142M, Ph+PgF:10214M/12444M, VA:1034M/2047M
    VM name : VMWare Version (6)
    Instance name: orcl
    Redo thread mounted by this instance: 1
    Oracle process number: 19
    Windows thread id: 3276, image: ORACLE.EXE (SHAD)
    *** 2011-10-26 09:18:01.283
    *** SESSION ID:(1.3) 2011-10-26 09:18:01.283
    *** CLIENT ID:() 2011-10-26 09:18:01.283
    *** SERVICE NAME:() 2011-10-26 09:18:01.283
    *** MODULE NAME:(oradim.exe) 2011-10-26 09:18:01.283
    *** ACTION NAME:() 2011-10-26 09:18:01.283
    Thread 1 checkpoint: logseq 1019, block 2, scn 15641501
    on-disk rba: logseq 1016, block 24845, scn 15581487
    start recovery at logseq 1019, block 2, scn 15641501
    *** 2011-10-26 09:18:01.751
    Started writing zeroblks thread 1 seq 1019 blocks 3-10
    *** 2011-10-26 09:18:02.329
    Completed writing zeroblks thread 1 seq 1019
    *** 2011-10-26 09:18:02.876
    ==== Redo read statistics for thread 1 ====
    Total physical reads (from disk and memory): 4096Kb
    -- Redo read_disk statistics --
    Read rate (ASYNC): 0Kb in 1.55s => 0.00 Mb/sec
    Longest record: 0Kb, moves: 0/1 (0%)
    Longest LWN: 0Kb, moves: 0/1 (0%), moved: 0Mb
    Last redo scn: 0x0000.00eeab9e (15641502)
    ----- Recovery Hash Table Statistics ---------
    Hash table buckets = 32768
    Longest hash chain = 0
    Average hash chain = 0/0 = 0.0
    Max compares per lookup = 0
    Avg compares per lookup = 0/0 = 0.0
    *** 2011-10-26 09:18:03.626
    KCRA: start recovery claims for 0 data blocks
    *** 2011-10-26 09:18:04.094
    KCRA: blocks processed = 0/0, claimed = 0, eliminated = 0
    *** 2011-10-26 09:18:04.891
    Recovery of Online Redo Log: Thread 1 Group 2 Seq 1019 Reading mem 0
    *** 2011-10-26 09:18:04.984
    Completed redo application of 0.00MB
    *** 2011-10-26 09:18:04.984
    Completed recovery checkpoint
    IR RIA: redo_size 0 bytes, time_taken 314 ms
    ----- Recovery Hash Table Statistics ---------
    Hash table buckets = 32768
    Longest hash chain = 0
    Average hash chain = 0/0 = 0.0
    Max compares per lookup = 0
    Avg compares per lookup = 0/0 = 0.0
    Recovery sets nab of thread 1 seq 1019 to 3 with 8 zeroblks
    *** 2011-10-26 09:18:11.466
    ORA-12578: TNS:wallet open failed
    ORA-12578: TNS:wallet open failed
    *** 2011-10-26 09:18:11.497
    USER (ospid: 3276): terminating the instance due to error 12578
    Symbol file E:\Oracle\product\11.2.0\dbhome_1\BIN\orageneric11.SYM does not match binary.
    Symbol TimeStamp=4bb5eb10, Module TimeStamp=0 are different
    EnumerateLoadedModules64 failed with error -1073741819
    Symbol file orageneric11.SYM does not match binary.
    Symbol TimeStamp=4bb5eb10, Module TimeStamp=0 are different
    Edited by: 878073 on Oct 26, 2011 1:36 PM

    I found the problem...installed wallet manager that created entry in SQLNET file pointing to a wallet that did not have proper OS permissions...

  • ORA-19502 while adding a tablespace

    Hello All,
    I am using ORACLE 10g R2, on LINUX, red hat 5
    When i am trying to add a tablespace through Enterprise manager I am getting the below error:
    Failed to commit: ORA-19502: write error on file "/u01/app/oracle/oradata/IMALREF/MDB_O10_DATA", blockno 31488 (blocksize=8192) ORA-27072: File I/O error Linux-x86_64 Error: 2: No such file or directory Additional information: 4 Additional information: 31488 Additional information: 790528
    Can i have your suggestion how to solve this error?
    Regards,

    below is the result:
    [oracle@LBLX-RHEL5-DDesign ~]$ id
    uid=501(oracle) gid=501(oinstall) groups=501(oinstall),502(dba),503(oper)
    [oracle@LBLX-RHEL5-DDesign ~]$ env | sort
    CLASSPATH=/u01/app/oracle/product/10.2.0/db_1/JRE:/u01/app/oracle/product/10.2.0/db_1/jlib:/u01/app/oracle/product/10.2.0/db_1/rdbms/jlib
    COLORTERM=gnome-terminal
    DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-Jrdkal32MR,guid=32d3fdef15ec0040a783c0004c7290a9
    DESKTOP_SESSION=default
    DESKTOP_STARTUP_ID=
    DISPLAY=lap-nbeayni.lb.path-solutions.com:1.0
    G_BROKEN_FILENAMES=1
    GDMSESSION=default
    GDM_XSERVER_LOCATION=xdmcp
    GNOME_DESKTOP_SESSION_ID=Default
    GNOME_KEYRING_SOCKET=/tmp/keyring-w6t17r/socket
    GTK_RC_FILES=/etc/gtk/gtkrc:/home/oracle/.gtkrc-1.2-gnome2
    HISTSIZE=1000
    HOME=/home/oracle
    HOSTNAME=LBLX-RHEL5-DDesign
    INPUTRC=/etc/inputrc
    LANG=en_US.UTF-8
    LD_LIBRARY_PATH=/u01/app/oracle/product/10.2.0/db_1/lib:/lib:/usr/lib
    LESSOPEN=|/usr/bin/lesspipe.sh %s
    LOGNAME=oracle
    LS_COLORS=no=00:fi=00:di=00;34:ln=00;36:pi=40;33:so=00;35:bd=40;33;01:cd=40;33;01:or=01;05;37;41:mi=01;05;37;41:ex=00;32:*.cmd=00;32:*.exe=00;32:*.com=00;32:*.btm=00;32:*.bat=00;32:*.sh=00;32:*.csh=00;32:*.tar=00;31:*.tgz=00;31:*.arj=00;31:*.taz=00;31:*.lzh=00;31:*.zip=00;31:*.z=00;31:*.Z=00;31:*.gz=00;31:*.bz2=00;31:*.bz=00;31:*.tz=00;31:*.rpm=00;31:*.cpio=00;31:*.jpg=00;35:*.gif=00;35:*.bmp=00;35:*.xbm=00;35:*.xpm=00;35:*.png=00;35:*.tif=00;35:
    MAIL=/var/spool/mail/oracle
    ORACLE_BASE=/u01/app/oracle
    ORACLE_HOME=/u01/app/oracle/product/10.2.0/db_1
    ORACLE_SID=IMALREF
    ORACLE_TERM=xterm
    PATH=/u01/app/oracle/product/10.2.0/db_1/bin:/usr/sbin:/usr/kerberos/bin:/usr/local/bin:/usr/bin:/bin:/usr/X11R6/bin
    PWD=/home/oracle
    SESSION_MANAGER=local/LBLX-RHEL5-DDesign:/tmp/.ICE-unix/13702
    SHELL=/bin/bash
    SHLVL=2
    SSH_AGENT_PID=13742
    SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
    SSH_AUTH_SOCK=/tmp/ssh-ScSlb13702/agent.13702
    TERM=xterm
    TMPDIR=/tmp
    TMP=/tmp
    USERNAME=oracle
    USER=oracle
    _=/usr/bin/env
    WINDOWID=46137424
    XAUTHORITY=/tmp/.gdmYH4THV
    XMODIFIERS=@im=none
    [oracle@LBLX-RHEL5-DDesign ~]$ ls -lart /u01/app/oracle/oradata/IMALREF/
    total 1051044
    drwxrwxrwx 3 oracle oinstall 4096 Aug 23 14:11 ..
    -rwxrwxrwx 1 oracle oinstall 20979712 Aug 23 14:14 temp01.dbf
    -rwxrwxrwx 1 oracle oinstall 5251072 Aug 23 17:23 users01.dbf
    -rwxrwxrwx 1 oracle oinstall 52429312 Aug 23 17:23 redo03.log
    -rwxrwxrwx 1 oracle oinstall 52429312 Aug 23 17:23 redo02.log
    -rwxrwxrwx 1 oracle oinstall 104865792 Aug 23 17:23 example01.dbf
    drwxrwxrwx 2 oracle oinstall 4096 Aug 23 19:14 .
    -rwxrwxrwx 1 oracle oinstall 251666432 Aug 23 19:39 sysaux01.dbf
    -rwxrwxrwx 1 oracle oinstall 31465472 Aug 23 19:39 undotbs01.dbf
    -rwxrwxrwx 1 oracle oinstall 503324672 Aug 23 19:39 system01.dbf
    -rwxrwxrwx 1 oracle oinstall 52429312 Aug 23 19:40 redo01.log
    -rwxrwxrwx 1 oracle oinstall 7061504 Aug 23 19:40 control03.ctl
    -rwxrwxrwx 1 oracle oinstall 7061504 Aug 23 19:40 control02.ctl
    -rwxrwxrwx 1 oracle oinstall 7061504 Aug 23 19:40 control01.ctl
    [oracle@LBLX-RHEL5-DDesign ~]$ ls -lart /u01/app/oracle/oradata/
    total 12
    drwxrwxrwx 7 oracle oinstall 4096 Aug 23 14:11 ..
    drwxrwxrwx 3 oracle oinstall 4096 Aug 23 14:11 .
    drwxrwxrwx 2 oracle oinstall 4096 Aug 23 19:14 IMALREF
    [oracle@LBLX-RHEL5-DDesign ~]$ df -h
    Filesystem Size Used Avail Use% Mounted on
    /dev/sda2 9.7G 9.0G 246M 98% /
    /dev/mapper/VolGroup00-data
    82G 184M 78G 1% /data
    /dev/mapper/VolGroup00-temp
    2.0G 226M 1.7G 12% /tmp
    /dev/sda1 494M 17M 452M 4% /boot
    tmpfs 1.5G 0 1.5G 0% /dev/shm
    /dev/hdc 3.4G 3.4G 0 100% /media/RHEL_5.4 x86_64 DVD
    [oracle@LBLX-RHEL5-DDesign ~]$

  • ORA-19502: write error on file ... (blocksize=8192)

    Dear DBA's,
    I'm facing an incredible crappy issue with RMAN and I don’t see where it come from.
    Target Database is OS is RHEL5 with ORACLE 10.2.4
    The RMAN repository is RHEL5 in Oracle 11g2
    In the host there are 2 databases CFM1 and DMB1 and both are backup with RMAN in same Repository. In DMB1 I don’t have any issue
    With CFM1 I’ve this error Message every time I run a Backup as follows :
    RMAN> run
    2> {
    3> sql "Alter System Switch logfile";
    4> sql "Alter System Archive Log Current";
    5> Backup device type disk database plus archivelog;
    6> Backup current controlfile for standby;
    7> sql "Alter System Switch logfile";
    8> sql "Alter System Archive Log Current";
    9> Backup filesperset 10 ArchiveLog all;
    10> }
    sql statement: Alter System Switch logfile
    sql statement: Alter System Archive Log Current
    Starting backup at 12-MAY-10
    current log archived
    allocated channel: ORA_DISK_1
    channel ORA_DISK_1: sid=226 devtype=DISK
    channel ORA_DISK_1: starting archive log backupset
    channel ORA_DISK_1: specifying archive log(s) in backup set
    input archive log thread=1 sequence=43392 recid=36539 stamp=718803231
    input archive log thread=1 sequence=43393 recid=36540 stamp=718803232
    input archive log thread=1 sequence=43394 recid=36541 stamp=718803240
    channel ORA_DISK_1: starting piece 1 at 12-MAY-10
    channel ORA_DISK_1: finished piece 1 at 12-MAY-10
    piece handle=/backup/ORA_BACKUP_CFMT/CFMT_120520100512_full_28ldg499_1_1 tag=TAG20100512T113401 comment=NONE
    channel ORA_DISK_1: backup set complete, elapsed time: 00:00:02
    Finished backup at 12-MAY-10
    Starting backup at 12-MAY-10
    using channel ORA_DISK_1
    channel ORA_DISK_1: starting full datafile backupset
    channel ORA_DISK_1: specifying datafile(s) in backupset
    input datafile fno=00031 name=/u01/oradata/CFMT/data/iws_data_02.dbf
    input datafile fno=00028 name=/u03/oradata/CFMT/index/tools_01.dbf
    . Then It goes trough several datafiles
    input datafile fno=00004 name=/u02/oradata/CFMT/system/users01.dbf
    input datafile fno=00014 name=/u01/oradata/CFMT/data/iws_data_01.dbf
    channel ORA_DISK_1: starting piece 1 at 12-MAY-10
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03002: failure of backup plus archivelog command at 05/12/2010 11:35:29
    ORA-19502: write error on file "/backup/ORA_BACKUP_CFMT/CFMT_120520100512_full_29ldg49c_1_1", blockno 734721 (blocksize=8192)
    ORA-27072: File I/O error
    Linux-x86_64 Error: 9: Bad file descriptor
    Additional information: 4
    Additional information: 734721
    Additional information: 917504
    I've check in Metalink and open a Sr and so far no answer !!!
    Any ideas ?
    Txs
    Carlos

    Txs for your reply,
    But the ID you Provide doesn't help
    Solution
    Options to resolve:
    1. Clean up unnecessary files on /oracle/u08.07/ - The File System as Enough Disk Space
    Filesystem Size Used Avail Use% Mounted on
    9.9G 3.8G 5.6G 41% /backup/ORA_BACKUP_CFMT
    2. Add disk space to /oracle/u08.07/
    As you see ther's enough space.

  • Rman backup error: ORA-19502

    I am running a rman backup script with incremental 1 level as
    backup as backupset incremental level 1 cumulative device type disk tag 'Baan_bkup$LEVEL_0' database;
    recover copy of database;
    backup device type disk tag 'Baan_bkup$LEVEL_0' archivelog all not backed up;
    backup archivelog until time 'sysdate-6' delete all input;
    delete noprompt obsolete device type disk;
    It has run almost two weeks and last night it showed this error and failed
    RMAN-03009: failure of backup command on ORA_DISK_1 channel at 11/08/2006 03:02:14
    ORA-19502: write error on file "/dbrecovery/flashback/goi1rkdm_1_1", blockno 164865 (blocksize=8192)
    ORA-27072: File I/O error
    Additional information: 4
    Additional information: 164865
    Additional information: 782336
    Linux Error: 2: No such file or directory
    I checked the df -k and I still have about 6% space in my /dbrecovery disk, a separated space, and I did not find the file indicated either. So was still possible the space is full? or others reason?
    I used the "delete obsolete"command in rman but nothing can be deleted.

    It seems your filesystem cannot handle large files (> 2G). Use 'maxpiecesize' option of 'allocate channel' command to limit the filesize.
    Werner

  • Errors - ORA-01034, ORA-27101 & Linux-x86_64 Error: 2: No such file or dir

    I have installed Oracle 10g database and AS 10g on SUSE linux EE 10 (SP2)
    When I try to log in as system/system using sqlplus locally on the server, it works fine. However, when I try the following I get error messages:
    SQL> conn system/system@botsdb
    ERROR:
    ORA-01034: ORACLE not available
    ORA-27101: shared memory realm does not exist
    Linux-x86_64 Error: 2: No such file or directory
    I tried the same from my laptop through sqlplus and the error message is the same.
    I checked if the database was up and to check this I executed follwing commands whicle still being logged as system/system:
    SQL>Select * from v$database;
    SQL>Select * from v$instance;
    SQL>Select * from tab;
    These do bring results. Also if I try to start up the database again, it gives error message that the database is already up. I have restarted the db number of times, checked if my listener was listening on the service BOTSDB and these all seem fine.
    It is very intriguing that when @BOTSDB is attached while connecting, the connection fails.
    Can someone please guide me to sort this error?
    Thanks and kind regards,
    Aparna

    Hi
    I am answering all the three questions here.
    1) No of instances on the machine, I understand it is 1.
    2) Results of lsnrctl status
    oracle@linuxserver:~> lsnrctl status
    LSNRCTL for Linux: Version 10.1.0.4.2 - Production on 28-JUL-2010 09:19:33
    Copyright (c) 1991, 2004, Oracle. All rights reserved.
    Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=linuxserv.dcdm.mu)(PORT=1521)))
    STATUS of the LISTENER
    Alias LISTENER
    Version TNSLSNR for Linux: Version 10.1.0.4.2 - Production
    Start Date 27-JUL-2010 11:24:12
    Uptime 0 days 21 hr. 55 min. 20 sec
    Trace Level off
    Security ON: Local OS Authentication
    SNMP OFF
    Listener Parameter File /oracle/app/ora10ginfra/network/admin/listener.ora
    Listener Log File /oracle/app/ora10ginfra/network/log/listener.log
    Listening Endpoints Summary...
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=linuxserver.dcdm.mu)(PORT=1521)))
    (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC)))
    Services Summary...
    Service "PLSExtProc" has 1 instance(s).
    Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
    Service "metarep.dcdm.mu" has 1 instance(s).
    Instance "metarep", status READY, has 3 handler(s) for this service...
    The command completed successfully
    --Note that lsnrctl status command was issued after loading 10ginfra.env file.
    Please note that the listener for the database is set as DBLISTENER and lsnrctl status DBLISTENER was executed after loading 10gdb.env file. The results of lsnrctl status DBLISTENER are as follows:
    oracle@linuxserver:~> . ./10gdb.env
    oracle@linuxserver:~> lsnrctl status DBLISTENER
    LSNRCTL for Linux: Version 10.2.0.1.0 - Production on 28-JUL-2010 09:24:44
    Copyright (c) 1991, 2005, Oracle. All rights reserved.
    Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=172.16.107.123)(PORT=1650)))
    STATUS of the LISTENER
    Alias DBLISTENER
    Version TNSLSNR for Linux: Version 10.2.0.1.0 - Production
    Start Date 27-JUL-2010 15:11:28
    Uptime 0 days 18 hr. 13 min. 15 sec
    Trace Level off
    Security ON: Local OS Authentication
    SNMP OFF
    Listener Parameter File /oracle/app/ora10gdb/network/admin/listener.ora
    Listener Log File /oracle/app/ora10gdb/network/log/dblistener.log
    Listening Endpoints Summary...
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=172.16.107.123)(PORT=1650)))
    Services Summary...
    Service "BOTSDB" has 1 instance(s).
    Instance "BOTSDB", status UNKNOWN, has 1 handler(s) for this service...
    Service "PLSExtProc" has 1 instance(s).
    Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
    The command completed successfully
    3) The output of ps -ef |grep pmon is
    oracle@linuxserver:~> ps -ef |grep pmon
    oracle 12524 12091 0 09:16 pts/1 00:00:00 grep pmon
    oracle 12525 1 0 Jul27 ? 00:00:00 ora_pmon_metarep
    oracle 25776 1 0 Jul27 ? 00:00:00 ora_pmon_BOTSDB
    The contents of listener.ora in two different Oracle Homes (one for AS infrastrcuture and another one for database) are as follows:
    oracle@linuxserver:/oracle/app/ora10ginfra/network/admin> vi listener.ora
    # listener.ora Network Configuration File: /oracle/app/ora10ginfra/network/admin/listener.ora
    # Generated by Oracle configuration tools.
    SID_LIST_LISTENER =
    (SID_LIST =
    (SID_DESC =
    (SID_NAME = PLSExtProc)
    (ORACLE_HOME = /oracle/app/ora10ginfra)
    (PROGRAM = extproc)
    LISTENER =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS_LIST =
    (ADDRESS = (PROTOCOL = TCP)(HOST = linuxserv.dcdm.mu)(PORT = 1521))
    (ADDRESS_LIST =
    (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))
    oracle@linuxserver:/oracle/app/ora10gdb/network/admin> vi listener.ora
    # Generated by Oracle configuration tools.
    SID_LIST_DBLISTENER =
    (SID_LIST =
    (SID_DESC =
    (SID_NAME = PLSExtProc)
    (ORACLE_HOME = /oracle/app/ora10gdb/)
    (PROGRAM = extproc)
    (SID_DESC =
    (SID_NAME = BOTSDB)
    (ORACLE_HOME = /oracle/app/ora10gdb/)
    DBLISTENER =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = 172.16.107.123)(PORT = 1650))
    Kind regards,
    Aparna

  • ORA-00245: control file backup failed; target is likely on a local file sys

    Hello,
    our RAC (Linux, 11.2.0.3.0) is rather new and we are still on gaining experiences with that system...
    When starting the backup with RMAN we are getting the following error:
    Starting Control File and SPFILE Autobackup at 04-JUL-12
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03009: failure of Control File and SPFILE Autobackup command on ORA_DISK_1 channel at 07/04/2012 16:41:48
    ORA-00245: control file backup failed; target is likely on a local file system
    The reason for the error is clear ORA-00245 - in a RAC environment the location of the Snapshot Controlfile must be on a shared location.
    When executing the RMAN command "show all" on each node, we are getting
    CONFIGURE SNAPSHOT CONTROLFILE NAME TO '/u01/app/oracle/product/11.2.0.3/db/dbs/snapcf_PROD021.f'; # default
    for node #1
    and
    CONFIGURE SNAPSHOT CONTROLFILE NAME TO '/u01/app/oracle/product/11.2.0.3/db/dbs/snapcf_PROD022.f'; # default
    for node #2
    When using a shared location for the Snapshot Controlfile do we still need to setup 2 different names for that file?
    CONFIGURE SNAPSHOT CONTROLFILE NAME TO '/<shared location>/snapcf_PROD021.f'; # default
    for node #1 and
    CONFIGURE SNAPSHOT CONTROLFILE NAME TO '/<shared location>/snapcf_PROD022.f'; # default
    for node #2
    Or should we configure just one Snapshot Controlfile?
    The RMAN setup for "CONFIGURE SNAPSHOT CONTROLFILE NAME TO..." must be changed on both nodes - correct?
    Hopefully my question is clear enough - any help will be appreciated.
    Rgds
    JH
    Edited by: VivaLaVida on 05.07.2012 11:41

    No, it must be configured on a shared storage:Not really required, i've RAC setup and snapshot is configured on local storage.
    Configuring the RMAN Snapshot Control File Location
    The snapshot control file is a copy of a database control file created in an operating system-specific location by Recovery Manager. RMAN creates the snapshot control file so that it has a consistent version of a control file to use when either resynchronizing the recovery catalog or backing up the control file. In Oracle RAC, the snapshot control file is only needed on the nodes on which RMAN performs backups; the snapshot control file does not need to be globally available to all instances in an Oracle RAC environment.
    See below from doc.
    http://docs.oracle.com/cd/B28359_01/rac.111/b28254/rman.htm#i455026

  • Rman : ORA-19502: write error on file "

    hi all,
    I have a oracle 9.2.0.6, i am taking backup of primary database, my DB is on Sun box and all the datafile are the raw filesystems.......
    but while taking backup i am getting an error.....
    I have checked across the internet and i got to know that the error occured because of Disk space not sufficient as such the catalog is on win 2003 an oracle home of the catalog db is having 20 Gb of space whereas i am taking backup on H:\ there i am having more than 100gb of space...
    please help me to resolve this problem....
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03009: failure of backup command on ch1 channel at 05/11/2009 13:00:19
    ORA-19502: write error on file "H:\mainbackup\bk_inc0_65_1", blockno 269825 (blo
    cksize=8192)
    ORA-27063: skgfospo: number of bytes read/written is incorrect
    Additional information: 131072
    Additional information: 1048576

    we have more enough space on disks but still getting an error
    pls suggest me...
    channel ch1: starting piece 1 at 12-MAY-09
    released channel: ch1
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03009: failure of backup command on ch1 channel at 05/12/2009 12:46:07
    ORA-19504: failed to create file "G:\mainbackup\bk_inc0_69_1"
    ORA-27044: unable to write the header block of file
    SVR4 Error: 28: No space left on device
    Additional information: 1
    {code}                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               

  • ORA-28544: connect to agent failed, probable Net8 administration error

    HI WHEN I TRY TO QUERY SQL SERVER DATABASE FROM ORACLE IAM GETTING THE FOLLOWING ERROR
    ORA-28544: connect to agent failed, probable Net8 administration error
    External procedure agent received SQL or transactional RPC
    CAN ANYONE HELP ME ON THIS

    I've got the same error, help!!!
    specs:
    0. issues
    #>cat /etc/issue
    Welcome to SUSE LINUX Enterprise Server 9 (i586) - Kernel \r (\l).
    1. Checking ODBC connection
    #>cat /etc/unixODBC/odbc.ini
    [myodbc01]
    Description = my01
    Driver = my01
    Server = 192.168.0.xxx
    Database = mysqldb
    USER = oracle
    Password = orapasswd
    Port =
    Socket =
    Option =
    Stmt =
    #>cat /etc/unixODBC/odbcinst.ini
    [my01]
    Description = MYODBC351
    Driver = /usr/lib/unixODBC/libmyodbc3-3.51.06.so
    Setup = /usr/lib/unixODBC/libodbcmyS.so.1
    FileUsage = 1
    CPTimeout =
    CPReuse =
    #>isql myodbc01 oracle orapasswd
    | Connected! |
    | |
    | sql-statement |
    | help [tablename] |
    | quit |
    | |
    SQL> select * from mytable;
    | id| bug_id| reporter_id| bugnote_text_id| view_state| date_submitted | last_modified | note_type| note_attr|
    | 51| 5 | 2 | 51 | 10 | 2007-06-08 13:06:40| 2007-06-08 13:06:40| 0 | |
    | 50| 5 | 6 | 50 | 50 | 2007-06-08 13:05:54| 2007-06-08 13:05:54| 0 | |
    | 49| 5 | 5 | 49 | 50 | 2007-06-08 13:01:05| 2007-06-08 13:01:05| 0 | |
    | 48| 5 | 6 | 48 | 50 | 2007-06-08 13:00:42| 2007-06-08 13:00:42| 0 | |
    | 47| 5 | 5 | 47 | 50 | 2007-06-08 12:59:49| 2007-06-08 12:59:49| 0 | |
    | 46| 5 | 3 | 46 | 10 | 2007-06-08 12:58:27| 2007-06-08 12:58:27| 0 | |
    | 45| 5 | 2 | 45 | 10 | 2007-06-08 12:46:20| 2007-06-08 12:46:20| 0 | |
    | 44| 5 | 6 | 44 | 50 | 2007-06-08 12:45:52| 2007-06-08 12:45:52| 0 | |
    | 43| 5 | 2 | 43 | 50 | 2007-06-08 12:44:42| 2007-06-08 12:44:42| 0 | |
    | 39| 5 | 5 | 39 | 50 | 2007-06-08 12:37:48| 2007-06-08 12:37:48| 0 | |
    | 40| 5 | 6 | 40 | 50 | 2007-06-08 12:41:06| 2007-06-08 12:41:06| 0 | |
    | 41| 5 | 5 | 41 | 50 | 2007-06-08 12:41:41| 2007-06-08 12:41:41| 0 | |
    | 42| 5 | 6 | 42 | 50 | 2007-06-08 12:43:04| 2007-06-08 12:43:04| 0 | |
    SQLRowCount returns 13
    13 rows fetched
    SQL>
    ...so, it works
    2. Configuring HS
    #>hsodbc
    Oracle Corporation --- WEDNESDAY JUN 13 2007 13:23:56.886
    Heterogeneous Agent Release 10.2.0.3.0 - Production Built with
    Driver for ODBC
    #>cat /home/oracle/Ora10g/hs/admin/initmantis.ora --SID=mantis
    HS_FDS_CONNECT_INFO = myodbc01
    HS_FDS_TRACE_LEVEL = ON
    HS_FDS_SHAREABLE_NAME = /usr/lib/libodbc.so
    set ODBCINI=/etc/unixODBC/odbc.ini
    #>cat /home/oracle/Ora10g/network/admin/listener.ora
    LISTENER =
    (ADDRESS_LIST=
    (ADDRESS=(PROTOCOL=tcp)(HOST=localhost)(PORT=1521))
    (ADDRESS=(PROTOCOL=ipc)(KEY=MANTIS)))
    SID_LIST_LISTENER=
    (SID_LIST=
    (SID_DESC=
    (SID_NAME=mantis)
    (ORACLE_HOME=/home/oracle/Ora10g)
    (PROGRAM=hsodbc)
    CONNECT_TIMEOUT_LISTENER = 5
    #>cat /home/oracle/Ora10g/network/admin/tnsnames.ora
    mantis =
    (DESCRIPTION=
    (ADDRESS=(PROTOCOL=tcp)(HOST=localhost)(PORT=1521))
    (CONNECT_DATA=(SID=mantis))
    (HS=OK)
    3. Creating 'n testing db link..
    #>sqlplus ...
    SQL*Plus: Release 10.2.0.3.0 - Production on Wed Jun 13 13:53:00 2007
    Copyright (c) 1982, 2006, Oracle. All Rights Reserved.
    Connected to:
    Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - Production
    With the Partitioning, OLAP and Data Mining options
    SQL>select banner from v$version;
    BANNER
    Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - Prod
    PL/SQL Release 10.2.0.3.0 - Production
    CORE 10.2.0.3.0 Production
    TNS for Linux: Version 10.2.0.3.0 - Production
    NLSRTL Version 10.2.0.3.0 - Production
    SQL>create database link mantis_dblink connect to oracle identified by orapasswd using 'mantis';
    Database link created.
    SQL> select * from mytable@mantis_dblink;
    SQL> select * from mytable@mantis_dblink
    ERROR at line 1:
    ORA-28545: error diagnosed by Net8 when connecting to an agent
    Unable to retrieve text of NETWORK/NCR message 65535
    ORA-02063: preceding 2 lines from MANTIS_DBLINK

Maybe you are looking for