[help me] Oracle 10G + ASM "ORA-00376: file 5 cannot be read at this time"

We have used Oracle 10G R2 RAC + ASM on Redhat 4 (EMC cx700 Storage)
I found below errors on alert log and can't inserted, updated and deleted datas in database.
Sun May 27 01:12:34 2007
SUCCESS: diskgroup ARCH was mounted
SUCCESS: diskgroup ARCH was dismounted
SUCCESS: diskgroup ARCH was mounted
SUCCESS: diskgroup ARCH was dismounted
SUCCESS: diskgroup ARCH was mounted
SUCCESS: diskgroup ARCH was dismounted
Sun May 27 01:19:11 2007
Errors in file /oracle/product/admin/DB/udump/db3_ora_15854.trc:
ORA-00376: file 5 cannot read at this time
ORA-01110: data file 5: '+DATA/db/datafile/undotbs3.257.617849281'
ORA-00376: file 5 cannot be read at this time
ORA-01110: data file 5: '+DATA/db/datafile/undotbs3.257.617849281'
ORA-00376: file 5 cannot be read at this time
ORA-01110: data file 5: '+DATA/db/datafile/undotbs3.257.617849281'
ORA-00372: file 5 cannot be modified at this time
ORA-01110: data file 5: '+DATA/db/datafile/undotbs3.257.617849281'
So:
I checked and recovered data file
SQL> select name,status,file# from v$datafile where status ='RECOVER';
NAME
STATUS FILE#
+DATA/db/datafile/undotbs3.257.617849281
RECOVER 5
RMAN> run {
allocate channel t1 type 'SBT_TAPE';
allocate channel t2 type DISK;
recover datafile 5;
recover completed.
SQL> alter database datafile 5 online;
Butttttttttttttttttt:
What is going on?
I checked EMC storage, not found any disk error.
I checked alert log of ASM, no found anything.
I don't know What the problem ?
Because I had the same problem 2 days ago.
This day error on undo datafile node 3.
2 days aGo; error on undo node 4.
Please please anybody
What bug or anything wrong ?
Please introduce me
trace file:
/oracle/product/admin/DB/udump/db3_ora_15854.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP and Data Mining options
ORACLE_HOME = /oracle/product/10.2.0/db
System name: Linux
Node name: db03.domain
Release: 2.6.9-42.ELsmp
Version: #1 SMP Wed Jul 12 23:32:02 EDT 2006
Machine: x86_64
Instance name: DB3
Redo thread mounted by this instance: 3
Oracle process number: 65
Unix process pid: 15854, image: [email protected]
*** SERVICE NAME:(DB) 2007-05-27 01:19:11.574
*** SESSION ID:(591.62658) 2007-05-27 01:19:11.574
*** 2007-05-27 01:19:11.574
ksedmp: internal or fatal error
ORA-00376: file 5 cannot be read at this time
ORA-01110: data file 5: '+DATA/db/datafile/undotbs3.257.617849281'
ORA-00376: file 5 cannot be read at this time
ORA-01110: data file 5: '+DATA/db/datafile/undotbs3.257.617849281'
ORA-00376: file 5 cannot be read at this time
ORA-01110: data file 5: '+DATA/db/datafile/undotbs3.257.617849281'
ORA-00372: file 5 cannot be modified at this time
ORA-01110: data file 5: '+DATA/db/datafile/undotbs3.257.617849281'
Current SQL statement for this session:
INSERT INTO DATA_ALL VALUES (:B1 ,:B2 ,:B3 ,:B4 ,:B5 ,:B6 ,:B7 ,:B8 ,:B9 ,:B10 ,:B11 ,:B12 ,:B13 ,:B14 ,:B15 ,:B16 ,:B17 ,:B18 ,:B19 ,:B20 ,:B21 ,:B22 ,:B23 ,:B24 ,:B25 ,:B26 ,:B27 ,:B28 ,:B29 ,:B30 ,:B31 ,:B32 ,:B33 ,:B34 ,:B35 ,:B36 ,:B37 ,:B38 ,:B39 ,:B40 ,:B41 ,:B42 ,:B43 ,:B44 ,:B45 ,:B46 ,:B47 ,:B48 ,:B49 ,:B50 )
----- PL/SQL Call Stack -----
object line object
handle number name
0x21dc2b4b8 780 package body MGR.AC
0x21e4815b0 3 anonymous block
----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
ksedst()+31 call ksedst1() 000000000 ? 000000001 ?
7FBFFF7290 ? 7FBFFF72F0 ?
7FBFFF7230 ? 000000000 ?
ksedmp()+610 call ksedst() 000000000 ? 000000001 ?
7FBFFF7290 ? 7FBFFF72F0 ?
7FBFFF7230 ? 000000000 ?
ksupop()+3581 call ksedmp() 000000003 ? 000000001 ?
7FBFFF7290 ? 7FBFFF72F0 ?
7FBFFF7230 ? 000000000 ?
opiodr()+3899 call ksupop() 000000002 ? 000000001 ?
7FBFFF7290 ? 7FBFFF72F0 ?
7FBFFF7230 ? 000000000 ?
rpidrus()+198 call opiodr() 000000066 ? 000000006 ?
.......etc.............................
Message was edited by:
HunterX (Surachart Opun)

To me it looks like your undotbs on node3 is filled and not marking old undo as expired. Use this query to find out if it is labeling old undo as expired.
SELECT tablespace_name, status, COUNT(*) AS HOW_MANY
FROM dba_undo_extents
GROUP BY tablespace_name, status;
Another thing I noticed from your alertlog is it is only doing that on undotbs3, which I assumes is on node3.
1) try recreate undotbs on node3
2) take node3 out of service (stop nodeapps, ASM, instance and finally CRS on node3) and see if you can do DML on your database.
-Moid

Similar Messages

  • ORA-00376: file cannot be read at this time

    Hi All,
    I am not able to login to database.after performing this activities .Please help.
    I have run the following commands. I checked tablespace datafile size and try to re-sizing the datafile size. I get following error.
    Would you please help me.
    Regards,
    GS
    =============================================
    SQL>select * from DBA_DATA_FILES where TABLESPACE_NAME='TLAPP';
    FILE_NAME
    FILE_ID TABLESPACE_NAME BYTES BLOCKS STATUS RELATIVE_FNO AUT MAXBYTES MAXBLOCKS INCREMENT_BY USER_BYTES USER_BLOCKS ONLINE_
    /HRPRODDATA/oradata/tlapp.dbf
    118 TLAPP 2306867200 281600 AVAILABLE 118 YES 3.4360E+10 4194302 640 2306736128 281584 ONLINE
    SQL> alter database datafile '/HRPRODDATA/oradata/tlapp.dbf' resize 9900m
    SQL> alter database datafile '/HRPRODDATA/oradata/tlapp.dbf' resize 9900m;
    alter database datafile '/HRPRODDATA/oradata/tlapp.dbf' resize 9900m
    ERROR at line 1:
    ORA-01135: file 118 accessed for DML/query is offline
    ORA-01110: data file 118: '/HRPRODDATA/oradata/tlapp.dbf'
    SQL> alter database datafile '/HRPRODDATA/oradata/tlapp.dbf' resize 9900m ;
    alter database datafile '/HRPRODDATA/oradata/tlapp.dbf' resize 9900m
    ERROR at line 1:
    ORA-00376: file 118 cannot be read at this time
    ORA-01110: data file 118: '/HRPRODDATA/oradata/tlapp.dbf'
    SQL> select * from DBA_DATA_FILES where TABLESPACE_NAME='TLAPP';
    FILE_NAME
    FILE_ID TABLESPACE_NAME BYTES BLOCKS STATUS RELATIVE_FNO AUT MAXBYTES MAXBLOCKS INCREMENT_BY USER_BYTES USER_BLOCKS ONLINE_
    /HRPRODDATA/oradata/tlapp.dbf
    118 TLAPP AVAILABLE 118 RECOVER
    SQL>
    ======================================================

    i ran and i got the following. Would you please tell me how to solve it.
    SQL> select * from v$recover_file;
    FILE# ONLINE ONLINE_ ERROR CHANGE# TIME
    2 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    8 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    50 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    60 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    63 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    73 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    76 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    78 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    91 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    92 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    98 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    FILE# ONLINE ONLINE_ ERROR CHANGE# TIME
    99 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    102 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    108 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    118 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    119 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    127 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    128 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    129 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    132 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    135 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    136 OFFLINE OFFLINE 1.7304E+10 21-DEC-11
    22 rows selected.

  • SQL error 376: 'ORA-00376: file 12 cannot be read at this time

    While installing Appl Patch set SAPKH70010- SAPKH70013 I received followingerror ,
    SQL_fehler in der Datenbank beim Zugriff auf eine
    Following is output of the dev_w0 logfile.
    C SELECT TLINE, SEQNO FROM SNAPT WHERE LANGU = :A0 AND ERRID = :A1 AND TTYPE = :A2 ORDER BY SEQNO;
    B ***LOG BY2=> sql error 376 performing FET dbds#1 @ 592 dbds 0592
    B ***LOG BY0=> ORA-00376: file 12 cannot be read at this time
    ORA-01110: data file 12: '/oracle/RTQ/sapdata2/sr3_9/sr3.data9' dbds#1 @ 592 dbds 0592
    C OCI-call failed with -1=OCI_ERROR
    C SQL error 376: 'ORA-00376: file 12 cannot be read at this time
    C ORA-01110: data file 12: '/oracle/RTQ/sapdata2/sr3_9/sr3.data9''
    C *** ERROR => Error 376 in stmt_fetch() from oci_execute_stmt(), orpc=0
    http://dbsloci.c 12861
    C *** ERROR => ORA-376 occurred when executing SQL stmt (parse error offset=0)
    http://dbsloci.c 12880
    C sc_p=0x106d644c8,no=227,idc_p=(nil),con=0,act=1,slen=95,smax=256,#vars=3,stmt=0x108563c80,table=SNAPT
    C SELECT TLINE, SEQNO FROM SNAPT WHERE LANGU = :A0 AND ERRID = :A1 AND TTYPE = :A2 ORDER BY SEQNO;
    C sc_p=0x106d644c8,no=227,idc_p=(nil),con=0,act=1,slen=95,smax=256,#vars=3,stmt=0x108563c80,table=SNAPT
    C prep=0,lit=0,nsql=1,lobret=0,#exec=1,dbcnt=0,upsh_p=(nil),ocistmth_p=0x1085649b0
    C IN : cols=3,rmax=1,xcnt=0,rpc=0,rowi=0,rtot=0,upto=4294967295,rsize=42,vmax=32,bound=1,iobuf_p=0x1070cf7d0,vda_p=0x1074f664
    0
    C lobs=0,lmax=0,lpcnt=0,larr=(nil),lcurr_p=(nil),rret=0
    C OUT: cols=2,rmax=208,xcnt=208,rpc=0,rowi=0,rtot=0,upto=4294967295,rsize=152,vmax=32,bound=1,iobuf_p=0x1070e9f50,vda_p=0x108
    565000
    According this i checked file
    ORA-01110: data file 12: '/oracle/RTQ/sapdata2/sr3_9/sr3.data9''
    This file is in RECOVER mode.
    my SAP application ECC6.9 is running.
    Oracle is also running.
    I do not have any oracle backup
    For any transaction the system is giving following error,
    "SQL_fehler in der Datenbank beim Zugriff auf eine"
    Please advice.

    Hi PushpaMitra,
    Check below note.
    Note 328785 - ORA-00376: File cannot be read at this time
    Regards
    Ashok

  • ORA-00376: file 29 cannot be read at this time

    Hi Guys,
    I am running Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production on RHEL5.
    I had mny files on auto-extend now my mount point went to 100%.
    I had a problem with some of the files that were on that mount point.
    I managed to can increase the mount point. Now I want to recover those files as their status is RECOVER.
    But when I do recover datafile 'file_name'; I get this error:
    ORA-00376: file 29 cannot be read at this time
    How do I make sure that the files are readable again?
    Please help!!!!!!!!!!!

    Go through your alert.log . File 29 would have been taken OFFLINE by Oracle at some time and a message would have been written to the alert.log
    You can
    ALTER DATABASE DATAFILE 29 ONLINE;
    ALTER DATABASE RECOVER DATAFILE 29;Hemant K Chitale

  • ORA-00376: file 201 cannot be read at this time

    How can i resolve this?
    SQL> alter database tempfile '/home/oracle/product/oradata/ora01/temp01.dbf' resize 10g;
    alter database tempfile '/home/oracle/product/oradata/ora01/temp01.dbf' resize 10g
    ERROR at line 1:
    ORA-00376: file 201 cannot be read at this time
    ORA-01110: data file 201: '/home/oracle/product/oradata/ora01/temp01.dbf'

    Hi
    If you have created a new TEMP Tablespace and dropped the old temp tablespace , then you will have to use the follwoing command to make use of the old temp files in the new temporary tablespace.
    alter tablespace <new temp tbs name > add tempfile '<old tempfile name>' reuse;
    To autoextend the tempfile :
    alter database tempfile '<tenpfile name>' autoextend on;
    Regards,
    Akash
    Link : [oracledreamz.blogspot.com]
    Edited by: akash@otn on 28 Mar, 2009 12:58 AM

  • ORA-00376: file 30 cannot be read at this time

    hi
    iam new for appsdba
    iam facing the below problem can any one help me.
    [appldev@ebs idev_ebs]$ ./adstrtal.sh apps/apps
    You are running adstrtal.sh version 115.16
    Executing service control script:
    /devc/p01/oracle/pixcomn/admin/scripts/idev_ebs/adapcctl.sh start
    script returned:
    adapcctl.sh version 115.47
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    Starting Apache Web Server Listener (dedicated HTTP) ...
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    Starting Apache Web Server Listener (dedicated PLSQL) ...
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    adapcctl.sh: exiting with status 0
    .end std out.
    .end err out.
    Executing service control script:
    /devc/p01/oracle/pixcomn/admin/scripts/idev_ebs/adalnctl.sh start
    script returned:
    adalnctl.sh version
    Checking for FNDFS executable.
    Starting listener process APPS_idev.
    adalnctl.sh: exiting with status 0
    .end std out.
    .end err out.
    Executing service control script:
    /devc/p01/oracle/pixcomn/admin/scripts/idev_ebs/adcmctl.sh start
    script returned:
    You are running adcmctl.sh version 115.24
    Starting concurrent manager for idev ...
    Starting idev_0628@idev Internal Concurrent Manager
    Default printer is noprint
    adcmctl.sh: exiting with status 0
    .end std out.
    .end err out.
    Executing service control script:
    /devc/p01/oracle/pixcomn/admin/scripts/idev_ebs/adfrmctl.sh start
    script returned:
    You are running adfrmctl.sh version 115.37
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    Starting forms server for idev on port 9080.
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    adfrmctl.sh: exiting with status 0
    .end std out.
    .end err out.
    Executing service control script:
    /devc/p01/oracle/pixcomn/admin/scripts/idev_ebs/adrepctl.sh start
    script returned:
    You are running adrepctl.sh version 115.31
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    starting Reports Server for idev on port 7080.
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    adrepctl.sh: exiting with status 0
    .end std out.
    .end err out.
    Executing service control script:
    /devc/p01/oracle/pixcomn/admin/scripts/idev_ebs/adfmcctl.sh start
    script returned:
    You are running adfmcctl.sh version 115.19
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    Starting forms load balancing client for idev.
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    adfmcctl.sh: exiting with status 0
    .end std out.
    .end err out.
    Executing service control script:
    /devc/p01/oracle/pixcomn/admin/scripts/idev_ebs/adfmsctl.sh start
    script returned:
    You are running adfmsctl.sh version 115.15
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    starting forms metrics server for idev.
    ORACLE error 376 in afpgdbcf
    Cause: afpgdbcf failed due to ORA-00376: file 30 cannot be read at this time
    ORA-01110: data file 30: '/devc/p05/oracle/pixdata/tx_data4.dbf'
    ORA-06512: at "APPS.FND_CORE_LOG", line 22
    ORA-06512: at "APPS.FND_PROFILE", line 99
    ORA-06512: at "APPS.FND_WEB_CONFIG", line .
    The SQL statement being executed at the time of the error was: begin :d := FND_SECURITY_PKG.DATABASE_ID; end; and was executed from the file &ERRFILE.
    adfmsctl.sh: exiting with status 0
    .end std out.
    .end err out.
    Executing service control script:
    /devc/p01/oracle/pixcomn/admin/scripts/idev_ebs/jtffmctl.sh start
    script returned:
    You are running jtffmctl.sh version 115.16
    Validating Fulfillment patch level via /devc/p01/oracle/pixcomn/java
    Fulfillment patch level validated.
    Starting Fulfillment Server for idev on port 9380 ...
    jtffmctl.sh: exiting with status 0
    .end std out.
    .end err out.
    All enabled services for this node are started.
    Check logfile /devc/p01/oracle/pixcomn/admin/log/idev_ebs/06280212.log for details
    Exiting with status 0
    [appldev@ebs idev_ebs]$

    You are trying to access objects of that perticular datafiles.
    If you want to access either you need to perform recovery, you should have all the archives of all those when datafiles put offline.
    Or you should not try to access the objects such resides in that tablespace.
    If you perform offline or offline drop. Next time you can face problems like object does not exist.

  • ORA-00376: file 2 cannot be read at this time

    Hi,
    Our SAP system is down. When checked I found PSAPUNDO tablespace needs recovery. (From SYSSMU1$ to SYSSMU10$ NEEDS RECOVERY and SYSSMU11$ to SYSSMU17$ are offline).
    So I have created another tablespace PSAPUNDO2 and altered the system.
    SQL >create undo tablespace PSAPUNDO2 datafile 'D:\Oracle\SOL\sapdata1\undo_2\UNDO.DATA2' size 700MB;
    SQL>alter system set undo_tablespace=PSAPUNDO2 scope=spfile;
    I have changed undo_management to Manual. And I have not dropped old tablespace PSAPUNDO yet,
    I have restarted the system and initially the database was not open.
    I gave command alter database open and opened it.
    The oracle has been started normally. But still SAP instance cannot be started.
    Last few lines of aler log:
    Sun Jan 06 04:05:12 2013
    Completed: ALTER DATABASE OPEN
    Sun Jan 06 04:06:08 2013
    Shutting down archive processes
    Sun Jan 06 04:06:13 2013
    ARCH shutting down
    ARC2: Archival stopped
    Adjusting the default value of parameter parallel_max_servers
    from 160 to 65 due to the value of parameter processes (80)
    Sun Jan 06 04:06:29 2013
    Starting ORACLE instance (normal)
    Sun Jan 06 04:14:09 2013
    Errors in file d:\oracle\sol\saptrace\background\sol_smon_3796.trc:
    ORA-00604: error occurred at recursive SQL level 1
    ORA-00376: file 2 cannot be read at this time
    ORA-01110: data file 2: 'D:\ORACLE\SOL\SAPDATA1\UNDO_1\UNDO.DATA1'
    Now when i give command:
    show parameter undo, I got the table_space name as PSAPUNDO2.But if I give command
    SQL> select segment_name,owner,tablespace_name,status from dba_rollback_segs;
    I am getting PSAPUNDO as the tablespace insteadof PSAPUNDO2. PSAPUNDO tablespace needs recovery. (From SYSSMU1$ to SYSSMU10$ NEEDS RECOVERY and SYSSMU11$ to SYSSMU17$ are offline).
    Also
    In BRTOOLS, in show tablespace command I cannot see the new tablespace PSAPUNDO2.
    Kindly suggest how to resolve this issue.

    Hi,
    Thanks for your reply. When I checked SAP down issue(around 6th Dec) I had exteneded the tablespace PSAPUNO and PSAPSR3 with brtools and restarted the server.
    Then I checked further and found the problem was PSAPUNDO needs recovery.
    Then I created another tablespace PSAPUNDO2 and altered system. (See my previous post).
    Now as you told I checked alert log history to check when the problem started and found the following:
    Incremental checkpoint up to RBA [0x2aad.15fb6.0], current log tail at RBA [0x2aad.15ff4.0]
    Sun Dec 02 19:01:16 2012
    Beginning log switch checkpoint up to RBA [0x2aae.2.10], SCN: 179359877
    Thread 1 advanced to log sequence 10926
    Current log# 2 seq# 10926 mem# 0: D:\ORACLE\SOL\ORIGLOGB\LOG_G12M1.DBF
    Current log# 2 seq# 10926 mem# 1: C:\ORACLE\SOL\MIRRLOGB\LOG_G12M2.DBF
    Sun Dec 02 19:06:21 2012
    Completed checkpoint up to RBA [0x2aae.2.10], SCN: 179359877
    Sun Dec 02 19:25:04 2012
    Incremental checkpoint up to RBA [0x2aae.2d36.0], current log tail at RBA [0x2aae.2e11.0]
    Sun Dec 02 19:30:00 2012
    KCF: write/open error block=0x19 online=1
    file=2 D:\ORACLE\SOL\SAPDATA1\UNDO_1\UNDO.DATA1
    error=27072 txt: 'OSD-04008: WriteFile() failure, unable to write to file
    O/S-Error: (OS 33) The process cannot access the file because another process has locked a portion of the file.'
    Automatic datafile offline due to write error on
    file 2: D:\ORACLE\SOL\SAPDATA1\UNDO_1\UNDO.DATA1
    Sun Dec 02 19:30:01 2012
    Errors in file d:\oracle\sol\saptrace\usertrace\sol_ora_5408.trc:
    ORA-00376: file 2 cannot be read at this time
    ORA-01110: data file 2: 'D:\ORACLE\SOL\SAPDATA1\UNDO_1\UNDO.DATA1'
    ORA-00376: file 2 cannot be read at this time
    I am not sure what caused this error: ORA-00376: file 2 cannot be read at this time
    I think there is no issue with Parallel_Max_Server as I can see its entry in Alert log since 2007.
    Thu Oct 25 20:48:48 2007
    Adjusting the default value of parameter parallel_max_servers
    from 160 to 65 due to the value of parameter processes (80)
    Thu Oct 25 20:48:48 2007
    Starting ORACLE instance (normal)
    Will wait for your reply.
    Edited by: 980149 on Jan 6, 2013 9:32 AM

  • ORA-00376: file 24 cannot be read at this time

    Hi,
    DB 10.2.0.4
    AIX 5.3
    PROD
    When i am trying to start database i got below error.kindly suggest me.
    SQL> startup
    ORACLE instance started.
    Total System Global Area 5368709120 bytes
    Fixed Size 2091632 bytes
    Variable Size 2399143312 bytes
    Database Buffers 2952790016 bytes
    Redo Buffers 14684160 bytes
    Database mounted.
    ORA-00376: file 24 cannot be read at this time
    ORA-01110: data file 27: '/vol01/oracle/undo_.dbf'
    Thanks
    Edited by: user13382934 on Apr 21, 2011 2:05 PM

    In trace file find below
    ORA-00376: file 27 cannot be read at this time
    ORA-01110: data file 27: '/vol01/oracle/data/undo.dbf'
    Parallel Transaction recovery caught exception 376
    Parallel Transaction recovery caught error 376
    *** 2011-04-21 19:09:26.615
    SMON: following errors trapped and ignored:
    ORA-00376: file 27 cannot be read at this time
    ORA-01110: data file 27: '/vol01/oracle/data/undo.dbf'
    Parallel Transaction recovery caught exception 376
    Parallel Transaction recovery caught error 376
    *** 2011-04-21 19:09:27.633
    SMON: following errors trapped and ignored:
    ORA-00376: file 27 cannot be read at this time
    ORA-01110: data file 27: '/vol01/oracle/data/undo.dbf'
    Parallel Transaction recovery caught exception 376
    Parallel Transaction recovery caught error 376
    *** 2011-04-21 19:09:28.651
    SMON: following errors trapped and ignored:
    ORA-00376: file 24 cannot be read at this time
    ORA-01110: data file 27: '/vol01/oracle/data//undo.dbf'
    In alert log file
    *** 2011-04-21 20:18:16.178
    SMON: following errors trapped and ignored:
    ORA-00376: file 24 cannot be read at this time
    ORA-01110: data file 27: '/vol01/oracle/data/undo.dbf'
    MMNL absent for 4286 secs; Foregrounds taking over
    MMNL absent for 4286 secs; Foregrounds taking over
    MMNL absent for 4286 secs; Foregrounds taking over
    MMNL absent for 4286 secs; Foregrounds taking over
    Thu Apr 21 20:20:26 2011
    Errors in file /vol01/oracle/admin/bdump/dev_smon_516148.trc:
    ORA-00376: file 27 cannot be read at this time
    ORA-01110: data file 27: '/vol01/oracle/data/undo.dbf'
    Thu Apr 21 20:20:36 2011
    Errors in file /vol01/oracle/admin/bdump/dev_smon_516148.trc:
    ORA-00376: file 27 cannot be read at this time
    ORA-01110: data file 27: '/vol01/oracle/data/undo.dbf'
    Kindly update me,
    http://www.oracle.cc/2008/06/case-study-recover-database-after-crash-of-storage-array-linux-error-5-ora-01243-ora-00376.html
    This link is giving solution for the same,confirm me
    Thanks
    Edited by: user13382934 on Apr 21, 2011 2:15 PM
    Edited by: user13382934 on Apr 21, 2011 2:19 PM

  • ORA-00376 file string cannot be read at this time

    Hi,
    I have got a big big problem.
    We are useing
    Oracle8i Release 8.1.7.0.0 - Production
    JServer Release 8.1.7.0.0 - Production
    we get the following error message: "ORA-00376 file users01.dbf cannot be read at this time" when i want to execute an select statement. What can i do? i´ve got a backup only form the filesystem and not with an Oracle agent. I already restored the file from yesterday but the error message was the same!!!

    Check if u have the rights to read in this file.
    Check in dba_data_files the status of this datafile, u perhaps need to recover it :
    recover datafile '/users1.dbf'
    And u should backup your database "better" than by filesystem...
    Avoir products like "Storage something", use standard Oracle utility such as command line (alter tablespace begin backup, ...) or RMAN...
    Fred

  • Urgent ORA-00376: file 11 cannot be read at this time

    Does file 11 needs media recovery ? If yes what are the steps to do that ?
    SQL> select * from v$recover_file;
    FILE# ONLINE ONLINE_STATUS ERROR CHANGE# TIME
    11 OFFLINE OFFLINE 5968032723 02/07/2007
    12 OFFLINE OFFLINE 5968032723 02/07/2007
    13 OFFLINE OFFLINE 5968032723 02/07/2007
    14 OFFLINE OFFLINE 5968032723 02/07/2007
    SQL> select name, status from v$datafile where status not in ('ONLINE', 'SYSTEM') ;
    NAME STATUS
    /data3/app/oracle/oradata/data1.dbf RECOVER
    /data3/app/oracle/oradata/index1.dbf RECOVER
    /data3/app/oracle/oradata/archive1.dbf RECOVER
    /data3/app/oracle/oradata/archive2.dbf RECOVER
    Rajkum

    Hi,
    You have deleted the data files then how can you expect to query the data :). You need to recover from a valid backup to get the database back. You CAN NOT open database if current undo tablespace data file is gone
    Salman

  • How do I map Hitachi SAN LUNs to Solaris 10 and Oracle 10g ASM?

    Hi all,
    I am working on an Oracle 10g RAC and ASM installation with Sun E6900 servers attached to a Hitachi SAN for shared storage with Sun Solaris 10 as the server OS. We are using Oracle 10g Release 2 (10.2.0.3) RAC clusterware
    for the clustering software and raw devices for shared storage and Veritas VxFs 4.1 filesystem.
    My question is this:
    How do I map the raw devices and LUNs on the Hitachi SAN to Solaris 10 OS and Oracle 10g RAC ASM?
    I am aware that with an Oracle 10g RAC and ASM instance, one needs to configure the ASM instance initialization parameter file to set the asm_diskstring setting to recognize the LUNs that are presented to the host.
    I know that Sun Solaris 10 uses /dev/rdsk/CwTxDySz naming convention at the OS level for disks. However, how would I map this to Oracle 10g ASM settings?
    I cannot find this critical piece of information ANYWHERE!!!!
    Thanks for your help!

    Yes that is correct however due to use of Solaris 10 MPxIO multipathing software that we are using with the Hitachi SAN it does present an extra layer of complexity and issues with ASM configuration. Which means that ASM may get confused when it attempts to find the new LUNs from the Hitachi SAN at the Solaris OS level. Oracle Metalink note 396015.1 states this issue.
    So my question is this: how to configure the ASM instance initialization parameter asm_diskstring to recognize the new Hitachi LUNs presented to the Solaris 10 host?
    Lets say that I have the following new LUNs:
    /dev/rdsk/c7t1d1s6
    /dev/rdsk/c7t1d2s6
    /dev/rdsk/c7t1d3s6
    /dev/rdsk/c7t1d4s6
    Would I set the ASM initialization parameter for asm_diskstring to /dev/rdsk/c7t1d*s6
    as correct setting so that the ASM instance recognizes my new Hitachi LUNs? Solaris needs to map these LUNs using pseudo devices in the Solaris OS for ASM to recognize the new disks.
    How would I set this up in Solaris 10 with Sun multipathing (MPxIO) and Oracle 10g RAC ASM?
    I want to get this right to avoid the dreaded ORA-15072 errors when creating a diskgroup with external redundancy for the Oracle 10g RAC ASM installation process.

  • Create a new user for oracle 10G ASM instance with sysdba system privilege

    Hi,
    In our Golden Gate Project, we require the SYS user credential to connect to the Oracle 10g  ASM instance to read the database transaction logs.But our client is not providing the SYS user credential to  connnect to ASM instance.
    I'm getting the error message "ORA-01109:  database not open",When I tried to create a new user using the  below the steps in oracle 10g ASM instance
    1. Login using "sqlplus / as sysdba"
    2. Create user <username> identified by <password>;
    But in oracle 11g ASM instance, I'm able to create new  user  by connecting the ASM instance with SYSASM role without issues.
    Is there is any workaround to create a new user with sysdba system privilege in oracle 10g ASM instance?.
    Thanks in advance .

    Hi,
    Recreate the password file for the ASM instance as follows:
    Unix:
    orapwd file=<ORACLE_HOME>/dbs/PWD<SID> password=<sys_password>
    Windows:
    orapwd file=<ORACLE_HOME>/database/PWD<SID>.ora password=<sys_password>
    Now sys password is reset, we are ready to use sys for ASM management. I decided to create another user ASMDBA as I tried above.
    SQL> create user ASMDBA identified by test01;
    User created.
    SQL> grant SYSASM, SYSOPER to ASMDBA;
    Grant succeeded.
    SQL> select * from v$pwfile_users;
    USERNAME SYSDBA SYSOPE SYSASM
    SYS TRUE TRUE TRUE
    ASMDBA FALSE TRUE TRUE
    Please see this link : http://orachat.com/how-to-change-asm-sys-password-creating-sysasm-user-11g/
    Thank you

  • How to delete client from oracle 10g ASM

    Hi,
    I would like to know how to delete client from oracle 10g ASM, while configuring Dataguard in same windows os i have by mistake created the standby in ASM.
    However later i have corrected the datafile destination. My Primary database is in ASM and the standby in disk.
    Could anyone please tell me how do i delete the client from ASM. On view from asmcmd it shows db_unknown and from v$asm_client
    GROUP_NUMBER INSTANCE_NAME
    DB_NAME STATUS
    SOFTWARE_VERSION
    COMPATIBLE_VERSION
    1 stby
    stby CONNECTED
    10.2.0.1.0
    10.2.0.1.0
    Thanks and regards,
    shaan

    Hi Deepak,
    Pls see the result from the view, i wanted to delete stby
    SQL> select * from v$asm_client;
    GROUP_NUMBER INSTANCE_NAME
    DB_NAME STATUS
    SOFTWARE_VERSION
    COMPATIBLE_VERSION
    1 prim
    prim CONNECTED
    10.2.0.1.0
    10.2.0.1.0
    2 prim
    prim CONNECTED
    10.2.0.1.0
    10.2.0.1.0
    1 stby
    stby CONNECTED
    10.2.0.1.0
    10.2.0.1.0
    regards,
    shaan

  • Oracle 10g excpress edition (control file)

    Dear friends,
    I am using oracle 10g excpress edition. control file curruption occued several time.
    But i could recover those times. Because i keep reguler backup. can you explane me why this happen several time.
    Regrds
    upul Indika.
    Message was edited by:
    Upul Indika

    Hi,
    >>can i create a nother control file.
    Yes you can.
    1 - alter system set control_files = 'path controlfile 1', 'path controlfile 2' SCOPE=SPFILE;
    2 - shutdown immediate
    3 - copy the controlfiles to desired locations
    4 - startup the database.
    Cheers

  • Oracle 10g rac ora-01092 oracle instance terminated disconnection forced

    hi
    I am getting following error on 2 node RAC (on NFS mount point )
    oracle 10g rac ora-01092 oracle instance terminated disconnection forced
    br
    anuj singh

    Anju,
    Its really very difficult to tell you what exactly went wrong with the limited information given by you. Did you check the alert log and other cluster (crsd and cssd ) logs? If not, I would strongly recommend you to pay attention to these logs for any clue.
    Jaffar

Maybe you are looking for

  • Macbook Air and iPad iMessage not working

    After getting a new iPhone, iMessage no longer works on my iPad and Macbook Air. Advice on how to fix? Thanks!

  • EAP-TLS with ISE

    I have been reading the Cisco ISE for BYOD and trying to create an Authentication Policy for EAP-TLS. When I build the new policy and add a new condition, then go to Network Access, EAPAuthentication is not an option. So I went to policy element and

  • OWS for Linux

    Where can I find OWS for Linux ? If someone know, please send me the URL. null

  • Major argument against replacing HP with HP

    Dear HP management,  I have been using an OfficeJet d145 since March 2003, with fairly heavy usage. Works fine except that the document feeder will only tolerate single sheet feed. That's okay, I can live with that. However, this unit uses inkjet car

  • Z10 & Basic battery dying after latest update

    I would like to know what Blackberry is doing about this problem. I  have read  it is caused by the android  file in the file manager. I have tried deleting this file, and its contents, but am unable. When is this another update going to be released