ORA-01171: datafile 6 going offline due to error advancing checkpoint
Hi
Anyone here know what cause this error? This error happened after backup at night.The data file then went offline. Anyone know the reason?
Thanks
Excerpt from alert.log:
Mon Feb 26 20:34:45 2007
Errors in file d:\oracle\admin\live\bdump\live_ckpt_1064.trc:
ORA-01171: datafile 6 going offline due to error advancing checkpoint
ORA-01122: database file 6 failed verification check
ORA-01110: data file 6: 'D:\ORACLE\ORADATA\LIVE\VGSM_DB01.DBF'
ORA-01208: data file is an old version - not accessing current version
Contents of d:\oracle\admin\live\bdump\live_ckpt_1064.trc
Dump file d:\oracle\admin\live\bdump\live_ckpt_1064.trc
Mon Feb 26 20:34:45 2007
ORACLE V9.2.0.1.0 - Production vsnsta=0
vsnsql=12 vsnxtr=3
Windows 2000 Version 5.0 Service Pack 4, CPU type 586
Oracle9i Enterprise Edition Release 9.2.0.1.0 - Production
With the Partitioning, OLAP and Oracle Data Mining options
JServer Release 9.2.0.1.0 - Production
Windows 2000 Version 5.0 Service Pack 4, CPU type 586
Instance name: live
Redo thread mounted by this instance: 1
Oracle process number: 5
Windows thread id: 1064, image: ORACLE.EXE
*** 2007-02-26 20:34:45.000
*** SESSION ID:(4.1) 2007-02-26 20:34:45.000
ORA-01171: datafile 6 going offline due to error advancing checkpoint
ORA-01122: database file 6 failed verification check
ORA-01110: data file 6: 'D:\ORACLE\ORADATA\LIVE\VGSM_DB01.DBF'
ORA-01208: data file is an old version - not accessing current version
Thanks
I looked at applicaiton log and found there are message on audit trail:
26/02/2007 20:03:56 Oracle.live Audit trail: ACTION : 'CONNECT' DATABASE USER: '/' PRIVILEGE : SYSDBA CLIENT USER: PHARMA\OmniBack CLIENT TERMINAL: AUSALDB03 STATUS: 0 .
26/02/2007 20:01:35 Oracle.live Audit trail: ACTION : 'CONNECT' DATABASE USER: '/' PRIVILEGE : SYSDBA CLIENT USER: PHARMA\OmniBack CLIENT TERMINAL: AUSALDB03 STATUS: 0 .
But the datbase was not shotdown immediately, it was shutdown next day as shown below:
27/02/2007 12:17:46 Oracle.live Audit trail: ACTION : 'CONNECT' DATABASE USER: '/' PRIVILEGE : SYSDBA CLIENT USER: AUSALDB03\oborj0 CLIENT TERMINAL: AUSALDB03 STATUS: 0 .
27/02/2007 12:17:45 Oracle.live AUSALDB03 Initializing PGA for process ARC1 in instance live.
27/02/2007 12:17:44 Oracle.live Initializing PGA for process ARC0 in instance live.
27/02/2007 12:17:44 Oracle.live Initializing PGA for process RECO in instance live.
27/02/2007 12:17:44 Oracle.live Initializing PGA for process SMON in instance live.
27/02/2007 12:17:43 Oracle.live Initializing PGA for process CKPT in instance live.
27/02/2007 12:17:43 Oracle.live Initializing PGA for process LGWR in instance live.
27/02/2007 12:17:43 Oracle.live Initializing PGA for process DBW0 in instance live.
27/02/2007 12:17:42 Oracle.live Initializing PGA for process PMON in instance live.
27/02/2007 12:17:42 Oracle.live Initializing SGA for instance live.
27/02/2007 12:17:42 Oracle.live Audit trail: ACTION : 'STARTUP' DATABASE USER: '/' PRIVILEGE : SYSDBA CLIENT USER: AUSALDB03\oborj0 CLIENT TERMINAL: Not Available STATUS: 0 .
27/02/2007 12:17:11 Oracle.live Instance live has been terminated.
27/02/2007 12:17:10 Oracle.live All process in instance live stopped
27/02/2007 12:17:09 Oracle.live Shutdown normal performed on instance live.
27/02/2007 12:17:09 Oracle.live Audit trail: ACTION : 'SHUTDOWN' DATABASE USER: '/' PRIVILEGE : SYSDBA CLIENT USER: AUSALDB03\oborj0 CLIENT TERMINAL: AUSALDB03 STATUS: 0 .
27/02/2007 12:13:31 Oracle.live Audit trail: ACTION : 'CONNECT' DATABASE USER: '/' PRIVILEGE : SYSDBA CLIENT USER: AUSALDB03\oborj0 CLIENT TERMINAL: AUSALDB03 STATUS: 0 .
Do you think the database was not shutdown properly at that time? If backup of datafile was carried on with database still open, it may cause the errors as shwon on oracle alert log file, but I am not sure.
Also I found the database was shutdown properly on the othe day but with user name ="sys"! Do you think this username cause the problem of shutdown?
24/02/2007 20:04:54 Oracle.live Audit trail: ACTION : 'CONNECT' DATABASE USER: 'sys' PRIVILEGE : SYSDBA CLIENT USER: PHARMA\AUSALDB03$ CLIENT TERMINAL: AUSALDB03 STATUS: 0 .
24/02/2007 20:04:54 Oracle.liveInitializing PGA for process ARC1 in instance live.
24/02/2007 20:04:53 Oracle.live Initializing PGA for process ARC0 in instance live.
24/02/2007 20:04:53 Oracle.liveInitializing PGA for process RECO in instance live.
24/02/2007 20:04:53 Oracle.live Initializing PGA for process SMON in instance live.
24/02/2007 20:04:53 Oracle.live Initializing PGA for process CKPT in instance live.
24/02/2007 20:04:52 Oracle.live Initializing PGA for process LGWR in instance live.
24/02/2007 20:04:52 Oracle.live Initializing PGA for process DBW0 in instance live.
24/02/2007 20:04:52 Oracle.live Initializing PGA for process PMON in instance live.
24/02/2007 20:04:51 Oracle.live Initializing SGA for instance live.
24/02/2007 20:04:51 Oracle.live Audit trail: ACTION : 'STARTUP' DATABASE USER: '/' PRIVILEGE : SYSDBA CLIENT USER: PHARMA\AUSALDB03$ CLIENT TERMINAL: Not Available STATUS: 0 .
24/02/2007 20:04:51 Oracle.live Audit trail: ACTION : 'CONNECT' DATABASE USER: 'sys' PRIVILEGE : SYSDBA CLIENT USER: PHARMA\AUSALDB03$ CLIENT TERMINAL: AUSALDB03 STATUS: 0 .
24/02/2007 20:00:17 Oracle.live Instance live has been terminated.
24/02/2007 20:00:15 Oracle.live All process in instance live stopped
24/02/2007 20:00:11 Oracle.live Shutdown normal performed on instance live.
24/02/2007 20:00:11 Oracle.live Audit trail: ACTION : 'SHUTDOWN' DATABASE USER: '/' PRIVILEGE : SYSDBA CLIENT USER: PHARMA\AUSALDB03$ CLIENT TERMINAL: AUSALDB03 STATUS: 0 .
24/02/2007 20:00:08 Oracle.live Audit trail: ACTION : 'CONNECT' DATABASE USER: 'sys' PRIVILEGE : SYSDBA CLIENT USER: PHARMA\AUSALDB03$ CLIENT TERMINAL: AUSALDB03 STATUS: 0 .
Thanks for your help!
Li
Similar Messages
-
ORA-19612: datafile 0 not restored due to missing data
Hello,
I'm testing a restore of the controlfile. The database is in archivelog mode and autobackup is set to ON. I successfully did a full backup and backup as copy database.
To test I did the following:
- note the DBID
- shutdown the database
- renamed both controlfiles:
$ mv /u02/rcat/control01.ctl /u02/rcat/control01.ctl_old
$ mv /u02/fra/rcat/control02.ctl /u02/fra/rcat/control02.ctl_old
When I try to restore the controlfile form autobackup I receive the following error. What could be reason please?
[rcat@oel54]$ rman target /
Recovery Manager: Release 11.2.0.1.0 - Production on Fri Dec 10 00:07:41 2010
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database: RCAT (not mounted)
RMAN> set dbid 502889862;
executing command: SET DBID
RMAN> restore controlfile from autobackup;
Starting restore at 10-DEC-10
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=19 device type=DISK
recovery area destination: /u02/fra
database name (or database unique name) used for search: RCAT
channel ORA_DISK_1: AUTOBACKUP /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkp found in the recovery area
channel ORA_DISK_1: looking for AUTOBACKUP on day: 20101210
channel ORA_DISK_1: looking for AUTOBACKUP on day: 20101209
channel ORA_DISK_1: restoring control file from AUTOBACKUP /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkp
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of restore command at 12/10/2010 00:09:55
ORA-19870: error while restoring backup piece /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkp
ORA-19612: datafile 0 not restored due to missing data
$ ll /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkp
-rw-r----- 1 oracle dba 10354688 Dec 9 23:44 /u02/fra/RCAT/autobackup/2010_12_09/o1_mf_s_737336682_6j2pyv2l_.bkpThanks!The file was indeed corrupted as below will show.
Very strange. Perhaps something with the latest Virtualbox or the SSD/hybrid harddrive. (host MacOSX 10.6, guest Oracle Linux 5.5 UEK)
$ mv /u02/rcat/control01.ctl_old /u02/rcat/control01.ctl
$ mv /u02/fra/rcat/control02.ctl_old /u02/fra/rcat/control02.ctl
SQL> startup mount
ORACLE instance started.
SQL> recover database;
ORA-00283: recovery session canceled due to errors
ORA-00264: no recovery required
SQL> alter database open;
Database altered.
$ rman target /
connected to target database: RCAT (DBID=502889862)
RMAN> backup current controlfile;
piece handle=/u02/fra/RCAT/backupset/2010_12_10/o1_mf_ncnnf_TAG20101210T012420_6j2wsoko_.bkp
Finished backup at 10-DEC-10
Starting Control File and SPFILE Autobackup at 10-DEC-10
piece handle=/u02/fra/RCAT/autobackup/2010_12_10/o1_mf_s_737342662_6j2wspvf_.bkp comment=NONE
Finished Control File and SPFILE Autobackup at 10-DEC-10
RMAN> restore validate controlfile;
piece handle=/u02/fra/RCAT/autobackup/2010_12_10/o1_mf_s_737342662_6j2wspvf_.bkp tag=TAG20101210T012422
channel ORA_DISK_1: restored backup piece 1
channel ORA_DISK_1: validation complete, elapsed time: 00:00:02
Finished restore at 10-DEC-10
SQL> shutdown immediate
$ mv /u02/rcat/control01.ctl /u02/rcat/control01.ctl_old
$ mv /u02/fra/rcat/control02.ctl /u02/fra/rcat/control02.ctl_old
SQL> startup nomount
$ rman target /
connected to target database: RCAT (not mounted)
RMAN> set dbid 502889862;
RMAN> restore controlfile from autobackup;
Starting restore at 10-DEC-10
using target database control file instead of recovery catalog
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=19 device type=DISK
recovery area destination: /u02/fra
database name (or database unique name) used for search: RCAT
channel ORA_DISK_1: AUTOBACKUP /u02/fra/RCAT/autobackup/2010_12_10/o1_mf_s_737342662_6j2wspvf_.bkp found in the recovery area
channel ORA_DISK_1: looking for AUTOBACKUP on day: 20101210
channel ORA_DISK_1: restoring control file from AUTOBACKUP /u02/fra/RCAT/autobackup/2010_12_10/o1_mf_s_737342662_6j2wspvf_.bkp
channel ORA_DISK_1: control file restore from AUTOBACKUP complete
output file name=/u02/rcat/control01.ctl
output file name=/u02/fra/rcat/control02.ctl
Finished restore at 10-DEC-10 -
What can make a DBF going offline ?
Hello,
First post here...
I got an error that made 2 datafiles become offline. I had to recover them and it seems to work now.
I wonder what is the cause of that. My db (9i in Archivelog mode) is on a W2K Server.
Here is part of the alert.log:
Thu Apr 14 10:10:52 2005
Thread 1 cannot allocate new log, sequence 1132189
Checkpoint not complete
Current log# 3 seq# 1132188 mem# 0: L:\ORAHOME1\ORADATA\MYBASE\REDO03.LOG
Thu Apr 14 10:10:53 2005
Errors in file d:\orahome9i\admin\mybase\bdump\mybase_ckpt_5528.trc:
ORA-01171: datafile 29 going offline due to error advancing checkpoint
ORA-01122: database file 29 failed verification check
ORA-01110: data file 29: 'D:\ORAHOME1\ORADATA\MYBASE\MY_DATA_FILE.ORA'
ORA-01208: data file is an old version - not accessing current version
I have to precise that the datafiles are quite
small (ie <1GB) and that the problem occured during the production (not after any admin operation on the db).
The only preceding events that could be the cause of this problem, I think, are due to ARC process:
Thu Apr 14 10:10:49 2005
ARC0: Evaluating archive log 1 thread 1 sequence 1132186
ARC0: Warning. Log sequence in archive filename wrapped
to fix length as indicated by %S in LOG_ARCHIVE_FORMAT.
Old log archive with same name might be overwritten.
ARC0: Beginning to archive log 1 thread 1 sequence 1132186
Creating archive destination LOG_ARCHIVE_DEST_1: 'E:\ARCHIVELOGS_ORACLE\ARC32186.001'
ARC0: Completed archiving log 1 thread 1 sequence 1132186
I know that I should use %s instead of %S in my file mask.
But do you think that it could have been the origin of my problem ?
Thanks for any advice or idea to dig
Aurélien BastardieYour error is not related to the archive logs. Oracle offlined the datafiles because it could not update file header(s). The ORA-01122 indicates that the file was out of synch w/ the control file - most likely because it could not update the file - so it offlined it.
Check your system event logs for any disk related errors.
ORA-01171: datafile 29 going offline due to error advancing checkpoint
ORA-01122: database file 29 failed verification check
ORA-01110: data file 29: 'D:\ORAHOME1\ORADATA\MYBASE\MY_DATA_FILE.ORA' -
Automatic datafile offline due to write error
Hi,
Our SAP system are down. In the alert.log file, i found that one of the files are being locked by third party backup software.
I'm new to both oracle and basis, pls advise the steps to recover the database. Thank you.
The error in the alert log file:
Errors in file f:\oracle\p02\saptrace\background\p02_lgwr_3896.trc:
ORA-00345: redo log write error block 8404 count 2
ORA-00312: online log 3 thread 1: 'D:\ORACLE\P02\ORIGLOGA\LOG_G13M1.DBF'
ORA-27072: File I/O error
OSD-04008: WriteFile() failure, unable to write to file
O/S-Error: (OS 33) The process cannot access the file because another process has locked a portion of the file.
Sat Oct 25 00:23:12 2008
Errors in file f:\oracle\p02\saptrace\background\p02_lgwr_3896.trc:
ORA-00343: too many errors, log member closed
ORA-00346: log member marked as STALE
ORA-00312: online log 3 thread 1: 'D:\ORACLE\P02\ORIGLOGA\LOG_G13M1.DBF'
Sat Oct 25 00:26:04 2008
Incremental checkpoint up to RBA [0x1c1b.2079.0], current log tail at RBA [0x1c1b.20dc.0]
Sat Oct 25 00:35:18 2008
KCF: write/open error block=0x3f7c6 online=1
file=5 G:\ORACLE\P02\SAPDATA1\SR3_2\SR3.DATA2
error=27072 txt: 'OSD-04008: WriteFile() failure, unable to write to file
O/S-Error: (OS 33) The process cannot access the file because another process has locked a portion of the file.'
Automatic datafile offline due to write error on
file 5: G:\ORACLE\P02\SAPDATA1\SR3_2\SR3.DATA2
Sat Oct 25 00:35:19 2008
KCF: write/open error block=0x3f7c4 online=1
file=5 G:\ORACLE\P02\SAPDATA1\SR3_2\SR3.DATA2
error=27070 txt: 'OSD-04016: Error queuing an asynchronous I/O request.
O/S-Error: (OS 33) The process cannot access the file because another process has locked a portion of the file.'
Automatic datafile offline due to write error on
file 5: G:\ORACLE\P02\SAPDATA1\SR3_2\SR3.DATA2
Sat Oct 25 00:36:00 2008
KCF: write/open error block=0x37f74 online=1
file=7 G:\ORACLE\P02\SAPDATA1\SR3_4\SR3.DATA4
error=27072 txt: 'OSD-04008: WriteFile() failure, unable to write to file
O/S-Error: (OS 33) The process cannot access the file because another process has locked a portion of the file.'
Automatic datafile offline due to write error on
file 7: G:\ORACLE\P02\SAPDATA1\SR3_4\SR3.DATA4
Sat Oct 25 00:45:49 2008
Errors in file f:\oracle\p02\saptrace\usertrace\p02_ora_3876.trc:
ORA-00600: internal error code, arguments: [kdtdelrow-2], [2], [2], [], [], [], [], []
ORA-00376: file 5 cannot be read at this time
ORA-01110: data file 5: 'G:\ORACLE\P02\SAPDATA1\SR3_2\SR3.DATA2'Hi
As alway use this information for research purposes only.
I presume that Oracle and SAP application servers are down.
Now would be a good time to make a backup image of your crippled system.
This way you can always get back to this state if needed.
So do an offline backup if possible.
It looks like a log file is damaged or deleted. You may find that you have a
mirror image of it so this might not be the end of the world.
If you have oracle up to the mount point e.g.
startup mount
then you should be able to acces the v$logfile
select GROUP#,STATUS,MEMBER from v$logfile;
This will show you whether the have a mirror setup for the log file you need.
Make sure all the files outlined in this output exist.
e.g. do a DIR in the parant directory.
Post all the output of v$logfile and whether all the files exist.
regards
Stephen -
Alert from OEM if datafile goes offline
what is the metric we need to set to get alert if a datafile goes offline in OEM11g?
Is it data failure? If so i have set critical threshold as .*?
Still not getting any alert form GC. Please advice.hi
ORA-01115: IO error reading block from file 11 (block # 1819298)this error related to datablock corruption....
in this the error reason is datablock corruption.
regards
Mohammadi -
Automatic tempfile offline due to write error on
Hi everybody,
I am getting the following in my alert log and my TEMPFILE went offline.
KCF: write/open error block=0x5a909 online=1
file=4 /database1/oratemp1/temp1_04.dbf
error=27091 txt: 'HP-UX Error: 28: No space left on device
Automatic tempfile offline due to write error on
file 4: /database1/oratemp1/temp1_04.dbf
The funny thing is I found that it is not autoextensible. The sapce in the mount point is 100% utilized. But why would such an error come when the tempfile is in autoextend off??
Any ideas?
Thanks in advanceHi.
Oracle does not guarantee whether temp datafiles are fully allocated on file system by OS when you create a temp tablespace or a add tempfile.
Usually it will not be fully allocated on file system until you fully utilize the temp space.
You should make some free space for tempspace to (really) allocate in the volume
or create another temp tablespace on another volume and switch to it. -
Report Job Server goes Offline
I've had a persistent problem with the Report Job Server in the CMC going offline (BO XI R2). I try to stop/start but I get a message that the server is already in the requested state (started).
I've tried disable/enable -- still it is offline and my reports won't run.
I check the CCM and all the servers are running. The Event Viewer in Windows shows that the Report Job Server has stopped..."Unable to contact server sccecho2.reportjobserver.jobserver to change its enabled status. Please restart it."
The only way to get it started again is via a server reboot. Then the reports will run.
This problem seems to happen shortly before I have several reports scheduled to run and none of them get sent off due to the Report Job Server being offline.
Is there something else I can check somewhere or other thoughts as to what is causing this persistent problem?
Thank you for any help you can send my way.
kdHi Kim,
Try creating a new Server and check the issue.
Thanks,
Anisa -
ORA-00283: recovery session canceled due to errors
Dear All,
I have standby database in which STANDBY_FILE_MANAGEMENT was MANUAL. I have shrink undo table-space in primary database. After 2 days I tried to recover standby database. I got following error.
ORA-00283: recovery session canceled due to errors
ORA-01274: cannot add data file '/home/app/oracle/oradata/OMNDB/undotbs01.dbf'
- file could not be created
I am unable to shrink undo table-space in standby database as I did in primary database as it is not open.
please anyone help me to get clarify this issue.
In Standby_
SQL> select name from v$datafile;
NAME
/home/app/oracle/oradata/OMNDB/system01.dbf
/home/app/oracle/oradata/OMNDB/undotbs01.dbf
/home/app/oracle/oradata/OMNDB/sysaux01.dbf
/home/app/oracle/oradata/OMNDB/MY_oms_ts01.dbf
/home/app/oracle/oradata/OMNDB/nologging_ts01.dbfThank you CKPT for reply.
this is the output when MRP
SQL> recover standby database;
ORA-00283: recovery session canceled due to errors
ORA-01111: name for data file 2 is unknown - rename to correct file
ORA-01110: data file 2: '/home/app/oracle/product/10.2.0/db_1/dbs/UNNAMED00002'
ORA-01157: cannot identify/lock data file 2 - see DBWR trace file
ORA-01111: name for data file 2 is unknown - rename to correct file
ORA-01110: data file 2: '/home/app/oracle/product/10.2.0/db_1/dbs/UNNAMED00002'
this is in the alert log
ORA-1112 signalled during: ALTER DATABASE RECOVER CANCEL ...
Tue Jan 29 09:17:53 2013
db_recovery_file_dest_size of 10240 MB is 0.00% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
Tue Jan 29 10:29:57 2013
ALTER DATABASE RECOVER standby database
Tue Jan 29 10:29:57 2013
Media Recovery Start
Managed Standby Recovery not using Real Time Apply
Tue Jan 29 10:29:57 2013
Media Recovery failed with error 1111
ORA-283 signalled during: ALTER DATABASE RECOVER standby database ... -
ORA-00283: recovery session canceled due to errors. Help me.
Something appears to be wrong with my control file backup. Upon
moving the backed up files to my "test" machine, I place them in the
data directory, and rename my control file backup to the correct name
and run this procedure:
- I start the instance
- I mount the database
- I issue a recover database
I then receive the following error:
ORA-00283: recovery session canceled due to errors
ORA-01610: recovery using the BACKUP CONTROLFILE option must be done
Does anyone have any thoughts around this?Hi,
Have you taken backup of control file?
(alter database backup controlfile to trace)
Does the path of datafiles on test machine is same as that of production machine from where you have copied files?
Steps:
1> startup nomount
2> copy create controlfile command from tracefile
If paths are different change them.
3> recover database until cancel using backup controlfile
It will ask archive logs path, specify path.
Press cancel after you have applied all archivelogs.
4> alter database open resetlogs
5> add tempfile in database. -
ORA-19909: datafile 1 belongs to an orphan incarnation
Hi All,
os :linux
db: oracle 11gr2
am facing below error..how to recover database;
SQL> recover database until cancel using backup controlfile;
ORA-00283: recovery session canceled due to errors
ORA-19909: datafile 1 belongs to an orphan incarnation
ORA-01110: data file 1: '/ora/db001/data001/LLDBOO1/system01.dbf'
SQL>
actuallly, i have tried incarnation set to 1 etc..but no luck...
i have archive logs.....
2 hrs back i have tried ...below option...
i have set ALLOWRESETLOGS_CORRUPTION=TRUE in init.ora file. and oped resetlogs ..it is opend but it is showing error...
here is I would like to open backup controlfile...is it possible?
thanks,
dbc
Edited by: dbc001 on Feb 7, 2013 12:29 PMApparently, you have already attempted
RESTORE
RESETLOGS at least once before this
We do not know what commands you executed in which sequence. (an orphaned SYSTEM file is astonishing !)
.......... maybe you should go back to the beginning.
Tell us
a. WHY you need to RESTORE and RECOVER
b. EXACTLY what you did (list every step, in the right sequence of actions)
c. What errors / messages did Oracle present at every step
Hemant K Chitale -
Listener & ASM going OFFLINE frequently
Hi,
I Install successfully RAC on 2-node clusterware, After I root both nodes its going UNKNOWN state then I tried to bring ONLINE with SRVCTL its successfully ONLINE but after some time nearly 10-minuts the ASM & LISTENERS going OFFLINE both Node. please any idea how to trouble shoot.
2-node cluterware on VMWare.
clusterware version: 10.2.0.1
DB version:10.2.0.1
os: linux as4
Home:
CRS: /oracle/product/10.2.0/crs
ASM: /oracle/product/10.2.0/asm
RDBMS: /oracle/product/10.2.0/rdbms
after reboot the nodes see the below :
[root@rac1 bin]# ./crs_stat -t
Name Type Target State Host
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE UNKNOWN rac1
ora.rac1.gsd application ONLINE UNKNOWN rac1
ora.rac1.ons application ONLINE UNKNOWN rac1
ora.rac1.vip application ONLINE OFFLINE
ora....SM2.asm application ONLINE UNKNOWN rac2
ora....C2.lsnr application ONLINE OFFLINE
ora.rac2.gsd application ONLINE UNKNOWN rac2
ora.rac2.ons application ONLINE UNKNOWN rac2
ora.rac2.vip application ONLINE ONLINE rac2
ora.racdb.db application ONLINE UNKNOWN rac2
ora....b1.inst application ONLINE UNKNOWN rac1
ora....b2.inst application ONLINE OFFLINE
After bring Online manually with SRVCTL utility:
ora....SM1.asm application ONLINE OFFLINE
ora....C1.lsnr application ONLINE OFFLINE
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE ONLINE rac2
ora....SM2.asm application ONLINE OFFLINE
ora....C2.lsnr application ONLINE OFFLINE
ora.rac2.gsd application ONLINE ONLINE rac2
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip application ONLINE ONLINE rac1
ora.racdb.db application OFFLINE OFFLINE
ora....b1.inst application OFFLINE OFFLINE
ora....b2.inst application ONLINE OFFLINEora.rac1.vip.log_:
2012-02-07 10:56:23.702: [ RACG][4143856384] [11290][4143856384][ora.rac1.vip]: d getifbyip
2012-02-07 13:53:59.725: [ RACG][4143856384] [23948][4143856384][ora.rac1.vip]: Tue Feb 7 13:53:46 AST 2012 [ 23962 ] Broadcast = 192.168.1.255
Tue Feb 7 13:53:46 AST 2012 [ 23962 ] Checking interface existance
Tue Feb 7 13:53:46 AST 2012 [ 23962 ] Calling getifbyip
Tue Feb 7 13:53:46 AST 2012 [ 23962 ] getifbyip: started for 19
2012-02-07 13:53:59.726: [ RACG][4143856384] [23948][4143856384][ora.rac1.vip]: 2.168.1.102
Tue Feb 7 13:53:46 AST 2012 [ 23962 ] Completed getifbyip
Tue Feb 7 13:53:46 AST 2012 [ 23962 ] Calling getifbyip -a
Tue Feb 7 13:53:46 AST 2012 [ 23962 ] getifbyip: started for 192.168.1.102
Tue Feb 7 13:53:47 AST 2012 [ 23962 ] Complete
2012-02-07 13:53:59.726: [ RACG][4143856384] [23948][4143856384][ora.rac1.vip]: d getifbyip
Tue Feb 7 13:53:50 AST 2012 [ 23962 ] Completed with initial interface test
Tue Feb 7 13:53:50 AST 2012 [ 23962 ] Interface tests
Tue Feb 7 13:53:50 AST 2012 [ 23962 ] checkIf: start for if=eth0
Tue Feb 7 13:53:50 AST 2012 [ 23962 ] /sbin/
2012-02-07 13:53:59.727: [ RACG][4143856384] [23948][4143856384][ora.rac1.vip]: mii-tool eth0 error
Tue Feb 7 13:53:50 AST 2012 [ 23962 ] defaultgw: started
Tue Feb 7 13:53:50 AST 2012 [ 23962 ] defaultgw: completed with 10.10.1.1
Tue Feb 7 13:53:56 AST 2012 [ 23962 ] checkIf: RX packets checked if=eth0 OK
Tue Feb 7 13:53:56 AS
2012-02-07 13:53:59.727: [ RACG][4143856384] [23948][4143856384][ora.rac1.vip]: T 2012 [ 23962 ] checkIf: end for if=eth0
Tue Feb 7 13:53:56 AST 2012 [ 23962 ] getnextli: started for if=eth0
Tue Feb 7 13:53:56 AST 2012 [ 23962 ] listif: starting
Tue Feb 7 13:53:56 AST 2012 [ 23962 ] listif: completed with eth0
eth1
Tue Feb 7 13
2012-02-07 13:53:59.727: [ RACG][4143856384] [23948][4143856384][ora.rac1.vip]: :53:56 AST 2012 [ 23962 ] getnextli: completed with nextli=eth0:1
Tue Feb 7 13:53:56 AST 2012 [ 23962 ] Success exit 1
2012-02-07 14:01:51.130: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: Tue Feb 7 14:01:46 AST 2012 [ 1061 ] Broadcast = 192.168.1.255
Tue Feb 7 14:01:46 AST 2012 [ 1061 ] Checking interface existance
Tue Feb 7 14:01:46 AST 2012 [ 1061 ] Calling getifbyip
Tue Feb 7 14:01:46 AST 2012 [ 1061 ] getifbyip: started for 192.16
2012-02-07 14:01:51.130: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: 8.1.102
Tue Feb 7 14:01:46 AST 2012 [ 1061 ] getifbyip: returning IP eth0:1
Tue Feb 7 14:01:46 AST 2012 [ 1061 ] Completed getifbyip eth0:1
Tue Feb 7 14:01:46 AST 2012 [ 1061 ] Calling getifbyip -a
Tue Feb 7 14:01:46 AST 2012 [ 1061 ] getifbyip: sta
2012-02-07 14:01:51.131: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: rted for 192.168.1.102
Tue Feb 7 14:01:46 AST 2012 [ 1061 ] getifbyip: returning IP eth0:1
Tue Feb 7 14:01:46 AST 2012 [ 1061 ] Completed getifbyip eth0:1
Tue Feb 7 14:01:47 AST 2012 [ 1061 ] Completed with initial interface test
Tue Feb 7 14:01:47 A
2012-02-07 14:01:51.131: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: ST 2012 [ 1061 ] checkIf: start for if=eth0
Tue Feb 7 14:01:47 AST 2012 [ 1061 ] /sbin/mii-tool eth0 error
Tue Feb 7 14:01:47 AST 2012 [ 1061 ] defaultgw: started
Tue Feb 7 14:01:47 AST 2012 [ 1061 ] defaultgw: completed with 10.10.1.1
Tue Feb 7 14:
2012-02-07 14:01:51.131: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: 01:50 AST 2012 [ 1061 ] checkIf: ping and RX packets checked if=eth0 failed
Interface eth0 checked failed (host=rac1)
Tue Feb 7 14:01:50 AST 2012 [ 1061 ] checkIf: end for if=eth0
Tue Feb 7 14:01:50 AST 2012 [ 1061 ] Performing CRS_STAT testing
Tue Feb
2012-02-07 14:01:51.131: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: 7 14:01:50 AST 2012 [ 1061 ] Completed CRS_STAT testing
Tue Feb 7 14:01:50 AST 2012 [ 1061 ] Completed second gateway test
Tue Feb 7 14:01:50 AST 2012 [ 1061 ] Interface tests
Invalid parameters, or failed to bring up VIP (host=rac1)
2012-02-07 14:01:51.131: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/crs
2012-02-07 14:01:51.131: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/crs/bin/racgeut -e USRORA_DEBUG=0 54 /oracle/product/10.2.0/crs/bin/racgvip check rac1
2012-02-07 14:01:51.131: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: clsrcexecut: rc = 1, time = 4.650s
2012-02-07 14:01:51.132: [ RACG][4143856384] [1054][4143856384][ora.rac1.vip]: end for resource = ora.rac1.vip, action = check, status = 1, time = 4.770s
2012-02-07 14:01:55.436: [ RACG][4143856384] [1220][4143856384][ora.rac1.vip]: Tue Feb 7 14:01:51 AST 2012 [ 1232 ] Broadcast = 192.168.1.255
Tue Feb 7 14:01:51 AST 2012 [ 1232 ] Checking interface existance
Tue Feb 7 14:01:52 AST 2012 [ 1232 ] Calling getifbyip
Tue Feb 7 14:01:52 AST 2012 [ 1232 ] getifbyip: started for 192.16
2012-02-07 14:01:55.438: [ RACG][4143856384] [1220][4143856384][ora.rac1.vip]: 8.1.102
Tue Feb 7 14:01:52 AST 2012 [ 1232 ] Completed getifbyip
Tue Feb 7 14:01:52 AST 2012 [ 1232 ] Calling getifbyip -a
Tue Feb 7 14:01:52 AST 2012 [ 1232 ] getifbyip: started for 192.168.1.102
Tue Feb 7 14:01:52 AST 2012 [ 1232 ] Completed getifb
2012-02-07 14:01:55.438: [ RACG][4143856384] [1220][4143856384][ora.rac1.vip]: yip
2012-02-07 14:06:19.920: [ RACG][4143856384] [6233][4143856384][ora.rac1.vip]: Tue Feb 7 14:06:06 AST 2012 [ 6237 ] Broadcast = 192.168.1.255
Tue Feb 7 14:06:07 AST 2012 [ 6237 ] Checking interface existance
Tue Feb 7 14:06:07 AST 2012 [ 6237 ] Calling getifbyip
Tue Feb 7 14:06:07 AST 2012 [ 6237 ] getifbyip: started for 192.16
2012-02-07 14:06:19.922: [ RACG][4143856384] [6233][4143856384][ora.rac1.vip]: 8.1.102
Tue Feb 7 14:06:07 AST 2012 [ 6237 ] Completed getifbyip
Tue Feb 7 14:06:07 AST 2012 [ 6237 ] Calling getifbyip -a
Tue Feb 7 14:06:07 AST 2012 [ 6237 ] getifbyip: started for 192.168.1.102
Tue Feb 7 14:06:07 AST 2012 [ 6237 ] Completed getifb
2012-02-07 14:06:19.922: [ RACG][4143856384] [6233][4143856384][ora.rac1.vip]: yip
Tue Feb 7 14:06:10 AST 2012 [ 6237 ] Completed with initial interface test
Tue Feb 7 14:06:10 AST 2012 [ 6237 ] Interface tests
Tue Feb 7 14:06:10 AST 2012 [ 6237 ] checkIf: start for if=eth0
Tue Feb 7 14:06:10 AST 2012 [ 6237 ] /sbin/mii-tool eth
2012-02-07 14:06:19.922: [ RACG][4143856384] [6233][4143856384][ora.rac1.vip]: 0 error
Tue Feb 7 14:06:10 AST 2012 [ 6237 ] defaultgw: started
Tue Feb 7 14:06:10 AST 2012 [ 6237 ] defaultgw: completed with 10.10.1.1
Tue Feb 7 14:06:16 AST 2012 [ 6237 ] checkIf: RX packets checked if=eth0 OK
Tue Feb 7 14:06:16 AST 2012 [ 6237 ]
2012-02-07 14:06:19.923: [ RACG][4143856384] [6233][4143856384][ora.rac1.vip]: checkIf: end for if=eth0
Tue Feb 7 14:06:16 AST 2012 [ 6237 ] getnextli: started for if=eth0
Tue Feb 7 14:06:16 AST 2012 [ 6237 ] listif: starting
Tue Feb 7 14:06:16 AST 2012 [ 6237 ] listif: completed with eth0
eth0:2
eth1
Tue Feb 7 14:06:16 AST 2
2012-02-07 14:06:19.923: [ RACG][4143856384] [6233][4143856384][ora.rac1.vip]: 012 [ 6237 ] getnextli: completed with nextli=eth0:1
Tue Feb 7 14:06:16 AST 2012 [ 6237 ] Success exit 1
2012-02-07 14:48:24.219: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: Tue Feb 7 14:48:17 AST 2012 [ 21896 ] Broadcast = 192.168.1.255
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] Checking interface existance
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] Calling getifbyip
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] getifbyip: started for 19
2012-02-07 14:48:24.220: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: 2.168.1.102
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] getifbyip: returning IP eth0:1
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] Completed getifbyip eth0:1
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] Calling getifbyip -a
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] getifby
2012-02-07 14:48:24.220: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: ip: started for 192.168.1.102
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] getifbyip: returning IP eth0:1
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] Completed getifbyip eth0:1
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] Completed with initial interface test
Tue Feb 7
2012-02-07 14:48:24.220: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: 14:48:17 AST 2012 [ 21896 ] checkIf: start for if=eth0
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] /sbin/mii-tool eth0 error
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] defaultgw: started
Tue Feb 7 14:48:17 AST 2012 [ 21896 ] defaultgw: completed with 10.10.1.1
2012-02-07 14:48:24.220: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]:
Tue Feb 7 14:48:23 AST 2012 [ 21896 ] checkIf: ping and RX packets checked if=eth0 failed
Interface eth0 checked failed (host=rac1)
Tue Feb 7 14:48:23 AST 2012 [ 21896 ] checkIf: end for if=eth0
Tue Feb 7 14:48:23 AST 2012 [ 21896 ] Performing CRS_STA
2012-02-07 14:48:24.220: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: T testing
Tue Feb 7 14:48:24 AST 2012 [ 21896 ] Completed CRS_STAT testing
Tue Feb 7 14:48:24 AST 2012 [ 21896 ] Completed second gateway test
Tue Feb 7 14:48:24 AST 2012 [ 21896 ] Interface tests
Invalid parameters, or failed to bring up VIP (host=rac
2012-02-07 14:48:24.220: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: 1)
2012-02-07 14:48:24.220: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: clsrcexecut: env ORACLE_CONFIG_HOME=/oracle/product/10.2.0/crs
2012-02-07 14:48:24.220: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: clsrcexecut: cmd = /oracle/product/10.2.0/crs/bin/racgeut -e USRORA_DEBUG=0 54 /oracle/product/10.2.0/crs/bin/racgvip check rac1
2012-02-07 14:48:24.220: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: clsrcexecut: rc = 1, time = 7.230s
2012-02-07 14:48:24.221: [ RACG][4143856384] [21892][4143856384][ora.rac1.vip]: end for resource = ora.rac1.vip, action = check, status = 1, time = 7.370s
2012-02-07 14:48:28.525: [ RACG][4143856384] [22100][4143856384][ora.rac1.vip]: Tue Feb 7 14:48:25 AST 2012 [ 22110 ] Broadcast = 192.168.1.255
Tue Feb 7 14:48:25 AST 2012 [ 22110 ] Checking interface existance
Tue Feb 7 14:48:25 AST 2012 [ 22110 ] Calling getifbyip
Tue Feb 7 14:48:25 AST 2012 [ 22110 ] getifbyip: started for 19
2012-02-07 14:48:28.527: [ RACG][4143856384] [22100][4143856384][ora.rac1.vip]: 2.168.1.102
Tue Feb 7 14:48:25 AST 2012 [ 22110 ] Completed getifbyip
Tue Feb 7 14:48:25 AST 2012 [ 22110 ] Calling getifbyip -a
Tue Feb 7 14:48:25 AST 2012 [ 22110 ] getifbyip: started for 192.168.1.102
Tue Feb 7 14:48:25 AST 2012 [ 22110 ] Complete
2012-02-07 14:48:28.527: [ RACG][4143856384] [22100][4143856384][ora.rac1.vip]: d getifbyip -
EBS 11i - Concurrent Manager goes down due to network failure.
Hi,
We have a Single Node Oracle EBS 11i (11.5.10) [upgraded from 11.0.3] Production Instance on a Windows 2003 (32-Bit) server.
We have UPS support for the Server but the Netwok Switch is not on UPS. Due to this whenever there is a power trip the network goes down and due to this the Concurrent Manager (only)goes down. All other Apps Tier and DB Tier services are up inlcluding the 806 Listener (APPS_SID).
Is this how it is designed to work? Is there anyway to ensure that the Conc. Manager does not go down due to network failure.
Rgds,
ThiruHere it is
Process monitor session ended : 02-OCT-2009 07:30:04
The Internal Concurrent Manager has encountered an error.
Review concurrent manager log file for more detailed information. : 02-OCT-2009 07:43:16 -
Shutting down Internal Concurrent Manager : 02-OCT-2009 07:45:56
Reviver is not enabled, not spawning a reviver process.
List of errors encountered:
_ 1 _
Routine AFPCMT encountered an ORACLE error. ORA-01041: internal error.
hostdef extension doesn't exist
Review your error messages for the cause of the error. (=<POINTER>)
_ 2 _
Routine AFPSMG encountered an ORACLE error. ORA-03114: not connected
to ORACLE
Review your error messages for the cause of the error. (=<POINTER>)
_ 3 _
Routine FDPCRQ encountered an ORACLE error. ORA-03113: end-of-file on
communication channel
Review your error messages for the cause of the error. (=<POINTER>)
APP-FND-01564: ORACLE error 1041 in fdudat
Cause: fdudat failed due to ORA-01041: internal error. hostdef extension doesn't exist.
The SQL statement being executed at the time of the error was: &SQLSTMT and was executed from the file &ERRFILE.
List of errors encountered:
_ 1 _
Routine AFPCAL received failure code while parsing or running your
concurrent program CPMGR
Review your concurrent request log file for more detailed information.
Make sure you are passing arguments in the correct format.
The PROPTRN_1002@PROPTRN internal concurrent manager has terminated with status 1 - giving up. -
Airport Extreme regularly goes offline
We have our computer network online using an airport extreme (about 4 years old), we also have an airport express that helps to extend our network. We have an issue with the airport regularly dropping our internet signal, basically it just goes offline for no apparent reason and due to the history I'm pretty sure it is the airport and not our cable modem.
To correct this problem I usually just unplug the airport and unplug the cable modem and this usually resolves the problem. I've had this problem in the past, and it got to the point where this no longer fixed the problem. I brought the airport to a mac genius bar and they reset it back to factory settings and that resolved the problem for about two months. Now the problem is back again, and the airport tends to drop our signal 5+ times a day (it would probably do it more, but we're not home for a good portion of the day to reset it).
As far as I know the airport is up to date on its firmware (v5.7), airport express v6.3. Any help you can give to correct this really annoying problem would be greatly appreciated.The usual cause for this is RF interference from other devices operating at 2.4 GHz. If you can't remove the devices causing interference, you can change the channel used by the AirPort Extreme base station (AEBS) until you find a channel which works better or you run out of channels.
KB 58543, AirPort: Potential sources of interference -
HP LaserJet 600 M602 printer goes offline every night
Hi,
I have a HP LaserJet 600 M602 CE991A printer on a wired network. I have quite a few other printers on the network as well and do not show me this kind of behavior.
But for some reason, this printer, from as soon as I bought it, goes offline every time from around 5.20-5.30pm to around 8.30pm. I have a ping tester running as I am trying to figure out what's going on and I got 100% drop every night for that time period.
I looked to see if there was a setting that puts this device to sleep or so but no, I cant find anything. I have tried with the energy setting sleep mode on or off, wake up events to trigger a wake up call to the printer but no luck.
Firmware Bundle Version3.2.5
Firmware Revision2302908_435019
Firmware Date Code20140529
I am out of options, in our other locations, we have sam printer but a CE993A models and they do not show this kind of behavior at all.
I am at a deadlock here.Hi @Halan ,
I see by your post that you aren't able to print when the laptop isn't in the same area as the printer. I would like to help you out today.
What is the distance of the printer and the Laptop when the printer goes offline?
Try these steps to see if it will resolve the issue.
'Printer is offline' Message Displays on the Computer and the HP Printer Will Not Print.
What operating system are you using? How to Find the Windows Edition and Version on Your Computer.
If you need further assistance, just let me know.
Have a nice day!
Thank You.
Please click “Accept as Solution ” if you feel my post solved your issue, it will help others find the solution.
Click the “Kudos Thumbs Up" on the right to say “Thanks” for helping!
Gemini02
I work on behalf of HP -
Files goes offline if I import them in AfterEffects
I made my edit in FCPX and now I need to do some work on the used clips in After Effects, so I import them in AE but they immediately goes offline in FCPX. Why ?
What is the correct procedure to edit files in the timeline with an external editor ?
ThanksAE tages the metadata in the file and FCP can't find it in the directory any more.
Depends on the external editor. You can't with AE.
Maybe you are looking for
-
Can I have more than one user account on itunes?
My wife and I currently have a laptop each, and so I have my itunes account through my macbook and my wife has hers through her macbook. We are looking at getting a Mac Mini, as my wife's macbook is on it's last legs, and we would like to have both i
-
Full year Total in previous year
I use the ago function and I want the full year amount of the previous year. Example when a have my amount for period 4 in year 2010; I want to see the full year amount for 2009 in another column. Somebody has a solution, Thanks
-
Hi, Following are my table structure. Table Name : CODE ID, Code, Level, Details [ Note : ID is Auto generated by sequence] I have a job that runs everyday to hit the remote view to pull the data into CODE table. View structure and Sample data in the
-
Standby from 11.2.0.2 --- 11.2.0.4
Primary ---- Windows2008 64bit, 11.2.0.2 Physical Standby ---- Windows2012 64bit 11.2.0.4. Can we set-up a standby between these 2 boxes? If not possible what is the best way to clone a database from 11.2.0.2 to 11.2.0.4. Appreciate your help on this
-
I need to download Adobe flash player to Windo ws 7. I need to have Internet Explorer. I only can find IE64 or