Database hangs due to full archive dest

Hi All;
Today Morning my database went in Hang status as my archive location of the production database was full.
there was 30g Space avaliable on the on archiveloation last night.
When we checked we found around 360 logs were generated between 6 to 6.30 & location went full, Only 20 logs get generated during this time daily.
We are checking if any change was made in the night jobs yestarday & also the report of that period.
Is there is any other way to find out why more archives generated then normal
Database =10g
OS =AIX 64 bit
Thanks,

hi,
whithout redo log generation archivelog not generated. so without any DML operation as told by SB thereis not possible generation of logs.
so there might be some reason. you have mention all the possibility to check .. so its in ur hand..
schedule a backup to backup archivelogs and delete the old one..
regards,
Deepak

Similar Messages

Duplicate target database - is failed due to missing archive log

Hi,
"duplicate target database to " is failed due to required archive log is not found on tape.
After mounting the right tape, how to proceed , please suggest
ERROR:-->
RMAN>
connect catalog *******
connect auxiliary /
connect target ******
Run {
set until time '16-NOV-2008 23:50';
allocate auxiliary channel t1 type 'sbt_tape' parms ....
duplicate target database to mydb;
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03002: failure of Duplicate Db command at 11/30/2008 10:27:00
RMAN-03015: error occurred in stored script Memory Script
ORA-19501: read error on file "orcl_ARCHIVES_BACKUP_0811160110_u0jvq7vt_1
_1", blockno 1 (blocksize=512)
ORA-27190: skgfrd: sbtread2 returned error
ORA-19511: Error received from media manager layer, error text:
ANS1314E (RC14) File data currently unavailable on server
Recovery Manager complete.
Thanks In Advance,

This is basically not a RMAN problem,but a media management issue,which has to be addressed to the TSM staff:
ANS1314E
File data currently unavailable on server
Explanation:
The file data is currently unavailable on the server. A retrieve or restore operation was attempted. Possible causes are:
Data was corrupted at the server
Server found a read error
File is temporarily involved in a reclaim operation at the server
Server requested a tape volume that was marked unavailable.
System action:
Processing stopped.
User response:
Retry the operation. If the problem continues, see your system administrator to determine the problem from the server console or the activity log. Check whether any requests were made for a tape volume that was unavailable. A tape volume may be marked unavailable if prior read errors were encountered or the volume is checked out of the tape library.
Werner

Primary and Physical Standby databases hanging on sqlplus shell command...

I am primarily a java developer that has had the task of oracle dba thrust upon me due to circumstances that are beyond my control. In the QA lab we have two oracle 10 g release 1 instances running. They set up in a dataguard configuration: one is the primary and the other is in a physical standby.
Last week I noticed that the disk space on the primary database was at 100%. After some investigation I discovered that a good deal of the files taking up space on the box were log files and the best solution that I could think of would be to delete all old archive files. So I deleted the old archive files that were at least two weeks old using RMAN.
During this week the database started to shutdown automatically. The QA associate restarted the database twice using the ‘STARTUP’ command from sqlplus. Additionally, the standby database began to have issues: when login in to sqlplus the application would just hang: no ‘SQL” prompt or anything. Finally today the primary database has also begun to hang in a similar manner.
I have looked at many of the trace files and alert logs but haven’t been able to really discern what the real problem is with the database and the proper rectification for the database. Does anyone have a clue into what is going on? If someone could even point me in the right direction it would be greatly appreciated.

Guessing that your flash recovery area is full, archiving is stopped so the instance appears to hang.
Do you see messages like so in the alert log:
You have following choices to free up space from flash recovery area:
1. Consider changing RMAN RETENTION POLICY. If you are using Data Guard,
   then consider changing RMAN ARCHIVELOG DELETION POLICY.
2. Back up files to tertiary device such as tape using RMAN
   BACKUP RECOVERY AREA command.
3. Add disk space and increase db_recovery_file_dest_size parameter to
   reflect the new space.
4. Delete unnecessary files using RMAN DELETE command. If an operating
   system command was used to delete files, then use RMAN CROSSCHECK and
   DELETE EXPIRED commands.
************************************************************************

Shutting down database hangs

Dear Gurus,
I m facing a database hang issue while performing the scheduled offline backup.I m able to take the online backup.When the backup starts , the database starts to shutdown.When checked in the log of backup it shows in tail as shutting down database.When checked for user trace , it shows message as "Attempting to kill pid xxxxxxx" and keeps on retrying for n no. of times.Then I have to manually kill the backup and restart the application.Then again try for an offline backup.This time it happens smoothly.This activity we did for couple of weeks .But now from past 3 days even after restarting the backup, it goes to hang mode.In other words unable to perform the backup activity.
The message had been raised to SAP from almost 15 days at very high.They every time ask the logs , and say that the data in log is nt providing much info for analysing the issue or cause of hang.Also enabled the traces of 10400 for trace level 1 ,10 some more traces also.But still the output is not helping even them to analyse the root cause.
Its my observation that this issue is occuring only on ABAP+JAVA systems(CRM &BIW)not in ECC.We are on oracle database 10.2.0.0.4 with latest patch set as suggested by SAP for the same issue.
This issue is h
Please suggest me at the earliest.As need to resolve this at the earliest.
Bye.
Amit

Hi,
No "archive process shutdown avoided" message is there in the log file.
In usertrace i get messages as mentioned below.
bslcrmprddb #more bcp_ora_1257502.trc
Dump file /oracle/BCP/saptrace/usertrace/bcp_ora_1257502.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, Data Mining and Real Application Testing options
ORACLE_HOME = /oracle/BCP/102_64
System name:    AIX
Node name:      bslcrmprddb
Release:        3
Version:        5
Machine:        00C6C4024C00
Instance name: BCP
Redo thread mounted by this instance: 1
Oracle process number: 0
Unix process pid: 1257502, image: oracle@bslcrmprddb
2009-06-05 08:01:36.875
Oracle Instance Startup operation failed. Another process may be attempting to startup or shutdown
Failed to acquire instance startup/shutdown serialization primitive
bslcrmprddb #more bcp_ora_2453676.trc
Dump file /oracle/BCP/saptrace/usertrace/bcp_ora_2453676.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, Data Mining and Real Application Testing options
ORACLE_HOME = /oracle/BCP/102_64
System name:    AIX
Node name:      bslcrmprddb
Release:        3
Version:        5
Machine:        00C6C4024C00
Instance name: BCP
Redo thread mounted by this instance: 0 <none>
Oracle process number: 0
Unix process pid: 2453676, image: oracle@bslcrmprddb
2009-06-06 07:04:22.494
Dynamic strand is set to TRUE
Running with 2 shared and 88 private strand(s). Zero-copy redo is FALSE
bslcrmprddb #more bcp_ora_1495266.trc
Dump file /oracle/BCP/saptrace/usertrace/bcp_ora_1495266.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, Data Mining and Real Application Testing options
ORACLE_HOME = /oracle/BCP/102_64
System name:    AIX
Node name:      bslcrmprddb
Release:        3
Version:        5
Machine:        00C6C4024C00
Instance name: BCP
Redo thread mounted by this instance: 1
Oracle process number: 213
Unix process pid: 1495266, image: oracle@bslcrmprddb (TNS V1-V3)
ACTION NAME:() 2009-06-06 03:00:22.223
MODULE NAME:(sqlplus@bslcrmprddb (TNS V1-V3)) 2009-06-06 03:00:22.223
SERVICE NAME:(SYS$USERS) 2009-06-06 03:00:22.223
SESSION ID:(517.13229) 2009-06-06 03:00:22.223
ksukia: Starting kill, force = 0
ksukia: killed 274 out of 274 processes.
ksukia: Starting kill, force = 0
ksukia: killed 0 out of 2 processes.
ksukia: Starting kill, force = 0
ksukia: killed 0 out of 1 processes.
ksukia: Starting kill, force = 0
ksukia: killed 0 out of 1 processes.
ksukia: Starting kill, force = 0
Please suggest.
Regards,
Amit

Database Hanging

Hi,
I have Oracle database 10g my database is hanging and i want to check what locks occur on which table how can i work on this database hanging process.Kindly help...because i am new for this i need good procedure to face this problem..

If db hangs there could be a lot of possibilities..
eg. no more space for archive log or datafiles
Locks on table are different. You can look on alertlog and start investigating..

Details of database and status information of archived object can't be seen

Hi
I am trying to archive the ODS-0FIAP_O03 and the job overview(T.Code SARA) shows the status as finished. Attached screenshots show the statistics of written data objects and active records in spool. However when we display statistics(T.Code SARA ) , I do not see any details of database and status information of archived object.Please suggest where could the error be.
Also let me know if you want to see the related screenshots.
Will award high points.Thanks
Reenu Lodha

This could be an issue due to program error.
Would you provide me the archiving object so as to find OSS notes if available.
This is a common issue for most of the archiving objects..we do generally miss out the statistics..and that is after the modification in the program, this is ok.

DBCA can not use ASM for database storage due to following reason: Could no

Hi
I've a recently installed RAC11gR2(11.2.0.3) on HP-UX
I installed Grid Infrastructure with grid user:
Node1: # id grid
uid=1100(grid) gid=1000(oinstall) groups=1031(dba),1021(asmdba)
Node2: # id grid
uid=1100(grid) gid=1000(oinstall) groups=1031(dba),1021(asmdba)
I installed the Oracle Server with oracle user:
Node1: # id oracle
uid=1101(oracle) gid=1000(oinstall) groups=1031(dba),1021(asmdba),1033(oper)
Node2: # id oracle
uid=1101(oracle) gid=1000(oinstall) groups=1031(dba),1021(asmdba),1033(oper)
All related Grid Infrastructure is functioning well in both nodes:
$ crs_stat -t
Name Type Target State Host
ora.DATA.dg ora....up.type ONLINE ONLINE node03
ora.FRA.dg ora....up.type ONLINE ONLINE node03
ora....ER.lsnr ora....er.type ONLINE ONLINE node03
ora....N1.lsnr ora....er.type ONLINE ONLINE node04
ora.asm ora.asm.type ONLINE ONLINE node03
ora.cvu ora.cvu.type ONLINE ONLINE node04
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE node03
ora.oc4j ora.oc4j.type OFFLINE OFFLINE
ora.ons ora.ons.type ONLINE ONLINE node03
ora.scan1.vip ora....ip.type ONLINE ONLINE node04
ora....SM1.asm application ONLINE ONLINE node03
ora....03.lsnr application ONLINE ONLINE node03
ora....d03.gsd application OFFLINE OFFLINE
ora....d03.ons application ONLINE ONLINE node03
ora....d03.vip ora....t1.type ONLINE ONLINE node03
ora....SM2.asm application ONLINE ONLINE node04
ora....04.lsnr application ONLINE ONLINE node04
ora....d04.gsd application OFFLINE OFFLINE
ora....d04.ons application ONLINE ONLINE node04
ora....d04.vip ora....t1.type ONLINE ONLINE node04
$
The ASM instance are running well in both nodes
Connected with oracle user, the listener has registered perfectly the ASM instance in each node:
$
$ lsnrctl status
LSNRCTL for HPUX: Version 11.2.0.3.0 - Production on 16-MAY-2012 15:41:06
Copyright (c) 1991, 2011, Oracle. All rights reserved.
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
STATUS of the LISTENER
Alias LISTENER
Version TNSLSNR for HPUX: Version 11.2.0.3.0 - Production
Start Date 16-MAY-2012 15:24:19
Uptime 0 days 0 hr. 16 min. 47 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /u01/app/11.2.0/grid/network/admin/listener.ora
Listener Log File /u01/app/grid/diag/tnslsnr/node03/listener/alert/log .xml
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=16.0.0.133)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=16.0.0.136)(PORT=1521)))
Services Summary...
Service "+ASM" has 1 instance(s).
Instance "+ASM1", status READY, has 1 handler(s) for this service...
The command completed successfully
$
$
DATA & FRA disk group are created:
$
$ echo $ORACLE_SID
+ASM1
$
$ asmcmd
ASMCMD>
ASMCMD> ls -lt
State Type Rebal Name
MOUNTED EXTERN N DATA/
MOUNTED EXTERN N FRA/
ASMCMD>
ASMCMD>
The big issue is... that the DBCA can not see the diskgroups. When I choose ASM Storage it can not see them. It shows the chart in blank and if i try to write the disk group, so the following message appears: can not use ASM for database storage due to following reason: Could not connect to ASM due to following error: ORA-01034 ORACLE not available
What can be passing in this case... ?
Thanks in advance

Thanks both
Really the problem initially was because of this:
[INS-06006] Passwordless SSH connectivity not set up between the following node(s): [node1, node2]. CVU may reports "PRVF-4007 : User equivalence check failed for user "user"" for same error
and I had to install node1 first and after node2 manually and perhaps for this the product was not well linked.
I resolved the problem establishing the keys with the wizard and after copying the following files from node1 to node2
/home/grid/.ssh -------> /home/grid/.ssh
authorized_keys
known_hosts
This is the procedure if you run the wizard at the node1.
The problem is that the wizard creates the keys incompletely...
Thanks

How to reduce buffer busy waits, session hanging due to buffer busy waits

Hi,
How to reduce buffer busy waits, session hanging due to buffer busy waits.
Thanks,
Sathis.

When I see through enterprise manager I see lot of
tables with buffer busy waits.
Is there any way by table name we can check the
blocks info.
The simple way is to look at the SQL statement and corresponding table name?
P1=file#, P2=block#. You can extract segment name(table or index) using this info.
Query v$bh like following:
SQL> select file#, block#, class#, objd from v$bh where file# = P1 and block# = P2;
SQL> select object_name from all_objects where object_id = <objd>;See following doc:
http://download-west.oracle.com/docs/cd/B19306_01/server.102/b14237/dynviews_1051.htm
Or you can dump block:
SQL> alter system dump datafie <P1> block <P2>;Some excerpts from block dump:
scn: 0x07df.17e70782 seq: 0x01 flg: 0x04 tail: 0x07822301
frmt: 0x02 chkval: 0x61d0 type: 0x23=PAGETABLE SEGMENT HEADER
Map Header:: next 0x00000000 #extents: 1 obj#: 55881 flag: 0x10000000>
Can we do something at table level that will reduce
the waits.
Yes, some methods are known. But before thinking of that, you must verify which block class and which access are involved.
Typo... always. :(
Message was edited by:
Dion_Cho

Oracle 10g Database Hanging twice a day

My database server has 10g with MS 2003 server as OS.
Twice a day the database hangs and does disconnects all the users from local and remote locations.
Current SYSTEM tablespace has a size of 470 MB and is 98.86 in use, when I try to add another datafile as 'SYSTEM02.DBF' in the same path where other system data files are, I kept this operation running during weekends but datafile was not added.
Has it anything to do with the MS 2003 server no. of users.
Any other suggestions for SYSTEM Tablespace to be free.
Please reply.
Thanks
Ajaz Ahmed

Hi friends / sameer,
Sorry for the delay. Here is the attached alert.log file Since the data from foxpro was loaded into oracle on to oracle 10 g from 7th may the problem of database hanging started from the next day. I joined the organization on 22nd july.
Current SYSTEM tablespace has a size of 470 MB and is 98.86 in use, when I try to add another datafile as 'SYSTEM02.DBF' in the same path where other system data file is, it does not add. I kept this operation running during weekends but datafile was not added.
Has it anything to do with the MS 2003 server no. of users.
Any other suggestions for SYSTEM Tablespace to be free.
If you can get me your mail id then I can send the
attachment of alert.log file as [email protected] bounces back.
Thanks
Ajaz Ahmed

Oracle 8i database hangs for the same amount during JDBC calls.

Hi all,
I have a Oracle 8i database on solaris. The database hangs for exactly 61 seconds for a random jdbc call from my Java application, i mean there is no particular pattern or a JDBC call for which the database hangs. If i choose to wait for 61 seconds it returns the results from the database but if i try to access the database with another query(SQL Plus) the first query starts executing immediately. Is that a database configuration problem or some thing else.
And i also get some exceptions occasionally( Maximum Open Cursors exception). Are these two related?
Any feedback is appreciated.
Thanks
Hugo Victor

I have uninstalled Oracle 8i.
Removed all the services from Windows services by deleting corresponding registry entries and deleted the Oracle folder.
I have reinstalled Oracle 8i, this time i changed the name of global database to oracledb.
I channged the tnsnames.ora file from DevSuite appropriately as:
# tnsnames.ora Network Configuration File: C:\DevSuiteHome_1\network\admin\tnsnames.ora
# Generated by Oracle configuration tools.
EXTPROC_CONNECTION_DATA =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = mscserver)(PORT = 1521))
(CONNECT_DATA =
(SERVICE_NAME = ORACLEDB)
Still it can't login using scott/tiger authentication.
What may be the problem? Please help.
-Sameer

LABVIEW APPLICATION HANGS DUE TO INSUFICIENT MEMORY

I AM USING LABVIEW 7.1. I BUILD ONE APPLICATION. IN THAT APPLICATION I USED MSCOMM ACTIVEX FOR SERIAL COMMUNICATION TO MY PLC. ALSO I USED TOOLBAR , STATUS BAR ACTIVEX IN MY APPLICATION. IT WORKS OK. BUT AFTER SOME TIME SOFTWARE GET HANGS DUE TO INSUFFICIENT MEMORY. I FOUND THAT AFTER 3SECOND THAT EXE SIZE IN MEMORY GET INCREASED BY 4K. WHY DON'T KNOW. PLEASE TELL WHY MEMORY SIZED INCREASED.

How can we say why, without seeing your code ?
-Check if you open references and not closing them.
-Use "Performance and Memory" to see in which vi, the memory is increased

What to do when database hang

Hi all,
May I know what to do when database hangs after shutdown immediate command perform? Can I use kill process command to stop Oracle process?

Hello,
see documentation for details of immediate-clause:
http://download.oracle.com/docs/cd/B19306_01/server.102/b14231/start.htm#sthref589
You can do an shutdown abort instead, but then sql is terminated. You can read details here: http://download.oracle.com/docs/cd/B19306_01/server.102/b14231/start.htm#sthref595
Greets,
Hannibal

Database Hang Analysis

DB:11.2.0.3
OS :Linux 5
My database is in hung state now. I did the below steps
sqlplus -prelim '/as sysdba'
SQL*Plus: Release 11.2.0.3.0 Production on Thu Oct 24 08:18:17 2013
Copyright (c) 1982, 2011, Oracle. All rights reserved.
SQL> oradebug setmypid
Statement processed.
SQL> oradebug unlimit
Statement processed.
SQL> oradebug hanganalyze 3
Statement processed.
SQL> oradebug hanganalyze 3
Statement processed.
SQL> oradebug tracefile_name
/oemdwlk1/oracle/diag/rdbms/eioemd1/eioemd1/trace/eioemd1_ora_14132.trc
SQL> exit
Getting the below output in trace file
Processing Oradebug command 'hanganalyze 3'
===============================================================================
HANG ANALYSIS:
ERROR: Can not perform hang analysis dump without a process
state object and a session state object.
( process=(nil), sess=(nil) )
As per oracle doc How to Collect Diagnostics for Database Hanging Issues (Doc ID 452358.1).
Note: From 11.2.0.2 onwards, hanganalyze will not produce output under a sqlplus "preliminary connection" since it requires a process state object and a session state object. If a hanganalyze is attempted, the trace will output:
HANG ANALYSIS:
ERROR: Can not perform hang analysis dump without a process state object and a session state object.
( process=(nil), sess=(nil) )
Is something i am missing or there is some different steps.
===============================================================================

Level 3 --> will collect HANGANALYZE OUTPUT + DUMPS ONLY THE PROCESSES THOUGH TO BE IN HANG.
This many not be a case of process hang. So check with LEVEL 10 .
Still if you are getting the same error than , you need to contact oracle support.
Thanks,
<mod. action: blog ref. removed, please link to one of your blog entries when it's appropriate>
Message was edited by: Nicolas.Gasparotto

Oracle Database 11g Certified Master (Full) Exam To Begin Mid-2010

DBA Gurus: the Oracle Database 11g Certified Master (full) exam is on its way soon! http://bit.ly/dfvsI5

No - it means that the exam is now out of beta and is giving candidates immediate scoring and pass/fail status.

On performing continuous delete operation database hangs

Dear All,
On performing continuous delete operation , the instance on which delete operation is performed database hangs i.e it does not allows to make new connection and some times on alert log we get ORA-3136 error
Database version 10.2.0.3 , OS : HP-UXvi3
Regards

Refer this thread
ORA-3136 while performing bulk delete

Database hangs due to full archive dest

Similar Messages

Maybe you are looking for