RAC recovery

In a RAC environment, when we perform a RECOVERY. Does all the instance need to be shutdown? or only one instance?

Hello,
Yes it's possible
Here are some regular example
http://download.oracle.com/docs/cd/B19306_01/backup.102/b14191/rcmrecov.htm#BRADV159
And check this document
http://blogs.oracle.com/AlejandroVargas/gems/RMANBACKRECPRACTICE.pdf
Regards

Similar Messages

  • Question on Restore,Recovery from Image Copy in RAC

    version: 11.2.0.3
    Platform : AIX 6
    Found the following in
    http://www.oracleracexpert.com/2011_12_01_archive.html
    SYS@DBTEST>startup mount
    SYS@DBTEST>switch database to copy;
    SYS@DBTEST>Recovery the database;
    SYS@DBTEST>Alter database open;The author of the blog says
    "Please note that we didn’t restore backup from backup disk or media, we have pointed the database to backup. "
    So, how will this work for restores in RAC ? Because, after the 'switching' to a datafile which is now disk based only one of the instance will be able to acess that datafile. Right ?
    Even if we be cross-mount the backup location to both nodes , the datafile will still not be in the ASM diskgroup where it was originally stored ?

    The blog is "oracleracexpert" but the notes on Incrementally Updated backups at http://www.oracleracexpert.com/2011/12/rman-incrementally-updated-backups.html are NOT necessarily for RAC.
    The backup is done to '/oradata/rman/backup.%u' which may not be a filesystem accesible by all the notes.
    If you really want to implement Incrementally Updated Backups with the ability to SWITCH DATABASE TO COPY for a RAC environment, your backup destination must
    (a) asupported Cluster FileSystem (*not* Oracle ACFS which is not to be used for Database Files)
    OR
    (b) an ASM DiskGroup accessible by all the nodes.
    Hemant K Chitale

  • Related to recovery in Physical standby database in RAC

    In Physical Standby database all instance involved in recovery processes or any one instance will be their in in recovery mode
    If is like this another instance will be for high availabily can any one in forum explain me it will be help full

    With your Primary database being RAC, the Physical Standby does not have to be RAC, although, obviously it would be preferred to have scalability as required at a DR site.
    Whether your Standby is RAC or non-RAC, the automatic Recovery that is done at the Standby is done by one instance only. It would be applying the ArchiveLogs from all the threads (i.e. instances) of the Primary.
    Database Recovery is always done by a single instance.
    Hemant K Chitale
    http://hemantoracledba.blogspot.com

  • Transaction Recovery within an Oracle RAC environment

    Good evening everyone.
    I need some help with Oracle 11gR1 RAC transaction-level recovery issues. Here's the scenario.
    We have a three(3) node RAC Cluster running Oracle 11g R1. The Web UI portion of the application connects through WLS 9.2.3 with connection pooling set. We also have a command-line/SQL*Developer component that uses a TNSNAMES file that allows for both failover and load balancing. Within either the UI or the command line portion of the application, a user can run a process by which invokes one or more PL/SQL Packages to be invoked. The exact location of the physical to the database is dependent on which server is chosen from either the connection pooling or the TNSNAMES.ORA Load Balancing option.
    In the normal world, the process executes and all is good. The status of the execution of this process is updated by the Packages once completed. The problem we are encountering is when an Oracle Instance fails. Here's where I need some help. For Application-level (Transaction Level) recovery, the database instances are first recovered by the database background proccesses and then Users must determine which processes were in flight and either re-execute them (if restart processing is part of the process) or remove any changes and restart from scratch. Given that the database instance does not record which processes are "in flight" it is the responsibility of the application to perform its own recovery processing. Is this still true?
    If an instance fails, are "in flight" transactions/connections moved to other instances in the Grid/RAC environment? I don't think this is possible but I don't remember if this was accomplished through a combination of Application and Database Server features that provide feedback between each other. How is the underlying application notified of the change if such an issue occurs? I remember something similar to this in older versions of Oracle but I cannot remember what it was callled.
    Any help or guidance would be great as our client is being extremely difficult in pressing this issue.
    Thanks in advance
    Stephen Karniotis
    Project Architect - Compuware
    [email protected]
    (248) 408-2918

    You have not indicated whether you are using TAF or FCF ... that would be the first place to start.
    My recommendation would be to let Oracle roll back the database changes and have the application resubmit the most recent work.
    If the application knows what it did since the last "COMMIT" then you should be fine with the possible exception of variables stored
    in packages. Depending on packages retaining values is an issue best solved with PRAGMA SERIALLY_REUSABLE ... in other words
    not using the retention feature.

  • Manual Recovery of  RAC

    Hi,
    I am cloning from 10g RAC to single node. For this, I am trying to recover from the
    Hot backup of RAC database.
    I have take the archives from both the nodes, while backup was in progress.
    But during recovery, I am getting messed up with Thread1 and Thread 2 archives.
    Is there any funda behind RAC manual recovery ??
    Thanks
    Sunil.

    What do you mean by "I am getting messed up with Thread1 and Thread 2 archives." ?
    The THREAD# should be part of the log_archive_format so that you can identify the archivelogs of each thread.
    At the RECOVER DATABASE session, if Oracle starts from Thread#1, it can identify the archivelog for the Thread#1 file. However, for the first archivelog from Thread#2, it may not be be able to identify the archivelog file name but it DOES provide you the expected Sequence#. So, you can enter the archivelog from Thread#2 corrresponding to that Sequence#. Subsequently, Oracle should be able to identify and apply archivelogs from both Threads.

  • Reasonable time for instance recovery in RAC

    Hi,
    We're running with Oracle RAC configuration. The configuration is 2 instances one active one passive and we simulate failure of the active instance under load of ~1500 transactions per second.
    In our tests we're seeing that between failure time until 2nd passive instance is taking responsibility it might take more than 1 or 2 minutes.
    The question is: Is this behavior is reasonable? Fine - what SLA we can expect in those scenarios? other scenarios?
    Where can we read about this in details.
    Thank you,
    Moshe

    user12187426 wrote:
    Harish Kumar Kalra wrote:
    SLA depends on your business requirement but wrt to recovery of the second instance, this looks reasonable based on 1500 active transactions and induced failure on first instance. Look at FAST_START_MTTR_TARGET parameter to tune this further.
    Ta
    I am not agree with this, 1500 transaction per second if you lost it in 2 mins that means 180000 transaction. If one transaction worth of $1 then you have loose $180000
    and I don't think FAST_START_MTTR_TARGET, this will make checkpoint to occur more frequent hence make overall performance degrated
    ThxYes, but if you're starting to calculate in that kind of numbers, then I'm wondering why they use an active/passive config.
    Regards
    FJFranken

  • Parallel recovery on DR on RAC

    Hi all,
    We have a 2 node DR on 2 node RAC. Just wanted to know if it is possible to do recovery from both the nodes parallel, I mean node 1 will apply its archive and node 2 prod nodes 2 archive.
    If this is possible how is that and if its not why?
    Regards
    ID

    Hello;
    Have you looked at:
    D.1.1 Setting Up a Multi-Instance Primary with a Single-Instance Standby
    Data Guard Concepts and Administration 11g Release 2 (11.2) E25608-04
    If yes, what would parallel recovery give you?
    I have never tried to do this setup but the main issues I would see it the second standby instance would not be available
    if something happened to the first standby instance.
    By using only one instance for apply it's much simplier to keep track of the redo coming from the two primary instances.
    If you don't use a standby as a reader database it does not have a lot of load on it. Generally if you check the alert
    log there are several minutes between the "waiting for log..." messages.
    Great question!
    Best Regards
    mseberg

  • RAC at Disaster Recovery site?

    HI
    I am having two node RAC production database right now. Now i want to implement disaster recovery using oracle data guard and for that also i am planning to go for 2 node RAC. Is it possible to implement two node RAC at disaster recover site. If yes then please send me link for the document that is related to this implementation.
    DB Version:10.2.0.1
    OS:LINUX
    Thank You....

    hi,
    yes its similar to normal stanby crearttion
    http://www.oracle.com/technology/deploy/availability/pdf/MAA_WP_10g_RACPrimaryRACPhysicalStandby.pdf
    http://www.dba-oracle.com/real_application_clusters_rac_grid/single_instance.htm
    regards,
    Deepak

  • Oracle 11gR2 RAC Backup & Recovery

    I am new to Oracle RAC, I have installed Oracle 11gR2 RAC (2 node) on HP-UX with ASM, configured FRA location on ASM.
    Now I would like to configure RMAN backup, Can someone give some idea or document to setup RMAN backup for Oracle 11gR2 RAC.
    - Mano

    ManoRangasamy wrote:
    I am new to Oracle RAC, I have installed Oracle 11gR2 RAC (2 node) on HP-UX with ASM, configured FRA location on ASM.
    Now I would like to configure RMAN backup, Can someone give some idea or document to setup RMAN backup for Oracle 11gR2 RAC. There won't be any different settings for RMAN for RAC except for where and how you would be configuring the Archive logs and place your backups. Both, ideally speaking, should be on the shared storage like ASM but there are other combinations also possible. Review the above given links for the same. That should provide a good starting point.
    Aman....

  • OCR recovery/restore from backup or ocrmirror 11gr2 RAC

    Say i have an OCR and OCRMIRROR on asm diskgroup CRS_OCR ,CRS_OCRMIRROR diskgroups with external redundancy.If i lost one of the diskgroup say CRS_OCR how can i copy over from the OCRMIRROR to restore the primary OCR?or how can i go about restoring the primary ocr ?Please any help on this would be a helpful...
    Thanks
    Edited by: user9097501 on Oct 18, 2010 6:28 AM
    Edited by: user9097501 on Oct 18, 2010 6:32 AM

    Hi,
    Loss of the Oracle Cluster Registry file affects the availability of RAC and Cluster Ready Services.
    The OCR file can be restored from a physical backup that is automatically created or from an export file that is manually created by using the ocrconfig tool.
    Additionally, starting with Oracle Database 10g Release 10.2, Oracle can optionally mirror the OCR so that a single OCR device failure can be tolerated.
    Check This..
    *How to restore ASM based OCR after complete loss of the CRS diskgroup [ID 1062983.1]*
    Regards,
    Levi Pereira

  • Oracle RAC node recovery

    Hi,All,
    Oracle 10.2.0.4 soalris 10 sun cluster. 2 nodes
    Node 1's OS system and Oracle software was delete by mis-action.
    how can I recovery Node 1 after re-install OS.
    Thanks
    Simon Lai

    Nodes are not databases.
    Instances are not databases.
    Databases are recovered not memory processes and caches.

  • RAC RMAN BACKUP Recovery FOR  Oracle APPS Application

    Hi,
    We have an Application which is similar to Oracle APPs application and We have a RAC Database at Backend.
    As I am a Oracle RAC DBA and never worked as an Oracle apps DBA.
    Each Week or month We have to deploy a patch on Our Database which are kind of sql changes to Database and before we applying we need to backup our Database.
    I am very comfortable while applying patches on Single instance Database:-
    I Usually shutdown my database and backing up My Database(Conistent\cold Backup) before applying patch.
    and I have a Flash back on both option I am having for my Database.
    Problem:-
    But in Production I have RAC Database, on which I already configured Hot Backup.
    FlashBackup Feature is there with me, but Not reliable.
    I want cold backup along with my existing hot backup, and want to restore same if something goes wrong.
    Since ASM is configured so we have only option RMAN backup.
    IF possible kindly Share your knowledge and Experience of your to handle Such Problem.

    Sir,
    RMAN is already configured for backing up database online.
    My only intention is to have cold or consistent backup before applying application patch, So that at the time of crisis I will resotre my Cold/Conistent backup.
    Because I am using 11gr2 RAC with ASM, so only option is there for me to use rman as backup tool.
    But I never tried to Have Cold backup in RAC environment in my previous jobs, and I am new to this Oracle APPS DBA technology. So Here I am looking for a Strategy that Normally oracle apps dba use while applying patch to Oracle Database and kind of backup strategy they use.
    Regards
    Gaurav

  • Error in Creation of Dataguard for RAC

    My pfile of RAC looks like:
    RACDB2.__large_pool_size=4194304
    RACDB1.__large_pool_size=4194304
    RACDB2.__shared_pool_size=92274688
    RACDB1.__shared_pool_size=92274688
    RACDB2.__streams_pool_size=0
    RACDB1.__streams_pool_size=0
    *.audit_file_dest='/u01/app/oracle/admin/RACDB/adump'
    *.background_dump_dest='/u01/app/oracle/admin/RACDB/bdump'
    *.cluster_database_instances=2
    *.cluster_database=true
    *.compatible='10.2.0.1.0'
    *.control_files='+DATA/racdb/controlfile/current.260.627905745','+FLASH/racdb/controlfile/current.256.627905753'
    *.core_dump_dest='/u01/app/oracle/admin/RACDB/cdump'
    *.db_block_size=8192
    *.db_create_file_dest='+DATA'
    *.db_domain=''
    *.db_file_multiblock_read_count=16
    *.db_file_name_convert='+DATA/RACDB','+DATADG/RACDG'
    *.db_name='RACDB'
    *.db_recovery_file_dest='+FLASH'
    *.db_recovery_file_dest_size=2147483648
    *.dispatchers='(PROTOCOL=TCP) (SERVICE=RACDBXDB)'
    *.fal_client='RACDB'
    *.fal_server='RACDG'
    RACDB1.instance_number=1
    RACDB2.instance_number=2
    *.job_queue_processes=10
    *.log_archive_config='DG_CONFIG=(RACDB,RACDG)'
    *.log_archive_dest_1='LOCATION=+FLASH/RACDB/ VALID_FOR=(ALL_LOGFILES,ALL_ROLES) DB_UNIQUE_NAME=RACDB'
    *.log_archive_dest_2='SERVICE=RACDG VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=RACDG'
    *.log_archive_dest_state_1='ENABLE'
    *.log_archive_dest_state_2='DEFER'
    *.log_archive_format='%t_%s_%r.arc'
    *.log_file_name_convert='+DATA/RACDB','+DATADG/RACDG'
    *.open_cursors=300
    *.pga_aggregate_target=16777216
    *.processes=150
    *.remote_listener='LISTENERS_RACDB'
    *.remote_login_passwordfile='exclusive'
    *.service_names='RACDB'
    *.sga_target=167772160
    *.standby_file_management='AUTO'
    RACDB2.thread=2
    RACDB1.thread=1
    *.undo_management='AUTO'
    RACDB2.undo_tablespace='UNDOTBS2'
    RACDB1.undo_tablespace='UNDOTBS1'
    *.user_dump_dest='/u01/app/oracle/admin/RACDB/udump'
    My pfile of Dataguard Instance in nomount state looks like:
    RACDG.__db_cache_size=58720256
    RACDG.__java_pool_size=4194304
    RACDG.__large_pool_size=4194304
    RACDG.__shared_pool_size=96468992
    RACDG.__streams_pool_size=0
    *.audit_file_dest='/u01/app/oracle/admin/RACDG/adump'
    *.background_dump_dest='/u01/app/oracle/admin/RACDG/bdump'
    ##*.cluster_database_instances=2
    ##*.cluster_database=true
    *.compatible='10.2.0.1.0'
    ##*.control_files='+DATA/RACDG/controlfile/current.260.627905745','+FLASH/RACDG/controlfile/current.256.627905753'
    *.core_dump_dest='/u01/app/oracle/admin/RACDG/cdump'
    *.db_block_size=8192
    *.db_create_file_dest='+DATADG'
    *.db_domain=''
    *.db_file_multiblock_read_count=16
    *.db_file_name_convert='+DATADG/RACDG','+DATA/RACDB'
    *.db_name='RACDB'
    *.db_recovery_file_dest='+FLASHDG'
    *.db_recovery_file_dest_size=2147483648
    *.dispatchers='(PROTOCOL=TCP) (SERVICE=RACDGXDB)'
    *.FAL_CLIENT='RACDG'
    *.FAL_SERVER='RACDB'
    *.job_queue_processes=10
    *.LOG_ARCHIVE_CONFIG='DG_CONFIG=(RACDB,RACDG)'
    *.log_archive_dest_1='LOCATION=+FLASHDG/RACDG/ VALID_FOR=(ALL_LOGFILES,ALL_ROLES) DB_UNIQUE_NAME=RACDG'
    *.log_archive_dest_2='SERVICE=RACDB VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=RACDB'
    *.LOG_ARCHIVE_DEST_STATE_1='ENABLE'
    *.LOG_ARCHIVE_DEST_STATE_2='ENABLE'
    *.log_archive_format='%t_%s_%r.arc'
    *.log_file_name_convert='+DATADG/RACDG','+DATA/RACDB'
    *.open_cursors=300
    *.pga_aggregate_target=16777216
    *.processes=150
    ##*.remote_listener='LISTENERS_RACDG'
    *.remote_login_passwordfile='exclusive'
    SERVICE_NAMES='RACDG'
    sga_target=167772160
    standby_file_management='auto'
    undo_management='AUTO'
    undo_tablespace='UNDOTBS1'
    user_dump_dest='/u01/app/oracle/admin/RACDG/udump'
    DB_UNIQUE_NAME=RACDG
    and here is what I am doing on the standby location:
    [oracle@dg01 ~]$ echo $ORACLE_SID
    RACDG
    [oracle@dg01 ~]$ rman
    Recovery Manager: Release 10.2.0.1.0 - Production on Tue Jul 17 21:19:21 2007
    Copyright (c) 1982, 2005, Oracle. All rights reserved.
    RMAN> connect auxiliary /
    connected to auxiliary database: RACDG (not mounted)
    RMAN> connect target sys/xxxxxxx@RACDB
    connected to target database: RACDB (DBID=625522512)
    RMAN> duplicate target database for standby;
    Starting Duplicate Db at 2007-07-17 22:27:08
    using target database control file instead of recovery catalog
    allocated channel: ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: sid=156 devtype=DISK
    contents of Memory Script:
    restore clone standby controlfile;
    sql clone 'alter database mount standby database';
    executing Memory Script
    Starting restore at 2007-07-17 22:27:10
    using channel ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: starting datafile backupset restore
    channel ORA_AUX_DISK_1: restoring control file
    channel ORA_AUX_DISK_1: reading from backup piece /software/backup/ctl4.ctl
    channel ORA_AUX_DISK_1: restored backup piece 1
    piece handle=/software/backup/ctl4.ctl tag=TAG20070717T201921
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:00:23
    output filename=+DATADG/racdg/controlfile/current.275.628208075
    output filename=+FLASHDG/racdg/controlfile/backup.268.628208079
    Finished restore at 2007-07-17 22:27:34
    sql statement: alter database mount standby database
    released channel: ORA_AUX_DISK_1
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03002: failure of Duplicate Db command at 07/17/2007 22:27:43
    RMAN-05501: aborting duplication of target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/undotbs2.265.627906771 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/example.264.627905917 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/users.259.627905395 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/sysaux.257.627905385 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/undotbs1.258.627905395 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/system.256.627905375 conflicts with a file used by the target database
    RMAN>
    Any help to clear this error will be apprecited.......
    Message was edited by:
    Bal
    null

    Hi
    Thanks everybody for helping me on this issue...........
    As suggested, I had taken the parameter log_file_name_convert and db_file_name_convert out of my RAC primary database but still I am getting the same error.
    Any help will be appriciated..............
    SQL> show parameter convert
    NAME TYPE VALUE
    db_file_name_convert string
    log_file_name_convert string
    SQL>
    oracle@dg01<3>:/u01/app/oracle> rman
    Recovery Manager: Release 10.2.0.1.0 - Production on Wed Jul 18 17:07:49 2007
    Copyright (c) 1982, 2005, Oracle. All rights reserved.
    RMAN> connect auxiliary /
    connected to auxiliary database: RACDB (not mounted)
    RMAN> connect target sys/xxx@RACDB
    connected to target database: RACDB (DBID=625522512)
    RMAN> duplicate target database for standby;
    Starting Duplicate Db at 2007-07-18 17:10:53
    using target database control file instead of recovery catalog
    allocated channel: ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: sid=156 devtype=DISK
    contents of Memory Script:
    restore clone standby controlfile;
    sql clone 'alter database mount standby database';
    executing Memory Script
    Starting restore at 2007-07-18 17:10:54
    using channel ORA_AUX_DISK_1
    channel ORA_AUX_DISK_1: starting datafile backupset restore
    channel ORA_AUX_DISK_1: restoring control file
    channel ORA_AUX_DISK_1: reading from backup piece /software/backup/ctl5.ctr
    channel ORA_AUX_DISK_1: restored backup piece 1
    piece handle=/software/backup/ctl5.ctr tag=TAG20070718T170529
    channel ORA_AUX_DISK_1: restore complete, elapsed time: 00:00:33
    output filename=+DATADG/racdg/controlfile/current.275.628208075
    output filename=+FLASHDG/racdg/controlfile/backup.268.628208079
    Finished restore at 2007-07-18 17:11:31
    sql statement: alter database mount standby database
    released channel: ORA_AUX_DISK_1
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03002: failure of Duplicate Db command at 07/18/2007 17:11:43
    RMAN-05501: aborting duplication of target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/undotbs2.265.627906771 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/example.264.627905917 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/users.259.627905395 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/sysaux.257.627905385 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/undotbs1.258.627905395 conflicts with a file used by the target database
    RMAN-05001: auxiliary filename +DATA/racdb/datafile/system.256.627905375 conflicts with a file used by the target database                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               

  • Database is not starting after RAC installation

    Hi All,
    I have installed 10g R2 2-node RAC on RHEL4 without any problem. But after the installation the database is not starting and i'm not able to connect. It is showing the below error..
    ERROR:
    ORA-01034: ORACLE not available
    ORA-27101: shared memory realm does not exist
    Linux Error: 2: No such file or directory
    Can anybody help what might be the problem?
    Thanks,
    Praveen

    Hi,
    I'm giving the contents of alter log file from the first node...
    Mon Feb 19 16:45:59 2007
    Starting ORACLE instance (normal)
    LICENSE_MAX_SESSION = 0
    LICENSE_SESSIONS_WARNING = 0
    Interface type 1 eth1 10.250.90.0 configured from OCR for use as a cluster interconnect
    Interface type 1 eth0 10.250.90.0 configured from OCR for use as a public interface
    Shared memory segment for instance monitoring created
    Picked latch-free SCN scheme 2
    Autotune of undo retention is turned on.
    IMODE=BR
    ILAT =36
    LICENSE_MAX_USERS = 0
    SYS auditing is disabled
    ksdpec: called for event 13740 prior to event group initialization
    Starting up ORACLE RDBMS Version: 10.2.0.2.0.
    System parameters with non-default values:
    processes = 300
    sessions = 335
    sga_max_size = 1073741824
    sga_target = 1073741824
    db_block_size = 8192
    compatible = 10.2.0.2.0
    log_archive_dest_1 = LOCATION=+BSA_DATA1/bsaprod/
    log_archive_format = %t_%s_%r.dbf
    db_file_multiblock_read_count= 16
    cluster_database_instances= 1
    db_create_file_dest = +ORCL_DATA1
    instance_number = 1
    undo_management = AUTO
    undo_tablespace = UNDOTBS1
    remote_login_passwordfile= EXCLUSIVE
    db_domain =
    dispatchers = (PROTOCOL=TCP) (SERVICE=bsaprodXDB)
    remote_listener = LISTENERS_BSAPROD
    job_queue_processes = 10
    background_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/bdump
    user_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/udump
    core_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/cdump
    audit_file_dest = /u01/app/oracle/oracle/admin/bsaprod/adump
    db_name = bsaprod
    open_cursors = 300
    pga_aggregate_target = 262144000
    Cluster communication is configured to use the following interface(s) for this instance
    10.250.90.107
    Mon Feb 19 16:46:00 2007
    cluster interconnect IPC version:Oracle UDP/IP (generic)
    IPC Vendor 1 proto 2
    PMON started with pid=2, OS id=31282
    DIAG started with pid=3, OS id=31284
    PSP0 started with pid=4, OS id=31286
    LMON started with pid=5, OS id=31300
    LMD0 started with pid=6, OS id=31315
    MMAN started with pid=7, OS id=31317
    DBW0 started with pid=8, OS id=31319
    LGWR started with pid=9, OS id=31321
    CKPT started with pid=10, OS id=31323
    SMON started with pid=11, OS id=31325
    RECO started with pid=12, OS id=31327
    CJQ0 started with pid=13, OS id=31329
    MMON started with pid=14, OS id=31331
    Mon Feb 19 16:46:00 2007
    starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
    MMNL started with pid=15, OS id=31333
    Mon Feb 19 16:46:00 2007
    starting up 1 shared server(s) ...
    Mon Feb 19 16:46:00 2007
    lmon registered with NM - instance id 1 (internal mem no 0)
    Mon Feb 19 16:46:01 2007
    Reconfiguration started (old inc 0, new inc 2)
    List of nodes:
    0
    Global Resource Directory frozen
    * allocate domain 0, invalid = TRUE
    Communication channels reestablished
    Master broadcasted resource hash value bitmaps
    Non-local Process blocks cleaned out
    Resources and enqueues cleaned out
    Resources remastered 0
    Set master node info
    Submitted all remote-enqueue requests
    Dwn-cvts replayed, VALBLKs dubious
    All grantable enqueues granted
    Post SMON to start 1st pass IR
    Submitted all GCS remote-cache requests
    Post SMON to start 1st pass IR
    Reconfiguration complete
    Mon Feb 19 16:46:01 2007
    CREATE DATABASE "bsaprod"
    MAXINSTANCES 32
    MAXLOGHISTORY 1
    MAXLOGFILES 192
    MAXLOGMEMBERS 3
    MAXDATAFILES 1024
    DATAFILE SIZE 300M AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED
    EXTENT MANAGEMENT LOCAL
    SYSAUX DATAFILE SIZE 120M AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED
    SMALLFILE DEFAULT TEMPORARY TABLESPACE TEMP TEMPFILE SIZE 20M AUTOEXTEND ON NEXT 640K MAXSIZE UNLIMITED
    SMALLFILE UNDO TABLESPACE "UNDOTBS1" DATAFILE SIZE 200M AUTOEXTEND ON NEXT 5120K MAXSIZE UNLIMITED
    CHARACTER SET WE8ISO8859P1
    NATIONAL CHARACTER SET AL16UTF16
    LOGFILE GROUP 1 SIZE 51200K,
    GROUP 2 SIZE 51200K
    USER SYS IDENTIFIED BY *USER SYSTEM IDENTIFIED BY
    Mon Feb 19 16:46:01 2007
    Starting background process ASMB
    ASMB started with pid=19, OS id=31365
    Starting background process RBAL
    RBAL started with pid=20, OS id=31369
    Loaded ASM Library - Generic Linux, version 2.0.2 (KABI_V2) library for asmlib interface
    Mon Feb 19 16:46:05 2007
    SUCCESS: diskgroup ORCL_DATA1 was mounted
    SUCCESS: diskgroup ORCL_DATA1 was dismounted
    Mon Feb 19 16:46:06 2007
    SUCCESS: diskgroup ORCL_DATA1 was mounted
    Mon Feb 19 16:46:06 2007
    Database mounted in Exclusive Mode
    Mon Feb 19 16:46:09 2007
    Successful mount of redo thread 1, with mount id 3309011657
    Assigning activation ID 3309011657 (0xc53b82c9)
    Thread 1 opened at log sequence 1
    Current log# 1 seq# 1 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Successful open of redo thread 1
    Mon Feb 19 16:46:09 2007
    MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
    Mon Feb 19 16:46:09 2007
    SMON: enabling cache recovery
    Mon Feb 19 16:46:09 2007
    create tablespace SYSTEM datafile SIZE 300M AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED
    EXTENT MANAGEMENT LOCAL online
    Mon Feb 19 16:46:20 2007
    Completed: create tablespace SYSTEM datafile SIZE 300M AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED
    EXTENT MANAGEMENT LOCAL online
    Mon Feb 19 16:46:20 2007
    create rollback segment SYSTEM tablespace SYSTEM
    storage (initial 50K next 50K)
    Completed: create rollback segment SYSTEM tablespace SYSTEM
    storage (initial 50K next 50K)
    Mon Feb 19 16:46:24 2007
    CREATE SMALLFILE UNDO TABLESPACE UNDOTBS1 DATAFILE SIZE 200M AUTOEXTEND ON NEXT 5120K MAXSIZE UNLIMITED
    Mon Feb 19 16:46:31 2007
    Successfully onlined Undo Tablespace 1.
    Completed: CREATE SMALLFILE UNDO TABLESPACE UNDOTBS1 DATAFILE SIZE 200M AUTOEXTEND ON NEXT 5120K MAXSIZE UNLIMITED
    Mon Feb 19 16:46:31 2007
    create tablespace SYSAUX datafile SIZE 120M AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED
    EXTENT MANAGEMENT LOCAL SEGMENT SPACE MANAGEMENT AUTO online
    Completed: create tablespace SYSAUX datafile SIZE 120M AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED
    EXTENT MANAGEMENT LOCAL SEGMENT SPACE MANAGEMENT AUTO online
    Mon Feb 19 16:46:36 2007
    CREATE SMALLFILE TEMPORARY TABLESPACE TEMP TEMPFILE SIZE 20M AUTOEXTEND ON NEXT 640K MAXSIZE UNLIMITED
    Completed: CREATE SMALLFILE TEMPORARY TABLESPACE TEMP TEMPFILE SIZE 20M AUTOEXTEND ON NEXT 640K MAXSIZE UNLIMITED
    Mon Feb 19 16:46:36 2007
    ALTER DATABASE DEFAULT TEMPORARY TABLESPACE TEMP
    Completed: ALTER DATABASE DEFAULT TEMPORARY TABLESPACE TEMP
    Mon Feb 19 16:46:36 2007
    ALTER DATABASE DEFAULT TABLESPACE SYSTEM
    Completed: ALTER DATABASE DEFAULT TABLESPACE SYSTEM
    Mon Feb 19 16:46:38 2007
    SMON: enabling tx recovery
    Mon Feb 19 16:46:39 2007
    Threshold validation cannot be done before catproc is loaded.
    Threshold validation cannot be done before catproc is loaded.
    replication_dependency_tracking turned off (no async multimaster replication found)
    Starting background process QMNC
    QMNC started with pid=22, OS id=32303
    Mon Feb 19 16:46:39 2007
    Completed: CREATE DATABASE "bsaprod"
    MAXINSTANCES 32
    MAXLOGHISTORY 1
    MAXLOGFILES 192
    MAXLOGMEMBERS 3
    MAXDATAFILES 1024
    DATAFILE SIZE 300M AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED
    EXTENT MANAGEMENT LOCAL
    SYSAUX DATAFILE SIZE 120M AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED
    SMALLFILE DEFAULT TEMPORARY TABLESPACE TEMP TEMPFILE SIZE 20M AUTOEXTEND ON NEXT 640K MAXSIZE UNLIMITED
    SMALLFILE UNDO TABLESPACE "UNDOTBS1" DATAFILE SIZE 200M AUTOEXTEND ON NEXT 5120K MAXSIZE UNLIMITED
    CHARACTER SET WE8ISO8859P1
    NATIONAL CHARACTER SET AL16UTF16
    LOGFILE GROUP 1 SIZE 51200K,
    GROUP 2 SIZE 51200K
    USER SYS IDENTIFIED BY *USER SYSTEM IDENTIFIED BY
    Mon Feb 19 16:46:39 2007
    CREATE SMALLFILE UNDO TABLESPACE "UNDOTBS2" DATAFILE SIZE 200M AUTOEXTEND ON NEXT 5120K MAXSIZE UNLIMITED
    Completed: CREATE SMALLFILE UNDO TABLESPACE "UNDOTBS2" DATAFILE SIZE 200M AUTOEXTEND ON NEXT 5120K MAXSIZE UNLIMITED
    Mon Feb 19 16:46:46 2007
    CREATE SMALLFILE TABLESPACE "USERS" LOGGING DATAFILE SIZE 5M AUTOEXTEND ON NEXT 1280K MAXSIZE UNLIMITED EXTENT MANAGEMENT LOCAL SEGMENT SPACE MANAGEMENT AUTO
    Completed: CREATE SMALLFILE TABLESPACE "USERS" LOGGING DATAFILE SIZE 5M AUTOEXTEND ON NEXT 1280K MAXSIZE UNLIMITED EXTENT MANAGEMENT LOCAL SEGMENT SPACE MANAGEMENT AUTO
    Mon Feb 19 16:46:46 2007
    ALTER DATABASE DEFAULT TABLESPACE "USERS"
    Completed: ALTER DATABASE DEFAULT TABLESPACE "USERS"
    Mon Feb 19 16:47:05 2007
    Thread 1 advanced to log sequence 2
    Current log# 2 seq# 2 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 16:47:34 2007
    Thread 1 cannot allocate new log, sequence 3
    Checkpoint not complete
    Current log# 2 seq# 2 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 3
    Current log# 1 seq# 3 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 16:48:10 2007
    Thread 1 cannot allocate new log, sequence 4
    Checkpoint not complete
    Current log# 1 seq# 3 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 4
    Current log# 2 seq# 4 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 16:49:05 2007
    Thread 1 cannot allocate new log, sequence 5
    Checkpoint not complete
    Current log# 2 seq# 4 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 5
    Current log# 1 seq# 5 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 16:50:19 2007
    Thread 1 cannot allocate new log, sequence 6
    Checkpoint not complete
    Current log# 1 seq# 5 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 6
    Current log# 2 seq# 6 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 16:51:00 2007
    Thread 1 cannot allocate new log, sequence 7
    Checkpoint not complete
    Current log# 2 seq# 6 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 7
    Current log# 1 seq# 7 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 16:51:54 2007
    Thread 1 cannot allocate new log, sequence 8
    Checkpoint not complete
    Current log# 1 seq# 7 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 8
    Current log# 2 seq# 8 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 16:55:32 2007
    Thread 1 cannot allocate new log, sequence 9
    Checkpoint not complete
    Current log# 2 seq# 8 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 9
    Current log# 1 seq# 9 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 16:56:35 2007
    Thread 1 cannot allocate new log, sequence 10
    Checkpoint not complete
    Current log# 1 seq# 9 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 10
    Current log# 2 seq# 10 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 16:56:52 2007
    Thread 1 cannot allocate new log, sequence 11
    Checkpoint not complete
    Current log# 2 seq# 10 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 11
    Current log# 1 seq# 11 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 16:57:04 2007
    Thread 1 cannot allocate new log, sequence 12
    Checkpoint not complete
    Current log# 1 seq# 11 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 12
    Current log# 2 seq# 12 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 16:57:14 2007
    Thread 1 cannot allocate new log, sequence 13
    Checkpoint not complete
    Current log# 2 seq# 12 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 13
    Current log# 1 seq# 13 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 16:57:31 2007
    Thread 1 cannot allocate new log, sequence 14
    Checkpoint not complete
    Current log# 1 seq# 13 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 14
    Current log# 2 seq# 14 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 16:58:13 2007
    Thread 1 cannot allocate new log, sequence 15
    Checkpoint not complete
    Current log# 2 seq# 14 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 15
    Current log# 1 seq# 15 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 16:59:42 2007
    Thread 1 cannot allocate new log, sequence 16
    Checkpoint not complete
    Current log# 1 seq# 15 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 16
    Current log# 2 seq# 16 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 17:00:33 2007
    Thread 1 cannot allocate new log, sequence 17
    Checkpoint not complete
    Current log# 2 seq# 16 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 17
    Current log# 1 seq# 17 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 17:01:49 2007
    Thread 1 cannot allocate new log, sequence 18
    Checkpoint not complete
    Current log# 1 seq# 17 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 18
    Current log# 2 seq# 18 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 17:02:23 2007
    Thread 1 cannot allocate new log, sequence 19
    Checkpoint not complete
    Current log# 2 seq# 18 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 19
    Current log# 1 seq# 19 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 17:04:06 2007
    Thread 1 cannot allocate new log, sequence 20
    Checkpoint not complete
    Current log# 1 seq# 19 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 20
    Current log# 2 seq# 20 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 17:05:22 2007
    Thread 1 cannot allocate new log, sequence 21
    Checkpoint not complete
    Current log# 2 seq# 20 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 21
    Current log# 1 seq# 21 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 17:06:22 2007
    Thread 1 cannot allocate new log, sequence 22
    Checkpoint not complete
    Current log# 1 seq# 21 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 22
    Current log# 2 seq# 22 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 17:08:42 2007
    Thread 1 cannot allocate new log, sequence 23
    Checkpoint not complete
    Current log# 2 seq# 22 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 23
    Current log# 1 seq# 23 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 17:09:43 2007
    Thread 1 cannot allocate new log, sequence 24
    Checkpoint not complete
    Current log# 1 seq# 23 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 24
    Current log# 2 seq# 24 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 17:10:42 2007
    Thread 1 cannot allocate new log, sequence 25
    Checkpoint not complete
    Current log# 2 seq# 24 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 25
    Current log# 1 seq# 25 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 17:11:31 2007
    Thread 1 cannot allocate new log, sequence 26
    Checkpoint not complete
    Current log# 1 seq# 25 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 26
    Current log# 2 seq# 26 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 17:12:01 2007
    Thread 1 cannot allocate new log, sequence 27
    Checkpoint not complete
    Current log# 2 seq# 26 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 27
    Current log# 1 seq# 27 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 17:13:12 2007
    Thread 1 cannot allocate new log, sequence 28
    Checkpoint not complete
    Current log# 1 seq# 27 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 28
    Current log# 2 seq# 28 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 17:14:05 2007
    Thread 1 cannot allocate new log, sequence 29
    Checkpoint not complete
    Current log# 2 seq# 28 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 29
    Current log# 1 seq# 29 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 17:14:57 2007
    Thread 1 cannot allocate new log, sequence 30
    Checkpoint not complete
    Current log# 1 seq# 29 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Thread 1 advanced to log sequence 30
    Current log# 2 seq# 30 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Mon Feb 19 17:16:29 2007
    Thread 1 cannot allocate new log, sequence 31
    Checkpoint not complete
    Current log# 2 seq# 30 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_2.258.614969167
    Thread 1 advanced to log sequence 31
    Current log# 1 seq# 31 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Mon Feb 19 17:17:54 2007
    Starting background process EMN0
    EMN0 started with pid=25, OS id=15651
    Mon Feb 19 17:17:54 2007
    Shutting down instance: further logons disabled
    Mon Feb 19 17:17:55 2007
    Stopping background process QMNC
    Mon Feb 19 17:17:55 2007
    Stopping background process CJQ0
    Mon Feb 19 17:17:57 2007
    Stopping background process MMNL
    Mon Feb 19 17:17:58 2007
    Stopping background process MMON
    Mon Feb 19 17:17:59 2007
    Shutting down instance (immediate)
    License high water mark = 1
    Mon Feb 19 17:17:59 2007
    Stopping Job queue slave processes
    Mon Feb 19 17:17:59 2007
    Job queue slave processes stopped
    All dispatchers and shared servers shutdown
    Mon Feb 19 17:18:01 2007
    ALTER DATABASE CLOSE NORMAL
    Mon Feb 19 17:18:01 2007
    SMON: disabling tx recovery
    SMON: disabling cache recovery
    Mon Feb 19 17:18:03 2007
    Shutting down archive processes
    Archiving is disabled
    Archive process shutdown avoided: 0 active
    Thread 1 closed at log sequence 31
    Successful close of redo thread 1
    Mon Feb 19 17:18:04 2007
    Completed: ALTER DATABASE CLOSE NORMAL
    Mon Feb 19 17:18:04 2007
    ALTER DATABASE DISMOUNT
    Mon Feb 19 17:18:04 2007
    SUCCESS: diskgroup ORCL_DATA1 was dismounted
    Mon Feb 19 17:18:04 2007
    Completed: ALTER DATABASE DISMOUNT
    ARCH: Archival disabled due to shutdown: 1089
    Shutting down archive processes
    Archiving is disabled
    Archive process shutdown avoided: 0 active
    ARCH: Archival disabled due to shutdown: 1089
    Shutting down archive processes
    Archiving is disabled
    Archive process shutdown avoided: 0 active
    Mon Feb 19 17:18:09 2007
    freeing rdom 0
    Mon Feb 19 17:18:12 2007
    Starting ORACLE instance (normal)
    LICENSE_MAX_SESSION = 0
    LICENSE_SESSIONS_WARNING = 0
    Interface type 1 eth1 10.250.90.0 configured from OCR for use as a cluster interconnect
    Interface type 1 eth0 10.250.90.0 configured from OCR for use as a public interface
    Picked latch-free SCN scheme 2
    Autotune of undo retention is turned on.
    IMODE=BR
    ILAT =36
    LICENSE_MAX_USERS = 0
    SYS auditing is disabled
    ksdpec: called for event 13740 prior to event group initialization
    Starting up ORACLE RDBMS Version: 10.2.0.2.0.
    System parameters with non-default values:
    processes = 300
    sessions = 335
    sga_max_size = 1073741824
    sga_target = 1073741824
    control_files = +ORCL_DATA1/bsaprod/controlfile/current.256.614969167
    db_block_size = 8192
    compatible = 10.2.0.2.0
    log_archive_dest_1 = LOCATION=+BSA_DATA1/bsaprod/
    log_archive_format = %t_%s_%r.dbf
    db_file_multiblock_read_count= 16
    cluster_database_instances= 1
    db_create_file_dest = +ORCL_DATA1
    instance_number = 1
    undo_management = AUTO
    undo_tablespace = UNDOTBS1
    remote_login_passwordfile= EXCLUSIVE
    db_domain =
    dispatchers = (PROTOCOL=TCP) (SERVICE=bsaprodXDB)
    remote_listener = LISTENERS_BSAPROD
    job_queue_processes = 10
    background_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/bdump
    user_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/udump
    core_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/cdump
    audit_file_dest = /u01/app/oracle/oracle/admin/bsaprod/adump
    db_name = bsaprod
    open_cursors = 300
    pga_aggregate_target = 262144000
    Cluster communication is configured to use the following interface(s) for this instance
    10.250.90.107
    Mon Feb 19 17:18:13 2007
    cluster interconnect IPC version:Oracle UDP/IP (generic)
    IPC Vendor 1 proto 2
    PMON started with pid=2, OS id=16124
    DIAG started with pid=3, OS id=16126
    PSP0 started with pid=4, OS id=16128
    LMON started with pid=5, OS id=16130
    LMD0 started with pid=6, OS id=16132
    MMAN started with pid=7, OS id=16134
    DBW0 started with pid=8, OS id=16136
    LGWR started with pid=9, OS id=16138
    CKPT started with pid=10, OS id=16140
    SMON started with pid=11, OS id=16142
    RECO started with pid=12, OS id=16144
    CJQ0 started with pid=13, OS id=16146
    MMON started with pid=14, OS id=16148
    Mon Feb 19 17:18:13 2007
    starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
    MMNL started with pid=15, OS id=16150
    Mon Feb 19 17:18:13 2007
    starting up 1 shared server(s) ...
    Mon Feb 19 17:18:13 2007
    lmon registered with NM - instance id 1 (internal mem no 0)
    Mon Feb 19 17:18:14 2007
    Reconfiguration started (old inc 0, new inc 2)
    List of nodes:
    0
    Global Resource Directory frozen
    * allocate domain 0, invalid = TRUE
    Communication channels reestablished
    Master broadcasted resource hash value bitmaps
    Non-local Process blocks cleaned out
    Resources and enqueues cleaned out
    Resources remastered 0
    Set master node info
    Submitted all remote-enqueue requests
    Dwn-cvts replayed, VALBLKs dubious
    All grantable enqueues granted
    Post SMON to start 1st pass IR
    Submitted all GCS remote-cache requests
    Post SMON to start 1st pass IR
    Reconfiguration complete
    Mon Feb 19 17:18:14 2007
    ALTER DATABASE MOUNT
    Mon Feb 19 17:18:14 2007
    Starting background process ASMB
    ASMB started with pid=19, OS id=16182
    Starting background process RBAL
    RBAL started with pid=20, OS id=16186
    Loaded ASM Library - Generic Linux, version 2.0.2 (KABI_V2) library for asmlib interface
    Mon Feb 19 17:18:18 2007
    SUCCESS: diskgroup ORCL_DATA1 was mounted
    Mon Feb 19 17:18:23 2007
    Setting recovery target incarnation to 1
    Mon Feb 19 17:18:23 2007
    Successful mount of redo thread 1, with mount id 3309012054
    Mon Feb 19 17:18:23 2007
    Database mounted in Exclusive Mode
    Completed: ALTER DATABASE MOUNT
    Mon Feb 19 17:18:23 2007
    alter database archivelog
    Completed: alter database archivelog
    Mon Feb 19 17:18:23 2007
    alter database open
    Mon Feb 19 17:18:23 2007
    LGWR: STARTING ARCH PROCESSES
    ARC0 started with pid=22, OS id=16393
    Mon Feb 19 17:18:23 2007
    ARC0: Archival started
    ARC1: Archival started
    LGWR: STARTING ARCH PROCESSES COMPLETE
    ARC1 started with pid=23, OS id=16395
    Mon Feb 19 17:18:23 2007
    Thread 1 opened at log sequence 31
    Current log# 1 seq# 31 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Successful open of redo thread 1
    Mon Feb 19 17:18:23 2007
    MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
    Mon Feb 19 17:18:23 2007
    SMON: enabling cache recovery
    Mon Feb 19 17:18:23 2007
    ARC0: STARTING ARCH PROCESSES
    Mon Feb 19 17:18:23 2007
    ARC1: Becoming the 'no FAL' ARCH
    ARC1: Becoming the 'no SRL' ARCH
    Mon Feb 19 17:18:23 2007
    ARC2: Archival started
    ARC0: STARTING ARCH PROCESSES COMPLETE
    ARC0: Becoming the heartbeat ARCH
    ARC2 started with pid=24, OS id=16422
    Mon Feb 19 17:18:23 2007
    Successfully onlined Undo Tablespace 1.
    Mon Feb 19 17:18:23 2007
    SMON: enabling tx recovery
    Mon Feb 19 17:18:23 2007
    Database Characterset is WE8ISO8859P1
    replication_dependency_tracking turned off (no async multimaster replication found)
    Starting background process QMNC
    QMNC started with pid=25, OS id=16449
    Mon Feb 19 17:18:25 2007
    Completed: alter database open
    Mon Feb 19 17:18:25 2007
    ALTER DATABASE ADD LOGFILE THREAD 2 GROUP 3 SIZE 51200K,
    GROUP 4 SIZE 51200K
    Completed: ALTER DATABASE ADD LOGFILE THREAD 2 GROUP 3 SIZE 51200K,
    GROUP 4 SIZE 51200K
    Mon Feb 19 17:18:28 2007
    ALTER DATABASE ENABLE PUBLIC THREAD 2
    Completed: ALTER DATABASE ENABLE PUBLIC THREAD 2
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    Mon Feb 19 17:18:29 2007
    Starting background process EMN0
    EMN0 started with pid=26, OS id=16564
    Mon Feb 19 17:18:29 2007
    Shutting down instance: further logons disabled
    Mon Feb 19 17:18:29 2007
    Stopping background process QMNC
    Mon Feb 19 17:18:29 2007
    Stopping background process CJQ0
    Mon Feb 19 17:18:30 2007
    Stopping background process MMNL
    Mon Feb 19 17:18:31 2007
    Stopping background process MMON
    Mon Feb 19 17:18:32 2007
    Shutting down instance (immediate)
    License high water mark = 3
    Mon Feb 19 17:18:32 2007
    Stopping Job queue slave processes
    Mon Feb 19 17:18:32 2007
    Job queue slave processes stopped
    All dispatchers and shared servers shutdown
    Mon Feb 19 17:18:34 2007
    ALTER DATABASE CLOSE NORMAL
    Mon Feb 19 17:18:34 2007
    SMON: disabling tx recovery
    SMON: disabling cache recovery
    Mon Feb 19 17:18:34 2007
    Shutting down archive processes
    Archiving is disabled
    Mon Feb 19 17:18:39 2007
    ARCH shutting down
    ARC2: Archival stopped
    Mon Feb 19 17:18:44 2007
    ARCH shutting down
    ARC1: Archival stopped
    Mon Feb 19 17:18:49 2007
    ARCH shutting down
    ARC0: Archival stopped
    Mon Feb 19 17:18:50 2007
    Thread 1 closed at log sequence 31
    Successful close of redo thread 1
    Mon Feb 19 17:18:51 2007
    Completed: ALTER DATABASE CLOSE NORMAL
    Mon Feb 19 17:18:51 2007
    ALTER DATABASE DISMOUNT
    Mon Feb 19 17:18:51 2007
    SUCCESS: diskgroup ORCL_DATA1 was dismounted
    Mon Feb 19 17:18:51 2007
    Completed: ALTER DATABASE DISMOUNT
    ARCH: Archival disabled due to shutdown: 1089
    Shutting down archive processes
    Archiving is disabled
    Archive process shutdown avoided: 0 active
    ARCH: Archival disabled due to shutdown: 1089
    Shutting down archive processes
    Archiving is disabled
    Archive process shutdown avoided: 0 active
    Mon Feb 19 17:18:56 2007
    freeing rdom 0
    Mon Feb 19 17:18:59 2007
    Starting ORACLE instance (normal)
    LICENSE_MAX_SESSION = 0
    LICENSE_SESSIONS_WARNING = 0
    Interface type 1 eth1 10.250.90.0 configured from OCR for use as a cluster interconnect
    Interface type 1 eth0 10.250.90.0 configured from OCR for use as a public interface
    Picked latch-free SCN scheme 2
    Autotune of undo retention is turned on.
    LICENSE_MAX_USERS = 0
    SYS auditing is disabled
    ksdpec: called for event 13740 prior to event group initialization
    Starting up ORACLE RDBMS Version: 10.2.0.2.0.
    System parameters with non-default values:
    processes = 300
    sessions = 335
    sga_max_size = 1073741824
    spfile = +BSA_DATA1/bsaprod/spfilebsaprod.ora
    sga_target = 1073741824
    control_files = +ORCL_DATA1/bsaprod/controlfile/current.256.614969167
    db_block_size = 8192
    compatible = 10.2.0.2.0
    log_archive_dest_1 = LOCATION=+BSA_DATA1/bsaprod/
    log_archive_format = %t_%s_%r.dbf
    db_file_multiblock_read_count= 16
    cluster_database = TRUE
    cluster_database_instances= 2
    db_create_file_dest = +ORCL_DATA1
    thread = 1
    instance_number = 1
    undo_management = AUTO
    undo_tablespace = UNDOTBS1
    remote_login_passwordfile= EXCLUSIVE
    db_domain =
    dispatchers = (PROTOCOL=TCP) (SERVICE=bsaprodXDB)
    remote_listener = LISTENERS_BSAPROD
    job_queue_processes = 10
    background_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/bdump
    user_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/udump
    core_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/cdump
    audit_file_dest = /u01/app/oracle/oracle/admin/bsaprod/adump
    db_name = bsaprod
    open_cursors = 300
    pga_aggregate_target = 262144000
    Cluster communication is configured to use the following interface(s) for this instance
    10.250.90.107
    Mon Feb 19 17:19:00 2007
    cluster interconnect IPC version:Oracle UDP/IP (generic)
    IPC Vendor 1 proto 2
    PMON started with pid=2, OS id=17373
    DIAG started with pid=3, OS id=17375
    PSP0 started with pid=4, OS id=17377
    LMON started with pid=5, OS id=17379
    LMD0 started with pid=6, OS id=17381
    LMS0 started with pid=7, OS id=17383
    LMS1 started with pid=8, OS id=17387
    MMAN started with pid=9, OS id=17391
    DBW0 started with pid=10, OS id=17393
    LGWR started with pid=11, OS id=17395
    CKPT started with pid=12, OS id=17397
    SMON started with pid=13, OS id=17399
    RECO started with pid=14, OS id=17412
    CJQ0 started with pid=15, OS id=17428
    MMON started with pid=16, OS id=17430
    Mon Feb 19 17:19:00 2007
    starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
    MMNL started with pid=17, OS id=17432
    Mon Feb 19 17:19:00 2007
    starting up 1 shared server(s) ...
    Mon Feb 19 17:19:01 2007
    lmon registered with NM - instance id 1 (internal mem no 0)
    Mon Feb 19 17:19:01 2007
    Reconfiguration started (old inc 0, new inc 2)
    List of nodes:
    0
    Global Resource Directory frozen
    * allocate domain 0, invalid = TRUE
    Communication channels reestablished
    Master broadcasted resource hash value bitmaps
    Non-local Process blocks cleaned out
    Mon Feb 19 17:19:01 2007
    LMS 1: 0 GCS shadows cancelled, 0 closed
    Mon Feb 19 17:19:01 2007
    LMS 0: 0 GCS shadows cancelled, 0 closed
    Set master node info
    Submitted all remote-enqueue requests
    Dwn-cvts replayed, VALBLKs dubious
    All grantable enqueues granted
    Post SMON to start 1st pass IR
    Mon Feb 19 17:19:01 2007
    LMS 1: 0 GCS shadows traversed, 0 replayed
    Mon Feb 19 17:19:01 2007
    LMS 0: 0 GCS shadows traversed, 0 replayed
    Mon Feb 19 17:19:01 2007
    Submitted all GCS remote-cache requests
    Post SMON to start 1st pass IR
    Fix write in gcs resources
    Reconfiguration complete
    LCK0 started with pid=20, OS id=17460
    Mon Feb 19 17:19:02 2007
    ALTER DATABASE MOUNT
    Mon Feb 19 17:19:02 2007
    This instance was first to mount
    Mon Feb 19 17:19:02 2007
    Starting background process ASMB
    ASMB started with pid=22, OS id=17466
    Starting background process RBAL
    RBAL started with pid=23, OS id=17470
    Loaded ASM Library - Generic Linux, version 2.0.2 (KABI_V2) library for asmlib interface
    Mon Feb 19 17:19:06 2007
    SUCCESS: diskgroup ORCL_DATA1 was mounted
    Mon Feb 19 17:19:09 2007
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    Mon Feb 19 17:19:10 2007
    Setting recovery target incarnation to 1
    Mon Feb 19 17:19:10 2007
    Successful mount of redo thread 1, with mount id 3308997510
    Mon Feb 19 17:19:10 2007
    Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
    Completed: ALTER DATABASE MOUNT
    Mon Feb 19 17:19:11 2007
    ALTER DATABASE OPEN
    This instance was first to open
    Picked broadcast on commit scheme to generate SCNs
    Mon Feb 19 17:19:11 2007
    LGWR: STARTING ARCH PROCESSES
    ARC0 started with pid=26, OS id=17679
    Mon Feb 19 17:19:11 2007
    ARC0: Archival started
    ARC1: Archival started
    LGWR: STARTING ARCH PROCESSES COMPLETE
    ARC1 started with pid=27, OS id=17706
    Mon Feb 19 17:19:11 2007
    Thread 1 opened at log sequence 31
    Current log# 1 seq# 31 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Successful open of redo thread 1
    Mon Feb 19 17:19:11 2007
    MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
    Mon Feb 19 17:19:11 2007
    ARC0: STARTING ARCH PROCESSES
    Mon Feb 19 17:19:11 2007
    ARC1: Becoming the 'no FAL' ARCH
    ARC1: Becoming the 'no SRL' ARCH
    Mon Feb 19 17:19:11 2007
    SMON: enabling cache recovery
    Mon Feb 19 17:19:11 2007
    ARC2: Archival started
    ARC0: STARTING ARCH PROCESSES COMPLETE
    ARC0: Becoming the heartbeat ARCH
    ARC2 started with pid=28, OS id=17708
    Mon Feb 19 17:19:11 2007
    Successfully onlined Undo Tablespace 1.
    Mon Feb 19 17:19:11 2007
    SMON: enabling tx recovery
    Mon Feb 19 17:19:11 2007
    Database Characterset is WE8ISO8859P1
    Mon Feb 19 17:19:11 2007
    Instance recovery: looking for dead threads
    Instance recovery: lock domain invalid but no dead threads
    Mon Feb 19 17:19:12 2007
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    Mon Feb 19 17:19:12 2007
    replication_dependency_tracking turned off (no async multimaster replication found)
    Starting background process QMNC
    QMNC started with pid=29, OS id=17735
    Mon Feb 19 17:19:13 2007
    Completed: ALTER DATABASE OPEN
    Mon Feb 19 17:20:11 2007
    Shutting down archive processes
    Mon Feb 19 17:20:16 2007
    ARCH shutting down
    ARC2: Archival stopped
    Mon Feb 19 17:23:35 2007
    Starting background process EMN0
    EMN0 started with pid=74, OS id=28350
    Mon Feb 19 17:23:35 2007
    Shutting down instance: further logons disabled
    Mon Feb 19 17:23:36 2007
    Stopping background process QMNC
    Mon Feb 19 17:23:36 2007
    Stopping background process CJQ0
    Mon Feb 19 17:23:38 2007
    Stopping background process MMNL
    Mon Feb 19 17:23:39 2007
    Stopping background process MMON
    Mon Feb 19 17:23:40 2007
    Shutting down instance (immediate)
    License high water mark = 34
    Mon Feb 19 17:23:40 2007
    Stopping Job queue slave processes
    Mon Feb 19 17:23:40 2007
    Job queue slave processes stopped
    All dispatchers and shared servers shutdown
    Mon Feb 19 17:24:07 2007
    ALTER DATABASE CLOSE NORMAL
    Mon Feb 19 17:24:07 2007
    SMON: disabling tx recovery
    SMON: disabling cache recovery
    Mon Feb 19 17:24:08 2007
    Shutting down archive processes
    Archiving is disabled
    Mon Feb 19 17:24:18 2007
    ARC1: Becoming the 'no FAL' ARCH
    ARC1: Becoming the 'no SRL' ARCH
    ARC1: Archiving disabled
    ARCH shutting down
    Mon Feb 19 17:24:18 2007
    ARC1: Archival stopped
    Mon Feb 19 17:24:18 2007
    ARC0: Becoming the heartbeat ARCH
    Mon Feb 19 17:24:18 2007
    ARC0: Archiving disabled
    ARCH shutting down
    ARC0: Archival stopped
    Mon Feb 19 17:24:19 2007
    Thread 1 closed at log sequence 31
    Successful close of redo thread 1
    Mon Feb 19 17:24:19 2007
    Completed: ALTER DATABASE CLOSE NORMAL
    Mon Feb 19 17:24:19 2007
    ALTER DATABASE DISMOUNT
    Mon Feb 19 17:24:19 2007
    SUCCESS: diskgroup ORCL_DATA1 was dismounted
    Mon Feb 19 17:24:19 2007
    Completed: ALTER DATABASE DISMOUNT
    ARCH: Archival disabled due to shutdown: 1089
    Shutting down archive processes
    Archiving is disabled
    Archive process shutdown avoided: 0 active
    ARCH: Archival disabled due to shutdown: 1089
    Shutting down archive processes
    Archiving is disabled
    Archive process shutdown avoided: 0 active
    Mon Feb 19 17:24:25 2007
    freeing rdom 0
    Mon Feb 19 17:24:35 2007
    Starting ORACLE instance (normal)
    LICENSE_MAX_SESSION = 0
    LICENSE_SESSIONS_WARNING = 0
    Interface type 1 eth1 10.250.90.0 configured from OCR for use as a cluster interconnect
    Interface type 1 eth0 10.250.90.0 configured from OCR for use as a public interface
    Picked latch-free SCN scheme 2
    Autotune of undo retention is turned on.
    LICENSE_MAX_USERS = 0
    SYS auditing is disabled
    ksdpec: called for event 13740 prior to event group initialization
    Starting up ORACLE RDBMS Version: 10.2.0.2.0.
    System parameters with non-default values:
    processes = 300
    sessions = 335
    sga_max_size = 1073741824
    __shared_pool_size = 255852544
    __large_pool_size = 4194304
    __java_pool_size = 4194304
    __streams_pool_size = 0
    spfile = +BSA_DATA1/bsaprod/spfilebsaprod.ora
    sga_target = 1073741824
    control_files = +ORCL_DATA1/bsaprod/controlfile/current.256.614969167
    db_block_size = 8192
    __db_cache_size = 801112064
    compatible = 10.2.0.2.0
    log_archive_dest_1 = LOCATION=+BSA_DATA1/bsaprod/
    log_archive_format = %t_%s_%r.dbf
    db_file_multiblock_read_count= 16
    cluster_database = TRUE
    cluster_database_instances= 2
    db_create_file_dest = +ORCL_DATA1
    thread = 1
    instance_number = 1
    undo_management = AUTO
    undo_tablespace = UNDOTBS1
    remote_login_passwordfile= EXCLUSIVE
    db_domain =
    dispatchers = (PROTOCOL=TCP) (SERVICE=bsaprodXDB)
    remote_listener = LISTENERS_BSAPROD
    job_queue_processes = 10
    background_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/bdump
    user_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/udump
    core_dump_dest = /u01/app/oracle/oracle/admin/bsaprod/cdump
    audit_file_dest = /u01/app/oracle/oracle/admin/bsaprod/adump
    db_name = bsaprod
    open_cursors = 300
    pga_aggregate_target = 262144000
    Cluster communication is configured to use the following interface(s) for this instance
    10.250.90.107
    Mon Feb 19 17:24:35 2007
    cluster interconnect IPC version:Oracle UDP/IP (generic)
    IPC Vendor 1 proto 2
    PMON started with pid=2, OS id=29950
    DIAG started with pid=3, OS id=29952
    PSP0 started with pid=4, OS id=29954
    LMON started with pid=5, OS id=29956
    LMD0 started with pid=6, OS id=29958
    LMS0 started with pid=7, OS id=29960
    LMS1 started with pid=8, OS id=29964
    MMAN started with pid=9, OS id=29968
    DBW0 started with pid=10, OS id=29970
    LGWR started with pid=11, OS id=29972
    CKPT started with pid=12, OS id=29974
    SMON started with pid=13, OS id=29976
    RECO started with pid=14, OS id=29978
    CJQ0 started with pid=15, OS id=29980
    MMON started with pid=16, OS id=29982
    Mon Feb 19 17:24:36 2007
    starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
    MMNL started with pid=17, OS id=29984
    Mon Feb 19 17:24:36 2007
    starting up 1 shared server(s) ...
    Mon Feb 19 17:24:36 2007
    lmon registered with NM - instance id 1 (internal mem no 0)
    Mon Feb 19 17:24:39 2007
    Reconfiguration started (old inc 0, new inc 4)
    List of nodes:
    0 1
    Global Resource Directory frozen
    * allocate domain 0, invalid = TRUE
    Communication channels reestablished
    * domain 0 not valid according to instance 1
    * domain 0 valid = 0 according to instance 1
    Mon Feb 19 17:24:39 2007
    Master broadcasted resource hash value bitmaps
    Non-local Process blocks cleaned out
    Mon Feb 19 17:24:39 2007
    LMS 1: 0 GCS shadows cancelled, 0 closed
    Mon Feb 19 17:24:39 2007
    LMS 0: 0 GCS shadows cancelled, 0 closed
    Set master node info
    Submitted all remote-enqueue requests
    Dwn-cvts replayed, VALBLKs dubious
    All grantable enqueues granted
    Mon Feb 19 17:24:39 2007
    LMS 0: 0 GCS shadows traversed, 0 replayed
    Mon Feb 19 17:24:39 2007
    LMS 1: 0 GCS shadows traversed, 0 replayed
    Mon Feb 19 17:24:39 2007
    Submitted all GCS remote-cache requests
    Post SMON to start 1st pass IR
    Fix write in gcs resources
    Reconfiguration complete
    LCK0 started with pid=20, OS id=30069
    Mon Feb 19 17:24:40 2007
    ALTER DATABASE MOUNT
    Mon Feb 19 17:24:41 2007
    Starting background process ASMB
    ASMB started with pid=22, OS id=30121
    Starting background process RBAL
    RBAL started with pid=23, OS id=30125
    Loaded ASM Library - Generic Linux, version 2.0.2 (KABI_V2) library for asmlib interface
    Mon Feb 19 17:24:45 2007
    SUCCESS: diskgroup ORCL_DATA1 was mounted
    Mon Feb 19 17:24:49 2007
    Setting recovery target incarnation to 1
    Mon Feb 19 17:24:49 2007
    Successful mount of redo thread 1, with mount id 3309017062
    Mon Feb 19 17:24:49 2007
    Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
    Mon Feb 19 17:24:51 2007
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    SUCCESS: diskgroup BSA_DATA1 was mounted
    SUCCESS: diskgroup BSA_DATA1 was dismounted
    Mon Feb 19 17:24:52 2007
    Completed: ALTER DATABASE MOUNT
    Mon Feb 19 17:24:52 2007
    ALTER DATABASE OPEN
    Picked broadcast on commit scheme to generate SCNs
    Mon Feb 19 17:24:52 2007
    LGWR: STARTING ARCH PROCESSES
    ARC0 started with pid=25, OS id=30406
    Mon Feb 19 17:24:53 2007
    ARC0: Archival started
    ARC1: Archival started
    LGWR: STARTING ARCH PROCESSES COMPLETE
    ARC1 started with pid=26, OS id=30422
    Mon Feb 19 17:24:53 2007
    Thread 1 opened at log sequence 31
    Current log# 1 seq# 31 mem# 0: +ORCL_DATA1/bsaprod/onlinelog/group_1.257.614969167
    Successful open of redo thread 1
    Mon Feb 19 17:24:53 2007
    MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
    Mon Feb 19 17:24:53 2007
    ARC0: STARTING ARCH PROCESSES
    Mon Feb 19 17:24:53 2007
    ARC1: Becoming the 'no FAL' ARCH
    ARC1: Becoming the 'no SRL' ARCH
    Mon Feb 19 17:24:53 2007
    SMON: enabling cache recovery
    Mon Feb 19 17:24:53 2007
    ARC2: Archival started
    ARC0: STARTING ARCH PROCESSES COMPLETE
    ARC0: Becoming the heartbeat ARCH
    ARC2 started with pid=27, OS id=30436
    Mon Feb 19 17:25:07 2007
    Successfully onlined Undo Tablespace 1.
    Mon Feb 19 17:25:07 2007
    SMON: enabling tx recovery
    Mon Feb 19 17:25:07 2007
    Database Characterset is WE8ISO8859P1
    replication_dependency_tracking turned off (no async multimaster replication found)
    Starting background process QMNC
    QMNC started with pid=29, OS id=30882
    Mon Feb 19 17:26:31 2007
    Completed: ALTER DATABASE OPEN
    Mon Feb 19 17:26:38 2007
    ALTER SYSTEM SET service_names='bsaprod','bsatest' SCOPE=MEMORY SID='bsaprod1';
    Mon Feb 19 17:26:53 2007
    Shutting down archive processes
    Mon Feb 19 17:26:58 2007
    ARCH shutting down
    ARC2: Archival stopped
    Mon Feb 19 17:32:16 2007
    Error: KGXGN aborts the instance (6)
    Mon Feb 19 17:32:16 2007
    Errors in file /u01/app/oracle/oracle/admin/bsaprod/bdump/bsaprod1_lmon_29956.trc:
    ORA-29702: error occurred in Cluster Group Service operation
    LMON: terminating instance due to error 29702
    Mon Feb 19 17:32:17 2007
    System state dump is made for local instance
    System State dumped to trace file /u01/app/oracle/oracle/admin/bsaprod/bdump/bsaprod1_diag_29952.trc
    Mon Feb 19 17:32:18 2007
    Trace dumping is performing id=[cdmp_20070219173217]
    Mon Feb 19 17:32:21 2007
    Instance terminated by LMON, pid = 29956
    and also the output of crs_stat -t in first node is....
    Name Type Target State Host
    ora....d1.inst application ONLINE OFFLINE
    ora....d2.inst application ONLINE OFFLINE
    ora....od1.srv application ONLINE OFFLINE
    ora....od2.srv application ONLINE OFFLINE
    ora....test.cs application ONLINE OFFLINE
    ora.bsaprod.db application ONLINE OFFLINE
    ora....SM1.asm application ONLINE UNKNOWN dsrvbd003
    ora....ER.lsnr application ONLINE UNKNOWN dsrvbd003
    ora....03.lsnr application ONLINE UNKNOWN dsrvbd003
    ora....003.gsd application ONLINE UNKNOWN dsrvbd003
    ora....003.ons application ONLINE UNKNOWN dsrvbd003
    ora....003.vip application ONLINE ONLINE dsrvbd003
    ora....SM2.asm application ONLINE OFFLINE
    ora....04.lsnr application ONLINE OFFLINE
    ora....004.gsd application ONLINE OFFLINE
    ora....004.ons application ONLINE OFFLINE
    ora....004.vip application ONLINE OFFLINE

  • ORA-01092: ORACLE instance terminated. Disconnection forced ORA-00942: table or view does not exist on 12C RAC

    Hi Geeks,
    I have encountered an issue while starting up my database on 12c RAC.
    Till mount it goes fine but when i attempt to open it throws me an error.
    Total System Global Area 1.5400E+10 bytes
    Fixed Size                  4737560 bytes
    Variable Size            2952791528 bytes
    Database Buffers         1.2415E+10 bytes
    Redo Buffers               26857472 bytes
    Database mounted.
    SQL> alter database open;
    alter database open
    ERROR at line 1:
    ORA-01092: ORACLE instance terminated. Disconnection forced
    ORA-00942: table or view does not exist
    Process ID: 11338068
    Session ID: 1429 Serial number: 3
    Here is the trace file output...
    ORACLE_HOME = /oracle_home/app/orahome
    System name:    AIX
    Node name:      INS1
    Release:        1
    Version:        7
    Machine:        00C8CCA74C00
    Instance name: INST1
    Redo thread mounted by this instance: 1
    Oracle process number: 7
    Unix process pid: 20381876, image: oracle@ins1 (TNS V1-V3)
    *** 2014-11-27 22:49:20.892
    *** SESSION ID:(197.5) 2014-11-27 22:49:20.892
    *** CLIENT ID:() 2014-11-27 22:49:20.892
    *** SERVICE NAME:() 2014-11-27 22:49:20.892
    *** MODULE NAME:(sqlplus@ins1 (TNS V1-V3)) 2014-11-27 22:49:20.892
    *** ACTION NAME:() 2014-11-27 22:49:20.892
    2014-11-27 22:49:20.889716 : Start recovery for domain=0, valid=0, flags=0x4
    *** 2014-11-27 22:49:24.580
    Successfully allocated 32 recovery slaves
    Using 3 overflow buffers per recovery slave
    *** 2014-11-27 22:49:24.740
    Thread 1 checkpoint: logseq 15, block 2, scn 3510749
      cache-low rba: logseq 15, block 3
        on-disk rba: logseq 15, block 72, scn 3510824
      start recovery at logseq 15, block 3, scn 0
    *** 2014-11-27 22:49:24.981
    Started resilvering redo thread 1 seq 15 blocks 72-73
    *** 2014-11-27 22:49:24.994
    Completed resilvering redo thread 1 seq 15
    *** 2014-11-27 22:49:24.994
    Started writing zeroblks thread 1 seq 15 blocks 74-81
    *** 2014-11-27 22:49:24.994
    Completed writing zeroblks thread 1 seq 15
    ==== Redo read statistics for thread 1 ====
    Total physical reads (from disk and memory): 4096Kb
    -- Redo read_disk statistics --
    Read rate (ASYNC): 35Kb in 0.25s => 0.14 Mb/sec
    Longest record: 0Kb, moves: 0/104 (0%)
    Longest LWN: 2Kb, moves: 0/33 (0%), moved: 0Mb
    Last redo scn: 0x0000.0035922b (3510827)
    ----- Recovery Hash Table Statistics ---------
    Hash table buckets = 262144
    Longest hash chain = 1
    Average hash chain = 25/25 = 1.0
    Max compares per lookup = 1
    Avg compares per lookup = 151/176 = 0.9
    *** 2014-11-27 22:49:25.007
    KCRA: start recovery claims for 25 data blocks
    *** 2014-11-27 22:49:25.039
    KCRA: blocks processed = 25/25, claimed = 25, eliminated = 0
    *** 2014-11-27 22:49:25.054
    Recovery of Online Redo Log: Thread 1 Group 6 Seq 15 Reading mem 0
    *** 2014-11-27 22:49:25.060
    Completed redo application of 0.02MB
    *** 2014-11-27 22:49:25.235
    Completed recovery checkpoint
    ----- Recovery Hash Table Statistics ---------
    Hash table buckets = 262144
    Longest hash chain = 1
    Average hash chain = 25/25 = 1.0
    Max compares per lookup = 1
    Avg compares per lookup = 176/176 = 1.0
    Recovery sets nab of thread 1 seq 15 to 74 with 8 zeroblks
    *** 2014-11-27 22:49:26.000
    2014-11-27 22:49:26.000433 : Validate domain 0
    2014-11-27 22:49:26.001348 : Validated domain 0, flags = 0x0
    *** 2014-11-27 22:49:28.315
    Count of ofsmtab$: 0 entries
    *** 2014-11-27 22:49:28.732
    ORA-00942: table or view does not exist
    ORA-00942: table or view does not exist
    *** 2014-11-27 22:49:28.738
    USER (ospid: 20381876): terminating the instance due to error 942

    In my case the issue has fixed by executing the following..
    grant SELECT on SYS.USER$ to XDB;
    grant SELECT on SYS.USER$ to CTXSYS;
    grant SELECT on SYS.USER$ to DVSYS;
    grant SELECT on SYS.USER$ to LBACSYS;
    grant SELECT on SYS.USER$ to APEX_040200;
    grant SELECT on SYS.USER$ to DV_SECANALYST; 
    Refer the above screen shot...

Maybe you are looking for

  • Error in local message creation

    in solution manager I'm getting the error in local message creation CPI-C its very urgent pls.............................

  • Data Change Notification

    Hi All, I am asked to implement Oracle 10g Data Change Notification-DCN feature in one of our prod database. I have configured the same and found that PL/SQL call out is capturing all DMLs and notification is being triggered. I am configuring DCN on

  • Got errors in formula

    Hi, I need to determine if the area is closed. I have  = IF(COUNTIF('com hourly'!$a:$a,B3),"open","")for the opening  But I am getting errors with this to check closing =IF(OR(INDEX('com hourly'!$c:$c,MATCH(B27,'com hourly'!$A:$A,0)), "closing","INVA

  • Burning dvd on premiere elements 11

    when i try to burn a dvd project it hangs on the indexing screen and doesnt index

  • Authorization roles for Release Codes

    Hi, We have a requirement wherein the release codes for the PO release strategy are about 100. The roles are repeating itself i.e. Buyer, Manager, Director etc for different countries and other attributes. Is there any way by which we can reduce the