ORA-16014,00312

hi all,
i am getting this error when setting the flashback on in mount mode, then try to open the database it show this error
11gR1 on windows 2008 with ASM
SQL> alter database open;
alter database open
ERROR at line 1:
ORA-16014: log 1 sequence# 25 not archived, no available destinations
ORA-00312: online log 1 thread 1:
'+REDO/oradba/onlinelog/group_1.257.703288193'
Thanks

thanks,
yes +ARCHIVE exist & writable
ASMCMD> cd onlinelog
ASMCMD> ls -l
Type Redund Striped Time Sys Name
ONLINELOG UNPROT FINE DEC 01 09:00:00 Y group_1.257.703288193
ONLINELOG UNPROT FINE DEC 01 09:00:00 Y group_2.258.703288195
ONLINELOG UNPROT FINE DEC 01 09:00:00 Y group_3.259.703288197
the contents of alert log file are..........
2009-12-01 00:02:58.254000 +05:30
SUCCESS: diskgroup ARCHIVE was mounted
ARCH: Archival stopped, error occurred. Will continue retrying
Errors in file c:\app\administrator\diag\rdbms\oradba\oradba\trace\oradba_arc2_3044.trc:
ORA-16038: log 1 sequence# 25 cannot be archived
ORA-19504: failed to create file ""
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
SUCCESS: diskgroup DBF was mounted
SUCCESS: diskgroup TESTME was mounted
2009-12-01 00:03:03.645000 +05:30
SUCCESS: diskgroup ARCHIVE was dismounted
SUCCESS: diskgroup DBF was dismounted
SUCCESS: diskgroup TESTME was dismounted
2009-12-01 00:03:58.285000 +05:30
ARCH: Archival stopped, error occurred. Will continue retrying
Errors in file c:\app\administrator\diag\rdbms\oradba\oradba\trace\oradba_arc3_3048.trc:
ORA-16014: log 1 sequence# 25 not archived, no available destinations
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
SUCCESS: diskgroup DBF was mounted
SUCCESS: diskgroup TESTME was mounted
2009-12-01 00:04:03.613000 +05:30
SUCCESS: diskgroup DBF was dismounted
SUCCESS: diskgroup TESTME was dismounted
2009-12-01 00:08:58.363000 +05:30
SUCCESS: diskgroup ARCHIVE was mounted
ARCH: Archival stopped, error occurred. Will continue retrying
Errors in file c:\app\administrator\diag\rdbms\oradba\oradba\trace\oradba_arc1_3040.trc:
ORA-16038: log 1 sequence# 25 cannot be archived
ORA-19504: failed to create file ""
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
SUCCESS: diskgroup DBF was mounted
SUCCESS: diskgroup TESTME was mounted
2009-12-01 00:09:03.723000 +05:30
SUCCESS: diskgroup ARCHIVE was dismounted
SUCCESS: diskgroup DBF was dismounted
SUCCESS: diskgroup TESTME was dismounted
2009-12-01 00:09:58.379000 +05:30
ARCH: Archival stopped, error occurred. Will continue retrying
Errors in file c:\app\administrator\diag\rdbms\oradba\oradba\trace\oradba_arc2_3044.trc:
ORA-16014: log 1 sequence# 25 not archived, no available destinations
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
2009-12-01 00:14:58.488000 +05:30
SUCCESS: diskgroup ARCHIVE was mounted
& the contents of c:\app\administrator\diag\rdbms\oradba\oradba\trace\oradba_arc2_3044.trc:
*** 2009-12-01 00:02:58.254
kcrroda: calling ksfdrcres to create AL or RL
Failed to create file '+ARCHIVE' (file not accessible?)
*** 2009-12-01 00:02:58.285 1117 krsh.c
ARC2: Error 19504 Creating archive log file to '+ARCHIVE'
*** 2009-12-01 00:02:58.285 27155 kcrr.c
kcrrfail: dest:1 err:19504 force:0 blast:1
DDE rules only execution for: ORA 312
----- START Event Driven Actions Dump ----
---- END Event Driven Actions Dump ----
----- START DDE Actions Dump -----
Executing SYNC actions
----- START DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (Async) -----
Successfully dispatched
----- END DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (SUCCESS, 0 csec) -----
Executing ASYNC actions
----- END DDE Actions Dump (total 0 csec) -----
*** 2009-12-01 00:02:58.301 11633 kcrr.c
ORA-16038: log 1 sequence# 25 cannot be archived
ORA-19504: failed to create file ""
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
*** 2009-12-01 00:09:58.363
DDE: Problem Key 'ORA 312' was flood controlled (0x5) (no incident)
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
*** 2009-12-01 00:09:58.379 11633 kcrr.c
ORA-16014: log 1 sequence# 25 not archived, no available destinations
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
Impossible archival state:10
*** 2009-12-01 00:20:55.379
*** 2009-12-01 00:20:55.379 11633 kcrr.c
ORA-16038: log 1 sequence# 25 cannot be archived
ORA-00001: unique constraint (.) violated
*** 2009-12-01 00:25:58.691
*** 2009-12-01 00:25:58.691 3333 kcrr.c
kcrroda: calling ksfdrcres to create AL or RL
Failed to create file '+ARCHIVE' (file not accessible?)
*** 2009-12-01 00:25:58.723 1117 krsh.c
ARC2: Error 19504 Creating archive log file to '+ARCHIVE'
*** 2009-12-01 00:25:58.723 27155 kcrr.c
kcrrfail: dest:1 err:19504 force:0 blast:1
DDE rules only execution for: ORA 312
----- START Event Driven Actions Dump ----
---- END Event Driven Actions Dump ----
----- START DDE Actions Dump -----
Executing SYNC actions
----- START DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (Async) -----
Successfully dispatched
----- END DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (SUCCESS, 0 csec) -----
Executing ASYNC actions
----- END DDE Actions Dump (total 0 csec) -----
*** 2009-12-01 00:25:58.738 11633 kcrr.c
ORA-16038: log 1 sequence# 25 cannot be archived
ORA-19504: failed to create file ""
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
DDE: Problem Key 'ORA 312' was flood controlled (0x5) (no incident)
*** 2009-12-01 00:32:58.816
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
*** 2009-12-01 00:32:58.816 11633 kcrr.c
ORA-16014: log 1 sequence# 25 not archived, no available destinations
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
*** 2009-12-01 00:43:59.066
*** 2009-12-01 00:43:59.066 3333 kcrr.c
kcrroda: calling ksfdrcres to create AL or RL
Failed to create file '+ARCHIVE' (file not accessible?)
*** 2009-12-01 00:43:59.098 1117 krsh.c
ARC2: Error 19504 Creating archive log file to '+ARCHIVE'
*** 2009-12-01 00:43:59.098 27155 kcrr.c
kcrrfail: dest:1 err:19504 force:0 blast:1
DDE rules only execution for: ORA 312
----- START Event Driven Actions Dump ----
---- END Event Driven Actions Dump ----
----- START DDE Actions Dump -----
Executing SYNC actions
----- START DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (Async) -----
Successfully dispatched
----- END DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (SUCCESS, 0 csec) -----
Executing ASYNC actions
----- END DDE Actions Dump (total 0 csec) -----
*** 2009-12-01 00:43:59.113 11633 kcrr.c
ORA-16038: log 1 sequence# 25 cannot be archived
ORA-19504: failed to create file ""
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
DDE: Problem Key 'ORA 312' was flood controlled (0x5) (no incident)
*** 2009-12-01 00:50:55.473
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
*** 2009-12-01 00:50:55.473 11633 kcrr.c
ORA-16014: log 1 sequence# 25 not archived, no available destinations
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
*** 2009-12-01 00:55:55.598
Impossible archival state:10
*** 2009-12-01 00:55:55.613 11633 kcrr.c
ORA-16038: log 1 sequence# 25 cannot be archived
ORA-00001: unique constraint (.) violated
*** 2009-12-01 00:55:59.301
DDE: Problem Key 'ORA 312' was flood controlled (0x5) (no incident)
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
*** 2009-12-01 00:55:59.301 11633 kcrr.c
ORA-16014: log 1 sequence# 25 not archived, no available destinations
ORA-00312: online log 1 thread 1: '+REDO/oradba/onlinelog/group_1.257.703288193'
*** 2009-12-01 01:06:59.551 3333 kcrr.c
*** 2009-12-01 01:06:59.551
kcrroda: calling ksfdrcres to create AL or RL
Failed to create file '+ARCHIVE' (file not accessible?)
*** 2009-12-01 01:06:59.582 1117 krsh.c
ARC2: Error 19504 Creating archive log file to '+ARCHIVE'
*** 2009-12-01 01:06:59.582 27155 kcrr.c
kcrrfail: dest:1 err:19504 force:0 blast:1
DDE rules only execution for: ORA 312
----- START Event Driven Actions Dump ----
---- END Event Driven Actions Dump ----
----- START DDE Actions Dump -----
Executing SYNC actions
----- START DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (Async) -----
Successfully dispatched
----- END DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (SUCCESS, 0 csec) -----
Edited by: user12270655 on Nov 30, 2009 8:27 PM

Similar Messages

  • ORA-16014: log 1 sequence# 40845 not archived, no available destinations

    Hi,
    My RMAN archive script gives the following error. I'm not sure why - there is still about 16 GB diskspace and an archivelog is not more than 50 MB. Does anyone know what could be the cause of this error? Thanks.
    Recovery Manager: Release 8.1.7.4.1 - Production
    RMAN-06005: connected to target database: PROD (DBID=1412471481)
    RMAN-06009: using target database controlfile instead of recovery catalog
    RMAN> sql 'alter system archive log current';
    2> change archivelog all validate;
    3> run{                                         
    4> allocate channel c1 type DISK;
    5> allocate channel c2 type DISK;
    6> backup filesperset 10
    7> format 'C:\backup\rman\PROD\%d_ARCHIVES_%u_%s.bak'
    8> archivelog all delete input;
    9> release channel c1;
    10> release channel c2;
    11> }
    12>
    RMAN-03022: compiling command: sql
    RMAN-06162: sql statement: alter system archive log current
    RMAN-03023: executing command: sql
    RMAN-03026: error recovery releasing channel resources
    RMAN-00571: ===========================================================
    RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
    RMAN-00571: ===========================================================
    RMAN-03006: non-retryable error occurred during execution of command: sql
    RMAN-07004: unhandled exception during command execution on channel default
    RMAN-20000: abnormal termination of job step
    RMAN-11003: failure during parse/execution of SQL statement: alter system archive log current
    RMAN-11001: Oracle Error: ORA-16014: log 1 sequence# 40845 not archived, no available destinations
    ORA-00312: online log 1 thread 1: 'C:\ORACLE\ORADATA\PROD\REDO01.LOG'
    Recovery Manager complete.

    NAME TYPE VALUE
    log_archive_dest string
    log_archive_dest_1 string LOCATION=/ora MANDATORY R
    EOPEN=300
    log_archive_dest_10 string
    log_archive_dest_2 string
    log_archive_dest_3 string
    log_archive_dest_4 string
    log_archive_dest_5 string
    log_archive_dest_6 string
    log_archive_dest_7 string
    log_archive_dest_8 string
    NAME TYPE VALUE
    log_archive_dest_9 string
    log_archive_dest_state_1 string enable
    log_archive_dest_state_10 string enable
    log_archive_dest_state_2 string enable
    log_archive_dest_state_3 string enable
    log_archive_dest_state_4 string enable
    log_archive_dest_state_5 string enable
    log_archive_dest_state_6 string enable
    log_archive_dest_state_7 string enable
    log_archive_dest_state_8 string enable
    log_archive_dest_state_9 string enable

  • 11.2 DB & Data Guard : ORA-16014 how to archive a sequence?

    Hi,
    I've installed 11.2 Oracle Database in my laptop with Oracle Enterprise Linux 5.3 and I have created two standby databases, orcl (primary) and orclstby (physical standby). I performed a switchover to orclstby and consequently, orclstby was the new primary and orcl the physical standby, I checked those values with SQLPlus executing the select database_role from v$database statement, so, there were no problems during the switchover.I also shutteddown and started both primary and stanby databases to check all was fine.
    Today, I've tried to start the environment again and I've encountered the following problem during the startup of the primary database:
    [oracle@mredon-es ~]$ sqlplus / as sysdba
    SQL*Plus: Release 11.2.0.1.0 Production on Wed Oct 21 17:34:21 2009
    Copyright (c) 1982, 2009, Oracle. All rights reserved.
    Connected to an idle instance.
    SQL> startup
    ORACLE instance started.
    Total System Global Area 839282688 bytes
    Fixed Size 2217992 bytes
    Variable Size 507512824 bytes
    Database Buffers 322961408 bytes
    Redo Buffers 6590464 bytes
    Database mounted.
    ORA-03113: end-of-file on communication channel
    Process ID: 5562
    Session ID: 9 Serial number: 3
    I've checked the newest log created and this is its content:
    Dump file /u01/app/oracle/product/11.2.0/dbhome_1/rdbms/log/orclstby_ora_5382.trc
    *** 2009-10-21 17:34:30.467
    Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
    With the Partitioning, OLAP, Data Mining and Real Application Testing options
    ORACLE_HOME = /u01/app/oracle/product/11.2.0/dbhome_1
    System name: Linux
    Node name: mredon-es.us.oracle.com
    Release: 2.6.18-128.el5
    Version: #1 SMP Wed Jan 21 08:45:05 EST 2009
    Machine: x86_64
    Instance name: orclstby
    Redo thread mounted by this instance: 0 <none>
    Oracle process number: 0
    Unix process pid: 5382, image: [email protected]
    *** 2009-10-21 17:34:30.526
    2009-10-21 17:34:30.457: [ default]utgdv:2:ocr loc file /etc/oracle/olr.loc cann
    ot be opened. errno 2
    2009-10-21 17:34:30.527: [ default]utgdv:2:ocr loc file /etc/oracle/ocr.loc cann
    ot be opened. errno 2
    I've searched in Metalink information about ocr.loc and olr.loc and they seem to be part of an Oracle RAC installation, I don't know why the database needs these files to start if I am using single instance...
    Any idea would be kindly appreciated because I'm a bit confused and I don't really know what steps I am suppposed to take in order to solve this problem.
    Thanks in advance.
    Edited by: mredon on Oct 26, 2009 5:22 AM
    Reason: title of the post changed

    sorry for the delay, here is the alert log:
    <msg time='2009-10-21T23:03:09.576+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module='[email protected] (TNS V1-V3)'
    pid='6582'>
    <txt>Data Guard: version check completed
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:09.642+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module=''
    pid='6486'>
    <txt>LGWR: STARTING ARCH PROCESSES
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:09.709+02:00' org_id='oracle' comp_id='rdbms'
    msg_id='ksbrdp:3833:3697353022' type='NOTIFICATION' group='process start'
    level='16' host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130'
    pid='6588'>
    <txt>RSM0 started with pid=23, OS id=6588
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:09.831+02:00' org_id='oracle' comp_id='rdbms'
    msg_id='ksbrdp:3833:3697353022' type='NOTIFICATION' group='process start'
    level='16' host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130'
    pid='6590'>
    <txt>ARC0 started with pid=24, OS id=6590
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:10.832+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module=''
    pid='6486'>
    <txt>ARC0: Archival started
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:10.832+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module=''
    pid='6486'>
    <txt>LGWR: STARTING ARCH PROCESSES COMPLETE
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:10.833+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module=''
    pid='6590'>
    <txt>ARC0: STARTING ARCH PROCESSES
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:11.180+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module='[email protected] (TNS V1-V3)'
    pid='6582'>
    <txt>ARCH: LGWR is scheduled to archive destination LOG_ARCHIVE_DEST_2 after log switch
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:11.183+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module='[email protected] (TNS V1-V3)'
    pid='6582'>
    <txt>ARCH: LGWR is scheduled to archive destination LOG_ARCHIVE_DEST_1 after log switch
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:11.258+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module='[email protected] (TNS V1-V3)'
    pid='6582'>
    <txt>Errors in file /u01/app/oracle/product/diag/rdbms/orclstby/orclstby/trace/orclstby_ora_6582.trc:
    ORA-16014: log 1 sequence# 27 not archived, no available destinationsORA-00312: online log 1 thread 1: &apos;/u01/app/oracle/product/oradata/orclstby/redo01.log&apos;
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:11.263+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module='[email protected] (TNS V1-V3)'
    pid='6582'>
    <txt>USER (ospid: 6582): terminating the instance due to error 16014 </txt>
    </msg>
    <msg time='2009-10-21T23:03:11.429+02:00' org_id='oracle' comp_id='rdbms'
    msg_id='ksbrdp:3833:3697353022' type='NOTIFICATION' group='process start'
    level='16' host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130'
    pid='6592'>
    <txt>ARC1 started with pid=25, OS id=6592
    </txt>
    </msg>
    <msg time='2009-10-21T23:03:12.728+02:00' org_id='oracle' comp_id='rdbms'
    client_id='' type='UNKNOWN' level='16'
    host_id='mredon-es.us.oracle.com' host_addr='192.168.237.130' module='[email protected] (TNS V1-V3)'
    pid='6582'>
    <txt>Instance terminated by USER, pid = 6582
    </txt>
    </msg>
    I've marked in bold the errors which may be causing the problem, ¿what do you think?

  • ORA-16014: log 1 sequence# 512 not archived, no available destinations

    Dear all,
    Upon opening database 10g, i get the error below
    ERROR at line 1:
    ORA-16014: log 1 sequence# 512 not archived, no available destinations
    ORA-00312: online log 1 thread 1:
    'D:\ORACLE\PRODUCT\10.2.0\ORADATA\TRADEV2\REDO01.LOG'
    Please assist.
    Kind regards,
    Dollongo

    Hi,
    Refer similar thread:
    Re: ORA-00312: online log 3 thread 1: 'C:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\RE
    thanks,
    X A H E E R

  • ORA-16014: log 2 sequence# 283 not archived, no available destinations

    When trying to start my database my alert log is showing
    ORA-16014: log 2 sequence# 283 not archived, no available destinations
    ORA-00312: online log 2 thread 1: '/home/app/oracle/oradata/PRIMARYP/redo02.log'
    I can mount the instance ok but not actually open the database
    my db_recovery_file_dest_size is 22 Gb and and the mount point defined by db_recovery_file_dest has pleanty of free space
    Also
    select *
    from v$recovery_file_dest;
    shows plenty of free FRA space -
    NAME
    SPACE_LIMIT SPACE_USED SPACE_RECLAIMABLE NUMBER_OF_FILES
    /home/app/oracle/fast_recovery_area
    2.3622E+10 5506131968        3297617408             159
    select error
    from v$archive_dest;
    shows no errors
    Can anyone help !
    thanks, Jim

    ok here's the wierd thing. When I set up the primary, physical standby and logical standby, I set the following Log Archive Destinations on my primary database ( into the SPFILE )
    ALTER SYSTEM SET log_archive_dest_1='LOCATION=USE_DB_RECOVERY_FILE_DEST VALID_FOR=(ONLINE_LOGFILES,ALL_ROLES) DB_UNIQUE_NAME=PRIMARYP' SCOPE=BOTH;
    ALTER SYSTEM SET log_archive_dest_2='SERVICE=STANDBYP ASYNC VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=STANDBYP' SCOPE=BOTH;
    ALTER SYSTEM SET log_archive_dest_3='SERVICE=STANDBYL ASYNC VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=STANDBYL'
    SCOPE=BOTH;
    ALTER SYSTEM SET log_archive_dest_4='LOCATION=USE_DB_RECOVERY_FILE_DEST VALID_FOR=(STANDBY_LOGFILES,STANDBY_ROLE) DB_UNIQUE_NAME=PRIMARYP' SCOPE=BOTH;
    Then I converted to using DGMGRL instead od SqlPlus to manage my Data Guard Environment. I then did a switchover to my Physical Standby and then a switchbach to my primary. Today when I check the log_archive_dests on my primary, they are completely different from how I set them up originally !
    *.log_archive_dest_1='service="STANDBYL"','LGWR ASYNC NOAFFIRM delay=0 optional compression=disable max_failure=0 max_connections=1 reopen=300 db_unique_name="STANDBYL" net_timeout=30','valid_for=(all_logfiles,primary_role)'
    *.log_archive_dest_2='service="STANDBYP"','LGWR ASYNC NOAFFIRM delay=0 optional compression=disable max_failure=0 max_connections=1 reopen=300 db_unique_name="STANDBYP" net_timeout=30','valid_for=(all_logfiles,primary_role)'
    *.log_archive_dest_3=''
    *.log_archive_dest_4='LOCATION=USE_DB_RECOVERY_FILE_DEST VALID_FOR=(STANDBY_LOGFILES,STANDBY_ROLE) DB_UNIQUE_NAME=PRIMARYP'
    As you can see there is no setting place for the standard archive logs for PRIMARYP !
    When I set log_archive_dest_3 to
    'LOCATION=USE_DB_RECOVERY_FILE_DEST VALID_FOR=(STANDBY_LOGFILES,STANDBY_ROLE) DB_UNIQUE_NAME=PRIMARYP' SCOPE=BOTH;
    Then I am able to open the PRIMARYP database again.
    Q. what cause the entire resetting of the 4 log_archive_dest_n settings ? I am presuming it is something the broker has done ( presumably on the switchover or switch back ) ? However it seems to have completely mucked itself up, not even provising a standard archive log destination for PRIMARYP and in the process causing the instance not to be able to start
    Has anyone ever seen this before ?
    Also now I am getting  ORA-16783: cannot resolve gap for database STANDBYP, STANDBYL
    In my Broker Config for the PRIMARYP database. I am worried because during the investigation of this problem I issues the following on PRIMARYP
    alter database clear unarchived logfile group 1;
    Have I created a Gap which I cannot resolve ?
    thanks,
    Jim

  • Problem with ORA-16014

    Hi
    Please help me
    when I log in to the database then i got "ORA-16014: log 1 sequence# 79239 not archived, no available destinations" . I'm using Windows 2000 advanced server as O.S. and Oracle is 8i ( Oracle8i Enterprise edition release 8.1.7.0.0.). At this circumstances I give a command ( when the aforesaid error occures) " alter database clear unarchived logfile group 1;" after that the database get started successfully. But the problem is, within 1/2 hour i got "ORA-00257". Then again I stop and restart the database and again give the same command; database started successfully again but for 1/2 hours . again i got "ORA-00257".
    Please suggest me what I have to do.
    Regards,
    Debasis
    +91 9836033924

    ORA 257 means archiver is stuck. So you should check that ARCHIVE_LOG_DEST is used properly for archiving and you should look into archiver trace file for more information about this problem.
    Giving phone numbers on a public forum is not advised.
    Adith

  • ORA - 16014 Archival Error

    I ran into an ORA-16014 error when I performed a full database backup using
    RMAN with NoCatalog option. After a backupset(11GB) was generated,an error message box showing on a DOS prompt was: "
    ORA-16014 log 1 sequence# 13080 not atchived,
    no available destinatiins". And it said "Oracle Instance Wenco - Archival Error."
    Any Clue?

    A space issue normally came up with another message "No space left", etc. in the output. I am a little bit doubt this is the case. It seems that the problem is caused by that the archiver stops working or the archive configuration has some problem. You need to make sure the archiver is started and the dest is correct by issuing:
    SQL> show parameter archive;
    If there is no problem, try to restart the archiver by issuing:
    SQL> alter system archive log stop;
    SQL> alter system archive log start;
    Then try to run the hot backup again.
    Good luck.

  • Archive log mode - ORA-16014

    Hi all,
    I have a development database, oracle 10g R2 (10.2.0.1.0) on OEL 4 environment.
    I had set the database in archivelog mode using this commands.
    ALTER SYSTEM SET log_archive_start=TRUE SCOPE=spfile;
    ALTER SYSTEM SET log_archive_dest_1='location=/arch/' SCOPE=spfile;
    ALTER SYSTEM SET log_archive_format='arch_%r_%t_%s.arc' SCOPE=spfile;
    SHUTDOWN IMMEDIATE;
    STARTUP MOUNT;
    ARCHIVE LOG START;
    ALTER DATABASE ARCHIVELOG;
    ALTER DATABASE OPEN;
    alter system switch logfile;
    but, it is not archiving the redologs. i have seen the following ora-error messages on my alert log file.
    Sat Feb 5 10:50:15 2011
    ARC0: Archiving not possible: No primary destinations
    ARC0: Failed to archive thread 1 sequence 2907 (4)
    Sat Feb 5 10:50:20 2011
    ARC1: Archiving not possible: No primary destinations
    ARC1: Failed to archive thread 1 sequence 2907 (4)
    how can i resolve this problem. pls. help me.
    thanks and regards.

    785092 wrote:
    Hi chinar,
    I have changed the ownership of the /arch mountpoint to oracle user. now the archs are generating.
    now i want to edit the 'pfile' with arch destination details.
    can i create the pfile using the spfile or should i do manually.
    thanks very much chinar.
    Edited by: 785092 on Feb 4, 2011 9:59 PMIf you use(started database with ) pfile then you need manually edit pfile and change LOG_ARCHIVE_DEST_1 parameter else just use ALTER SYSTEM SET LOG_ARCHIVE_DEST_1='location=....'

  • ORA-16020: fewer destinations available than specified by LOG_ARCHIVE_MIN_S

    Hi all,
    I'm testing setup of primary and standby database and everything seems to work normally.
    Now, I want to set up DG Broker so I can test switching it over and back.
    So, I went through steps by Gavin (ref. http://gavinsoorma.com/2010/03/11g-data-guard-broker-dgmgrl-configuration-quick-steps/).
    All went well until I showed configuration after enabling the broker.
    Then I got error: ORA-16020: fewer destinations available than specified by LOG_ARCHIVE_MIN_SUCCEED_DEST
    So, then I check the DG log files and on the standby database, I see errors:
    2013-03-26 11:03:52.457                      Executing SQL [ALTER SYSTEM SET log_archive_min_succeed_dest=1 SCOPE=BOTH sid='*']
    2013-03-26 11:03:52.457                      SQL Execution error=604, sql=[ALTER SYSTEM SET log_archive_min_succeed_dest=1 SCOPE=BOTH sid='*']. See error stack below.
    2013-03-26 11:03:52.457                        ORA-00604: error occurred at recursive SQL level 1
    2013-03-26 11:03:52.457                        ORA-02097: parameter cannot be modified because specified value is invalid
    2013-03-26 11:03:52.457                        ORA-16020: fewer destinations available than specified by LOG_ARCHIVE_MIN_SUCCEED_DEST
    2013-03-26 11:03:52.458                      RSM0: Failed to set property LogArchiveMinSucceedDest
    2013-03-26 11:03:52.458                      RSM0: return status of set property 'LogArchiveMinSucceedDest' is ORA-16788
    2013-03-26 11:03:52.458 02010000  1827537550 Operation EDIT_RES_PROP canceled during phase 1, error = ORA-16788
    2013-03-26 11:03:52.458 02010000  1827537550 DMON: Entered rfm_release_chief_lock() for EDIT_RES_PROP
    2013-03-26 11:03:52.460 02010000  1827537550 DMON: EDIT_RES_PROP operation completedSo now, i check the DG InconsistentProperties
    First, standby:   tststby2
    ================
    DGMGRL> show database 'tststby2' InconsistentProperties;
    INCONSISTENT PROPERTIES
       INSTANCE_NAME        PROPERTY_NAME         MEMORY_VALUE         SPFILE_VALUE         BROKER_VALUE
            tststby2 LogArchiveMinSucceedDest                    1                                         1
    Then, primary:  tstprim2
    ================
    DGMGRL> show database 'tstprim2' InconsistentProperties;
    INCONSISTENT PROPERTIES
       INSTANCE_NAME        PROPERTY_NAME         MEMORY_VALUE         SPFILE_VALUE         BROKER_VALUESo, looking now in the database, I check standby and it shows:
    log_archive_min_succeed_dest integer 1
    And, checking primary, it shows:
    log_archive_min_succeed_dest integer 1
    Okay, so what's next?
    I tried resetting the LogArchiveMinSucceedDest to see if that would help, but it just gave me error.
    DGMGRL> edit database 'tststby2' set property 'LogArchiveMinSucceedDest'=1;
    Error: ORA-16788: unable to set one or more database configuration property valuesI do see that my LOG_ARCHIVE_DEST_STATE_2 is set to ENABLE in primary, and is set to DEFER in standby, but it doesn't seem to let me change it in standby.
    What else can I check?
    Adding a couple of more things that might shed light on this:
    ======================================
    on tstprim2 (primary)
    ==============
    SQL> sho parameter convert
    NAME                                 TYPE        VALUE
    db_file_name_convert                 string      tststby2, tstprim2
    log_file_name_convert                string      tststby2, tstprim2
    on tststby2 (standby)
    ==============
    NAME                                 TYPE        VALUE
    db_file_name_convert                 string      tstprim2, tststby2
    log_file_name_convert                string      tstprim2, tststby2
    SQL> SELECT PROCESS, STATUS FROM V$MANAGED_STANDBY;
    PROCESS   STATUS
    ARCH      CLOSING
    ARCH      CLOSING
    RFS       IDLE
    RFS       IDLE
    RFS       IDLE
    RFS       IDLE
    MRP0      APPLYING_LOG  <== as you can see, the standby database is working properly
    35 rows selected.Edited by: 974632 on Mar 26, 2013 9:06 AM

    Okay, I will check that.
    Meanwhile, I'm trying a standard manual switchover, which worked fine.
    But, when I try to switch logfiles, it is just hanging.
    When i check alert log, it shows errors:
    Tue Mar 26 12:24:31 2013
    ARCH: Archival stopped, error occurred. Will continue retrying
    ORACLE Instance tststby2 - Archival Error
    ORA-16014: log 1 sequence# 380 not archived, no available destinations
    ORA-00312: online log 1 thread 1: '/redo1/tststby2/redo01a.rdo'
    ORA-00312: online log 1 thread 1: '/redo2/tststby2/redo01b.rdo'
    Tue Mar 26 12:24:33 2013
    krsk_srl_archive_int: Enabling archival of deferred physical standby SRLs
    krsk_srl_archive_int: Enabling archival of deferred physical standby SRLsI have a feeling it might be because I don't have my dest_2 set correctly.
    The reason I suspect that is because, when I try to enable dest_2, I see error:
    SQL> alter system archive log all;
    alter system archive log all
    ERROR at line 1:
    ORA-16020: fewer destinations available than specified by LOG_ARCHIVE_MIN_SUCCEED_DEST
    SQL> alter system set log_archive_dest_state_2=enable;
    alter system set log_archive_dest_state_2=enable
    ERROR at line 1:
    ORA-02097: parameter cannot be modified because specified value is invalid
    ORA-16028: new LOG_ARCHIVE_DEST_STATE_2 causes less destinations than LOG_ARCHIVE_MIN_SUCCEED_DEST requiresMy dest_2 is set at (remember this is now primary on my standby server):
    log_archive_dest_2                   string      SERVICE=tststby2 LGWR ASYNC
                                                     VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE)
                                                     DB_UNIQUE_NAME=tststby2My dest_1 is set at:
    log_archive_dest_1                   string      LOCATION=USE_DB_RECOVERY_FILE_DEST
                                                     VALID_FOR=(ALL_LOGFILES,ALL_ROLES)
                                                     DB_UNIQUE_NAME=tstprim2Okay, so now, out of desperation, here's what I did, which seems to have worked.
    (I had previously also enabled dest_state_3 per the instructions in the original web page notes)
    SQL> alter system set log_archive_dest_3='LOCATION=/arch/tststby2';
    System altered.
    SQL> alter system archive log all;
    System altered.Now, when I check my location, i see new files just put into that location.
    $ <tststby2> /arch/tststby2>ll
    total 13484
    drwxr-xr-x 2 oracle dba    4096 Mar 26 12:47 ./
    drwxr-xr-x 6 oracle 300    4096 Mar 22 10:56 ../
    -rw-r----- 1 oracle dba 7453184 Mar 26 12:47 log_1_376_809878919.arc
    -rw-r----- 1 oracle dba 6177792 Mar 26 12:47 log_1_377_809878919.arc
    -rw-r----- 1 oracle dba   14336 Mar 26 12:47 log_1_378_809878919.arc
    -rw-r----- 1 oracle dba   96768 Mar 26 12:47 log_1_380_809878919.arc
    -rw-r----- 1 oracle dba   47616 Mar 26 12:47 log_1_381_809878919.arcOne other point of reference is that I created my primary and standby based on your webpage:
    http://www.visi.com/~mseberg/data_guard_on_oracle_11_step_by_step.html
    The only main differences are path locations and names of primary and standby database.
    (Thank you mseberg. You are very good explaining things very well.)

  • ORA-00257: archiver error.

    Hi Experts,
    Again, I need you expert opinions on the issue I'm facing in my EBS production database.
    My database is up and running but I see loads of ORA errors in my alert log file...
    Content of alert logfile:-
    ORA-16038: log 1 sequence# 8950 cannot be archived
    ORA-19502: write error on file "", block number (block size=)
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01a.log'
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01b.log'
    ORA-16014: log 1 sequence# 8950 not archived, no available destinations
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01a.log'
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01b.log'
    ORA-16038: log 1 sequence# 8950 cannot be archived
    ORA-19502: write error on file "", block number (block size=)
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01a.log'
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01b.log'
    ORA-16014: log 1 sequence# 8950 not archived, no available destinations
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01a.log'
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01b.log'
    ORA-16038: log 1 sequence# 8950 cannot be archived
    ORA-19502: write error on file "", block number (block size=)
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01a.log'
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01b.log'
    ORA-16014: log 1 sequence# 8950 not archived, no available destinations
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01a.log'
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01b.log'
    ORA-16038: log 1 sequence# 8950 cannot be archived
    ORA-19502: write error on file "", block number (block size=)
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01a.log'
    ORA-00312: online log 1 thread 1: '/mnt/PRDdata/trcprd/redo01b.log'
    Also my Workflow mailer has stopped with this error:
    " ORA-00257: archiver error. Connect internal only, until freed.. "
    The first thing I did after this error was to check the archive destination space
    SQL> archive log list;
    Database log mode              Archive Mode
    Automatic archival             Enabled
    Archive destination            /mnt/PRDarchive/trcprd
    Oldest online log sequence     8960
    Next log sequence to archive   8960
    Current log sequence           8962
    SQL> !df -h /mnt/PRDarchive/trcprd
    Filesystem            Size  Used Avail Use% Mounted on
    /dev/mapper/oracle_archive-oracle_archive
                           99G   94G   59M 100% /mnt/PRDarchive
    I removed some of the old archives which were already backed up to release some space, and ran
    1. crosscheck archivelog all
    2. delete noprompt expired archivelog all;
    2. crosscheck archivelog all;
    Meanwhile my database was scheduled for a hot backup, and it failed with the below error:
    The log file says:-
    RMAN-03009: failure of delete command on dsk_9 channel at 10/25/2013 23:59:49
    ORA-19606: Cannot copy or restore to snapshot control file
    Please tell me how do I troubleshoot to know the root cause behind all these activities and how do I fix it.
    Your response will be highly appreciated.
    DB Version - 11.2.0.3
    OS Version - RHEL 5, 64bit
    EBS Version- 11.5.10.2
    -Thanks

    Hi,
    ORA-16038: log 1 sequence# 8950 cannot be archived
    ORA-19502: write error on file "", block number (block size=)
    Please confirm that after you have released space for archive logs, do you still get the errors that were before reported in the alert log file? And what is the current output of:
    df -h /mnt/PRDarchive/trcprd
    RMAN-03009: failure of delete command on dsk_9 channel at 10/25/2013 23:59:49
    ORA-19606: Cannot copy or restore to snapshot control file
    Please refer the following for cause and solution:
    ORA-19606: Cannot copy or restore to snapshot control file, RMAN-06214
    https://forums.oracle.com/message/3931860
    Thanks &
    Best Regards,

  • ORA-19510:

    Hi,
    Version :11.2.0.1
    Os :AIX
    we getting the below message in alertlog.
    kkjcre1p: unable to spawn jobq slave process
    Errors in file /u01/app/oracle/admin/ITT11/diag/rdbms/ITT11/ITT11/trace/ITT11_cjq0_24183490.trc:
    Tue Oct 02 01:04:53 2012
    Trace dumping is performing id=[cdmp_20121002010453]
    Tue Oct 02 01:05:08 2012
    PMON failed to acquire latch, see PMON dump
    Tue Oct 02 01:06:08 2012
    PMON failed to acquire latch, see PMON dump
    Tue Oct 02 01:06:44 2012
    NOTE: deferred map free for map id 44495
    Tue Oct 02 01:06:44 2012
    Errors in file /u01/app/oracle/admin/ITT11/diag/rdbms/ITT11/ITT11/trace/ITT11_arca_59834642.trc (incident=1290244):
    ORA-00240: control file enqueue held for more than 120 seconds
    Incident details in: /u01/app/oracle/admin/ITT11/diag/rdbms/ITT11/ITT11/incident/incdir_1290244/ITT11_arca_59834642_i1290244.trc
    Tue Oct 02 01:06:45 2012
    Errors in file /u01/app/oracle/admin/ITT11/diag/rdbms/ITT11/ITT11/trace/ITT11_arc9_15794204.trc:
    ORA-19510: failed to set size of 15797941 blocks for file "+ITT11_ARCHGROUP01/ITT11/arch/arch_1_39575_774871139.arc" (block size=512)
    ORA-17505: ksfdrsz:1 Failed to resize file to size 15797941 blocks
    ORA-15082: ASM failed to communicate with database instance
    ORA-15064: communication failure with ASM instance
    Errors in file /u01/app/oracle/admin/ITT11/diag/rdbms/ITT11/ITT11/trace/ITT11_arc9_15794204.trc:
    ORA-19510: failed to set size of 15797941 blocks for file "+ITT11_ARCHGROUP01/ITT11/arch/arch_1_39575_774871139.arc" (block size=512)
    ORA-17505: ksfdrsz:1 Failed to resize file to size 15797941 blocks
    ORA-15082: ASM failed to communicate with database instance
    ORA-15064: communication failure with ASM instance
    ARC9: Error 19510 Closing archive log file '+ITT11_ARCHGROUP01/ITT11/arch/arch_1_39575_774871139.arc'
    Tue Oct 02 01:06:48 2012
    Trace dumping is performing id=[cdmp_20121002010648]
    Tue Oct 02 01:06:48 2012
    ARCb: STARTING ARCH PROCESSES
    Tue Oct 02 01:06:48 2012
    Thread 1 advanced to log sequence 39578 (LGWR switch)
    Current log# 2 seq# 39578 mem# 0: +ITT11_REDOGROUP01/ITT11/redo02a.log
    Current log# 2 seq# 39578 mem# 1: +ITT11_DATAGROUP01/ITT11/redo02b.log
    Tue Oct 02 01:06:48 2012
    ARC8 started with pid=1788, OS id=8323466
    Tue Oct 02 01:06:48 2012
    Sweep [inc][1290330]: completed
    ARCH: Archival stopped, error occurred. Will continue retrying
    ORACLE Instance ITT11 - Archival Error
    ORA-16038: log 6 sequence# 39575 cannot be archived
    ORA-19510: failed to set size of blocks for file "" (block size=)
    ORA-00312: online log 6 thread 1: '+ITT11_REDOGROUP01/ITT11/redo06a.log'
    ORA-00312: online log 6 thread 1: '+ITT11_DATAGROUP01/ITT11/redo06b.log'
    Errors in file /u01/app/oracle/admin/ITT11/diag/rdbms/ITT11/ITT11/trace/ITT11_arc9_15794204.trc:
    ORA-16038: log 6 sequence# 39575 cannot be archived
    ORA-19510: failed to set size of blocks for file "" (block size=)
    ORA-00312: online log 6 thread 1: '+ITT11_REDOGROUP01/ITT11/redo06a.log'
    ORA-00312: online log 6 thread 1: '+ITT11_DATAGROUP01/ITT11/redo06b.log'
    Sweep [inc][1290329]: completed
    Sweep [inc][1290268]: completed
    Sweep [inc][1290260]: completed
    Sweep [inc][1290244]: completed
    ARC8: Archival started
    ARCb: STARTING ARCH PROCESSES COMPLETE
    Sweep [inc][1290204]: completed
    Sweep [inc2][1290330]: completed
    ARCH: Archival stopped, error occurred. Will continue retrying
    ORACLE Instance ITT11 - Archival Error
    ORA-16014: log 7 sequence# 39574 not archived, no available destinations
    ORA-00312: online log 7 thread 1: '+ITT11_REDOGROUP01/ITT11/redo07a.log'
    ORA-00312: online log 7 thread 1: '+ITT11_DATAGROUP01/ITT11/redo07b.log'
    Errors in file /u01/app/oracle/admin/ITT11/diag/rdbms/ITT11/ITT11/trace/ITT11_arca_59834642.trc:
    ORA-16014: log 7 sequence# 39574 not archived, no available destinations
    ORA-00312: online log 7 thread 1: '+ITT11_REDOGROUP01/ITT11/redo07a.log'
    ORA-00312: online log 7 thread 1: '+ITT11_DATAGROUP01/ITT11/redo07b.log'
    Tue Oct 02 01:06:50 2012
    Archiver process freed from errors. No longer stopped
    Sweep [inc2][1290329]: completed
    Tue Oct 02 01:06:50 2012
    ARCH: Archival stopped, error occurred. Will continue retrying
    ORACLE Instance ITT11 - Archival Error
    ORA-16014: log 6 sequence# 39575 not archived, no available destinations
    ORA-00312: online log 6 thread 1: '+ITT11_REDOGROUP01/ITT11/redo06a.log'
    ORA-00312: online log 6 thread 1: '+ITT11_DATAGROUP01/ITT11/redo06b.log'
    Errors in file /u01/app/oracle/admin/ITT11/diag/rdbms/ITT11/ITT11/trace/ITT11_arc4_15532170.trc:
    ORA-16014: log 6 sequence# 39575 not archived, no available destinations
    ORA-00312: online log 6 thread 1: '+ITT11_REDOGROUP01/ITT11/redo06a.log'
    ORA-00312: online log 6 thread 1: '+ITT11_DATAGROUP01/ITT11/redo06b.log'
    Archiver process freed from errors. No longer stopped
    Sweep [inc2][1290268]: completed
    Sweep [inc2][1290260]: completed
    Sweep [inc2][1290244]: completed
    Tue Oct 02 01:06:50 2012
    Buffer cache integrity check completed
    Sweep [inc2][1290204]: completed
    Tue Oct 02 01:07:03 2012
    opiodr aborting process unknown ospid (9372080) as a result of ORA-28
    Tue Oct 02 01:07:04 2012
    opiodr aborting process unknown ospid (5571510) as a result of ORA-28
    Tue Oct 02 01:07:05 2012
    opiodr aborting process unknown ospid (12910892) as a result of ORA-28
    Tue Oct 02 01:07:05 2012
    Any Suggestions.
    Thanks

    Hi,
    Thanks.
    All the diskgroups are mounted.
    *ASM INSTANCE CRASHES FREQUENTLY WITH ORA-15082 in 11g [ID 1056695.1]*
    +ASM-SQL> select STARTUP_TIME,STATUS from v$instance;
    STARTUP_T STATUS
    04-AUG-12 STARTED
    The id 1056695.1 related to 10.2.0.1 to 11.1.0.7 - Release: 10.2 to 11.1.But the database version is 11.2.0.1.0.
    We got it from trace file.
    END OF SYSTEM STATE
    ORA-15064 at kfnmsg_SendtoUFGs13
    ----- Abridged Call Stack Trace -----
    ksedsts()+644<-kfnmsg_SendtoUFGs()+4064<-kfnmsg_SendtoLocalUFGs()+28<-kfnmClientRegisterPriv()+680<-kffResize()+528<-kfnsFile
    Resize()+712<-kfnDispatch()+564<-opiodr()+3320<-ttcpip()+4628<-opitsk()+6932<-opiino()+2804<-opiodr()+3320<-opidrv()+1172<-so
    u2o()+192
    <-opimai_real()+428<-ssthrdmain()+324<-main()+216<-__start()+112
    ----- End of Abridged Call Stack Trace -----
    ORA-15082 at kfnmsg_SendtoUFGs14
    ----- Abridged Call Stack Trace -----
    ksedsts()+644<-kfnmsg_SendtoUFGs()+4132<-kfnmsg_SendtoLocalUFGs()+28<-kfnmClientRegisterPriv()+680<-kffResize()+528<-kfnsFile
    Resize()+712<-kfnDispatch()+564<-opiodr()+3320<-ttcpip()+4628<-opitsk()+6932<-opiino()+2804<-opiodr()+3320<-opidrv()+1172<-so
    u2o()+192
    <-opimai_real()+428<-ssthrdmain()+324<-main()+216<-__start()+112
    ----- End of Abridged Call Stack Trace -----
    another file
    ORA-15082 at kfnmsg_SendtoUFGs12
    ----- Abridged Call Stack Trace -----
    ksedsts()+644<-kfnmsg_SendtoUFGs()+3992<-kfnmFdOp()+360<-kfnmGetIOStat()+20<-kfkTableCb4Asm()+188<-kfkTableCb()+36<-qerfxFetc
    h()+5636<-qersoProcessULS()+304<-qersoFetch()+196<-qerjoFetch()+1940<-qergsFetch()+1028<-opifch2()+6948<-kpoal8()+6340<-opiod
    r()+3320
    <-ttcpip()+4628<-opitsk()+6932<-opiino()+2804<-opiodr()+3320<-opidrv()+1172<-sou2o()+192<-opimai_real()+428<-ssthrdmain()+324
    <-main()+216<-__start()+112
    Thanks

  • ORA-00354: corrupt redo log block header

    Hi Guys,
    Need your support to resolve one of the oracle issues,
    Below are errors visible in alert.log in oracle,
    ORA-16038: log 24 sequence# 660467 cannot be archived
    ORA-00354: corrupt redo log block header
    ORA-00312: online log 24 thread 1: '/oracle/PRD/origlogB/log_g24_m1.dbf'...
    2010-10-03 07:26:12.835 20195 kcrr.c
    ORA-16014: log 24 sequence# 660467 not archived, no available
    destinations
    Below is o/p of archive log list seems to be bit strange,
    SQL> archive log list
    Database log mode              Archive Mode
    Automatic archival             Enabled
    Archive destination            /oracle/PRD/saparch/PRDarch
    Oldest online log sequence     660467
    Next log sequence to archive   660467
    Current log sequence           660576
    And some more info,
    SQL> SELECT GROUP#, STATUS, MEMBER FROM V$LOGFILE;
        GROUP# STATUS  MEMBER
            28         /oracle/PRD/origlogB/log_g28_m1.dbf
            28         /oracle/PRD/mirrlogB/log_g28_m2.dbf
            27         /oracle/PRD/origlogA/log_g27_m1.dbf
            27         /oracle/PRD/mirrlogA/log_g27_m2.dbf
            26         /oracle/PRD/origlogB/log_g26_m1.dbf
            26         /oracle/PRD/mirrlogB/log_g26_m2.dbf
            25         /oracle/PRD/origlogA/log_g25_m1.dbf
            25         /oracle/PRD/mirrlogA/log_g25_m2.dbf
            24         /oracle/PRD/origlogB/log_g24_m1.dbf
            24         /oracle/PRD/mirrlogB/log_g24_m2.dbf
            23         /oracle/PRD/origlogA/log_g23_m1.dbf
            23         /oracle/PRD/mirrlogA/log_g23_m2.dbf
            22         /oracle/PRD/origlogB/log_g22_m1.dbf
            22         /oracle/PRD/mirrlogB/log_g22_m2.dbf
            21         /oracle/PRD/origlogA/log_g21_m1.dbf
            21         /oracle/PRD/mirrlogA/log_g21_m2.dbf
    16 rows selected.
    SQL> SELECT GROUP#, SEQUENCE#, MEMBERS, ARCHIVED, STATUS, FIRST_CHANGE# FROM V$LOG;
        GROUP#  SEQUENCE#    MEMBERS ARC STATUS           FIRST_CHANGE#
            21     660571          2 NO  INACTIVE            2.9116E+10
            22     660572          2 NO  INACTIVE            2.9116E+10
            23     660570          2 NO  INACTIVE            2.9116E+10
            24     660467          2 NO  INACTIVE            2.9114E+10
            25     660573          2 NO  ACTIVE              2.9116E+10
            26     660574          2 NO  CURRENT             2.9116E+10
            27     660568          2 NO  INACTIVE            2.9116E+10
            28     660569          2 NO  INACTIVE            2.9116E+10
    8 rows selected.
    All file exists but still facing issue, no backup is running
    Regards,
    Yash

    Hi,
    Instead of the logfile name, try the command with the logfile integer as mentioned below.
    alter database clear unarchived logfile group <integer>;
    You can get the logfile integer using the view, v$log.
    select GROUP#,MEMBERS,STATUS from v$log;
    The value for the parameter GROUP# is the logfile integer.
    Hope this helps.
    Regards,
    Varadharajan M

  • ORA 16038 log 1 sequence# 158249 cannot be archived

    hi im getting this error on my database when opening
    ORA-16038: log 1 sequence# 158249 cannot be archived
    ORA-19809: limit exceeded for recovery files
    ORA-00312: online log 1 thread 1: '/bill01/app/oracle/oradata/billing/redo01.log
    i have tried to free the space but still getting the same error
    this are the setting on the init file
    *.db_recovery_file_dest='/bill01/oracle/archive/BILLING'
    *.db_recovery_file_dest_size=21021851648
    on /bill01 ...... i have 131 GB free
    any idea

    SQL> alter system set db_recovery_file_dest_size=30G;
    System altered.
    SQL> alter database open;
    alter database open
    ERROR at line 1:
    ORA-16014: log 1 sequence# 158249 not archived, no available destinations
    ORA-00312: online log 1 thread 1:
    '/bill01/app/oracle/oradata/billing/redo01.log'
    ======================
    *.db_recovery_file_dest='/bill01/oracle/archive/BILLING'
    set on init

  • Sap instance is not starting

    Hi this is sathyan here i have SAP 4.6c on win2k and recently when i started the server the nessage server is working ok but the dispatcher starts and then stops immediately. and all the work process end not able to find out the problem please help below are the following log files ...please help me.....
    1. dev_disp
    trc file: "dev_disp", trc level: 1, release: "46C"
    Mon May 29 15:33:05 2006
    relno 4640
    patchlevel 0
    patchno 748
    intno 0
    pid 1628
    ***LOG Q00=> DpSapEnvInit, DPStart (00 1628) [dpxxdisp.c 878]
    MtxInit: -2 0 0
    MBUF state OFF
    MBUF opmode USE
    Mon May 29 15:33:07 2006
    EmInit: MmSetImplementation( 2 ).
    <ES> client 0 initializing ....
    <ES> InitFreeList
    <ES> block size is 1024 kByte.
    Using implementation std
    <ES> Memory Reset enabled as NT default
    <EsNT> EsIUnamFileMapInit: Initialize the memory 360 MB
    <ES> 359 blocks reserved for free list.
    ES initialized.
    Mon May 29 15:33:08 2006
    ***LOG Q0K=> DpMsAttach, mscon ( sapsrv) [dpxxdisp.c 7536]
    MBUF set hwid_state to HWID_PENDING
    CCMS: Initalizing shared memory of size 10000000 for monitoring segment.
    Mon May 29 15:33:09 2006
    CCMS: start to initalize 3.X shared alert area (first segment).
    DpMsgAdmin: Set release to 4640, patchlevel 0
    MBUF state PREPARED
    MBUF component UP
    MBUF set hwid_state to SAP_O_K (P0529498296 )
    DpMsgAdmin: Set patchno for this platform to 748
    Release check o.K.
    Mon May 29 15:33:48 2006
    ERROR => W0 (pid 1824) died [dpxxdisp.c 9723]
    ERROR => W1 (pid 1832) died [dpxxdisp.c 9723]
    ERROR => W2 (pid 1840) died [dpxxdisp.c 9723]
    ERROR => W3 (pid 1848) died [dpxxdisp.c 9723]
    ERROR => W4 (pid 1856) died [dpxxdisp.c 9723]
    ERROR => W5 (pid 1864) died [dpxxdisp.c 9723]
    ERROR => W7 (pid 1880) died [dpxxdisp.c 9723]
    ERROR => W8 (pid 1888) died [dpxxdisp.c 9723]
    ERROR => W10 (pid 1904) died [dpxxdisp.c 9723]
    ERROR => W11 (pid 1908) died [dpxxdisp.c 9723]
    my types changed after wp death/restart 0x3f --> 0x3b
    MBUF MOD: state MBUF_PREPARED -> return
    Mon May 29 15:34:08 2006
    ERROR => W6 (pid 1872) died [dpxxdisp.c 9723]
    ERROR => W9 (pid 1896) died [dpxxdisp.c 9723]
    ERROR => W12 (pid 1916) died [dpxxdisp.c 9723]
    ERROR => W13 (pid 1924) died [dpxxdisp.c 9723]
    ERROR => W14 (pid 1944) died [dpxxdisp.c 9723]
    my types changed after wp death/restart 0x3b --> 0x0
    DP_FATAL_ERROR => DpEnvCheck: no more work processes
    DISPATCHER EMERGENCY SHUTDOWN ***
    Mon May 29 15:34:09 2006
    ***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 7741]
    MBUF state OFF
    MBUF component DOWN
    ***LOG Q05=> DpHalt, DPStop ( 1628) [dpxxdisp.c 6458]
    2. dev_ms
    trc file: "dev_ms", trc level: 1, release: "46C"
    [Thr 1552] Mon May 29 15:33:02 2006
    [Thr 1552] MsSSetTrcLog: trc logging not active
    [Thr 1552] Mon May 29 15:33:03 2006
    [Thr 1552] relno 4640
    [Thr 1552] patchlevel 0
    [Thr 1552] patchno 690
    [Thr 1552] intno 0
    [Thr 1552] pid 232
    ***LOG Q01=> MsSInit, MSStart (Msg Server 1 232) [msxxserv.c 1307]
    [Thr 1552] *** I listen to port sapmsTBC (3600) ***
    [Thr 1552] CUSTOMER KEY: >P0529498296<
    [Thr 1552] Mon May 29 15:34:09 2006
    [Thr 1552] ***LOG Q0I=> NiPRead: recv [Thr 1552] (10054: WSAECONNRESET: Connection reset by peer) [Thr 1552] [ninti.c 1123]
    [Thr 1552] *** ERROR => MsSRead: NiBufReceive (rc=NIECONN_BROKEN) [msxxserv.c 7393]
    [Thr 1552] *** ERROR => MsSClientHandle: MsSRead C1 (sapsrv_TBC_00), MSEINTERN [msxxserv.c 3113]
    [Thr 1668] Mon May 29 15:34:55 2006
    [Thr 1668] MsSExit: received SIGINT (2)
    ***LOG Q02=> MsSHalt, MSStop (Msg Server 232) [msxxserv.c 4139]
    3.dev_rfc
    ERROR file opened at 20070107 233251 Pacific Standar, REL 46C,0,748, VER 3 MT-SL
    T:2060 ======> CPIC-CALL: 'CMRCV'
    LOCATION CPIC (TCP/IP) on local host
    ERROR connection to partner broken
    TIME Sun Jan 07 23:32:51 2007
    RELEASE 46C
    COMPONENT NI (network interface)
    VERSION 34
    RC -6
    MODULE ninti.c
    LINE 1123
    DETAIL NiPRead
    SYSTEM CALL recv
    ERRNO 10054
    ERRNO TEXT WSAECONNRESET: Connection reset by peer
    COUNTER 3
    T:2060 <* RfcDispatch [1] : returns 1:RFC_FAILURE
    ERROR file opened at 20060419 161537 Pacific Dayligh, REL 46C,0,748, VER 3 MT-SL
    T:1012 ======> CPIC-CALL: 'CMRCV'
    LOCATION CPIC (TCP/IP) on local host
    ERROR connection to partner broken
    TIME Wed Apr 19 16:15:37 2006
    RELEASE 46C
    COMPONENT NI (network interface)
    VERSION 34
    RC -6
    MODULE ninti.c
    LINE 1699
    DETAIL NiPWrite
    SYSTEM CALL WSASend
    ERRNO 10054
    ERRNO TEXT WSAECONNRESET: Connection reset by peer
    COUNTER 3
    T:1012 <* RfcDispatch [1] : returns 1:RFC_FAILURE
    4.dev_w0
    trc file: "dev_w0", trc level: 1, release: "46C"
    ACTIVE TRACE LEVEL 1
    ACTIVE TRACE COMPONENTS all, M
    B
    B Mon May 29 15:33:09 2006
    B create_con (con_name=R/3)
    B Loading DB library 'E:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B Library 'E:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B Version of library 'E:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46C.00", patchlevel (0.575)
    B New connection 0 created
    M relno 4640
    M patchlevel 0
    M patchno 748
    M intno 0
    M pid 1824
    M
    M ***LOG Q0Q=> tskh_init, WPStart (Workproc 0 1824) [dpxxdisp.c 912]
    I MtxInit: -2 0 0
    X EmInit: MmSetImplementation( 2 ).
    X <ES> client 0 initializing ....
    X Using implementation std
    M <ES> Memory Reset enabled
    X ES initialized.
    M ThSysUsrCheck: clear T0
    M calling db_connect ...
    B find_con found the following connection for reuse:
    B 0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C Got ORACLE_HOME=E:\oracle\ora81 from environment
    C Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C Logon as OPS$-user to get SAPR3's password
    C Connecting as /@TBC on connection 0 ...
    C
    C Mon May 29 15:33:26 2006
    C *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c 2423]
    C *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c 6721]
    C Try to connect with default password
    C Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c 2423]
    C *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c 6721]
    C Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C Logon as OPS$-user to get SAPR3's password
    C Connecting as /@TBC on connection 0 ...
    C *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c 2423]
    C *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c 6721]
    C Try to connect with default password
    C Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c 2423]
    C *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c 6721]
    B ***LOG BY2=> sql error 1033 performing CON [dbsh 0695 ]
    B ***LOG BY0=> [dbsh 0695 ]
    B ***LOG BY2=> sql error 1033 performing CON [dblink 0627 ]
    B ***LOG BY0=> [dblink 0627 ]
    M ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c 1093]
    M *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c 7850]
    M
    M Info for wp 0
    M
    M stat = 4
    M reqtype = 1
    M act_reqtype = -1
    M tid = -1
    M mode = 255
    M len = -1
    M rq_id = -1
    M rq_source = 255
    M last_tid = 0
    M last_mode = 0
    M rfc_req = 0
    M report = > <
    M action = 0
    M tab_name = > <
    M
    M *****************************************************************************
    M *
    M * LOCATION SAP-Server sapsrv_TBC_00 on host sapsrv (wp 0)
    M * ERROR tskh_init: db_connect
    M *
    M * TIME Mon May 29 15:33:26 2006
    M * RELEASE 46C
    M * COMPONENT Taskhandler
    M * VERSION 1
    M * RC 13
    M * MODULE thxxhead.c
    M * LINE 7930
    M * COUNTER 1
    M *
    M *****************************************************************************
    M
    M ***LOG Q02=> wp_halt, WPStop (Workproc 0 1824) [dpnttool.c 300]
    5. SAP-R/3-Startup Program
    Starting at 2006/05/29 15:32:46
    Startup Profile: "E:\usr\sap\TBC\sys\profile\START_DVEBMGS00_sapsrv"
    Starting Programs
    (1540) Execute: E:\usr\sap\TBC\SYS\exe\run\strdbs.cmd TBC
    (232) CreateProcess: E:\usr\sap\TBC\SYS\exe\run\msg_server.exe pf=E:\usr\sap\TBC\SYS\profile\TBC_DVEBMGS00_sapsrv
    (1628) CreateProcess: E:\usr\sap\TBC\SYS\exe\run\disp+work.exe pf=E:\usr\sap\TBC\SYS\profile\TBC_DVEBMGS00_sapsrv
    sapsrv\Administrator is stopping R/3 System at 2006/05/29 15:34:55
    (840) Parent Shutdown at 2006/05/29 15:34:55
    (840) kill(1628) failed
    6.sqlnet
    Fatal NI connect error 12560, connecting to:
    (DESCRIPTION=(ADDRESS=(PROTOCOL=BEQ)(PROGRAM=oracle)(ARGV0=oracleTBC)(ARGS='(DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))'))(CONNECT_DATA=(SID=TBC)(CID=(PROGRAM=E:\usr\sap\TBC\SYS\exe\run\disp+work.EXE)(HOST=sapsrv)(USER=SAPServiceTBC))))
    VERSION INFORMATION:
    TNS for 32-bit Windows: Version 8.1.7.0.0 - Production
    Oracle Bequeath NT Protocol Adapter for 32-bit Windows: Version 8.1.7.0.0 - Production
    Time: 29-MAR-2006 18:25:40
    Tracing not turned on.
    Tns error struct:
    nr err code: 0
    ns main err code: 12560
    TNS-12560: TNS:protocol adapter error
    ns secondary err code: 0
    nt main err code: 530
    TNS-00530: Protocol adapter error
    nt secondary err code: 2
    nt OS err code: 0
    7. stderr2
    E:\usr\sap\TBC\DVEBMGS00\work>echo connect internal 1>v8start.sql
    E:\usr\sap\TBC\DVEBMGS00\work>echo startup 1>>v8start.sql
    Oracle Server Manager Release 3.1.7.0.0 - Production
    Copyright (c) 1997, 1999, Oracle Corporation. All Rights Reserved.
    Oracle8i Enterprise Edition Release 8.1.7.0.0 - Production
    JServer Release 8.1.7.0.0 - Production
    Connected.
    ORACLE instance started.
    Total System Global Area 143796252 bytes
    Fixed Size 75804 bytes
    Variable Size 70942720 bytes
    Database Buffers 71720960 bytes
    Redo Buffers 1056768 bytes
    Database mounted.
    ORA-16014: log 11 sequence# 1549 not archived, no available destinations
    ORA-00312: online log 11 thread 1: 'E:\ORACLE\TBC\ORIGLOGA\LOG_G11M1.DBF'
    ORA-00312: online log 11 thread 1: 'E:\ORACLE\TBC\MIRRLOGA\LOG_G11M2.DBF'
    Server Manager complete.
    8.stderr3
    sapparam: Illegal Parameter in Default Profile: "DIR_CLIENT_ORAHOME". (no Default-Value)
    sapparam: Illegal Parameter in Default Profile: "DIR_SERVER_ORAHOME". (no Default-Value)
    rslgwr1(21): Searching for overlap point in pre-existing SysLog file...
    9.tcp\ip
    Copyright (c) 1993-1999 Microsoft Corp.
    This file contains port numbers for well-known services defined by IANA
    Format:
    <service name> <port number>/<protocol> [aliases...] [#<comment>]
    echo 7/tcp
    echo 7/udp
    discard 9/tcp sink null
    discard 9/udp sink null
    systat 11/tcp users #Active users
    systat 11/tcp users #Active users
    daytime 13/tcp
    daytime 13/udp
    qotd 17/tcp quote #Quote of the day
    qotd 17/udp quote #Quote of the day
    chargen 19/tcp ttytst source #Character generator
    chargen 19/udp ttytst source #Character generator
    ftp-data 20/tcp #FTP, data
    ftp 21/tcp #FTP. control
    telnet 23/tcp
    smtp 25/tcp mail #Simple Mail Transfer Protocol
    time 37/tcp timserver
    time 37/udp timserver
    rlp 39/udp resource #Resource Location Protocol
    nameserver 42/tcp name #Host Name Server
    nameserver 42/udp name #Host Name Server
    nicname 43/tcp whois
    domain 53/tcp #Domain Name Server
    domain 53/udp #Domain Name Server
    bootps 67/udp dhcps #Bootstrap Protocol Server
    bootpc 68/udp dhcpc #Bootstrap Protocol Client
    tftp 69/udp #Trivial File Transfer
    gopher 70/tcp
    finger 79/tcp
    http 80/tcp www www-http #World Wide Web
    kerberos 88/tcp krb5 kerberos-sec #Kerberos
    kerberos 88/udp krb5 kerberos-sec #Kerberos
    hostname 101/tcp hostnames #NIC Host Name Server
    iso-tsap 102/tcp #ISO-TSAP Class 0
    rtelnet 107/tcp #Remote Telnet Service
    pop2 109/tcp postoffice #Post Office Protocol - Version 2
    pop3 110/tcp #Post Office Protocol - Version 3
    sunrpc 111/tcp rpcbind portmap #SUN Remote Procedure Call
    sunrpc 111/udp rpcbind portmap #SUN Remote Procedure Call
    auth 113/tcp ident tap #Identification Protocol
    uucp-path 117/tcp
    nntp 119/tcp usenet #Network News Transfer Protocol
    ntp 123/udp #Network Time Protocol
    epmap 135/tcp loc-srv #DCE endpoint resolution
    epmap 135/udp loc-srv #DCE endpoint resolution
    netbios-ns 137/tcp nbname #NETBIOS Name Service
    netbios-ns 137/udp nbname #NETBIOS Name Service
    netbios-dgm 138/udp nbdatagram #NETBIOS Datagram Service
    netbios-ssn 139/tcp nbsession #NETBIOS Session Service
    imap 143/tcp imap4 #Internet Message Access Protocol
    pcmail-srv 158/tcp #PCMail Server
    snmp 161/udp #SNMP
    snmptrap 162/udp snmp-trap #SNMP trap
    print-srv 170/tcp #Network PostScript
    bgp 179/tcp #Border Gateway Protocol
    irc 194/tcp #Internet Relay Chat Protocol
    ipx 213/udp #IPX over IP
    ldap 389/tcp #Lightweight Directory Access Protocol
    https 443/tcp MCom
    https 443/udp MCom
    microsoft-ds 445/tcp
    microsoft-ds 445/udp
    kpasswd 464/tcp # Kerberos (v5)
    kpasswd 464/udp # Kerberos (v5)
    isakmp 500/udp ike #Internet Key Exchange
    exec 512/tcp #Remote Process Execution
    biff 512/udp comsat
    login 513/tcp #Remote Login
    who 513/udp whod
    cmd 514/tcp shell
    syslog 514/udp
    printer 515/tcp spooler
    talk 517/udp
    ntalk 518/udp
    efs 520/tcp #Extended File Name Server
    router 520/udp route routed
    timed 525/udp timeserver
    tempo 526/tcp newdate
    courier 530/tcp rpc
    conference 531/tcp chat
    netnews 532/tcp readnews
    netwall 533/udp #For emergency broadcasts
    uucp 540/tcp uucpd
    klogin 543/tcp #Kerberos login
    kshell 544/tcp krcmd #Kerberos remote shell
    new-rwho 550/udp new-who
    remotefs 556/tcp rfs rfs_server
    rmonitor 560/udp rmonitord
    monitor 561/udp
    ldaps 636/tcp sldap #LDAP over TLS/SSL
    doom 666/tcp #Doom Id Software
    doom 666/udp #Doom Id Software
    kerberos-adm 749/tcp #Kerberos administration
    kerberos-adm 749/udp #Kerberos administration
    kerberos-iv 750/udp #Kerberos version IV
    kpop 1109/tcp #Kerberos POP
    phone 1167/udp #Conference calling
    ms-sql-s 1433/tcp #Microsoft-SQL-Server
    ms-sql-s 1433/udp #Microsoft-SQL-Server
    ms-sql-m 1434/tcp #Microsoft-SQL-Monitor
    ms-sql-m 1434/udp #Microsoft-SQL-Monitor
    wins 1512/tcp #Microsoft Windows Internet Name Service
    wins 1512/udp #Microsoft Windows Internet Name Service
    ingreslock 1524/tcp ingres
    l2tp 1701/udp #Layer Two Tunneling Protocol
    pptp 1723/tcp #Point-to-point tunnelling protocol
    radius 1812/udp #RADIUS authentication protocol
    radacct 1813/udp #RADIUS accounting protocol
    nfsd 2049/udp nfs #NFS server
    knetd 2053/tcp #Kerberos de-multiplexor
    man 9535/tcp #Remote Man Server
    sapdp00 3200/tcp
    sapgw00 3300/tcp
    sapgw00s 4800/tcp
    sapmsTBC 3600/tcp
    sapdp01 3201/tcp
    sapdp02 3202/tcp
    sapdp03 3203/tcp
    sapdp04 3204/tcp
    sapdp05 3205/tcp
    sapdp06 3206/tcp
    sapdp07 3207/tcp
    sapdp08 3208/tcp
    sapdp09 3209/tcp
    sapdp10 3210/tcp
    sapdp11 3211/tcp
    sapdp12 3212/tcp
    sapdp13 3213/tcp
    sapdp14 3214/tcp
    sapdp15 3215/tcp
    sapdp16 3216/tcp
    sapdp17 3217/tcp
    sapdp18 3218/tcp
    sapdp19 3219/tcp
    sapdp20 3220/tcp
    sapdp21 3221/tcp
    sapdp22 3222/tcp
    sapdp23 3223/tcp
    sapdp24 3224/tcp
    sapdp25 3225/tcp
    sapdp26 3226/tcp
    sapdp27 3227/tcp
    sapdp28 3228/tcp
    sapdp29 3229/tcp
    sapdp30 3230/tcp
    sapdp31 3231/tcp
    sapdp32 3232/tcp
    sapdp33 3233/tcp
    sapdp34 3234/tcp
    sapdp35 3235/tcp
    sapdp36 3236/tcp
    sapdp37 3237/tcp
    sapdp38 3238/tcp
    sapdp39 3239/tcp
    sapdp40 3240/tcp
    sapdp41 3241/tcp
    sapdp42 3242/tcp
    sapdp43 3243/tcp
    sapdp44 3244/tcp
    sapdp45 3245/tcp
    sapdp46 3246/tcp
    sapdp47 3247/tcp
    sapdp48 3248/tcp
    sapdp49 3249/tcp
    sapdp50 3250/tcp
    sapdp51 3251/tcp
    sapdp52 3252/tcp
    sapdp53 3253/tcp
    sapdp54 3254/tcp
    sapdp55 3255/tcp
    sapdp56 3256/tcp
    sapdp57 3257/tcp
    sapdp58 3258/tcp
    sapdp59 3259/tcp
    sapdp60 3260/tcp
    sapdp61 3261/tcp
    sapdp62 3262/tcp
    sapdp63 3263/tcp
    sapdp64 3264/tcp
    sapdp65 3265/tcp
    sapdp66 3266/tcp
    sapdp67 3267/tcp
    sapdp68 3268/tcp
    sapdp69 3269/tcp
    sapdp70 3270/tcp
    sapdp71 3271/tcp
    sapdp72 3272/tcp
    sapdp73 3273/tcp
    sapdp74 3274/tcp
    sapdp75 3275/tcp
    sapdp76 3276/tcp
    sapdp77 3277/tcp
    sapdp78 3278/tcp
    sapdp79 3279/tcp
    sapdp80 3280/tcp
    sapdp81 3281/tcp
    sapdp82 3282/tcp
    sapdp83 3283/tcp
    sapdp84 3284/tcp
    sapdp85 3285/tcp
    sapdp86 3286/tcp
    sapdp87 3287/tcp
    sapdp88 3288/tcp
    sapdp89 3289/tcp
    sapdp90 3290/tcp
    sapdp91 3291/tcp
    sapdp92 3292/tcp
    sapdp93 3293/tcp
    sapdp94 3294/tcp
    sapdp95 3295/tcp
    sapdp96 3296/tcp
    sapdp97 3297/tcp
    sapdp98 3298/tcp
    sapdp99 3299/tcp
    sapgw01 3301/tcp
    sapgw02 3302/tcp
    sapgw03 3303/tcp
    sapgw04 3304/tcp
    sapgw05 3305/tcp
    sapgw06 3306/tcp
    sapgw07 3307/tcp
    sapgw08 3308/tcp
    sapgw09 3309/tcp
    sapgw10 3310/tcp
    sapgw11 3311/tcp
    sapgw12 3312/tcp
    sapgw13 3313/tcp
    sapgw14 3314/tcp
    sapgw15 3315/tcp
    sapgw16 3316/tcp
    sapgw17 3317/tcp
    sapgw18 3318/tcp
    sapgw19 3319/tcp
    sapgw20 3320/tcp
    sapgw21 3321/tcp
    sapgw22 3322/tcp
    sapgw23 3323/tcp
    sapgw24 3324/tcp
    sapgw25 3325/tcp
    sapgw26 3326/tcp
    sapgw27 3327/tcp
    sapgw28 3328/tcp
    sapgw29 3329/tcp
    sapgw30 3330/tcp
    sapgw31 3331/tcp
    sapgw32 3332/tcp
    sapgw33 3333/tcp
    sapgw34 3334/tcp
    sapgw35 3335/tcp
    sapgw36 3336/tcp
    sapgw37 3337/tcp
    sapgw38 3338/tcp
    sapgw39 3339/tcp
    sapgw40 3340/tcp
    sapgw41 3341/tcp
    sapgw42 3342/tcp
    sapgw43 3343/tcp
    sapgw44 3344/tcp
    sapgw45 3345/tcp
    sapgw46 3346/tcp
    sapgw47 3347/tcp
    sapgw48 3348/tcp
    sapgw49 3349/tcp
    sapgw50 3350/tcp
    sapgw51 3351/tcp
    sapgw52 3352/tcp
    sapgw53 3353/tcp
    sapgw54 3354/tcp
    sapgw55 3355/tcp
    sapgw56 3356/tcp
    sapgw57 3357/tcp
    sapgw58 3358/tcp
    sapgw59 3359/tcp
    sapgw60 3360/tcp
    sapgw61 3361/tcp
    sapgw62 3362/tcp
    sapgw63 3363/tcp
    sapgw64 3364/tcp
    sapgw65 3365/tcp
    sapgw66 3366/tcp
    sapgw67 3367/tcp
    sapgw68 3368/tcp
    sapgw69 3369/tcp
    sapgw70 3370/tcp
    sapgw71 3371/tcp
    sapgw72 3372/tcp
    sapgw73 3373/tcp
    sapgw74 3374/tcp
    sapgw75 3375/tcp
    sapgw76 3376/tcp
    sapgw77 3377/tcp
    sapgw78 3378/tcp
    sapgw79 3379/tcp
    sapgw80 3380/tcp
    sapgw81 3381/tcp
    sapgw82 3382/tcp
    sapgw83 3383/tcp
    sapgw84 3384/tcp
    sapgw85 3385/tcp
    sapgw86 3386/tcp
    sapgw87 3387/tcp
    sapgw88 3388/tcp
    sapgw89 3389/tcp
    sapgw90 3390/tcp
    sapgw91 3391/tcp
    sapgw92 3392/tcp
    sapgw93 3393/tcp
    sapgw94 3394/tcp
    sapgw95 3395/tcp
    sapgw96 3396/tcp
    sapgw97 3397/tcp
    sapgw98 3398/tcp
    sapgw99 3399/tcp
    10.
    Microsoft Windows 2000 [Version 5.00.2195]
    (C) Copyright 1985-2000 Microsoft Corp.
    C:\>startsap r3 TBC TBC_DEVBMGS00_sapsrv
    STARTSAP failed
    Details are written to C:
    start.log
    C:\>startsap r3 TBC START_DEVBMGS00_sapsrv
    STARTSAP failed
    Details are written to C:
    start.log
    C:\>tp connect TBC
    This is tp version 305.12.36 (release 46C) for ANY database
    E-TPPARAM could not be opened.
    EXIT
    tp returncode summary:
    TOOLS: Highest return code of single steps was: 0
    ERRORS: Highest tp internal error was: 0212
    tp finished with return code: 212
    meaning:
    could not access file as supposed (see SLOG for more details)
    C:\>r3trans -d -v
    This is r3trans version 6.05 (release 46C - 09.08.01 - 15:20:00).
    2EETW169 no connect possible: "DBMS = ORACLE --- dbs_o
    ra_tnsname = 'TBC'"
    r3trans finished (0012).
    C:\>sappfpar check pf=TBC_DEVBMGS00_sapsrv
    sapparam(2): fopenU("TBC_DEVBMGS00_sapsrv","r"): No such file or directory
    No Profile used.
    sapparam: SAPSYSTEMNAME neither in Profile nor in Commandline
    ================================================================================
    == Checking profile:
    ================================================================================
    Shared memory disposition overview
    ================================================================
    Key: 1 Size: 2000 ( 0.0 MB) System administration
    Key: 2 Size: 961296 ( 0.9 MB) Disp. administration tables
    Key: 3 Size: 13714400 ( 13.1 MB) Disp. communication areas
    Key: 4 Size: 503248 ( 0.5 MB) statistic area
    Key: 5 Size: 4096 ( 0.0 MB) SCSA area
    Key: 6 Size: 159744000 ( 152.3 MB) ABAP program buffer
    Key: 7 Size: 14838 ( 0.0 MB) Update task administration
    Key: 8 Size: 63242340 ( 60.3 MB) Paging buffer
    Key: 9 Size: 137625700 ( 131.2 MB) Roll buffer
    Key: 11 Size: 500000 ( 0.5 MB) Factory calender buffer
    Key: 12 Size: 3000000 ( 2.9 MB) TemSe Char-Code convert Buf.
    Key: 13 Size: 10500000 ( 10.0 MB) Alert Area
    Key: 14 Size: 4400000 ( 4.2 MB) Presentation buffer
    Key: 16 Size: 22400 ( 0.0 MB) Semaphore activity monitoring
    Key: 17 Size: 772900 ( 0.7 MB) Roll administration
    Key: 18 Size: 917604 ( 0.9 MB) Paging adminitration
    Key: 19 Size: 6000000 ( 5.7 MB) Table-buffer
    Key: 30 Size: 22200 ( 0.0 MB) Taskhandler Runtime Admin
    Key: 31 Size: 1806000 ( 1.7 MB) Dispatcher request queue
    Key: 33 Size: 2048000 ( 2.0 MB) Table buffer, part.buffering
    Key: 41 Size: 9010000 ( 8.6 MB) DB statistics buffer
    Key: 42 Size: 3620592 ( 3.5 MB) DB TTAB buffer
    Key: 43 Size: 32534392 ( 31.0 MB) DB FTAB buffer
    Key: 44 Size: 7958392 ( 7.6 MB) DB IREC buffer
    Key: 45 Size: 4886392 ( 4.7 MB) DB short nametab buffer
    Key: 46 Size: 20480 ( 0.0 MB) DB sync table
    Key: 47 Size: 3073024 ( 2.9 MB) DB CUA buffer
    Key: 48 Size: 300000 ( 0.3 MB) Number range buffer
    Key: 49 Size: 3000000 ( 2.9 MB) Spool admin (SpoolWP+DiaWP)
    Key: 51 Size: 3200000 ( 3.1 MB) Extended memory admin.
    Key: 52 Size: 40000 ( 0.0 MB) Message Server buffer
    Key: 54 Size: 4202496 ( 4.0 MB) Export/Import buffer
    Key: 55 Size: 8192 ( 0.0 MB) Spool local printer+joblist
    Key: 57 Size: 1048576 ( 1.0 MB) Profil in shared Memory
    Key: 58 Size: 4096 ( 0.0 MB) EnqId
    Key: 1002 Size: 400000 ( 0.4 MB) Performance monitoring V01.0
    Nr of operating system shared memory segments: 36
    Shared memory resource requirements estimated
    ================================================================
    Total Nr of shared segments required.....: 36
    Shared memory segment size required min..: 159744000 ( 152.3 MB)
    Swap space requirements estimated
    ================================================
    Shared memory....................: 456.9 MB
    Processes........................: 23.6 MB
    Extended Memory .................: 991.0 MB
    Total, minimum requirement.......: 1471.6 MB
    Process local heaps, worst case..: 1907.3 MB
    Total, worst case requirement....: 3378.9 MB
    Errors detected..................: 0
    Warnings detected................: 0
    C:\>ps -ef
    'ps' is not recognized as an internal or external command,
    operable program or batch file.
    C:\>ps -u
    'ps' is not recognized as an internal or external command,
    operable program or batch file.
    C:\>ipconfig/all
    Windows 2000 IP Configuration
    Host Name . . . . . . . . . . . . : sapsrv
    Primary DNS Suffix . . . . . . . :
    Node Type . . . . . . . . . . . . : Broadcast
    IP Routing Enabled. . . . . . . . : No
    WINS Proxy Enabled. . . . . . . . : No
    Ethernet adapter Local Area Connection:
    Connection-specific DNS Suffix . :
    Description . . . . . . . . . . . : Microsoft Loopback Adapter
    Physical Address. . . . . . . . . : 02-00-4C-4F-4F-50
    DHCP Enabled. . . . . . . . . . . : Yes
    Autoconfiguration Enabled . . . . : Yes
    Autoconfiguration IP Address. . . : 169.254.25.129
    Subnet Mask . . . . . . . . . . . : 255.255.0.0
    Default Gateway . . . . . . . . . :
    DNS Servers . . . . . . . . . . . :
    C:\>hostname
    sapsrv
    C:\>sapntchk
    SAPNTCHK for Windows NT (3.2.0.0)
    ==================================
    - Program Arguments ... [OK] ( 0.004 sec)
    - System-Informations ...
    Exception Handling
    ==================
    C:\>gwmon
    call gwmon with following parameters:
    pf=<profile> : Specify Name of parameter file or
    nr=<nr> : System number
    [-e all] : Reset error counts of all connections
    [-e <conn no> : Reset error count of specified connection
    [-V] : Print release
    [-refresh n] : Refresh after n seconds
    [-gwhost host] : Hostname of remote gateway
    [-gwserv service] : Service of remote gateway
    [-noheader] : Suppress headers
    [-cmdfile file] : Execute commands from cmdfile
    if filename '-' read from stdin
    C:\>gwmon sapsrv
    Connect to gateway on host sapsrv, service sapgw00 failed
    ERROR partner not reached (host sapsrv, service sapgw00)
    TIME Mon May 29 17:42:06 2006
    RELEASE 46C
    COMPONENT NI (network interface)
    VERSION 34
    RC -10
    MODULE ninti.c
    LINE 1008
    DETAIL NiPConnect2
    SYSTEM CALL SO_ERROR
    ERRNO 10061
    ERRNO TEXT WSAECONNREFUSED: Connection refused
    COUNTER 1
    C:\>tp connect TBC
    This is tp version 305.12.36 (release 46C) for ANY database
    E-TPPARAM could not be opened.
    EXIT
    tp returncode summary:
    TOOLS: Highest return code of single steps was: 0
    ERRORS: Highest tp internal error was: 0212
    tp finished with return code: 212
    meaning:
    could not access file as supposed (see SLOG for more details)
    C:\>tp showbuffer TBC
    This is tp version 305.12.36 (release 46C) for ANY database
    E-TPPARAM could not be opened.
    EXIT
    tp returncode summary:
    TOOLS: Highest return code of single steps was: 0
    ERRORS: Highest tp internal error was: 0212
    tp finished with return code: 212
    meaning:
    could not access file as supposed (see SLOG for more details)
    C:\>sapstart.exe r3 TBC START_DEVBMGS00_sapsrv -wait
    SAPSTART failed
    Message was edited by:
            Sathyanarayanan Melath

    i donot know but i have the new log.
    dev_w0
    trc file: "dev_w0", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2028

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 0 2028) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 0 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T0
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:10 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...

    C Fri Mar 23 00:17:11 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 0

    M    stat = 4
    M    reqtype = 1
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 0)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:11 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 0 2028) [dpnttool.c   300]
    dev_w1
    trc file: "dev_w1", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        1192

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 1 1192) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 1 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T1
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:40 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 1

    M    stat = 4
    M    reqtype = 1
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 1)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:40 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 1 1192) [dpnttool.c   300]
    dev_w2
    trc file: "dev_w2", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2164

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 2 2164) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 2 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T2
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:51 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 2

    M    stat = 4
    M    reqtype = 1
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 2)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:51 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 2 2164) [dpnttool.c   300]
    dev_w3
    trc file: "dev_w3", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2168

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 3 2168) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 3 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T3
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:46 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...

    C Fri Mar 23 00:17:47 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 3

    M    stat = 4
    M    reqtype = 1
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 3)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:47 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 3 2168) [dpnttool.c   300]
    dev_w4
    trc file: "dev_w4", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2284

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 4 2284) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 4 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T4
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:40 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 4

    M    stat = 4
    M    reqtype = 1
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 4)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:40 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 4 2284) [dpnttool.c   300]
    dev_w5
    trc file: "dev_w5", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2064

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 5 2064) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 5 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T5
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:44 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 5

    M    stat = 4
    M    reqtype = 1
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 5)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:44 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 5 2064) [dpnttool.c   300]
    dev_w6
    trc file: "dev_w6", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2252

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 6 2252) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 6 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T6
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:10 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...

    C Fri Mar 23 00:17:11 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 6

    M    stat = 4
    M    reqtype = 1
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 6)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:11 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 6 2252) [dpnttool.c   300]
    dev_w7
    trc file: "dev_w7", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        1704

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 7 1704) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 7 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T7
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:40 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 7

    M    stat = 4
    M    reqtype = 1
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 7)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:40 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 7 1704) [dpnttool.c   300]
    dev_w8
    trc file: "dev_w8", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2124

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 8 2124) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 8 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T8
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:51 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 8

    M    stat = 4
    M    reqtype = 2
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 8)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:51 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 8 2124) [dpnttool.c   300]
    dev_w9
    trc file: "dev_w9", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2208

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 9 2208) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 9 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T9
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:40 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 9

    M    stat = 4
    M    reqtype = 2
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 9)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:40 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc 9 2208) [dpnttool.c   300]
    dev_w10
    trc file: "dev_w10", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        1732

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc10 1732) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 10 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T10
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:44 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 10

    M    stat = 4
    M    reqtype = 3
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 10)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:44 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc10 1732) [dpnttool.c   300]
    dev_w11
    trc file: "dev_w11", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2220

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc11 2220) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 11 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T11
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:37 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...

    C Fri Mar 23 00:17:38 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 11

    M    stat = 4
    M    reqtype = 4
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 11)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:38 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc11 2220) [dpnttool.c   300]
    dev_w12
    trc file: "dev_w12", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  patchno    748
    M  intno      0
    M  pid        2128

    M  ***LOG Q0Q=> tskh_init, WPStart (Workproc12 2128) [dpxxdisp.c   912]
    I  MtxInit: -2 0 0
    X  EmInit: MmSetImplementation( 2 ).
    X  <ES> client 12 initializing ....
    X  Using implementation std
    M  <ES> Memory Reset enabled
    X  ES initialized.
    M  ThSysUsrCheck: clear T12
    M  calling db_connect ...
    B  find_con found the following connection for reuse:
    B  0: name = R/3, concnt= 000000 state = DISCONNECTED, perm = YES, reco = NO
    C  Got ORACLE_HOME=D:\oracle\ora81 from environment
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...

    C Fri Mar 23 00:17:40 2007
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Got NLS_LANG=AMERICAN_AMERICA.WE8DEC from environment
    C  Logon as OPS$-user to get SAPR3's password
    C  Connecting as /@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    C  Try to connect with default password
    C  Connecting as SAPR3/<pwd>@TBC on connection 0 ...
    C  *** ERROR => OCI-call 'olog' failed: rc = 1033
    [dboci.c      2423]
    C  *** ERROR => CONNECT failed with sql error '1033'
    [dboci.c      6721]
    B  ***LOG BY2=> sql error 1033   performing CON [dbsh    0695 ]
    B  ***LOG BY0=>  [dbsh    0695 ]
    B  ***LOG BY2=> sql error 1033   performing CON [dblink  0627 ]
    B  ***LOG BY0=>  [dblink  0627 ]
    M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1093]
    M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   7850]

    M  Info for wp 12

    M    stat = 4
    M    reqtype = 4
    M    act_reqtype = -1
    M    tid = -1
    M    mode = 255
    M    len = -1
    M    rq_id = -1
    M    rq_source = 255
    M    last_tid = 0
    M    last_mode = 0
    M    rfc_req = 0
    M    report = >                                        <
    M    action = 0
    M    tab_name = >                              <

    M  *****************************************************************************
    M  *
    M  *  LOCATION    SAP-Server sapsrv_TBC_00 on host sapsrv (wp 12)
    M  *  ERROR       tskh_init: db_connect
    M  *
    M  *  TIME        Fri Mar 23 00:17:40 2007
    M  *  RELEASE     46D
    M  *  COMPONENT   Taskhandler
    M  *  VERSION     1
    M  *  RC          13
    M  *  MODULE      thxxhead.c
    M  *  LINE        7930
    M  *  COUNTER     1
    M  *
    M  *****************************************************************************

    M  ***LOG Q02=> wp_halt, WPStop (Workproc12 2128) [dpnttool.c   300]
    dev_w13
    trc file: "dev_w13", trc level: 1, release: "46D"
    ACTIVE TRACE LEVEL           1
    ACTIVE TRACE COMPONENTS      all, M

    B Fri Mar 23 00:16:07 2007
    B  create_con (con_name=R/3)
    B  Loading DB library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' ...
    B  Library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' loaded
    B  Version of library 'C:\usr\sap\TBC\SYS\exe\run\dboraslib.dll' is "46D.00", patchlevel (0.575)
    B  New connection 0 created
    M  relno      4640
    M  patchlevel 0
    M  pa

  • Data Guard Failover after primary site network failure or disconnect.

    Hello Experts:
    I'll try to be clear and specific with my issue:
    Environment:
    Two nodes with NO shared storage (I don't have an Observer running).
    Veritas Cluser Server (VCS) with Data Guar Agent. (I don't use the Broker. Data Guard agent "takes care" of the switchover and failover).
    Two single instance databases, one per node. NO RAC.
    What I'm being able to perform with no issues:
    Manual switch(over) of the primary database by running VCS command "hagrp -switch oraDG_group -to standby_node"
    Automatic fail(over) when primary node is rebooted with "reboot" or "init"
    Automatic fail(over) when primary node is shut down with "shutdown".
    What I'm NOT being able to perform:
    If I manually unplug the network cables from the primary site (all the network, not only the link between primary and standby node so, it's like a server unplug from the energy source).
    Same situation happens if I manually disconnect the server from the power.
    This is the alert logs I have:
    This is the portion of the alert log at Standby site when Real Time Replication is working fine:
    Recovery of Online Redo Log: Thread 1 Group 4 Seq 7 Reading mem 0
      Mem# 0: /u02/oracle/fast_recovery_area/standby_db/onlinelog/o1_mf_4_9c3tk3dy_.log
    At this moment, node1 (Primary) is completely disconnected from the network. SEE at the end when the database (standby which should be converted to PRIMARY) is not getting all the archived logs from the Primary due to the abnormal disconnect from the network:
    Identified End-Of-Redo (failover) for thread 1 sequence 7 at SCN 0xffff.ffffffff
    Incomplete Recovery applied until change 15922544 time 12/23/2013 17:12:48
    Media Recovery Complete (primary_db)
    Terminal Recovery: successful completion
    Forcing ARSCN to IRSCN for TR 0:15922544
    Mon Dec 23 17:13:22 2013
    ARCH: Archival stopped, error occurred. Will continue retrying
    ORACLE Instance primary_db - Archival ErrorAttempt to set limbo arscn 0:15922544 irscn 0:15922544
    ORA-16014: log 4 sequence# 7 not archived, no available destinations
    ORA-00312: online log 4 thread 1: '/u02/oracle/fast_recovery_area/standby_db/onlinelog/o1_mf_4_9c3tk3dy_.log'
    Resetting standby activation ID 2071848820 (0x7b7de774)
    Completed:  ALTER DATABASE RECOVER MANAGED STANDBY DATABASE FINISH
    Mon Dec 23 17:13:33 2013
    ALTER DATABASE RECOVER MANAGED STANDBY DATABASE FINISH
    Terminal Recovery: applying standby redo logs.
    Terminal Recovery: thread 1 seq# 7 redo required
    Terminal Recovery:
    Recovery of Online Redo Log: Thread 1 Group 4 Seq 7 Reading mem 0
      Mem# 0: /u02/oracle/fast_recovery_area/standby_db/onlinelog/o1_mf_4_9c3tk3dy_.log
    Identified End-Of-Redo (failover) for thread 1 sequence 7 at SCN 0xffff.ffffffff
    Incomplete Recovery applied until change 15922544 time 12/23/2013 17:12:48
    Media Recovery Complete (primary_db)
    Terminal Recovery: successful completion
    Forcing ARSCN to IRSCN for TR 0:15922544
    Mon Dec 23 17:13:22 2013
    ARCH: Archival stopped, error occurred. Will continue retrying
    ORACLE Instance primary_db - Archival ErrorAttempt to set limbo arscn 0:15922544 irscn 0:15922544
    ORA-16014: log 4 sequence# 7 not archived, no available destinations
    ORA-00312: online log 4 thread 1: '/u02/oracle/fast_recovery_area/standby_db/onlinelog/o1_mf_4_9c3tk3dy_.log'
    Resetting standby activation ID 2071848820 (0x7b7de774)
    Completed:  ALTER DATABASE RECOVER MANAGED STANDBY DATABASE FINISH
    Mon Dec 23 17:13:33 2013
    ALTER DATABASE RECOVER MANAGED STANDBY DATABASE FINISH
    Attempt to do a Terminal Recovery (primary_db)
    Media Recovery Start: Managed Standby Recovery (primary_db)
    started logmerger process
    Mon Dec 23 17:13:33 2013
    Managed Standby Recovery not using Real Time Apply
    Media Recovery failed with error 16157
    Recovery Slave PR00 previously exited with exception 283
    ORA-283 signalled during:  ALTER DATABASE RECOVER MANAGED STANDBY DATABASE FINISH...
    Mon Dec 23 17:13:34 2013
    Shutting down instance (immediate)
    Shutting down instance: further logons disabled
    Stopping background process MMNL
    Stopping background process MMON
    License high water mark = 38
    All dispatchers and shared servers shutdown
    ALTER DATABASE CLOSE NORMAL
    ORA-1109 signalled during: ALTER DATABASE CLOSE NORMAL...
    ALTER DATABASE DISMOUNT
    Shutting down archive processes
    Archiving is disabled
    Mon Dec 23 17:13:38 2013
    Mon Dec 23 17:13:38 2013
    Mon Dec 23 17:13:38 2013
    ARCH shutting downARCH shutting down
    ARCH shutting down
    ARC0: Relinquishing active heartbeat ARCH role
    ARC2: Archival stopped
    ARC0: Archival stopped
    ARC1: Archival stopped
    Completed: ALTER DATABASE DISMOUNT
    ARCH: Archival disabled due to shutdown: 1089
    Shutting down archive processes
    Archiving is disabled
    Mon Dec 23 17:13:40 2013
    Stopping background process VKTM
    ARCH: Archival disabled due to shutdown: 1089
    Shutting down archive processes
    Archiving is disabled
    Mon Dec 23 17:13:43 2013
    Instance shutdown complete
    Mon Dec 23 17:13:44 2013
    Adjusting the default value of parameter parallel_max_servers
    from 1280 to 470 due to the value of parameter processes (500)
    Starting ORACLE instance (normal)
    ************************ Large Pages Information *******************
    Per process system memlock (soft) limit = 64 KB
    Total Shared Global Region in Large Pages = 0 KB (0%)
    Large Pages used by this instance: 0 (0 KB)
    Large Pages unused system wide = 0 (0 KB)
    Large Pages configured system wide = 0 (0 KB)
    Large Page size = 2048 KB
    RECOMMENDATION:
      Total System Global Area size is 3762 MB. For optimal performance,
      prior to the next instance restart:
      1. Increase the number of unused large pages by
    at least 1881 (page size 2048 KB, total size 3762 MB) system wide to
      get 100% of the System Global Area allocated with large pages
      2. Large pages are automatically locked into physical memory.
    Increase the per process memlock (soft) limit to at least 3770 MB to lock
    100% System Global Area's large pages into physical memory
    LICENSE_MAX_SESSION = 0
    LICENSE_SESSIONS_WARNING = 0
    Initial number of CPU is 32
    Number of processor cores in the system is 16
    Number of processor sockets in the system is 2
    CELL communication is configured to use 0 interface(s):
    CELL IP affinity details:
        NUMA status: NUMA system w/ 2 process groups
        cellaffinity.ora status: cannot find affinity map at '/etc/oracle/cell/network-config/cellaffinity.ora' (see trace file for details)
    CELL communication will use 1 IP group(s):
        Grp 0:
    Picked latch-free SCN scheme 3
    Autotune of undo retention is turned on.
    IMODE=BR
    ILAT =88
    LICENSE_MAX_USERS = 0
    SYS auditing is disabled
    NUMA system with 2 nodes detected
    Starting up:
    Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
    With the Partitioning, OLAP, Data Mining and Real Application Testing options.
    ORACLE_HOME = /u01/oracle/product/11.2.0.4
    System name:    Linux
    Node name:      node2.localdomain
    Release:        2.6.32-131.0.15.el6.x86_64
    Version:        #1 SMP Tue May 10 15:42:40 EDT 2011
    Machine:        x86_64
    Using parameter settings in server-side spfile /u01/oracle/product/11.2.0.4/dbs/spfileprimary_db.ora
    System parameters with non-default values:
      processes                = 500
      sga_target               = 3760M
      control_files            = "/u02/oracle/orafiles/primary_db/control01.ctl"
      control_files            = "/u01/oracle/fast_recovery_area/primary_db/control02.ctl"
      db_file_name_convert     = "standby_db"
      db_file_name_convert     = "primary_db"
      log_file_name_convert    = "standby_db"
      log_file_name_convert    = "primary_db"
      control_file_record_keep_time= 40
      db_block_size            = 8192
      compatible               = "11.2.0.4.0"
      log_archive_dest_1       = "location=/u02/oracle/archivelogs/primary_db"
      log_archive_dest_2       = "SERVICE=primary_db ASYNC VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=primary_db"
      log_archive_dest_state_2 = "ENABLE"
      log_archive_min_succeed_dest= 1
      fal_server               = "primary_db"
      log_archive_trace        = 0
      log_archive_config       = "DG_CONFIG=(primary_db,standby_db)"
      log_archive_format       = "%t_%s_%r.dbf"
      log_archive_max_processes= 3
      db_recovery_file_dest    = "/u02/oracle/fast_recovery_area"
      db_recovery_file_dest_size= 30G
      standby_file_management  = "AUTO"
      db_flashback_retention_target= 1440
      undo_tablespace          = "UNDOTBS1"
      remote_login_passwordfile= "EXCLUSIVE"
      db_domain                = ""
      dispatchers              = "(PROTOCOL=TCP) (SERVICE=primary_dbXDB)"
      job_queue_processes      = 0
      audit_file_dest          = "/u01/oracle/admin/primary_db/adump"
      audit_trail              = "DB"
      db_name                  = "primary_db"
      db_unique_name           = "standby_db"
      open_cursors             = 300
      pga_aggregate_target     = 1250M
      dg_broker_start          = FALSE
      diagnostic_dest          = "/u01/oracle"
    Mon Dec 23 17:13:45 2013
    PMON started with pid=2, OS id=29108
    Mon Dec 23 17:13:45 2013
    PSP0 started with pid=3, OS id=29110
    Mon Dec 23 17:13:46 2013
    VKTM started with pid=4, OS id=29125 at elevated priority
    VKTM running at (1)millisec precision with DBRM quantum (100)ms
    Mon Dec 23 17:13:46 2013
    GEN0 started with pid=5, OS id=29129
    Mon Dec 23 17:13:46 2013
    DIAG started with pid=6, OS id=29131
    Mon Dec 23 17:13:46 2013
    DBRM started with pid=7, OS id=29133
    Mon Dec 23 17:13:46 2013
    DIA0 started with pid=8, OS id=29135
    Mon Dec 23 17:13:46 2013
    MMAN started with pid=9, OS id=29137
    Mon Dec 23 17:13:46 2013
    DBW0 started with pid=10, OS id=29139
    Mon Dec 23 17:13:46 2013
    DBW1 started with pid=11, OS id=29141
    Mon Dec 23 17:13:46 2013
    DBW2 started with pid=12, OS id=29143
    Mon Dec 23 17:13:46 2013
    DBW3 started with pid=13, OS id=29145
    Mon Dec 23 17:13:46 2013
    LGWR started with pid=14, OS id=29147
    Mon Dec 23 17:13:46 2013
    CKPT started with pid=15, OS id=29149
    Mon Dec 23 17:13:46 2013
    SMON started with pid=16, OS id=29151
    Mon Dec 23 17:13:46 2013
    RECO started with pid=17, OS id=29153
    Mon Dec 23 17:13:46 2013
    MMON started with pid=18, OS id=29155
    Mon Dec 23 17:13:46 2013
    MMNL started with pid=19, OS id=29157
    starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
    starting up 1 shared server(s) ...
    ORACLE_BASE from environment = /u01/oracle
    Mon Dec 23 17:13:46 2013
    ALTER DATABASE   MOUNT
    ARCH: STARTING ARCH PROCESSES
    Mon Dec 23 17:13:50 2013
    ARC0 started with pid=23, OS id=29210
    ARC0: Archival started
    ARCH: STARTING ARCH PROCESSES COMPLETE
    ARC0: STARTING ARCH PROCESSES
    Successful mount of redo thread 1, with mount id 2071851082
    Mon Dec 23 17:13:51 2013
    ARC1 started with pid=24, OS id=29212
    Allocated 15937344 bytes in shared pool for flashback generation buffer
    Mon Dec 23 17:13:51 2013
    ARC2 started with pid=25, OS id=29214
    Starting background process RVWR
    ARC1: Archival started
    ARC1: Becoming the 'no FAL' ARCH
    ARC1: Becoming the 'no SRL' ARCH
    Mon Dec 23 17:13:51 2013
    RVWR started with pid=26, OS id=29216
    Physical Standby Database mounted.
    Lost write protection disabled
    Completed: ALTER DATABASE   MOUNT
    Mon Dec 23 17:13:51 2013
    ALTER DATABASE RECOVER MANAGED STANDBY DATABASE
             USING CURRENT LOGFILE DISCONNECT FROM SESSION
    Attempt to start background Managed Standby Recovery process (primary_db)
    Mon Dec 23 17:13:51 2013
    MRP0 started with pid=27, OS id=29219
    MRP0: Background Managed Standby Recovery process started (primary_db)
    ARC2: Archival started
    ARC0: STARTING ARCH PROCESSES COMPLETE
    ARC2: Becoming the heartbeat ARCH
    ARC2: Becoming the active heartbeat ARCH
    ARCH: Archival stopped, error occurred. Will continue retrying
    ORACLE Instance primary_db - Archival Error
    ORA-16014: log 4 sequence# 7 not archived, no available destinations
    ORA-00312: online log 4 thread 1: '/u02/oracle/fast_recovery_area/standby_db/onlinelog/o1_mf_4_9c3tk3dy_.log'
    At this moment, I've lost service and I have to wait until the prmiary server goes up again to receive the missing log.
    This is the rest of the log:
    Fatal NI connect error 12543, connecting to:
    (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=node1)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=primary_db)(CID=(PROGRAM=oracle)(HOST=node2.localdomain)(USER=oracle))))
      VERSION INFORMATION:
            TNS for Linux: Version 11.2.0.4.0 - Production
            TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.4.0 - Production
      Time: 23-DEC-2013 17:13:52
      Tracing not turned on.
      Tns error struct:
        ns main err code: 12543
    TNS-12543: TNS:destination host unreachable
        ns secondary err code: 12560
        nt main err code: 513
    TNS-00513: Destination host unreachable
        nt secondary err code: 113
        nt OS err code: 0
    Fatal NI connect error 12543, connecting to:
    (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=node1)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=primary_db)(CID=(PROGRAM=oracle)(HOST=node2.localdomain)(USER=oracle))))
      VERSION INFORMATION:
            TNS for Linux: Version 11.2.0.4.0 - Production
            TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.4.0 - Production
      Time: 23-DEC-2013 17:13:55
      Tracing not turned on.
      Tns error struct:
        ns main err code: 12543
    TNS-12543: TNS:destination host unreachable
        ns secondary err code: 12560
        nt main err code: 513
    TNS-00513: Destination host unreachable
        nt secondary err code: 113
        nt OS err code: 0
    started logmerger process
    Mon Dec 23 17:13:56 2013
    Managed Standby Recovery starting Real Time Apply
    MRP0: Background Media Recovery terminated with error 16157
    Errors in file /u01/oracle/diag/rdbms/standby_db/primary_db/trace/primary_db_pr00_29230.trc:
    ORA-16157: media recovery not allowed following successful FINISH recovery
    Managed Standby Recovery not using Real Time Apply
    Completed: ALTER DATABASE RECOVER MANAGED STANDBY DATABASE
             USING CURRENT LOGFILE DISCONNECT FROM SESSION
    Recovery Slave PR00 previously exited with exception 16157
    MRP0: Background Media Recovery process shutdown (primary_db)
    Fatal NI connect error 12543, connecting to:
    (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=node1)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=primary_db)(CID=(PROGRAM=oracle)(HOST=node2.localdomain)(USER=oracle))))
      VERSION INFORMATION:
            TNS for Linux: Version 11.2.0.4.0 - Production
            TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.4.0 - Production
      Time: 23-DEC-2013 17:13:58
      Tracing not turned on.
      Tns error struct:
        ns main err code: 12543
    TNS-12543: TNS:destination host unreachable
        ns secondary err code: 12560
        nt main err code: 513
    TNS-00513: Destination host unreachable
        nt secondary err code: 113
        nt OS err code: 0
    Mon Dec 23 17:14:01 2013
    Fatal NI connect error 12543, connecting to:
    (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=node1)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=primary_db)(CID=(PROGRAM=oracle)(HOST=node2.localdomain)(USER=oracle))))
      VERSION INFORMATION:
            TNS for Linux: Version 11.2.0.4.0 - Production
            TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.4.0 - Production
      Time: 23-DEC-2013 17:14:01
      Tracing not turned on.
      Tns error struct:
        ns main err code: 12543
    TNS-12543: TNS:destination host unreachable
        ns secondary err code: 12560
        nt main err code: 513
    TNS-00513: Destination host unreachable
        nt secondary err code: 113
        nt OS err code: 0
    Error 12543 received logging on to the standby
    FAL[client, ARC0]: Error 12543 connecting to primary_db for fetching gap sequence
    Archiver process freed from errors. No longer stopped
    Mon Dec 23 17:15:07 2013
    Using STANDBY_ARCHIVE_DEST parameter default value as /u02/oracle/archivelogs/primary_db
    Mon Dec 23 17:19:51 2013
    ARCH: Archival stopped, error occurred. Will continue retrying
    ORACLE Instance primary_db - Archival Error
    ORA-16014: log 4 sequence# 7 not archived, no available destinations
    ORA-00312: online log 4 thread 1: '/u02/oracle/fast_recovery_area/standby_db/onlinelog/o1_mf_4_9c3tk3dy_.log'
    Mon Dec 23 17:26:18 2013
    RFS[1]: Assigned to RFS process 31456
    RFS[1]: No connections allowed during/after terminal recovery.
    Mon Dec 23 17:26:47 2013
    flashback database to scn 15921680
    ORA-16157 signalled during: flashback database to scn 15921680...
    Mon Dec 23 17:27:05 2013
    alter database recover managed standby database using current logfile disconnect
    Attempt to start background Managed Standby Recovery process (primary_db)
    Mon Dec 23 17:27:05 2013
    MRP0 started with pid=28, OS id=31481
    MRP0: Background Managed Standby Recovery process started (primary_db)
    started logmerger process
    Mon Dec 23 17:27:10 2013
    Managed Standby Recovery starting Real Time Apply
    MRP0: Background Media Recovery terminated with error 16157
    Errors in file /u01/oracle/diag/rdbms/standby_db/primary_db/trace/primary_db_pr00_31486.trc:
    ORA-16157: media recovery not allowed following successful FINISH recovery
    Managed Standby Recovery not using Real Time Apply
    Completed: alter database recover managed standby database using current logfile disconnect
    Recovery Slave PR00 previously exited with exception 16157
    MRP0: Background Media Recovery process shutdown (primary_db)
    Mon Dec 23 17:27:18 2013
    RFS[2]: Assigned to RFS process 31492
    RFS[2]: No connections allowed during/after terminal recovery.
    Mon Dec 23 17:28:18 2013
    RFS[3]: Assigned to RFS process 31614
    RFS[3]: No connections allowed during/after terminal recovery.
    Do you have any advice?
    Thanks!
    Alex.

    Hello;
    What's not clear to me in your question at this point:
    What I'm NOT being able to perform:
    If I manually unplug the network cables from the primary site (all the network, not only the link between primary and standby node so, it's like a server unplug from the energy source).
    Same situation happens if I manually disconnect the server from the power.
    This is the alert logs I have:"
    Are you trying a failover to the Standby?
    Please advise.
    Is it possible your "valid_for clause" is set incorrectly?
    Would also review this:
    ORA-16014 and ORA-00312 Messages in Alert.log of Physical Standby
    Best Regards
    mseberg

Maybe you are looking for