Physical Standby: RFS: 'Attach' request version mismatch
I have a 10.1.0.4 database that I want to move to a new machine and also upgrade to 10.2.0.1. I'm trying to follow the instructions for using SQL Apply to perforn a rolling upgrade with minimal downtime. My understanding is that I must first create a physical standby, and then transition the physical standby to a logical standby. Well, my physical standby is failing. I see the following in the standby's alert log:
RFS: 'Attach' request version mismatch
Both databases have their COMPATIBLE parameter set to 10.1.0.2.
As an aside, if I must first create a working physical standby, then why do I need to transition that standby to a logical standby? I mean, can't I just get the physical standby working, perform a switchover, and be done with it?
I was confused. I thought I could just create a 10.2.0.1 standby for a 10.1.0.4 primary. The process, though, is to first get a working 10.1.0.4 (logical) standby for the 10.1.0.4 primary. At that point dbua can be used to upgrade the standby, and I can go from there.
I'm sure everything will work, now that I understand the steps required.
Similar Messages
-
Logical and Physical Standby Practice
Hello Gurus
I am now attempting to practice Oracle Data Guard and in this direction I understand since 10g we have logical standby server as well as a physical standby server. While I am gathering information and knowledge about the data guard as is and varisous modes and types possible with oracle 10g and 11g in specific, an attempt to upgrade my self and learn these set-ups and understand them in detail.. I come to you for some guidence..
I am referring to Oracle Documentation for these details. At the same time I also approach you to share your experiences .. may be a link apart from the documentation of oracle which you might want to refer me to use as a quick reference.. some thing that a person like me .. fairly new to this set-up understand it and then attempt to come up with one..
This is for my practise and learning purpose.
Sarat.Logical Standby was already introduced in 9i. It differs from physical standby in the way, the redo protocol, transmitted from the primary, gets used to actualize the standby. With logical standby, you have SQL APPLY - basically, we try to generate the same SQL that was done on the primary from the redo protocol that was written on behalf of that SQL on the primary. That SQL then is done on the OPEN instance at the logical standby.
In case of a physical standby, the redo protocol from the primary is used to do RECOVERY - called REDO APPLY - to actualize the standby.
Since 10g, the sames protection levels can be achieved with logical or physical standby.
Drawback of logical standby: Not all kinds of SQL and all datatypes are supported
Drawback of physical standby: It is mounted (versions before 11g) while being recoverd - or in 11g, REDO APPLY in READ ONLY status is possible but comes with an extra charge (ACTIVE DATA GUARD feature).
If you look on my Blog, I have some examples about creating physical & logical standby DBs
Kind regards
Uwe
http://uhesse.wordpress.com -
Can read-only standby be cascaded from another DR physical standby
we are going to have one two-node RAC database in the primary site (site A), one Data Guard maintained standby database in the DR site (site B) and one ACTIVE Data Guard maintained read-only database for reporting (site C, on the same subnet as site B). My question is what is the best practice for the data guard configuration in terms of the redo log transportation, Is it possible to set up relay of redo log transport from one physical standby to another (database version 11gR2, data guard in Maximum Performance Mode):
1) A->B->C (minimum overhead to primary site A, maximum delay to report site C)
2) A->C->B (minimum overhead to primary site A, maximum delay to DR site C)
3) A->B; A-C (maximum overhead to primary site A, minimum delay to site B and C)
Are all three configuration possible, which one would you recommend?
Any discussion document or white paper about the above configuration you can point to for me (I gather the scenario may be rare, but multiple physical standby instances set up are not uncommon, if to ignore active data guard part) ?
Edited by: user10786648 on 24/07/2012 17:40
Edited by: user10786648 on 24/07/2012 17:47
Edited by: user10786648 on 24/07/2012 23:36Hello;
Welcome to the forum.
minimum overhead to primary site A, maximum delay to report site - ( I don't believe in emergency reports, Primary should rule. )
Will refer to these white papers :
Data Guard Redo Transport & Network Best Practices
http://www.oracle.com/technetwork/database/features/availability/maa-wp-10gr2-dataguardnetworkbestpr-134557.pdf
And
Rapid Oracle RAC Standby
http://www.oracle.com/technetwork/database/availability/maa-wp-11g-racone-standby-501088.pdf
And of General interest
Oracle Data Guard with Oracle Database 11g Release 2
http://www.oracle.com/technetwork/database/features/availability/twp-dataguard-11gr2-1-131981.pdf
Oracle Data Guard Technical White Papers
http://www.oracle.com/technetwork/database/features/availability/data-guard-technical-info-152834.html
http://grokbase.com/t/freelists.org/oracle-l/11c18th65t/active-dataguard-ndash-ndash-cascade-standby-or-not
Best Regards
mseberg
Edited by: mseberg on Jul 24, 2012 7:55 PM -
Physical standby database Version 11g Creation over grid control 10g
We are useing oracale 11g enterprise edition and want to create a physical standby database on another machine:
On primary host we've installed "standard database" and turned on archive log mode over em.
On the standby host we've installed only oracle without a database and without a listener.
On a third machine we've installed grid control and registered the primary and standby hosts. Using EM with Data Grid I'm attempting to create a Physical Standby on standby host. Everything is working except for the last part as noted here:
SQL*Plus: Release 11.1.0.6.0 - Production on Do Apr 3 11:21:17 2008
Copyright (c) 1982, 2007, Oracle. All rights reserved.
SQL> SQL> Bei einer nicht hochgefahrenen Instance angemeldet.
SQL> SQL> ORA-32004: obsolete and/or deprecated parameter(s) specified
ORACLE-Instance hochgefahren.
Total System Global Area 535662592 bytes
Fixed Size 1334380 bytes
Variable Size 167773076 bytes
Database Buffers 360710144 bytes
Redo Buffers 5844992 bytes
SQL>
Datenbank wurde geändert.
SQL> Verbindung zu Oracle Database 11g Enterprise Edition Release 11.1.0.6.0 - Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options beendet
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE 'C:\ORACLE\ORADATA\TTDB1\SYSTEM01.DBF' to 'c:\oracle\product\11.1.0\db_1\oradata\dg3\SYSTEM01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = 'C:\ORACLE\ORADATA\TTDB1\SYSTEM01.DBF'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE 'C:\ORACLE\ORADATA\TTDB1\SYSAUX01.DBF' to 'c:\oracle\product\11.1.0\db_1\oradata\dg3\SYSAUX01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = 'C:\ORACLE\ORADATA\TTDB1\SYSAUX01.DBF'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE 'C:\ORACLE\ORADATA\TTDB1\UNDOTBS01.DBF' to 'c:\oracle\product\11.1.0\db_1\oradata\dg3\UNDOTBS01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = 'C:\ORACLE\ORADATA\TTDB1\UNDOTBS01.DBF'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE 'C:\ORACLE\ORADATA\TTDB1\USERS01.DBF' to 'c:\oracle\product\11.1.0\db_1\oradata\dg3\USERS01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = 'C:\ORACLE\ORADATA\TTDB1\USERS01.DBF'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE 'C:\ORACLE\ORADATA\TTDB1\EXAMPLE01.DBF' to 'c:\oracle\product\11.1.0\db_1\oradata\dg3\EXAMPLE01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = 'C:\ORACLE\ORADATA\TTDB1\EXAMPLE01.DBF'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE 'C:\ORACLE\ORADATA\TTDB1\REDO01.LOG' to 'c:\oracle\product\11.1.0\db_1\oradata\dg3\REDO01.log'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE 'C:\ORACLE\ORADATA\TTDB1\REDO02.LOG' to 'c:\oracle\product\11.1.0\db_1\oradata\dg3\REDO02.log'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE 'C:\ORACLE\ORADATA\TTDB1\REDO03.LOG' to 'c:\oracle\product\11.1.0\db_1\oradata\dg3\REDO03.log'
dgcreate.DGrenameFiles: ALTER DATABASE CLEAR LOGFILE GROUP 1
dgcreate.DGrenameFiles: ALTER DATABASE CLEAR LOGFILE GROUP 2
dgcreate.DGrenameFiles: ALTER DATABASE CLEAR LOGFILE GROUP 3
dgcreate.DGgetRecoverySCN: SELECT MAX(NEXT_CHANGE#) FROM V$ARCHIVED_LOG
dgcreate.DGrecoverStby: ALTER DATABASE RECOVER AUTOMATIC FROM '%ORACLE_HOME%\RDBMS' STANDBY DATABASE UNTIL CHANGE 1061001
dgcreate.DGrecoverStby: ALTER DATABASE RECOVER CANCEL
dgcreate.DGrecoverStby: ALTER DATABASE OPEN READ ONLY
SQL Error: ORA-16004: Sciherungs-Datenbank muss wiederhergestellt werden
ORA-01152: Backup-Datei zum Wiederherstellen der Datei 1 war nicht alt genug
ORA-01110: Datendatei 1: 'C:\ORACLE\PRODUCT\11.1.0\DB_1\ORADATA\DG3\SYSTEM01.DBF' (DBD ERROR: OCIStmtExecute)
What is to do?
What mean's in this case:
"ORA-01152 file string was not restored from a sufficiently old backup
Cause: An incomplete recovery session was started, but an insufficient number of redo logs were applied to make the database consistent. This file is still in the future of the last redo log applied. The most likely cause of this message is forgetting to restore the file from backup before doing incomplete recovery.
Action: Apply additional redo log files until the database is consistent or restore the datafiles from an older backup and repeat recovery."Thanks for your immediate reply,
but there's a problem: We don't create the standby database manually. The creation is done by data guard over grid control. And the "automatic" creation stopps at this point.
Unfortunatly we don't know, wich steps of a manuall standby database creation are done and wich steps are not done at this point.
The oracle documentation (for release 11g) to create a manuall standby database is "B28294-02". But there's no step 5 "alter database recover managed standby database disconnect from session". Do you mean step 4 of chapter 3.2.6?
Is there no way, to create a standby database automatically over grid control? Or do we have to do something else before creating the physical standby database? Perhaps we have to create a full backup after switching to archive log mode? -
Physical standby database standby redo log problem
Hello
We have a physical standby database , I've created some standby redo log files but my problem is that they aren't used,
their status in v$stanby_log view is UNASSIGNED
and I see this message (ORA-16086: standby database does not contain available standby log files) in primary database alert_log file
while when I run "alter system switch logfile" in the primary database it transfer redo logs to the physsical standby database
and archive log file will be created in standby database
I've even recreated the standby redo log files and I added new ones to them but the problem wasn't solved
Do you know what is problem ?
elect group#,THREAD#,BYTES,STATUS from V$STANDBY_LOG;
group# THREAD# BYTES STATUS
1 0 524288000 UNASSIGNED
2 0 524288000 UNASSIGNED
3 0 524288000 UNASSIGNED
8 0 524288000 UNASSIGNED
9 0 524288000 UNASSIGNED
10 0 524288000 UNASSIGNED
select group#,THREAD#,BYTES,MEMBERS,STATUS from v$log;
group# THREAD# BYTES MEMBERS STATUS
4 1 524288000 2 CLEARING
7 1 524288000 2 CLEARING_CURRENT
6 1 524288000 2 CLEARING
5 1 524288000 2 CLEARING
thanksHello Anurag
Thank you for your reply
I have found some issue in the standby database alert_log too , in the standby database alert_log it has been written:
RFS[782]: Assigned to RFS process 3919
RFS[782]: Identified database type as 'physical standby'
Primary database is in MAXIMUM AVAILABILITY mode
Standby controlfile consistent with primary
Primary database is in MAXIMUM AVAILABILITY mode
Standby controlfile consistent with primary
RFS[782]: No standby redo logfiles selected (reason:6)
Sun Jan 31 13:59:43 2010
Errors in file /u01/app/oracle/admin/tehrep/udump/tehrep_rfs_3919.trc:
ORA-16086: standby database does not contain available standby log files
Sun Jan 31 13:59:48 2010
RFS[781]: Archived Log: '/disks/sda/tehrep/archivelogs/1_6516_670414641.dbf'
Sun Jan 31 13:59:50 2010
and the context "/u01/app/oracle/admin/tehrep/udump/tehrep_rfs_3919.trc" is below :
+/u01/app/oracle/admin/tehrep/udump/tehrep_rfs_3919.trc+
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - Production
With the Partitioning, OLAP and Data Mining options
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db_1
System name: Linux
Node name: linserver2.com
Release: 2.6.9-42.ELsmp
Version: #1 SMP Wed Jul 12 23:27:17 EDT 2006
Machine: i686
Instance name: tehrep
Redo thread mounted by this instance: 1
Oracle process number: 58
Unix process pid: 3919, image: [email protected]
*** SERVICE NAME:() 2010-01-31 13:59:43.865
*** SESSION ID:(109.1225) 2010-01-31 13:59:43.865
KCRRFLAS
KCRRSNPS
No space in recovery area for active standby redo logs
The primary database is operating in MAXIMUM PROTECTION
or MAXIMUM AVAILABILITY mode, and the standby database
does not contain adequate disk space in the recovery area
to safely archive the contents of the standby redo logfiles.
ORA-16086: standby database does not contain available standby log files
when I saw this line "No space in recovery area for active standby redo logs" I thought that STANDBY_ARCHIVE_DEST parameter points where that there is no enough space , but when I consider I found out that points a directory on disk a "sda" that has enough space , I don't know what that means
by the way, at below I've written a section of the primary database alert_log context and "lgwr" trace file around Sun Jan 31 13:30:34 2010
alert_log :
ORA-16086: standby database does not contain available standby log files
Sun Jan 31 13:30:34 2010
LGWR: Failed to archive log 7 thread 1 sequence 6512 (16086)
Thread 1 advanced to log sequence 6512
Current log# 7 seq# 6512 mem# 0: /disks/sdb/tehrep/redo71.log
Current log# 7 seq# 6512 mem# 1: /disks/sdd/tehrep/redo72.log
LNSc started with pid=53, OS id=11451
Sun Jan 31 13:36:34 2010
Errors in file /u01/app/oracle/admin/tehrep/bdump/tehrep_lgwr_3692.trc:
ORA-16086: standby database does not contain available standby log files
Sun Jan 31 13:36:34 2010
LGWR: Failed to archive log 5 thread 1 sequence 6513 (16086)
Thread 1 advanced to log sequence 6513
Current log# 5 seq# 6513 mem# 0: /disks/sdb/tehrep/redo51.log
Current log# 5 seq# 6513 mem# 1: /disks/sdd/tehrep/redo52.log
*/u01/app/oracle/admin/tehrep/bdump/tehrep_lgwr_3692.trc file :*
Error 16086 creating standby archive log file at host '(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=tcp)(HOST=linserver2.com
+)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=tehrep_XPT.com)(INSTANCE_NAME=tehrep)(SERVER=dedicated)))'+
*** 2010-01-31 13:30:34.712 60679 kcrr.c
LGWR: Attempting destination LOG_ARCHIVE_DEST_3 network reconnect (16086)
*** 2010-01-31 13:30:34.712 60679 kcrr.c
LGWR: Destination LOG_ARCHIVE_DEST_3 network reconnect abandoned
ORA-16086: standby database does not contain available standby log files
*** 2010-01-31 13:30:34.712 60679 kcrr.c
LGWR: Error 16086 creating archivelog file '(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=tcp)(HOST=linserver2.com)(PORT=1521
+)))(CONNECT_DATA=(SERVICE_NAME=tehrep_XPT.com)(INSTANCE_NAME=tehrep)(SERVER=dedicated)))'+
*** 2010-01-31 13:30:34.712 58941 kcrr.c
kcrrfail: dest:3 err:16086 force:0 blast:1
Receiving message from LNSc
*** 2010-01-31 13:30:34.718 55444 kcrr.c
Making upidhs request to LNSc (ocis 0x0xb648db48). Begin time is <01/31/2010 13:30:30> and NET_TIMEOUT <180> seconds
NetServer pid:11196
*** 2010-01-31 13:30:38.718 55616 kcrr.c
upidhs done status 0
*** 2010-01-31 13:36:31.062
LGWR: Archivelog for thread 1 sequence 6513 will NOT be compressed
*** 2010-01-31 13:36:31.062 53681 kcrr.c
+Initializing NetServer[LNSc] for dest=(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=tcp)(HOST=linserver2.com)(PORT=1521)))(CO+
NNECT_DATA=(SERVICE_NAME=tehrep_XPT.com)(INSTANCE_NAME=tehrep)(SERVER=dedicated))) mode SYNC
LNSc is not running anymore.
New SYNC LNSc needs to be started
Waiting for subscriber count on LGWR-LNSc channel to go to zero
Subscriber count went to zero - time now is <01/31/2010 13:36:31>
Starting LNSc ...
Waiting for LNSc to initialize itself
*** 2010-01-31 13:36:34.116 53972 kcrr.c
+Netserver LNSc [pid 11451] for mode SYNC has been initialized+
Performing a channel reset to ignore previous responses
+Successfully started LNSc [pid 11451] for dest (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=tcp)(HOST=linserver2.com)(PORT=1+
+521)))(CONNECT_DATA=(SERVICE_NAME=tehrep_XPT.com)(INSTANCE_NAME=tehrep)(SERVER=dedicated))) mode SYNC ocis=0x0xb648db48+
*** 2010-01-31 13:36:34.116 54475 kcrr.c
+Making upiahm request to LNSc [pid 11451]: Begin Time is <01/31/2010 13:36:31>. NET_TIMEOUT = <180> seconds+
Waiting for LNSc to respond to upiahm
*** 2010-01-31 13:36:34.266 54639 kcrr.c
upiahm connect done status is 0
Receiving message from LNSc
Receiving message from LNSc
Destination LOG_ARCHIVE_DEST_3 is in STANDBY RESYNCHRONIZATION mode
Receiving message from LNSc -
Unable to open the physical standby in read only (10g)
Hi,
I m trying to create physical standby using RMAN to another server . But at the last step when trying to test Real Time Apply i m unable to open the standby in read only mode.Can Anyone please let me know whats the issue and how to resolve it
SQL> select status from v$instance;
STATUS
MOUNTED
SQL> alter database recover managed standby database using current logfile disconnect from session;
Database altered.
SQL> alter database recover managed standby database cancel;
Database altered.
SQL> alter database open read only;
alter database open read only
ERROR at line 1:
ORA-16004: backup database requires recovery
ORA-01152: file 1 was not restored from a sufficiently old backup
ORA-01110: data file 1:
'/u01/app/oracle/product/10.2.0/oradata/test1/system.dbf'Hi,
This is a newly created standby. I created just now. Below the o/p requested
In Primary
SQL> set line 200
SQL> set pagesize 200
SQL> col message format a90
SQL> select severity, error_code, to_char(timestamp,'DD-MON-YYYY HH24:MI:SS'), message from v$dataguard_status where dest_id=2;
SEVERITY ERROR_CODE TO_CHAR(TIMESTAMP,'D MESSAGE
Error 12541 04-MAR-2012 11:55:05 PING[ARC1]: Heartbeat failed to connect to standby 'test1'. Error is 12541.
Error 12541 04-MAR-2012 12:00:12 PING[ARC1]: Heartbeat failed to connect to standby 'test1'. Error is 12541.
Error 1034 04-MAR-2012 12:06:25 PING[ARC1]: Heartbeat failed to connect to standby 'test1'. Error is 1034.
Warning 3113 04-MAR-2012 13:21:24 ARC1: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (3113)
Warning 3113 04-MAR-2012 13:21:24 ARC1: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Error 3113 04-MAR-2012 13:21:24 PING[ARC1]: Error 3113 when pinging standby test1.
Warning 3113 04-MAR-2012 13:33:29 ARC1: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (3113)
Warning 3113 04-MAR-2012 13:33:29 ARC1: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Error 3113 04-MAR-2012 13:33:29 PING[ARC1]: Error 3113 when pinging standby test1.
Error 1034 04-MAR-2012 13:39:50 PING[ARC1]: Heartbeat failed to connect to standby 'test1'. Error is 1034.
Error 1034 04-MAR-2012 13:45:29 PING[ARC1]: Heartbeat failed to connect to standby 'test1'. Error is 1034.
Warning 3113 04-MAR-2012 13:57:56 ARC1: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (3113)
Warning 3113 04-MAR-2012 13:57:56 ARC1: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Error 3113 04-MAR-2012 13:57:56 PING[ARC1]: Error 3113 when pinging standby test1.
14 rows selected.
SQL> select ds.dest_id id
, ad.status
, ds.database_mode db_mode
, ad.archiver type
, ds.recovery_mode
, ds.protection_mode
, ds.standby_logfile_count "SRLs"
, ds.standby_logfile_active active
, ds.archived_seq#
from v$archive_dest_status ds
, v$archive_dest ad
where ds.dest_id = ad.dest_id
and ad.status != 'INACTIVE'
order by
ds.dest_id
/ 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
ID STATUS DB_MODE TYPE RECOVERY_MODE PROTECTION_MODE SRLs ACTIVE ARCHIVED_SEQ#
1 VALID OPEN ARCH IDLE MAXIMUM PERFORMANCE 0 0 64
2 VALID UNKNOWN ARCH UNKNOWN MAXIMUM PERFORMANCE 3 0 64In standby
SQL> select thread#,max(sequence#) from v$archived_log where applied='YES' group by thread#;
THREAD# MAX(SEQUENCE#)
1 64
SQL> select thread#,max(sequence#) from v$archived_log group by thread#;
THREAD# MAX(SEQUENCE#)
1 64
SQL> select message from v$dataguard_status;
MESSAGE
ARC0: Archival started
ARC1: Archival started
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
ARC0: Becoming the heartbeat ARCH
Attempt to start background Managed Standby Recovery process
MRP0: Background Managed Standby Recovery process started
Managed Standby Recovery starting Real Time Apply
Media Recovery Waiting for thread 1 sequence 63
Redo Shipping Client Connected as PUBLIC
-- Connected User is Valid
MESSAGE
RFS[1]: Assigned to RFS process 9880
RFS[1]: Identified database type as 'physical standby'
Media Recovery Log /u01/app/oracle/product/10.2.0/archive/test1/1_63_776981781.arc
Media Recovery Log /u01/app/oracle/product/10.2.0/archive/test1/1_64_776981781.arc
Media Recovery Waiting for thread 1 sequence 65
16 rows selected. -
Problem While Creating Physical Standby Using RMAN
Hi Guru's
May be this incidence you all face while creating physical standby DB. I try to create Physical standby database Using RMAN Duplicate Command from one server
(pri machine) to Standby Machine.
The steps i followed to create the above are as follows:
Step 1:- Enable Forced Logging
SQL> ALTER DATABASE FORCE LOGGING;
Step 2:- Configure a Standby Redo Log
SQL> ALTER DATABASE ADD STANDBY LOGFILE GROUP 10
2> ('/oracle/dbs/log1c.rdo','/oracle/dbs/log2c.rdo') SIZE 500M;
Step 3:- Set Primary Database Initialization Parameters
SQL> create pfile='?/dbs/pfileorcl.ora' from spfile;
Edit the pfile to add the standby parameters, here shown:
db_unique_name='orcl'
LOG_ARCHIVE_CONFIG='DG_CONFIG=(orcl,orcldr)'
LOG_ARCHIVE_DEST_2='SERVICE=orcldr LGWR ASYNC VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=orcldr'
*.fal_server=orcldr
*.fal_client=orcl
*.standby_file_management=auto
Step 4:- Enable Archiving
SQL> SHUTDOWN IMMEDIATE;
SQL> STARTUP MOUNT;
SQL> ALTER DATABASE ARCHIVELOG;
SQL> ALTER DATABASE OPEN;
Step 5:- Setup tnsnames for standby database
This should be done on primary database by altering tnsnames.ora or using NetCA command, and create it by the name orcldr
orcldr =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = standby-svr)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = orcldr)
Step 6:- Backup database and copy it to standby
This backup script should be run on primary and copied to standby on the same mount point, running this scripts using RMAN, all files under /rman_backup should be copied to /rman_backup on standby server.
$rman target /
RMAN> run
allocate channel c1 type disk;
allocate channel c2 type disk;
backup database format '/rman_backup/%U';
backup archivelog all format '/rman_backup /%U';
backup current controlfile for standby format '/rman_backup/%U';
Step 7:- Standby Database Steps
Installing Oracle Software
This should be same release and patchset with exactly same ORACLE_HOME mount point.
Setting Up listener
Create and start a listener on standby database using NetCA, or creating listener.ora in $ORACLE_HOME/network/admin
LISTENER =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = standby-svr)(PORT = 1521))
Step 8:- Set Standby Database Initialization Parameters
Copying the pfile created in primary database and renames it to initorcldr.ora, and changes these parameters:
db_unique_name='orcldr'
LOG_ARCHIVE_CONFIG='DG_CONFIG=(orcldr,orcl)'
LOG_ARCHIVE_DEST_2='SERVICE=orcl LGWR ASYNC VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=orcl'
*.fal_server=orcl
*.fal_client=orcldr
*.LOG_ARCHIVE_DEST_STATE_2='ENABLE'
Step 9:- Setup tnsnames for primary database
This should be done on standby database by altering tnsnames.ora or using NetCA command, and create it by the name orcl
orcl =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = primary-svr)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = orcl)
Step 10:- Copy a Password File
A password file must be created on the Primary and copied over to the Standby site. The sys password must be identical on both sites. Copy orapworcl to $ORACLE_HOME/dbs and rename file to orapworcldr
Step 11:- Create mount points for Oracle
Mount point should be created on standby server with the same convention used in primary, this includes the location for controlfiles, redo logs, datafiles, archive log destination and alert logs.
$ mkdir -p /u01/app/oracle/oradata/orcl/
$ mkdir -p /u01/app/oracle/flash_recovery_area/
$ mkdir -p /u01/app/oracle/admin/orcl/adump
$ mkdir -p /u01/app/oracle/admin/orcl/bdump
$ mkdir -p /u01/app/oracle/admin/orcl/cdump
$ mkdir -p /u01/app/oracle/admin/orcl/udump
Step 12:- Use RMAN to restore backup and setup standby
Connect to RMAN and execute the following command to create standby database, this should be performed on standby server after copying backup and setting tnsnames.
$ export ORACLE_SID=orcldr
$ rman target sys/tiger@orcl auxiliary sys/tiger@orcldr
RMAN> duplicate target database for standby dorecover;
Here i am getting problem as :
While trying to connect to traget database and auxiliary database i notice that when RMAN is connect to both databases it shows
orcl ( DBID xyz)
orcl (not mounted)
Here in my view the second database must be standby database name or auxiiary db name is standby db name which in my case is orcldr
after this issue i am facing the second issues as :
in command
duplicate target database for standby dorecover;
After modifying the command to
RMAN> duplicate target database to "standby";
rman-05520 database name mismatch
Can u please let me know where i am mistakingok for pri:
db_name=orcl
db_unique_name=orcl
for standby:
db_name=orcl
db_unique_name=sbyorcl ( i change orcldr to sbyorcl later)for new testing
but now what i am getting on
Verify connectivity
On Primary Server:
C:\> lsnrctl stop LISTENERI (working fine)
C:\> lsnrctl start LISTENER (working fine)
C:\> tnsping orcl (working fine)
C:\> tnsping sbyorcl (working fine)
C:\> sqlplus sys/xxxxx@orcl (working fine)
C:\> sqlplus sys/xxxxx@sbyorcl (not working fine)
ERROR:
ORA-12514: TNS:listener does not currently know of service requested in connect
descriptor
On Standby Server:
C:\>lsnrctl stop LISTENER
C:\> lsnrctl start LISTENER
C:\> tnsping orcl
C:\> tnsping sbyorcl
C:\> sqlplus sys/xxxxx@orcl
C:\> sqlplus sys/xxxxx@sbyorcl
My listner file for pri :-
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(GLOBAL_DBNAME = orcl)
(ORACLE_HOME = C:\oracle\product\10.2.0\db_1)
(SID_NAME = ORCL)
LISTENER =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.202.129)(PORT = 1521))
tnsnames.ora file on pri is:
sbyorcl =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.202.128)(PORT = 1521))
(CONNECT_DATA =
(SERVICE_NAME = sbyorcl)
ORCL =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.202.129)(PORT = 1521))
(CONNECT_DATA =
(SERVICE_NAME = orcl)
and listener file on standby :
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(SID_NAME = PLSExtProc)
(ORACLE_HOME = C:\oracle\product\10.2.0\db_1)
(PROGRAM = extproc)
(SID_DESC =
(GLOBAL_DBNAME = orcl)
(ORACLE_HOME = C:\oracle\product\10.2.0\db_1)
(SID_NAME = orcl)
LISTENER =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.202.128)(PORT = 1521))
(DESCRIPTION =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC0))
and tnsnames.ora file on standby:
ORCL =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.202.128)(PORT = 1521))
(CONNECT_DATA =
(SERVICE_NAME = orcl)
sbyorcl =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.202.129)(PORT = 1521))
(CONNECT_DATA =
SERVICE_NAME = sbyorcl)
EXTPROC_CONNECTION_DATA =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC0))
(CONNECT_DATA =
(SID = PLSExtProc)
(PRESENTATION = RO)
Kinldy guide me where i am mistaking it's urgent -
Oracle 10g physical standby error
Hi all,
We been frequently getting this error on our standby DB and not sure if it's network related or a possible configuration tuning.
RFS[425]: Assigned to RFS process 3640
RFS[425]: Identified database type as 'physical standby'
Primary database is in MAXIMUM PERFORMANCE mode
Primary database is in MAXIMUM PERFORMANCE mode
RFS[425]: No standby redo logfiles created
Mon Nov 23 09:47:28 2009
Fetching gap sequence in thread 1, gap sequence 35418-35418
Mon Nov 23 09:48:02 2009
FAL[client]: Failed to request gap sequence
GAP - thread 1 sequence 35418-35418
DBID 3292763437 branch 615642223
FAL[client]: All defined FAL servers have been attempted.
Check that the CONTROL_FILE_RECORD_KEEP_TIME initialization
parameter is defined to a value that is sufficiently large
enough to maintain adequate log switch information to resolve
archivelog gaps.
Mon Nov 23 09:48:17 2009
RFS[384]: No standby redo logfiles created
Mon Nov 23 09:48:21 2009
RFS[425]: Possible network disconnect with primary database
Closing latent archivelog for thread 1 sequence 35419
EOF located at block 1201 low SCN 0:-1055223653 next SCN 0:-1055223015
Latent archivelog 'E:\ORACLE\ARCH\xxxxx\LOG_615642223_1_35419.ARC'
If you wish to failover to this standby database, you should use the
following command to manually register the archivelog for recovery:
ALTER DATABASE REGISTER LOGFILE 'E:\ORACLE\ARCH\xxxxx\LOG_xxx615642223_1_35419.ARC';
Redo Shipping Client Connected as PUBLIC
-- Connected User is Valid
RFS[426]: Assigned to RFS process 3200
RFS[426]: Identified database type as 'physical standby'
Primary database is in MAXIMUM PERFORMANCE mode
Primary database is in MAXIMUM PERFORMANCE mode
RFS[426]: No standby redo logfiles created
Any ideas?
thxI've inherited this DB and never really looked at the settings.
The error I see in the primary DB is
FAL[server]: Fail to queue the whole FAL gap
Protection level on primary is
SQL> SELECT PROTECTION_MODE, PROTECTION_LEVEL FROM V$DATABASE;
PROTECTION_MODE PROTECTION_LEVEL
MAXIMUM PERFORMANCE MAXIMUM PERFORMANCE
Edited by: jrmtl on Nov 23, 2009 7:32 AM -
Redologs in physical standby database
The MRP process is started and the standby database is physical standby, which is running under managed standby. My Question is as below
1. Under managed recovery mode do we require the redo logs created on the physical standby database.
2. How does oracle keep the database in sync when there are no redo logs are created on the standby database.The output is as below
SQL> select status, pid, sequence# from v$managed_standby where process like 'MRP%';
STATUS PID SEQUENCE#
WAIT_FOR_GAP 29710 88576
SQL>
The contents of alertlog ; i Just restarted the managed recovery to capture the information
RFS[1]: Archived Log: '/u02/archive/1_88817_665420030.dbf'
Sun Apr 18 18:34:26 2010
RFS[2]: No standby redo logfiles created
RFS[2]: Archived Log: '/u02/archive/1_88818_665420030.dbf'
Sun Apr 18 18:44:26 2010
RFS[3]: No standby redo logfiles created
RFS[3]: Archived Log: '/u02/archive/1_88819_665420030.dbf'
Sun Apr 18 18:54:26 2010
RFS[4]: No standby redo logfiles created
RFS[4]: Archived Log: '/u02/archive/1_88820_665420030.dbf'
Sun Apr 18 18:56:32 2010
alter database recover managed standby database cancel
Sun Apr 18 18:56:50 2010
MRP0: Background Media Recovery cancelled with status 16037
Sun Apr 18 18:56:50 2010
Errors in file /opt/home/oracle/admin/rmdp3/bdump/rmdp3_mrp0_29710.trc:
ORA-16037: user requested cancel of managed recovery operation
Recovery interrupted!
Sun Apr 18 18:56:51 2010
Waiting for MRP0 pid 29710 to terminate
Sun Apr 18 18:56:51 2010
Errors in file /opt/home/oracle/admin/rmdp3/bdump/rmdp3_mrp0_29710.trc:
ORA-16037: user requested cancel of managed recovery operation
Sun Apr 18 18:56:51 2010
MRP0: Background Media Recovery process shutdown (rmdp3)
Sun Apr 18 18:56:52 2010
Managed Standby Recovery Canceled (rmdp3)
Completed: alter database recover managed standby database cancel
Sun Apr 18 18:57:19 2010
alter database recover managed standby database disconnect
from session
Sun Apr 18 18:57:19 2010
Attempt to start background Managed Standby Recovery process (rmdp3)
MRP0 started with pid=19, OS id=2123
Sun Apr 18 18:57:19 2010
MRP0: Background Managed Standby Recovery process started (rmdp3)
Managed Standby Recovery not using Real Time Apply
Sun Apr 18 18:57:24 2010
Errors in file /opt/home/oracle/admin/rmdp3/bdump/rmdp3_mrp0_2123.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u03/redologs/rmdp3/redo01.log'
ORA-27037: unable to obtain file status
SVR4 Error: 2: No such file or directory
Additional information: 3
Sun Apr 18 18:57:24 2010
Errors in file /opt/home/oracle/admin/rmdp3/bdump/rmdp3_mrp0_2123.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u03/redologs/rmdp3/redo01.log'
ORA-27037: unable to obtain file status
SVR4 Error: 2: No such file or directory
Additional information: 3
Clearing online redo logfile 1 /u03/redologs/rmdp3/redo01.log
Clearing online log 1 of thread 1 sequence number 88818
Sun Apr 18 18:57:24 2010
Errors in file /opt/home/oracle/admin/rmdp3/bdump/rmdp3_mrp0_2123.trc:
ORA-00313: open failed for members of log group 1 of thread 1
ORA-00312: online log 1 thread 1: '/u03/redologs/rmdp3/redo01.log'
ORA-27037: unable to obtain file status
SVR4 Error: 2: No such file or directory
Additional information: 3
Sun Apr 18 18:57:24 2010
Errors in file /opt/home/oracle/admin/rmdp3/bdump/rmdp3_mrp0_2123.trc:
ORA-19527: physical standby redo log must be renamed
ORA-00312: online log 1 thread 1: '/u03/redologs/rmdp3/redo01.log'
Clearing online redo logfile 1 complete
Media Recovery Waiting for thread 1 sequence 88576
Fetching gap sequence in thread 1, gap sequence 88576-88675
FAL[client]: Error fetching gap sequence, no FAL server specified
Sun Apr 18 18:57:25 2010
Completed: alter database recover managed standby database disconnect
from session
Sun Apr 18 18:57:54 2010
FAL[client]: Failed to request gap sequence
GAP - thread 1 sequence 88576-88675
DBID 440735188 branch 665420030
FAL[client]: All defined FAL servers have been attempted.
Check that the CONTROL_FILE_RECORD_KEEP_TIME initialization
parameter is defined to a value that is sufficiently large
enough to maintain adequate log switch information to resolve
archivelog gaps.
Edited by: user11982297 on Apr 18, 2010 10:58 AM -
Hi All,
I have a configured data guard in my local system . Please find the below configuration of the Data guard
Data Guard Type : - Physical Standby (Oracle version 11g)
Service Responsible for Log Transport : - ARCH
No Standby Redo log : - Neither in Primary Nor in Standby
I am trying to fail over by using command "alter database recover managed standby database finish"
Please find the below alert log info after this command .
Tue Dec 03 01:42:14 2013
alter database recover managed standby database finish
Attempt to do a Terminal Recovery (PRD)
Media Recovery Start: Managed Standby Recovery (PRD)
Fast Parallel Media Recovery enabled
Managed Standby Recovery not using Real Time Apply
Media Recovery Waiting for thread 1 sequence 145
Terminal Recovery timestamp is '12/03/2013 01:42:15'
Terminal Recovery: applying standby redo logs.
Terminal Recovery: thread 1 seq# 145 redo required
Media Recovery Waiting for thread 1 sequence 145
Terminal Recovery: End-Of-Redo log allocation
Terminal Recovery: standby redo logfile 3 created '/data/PRD_DR/arch/arch_1_0_831359165.arch'
This standby redo logfile is being created as part of the failover
operation. This standby redo logfile should be deleted after the
switchover to primary operation completes.
Media Recovery Log /data/PRD_DR/arch/arch_1_0_831359165.arch
Terminal Recovery: log 3 reserved for thread 1 sequence 145
Recovery of Online Redo Log: Thread 1 Group 3 Seq 145 Reading mem 0
Mem# 0: /data/PRD_DR/arch/arch_1_0_831359165.arch
Identified End-Of-Redo for thread 1 sequence 145
Incomplete recovery applied all redo ever generated.
Recovery completed through change 559773 time 11/23/2013 13:38:13
Media Recovery Complete (PRD)
Terminal Recovery: successful completion
Resetting standby activation ID 1895332757 (0x70f87b95)
Completed: alter database recover managed standby database finish
Tue Dec 03 01:42:50 2013
alter database commit to switchover to primary
ALTER DATABASE SWITCHOVER TO PRIMARY (PRD)
Maximum wait for role transition is 15 minutes.
Backup controlfile written to trace file /apps/oracle/diag/rdbms/stand/PRD/trace/PRD_ora_9466.trc
tkcrrxms: Killing 3 processes (all RFS)
Standby terminal recovery start SCN: 559772
RESETLOGS after complete recovery through change 559773
Online log /data/PRD_DR/REDOLOG11.LOG: Thread 1 Group 1 was previously cleared
Online log /data/PRD_DR/REDOLOG21.LOG: Thread 1 Group 2 was previously cleared
Standby became primary SCN: 559771
Tue Dec 03 01:42:53 2013
Here my question is , why oracle implicitly creates a standby redo log in Standby database for successful completion of 'alter database recover managed standby database finish'.
Thanks,Terminal Recovery timestamp is '12/03/2013 01:42:15'
Terminal Recovery: applying standby redo logs.
Terminal Recovery: thread 1 seq# 145 redo required
Media Recovery Waiting for thread 1 sequence 145
Terminal Recovery: End-Of-Redo log allocation
Terminal Recovery: standby redo logfile 3 created '/data/PRD_DR/arch/arch_1_0_831359165.arch'
This standby redo logfile is being created as part of the failover
operation. This standby redo logfile should be deleted after the
switchover to primary operation completes.
Media Recovery Log /data/PRD_DR/arch/arch_1_0_831359165.arch
Terminal Recovery: log 3 reserved for thread 1 sequence 145
Recovery of Online Redo Log: Thread 1 Group 3 Seq 145 Reading mem 0
Mem# 0: /data/PRD_DR/arch/arch_1_0_831359165.arch
Identified End-Of-Redo for thread 1 sequence 145
Looks like, its due to the following bug.
Bug 5889025 : FINISH FAILOVER GENERATES INCORRECT STANDBY REDO LOG. -
Good day.
Assume I open the pyhsical standby in two seconds and closed
Probably no chekpoint will occur in this interval and checkpoint SCN of the datafiles and control
file will not change.
So what makes recovering it anymore impossible?Sorry,
When you open the physical standby database, checkpoint will occur and database SCN will change...
So the information in the standby controlfile will change...
Thats why you cannot recover it again...since SCN's and sequence numbers mismatch...
If you want to open a physical standby database , then use 11g version...you can configure Active Dataguard...in which you can open the physical standby for reporting purposes...
HTH,
:) -
Physical standby crash leads to peculiar process behavior on primary nodes
Hey all, we had an issue early this morning with our physical standby database in our production environment. It's an odd problem and I thought I'd share it to see if anyone else has come across a similar problem.
Our environment consists of a two node RAC cluster running 10.2.0.2 Enterprise on Red-Hat x86-64 Linux boxes. We have implemented a single physical standby at a remote site using real-time log apply.
Upon arrival this morning I discovered that a large portion of the primary database activity was a wait class event(ARCH wait on SENDREQ). The problem was quickly identified as a network issue between our site and the remote standby. However, the physical standby seemed to be running normal, with no messages in the alert logs regarding network disconnects. Further investigation showed that our log-apply had stopped all together early that morning. It seems the DBWR process crashed around 630am, as per this trace dump:
*** 2008-02-27 06:24:53.667
Waited for detached process: DBW0 for 300 seconds:
*** 2008-02-27 06:24:53.667
Dumping diagnostic information for DBW0:
OS pid = 10587
loadavg : 12.11 11.67 8.95
memory info: free memory = 0.00M
swap info: free = 0.00M alloc = 0.00M total = 0.00M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
0 S oracle 2448 31813 0 78 0 - 13190 wait 06:07 ? 00:00:00 /bin/sh -c /usr/bin/gdb -quiet -x
/tmp/stacknvvano
/proc/10587/exe 10587 < /dev/null 2>&1
0 S oracle 2449 2448 0 78 0 - 38780 wait 06:07 ? 00:00:00 /usr/bin/gdb -quiet -x
/tmp/stacknvvano /proc/10587
/exe 10587
0 D oracle 10587 1 0 76 0 - 43072 - Jan04 ? 00:04:09 ora_dbw0_schclsdb
So what we did was restart the standby server and the database came up fine. We reinitiated log apply services and both databases did sync up. However
we are still seeing the "ARCH wait on SENDREQ" wait event from ARC0 and ARC1 on both the RAC instances.
We tried reseting the connection to the standby database, however did this not clear up the wait event. The system itself, as far as I can tell is not suffering, and redo logs are going across to the standby database without issue. What could be the problem with the ARC0 and ARC1 processes?
It would probably be helpful to mention that we don't actually use the ARCH processes for the log apply unless the standby falls behind. Archiving is handled by the local LNS process and remote RFS service. A quick instance restart would fix it, to be sure, but since this is happening in a production deployment in a 24x7 environment, I'd rather not have any downtime. A service request is of course filed, but since they have not gotten back to me yet and Metalink hasn't been of much help, I thought I'd see if any of you have seen this before. This giant gray blob on my grid control histogram is quite obnoxious. =) Thanks for taking the time to read. Cheers.
-Jim HenaghanJust as an update to anyone else who may have this problem, we haven't found a good way to clear up our Archiver issue, so a instance restart will take place. Further research indicates the issue came about from a MRP process crash due to a known bug fixed in 10.2.0.4 (https://metalink.oracle.com/metalink/plsql/f?p=130:14:316259464254960300::::p14_database_id,p14_docid,p14_show_header,p14_show_help,p14_black_frame,p14_font:NOT,5894403.8,1,0,1,helvetica)
-
Dp lib version mismatch-After kernel upgrade
Hi All,
After kernel upgrade from 700 162 to 179 all the workprocess are not coming up i am getting the below error:
Full qualified hostname = XXXXXX.saipc.XXX.com
***LOG Q0Z=> DpSysAdmExtCreate, bad version (lib=241000 krn=239000) [dpxxtool2.c 681]
LOCATION SAP-Gateway on host XXXXXXX / sapgw01
ERROR dp lib version mismatch, please check installation
TIME Mon Oct 20 00:33:37 2008
RELEASE 700
COMPONENT DP
VERSION 241000
RC -9999
MODULE dpxxtool2.c
LINE 688
DETAIL version of external and kernel dp lib mismatch (ext lib
version is 241000 / kernel lib version is 239000)
COUNTER 1
ERROR => DpIPCInit2: DpSysAdmExtCreate [dpxxtool2.c 369]
***LOG S0V=> GwStopGateway, gateway stopped () [gwxxrd.c 14652]
XXXXXXXXX:ts2adm 30% pg sapcpe.log
================ >>> main =======================
INFO: sapcpe version: @(#) $Id: //bas/700_REL/src/ccm/sapstart/sapxxcpe.c#18 $ SAP
=================================================
INFO: Try to find file table sapcpeft (default:sapcpeft)
INFO: Try to find file table in the central directory /usr/sap/TS2/SYS/exe/ctrun/sapcpeft
INFO: not found any file table.
=================================================
Update Local Programs (dir-sync + file-path + ln)
=================================================
Starting at 2008/10/20 00:33:34
ERROR: can't change to central Executable-Dir /usr/sap/TS2/SYS/exe/ctrun (No such file or directory) [sapxxcpe.c:1488]
Mon Oct 20 00:50:19 2008
ERROR => gateway (pid 24413) died [dpxxdisp.c 16063]
DpGwCheck: appc_adm.stat = 2
DP_FATAL_ERROR => Gateway could not be started - I better exit now
please help in solving this problem
Thanks
Giridhar
Edited by: giridhar n on Oct 20, 2008 12:47 PMHi,
We faced an issue with workprocesses which are not coming up after the kernel(700) upgrade from patch 162 to 179. below are the error logs:
Error Log
(XXXXXXXXX is the hostname)
Dev_W1:
XXXXXXXXX:ts2adm 9% more dev_w1.old
trc file: "dev_w1", trc level: 1, release: "700"
ACTIVE TRACE LEVEL 1
ACTIVE TRACE COMPONENTS all, MJ
M sysno 01
M sid TS2
M systemid 370 (Solaris on SPARCV9 CPU)
M relno 7000
M patchlevel 0
M patchno 162
M intno 20050900
M make: single threaded, Unicode, 64 bit, optimized
M pid 3867
M
M
M Mon Oct 20 03:59:26 2008
M kernel runs with dp version 239000(ext=110000) (-(#) DPLIB-INT-VERSION-239000-UC)
M length of sys_adm_ext is 576 bytes
M ***LOG Q01=> ThInit, WPStart (Workproc 1 1 3867) [thxxhead.c 1281]
M ThInit: running on host XXXXXXXXX
M calling db_connect ...
C Oracle Client Version: '10.2.0.2.0'
C
C Mon Oct 20 03:59:27 2008
C Client NLS settings: AMERICAN_AMERICA.UTF8
C Logon as OPS$-user to get SAPTS2's password
C Connecting as /-TS2 on connection 0 (nls_hdl 0) ... (dbsl 700 030508)
C Nls CharacterSet NationalCharSet C EnvHp ErrHp ErrHpBatch
C 0 UTF8 1 0x106eea0c0 0x106ef1b80 0x106f02318
C Attaching to DB Server TS2 (con_hdl=0,svchp=0x106f02248,srvhp=0x106f04598)
C Starting user session (con_hdl=0,svchp=0x106f02248,srvhp=0x106f04598,usrhp=0x106ef2398)
C Now '/-TS2' is connected: con_hdl=0, nls_hdl=0, session_id=475.
C Got SAPTS2's password from OPS$-user
C Disconnecting from connection 0 ...
C Closing user session (con_hdl=0,svchp=0x106f02248,usrhp=0x106ef2398)
C Now I'm disconnected from ORACLE
C Connecting as SAPTS2/<pwd>-TS2 on connection 0 (nls_hdl 0) ... (dbsl 700 030508)
C Nls CharacterSet NationalCharSet C EnvHp ErrHp ErrHpBatch
C 0 UTF8 1 0x106eea0c0 0x106ef1b80 0x106f02318
C Starting user session (con_hdl=0,svchp=0x106f02248,srvhp=0x106f04598,usrhp=0x106ef2398)
C Now 'SAPTS2/<pwd>-TS2' is connected: con_hdl=0, nls_hdl=0, session_id=475.
C Database NLS settings: AMERICAN_AMERICA.UTF8
C DB instance TS2 is running on XXXXXXXXX with ORACLE version 10.2.0.2.0 since OCT 20, 2008, 03:49:47
B Connection 0 opened (DBSL handle 0)
B Wp Hdl ConName ConId ConState TX PRM RCT TIM MAX OPT Date Time DBHost
B 000 000 R/3 000000000 ACTIVE NO YES NO 000 255 255 20081020 035926 XXXXXXXXX
C build_stmt: reallocating stmt buffer: 256 -> 2000 characters
M db_connect o.k.
M ICT: exclude compression: .zip,.cs,.rar,.arj,.z,.gz,.tar,.lzh,.cab,.hqx,.ace,.jar,.ear,.war,.css,.pdf,.js,.gzip,.uue,.bz2,.iso,.sda,
.sar,.gif
I
I Mon Oct 20 03:59:30 2008
I MtxInit: 1 0 0
M SHM_PRES_BUF (addr: 0xffffffff64c00000, size: 20000768)
M SHM_ROLL_AREA (addr: 0xfffffffe40000000, size: 268435456)
M SHM_PAGING_AREA (addr: 0xfffffffe36000000, size: 134217728)
M SHM_ROLL_ADM (addr: 0xffffffff7597a000, size: 3715586)
M SHM_PAGING_ADM (addr: 0xffffffff79a00000, size: 656416)
M ThCreateNoBuffer allocated 572152 bytes for 1000 entries at 0xfffffffe2c004000
M ThCreateNoBuffer index size: 3000 elems
M ThCreateVBAdm allocated 12176 bytes (50 server) at 0xffffffff7a900000
X EmInit: MmSetImplementation( 2 ).
X MM global diagnostic options set: 0
X <ES> client 1 initializing ....
X Using implementation std
X <ES> Info: use normal pages (no huge table support available)
X ES initialized.
B dbntab: NTAB buffers attached
B dbntab: Buffer FTAB(hash header) (addr: 0xfffffffe2c092088, size: 576)
B dbntab: Buffer FTAB(anchor array) (addr: 0xfffffffe2c0922c8, size: 798968)
B dbntab: Buffer FTAB(item array) (addr: 0xfffffffe2c1553c0, size: 3195648)
B dbntab: Buffer FTAB(data area) (addr: 0xfffffffe2c4616c0, size: 30740480)
B dbntab: Buffer IREC(hash header) (addr: 0xfffffffe2e1b6088, size: 576)
B dbntab: Buffer IREC(anchor array) (addr: 0xfffffffe2e1b62c8, size: 798968)
B dbntab: Buffer IREC(item array) (addr: 0xfffffffe2e2793c0, size: 798912)
B dbntab: Buffer IREC(data area) (addr: 0xfffffffe2e33c480, size: 6148096)
B dbntab: Buffer STAB(hash header) (addr: 0xfffffffe2e91c088, size: 576)
B dbntab: Buffer STAB(anchor array) (addr: 0xfffffffe2e91c2c8, size: 798968)
B dbntab: Buffer STAB(item array) (addr: 0xfffffffe2e9df3c0, size: 798912)
B dbntab: Buffer STAB(data area) (addr: 0xfffffffe2eaa2480, size: 3072000)
B dbntab: Buffer TTAB(hash header) (addr: 0xfffffffe2ed94088, size: 3072)
B dbntab: Buffer TTAB(anchor array) (addr: 0xfffffffe2ed94c88, size: 798968)
B dbntab: Buffer TTAB(item array) (addr: 0xfffffffe2ee57d80, size: 1997280)
B dbntab: Buffer TTAB(data area) (addr: 0xfffffffe2f03f760, size: 14580144)
B db_con_shm_ini: WP_ID = 1, WP_CNT = 24, CON_ID = -1
B dbstat: TABSTAT buffer attached (addr: 0xfffffffe28012008)
B dbtbxbuf: Buffer TABL (addr: 0xfffffffe24000100, size: 60000256, end: 0xfffffffe27938900)
B dbtbxbuf: Buffer TABLP (addr: 0xfffffffe20000100, size: 40960000, end: 0xfffffffe22710100)
B dbexpbuf: Buffer EIBUF (addr: 0xffffffff5d800108, size: 4194304, end: 0xffffffff5dc00108)
B dbexpbuf: Buffer ESM (addr: 0xfffffffe5f800108, size: 4194304, end: 0xfffffffe5fc00108)
B dbexpbuf: Buffer CUA (addr: 0xfffffffe2fe30108, size: 5120000, end: 0xfffffffe30312108)
B dbexpbuf: Buffer OTR (addr: 0xfffffffe59800108, size: 4194304, end: 0xfffffffe59c00108)
B dbcalbuf: Buffer CALE (addr: 0xffffffff75d08000, size: 500000, end: 0xffffffff75d82120)
I *** ERROR => ShmProtect(62,3) shmat(268435641,0x0xfffffffe5a000000,(SHM_RND | 0)) (22: Invalid argument) [shmux.c 2782]
I *** ERROR => ShmCreate: ShmProtect( 62, 3) failed [shmux.c 1359]
I *** ERROR => ShmCreate( ATTACH 62, 86228824) failed 1 [mpixx.c 855]
M *** ERROR => DpInitMpi: MpiInit failed (1) [dpxxtool2.c 5064]
M in_ThErrHandle: 1
M *** ERROR => ThInit: DpInitMpi (step 1, th_errno 17, action 3, level 1) [thxxhead.c 10506]
M
M Info for wp 1
M
M pid = 3867
M severity = 0
M status = 0
M stat = WP_RUN
M waiting_for = NO_WAITING
M reqtype = DP_RQ_DIAWP
M act_reqtype = NO_REQTYPE
M rq_info = 0
M tid = -1
M mode = 255
M len = -1
M rq_id = 65535
M rq_source =
M last_tid = 0
M last_mode = 0
M semaphore = 0
M act_cs_count = 0
M csTrack = 0
M csTrackRwExcl = 0
M csTrackRwShrd = 0
M mode_cleaned_counter = 0
M control_flag = 0
M int_checked_resource(RFC) = 0
M ext_checked_resource(RFC) = 0
M int_checked_resource(HTTP) = 0
M ext_checked_resource(HTTP) = 0
M report = > <
M action = 0
M tab_name = > <
M attachedVm = no VM
M PfStatDisconnect: disconnect statistics
M Entering TH_CALLHOOKS
M ThCallHooks: call hook >SAP-Trace buffer write< for event BEFORE_DUMP
M TrThHookFunc: called for WP dump
M ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP
M *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c 724]
M *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c 261]
M Entering ThSetStatError
M ThIErrHandle: do not call ThrCoreInfo (no_core_info=0, in_dynp_env=0)
M Entering ThReadDetachMode
M call ThrShutDown (1)...
B dbtbxbuf: Saving TBX statistics:
B dbtbxbuf: 0 object entries written.
M ***LOG Q02=> wp_halt, WPStop (Workproc 1 3867) [dpuxtool.c 269]
dev_icm:
trc file: "dev_icm", trc level: 1, release: "700"
sysno 01
sid TS2
systemid 370 (Solaris on SPARCV9 CPU)
relno 7000
patchlevel 0
patchno 177
intno 20050900
make: multithreaded, Unicode, 64 bit, optimized
pid 3865
[Thr 1] started security log to file dev_icm_sec
[Thr 1] ICM running on: XXXXXXXXX.saipc.XXX.com
[Thr 1] MtxInit: 30001 0 2
[Thr 1] IcmInit: listening to admin port: 64999
[Thr 1] ***LOG Q0Z=> DpSysAdmExtCreate, bad version (lib=241000 krn=239000) [dpxxtool2_mt 681]
[Thr 1]
[Thr 1] * LOCATION ICM runing on host XXXXXXXXX
[Thr 1] * ERROR dp lib version mismatch, please check installation
[Thr 1] *
TIME Mon Oct 20 03:59:28 2008
[Thr 1] * RELEASE 700
[Thr 1] * COMPONENT DP
[Thr 1] * VERSION 241000
[Thr 1] * RC -9999
[Thr 1] * MODULE dpxxtool2_mt.c
[Thr 1] * LINE 688
[Thr 1] * DETAIL version of external and kernel dp lib mismatch (ext lib
version is 241000 / kernel lib version is 239000)
[Thr 1] * COUNTER 3
[Thr 1] *
[Thr 1] *****************************************************************************
[Thr 1] *** ERROR => DpIPCInit2: DpSysAdmExtCreate [dpxxtool2_mt 369]
[Thr 1] *** ERROR => IcmInit: IcmIPCInit failed (rc=-9999) [icxxman_mt.c 1741]
[Thr 1] *** ICM shutdown completed (pid: 3865) ***
dev_ms:
trc file: "dev_ms", trc level: 1, release: "700"
[Thr 1] Mon Oct 20 03:59:24 2008
[Thr 1] MsSSetTrcLog: trc logging active, max size = 20971520 bytes
systemid 370 (Solaris on SPARCV9 CPU)
relno 7000
patchlevel 0
patchno 145
intno 20050900
make: multithreaded, Unicode, 64 bit, optimized
pid 3853
[Thr 1] ***LOG Q01=> MsSInit, MSStart (Msg Server 1 3853) [msxxserv_mt. 1834]
[Thr 1] SigISetDefaultAction : default handling for signal 18
[Thr 1] load acl file = /usr/sap/TS2/SYS/global/ms_acl_info
[Thr 1] MsGetOwnIpAddr: my host addresses are :
[Thr 1] 1 : [148.92.31.49] XXXXXXXXX (HOSTNAME)
[Thr 1] 2 : [127.0.0.1] localhost (LOCALHOST)
[Thr 1] 3 : [148.92.31.157] XXXXXXXXX-maint (NILIST)
[Thr 1] 4 : [10.220.6.72] XXXXXXXXX-bkup (NILIST)
[Thr 1] MsHttpInit: full qualified hostname = XXXXXXXXX.saipc.XXX.com
[Thr 1] HTTP logging is switch off
[Thr 1] MsHttpOwnDomain: own domain[1] = saipc.XXX.com
[Thr 1] ms/icf_info_server : deleted
[Thr 1] *** I listen to port sapmsTS2 (3601) ***
[Thr 1] *** I listen to internal port 3901 (3901) ***
[Thr 1] CUSTOMER KEY: >C0395101982<
[Thr 1] Mon Oct 20 04:01:28 2008
[Thr 1] *** ERROR => MsSClientHandle: no server provides service ENQ (4), requested from XXXXXXXXX_TS2_01 [msxxserv_mt. 4687]
[Thr 1] Mon Oct 20 04:05:07 2008
[Thr 1] MsSExit: received SIGINT (2)
[Thr 1] ***LOG Q02=> MsSHalt, MSStop (Msg Server 3853) [msxxserv_mt. 5998]
dev_rd:
trc file: "dev_rd", trc level: 1, release: "700"
Mon Oct 20 03:59:26 2008
***LOG S00=> GwInitReader, gateway started ( 3864) [gwxxrd.c 1757]
systemid 370 (Solaris on SPARCV9 CPU)
relno 7000
patchlevel 0
patchno 176
intno 20050900
make: single threaded, Unicode, 64 bit, optimized
pid 3864
gateway runs with dp version 241000(ext=110000) (-(#) DPLIB-INT-VERSION-241000-UC)
gateway (version=700.2008.06.23)
gw/local_addr : 0.0.0.0
CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.
CCMS: Initalizing shared memory of size 60000000 for monitoring segment.
Mon Oct 20 03:59:27 2008
CCMS: Checking Downtime Configuration of Monitoring Segment.
Bind service sapgw01 (socket) to port 3301
GwPrintMyHostAddr: my host addresses are :
1 : [148.92.31.49] XXXXXXXXX (HOSTNAME)
2 : [127.0.0.1] localhost (LOCALHOST)
3 : [148.92.31.157] XXXXXXXXX-maint (NILIST)
4 : [10.220.6.72] XXXXXXXXX-bkup (NILIST)
Full qualified hostname = XXXXXXXXX.saipc.XXX.com
***LOG Q0Z=> DpSysAdmExtCreate, bad version (lib=241000 krn=239000) [dpxxtool2.c 681]
LOCATION SAP-Gateway on host XXXXXXXXX / sapgw01
ERROR dp lib version mismatch, please check installation
TIME Mon Oct 20 03:59:27 2008
RELEASE 700
COMPONENT DP
VERSION 241000
RC -9999
MODULE dpxxtool2.c
LINE 688
DETAIL version of external and kernel dp lib mismatch (ext lib
version is 241000 / kernel lib version is 239000)
COUNTER 1
ERROR => DpIPCInit2: DpSysAdmExtCreate [dpxxtool2.c 369]
***LOG S0V=> GwStopGateway, gateway stopped () [gwxxrd.c 14652]
dev_rfc24:
Trace file opened at 20081020 031506 EDT SAP-REL 700,0,162 RFC-VER U 3 985555
======> User is locked. Please notify the person responsible
ABAP Programm: SAPLTMSC (Transaction: )
Called function module: TMS_CI_START_SERVICE
User: DDIC (Client: 015)
Destination: TMSADM-TS2.DOMAIN_DV2 (handle: 2, 11671309, {48FC3006-2FF4-60E5-E100-0000945C1F31})
dev_disp
trc file: "dev_disp.new", trc level: 1, release: "700"
sysno 01
sid TS2
systemid 370 (Solaris on SPARCV9 CPU)
relno 7000
patchlevel 0
patchno 162
intno 20050900
make: single threaded, Unicode, 64 bit, optimized
pid 3854
Mon Oct 20 03:59:25 2008
kernel runs with dp version 239000(ext=110000) (-(#) DPLIB-INT-VERSION-239000-UC)
length of sys_adm_ext is 576 bytes
SWITCH TRC-HIDE on ***
***LOG Q00=> DpSapEnvInit, DPStart (01 3854) [dpxxdisp.c 1257]
shared lib "dw_xml.so" version 162 successfully loaded
shared lib "dw_xtc.so" version 162 successfully loaded
shared lib "dw_stl.so" version 162 successfully loaded
shared lib "dw_gui.so" version 162 successfully loaded
shared lib "dw_mdm.so" version 162 successfully loaded
rdisp/softcancel_sequence : -> 0,5,-1
use internal message server connection to port 3901
MtxInit: 30000 0 0
DpSysAdmExtInit: ABAP is active
DpSysAdmExtInit: VMC (JAVA VM in WP) is not active
DpIPCInit2: start server >XXXXXXXXX_TS2_01 <
DpShMCreate: sizeof(wp_adm) 42240 (1760)
DpShMCreate: sizeof(tm_adm) 150350080 (30064)
DpShMCreate: sizeof(wp_ca_adm) 31232 (104)
DpShMCreate: sizeof(appc_ca_adm) 208000 (104)
DpCommTableSize: max/headSize/ftSize/tableSize=500/8/548056/548064
DpShMCreate: sizeof(comm_adm) 548064 (1088)
DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
DpShMCreate: sizeof(slock_adm) 0 (104)
DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
DpShMCreate: sizeof(file_adm) 0 (72)
DpShMCreate: sizeof(vmc_adm) 0 (2080)
DpShMCreate: sizeof(wall_adm) (1000056/862328/88/192)
DpShMCreate: sizeof(gw_adm) 48
DpShMCreate: SHM_DP_ADM_KEY (addr: 0xffffffff66000000, size: 153051096)
DpShMCreate: allocated sys_adm at 0xffffffff66000000
DpShMCreate: allocated wp_adm at 0xffffffff66002218
DpShMCreate: allocated tm_adm_list at 0xffffffff6600c718
DpShMCreate: allocated tm_adm at 0xffffffff6600c778
DpShMCreate: allocated wp_ca_adm at 0xffffffff6ef6f078
DpShMCreate: allocated appc_ca_adm at 0xffffffff6ef76a78
DpShMCreate: allocated comm_adm at 0xffffffff6efa96f8
DpShMCreate: system runs without slock table
DpShMCreate: system runs without file table
DpShMCreate: allocated vmc_adm_list at 0xffffffff6f02f3d8
DpShMCreate: allocated gw_adm at 0xffffffff6f02f458
DpShMCreate: system runs without vmc_adm
DpShMCreate: allocated ca_info at 0xffffffff6f02f488
DpShMCreate: allocated wall_adm at 0xffffffff6f02f490
Mon Oct 20 03:59:26 2008
MBUF state OFF
DpCommInitTable: init table for 500 entries
rdisp/queue_size_check_value : -> off
ThTaskStatus: rdisp/reset_online_during_debug 0
EmInit: MmSetImplementation( 2 ).
MM global diagnostic options set: 0
<ES> client 0 initializing ....
<ES> InitFreeList
<ES> block size is 1024 kByte.
Using implementation std
<ES> Info: use normal pages (no huge table support available)
EsStdUnamFileMapInit: ES base = 0x0xfffffffe60000000
EsStdInit: Extended Memory 4048 MB allocated
<ES> 4047 blocks reserved for free list.
ES initialized.
Mon Oct 20 03:59:31 2008
rdisp/http_min_wait_dia_wp : 1 -> 1
***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1659]
***LOG Q0K=> DpMsAttach, mscon ( XXXXXXXXX) [dpxxdisp.c 12153]
DpStartStopMsg: send start message (myname is >XXXXXXXXX_TS2_01 <)
DpStartStopMsg: start msg sent
CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.
ERROR => DpWPCheck: W0 (pid 3866) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3866) exited with exit code 255
my types changed after wp death/restart 0xbf --> 0xbd
ERROR => DpWPCheck: W1 (pid 3867) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3867) exited with exit code 255
ERROR => DpWPCheck: W2 (pid 3868) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3868) exited with exit code 255
ERROR => DpWPCheck: W4 (pid 3870) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3870) exited with exit code 255
ERROR => DpWPCheck: W5 (pid 3871) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3871) exited with exit code 255
ERROR => DpWPCheck: W6 (pid 3872) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3872) exited with exit code 255
ERROR => DpWPCheck: W7 (pid 3873) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3873) exited with exit code 255
ERROR => DpWPCheck: W8 (pid 3874) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3874) exited with exit code 255
ERROR => DpWPCheck: W9 (pid 3875) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3875) exited with exit code 255
ERROR => DpWPCheck: W10 (pid 3885) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3885) exited with exit code 255
ERROR => DpWPCheck: W11 (pid 3888) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3888) exited with exit code 255
ERROR => DpWPCheck: W12 (pid 3890) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3890) exited with exit code 255
ERROR => DpWPCheck: W13 (pid 3902) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3902) exited with exit code 255
DpMsgAdmin: Set release to 7000, patchlevel 0
MBUF state PREPARED
MBUF component UP
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1050]
DpMsgAdmin: Set patchno for this platform to 162
Release check o.K.
Mon Oct 20 03:59:51 2008
my types changed after wp death/restart 0xbd --> 0x81
ERROR => DpWPCheck: W14 (pid 3903) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3903) exited with exit code 255
ERROR => DpWPCheck: W15 (pid 3904) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3904) exited with exit code 255
ERROR => DpWPCheck: W16 (pid 3905) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3905) exited with exit code 255
ERROR => DpWPCheck: W17 (pid 3908) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3908) exited with exit code 255
ERROR => DpWPCheck: W18 (pid 3911) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3911) exited with exit code 255
ERROR => DpWPCheck: W19 (pid 3914) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3914) exited with exit code 255
ERROR => DpWPCheck: W20 (pid 3915) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3915) exited with exit code 255
ERROR => DpWPCheck: W21 (pid 3916) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3916) exited with exit code 255
ERROR => DpWPCheck: W22 (pid 3919) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3919) exited with exit code 255
ERROR => DpWPCheck: W23 (pid 3924) died (severity=0, status=65280) [dpxxdisp.c 15218]
child (pid=3924) exited with exit code 255
Mon Oct 20 04:00:11 2008
ERROR => gateway (pid 3864) died [dpxxdisp.c 16063]
DpGwCheck: appc_adm.stat = 2
DP_FATAL_ERROR => Gateway could not be started - I better exit now
DISPATCHER EMERGENCY SHUTDOWN ***
increase tracelevel of WPs
kill(3869,0) successful -> process alive
killing W3-3869 (SIGUSR2)
NiWait: sleep (10000ms) ...
NiISelect: timeout 10000ms
NiISelect: maximum fd=12
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Oct 20 04:00:21 2008
NiISelect: TIMEOUT occured (10000ms)
dump system status
Workprocess Table (long) Mon Oct 20 08:00:21 2008
========================
No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table
0 DIA 3866 Ended no 3 0 0
1 DIA 3867 Ended no 3 0 0
2 DIA 3868 Ended no 3 0 0
3 DIA 3869 Run yes 0 0 0
4 DIA 3870 Ended no 3 0 0
5 DIA 3871 Ended no 3 0 0
6 DIA 3872 Ended no 3 0 0
7 DIA 3873 Ended no 3 0 0
8 DIA 3874 Ended no 3 0 0
9 DIA 3875 Ended no 3 0 0
10 UPD 3885 Ended no 3 0 0
11 UPD 3888 Ended no 3 0 0
12 UPD 3890 Ended no 3 0 0
13 UPD 3902 Ended no 3 0 0
14 ENQ 3903 Ended no 2 0 0
15 BTC 3904 Ended no 2 0 0
16 BTC 3905 Ended no 2 0 0
17 BTC 3908 Ended no 2 0 0
18 BTC 3911 Ended no 2 0 0
19 BTC 3914 Ended no 2 0 0
20 BTC 3915 Ended no 2 0 0
21 SPO 3916 Ended no 2 0 0
22 UP2 3919 Ended no 2 0 0
23 UP2 3924 Ended no 2 0 0
Dispatcher Queue Statistics Mon Oct 20 08:00:21 2008
===========================
--------++++--
+
Typ
now
high
max
writes
reads
--------++++--
+
NOWP
0
0
4000
0
0
--------++++--
+
DIA
4
4
4000
4
0
--------++++--
+
UPD
0
0
4000
0
0
--------++++--
+
ENQ
0
0
4000
0
0
--------++++--
+
BTC
0
0
4000
0
0
--------++++--
+
SPO
0
0
4000
0
0
--------++++--
+
UP2
0
0
4000
0
0
--------++++--
+
max_rq_id 7
wake_evt_udp_now 0
wake events total 3, udp 2 ( 66%), shm 1 ( 33%)
since last update total 3, udp 2 ( 66%), shm 1 ( 33%)
Dump of tm_adm structure: Mon Oct 20 08:00:21 2008
=========================
Term uid man user term lastop mod wp ta a/i (modes)
Workprocess Comm. Area Blocks Mon Oct 20 08:00:21 2008
=============================
Slots: 300, Used: 1, Max: 0
--------++--
+
id
owner
pid
eyecatcher
--------++--
+
0
DISPATCHER
-1
WPCAAD000
NiWait: sleep (5000ms) ...
NiISelect: timeout 5000ms
NiISelect: maximum fd=12
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Mon Oct 20 04:00:26 2008
NiISelect: TIMEOUT occured (5000ms)
DpHalt: shutdown server >XXXXXXXXX_TS2_01 < (normal)
DpJ2eeDisableRestart
DpModState: buffer in state MBUF_PREPARED
please help me to solve this.
Thanks
Giridhar -
Error while trying to open physical standby database - (DATA GUARD)
Hi Everyone,
I have problems in opening the database of the physical standby in read- write mode/ read only mode. I have a primary server which is running on 2 node RAC and the standby on a seperate single server being used as DR. I recently got this server and my aim was to isolate the standby server from primary server and perform few test. As it has never been tested even once.
Primary Database spec: (2 Node Rac on ASM)
Oracle Version : 10.2.0.3.0
O/s : HP-UX B.11.23
Standby Database spec: (Single Node)
Oracle Version : 10.2.0.3.0
O/s: HP-UX db01 B.11.23
Error:
alter database recover managed standby database cancel;
Database altered.
SQL> alter database open
2 ;
alter database open
ERROR at line 1:
ORA-16004: backup database requires recovery
ORA-01152: file 1 was not restored from a sufficiently old backup
ORA-01110: data file 1: '+DATA/dprod/datafile/system01.dbf'
Parameters :
log_archive_dest_2 string SERVICE=PROD1 LGWR ASYNC VALID
FOR=(ONLINELOGFILES,PRIMARY_
ROLE) DB_UNIQUE_NAME=PROD
remote_archive_enable string true
fal_client string DPROD
fal_server string PROD1, PROD2
Steps tried so far:
Changed log_archive_dest_2 = DEFER on both the primary nodes
Standby :
startup nomount
alter database mount standby database;
alter database recover managed standby database disconnect;
alter database recover managed standby database cancel;
alter database open/readonly (tried both)
Same error.
On Primary:
SQL> select max(sequence#) from v$log_history;
MAX(SEQUENCE#)
55702
on Standby:
MAX(SEQUENCE#)
33289
Primary Database:
SELECT SEQUENCE#, FIRST_TIME, NEXT_TIME FROM V$ARCHIVED_LOG ORDER BY SEQUENCE#;
SEQUENCE# FIRST_TIME NEXT_TIME
55700 13-JUN-11 13-JUN-11
55700 13-JUN-11 13-JUN-11
55701 13-JUN-11 13-JUN-11
55701 13-JUN-11 13-JUN-11
55702 13-JUN-11 13-JUN-11
60824 rows selected.
Standby Database:
SEQUENCE# FIRST_TIME NEXT_TIME
55698 13-JUN-11 13-JUN-11
55699 13-JUN-11 13-JUN-11
55700 13-JUN-11 13-JUN-11
55701 13-JUN-11 13-JUN-11
15206 rows selected.
Additional Information :
There is a delay of 20 minutes before the logs get applied. which has been intentional set by team.
Any help will be highly appreciated. Thanks in advance
SadiqHi,
Primary Database:
select status,checkpoint_count from v$datafile_header;
STATUS CHECKPOINT_COUNT
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
STATUS CHECKPOINT_COUNT
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 672472065
ONLINE 59736
ONLINE 59736
ONLINE 59736
ONLINE 59736
ONLINE 59736
STATUS CHECKPOINT_COUNT
ONLINE 57717
ONLINE 57717
57 rows selected.
Standby Database;
select status,checkpoint_count from v$datafile_header;
STATUS CHECKPOINT_COUNT
ONLINE 672445072
ONLINE 672445072
ONLINE 672445072
ONLINE 672445072
ONLINE 672445072
ONLINE 672445072
ONLINE 672445072
ONLINE 672445071
ONLINE 672445071
ONLINE 672445071
ONLINE 672445071
STATUS CHECKPOINT_COUNT
ONLINE 672445071
ONLINE 672445071
ONLINE 672445071
ONLINE 672445071
ONLINE 672445071
ONLINE 672445071
ONLINE 32742
ONLINE 32742
ONLINE 32742
ONLINE 32742
ONLINE 32742
STATUS CHECKPOINT_COUNT
ONLINE 30723
ONLINE 30723
57 rows selected.
Archieve log list :
Primary database:
SQL> archive log list
Database log mode Archive Mode
Automatic archival Enabled
Archive destination USE_DB_RECOVERY_FILE_DEST
Oldest online log sequence 49110
Next log sequence to archive 49111
Current log sequence 49111
Standby Database:
SQL> archive log list;
Database log mode Archive Mode
Automatic archival Enabled
Archive destination USE_DB_RECOVERY_FILE_DEST
Oldest online log sequence 49110
Next log sequence to archive 0
Current log sequence 49111
I tried log switch multiple times in primary database i saw that its getting highlighted in standby database. -
Drop a datafile from physical standby's control file
Hi,
I am trying to create a physical standby database for my production...
1) I have taken cold backup of my primary database on 18-Nov-2013...
2) I added a datafile on 19-nov-2013 ( 'O:\ORADATA\SFMS\SFMS_DATA4.DBF' )
3) Standby control file was generated on 20-ov-2013 (today) after shutting down and then mounting the primary database...
When i try to recover the newly setup standby using archive files, i am getting the following error (datafile added on 19th Nov is missing)
SQL> recover standby database;
ORA-00283: recovery session canceled due to errors
ORA-01110: data file 39: 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
ORA-01157: cannot identify/lock data file 39 - see DBWR trace file
ORA-01110: data file 39: 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
How to overcome this situation...
Can i delete the entry for the newly added datafile from the backup control file ?
When i tried to delete datafile using "alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF';", it is showing that database should be open..
SQL> alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
ERROR at line 1:
ORA-01109: database not open
SQL> show parameter STANDBY_FILE_MANAGEMENT
NAME TYPE VALUE
standby_file_management string AUTO
SQL> alter system set STANDBY_FILE_MANAGEMENT=manual;
System altered.
SQL> show parameter STANDBY_FILE_MANAGEMENT
NAME TYPE VALUE
standby_file_management string MANUAL
SQL> alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
ERROR at line 1:
ORA-01109: database not open
Regards,
JibuJibu wrote:
Hi,
I am trying to create a physical standby database for my production...
1) I have taken cold backup of my primary database on 18-Nov-2013...
2) I added a datafile on 19-nov-2013 ( 'O:\ORADATA\SFMS\SFMS_DATA4.DBF' )
3) Standby control file was generated on 20-ov-2013 (today) after shutting down and then mounting the primary database..
Hi,
What is your version?
If you added new datafile or created new tablespace, take backup again for restore new created standby database.
If your standby database running well, DG configuration success, then this datafile will create on standby side, too.
Set STANDBY_FILE_MANAGEMENT=AUTO best practice.
When i try to recover the newly setup standby using archive files, i am getting the following error (datafile added on 19th Nov is missing)
SQL> recover standby database;
ORA-00283: recovery session canceled due to errors
ORA-01110: data file 39: 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
ORA-01157: cannot identify/lock data file 39 - see DBWR trace file
ORA-01110: data file 39: 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
How to overcome this situation...
Can i delete the entry for the newly added datafile from the backup control file ?
Not need any delete datafile from standby side, you must recreate standby database, or you can take RMAN backup and restore to standby side again.
When i tried to delete datafile using "alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF';", it is showing that database should be open..
SQL> alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
ERROR at line 1:
ORA-01109: database not open
SQL> show parameter STANDBY_FILE_MANAGEMENT
NAME TYPE VALUE
standby_file_management string AUTO
SQL> alter system set STANDBY_FILE_MANAGEMENT=manual;
System altered.
SQL> show parameter STANDBY_FILE_MANAGEMENT
NAME TYPE VALUE
standby_file_management string MANUAL
SQL> alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
alter tablespace SFMS_BR_DATA drop datafile 'O:\ORADATA\SFMS\SFMS_DATA4.DBF'
ERROR at line 1:
ORA-01109: database not open
It is not logical, Physical standby must be bit-for-bit same with Primary database.
Regards
Mahir M. Quluzade
Maybe you are looking for
-
How do I get Snowleopard to keep the computer awake when busy?
I'd like the computer to disregard the powersave options when files are being moved from one location to another, a movie is playing, and during any other task in for which interruption isn't preferable.
-
ULN oracle-validated, Note 761566.1 and database packages for OEL 5.5
I purchased the ULN to simiplify installing the packages for an Oracle E-Business installation. I'm assuming the oracle-validated is not for E-Business installation because there were several required packages from note 761566.1 that were not install
-
Problems trying to upgrade from Solaris 10 update 4 to update 8
Hello, I am having problems trying to upgrade a system from update 4 to update 8. I have broken all the mirrors and everything is now setup off of one disk, yet I do not get the upgrade option when I boot from the CDROM. Anybody have any ideas? It is
-
Hi Experts, Scenario JMS -- XI -- IDOC I have tested the interface and found it works fine. As disabled EDI_DC40 segment in mapping and checked Apply Control record Values from Payload in the Receiver IDOC communication Channel. Since I have develo
-
Error occured for the data source 0uc_isu_27
Error when updating Idocs in Source System Diagnosis Errors have been reported in Source System during IDoc update: Incomplete control parameter for commmunication wi Hi everybody, At the time of loading data in to the BW side for the datasource i go