Database not found/Error: ORA-16621: database name for ADD DATABASE must be

Question

I am new to Data Guard and am trying to set up Data Guard Broker. I had created a configuration file with both my primary and standby databases and at one time I could show both databases. But now I can no longer show the standby database nor can I enable, disable or reinstate it. Here is what I have:
Primary Database: orcl10g
Standby Database: 10gSB
DGMGRL> show configuration
Configuration
Name: orcl10g
Enabled: YES
Protection Mode: MaxPerformance
Fast-Start Failover: DISABLED
Databases:
orcl10g - Primary database
10gSB - Physical standby database
Current status for "orcl10g":
SUCCESS
DGMGRL> show database verbose orcl10g
Database
Name: orcl10g
Role: PRIMARY
Enabled: YES
Intended State: ONLINE
Instance(s):
orcl10g
Properties:
InitialConnectIdentifier = 'orcl10g'
LogXptMode = 'ASYNC'
Dependency = ''
DelayMins = '0'
Binding = 'OPTIONAL'
MaxFailure = '0'
MaxConnections = '1'
ReopenSecs = '300'
NetTimeout = '180'
LogShipping = 'ON'
PreferredApplyInstance = ''
ApplyInstanceTimeout = '0'
ApplyParallel = 'AUTO'
StandbyFileManagement = 'AUTO'
ArchiveLagTarget = '0'
LogArchiveMaxProcesses = '30'
LogArchiveMinSucceedDest = '1'
DbFileNameConvert = '10gSB, orcl10g'
LogFileNameConvert = '/oracle/oracle/product/10.2.0/oradata/orcl10g/redo01.log, /oracle/oracle/product/10.2.0/oradata/10gSB/redo01.log, /oracle/oracle/product/10.2.0/oradata/orcl10g/redo02.log, /oracle/oracle/product/10.2.0/oradata/10gSB/redo02.log, /oracle/oracle/product/10.2.0/oradata/orcl10g/redo03.log, /oracle/oracle/product/10.2.0/oradata/10gSB/redo03.log'
FastStartFailoverTarget = ''
StatusReport = '(monitor)'
InconsistentProperties = '(monitor)'
InconsistentLogXptProps = '(monitor)'
SendQEntries = '(monitor)'
LogXptStatus = '(monitor)'
RecvQEntries = '(monitor)'
HostName = 'remarkable.mammothnetworks.com'
SidName = 'orcl10g'
LocalListenerAddress = '(ADDRESS=(PROTOCOL=tcp)(HOST=remarkable.mammothnetworks.com)(PORT=1521))'
StandbyArchiveLocation = '/oracle/flash_recovery_area/orcl10g/archivelog'
AlternateLocation = ''
LogArchiveTrace = '1024'
LogArchiveFormat = '%t_%s_%r.arc'
LatestLog = '(monitor)'
TopWaitEvents = '(monitor)'
Current status for "orcl10g":
SUCCESS
DGMGRL> show database verbose 10gSB
Object "10gsb" was not found
DGMGRL>
DGMGRL> remove database 10gSB
Object "10gsb" was not found
DGMGRL>
DGMGRL> reinstate database 10gSB
Object "10gsb" was not found
DGMGRL>
DGMGRL> enable database 10gSB
Object "10gsb" was not found
DGMGRL>
DGMGRL> add database '10gSB' as
connect identifier is 10gSB
maintained as physical;Error: ORA-16621: database name for ADD DATABASE must be unique
Failed.
How can I get Data Guard to see the standby database correctly again?

Answer 1

Thank you for the constructive feedback. I have been able to make progress on this issue.
I did check the Data Guard Log files as you suggested. I did not find anything when I checked them before but this time I found the following:
DG 2011-06-16-17:23:18 0 2 0 RSM detected log transport problem: log transport for database '10gSB' has the following error.
DG 2011-06-16-17:23:18 0 2 0 RSM0: HEALTH CHECK ERROR: ORA-16737: the redo transport service for standby database "10gSB" has an error
DG 2011-06-16-17:23:18 0 2 0 NSV1: Failed to connect to remote database 10gSB. Error is ORA-12514
DG 2011-06-16-17:23:18 0 2 0 RSM0: Failed to connect to remote database 10gSB. Error is ORA-12514
DG 2011-06-16-17:23:18 0 2 753988034 Operation CTL_GET_STATUS cancelled during phase 2, error = ORA-16778
DG 2011-06-16-17:23:18 0 2 753988034 Operation CTL_GET_STATUS cancelled during phase 2, error = ORA-16778
I verified that I am able to connect to both the primary and standby databases via external connections:
-bash-3.2$ lsnrctl status
LSNRCTL for Linux: Version 10.2.0.1.0 - Production on 17-JUN-2011 12:41:03
Copyright (c) 1991, 2005, Oracle. All rights reserved.
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
STATUS of the LISTENER
Alias LISTENER
Version TNSLSNR for Linux: Version 10.2.0.1.0 - Production
Start Date 17-JUN-2011 01:40:30
Uptime 0 days 11 hr. 0 min. 32 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /oracle/oracle/product/10.2.0/db_1/network/admin/listener.ora
Listener Log File /oracle/oracle/product/10.2.0/db_1/network/log/listener.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=remarkable.mammothnetworks.com)(PORT=1521)))
Services Summary...
Service "10gSB" has 1 instance(s).
Instance "10gSB", status READY, has 1 handler(s) for this service...
Service "10gSB_DGB" has 1 instance(s).
Instance "10gSB", status READY, has 1 handler(s) for this service...
Service "10gSB_XPT" has 1 instance(s).
Instance "10gSB", status READY, has 1 handler(s) for this service...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
Service "orcl10g" has 1 instance(s).
Instance "orcl10g", status READY, has 1 handler(s) for this service...
Service "orcl10gXDB" has 1 instance(s).
Instance "orcl10g", status READY, has 1 handler(s) for this service...
Service "orcl10g_DGB" has 1 instance(s).
Instance "orcl10g", status READY, has 1 handler(s) for this service...
Service "orcl10g_XPT" has 1 instance(s).
Instance "orcl10g", status READY, has 1 handler(s) for this service...
The command completed successfully
-bash-3.2$
-bash-3.2$
-bash-3.2$ sqlplus system/dbas4ever@orcl10g
SQL*Plus: Release 10.2.0.1.0 - Production on Fri Jun 17 12:43:41 2011
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - 64bit Production
With the Partitioning, OLAP and Data Mining options
SQL> quit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - 64bit Production
With the Partitioning, OLAP and Data Mining options
-bash-3.2$ sqlplus system/dbas4ver@10gSB
SQL*Plus: Release 10.2.0.1.0 - Production on Fri Jun 17 12:43:59 2011
Copyright (c) 1982, 2005, Oracle. All rights reserved.
ERROR:
ORA-01033: ORACLE initialization or shutdown in progress <== I think this is normal since the database is in mount mode
Enter user-name:
I also checked the listener log file and did see and error associated with a known bug:
WARNING: Subscription for node down event still pending
So I added the following to the listener.ora file and bounced the listener:
SUBSCRIBE_FOR_NODE_DOWN_EVENT_LISTENER=OFF
That seems to have taken care of the error.
The following is my listener.ora file:
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(SID_NAME = PLSExtProc)
(ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1)
(PROGRAM = extproc)
(SID_DESC = ( GLOBAL_DBNAME = 10gsb_DGMGRL.remarkable.mammothnetworks.com )
( SERVICE_NAME = 10gsb.remarkable.mammothnetworks.com )
( SID_NAME = 10gsb )
( ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1 )
(SID_DESC = ( GLOBAL_DBNAME = orcl10g_DGMGRL.remarkable.mammothnetworks.com )
( SERVICE_NAME = orcl10g.remarkable.mammothnetworks.com )
( SID_NAME = orcl10g )
( ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1 )
(SID_DESC = ( GLOBAL_DBNAME = orcl10g.remarkable.mammothnetworks.com )
( SERVICE_NAME = orcl10g.remarkable.mammothnetworks.com )
( SID_NAME = orcl10g )
( ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1 )
(SID_DESC = ( GLOBAL_DBNAME = 10gsb.remarkable.mammothnetworks.com )
( SERVICE_NAME = 10gsb.remarkable.mammothnetworks.com )
( SID_NAME = 10gsb )
( ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1 )
SUBSCRIBE_FOR_NODE_DOWN_EVENT_LISTENER=OFF
I again tried connecting externally to the standby database:
-bash-3.2$ sqlplus system/dbas4ever@10gSB
SQL*Plus: Release 10.2.0.1.0 - Production on Fri Jun 17 13:09:00 2011
Copyright (c) 1982, 2005, Oracle. All rights reserved.
ERROR:
ORA-01033: ORACLE initialization or shutdown in progress
Enter user-name:
and see this in the listener.log file:
17-JUN-2011 13:10:22 * (CONNECT_DATA=(SERVICE_NAME=10gSB_XPT)(SERVER=dedicated)(CID=(PROGRAM=oracle)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=199.187.124.130)(PORT=11357)) * establish * 10gSB_XPT * 0
17-JUN-2011 13:10:22 * (CONNECT_DATA=(SERVICE_NAME=10gSB_XPT)(SERVER=dedicated)(CID=(PROGRAM=oracle)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=199.187.124.130)(PORT=11358)) * establish * 10gSB_XPT * 0
17-JUN-2011 13:10:24 * service_update * 10gSB * 0
17-JUN-2011 13:10:30 * (CONNECT_DATA=(SID=orcl10g)(CID=(PROGRAM=perl)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=127.0.0.1)(PORT=25119)) * establish * orcl10g * 0
17-JUN-2011 13:10:30 * (CONNECT_DATA=(SID=orcl10g)(CID=(PROGRAM=perl)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=127.0.0.1)(PORT=25120)) * establish * orcl10g * 0
17-JUN-2011 13:10:30 * (CONNECT_DATA=(SID=orcl10g)(CID=(PROGRAM=emagent)(HOST=localhost.localdomain)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=127.0.0.1)(PORT=25121)) * establish * orcl10g * 0
17-JUN-2011 13:11:22 * (CONNECT_DATA=(SERVICE_NAME=10gSB_XPT)(SERVER=dedicated)(CID=(PROGRAM=oracle)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=199.187.124.130)(PORT=11420)) * establish * 10gSB_XPT * 0
17-JUN-2011 13:11:22 * (CONNECT_DATA=(SERVICE_NAME=10gSB_XPT)(SERVER=dedicated)(CID=(PROGRAM=oracle)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=199.187.124.130)(PORT=11422)) * establish * 10gSB_XPT * 0
17-JUN-2011 13:11:24 * service_update * 10gSB * 0
I tried again to see the database in Data Guard Broker:
DGMGRL> show database 10gSB
Object "10gsb" was not found
however, I then was able to add the database in Data Guard Broker:
DGMGRL> add database 10gSB
as connect identifier is 10gSB
maintained as physical;Database "10gsb" added <== this is progress!!!
However the configuration shows the following:
DGMGRL> show database 10gSB
Database
Name: 10gsb
Role: PHYSICAL STANDBY
Enabled: NO
Intended State: OFFLINE
Instance(s):
10gSB
Current status for "10gsb":
DISABLED <=====
So I tried to enable the database:
DGMGRL> enable database 10gSB
Error: ORA-16626: failed to enable specified object
Failed.
and I tried to reinstate the database:
DGMGRL> reinstate database 10gSB
Reinstating database "10gsb", please wait...
Error: ORA-16653: failed to reinstate database
Failed.
Reinstatement of database "10gsb" failed
So I checked the configuration and now see two entries for the standby database but with case differences:
DGMGRL> show configuration
Configuration
Name: orcl10g
Enabled: YES
Protection Mode: MaxPerformance
Fast-Start Failover: DISABLED
Databases:
orcl10g - Primary database
10gSB - Physical standby database
10gsb - Physical standby database (disabled)
Current status for "orcl10g":
SUCCESS
Question: How do I get rid of 10gSB and enable 10gsb?