RSMO: Health Check Error ORA-16820

Hello Everyone,
I'm trying to troubleshoot this weird error in our DG setup. I have FSFO enabled and observer running. However, when i check the status of standby database with show database 'stdby', i get ORA-16820, however, i do the same for primary database, status is success.
Already looked at DG logs, but not much help other than health check error with ORA 16820 FSFO observer is no longer observing this database.
Any pointers to troubleshoot is appreciated.
Thanks.
PS. 10.2.0.5/Linux 5.x
Edited by: user11241492 on May 11, 2011 5:24 PM

What does SHOW CONFIGURATION VERBOSE; return?
Larry

Similar Messages

Upgrade - Health Check Error

Hi All, I am upgrading the site collection which has NO workflow implemented in 2010. When I am doing health check before the upgrade I am getting this
•<websiteUrl>/_catalogs/wfpub/Approval - SharePoint 2010/ReviewApproval_1033.vdw - Reset page to default
•<websiteUrl>/entsearch/Pages/peopleresults.aspx - Reset page to default
•<websiteUrl>/_catalogs/wfpub/Collect Feedback - SharePoint 2010/ReviewFeedback_1033.xoml.wfconfig.xml - Reset page to default
•<websiteUrl>/_catalogs/wfpub/Approval - SharePoint 2010/ReviewApproval_1033.xoml.wfconfig.xml - Reset page to default
•<websiteUrl>/_catalogs/wfpub/Collect Feedback - SharePoint 2010/ReviewFeedback_1033.vdw - Reset page to default
•<websiteUrl>/_catalogs/wfpub/Collect Signatures - SharePoint 2010/Signatures_1033.vdw - Reset page to default
•<websiteUrl>/entsearch/Pages/results.aspx - Reset page to default
•<websiteUrl>/_catalogs/wfpub/Collect Signatures - SharePoint 2010/Signatures_1033.xoml.wfconfig.xml - Reset page to default
•<websiteUrl>/Education Documents/Forms/template.dotx - Reset page to default
•<websiteUrl>/_catalogs/masterpage/VariationRootPageLayout.aspx - Reset page to default
What is this error about? Should I proceed the upgrade with this error or resolve?
Please advice.
Regards,
Khushi
Khushi

Hi,
According to your post, my understanding is that you got “Reset page to default” error in Health Check.
If you haven't customize any workflow or anything, you can just reset them to the default, it’s OK.
Because in the database the sourse pages were completely uncustomized, out of the box.
So, you can reset them to the default, then check with Health Check, it would no error again.
http://www.chrismcnulty.net/blog/Lists/Posts/Post.aspx?ID=113
Thanks & Regards,
Jason
Jason Guo
TechNet Community Support

Health Check Error: Dependency$ p_timestamp mismatch for VALID objects

Just before the upgrade when we ran the health check we got the following 8 errors and want to fix them.
Dependency$ p_timestamp mismatch for VALID objects
[E] - P_OBJ#=5015556 D_OBJ#=5015647
[E] - P_OBJ#=5015556 D_OBJ#=8432965
[E] - P_OBJ#=5015576 D_OBJ#=5015647
[E] - P_OBJ#=5015576 D_OBJ#=8432965
[E] - P_OBJ#=5015588 D_OBJ#=5015647
[E] - P_OBJ#=5015588 D_OBJ#=8432965
[E] - P_OBJ#=5015589 D_OBJ#=5015647
[E] - P_OBJ#=5015589 D_OBJ#=8432965
SELECT o.obj# d_obj, do.name d_name, do.type# d_type, po.obj# p_obj, po.name p_name, to_char(p_timestamp,'DD-MON-YYYY HH24:MI:SS') "P_Timestamp",
to_char(po.stime ,'DD-MON-YYYY HH24:MI:SS') "STIME", decode(sign(po.stime-p_timestamp),0,'SAME','*DIFFER*') X FROM sys.obj$ do, sys.dependency$ d, sys.obj$ po WHERE
P_OBJ#=po.obj#(+) AND D_OBJ#=do.obj# AND do.status=1 /*dependent is valid*/ AND po.status=1 /*parent is valid*/ AND po.stime!=p_timestamp /*parent timestamp not match*/ ORDER BY 2,1;
8432965 AQ$_KUPC$DATAPUMP_QUETAB_P 2 5015576KUPC$_API_ACK09-DEC-2009 14:01:28 29-NOV-2010 12:04:14*DIFFER*
8432965 AQ$_KUPC$DATAPUMP_QUETAB_P 2 5015589KUPC$_MASTERJOBINFO 09-DEC-2009 14:01:28 29-NOV-2010 12:04:14*DIFFER*
8432965 AQ$_KUPC$DATAPUMP_QUETAB_P 2 5015556KUPC$_LOGENTRIES 09-DEC-2009 14:01:27 29-NOV-2010 12:04:13*DIFFER*
8432965 AQ$_KUPC$DATAPUMP_QUETAB_P 2 5015588KUPC$_MASTERERROR 09-DEC-2009 14:01:28 29-NOV-2010 12:04:14*DIFFER*
5015647 KUPC$DATAPUMP_QUETAB 2 5015576KUPC$_API_ACK 09-DEC-2009 14:01:28 29-NOV-2010 12:04:14*DIFFER*
5015647 KUPC$DATAPUMP_QUETAB 2 5015589KUPC$_MASTERJOBINFO 09-DEC-2009 14:01:28 29-NOV-2010 12:04:14*DIFFER*
5015647 KUPC$DATAPUMP_QUETAB 2 5015556KUPC$_LOGENTRIES 09-DEC-2009 14:01:27 29-NOV-2010 12:04:13*DIFFER*
5015647 KUPC$DATAPUMP_QUETAB 2 5015588KUPC$_MASTERERROR 09-DEC-2009 14:01:28 29-NOV-2010 12:04:14*DIFFER*
Solution as per the 579256.1's is
The returning objects will have to be recompiled or recreated to clear the problem.
Please see Note 781959.1 to recompile them. This can cause problems during upgrade and PLSQL validation.
But in my case above objects are not synonyms and are of type=2.
So, not sure how to fix them. pl. let us know how we can fix these errors.

Well, I can tell you that this kind of error is not OS related, but rather a HW thing. It happens where there is a general detection of something going wrong. Sometimes it can happen randomly and might not be an indication of a problem. But sometimes it can be caused by things that are improperly functioning within the system like bad capacitors.
Unfortunately I don't really know what to do about such things except give you machine a proper inspection. But if things are working fine, and continue to do so, I wouldn't worry about it. If it becomes a regular occurance, then I'd worry.

CDS Data Quality Health Check Error -(Code: 207,103)

Using the CDS Individual Data Quality Health Check.
Created a new data source, snap shot and mapping. Cloned the job and modified the snapshot an mapping. Ran the Job and go the following :An error occurred whilst creating task '[I2A] Profile Individual Misc Data' : Failed to load process "[I2A] Profile Individual Misc Data" (Code: 207,103) - Any Suggestions

Determined the Error to be a missing processor. I must have deleted it by mistake. You can identify which one is missing by the processor Name [I2A] Profile Individual Misc Data

Error: ORA-16751: resource guard encountered errors in switchover to primar

Hello ,
I have just completed dataguard configuration for one standby server. However when I tries to switchover i am getting following error in dataguard log file.
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK ERROR: ORA-16816: incorrect database role
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK ERROR: ORA-16783: instance p11 not open for read and write access
DG 2011-07-09-20:08:58 0 2 0 RSM Warning: cannot find the destinationsetting in v$archive_dest for database 'p11_disaster'.
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16728: consistency check for property LogXptMode found ORA-16777 error
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16777: unable to find the destination entry of a standby database in V$ARCHIVE_DEST
DG 2011-07-09-20:08:58 0 2 0 RSM Warning: cannot find the destinationsetting in v$archive_dest for database 'p11_disaster'.
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16728: consistency check for property DelayMins found ORA-16777 error
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16777: unable to find the destination entry of a standby database in V$ARCHIVE_DEST
DG 2011-07-09-20:08:58 0 2 0 RSM Warning: cannot find the destinationsetting in v$archive_dest for database 'p11_disaster'.
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16728: consistency check for property Binding found ORA-16777 error
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16777: unable to find the destination entry of a standby database in V$ARCHIVE_DEST
DG 2011-07-09-20:08:58 0 2 0 RSM Warning: cannot find the destinationsetting in v$archive_dest for database 'p11_disaster'.
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16728: consistency check for property MaxFailure found ORA-16777 error
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16777: unable to find the destination entry of a standby database in V$ARCHIVE_DEST
DG 2011-07-09-20:08:58 0 2 0 RSM Warning: cannot find the destinationsetting in v$archive_dest for database 'p11_disaster'.
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16728: consistency check for property MaxConnections found ORA-16777 error
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16777: unable to find the destination entry of a standby database in V$ARCHIVE_DEST
DG 2011-07-09-20:08:58 0 2 0 RSM Warning: cannot find the destinationsetting in v$archive_dest for database 'p11_disaster'.
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16728: consistency check for property ReopenSecs found ORA-16777 error
DG 2011-07-09-20:08:58 0 2 0 RSM0: HEALTH CHECK WARNING: ORA-16777: unable to find the destination entry of a standby database in V$ARCHIVE_DEST
DG 2011-07-09-20:08:58 0 2 756068556 Operation CTL_GET_STATUS cancelled during phase 2, error = ORA-16810
DG 2011-07-09-20:08:58 0 2 756068556 Operation CTL_GET_STATUS cancelled during phase 2, error = ORA-16810
I have tried several times however it changes the role of primary DB to physical standby , which i again change to primary by "Alter Database Commit to Switchover to PRIMARY with session Shutdown;"
Here are the DGMGRL command prompts output.
C:\Documents and Settings\p11adm>dgmgrl
DGMGRL for 64-bit Windows: Version 10.2.0.2.0 - 64bit Production
Copyright (c) 2000, 2005, Oracle. All rights reserved.
Welcome to DGMGRL, type "help" for information.
DGMGRL> connect sys/windows123@to_primary
Connected.
DGMGRL> show database verbose p11_primary;
Database
Name: p11_primary
Role: PRIMARY
Enabled: YES
Intended State: ONLINE
Instance(s):
p11
Properties:
InitialConnectIdentifier = 'to_primary'
LogXptMode = 'ASYNC'
Dependency = ''
DelayMins = '0'
Binding = 'OPTIONAL'
MaxFailure = '0'
MaxConnections = '1'
ReopenSecs = '300'
NetTimeout = '180'
LogShipping = 'ON'
PreferredApplyInstance = ''
ApplyInstanceTimeout = '0'
ApplyParallel = 'AUTO'
StandbyFileManagement = 'AUTO'
ArchiveLagTarget = '0'
LogArchiveMaxProcesses = '10'
LogArchiveMinSucceedDest = '1'
DbFileNameConvert = ''
LogFileNameConvert = ''
FastStartFailoverTarget = ''
StatusReport = '(monitor)'
InconsistentProperties = '(monitor)'
InconsistentLogXptProps = '(monitor)'
SendQEntries = '(monitor)'
LogXptStatus = '(monitor)'
RecvQEntries = '(monitor)'
HostName = 'PROD104'
SidName = 'p11'
LocalListenerAddress = '(ADDRESS=(PROTOCOL=TCP)(HOST=10.0.1.104)(
PORT=1527))'
StandbyArchiveLocation = 'C:\oracle\P11\oraarch\P11arch'
AlternateLocation = ''
LogArchiveTrace = '0'
LogArchiveFormat = 'ARC%S_%R.%T'
LatestLog = '(monitor)'
TopWaitEvents = '(monitor)'
Current status for "p11_primary":
SUCCESS
DGMGRL> show database verbose p11_disaster;
Database
Name: p11_disaster
Role: PHYSICAL STANDBY
Enabled: YES
Intended State: ONLINE
Instance(s):
p11
Properties:
InitialConnectIdentifier = 'to_standby'
LogXptMode = 'ARCH'
Dependency = ''
DelayMins = '0'
Binding = 'OPTIONAL'
MaxFailure = '0'
MaxConnections = '1'
ReopenSecs = '300'
NetTimeout = '180'
LogShipping = 'ON'
PreferredApplyInstance = ''
ApplyInstanceTimeout = '0'
ApplyParallel = 'AUTO'
StandbyFileManagement = 'AUTO'
ArchiveLagTarget = '0'
LogArchiveMaxProcesses = '10'
LogArchiveMinSucceedDest = '1'
DbFileNameConvert = ''
LogFileNameConvert = ''
FastStartFailoverTarget = ''
StatusReport = '(monitor)'
InconsistentProperties = '(monitor)'
InconsistentLogXptProps = '(monitor)'
SendQEntries = '(monitor)'
LogXptStatus = '(monitor)'
RecvQEntries = '(monitor)'
HostName = 'PROD102'
SidName = 'p11'
LocalListenerAddress = '(ADDRESS=(PROTOCOL=TCP)(HOST=10.0.1.102)(
PORT=1527))'
StandbyArchiveLocation = 'C:\oracle\P11\oraarch\P11arch'
AlternateLocation = ''
LogArchiveTrace = '0'
LogArchiveFormat = 'ARC%S_%R.%T'
LatestLog = '(monitor)'
TopWaitEvents = '(monitor)'
Current status for "p11_disaster":
SUCCESS
DGMGRL> switchover to p11_disaster;
Performing switchover NOW, please wait...
Error: ORA-16751: resource guard encountered errors in switchover to primary dat
abase
Failed.
Unable to switchover, primary database is still "p11_primary"
Here are the changed pfile of both DB's
Pfile changes at Primary
*.db_name='p11'
*.db_unique_name='p11_primary'
*.dg_broker_start=true
*.dml_locks=4000
*.event='10191 trace name context forever, level 1'
*.FILESYSTEMIO_OPTIONS='setall'
*.job_queue_processes=1
*.local_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = 10.0.1.104)(PORT = 1527))'
*.log_archive_config='dg_config=(p11_disaster,p11_primary)'
*.log_archive_dest_1='LOCATION=C:\oracle\P11\oraarch\P11arch VALID_FOR=(ALL_LOGFILES,ALL_ROLES)'
*.log_archive_dest_state_1='enable'
*.log_archive_dest_state_2='ENABLE'
*.log_archive_max_processes=10
*.log_archive_min_succeed_dest=1
*.log_buffer=1048576
*.log_checkpoint_interval=0
*.log_checkpoints_to_alert=true
*.open_cursors=800
*.parallel_execution_message_size=16384
*.pga_aggregate_target=347917516
*.processes=80
*.query_rewrite_enabled='false'
*.recyclebin='off'
*.remote_login_passwordfile='exclusive'
*.remote_os_authent=true
Pfile of standby server ( few parameters are created by DGMGRL itself)
*.db_name='P11'
*.db_unique_name='P11_disaster'
*.dg_broker_start=TRUE
*.dml_locks=4000
*.event='10191 trace name context forever, level 1'
*.fal_client='(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=10.0.1.102)(PORT=1527)))(CONNECT_DATA=(SERVICE_NAME=p11_disaster_XPT)(INSTANCE_NAME=p11)(SERVER=dedicated)))'
*.fal_server='(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=10.0.1.104)(PORT=1527)))(CONNECT_DATA=(SERVICE_NAME=p11_primary_XPT)(SERVER=dedicated)))'
*.FILESYSTEMIO_OPTIONS='setall'
*.job_queue_processes=1
*.local_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = 10.0.1.102)(PORT = 1527))'
*.log_archive_config='DG_CONFIG= (P11_primary, P11_disaster)'
*.log_archive_dest_1='LOCATION="C:\oracle\P11\oraarch\P11arch", VALID_FOR=(ALL_LOGFILES,ALL_ROLES)'
p11.log_archive_dest_1='location="C:\oracle\P11\oraarch\P11arch"','valid_for=(ALL_LOGFILES,ALL_ROLES)'
*.log_archive_dest_state_1='enable'
p11.log_archive_dest_state_1='ENABLE'
p11.log_archive_format='ARC%S_%R.%T'
*.log_archive_max_processes=10
*.log_archive_min_succeed_dest=1
p11.log_archive_trace=0
*.log_buffer=1048576
*.log_checkpoint_interval=0
*.log_checkpoints_to_alert=true
*.open_cursors=800
*.parallel_execution_message_size=16384
*.pga_aggregate_target=207827763
*.processes=80
*.query_rewrite_enabled='false'
*.recyclebin='off'
*.remote_login_passwordfile='exclusive'
*.remote_os_authent=true
*.replication_dependency_tracking=false
*.sessions=96
*.sga_max_size=311741644
*.shared_pool_reserved_size=15587082
*.shared_pool_size=300870822
*.sort_area_retained_size=0
*.sort_area_size=2097152
p11.standby_archive_dest='C:\oracle\P11\oraarch\P11arch'
*.standby_file_management='AUTO'
Please advice .
Thanks & Regards
Edited by: dharm.singh on Jul 9, 2011 7:48 AM

I have added the standby archive log destination as per your suggestion p11.standby_archive_dest='C:\oracle\P11\oraarch\P11arch'
However , i am now getting these errors in dgmgrl log file while doing switchover.
DG 2011-07-11-14:39:24 0 2 756225487 DMON: CTL_ENABLE of p11
DG 2011-07-11-14:39:24 0 2 756225487 requires reset of LOG XPT Engine
DG 2011-07-11-14:39:24 0 2 756225487 on Site p11_primary
DG 2011-07-11-14:39:24 0 2 0 Reset Log Transport Resource: SetState ONLINE, phase BUILD-UP, External Cond ENABLE
DG 2011-07-11-14:39:24 0 2 0 Set log transport destination: SetState ONLINE, phase BUILD-UP, External Cond ENABLE
DG 2011-07-11-14:39:24 0 2 0 Executing SQL [alter system set log_archive_dest_2 = 'service="(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=10.0.1.102)(PORT=1527)))(CONNECT_DATA=(SERVICE_NAME=p11_disaster_XPT)(INSTANCE_NAME=p11)(SERVER=dedicated)))"', '   LGWR ASYNC NOAFFIRM delay=0 OPTIONAL max_failure=0 max_connections=1   reopen=300 db_unique_name="p11_disaster" register net_timeout=180 valid_for=(online_logfile,primary_role)']
DG 2011-07-11-14:39:24 0 2 0 SQL [alter system set log_archive_dest_2 = 'service="(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=10.0.1.102)(PORT=1527)))(CONNECT_DATA=(SERVICE_NAME=p11_disaster_XPT)(INSTANCE_NAME=p11)(SERVER=dedicated)))"', '   LGWR ASYNC NOAFFIRM delay=0 OPTIONAL max_failure=0 max_connections=1   reopen=300 db_unique_name="p11_disaster" register net_timeout=180 valid_for=(online_logfile,primary_role)'] Executed successfully
DG 2011-07-11-14:39:24 0 2 0 Executing SQL [alter system set log_archive_dest_state_2 = 'ENABLE']
DG 2011-07-11-14:39:24 0 2 0 SQL [alter system set log_archive_dest_state_2 = 'ENABLE'] Executed successfully
DG 2011-07-11-14:39:24 0 2 0 Executing SQL [ALTER SYSTEM SWITCH ALL LOGFILE]
DG 2011-07-11-14:39:26 0 2 0 SQL [ALTER SYSTEM SWITCH ALL LOGFILE] Executed successfully
DG 2011-07-11-14:39:26 0 2 0 DMON: site 01001000, instance 00000001 queuing healthcheck lock request
DG 2011-07-11-14:39:26 0 2 0 DMON: Releasing healthcheck master lock
DG 2011-07-11-14:39:26 0 2 0 DMON: Health check master lock conversion successful
DG 2011-07-11-14:39:26 0 2 0 DMON: a process acquired the healthcheck master lock
DG 2011-07-11-14:39:26 0 2 0 INSV: Received message for inter-instance publication
DG 2011-07-11-14:39:26 0 2 756225487 DMON: status from rfi_post_instances() for ENABLE = ORA-00000
DG 2011-07-11-14:39:26 0 2 0 req_id 1.1.756225487, opcode CTL_ENABLE, phase END, flags 5
DG 2011-07-11-14:39:26 0 2 756225487 DMON: ENABLE Complete, Object p11
DG 2011-07-11-14:39:26 0 2 756225487      enabled in State ONLINE
DG 2011-07-11-14:39:26 0 2 756225487 rfm_inst_phase_dispatch 16 END phase processing
DG 2011-07-11-14:39:26 0 2 0 INSV: All instances have replied for message
DG 2011-07-11-14:39:26 0 2 0 req_id 1.1.756225487, opcode CTL_ENABLE, phase END
DG 2011-07-11-14:39:26 0 2 756225487 DMON: CTL_ENABLE operation completed
DG 2011-07-11-14:39:26 0 2 756225487 DMON: Entered rfm_release_chief_lock for CTL_ENABLE
DG 2011-07-11-14:39:29 0 2 756225495 DMON: ENUM_DRC: success. (len = 652)
DG 2011-07-11-14:39:29 0 2 756225495 DMON: ENUM_DRC operation completed
DG 2011-07-11-14:39:29 1000 2 756225496 DMON: MON_PROPERTY operation completed
DG 2011-07-11-14:39:29 1000 2 756225497 DMON: Entered rfm_get_chief_lock() for MON_VERIFY, reason 0
DG 2011-07-11-14:39:29 1000 2 756225497 DMON: chief lock convert for client healthcheck
DG 2011-07-11-14:39:29 0 2 0 INSV: Received message for inter-instance publication
DG 2011-07-11-14:39:29 0 2 0 req_id 1.1.756225497, opcode MON_VERIFY, phase BEGIN, flags 5
DG 2011-07-11-14:39:30 0 2 0 INSV: All instances have replied for message
DG 2011-07-11-14:39:30 0 2 0 req_id 1.1.756225497, opcode MON_VERIFY, phase BEGIN
DG 2011-07-11-14:39:30 0 2 0 INSV: Received message for inter-instance publication
DG 2011-07-11-14:39:30 0 2 0 req_id 1.1.756225497, opcode MON_VERIFY, phase RESYNCH, flags 10005
DG 2011-07-11-14:39:30 0 2 0 INSV: All instances have replied for message
DG 2011-07-11-14:39:30 0 2 0 req_id 1.1.756225497, opcode MON_VERIFY, phase RESYNCH
DG 2011-07-11-14:39:30 1000 2 756225497 DMON: MON_VERIFY operation completed
DG 2011-07-11-14:39:30 1000 2 756225497 DMON: Entered rfm_release_chief_lock for MON_VERIFY
DG 2011-07-11-14:39:30 1000 2 756225500 DMON: CTL_GET_STATUS operation completed
DG 2011-07-11-14:39:44 1000 2 756225501 DMON: Entered rfm_get_chief_lock() for MON_VERIFY, reason 0
DG 2011-07-11-14:39:44 1000 2 756225501 DMON: chief lock convert for client healthcheck
DG 2011-07-11-14:39:44 0 2 0 INSV: Received message for inter-instance publication
DG 2011-07-11-14:39:44 0 2 0 req_id 1.1.756225501, opcode MON_VERIFY, phase BEGIN, flags 5
DG 2011-07-11-14:39:45 0 2 0 INSV: All instances have replied for message
DG 2011-07-11-14:39:45 0 2 0 req_id 1.1.756225501, opcode MON_VERIFY, phase BEGIN
DG 2011-07-11-14:39:45 0 2 0 INSV: Received message for inter-instance publication
DG 2011-07-11-14:39:45 0 2 0 req_id 1.1.756225501, opcode MON_VERIFY, phase RESYNCH, flags 10005
DG 2011-07-11-14:39:45 0 2 0 INSV: All instances have replied for message
DG 2011-07-11-14:39:45 0 2 0 req_id 1.1.756225501, opcode MON_VERIFY, phase RESYNCH
DG 2011-07-11-14:39:45 1000 2 756225501 DMON: MON_VERIFY operation completed
DG 2011-07-11-14:39:45 1000 2 756225501 DMON: Entered rfm_release_chief_lock for MON_VERIFY
DG 2011-07-11-14:39:45 0 2 756225504 DMON: ENUM_DRC: success. (len = 652)
DG 2011-07-11-14:39:45 0 2 756225504 DMON: ENUM_DRC operation completed
DG 2011-07-11-14:39:45 1000 2 756225505 DMON: MON_PROPERTY operation completed
DG 2011-07-11-14:39:45 2000000 3 756225506 DMON: Entered rfm_get_chief_lock() for CTL_SWITCH, reason 0
DG 2011-07-11-14:39:45 2000000 3 756225506 DMON: chief lock convert for switchover
DG 2011-07-11-14:39:45 0 2 0 Executing SQL [ALTER SYSTEM ARCHIVE LOG CURRENT]
DG 2011-07-11-14:39:53 0 2 0 SQL [ALTER SYSTEM ARCHIVE LOG CURRENT] Executed successfully
DG 2011-07-11-14:39:53 2000000 3 756225506 DMON: posting primary instances for SWITCHOVER phase 1
DG 2011-07-11-14:39:53 2000000 3 756225506 DMON: dispersing message to standbys for SWITCHOVER phase 1
DG 2011-07-11-14:39:53 0 2 0 INSV: Received message for inter-instance publication
DG 2011-07-11-14:39:53 0 2 0 req_id 1.1.756225506, opcode CTL_SWITCH, phase BEGIN, flags 5
DG 2011-07-11-14:39:53 2000000 3 756225506 DMON: Entered rfmsoexinst for phase 1
DG 2011-07-11-14:39:53 0 2 0 INSV: All instances have replied for message
DG 2011-07-11-14:39:53 0 2 0 req_id 1.1.756225506, opcode CTL_SWITCH, phase BEGIN
DG 2011-07-11-14:39:53 2000000 3 756225506 DMON: CLSR being notified to disable services and shutdown instances as appropriate for SWITCHOVER.
DG 2011-07-11-14:39:53 2000000 3 756225506 DMON: posting primary instances for SWITCHOVER phase 2
DG 2011-07-11-14:39:53 0 2 0 INSV: Received message for inter-instance publication
DG 2011-07-11-14:39:53 2000000 3 756225506 DMON: dispersing message to standbys for SWITCHOVER phase 2
DG 2011-07-11-14:39:53 0 2 0 req_id 1.1.756225506, opcode CTL_SWITCH, phase TEARDOWN, flags 5
DG 2011-07-11-14:39:53 2000000 3 756225506 DMON: Entered rfmsoexinst for phase 2
DG 2011-07-11-14:39:53 0 2 0 RSM 0 received SETSTATE request: rid=0x01041000, sid=0, phid=1, econd=2, sitehndl=0x02001000
DG 2011-07-11-14:39:53 0 2 0 Log Transport Resource: SetState OFFLINE, phase TEAR-DOWN, External Cond SWITCH-OVER-PHYS_STBY
DG 2011-07-11-14:39:53 0 2 0 RSM 0 received SETSTATE request: rid=0x01012000, sid=4, phid=1, econd=2, sitehndl=0x02001000
DG 2011-07-11-14:39:53 0 2 0 Database Resource[IAM=PRIMARY]: SetState PHYSICAL-APPLY-ON, phase TEAR-DOWN, External Cond SWITCH-OVER-PHYS_STBY, Target Site Handle 0x02001000
DG 2011-07-11-14:39:53 0 2 0 Executing SQL [ALTER DATABASE COMMIT TO SWITCHOVER TO PHYSICAL STANDBY WITH SESSION SHUTDOWN]
DG 2011-07-11-14:41:32 0 2 0 SQL [ALTER DATABASE COMMIT TO SWITCHOVER TO PHYSICAL STANDBY WITH SESSION SHUTDOWN] Executed successfully
DG 2011-07-11-14:41:32 0 2 0 Executing SQL [alter system set log_archive_dest_2 = '']
DG 2011-07-11-14:41:32 0 2 0 SQL [alter system set log_archive_dest_2 = ''] Executed successfully
DG 2011-07-11-14:41:32 0 2 0 Executing SQL [alter system set log_archive_dest_state_2 = 'ENABLE']
DG 2011-07-11-14:41:32 0 2 0 SQL [alter system set log_archive_dest_state_2 = 'ENABLE'] Executed successfully
DG 2011-07-11-14:41:32 0 2 0 Database Resource SetState succeeded
DG 2011-07-11-14:41:32 0 2 0 INSV: All instances have replied for message
DG 2011-07-11-14:41:32 0 2 0 req_id 1.1.756225506, opcode CTL_SWITCH, phase TEARDOWN
DG 2011-07-11-14:41:32 2000000 3 756225506 DMON: posting primary instances for SWITCHOVER phase 2
DG 2011-07-11-14:41:32 2000000 3 756225506 DMON: dispersing message to standbys for SWITCHOVER phase 2
DG 2011-07-11-14:41:32 0 2 0 INSV: Received message for inter-instance publication
DG 2011-07-11-14:41:32 0 2 0 req_id 1.1.756225506, opcode CTL_SWITCH, phase TEARDOWN, flags 5
DG 2011-07-11-14:41:32 2000000 3 756225506 DMON: Entered rfmsoexinst for phase 2
DG 2011-07-11-14:41:32 0 2 0 INSV: All instances have replied for message
DG 2011-07-11-14:41:32 0 2 0 req_id 1.1.756225506, opcode CTL_SWITCH, phase TEARDOWN
DG 2011-07-11-14:41:47 2000000 3 756225506 Operation CTL_SWITCH cancelled during phase 2, error = ORA-16751
DG 2011-07-11-14:41:47 2000000 3 756225506 DMON: CLSR being notified to enable services and startup primary instances as appropriate for SWITCHOVER.
DG 2011-07-11-14:41:47 0 2 0 DMON: site 01001000, instance 00000001 queuing healthcheck lock request
DG 2011-07-11-14:41:47 0 2 0 DMON: Releasing healthcheck master lock
DG 2011-07-11-14:41:47 0 2 0 DMON: Health check master lock conversion successful
DG 2011-07-11-14:41:47 0 2 0 DMON: a process acquired the healthcheck master lock
DG 2011-07-11-14:41:47 2000000 3 756225506 DMON: posting primary instances for SWITCHOVER phase 5
DG 2011-07-11-14:41:47 2000000 3 756225506 DMON: SWITCHOVER Aborted due to errors
DG 2011-07-11-14:41:47 0 2 0 INSV: Received message for inter-instance publication
DG 2011-07-11-14:41:47 2000000 3 756225506      Site named: p11_primary is still primary
DG 2011-07-11-14:41:48 0 2 0 req_id 1.1.756225506, opcode CTL_SWITCH, phase END, flags 5
DG 2011-07-11-14:41:48 2000000 3 756225506      error = ORA-16751
DG 2011-07-11-14:41:48 2000000 3 756225506 DMON: dispersing message to standbys for SWITCHOVER phase 5
DG 2011-07-11-14:41:48 0 2 0 INSV: All instances have replied for message
DG 2011-07-11-14:41:48 0 2 0 DMON: site 01001000, instance 00000001 queuing healthcheck lock request
DG 2011-07-11-14:41:48 0 2 0 req_id 1.1.756225506, opcode CTL_SWITCH, phase END
DG 2011-07-11-14:41:48 0 2 0 DMON: Releasing healthcheck master lock
DG 2011-07-11-14:41:48 0 2 0 DMON: Health check master lock conversion successful
DG 2011-07-11-14:41:48 0 2 0 DMON: a process acquired the healthcheck master lock
DG 2011-07-11-14:41:48 2000000 3 756225506 Operation CTL_SWITCH cancelled during phase 5, error = ORA-16751
DG 2011-07-11-14:41:48 2000000 3 756225506 DMON: CTL_SWITCH operation completed
DG 2011-07-11-14:41:48 2000000 3 756225506 DMON: Entered rfm_release_chief_lock for CTL_SWITCH
Please advice.

Database not found/Error: ORA-16621: database name for ADD DATABASE must be

I am new to Data Guard and am trying to set up Data Guard Broker. I had created a configuration file with both my primary and standby databases and at one time I could show both databases. But now I can no longer show the standby database nor can I enable, disable or reinstate it. Here is what I have:
Primary Database: orcl10g
Standby Database: 10gSB
DGMGRL> show configuration
Configuration
Name: orcl10g
Enabled: YES
Protection Mode: MaxPerformance
Fast-Start Failover: DISABLED
Databases:
orcl10g - Primary database
10gSB - Physical standby database
Current status for "orcl10g":
SUCCESS
DGMGRL> show database verbose orcl10g
Database
Name: orcl10g
Role: PRIMARY
Enabled: YES
Intended State: ONLINE
Instance(s):
orcl10g
Properties:
InitialConnectIdentifier = 'orcl10g'
LogXptMode = 'ASYNC'
Dependency = ''
DelayMins = '0'
Binding = 'OPTIONAL'
MaxFailure = '0'
MaxConnections = '1'
ReopenSecs = '300'
NetTimeout = '180'
LogShipping = 'ON'
PreferredApplyInstance = ''
ApplyInstanceTimeout = '0'
ApplyParallel = 'AUTO'
StandbyFileManagement = 'AUTO'
ArchiveLagTarget = '0'
LogArchiveMaxProcesses = '30'
LogArchiveMinSucceedDest = '1'
DbFileNameConvert = '10gSB, orcl10g'
LogFileNameConvert = '/oracle/oracle/product/10.2.0/oradata/orcl10g/redo01.log, /oracle/oracle/product/10.2.0/oradata/10gSB/redo01.log, /oracle/oracle/product/10.2.0/oradata/orcl10g/redo02.log, /oracle/oracle/product/10.2.0/oradata/10gSB/redo02.log, /oracle/oracle/product/10.2.0/oradata/orcl10g/redo03.log, /oracle/oracle/product/10.2.0/oradata/10gSB/redo03.log'
FastStartFailoverTarget = ''
StatusReport = '(monitor)'
InconsistentProperties = '(monitor)'
InconsistentLogXptProps = '(monitor)'
SendQEntries = '(monitor)'
LogXptStatus = '(monitor)'
RecvQEntries = '(monitor)'
HostName = 'remarkable.mammothnetworks.com'
SidName = 'orcl10g'
LocalListenerAddress = '(ADDRESS=(PROTOCOL=tcp)(HOST=remarkable.mammothnetworks.com)(PORT=1521))'
StandbyArchiveLocation = '/oracle/flash_recovery_area/orcl10g/archivelog'
AlternateLocation = ''
LogArchiveTrace = '1024'
LogArchiveFormat = '%t_%s_%r.arc'
LatestLog = '(monitor)'
TopWaitEvents = '(monitor)'
Current status for "orcl10g":
SUCCESS
DGMGRL> show database verbose 10gSB
Object "10gsb" was not found
DGMGRL>
DGMGRL> remove database 10gSB
Object "10gsb" was not found
DGMGRL>
DGMGRL> reinstate database 10gSB
Object "10gsb" was not found
DGMGRL>
DGMGRL> enable database 10gSB
Object "10gsb" was not found
DGMGRL>
DGMGRL> add database '10gSB' as
connect identifier is 10gSB
maintained as physical;Error: ORA-16621: database name for ADD DATABASE must be unique
Failed.
How can I get Data Guard to see the standby database correctly again?

Thank you for the constructive feedback. I have been able to make progress on this issue.
I did check the Data Guard Log files as you suggested. I did not find anything when I checked them before but this time I found the following:
DG 2011-06-16-17:23:18 0 2 0 RSM detected log transport problem: log transport for database '10gSB' has the following error.
DG 2011-06-16-17:23:18 0 2 0 RSM0: HEALTH CHECK ERROR: ORA-16737: the redo transport service for standby database "10gSB" has an error
DG 2011-06-16-17:23:18 0 2 0 NSV1: Failed to connect to remote database 10gSB. Error is ORA-12514
DG 2011-06-16-17:23:18 0 2 0 RSM0: Failed to connect to remote database 10gSB. Error is ORA-12514
DG 2011-06-16-17:23:18 0 2 753988034 Operation CTL_GET_STATUS cancelled during phase 2, error = ORA-16778
DG 2011-06-16-17:23:18 0 2 753988034 Operation CTL_GET_STATUS cancelled during phase 2, error = ORA-16778
I verified that I am able to connect to both the primary and standby databases via external connections:
-bash-3.2$ lsnrctl status
LSNRCTL for Linux: Version 10.2.0.1.0 - Production on 17-JUN-2011 12:41:03
Copyright (c) 1991, 2005, Oracle. All rights reserved.
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
STATUS of the LISTENER
Alias LISTENER
Version TNSLSNR for Linux: Version 10.2.0.1.0 - Production
Start Date 17-JUN-2011 01:40:30
Uptime 0 days 11 hr. 0 min. 32 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /oracle/oracle/product/10.2.0/db_1/network/admin/listener.ora
Listener Log File /oracle/oracle/product/10.2.0/db_1/network/log/listener.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=remarkable.mammothnetworks.com)(PORT=1521)))
Services Summary...
Service "10gSB" has 1 instance(s).
Instance "10gSB", status READY, has 1 handler(s) for this service...
Service "10gSB_DGB" has 1 instance(s).
Instance "10gSB", status READY, has 1 handler(s) for this service...
Service "10gSB_XPT" has 1 instance(s).
Instance "10gSB", status READY, has 1 handler(s) for this service...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
Service "orcl10g" has 1 instance(s).
Instance "orcl10g", status READY, has 1 handler(s) for this service...
Service "orcl10gXDB" has 1 instance(s).
Instance "orcl10g", status READY, has 1 handler(s) for this service...
Service "orcl10g_DGB" has 1 instance(s).
Instance "orcl10g", status READY, has 1 handler(s) for this service...
Service "orcl10g_XPT" has 1 instance(s).
Instance "orcl10g", status READY, has 1 handler(s) for this service...
The command completed successfully
-bash-3.2$
-bash-3.2$
-bash-3.2$ sqlplus system/dbas4ever@orcl10g
SQL*Plus: Release 10.2.0.1.0 - Production on Fri Jun 17 12:43:41 2011
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - 64bit Production
With the Partitioning, OLAP and Data Mining options
SQL> quit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - 64bit Production
With the Partitioning, OLAP and Data Mining options
-bash-3.2$ sqlplus system/dbas4ver@10gSB
SQL*Plus: Release 10.2.0.1.0 - Production on Fri Jun 17 12:43:59 2011
Copyright (c) 1982, 2005, Oracle. All rights reserved.
ERROR:
ORA-01033: ORACLE initialization or shutdown in progress <== I think this is normal since the database is in mount mode
Enter user-name:
I also checked the listener log file and did see and error associated with a known bug:
WARNING: Subscription for node down event still pending
So I added the following to the listener.ora file and bounced the listener:
SUBSCRIBE_FOR_NODE_DOWN_EVENT_LISTENER=OFF
That seems to have taken care of the error.
The following is my listener.ora file:
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(SID_NAME = PLSExtProc)
(ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1)
(PROGRAM = extproc)
(SID_DESC = ( GLOBAL_DBNAME = 10gsb_DGMGRL.remarkable.mammothnetworks.com )
( SERVICE_NAME = 10gsb.remarkable.mammothnetworks.com )
( SID_NAME = 10gsb )
( ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1 )
(SID_DESC = ( GLOBAL_DBNAME = orcl10g_DGMGRL.remarkable.mammothnetworks.com )
( SERVICE_NAME = orcl10g.remarkable.mammothnetworks.com )
( SID_NAME = orcl10g )
( ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1 )
(SID_DESC = ( GLOBAL_DBNAME = orcl10g.remarkable.mammothnetworks.com )
( SERVICE_NAME = orcl10g.remarkable.mammothnetworks.com )
( SID_NAME = orcl10g )
( ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1 )
(SID_DESC = ( GLOBAL_DBNAME = 10gsb.remarkable.mammothnetworks.com )
( SERVICE_NAME = 10gsb.remarkable.mammothnetworks.com )
( SID_NAME = 10gsb )
( ORACLE_HOME = /oracle/oracle/product/10.2.0/db_1 )
SUBSCRIBE_FOR_NODE_DOWN_EVENT_LISTENER=OFF
I again tried connecting externally to the standby database:
-bash-3.2$ sqlplus system/dbas4ever@10gSB
SQL*Plus: Release 10.2.0.1.0 - Production on Fri Jun 17 13:09:00 2011
Copyright (c) 1982, 2005, Oracle. All rights reserved.
ERROR:
ORA-01033: ORACLE initialization or shutdown in progress
Enter user-name:
and see this in the listener.log file:
17-JUN-2011 13:10:22 * (CONNECT_DATA=(SERVICE_NAME=10gSB_XPT)(SERVER=dedicated)(CID=(PROGRAM=oracle)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=199.187.124.130)(PORT=11357)) * establish * 10gSB_XPT * 0
17-JUN-2011 13:10:22 * (CONNECT_DATA=(SERVICE_NAME=10gSB_XPT)(SERVER=dedicated)(CID=(PROGRAM=oracle)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=199.187.124.130)(PORT=11358)) * establish * 10gSB_XPT * 0
17-JUN-2011 13:10:24 * service_update * 10gSB * 0
17-JUN-2011 13:10:30 * (CONNECT_DATA=(SID=orcl10g)(CID=(PROGRAM=perl)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=127.0.0.1)(PORT=25119)) * establish * orcl10g * 0
17-JUN-2011 13:10:30 * (CONNECT_DATA=(SID=orcl10g)(CID=(PROGRAM=perl)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=127.0.0.1)(PORT=25120)) * establish * orcl10g * 0
17-JUN-2011 13:10:30 * (CONNECT_DATA=(SID=orcl10g)(CID=(PROGRAM=emagent)(HOST=localhost.localdomain)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=127.0.0.1)(PORT=25121)) * establish * orcl10g * 0
17-JUN-2011 13:11:22 * (CONNECT_DATA=(SERVICE_NAME=10gSB_XPT)(SERVER=dedicated)(CID=(PROGRAM=oracle)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=199.187.124.130)(PORT=11420)) * establish * 10gSB_XPT * 0
17-JUN-2011 13:11:22 * (CONNECT_DATA=(SERVICE_NAME=10gSB_XPT)(SERVER=dedicated)(CID=(PROGRAM=oracle)(HOST=remarkable.mammothnetworks.com)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=199.187.124.130)(PORT=11422)) * establish * 10gSB_XPT * 0
17-JUN-2011 13:11:24 * service_update * 10gSB * 0
I tried again to see the database in Data Guard Broker:
DGMGRL> show database 10gSB
Object "10gsb" was not found
however, I then was able to add the database in Data Guard Broker:
DGMGRL> add database 10gSB
as connect identifier is 10gSB
maintained as physical;Database "10gsb" added <== this is progress!!!
However the configuration shows the following:
DGMGRL> show database 10gSB
Database
Name: 10gsb
Role: PHYSICAL STANDBY
Enabled: NO
Intended State: OFFLINE
Instance(s):
10gSB
Current status for "10gsb":
DISABLED <=====
So I tried to enable the database:
DGMGRL> enable database 10gSB
Error: ORA-16626: failed to enable specified object
Failed.
and I tried to reinstate the database:
DGMGRL> reinstate database 10gSB
Reinstating database "10gsb", please wait...
Error: ORA-16653: failed to reinstate database
Failed.
Reinstatement of database "10gsb" failed
So I checked the configuration and now see two entries for the standby database but with case differences:
DGMGRL> show configuration
Configuration
Name: orcl10g
Enabled: YES
Protection Mode: MaxPerformance
Fast-Start Failover: DISABLED
Databases:
orcl10g - Primary database
10gSB - Physical standby database
10gsb - Physical standby database (disabled)
Current status for "orcl10g":
SUCCESS
Question: How do I get rid of 10gSB and enable 10gsb?

Alerts - All Metrics Errors - Health Check - Collection Failure

I have database instances with Health Check - Collection Failures.
These errors are almost 30 days old. I originally received the Health Check errors because the credentials were not set properly. I then set them but the errors have not aged out.
Does anyone know how can I clear out the Health Check errors?
When I look at All Metrics, Health Check for one of these databases, the Last Upload date is very old.
Maybe I can I force a re-collection?

Hi ,
I had the same problem and posted the same ...question...
So , the link will help you to solve the problem
Clear the Alert list
unless somebody else has another idea...!!!!!!!!!!!
Regards and hope this will help,
Simon

ORA-16820: fast-start failover observer is no longer observing this databa

Wem have primary and physical standby of Oracle 11.2 on linux 2.6.18-92.el5. For a reason of hardware resources, we want to run the Observer on the standby machine. Here I have several questions:
1) Is it supported to run Observer on the standby?
2) Does fast-start failover means automatical detecting down of primary and switch over the role automatically? WE do not want automatical switch over.
3) Started Observer on the standby and run show configuration, get errorDGMGRL> show configuration;
Configuration - antony
Protection Mode: MaxAvailability
Databases:
    rdev2 - Primary database
    sdev2 - (*) Physical standby database
      Error: ORA-16820: fast-start failover observer is no longer observing this database
Fast-Start Failover: ENABLED
Configuration Status:
ERROR Is the error caused by sunning Observer on standby, or other things?
Thanks.

Answering all your questions
Does fast-start failover means automatical detecting down of primary and switch over the role automatically? WE do not want automatical switch over.
Fast-Start Failover is an Oracle Data Guard 10g Release 2 feature that automatically, quickly, and reliably fails over to a designated, synchronized standby database in the event of loss of the production database, without requiring manual intervention to execute the failover.
In addition, following a fast-start failover, the original production database is automatically reconfigured as a new standby database upon reconnection to the configuration. This enables Data Guard to restore disaster protection in the configuration quickly and easily, returning the database to a protected state as soon as possible.
Is it supported to run Observer on the standby?
There are three essential participants in a Fast-Start Failover configuration:
• The production database
• A target standby database
• The Fast-Start Failover Observer
The target standby database will become the new production database following a fast-start failover (note: There can be multiple standby databases in a Data Guard configuration, but only one can be designated as the fast-start failover target. A manual failover would be required in order to execute a failover to any of the additional standby databases within the configuration).
The Observer is a separate process incorporated into the DGMGRL client that continuously monitors the production database and the target standby database for possible failure conditions.
The rule is that out of these three participants, (production database, standby database & observer) whichever two can communicate with each other will determine the outcome of fast-start failover
Hope the above explaination answers your question.

Check database with error "ORA-01031: insufficient privileges"

Dear Gurus,
        I ran "Check database" in DB13 but I got error "ORA-01031: insufficient privileges"
BR0280I BRCONNECT time stamp: 2010-03-31 12.37.00
BR0301E SQL error -1031 at location BrDbdiffRead-1, SQL statement:
'PREPARE stmt_5 STATEMENT FROM'
'SELECT OBJNAME FROM "SAPSR3".DBDIFF WHERE DBSYS IN ('ORACLE', ' ') AND OBJTYPE = 'TABL' AND DIFFKIND IN ('02', '61', '99') ORDER BY OBJNAME'
ORA-01031: insufficient privileges
BR0806I End of BRCONNECT processing: cecxekdh.chk 2010-03-31 12.37.00
       Note I try to execute sapdba_role.sql (with command "sqlplus /nolog @sapdba_role.sql SR3") as Note 134592 both login 'oradev' and 'devadm' but it seem to do nothing (not found sapdba_role.log)
      Please advice.
Best regards,
Choosak B.
Ps.
detailed log of /oracle/DEV/sapcheck/cecxekdh.chk
BR0801I BRCONNECT 7.00 (40)
BR0477I Oracle pfile /oracle/DEV/102_64/dbs/initDEV.ora created from spfile /oracle/DEV/102_64/dbs/spfileDEV.ora
BR0805I Start of BRCONNECT processing: cecxekdh.chk 2010-03-31 12.30.53
BR0484I BRCONNECT log file: /oracle/DEV/sapcheck/cecxekdh.chk
BR0101I Parameters
Name                           Value
oracle_sid                     DEV
oracle_home                    /oracle/DEV/102_64
oracle_profile                 /oracle/DEV/102_64/dbs/initDEV.ora
sapdata_home                   /oracle/DEV
sap_profile                    /oracle/DEV/102_64/dbs/initDEV.sap
system_info                    devadm/oradev sapdev SunOS 5.10 Generic_142900-03 sun4v
oracle_info                    DEV 10.2.0.4.0 8192 7465 94896497 sapdev UTF8 UTF8
sap_info                       701 SAPSR3 0002LK0003DEV0011N11827599290015Maintenance_ORA
make_info                      sun_64 OCI_102 Feb 21 2009
command_line                   brconnect -u / -jid CHECK20100331123000 -c -f check
alert_log                      /oracle/DEV/saptrace/background/alert_DEV.log
BR0280I BRCONNECT time stamp: 2010-03-31 12.30.56
BR0813I Schema owners found in database DEV:
DBSNMP, DIP, OPS$DEVADM, OPS$ORADEV, OPS$SAPSERVICEDEV, ORACLE_OCM, OUTLN, SAPSR3*, SYS, SYSTEM,
TSMSYS
BR0118I Tablespaces and data files
Tablespace     Status     File                                               Status     Id.        Size      MaxSize     IncrSize BlkSize      Device Type Link
PSAPSR3        ONLINE+    /oracle/DEV/sapdata2/sr3_1/sr3.data1               ONLINE+     4   2411732992 10485760000     20971520     8192    16777219 FILE NOLINK
SYSTEM         ONLINE+    /oracle/DEV/sapdata1/system_1/system.data1         SYSTEM+     1   1017126912 10485760000     20971520     8192    16777219 FILE NOLINK
BR0119I Redo log files
File                                          Status Group       Size       Device Type Link
/oracle/DEV/origlogA/log_g11m1.dbf            INUSE      1    52429312     16777218 FILE NOLINK
/oracle/DEV/mirrlogA/log_g11m2.dbf            INUSE      1    52429312     16777218 FILE NOLINK
/oracle/DEV/origlogB/log_g12m1.dbf            INUSE      2    52429312     16777218 FILE NOLINK
/oracle/DEV/mirrlogB/log_g12m2.dbf            INUSE      2    52429312     16777218 FILE NOLINK
/oracle/DEV/origlogA/log_g13m1.dbf            INUSE      3    52429312     16777218 FILE NOLINK
/oracle/DEV/mirrlogA/log_g13m2.dbf            INUSE      3    52429312     16777218 FILE NOLINK
/oracle/DEV/origlogB/log_g14m1.dbf            INUSE      4    52429312     16777218 FILE NOLINK
/oracle/DEV/mirrlogB/log_g14m2.dbf            INUSE      4    52429312     16777218 FILE NOLINK
BR0120I Control files
File                                                Size       Device Type Link
/oracle/DEV/origlogA/cntrl/cntrlDEV.dbf         15024128     16777218 FILE NOLINK
/oracle/DEV/origlogB/cntrl/cntrlDEV.dbf         15024128     16777218 FILE NOLINK
/oracle/DEV/sapdata1/cntrl/cntrlDEV.dbf         15024128     16777219 FILE NOLINK
BR0982I Database disk volumes
Directory / Raw disk                          Device      Total[KB]      Free[KB]    Used[%]   MaxNeed[KB]   MaxMiss[KB]
/oracle/DEV/102_64                          16777218     480700086     404332206      15.89             0             0
/oracle/DEV                                 16777218     480700086     404332206      15.89             0             0
/oracle/DEV/mirrlogA                        16777218     480700086     404332206      15.89             0             0
/oracle/DEV/mirrlogB                        16777218     480700086     404332206      15.89             0             0
/oracle/DEV/origlogA                        16777218     480700086     404332206      15.89             0             0
/oracle/DEV/origlogB                        16777218     480700086     404332206      15.89             0             0
/oracle/DEV/sapdata1                        16777219     591212116     404332206      31.61     240019884             0
/oracle/DEV/sapdata2                        16777219     591212116     404332206      31.61     240019884             0
/oracle/DEV/sapdata3                        16777219     591212116     404332206      31.61     240019884             0
/oracle/DEV/sapdata4                        16777219     591212116     404332206      31.61     240019884             0
/oracle/DEV/saparch                         16777218     480700086     404332206      15.89             0             0
/oracle/DEV/sapbackup                       16777218     480700086     404332206      15.89             0             0
/oracle/DEV/sapcheck                        16777218     480700086     404332206      15.89             0             0
/oracle/DEV/sapreorg                        16777218     480700086     404332206      15.89             0             0
/oracle/DEV/saptrace                        16777218     480700086     404332206      15.89             0             0
/oracle/DEV/oraarch                         16777218     480700086     404332206      15.89             0             0
BR0280I BRCONNECT time stamp: 2010-03-31 12.31.29
BR0814I Number of tables in schema of owner SAPSR3: 74582
BR0836I Number of info cube tables found for owner SAPSR3: 49
BR0814I Number of tables/partitions in schema of owner SYS: 625/189
BR0814I Number of tables/partitions in schema of owner SYSTEM: 134/27
BR0280I BRCONNECT time stamp: 2010-03-31 12.32.28
BR0815I Number of indexes in schema of owner SAPSR3: 89159
BR0815I Number of indexes/partitions in schema of owner SYS: 678/199
BR0815I Number of indexes/partitions in schema of owner SYSTEM: 175/32
BR0280I BRCONNECT time stamp: 2010-03-31 12.37.00
BR0816I Number of segments in schema of owner DBSNMP: 25
BR0816I Number of segments in schema of owner OPS$DEVADM: 1
BR0816I Number of segments in schema of owner OUTLN: 9
BR0816I Number of segments/LOBs in schema of owner SAPSR3: 168369/2314
BR0816I Number of segments/LOBs in schema of owner SYS: 1831/87
BR0816I Number of segments/LOBs in schema of owner SYSTEM: 353/22
BR0816I Number of segments in schema of owner TSMSYS: 4
BR0280I BRCONNECT time stamp: 2010-03-31 12.37.00
BR0961I Number of conditions found in DBCHECKORA: 118
BR0983I Tablespace fragmentation
Tablespace    Files   Tables Indexes    Extents     Total[KB]   Used[%]     Free[KB]   FreeExt.   MaxSize[KB]   MaxAlloc[KB]   Used[%]       Free[KB]       Largest[KB]
PSAPSR3          16    74248    88689     209864     54138880     94.51      2970752        240     163840000+     109701120+    31.23+     112671872+       9246720:7966720:7946240:7905280:7905280+
PSAPSR3701       14        0        0          0     54466560      0.00     54465664         20     143360000+      88893440+     0.00+     143359104+       9021440:8192000:8192000:8192000:8192000+
PSAPSR3701X       4      310      445      12190     68342784     94.20      3962240          7      68342784              0     94.20        3962240        1298432:1191936:979968:163776:163776
PSAPSR3USR        1       24       25         51        51200      6.50        47872          1      10240000+      10188800+     0.03+      10236672+      10188800+:47872:0:0:0
PSAPTEMP          1        0        0          0      1433600      0.00      1433600          0      10240000+       8806400+     0.00+      10240000+       8806400+:0:0:0:0
PSAPUNDO          1        0        0          0      7823360      0.00      7823296        406      10240000+       2416640+     0.00+      10239936+       2416640+:2041792:1814464:1433536:603072
SYSAUX            1      254      284       2059       307200     93.35        20416         16      10240000+       9932800+     2.80+       9953216+       9932800+:13248:3072:1024:640
SYSTEM            1      505      569       2926       993280     98.91        10816          2      10240000+       9246720+     9.59+       9257536+       9246720+:10176:640:0:0
Total:           39    75341    90012     227090    187556864     62.29     70734656        692     426742784      239185920     27.38      309920576       60157952:19463744:18936384:17695616:16864768
BR0280I BRCONNECT time stamp: 2010-03-31 12.37.00
BR0301E SQL error -1031 at location BrDbdiffRead-1, SQL statement:
'PREPARE stmt_5 STATEMENT FROM'
'SELECT OBJNAME FROM "SAPSR3".DBDIFF WHERE DBSYS IN ('ORACLE', ' ') AND OBJTYPE = 'TABL' AND DIFFKIND IN ('02', '61', '99') ORDER BY OBJNAME'
ORA-01031: insufficient privileges
BR0806I End of BRCONNECT processing: cecxekdh.chk 2010-03-31 12.37.00
BR0280I BRCONNECT time stamp: 2010-03-31 12.37.00
BR0804I BRCONNECT terminated with errors

Hi,
       It solved after change permission of directory that sapdba_role.sql kept to oradev:dba after that it can write sapdba_role.log.
      Thank you for your guideline.
      Now, I can ran 'Check database' via DB13 without that error.
Best regards,
Choosak B.

Instance health check failing with errors

Hi
One of the instance showing " Agent connection is Instance is unavailable". How ever it is collecting and showing instance performance when I go to Performance pane.
When I check in emagent.trc file it is saying either agent/instance are running with different user than ORACLE or group not DBA.
Actually, in my case both are same.. l mean Oracle:dba.
I have bounce many times agent but no luck.
Your valuble comments helps greatly.
Here is error message
Target TARGET_NAME_INST1
Type Database Instance
Metric Health Check
Collection Timestamp Jul 16, 2007 10:45:28 AM
Error Type Collection Failure
Message Instance Health Check initialization failed due to one of the following causes: the owner of the EM agent process is not same as the owner of the Oracle instance processes; the owner of the EM agent process is not part of the dba group; or the database version is not 10g (10.1.0.2) and above.
________________________________________________________________

Use metalink - its your friend...
Symptoms
Caution:
The scope of this note is limited to Agents 10.2.x monitoring Oracle Databases running on HP-UX.
By default, the Agent 10.2.x is collecting the Healthcheck metric every 15 seconds. This metric basically gives an indication whether the monitored database is up and running.
On some circumstances, the Healthcheck metric cannot be collected. This results in such entries being added every 15 seconds to the $AGENT_HOME/sysman/log/emagent.trc log file:
2007-05-09 09:21:36 Thread-81 ERROR fetchlets.healthCheck: Error: process context is not initialized
2007-05-09 09:21:36 Thread-81 ERROR engine: [oracle_database,EMI10104_rmtdchp4,health_check] : nmeegd_GetMetricData failed : Instance Health Check initialization failed due to one of the following causes: the owner of the EM agent process is not same as the owner of the Oracle instance processes; the owner of the EM agent process is not part of the dba group; or the database version is not 10g (10.1.0.2) and above.
2007-05-09 09:21:36 Thread-81 WARN collector: <nmecmc.c> Error exit. Error message: Instance Health Check initialization failed due to one of the following causes: the owner of the EM agent process is not same as the owner of the Oracle instance processes; the owner of the EM agent process is not part of the dba group; or the database version is not 10g (10.1.0.2) and above.
or
Solution
There are several steps to solve this problem:
1. If the Agent Release is 10.2.0.1 or 10.2.0.2, upgrade the Agent to 10.2.0.3 and follow the steps below.
2. For HP-UX 10.2.0.3 Agent, here are the instructions to fix the problem while keeping the Healthcheck metric enabled. This section takes place in the Agent Oracle Home.
2.1. Download Patch 5854190 from Metalink.
2.2. Setup the Agent environment and shutdown the Agent by doing:

Battery was replaced but error still appears in the HP health check

The HP health check shows the HP Notebook PC Battery Pack needs to be replaced. I have a HP Pavilion Entertainment and I did replace the battery but the message still appears. Any suggestions as to how to stop the message from appearing?

full charge, then let the battery FULLY depleat, this will teach the computerto read the battery properly,

Error ORA-12560 prompts when trying to log in to the Enterprise Manager

Hi all,
I am a newbie to Oracle.
Just installed the Oracle 9i Database Enterprise Edition (9.0.1) into Windows Server 2003 Standard Edition. Problem is encountered when trying to log in to the Enterprise Manager Standalone mode using either system/oracle or scott/tiger as credentials. Error "ORA-12560: TNS:protocol adapter error" prompts.
I tried to check with some configuration and see whether the services are started. Services of "OracleOraHome90TNSListener" and "OracleServiceORCL" have been started and the database exists in the dedicated directory. Environment variables of "ORACLE_HOME" and "ORACLE_SID" have been added manually as the SID is set to orcl, which I just follow what the instruction manual has stated. Moreover, I can't get access using command prompt typing "svrmgrl"; error returned stating " 'svrmgrl' is not recognized as an internal or external command, operable program or batch file."
Another information is that there is no domain set in my server. Just a server with a name being assigned in a workgroup.
Hence, would you mind please advice me what to do in order to get access into the Enterprise Manager? It's quite an urgent task.
A million thx in advance!
Best Regards,
Karen

Hi Jigneshrp,
Thanks for your reply.
It is checked that the listener is running and TNS name service exists. Following your advice, I did create a new listener and another name service and use them, but the same error turns out when trying to log in to the Enterprise Manager again.
Additional information to take note for is that while reconfiguring the existing listener or creating a new listener, a mesage prompts stating "The information provided for this listener is currently in use by other software on this computer. You can proceed with the configuration as it is, but it will not be possible to start this listener until the conflict is resolved. Would you like to continue with the continue with the configuration anyway? Yes/No".
As for the reconfiguration or the new creation of TNS names service, when I am trying to test for the connection, the results in the details pane states that "Connecting... ORA-12560: TNS:protocol adapter error. The test did not succeed...."
Would you mind pls advice me on these?
Furthermore, there exist 2 questions I am wondering is that it is stated in the instruction manual that prior to the installation, a static IP should be specified for it instead of the DHCP one; hence, I wanna ask after the complete insallation, is it that the server should be running in the network, i.e. allow it to get connected with the outside network?
2nd question is that can Oracle 9i Database Server Standard Edition (9.0.1) be installed under a Windows Server 2003 Standard Edition and just a Window XP Professional?
Thanks for your reply.
Best Regards,
Karen

[PL/SQL Error] ORA-01843: not a valid month, not sure how to troubleshoot

Trying to use PL/SQL to automatically create a report that show the following:
Daily:
# of Registered Users
# of Completes (assessment)      Average per User
# of Starts (assessment)      Average per User
Weekly:
# of Registered Users
# of Completes (assessment)      Average per User
# of Starts (assessment)      Average per User
Yearly:
# of Registered Users
# of Completes (assessment)      Average per User
# of Starts (assessment)      Average per User
When I run the PL/SQL I get the following
[error]
ORA-01843: not a valid month
[error]
The error occurs on this part of the PL/SQL
--registered users weekly starts
select count(*), trunc(next_day(sysdate-29, 'SUNDAY')-7), trunc(sysdate-29)
     into v_weekly_count_total_ru, v_weekly_start_date, v_weekly_end_date
          from entities
               where list_id = 3290
               and participation_code_id = 10
               and trunc(participation_date)
               between trunc(next_day(sysdate-29, 'SUNDAY')-7) and
                        trunc(sysdate-29);I'm using the number 29 because I'm using a test database to test this first before moving it into production. And my test data only goes back to early August 2006.
Also, I'm not doing anything with months, so I am suprised that it is throwing this type of error.
thanks

I tested a snippet of code in my production environment, just to see if I would get any results:
--registered users weekly starts
select count(*), trunc(next_day(sysdate-1, 'SUNDAY')-7), trunc(sysdate-1)
     --into v_weekly_count_total_ru, v_weekly_start_date, v_weekly_end_date
          from entities
               where list_id = 3290
               and participation_code_id = 10
               and trunc(participation_date)
               between trunc(next_day(sysdate-1, 'SUNDAY')-7) and trunc(sysdate-1);
COUNT(*)     TRUNC(NEXT_DAY(SYSDATE-1,'SUND     TRUNC(SYSDATE-1)--INTOV_WEEKLY
1     09/10/2006 00:00:00     09/11/2006 00:00:00I did a double check in my test DB to make sure there is data there:
select count(*)
     from entities
          where trunc(participation_date)
          between to_date('01-08-2006','DD-MM-YYYY')
          and to_date('14-08-2006','DD-MM-YYYY')
          and list_id = 3290;
COUNT(*)
11So I'm pretty sure that I'm not pulling anything null.
thanks

Error ORA-20003: Cannot read file/... in Cash Management?

Dear All.
I am having this Error in the Cash Management Module on the bank statement load process
Error ORA-20003: Cannot read file /software/d01/oracle/interface/finance/inbound/email.9Nemail.13111507.3445704.cnv.
How do I resolve this error.
Thank you.

Hi Lucy,
The error is probably due to one of the reasons:
1. There is no file in the location: /software/d01/oracle/interface/finance/inbound/email.9Nemail.13111507.3445704.cnv.
2. No permission on the file respective file.
Please get the assistance from the DBA to check on this.
Thanks &
Best Regards,

IR Report Search - ORA-20001: get_dbms_sql_cursor error ORA-00936: missing expression

Hi All,
I had created a IR report based on a table and it was working with no issues. But after few days, when I try searching using the IR search bar it shows "ORA-20001: get_dbms_sql_cursor error ORA-00936: missing expression" error message. I don't see any debug messages or errors in the debug window. The Finder drop down is empty too, there are no columns displayed to filter.
When I recreate the IR report(new page) based on the same table, It works fine and there are no issues with the search. But the old IR report search doesnt work. I have not modified the any thing in the old report after initial creation. Report uses Primary key based on a sequence.
What might have caused this issue?
Is there a way to intercept the search query from IR report?
Apex version - 4.2.3.00.08.
Any help on this appreciated.
Thanks,
Jagan

Hi MK, as I had mentioned in my post, I don't see any logs in the debug window, query tab.
Can you please guide me how to check the query logs on search?
Thanks,
Jagan

RSMO: Health Check Error ORA-16820

Similar Messages

Maybe you are looking for