DGMGRL 11gr2 switchover issues
Hi all,
im new to 11gr2 datagaurd setup using DGMGRL and currently troubleshooting an issue with switchover which was setup by teammate and he is on annual leave.
Details: 11gr2 linux 64-bit RHEL5
both Prod and DR is configured with same DBNAME,INSTANCE,SERVICE and both share the same file system structure.
below are my configuration:
DGMGRL> connect sys@POZW1COL_PRD
Password:
Connected.
DGMGRL> show configuration
Configuration - COLDGCONFIG
Protection Mode: MaxPerformance
Databases:
PCOLPRIM - Primary database
PCOLSTBY - Physical standby database
Fast-Start Failover: DISABLED
Configuration Status:
SUCCESS
DGMGRL> show database 'PCOLPRIM'
Database - PCOLPRIM
Role: PRIMARY
Intended State: TRANSPORT-ON
Instance(s):
POZW1COL
Database Status:
SUCCESS
DGMGRL> show database 'PCOLSTBY'
Database - PCOLSTBY
Role: PHYSICAL STANDBY
Intended State: APPLY-ON
Transport Lag: 0 seconds
Apply Lag: 0 seconds
Real Time Query: OFF
Instance(s):
POZW1COL
Database Status:
SUCCESS
scenario: SWICTHOVER to standby
DGMGRL> SWITCHOVER TO 'PCOLSTBY'
Performing switchover NOW, please wait...
New primary database "PCOLSTBY" is opening...
Operation requires shutdown of instance "POZW1COL" on database "PCOLPRIM"
Shutting down instance "POZW1COL"...
ORACLE instance shut down.
Operation requires startup of instance "POZW1COL" on database "PCOLPRIM"
Starting instance "POZW1COL"...
ORACLE instance started.
Database mounted.
Switchover succeeded, new primary is "PCOLSTBY"
DGMGRL> show configuration
Configuration - COLDGCONFIG
Protection Mode: MaxPerformance
Databases:
PCOLSTBY - Primary database
PCOLPRIM - Physical standby database
Fast-Start Failover: DISABLED
Configuration Status:
SUCCESS
DGMGRL> show database 'PCOLPRIM'
Database - PCOLPRIM
Role: PHYSICAL STANDBY
Intended State: APPLY-ON
Transport Lag: 0 seconds
Apply Lag: 0 seconds
Real Time Query: OFF
Instance(s):
POZW1COL
Database Status:
SUCCESS
DGMGRL> show database 'PCOLSTBY'
Database - PCOLSTBY
Role: PRIMARY
Intended State: TRANSPORT-ON
Instance(s):
POZW1COL
Database Status:
SUCCESS
SWICTHOVER TO PRIMARY (OLD PRIMARY):
DGMGRL> SWITCHOVER TO 'PCOLPRIM'
Performing switchover NOW, please wait...
New primary database "PCOLPRIM" is opening...
Operation requires shutdown of instance "POZW1COL" on database "PCOLSTBY"
Shutting down instance "POZW1COL"...
ORACLE instance shut down.
Operation requires startup of instance "POZW1COL" on database "PCOLSTBY"
Starting instance "POZW1COL"...
Unable to connect to database
ORA-12545: Connect failed because target host or object does not exist
Failed.
Warning: You are no longer connected to ORACLE.
Please complete the following steps to finish switchover:
start up and mount instance "POZW1COL" of database "PCOLSTBY"
DGMGRL>
above you could see the issue can anyone highlight me where it was wrong.
Hi mahir,
Now i tried to switch over from primary to standby.
it was sucessfull,
DGMGRL> SWITCHOVER TO 'PCOLSTBY'
Performing switchover NOW, please wait...
New primary database "PCOLSTBY" is opening...
Operation requires shutdown of instance "POZW1COL" on database "PCOLPRIM"
Shutting down instance "POZW1COL"...
ORACLE instance shut down.
Operation requires startup of instance "POZW1COL" on database "PCOLPRIM"
Starting instance "POZW1COL"...
ORACLE instance started.
Database mounted.
Switchover succeeded, new primary is "PCOLSTBY"
Also contents from Primary datagaurd broker log.
Command SWITCHOVER TO PCOLSTBY completed
09/03/2012 09:05:44
Starting Data Guard Broker bootstrap <<Broker Configuration File Locations:
dg_broker_config_file1 = "/u01/app/oracle/product/db/11gR2/dbs/dr1PCOLPRIM.dat"
dg_broker_config_file2 = "/u01/app/oracle/product/db/11gR2/dbs/dr2PCOLPRIM.dat"
09/03/2012 09:05:47
DMON Registering service PCOLPRIM_DGB with listener(s)
Broker Configuration: "COLDGCONFIG"
Protection Mode: Maximum Performance
Fast-Start Failover (FSFO): Disabled, flags=0x0, version=0
Primary Database: PCOLSTBY (0x02010000)
Standby Database: PCOLPRIM, Enabled Physical Standby (0x01010000)
09/03/2012 09:05:51
Creating process RSM0
09/03/2012 09:05:54
*SQL Execution error=604, sql=[alter system set log_archive_dest_1='']. See error stack below.*
ORA-00604: error occurred at recursive SQL level 1
ORA-02097: parameter cannot be modified because specified value is invalid
ORA-16028: new LOG_ARCHIVE_DEST_1 causes less destinations than LOG_ARCHIVE_MIN_SUCCEED_DEST requires09/03/2012 09:06:03
Notifying Oracle Clusterware to buildup standby database after SWITCHOVER
Data Guard notifying Oracle Clusterware to start services and other instances change
Command SWITCHOVER TO PCOLPRIM completed
Similar Messages
-
Hi all,
I am facing physical standby switchover issue. I set up a physical standby database everything works well. Last week I tried switching between primary abd standby, switchover also done well.
Switchover happend log sequence at 1011.
After a couple of days I tried switch over it back, then alter database switchover camand is taking too long.
I queried on standby for any archive log gap,
SQL>select * from v$archive_gap;
THREAD# LOW_SEQUENCE# HIGH_SEQUENCE#
1 1012 1012
When I look into primary database archivelog destination I did not find any archive log with sequence number 1012
I also notice that in Primary after 1011 sequence number next comes 1013
please see the details of primary archives,
SQL> select sequence#,applied from v$archived_log;
SEQUENCE# APPLIED
1007 YES
1008 YES
1009 YES
1010 YES
1011 YES
1013 NO
1 NO
1014 NO
1015 NO
1016 NO
1017 NO
1018 NO
1019 NO
1020 NO
1021 NO
1022 NO
1014 NO
1013 NO
1022 NO
1016 NO
1015 NO
1019 NO
1018 NO
1021 NO
1017 NO
1020 NO
1023 NO
1023 NO
1024 NO
1024 NO
1025 NO
1025 NO
1026 NO
1026 NO
1027 NO
1027 NO
1028 NO
1029 NO
1030 NO
1030 NO
1031 NO
1031 NO
1032 NO
1032 NO
1033 NO
1033 NO
1034 NO
1034 NO
1035 NO
1035 NO
1036 NO
1036 NO
1037 NO
1037 NO
1038 NO
1038 NO
I checked in standby I found that after sequence 1011 there is no archives applied on standby
SEQUENCE# APPLIED
999 YES
1000 YES
1001 YES
1002 YES
997 YES
999 YES
1002 YES
1001 YES
1000 YES
998 YES
1003 YES
1003 YES
1004 YES
1004 YES
1005 YES
1005 YES
1006 YES
1006 YES
1007 YES
1007 YES
1008 YES
1008 YES
1009 YES
1009 YES
1010 YES
1010 YES
1011 YES
1 YES
1 YES
I tried with recover manages standby commnads but nothing worked out. I wonder how a sequence number 1 has come on primary database, I manually copied the sequence 1 to stand by and regitered it, after that also it show archivelog gap?
Could you please help me in this?
-Thanks & cheers
AntonyDear Antonypaulm,
What is being written in the alert.log files and can you please also show the last few lines of v$dataguard_status dynamic performance view?
By the way are you using data guard broker?
Regards.
Ogan -
DG broker Switchover issue, ORA-16535: CRS is prevent execution of a broker
I am having setup of 2 node 10.2.0.4.0 RAC setup on ASM with Single Instance Physical standby on File System (OS: REHL 5.4). I configured DG Broker without any major issues. Getting all output of 'show configuration' and all DG related logs are clear. Archives are getting transferred from both Primary nodes.
DGMGRL> show configuration
Configuration
Name: dg_rac
Enabled: YES
Protection Mode: MaxPerformance
Fast-Start Failover: DISABLED
Databases:
livestdby - Primary database
livedg - Physical standby database
Current status for "dg_rac":
SUCCESS
Now I am getting error Error: ORA-16535: CRS is preventing execution of a broker operation.
DGMGRL> switchover to livedg;
Performing switchover NOW, please wait...
Error: ORA-16535: CRS is preventing execution of a broker operation
Oracle Says
Cause
A broker operation was underway that required CRS to stop managing the instances of this database, but CRS management could not be stopped on behalf of the broker"s request on
at least some of the instances, so the broker operation was canceled.
Action
Suspend CRS management of this database using SRVCTL STOP DATABASE -D <name> -O NONE. Then reissue the broker request.
But this command is not working as it's given to stop the database.
One more thing, it's nowhere said to stop CRS while performing Switchover / Switchback using DG Broker. When we do Switchover / Switchback we keep open only one of the Primary database.
Anybody knows regarding this error???? or is there any solution for this ???? (is it bug ???)
is there any documentation / link available to switchover of RAC database using dgmgrl (DG Broker)
Any help would be appreciated.
regards,
manishHello;
I would check the tnsnames.ora on the Standby that's about to become the new Primary.
Based on the information you provided I'm thinking you cannot connect from the Standby site to the Primary and thus the switchover fails and throws this error.
If that checks out make sure the firewall rules for both server line up.
Best Regards
mseberg -
Oracle Client 11gR2 installation issue on RHEL v5.4 64-bit
Hi,
I am trying to install Oracle Client software 11gR2 on RHEL v5.4 64-bit. I have resolved all the libraries dependency as well as Kernel changes as suggested by the installer. The error in the log file is as attached. At present I have "skipped" this error and proceeded with installation.
While installing the client, the installer fails while configuring the Net CA with error:
INFO: Done parsing command line arguments.
INFO: Oracle Net Services Configuration:
INFO: #
INFO: # An unexpected error has been detected by HotSpot Virtual Machine:
INFO: #
INFO: # SIGSEGV (0xb) at pc=0xe5e97498, pid=27377, tid=4160075984
INFO: #
INFO: # Java VM: Java HotSpot(TM) Client VM (1.5.0_17-b02 mixed mode)
INFO: # Problematic frame:
INFO: # C [libnnz11.so+0x3c498]
INFO: #
INFO: # An error report file with more information is saved as hs_err_pid27377.log
INFO: #
INFO: # If you would like to submit a bug report, please visit:
INFO: # http://java.sun.com/webapps/bugreport/crash.jsp
INFO: #
WARNING: /home/oracle/app/oracle/product/11.2.0/client_1/bin/netca: line 178: 27377 Aborted $JRE $JRE_OPTIONS -classpath $CLASSPATH oracle.ne
t.ca.NetCA $*
WARNING:
INFO:
INFO: Completed Plugin named: Oracle Net Configuration Assistant
INFO: Oracle Net Configuration Assistant failed.
INFO: Oracle Net Configuration Assistant failed.
Also when I invoke the SQL Client; sqlplus user@db and enter the password, the sqlplus exits without any error and returns to the terminal console. Please note earlier I has getting a SELinux violation and have changed it to "permissive" mode
Please let me know how to resolve NetCA installation and the sqplus issue.
Thanks & regards,
VinayHi,
Thet NetCA error occurs during installation and I believe the installer should take care of the ORACLE_HOME variable setting.
But before invoking sqlplus I have set the ORACLE_HOME and LD_LIBRARY_PATH setting in the .bash_profile as mentioned in the installation guide. The snippet of the profile file is:
export ORACLE_HOME=~/app/oracle/product/11.2.0/client_1
export JAVA_HOME=$ORACLE_HOME/jdk
export PATH=$ORACLE_HOME/bin:$JAVA_HOME/bin:$PATH;
export LD_LIBRARY_PATH=$ORACLE_HOME:$LD_LIBRARY_PATH
export TNS_ADMIN=$ORACLE_HOME/network/admin
export TWO_TASK=mmcoedb
I am able to tnsping to the server/service name too but when I try to login using the user/password using sqlplus, it simply exits without any error.
Please let me know how to resolve the error.
Best regards,
Vinay -
Installing Oracle 11gR2 RAC issue
I am installing Oracle 11gR2(11.2.0.3) RAC on RHEL 5.6. I am facing "TCP connectivity check failed" on my precheck using CVU
Interface information for node "hublpr4"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
eth0 172.16.34.71 172.16.32.0 0.0.0.0 172.16.32.4 00:17:A4:77:08:10 1500
eth1 192.168.10.3 192.168.10.0 0.0.0.0 172.16.32.4 00:17:A4:77:08:12 1500
Interface information for node "hublpr3"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
eth0 172.16.34.69 172.16.32.0 0.0.0.0 172.16.32.4 00:17:A4:77:0C:30 1500
eth1 192.168.10.2 192.168.10.0 0.0.0.0 172.16.32.4 00:17:A4:77:0C:32 1500
Check: Node connectivity of subnet "172.16.32.0"
Source Destination Connected?
hublpr4[172.16.34.71] hublpr3[172.16.34.69] yes
Result: Node connectivity passed for subnet "172.16.32.0" with node(s) hublpr4,hublpr3
Check: TCP connectivity of subnet "172.16.32.0"
Source Destination Connected?
hublpr3:172.16.34.69 hublpr4:172.16.34.71 failed
ERROR:
PRVF-7617 : Node connectivity between "hublpr3 : 172.16.34.69" and "hublpr4 : 172.16.34.71" failed
Result: TCP connectivity check failed for subnet "172.16.32.0"
Check: Node connectivity of subnet "192.168.10.0"
Source Destination Connected?
hublpr4[192.168.10.3] hublpr3[192.168.10.2] yes
Result: Node connectivity passed for subnet "192.168.10.0" with node(s) hublpr4,hublpr3
Check: TCP connectivity of subnet "192.168.10.0"
Source Destination Connected?
hublpr3:192.168.10.2 hublpr4:192.168.10.3 failed
ERROR:
PRVF-7617 : Node connectivity between "hublpr3 : 192.168.10.2" and "hublpr4 : 192.168.10.3" failed
Result: TCP connectivity check failed for subnet "192.168.10.0"
Interfaces found on subnet "172.16.32.0" that are likely candidates for VIP are:
hublpr4 eth0:172.16.34.71
hublpr3 eth0:172.16.34.69
WARNING:
Could not find a suitable set of interfaces for the private interconnect
Checking subnet mask consistency...
Subnet mask consistency check passed for subnet "172.16.32.0".
Subnet mask consistency check passed for subnet "192.168.10.0".
Subnet mask consistency check passed.
Result: Node connectivity check failed
Checking multicast communication...
Checking subnet "172.16.32.0" for multicast communication with multicast group "230.0.1.0"...
PRVG-11134 : Interface "172.16.34.71" on node "hublpr4" is not able to communicate with interface "172.16.34.71" on node "hublpr4"
PRVG-11134 : Interface "172.16.34.71" on node "hublpr4" is not able to communicate with interface "172.16.34.69" on node "hublpr3"
PRVG-11134 : Interface "172.16.34.69" on node "hublpr3" is not able to communicate with interface "172.16.34.71" on node "hublpr4"
PRVG-11134 : Interface "172.16.34.69" on node "hublpr3" is not able to communicate with interface "172.16.34.69" on node "hublpr3"
Checking subnet "172.16.32.0" for multicast communication with multicast group "224.0.0.251"...
PRVG-11134 : Interface "172.16.34.71" on node "hublpr4" is not able to communicate with interface "172.16.34.71" on node "hublpr4"
PRVG-11134 : Interface "172.16.34.71" on node "hublpr4" is not able to communicate with interface "172.16.34.69" on node "hublpr3"
PRVG-11134 : Interface "172.16.34.69" on node "hublpr3" is not able to communicate with interface "172.16.34.71" on node "hublpr4"
PRVG-11134 : Interface "172.16.34.69" on node "hublpr3" is not able to communicate with interface "172.16.34.69" on node "hublpr3"
Checking subnet "192.168.10.0" for multicast communication with multicast group "230.0.1.0"...
PRVG-11134 : Interface "192.168.10.3" on node "hublpr4" is not able to communicate with interface "192.168.10.3" on node "hublpr4"
PRVG-11134 : Interface "192.168.10.3" on node "hublpr4" is not able to communicate with interface "192.168.10.2" on node "hublpr3"
PRVG-11134 : Interface "192.168.10.2" on node "hublpr3" is not able to communicate with interface "192.168.10.3" on node "hublpr4"
PRVG-11134 : Interface "192.168.10.2" on node "hublpr3" is not able to communicate with interface "192.168.10.2" on node "hublpr3"
Checking subnet "192.168.10.0" for multicast communication with multicast group "224.0.0.251"...
PRVG-11134 : Interface "192.168.10.3" on node "hublpr4" is not able to communicate with interface "192.168.10.3" on node "hublpr4"
PRVG-11134 : Interface "192.168.10.3" on node "hublpr4" is not able to communicate with interface "192.168.10.2" on node "hublpr3"
PRVG-11134 : Interface "192.168.10.2" on node "hublpr3" is not able to communicate with interface "192.168.10.3" on node "hublpr4"
PRVG-11134 : Interface "192.168.10.2" on node "hublpr3" is not able to communicate with interface "192.168.10.2" on node "hublpr3"Try following metalink note for sorting out multicast issues.
Oracle Grid Infrastructure 11.2.0.2 Installation or Upgrade may fail due to Multicasting Requirement [ID 1212703.1] -
Hello Experts,
We are trying to install OIM 11gR2, getting below error in domain confirguration step,
Component Schema=OIM Schema
Driver=oracle.jdbc.OracleDriver
URL=jdbc:oracle:thin:@oim-db-dev1:1530/CGSDTD34.WORLD
User=DEV1_OIM
Password=********
SQL Test=select 1 from schema_version_registry where owner=(select user from dual) and mr_type='OIM' and version='11.1.2.0.0'
CFGFWK-60850: Test Failed!
CFGFWK-60853: A connection was established to the database but no rows were returned from the test SQL statement.
We have used RCU version 11.1.1.6.0. We have used the exact same version of RCU few weeks back and surprisingly the installation went fine, not sure why it is failing today. I've checked schema_version_registry table and i can see the version # for OIM as 11.1.1.5.0, but in the older environment it is 11.1.2.0.
I found this thread but not of much use to me,
Re: OIM 11g R2-Issue while configuring oim domain in weblogic
Please let me know if anyone faced the similar issue and whats the resolution.I think you should be using the RCU version specifically for OIM 11G R2... RCU version 11.1.1.6.0 is inappropriate for R2...
Follow the following steps:
(1) Login to the edelivery.oracle.com
(2) Go to Oracle Fusion Middleware Identity Management 11g R2 Media Pack
(3) Download:-
Oracle Fusion Middleware Repository Creation Utility 11g (11.1.2.0.0) for Linux x86...
The part number:- V33642-01
Size:- 383M
or
Oracle Fusion Middleware Repository Creation Utility 11g (11.1.2.0.0) for Microsoft Windows
V33643-01
311M
I think currently you are using:-
Oracle Fusion Middleware Repository Creation Utility 11g (11.1.1.6.0) for Linux x86
V29674-01
390M
or
Oracle Fusion Middleware Repository Creation Utility 11g (11.1.1.6.0) for Microsoft Windows
V29675-01
319M
I used RCU 11.1.2.0.0 and my installation went fine... -
Hi,
I have carried out the following
a 10g database install on 2 servers
enabled dataguard between them so I have a primary and a standby database.
I then installed Grid Control onto each server using the opetion to install into an existing database. this worked.
On the standby server opmnctl is shutdown and the database is a PHYSICAL STANDBY.
when I do a dataguard switchover I see the standby database is now the primary. I restart opmnctl and go to the web browser to look at Grid Control.
The issue I have is that Grid Control, even though it is on the standby server, points to the primary server. How can I change this behaviour
When I first started Grid Control I had to perform the following actions
[oracle@griddg bin]$ ./emctl status emkey
Oracle Enterprise Manager 10g Release 3 Grid Control
Copyright (c) 1996, 2007 Oracle Corporation. All rights reserved.
Please enter repository password:
The Em Key exists in the Management Repository, but is not configured properly or is corrupted in the file system.
Configure the Em Key by running "emctl config emkey -repos".
[oracle@griddg bin]$ ./emctl config emkey -repos
Oracle Enterprise Manager 10g Release 3 Grid Control
Copyright (c) 1996, 2007 Oracle Corporation. All rights reserved.
Please enter repository password:
The Em Key has been configured successfully.
after this gridcontrol was able to start but points to the wrong host.
rgds
alanhi,
the steps I took are as follows
1 - precreate a database on the primary and standby.
2 - configure the tnsnames and listener files so that the databases can talk to each other
3 - create a standby control file from the primary database.
4 - copy all database files from the primary to the standby
5 - copy the standby controlfile to the standby
6 - start the primary database
7 - start the standby database but only mounted, check database_role from v$database; it should be physical standby
8 - install Grid Control on the primary server with the option to install onto an existing database. Complete this installation.
9 - Install Grid Control onto the standby server with the option to install onto an existing database. Complete the installation and then carry out an 'opmnctl stopall'
10 - all being well Grid Control should now show both hosts and databases.
11 - create a dataguard configuration from within GC
The standby database cannot be discovered correctly in GC and this must be because it is in a mount state, not sure what to do about this. This then meant that I had to carry out a switchover from the command line. I am just testing this now and will post back when complete.
regards
Alan -
Hi There,
Our issue is about a WLC 5508 conected to a HP Switch L3 model HP7500 using link-aggregation. Sometimes the controller change to the secondary box and log the error message: Switchover Reason = Default gateway is not reachable, Switchover Time
Manufacturer's Name.............................. Cisco Systems Inc.
Product Name..................................... Cisco Controller
Product Version.................................. 7.6.120.0
Bootloader Version............................... 1.0.1
Field Recovery Image Version..................... 6.0.182.0
Firmware Version................................. FPGA 1.7, Env 1.8, USB console 2.2
Build Type....................................... DATA + WPS
management LAG untagged x.y.z.a Static Yes No
redundancy-management LAG untagged x,y.z.b Static No No
redundancy-port - untagged 169.254.0.12 Static No No
(Cisco Controller) >show redundancy summary
Redundancy Mode = SSO ENABLED
Local State = ACTIVE
Peer State = STANDBY HOT
Unit = Primary
Unit ID = 6C:41:6A:5F:75:00
Redundancy State = SSO (Both AP and Client SSO)
Mobility MAC = 6C:41:6A:5F:75:00
Average Redundancy Peer Reachability Latency = 488 usecs
Average Management Gateway Reachability Latency = 748 usecs
Redundancy Management IP Address................. x.y.z.a
Peer Redundancy Management IP Address............ x.y.z.b
Redundancy Port IP Address....................... 169.254.0.12
Peer Redundancy Port IP Address.................. 169.254.0.13
Peer Service Port IP Address..................... 0.0.0.0
Switchover History[1]:
Previous Active = 10.140.0.13, Current Active = x.y.z.a
Switchover Reason = Default gateway is not reachable, Switchover Time = Tue Aug 19 05:32:44 2014
Any idea what´s the problem could be? We check alllan environment spanning-tree, vlan, routing, no physical issues.
My best regards
Adriano PorcaroShow sysinfo results :
Manufacturer's Name.............................. Cisco Systems Inc.
Product Name..................................... Cisco Controller
Product Version.................................. 7.0.116.0
Bootloader Version............................... 1.0.1
Field Recovery Image Version..................... 6.0.182.0
Firmware Version................................. FPGA 1.3, Env 1.6, USB console 1.27
Build Type....................................... DATA + WPS -
Dataguard Post Switchover issue
Hi All,
OS:AIX
DB:11.2.0.3
I have just performed the switcover from my primary to standby database. The switchover was smooth but the archives are not getting shipped and applied on the new DR. I have checked the process and found that the RFS process is not up. Upon further checking I have found that the alert of my new DR is giving me this line
Resetting standby activation ID 0 (0x0)
Please let me know what does this indicates
RegardsThe message Resetting standby activation ID 0 (0x0)" is a normal message after switchover. It hard to think about a problem with so little details. Check this metalink note, this might help. There was also a similar kind of bug but in 10.2.0.4
11.2 Data Guard Physical Standby Switchover Best Practices using SQL*Plus (Doc ID 1304939.1)
There was also a similar kind of bug but in 10.2.0.4. Workaround is to reboot the database. You can try rebooting the database. It might fix the issue.
Bug 5476236 - RFS logminer client inoperative after physical standby switchover to primary (Doc ID 5476236.8) -
Oracle 11gR2 Performance Issue
We have Oracle 11gR2 (11.2.0.2) database on HP-UX for GIS application.
We recently upgraded this database from 10g to 11gR2, Everything is working good, no issue expect one month end process. This process hung because of Library Cache Wait (Concurrency). Whenever we start this process the Library Cache Wait is increasing and the process is not completing.
Instance Efficiency Percentages (Target 100%)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 99.49 In-memory Sort %: 100.00
Library Hit %: 22.90 Soft Parse %: 84.22
Execute to Parse %: 41.06 Latch Hit %: 98.80
Parse CPU to Parse Elapsd %: 26.78 % Non-Parse CPU: 79.40
Shared Pool Statistics Begin End
Memory Usage %: 76.07 67.50
% SQL with executions>1: 97.69 89.31
% Memory for SQL w/exec>1: 97.20 98.96
Top 5 Timed Foreground Events
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Avg
wait % DB
Event Waits Time(s) (ms) time Wait Class
library cache lock 3,459,453 12,400 4 55.2 Concurrenc
DB CPU 7,840 34.9
cursor: mutex S 811,819 933 1 4.2 Concurrenc
cursor: pin S wait on X 21,339 813 38 3.6 Concurrenc
db file sequential read 42,997 158 4 .7 User I/O
^LHost CPU (CPUs: 4 Cores: 4 Sockets: 1)
~~~~~~~~ Load Average
Begin End %User %System %WIO %Idle
0.06 1.76 53.0 1.3 1.0 45.8
Instance CPU
~~~~~~~~~~~~
% of total CPU for Instance: 54.3
% of busy CPU for Instance: 100.1
%DB time waiting for CPU - Resource Mgr: 0.0
Memory Statistics
~~~~~~~~~~~~~~~~~ Begin End
Host Mem (MB): 32,666.4 32,666.4
SGA use (MB): 3,504.0 3,504.0
PGA use (MB): 278.2 324.2
% Host Mem used for SGA+PGA: 11.58 11.72I used catupgrd.sql script to upgrade the database, installed 11g on same server in different home and used catupgrd.
Parameter Value_
SQL> show parameter opt
NAME_COL_PLUS_SHOW_PARAM TYPE VALUE_COL_PLUS_SHOW_PARAM
filesystemio_options string DIRECTIO
object_cache_optimal_size integer 102400
optimizer_capture_sql_plan_baselines boolean FALSE
optimizer_dynamic_sampling integer 2
optimizer_features_enable string 11.2.0.2
optimizer_index_caching integer 0
optimizer_index_cost_adj integer 100
optimizer_mode string ALL_ROWS
optimizer_secure_view_merging boolean TRUE
optimizer_use_invisible_indexes boolean FALSE
optimizer_use_pending_statistics boolean FALSE
optimizer_use_sql_plan_baselines boolean TRUE
plsql_optimize_level integer 2
SQL>
SQL>
SQL> show parameter cursor
NAME_COL_PLUS_SHOW_PARAM TYPE VALUE_COL_PLUS_SHOW_PARAM
cursor_bind_capture_destination string memory+disk
cursor_sharing string SIMILAR
cursor_space_for_time boolean FALSE
open_cursors integer 2000
session_cached_cursors integer 200
SQL>
SQL> select * from ( select SQL_ID,VERSION_COUNT,EXECUTIONS from v$sqlarea order by VERSION_COUNT desc) where rownum<=20;
SQL_ID VERSION_COUNT EXECUTIONS
0ynhd4qz3avdh 6453 9198
b1kg0nth4ax9f 6410 15348
7qscuaqtt32zb 4449 17243
duntdcykba52p 2815 1325
g06n424cwup4m 2457 2492
2zgfq8kqqzcm7 1911 1205
b67j985tf4gsw 1868 1740
bmn1m6x3hq8cm 1467 155
fdcvny2d9d6kw 783 405
fphtsy5rd9gkq 401 21702
771v4ntn6mqhg 293 12174
g3dqmahsk5t8f 195 8200
fhrh7858qhrm3 135 2454
8xx3nxsndzyar 112 222
f280fzy0a1bsb 70 263
5rn144gqjkv53 64 125
0v3dvmc22qnam 59 53
f37373tqsbqhz 55 38
f1gu4r0wbhfn3 44 81
dcc7g533zymtm 41 83
SQL ordered by Version Count - From AWR Report_
SQL ordered by Version Count DB/Inst: GISPROD/gisprod Snaps: 23062-23063
-> Only Statements with Version Count greater than 20 are displayed
Version
Count Executions SQL Id
4,449 8,543 7qscuaqtt32zb
Module: gsrvr.exe
SELECT V__276.*, SHAPE.fid,SHAPE.numofpts,SHAPE.entity,SHAPE.points,SHAPE.row
id FROM (SELECT b.OBJECTID,b.ENABLED,b.SHAPE FROM ARCFM.Electric_Network_Juncti
ons b WHERE b.OBJECTID NOT IN (SELECT /*+ HASH_AJ */ SDE_DELETES_ROW_ID FROM ARC
FM.D276 WHERE DELETED_AT IN (SELECT l.lineage_id FROM SDE.state_lineages l WHERE
2,940 N/A 0ynhd4qz3avdh
SELECT OBJECTID, ENABLED, CREATIONUSER, DATECREATED, DATEMODIFIED, LASTUSE
R, SUBTYPECODE, PHASINGCODE, FEEDERID, FEEDERID2, OPERVOLT, NEUTTYPE, NEU
TSIZE, LOCATIONID, ASSEMBLYCODE, LENGTH, LENGTHSRC, COMMENTS, FDRMGRNONTRA
CEABLE, LABELTEXT, ELECTRICTRACEWEIGHT, FEEDERINFO, RATEDVOLT, CONDUITFLG,
2,006 N/A b1kg0nth4ax9f
SELECT V__159.*, SHAPE.fid,SHAPE.numofpts,SHAPE.entity,SHAPE.points,SHAPE.row
id FROM (SELECT b.OBJECTID,b.ANCILLARYROLE,b.ENABLED,b.CREATIONUSER,b.DATECREATE
D,b.DATEMODIFIED,b.LASTUSER,b.SUBTYPECODE,b.FACILITYID,b.LOCATIONID,b.PHASINGCOD
E,b.OPERATINGVOLTAGE,b.FEEDERID,b.FEEDERID2,b.ASSEMBLYCODE,b.COMMENTS,b.SYMBOLRO
1,765 65 duntdcykba52p
Module: gsrvr.exe
SELECT SWITCHTYPE FROM (SELECT b.OBJECTID,b.CREATIONUSER,b.DATECREATED,b.DATEM
ODIFIED,b.LASTUSER,b.FACILITYID,b.PHASINGCODE,b.MANUFACTURER,b.SUBTYPECODE,b.SWI
TCHID,b.SWITCHTYPE,b.SWITCHRATING,b.LEGACYSWITCHID,b.WORKREQUESTID,b.DESIGNID,b.
WORKLOCATIONID,b.WORKFLOWSTATUS,b.WORKFUNCTION FROM ARCFM.SwitchUnit b WHERE b.
1,467 19 bmn1m6x3hq8cm
Module: gsrvr.exe
select privilege from user_sys_privs where privilege in (:"SYS_B_0",:"SYS_B_1",:
"SYS_B_2",:"SYS_B_3") UNION select privilege from role_sys_privs where privilege
in (:"SYS_B_4",:"SYS_B_5",:"SYS_B_6",:"SYS_B_7")
1,467 19 bmn1m6x3hq8cm
Module: gsrvr.exe
select privilege from user_sys_privs where privilege in (:"SYS_B_0",:"SYS_B_1",:
"SYS_B_2",:"SYS_B_3") UNION select privilege from role_sys_privs where privilege
in (:"SYS_B_4",:"SYS_B_5",:"SYS_B_6",:"SYS_B_7")
991 N/A 2zgfq8kqqzcm7
SELECT OBJECTID, ENABLED, CREATIONUSER, DATECREATED, DATEMODIFIED, LASTUSE
R, SUBTYPECODE, PHASINGCODE, FEEDERID, FEEDERID2, OPERVOLT, NEUTTYPE, NEU
TSIZE, LOCATIONID, ASSEMBLYCODE, LENGTH, LENGTHSRC, COMMENTS, FDRMGRNONTRA
CEABLE, LABELTEXT, ELECTRICTRACEWEIGHT, FEEDERINFO, RATEDVOLT, CONSTR, PHA
Active Session History
ASH Report For GISPROD/gisprod
DB Name DB Id Instance Inst Num Release RAC Host
GISPROD 1774954232 gisprod 1 11.2.0.2.0 NO hublhp9
CPUs SGA Size Buffer Cache Shared Pool ASH Buffer Size
4 4,078M (100%) 1,168M (28.6%) 1,933M (47.4%) M (%)
Analysis Begin Time: 06-Feb-12 08:00:00
Analysis End Time: 06-Feb-12 08:01:00
Elapsed Time: 1.0 (mins)
Begin Data Source: DBA_HIST_ACTIVE_SESS_HISTORY
in AWR snapshot 23062
End Data Source: DBA_HIST_ACTIVE_SESS_HISTORY
in AWR snapshot 23063
Sample Count: 2
Average Active Sessions: 0.33
Avg. Active Session per CPU: 0.08
Report Target: None specified
Top User Events DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
Avg Active
Event Event Class % Event Sessions
CPU + Wait for CPU CPU 50.00 0.17
Top Background Events DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
Avg Active
Event Event Class % Activity Sessions
CPU + Wait for CPU CPU 50.00 0.17
Top Event P1/P2/P3 Values DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top Service/Module DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
Service Module % Activity Action % Action
SYS$BACKGROUND MMON_SLAVE 50.00 Auto-Flush Slave A 50.00
SYS$USERS ArcMap.exe 50.00 UNNAMED 50.00
Top Client IDs DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top SQL Command Types DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
-> 'Distinct SQLIDs' is the count of the distinct number of SQLIDs
with the given SQL Command Type found over all the ASH samples
in the analysis period
Distinct Avg Active
SQL Command Type SQLIDs % Activity Sessions
INSERT 1 50.00 0.17
SELECT 1 50.00 0.17
Top Phases of Execution DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
Avg Active
Phase of Execution % Activity Sessions
SQL Execution 50.00 0.17
Top SQL with Top Events DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
Sampled #
SQL ID Planhash of Executions % Activity
Event % Event Top Row Source % RwSrc
2prbzh4qfms7u 2500066303 1 50.00
CPU + Wait for CPU 50.00 FIXED TABLE - FULL 50.00
insert into wrh$_latch_children (snap_id, dbid, instance_number, latch_hash, c
hild#, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, sle
ep1, sleep2, sleep3, sleep4, wait_time) select :snap_id, :dbid, :instance
_number, hash, child#, gets, misses, sleeps, immediate_gets, immediate_misses
a4w3b09vg8705 52468664 1 50.00
CPU + Wait for CPU 50.00 SELECT STATEMENT 50.00
SELECT PROCESS.MM_PX_CURRENT_STATE.*, PROCESS.MM_PX_CURRENT_STATE."ROWID" FROM
PROCESS.MM_PX_CURRENT_STATE
Top SQL with Top Row Sources DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
Sampled #
SQL ID PlanHash of Executions % Activity
Row Source % RwSrc Top Event % Event
2prbzh4qfms7u 2500066303 1 50.00
FIXED TABLE - FULL 50.00 CPU + Wait for CPU 50.00
insert into wrh$_latch_children (snap_id, dbid, instance_number, latch_hash, c
hild#, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, sle
ep1, sleep2, sleep3, sleep4, wait_time) select :snap_id, :dbid, :instance
_number, hash, child#, gets, misses, sleeps, immediate_gets, immediate_misses
a4w3b09vg8705 52468664 1 50.00
SELECT STATEMENT 50.00 CPU + Wait for CPU 50.00
SELECT PROCESS.MM_PX_CURRENT_STATE.*, PROCESS.MM_PX_CURRENT_STATE."ROWID" FROM
PROCESS.MM_PX_CURRENT_STATE
Top SQL using literals DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top Parsing Module/Action DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top PL/SQL Procedures DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top Java Workload DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top Call Types DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
Call Type Count % Activity Avg Active
FETCH 1 50.00 0.17
Top Sessions DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
-> '# Samples Active' shows the number of ASH samples in which the session
was found waiting for that particular event. The percentage shown
in this column is calculated with respect to wall clock time
and not total database activity.
-> 'XIDs' shows the number of distinct transaction IDs sampled in ASH
when the session was waiting for that particular event
-> For sessions running Parallel Queries, this section will NOT aggregate
the PQ slave activity into the session issuing the PQ. Refer to
the 'Top Sessions running PQs' section for such statistics.
Sid, Serial# % Activity Event % Event
User Program # Samples Active XIDs
23, 8635 50.00 CPU + Wait for CPU 50.00
JOHNSONV ArcMap.exe 1/6 [ 17%] 0
150, 963 50.00 CPU + Wait for CPU 50.00
SYS oracle@hublhp9 (M000) 1/6 [ 17%] 0
Top Blocking Sessions DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top Sessions running PQs DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top DB Objects DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top DB Files DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Top Latches DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
No data exists for this section of the report.
Activity Over Time DB/Inst: GISPROD/gisprod (Feb 06 08:00 to 08:01)
-> Analysis period is divided into smaller time slots
-> Top 3 events are reported in each of those slots
-> 'Slot Count' shows the number of ASH samples in that slot
-> 'Event Count' shows the number of ASH samples waiting for
that event in that slot
-> '% Event' is 'Event Count' over all ASH samples in the analysis period
Slot Event
Slot Time (Duration) Count Event Count % Event
08:00:00 (60 secs) 2 CPU + Wait for CPU 2 100.00
End of Report -
I have 2 node RAC (Oracle 11gR2 on HP-UX). Instances are running fine on both the nodes, but the srvctl command is showing the database is not running.
oracle@hublhp1:/home/oracle$ ps -ef | grep pmon
oracle 2485 1 0 Nov 9 ? 4:19 asm_pmon_+ASM1
oracle 25512 1 0 Nov 11 ? 5:50 ora_pmon_omsprod1
oracle 1439 21309 0 11:31:53 pts/0 0:00 grep pmon
oracle@hublhp1:/home/oracle$ srvctl status database -d omsprod
Instance omsprod1 is not running on node hublhp1
Instance omsprod2 is not running on node hublhp3
oracle@hublhp1:/home/oracle$ srvctl status instance -d omsprod -i omsprod1,omsprod2
Instance omsprod1 is not running on node hublhp1
Instance omsprod2 is not running on node hublhp3
oracle@hublhp1:/home/oracle$ echo $ORACLE_SID
omsprod1
oracle@hublhp1:/home/oracle$ sqlplus "/as sysdba"
SQL*Plus: Release 11.2.0.1.0 Production on Thu Nov 18 11:32:38 2010
Copyright (c) 1982, 2009, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
SQL>
SQL> select instance_number, instance_name, host_name, status from gv$instance;
INSTANCENUMBER INSTANCE_NAME HOST_NAME STATUS_
1 omsprod1 hublhp1 OPEN
2 omsprod2 hublhp3 OPEN
SQL>
SQL>
SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
oracle@hublhp1:/home/oracle$
Any idea what is missing here, where to look at it.Hi,
try to add the database again with srvctl
$srvctl add instance -d db_name -i instance_name
if not try to clear the instance from CRS registry and again register... -
Environment: HP-UX / Oracle 11gR2 RAC with ASM
We renamed our ASM disk from c5t1d3 to ora_c5t1d3 in UNIX, and now we want to remove the old name c5t1d3, before that we want to change the disk on ASM diskgroup from c5t1d3 to ora_c5t1d3.
I dropped the disk c5t1d3 and try to add the same disk with different name ora_c5t1d3, but I am not able to add, I am getting the following error
SQL> alter diskgroup asmcrsdg1 add disk '/dev/rdsk/ora_c5t1d3';
alter diskgroup asmcrsdg1 add disk '/dev/rdsk/ora_c5t1d3'
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15020: discovered duplicate ASM disk "ASMCRSDG1_0006"
But this disk is not there, when I try to drop this disk, I am getting the following error,
SQL> alter diskgroup asmcrsdg1 drop disk ASMCRSDG1_0006;
alter diskgroup asmcrsdg1 drop disk ASMCRSDG1_0006
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15054: disk "ASMCRSDG1_0006" does not exist in diskgroup "ASMCRSDG1"
I am confused, Can anyone please help me to understand what’s going on here.Check if ASM disk is still a part of ASM disk group.
1.
Query header_status and mount_status columns in V$ASM_DISK
2.
# dd if=/dev/rdsk/c5t1d3 of=/tmp/disk.out bs=8192 count=1000
# vi /tmp/disk.out
If the disk is still a part of the diskgroup, then clean up ASM disk header.
# dd if=/dev/null of=/dev/rdsk/c5t1d3 bs=8192 count=1000
Add a renamed disk again. -
Oracle Rac 11GR2 installation issues;
Hi fellows. I wonder if you could help me with an issue:
I have this Oracle RAC with 2 nodes, using OS Oracle Linux 6.3 with architecture x86_64.
The installation was doing ok, but on "Prerequisite Checks" i had a problem:
"Device Checks for ASM"
Device Checks for ASM - This is a pre-check to verify if the specified devices meet the requirements for configuration through the Oracle Universal Storage Manager Configuration Assistant. Error:
"/dev/oracleasm/disks/OCR1" is not shared - Cause: Cause Of Problem Not Available - Action: User Action Not Available
Check Failed on Nodes: [cmsora02, cmsora01]
Verification result of failed node: cmsora02
Details:
PRVF-5149 : WARNING: Storage "/dev/oracleasm/disks/OCR1" is not shared on all nodes - Cause: - Action:
Back to Top
Verification result of failed node: cmsora01
Details:
PRVF-5149 : WARNING: Storage "/dev/oracleasm/disks/OCR1" is not shared on all nodes - Cause: - Action:
Back to Top
But, the thing is: They are Shareable.
I will prove to you:
[root@cmsora01:/root]$ oracleasm listdisks
DAT1
FRA1
OCR1
OCR2
OCR3
OCR4
OCR5
REDA1
REDB1
And
[root@cmsora02:/root]$ oracleasm listdisks
DAT1
FRA1
OCR1
OCR2
OCR3
OCR4
OCR5
REDA1
REDB1
I don't know if this proves a thing, but the disks are readable for both nodes.
Anyone has passed for this situation before ?
Any hint would be helpful.
Thanks in Advance.
Regards.check the following links if it help's you out
http://www.oracler.net/?p=66
http://nnarimanov.blogspot.in/2012/11/asm-disk-permissions-in-rhel6.html -
SGA sizing recommendation / white paper
Hello,
I am interested in finding a white paper / recommendations on how to best size Oracle database memory SGA. I know it depends on many variables but here is the details that I have so far:
OS - either windows 2003 or HP unix 11i
# of databases - 5
# of schemas per database = 1
size of each schema 40GB
# of sessions 30-50 at any given time
one user defined per schema
most likely will utilize RAC solution with cluster software on either platform. But we could also use standby database technology instead of RAC as a means of failover/switchover issues.I agree with Justin, better to create one instance with 5 schemas then the other way around. This way, you can devote all available system resources, to one instance, and let the apps/schemas achieve a balance within that.
If you do five instances, you will have to constantly re-balance the system resources manually based on requirements at the time. -
Any future on the exam 1Z0-046
Hi Certification experts
before i start investing my time on the exam Managing Oracle under Linux 1Z0-046, i would like to know if this exam has a future as it is a 10g exam. And we are now all using 11g soon R2.
Any clarifications pealse?haggy_fleisch wrote:
Hi Certification experts
before i start investing my time on the exam Managing Oracle under Linux 1Z0-046, i would like to know if this exam has a future as it is a 10g exam. And we are now all using 11g soon R2.
Any clarifications pealse?IMHO The issue isn't so much whether it's oracle 10gR2 or 11gR2, the issue is that the exam is RHEL 4 with a some emphasis on 32-bit and workarrounds required because of that.
I think real world is now effectively linux 64 bit for serious stuff (unless possibly using VM's) ... so the 32 bit workarrounds are close to going to a museum ... having said that there will be many such 32 bit installations working still.
Some of the topics can be hard to locate information on.
If you can wait hopefully this book can soon be published ..... [http://www.rampant-books.com/book_0902_managing_oracle_on_linux_OCE_oracle_certified_expert.htm] ...
The author has posted on these forums and has said the manuscript is with the publsher.
Overall not an easy call ....
Maybe you are looking for
-
Touch no longer recognized after updates
I updated a lot of software on the MacBook a few days ago as recommended by Software Update. I guess the latest versions of Snow Leopard and other stuff like iMovie and iPhoto and iTunes. Today, i tried to sync my Touch and it was invisible. Not even
-
How can i install Enterprise Manager for Fussion Middleware Control 11.1.2
I was lookig information on oracle support but only find how to install it on release 11.1.1.5 I need to monitor my adf 11.1.2 application..
-
Application Module no commits until released
jdev-903 standalone oc4j-903... When I set configuration to run in 'local' mode, I can do am.getTransaction().commit() anywhere in the main routine or in the 'EJB' and the commits show up in the database. (This application can run for hours loading d
-
Stupid Java Development Question (JDK? XCode?)
I'm brand new to OS X, so forgive my noobness. I'm still getting used to OS X. I'm doing this little Java tutorial. It says I need to download an install the Java JDK. As I understand it, Java is already built into OS X and I need to use XCode to cre
-
Flash player locks up web browsers
I'm having problems with Flash Player locking up my web browser. Any time I play a flash movie to make the browser crash (not responding). I've tried IE 8, Firefox, and Chrome all with the same results. Here are the specs: ATI Mobile Radeon driver