Cluster database control showing instances down
I have created a two node cluster in windows 2k3 x 64bit and therefore cant use my grid control as there doesnt seem to be an agent for it, therefore am using the DBconsole instead.
on the welcome window its showing both instances as down, but i know this not to be the case. When going into the database page, both instances are showing as up! I cant work out quite why, have done everything i can think of to get it working with no joy.
any ideas?
The CLUSTER_NAME parameter appears to have not been set when creating the DB Console repository.
See Metalink note: 340362.1 How to Create DB Console in A RAC Environment.
Similar Messages
-
Grid control shows process down but process is up
How can I correct this issue?
the processes are running, but grid control shows them down, is there a manual refresh that needs to be done?the agent is running on a windows server.
it has been showing down for about a week, and it is still showing down, but all the processes are running.
while looking in grid control the arrow on the top left is pointing down, and red
but when I look further down the screen, I see that all of the arrows are pointing up and green. -
Database control shows java.lang.Exception: IOException in connect refuse
Hi All,
I need some help on this issue.
I followed MOS Doc 259387.1 to reset dbsnmp password because its password is unknown.
The error is
Error
java.lang.Exception: IOException in sending Request :: Connection refused
Thanks in advance.
leimHi,
Posting this error in metalink you could get nice directions...
I have the same problem, and looks fixed now...
Try review doc 420761.1
And what I do, was:
Stop dbconsole
start dbconsole (fails)
review logs generated and look this errors:
$ORACLE_HOME/<hostname>_<instance_name>/sysman/log
doing there a directory listing by date, "ls -ltr" the last file showed is the modified one, in my case was:
rw-r--- 1 oracle oinstall 920007 Oct 27 19:33 emoms.log
-rw-r----- 1 oracle oinstall 522694 Oct 27 19:34 emdb.nohup
-rw-r----- 1 oracle oinstall 39130 Oct 27 19:38 emdctl.trc
tail emdctl.trc
2009-10-27 19:19:05 Thread-14236448 ERROR main: nmectl.c: nmectl_validateTZRegion, agentTZoffset =-360,and testTZoffset for -05:00:-300 do not match
2009-10-27 19:19:05 Thread-1125024 WARN http: snmehl_connect: connect failed to (<hostname>:3938): Connection refused (error = 111)
And tail emdb.nohup gives you the instructions to fix the first one, in my case, solving the TZRegion was enough.
$ tail emdb.nohup
----- Tue Oct 27 19:19:05 2009::The agentTZRegion value in /oracle/product/102/db_1/dbserver.uadec.mx_siin/sysman/config/emd.properties is not in agreement with what agent thinks it should be.Please verify your environment to make sure that TZ setting has not changed since the last start of the agent.
If you modified the timezone setting in the environment, please stop the agent and exectute 'emctl resetTZ agent' and also execute the script 'mgmt_target.set_agent_tzrgn' to get the value propagated to repository -----
Hope this could help you.
Regards
Edited by: EnriqueGB on 27/10/2009 08:16 PM -
CloudControl 12c: when adding cluster-database single instances are missing
Hello ,
I'e have installed the agent 12c on every single host of our RAC. When adding a database to CloudControl 12c just the RAC-instance gets discovered - but not the single database instances on each host.
Due to this when clicking targets -> databases I just see the cluster-database - but not every single instance of the database.
Compared to another RAC database this is totally different behaviour.
Any help will be appreciated
Rgds
JHHello ,
maybe I should try to explain the issue a little bit clearer...
We have one RAC database called PROD02. When clicking "targets -> databases" I see the following:
PROD02 of type Cluster Database
PROD021 of type Database Instance
PROD022 of type Database Instance
That's the way it shoudl be - that's the way I expected it...
For the newly cofgured RAC database, called PREP02, it looks different when clicking "targets -> databases"
PREP02 of type Cluster Database
The single instances don't show up. Of course I see the single instances when clicking on "PREP02" under the item "Instances".
Now I wonder why these two RAC databases are differently displayed when clicking "targets -> databases". When trying to add the single instances (clicking "Add" under "targets -> databases") and selecting then either "only on the host <hostname>" or "on all hosts in the cluster" no single instances are found or displayed...
Rgds
Jan -
hi
I am trying to configure oracle 10g 2 node cluster database on Oracle grid control.
When i am trying to add the database, it discovers the defaulr one which is not proper. so i add manually. When I add the cluster database details and instance details when i submit i am getting foll. error.
Database Configuration Result
D2mp.prd.amer.dell.com:
Saving D2mp1.prd.amer.dell.com ...java.sql.SQLException: ORA-20600: The specified target is in the process of being deleted.(target name = D2mp.prd.amer.dell.com)(target type = rac_database)(target guid = CE1212BCBABF40F46B893140DBB5EBFC) ORA-06512: at "SYSMAN.TARGETS_INSERT_TRIGGER", line 24 ORA-04088: error during execution of trigger 'SYSMAN.TARGETS_INSERT_TRIGGER' ORA-06512: at "SYSMAN.MGMT_TARGET", line 2720 ORA-06512: at line 1 - ORA-20600: The specified target is in the process of being deleted.(target name = D2mp.prd.amer.dell.com)(target type = rac_database)(target guid = CE1212BCBABF40F46B893140DBB5EBFC) ORA-06512: at "SYSMAN.TARGETS_INSERT_TRIGGER", line 24 ORA-04088: error during execution of trigger 'SYSMAN.TARGETS_INSERT_TRIGGER' ORA-06512: at "SYSMAN.MGMT_TARGET", line 2720 ORA-06512: at line 1
Saving D2mp2.prd.amer.dell.com ...java.sql.SQLException: ORA-20600: The specified target is in the process of being deleted.(target name = D2mp.prd.amer.dell.com)(target type = rac_database)(target guid = CE1212BCBABF40F46B893140DBB5EBFC) ORA-06512: at "SYSMAN.TARGETS_INSERT_TRIGGER", line 24 ORA-04088: error during execution of trigger 'SYSMAN.TARGETS_INSERT_TRIGGER' ORA-06512: at "SYSMAN.MGMT_TARGET", line 2720 ORA-06512: at line 1 - ORA-20600: The specified target is in the process of being deleted.(target name = D2mp.prd.amer.dell.com)(target type = rac_database)(target guid = CE1212BCBABF40F46B893140DBB5EBFC) ORA-06512: at "SYSMAN.TARGETS_INSERT_TRIGGER", line 24 ORA-04088: error during execution of trigger 'SYSMAN.TARGETS_INSERT_TRIGGER' ORA-06512: at "SYSMAN.MGMT_TARGET", line 2720 ORA-06512: at line 1
If i check management system and deleted targets there are no pending deletions.
Then still why I am not able to add the cluster database.
Please help.the oms is 10.1.0.4 on linux.
the database i am trying to configure is oracle 10g 2 node RAC on linux.
please let me know if u want any other information . -
Database control 10g agent connection to instance down
I am use oracle OEM of database control 10g ,in OEM home page two instance are seen but when i hv click in switch in instance2 then agent connection to instacne is down
i hv also check the alert log of OEM but i give not answer
pls how can solve this problemPlease provide emoms.trc/emagent.trc and platform info
-
CloudControl 12c shows "Agent Unreachable" for Cluster Database
Hello ,
when clicking on "Targets -> Databases" our RAC database shows up as follows:
Name Type Status
PROD02 Cluster Database symbol for "Agent Unreachable"
PROD021 Database Instance symbol "green arrow" for "Up"
PROD022 Database Instance symbol "green arrow" for "Up"
I don't understand why the symbol for the Cluster Database is not a green arrow, too. The agent on each node is up and running - and when either clicking on "PROD02" or "PROD021" (or PROD022) Cloud Control offers the full functionality. Therefore the status "Agent Unreachable" is missleading (from my point of view). I don't want to remove the complete Cluster Database and discover it once again - several jobs have already been defined and I don't want to do that once again.
Did anybody else experience the same behaviour?
Any help will get appreciated...
Rgds
JH... seems like if I'm hitting bug "BUG 13865299".
=> "12c Cluster database or Cluster ASM in Pending or "Agent unreachable" for undetermined time [ID 1463196.1]" -
Configure Database Control web page in MSCS Failover Cluster
I have a two-node windows 2000 cluster that is managed with Microsoft Cluster Services and Oracle FailSafe Manager. The cluster works fine, so does connecting to the database with SQL; however, I have been unable to use the database control EM web page to access the database. The page appears with the Database/Instance/Listener titles but no data/information appears.
There is a virtual host name and IP address for the cluster which I can use successfully when accessing thru SQL. I've tried the system name and the virtual cluster name in the http://<SYSTEMNAME>:1521/em web address. I've tried both without the "em".
The emctl agent is running. The dbconsole service is running correctly.
Which name should I use in the web address - host system name or virtual (cluster) host name? What configuration parameters am I missing?
Any help would be greatly appreciated.
Thanks in advance!Problem could be same but reason could be diffrent
please paste the emos.trc and tell the oms version , platform. -
Multiple Single Instance DB Conversion to Cluster Database RAC
Hi,
Good Day.
we are in planning phase to perform an activity, in which 8 existing (Single Instance) and 1 new database will be consolidated in ONE Oracle RAC Cluster database.
Kindly share your ideas, to perform the consolidation smoothly with minimal downtime.
can any one share the cons/pros, what if we create MULTIPLE RAC cluster databases instead of one cluster database?
Thank You.
Regards,The cons are pretty much the same as running multiple instances on a single server: Tuning will be much harder because you will have to look for bottleneck and depletion of common resources (CPU, RAM, IO) across all your instances instead of one (where you have lots of nice and integrated features). There is the potential for contention between resources and since each instance/database has its own SGA (and they are not shared) you will potentially waste a lot of ram for stuff that is redundant between the instances.
But if you still think this is something you want to do, you should take a look at the 'server pool' feature. It will give you some more control over how your databases/instances should be ditributed across your rac (there is propably no need for all databases to be running on all servers at the same time)
Bjoern -
DB console is showing two Cluster databases
Hi,
I have a two RAC envieronment. I added another instacne . Now the EM (DBconsole) is showing only the old instances , not the new one as well. when i did further investigation , found this.
On the OEM console page, click preferences, click preferred Credentials and the database instance
Under cluster databases, system is showing following
(+)DBNAME.hostname.lcl
(+)DBNAME
when i expanded the (+)DBNAME.hostname.lcl, its showing
DBNAME.hostname.lcl_DBNAME3
Exapanding (+)DBNAME shows
DBNAME_DBNAME2
DBNAME_DBNAME1
The problem is , why not all the instances are shown into one cluster databases.
does anyone knows, how to fix. I have raised a SR , but as usual no solution.I definitely feel your pain, I've been there and done that. If you don't mind punting I would suggest the following:
As an example, we have a three node rac database. The node/instance names are rac01/ORADB1, rac02/ORADB2, and rac03/ORADB3. We want to install EM dbconsole to manage all the instances. rac01 is the EM host server. The database registry shows the following:
COMP_ID COMP_NAME VERSION STATUS SCHEMA
EM Oracle Enterprise Manager 11.1.0.6.0 VALID SYSMAN
Set up ssh authorization in such way so that all nodes can connect to each other without password prompt. The ssh authorization can be disabled after the configuration.
emca -config dbcontrol db -repos recreate -cluster -EM_NODE rac01 -EM_SID_LIST ORADB2,ORADB3 -SYS_PWD password -DBSNMP_PWD password -SYSMAN_PWD password -PORT 1521
The logs for this activity can be found under:
cd $ORACLE_BASE/cfgtoollogs/emca/<DB_UNIQUE_NAME>
You will be prompted for :
Database unique name: ORADB
Cluster name: rac_cluster
Email address for notifications (optional): <enter>
Outgoing Mail (SMTP) server for notifications (optional): <enter>
ASM ORACLE_HOME [ /apps/dbs/oracle/product/11.1.0/db_1 ]: <enter>
ASM port [ 1521 ]: <enter>
ASM user role [ SYSDBA ]: <enter>
ASM username [ SYS ]: <enter>
ASM user password: < the password for SYS ASM user>
The whole process takes about 1 hour, depending on the speed of the servers that you are using.
If in the future another node is added to the RAC system, then issue the following command on node 1:
emca -addInst db
You will be prompted for :
Node name: <new server name>
Database unique name: ORADB
Database SID: <new instance name>
Password for SYS user: <password>
You should find the agent running on non host nodes, in this case rac02 and rac03, while db console will also be running on the host node i.e. rac01.
IF not then run emctl start dbconsole on all on nodes.
How does that work for you?
-JR jr. -
Oemd_oms_csa_collector showing as down (10GR2 Grid Control)
The oemd_oms_csa_collector target is showing as down.
Yes I know its bug fixed in the next patch. Has anyone attempted to remove the target, edit the targets.xml to stop it showing up?
BarrySee if my response to this posting will help
Database Control always gets "The database status is currently unavailable" -
Add second instance to Enterprise Manager 10g database control
Hi,
I have a server with one Oracle 10g database instance, and I
configured the local Enterprise Manager database control for it.
Now I added a second instance on the server, using the same Oracle
home. Can I manage this new instance using the existing database
control or do I have to configure a second database control using
another port? The documentation isn't too clear on this.
Thanks,
MatthiasYou can't manage the two database using database control. you have to go for Grid control only if you need to configure two or more instance.
-
Database control in a two node oracle fail safe cluster
os windows server 2003 r2
db 10.2.0.4
ofs 3.4.1
i've configured db control in the following
D:\oracle\product\10.2.0\db_1\BIN>emca -config dbcontrol db -repos recreate -cluster_name name_of_the_cluster
is this right?
next question
the -cluster flag and the -EM_NODE / -EM_SID_LIST parameters in the emca are only for rac?
with my configuration i can't login to my database over dbcontrol
Listener refused the connection with the following error: ORA-12514, TNS:listener does not currently know of service requested in connect descriptor The Connection descriptor used by the client was: (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=node1.blah)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=ABBA)))How to Configure the 10.2 DB Control in a Failsafe Environment
ID: 452305.1
HOWTO: PUBLISHED 17-OCT-2008
In this Document
Goal
Solution
References
Applies to:
Enterprise Manager Grid Control - Version: 10.2.0.1 to 10.2.0.3
Information in this document applies to any platform.
Goal
The goal of the document is to provide the steps to configure the DB Console in an Oracle Failsafe environment.
Please note that the solution offered in this document is not certified by Oracle. It's only provided as a workaround for customers who wish to use this setup for the Database Control Console in a failsafe environment. Support for the procedure outlined in this document will be provided on a 'best efforts' approach.
As an alternative to this approach you can use Grid Control Agents to monitor a database in a failsafe environment. For more details please see:
Note 396659.1 How To Setup Grid Control Central Agent Manually in Oracle Failsafe Environment
We assume the following:
- the database binaries are installed on each node on the local disk
- you already have a failsafe group with the database, the listener, disk resource, and virtual
ip/hostname
Note: This is specific for Windows environments using Oracle Failsafe. For setting up the DB Console in Active/Passive clusters on UNIX please use the following note instead:
Note 362524.1 Configure DB Control 10.2 for use in Active/Passive High Availability Environments
Solution
1. Drop the DB Control repository and configuration files on the active node:
<ORACLE_HOME>/bin/emca -deconfig dbcontrol db -repos drop
2. Recreate the DB Control using the virtual hostname:
- in a command window do the following:
set oracle_sid=<your_sid>
set oracle_home=<your_oracle_home>
set oracle_hostname=<virtual_hostname>
cd %oracle_home%\bin
emca -config dbcontrol db -repos create
-- make sure that the virtual host name was picked up by emca (it will display a summary screen
before continuing)
3. Verify that the DB Console works fine and can be accessed using the virtual host name in the URL
4. Stop the DB Console
5. Create a directory path on the group disk resource similar to your oracle home path on the local disk.
For example:
If the oracle home on the local disk is C:\oracle\product\10.2.0\db_1 and the shared disk is D:
then create the following path: D:\oracle\product\10.2.0\db_1
Copy C:\oracle\product\10.2.0\db_1\<hostname_sid> and
C:\oracle\product\10.2.0\db_1\oc4j\j2ee\OC4J_DBConsole_<hostname_sid>
to D:\oracle\product\10.2.0\db_1\<hostname_sid> and respectively
D:\oracle\product\10.2.0\db_1\oc4j\j2ee\OC4J_DBConsole_<hostname_sid>
Remember to change the values enclosed in <> with those in your environment.
6. Delete the following directories from the local disk
C:\oracle\product\10.2.0\db_1\<hostname_sid>
C:\oracle\product\10.2.0\db_1\oc4j\j2ee\OC4J_DBConsole_<hostname_sid>
7. Create NTFS junction points from the local disk to the shared disk (these work like symbolic
links on UNIX) . It is your responsibility to create these.
You can find a brief guide as well as some tools that will help you create them at:
http://en.wikipedia.org/wiki/NTFS_junction_point
http://www.microsoft.com/technet ... dDisk/Junction.mspx
Important: Please note that this functionality is not certified nor supported by Oracle. Make sure you understand the
implications. Especially don't delete the junction points from Windows Explorer !!
In the end you should have the junction points on the local disk (with the same names as the
original directories) that would point to the directories you copied on the shared disk.
8. Start the DB Console service and verify that everything is still working fine.
9. Stop the DB Console service.
10. Move the Fail Safe group to the 2nd node.
11. Once the database is started, create the DB Console configuration files on the 2nd node:
<ORACLE_HOME>/bin/emca -config dbcontrol db
12. Stop the DB Console
13. Delete the created configuration files from the local disk:
C:\oracle\product\10.2.0\db_1\<hostname_sid>
C:\oracle\product\10.2.0\db_1\oc4j\j2ee\OC4J_DBConsole_<hostname_sid>
14. Create junction points from the local disk to the directories already located on the shared
disk.
15. Start the DB Console service and verify that is working fine.
16. Add the DB Console service as a resource to the fail safe group and put dependencies on the
database and listener services.
17. Perform a fail over and see if everything works fine.
References
Note 298238.1 - Oracle10g Grid Control with Oracle Fail Safe
Note 362524.1 - Configure DB Control 10.2, 11g for use in Active/Passive High Availability Environments
Note 396659.1 - How To Setup Grid Control Central Agent Manually in Oracle Failsafe Environment
Keywords
EMCA ; DB~CONTROL ; FAILSAFE ; DBCONTROL ; ENTERPRISE~MANAGER ; -
Database control in a cluster environment
Hello DBA's
Is it possible to use the database control in a windows cluster with oracle fail safe? I haven't found any documentation to this topic (only with RAC).
I have two possibility's:
1. To use it as a cluster service where I could connect with the clustername/IP address?
Yet couldn't configure it right by my own.
2. To use it as normal service where allways the active note can connect to the database control? (Problem with the Host-Names because each note has there own)
I use Oracle 10.1.0.4 database with NO grid control only em database control.I found a Metalink entry how you can configure the Oracle Enterprise Manager in a FailSafe Environment but only for Grid Control:
Note:396659.1 How To Setup Grid Control Central Agent Manually in Oracle Failsafe Environment
Is there a script/guide to do it with the local "enterprise manager database control"?
Replying to mnazi: Ok it is an overview and they mean that it is better to implement the enterprise manager to a management server but I couldn't found any hot information in the documentation to that. Maybe you know further info's? -
11.2 cluster database instances crashed..
Hi all,
we have a two node 11.2 cluster on OL 5.7.
Today our cluster database instances on node two all crashed.
I found several log entry´s. There are all addicted to network.
_____Alert log
Thu Mar 22 09:15:31 2012
Errors in file /u01/app/oracle/diag/rdbms/borac4/borac42/trace/borac42_ora_27888.trc (incident=5217):
ORA-00603: ORACLE server session terminated by fatal error
ORA-27501: IPC error creating a port
ORA-27300: OS system dependent operation:bind failed with status: 99
ORA-27301: OS failure message: Cannot assign requested address
ORA-27302: failure occurred at: sskgxpsock
Incident details in: /u01/app/oracle/diag/rdbms/borac4/borac42/incident/incdir_5217/borac42_ora_27888_i5217.trc
Thu Mar 22 09:15:33 2012
SKGXP: ospid 5375: network interface query failed for IP address 169.254.68.184.
SKGXP: [error 11017]
... we can ping all interfaces, interlinks and virtuelle ip-addresse linke 169.254....
we als can not find any misconfiguration and can ping all routes.
If I try to restart the instances with sqlplus startup
ORA-00119: invalid specification for system parameter REMOTE_LISTENER
ORA-00132: syntax error or unresolved network name 'borac4-prod:1521'
We did not change anything at the configuration :-/
I can ping the SCAN address from dns configuration "ping borac4-prod:" also telnet established a connection "telnet borac4-prod 1521"
We start all instances via SPFILE from an ASM instance
Does anyone has some ideas to dig the problem out ?
Thanks
*TI repeat we did not change anything at the configuration .....I guess....I hope....NOT
$ORACLE_HOME/network/admin/sqlnet.ora
NAMES.DIRECTORY_PATH= (tnsnames,ldap,EZCONNECT)
--> EZCONNECT
METANOTE: 1254929.1
*T
Maybe you are looking for
-
BI Pub report bursting based on parameters set in interactive dashboard
Hi, Could someone help me in creating and bursting reports as per the following requirement: 1. there is interactive dashboard with html multi select parameter that has display values department, location, employee job code. user can select one or mo
-
No fact table exists at the required level of detail
Hi All, I am getting the below error in report level(11.1.1.6.4). No fact table exists at the required level of detail. Thanks & Regards, Chandra
-
Form values in subsequent layers of VC based UI wizard are not refreshed
Hello experts, i am just about to develop a wizard based UI for an custom ess application with the VC and now i face a strange phenomenon. I got two layers each containing a form. Both forms have a dropdown list with the same contents. The logic is,
-
No internet access after disconnecting from VPN
Summary: windows fails to restore normal network after disconnecting from a VPN network, the PPP adapter which represent VPN connection stays in the interface list even after disconnection. system has no network access to anywhere. Synopsis: a. Win 7
-
I got a new macbook pro with mac ox 10.9.4 and couldn't launch the installer for CS4. The setup error message was "Setup has encountered an error and cannot continue. Contact Adobe Customer Support for assistance." Any idea you have would be greatly