Private interconnect of an Oracle 10g cluster

Can you please answer below questions?
Is a direct connection between two nodes supported on the private interconnect of an Oracle 10g cluster?
We know that crossover cables are not supported, but what about a Gigabit network with a straight cable?”

Hi,
I really wouldn't suggest that approach, It is definitely not efficient and not flexible
- If you have 4 nodes, and nodes 1 want to send message to node 4, the package must go through node 2 and 3? Is it efficient? NO absolutely
- If you have e.g 2 nodes, if one of the link down in one of the nodes, the other nodes link will also down, this will most likely evicting both nodes instead of one node
- your clusterware nodes iis limited by the cable which is not efficient
- etc etc etc more disadvantages than advantages
Cheers
FZheng

Similar Messages

Making new oracle 10g cluster in redhat enterprise linux

Hy All
i have installed redhat enterprise server in 2 systems and both are attached with SANE network storage. i want to configure oracle 10 g clustering with this setup.
should i have to configure clustering in linux only or there is a feature of clustering in oracle?
if yes than how to do that? i dont have any idea about oracle
please somebody help me
with regards,
ali

Hi Ali!
Hardware clustering is differnet from Oracle clustering.
If you have the database you should investigate RAC http://www.oracle.com/pls/db102/to_toc?pathname=rac.102%2Fb14197%2Ftoc.htm&remark=portal+%28Administration%29
For the Application Server have a look at http://download-uk.oracle.com/docs/cd/B14099_18/core.1012/b14003/toc.htm
Hardware clustering with RedHat could be achieved with Piranha.
cu
Andreas

Copper cable / GigE Copper Interface as Private Interconnect for Oracle RAC

Hello Gurus
Can some one confirm if the copper Cables ( Cat5/RJ45) can be used for Gig Ethernet i.e. Private interconnects for deploying Oracle RAC 9.x or 10gR2 on Solaris 9/10 .
i am planning to use 2 X GigE Interfaces (one port each from X4445 Quad Port Ethernet Adapters) & Planning to connect it using copper cables ( all the documents that i came across is been refering to the fiber cables for Private Interconnects , connecting GigE Interfaces , so i am getting bit confused )
would appretiate if some one can throw some lights on the same.
regards,
Nilesh Naik
thanks

Cat5/RJ45 can be used for Gig Ethernet Private interconnects for Oracle RAC. I would recommend trunking the two or more interconnects for redundancy. The X4445 adapters are compatible with the Sun Trunking 1.3 software (http://www.sun.com/products/networking/ethernet/suntrunking/). If you have servers that support the Nemo framework (bge, e1000g, xge, nge, rge, ixgb), you can use the Solaris 10 trunking software, dladmin.
We have a couple of SUN T2000 servers and are using the onboard GigE ports for the Oracle 10gR2 RAC interconnects. We upgraded the onboard NIC drivers to the e1000g and used the Solaris 10 trunking software. The next update of Solaris will have the e1000g drivers as the default for the SUN T2000 servers.

Enable autoarchiving for Oracle 10g RAC db

Hello
What are the steps to enable autoarchiving for Oracle 10g cluster database?
It is currentrly in noarchivelog mode.
Thank you,
Yelena

Hi.
I think that this has been improved in 10g, so that we can do an exclusive mount on any database in a RAC without setting cluster_database to false. Also the parameter log_archive_start has been depreciated so the steps is simply (assuming that you by default wants to use db_recovery_file_dest to store archived redo logs)
1) Shutdown immediate (instance 1)
2) Startup mount
3) Alter database archivelog
4) Alter database open
Repeat this sequence for all nodes in the RAC.
And the best is to leave the log_archive_format by it's default value, to ensure that the incarnation of the database is represented in the archive log name.
(On 10g, backupsets and archivelogs are usable beyond different reincarnation of a database, so there is a good change that S% or s% will repeat itself after an open resetlogs).
Hopes this might help you.
Good Luck
Rgds
Kjell Ove

Gig Ethernet V/S SCI as Cluster Private Interconnect for Oracle RAC

Hello Gurus
Can any one pls confirm if it's possible to configure 2 or more Gigabit Ethernet interconnects ( Sun Cluster 3.1 Private Interconnects) on a E6900 cluster ?
It's for a High Availability requirement of Oracle 9i RAC. i need to know ,
1) can i use gigabit ethernet as Private cluster interconnect for Deploying Oracle RAC on E6900 ?
2) What is the recommended Private Cluster Interconnect for Oracle RAC ? GiG ethernet or SCI with RSM ?
3) How about the scenarios where one can have say 3 X Gig Ethernet V/S 2 X SCI , as their cluster's Private Interconnects ?
4) How the Interconnect traffic gets distributed amongest the multiple GigaBit ethernet Interconnects ( For oracle RAC) , & is anything required to be done at oracle Rac Level to enable Oracle to recognise that there are multiple interconnect cards it needs to start utilizing all of the GigaBit ethernet Interfaces for transfering packets ?
5) what would happen to Oracle RAC if one of the Gigabit ethernet private interconnects fails
Have tried searching for this info but could not locate any doc that can precisely clarify these doubts that i have .........
thanks for the patience
Regards,
Nilesh

Answers inline...
Tim
Can any one pls confirm if it's possible to configure
2 or more Gigabit Ethernet interconnects ( Sun
Cluster 3.1 Private Interconnects) on a E6900
cluster ?Yes, absolutely. You can configure up to 6 NICs for the private networks. Traffic is automatically striped across them if you specify clprivnet0 to Oracle RAC (9i or 10g). That is TCP connections and UDP messages.
It's for a High Availability requirement of Oracle
9i RAC. i need to know ,
1) can i use gigabit ethernet as Private cluster
interconnect for Deploying Oracle RAC on E6900 ? Yes, definitely.
2) What is the recommended Private Cluster
Interconnect for Oracle RAC ? GiG ethernet or SCI
with RSM ? SCI is or is in the process of being EOL'ed. Gigabit is usually sufficient. Longer term you may want to consider Infiniband or 10 Gigabit ethernet with RDS.
3) How about the scenarios where one can have say 3 X
Gig Ethernet V/S 2 X SCI , as their cluster's
Private Interconnects ? I would still go for 3 x GbE because it is usually cheaper and will probably work just as well. The latency and bandwidth differences are often masked by the performance of the software higher up the stack. In short, unless you tuned the heck out of your application and just about everything else, don't worry too much about the difference between GbE and SCI.
4) How the Interconnect traffic gets distributed
amongest the multiple GigaBit ethernet Interconnects
( For oracle RAC) , & is anything required to be done
at oracle Rac Level to enable Oracle to recognise
that there are multiple interconnect cards it needs
to start utilizing all of the GigaBit ethernet
Interfaces for transfering packets ?You don't need to do anything at the Oracle level. That's the beauty of using Oracle RAC with Sun Cluster as opposed to RAC on its own. The striping takes place automatically and transparently behind the scenes.
5) what would happen to Oracle RAC if one of the
Gigabit ethernet private interconnects fails It's completely transparent. Oracle will never see the failure.
Have tried searching for this info but could not
locate any doc that can precisely clarify these
doubts that i have .........This is all covered in a paper that I have just completed and should be published after Christmas. Unfortunately, I cannot give out the paper yet.
thanks for the patience
Regards,
Nilesh

Link Based IPMP Private Interconnect - Oracle 10g

I am configuring IPMP for Oracle 10g RAC private and Private Interconnect.
Following an Oracle white paper we are configuring LINK Based IPMP in an Active/Active Configuration
I have information from metalink for configuring the VIP, however I am a little unsure about the configuration of the private interconnect.
Is it just a case of removing the cluster interconnect from oifcfg and using cluster_interconnect for ASM and Database instances.
Is there any other considerations for Oracle 10g RAC deployment beside making change using oifcfg as well as using private_interconnect initialization parameter.
Thanks
Paul

The following notes are of help for you:
How to Setup IPMP as Cluster Interconnect (Doc ID 368464.1)
Configuring Solaris IP Multipathing (IPMP) for the Oracle 10g VIP (Doc ID 283107.1)
White paper on IPMP:
http://www.oracle.com/technetwork/articles/systems-hardware-architecture/ha-rac-networking-ipmp-168440.pdf
Raj Mareddi
http://www.freeoraclehelp.com

Private interconnect oracle 10g RAC configuration

Can you please answer below questions?
Why does a private interconnect need a switch, and why is straight through cables not supported.

Hi,
Why do you need a switch between the nodes".When network plugs are pulled out from one node on a two node cluster, a split brain scenerio occurs. (just it's enough)
If you are using a crossover cable and you shutdown node (A) you will loose the network (private) link from node (B) (this happens in some servers.), Oracle RAC will not work with private network link down, both nodes will down and will not start until you get link on network private. (Goodbye high availability)
You will be very unhappy with the error ORA-29740. Prelude to suggest this note: Troubleshooting ORA-29740 in a RAC Environment [ID 219361.1]
There is no "why" Oracle RAC does not support crossover cable because RAC depends of SWITCH (it's a Hardware Requirements) and any problems in your environment Oracle will force you to implement a supported solution.
You will have implemented a poor environment, if you not use a GB switch for private network.
Oracle Words:
*Physical Layout of the Private Interconnect*
The basic requirements are described in the Installation Guide for each platform. Additional information about certification can be found on Metalink Certify.
The interconnect as identified by both subnet number and interface name must be configured on all clustered nodes.
*A switch between the clustered nodes is an absolute requirement.*
*Cluster Interconnect in Oracle 10g and 11g [ID 787420.1]*
Regards,
Levi Pereira

Oracle 10g RAC - Private Interconnect on Private non-routable VLAN

In our data center there is an existing Oracle 10g RAC configured with private VLAN for Interconnect administered by a different group of DBAs.
We are designing a new, separate Oracle 10g RAC environment to support our application.
When we discussed with our data center folks to set up a private VLAN for our RAC Interconnect, they suggest to use the same existing Private VLAN used by other Oracle RAC configurations. In that case the Interconnect IPs will be on the same subnet as other Oracle RAC configurations.
For example, if
RAC1 with 2 nodes is using 192.168.1.1 and 192.168.1.2 in the VLAN_1 for the Interconect, they want us to use the same VLAN_1 with Interconnect IPs 192.168.1.3 and 192.168.1.4 for our 2 node RAC.
Is Sharing same subnet on the same Private VLANs for interconnects of different RAC configurations supported?
Will that cause any performance hit? That means the Interconnect IPs of One RAC configuration is pingable from other RAC configuration.
Did anyone come across such a design?
Could not find any info on this on Metalink.
Thanks

yes
this is practically very much feasible.. as you would have only 4 m/c in ip subnet .... and this is very much less than the public subnet which we should refrain from using from interconnect.

Oracle Cluster private Interconnect

What are the different speeds and technologies that we can configure the oracle private interconnect for RAC 11g?

ghd wrote:
What are the different speeds and technologies that we can configure the oracle private interconnect for RAC 11g?The recommended technology (looking at what Oracle's Database Machine uses) is QDR (Quad Data Rate/40Gbs) Infiniband, using the RDS (Reliable Datagram Sockets). This provides (according to Oracle testing), a 50% faster cache-to-cache block throughput with 50% less CPU time - in comparison to using UDP as the RAC Interconnect wire protocol.
Oracle presented these results to the Infiniband/OFED members in a presentation called Oracle’s Next-Generation Interconnect Protocol (PDF).
The Infiniband roadmap shows that the NDR (Next Data Rate) will scale to 320Gb/s.
There is absolutely nothing I have seen from the Ethernet vendors that show GigE matching Infiniband.
From Top 500, listing the biggest and fastest 500 clusters on this planet, Infiniband has a 41.8% market share, in comparison with the 41.4% share of GigE.
Compare this to 2005 (when we first got Infiniband for RAC). Back then Infiniband had a 3.2% market share. GigE had a 42.8% share. So there has been an incredible growth in using Infiniband as Interconnect - unlike GigE that has been stagnant and now is the 2nd place as top500 Interconnect family architecture.
What is needed for using Infiniband for Oracle RAC? A HCA (Host Channel Adapter) card for each RAC server (high speed PCI cards, dual port). An Infiniband switch (2 ports per RAC server needed). And cables of course. All these are sold by most server h/w vendors. Costs are quite comparable to 10Gb/s GigE (and even cheaper) in my experience.

INS-20802 Oracle Private Interconnect Configuration Assistant failed

Thought I would post what information I've gathered, after facing this error during install of RAC Grid Infrastructure 11.2.0.1 on Red Hat Enterprise Linux Server release 5.5 64-bit, as Oracle Support is once again unable to help. Maybe this will save someone else some time and the aggravation of dealing with lousy Oracle Support.
The error occurs after root.sh has successfully completed on all nodes. Oracle Net Configuration Assistant runs successfully, then Oracle Private Interconnect Configuration Assistant launches and subsequently fails with the following.
[INS-20802] Oracle Private Interconnect Configuration Assistant failed.
/u01/app/oraInventory/logs/installActions2010-12-13_01-26-10PM.log
INFO: Starting 'Oracle Private Interconnect Configuration Assistant'
INFO: Starting 'Oracle Private Interconnect Configuration Assistant'
INFO: PRIF-26: Error in update the profiles in the cluster
INFO:
WARNING:
INFO: Completed Plugin named: Oracle Private Interconnect Configuration Assistant
INFO: Oracle Private Interconnect Configuration Assistant failed.
INFO: Oracle Private Interconnect Configuration Assistant failed.
I was able to find another error that coincides with the PRIF-26 error: "CRS-2324:Error(s) occurred while trying to push GPnP profile. State may be inconsistent."
I was also able to duplicate the PRIF-26 error by trying to add a non-existent network interface via oifcfg:
./oifcfg setif -global jjj1/192.167.1.0:cluster_interconnect
PRIF-26: Error in update the profiles in the cluster
My best guess is the Oracle Private Interconnect Configuration Assistant makes a call to oifcfg. When oifcfg makes an update or adds a public/private interface, some XML files are also updated or maybe cross-referenced. These files are located here: <grid_home>/gpnp/<host>/profiles/peer
Any updates/changes/addtions to the private or public interfaces include changes for the Grid Plug-n-Play component, which uses the XML files. If the interface name is not contained in the XML files, my best guess is that triggers the "CRS-2324:Error(s) occurred while trying to push GPnP profile. State may be inconsistent.
I verified everything was configured correctly; the cluster verification utility reported everything was ok. I also ran the cluster verifcation utility against the GP-nP:
./cluvfy comp gpnp -verbose
I also reviewed the public and private interfaces via oifcfg and they are correct:
[oracle@ryoradb1 bin]$ ./oifcfg getif -global
eth0 10.10.2.0 global public
eth1 192.167.1.0 global cluster_interconnect
[oracle@ryoradb1 bin]$ ./oifcfg iflist -p
eth0 10.10.2.0 PRIVATE
eth1 192.167.1.0 UNKNOWN
My conclusion is the environment is configured correctly, in spite of the error generated by the Oracle Private Configuration Assistant.

I understand that you have installed 11.2.0.1 not 11.2.0.2 because multicating must be enabled if you have installed 11.2.0.2 and you may face these sort of problems because cluster nodes would not be able to communicate with each other.
Please check ocssd.log especially on the first node because this file will give more inforamtion as to why first node is not able to push GPnP file. As you have executed cluvfy to confirm the GPnP but to confirm whether GPnP profile is accurate to just narrow down the problem, I would suggest you to try to start cluster in exclusive mode so that you can sure that GPnP profile is good.
Shutdown CRS on all nodes, if there is any hung processes then kill them before executing the fllowing command to start cluster in exclusive mode.
$GRID_HOME/bin/crsctl start crs -excl
If you are able to start cluster in exclusive then it is sure that GPnP is correct and then next step would be to verify the private network.
See how you goes.
FYI, I was recently analyzing the same sort of problems where cluster was not able to access GPnP profile and finally I found issues on my private network. Customer had enabled IGMP snooping, which was avoiding multicast communication over the private network but it was 11.2.0.2, which is not the case here.
Harish Kumar
http://www.oraxperts.com

Problems with Cluster Ready Service installation (RAC) in Oracle 10g R1

Hello
I have got problems with this installation. I am starting Oracle user
At the end of the installation I get a mesage when all Configuration Assistants are failed
I have got 2 computers with Windows 2000 PRO, two networks (private and public)
As a shared disk I use one external disk (with USB) attached to one computer.
What to do here?
please for a reply
Martin
PROT-1: Failed to initialize ocrconfig
SCLS error 1 reading current privileges.
Internal Error Information:
Category: 1234
Operation: scls_iddb_has_privgrp_by_name
Location: NetLocalGrou
Other: get local group failed
Dep: 0
Step 1: checking status of CRS cluster
Step 2: configuring OCR repository
ignoring upgrade failure of ocr(-1)
failed to configure Oracle Cluster Registry with CLSCFG, ret 102
Result code for launching of configuration assistant is: 1
The OUICA command is launched from D:\oracle\product\10.1.0\crs\oui\bin\ouica.bat.
Launched configuration assistant 'Oracle Notification Server Configuration Assistant'
Tool type is: Optional.
The command being spawned is: 'D:\oracle\product\10.1.0\crs/bin/racgons.exe add_config migi:4948'
Start output from spawned process:
End output from spawned process.
Configuration assistant "Oracle Notification Server Configuration Assistant" failed
Result code for launching of configuration assistant is: 1
The OUICA command is launched from D:\oracle\product\10.1.0\crs\oui\bin\ouica.bat.
Launched configuration assistant 'Oracle Private Interconnect Configuration Assistant'
Tool type is: Optional.
The command being spawned is: 'D:\oracle\product\10.1.0\crs/bin/oifcfg.exe setif -global "public"/10.0.0.0:cluster_interconnect "public"/192.168.1.0:public'
Start output from spawned process:
PRIF-12: failed to initialize cluster support services
End output from spawned process.
Configuration assistant "Oracle Private Interconnect Configuration Assistant" failed
PRIF-12: failed to initialize cluster support services
Result code for launching of configuration assistant is: 1
The OUICA command is launched from D:\oracle\product\10.1.0\crs\oui\bin\ouica.bat.
Error:*** Alert: Some of the configuration assistants failed. However these are optional assistants, so they are not required for the correct configuration of your system. If you want to try to run those assistants again, select the failed assistants and click the 'Retry' button. ***
User Selected: Yes/OK
Starting to execute configuration assistants
Launched configuration assistant 'Oracle Cluster Ready Services Configuration Assistant'
Tool type is: Optional.
The command being spawned is: 'D:\oracle\product\10.1.0\crs/install/crssetup.config.bat'

Also you clusterware installation installs to an ORACLE_HOME.
Oracle does only make a differentiation, if it has to be clear, that you got a clusterware home and a database home.
Normally if a patch is referring to $ORACLE_HOME (and the patch can be used for clusterware & database), it just means the installation directory of the oracle software installed.
Sebastian

How can i install oracle 10g on linux cluster

Dear all:
please advice How can i install oracle 10g on linux cluster service ..
thanks ,,

Without RAC, you can only have one instance manage the database. One instance = one set of processes communicating via IPC.
Unless you know of a way to have processes use memory-based IPC across nodes, you need to pick a node and install & run the database software on that node.

Install Oracle 10g on Windows 2003 Server cluster (MSCS)

Hi all
How do I install Oracle 10g on Windows 2000 cluster (MSCS installed)?
I have a 2-nodes Microsoft windows 2003 server cluster and I want to install Oracle 10g,
Do I folloow this order:
1. Install the software on both without the database
2. Create the database from the first node
in this case, The second node can see the database as it is available?,
and what about the IP adresses?
If you can point me to some documentation, or help in any way, I would appreciate it.
Thanks for any help.

Read here...
http://download.oracle.com/docs/html/A96685_01/intro.htm
>>
Oracle Fail Safe comprises multiple components: Oracle Fail Safe Manager, Oracle Services for MSCS, and server components specific to Oracle Fail Safe.
>>
So I don't know how you can achieve this without Fail Safe.
There might be other link which I cannot find right now.

Oracle 10g AS 10.1.3 cluster : Topic MDB does not receive messages

Dear experts,
We have the latest Oracle 10g AS 10.1.3 cluster, which consists of two nodes.
Background: Our application is a J2EE app extensively using JMS for communicating notifications between cluster nodes. It does work fine in standalone OC4J, clustered WebLogic and clustered SAP WebAS.
Application is deployed without any errors to Oracle AS. It works fine with 1 cluster node, it 'half' works when second node is added.
The cluster does recognize both nodes - we can administer and see them fine from the console.
The problem application experiences is this:
1. The application MDBs do not seem to receive any messages sent from another node. Only messages submitted from the same JVM are ever seen. This leads to incosistency in server caches.
2. JNDI tree updates made from one node are also not visible on the other and vice versa.
We tried it on a single physical server with 2 App Server instances and on 2 physical servers.
I followed standard instructions on how to configure clustered environment - basically all we could do after we installed two instances was we turned on the PEER clustering for our application.
Firewalls are also turned off on both servers.
I would really appreciate any piece of advice because we're really stuck at this point!
Thank you!
-Yuri Sokolovski
SCEA

Hi Peter,
Can you just install 10.1.3 on top of another AS installation?You can't install an Oracle Application Server on top of another version. The 10.1.3 install needs to have its own Oracle Home. However, you can configure a 10.1.3 install to use OHS 10.1.2 and to use OID 10.1.2 as its identity management store.
Can you install 10.1.3 standalone?Absolutely. You can download it from:
http://www.oracle.com/technology/software/products/ias/htdocs/utilsoft.html
Serouj

Installing Oracle 10g Forms and Reports in Cluster Mode

Dear All,
My OS version is RHEL 4
In our current setup we have oracle 10g database two node cluster and Application Server 10g to node cluster.
Currently our report server has been configured to run in standalone mode
I have been asked to configure oracle 10g forms and report server in cluster mode.
Please provide me with the documentation link to configure oracle 10g reports server in cluster mode.
Thanks and Regards
Monoj Das

my main goal is load balancing only
Then what I've done in 2007 might be what you need. In that thread there is a link to Web Cache Administrator's Guide : there you'll find everything you need to configure the web cache as a load balancer, particularly chapter 8 Setup and Configuration.
Anyway, here briefly some configurations : we have two machines, say MachineA and MachineB. The DNS resolves MachineA to a virtual address, which is normally assigned to MachineA; if MachineA crashes, it gets assigned to MachineB.
Users URL looks like this : http://MachineA:<port>/forms/frmservlet?config=<some config>
MachineA's web cache distributes connection requests between MachineA and MachineB.
Of course we're now using 11g as well, but that's another thing.

Private interconnect of an Oracle 10g cluster

Similar Messages

Maybe you are looking for