Max nodes using Gigabit ethernet and 10G RAC

Does anybody have any experience on the maximum practical number of nodes that can be hooked together using Gigabit ethernet (over copper) as the interconnect? What's the largest such configuration that anyone has done before saturating the private network? I realize that the type of application/database and utilization can affect this (i.e. OLTP vs DW vs etc...) but I'm just trying to get an idea. I heard 1 dba say that they started saturating the network after 4 nodes. Another said the practical limit was 32.
Any real world numbers out there?

Well, without knowing there needs, there isn't much i can offer you. gigE interconnects are about as fast as most locally contained IO devices if you have a quality network to back it up with.
5 nodes is no problem in most cases, however if your concerned and have the budget - look at enterprise class interconnects such as:
http://doc.quadrics.com/quadrics/QuadricsHome.nsf/DisplayPages/Homepage
Most of the "high end" stuff is considered supercomputing for mass bandwidth on shared memory and bus interconnects.
10gigE is probably more affordable than true grid computing interconnects by supercomputing standards.
Grids really shine with planning - and not with brute force. You can make a "grid" that is divided in processing and databases but acts as one "instance" for example dedicate certain batch jobs to certain servers in the cluster, do backups from a backup node and distribute jobs across the network/grid. Your interconnects would usually be the least contention in an RDBMS environment vs your SAN/Storage environment.
Again.. depends on what you want to do and what your scalability requirements are :)

Similar Messages

How do I maximize LAN speeds using Gigabit Ethernet, jumbo frames?

I move a lot of large files (RAW photos, music and video) around my internal network, and I'm trying to squeeze out the fastest transfer speeds possible. My question has to do both with decisions about hardware and what settings to use once it's all hooked up.
This is what I have so far:
-- imac 3.06GHz, macbook pro 2.53GHz
-- Cisco gigabit smart switch capable of jumbo frames
-- Buffalo Terastation Duo NAS (network attached storage), also capable of Gbit and jumbo frames
-- All wired up with either cat6 or cat53e.
-- The sizes of the files I'm moving would include large #s of files at either 15MB (photos), 7MB (music), 1-2GB (video) and 650MB (also video).
-- jumbo frames have been enabled in the settings of the macs, the switch and the buffalo HD.
-- I've played with various settings of simultaneous connections (more of a help with smaller files), no real difference
-- Network utility shows the ethernet set to Gbit, with no errors or collisions.
-- have tried both ftp and the finder's drap and drop
-- also, whenever I'm doing a major move of data, I kick my family off the network, so there is no other traffic that should be interfering.
Even with all that, I'm still lucky to get transfer speeds at 15-20mbps, but more commonly at around 10. The other odd thing I've encountered while trying to up my speeds, is that I might start out a transfer at maybe 60mbps, it will maintain that for about 30-60sec and then it appears to ramp itself down, sometimes to as low as 1-5mbps. I'm starting to think my network is mocking me
I also have a dual band (2.4/5) wireless n router (not jumbo frame capable), but I'm assuming wired is going to trump wireless? (NOTE: in my tests, I have disabled wireless to force the connection through the ethernet).
Can anyone help with suggestions, and/or suggest a strong networking reference book with emphasis on mac? I'm willing to invest in additional equipment within reason.
Thanks in advance!
juliana

I'm going to pick and choose to answer just a few of the items you have listed. Hopefully others will address other items.
• This setup was getting me speeds as high as 10-15MB/sec, and as low as 5-6MB/sec when I was transferring video files around 1-2 GB in size
I would think a single large file would get the best sustained transfer rates, as you have less create new file overhead on the destination device. It is disturbing that the large files transfer at a slower rate.
• Would a RAID0 config get me faster write speeds than RAID1? I have another NAS that can do other RAID configs, which is fastest as far as write times?
RAID0 (Striped) is generally faster, as the I/O is spread across 2 disks.
RAID1 is mirrored, so you can not free the buffer until the same data is on BOTH disks. The disks are NOT going to be in rotational sync, so at least one of the disks will have to wait longer for the write sectors to move under the write heads.
But RAID1 gives you redundency. RAID0 has not redundency. And you can NOT switch back and forth between the 2 without reformatting your disks, so if you choose RAID0, you do not get redundency unless you provide your own via a backup device for your NAS.
• what is the most efficient transfer protocol? ftp? smb? something else? And am I better off invoking the protocol from the terminal, or is the overhead of an app-based client negligible?
Test the different transfers using a large file (100's of MB or a GB sized file would be good as a test file).
I've had good file transfers with AFP file sharing, but not knowing anything about your NAS, I do not know if it supports AFP, and if it does, whether it is a good implementation.
If your NAS supports ssh, then I would try scp instead of ftp. scp is like using cp only it works over the network.
If your NAS support rsync, that would be even better, as it has the ability to just copy files that are either NOT on the destination or update files which have changed, but leave the matching files alone.
This would help in situations where you cannot copy everything all at once.
But no matter what you choose, you should measure your performance so you choose something that is good enough.
• If a client is fine, does anyone have a suggestion as to best one for speed? Doesn't have to be free -- I don't mind supporting good software.
Again just test what you have.
• Whats a good number to allow for simultaneous connections, given the number of files and their size?
If the bottleneck is the NAS, then adding more I/O that will force the disk heads to move away from the current file being written will just slow things down.
But try 2 connections and measure your performance. If it gets better, then maybe the NAS is not the bottleneck.
• What question am I not asking?
You should try using another system as a test destination device in the network setup to see if it gets better, worse, or the same throughput as the NAS. You need to see about changing things in your setup to isolate where the problem might be.
Also do not rule out bad ethernet cables, so switch them out as well. For example, there was a time I tried to use Gigabit ethernet, but could only get 100BaseT. I even purchased a new gigabit switch, thinking the 1st was just not up to the task. It turned out I had a cheap ethernet cable that only had 4 wires instead of 8 and was not capable of gigabit speeds. An ethernet cable that has a broken wire or connector could exhibit similar performance issues.
So change anything and everything in your setup, one item at a time and use the same test so you have a pear to pear comparision.

Can Oracle 11g RAC and 10g RAC co-exists on same host

Can somebody tell me if it is possible to have Oracle 11g and 10g RAC installed and configured on same host.
Thanks,
-Zubair

user10948684 wrote:
Can somebody tell me if it is possible to have Oracle 11g and 10g RAC installed and configured on same host.
Thanks,
-ZubairYou have to use 11G Clusterware , if you want to use 11g Database and you can use 10g Database as well.
(You can not use 10g Clusterware and 11g Clusterware on the same host...)
But you can use 10g Database and 11g Database on the same host, But you have to use 11G Clusterware.

Running 9i RAC and 10g RAC on the same physical cluster

We are planning to run 9i RAC ( with OCFS2 ) and 10g RAC ( ASM ) on the same cluster with 4-Nodes.
I will really appreciate if any of the forum members can share the information and experiences if the have done such implementation. We are currently running six 9i R2 clusters and are in the process of migrating them. The current need is to make the 9i and 10g cluster co-exist up to a certain point.
Thank You,
Madhu

Yes this is possible.. you may want to check out some papers relating to this on OTN and on the RAC SIG website at www.oracleracsig.org.

Differance between Oracle 9i RAC and 10g RAC

Hello,
I am almost new to RAC. I have worked on Oracle 9i RAC since longtime back. Now I am trying to find what is difference between Oracle 9i and 10g RAC structure ? Before it was CM and now it's clusterware. But what it makes different ? Any good explanation or web link.
thanks
~Keyur
null

The main difference is 10g RAC is almost completely platform independent, and 9i RAC isn't.
This means it has changed tremendously.
As 9i is desupported I wouldn't spend any time in 9i RAC if you have yet to learn it.
Sybrand Bakker
Senior Oracle DBA

How to tell if my netbook has gigabit Ethernet (and/or can use it)

I have owned an Asus Eee 701SD (the 8GB version) since 2009, and installed Arch on it last summer (a great move :-) ).
The other day, I came across a page on the FreeBSD wiki, which suggested that certain 700-series Eee's have a gigabit Ethernet interface (rather than the usual 10/100). Through checking 'hardinfo' and 'sudo lshw -c network', it appears that my machine might have a gigabit interface, but I'm not sure. This is the output from lshw:
*-network
description: Ethernet interface
product: AR8121/AR8113/AR8114 Gigabit or Fast Ethernet
vendor: Atheros Communications
physical id: 0
bus info: pci@0000:03:00.0
logical name: eth0
version: b0
serial: 00:24:8c:3f:3a:ba
capacity: 100Mbit/s
width: 64 bits
clock: 33MHz
capabilities: pm msi pciexpress vpd bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd autonegotiation
configuration: autonegotiation=on broadcast=yes driver=ATL1E driverversion=1.0.0.7-NAPI firmware=L1e latency=0 link=no multicast=yes port=twisted pair
resources: irq:44 memory:fbfc0000-fbffffff ioport:ec00(size=128)
This is a bit confusing - the "capacity" heading above indicates the Ethernet is 10/100, but the Atheros Ethernet interface is given as "AR8121/AR8113/AR8114 Gigabit or Fast Ethernet" (confirmed by 'lspci'), which I guess means it can act as either gigabit or 10/100.
Assuming that all this means I do have a gigabit Ethernet port on my netbook: will the Arch system make automatic use of the extra speed, or do I need to issue any commands, change any settings, recompile the kernel, etc.?
Many thanks :-)
Tim

If it were a Gigabit NIC, it would simply be "AR8121/AR8113/AR8114 Gigabit"
Seriously, if the driver is working properly, 100Mbit/s is what you have got. You can check again with
ethtool eth0
which lists the supported device speeds.
Last edited by lolilolicon (2012-01-12 11:21:30)

Occasional ora-6502 using forms 6i and 10g

Hi all.
We have been experiencing some weird and unexpected ora-6502 errors in some of our forms 6i modules running against 10g (rel 1 or 2).
Forms modules are correctly functioning and for some reason, one day an ora-6502 error suddenly pops up.
Now the weirdest thing is that after you put some messages on the trigger, so you can track down where the error is coming from, it disappears.
I know that this may sound hard to believe, but it has happened several times. All we do is put some message built in, recompile all, and the error is gone (for a while).
So my questions are:
- Is this a known issue beween forms 6i and 10g Db?.
- Is there a patch on Metalink ( we use Forms [32 bits] Versión 6.0.8.26.0 (Producción))
- A workaround?
and most important
- Have anyone been exposed to a similar situation?
Regards, Luis ...!

Now the weirdest thing is that after you put some messages on the trigger, so you can track down where the error is coming from, it disappears.Sounds like the form has not been "clean compiled" against the server on which it is running. Try a "Compile All", which causes all previously compiled program units to be compiled fresh.
Or even better, clean out all the compiled code from your fmb before compiling the fmb on the server where it runs.
See this topic: Re: Why does this happen - find ';', replace with ';'?

Difference between oracle 9i Rac and 10g Rac

Friends -
Could you please list out what are the main differences between oracle 9i Rac and oracle 10g Rac
Appreciate your support on this
Regards
satish

hi
check the new features document of 10g RAC
http://download.oracle.com/docs/cd/B19306_01/rac.102/b14197/whatsnew.htm#sthref6
HTH

How to configure use of Ethernet and wireless simultaneously, with different Windows´s?

Hello friends,
My network has two Win XP-laptops connected via ethernet to a Dovado-router, and from the Dovado-router another ethernet cable to a Win 7 PC.
The Win 7 PC connects to the internet via a D-Link wireless network to my ISP wireless router Huawei E589.
Problem: the PC refuses to work with both ethernet and wireless at the same time.
I use the ethernet for tranferring vast amounts of graphical data (astronomy photographs at 3-4 GB each), and I can only access the internet through the wireless. Neither XP nor 7 wizards are able to fix it. Both networks were visable in Network Center,
now only the wireless is available. Ethernet is gone.
What do I do, to make it work?

Hi,
What's your purpose? My understanding is that you want Windows 7 PC wireless use internet and wired use Lan. If I am misunderstand please point me fault.
For the situation you can do like this:
1) Setting for your both routers.
Make sure both routers have different Router IP's and SUBNETS, you should try to set the subnet of Dovado-router to 255.255.255.252(this router should be used as local Lan, not connect to internet).
Set the subnet of D-link to 255.255.255.0
2) Setting For the LAN adapter.
Under the TCP/IP properties(Lan adapter), please assign a unique IP address (which coincides with the subnet of Dovado-router ), set the subnet to 255.255.255.252 (or whatever you set it to Dovado-router). The very important things is that
don't assign any GATEWAY to Lan adapter, leave it blank.
3) Setting For the WIRELESS adapter.
Under TCP/IP properties(wireless adapter), please assign a unique IP address (that coincides with the wireless router), set the subnet to 255.255.255.0 (or whatever the default is for the wireless router), and make sure to type gateway IP address ( D-link
IP address).
Now you can test if they are work normally.
Hope this helps.
Regards.
Spencer
TechNet Community Support

Can I use thunderbolt Ethernet and VGA?

Is it possible to simultaneously connect a thunderbort ethernet and VGA adapter?
I'm fairly certain there is no hub available for Thunderbolt, but I'm not sure if there is perhaps an Ethernet or VGA dongle with a second port on it to daisy chain.
I am aware of the USB Ethernet dongle Apple sells but it would be nice to have an option that doesn't eat up the scarce USB ports.

Indeed, there are 'hubs' for Thunderbolt available.
One example that gives you Ethernet, Firewire, Thunderbolt and more: http://www.belkin.com/us/p/P-F4U055

No list tree of device and interface, software in MAX sytem. using pci 6034E and chasis 2345

Hye, i got the problem about this device.
I using PCI 6034 E which will connect to SCC 2345 to measure current and voltage.
My os is 32 bit Windows XP.
First i install this software, my MAX listed the tree of devices & interface which is PCI 6034 E and chasis 2345, and all download software are listed in tree of software.
By the way, when i start to measure the current, my MAX is working fine.. but, the problem is starting in the next day, wheni try to measure againt, all the list are dissapear. Then i uninstall all the NI component and reinstall again. Thereare a lot of install and reinstall again and again.. By the way the result is still same. Do not have any tree appear..
so, any colution for my problem?
i try to solve this problem, and i read that when the tree of devices and interfaces not appear, it's maybe because we using driver : NI 488.2 , i try to uninstall this driver.. by the way the result is still same...

sahizansalman,
It looks like the same is happening with the Software list. This is often a sign of a MAX database corruption. I'd try the steps outlined in this knowledgebase:
What is the Process For Removing MAX Database Corruption?
Feel free to post back if this does not work.
By the way, do you know what device is showing up as unknown in the device manager? You did not mention anything besides your PCI DAQ card and SCC 2345, which are showing up fine.
Message Edited by mishkin on 03-11-2010 07:42 AM
Misha

Document on 10g RAC setup on solaris using vmware

Hi All,
I am planning to setup "Oracle 10g RAC setup on Solaris using vmware", but I am strucked up at installation of Soaris 10 in VMWare.
Can any body please help/provide me the document on Solaris 10 installation for RAC setup .
The main problems I am having during the SOlaris 10 setup is
1) Setting up the static public and private addresses required for RAC
2) Partitioning the disk space.
Thanks in advance,
Mahipal Reddy

Refer these,
http://www.scribd.com/doc/15650880/Install-Rac-on-Solaris-Vmware
http://www.disperu.com/using-vmware-server-install-10g-rac-on-solaris/
http://nayyares.blogspot.com/2008/11/step-by-step-rac-10g-r2-solaris-10.html
Thanks
Edited by: Cj on Dec 13, 2010 2:38 AM

How to use oracle servcies in roacle 10g rac

hi all,
I want to know how to use SERVICES in oracle 10g rac.I know how to create servcies i.e using srvctl create servcies or DBMS_SERVICES.
I know servcies can be used with JOBS using DBMS_SCHEDULER but i wat ot know besides jobs what are all the things we can used with services.

Yeah.That's right.
But in my case mwe are having a ERP applicaiton that has been build on oracle forms, so here we are having aeprate forms.Lets suppose that one form name is MEMBER.
and i have also created on servcie using
srvctl add service -d DB -s MEM -r RAC1,RAC2 -a RAC3
now my question how do i integrate this MEMBER form to services i.e MEM.
Like we can use in case oj create scheduling jobs using dbms_scheduler, we are having one prameter job_class where er have to specify the name of the parameter
but in my case how do i integrate it.
I hope you understandb my question.

Dell Venue Pro 11 w/Dock / Unable to concurrently use ethernet and wifi?

Does anyone know why you are unable to use the dock ethernet connection and the tablet's wifi connection at the same time?
I assume this is a limitation of the dock / tablet because if you hook a laptop up you can use the ethernet and wifi at the same time because they have different MAC addresses.
Thanks for any assistance you can provide....

Does anyone know why you are unable to use the dock ethernet connection and the tablet's wifi connection at the same time?
I assume this is a limitation of the dock / tablet because if you hook a laptop up you can use the ethernet and wifi at the same time because they have different MAC addresses.
Thanks for any assistance you can provide....

How Do I Network Multiple Base Stations Using Ethernet AND Wireless?

Hi, everyone. I am having great difficulty setting up a network using multiple Airport Extreme base stations that are connected using both ethernet and wireless connections. I have one main base station connected to a cable modem, and I want to create a unified network and share its internet connection with three other base stations: one that is connected on an ethernet network, one connected to it wirelessly, and the fourth that would be connected wirelessly to the base station on the ethernet network.
The "Designing Airport Networks" manual explains how to build roaming networks of base stations that are connected to one another via ethernet. And it also explains how to build a WDS of wirelessly connected base stations. What it doesn't explain is how to build a network employing both ethernet AND wireless!
I spent most of today trying to get the base stations to work in various configurations to no avail. I could get part of the network working, but not all of it. I'm at the point where I'm going to need to do a hard, factory reset on all the base stations and start over, but I wanted to see if anyone had any suggestions for me. Any help would be incredibly appreciated! Thanks so much...
Message was edited by: Bill Ryan2

If you have stations connected via Ethernet and want them to appear as a single seamless wireless network, configure them as follows:
Same SSID (network name).
Different channels. As far apart as possible.
Same wireless encryption type/level/password.
Only the base station connected to the Internet source distributes IP addresses. All the others are configured as bridges.
If you have stations connected wirelessly using WDS and want them to appear as a single seamless wireless network, configure them as follows:
Same SSID (network name).
Same channel.
Same wireless encryption type/level/password.
It appears that you want to mix the 2 type of connections. This is easily done and here is a simple example:
base1 Ethernet base2
In this example base1 and base 2 are configured as I suggested above for Ethernet connections.
Now add base3 connected wirelessly:
base1 Ethernet base2 wireless base3
Now base2's configuration must be modified slightly so that it acts as a WDS main. base3 is configured to act as a WDS remote (or relay).
No changes are needed to base1 since it is completely unaware and uninvolved in the WDS link between base2 and base3.

Max nodes using Gigabit ethernet and 10G RAC

Similar Messages

Maybe you are looking for