How to configure Oracle VM(Xen) bridge networking?

Question

Hi,
I have installed Oracle VM (Xen) and within it 2 VM Templates: One for Oracle 11g DB and the other with Siebel App. RHEL5.3 x86
The problem is that I cannot get the xen network bridge to work properly and get no ping to the gateway or any other ip from the VM's.
arping to and from the vm's to the hosting xen works ok.
i have configured the vm.cfg to have : vif = ['type=netfront,bridge=xenbr0',] is this correct?
Can you please help?
Thanks,
Liron
On the VM(Siebel App) for example:
/etc/sysconfig/network-scripts/*ifcfg-eth0* seem ok.
I had eth1 in my ifconfig right after I added ['bridge=xenb0'] but somehow I am now getting 'Device not present'
though I am not sure this is the issue.
'#route -n' shows a strange routing Destination 169.254.0.0 Gateway 0.0.0.0 Genmask 255.255.0.0 Interface eth0
#arping -b -c 1 -I eth0 10.2.0.254 (The gw) returns empty
On Domain--0 (Xen)
===============================================
# brctl show
bridge name bridge id STP enabled interfaces
xenbr0 8000.0050568b3ae4 no vif3.0
eth0
======================================
*# ./network-bridge status*
============================================================
6: vif3.0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 32
link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff
3: xenbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
link/ether 00:50:56:8b:3a:e4 brd ff:ff:ff:ff:ff:ff
inet 10.2.0.52/24 scope global xenbr0
bridge name bridge id STP enabled interfaces
xenbr0 8000.0050568b3ae4 no vif3.0
eth0
10.2.0.0/24 dev xenbr0 proto kernel scope link src 10.2.0.52
default via 10.2.0.254 dev xenbr0
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
10.2.0.0 0.0.0.0 255.255.255.0 U 0 0 0 xenbr0
0.0.0.0 10.2.0.254 0.0.0.0 UG 0 0 0 xenbr0
============================================================
============================================================
*# ifconfig*
eth0 Link encap:Ethernet HWaddr 00:50:56:8B:3A:E4
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:55619 errors:0 dropped:0 overruns:0 frame:0
TX packets:46176 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:4215814 (4.0 MiB) TX bytes:15245752 (14.5 MiB)
Interrupt:17 Base address:0x2000
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:119 errors:0 dropped:0 overruns:0 frame:0
TX packets:119 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:17330 (16.9 KiB) TX bytes:17330 (16.9 KiB)
vif3.0 Link encap:Ethernet HWaddr FE:FF:FF:FF:FF:FF
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:64 errors:0 dropped:0 overruns:0 frame:0
TX packets:4845 errors:0 dropped:349 overruns:0 carrier:0
collisions:0 txqueuelen:32
RX bytes:7756 (7.5 KiB) TX bytes:419686 (409.8 KiB)
xenbr0 Link encap:Ethernet HWaddr 00:50:56:8B:3A:E4
inet addr:10.2.0.52 Bcast:0.0.0.0 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:55831 errors:0 dropped:0 overruns:0 frame:0
TX packets:45880 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:3474452 (3.3 MiB) TX bytes:15199783 (14.4 MiB)
============================================================
# ip link
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 16436 qdisc noqueue
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
link/ether 00:50:56:8b:3a:e4 brd ff:ff:ff:ff:ff:ff
3: xenbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
link/ether 00:50:56:8b:3a:e4 brd ff:ff:ff:ff:ff:ff
6: vif3.0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 32
link/ether fe:ff:ff:ff:ff:ff brd ff:ff:ff:ff:ff:ff

Answer 1

Alternativ way to correct the gateway problem.:
Show the device that actually bears your IP
[root@bdk-esb-ovs11 ~]# ip route show dev 0a004300
default via 10.0.67.10
10.0.67.0/24  proto kernel  scope link  src 10.0.67.32
[root@bdk-esb-ovs11 ~]# cat /etc/resolv.conf
nameserver 10.0.67.10
[root@bdk-esb-ovs11 ~]# cat /etc/sysconfig/network
NETWORKING=yes
NETWORKING_IPV6=no
HOSTNAME=bdk-esb-ovs11
GATEWAY=10.0.67.10
Now correct the GATEWAY:
[root@bdk-esb-ovs11 ~]# cat /etc/sysconfig/network
NETWORKING=yes
NETWORKING_IPV6=no
HOSTNAME=bdk-esb-ovs11
GATEWAY=10.0.67.1
The network needs restart now, to get the right gateway.
BEWARE , Do get downtime to restart the network on OVS.
Alternatively migrate your machine to another OVS .
# service network restart
My VM on the OVS server survived a service network restart on its host OVS, but missed 18 pings..
Regards Martin Rønde Andersen
[root@bdk-esb-ovs11 ~]# service network restart
Shutting down interface 0a004300:                          [  OK  ]
Shutting down interface 10267f5e63:                        [  OK  ]
Shutting down interface 106e32ed71:                        [  OK  ]
Shutting down interface 10c3aeca96:                        [  OK  ]
Shutting down interface bond0.103:  Removed VLAN -:bond0.103:-
                                                           [  OK  ]
Shutting down interface bond0.104:  Removed VLAN -:bond0.104:-
                                                           [  OK  ]
Shutting down interface bond0.253:  Removed VLAN -:bond0.253:-
                                                           [  OK  ]
Shutting down interface bond0.254:  Removed VLAN -:bond0.254:-
                                                           [  OK  ]
Shutting down interface bond0.255:  Removed VLAN -:bond0.255:-
                                                           [  OK  ]
Shutting down interface bond0:                             [  OK  ]
Shutting down loopback interface:                          [  OK  ]
Bringing up loopback interface:                            [  OK  ]
Bringing up interface bond0:                               [  OK  ]
Bringing up interface bond0.103:  Added VLAN with VID == 103 to IF -:bond0:-
                                                           [  OK  ]
Bringing up interface bond0.104:  Added VLAN with VID == 104 to IF -:bond0:-
                                                           [  OK  ]
Bringing up interface bond0.253:  Added VLAN with VID == 253 to IF -:bond0:-
                                                           [  OK  ]
Bringing up interface bond0.254:  Added VLAN with VID == 254 to IF -:bond0:-
                                                           [  OK  ]
Bringing up interface bond0.255:  Added VLAN with VID == 255 to IF -:bond0:-
                                                           [  OK  ]
Bringing up interface 0a004300:                            [  OK  ]
Bringing up interface 10267f5e63:                          [  OK  ]
Bringing up interface 106e32ed71:                          [  OK  ]
Bringing up interface 10c3aeca96:                          [  OK  ]
[root@bdk-esb-ovs11 ~]# route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
default         10.0.67.1       0.0.0.0         UG    0      0        0 0a004300
10.0.67.0       *               255.255.255.0   U     0      0        0 0a004300
169.254.0.0     *               255.255.0.0     U     0      0        0 10c3aeca96