Issue with Multiple Nics/ IP aliases under VE 3.x

ucman

New Member
Jul 9, 2014
3
0
1
We've been using the following network configuration on our hardware nodes for several years without any issues under VE 2.2 and 2.3. We've just started building some new nodes with VE 3.x and have run into problems. Essentially the aliased interfaces are created but do not have any associated IP addresses. Manually creating interfaces and ip's work correctly as it always has on ipv4. I'm looking for answers as to why the old configuration no longer works and how to reestablish it under VE 3.x.

Working 2.2/2.3 network config:

Code:
# more /etc/network/interfaces 
auto lo
iface lo inet loopback

auto vmbr0
iface vmbr0 inet static
        address xxx.yyy.zzz.218
        netmask 255.255.255.224
        gateway xxx.yyy.zzz.193
        broadcast xxx.yyy.zzz.223
        network xxx.yyy.zzz.0
        bridge_ports eth0
        bridge_stp off
        bridge_fd 0

auto vmbr0:0
iface vmbr0:0 inet static
        address 192.168.0.218
        netmask 255.255.255.0
        broadcast 192.168.0.255
        network 192.168.0.0
        bridge_ports eth0:0
        bridge_stp off
        bridge_fd 0

auto vmbr1
iface vmbr1 inet static
        address 10.0.0.218
        netmask 255.255.255.0
        broadcast 10.255.255.255
        network 10.0.0.0
        bridge_ports eth1
        bridge_stp off
        bridge_fd 0

auto vmbr1:0
iface vmbr1:0 inet static
        address 10.0.10.218
        netmask 255.255.255.0
        broadcast 10.0.10.255
        network 10.0.10.0
        bridge_ports eth1:0
        bridge_stp off
        bridge_fd 0

auto vmbr1:1
iface vmbr1:1 inet static
        address 10.0.2.218
        netmask 255.255.255.0
        broadcast 10.0.2.255
        network 10.0.2.0
        bridge_ports eth1:1
        bridge_stp off
        bridge_fd 0

Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
xxx.yyy.zzz.192 *               255.255.255.224 U     0      0        0 vmbr0
10.0.0.0        *               255.255.255.0   U     0      0        0 vmbr1
10.0.2.0        *               255.255.255.0   U     0      0        0 vmbr1
192.168.0.0     *               255.255.255.0   U     0      0        0 vmbr0
10.0.10.0       *               255.255.255.0   U     0      0        0 vmbr1
default         xxx.yyy.zzz.193 0.0.0.0         UG    0      0        0 vmbr0


Changing the IP address and deploying on a VE 3.x node results in the following:
(ipv6 addresses purposefully removed)


Code:
eth0      Link encap:Ethernet  HWaddr  
          inet6 addr: Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2347 errors:0 dropped:0 overruns:0 frame:0
          TX packets:119 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:258936 (252.8 KiB)  TX bytes:13476 (13.1 KiB)

eth1      Link encap:Ethernet  HWaddr   
          inet6 addr:  Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1523 errors:0 dropped:0 overruns:0 frame:0
          TX packets:14 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:670288 (654.5 KiB)  TX bytes:1020 (1020.0 B)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

venet0    Link encap:UNSPEC  HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00  
          inet6 addr: fe80::1/128 Scope:Link
          UP BROADCAST POINTOPOINT RUNNING NOARP  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:3 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

vmbr0     Link encap:Ethernet  HWaddr  
          inet addr:xxx.yyy.zzz.219  Bcast:xxx.yyy.zzz.223  Mask:255.255.255.224
          inet6 addr:Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:2197 errors:0 dropped:0 overruns:0 frame:0
          TX packets:111 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:204560 (199.7 KiB)  TX bytes:12924 (12.6 KiB)

vmbr0:0   Link encap:Ethernet  HWaddr  
          inet6 addr: Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:468 (468.0 B)

vmbr1     Link encap:Ethernet  HWaddr 
          inet addr:10.0.0.219  Bcast:10.255.255.255  Mask:255.255.255.0
          inet6 addr:  Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:615 errors:0 dropped:0 overruns:0 frame:0
          TX packets:7 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:28874 (28.1 KiB)  TX bytes:578 (578.0 B)

vmbr1:0   Link encap:Ethernet  
          inet6 addr:  Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:468 (468.0 B)

vmbr1:1   Link encap:Ethernet  HWaddr 
          inet6 addr: Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:468 (468.0 B)

Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
xxx.yyy.zzz.192 *               255.255.255.224 U     0      0        0 vmbr0
10.0.0.0        *               255.255.255.0   U     0      0        0 vmbr1
10.0.2.0        *               255.255.255.0   U     0      0        0 vmbr1:1
192.168.0.0     *               255.255.255.0   U     0      0        0 vmbr0:0
10.0.10.0       *               255.255.255.0   U     0      0        0 vmbr1:0
default         xxx.yyy.zzz.193 0.0.0.0         UG    0      0        0 vmbr0
 
My apologies. I moved it since the original was in the wrong category. This issue pertains to VE 3.x NOT VE 1.x. If it were possible to delete or recategorize the first I would have.
 
Resolved this myself. It appears the bridge control features are very different now.

Changing;

Code:
auto vmbr0:0
iface vmbr0:0 inet static
        address 192.168.0.218
        netmask 255.255.255.0
        broadcast 192.168.0.255
        network 192.168.0.0
        bridge_ports eth0:0
        bridge_stp off
        bridge_fd 0

To:

auto vmbr0:0
iface vmbr0:0 inet static
        address 192.168.0.218
        netmask 255.255.255.0
        broadcast 192.168.0.255

Resolved all issues with the networking and allowed our config to work properly.