Multiple NICs one subnet

Oct 22, 2009
92
1
26
Hi,

I have a bunch of NICs in my server and want to distribute the VMs to different NICs. However all the VMs are on the same subnet and it seems to give me some trouble when routing.
The general subnet is 255.255.224.0. If I add a machine to vmbr1 with e.g. 192.168.31.230 I am not able to ping either to/from the machine. Any one done a similar setup? Is it required to enter an IP for each vmbrX?

My configuration is the following:
Code:
# network interface settings
auto lo
iface lo inet loopback

iface eth0 inet manual

iface eth1 inet manual

iface eth2 inet manual

iface eth3 inet manual

iface eth4 inet manual

iface eth5 inet manual

auto eth6
iface eth6 inet static
        address  172.16.31.12
        netmask  255.255.255.0

auto eth7
iface eth7 inet static
        address  172.16.32.12
        netmask  255.255.255.0

auto bond0
iface bond0 inet manual
        slaves eth0 eth1
        bond_miimon 100
        bond_mode balance-xor

auto bond1
iface bond1 inet manual
        slaves eth2 eth3
        bond_miimon 100
        bond_mode balance-xor

auto bond2
iface bond2 inet manual
        slaves eth4 eth5
        bond_miimon 100
        bond_mode balance-xor


auto vmbr0
iface vmbr0 inet static
        address  192.168.31.12
        netmask  255.255.224.0
        gateway  192.168.0.254
        bridge_ports bond0
        bridge_stp off
        bridge_fd 0

auto vmbr1
iface vmbr1 inet manual
        bridge_ports bond1
        bridge_stp off
        bridge_fd 0

auto vmbr1
iface vmbr1 inet manual
        bridge_ports bond1
        bridge_stp off
        bridge_fd 0

auto vmbr2
iface vmbr2 inet manual
        bridge_ports bond2
        bridge_stp off
        bridge_fd 0

Best regards,
Bo
 
I'm not expert on this (never used bounding), but I've noticed the vmbr1 "section" is listed twice. A copy & paste error, or is listed twice in network/interfaces? Could it have some negative effect?
 
Did you try to remove ip address on eth6,7 interfaces ?

Code:
# network interface settings
auto lo
iface lo inet loopback

iface eth0 inet manual

iface eth1 inet manual

iface eth2 inet manual

iface eth3 inet manual

iface eth4 inet manual

iface eth5 inet manual

[COLOR="red"]iface eth6 inet manual

iface eth7 inet manual[/COLOR]

auto bond0
iface bond0 inet manual
        slaves eth0 eth1
        bond_miimon 100
        bond_mode balance-xor

auto bond1
iface bond1 inet manual
        slaves eth2 eth3
        bond_miimon 100
        bond_mode balance-xor

auto bond2
iface bond2 inet manual
        slaves eth4 eth5
        bond_miimon 100
        bond_mode balance-xor


auto vmbr0
iface vmbr0 inet static
        address  192.168.31.12
        netmask  255.255.224.0
        gateway  192.168.0.254
        bridge_ports bond0
        bridge_stp off
        bridge_fd 0

auto vmbr1
iface vmbr1 inet manual
        bridge_ports bond1
        bridge_stp off
        bridge_fd 0

auto vmbr2
iface vmbr2 inet manual
        bridge_ports bond2
        bridge_stp off
        bridge_fd 0

Post output of route -n from pve.
 
Output from route -n:
Code:
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
172.16.32.0     0.0.0.0         255.255.255.0   U     0      0        0 eth7
172.16.31.0     0.0.0.0         255.255.255.0   U     0      0        0 eth6
192.168.0.0     0.0.0.0         255.255.224.0   U     0      0        0 vmbr0
0.0.0.0         192.168.0.254   0.0.0.0         UG    0      0        0 vmbr0

I have a machine running using vmbr1. I understand I need a route for vmbr1. The question is maybe rather if I have to make in manually or I can use the web GUI of proxmox in this case?

Eth6/7 is reserved for DRBD and setup using the webinterface.