[SOLVED] Second bond and VMBR on two physical server ports

[mervin]

Hi there,

We are currently running Proxmox VE 6.2-4 on Dell PowerEdge R640 machines.
The servers each have two NICs installed, the network cables are divided across two switches in a datacenter.
At the moment we are using a total of four physical NIC ports per server (divided across the two NICs).
The network configuration is bonding (active-backup) and on top of that two VMBRs.
Now I'm trying to accomplish the following, we have added two more cables per server also divided across the two NICs and switches,
the switch port is configured to use a VLAN with two different network segments. Now I would like to create two bonds across the
two NICs and on top of that two VMBRs. I'm thinking of something like (shortened):

auto bond1
iface bond1 inet manual

auto bond1:0
iface bond1:0 inet manual

auto vmbr1
iface vmbr1 inet static
        address MYADDRESSRANGE
        bridge-ports bond1
        bridge-stp off
        bridge-fd 0

auto vmbr2
iface vmbr2 inet static
        address MYADDRESSRANGE
        bridge-ports bond1:0
        bridge-stp off
        bridge-fd 0

Is such a configuration possible, I have tried it on my testenvironment, it seems to work but I would like to know if this is the recommended way, or is there a better alternative perhaps? I'm editing the interfaces file manually b.t.w.

Thank you in advance!

 

[spirit]

you can't plug 1 interface in 2 differents bridge.

if you need vlans, you can simply use vlan tag in vm nic options + bridge= vmbr1

with

auto bond1
iface bond1 inet manual
    .....

auto vmbr1
iface vmbr1 inet static
        address MYADDRESSRANGE
        bridge-ports bond1
        bridge-stp off
        bridge-fd 0

if you don't want to use vlan tag on vm nic, you can do something like

auto bond1
iface bond1 inet manual
      ....

auto vmbr1
iface vmbr1 inet static
        address MYADDRESSRANGE
        bridge-ports bond1
        bridge-stp off
        bridge-fd 0

#vlan10
auto vmbr1v10
iface vmbr1 inet manual
        bridge-ports bond1.10
        bridge-stp off
        bridge-fd 0

#vlan 20
auto vmbr1v20
iface vmbr1 inet manual
        bridge-ports bond1.20
        bridge-stp off
        bridge-fd 0

 

[mervin]

@spirit
Thank you for the answer!
We do not necessarily need VLANs on the Proxmox level because we have created VLANs on the switch already.
Just to clarify this a bit more,
VLAN id 1025 (on the Cisco switch) is capable of routing two subnets:
192.168.20.0/24 and 192.168.30.0/24

What we would like to accomplish is to create a new bond over the two NIC ports.
On top of this bond we would like to create two VMBRs. one for 192.168.20.0 and the other for 192.168.30.0

Do you mean that we can accomplish this by using VLANs on the Proxmox host?
Or is it not possible at all?

Thanks again.

 

[spirit]

you don't need to define subnets/ips on vmbr .
(ips on vmbrX are only to define ip management for proxmox node)

Simply use 1 vmbr1, and configure different ips in differents subnets in your vms.

 

[mervin]

@spirit
Thanks! I will try this a.s.ap.
One note, we are using containers but I don't think that will make any difference, right?

 

[mervin]

@spirit Thank you very much for pointing me in the right direction.
I have tested it and it works as you mentioned!

For anyone that reads this in the future, I have managed to get the two subnets going
by creating a new bond and vmbr on top of two physical network ports. I can then add the new vmbr to the container twice
and add a 192.168.20.N and 192.168.30.N address!