I am struggling with LACP and VLAN

[xybor]

Hello guys,

I recently decided to move my homelab ESXi 6.7 to ProxmoxVE. The basic Proxmox setup was pretty easy but now I am struggling with my network configuration.
I have two VLANs:
10, LAN
20, DMZ

My server has two network interfaces and both are connected with my Cisco SG250 switch. I am trying to create LACP with both adapters and a VLAN trunk with both VLANs included. The management IP of Proxmox will be in VLAN 10. I've tried different configurations I found in this forum but none worked for me and I'm pretty new into Proxmox and Linux network configurations like this.

Can someone help me with a good example?

Thanks.

 

[wolfgang]

Hi,

install ifupdown2 and edit the /etc/network/interfaces

auto lo
iface lo inet loopback

auto ens18
iface ens18 inet manual

auto ens19
iface ens19 inet manual

auto bond0
iface bond0 inet manual
    bond-slaves ens18 ens19
    bond-miimon 100
    bond-mode 802.3ad
    bond-xmit-hash-policy layer2+3

auto vmbr0
iface vmbr0 inet static
    address  192.168.0.32
    netmask  255.255.255.0
    gateway  192.168.0.1
    bridge-ports bond0
    bridge-stp off
    bridge-fd 0
    bridge-vlan-aware yes
    bridge-vids 2-4094
    bridge-pvid 10

 

[oz1cw7yymn]

I have a similar situation, but slightly more complicated.

I currently have two pve servers with 6 nics each. I have three networks: one 3 nic bond for ceph cluster activity, one 2 nic bond for normal operations and the last nic for pve cluster activity.

I would like to configure my machines to have one bond with all six nics and put three vlans on top. I currently do not have any vlan separation in my network, the three networks are just in different subnets.
Questions:
1. is this possible? a good approach?
2. if so, is there a way to achieve this in steps, i.e. convert one machine at a time, or would it be easier to do both at the same time?
3. the guests would mostly use just the normal operations vlan, should I keep that on vlan 0?
4. do need to do anything on the switch(es) apart from enabling vlan trunk mode on the LAG?

Will possibly have more questions further on!

 

[xybor]

Hi,

install ifupdown2 and edit the /etc/network/interfaces

auto lo
iface lo inet loopback

auto ens18
iface ens18 inet manual

auto ens19
iface ens19 inet manual

auto bond0
iface bond0 inet manual
    bond-slaves ens18 ens19
    bond-miimon 100
    bond-mode 802.3ad
    bond-xmit-hash-policy layer2+3

auto vmbr0
iface vmbr0 inet static
    address  192.168.0.32
    netmask  255.255.255.0
    gateway  192.168.0.1
    bridge-ports bond0
    bridge-stp off
    bridge-fd 0
    bridge-vlan-aware yes
    bridge-vids 2-4094
    bridge-pvid 10

Hi,

Thanks a lot for your example. I tried this configuration but still having problems, may you have an idea what the problem could be.

Proxmox /etc/network/interfaces (ifupdown2 installed):

auto lo
iface lo inet loopback

auto eno1
iface eno1 inet manual

auto enx00249b2890c9
iface enx00249b2890c9 inet manual

auto bond0
iface bond0 inet manual
    bond-slaves eno1 enx00249b2890c9
    bond-miimon 100
    bond-mode 802.3ad
    bond-xmit-hash-policy layer2+3

auto vmbr0
iface vmbr0 inet static
    address  10.0.1.20
    netmask  255.255.255.0
    gateway  10.0.1.1
    bridge-ports bond0
    bridge-stp off
    bridge-fd 0
    bridge-vlan-aware yes
    bridge-vids 2-4094
    bridge-pvid 10

Cisco SG250 config:

...
interface GigabitEthernet6
 flowcontrol on
 description SID-PVE01
 channel-group 1 mode auto
 switchport mode trunk
!
interface GigabitEthernet7
 flowcontrol on
 description SID-PVE01
 channel-group 1 mode auto
 switchport mode trunk
!
...
!
interface Port-Channel1
 flowcontrol on
 description SID-PVE01
 switchport mode trunk
...

 

[wolfgang]

Hi,

I would like to configure my machines to have one bond with all six nics and put three vlans on top.

This works but makes no sense. LACP works source/destination algorithm.
So the most application will not see any speed up and the cost for the LAG will enormously explode.
Also, many switches do not support this.

I would recommend you to make 3 bonds.

 

[wolfgang]

Thanks a lot for your example. I tried this configuration but still having problems, may you have an idea what the problem could be.

I guess the second nic.
This naming is mostly used by USB NICs.
Does the NIC support LACP?

 

[xybor]

I guess the second nic.
This naming is mostly used by USB NICs.
Does the NIC support LACP?

That's actually a very good question I never thought about. It seems that this USB NIC only supports tagged VLAN IEEE 802.1q (https://www.startech.com/ch/Netzwer...igabit-Ethernet-NIC-Netzwerkadapter~USB31000S).

In this case I will only use my built-in NIC with tagged VLAN. What is the important command to use the management IP within my VLAN 10 which will also be used by my VMs?

 

[wolfgang]

Do not missunderstud me.
There is no feature like IEEE 802.1q what a nic must support.
But the nic driver must correct implemented.
Like are the link states up and correct.