[Pve 6.0.6] Vlans not working on one node

[Dariusz Bilewicz]

Hi,

I have Pve 6 cluster on two nodes. Both have same network configuration and one of those nodes have vlan issue. it looks like that bond0 interface is not aware about tagged vlans configured on vmbr0 attached to this bond.

Here is network configuration from a working node:

auto lo
iface lo inet loopback

iface eno1 inet manual

iface eno2 inet manual

iface ens6f0 inet manual

iface ens6f1 inet manual

auto bond0
iface bond0 inet manual
bond-slaves ens6f0 ens6f1
bond-miimon 100
bond-mode 802.3ad

auto vmbr0
iface vmbr0 inet static
address 10.27.0.62
netmask 24
gateway 10.27.0.1
bridge-ports bond0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
#Uplink

And here is configuration from bad node with vlans issue:

auto lo
iface lo inet loopback

iface ens6f0 inet manual

iface ens6f1 inet manual

auto bond0
iface bond0 inet manual
bond-slaves ens6f0 ens6f1
bond-miimon 100
bond-mode 802.3ad

auto vmbr0
iface vmbr0 inet static
address 10.27.0.63
netmask 24
gateway 10.27.0.1
bridge-ports bond0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

iface eno1 inet manual

iface eno2 inet manual


After execution of bridge vlan show on good node i see vlans 2-4096 on bond0 interface:

port vlan ids
bond0 1 PVID Egress Untagged
2
3
...
4093
4094

And on bad node i only see:

port vlan ids
bond0 1 PVID Egress Untagged

Does anyone have any idea how to solve it?

 

[Dariusz Bilewicz]

I'd want to add that it's not likely a network issu because after adding manualy vlan interface to bond0 i was managed to make connection.

 

[Dariusz Bilewicz]

I found a solution. I've disabled vlan-aware on bridge interface, rebooted server, enabled it again then rebooted it again. Now it's working.

 

[spirit]

if you enable/disable vlan aware, a networking service restart could fail to do change.

(you can give a try to ifupdown2 (#apt-install ifupdown2) , you can reload networking service live with it.

 

[Dariusz Bilewicz]

It wasn't problem just with restarting interface. I was restarting whole server many times before and it didn't work either.

 

[spirit]

do you have tried to add "auto xxx" to your physical interfaces ? could be a race or something at startup.