Network Configuration for Proxmox Cluster - OVS / RSTP

[oezay]

Hi everyone,

I'm experiencing issues with my network configuration in a Proxmox cluster, and I hope someone here can help identify what might be wrong.

Here's my setup:

• Cluster Details: 3 nodes connected via a dual-port 25Gb NIC in a point-to-point ring topology.
• WAN Connectivity: An additional 1Gb NIC on each node, connected to a switch for WAN access.
• Objective:
  • Create 3 OVS interfaces, each in its own VLAN.
  • Set up an OVS bridge on each node to connect VMs later.

I have configured the network as follows, but unfortunately, it’s not working as expected. Below is the configuration for one of the nodes:
Can anyone spot any issues with this setup? Or suggest why it might not be working as intended?
I would really appreciate any tips, advice, or insights you might have!
Thank you in advance!
best regards,
Oezay

auto lo
iface lo inet loopback

iface enp193s0f0np0 inet manual

iface enp193s0f1np1 inet manual

iface enxfed9a43d1dea inet manual

auto enp135s0f0np0
iface enp135s0f0np0 inet manual
ovs_type OVSPort
ovs_bridge vmbr1
ovs_mtu 9000
ovs_options other_config:rstp-enable=true other_config:rstp-path-cost=150 other_config:rstp-port-admin-edge=false other_config:rstp-port-auto-edge=false other_config:rstp-port-mcheck=true vlan_mode=native-untagged
#to PVE2

auto enp135s0f1np1
iface enp135s0f1np1 inet manual
ovs_type OVSPort
ovs_bridge vmbr1
ovs_mtu 9000
ovs_options other_config:rstp-enable=true other_config:rstp-path-cost=150 other_config:rstp-port-admin-edge=false other_config:rstp-port-auto-edge=false other_config:rstp-port-mcheck=true vlan_mode=native-untagged
#to PVE3

auto vlan100
iface vlan100 inet static
ovs_type OVSIntPort
ovs_bridge vmbr1
ovs_options tag=100
address 10.0.0.1/24
ovs_mtu 1500
#pve-cluster

auto vlan101
iface vlan101 inet static
ovs_type OVSIntPort
ovs_bridge vmbr1
ovs_options tag=101
address 10.1.0.1/24
ovs_mtu 9000
#ceph-cluster

auto vlan102
iface vlan102 inet static
ovs_type OVSIntPort
ovs_bridge vmbr1
ovs_options tag=102
address 10.2.0.1/24
ovs_mtu 9000
#ceph-Public

auto vmbr0
iface vmbr0 inet static
address x.x.x.x/26
gateway x.x.x.x
bridge-ports enp193s0f0np0
bridge-stp off
bridge-fd 0
#wan

auto vmbr1
iface vmbr1 inet static
ovs_type OVSBridge
ovs_ports enp135s0f0np0 enp135s0f1np1 vlan100 vlan101 vlan102
ovs_mtu 9000
up ovs-vsctl set Bridge ${IFACE} rstp_enable=true other_config:rstp-priority=32768 other_config:rstp-forward-delay=4 other_config:rstp-max-age=6
post-up sleep 10
#ovs-bridge

source /etc/network/interfaces.d/*

 

[oezay]

I’d also like to add that when I delete the OVS interfaces and assign an IP directly to the bridge, it works. However, this is not the setup I want to achieve.