Using a SDN VNET with a VLAN already present on Proxmox

[EnhancedC]

On my nodes i have this

enp0s31f6 -> vmbr0 -> vmbr0.16 Proxmox Management network
vmbr0.1000 Cluster network
SDN -> lzone

Network is a VLAN SDN zone

i have working VNET on lzone
e.g.

lnet10 - VLAN 10
lnet20 - VLAN 20

Attached to this zone, which is able to communicate with devices across the network including physical devices.

However when creating lnet16 - VLAN 16, that node that it gets applied to is no longer reachable on the Management network, luckily i can still access it from the Cluster network and undo the changes.

I assume when is creates the lnet16 interface, it would need to create vmbr0.16, and therefore overwrite my own vmbr0.16 config.

Does anyone know how i can get this to work?

# network interface settings; autogenerated
# Please do NOT modify this file directly, unless you know what
# you're doing.
#
# If you want to manage parts of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT read its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!

auto lo
iface lo inet loopback

iface enp0s31f6 inet manual
    mtu 9000
#Root

auto vmbr0
iface vmbr0 inet manual
    bridge-ports enp0s31f6
    bridge-stp off
    bridge-fd 0
    bridge-vlan-aware yes
    bridge-vids 2-4094
    mtu 9000

iface wlp4s0 inet manual

auto vmbr0.1000
iface vmbr0.1000 inet static
    address 10.12.0.15/24
    mtu 9000
#Storage Net

auto vmbr0.17
iface vmbr0.17 inet static
    address 10.11.0.15/22
    mtu 9000
#Ceph Public

auto vmbr16
iface vmbr16 inet static
    address 10.10.0.15/22
    gateway 10.10.0.1
    bridge-ports vmbr0.16
    bridge-stp off
    bridge-fd 0
    mtu 9000

source /etc/network/interfaces.d/*

#version:19

auto lnet10
iface lnet10
    bridge_ports vmbr0.10
    bridge_stp off
    bridge_fd 0
    mtu 9000

auto lnet16
iface lnet16
    bridge_ports vmbr0.16
    bridge_stp off
    bridge_fd 0
    mtu 9000

auto lnet20
iface lnet20
    bridge_ports vmbr0.20
    bridge_stp off
    bridge_fd 0
    mtu 9000

 

[Carko]

Had the same issue today. Looks like the solution is to set the IP on the VNet interface instead and remove the vmbr16 interface

so in /etc/network/interfaces add:

iface lnet16 inet static
address 10.10.0.15/22
gateway 10.10.0.1

There's no option in the GUI (yet?)

 

[mvern]

This worked for me - thank you very much for posting it.
Can't say I fully understand why it works, but it works!

 

[Cyberndj]

Ran into the same issue...created vlan interfaces on the Host. Received error message (below) when trying to create a "vlan zone" with a VNET with a tag of 172.

1. Removed interface "vlan172" through the GUI and applied configuration
2. Redeployed the SDN with a VNET tagged of 172.
3. Edited the configuration at '/etc/network/interfaces.d/sdn' by applying the address info to the named interface ("REPL" in my case).
4. Ran 'systemctl restart networking'
5. Verified connectivity from a different node on the same VLAN.
6. Created 2nd VNET with different VLAN tagging (20) and applied configuration
7. Lost ping and saw that the address info was missing from the 'sdn' file.
8. Created named iface same as VNET name in '/etc/network/interfaces'
9. Ran 'systemctl restart networking'
10. Repeat steps 2,6,8-9 on each Node in the cluster.
11. Update the network settings on EVERY Container and VM with the new SDN network/bridge, removing the vlan tag, updating MTU (to 1 for VirtIO)
12. Ping tests succeeded on both VLANs and the named interfaces show up in the GUI.

I think that there two issues. 1) Unclear error messages. 2) Not being able to assign host interfaces to a VNET.
Hope we can get adding a host interfaces on a SDN VNET in the GUI added to the development list for the devs. (If its a request, kindly PM me the request process...)

Thanks!
-Jake

Error Message when trying to Apply SDN:

REPL : error: REPL: bridge port vmbr1.172 does not exist
REPL : warning: REPL: apply bridge ports settings: bridge configuration failed (missing ports)

TASK ERROR: command 'ifreload -a' failed: exit code 1