SDN configuration not generating on one cluster node

[JohanKarlsson]

Hello!
I'm currently trying out a SDN of the VXLAN type within one of my 6 node clusters.
The configuration file (/etc/network/interfaces.d/sdn) generates and gets applied perfectly on all nodes expect for one which leaves the following message:
"local sdn network configuration is not yet generated, please reload"

The VXLAN works perfectly on all other nodes except this one for some reason.
Here's the output of pveversion -v from the "faulty" node:
proxmox-ve: 7.3-1 (running kernel: 5.15.74-1-pve)
pve-manager: 7.3-4 (running version: 7.3-4/d69b70d4)
pve-kernel-5.15: 7.3-1
pve-kernel-helper: 7.3-1
pve-kernel-5.15.83-1-pve: 5.15.83-1
pve-kernel-5.15.74-1-pve: 5.15.74-1
ceph-fuse: 14.2.21-1
corosync: 3.1.7-pve1
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown: residual config
ifupdown2: 3.1.0-1+pmx3
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve2
libproxmox-acme-perl: 1.4.3
libproxmox-backup-qemu0: 1.3.1-1
libpve-access-control: 7.3-1
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.3-1
libpve-guest-common-perl: 4.2-3
libpve-http-server-perl: 4.1-5
libpve-network-perl: 0.7.2
libpve-storage-perl: 7.3-1
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.0-3
lxcfs: 4.0.12-pve1
novnc-pve: 1.3.0-3
proxmox-backup-client: 2.3.2-1
proxmox-backup-file-restore: 2.3.2-1
proxmox-mini-journalreader: 1.3-1
proxmox-offline-mirror-helper: 0.5.0-1
proxmox-widget-toolkit: 3.5.3
pve-cluster: 7.3-1
pve-container: 4.4-2
pve-docs: 7.3-1
pve-edk2-firmware: 3.20220526-1
pve-firewall: 4.2-7
pve-firmware: 3.6-2
pve-ha-manager: 3.5.1
pve-i18n: 2.8-1
pve-qemu-kvm: 7.1.0-4
pve-xtermjs: 4.16.0-1
qemu-server: 7.3-2
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.8.0~bpo11+2
vncterm: 1.7-1
zfsutils-linux: 2.1.7-pve2

Thanks in advance!

Regards,
Johan Karlsson

 

[sterzy]

Can you maybe post the network configuration on that node (/etc/network/interfaces)? And maybe also /etc/pve/sdn? Please use [code][/code] tags to preserve the formatting.

In case /etc/pve/sdn differs on the faulty node from the other nodes (it shouldn't, but just in case) maybe post both.

 

[JohanKarlsson]

Thank you for your answer!
Here's the contents of the /etc/network/interfaces file

source /etc/network/interfaces.d/*

auto lo
iface lo inet loopback

auto enp4s0
iface enp4s0 inet manual
        dns-nameservers 127.0.0.1

auto vmbr0
iface vmbr0 inet static
        address xx.xx.xx.xx/23
        gateway xx.xx.xx.xx
        bridge-ports enp4s0
        bridge-stp off
        bridge-fd 0

Which file in /etc/pve/sdn/ are you looking for? The subnets.cfg, vnets.cfg or zones.cfg?

 

[sterzy]

source /etc/network/interfaces.d/*

Have you tried moving that line to the end of the network configuration?

 

[JohanKarlsson]

Yes, I've tried it both at the top and at the end.
If i create the configuration manually in /etc/network/interfaces.d/sdn it works perfectly. PVE is just not creating & applying it for some reason.

 

[patrick7]

Same here.

 

[spirit]

Same here.

when you use the apply configuration on sdn panel, do you see the reload task launched for this specific node ?

if not:

The main apply task (from the node where you are loggue), is connecting through ssh to other other, to send the reload task.
you should try to verify if you are able to connect with ssh from this node to the other node


if the task is launched correctly:
-do you see any error in the task ?

if no error in the task:
an "/etc/network/interfaces.d/sdn" file should be generated

if you still have error in the gui, verify that you have
"source /etc/network/interfaces.d/*" in /etc/network/interfaces

 

[patrick7]

I've reinstalled the node to which push didn't work. SSH was working good to the nodename, but not to the IP (still had the old host key). After removing the host key for the IP from known_hosts, SDN seems to be working again.