SDN broken after setting Vnet tags to 1 and 2

[ZZer00]

I created 2 new Vnets and without thinking it through set the tags to 1 and 2.
Applied the config and lost connectivity to the box.

I have since gone back in and regained connectivity, but the SDN configuration on that node is now stuck at pending and "local sdn configuration is too old, please reload".
Reloading doesn't work, and rebooting doesn't change anything.

Config files in /etc/pve/sdn/ are the same on both nodes

 

[ZZer00]

OK, I managed to fix it, so I'll leave this here for anyone else.

For some reason ssh from node 1 to node 2 was broken
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

I have no idea how that happended, but it definitely broke the SDN sync.
I reset the certs on both nodes and things are working again

pvecm updatecerts -F

systemctl restart pvedaemon pveproxy

 

[shanreich]

Reloading doesn't work, and rebooting doesn't change anything.

What's the output of the reload task? In particular 'SRV networking - Reload'

 

[ZZer00]

What's the output of the reload task? In particular 'SRV networking - Reload'

It would only try to reload on the node that was working. No messages at all for the "broken" node

 

[esi_y]

OK, I managed to fix it, so I'll leave this here for anyone else.

For some reason ssh from node 1 to node 2 was broken
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

I have no idea how that happended, but it definitely broke the SDN sync.
I reset the certs on both nodes and things are working again

pvecm updatecerts -F

systemctl restart pvedaemon pveproxy

Could be related to: https://forum.proxmox.com/threads/cannot-migrate-vm-ct-due-to-ssh-key-error.133560/#post-614183