[SOLVED] Proxmox SDN disables ospfd despite usage in /etc/frr/frr.conf.local

[fmaurer]

Hello, we are using a relatively simple ospf config similar to this:
https://packetpushers.net/blog/proxmox-ceph-full-mesh-hci-cluster-w-dynamic-routing/

We use ospfd and ospfd6

/etc/frr/frr.conf.local looks like this:

frr version 10.4.1
frr defaults datacenter
hostname ffac-epyc-03
log syslog informational
service integrated-vtysh-config
!
interface eno1np0
 ip address 192.168.101.12 peer 192.168.101.11/32
 ip ospf area 0
 ip ospf network point-to-point
 ipv6 ospf6 area 0
 ipv6 ospf6 network point-to-point
exit
!
interface eno2np1
 ip address 192.168.103.12 peer 192.168.103.13/32
 ip ospf area 0
 ip ospf network point-to-point
 ipv6 ospf6 area 0
 ipv6 ospf6 network point-to-point
exit
!
interface lo
 ip ospf area 0
 ipv6 ospf6 area 0
exit
!
router ospf6
 ospf6 router-id 192.168.111.12
 log-adjacency-changes
exit
!

And I manually changed ospfd=yes in /etc/frr/daemons.

Since Proxmox 9 SDN, the config in /etc/frr/daemons is just overwritten with a proxmox "SDN apply" in the UI.
So it is ospfd=no again.

It would be good if Proxmox would check the /etc/frr/frr.conf.local as well to determine if a service is used.
Or is it possible to overwrite this as well through some /etc/frr/daemons.local ..?

 

[fmaurer]

We managed to fix this, by migrating our custom local config to the built-in OSPF feature.

Leaving us with the /etc/frr/frr.conf.local being only used for ospfd6 (and lo):

frr version 10.4.1
frr defaults datacenter
hostname ffac-epyc-03
log syslog informational
service integrated-vtysh-config
!
interface eno1np0
 ipv6 ospf6 area 0
 ipv6 ospf6 network point-to-point
exit
!
interface eno2np1
 ipv6 ospf6 area 0
 ipv6 ospf6 network point-to-point
exit
!
interface lo
 ip ospf area 0
 ipv6 ospf6 area 0
exit
!
router ospf6
 ospf6 router-id 192.168.111.12
 log-adjacency-changes
exit
!

And configuring the fabric as shown here:



This leaves us with a setting where ospfd is managed through the Proxmox SDN, while ospfd6 is not touched by Proxmox SDN (as it is not (yet) capable of handling it).
So the ospfd6 config stays in /etc/frr/frr.conf.local

This is similar to the topology documented for the full mesh ceph network here:
https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server#Routed_Setup_(with_Fallback)
Except that I am using OSPF instead of OpenFabric (which works equally well)

I think that this is still just a workaround and would like to know if there is an option to ensure that ospfd6 will not be disabled by a SDN apply as soon as proxmox supports it..?

Thanks!

 

[ggoller]

Using the new fabrics and overriding with frr.conf.local as mentioned by @fmaurer is fine as well.
Otherwise you can override the daemons config using the /etc/default/frr file:

https://pve.proxmox.com/wiki/Upgrad...bric_or_OSPF_Fabric_FRR_configurations_broken

 

[fmaurer]

Thanks! I missed this while reading the upgrade docs.
But the built-in SDN also works well, glad that I tried that out now - great work!