SDN - connecting PVE host/Ceph to VxLan/EVPN ? (meshed setup)

hvisage

Renowned Member
May 21, 2013
297
32
93
Busy FAFOing with this in a totally meshed setup, and the use case is to have Ceph on that SDN created VxLan/EVPN vnets of it's own. Reason to NOT have it on the "public" network, but also to allow VMs (pointing fingers to K8s) that wants direct Ceph storage access on the access network, and in future to L3 extend to external/dedicated Ceph.

So from a VM/LXC perspective the GUI is "there" to attach and PVE should/does attach to the vnet.

The problem now is that the GUI doesn't (yet?) allow me to create and attach an interface to that bridge (ala OVS IntPort or similar), so yes, I *can* go an manually add an IP and it's pingable across the cluster, and yes, I can manually add it to /etc/network/interfaces.d/sdn or I could add a /etc/network/interfaces.d/zExtraSdn ?

Q1: *Usually* you need to add the interfaces (for ifupdown2) in the bridge, guess I can force it with "pre/post-up" to the bridge. What do I need to be aware of that I will/might trip?

Q2: Is there any plans for similar in the GUI to create a "localnet" interface to attach to a SDN vnet bridge?

Q3: What other options are there for a converged type setup to have Ceph on a separate vxlan/EVPN?
 
Did you ever find a solution to this? I have finally made it so i can use the mesh network for both sdn and ceph network. VMs can also connect to ceph host ip but not trough the fast meshed network.