Moving away from Full Mesh Network - Routed Setup

[bbx1_]

Hey everyone, I have a 3-node PVE cluster that I've been using for testing and learning the platform in a business setting.

Initially I had my PVE nodes connected to a Mellanox SX1024 40G switch.

A few months ago, I spent some time and reconfigured my cluster to use Full mesh networking for CEPH, routed setup (with fallback), manual configuration

As my server nodes are quite small (R240) and I want to now start digging into Proxmox Backup Server and utilize the 40GbE connections, I want to "undo" my full mesh configuration and rely on the Mellanox switch again.

I can confirm that I have FRR installed by checking vtysh.

At this time, I am testing a few VMs being hosted on Proxmox. They are backed up with PBS through a slower link.

I am unsure of the best and cleanest way to move away from full-mesh-FRR.


Thank you

 

[ggoller]

You should make sure to give static ips (in the same subnet as the ceph network (check the ceph config file for this)) to the interfaces attached to the switch. Then just remove the frr config and restart frr to apply the change.