We are currently setting up two separate PVE clusters. Both are HCI clusters running Ceph. The servers are distributed across two colocation facilities in the same city, connected via a low-latency data centre interconnect.
One cluster consists of 12 nodes in each data centre, while the second cluster consists of 3+3 nodes.
We also have access to a third data centre where we would like to deploy the tiebreaker nodes. As I understand it from the Corosync and Ceph documentation, connecting the tiebreaker nodes via routed networks should be possible.
However, the Proxmox configuration dialogs appear to require that the Corosync and Ceph IP addresses reside within the same Layer 2 network.
This raises several questions:
1. Is a stretched Layer 2 network across all three sites actually required?
2. Has anyone successfully deployed tiebreaker nodes over routed connections?
3. Are there any plans or recommendations from Proxmox development team to officially support or simplify this setup?
One cluster consists of 12 nodes in each data centre, while the second cluster consists of 3+3 nodes.
We also have access to a third data centre where we would like to deploy the tiebreaker nodes. As I understand it from the Corosync and Ceph documentation, connecting the tiebreaker nodes via routed networks should be possible.
However, the Proxmox configuration dialogs appear to require that the Corosync and Ceph IP addresses reside within the same Layer 2 network.
This raises several questions:
1. Is a stretched Layer 2 network across all three sites actually required?
2. Has anyone successfully deployed tiebreaker nodes over routed connections?
3. Are there any plans or recommendations from Proxmox development team to officially support or simplify this setup?
