Hi,
I'm currently in the process of installing a 3-node cluster. This is my network setup for each node:
- 1x 10G NIC -> LAN (Switch)
- 2x 25G NIC -> CEPH (Full Mesh)
- 2x 1G NIC -> Corosync (Full Mesh)
Full mesh cabling of the nodes:
Node1 <-> Node2
Node1 <-> Node3
Node2 <-> Node3
For the 10G LAN I'm using a Linux bridge and for the CEPH network I'm using a OVS bridge, like described in the Proxmox wiki. But I'm currently struggling with the setup of the corosync. The setup should also give redundancy, so if one of the 1G network ports fails, the packets should be routed through one node to the other. There are many suggestions to not use a bond or a bridge, instead to use single network adapters. But I'm currently thinking about also using an OVS bridge like CEPH, because of RSTP, which will be faster in case of changes in topology.
Do you have any suggestions for my setup?
Thanks,
Martin
I'm currently in the process of installing a 3-node cluster. This is my network setup for each node:
- 1x 10G NIC -> LAN (Switch)
- 2x 25G NIC -> CEPH (Full Mesh)
- 2x 1G NIC -> Corosync (Full Mesh)
Full mesh cabling of the nodes:
Node1 <-> Node2
Node1 <-> Node3
Node2 <-> Node3
For the 10G LAN I'm using a Linux bridge and for the CEPH network I'm using a OVS bridge, like described in the Proxmox wiki. But I'm currently struggling with the setup of the corosync. The setup should also give redundancy, so if one of the 1G network ports fails, the packets should be routed through one node to the other. There are many suggestions to not use a bond or a bridge, instead to use single network adapters. But I'm currently thinking about also using an OVS bridge like CEPH, because of RSTP, which will be faster in case of changes in topology.
Do you have any suggestions for my setup?
Thanks,
Martin