Enquiry on Network Architecture

[steveyau]

Hi,

I am newbie to PVE. Currently I am deploying a 3 nodes hyper-converged cluster. Each node has only two 10Gb NIC (eth0, eth1). All the nodes are connected to one 10Gb switch the uplink to the router. Which of the following architecture is more preferable?

1. Bonding (bond0 = eth0 + eth1) then split by vlan: i ) corosync primary on bond0.10, secondary on bond0.11 ii) ceph public network on bond0.20 , ceph cluster network on bond0.21
2. Simple two rings with vlan i) corosync singe ring on eth0 ring ii) ceph public + cluster on eth1 ring
3. Architecture 2 + backup i) corosync primary on eth0 ring, secondary on eth1 ring ii) ceph public on eth1 ring, cluster on eth0 ring

Regards,
Steve

 

[ph0x]

If all NICs are connected to one switch, there is no need for a second Corosync ring.
So, option no. 2 is the way to go, although you waste a totally potent 10G link ...
Corosync should be unaffected by high loads, so over VLAN is only possible if you can guarantee highest priority to Corosync in terms of latency, maybe by QoS. In all other cases use a separate NIC.