CEPH - simple network question

[damonpillinger]

With ceph - if you have a 5 node system. Each node has a 2x 1 GB and 2 x 10gB on a single card
2x 1GB are motherboard
2x 10GB are single PCIe card NIC
is it better to use the 2 x 1GB Bonded for proxmox
and
2x 10GB for Ceph

please assume all Nodes are i9 CPU/motherboards / DDR5 Ram etc....

thanks
damon

 

[npauli]

Hi @damonpillinger,

I would recommend you to use the 2x 1Gbit port for Proxmox. 1x GUI and 1x Corosync (Proxmox cluster network). I would not configure this as a bond though, as Corosync needs very low latencies, but the GUI interface needs to be routed.

On the 10Gbit network card I would configure Ceph, since Ceph replicates quite a bit of data between the nodes. The 1Gbit connection will probably not be enough for a long time..

Kind regards
Niklas