recommended 100 Gbit/s NICs for Ceph

d147

Active Member
May 13, 2019
1
0
41
60
Hi,

I'm planning a HCI cluster with MikroTik CRS520-4XS-16XQ switches for the Ceph network. Are there recommendations regarding the manufacturer of the server NICs? The dual port NICs Broadcom P2100G and NVIDIA ConnectX-6 Dx EN are offered by the distributors. The former are less expensive, but as reliability has precedence I would pay for the more expensive NVIDIA/Mellanox if they are better. I don't want to risk instability within the storage network.

It would be nice if you could share your experiences.

Thanks and regards
 
At work, the order of precedence for reliability is:

1) Mellanox (CX-6)
2) Intel (E810)
3) Broadcom (NetXtreme/Thor)