Using a VLAN for the cluster network

[David Thistlethwaite]

I have 3 nodes and each node has 9 nics.
I currently have a dedicated NIC for the cluster network.
I was thinking of bonding all 9 nics and running all the traffic on their own appropriate VLANS

traffic consists of: (all seperate vlans)

vm host data (cifs, nfs)
pve management
vm data
pve cluster
ceph client
ceph cluster

Thoughts ?

 

[sb-jw]

Sure, you can connect any node with 9 ports, but do you want to?

What bandwidth do the ports offer?

I run everything over 2x 10GbE and have never had any problems with it for years. Basically, it is enough if you have 2x 10 G for everything and an additional link for Corosync.

It is important that you always keep in mind that although VLANs are a separation, they do not give you multiple bandwidth. So if you have a DDoS attack on one VM, it can have a negative impact on the rest of the connections. Ideally, your external connection is smaller than your internal network.