New Cluster Network Configuration

[afrugone]

I've receive a donation of a Lenovo Flex Chasis with 7 nodes, each node has 4 1GB nics, connected to 2 EN2092 (Layer 3) switches, besides we receive a VNX5200 storage with 2 controllers with 4 1GB nics each. I've being using Proxmox for some time, but never use HA, with this little monster I'd like to build a HA cluster, wich is the best Network configuration to configure the HA cluster with the best possible performance, I've made an sketch of what configuration I' think could be possible, is a good idea to bond all 4 nics of each node and create 2 vlans, one for storage and the other for production? if I'm wrong please tell me.

 

[afrugone]

Each node x240 has 4 1gb nics, is a good idea to create a bond with these 4 nics?, and create two different vlans on this bond, one vlan for storage, and the other for production? I'll need another vlan for intercluster communicaton?

So what's the recommended configuration for networking for this configuration?

Thanks for your comments

 

[fireon]

Recommended is to use dedicated network (PHY) for Clusternetwork. In the past we had also more NICs in one Bond, one Bridge and and a lot of VLANs. When networkslable was very high for a long time, it's happened before that the clustercommunication is broken for a time.

During the Clusterupgrade from pve3 to pve4 we build an extra bond with to nics on each node for an extra clustervlan without gateway and without bridge, really only for clustercommunication. I talked to the support and it is hightly recommended to do this so.

 

[afrugone]

Thanks for your comments.

So you recommned to not bonding all NICs, is not safe?, and use for example one NIC1 for cluster communication, NIC2 for production (users access) and could BOND NIC3 and NIC4 for storage, for higher speed.

For Bonding is a good idea to use active-active configuration? or is not safe? and could be safer use active-passive?

Thanks for your comments.

 

[fireon]

The problem is the the linuximplementation of bonding do not working great. Many problems, particularly with ipv6. With linuxbonding i only use active-backup. Otherwise we use for all things LACP. But you need Layer2 Switches.

 

[afrugone]

The switches support LACP and I will not use IPV6, in that case, do you think is safe to use active-active? or still not safe.

Thanks again for your valuable help.

 

[fireon]

The switches support LACP and I will not use IPV6, in that case, do you think is safe to use active-active? or still not safe.

Thanks again for your valuable help.

Should be, i would like to use XOR.