Need help for cluster design

[kev974]

Hello,

We are designing a new 5 nodes cluster configuration and would like to know if this is the good configuration.

5 nodes with 4 1 Gb ports and 2 additionnal X520 dual port 10GBE
1 DELL SAN 10GBE (two controllers and two port by controller)
2 10 GBE Dell switch
4 1 GB Dell switch
1 Server with 2 10GBE port for NFS (backups)

1 10 GBE port of X520 for ISCSI (Vlan 100) and 1 from the other X520 for redundancy with 802.3ad (VLAN100)
1 10 GBE port of X520 (Vlan 101) for cluster and 1 from the other X520 for redundancy with 802.3ad (Vlan 101)
Connecting each couple of port on 10GBE Switch and use VLAN to separate ISCSI and cluster traffic
2 bonded 1GBE port for production VM traffic (Vlan 102)
Connecting each 10GBE port of vzdump backup server on 10GBE Switches in vlan (100 or 101?)
Connecting each 10GBE port of SAN on 10GBE Switches in vlan 100

Should we separate other networks?Is it OK to put Cluster and ISCSI traffic on the same switch or should we get 4 10GBE Switches ?
As actually our vzdump backups are running very slow in which vlan should we put the backup server's cards to get (500 Mo/s or more) backup speed?

Thank you in advance.

 

[Richard]

1 10 GBE port of X520 for ISCSI (Vlan 100) and 1 from the other X520 for redundancy with 802.3ad (VLAN100)
1 10 GBE port of X520 (Vlan 101) for cluster and 1 from the other X520 for redundancy with 802.3ad (Vlan 101)
Connecting each couple of port on 10GBE Switch and use VLAN to separate ISCSI and cluster traffic
2 bonded 1GBE port for production VM traffic (Vlan 102)
Connecting each 10GBE port of vzdump backup server on 10GBE Switches in vlan (100 or 101?)
Connecting each 10GBE port of SAN on 10GBE Switches in vlan 100

To bond the 10GB interfaces and separate afterwards them by vlan does not make sense - the clusternetwork chould be separeted physically from others - onthe other hand: 1Gb/s is sufficient.

 

[kev974]

To bond the 10GB interfaces and separate afterwards them by vlan does not make sense - the clusternetwork chould be separeted physically from others - onthe other hand: 1Gb/s is sufficient.

I bond them to get redundancy (in case of one interface or switch failure)as we would buy only 2 10Gbe switches
So i could use:

2 1 Gbe bonded for VM traffic
2 1Gbe bonded for cluster
2 bonded interfaces on two different switches for ISCSI (should i use the 4 10Gbe port for ISCSI to get better perfs?)
What network is used for Vzdump backup ?we would like to get 10Gb/s speed for backups?

Thanks

 

[Richard]

2 1 Gbe bonded for VM traffic
2 1Gbe bonded for cluster
2 bonded interfaces on two different switches for ISCSI (should i use the 4 10Gbe port for ISCSI to get better perfs?)

Sounds ok. If you bond them all 4 or have 2 networks with 2 bonds each depends on your needs (see also below).

What network is used for Vzdump backup ?we would like to get 10Gb/s speed for backups?

Depending on your storage configuration the related network will be used. If you define as backup storage e.g. a certain iscsi device in your SAN the connection to SAN will be used. If your SAN allows to have different IP addresses at the different ports you can use a separated network. If not - or you prefer to have a more bandwidth - you bond all 4 interfaces into one bond.

 

[kev974]

Thanks really for your advices Richard.

My San will be probably a EMC and have 4 10 Gbe ports. Logically they could have different Ip address and I could do multipathing is this the good way?

My backup sever could be a NFS server (is Freenas OK for this?or better another?) with 2 Intel x520 dual, but I want the best perfs for backup should I reconsider to another storage type?

I'm also wandering if I should use 2 bonded 10Gbe ports for Iscsi and 2 other bonded 10Gbe ports for Vm traffic. Do you think 2 1Gbe ports is enough for Vms traffic?

Thanks for your help.

Sounds ok. If you bond them all 4 or have 2 networks with 2 bonds each depends on your needs (see also below).


Depending on your storage configuration the related network will be used. If you define as backup storage e.g. a certain iscsi device in your SAN the connection to SAN will be used. If your SAN allows to have different IP addresses at the different ports you can use a separated network. If not - or you prefer to have a more bandwidth - you bond all 4 interfaces into one bond.