Ideal Network Configuration

afrugone

Renowned Member
Nov 26, 2008
106
0
81
Hi,

We received a second handed rack, with the following:

3 Servers with 12x600GB 64GBRam 4x10GB NIC x CEPH+VM
2 servers with 3x300GB 320GBRam 4x10GB NIC X VM
1 server with 6x4TB 64GBRam 4x1GB NIC X FREENAS (BACKUP)
2 DLINK DL1210 12X10GB
1 CISCO 4980E-F

My question is, how must In configure my network assuming we will have 3 CEPH+VM servers and 2 VM only servers, I have read that is good to have 4 separated networks, cluster+storage+migration+service as show in attached schema, I'll appreciate someone can send me a sample network configuration file to start from, and could explain how force traffic use the right interface.
Besides the storage servers CEPH-PROC1-3, includes 16 100GB SSD cards, the HDD are controlled by an array card, and cant be configured as JBOD, as shown bellow, so if someone can recommend me how to to configure disks in this situation.

Thanks
Alfredo
PROXMOX CLUSTER.png
DISKs.png
 

Attachments

  • PROXMOX CLUSTER.png
    PROXMOX CLUSTER.png
    96.2 KB · Views: 13
Last edited:
I have read that is good to have 4 separated networks
Ideally those networks are physically separated and not only as VLANs. There are some example network configurations available in our Administration Guide. You can find information on how to separate cluster traffic from the rest of your network traffic here.
 
Last edited:
Dominic, Thanks for your comments I've configured the network with four independent networks, as shown bellow. So now, how can I force that traffic will use the right network. How can be sure that cluster will use the clsuter network, storage use it's corresponding interface, and so on, I've configured all using the webgui.
Network configuration.png
 
So now, how can I force that traffic will use the right network.
This is explained in our documentation.

I've already mentioned cluster networks:
You can find information on how to separate cluster traffic from the rest of your network traffic here.

How to set up a migration network is explained in the same chapter: Here.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!