hanley.development

New Member
Oct 3, 2023
6
0
1
Physical Hardware:
3 nodes with same Hardware
1 -1GB nic
2 - 2.5GB nic
1 - 10GB nic

Network hardware:
1 - 8 port 10GBe switch
1 - 24 port 1GBe switch
1 - 8 port 1GBe Switch
All LACP LAG capable

I am trying to figure out what would be the best configuration for a clustered, HA, and CEPH capable?

Each node would be running various VMs and CTs that will be vlan tagged individually.

Reading the documentation it suggests to keep the cluster and management, migration, and CEPH networks separate.

What I've come up with so far is:
Use the 1GB nic for cluster
(VLan5 on 8 port 1GB switch)
Node1 - 192.168.5.11/24
Node2 - 192.168.5.12/24
Node3 - 192.168.5.13/24

Bond0 the 2 2.5GB nics
Use Bond0 > Vmbr0 (vlan aware) as Management
(VLAN2 on 24 port 1GB Switch)
Node1 - 192.168.2.11/24
Node2 - 192.168.2.12/24
Node3 - 192.168.2.13/24
Gateway - 192.168.2.1

Use the 10GB nic for CEPH and Migration
(VLAN10 on 4 port 10GB Switch)
Node1 - 192.168.10.11/24
Node2 - 192.168.10.12/24
Node3 - 192.168.10.13/24

VLans are blocked from communication on the router firewall.

Is there a better configuration?
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!