Proxmox network configuration with Ceph ?

anaveli

New Member
May 24, 2024
2
0
1
Hello all,
I have 3nodes, and have 8 x 10G nics per a node.
I want to set up Ceph with 3nodes + 1 PBS node
What is the best network configuration for this environment ?
Let me tell you my idea.
(As I have 8 10NICs, I don't want to use vlan, but physically separate the network traffic )
For 3nodes for Ceph ;
ens1 ens2 => bond0(active/backup mode) : vmbr0
ens3 ens4 => bond1(active/backup mode) : vmbr1
ens5 ens6 => bond2(active/backup mode) : vmbr2
ens7 ens8 => bond3(active/backup mode) : vmbr3

and assign vmbr# like below ;

vmbr0 : Management Network + Backup Network ( as Management Network traffic is not that much I think )
vmbr1 : Guest VM Service Network ( VMs on proxmox will use this )
vmbr2 : Ceph Cluster Network
vmbr3 : Ceph Public Network

In the above design, Where do I put the Cluster Network(for proxmox corosync) ?
I've checked many documents and articles, but it's not clear to me.
Can I put Cluster Network(proxmox corosync ? ) and Ceph Cluster Network together as it's 10G Nic ?
and where do I put Backup Network for PBS backup traffic ?

Can you guide me better design ?

Thanks
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!