Hello all,
I have 3nodes, and have 8 x 10G nics per a node.
I want to set up Ceph with 3nodes + 1 PBS node
What is the best network configuration for this environment ?
Let me tell you my idea.
(As I have 8 10NICs, I don't want to use vlan, but physically separate the network traffic )
For 3nodes for Ceph ;
ens1 ens2 => bond0(active/backup mode) : vmbr0
ens3 ens4 => bond1(active/backup mode) : vmbr1
ens5 ens6 => bond2(active/backup mode) : vmbr2
ens7 ens8 => bond3(active/backup mode) : vmbr3
and assign vmbr# like below ;
vmbr0 : Management Network + Backup Network ( as Management Network traffic is not that much I think )
vmbr1 : Guest VM Service Network ( VMs on proxmox will use this )
vmbr2 : Ceph Cluster Network
vmbr3 : Ceph Public Network
In the above design, Where do I put the Cluster Network(for proxmox corosync) ?
I've checked many documents and articles, but it's not clear to me.
Can I put Cluster Network(proxmox corosync ? ) and Ceph Cluster Network together as it's 10G Nic ?
and where do I put Backup Network for PBS backup traffic ?
Can you guide me better design ?
Thanks
I have 3nodes, and have 8 x 10G nics per a node.
I want to set up Ceph with 3nodes + 1 PBS node
What is the best network configuration for this environment ?
Let me tell you my idea.
(As I have 8 10NICs, I don't want to use vlan, but physically separate the network traffic )
For 3nodes for Ceph ;
ens1 ens2 => bond0(active/backup mode) : vmbr0
ens3 ens4 => bond1(active/backup mode) : vmbr1
ens5 ens6 => bond2(active/backup mode) : vmbr2
ens7 ens8 => bond3(active/backup mode) : vmbr3
and assign vmbr# like below ;
vmbr0 : Management Network + Backup Network ( as Management Network traffic is not that much I think )
vmbr1 : Guest VM Service Network ( VMs on proxmox will use this )
vmbr2 : Ceph Cluster Network
vmbr3 : Ceph Public Network
In the above design, Where do I put the Cluster Network(for proxmox corosync) ?
I've checked many documents and articles, but it's not clear to me.
Can I put Cluster Network(proxmox corosync ? ) and Ceph Cluster Network together as it's 10G Nic ?
and where do I put Backup Network for PBS backup traffic ?
Can you guide me better design ?
Thanks