Whats the best way to give vms access to ceph network?

jsterr

Renowned Member
Jul 24, 2020
758
203
68
32
I want to mount cephfs inside vms, so they can use it for shared storage, so we need network access for vms to the ceph network. Thats the current network config. I dont want to put ceph on a vmbr by default, but thought about creating some additional devices that can use the bond1. seems like this is not allowed, anyone knows whats the best practice here?

Code:
auto lo
iface lo inet loopback

auto enp195s0f0
iface enp195s0f0 inet static
        address 10.2.121.10/24
        gateway 10.2.121.1
#GUI-01

auto enp195s0f1
iface enp195s0f1 inet static
        address 10.99.99.231/24
#Corosync-01

auto enp67s0f0
iface enp67s0f0 inet manual

auto enp67s0f1
iface enp67s0f1 inet manual

auto ens5f0np0
iface ens5f0np0 inet manual

auto ens5f1np1
iface ens5f1np1 inet manual

auto enp129s0f0np0
iface enp129s0f0np0 inet manual

auto enp129s0f1np1
iface enp129s0f1np1 inet manual

auto bond0
iface bond0 inet manual
        bond-slaves enp67s0f0 enp67s0f1
        bond-miimon 100
        bond-mode 802.3ad
        bond-xmit-hash-policy layer2+3
#VM-01

auto bond1
iface bond1 inet static
        address 10.100.100.231/24
        bond-slaves enp129s0f0np0 enp129s0f1np1
        bond-miimon 100
        bond-mode 802.3ad
        bond-xmit-hash-policy layer3+4
        mtu 9000
#CEPH-01

auto bond0.33
iface bond0.33 inet manual

auto vmbr0
iface vmbr0 inet manual
        bridge-ports bond0
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094
#VM-01

auto vmbr1
iface vmbr1 inet static
        address 10.33.33.1/24
        bridge-ports bond0.33
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094
#internal LAN
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!