Two bonds and two VLANS - no network on VMs

G

gumis7

New Member
Feb 13, 2024
3
0
1
Hi,

I've installed Proxmox VE 8 on Dell R740 that is eqipped with 4 NIC (2x1GB and 2x10GB)

NIC's are bonded in pairs and I have two VLANs

VLAN 39 on bond with two 10GB NIC - Address 10.20.22.0 - planned to be internal network for future proxmox cluster
VLAN 91 on bond with two 1GB NIC - Address 10.20.21.0 - planned to be production network for all VMs

I've created bonds, VLANs and bridges in proxmox configuration.
I've installed first VM with AlmaLinux and connected to bridge vmbr91 but there is no network on that vm.
No mater how I configure the network on VM with VLAN config and without it.

I'm pretty sure that I have missed some configs but now out of ideas.
Maybe You can find some mistakes in my config?

My /etc/network/interfaces:
Bash: 
auto lo
iface lo inet loopback

auto eno1np0
iface eno1np0 inet manual

auto eno2np1
iface eno2np1 inet manual

auto eno3
iface eno3 inet manual

auto eno4
iface eno4 inet manual

auto bond0
iface bond0 inet manual
        bond-slaves eno1np0 eno2np1
        bond-miimon 100
        bond-mode 802.3ad
        bond-xmit-hash-polisy layer2+3

auto bond1
iface bond1 inet manual
        bond-slaves eno3 eno4
        bond-miimon 100
        bond-mode 802.3ad
        bond-xmit-hash-policy layer2+3

auto bond1.91
iface bond1.91 inet manual

auto bond0.39
iface bond0.39 inet manual

auto vmbr39
iface vmbr39 inet static
        address 10.20.22.11/24
        gateway 10.20.22.1
        bridge-ports bond0.39
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094

auto vmbr91
iface vmbr91 inet static
        address 10.20.21.11/24
        bridge-ports bond1.91
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094


IP config on proxmox
Code: 
oot@proxmox02:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute
       valid_lft forever preferred_lft forever
2: eno3: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond1 state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6a brd ff:ff:ff:ff:ff:ff
    altname enp1s0f0
3: eno1np0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6c brd ff:ff:ff:ff:ff:ff
    altname enp24s0f0np0
4: eno4: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond1 state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6a brd ff:ff:ff:ff:ff:ff permaddr 00:0a:f7:e2:98:6b
    altname enp1s0f1
5: eno2np1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6c brd ff:ff:ff:ff:ff:ff permaddr 00:0a:f7:e2:98:6d
    altname enp24s0f1np1
6: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6c brd ff:ff:ff:ff:ff:ff
    inet6 fe80::20a:f7ff:fee2:986c/64 scope link
       valid_lft forever preferred_lft forever
7: bond0.39@bond0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr39 state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6c brd ff:ff:ff:ff:ff:ff
18: bond1: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6a brd ff:ff:ff:ff:ff:ff
    inet6 fe80::20a:f7ff:fee2:986a/64 scope link
       valid_lft forever preferred_lft forever
24: bond1.91@bond1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr91 state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6a brd ff:ff:ff:ff:ff:ff
25: vmbr91: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6a brd ff:ff:ff:ff:ff:ff
    inet 10.20.21.11/24 scope global vmbr91
       valid_lft forever preferred_lft forever
    inet6 fe80::d429:cbff:fe79:a3bf/64 scope link
       valid_lft forever preferred_lft forever
26: vmbr39: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 00:0a:f7:e2:98:6c brd ff:ff:ff:ff:ff:ff
    inet 10.20.22.11/24 scope global vmbr39
       valid_lft forever preferred_lft forever
    inet6 fe80::20a:f7ff:fee2:986c/64 scope link
       valid_lft forever preferred_lft forever
30: tap100i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr91 state UNKNOWN group default qlen 1000
    link/ether 4a:e8:b6:42:c1:8c brd ff:ff:ff:ff:ff:ff
root@proxmox02:~# ip r
default via 10.20.21.1 dev vmbr91
default via 10.20.22.1 dev vmbr39 proto kernel onlink
10.20.21.0/24 dev vmbr91 proto kernel scope link src 10.20.21.11
10.20.22.0/24 dev vmbr39 proto kernel scope link src 10.20.22.11
 
Last edited:
gumis7 said:
I've installed first VM with AlmaLinux and connected to bridge vmbr91 but there is no network on that vm.
Click to expand...
Hi,
how did you test the network connectivity for that VM? From a first glance, the network configuration seems fine to me, although I am not sure you need to additionally declare the VLAN bridges as vlan-aware, as they act as traditional bridge: you do not need to set the VLAN tags on the VM NICs when attached to that bridge. Otherwise you config looks like the example config shown in this wiki article https://pve.proxmox.com/wiki/Network_Configuration#sysadmin_network_vlan
 
Thanks tor the reply,

I've managed to find the sloution.
VLAN shoud be created ontop of the bridge and not on the bond itself.

The configuration after changes:
Code: 
auto lo
iface lo inet loopback

auto eno1np0
iface eno1np0 inet manual

auto eno2np1
iface eno2np1 inet manual

auto eno3
iface eno3 inet manual

auto eno4
iface eno4 inet manual

auto bond0
iface bond0 inet manual
        bond-slaves eno1np0 eno2np1
        bond-miimon 100
        bond-mode 802.3ad
        bond-xmit-hash-polisy layer2+3

auto bond1
iface bond1 inet manual
        bond-slaves eno3 eno4
        bond-miimon 100
        bond-mode 802.3ad
        bond-xmit-hash-policy layer2+3

auto vmbr39
iface vmbr39 inet manual
        bridge-ports bond0
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094

auto vmbr91
iface vmbr91 inet manual
        bridge-ports bond1
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094

auto vmbr91.91
iface vmbr91.91 inet static
        address 10.20.21.11/24
        up ip route add 10.20.21.0/24 via 10.20.21.1 dev vmbr91.91

auto vmbr39.39
iface vmbr39.39 inet static
        address 10.20.22.11/24
        gateway 10.20.22.1

After this change all VMs has connection to the network and there is no need do configure VLANs on the VMs
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back