[SOLVED] No network access for VMs

BenDDD

Member
Nov 28, 2019
59
1
11
41
Hello everyone,

I have a problem on a node of a Proxmox cluster.

Interfaces and bridges appear to be well configured but VMs do not have network access.

pveversion
pve-manager/6.2-15/48bd51b6 (running kernel: 5.4.65-1-pve)

cat /etc/network/interfaces
# network interface settings; autogenerated
# Please do NOT modify this file directly, unless you know what
# you're doing.
#
# If you want to manage parts of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT read its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!

auto lo
iface lo inet loopback

auto enp3s0f0
iface enp3s0f0 inet manual

auto enp3s0f1
iface enp3s0f1 inet manual

iface enp4s0f0 inet manual

iface enp4s0f1 inet manual

iface ens2f0 inet manual
mtu 9000

iface ens2f1 inet manual
mtu 9000

auto vmbr0
iface vmbr0 inet static
address X.X.X.X
netmask 255.255.255.0
gateway X.X.X.1
bridge-ports enp3s0f0
bridge-stp off
bridge-fd 0

auto vmbr1
iface vmbr1 inet manual
bridge-ports enp3s0f1
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

############################################
auto bond0
iface bond0 inet manual
bond-slaves ens2f0 ens2f1
bond-miimon 100
bond-mode 802.3ad
bond-xmit-hash-policy layer2+3
mtu 9000
bond_lacp_rate slow

auto vmbr2
iface vmbr2 inet static
bridge-ports bond0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 1-4094
bridge-pvid 99
mtu 9000

auto vmbr2.791
iface vmbr2.791 inet static
address X.X.X.X/16
mtu 9000
##########################################

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
2: enp3s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
link/ether e8:39:35:e9:21:f2 brd ff:ff:ff:ff:ff:ff
3: enp3s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP group default qlen 1000
link/ether e8:39:35:e9:21:f4 brd ff:ff:ff:ff:ff:ff
4: enp4s0f0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether e8:39:35:e9:21:f6 brd ff:ff:ff:ff:ff:ff
5: enp4s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether e8:39:35:e9:21:f8 brd ff:ff:ff:ff:ff:ff
6: ens2f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether f8:f2:1e:c2:1a:e0 brd ff:ff:ff:ff:ff:ff
7: ens2f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 9000 qdisc mq master bond0 state UP group default qlen 1000
link/ether f8:f2:1e:c2:1a:e0 brd ff:ff:ff:ff:ff:ff
8: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether e8:39:35:e9:21:f2 brd ff:ff:ff:ff:ff:ff
inet 147.215.130.106/24 scope global vmbr0
valid_lft forever preferred_lft forever
10: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 9000 qdisc noqueue master vmbr2 state UP group default qlen 1000
link/ether f8:f2:1e:c2:1a:e0 brd ff:ff:ff:ff:ff:ff
11: vmbr2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether f8:f2:1e:c2:1a:e0 brd ff:ff:ff:ff:ff:ff
12: vmbr2.791@vmbr2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP group default qlen 1000
link/ether f8:f2:1e:c2:1a:e0 brd ff:ff:ff:ff:ff:ff
inet X.X.X.X/16 scope global vmbr2.791
valid_lft forever preferred_lft forever
13: tap125i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000
link/ether d2:df:f4:5d:f0:51 brd ff:ff:ff:ff:ff:ff
inet6 fe80::d0df:f4ff:fe5d:f051/64 scope link
valid_lft forever preferred_lft forever
14: tap125i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000
link/ether a2:45:cd:ce:f3:ef brd ff:ff:ff:ff:ff:ff
inet6 fe80::a045:cdff:fece:f3ef/64 scope link
valid_lft forever preferred_lft forever
15: tap125i2: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000
link/ether 7e:15:1f:04:fa:42 brd ff:ff:ff:ff:ff:ff
inet6 fe80::7c15:1fff:fe04:fa42/64 scope link
valid_lft forever preferred_lft forever
19: tap119i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000
link/ether 0a:b1:46:bd:d6:b5 brd ff:ff:ff:ff:ff:ff
inet6 fe80::8b1:46ff:febd:d6b5/64 scope link
valid_lft forever preferred_lft forever
20: tap119i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000
link/ether 6e:77:1b:97:c9:13 brd ff:ff:ff:ff:ff:ff
inet6 fe80::6c77:1bff:fe97:c913/64 scope link
valid_lft forever preferred_lft forever
21: tap119i2: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000
link/ether ce:8b:74:d7:7b:31 brd ff:ff:ff:ff:ff:ff
inet6 fe80::cc8b:74ff:fed7:7b31/64 scope link
valid_lft forever preferred_lft forever
22: tap113i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr113i0 state UNKNOWN group default qlen 1000
link/ether ce:f0:8d:6f:36:22 brd ff:ff:ff:ff:ff:ff
23: fwbr113i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 86:9e:be:e4:c5:ed brd ff:ff:ff:ff:ff:ff
24: fwpr113p0@fwln113i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 9a:5b:c6:1d:61:d9 brd ff:ff:ff:ff:ff:ff
inet6 fe80::985b:c6ff:fe1d:61d9/64 scope link
valid_lft forever preferred_lft forever
25: fwln113i0@fwpr113p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr113i0 state UP group default qlen 1000
link/ether 86:9e:be:e4:c5:ed brd ff:ff:ff:ff:ff:ff
26: tap113i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr113i1 state UNKNOWN group default qlen 1000
link/ether ee:86:38:d1:21:cb brd ff:ff:ff:ff:ff:ff
27: fwbr113i1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 8a:43:60:38:f3:2a brd ff:ff:ff:ff:ff:ff
28: fwpr113p1@fwln113i1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 3e:d8:79:61:52:2c brd ff:ff:ff:ff:ff:ff
inet6 fe80::3cd8:79ff:fe61:522c/64 scope link
valid_lft forever preferred_lft forever
29: fwln113i1@fwpr113p1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr113i1 state UP group default qlen 1000
link/ether 8a:43:60:38:f3:2a brd ff:ff:ff:ff:ff:ff
30: tap113i2: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr113i2 state UNKNOWN group default qlen 1000
link/ether 0a:b6:29:ac:54:ae brd ff:ff:ff:ff:ff:ff
31: fwbr113i2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 2e:7c:d4:e9:de:62 brd ff:ff:ff:ff:ff:ff
32: fwpr113p2@fwln113i2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether aa:24:76:67:42:b7 brd ff:ff:ff:ff:ff:ff
inet6 fe80::a824:76ff:fe67:42b7/64 scope link
valid_lft forever preferred_lft forever
33: fwln113i2@fwpr113p2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr113i2 state UP group default qlen 1000
link/ether 2e:7c:d4:e9:de:62 brd ff:ff:ff:ff:ff:ff
35: vmbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether e8:39:35:e9:21:f4 brd ff:ff:ff:ff:ff:ff

But the virtual interfaces of the VMs are not associated with the vmbr1 bridge.

bridge name bridge id STP enabled interfaces
fwbr113i0 8000.869ebee4c5ed no fwln113i0
tap113i0
fwbr113i1 8000.8a436038f32a no fwln113i1
tap113i1
fwbr113i2 8000.2e7cd4e9de62 no fwln113i2
tap113i2
vmbr0 8000.e83935e921f2 no enp3s0f0
vmbr1 8000.e83935e921f4 no enp3s0f1
vmbr2 8000.f8f21ec21ae0 no bond0

Does anyone have a guess on the problem?

Thanks in advance.
 
Hello everyone,

For information, we have solved our problem. Virtual machine network interfaces were no longer attached to vmbr1.

Via the web interface, we attached them to vmbr0 then back to vmbr1 and everything is back to normal.