Proxmox is Making my router crash

[AlbanV]

Hi everyone,
I did the upgrade from 6.4 to 7 yesterday, and now I'm experciencing some very weird issues, particularely when the network is used a lot.
When the problem happen, sometimes my router gets completely crazy, no device can reach each other anymore over LAN.
The machines cannot access the internet anymore, and I can can't even ping Proxmox.
In some other cases, only Proxmox become unreachable.
I didn't change anything except for the interface mac addresses, i added them to the /etc/network/interfaces file.
I'm in a homelab configuration, the bridge is connected to the main network, with an ISP router.
Here is the content of my file:

auto lo
iface lo inet loopback

auto enp8s0
iface enp8s0 inet manual
        mtu 1500

auto eno2
iface eno2 inet manual
        mtu 9000

iface enp66s0 inet manual

iface enp66s0d1 inet manual

#VMBR0 is the main bridge, 192.168.1. 1 is my ISP router
auto vmbr0
iface vmbr0 inet static
        address 192.168.1.99/24
        hwaddress 00:d8:61:31:17:cb
        gateway 192.168.1.1
        bridge-ports enp8s0
        bridge-stp off
        bridge-fd 0
        mtu 1500

auto vmbr1
iface vmbr1 inet static
        address 192.168.2.1/25
        hwaddress 50:3e:aa:11:bb:03
        bridge-ports eno2
        bridge-stp off
        bridge-fd 0
        mtu 9000

 

[Stefan_R]

Can you post the output of ip link and ip addr? Why did you add the "hwaddress" stanzas to your network config?

 

[AlbanV]

Hi
Here are the outputs

root@pve:~# ip link
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc pfifo_fast master vmbr1 state UP mode DEFAULT group default qlen 1000
    link/ether 50:3e:aa:11:bb:03 brd ff:ff:ff:ff:ff:ff
    altname enp4s0
3: enp8s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 00:d8:61:31:17:cb brd ff:ff:ff:ff:ff:ff
4: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether 00:d8:61:31:17:cb brd ff:ff:ff:ff:ff:ff
5: vmbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether 50:3e:aa:11:bb:03 brd ff:ff:ff:ff:ff:ff
6: veth105i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr105i0 state UP mode DEFAULT group default qlen 1000
    link/ether fe:81:93:69:d9:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0
7: fwbr105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether e2:d5:e5:3d:b2:f2 brd ff:ff:ff:ff:ff:ff
8: fwpr105p0@fwln105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 16:cf:36:e2:0a:23 brd ff:ff:ff:ff:ff:ff
9: fwln105i0@fwpr105p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr105i0 state UP mode DEFAULT group default qlen 1000
    link/ether 52:67:4c:14:a2:64 brd ff:ff:ff:ff:ff:ff
10: veth107i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue master fwbr107i0 state UP mode DEFAULT group default qlen 1000
    link/ether fe:d1:10:e5:2b:d5 brd ff:ff:ff:ff:ff:ff link-netnsid 1
11: fwbr107i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether 7e:2c:9c:b9:fb:09 brd ff:ff:ff:ff:ff:ff
12: fwpr107p0@fwln107i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue master vmbr1 state UP mode DEFAULT group default qlen 1000
    link/ether fe:c7:1a:b6:30:9f brd ff:ff:ff:ff:ff:ff
13: fwln107i0@fwpr107p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc noqueue master fwbr107i0 state UP mode DEFAULT group default qlen 1000
    link/ether ae:12:24:71:37:59 brd ff:ff:ff:ff:ff:ff
14: veth108i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr108i0 state UP mode DEFAULT group default qlen 1000
    link/ether fe:c1:ca:f1:75:5c brd ff:ff:ff:ff:ff:ff link-netnsid 2
15: fwbr108i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether 4e:d4:2c:06:ab:ba brd ff:ff:ff:ff:ff:ff
16: fwpr108p0@fwln108i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 8e:f8:e0:57:4f:81 brd ff:ff:ff:ff:ff:ff
17: fwln108i0@fwpr108p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr108i0 state UP mode DEFAULT group default qlen 1000
    link/ether aa:e7:ab:f8:1d:fa brd ff:ff:ff:ff:ff:ff
18: veth109i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr109i0 state UP mode DEFAULT group default qlen 1000
    link/ether fe:a6:46:08:4d:35 brd ff:ff:ff:ff:ff:ff link-netnsid 3
19: fwbr109i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether a6:46:9b:d8:99:e2 brd ff:ff:ff:ff:ff:ff
20: fwpr109p0@fwln109i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 96:b4:1b:68:1f:44 brd ff:ff:ff:ff:ff:ff
21: fwln109i0@fwpr109p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr109i0 state UP mode DEFAULT group default qlen 1000
    link/ether 2e:de:85:60:ef:35 brd ff:ff:ff:ff:ff:ff
22: tap103i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr103i0 state UNKNOWN mode DEFAULT group default qlen 1000
    link/ether 0a:82:f4:cd:cd:3c brd ff:ff:ff:ff:ff:ff
23: fwbr103i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether 86:48:59:0d:13:20 brd ff:ff:ff:ff:ff:ff
24: fwpr103p0@fwln103i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 9e:a8:c4:0f:f8:99 brd ff:ff:ff:ff:ff:ff
25: fwln103i0@fwpr103p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr103i0 state UP mode DEFAULT group default qlen 1000
    link/ether f6:ce:7b:bc:55:cd brd ff:ff:ff:ff:ff:ff
26: tap103i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 9000 qdisc pfifo_fast master vmbr1 state UNKNOWN mode DEFAULT group default qlen 1000
    link/ether d2:ea:9f:be:8e:57 brd ff:ff:ff:ff:ff:ff

root@pve:~# ip r
default via 192.168.1.1 dev vmbr0 proto kernel onlink
192.168.1.0/24 dev vmbr0 proto kernel scope link src 192.168.1.99
192.168.2.0/25 dev vmbr1 proto kernel scope link src 192.168.2.1

 

[AlbanV]

Why did you add the "hwaddress" stanzas to your network config?

I followed the guide for migration to Proxmox 7 and saw this https://pve.proxmox.com/wiki/Upgrade_from_6.x_to_7.0#Linux_Bridge_MAC-Address_Change
So I hard coded the mac addresses.

EDIT: Now my router seems to be holding up when the issue occurs, only Proxmox and CTs/VMs become unresponsive. This happened just when a backup started. This network activity was going through vmbr1 (to a NFS share)

 

[Stefan_R]

I followed the guide for migration to Proxmox 7 and saw this https://pve.proxmox.com/wiki/Upgrade_from_6.x_to_7.0#Linux_Bridge_MAC-Address_Change
So I hard coded the mac addresses.

Do you need your MAC address to remain constant? If not, I'd try just removing that. It is meant as a fix if you cannot tolerate your MAC changing for outside network reasons. Also, are you using 'ifupdown2'? (post 'pveversion -v' if you're not sure, or just install the package and reboot)

 

[AlbanV]

No I don't a fixed mac address, so I'll remove the hwadress
Yes, Ifupdown2 to is installed

root@pve:~# pveversion -v | grep ifupdown2
ifupdown2: 3.1.0-1+pmx3

 

[AlbanV]

The server crashed again during the night, I really don't understand what is happening.
I did a memtest this morning and everything looks good.
Here are messages and kernel logs if someone has an idea