Linux VMs no Longer able to connect to network

Dec 20, 2024
2
0
1
Recently did the 11.2024 update. After a reboot, one of my server's VMs (primarily Linux) no longer has connectivity to the network. I am passing VLAN tags through to the VMs using a 2 bonded 10Gbps NICs. The server is part of a 2 server cluster with a Quorum Member. All the interfaces on the server are accessible and I tried to migrate the VMs not working to the server that does not seem to have the issue, but those VMs still do not work (start and accessible through console but no network connectivity) after the migration.

Also of note, the cluster seems to flap and that can be seen in the corasync.

Here is relevant info on the server:

Code:
CPU(s) - 32 x AMD Ryzen 9 5950X 16-Core Processor (1 Socket)

Kernel Version - Linux 6.8.12-4-pve (2024-11-06T15:04Z)

Boot Mode - Legacy BIOS

Manager Version - pve-manager/8.3.2/3e76eec21c4a14a7

Code:
root@pve2:~# pveversion -v
proxmox-ve: 8.3.0 (running kernel: 6.8.12-4-pve)
pve-manager: 8.3.2 (running version: 8.3.2/3e76eec21c4a14a7)
proxmox-kernel-helper: 8.1.0
pve-kernel-5.15: 7.4-9
proxmox-kernel-6.8: 6.8.12-4
proxmox-kernel-6.8.12-4-pve-signed: 6.8.12-4
proxmox-kernel-6.8.12-2-pve-signed: 6.8.12-2
proxmox-kernel-6.8.8-4-pve-signed: 6.8.8-4
proxmox-kernel-6.8.8-2-pve-signed: 6.8.8-2
proxmox-kernel-6.8.4-3-pve-signed: 6.8.4-3
proxmox-kernel-6.8.4-2-pve-signed: 6.8.4-2
proxmox-kernel-6.5.13-6-pve-signed: 6.5.13-6
proxmox-kernel-6.5: 6.5.13-6
proxmox-kernel-6.5.13-5-pve-signed: 6.5.13-5
proxmox-kernel-6.5.13-1-pve-signed: 6.5.13-1
proxmox-kernel-6.5.11-8-pve-signed: 6.5.11-8
proxmox-kernel-6.5.11-7-pve-signed: 6.5.11-7
pve-kernel-5.15.131-2-pve: 5.15.131-3
pve-kernel-5.15.102-1-pve: 5.15.102-1
ceph-fuse: 17.2.7-pve3
corosync: 3.1.7-pve3
criu: 3.17.1-2+deb12u1
frr-pythontools: 8.5.2-1+pve1
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx11
ksm-control-daemon: 1.5-1
libjs-extjs: 7.0.0-5
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.5.1
libproxmox-backup-qemu0: 1.4.1
libproxmox-rs-perl: 0.3.4
libpve-access-control: 8.2.0
libpve-apiclient-perl: 3.3.2
libpve-cluster-api-perl: 8.0.10
libpve-cluster-perl: 8.0.10
libpve-common-perl: 8.2.9
libpve-guest-common-perl: 5.1.6
libpve-http-server-perl: 5.1.2
libpve-network-perl: 0.10.0
libpve-rs-perl: 0.9.1
libpve-storage-perl: 8.3.2
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 6.0.0-1
lxcfs: 6.0.0-pve2
novnc-pve: 1.5.0-1
proxmox-backup-client: 3.3.2-1
proxmox-backup-file-restore: 3.3.2-2
proxmox-firewall: 0.6.0
proxmox-kernel-helper: 8.1.0
proxmox-mail-forward: 0.3.1
proxmox-mini-journalreader: 1.4.0
proxmox-widget-toolkit: 4.3.3
pve-cluster: 8.0.10
pve-container: 5.2.2
pve-docs: 8.3.1
pve-edk2-firmware: 4.2023.08-4
pve-esxi-import-tools: 0.7.2
pve-firewall: 5.1.0
pve-firmware: 3.14-1
pve-ha-manager: 4.0.6
pve-i18n: 3.3.2
pve-qemu-kvm: 9.0.2-4
pve-xtermjs: 5.3.0-3
qemu-server: 8.3.3
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.6-pve1

Code:
root@pve2:~# head -n -0 /etc/apt/sources.list /etc/apt/sources.list.d/*
==> /etc/apt/sources.list <==
deb http://ftp.us.debian.org/debian bookworm main contrib

deb http://ftp.us.debian.org/debian bookworm-updates main contrib

# security updates
deb http://security.debian.org bookworm-security main contrib

==> /etc/apt/sources.list.d/ceph.list <==
deb https://enterprise.proxmox.com/debian/ceph-quincy bookworm enterprise

Code:
==> /etc/apt/sources.list.d/pve-enterprise.list <==
deb https://enterprise.proxmox.com/debian/pve bookworm pve-enterprise
root@pve2:~# journalctl -u corosync
Jun 18 12:29:59 pve2 corosync[4668]:   [TOTEM ] Token has not been received in 2250 ms
Jun 18 12:30:00 pve2 corosync[4668]:   [TOTEM ] A processor failed, forming new configuration: token timed out (3000ms), waiting 3600ms for>
Jun 18 12:30:03 pve2 corosync[4668]:   [QUORUM] Sync members[1]: 2
Jun 18 12:30:03 pve2 corosync[4668]:   [QUORUM] Sync left[1]: 1
Jun 18 12:30:03 pve2 corosync[4668]:   [VOTEQ ] waiting for quorum device Qdevice poll (but maximum for 30000 ms)
Jun 18 12:30:03 pve2 corosync[4668]:   [TOTEM ] A new membership (2.2a72) was formed. Members left: 1
Jun 18 12:30:03 pve2 corosync[4668]:   [TOTEM ] Failed to receive the leave message. failed: 1
Jun 18 12:30:04 pve2 corosync[4668]:   [QUORUM] Members[1]: 2
Jun 18 12:30:04 pve2 corosync[4668]:   [MAIN  ] Completed service synchronization, ready to provide service.
Jun 18 12:30:06 pve2 corosync[4668]:   [QUORUM] Sync members[2]: 1 2
Jun 18 12:30:06 pve2 corosync[4668]:   [QUORUM] Sync joined[1]: 1
Jun 18 12:30:06 pve2 corosync[4668]:   [VOTEQ ] waiting for quorum device Qdevice poll (but maximum for 30000 ms)
Jun 18 12:30:06 pve2 corosync[4668]:   [TOTEM ] A new membership (1.2a76) was formed. Members joined: 1
Jun 18 12:30:06 pve2 corosync[4668]:   [QUORUM] Members[2]: 1 2
Jun 18 12:30:06 pve2 corosync[4668]:   [MAIN  ] Completed service synchronization, ready to provide service.
Jun 18 12:30:13 pve2 corosync[4668]:   [CFG   ] Node 1 was shut down by sysadmin
Jun 18 12:30:13 pve2 corosync[4668]:   [QUORUM] Sync members[1]: 2
Jun 18 12:30:13 pve2 corosync[4668]:   [QUORUM] Sync left[1]: 1
Jun 18 12:30:13 pve2 corosync[4668]:   [VOTEQ ] waiting for quorum device Qdevice poll (but maximum for 30000 ms)
Jun 18 12:30:13 pve2 corosync[4668]:   [TOTEM ] A new membership (2.2a7a) was formed. Members left: 1
Jun 18 12:30:13 pve2 corosync[4668]:   [QUORUM] Members[1]: 2
Jun 18 12:30:13 pve2 corosync[4668]:   [MAIN  ] Completed service synchronization, ready to provide service.
Jun 18 12:30:14 pve2 corosync[4668]:   [KNET  ] link: host: 1 link: 0 is down
Jun 18 12:30:14 pve2 corosync[4668]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Jun 18 12:30:14 pve2 corosync[4668]:   [KNET  ] host: host: 1 has no active links
Jun 18 12:31:14 pve2 corosync[4668]:   [KNET  ] link: Resetting MTU for link 0 because host 1 joined
Jun 18 12:31:14 pve2 corosync[4668]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Jun 18 12:31:14 pve2 corosync[4668]:   [QUORUM] Sync members[2]: 1 2
Jun 18 12:31:14 pve2 corosync[4668]:   [QUORUM] Sync joined[1]: 1
Jun 18 12:31:14 pve2 corosync[4668]:   [VOTEQ ] waiting for quorum device Qdevice poll (but maximum for 30000 ms)
Jun 18 12:31:14 pve2 corosync[4668]:   [TOTEM ] A new membership (1.2a7f) was formed. Members joined: 1
Jun 18 12:31:14 pve2 corosync[4668]:   [QUORUM] Members[2]: 1 2
Jun 18 12:31:14 pve2 corosync[4668]:   [MAIN  ] Completed service synchronization, ready to provide service.
Jun 18 12:31:15 pve2 corosync[4668]:   [KNET  ] pmtud: Global data MTU changed to: 1397
Jul 04 12:59:39 pve2 corosync[4668]:   [CFG   ] Node 1 was shut down by sysadmin
Jul 04 12:59:39 pve2 corosync[4668]:   [QUORUM] Sync members[1]: 2
Jul 04 12:59:39 pve2 corosync[4668]:   [QUORUM] Sync left[1]: 1
Jul 04 12:59:39 pve2 corosync[4668]:   [VOTEQ ] waiting for quorum device Qdevice poll (but maximum for 30000 ms)
Jul 04 12:59:39 pve2 corosync[4668]:   [TOTEM ] A new membership (2.2a83) was formed. Members left: 1
Jul 04 12:59:39 pve2 corosync[4668]:   [QUORUM] Members[1]: 2
Jul 04 12:59:39 pve2 corosync[4668]:   [MAIN  ] Completed service synchronization, ready to provide service.
Jul 04 12:59:39 pve2 corosync[4668]:   [KNET  ] link: host: 1 link: 0 is down
Jul 04 12:59:39 pve2 corosync[4668]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Jul 04 12:59:39 pve2 corosync[4668]:   [KNET  ] host: host: 1 has no active links
Jul 04 13:00:28 pve2 corosync[4668]:   [KNET  ] link: Resetting MTU for link 0 because host 1 joined
Jul 04 13:00:28 pve2 corosync[4668]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Jul 04 13:00:28 pve2 corosync[4668]:   [KNET  ] pmtud: Global data MTU changed to: 1397
Jul 04 13:00:28 pve2 corosync[4668]:   [QUORUM] Sync members[2]: 1 2
Jul 04 13:00:28 pve2 corosync[4668]:   [QUORUM] Sync joined[1]: 1
 
Additional Info because the content was to large:

Code:
root@pve2:~# cat /etc/network/interfaces
# network interface settings; autogenerated
# Please do NOT modify this file directly, unless you know what
# you're doing.
#
# If you want to manage parts of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT read its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!

auto lo
iface lo inet loopback

auto eno1
iface eno1 inet manual

auto eno2
iface eno2 inet manual

iface usb0 inet manual

auto enp66s0f0
iface enp66s0f0 inet manual

auto enp66s0f1
iface enp66s0f1 inet manual

iface enxbe3af2b6059f inet manual

auto bond0
iface bond0 inet manual
    bond-slaves enp66s0f0 enp66s0f1
    bond-miimon 100
    bond-mode 802.3ad
    bond-xmit-hash-policy layer3+4

auto vmbr0
iface vmbr0 inet static
    address 192.168.2.8/24
    gateway 192.168.2.1
    bridge-ports eno1
    bridge-stp off
    bridge-fd 0
    bridge-vlan-aware yes
    bridge-vids 2-4094

auto vmbr2
iface vmbr2 inet manual
    bridge-ports none
    bridge-stp off
    bridge-fd 0

auto vmbr1
iface vmbr1 inet static
    address 192.168.2.6/24
    bridge-ports bond0
    bridge-stp off
    bridge-fd 0
    bridge-vlan-aware yes
    bridge-vids 2-4094

auto vmbr3
iface vmbr3 inet manual
    bridge-ports none
    bridge-stp off
    bridge-fd 0

source /etc/network/interfaces.d/*

Code:
root@pve2:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
    link/ether 3c:ec:ef:9f:8a:dc brd ff:ff:ff:ff:ff:ff
    altname enp71s0f0
3: eno2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 3c:ec:ef:9f:8a:dd brd ff:ff:ff:ff:ff:ff
    altname enp71s0f1
4: enp66s0f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether 98:b7:85:1e:d8:d7 brd ff:ff:ff:ff:ff:ff
5: enp66s0f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
    link/ether 98:b7:85:1e:d8:d7 brd ff:ff:ff:ff:ff:ff permaddr 98:b7:85:1e:d8:d8
6: enxbe3af2b6059f: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether be:3a:f2:b6:05:9f brd ff:ff:ff:ff:ff:ff
7: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 3c:ec:ef:9f:8a:dc brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.8/24 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 fe80::3eec:efff:fe9f:8adc/64 scope link
       valid_lft forever preferred_lft forever
8: vmbr2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 5a:29:cc:1f:03:a1 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::5452:31ff:fe98:39cf/64 scope link
       valid_lft forever preferred_lft forever
9: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr1 state UP group default qlen 1000
    link/ether 98:b7:85:1e:d8:d7 brd ff:ff:ff:ff:ff:ff
10: vmbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 98:b7:85:1e:d8:d7 brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.6/24 scope global vmbr1
       valid_lft forever preferred_lft forever
    inet6 fe80::9ab7:85ff:fe1e:d8d7/64 scope link
       valid_lft forever preferred_lft forever
11: vmbr3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 22:9b:8f:b8:63:01 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::209b:8fff:feb8:6301/64 scope link
       valid_lft forever preferred_lft forever
12: ln_EsxLbVnt@pr_EsxLbVnt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master EsxLbVnt state UP group default qlen 1000
    link/ether 5e:17:61:99:e6:3b brd ff:ff:ff:ff:ff:ff
13: pr_EsxLbVnt@ln_EsxLbVnt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr2v1337 state UP group default qlen 1000
    link/ether a6:60:18:c3:23:41 brd ff:ff:ff:ff:ff:ff
14: EsxLbVnt: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 5e:17:61:99:e6:3b brd ff:ff:ff:ff:ff:ff
    inet6 fe80::5c17:61ff:fe99:e63b/64 scope link
       valid_lft forever preferred_lft forever
15: vmbr2v1337: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether a6:60:18:c3:23:41 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::a460:18ff:fec3:2341/64 scope link
       valid_lft forever preferred_lft forever
17: tap4102i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN group default qlen 1000
    link/ether b6:a2:24:70:05:de brd ff:ff:ff:ff:ff:ff
19: tap4209i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN group default qlen 1000
    link/ether c2:bc:a0:4b:c8:7e brd ff:ff:ff:ff:ff:ff
20: tap4213i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN group default qlen 1000
    link/ether 12:35:02:7d:a2:6b brd ff:ff:ff:ff:ff:ff
21: tap4214i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN group default qlen 1000
    link/ether 9e:c8:fc:7a:57:32 brd ff:ff:ff:ff:ff:ff
22: tap4215i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr4215i0 state UNKNOWN group default qlen 1000
    link/ether d6:07:4a:3d:b2:e2 brd ff:ff:ff:ff:ff:ff
23: fwbr4215i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 62:e9:d3:f2:f5:7f brd ff:ff:ff:ff:ff:ff
24: fwpr4215p0@fwln4215i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr1 state UP group default qlen 1000
    link/ether 4a:08:9d:ef:27:5c brd ff:ff:ff:ff:ff:ff
25: fwln4215i0@fwpr4215p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr4215i0 state UP group default qlen 1000
    link/ether 62:e9:d3:f2:f5:7f brd ff:ff:ff:ff:ff:ff
26: tap4216i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr4216i0 state UNKNOWN group default qlen 1000
    link/ether ba:02:29:f0:34:16 brd ff:ff:ff:ff:ff:ff
27: fwbr4216i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether a6:43:01:8a:30:44 brd ff:ff:ff:ff:ff:ff
28: fwpr4216p0@fwln4216i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr1 state UP group default qlen 1000
    link/ether 46:0e:61:09:09:83 brd ff:ff:ff:ff:ff:ff
29: fwln4216i0@fwpr4216p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr4216i0 state UP group default qlen 1000
    link/ether a6:43:01:8a:30:44 brd ff:ff:ff:ff:ff:ff
30: tap4217i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr4217i0 state UNKNOWN group default qlen 1000
    link/ether ca:f9:c3:48:81:b9 brd ff:ff:ff:ff:ff:ff
31: fwbr4217i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 12:96:e8:38:a8:cc brd ff:ff:ff:ff:ff:ff
32: fwpr4217p0@fwln4217i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr1 state UP group default qlen 1000
    link/ether d6:1a:46:1c:1b:e7 brd ff:ff:ff:ff:ff:ff
33: fwln4217i0@fwpr4217p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr4217i0 state UP group default qlen 1000
    link/ether 12:96:e8:38:a8:cc brd ff:ff:ff:ff:ff:ff
35: tap11000i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr11000i0 state UNKNOWN group default qlen 1000
    link/ether f2:c3:79:7c:8f:5d brd ff:ff:ff:ff:ff:ff
36: fwbr11000i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 9e:a9:8c:d9:15:54 brd ff:ff:ff:ff:ff:ff
37: fwpr11000p0@fwln11000i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr1 state UP group default qlen 1000
    link/ether 42:51:67:bf:f2:18 brd ff:ff:ff:ff:ff:ff
38: fwln11000i0@fwpr11000p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr11000i0 state UP group default qlen 1000
    link/ether 9e:a9:8c:d9:15:54 brd ff:ff:ff:ff:ff:ff
39: tap3006i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN group default qlen 1000
    link/ether 02:3c:8e:fa:33:55 brd ff:ff:ff:ff:ff:ff
40: tap3006i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr2 state UNKNOWN group default qlen 1000
    link/ether 5a:29:cc:1f:03:a1 brd ff:ff:ff:ff:ff:ff
43: tap1900i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN group default qlen 1000
    link/ether ca:a1:40:51:8e:9e brd ff:ff:ff:ff:ff:ff

Code:
root@pve2:~# journalctl --since '2025-01-13' > journal.txt
The journalctl output is to large to post as an attachment but can provide directly if desired.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!