Probleme mit neuer Proxmox installation

konabi

Active Member
Dec 14, 2013
108
4
38
Hallo,
nach einem Hardwaredefekt wurden auf einem Server verschiedene Komponenten gewechselt:
Arbeitsspeicher, Festplattencontroller...
ich habe einen neuen Proxmox Server installiert und verschiedene Probleme.
Mal brechen die Netzwerkverbindungen zu den VMs oder zum Host selber ab.
Dann stürzen verschiedene VMs mit Kernelpanik ab, oder zeigen Fehler im Dateisystem.

Auf dem Host zeigt mir dmesg folgende Meldungen:
Code:
[    3.706956] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    3.706963] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    3.706969] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[    3.706973] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    3.706976] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    3.706979] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    3.706981] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    3.706984] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    3.706986] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    3.706989] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    3.706991] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    3.706994] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    3.706997] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    3.707000] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    3.707002] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    3.707005] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    3.707008] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    3.707010] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[    3.707014] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[    3.707018] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[    3.707022] EDAC sbridge: Seeking for: PCI ID 8086:6f6c
[    3.707025] EDAC sbridge: Seeking for: PCI ID 8086:6f6d
[    3.707029] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    3.707031] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    3.707035] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    3.707036] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    3.707040] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    3.707042] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    3.707152] EDAC MC0: Giving out device to module sb_edac.c controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT)
[    3.707162] EDAC sbridge: Some needed devices are missing
[    3.740132] EDAC MC: Removed device 0 for sb_edac.c Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0
[    3.740145] EDAC sbridge: Couldn't find mci handler
[    3.740146] EDAC sbridge: Failed to register device with error -19.
[    3.824293] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    3.824296] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    3.824300] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[    3.824304] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    3.824305] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    3.824308] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    3.824310] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    3.824313] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    3.824314] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    3.824317] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    3.824319] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    3.824321] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    3.824323] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    3.824326] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    3.824327] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    3.824330] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    3.824332] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    3.824335] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[    3.824338] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[    3.824342] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[    3.824346] EDAC sbridge: Seeking for: PCI ID 8086:6f6c
[    3.824350] EDAC sbridge: Seeking for: PCI ID 8086:6f6d
[    3.824354] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    3.824355] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    3.824358] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    3.824359] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    3.824363] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    3.824364] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    3.824474] EDAC MC0: Giving out device to module sb_edac.c controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT)
[    3.824484] EDAC sbridge: Some needed devices are missing
[    3.824873] intel_rapl: Found RAPL domain package
[    3.824876] intel_rapl: Found RAPL domain dram
[    3.824877] intel_rapl: DRAM domain energy unit 15300pj
[    3.842708] ipmi_si dmi-ipmi-si.0: Found new BMC (man_id: 0x000157, prod_id: 0x006f, dev_id: 0x21)
[    3.842744] ipmi_si dmi-ipmi-si.0: IPMI kcs interface initialized
[    3.843495] IPMI SSIF Interface driver
[    3.851988] EDAC MC: Removed device 0 for sb_edac.c Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0
[    3.852004] EDAC sbridge: Couldn't find mci handler
[    3.852005] EDAC sbridge: Failed to register device with error -19.
[    3.908221] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    3.908224] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    3.908228] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[    3.908232] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    3.908233] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    3.908236] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    3.908238] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    3.908241] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    3.908242] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    3.908245] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    3.908247] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    3.908249] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    3.908251] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    3.908254] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    3.908255] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    3.908258] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    3.908260] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    3.908263] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[    3.908267] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[    3.908270] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[    3.908274] EDAC sbridge: Seeking for: PCI ID 8086:6f6c
[    3.908278] EDAC sbridge: Seeking for: PCI ID 8086:6f6d
[    3.908282] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    3.908283] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    3.908286] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    3.908287] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    3.908291] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    3.908292] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    3.908398] EDAC MC0: Giving out device to module sb_edac.c controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT)
[    3.908408] EDAC sbridge: Some needed devices are missing
[    3.932000] EDAC MC: Removed device 0 for sb_edac.c Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0
[    3.932016] EDAC sbridge: Couldn't find mci handler
[    3.932017] EDAC sbridge: Failed to register device with error -19.
[    3.947309] Console: switching to colour frame buffer device 128x48
[    3.970796] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device
[    4.007969] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0
[    4.044477] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    4.044481] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    4.044487] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[    4.044492] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    4.044494] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    4.044498] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    4.044501] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    4.044505] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    4.044507] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    4.044511] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    4.044513] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    4.044517] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    4.044520] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    4.044523] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    4.044526] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    4.044529] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    4.044532] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    4.044536] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[    4.044542] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[    4.044547] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[    4.044553] EDAC sbridge: Seeking for: PCI ID 8086:6f6c
[    4.044559] EDAC sbridge: Seeking for: PCI ID 8086:6f6d
[    4.044564] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    4.044566] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    4.044571] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    4.044573] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    4.044578] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    4.044580] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    4.044751] EDAC MC0: Giving out device to module sb_edac.c controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT)
[    4.044767] EDAC sbridge: Some needed devices are missing
[    4.088022] EDAC MC: Removed device 0 for sb_edac.c Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0
[    4.088038] EDAC sbridge: Couldn't find mci handler
[    4.088056] EDAC sbridge: Failed to register device with error -19.
[    4.160235] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    4.160238] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    4.160242] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[    4.160246] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    4.160248] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    4.160251] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    4.160253] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    4.160256] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    4.160257] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    4.160260] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    4.160262] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    4.160265] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    4.160267] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    4.160270] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    4.160271] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    4.160274] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    4.160276] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    4.160279] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[    4.160283] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[    4.160287] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[    4.160291] EDAC sbridge: Seeking for: PCI ID 8086:6f6c
[    4.160295] EDAC sbridge: Seeking for: PCI ID 8086:6f6d
[    4.160299] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    4.160300] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    4.160303] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    4.160305] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    4.160308] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    4.160310] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    4.160444] EDAC MC0: Giving out device to module sb_edac.c controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT)
[    4.160462] EDAC sbridge: Some needed devices are missing
[    4.188022] EDAC MC: Removed device 0 for sb_edac.c Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0
[    4.188038] EDAC sbridge: Couldn't find mci handler
[    4.188065] EDAC sbridge: Failed to register device with error -19.
[    4.232205] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    4.232208] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    4.232212] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[    4.232216] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    4.232218] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    4.232221] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    4.232222] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    4.232225] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    4.232227] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    4.232230] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    4.232231] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    4.232235] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    4.232236] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    4.232239] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    4.232241] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    4.232244] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    4.232246] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    4.232249] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[    4.232252] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[    4.232256] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[    4.232260] EDAC sbridge: Seeking for: PCI ID 8086:6f6c
[    4.232264] EDAC sbridge: Seeking for: PCI ID 8086:6f6d
[    4.232268] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    4.232270] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    4.232273] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    4.232274] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    4.232278] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    4.232279] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    4.232388] EDAC MC0: Giving out device to module sb_edac.c controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT)
[    4.232398] EDAC sbridge: Some needed devices are missing
[    4.259997] EDAC MC: Removed device 0 for sb_edac.c Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0
[    4.260014] EDAC sbridge: Couldn't find mci handler
[    4.260033] EDAC sbridge: Failed to register device with error -19.
[    4.324161] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    4.324164] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    4.324169] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[    4.324173] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    4.324174] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[    4.324177] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    4.324179] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[    4.324182] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    4.324184] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[    4.324187] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    4.324188] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[    4.324191] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    4.324193] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[    4.324196] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    4.324197] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[    4.324200] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    4.324203] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[    4.324205] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[    4.324209] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[    4.324213] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[    4.324217] EDAC sbridge: Seeking for: PCI ID 8086:6f6c
[    4.324221] EDAC sbridge: Seeking for: PCI ID 8086:6f6d
[    4.324225] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    4.324226] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[    4.324230] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    4.324231] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[    4.324234] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    4.324236] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[    4.324344] EDAC MC0: Giving out device to module sb_edac.c controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT)
[    4.324354] EDAC sbridge: Some needed devices are missing
[    4.351965] EDAC MC: Removed device 0 for sb_edac.c Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0
[    4.351981] EDAC sbridge: Couldn't find mci handler
[    4.352000] EDAC sbridge: Failed to register device with error -19.

Könnte das im Zusammenhang mit den Netzwerkabrüchen und Abstürzen stehen.
Wo kann man noch mehr Informationen zu den Abstürzen finden.

Anbei die Proxmox Version:
Code:
proxmox-ve: 5.1-31 (running kernel: 4.13.13-1-pve)
pve-manager: 5.1-40 (running version: 5.1-40/ea05b379)
pve-kernel-4.13.4-1-pve: 4.13.4-26
pve-kernel-4.13.13-1-pve: 4.13.13-31
libpve-http-server-perl: 2.0-8
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-19
qemu-server: 5.0-18
pve-firmware: 2.0-3
libpve-common-perl: 5.0-25
libpve-guest-common-perl: 2.0-14
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.1-12
pve-qemu-kvm: 2.9.1-5
pve-container: 2.0-18
pve-firewall: 3.0-5
pve-ha-manager: 2.0-4
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.1-2
lxcfs: 2.0.8-1
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.3-pve1~bpo9

Ich bin dankbar für jede Hilfe.

Sven
 
Eventuell ist der Fehler mit kernel commit 939f509d274541e32b1350ddc7f9d16d16617538 fort? Der commit ist auf jeden Fall nicht im Proxmox kernel.

sieht nach einem kandidaten aus - kommt auf die todo liste ;)
 
the commit in question is part of kernel 4.15 ;) so yeah, all subsequent kernels have it - although it is of course possible that the commit in question doesn't fix it, or it got broken again afterwards..
 
I am talking about regular upstream linux kernels which all the distro kernels are derived from.
 
  • Like
Reactions: Spirog
I am talking about regular upstream linux kernels which all the distro kernels are derived from.
ok thanks so I need to check upstream and post a bug for debian ?
sorry kind of a newbie
I tried to check journalctl and i have to scroll alot down still trying to see when it started I have nov 2021 to today in journal. not sure how to logrotate so its not so long lol
 
no - first you need to find out what the actual problem is (and whether there actually is a problem other than a bit of noisy logging at bootup once?). PVE doesn't use Debian's kernel, so filing a bug with them will just annoy them.
 
  • Like
Reactions: Spirog

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!