In my home lab I use nested virtualisation.
Host machine (Fedora 43, kernel 6.18.2, Virtual Machine Manager, KVM):
VMs:
The problem is that my virtual machines with Proxmox VE nodes are experiencing kernel crashes intermittently.
There's no pattern. They can work for weeks without problems, or they can freeze twice a day.
What's interesting, node N3 without any payload can freeze too, definitely not often as nodes N1 & N2, but it can.
From Fedora's point of view there are no problem with Proxmox VE VMs - I can manage hanged nodes and see their pretty pink kernel crash screen
I can forcefully restart VM and node will run again.
Proxmox BS VM and linux VMs that hosted directly on Fedora are rock solid.
It's definitely not hardware problem, same config was on my old server (Ryzen 5900X/X470/128GB ECC DDR4) and same problem was there.
Initially that config worked perfectly (Proxmox VE 6.xx - Proxmox VE 7.yy ?). But at some point my nodes started to freeze.
Any suggestions on how to fix this freezing issue?
Host machine (Fedora 43, kernel 6.18.2, Virtual Machine Manager, KVM):
- Ryzen 9900x/Asus Prime X670-P-CSM
- DDR5 ECC RAM 192Gb
- dedicated 500Gb SATA SSD Samsung 870 (ext4) - for Proxmox VE node system images (qcow2)
- dedicated NVMe KINGSTON SKC3000S1024G (1Tb, ext4) - as shared storage for Proxmox VE nodes (through VirtIO FS)
VMs:
- Proxmox node N1 (10 vCPU/64Gb) - bunch of linux VMs
- Proxmox node N2 (10 vCPU/64Gb) - linux VMs and Windows VMs
- Proxmox node N3 (2 vCPU/8Gb) - as quorum node only (no VMs at all)
- Proxmox BS
- some of linux VMs
The problem is that my virtual machines with Proxmox VE nodes are experiencing kernel crashes intermittently.
There's no pattern. They can work for weeks without problems, or they can freeze twice a day.
What's interesting, node N3 without any payload can freeze too, definitely not often as nodes N1 & N2, but it can.
From Fedora's point of view there are no problem with Proxmox VE VMs - I can manage hanged nodes and see their pretty pink kernel crash screen
I can forcefully restart VM and node will run again.
Proxmox BS VM and linux VMs that hosted directly on Fedora are rock solid.
It's definitely not hardware problem, same config was on my old server (Ryzen 5900X/X470/128GB ECC DDR4) and same problem was there.
Initially that config worked perfectly (Proxmox VE 6.xx - Proxmox VE 7.yy ?). But at some point my nodes started to freeze.
Any suggestions on how to fix this freezing issue?