If it still applies to someone:
For me the solution was to reduce the CPU units to 100 in "Hardware" > "Processors" (make sure you have "Advanced" checked) of the VM (Proxmox VE 6.2-10).
This issue also seems to affect most of BSD distros like pfsense and opnsense are.
