I have the same problem on 2 different home servers - Odroid-H2 and i5-2500k based.
I just create a minimal Debian Buster VM without any graphics and it eats about 8-10% of CPU in idle.
I've changed all options for this VM in hardware tab, but to no avail.
Here is a video of Proxmox UI and top...