What else is your proxmox host running? Only this one vm? Can you post screenshot of top?
I don't know what can cause this, but maybe some power management?
Few usefull commands (need to install stuff of course), which I have in my notes:
apt install i7z linux-cpupower
x86_energy_perf_policy...