PVE 8.1: missing ondemand CPU governor, high power usage & one kernel crash

[mhaluska]

Since upgrade to 8.1 and kernel 6.5, I'm experiencing high power usage on my system. With PVE 8.0 and kernel 6.2, power usage was around 7-8W, now with powersave governor usage is around 18-20W. Nothing else changed, same number of lxc/kvm, same CPU usage. System is most of time idling.

System: Asus MINIPC PN53 with 2x NVMe and 1x SATA SSD (all SSDs are enterprise class with PLP)

In kernel 6.5 I'm missing "ondemand" CPU governor, which I was using before and had optimal performance/watt usage.

# pveversion --verbose
proxmox-ve: 8.1.0 (running kernel: 6.5.11-4-pve)
pve-manager: 8.1.3 (running version: 8.1.3/b46aac3b42da5d15)
proxmox-kernel-helper: 8.0.9
pve-kernel-6.2: 8.0.5
proxmox-kernel-6.5.11-4-pve-signed: 6.5.11-4
proxmox-kernel-6.5: 6.5.11-4
proxmox-kernel-6.2.16-19-pve: 6.2.16-19
proxmox-kernel-6.2: 6.2.16-19
ceph-fuse: 17.2.6-pve1+3
corosync: 3.1.7-pve3
criu: 3.17.1-2
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx7
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-4
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.5.0
libproxmox-backup-qemu0: 1.4.0
libproxmox-rs-perl: 0.3.1
libpve-access-control: 8.0.7
libpve-apiclient-perl: 3.3.1
libpve-common-perl: 8.1.0
libpve-guest-common-perl: 5.0.6
libpve-http-server-perl: 5.0.5
libpve-network-perl: 0.9.4
libpve-rs-perl: 0.8.7
libpve-storage-perl: 8.0.5
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 5.0.2-4
lxcfs: 5.0.3-pve3
novnc-pve: 1.4.0-3
proxmox-backup-client: 3.0.4-1
proxmox-backup-file-restore: 3.0.4-1
proxmox-kernel-helper: 8.0.9
proxmox-mail-forward: 0.2.2
proxmox-mini-journalreader: 1.4.0
proxmox-widget-toolkit: 4.1.3
pve-cluster: 8.0.5
pve-container: 5.0.8
pve-docs: 8.1.3
pve-edk2-firmware: 4.2023.08-2
pve-firewall: 5.0.3
pve-firmware: 3.9-1
pve-ha-manager: 4.0.3
pve-i18n: 3.1.2
pve-qemu-kvm: 8.1.2-4
pve-xtermjs: 5.3.0-2
qemu-server: 8.0.10
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.0-pve3

And here is one crash from today morning, maybe not related to 8.1, but I never had such problem before on 8.0. Kernel log output attached.

 

[m0nji]

i'm also missing the ondemand governor after the 8.1.3 upgrade.

 

[vesikk]

I too am missing this feature on a proxmox system that was upgraded. However, on a system that was a fresh install I still have ondemand available. The system that lost 'on demand' is running a Ryzen 5 5600G + Asrock B450m Pro4 while the system that was a fresh install is running a Ryzen 5 3600 + Gigabyte B450M DS3H.. I might try a fresh install on the 5600G system later to see if anything changes.

 

[leesteken]

i'm also missing the ondemand governor after the 8.1.3 upgrade.

I too am missing this feature on a proxmox system that was upgraded. However, on a system that was a fresh install I still have ondemand available. The system that lost 'on demand' is running a Ryzen 5 5600G + Asrock B450m Pro4 while the system that was a fresh install is running a Ryzen 5 3600 + Gigabyte B450M DS3H.. I might try a fresh install on the 5600G system later to see if anything changes.

What is the output of cat /proc/cmdline? Did you set amd_pstate=active, which only supports performance and powersave? If so, try amd_pstate=guided instead.

 

[m0nji]

What is the output of cat /proc/cmdline? Did you set amd_pstate=active, which only supports performance and powersave? If so, try amd_pstate=guided instead.

i changed the cmdline to "amd_pstate=guided". i now have the ondemand governor available again. with the new kernel, the consumption is still high compared to the prior pve8.1 update. my server idled around 46-48W. with the pve 8.1 (6.5 kernel) i'm idling now around 59-62W.
Best efficency i can get with the 6.5 Kernel and amd_pstate=active is now "powersave" + "balance_performance" (54-56W). still not as good as before....