Hello, unfortunatly was not able to solve the issues by reading. So any help is highly appreciated. My server isn't going into higher C-States, thus power consumption is rather high. With VMs running I sit in the 30-35W region, while with just Proxmox running, I get 26-27W. I think, my first step should be looking at the idle state without VMs running. There powertop indicates the package does not go beyond C3.
Currently running :

ASPM ( lspci -vv | awk '/ASPM/{print $0}' RS= | grep --color -P '(^[a-z0-9:.]+|ASPM;|Disabled;|Enabled
'):

Powertop with VM Running:

Powertop without VMs Running:

Not sure, what this (https://askubuntu.com/questions/1440049/how-to-update-possible-c-states/1440073#1440073) would suggest in that context:
Currently running :
- Proxmox 8.4.1
- Kernel: Linux 6.14.5-1-bpo12-pve
- 3VMs (Home Assitant, Ubuntu Server for Docker Containers, OpenMediaVault)
- Intel Core i5-14400
- Gigabyte B760M DS3H (DDR5) - Latest F21C Firmware
- 2x Samsung 990 Evo Plus MZ-V9S1T0BW (ZFS Pool VMs)
- 2x 32GB DDR5 (Crucial CT32G48C40U5)
- 550W Be-Quiet Pure Power 12 M BN341
- 1x SATA SSD (240GB Crucial BX500) - Proxmox OS Boot
- 2x SATA HDD (Seagate IronWolf 10TB ST10000VN0008) - Passthrough to OpenMediaVault VM
- 2x USB Donlge (SONOFF ZBDongle-E 3.0 / Homematic IP HmIP-RFUSB) - Passthrough to HomeAssistant VM
- Adjusted the BIOS settings (see below)
- Run https://github.com/notthebee/AutoASPM/blob/main/autoaspm.py, also on reboot - befor running this the following two devices would have been flaged as ASPM disabled (however, this seems to be not persistend)
- PCI bridge Intel Corporation Raptor Point-S PCH - PCI Express Root
- Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller
- Install Powertop 2.15 - and use auto-tune on startup
- Adjusted CPU Governor, also on reboot (echo "powersave" | tee /sys/devices/system/cpu/cpu*/cpufreq/scaling_governor)
- Active ASPM, also on reboot (echo -n powersupersave > /sys/module/pcie_aspm/parameters/policy)

ASPM ( lspci -vv | awk '/ASPM/{print $0}' RS= | grep --color -P '(^[a-z0-9:.]+|ASPM;|Disabled;|Enabled


Powertop with VM Running:

Powertop without VMs Running:

Not sure, what this (https://askubuntu.com/questions/1440049/how-to-update-possible-c-states/1440073#1440073) would suggest in that context:
Code:
root@pve:~# grep . /sys/devices/system/cpu/cpu0/cpuidle/state*/name
/sys/devices/system/cpu/cpu0/cpuidle/state0/name:POLL
/sys/devices/system/cpu/cpu0/cpuidle/state1/name:C1_ACPI
/sys/devices/system/cpu/cpu0/cpuidle/state2/name:C2_ACPI
/sys/devices/system/cpu/cpu0/cpuidle/state3/name:C3_ACPI
root@pve:~# grep . /sys/devices/system/cpu/cpu0/cpuidle/state*/desc
/sys/devices/system/cpu/cpu0/cpuidle/state0/desc:CPUIDLE CORE POLL IDLE
/sys/devices/system/cpu/cpu0/cpuidle/state1/desc:ACPI FFH MWAIT 0x0
/sys/devices/system/cpu/cpu0/cpuidle/state2/desc:ACPI FFH MWAIT 0x21
/sys/devices/system/cpu/cpu0/cpuidle/state3/desc:ACPI FFH MWAIT 0x60
root@pve:~# grep . /sys/devices/system/cpu/cpuidle/*
/sys/devices/system/cpu/cpuidle/available_governors:ladder menu teo
/sys/devices/system/cpu/cpuidle/current_driver:intel_idle
/sys/devices/system/cpu/cpuidle/current_governor:menu
/sys/devices/system/cpu/cpuidle/current_governor_ro:menu
/sys/devices/system/cpu/cpuidle/low_power_idle_cpu_residency_us:0
/sys/devices/system/cpu/cpuidle/low_power_idle_system_residency_us:0
Last edited: