[SOLVED] Proxmox vs Openstack (kvm) slow performance for Windows Server 2022

[aloprozam]

Greetings community!


What's wrong with Proxmox for Windows systems? Recently migrated some hosts from Windows server 2012r2 to 2022 and performance it's so bad.
Best practices from Proxmox Wiki etc. applied !

Test Environment:
Dell PowerEdge R620
CPU: E5-2667 v2 3.3Ghz Base
RAM: DDR3 - 1866Mhz working speed
Storage: Ceph cluster - SAS3 - 12gbs - via 10gbe network cards.

VM Specs:
4Cx4Gb

Proxmox VM:
uefi - bios
host cpu with args without the same
virtio gpu or default one the same
q35 machine type
PCMark10 Score: 1387

Openstack VM (kvm):
Pure default config
no uefi
no q35 machine
PCMark10 Score: 2228

P.S.
Even on Dell R630 with E5-2690 v3 2.6Ghz Base, DDR4-2133 could not get Openstack VM score.

 

[_gabriel]

Proxmox use last LTS Ubuntu Kernel with all CPU mitigations enabled which taxes old CPU like yours.
try add mitigations=off as kernel option.
if grub boot loader (ext4 + ZFS Secure Boot Enabled) :
nano /etc/default/grub
then update-grub
if systemd-boot loader (only ZFS and Non Secure Boot) :
nano /etc/kernel/cmdline
proxmox-boot-tool refresh

 

[aloprozam]

Proxmox use last LTS Ubuntu Kernel with all CPU mitigations enabled which taxes old CPU like yours.
try add mitigations=off as kernel option.
if grub boot loader :
nano /etc/default/grub
then update-grub
if systemd-boot loader (when ZFS) :
nano /etc/kernel/cmdline
proxmox-boot-tool refresh

Nothing changed..... same 1300-1400 points.....

 

[_gabriel]

reboot is required.
cat /proc/cmdline to check mitigations=off is set.

 

[aloprozam]

reboot is required.
cat /proc/cmdline to check mitigations=off is set.

Of course.

BOOT_IMAGE=/boot/vmlinuz-6.8.8-2-pve root=/dev/mapper/pve-root ro quiet mitigations=off

 

[_gabriel]

I not yet tried PCMark10, is there a detail about score math ? is there detail / cpu / ram / disk / gpu ?
Try another like PassMark , there is the well know CPU multi score and single score or Geeekbench or cpu-Z embedded cpu.

 

[aloprozam]

Let's say i'm pretty disappointed in Proxmox......practically the same kvm but with no tune - Openstack kvm version shows who is the winner.
Useful Proxmox ? Yes, for Ceph integration ))))

Nothing changed after all workarounds :
BOOT_IMAGE=/boot/vmlinuz-6.8.8-2-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on iommu=pt mitigations=off spectre_v2_user=off l1tf=off mds=off tsx_async_abort=off nx_huge_pages=off nopti tsx_async_abort=off kvm.nx_huge_pages=off

 

[aloprozam]

I not yet tried PCMark10, is there a detail about score math ? is there detail / cpu / ram / disk / gpu ?
Try another like PassMark , there is the well know CPU multi score and single score or Geeekbench or cpu-Z embedded cpu.

Thanks for helping.

 

[_gabriel]

Nothing changed after all workarounds :
BOOT_IMAGE=/boot/vmlinuz-6.8.8-2-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on iommu=pt mitigations=off spectre_v2_user=off l1tf=off mds=off tsx_async_abort=off nx_huge_pages=off nopti tsx_async_abort=off kvm.nx_huge_pages=off

mitigations=off already disable the others, they aren't needed.

 

[aloprozam]

mitigations=off already disable the others, they aren't needed.

Anycase nothing changed.

 

[alexskysilk]

check underlying storage
host bus configuration
iothreads
presence of qemu-guest-agent and drivers/tools

 

[_gabriel]

I wait new box to re-test baremetal / pve / with pcmark10 and passmark.
with an i7-13700KF, I'm wondering if old/new cpu have big impact or not too.

edit: Just found an host with E5-2667v2 on HP ML350g8, will try PCMark10

 

[aloprozam]

I wait new box to re-test baremetal / pve / with pcmark10 and passmark.
with an i7-13700KF, I'm wondering if old/new cpu have big impact or not too.

edit: Just found an host with E5-2667v2 on HP ML350g8, will try PCMark10

How is going? How many points PCMark10 test showed?

 

[_gabriel]

How is going? How many points PCMark10 test showed?

I haven't license for PCMARK 10, so I tried the allowed benchmark seems called Basic.
On E5-2667v2 (2014 era , Passmark Single Thread 2018 ) 8x8GB , HP ML350g8, mitigations=off
HP Power Regulator = Dynamic Power Savings Mode
VM Storage : Local 2 x SAS 10k HDD 300 GB SFF disks behind HP raid P420i with 512 MB BBU :

edit: added VM Win2022 , 4cpu + 4GB RAM over Console :
Essentials 5226
App Start-up Score 6312
Video Conferencing Score 4378
Web Browsing Score 5167
Productivity 4299
Spreadsheets Score 3797
Writing Score 4869
Digital Content Creation 0
Photo Editing Score 1817
Rendering and Visualization Score 0
Video Editing Score 1476

VM Win2012r2 , 4vcpu + 4GB RAM , over Console :
Essentials 5595
App Start-up Score 8075
Video Conferencing Score 4090
Web Browsing Score 5304
Productivity 4665
Spreadsheets Score 4165
Writing Score 5227
Digital Content Creation 0
Photo Editing Score 1827
Rendering and Visualization Score 0
Video Editing Score 1451

edit2 added : Ryzen7 1700 (2017 era) PassMark Single Thread 2000 , mitigations=off
VM Win2022 / 4 vcpu + 4G RAM over Console :
Essentials 5806
App Start-up Score 10187
Video Conferencing Score 3891
Web Browsing Score 4937
Productivity 4477
Spreadsheets Score 3950
Writing Score 5075
Photo Editing Score 1767
Video Editing Score 1442

VM Win2012r2 , 16vcpu + 16GB RAM, over RDP (Idk if there impact) :
Essentials 6078
App Start-up Score 8249
Video Conferencing Score 5101
Web Browsing Score 5338
Productivity 4491
Spreadsheets Score 4001
Writing Score 5042
Digital Content Creation 0
Photo Editing Score 2999
Rendering and Visualization Score 0
Video Editing Score 1799

 

[_gabriel]

AMD EPYC 7302 / mid-2019 / 32c/64t 3 GHz ( Passmark Single Thread 2013 , same Single Thread score as E5-2667v2 )
HPE DL325 g10

PCMark10 Basic :

4 vcpu + 4 GB RAM over Console :
Essentials 7214
App Start-up Score 14607
Video Conferencing Score 4374
Web Browsing Score 5877
Productivity 5101
Spreadsheets Score 4406
Writing Score 5907
Digital Content Creation 0
Photo Editing Score 2170
Rendering and Visualization Score 0
Video Editing Score 1693


16 vcpu + 16 GB RAM over Console :
Essentials 7645
App Start-up Score 13176
Video Conferencing Score 5461
Web Browsing Score 6212
Productivity 4932
Spreadsheets Score 4305
Writing Score 5652
Digital Content Creation 0
Photo Editing Score 3506
Rendering and Visualization Score 0
Video Editing Score 2456

 

[aloprozam]

Bios -> Profile -> Performance: changed from Performance DAPC to Performance.