NVMe Poor Performance on Debian/Proxmox

[debian10]

Hello
We Use HP G9/G10 Server with Samsung 980 NVMe M.2 Disk,
when benchmark disk with hdparm -t option on Proxmox/Debian we get about 1600 MB/sec speed,
but when install Almalinux or Redhat Base distro on bare matel we get about 3000MB/sec speed.
we use normal Ext4 layout and test with another benchmark tools such a dd , ...
What do you think?
Thanks

 

[_gabriel]

don't forget Select scsi virtio single as controller, which is the faster.

edit : missing tests was only baremetal.

 

[debian10]

The problem is with proxmox debian itself, not vms

 

[leesteken]

when benchmark disk with hdparm -t option on Proxmox/Debian we get about 1600 MB/sec speed,
but when install Almalinux or Redhat Base distro on bare matel we get about 3000MB/sec speed.

It does not look like a Proxmox specific issue as Proxmox uses Debian but with a Ubuntu kernel. Can you test with Ubuntu 24.04 (and check both kernel versions)?
Even though it might not be a kernel issue, which kernel versions as used by the various Linux distributions you tested?
Maybe Debian has an older hdparm version than the others. Can you check the hdparm versions the various Linux distributions you tested?
"buffered disk reads" is a very poor indicator of actual real-world storage performance, but it might indicate a difference in the IO subsystem. Maybe the other distributions use different IO schedulers or even different events system for drive reads?

 

[LnxBil]

another benchmark tools such a dd , ...

Hopefully you also tried a real benchmark too, hdparm and dd are not real benchmark tools. Please try fio and report back for sequential and random read numbers.