Dell R620 / Perc H710-1GB / Centos 8 / Kingston DC500M

prjc

Member
May 31, 2021
11
0
6
42
Hi,
i am testing above configuration with Proxmox 7 and Centos 8 as a VM. Setup:
Raid level, virtual disk
- 2x Kingston DC500M in RAID1
- Stripe 64kb
- Write Back

Proxmox 7
- using virtual drive from Dell/H710 as LVM storage

Centos 8 :
- VM in Proxmox 7
- drive sitting on that LVM

So, according to compability list, this should work fine.

I have tested Centos 8 box with no-cache, write-back storage

Proxmox 7 pveperf:
CPU BOGOMIPS: 96004.20
REGEX/SECOND: 1598214
HD SIZE: 1681.31 GB (/dev/mapper/pve-root)
BUFFERED READS: 406.80 MB/sec
AVERAGE SEEK TIME: 0.56 ms
FSYNCS/SECOND: 3280.97
DNS EXT: 21.84 ms
DNS INT: 19.35 ms (semtix.cz)

Proxmox fio
fio --ioengine=libaio --filename=/home/petr/fio --direct=1 --sync=1 --rw=write --bs=4K --numjobs=12 --iodepth=32 --runtime=60 --time_based --name=fio --filesize=1G

WRITE: bw=357MiB/s (374MB/s),
I see app 100k iops in Proxmox - which is completely fine for that drivers.

Centos 8 fio
fio --ioengine=libaio --filename=/home/petr/fio --direct=1 --sync=1 --rw=write --bs=4K --numjobs=12 --iodepth=32 --runtime=60 --time_based --name=fio --filesize=1G

WRITE: bw=40MiB/s (37MB/s),
I see maximum of 10k IOPS - which is 10x decrease compared to pure Proxmox. Bandwidth is unlimited etc, I have tried many other changes, but the storage IO caused by virutalization is insane. Can you point me what to try?
Thank you!
 
heh. I tried to install clean debian 10,11 on the same box, with the same settings, and IOPS loss is just 10% instead of 90% in case of Centos. What does Centos hate on Proxmox and Dell h710 Perc? There is a maximum bandwidth of 40MBPs using Centos compared to Debian (400MBPs)... insane