Proxmox8 - Writing and reading speed test on SSD drives?

[osalj]

Hi,

I have a server with Proxmox 8 (HPE DL380Gen10).
The raid controller is set to HBA mode and all drives are visible in the system.
6x 1TB SSD Crucial MX500

I have two raids (zf) created in PROXMOX:
- raid 1
- raid 10

What's the best way to test read and write speeds on these drives?

 

[bbgeek17]

fio is the industry standard way to test performance of a disk.

Good luck.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[_gabriel]

double monitoring your MX500, they will wear out quickly, you can already buy spares.
ZFS double at best the WRITES on disks.
+ Non PLP SSDs will suffer in WRITE speed.

 

[osalj]

I did this test on disks in raid 1 with the command:

fio --filename=test1 --size=12GB --direct=1 --rw=randrw --bs=64k --ioengine=libaio --iodepth=64 --runtime=120 --numjobs=4 --time_based --group_reporting --name=throughput-test-job --eta-newline=1

But the result seems to me to be very poor:

Run status group 0 (all jobs):
   READ: bw=101MiB/s (106MB/s), 101MiB/s-101MiB/s (106MB/s-106MB/s), io=11.9GiB (12.7GB), run=120002-120002msec
  WRITE: bw=101MiB/s (106MB/s), 101MiB/s-101MiB/s (106MB/s-106MB/s), io=11.9GiB (12.7GB), run=120002-120002msec

 

[osalj]

What exactly parameters should you add to fio when you test the writing and reading speed of your disks?

 

[bbgeek17]

You have a consumer disk. It will have a burst of performance and will quickly run out of steam on prolonged access.

There are many examples here: https://github.com/axboe/fio/tree/master/examples

We also have some examples of FIO job files :
https://kb.blockbridge.com/technote/proxmox-tuning-low-latency-storage/#description
https://kb.blockbridge.com/technote/proxmox-aio-vs-iouring/index.html#description
https://kb.blockbridge.com/technote/proxmox-vs-vmware-nvmetcp/#description

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox