VM poor storage performance

maj0rmil4d

New Member
Nov 24, 2024
4
0
1
Hello there, I have a 5 node PM clsuter, ceph is configured, each node has a 3.84 TB ssd for OSD and 1 nvme drive for WAL/DB usage. ceph network is on 10G link and proxmox managmend network is on a 1G link

CEPH benchmark is as below :

READ ~= 1000 MB/S
Write ~= 1000 MB/S


I create a Windows vm and now inside windows storage performance is too slow
Even installed virtio drivers, check emulate SSD, Enbaled write back cache but no difference

What can I do ?

Please tell me what kind of details you want that I post here for troubleshooting
 

Attachments

  • lowspeed.png
    lowspeed.png
    77.3 KB · Views: 11
Thanks for your reply, I don't think this would be related to "multiple OSDs per node and 25G network", I included the benchmark results, I get almost 1000 MB/S with CEPH benchmark tool, I think something in Proxmox is limiting it, and I don't know where to check, its a clean fresh install cluster
 

Attachments

  • benchres.png
    benchres.png
    50.7 KB · Views: 7
Single thread performance like you have with one disk inside one VM will always be disappointing, especially with small block sizes.
You can just throw faster hardware at the problem.

BTW: Your rados bench uses 16 parallel threads and a block size of 4MB. This will show you nearly the maximum bandwidth achievable. It is not clear to me which block size the Windows benchmark did use.
 
Last edited:
  • Like
Reactions: Johannes S