7 mechanical disks in each node using xfs
3 nodes so 21 OSDs total
I've started moving journals to SSD which is only helping write performance.
CEPH nodes still running Proxmox 3.x
I have client nodes running 4.x and 3.x, both have the same issue.
Using 10G IPoIB, separate public/private...