hepo's latest activity
-
hepo replied to the thread [SOLVED] Ceph (stretched cluster) performance troubleshooting.@VictorSTS, technically you are right, we are using 3rd datacenter only for MON and to maintain quorum in the event of datacenter failure. The Ceph Stretched Cluster is something we've looked into long time ago, it was only available with Pacific... -
hepo replied to the thread [SOLVED] Ceph (stretched cluster) performance troubleshooting.Easy, go with single datacenter if your business case allows it. The latency between datacenters will have significant impact on the ceph performance. Even if 1ms round trip. Additionally we have 4 copies of each image (vs 3 by default), this...
-
hepo replied to the thread [SOLVED] Ceph (stretched cluster) performance troubleshooting.Excellent response above, nothing to add. Just know our journey was from consumer to enterprise NVMe's, we never used SSD's for the Ceph cluster. With regards to crush map, I have found the following in our docs: ceph osd tree ceph osd crush...
-
hepo replied to the thread [SOLVED] Ceph (stretched cluster) performance troubleshooting.The results are from the following fio command executed directly on the NVMe's, ceph is not involved in this test... fio --ioengine=libaio --filename=/dev/nvme... --direct=1 --sync=1 --rw=write --bs=4K --numjobs=1 --iodepth=1 --runtime=60...