Ceph - Write speed

AndreCast

New Member
Jan 19, 2023
4
0
1
Hi to all,
i'm testing ceph to migrate my VMs from NFS.

I have some doubts about performance:

3 nodes
3x sata SSD 560/540MB/s read/write

In theory what speed should i achive read and write in MB/s? a 1GB network can limit bandwidth?

thank you!!
 
Hi to all,
i'm testing ceph to migrate my VMs from NFS.

I have some doubts about performance:

3 nodes
3x sata SSD 560/540MB/s read/write

In theory what speed should i achive read and write in MB/s? a 1GB network can limit bandwidth?

thank you!!

Do you have 3 sata ssds per node or in total so only 1 per node? Ceph performance heavily depends on network and also needs some ram/cpu to work good . Usually you should not go below 10Gbit/s network for ceph. Theoretical you cant archieve better then 100MB/s (1GBit/s is maximal 100MB/s) You also need to think about replication factor, so data needs to be written twice until a ACK comes to a write in ceph storage. So 2 of 3 repliacs need to be writen, and every write goes over the network.

Whats the reason to go for ceph for you personally?
 
In this test i used 1 ssd for each node.
my question was only for understand the theory behind ceph: assuming there ins't limit from network, how can i calculate the "nominal" read/write speed?

this is only a test to evaluate the best choice between ceph and a nas synology HA.

thank you!
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!