Ceph - how many replicas do you use?

nethfel

Member
Dec 26, 2014
151
0
16
Basically the title says it all - how many replicas do you use for your storage pools? I've been thinking 3 replicas for vms that I really need to be confident of the data durability due to hardware issues and 2 replicas for where I need speed but less redundancy. I was wondering what other people have chosen and why?
 
I would agree, 2 similar to raid1, 3 equal better durabiliity, all depends on how much concurrent failures you would like to be able to handle while keeping service available, price/durability vs price/perf I guess :)
 
I think that more replicas does not mean less speed. Read requests are spread between all replicas, so more replicas -- higher read speed. But you have more network load on write.
So it's more tradeoff between durability and price.
 
I think that more replicas does not mean less speed. Read requests are spread between all replicas, so more replicas -- higher read speed...
Hi,
AFAIK still not yet - the reads are from the primary only. And write speed drops with each replica, because of one more writing before ACK.

To answer the thread question, I started with replica 2 but with many OSDs it's a little bit dangerous, because 2 failed disks mean data loss (and not only some VM, because the data of all VMs nearly on all OSDs).
Now I use replica 3 and one EC-pool for archive-data with m=2, which mean that also 2 ODSs can fail without data loss.

Udo
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!