Replication 3 to 2 - ceph - pgs degraded

sahostking

Renowned Member
I think I may have found something.

I had an issue with diskspace and hence changed from replication x3 to x2 knowing the possible risks.

However it was to be temporary while I add more OSDs.

But when I add more OSDs to new servers now I am noticing very high IO wait and servers "freeze".

I am thinking its because it pauses the PGS it is copying over to new disks? This is the issue you have with replicate x2.

When I had replication x3 with 5 nodes never had this issue. Adding more seems to be the issue now changing after replication x2.

I'll be changing back to x3 rather but just wanted to know if anyone experienced this or if my assumption is correct?
 
yip confirmed. Changed back to x3 replication now , no more VMs freezing due to high io wait when taking out OSDs and rebalancing happening. Everything still runs smoothly at a cost of a little performance penalty.
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!