Full Ceph pool, but plenty of space on cluster?

[drholr]

Hello,
I am seeking clarification on a few of the terms seen on the dashboard in Proxmox (5.4) whilst using Ceph.

On the "Ceph" window, I see the usage indicator, in this case indicating 64% usage (32.66TB of 50.87TB used).



Then, when I view the storage pool by clicking on a node, then on the shared storage (ceph_vm in this case) I see a very full looking pool, 92.72% (15.44TB of 16.65TB). This pool has a size of 2, min of 1.




I don't remember setting an upper limit of 16.65TB to the pool, and I would like to provide ceph_vm more of the cluster's storage (given that it is only 64% full). How may I go about this please?

Thank you!

 

[Alwin]

16 * 2 = 32 TiB. It is a terrible idea to run 2/1 replica on a small cluster, the chance to loose data due to a subsequent failure is high. Run with 3/2, which means, increase the storage space or delete data.

When you run a ceph df tree you should see the data distribution. One ore more OSDs should have more data stored. This will decrease the actual available space. This is different from the global raw space.