CEPH reporting pool usage when it is empty

[kifeo]

Hi !

I moved all rbd from an initial to new pools, and now the initial pool (hddpool) still reports used space and objects ?

Could someone tell me more ?

root@proxmox5:~#ceph df
POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL
hddpool 3 101 277 GiB 142.36k 389 GiB 10.57 2.3 TiB
...

root@proxmox5:~# rbd ls -l hddpool
root@proxmox5:~# rbd trash ls hddpool
(empty here)

This also reports empty in VM/CT on the GUI

Thanks !
Regards

 

[aaron]

Well, then lets take a look at what kind of objects are stored there.

You can run

rados -p hddpool ls

to get a first idea. The list is most likely quite long with mostly "rbd_data.xxxxxx" entries.

In that case you can try

rados -p hddpool ls | grep -v "rbd_data"

to filter those out.

It could be possible that for some reason you have orphaned objects. Is this pool already a bit older and has seen a few Ceph versions?

 

[kifeo]

Hi @aaron, sorry for the late reply, the cluster was down for electrical instabilities reasons.

the remaining objects are stuff like :

rbd_directory
benchmark_data_proxmox1_3076_object142
benchmark_data_proxmox1_3076_object229
benchmark_data_proxmox1_1354523_object126
benchmark_data_proxmox1_3169954_object296
benchmark_data_proxmox1_1354523_object25
benchmark_data_proxmox1_3076_object124
benchmark_data_proxmox1_1354523_object34

I was on Ceph13 the first time.
Thanks !

 

[aaron]

That is the result of running rados -p hddpool ls right?. The name kinda gives it away that these are old benchmark data.

Am I right in my assumption that you do not need that pool anymore? If so, you should be okay to delete the pool.

 

[kifeo]

there are some
rbd_data.5fb98cc6045b0e.000000000001d5c0
rbd_data.5fb98cc6045b0e.000000000000b509
rbd_data.5fb98cc6045b0e.0000000000004b7b
rbd_data.5fb98cc6045b0e.000000000001b1fd
rbd_data.5fb98cc6045b0e.0000000000015767
rbd_data.5fb98cc6045b0e.000000000000ff36
rbd_data.5fb98cc6045b0e.0000000000018116
rbd_data.5fb98cc6045b0e.000000000000b4e1
rbd_data.5fb98cc6045b0e.000000000000bd3a
rbd_data.5fb98cc6045b0e.000000000000ced9

the benchmark_data is with the grep -v "rbd_data"


###
rados -p hddpool ls | grep -v rbd_data | grep -v benchmark_data
rbd_directory
rbd_children
rbd_info
rbd_trash