When adding a new osd to ceph, the osd_mclock_max_capacity_iops_[hdd, ssd] values do not appear in the configuration database

plastilin

Renowned Member
Oct 9, 2012
99
5
73
Ukraine
I have been configuring and testing ceph. When OSDs were first added, the performance values of the added osds were automatically added to the configuration database. However, at some point it stopped working. Should it work? Maybe some update came that turned off this functionality?

1687163205697.png1687163258459.png

Running the test manually passes

Code:
root@nd01:~# ceph tell osd.0 cache drop
root@nd01:~# ceph tell osd.0 bench 12288000 4096 4194304 100
{
    "bytes_written": 12288000,
    "blocksize": 4096,
    "elapsed_sec": 2.2298931299999998,
    "bytes_per_sec": 5510577.9889998594,
    "iops": 1345.3559543456688
}

root@nd01:~# ceph tell osd.0 cache drop
root@nd01:~# ceph tell osd.0 bench
{
    "bytes_written": 1073741824,
    "blocksize": 4194304,
    "elapsed_sec": 4.1815870310000003,
    "bytes_per_sec": 256778542.70157841,
    "iops": 61.220775294680216
}

What is the default test when adding osd?

Please also explain how critical is the presence of this data in the configuration database? Is it possible to operate a ceph cluster without these counters?
 
Last edited:
What software version are you using? Those parameters should not be that important, I used it with and without and with higher values, but it didnt make any difference in performance. Is performance the same on your site? If you want you should be able to set it manually.

What did you change, so the values disappeared?
 
What software version are you using?
ceph version 17.2.6 (995dec2cdae920da21db2d455e55efbc339bde24) quincy (stable)

What did you change, so the values disappeared?
I tested cluster performance with wal/db hosted on nvme and cleared osd several times. The last time I added them, the counters did not appear. + I rolled back to the configuration version "0" with the ceph config revert command
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!