[SOLVED] 5.3.8 5 Nodes with Ceph

[bensode]

I have a fresh 5 node cluster installed running 5.3.8 with Ceph. The docs for installing ceph with PVE suggest a minimum of three nodes with monitors. Is it recommended to install a monitor on every node or is it ok to keep just 3 of my 5 nodes as monitors? When I connect to my forth and fifth node and click on Ceph in the left panel I get "pveceph configuration not enabled" however I can see the configuration, monitors and OSDs on the other nodes. Would I get any benefit by making all 5 monitors or be detrimental to only setup 3 of 5?

 

[sb-jw]

You need to run 'pveceph init' on each node you want to enable the ceph management GUI.

Normally you do not need 5 monitors, only you have a big cluster, but this is not the case with 3 or 5 nodes. Maybe I would install it, but only for redundancy if I reboot a node.

 

[Alwin]

There is work going on for this dilemma, as it should be possible to also install Ceph on nodes, where you don't want MONs.

EDIT: besides that, @sb-jw's approach works.