is ceph-adm compatible with proxmox ?

[kifeo]

I wanted to change to ceph-adm, as described here : https://docs.ceph.com/en/latest/cephadm/adoption/#cephadm-adoption

Is there any limitation ?


Thanks!

 

[aaron]

On a hyperconverged Ceph cluster on top of PVE?

I haven't tested it but even without that, I don't think it is a good idea to have another Ceph deployment tool besides PVE as there are likely some conflicts.

May I ask why you want to do that?

 

[kifeo]

yes, in order to add the ceph-adm tools on top of PVE.

I've face some limitations on proxmox, and ended up on this website as given above.

I saw this new tool, and before testing it, wanted to know.

 

[aaron]

I've face some limitations on proxmox, and ended up on this website as given above.

Would you care to explain which?

As I mentioned, on a hyperconverged PVE Ceph cluster, PVE is handling the Ceph deployment. Introducing another tool will most likely break stuff. One thing that I expect to break is the delivery of up to date ceph.conf files. PVE is using the pmxcfs to distribute it across the cluster and /etc/ceph/ceph.conf is only a symlink to /etc/pve/ceph.conf.

Using ceph-adm which deploys these via SSH (AFAICT) will most likely overwrite the /etc/ceph/ceph.conf file and thus breaking the symlink and PVEs assumption that all nodes have the same ceph.conf file.

 

[kifeo]

I see, thanks

sure, for example for the monitors

https://forum.proxmox.com/threads/w...le-pulbic-nets-are-defined.59059/#post-385762

I had to create osds also, which have the same issue, so I found this ceph-adm stuff.
It also seems to be easier to reload the ceph services after upgrade.