Manual entry missing from ceph.conf during Proxmox node reboot

wahmed

Famous Member
Oct 28, 2012
1,147
58
113
Calgary, Canada
www.symmcom.com
I added a MDS server manually into Proxmox+Ceph cluster along with some tuning such as under [client] segment in ceph.conf. Oddly, everytime i restart a node, it seems to remove the entries from ceph.conf. But any entries under [global] section seems to stay.

How can prevent Proxmox node to remove those manual entries or is there no way to do it as this moment?
 
you really changed it in /etc/pve/ceph.conf ?
 
Oddly, everytime i restart a node, it seems to remove the entries from ceph.conf. But any entries under [global] section seems to stay.

I cannot see where we overwrite the config at boot time, but we overwrite it as soon as you add an osd or mon. And it seems that we simply do not save section 'client' in PVE::CephTools::write_config()
 
I cannot see where we overwrite the config at boot time, but we overwrite it as soon as you add an osd or mon. And it seems that we simply do not save section 'client' in PVE::CephTools::write_config()
You are very likely correct. I added couple MONs and few OSDs at the same time i did Proxmox update on 4 nodes then restarted. One of the node was MDS server. After restart i noticed that MDS daemon was down due to [mds] section missing in ceph.conf. Only then i noticed [client] was missing too. Probably happened when adding/removing MON/OSD but it did not matter since MDS daemon was already running.
Any solution to this or do i need to manually add this sections after Proxmox overwrites the ceph.conf for now?