[SOLVED] ceph mgr and mon issue after upgrade to Luminous

[RobFantini]

thanks for the info.

this times out:

pveceph createmon
got timeout

 

[pabernethy]

And I assume the injection as well as the createmon are executed on sys8?

 

[RobFantini]

And I assume the injection as well as the createmon are executed on sys8?

Yes

sys8  ~ # ceph-mon -i sys8  --inject-monmap /tmp/monmap
2017-09-04 11:31:42.511553 7f58f27bcf80 -1 monitor data directory at '/var/lib/ceph/mon/ceph-sys8' does not exist: have you run 'mkfs'?
sys8  ~ # systemctl stop ceph-mon@sys8
sys8  ~ # ceph-mon -i sys8  --inject-monmap /tmp/monmap
2017-09-04 11:36:50.400002 7f0228553f80 -1 monitor data directory at '/var/lib/ceph/mon/ceph-sys8' does not exist: have you run 'mkfs'?
sys8  ~ # pveceph createmon
got timeout

 

[pabernethy]

So yeah, at this point it may be easier to scrap and recreate. And keep in mind to keep you cluster quorate at all times. If you need to recreate monitors, do one at a time.

 

[RobFantini]

I agree about quorate - I thought the initial delete mon's had failed.

I'll search for how to delete a ceph setup on pve.

 

[RobFantini]

so I'll close this. the issue was caused i think when
1- upgraded pve to 5
2- had not yet upgraded ceph to new version.
3- created a mon [sys8] from pve menu using older ceph software.