Cannot Initailize CMAP Service

[wrmanis]

Hey guys,

Thanks again for your help previously today. I'm working on readding the two ceph nodes I removed earlier, and everything turned to crap.

Changing nothing about my setup, I've run into all of my five regular Proxmox nodes telling me they can't start the CMAP service. Keep in mind, I have done absolutely nothing to them, besides running a delnode on the two previous ceph services.

This is what I get:

root@PMX01:~# systemctl status corosync.service -l
● corosync.service - Corosync Cluster Engine
Loaded: loaded (/lib/systemd/system/corosync.service; enabled)
Active: inactive (dead) since Sun 2016-12-04 18:44:28 EST; 12min ago
Process: 2075 ExecStop=/usr/share/corosync/corosync stop (code=exited, status=0/SUCCESS)
Process: 1901 ExecStart=/usr/share/corosync/corosync start (code=exited, status=0/SUCCESS)
Main PID: 1910 (code=exited, status=0/SUCCESS)

Dec 04 18:44:28 PMX01 corosync[1910]: [SERV ] Unloading all Corosync service engines.
Dec 04 18:44:28 PMX01 corosync[1910]: [QB ] withdrawing server sockets
Dec 04 18:44:28 PMX01 corosync[1910]: [SERV ] Service engine unloaded: corosync vote quorum service v1.0
Dec 04 18:44:28 PMX01 corosync[1910]: [QB ] withdrawing server sockets
Dec 04 18:44:28 PMX01 corosync[1910]: [SERV ] Service engine unloaded: corosync configuration map access
Dec 04 18:44:28 PMX01 corosync[1910]: [QB ] withdrawing server sockets
Dec 04 18:44:28 PMX01 corosync[1910]: [SERV ] Service engine unloaded: corosync configuration service
Dec 04 18:44:28 PMX01 corosync[1910]: [QB ] withdrawing server sockets
Dec 04 18:44:28 PMX01 corosync[1910]: [SERV ] Service engine unloaded: corosync cluster closed process group service v1.01
Dec 04 18:44:28 PMX01 corosync[1910]: [QB ] withdrawing server sockets

Any ideas?

 

[wrmanis]

The first thing I tried was

pvecm expected 1


But that still returns the same "cannot initailize cmap service"

 

[joshin]

I ran into this when a node couldn't talk to its name servers & got around it by adding the IP addresses for all the nodes in the cluster to each one's etc/hosts file.