cpg_send_message failed: 9

[hotwired007]

Hi guys,

i have a proxmox node in my cluster showing as offline with this in teh log file:

Apr 5 16:53:07 node2 pmxcfs[1617]: [status] crit: cpg_send_message failed: 9
Apr 5 16:53:07 node2 pmxcfs[1617]: [status] crit: cpg_send_message failed: 9
Apr 5 16:53:07 node2 pmxcfs[1617]: [status] crit: cpg_send_message failed: 9
Apr 5 16:53:07 node2 pmxcfs[1617]: [status] crit: cpg_send_message failed: 9
Apr 5 16:53:07 node2 pmxcfs[1617]: [status] crit: cpg_send_message failed: 9

i have tried:

# service pvstatd restart and it doesnt come back online

i can access all the VMs through the console and logging onto its own webinterface it shows as online but i cannot migrate

any suggestions?

 

[dietmar]

What is the output of

# pvecm status

 

[hotwired007]

root@node2:~# pvecm status
cman_tool: Cannot open connection to cman, is it running ?

 

[dietmar]

So is cman running?

 

[hotwired007]

i gave up and rebooted the server - it has come back online fine.

 

[Kirill]

service pve-cluster restart
service cman restart

 

[Andrii]

Nothing help.

Nov 11 19:04:39 serverius4 pmxcfs[168789]: [status] crit: cpg_send_message failed: 9
Nov 11 19:04:39 serverius4 pmxcfs[168789]: [status] crit: cpg_send_message failed: 9
Nov 11 19:04:39 serverius4 pmxcfs[168789]: [status] crit: cpg_send_message failed: 9
Nov 11 19:04:39 serverius4 pmxcfs[168789]: [status] crit: cpg_send_message failed: 9
Nov 11 19:04:39 serverius4 pmxcfs[168789]: [status] crit: cpg_send_message failed: 9
Nov 11 19:04:40 serverius4 corosync[168950]: [TOTEM ] Received message has invalid digest... ignoring.
Nov 11 19:04:40 serverius4 corosync[168950]: [TOTEM ] Invalid packet data
Nov 11 19:04:42 serverius4 corosync[168950]: [TOTEM ] Received message has invalid digest... ignoring.
Nov 11 19:04:42 serverius4 corosync[168950]: [TOTEM ] Invalid packet data
Nov 11 19:04:42 serverius4 corosync[168950]: [TOTEM ] Received message has invalid digest... ignoring.