â corosync.service - Corosync Cluster Engine
Loaded: loaded (/lib/systemd/system/corosync.service; enabled; vendor preset: enabled)
Active: active (running) since Mon 2020-06-22 08:52:57 CEST; 1 day 4h ago
Docs: man:corosync
man:corosync.conf
man:corosync_overview
Main PID: 17484 (corosync)
Tasks: 9 (limit: 4915)
Memory: 5.0G
CPU: 3h 29min 15.965s
CGroup: /system.slice/corosync.service
ââ17484 /usr/sbin/corosync -f
Jun 23 13:12:35 pro-04-dmed corosync[17484]: [MAIN ] Completed service synchronization, ready to provide service.
Jun 23 13:12:40 pro-04-dmed corosync[17484]: [TOTEM ] A new membership (2.2ba2f) was formed. Members
Jun 23 13:12:46 pro-04-dmed corosync[17484]: [TOTEM ] A new membership (2.2ba33) was formed. Members
Jun 23 13:12:51 pro-04-dmed corosync[17484]: [TOTEM ] A new membership (2.2ba37) was formed. Members
Jun 23 13:12:56 pro-04-dmed corosync[17484]: [TOTEM ] A new membership (2.2ba3b) was formed. Members
Jun 23 13:13:01 pro-04-dmed corosync[17484]: [TOTEM ] A new membership (2.2ba3f) was formed. Members
Jun 23 13:13:06 pro-04-dmed corosync[17484]: [TOTEM ] A new membership (2.2ba43) was formed. Members
Jun 23 13:13:11 pro-04-dmed corosync[17484]: [TOTEM ] A new membership (2.2ba47) was formed. Members
Jun 23 13:13:17 pro-04-dmed corosync[17484]: [TOTEM ] A new membership (2.2ba4b) was formed. Members
Jun 23 13:13:22 pro-04-dmed corosync[17484]: [TOTEM ] A new membership (2.2ba4f) was formed. Members
â pve-cluster.service - The Proxmox VE cluster filesystem
Loaded: loaded (/lib/systemd/system/pve-cluster.service; enabled; vendor preset: enabled)
Active: active (running) since Mon 2020-06-22 08:52:56 CEST; 1 day 4h ago
Main PID: 17451 (pmxcfs)
Tasks: 9 (limit: 4915)
Memory: 53.7M
CPU: 1min 21.607s
CGroup: /system.slice/pve-cluster.service
ââ17451 /usr/bin/pmxcfs
Jun 23 13:13:16 pro-04-dmed pmxcfs[17451]: [status] crit: cpg_send_message failed: 6
Jun 23 13:13:17 pro-04-dmed pmxcfs[17451]: [status] notice: cpg_send_message retry 10
Jun 23 13:13:18 pro-04-dmed pmxcfs[17451]: [status] notice: cpg_send_message retry 20
Jun 23 13:13:19 pro-04-dmed pmxcfs[17451]: [status] notice: cpg_send_message retry 30
Jun 23 13:13:20 pro-04-dmed pmxcfs[17451]: [status] notice: cpg_send_message retry 40
Jun 23 13:13:21 pro-04-dmed pmxcfs[17451]: [status] notice: cpg_send_message retry 50
Jun 23 13:13:22 pro-04-dmed pmxcfs[17451]: [status] notice: cpg_send_message retry 60
Jun 23 13:13:23 pro-04-dmed pmxcfs[17451]: [status] notice: cpg_send_message retry 70
Jun 23 13:13:24 pro-04-dmed pmxcfs[17451]: [status] notice: cpg_send_message retry 80
Jun 23 13:13:25 pro-04-dmed pmxcfs[17451]: [status] notice: cpg_send_message retry 90
pro-06-dmed:~# systemctl status corosync pve-cluster
â corosync.service - Corosync Cluster Engine
Loaded: loaded (/lib/systemd/system/corosync.service; enabled; vendor preset: enabled)
Active: active (running) since Mon 2020-06-22 14:43:39 CEST; 22h ago
Docs: man:corosync
man:corosync.conf
man:corosync_overview
Main PID: 10603 (corosync)
Tasks: 9 (limit: 6144)
Memory: 2.7G
CPU: 1h 15min 54.729s
CGroup: /system.slice/corosync.service
ââ10603 /usr/sbin/corosync -f
Jun 23 13:14:08 pro-06-dmed corosync[10603]: [CPG ] downlist left_list: 0 received
Jun 23 13:14:08 pro-06-dmed corosync[10603]: [QUORUM] Members[4]: 1 3 5 7
Jun 23 13:14:08 pro-06-dmed corosync[10603]: [MAIN ] Completed service synchronization, ready to provide service.
Jun 23 13:14:13 pro-06-dmed corosync[10603]: [TOTEM ] A new membership (1.2ba77) was formed. Members
Jun 23 13:14:13 pro-06-dmed corosync[10603]: [CPG ] downlist left_list: 0 received
Jun 23 13:14:13 pro-06-dmed corosync[10603]: [CPG ] downlist left_list: 0 received
Jun 23 13:14:13 pro-06-dmed corosync[10603]: [CPG ] downlist left_list: 0 received
Jun 23 13:14:13 pro-06-dmed corosync[10603]: [CPG ] downlist left_list: 0 received
Jun 23 13:14:13 pro-06-dmed corosync[10603]: [QUORUM] Members[4]: 1 3 5 7
Jun 23 13:14:13 pro-06-dmed corosync[10603]: [MAIN ] Completed service synchronization, ready to provide service.
â pve-cluster.service - The Proxmox VE cluster filesystem
Loaded: loaded (/lib/systemd/system/pve-cluster.service; enabled; vendor preset: enabled)
Active: active (running) since Mon 2020-06-22 08:55:41 CEST; 1 day 4h ago
Main PID: 21167 (pmxcfs)
Tasks: 9 (limit: 6144)
Memory: 72.6M
CPU: 2min 50.782s
CGroup: /system.slice/pve-cluster.service
ââ21167 /usr/bin/pmxcfs
Jun 23 13:11:02 pro-06-dmed pmxcfs[21167]: [dcdb] notice: all data is up to date
Jun 23 13:11:02 pro-06-dmed pmxcfs[21167]: [dcdb] notice: dfsm_deliver_queue: queue length 4
Jun 23 13:11:07 pro-06-dmed pmxcfs[21167]: [status] notice: received all states
Jun 23 13:11:07 pro-06-dmed pmxcfs[21167]: [status] notice: all data is up to date
Jun 23 13:11:07 pro-06-dmed pmxcfs[21167]: [status] notice: dfsm_deliver_queue: queue length 255
Jun 23 13:11:18 pro-06-dmed pmxcfs[21167]: [status] notice: cpg_send_message retried 6 times
Jun 23 13:12:38 pro-06-dmed pmxcfs[21167]: [status] notice: cpg_send_message retry 10
Jun 23 13:12:39 pro-06-dmed pmxcfs[21167]: [status] notice: cpg_send_message retry 20
Jun 23 13:12:40 pro-06-dmed pmxcfs[21167]: [status] notice: cpg_send_message retry 30
Jun 23 13:12:40 pro-06-dmed pmxcfs[21167]: [status] notice: cpg_send_message retried 39 times
pro-07-dmed:~# systemctl status corosync pve-cluster
â corosync.service - Corosync Cluster Engine
Loaded: loaded (/lib/systemd/system/corosync.service; enabled; vendor preset: enabled)
Active: active (running) since Mon 2020-06-22 16:00:39 CEST; 21h ago
Docs: man:corosync
man:corosync.conf
man:corosync_overview
Main PID: 31442 (corosync)
Tasks: 9 (limit: 6144)
Memory: 5.7G
CPU: 46min 27.871s
CGroup: /system.slice/corosync.service
ââ31442 /usr/sbin/corosync -f
Jun 23 13:14:18 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba7b) was formed. Members
Jun 23 13:14:24 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba7f) was formed. Members
Jun 23 13:14:29 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba83) was formed. Members
Jun 23 13:14:34 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba87) was formed. Members
Jun 23 13:14:39 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba8b) was formed. Members
Jun 23 13:14:44 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba8f) was formed. Members
Jun 23 13:14:49 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba93) was formed. Members
Jun 23 13:14:55 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba97) was formed. Members
Jun 23 13:15:00 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba9b) was formed. Members
Jun 23 13:15:05 pro-07-dmed corosync[31442]: [TOTEM ] A new membership (2.2ba9f) was formed. Members
â pve-cluster.service - The Proxmox VE cluster filesystem
Loaded: loaded (/lib/systemd/system/pve-cluster.service; enabled; vendor preset: enabled)
Active: active (running) since Mon 2020-06-22 14:51:32 CEST; 22h ago
Process: 1056 ExecStartPost=/usr/bin/pvecm updatecerts --silent (code=exited, status=0/SUCCESS)
Process: 1015 ExecStart=/usr/bin/pmxcfs (code=exited, status=0/SUCCESS)
Main PID: 1034 (pmxcfs)
Tasks: 10 (limit: 6144)
Memory: 58.9M
CPU: 2min 43.226s
CGroup: /system.slice/pve-cluster.service
ââ1034 /usr/bin/pmxcfs
Jun 23 13:15:00 pro-07-dmed pmxcfs[1034]: [status] notice: cpg_send_message retry 40
Jun 23 13:15:01 pro-07-dmed pmxcfs[1034]: [status] notice: cpg_send_message retry 50
Jun 23 13:15:02 pro-07-dmed pmxcfs[1034]: [status] notice: cpg_send_message retry 60
Jun 23 13:15:03 pro-07-dmed pmxcfs[1034]: [status] notice: cpg_send_message retry 70
Jun 23 13:15:04 pro-07-dmed pmxcfs[1034]: [status] notice: cpg_send_message retry 80
Jun 23 13:15:05 pro-07-dmed pmxcfs[1034]: [status] notice: cpg_send_message retry 90
Jun 23 13:15:06 pro-07-dmed pmxcfs[1034]: [status] notice: cpg_send_message retry 100
Jun 23 13:15:06 pro-07-dmed pmxcfs[1034]: [status] notice: cpg_send_message retried 100 times
Jun 23 13:15:06 pro-07-dmed pmxcfs[1034]: [status] crit: cpg_send_message failed: 6
Jun 23 13:15:07 pro-07-dmed pmxcfs[1034]: [status] notice: cpg_send_message retry 10