Upgrade from 5.4 to 6.0 - one node not in quorum

J

Josef Liedl

Active Member
Dec 11, 2018
3
0
41
Hello,

Brief description.
I have a 3 Node Custer, which I upgraded from 5.4 to 6.0 and Ceph from 12 to 14. worked without any problems. But after 1 day I now have the problem that a node is not in the qorum.

Details:
The nodes are called pve1, pve2 and pve3. I upgraded pve1 and pve3 with apt. I reinstalled pve3, first removed it from the cluster and then added it again. So far everything was ok and I also upgraded ceph.
The next day pve2 was no longer in the quorum. Ceph still works. Then I restarted pve2, but it didn't work. Now it gets strange, after some time pve2 was in the quorum, but pve3 wasn't anymore.
Can someone give me a hint what the reason is?
Thanks a lot

Code: 
proxmox-ve: 6.0-2 (running kernel: 5.0.21-1-pve)
pve-manager: 6.0-6 (running version: 6.0-6/c71f879f)
pve-kernel-5.0: 6.0-7
pve-kernel-helper: 6.0-7
pve-kernel-4.15: 5.4-8
pve-kernel-5.0.21-1-pve: 5.0.21-1
pve-kernel-4.15.18-20-pve: 4.15.18-46
pve-kernel-4.15.18-15-pve: 4.15.18-40
pve-kernel-4.15.18-9-pve: 4.15.18-30
ceph: 14.2.2-pve1
ceph-fuse: 14.2.2-pve1
corosync: 3.0.2-pve2
criu: 3.11-3
glusterfs-client: 5.5-3
libjs-extjs: 6.0.1-10
libknet1: 1.11-pve1
libpve-access-control: 6.0-2
libpve-apiclient-perl: 3.0-2
libpve-common-perl: 6.0-4
libpve-guest-common-perl: 3.0-1
libpve-http-server-perl: 3.0-2
libpve-storage-perl: 6.0-7
libqb0: 1.0.5-1
lvm2: 2.03.02-pve3
lxc-pve: 3.1.0-64
lxcfs: 3.0.3-pve60
novnc-pve: 1.0.0-60
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.0-7
pve-cluster: 6.0-5
pve-container: 3.0-5
pve-docs: 6.0-4
pve-edk2-firmware: 2.20190614-1
pve-firewall: 4.0-7
pve-firmware: 3.0-2
pve-ha-manager: 3.0-2
pve-i18n: 2.0-2
pve-qemu-kvm: 4.0.0-5
pve-xtermjs: 3.13.2-1
qemu-server: 6.0-7
smartmontools: 7.0-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
Code: 
proxmox-ve: 6.0-2 (running kernel: 5.0.21-1-pve)
pve-manager: 6.0-6 (running version: 6.0-6/c71f879f)
pve-kernel-5.0: 6.0-7
pve-kernel-helper: 6.0-7
pve-kernel-4.15: 5.4-8
pve-kernel-5.0.21-1-pve: 5.0.21-1
pve-kernel-4.15.18-20-pve: 4.15.18-46
pve-kernel-4.15.18-15-pve: 4.15.18-40
pve-kernel-4.15.18-9-pve: 4.15.18-30
ceph: 14.2.2-pve1
ceph-fuse: 14.2.2-pve1
corosync: 3.0.2-pve2
criu: 3.11-3
glusterfs-client: 5.5-3
libjs-extjs: 6.0.1-10
libknet1: 1.11-pve1
libpve-access-control: 6.0-2
libpve-apiclient-perl: 3.0-2
libpve-common-perl: 6.0-4
libpve-guest-common-perl: 3.0-1
libpve-http-server-perl: 3.0-2
libpve-storage-perl: 6.0-7
libqb0: 1.0.5-1
lvm2: 2.03.02-pve3
lxc-pve: 3.1.0-64
lxcfs: 3.0.3-pve60
novnc-pve: 1.0.0-60
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.0-7
pve-cluster: 6.0-5
pve-container: 3.0-5
pve-docs: 6.0-4
pve-edk2-firmware: 2.20190614-1
pve-firewall: 4.0-7
pve-firmware: 3.0-2
pve-ha-manager: 3.0-2
pve-i18n: 2.0-2
pve-qemu-kvm: 4.0.0-5
pve-xtermjs: 3.13.2-1
qemu-server: 6.0-7
smartmontools: 7.0-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
root@pve1:~# cat pve2version 
proxmox-ve: 6.0-2 (running kernel: 5.0.21-1-pve)
pve-manager: 6.0-6 (running version: 6.0-6/c71f879f)
pve-kernel-5.0: 6.0-7
pve-kernel-helper: 6.0-7
pve-kernel-5.0.21-1-pve: 5.0.21-1
ceph: 14.2.2-pve1
ceph-fuse: 14.2.2-pve1
corosync: 3.0.2-pve2
criu: 3.11-3
glusterfs-client: 5.5-3
libjs-extjs: 6.0.1-10
libknet1: 1.11-pve1
libpve-access-control: 6.0-2
libpve-apiclient-perl: 3.0-2
libpve-common-perl: 6.0-4
libpve-guest-common-perl: 3.0-1
libpve-http-server-perl: 3.0-2
libpve-storage-perl: 6.0-7
libqb0: 1.0.5-1
lvm2: 2.03.02-pve3
lxc-pve: 3.1.0-64
lxcfs: 3.0.3-pve60
novnc-pve: 1.0.0-60
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.0-7
pve-cluster: 6.0-5
pve-container: 3.0-5
pve-docs: 6.0-4
pve-edk2-firmware: 2.20190614-1
pve-firewall: 4.0-7
pve-firmware: 3.0-2
pve-ha-manager: 3.0-2
pve-i18n: 2.0-2
pve-qemu-kvm: 4.0.0-5
pve-xtermjs: 3.13.2-1
qemu-server: 6.0-7
smartmontools: 7.0-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
Code: 
proxmox-ve: 6.0-2 (running kernel: 5.0.21-1-pve)
pve-manager: 6.0-6 (running version: 6.0-6/c71f879f)
pve-kernel-5.0: 6.0-7
pve-kernel-helper: 6.0-7
pve-kernel-5.0.21-1-pve: 5.0.21-1
ceph: 14.2.2-pve1
ceph-fuse: 14.2.2-pve1
corosync: 3.0.2-pve2
criu: 3.11-3
glusterfs-client: 5.5-3
libjs-extjs: 6.0.1-10
libknet1: 1.11-pve1
libpve-access-control: 6.0-2
libpve-apiclient-perl: 3.0-2
libpve-common-perl: 6.0-4
libpve-guest-common-perl: 3.0-1
libpve-http-server-perl: 3.0-2
libpve-storage-perl: 6.0-7
libqb0: 1.0.5-1
lvm2: 2.03.02-pve3
lxc-pve: 3.1.0-64
lxcfs: 3.0.3-pve60
novnc-pve: 1.0.0-60
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.0-7
pve-cluster: 6.0-5
pve-container: 3.0-5
pve-docs: 6.0-4
pve-edk2-firmware: 2.20190614-1
pve-firewall: 4.0-7
pve-firmware: 3.0-2
pve-ha-manager: 3.0-2
pve-i18n: 2.0-2
pve-qemu-kvm: 4.0.0-5
pve-xtermjs: 3.13.2-1
qemu-server: 6.0-7
smartmontools: 7.0-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
root@pve1:~# cat pve3version 
proxmox-ve: 6.0-2 (running kernel: 5.0.21-1-pve)
pve-manager: 6.0-6 (running version: 6.0-6/c71f879f)
pve-kernel-5.0: 6.0-7
pve-kernel-helper: 6.0-7
pve-kernel-4.15: 5.4-8
pve-kernel-5.0.21-1-pve: 5.0.21-1
pve-kernel-4.15.18-20-pve: 4.15.18-46
pve-kernel-4.15.18-15-pve: 4.15.18-40
pve-kernel-4.15.18-9-pve: 4.15.18-30
ceph: 14.2.2-pve1
ceph-fuse: 14.2.2-pve1
corosync: 3.0.2-pve2
criu: 3.11-3
glusterfs-client: 5.5-3
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.11-pve1
libpve-access-control: 6.0-2
libpve-apiclient-perl: 3.0-2
libpve-common-perl: 6.0-4
libpve-guest-common-perl: 3.0-1
libpve-http-server-perl: 3.0-2
libpve-storage-perl: 6.0-7
libqb0: 1.0.5-1
lvm2: 2.03.02-pve3
lxc-pve: 3.1.0-64
lxcfs: 3.0.3-pve60
novnc-pve: 1.0.0-60
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.0-7
pve-cluster: 6.0-5
pve-container: 3.0-5
pve-docs: 6.0-4
pve-edk2-firmware: 2.20190614-1
pve-firewall: 4.0-7
pve-firmware: 3.0-2
pve-ha-manager: 3.0-2
pve-i18n: 2.0-2
pve-qemu-kvm: 4.0.0-5
pve-xtermjs: 3.13.2-1
qemu-server: 6.0-7
smartmontools: 7.0-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
zfsutils-linux: 0.8.1-pve2

Code: 
Quorum information
------------------
Date:             Sat Aug 31 10:38:03 2019
Quorum provider:  corosync_votequorum
Nodes:            2
Node ID:          0x00000001
Ring ID:          1/196452
Quorate:          Yes

Votequorum information
----------------------
Expected votes:   3
Highest expected: 3
Total votes:      2
Quorum:           2 
Flags:            Quorate

Membership information
----------------------
    Nodeid      Votes Name
0x00000001          1 10.0.2.3 (local)
0x00000002          1 10.0.2.4

Do you need more information?
 
Thank you very much for your answer.
After I restarted corosync, it worked for about half an hour. After that corosync crashed on pve2. Also a restart of corosync didn't improve the situation.

Code: 
● corosync.service - Corosync Cluster Engine
   Loaded: loaded (/lib/systemd/system/corosync.service; enabled; vendor preset: enabled)
   Active: failed (Result: signal) since Sat 2019-08-31 11:30:16 CEST; 6min ago
     Docs: man:corosync
           man:corosync.conf
           man:corosync_overview
  Process: 868133 ExecStart=/usr/sbin/corosync -f $COROSYNC_OPTIONS (code=killed, signal=SEGV)
 Main PID: 868133 (code=killed, signal=SEGV)

Aug 31 11:30:14 pve2 corosync[868133]:   [QUORUM] This node is within the non-primary component and will NOT provide any services.
Aug 31 11:30:14 pve2 corosync[868133]:   [QUORUM] Members[1]: 2
Aug 31 11:30:14 pve2 corosync[868133]:   [MAIN  ] Completed service synchronization, ready to provide service.
Aug 31 11:30:15 pve2 corosync[868133]:   [KNET  ] link: host: 3 link: 0 is down
Aug 31 11:30:15 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:30:15 pve2 corosync[868133]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:30:16 pve2 corosync[868133]:   [KNET  ] rx: host: 3 link: 0 is up
Aug 31 11:30:16 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:30:16 pve2 systemd[1]: corosync.service: Main process exited, code=killed, status=11/SEGV
Aug 31 11:30:16 pve2 systemd[1]: corosync.service: Failed with result 'signal'.
duplicate entries replaced by ...
Code: 
Aug 31 11:28:24 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 3c 3e 3f 43 44 45 46
Aug 31 11:28:24 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 3c 3e 3f 43 44 45 46
…
Aug 31 11:28:24 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 3c 3e 3f 43 44 45 46
Aug 31 11:28:24 pve2 corosync[868133]:   [KNET  ] rx: host: 1 link: 0 is up
Aug 31 11:28:24 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:28:24 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 3c 3e 3f 43 44 45 46
Aug 31 11:28:27 pve2 corosync[868133]:   [KNET  ] link: host: 3 link: 0 is down
Aug 31 11:28:27 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:28:27 pve2 corosync[868133]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:28:28 pve2 corosync[868133]:   [KNET  ] rx: host: 3 link: 0 is up
Aug 31 11:28:28 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:28:28 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 364 ms
Aug 31 11:28:35 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 1237 ms
Aug 31 11:28:36 pve2 corosync[868133]:   [TOTEM ] A processor failed, forming new configuration.
Aug 31 11:28:36 pve2 corosync[868133]:   [TOTEM ] A new membership (1:281880) was formed. Members
Aug 31 11:28:36 pve2 corosync[868133]:   [CPG   ] downlist left_list: 0 received
Aug 31 11:28:36 pve2 corosync[868133]:   [CPG   ] downlist left_list: 0 received
Aug 31 11:28:36 pve2 corosync[868133]:   [CPG   ] downlist left_list: 0 received
Aug 31 11:28:36 pve2 corosync[868133]:   [QUORUM] Members[3]: 1 2 3
Aug 31 11:28:36 pve2 corosync[868133]:   [MAIN  ] Completed service synchronization, ready to provide service.
Aug 31 11:28:51 pve2 corosync[868133]:   [KNET  ] link: host: 1 link: 0 is down
Aug 31 11:28:51 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:28:51 pve2 corosync[868133]:   [KNET  ] host: host: 1 has no active links
Aug 31 11:28:53 pve2 corosync[868133]:   [KNET  ] rx: host: 1 link: 0 is up
Aug 31 11:28:53 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:28:57 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 1237 ms
Aug 31 11:29:11 pve2 corosync[868133]:   [KNET  ] link: host: 1 link: 0 is down
Aug 31 11:29:11 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:29:11 pve2 corosync[868133]:   [KNET  ] host: host: 1 has no active links
Aug 31 11:29:13 pve2 corosync[868133]:   [KNET  ] rx: host: 1 link: 0 is up
Aug 31 11:29:13 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:29:19 pve2 corosync[868133]:   [KNET  ] link: host: 3 link: 0 is down
Aug 31 11:29:19 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:29:19 pve2 corosync[868133]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:29:20 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 279 ms
Aug 31 11:29:20 pve2 corosync[868133]:   [KNET  ] rx: host: 3 link: 0 is up
Aug 31 11:29:20 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:29:21 pve2 corosync[868133]:   [TOTEM ] A new membership (1:281884) was formed. Members
Aug 31 11:29:21 pve2 corosync[868133]:   [CPG   ] downlist left_list: 0 received
Aug 31 11:29:21 pve2 corosync[868133]:   [CPG   ] downlist left_list: 0 received
Aug 31 11:29:21 pve2 corosync[868133]:   [CPG   ] downlist left_list: 0 received
Aug 31 11:29:21 pve2 corosync[868133]:   [QUORUM] Members[3]: 1 2 3
Aug 31 11:29:21 pve2 corosync[868133]:   [MAIN  ] Completed service synchronization, ready to provide service.
Aug 31 11:29:32 pve2 corosync[868133]:   [KNET  ] link: host: 3 link: 0 is down
Aug 31 11:29:32 pve2 corosync[868133]:   [KNET  ] link: host: 1 link: 0 is down
Aug 31 11:29:32 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:29:32 pve2 corosync[868133]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:29:32 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:29:32 pve2 corosync[868133]:   [KNET  ] host: host: 1 has no active links
Aug 31 11:29:33 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 453 ms
Aug 31 11:29:33 pve2 corosync[868133]:   [KNET  ] rx: host: 3 link: 0 is up
Aug 31 11:29:33 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:29:33 pve2 corosync[868133]:   [KNET  ] rx: host: 1 link: 0 is up
Aug 31 11:29:33 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:29:40 pve2 corosync[868133]:   [KNET  ] link: host: 3 link: 0 is down
Aug 31 11:29:40 pve2 corosync[868133]:   [KNET  ] link: host: 1 link: 0 is down
Aug 31 11:29:40 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:29:40 pve2 corosync[868133]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:29:40 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:29:40 pve2 corosync[868133]:   [KNET  ] host: host: 1 has no active links
Aug 31 11:29:41 pve2 corosync[868133]:   [KNET  ] rx: host: 1 link: 0 is up
Aug 31 11:29:41 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:29:41 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 63 ms
Aug 31 11:29:42 pve2 corosync[868133]:   [KNET  ] rx: host: 3 link: 0 is up
Aug 31 11:29:42 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:29:44 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 1237 ms
Aug 31 11:29:47 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 60 ms
Aug 31 11:29:47 pve2 corosync[868133]:   [TOTEM ] A new membership (1:281900) was formed. Members joined: 1 left: 1
Aug 31 11:29:47 pve2 corosync[868133]:   [TOTEM ] Failed to receive the leave message. failed: 1
Aug 31 11:29:48 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 1a 1b
…
Aug 31 11:29:54 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 1a 1b
Aug 31 11:29:55 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 1237 ms
Aug 31 11:29:56 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 1a 1b
…
Aug 31 11:29:57 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 1a 1b
Aug 31 11:29:58 pve2 corosync[868133]:   [KNET  ] link: host: 3 link: 0 is down
Aug 31 11:29:58 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:29:58 pve2 corosync[868133]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:29:58 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 1a 1b
Aug 31 11:29:59 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 61 ms
Aug 31 11:29:59 pve2 corosync[868133]:   [KNET  ] rx: host: 3 link: 0 is up
Aug 31 11:29:59 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:30:00 pve2 corosync[868133]:   [KNET  ] link: host: 1 link: 0 is down
Aug 31 11:30:00 pve2 corosync[868133]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:30:00 pve2 corosync[868133]:   [KNET  ] host: host: 1 has no active links
Aug 31 11:30:01 pve2 corosync[868133]:   [KNET  ] rx: host: 1 link: 0 is up
 
Part2
Code: 
Aug 31 11:30:06 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 1237 ms
Aug 31 11:30:08 pve2 corosync[868133]:   [TOTEM ] A new membership (1:281912) was formed. Members joined: 1 left: 1
Aug 31 11:30:08 pve2 corosync[868133]:   [TOTEM ] Failed to receive the leave message. failed: 1
Aug 31 11:30:08 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 4 5
…
Aug 31 11:30:10 pve2 corosync[868133]:   [TOTEM ] Retransmit List: 4 5
Aug 31 11:30:11 pve2 corosync[868133]:   [TOTEM ] Token has not been received in 845 ms
Aug 31 11:30:12 pve2 corosync[868133]:   [TOTEM ] A processor failed, forming new configuration.
Aug 31 11:30:14 pve2 corosync[868133]:   [TOTEM ] A new membership (2:281916) was formed. Members left: 1 3
Aug 31 11:30:14 pve2 corosync[868133]:   [TOTEM ] Failed to receive the leave message. failed: 1 3
Aug 31 11:30:14 pve2 corosync[868133]:   [CPG   ] downlist left_list: 2 received
Aug 31 11:30:14 pve2 corosync[868133]:   [QUORUM] This node is within the non-primary component and will NOT provide any services.
Aug 31 11:30:14 pve2 corosync[868133]:   [QUORUM] Members[1]: 2
Aug 31 11:30:14 pve2 corosync[868133]:   [MAIN  ] Completed service synchronization, ready to provide service.
Aug 31 11:30:15 pve2 corosync[868133]:   [KNET  ] link: host: 3 link: 0 is down
Aug 31 11:30:15 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:30:15 pve2 corosync[868133]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:30:16 pve2 corosync[868133]:   [KNET  ] rx: host: 3 link: 0 is up
Aug 31 11:30:16 pve2 corosync[868133]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:30:16 pve2 systemd[1]: corosync.service: Main process exited, code=killed, status=11/SEGV
Aug 31 11:30:16 pve2 systemd[1]: corosync.service: Failed with result 'signal'.
Aug 31 11:38:44 pve2 corosync[885834]:   [MAIN  ] Corosync Cluster Engine 3.0.2-dirty starting up
Aug 31 11:38:44 pve2 corosync[885834]:   [MAIN  ] Corosync built-in features: dbus monitoring watchdog systemd xmlconf snmp pie relro bindnow
Aug 31 11:38:44 pve2 corosync[885834]:   [MAIN  ] interface section bindnetaddr is used together with nodelist. Nodelist one is going to be used.
Aug 31 11:38:44 pve2 corosync[885834]:   [MAIN  ] Please migrate config file to nodelist.
Aug 31 11:38:44 pve2 corosync[885834]:   [TOTEM ] Initializing transport (Kronosnet).
Aug 31 11:38:44 pve2 corosync[885834]:   [TOTEM ] kronosnet crypto initialized: aes256/sha256
Aug 31 11:38:44 pve2 corosync[885834]:   [TOTEM ] totemknet initialized
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] common: crypto_nss.so has been loaded from /usr/lib/x86_64-linux-gnu/kronosnet/crypto_nss.so
Aug 31 11:38:44 pve2 corosync[885834]:   [SERV  ] Service engine loaded: corosync configuration map access [0]
Aug 31 11:38:44 pve2 corosync[885834]:   [QB    ] server name: cmap
Aug 31 11:38:44 pve2 corosync[885834]:   [SERV  ] Service engine loaded: corosync configuration service [1]
Aug 31 11:38:44 pve2 corosync[885834]:   [QB    ] server name: cfg
Aug 31 11:38:44 pve2 corosync[885834]:   [SERV  ] Service engine loaded: corosync cluster closed process group service v1.01 [2]
Aug 31 11:38:44 pve2 corosync[885834]:   [QB    ] server name: cpg
Aug 31 11:38:44 pve2 corosync[885834]:   [SERV  ] Service engine loaded: corosync profile loading service [4]
Aug 31 11:38:44 pve2 corosync[885834]:   [SERV  ] Service engine loaded: corosync resource monitoring service [6]
Aug 31 11:38:44 pve2 corosync[885834]:   [WD    ] Watchdog not enabled by configuration
Aug 31 11:38:44 pve2 corosync[885834]:   [WD    ] resource load_15min missing a recovery key.
Aug 31 11:38:44 pve2 corosync[885834]:   [WD    ] resource memory_used missing a recovery key.
Aug 31 11:38:44 pve2 corosync[885834]:   [WD    ] no resources configured.
Aug 31 11:38:44 pve2 corosync[885834]:   [SERV  ] Service engine loaded: corosync watchdog service [7]
Aug 31 11:38:44 pve2 corosync[885834]:   [QUORUM] Using quorum provider corosync_votequorum
Aug 31 11:38:44 pve2 corosync[885834]:   [SERV  ] Service engine loaded: corosync vote quorum service v1.0 [5]
Aug 31 11:38:44 pve2 corosync[885834]:   [QB    ] server name: votequorum
Aug 31 11:38:44 pve2 corosync[885834]:   [SERV  ] Service engine loaded: corosync cluster quorum service v0.1 [3]
Aug 31 11:38:44 pve2 corosync[885834]:   [QB    ] server name: quorum
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 0)
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 1 has no active links
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 1 has no active links
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 1 has no active links
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 2 (passive) best link: 0 (pri: 0)
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 2 has no active links
Aug 31 11:38:44 pve2 corosync[885834]:   [TOTEM ] A new membership (2:281920) was formed. Members joined: 2
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 0)
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:38:44 pve2 corosync[885834]:   [KNET  ] host: host: 3 has no active links
Aug 31 11:38:44 pve2 corosync[885834]:   [CPG   ] downlist left_list: 0 received
Aug 31 11:38:44 pve2 corosync[885834]:   [QUORUM] Members[1]: 2
Aug 31 11:38:44 pve2 corosync[885834]:   [MAIN  ] Completed service synchronization, ready to provide service.
Aug 31 11:38:45 pve2 corosync[885834]:   [KNET  ] rx: host: 3 link: 0 is up
Aug 31 11:38:45 pve2 corosync[885834]:   [KNET  ] rx: host: 1 link: 0 is up
Aug 31 11:38:45 pve2 corosync[885834]:   [KNET  ] host: host: 3 (passive) best link: 0 (pri: 1)
Aug 31 11:38:45 pve2 corosync[885834]:   [KNET  ] host: host: 1 (passive) best link: 0 (pri: 1)
Aug 31 11:38:45 pve2 corosync[885834]:   [KNET  ] pmtud: PMTUD link change for host: 3 link: 0 from 469 to 1397
Aug 31 11:38:45 pve2 corosync[885834]:   [KNET  ] pmtud: PMTUD link change for host: 1 link: 0 from 469 to 1397
Aug 31 11:38:45 pve2 corosync[885834]:   [KNET  ] pmtud: Global data MTU changed to: 1397
 
please make sure you've installed the latest updates (especially for corosync and libknet1) - there have been a few bugfixes lately

I hope this helps!

else please post the output of `pveversion -v`
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom