Switch down cluster red

[geos_one]

after a short config change on the switch many nodes of the cluster cant find the rest of the cluster
how to get them reconnected (proxmox latest verison of 4.x)

Quorum information
------------------
Date: Wed Feb 15 13:05:40 2017
Quorum provider: corosync_votequorum
Nodes: 1
Node ID: 0x00000002
Ring ID: 2/1248
Quorate: No

Votequorum information
----------------------
Expected votes: 8
Highest expected: 8
Total votes: 1
Quorum: 5 Activity blocked
Flags:

Membership information
----------------------
Nodeid Votes Name
0x00000002 1 192.168.20.141 (local)

what's wrong with the cluster

another node has 3 of the 8 nodes

Quorum information
------------------
Date: Wed Feb 15 13:10:00 2017
Quorum provider: corosync_votequorum
Nodes: 3
Node ID: 0x00000003
Ring ID: 1/2588
Quorate: No

Votequorum information
----------------------
Expected votes: 8
Highest expected: 8
Total votes: 3
Quorum: 5 Activity blocked
Flags:

Membership information
----------------------
Nodeid Votes Name
0x00000001 1 192.168.20.140
0x00000003 1 192.168.20.143 (local)
0x00000004 1 192.168.20.144

 

[geos_one]

has someone an idee what to do to get them reconnecterd ?

 

[dcsapak]

if multicast between all the nodes work, they should reconnect automatically, maybe there is a wrong configuration on the switch after the change?

 

[geos_one]

i recheckt the config it,s the same

<28>Feb 16 12:43:47 pro-pve01-p corosync[12012]: [TOTEM ] JOIN or LEAVE message was thrown away during flush operation.
<28>Feb 16 12:43:47 pro-pve01-p corosync[12012]: [TOTEM ] JOIN or LEAVE message was thrown away during flush operation.
<28>Feb 16 12:43:47 pro-pve01-p corosync[12012]: [TOTEM ] JOIN or LEAVE message was thrown away during flush operation.
<28>Feb 16 12:43:47 pro-pve01-p corosync[12012]: [TOTEM ] JOIN or LEAVE message was thrown away during flush operation.

these are the actual logs from one of the still connected hosts