Found a bug with using IPv6-based clustering; also a hostname error

[Michael Adams]

Hey all. There seems to be two bugs regarding clustering setup and IPv6 addresses...

1. If you decide to use custom fe80:: addresses on a vlan/other interface, it may default to the primary network interface regardless (i.e. vmbr0 vs vlan###).
2. If you use a routed address, and it has a :: in it; it will truncate that last part of the address, and disregard any others. Example: (net)::c1 would work; (net)::c:c1 would trigger the issue.

Also, there appears to be an issue with joining via the web interface; possible due to an SSL certificate issue. CLI join using the -use_ssh option is more successful.

 

[Stoiko Ivanov]

Could you provide:
* /etc/network/interfaces
* `ip addr` output
* the journal when you try to join
* screenshots/text-output which show the problem a bit more explicitly?

Thanks

 

[Michael Adams]

/etc/network/interfaces

auto lo
iface lo inet loopback

auto eno1
iface eno1 inet manual
        ovs_type OVSPort
        ovs_bridge vmbr0

auto vlan1234
iface vlan1234 inet6 static
        address fd70:616e:6461:c215::c:1a/64
        ovs_type OVSIntPort
        ovs_bridge vmbr0
        ovs_options tag=1234

auto vmbr0
iface vmbr0 inet static
        address 172.29.215.200/24
        gateway 172.29.215.1
        ovs_type OVSBridge
        ovs_ports eno1 vlan1234

ip a (think the extra entries are from VMs)

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc cake master ovs-system state UP group default qlen 1000
    link/ether b4:2e:99:33:df:c5 brd ff:ff:ff:ff:ff:ff
    altname enp0s31f6
    inet6 fe80::b62e:99ff:fe33:dfc5/64 scope link
       valid_lft forever preferred_lft forever
3: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 6a:55:28:5b:6d:f0 brd ff:ff:ff:ff:ff:ff
4: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether b4:2e:99:33:df:c5 brd ff:ff:ff:ff:ff:ff
    inet 172.29.215.200/24 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 (GLOBAL ADDRESS REMOVED FROM THIS POSTING)
       valid_lft 2591999sec preferred_lft 604799sec
    inet6 fe80::d4e6:27ff:fed6:ce40/64 scope link
       valid_lft forever preferred_lft forever
5: vlan1234: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 92:13:6e:58:57:cf brd ff:ff:ff:ff:ff:ff
    inet6 fd70:616e:6461:c215::c:1a/64 scope global
       valid_lft forever preferred_lft forever
    inet6 fe80::9013:6eff:fe58:57cf/64 scope link
       valid_lft forever preferred_lft forever
6: tap100i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc cake master fwbr100i0 state UNKNOWN group default qlen 1000
    link/ether be:7f:52:a8:cd:97 brd ff:ff:ff:ff:ff:ff
7: fwbr100i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether e6:25:9d:d9:a8:b9 brd ff:ff:ff:ff:ff:ff
8: fwln100o0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr100i0 state UNKNOWN group default qlen 1000
    link/ether c2:25:78:dc:1b:7b brd ff:ff:ff:ff:ff:ff
9: tap101i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc cake master fwbr101i0 state UNKNOWN group default qlen 1000
    link/ether 32:19:91:fa:8a:e7 brd ff:ff:ff:ff:ff:ff
10: fwbr101i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether da:2d:3f:70:c4:2d brd ff:ff:ff:ff:ff:ff
11: fwln101o0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr101i0 state UNKNOWN group default qlen 1000
    link/ether 3e:03:02:8e:4f:c3 brd ff:ff:ff:ff:ff:ff
12: tap102i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc cake master fwbr102i0 state UNKNOWN group default qlen 1000
    link/ether 5a:67:6c:60:d0:85 brd ff:ff:ff:ff:ff:ff
13: fwbr102i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 7e:45:17:72:27:2a brd ff:ff:ff:ff:ff:ff
14: fwln102o0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr102i0 state UNKNOWN group default qlen 1000
    link/ether 16:fb:09:f4:aa:61 brd ff:ff:ff:ff:ff:ff

ip a from "the other system"

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc cake master ovs-system state UP group default qlen 1000
    link/ether e0:d5:5e:6a:bd:5b brd ff:ff:ff:ff:ff:ff
    altname enp0s31f6
    inet6 fe80::e2d5:5eff:fe6a:bd5b/64 scope link
       valid_lft forever preferred_lft forever
3: wlp8s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 00:19:d2:fd:c3:3e brd ff:ff:ff:ff:ff:ff
4: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 7a:48:77:fc:4b:90 brd ff:ff:ff:ff:ff:ff
5: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether e0:d5:5e:6a:bd:5b brd ff:ff:ff:ff:ff:ff
    inet 172.29.215.250/24 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 (GLOBAL ADDRESS REMOVED FROM THIS POSTING)
       valid_lft 2591901sec preferred_lft 604701sec
    inet6 fe80::44e:a1ff:fe44:8d45/64 scope link
       valid_lft forever preferred_lft forever
6: vlan1234: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 32:67:71:17:a5:87 brd ff:ff:ff:ff:ff:ff
    inet6 fd70:616e:6461:c215::c:a215/64 scope global
       valid_lft forever preferred_lft forever
    inet6 fe80::3067:71ff:fe17:a587/64 scope link
       valid_lft forever preferred_lft forever

"corosync-cfgtool -s" outputs

Local node ID 2, transport knet
LINK ID 0 udp
        addr    = fd70:616e:6461:c215::c:1a%2
        status:
                nodeid:          1:     connected
                nodeid:          2:     localhost

Local node ID 1, transport knet
LINK ID 0 udp
        addr    = fd70:616e:6461:c215::c:a215%2
        status:
                nodeid:          1:     localhost
                nodeid:          2:     connected

Also, at the moment I can't properly log into the "other system" of this setup, via the Web UI: keep getting incorrect password, despite SSH access.

Edit: @Stoiko Ivanov there's a separate pair of systems I can join together later today, that I can try recreating this particular error on, or try a different address format (like maybe c:node) instead of ::cnode). Things are a little time sensitive on my end for some project work, so I'm trying to figure out what works & report back on what doesn't. Thanks!