Found a bug with using IPv6-based clustering; also a hostname error

Michael Adams

Member
Sep 6, 2018
3
1
8
42
Hey all. There seems to be two bugs regarding clustering setup and IPv6 addresses...

1. If you decide to use custom fe80:: addresses on a vlan/other interface, it may default to the primary network interface regardless (i.e. vmbr0 vs vlan###).
2. If you use a routed address, and it has a :: in it; it will truncate that last part of the address, and disregard any others. Example: (net)::c1 would work; (net)::c:c1 would trigger the issue.

Also, there appears to be an issue with joining via the web interface; possible due to an SSL certificate issue. CLI join using the -use_ssh option is more successful.
 
  • Like
Reactions: DerDanilo
Could you provide:
* /etc/network/interfaces
* `ip addr` output
* the journal when you try to join
* screenshots/text-output which show the problem a bit more explicitly?

Thanks
 
/etc/network/interfaces

Code:
auto lo
iface lo inet loopback

auto eno1
iface eno1 inet manual
        ovs_type OVSPort
        ovs_bridge vmbr0

auto vlan1234
iface vlan1234 inet6 static
        address fd70:616e:6461:c215::c:1a/64
        ovs_type OVSIntPort
        ovs_bridge vmbr0
        ovs_options tag=1234

auto vmbr0
iface vmbr0 inet static
        address 172.29.215.200/24
        gateway 172.29.215.1
        ovs_type OVSBridge
        ovs_ports eno1 vlan1234

ip a (think the extra entries are from VMs)

Code:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc cake master ovs-system state UP group default qlen 1000
    link/ether b4:2e:99:33:df:c5 brd ff:ff:ff:ff:ff:ff
    altname enp0s31f6
    inet6 fe80::b62e:99ff:fe33:dfc5/64 scope link
       valid_lft forever preferred_lft forever
3: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 6a:55:28:5b:6d:f0 brd ff:ff:ff:ff:ff:ff
4: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether b4:2e:99:33:df:c5 brd ff:ff:ff:ff:ff:ff
    inet 172.29.215.200/24 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 (GLOBAL ADDRESS REMOVED FROM THIS POSTING)
       valid_lft 2591999sec preferred_lft 604799sec
    inet6 fe80::d4e6:27ff:fed6:ce40/64 scope link
       valid_lft forever preferred_lft forever
5: vlan1234: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 92:13:6e:58:57:cf brd ff:ff:ff:ff:ff:ff
    inet6 fd70:616e:6461:c215::c:1a/64 scope global
       valid_lft forever preferred_lft forever
    inet6 fe80::9013:6eff:fe58:57cf/64 scope link
       valid_lft forever preferred_lft forever
6: tap100i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc cake master fwbr100i0 state UNKNOWN group default qlen 1000
    link/ether be:7f:52:a8:cd:97 brd ff:ff:ff:ff:ff:ff
7: fwbr100i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether e6:25:9d:d9:a8:b9 brd ff:ff:ff:ff:ff:ff
8: fwln100o0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr100i0 state UNKNOWN group default qlen 1000
    link/ether c2:25:78:dc:1b:7b brd ff:ff:ff:ff:ff:ff
9: tap101i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc cake master fwbr101i0 state UNKNOWN group default qlen 1000
    link/ether 32:19:91:fa:8a:e7 brd ff:ff:ff:ff:ff:ff
10: fwbr101i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether da:2d:3f:70:c4:2d brd ff:ff:ff:ff:ff:ff
11: fwln101o0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr101i0 state UNKNOWN group default qlen 1000
    link/ether 3e:03:02:8e:4f:c3 brd ff:ff:ff:ff:ff:ff
12: tap102i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc cake master fwbr102i0 state UNKNOWN group default qlen 1000
    link/ether 5a:67:6c:60:d0:85 brd ff:ff:ff:ff:ff:ff
13: fwbr102i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 7e:45:17:72:27:2a brd ff:ff:ff:ff:ff:ff
14: fwln102o0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr102i0 state UNKNOWN group default qlen 1000
    link/ether 16:fb:09:f4:aa:61 brd ff:ff:ff:ff:ff:ff


ip a from "the other system"

Code:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc cake master ovs-system state UP group default qlen 1000
    link/ether e0:d5:5e:6a:bd:5b brd ff:ff:ff:ff:ff:ff
    altname enp0s31f6
    inet6 fe80::e2d5:5eff:fe6a:bd5b/64 scope link
       valid_lft forever preferred_lft forever
3: wlp8s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 00:19:d2:fd:c3:3e brd ff:ff:ff:ff:ff:ff
4: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 7a:48:77:fc:4b:90 brd ff:ff:ff:ff:ff:ff
5: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether e0:d5:5e:6a:bd:5b brd ff:ff:ff:ff:ff:ff
    inet 172.29.215.250/24 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 (GLOBAL ADDRESS REMOVED FROM THIS POSTING)
       valid_lft 2591901sec preferred_lft 604701sec
    inet6 fe80::44e:a1ff:fe44:8d45/64 scope link
       valid_lft forever preferred_lft forever
6: vlan1234: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 32:67:71:17:a5:87 brd ff:ff:ff:ff:ff:ff
    inet6 fd70:616e:6461:c215::c:a215/64 scope global
       valid_lft forever preferred_lft forever
    inet6 fe80::3067:71ff:fe17:a587/64 scope link
       valid_lft forever preferred_lft forever

"corosync-cfgtool -s" outputs

Code:
Local node ID 2, transport knet
LINK ID 0 udp
        addr    = fd70:616e:6461:c215::c:1a%2
        status:
                nodeid:          1:     connected
                nodeid:          2:     localhost

Local node ID 1, transport knet
LINK ID 0 udp
        addr    = fd70:616e:6461:c215::c:a215%2
        status:
                nodeid:          1:     localhost
                nodeid:          2:     connected

Also, at the moment I can't properly log into the "other system" of this setup, via the Web UI: keep getting incorrect password, despite SSH access.

Edit: @Stoiko Ivanov there's a separate pair of systems I can join together later today, that I can try recreating this particular error on, or try a different address format (like maybe c::(node) instead of ::c:(node). Things are a little time sensitive on my end for some project work, so I'm trying to figure out what works & report back on what doesn't. Thanks!
 

Attachments

  • incorrect_join_info.png
    incorrect_join_info.png
    59.8 KB · Views: 3
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!