We're running a three node Proxmox cluster on 6.2. In the last months we've been replacing a lot of our networking gear, replacing older Cisco swithces and routers with Juniper EX3400, EX4600 and MX204.
Shortly after moving our Proxmox cluster from a Cisco Nexus 5010 to a virtual chassis with two Juniper EX4600 we saw a problem where multicast between VM's wasn't working. Two VM's on seperate hosts in the cluster are running FreeBSD and CARP. IPv4 multicast between the guests works as intended, but IPv6 doesn't. Neither VM sees multicast messages from the other, so both assume the other one is dead and assume they're the master.
The VM's are connected through a vlan aware bridge to the network. The bridge is configured as
I've tried turning off snooping on the hosts ( echo 0 > /sys/class/net/vmbr0/bridge/multicast_snooping ), turning on the multicast_querier on the hosts, replacing lacp links with single links, turning on stp on the bridges.
I tried to ping IPv6 link-local addresses between two physical hosts ( not proxmox ), connected to another switch, and that didn't work either, probably since neighbor discovery uses multicast and isn't working. Surprisingly omping between VM's on seperate proxmox hosts works, using the default multicast address ff3e::4321:1234.
Does anyone have ideas of where to look for a solution?
.einar
Shortly after moving our Proxmox cluster from a Cisco Nexus 5010 to a virtual chassis with two Juniper EX4600 we saw a problem where multicast between VM's wasn't working. Two VM's on seperate hosts in the cluster are running FreeBSD and CARP. IPv4 multicast between the guests works as intended, but IPv6 doesn't. Neither VM sees multicast messages from the other, so both assume the other one is dead and assume they're the master.
The VM's are connected through a vlan aware bridge to the network. The bridge is configured as
Code:
auto vmbr0
iface vmbr0 inet manual
bridge-ports bond0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094I've tried turning off snooping on the hosts ( echo 0 > /sys/class/net/vmbr0/bridge/multicast_snooping ), turning on the multicast_querier on the hosts, replacing lacp links with single links, turning on stp on the bridges.
I tried to ping IPv6 link-local addresses between two physical hosts ( not proxmox ), connected to another switch, and that didn't work either, probably since neighbor discovery uses multicast and isn't working. Surprisingly omping between VM's on seperate proxmox hosts works, using the default multicast address ff3e::4321:1234.
Does anyone have ideas of where to look for a solution?
.einar
