Hello all,
Im trying SDN technology preview on PVE 8.4. I ran into a problem like many others before me.
BGP-EVPN + VxLAN. It is working if you have all PVE nodes in one local network (one VLAN) only.
If you put some nodes in different networks, it breaks.
The core of problem is the FRR can't see neighbours over one hop (via default gw).
My setup node1 (100.64.1.101), node2 (100.64.1.102), node3 (100.64.1.103) works fine together.
But not works after adding node4 (192.168.1.104). They dont see new one on BGP.
The FRR option
And the most exciting thing is coming now.
1) if I take a frr.conf generated by Proxmox SDN and copy it (with router-id changed only) to openSUSE Thumbleweed (frr 10.0.2)
everything is working as should be.
2) if I take a frr.conf generated by Proxmox SDN and copy it (with router-id changed only) to Debian 12 (frr/stable,stable-security,now 8.4.4-1.1~deb12u1) it is not working, but config option
3) On PVE 8.4 (frr/stable,now 8.5.2-1+pve1) mentioned workaround must be used to get things work.
PS. "It is working" means the node see all other nodes even behind default gw on BGP.
Im trying SDN technology preview on PVE 8.4. I ran into a problem like many others before me.
BGP-EVPN + VxLAN. It is working if you have all PVE nodes in one local network (one VLAN) only.
If you put some nodes in different networks, it breaks.
The core of problem is the FRR can't see neighbours over one hop (via default gw).
My setup node1 (100.64.1.101), node2 (100.64.1.102), node3 (100.64.1.103) works fine together.
But not works after adding node4 (192.168.1.104). They dont see new one on BGP.
Code:
node1# vtysh -c "show ip bgp nexthop"
Current BGP nexthop cache:
100.64.1.102 valid [IGP metric 0], #paths 1, peer 100.64.1.102
if vmbr0
Last update: Wed Nov 6 15:18:15 2024
100.64.1.103 valid [IGP metric 0], #paths 4, peer 100.64.1.103
if vmbr0
Last update: Wed Nov 6 15:18:15 2024
192.168.1.104 invalid, #paths 0, peer 192.168.1.104
Last update: Mon Nov 11 14:28:54 2024The FRR option
ip nht resolve-via-default doesn help, this workaround must be usedno ip nht resolve-via-defaultip route 192.168.1.104/32 100.64.1.1And the most exciting thing is coming now.
1) if I take a frr.conf generated by Proxmox SDN and copy it (with router-id changed only) to openSUSE Thumbleweed (frr 10.0.2)
everything is working as should be.
2) if I take a frr.conf generated by Proxmox SDN and copy it (with router-id changed only) to Debian 12 (frr/stable,stable-security,now 8.4.4-1.1~deb12u1) it is not working, but config option
ip nht resolve-via-default fix it.3) On PVE 8.4 (frr/stable,now 8.5.2-1+pve1) mentioned workaround must be used to get things work.
PS. "It is working" means the node see all other nodes even behind default gw on BGP.
