VxLAN configuration problem

daruom13

Member
Aug 1, 2020
31
2
13
37
Hello,

I have tried to configure a VxLAN between my Proxmox nodes by following the instructions in @spirit , but it does not work :
https://forum.proxmox.com/threads/o...vms-across-private-network.76866/#post-342238

My 3 nodes have a network card with a private IP (192.168.1.1, 192.168.1.2, 192.168.1.3).

At the network level, my configuration is:
  • VMBR0, bridged on the network card with the public IP.
  • VMBR1 on which I try to configure the VxLAN
  • VMBR2 currently used with a GRE tunnel.

Node 1 /etc/network/interface :
auto lo iface lo inet loopback iface enp3s0f0 inet manual iface enp0s20f0u9u2c2 inet manual auto enp3s0f1 iface enp3s0f1 inet static address 192.168.1.1/24 mtu 9000 auto vmbr0 iface vmbr0 inet dhcp bridge-ports enp3s0f0 bridge-stp off bridge-fd 0 auto vmbr2 iface vmbr2 inet manual ovs_type OVSBridge up ovs-vsctl add-port vmbr2 gre0 -- set interface gre0 type=gre options:remote_ip=''192.168.1.2'' up ovs-vsctl add-port vmbr2 gre1 -- set interface gre1 type=gre options:remote_ip=''192.168.1.3'' auto vmbr1 iface vmbr1 inet manual bridge-ports vxlan2 bridge-stp off bridge-fd 0 bridge-vlan-aware yes bridge-vids 2-4094 auto vxlan2 iface vxlan2 inet manual vxlan-id 2 vxlan_remoteip 192.168.1.2 vxlan_remoteip 192.168.1.3 vxlan_remoteip 192.168.1.4

Node 2 /etc/network/interface :
auto lo iface lo inet loopback iface eno1 inet manual auto eno2 iface eno2 inet static address 192.168.1.2/24 mtu 9000 auto vmbr0 iface vmbr0 inet dhcp bridge-ports eno1 bridge-stp off bridge-fd 0 auto vmbr2 iface vmbr2 inet manual ovs_type OVSBridge post-up ovs-vsctl add-port vmbr2 gre0 -- set interface gre0 type=gre options:remote_ip=''192.168.1.1'' auto vmbr1 iface vmbr1 inet manual bridge-ports vxlan2 bridge-stp off bridge-fd 0 auto vxlan2 iface vxlan2 inet manual vxlan-id 2 vxlan_remoteip 192.168.1.1 vxlan_remoteip 192.168.1.3 vxlan_remoteip 192.168.1.4

Node 3 /etc/network/interface :
auto lo iface lo inet loopback iface eno1 inet manual auto eno2 iface eno2 inet static address 192.168.1.3/24 mtu 9000 iface enp0s20f0u8u3c2 inet manual auto vmbr0 iface vmbr0 inet dhcp bridge-ports eno1 bridge-stp off bridge-fd 0 auto vmbr2 iface vmbr2 inet manual ovs_type OVSBridge post-up ovs-vsctl add-port vmbr2 gre1 -- set interface gre1 type=gre options:remote_ip=''192.168.1.1'' auto vmbr1 iface vmbr1 inet manual bridge-ports vxlan2 bridge-stp off bridge-fd 0 bridge-vlan-aware yes bridge-vids 2-4094 auto vxlan2 iface vxlan2 inet manual vxlan-id 2 vxlan_remoteip 192.168.1.1 vxlan_remoteip 192.168.1.2 vxlan_remoteip 192.168.1.4


Node 4 /etc/network/interface :
auto lo iface lo inet loopback iface eno1 inet manual auto eno2 iface eno2 inet static address 192.168.1.4/24 mtu 9000 iface enp0s20f0u8u3c2 inet manual auto vmbr0 iface vmbr0 inet dhcp bridge-ports eno1 bridge-stp off bridge-fd 0 auto vmbr2 iface vmbr2 inet manual ovs_type OVSBridge #post-up ovs-vsctl add-port vmbr2 gre2 -- set interface gre2 type=gre options:remote_ip=''192.168.1.1'' auto vmbr1 iface vmbr1 inet manual bridge-ports vxlan2 bridge-stp off bridge-fd 0 auto vxlan2 iface vxlan2 inet manual vxlan-id 2 vxlan_remoteip 192.168.1.1 vxlan_remoteip 192.168.1.2 vxlan_remoteip 192.168.1.3

I want to replace the GRE tunnel with the VxLAN because I cannot make an optimal configuration (see this post):
https://forum.proxmox.com/threads/gre-tunnel-configuration-problem-with-3-servers.75630/

On Proxmox, I have a PfSense VM with a public IP on the WAN side and several VLANs on the LAN side (therefore connect to VMBR2 currently).
I can also try with the new feature (SDN) if anyone knows how to configure it.

Thanks.
 
Last edited:
Hi,

The vxlan config seem to be ok, do you have any error when you reload the configuration ? (ifreload -a -d)

Do you have last ifupdown2 version installed? (dpkg -l|grep ifupdown2)


About the sdn, the doc of current beta is already in official documentation. (you need to create a vxlan zone, then a vlan aware vnet in sdn gui).
It should create something like your current configuration.
(if you need help of the sdn, please post in the sdn forum thread directly)
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!