VM Network not working

[Mike Loiterman]

I have a SuperMicro X11SSH-CTF motherboard with dual Intel X550 10GBase-T network adaptors.

Proxmox recognizes the adaptor with ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k.

Both ports are configured like this in the Node and I can ping both addresses from my local network:

auto lo
iface lo inet loopback

allow-hotplug eno1
iface eno1 inet manual

allow-hotplug eno2
iface eno2 inet manual

auto vmbr0
iface vmbr0 inet static
    address  192.168.1.30
    netmask  255.255.255.0
    gateway  192.168.1.1
    bridge-ports eno1
    bridge-stp off
    bridge-fd 0

auto vmbr1
iface vmbr1 inet static
    address  192.168.1.31
    netmask  255.255.255.0
    bridge-ports eno2
    bridge-stp off
    bridge-fd 0

The issue I have is that when I assign vmbr1 to my virtual machine, I get no network connectivity. If I assign vmbr0, it works perfectly.

Any ideas?

 

[Mike Loiterman]

I have not made any progress on this.

1. Rebooting host
2. Assigning static IPs
3. Assigning static DHCP
4. Setting auto for the eno device

Nothing will get this second interface to work. I know the port is OK because it was just in use with another OS and I can ping the IP address. It's got to be a Layer 6 or 7 issue.

 

[Alvks]

You did not define your gateway (192.168.1.1) for interface vmbr1. I may be wrong, but this would be what I would try first.

You have...

auto vmbr1
iface vmbr1 inet static
   address  192.168.1.31
   netmask  255.255.255.0
   bridge-ports eno2
   bridge-stp off
   bridge-fd 0

...when it should be

auto vmbr1
iface vmbr1 inet static
   address  192.168.1.31
   netmask  255.255.255.0
   gateway  192.168.1.1
   bridge-ports eno2
   bridge-stp off
   bridge-fd 0

 

[sb-jw]

You can only define one default Gateway per System. Otherwise you have to work with a FW in front who handle it or use Metrics.

 

[Mike Loiterman]

You can only define one default Gateway per System. Otherwise you have to work with a FW in front who handle it or use Metrics.

This is the problem. I want both interfaces to go out the same route. In other words I want the gateway for both to be 192.168.1.1. But this is what I thought was configured:

root@node:~# ip r
default via 192.168.1.1 dev vmbr0 onlink
192.168.1.0/24 dev vmbr0 proto kernel scope link src 192.168.1.30
192.168.1.0/24 dev vmbr1 proto kernel scope link src 192.168.1.31

But this doesn't work.

 

[sb-jw]

I found this German article, which you can try: https://www.thomas-krenn.com/de/wiki/Zwei_Default_Gateways_in_einem_System

 

[Mike Loiterman]

I followed the english version of that:
https://www.thomas-krenn.com/en/wiki/Two_Default_Gateways_on_One_System

and still couldn't get it to work.

But doesn't this:

root@marshall:~# ip r
default via 192.168.1.1 dev vmbr0 onlink 
192.168.1.0/24 dev vmbr0 proto kernel scope link src 192.168.1.30 
192.168.1.0/24 dev vmbr1 proto kernel scope link src 192.168.1.31

Indicate that the default route for everything is 192.1681.1?