No network access for guests (VM or LXC) - works for host

callumgare

Member
Sep 27, 2020
3
0
6
29
I’m completely stumped by this one o_O. One of my servers running Proxmox has 2 NIC’s which I have bonded together. A VLAN interfaces is created from that bond interface and then two bridges are created, one with a slave to the bond interface and one with a slave to the VLAN interface. These two bridges each have their own statically assigned addresses which belong to one of two separate subnets.

Code:
NIC 1                  
     \                    
      --- BOND 1 ----------------------------- VMBR 1
     /          \
NIC 2             --- BOND 1 [VLAN TAG 88] --- VMBR 2

The /etc/network/interfaces file on the host looks like this:
Code:
auto lo
iface lo inet loopback

auto enp0s25
iface enp0s25 inet manual

auto enp3s0
iface enp3s0 inet manual

auto bond0
iface bond0 inet manual
    slaves enp0s5 enp3s0
    bond-miimon 100
    bond-mode 802.3ad
    bond-xmit-hash-policy layer2+3

iface bond0.88 inet manual

auto vmbr0
iface vmbr0 inet static
    address 192.168.1.10/24
    gateway 192.168.1.1
    bridge-ports bond0
    bridge-stp off
    bridge-fd 0
    dns-search XXXXX
    hwaddress ether XX:XX:XX:XX:XX:XX

auto vmbr1
iface vmbr1 inet static
    address 10.XX.XX.10/24
    bridge-ports bond0.88
    bridge-stp off
    bridge-fd 0
    dns-search XXXXXX
    hwaddress ether XX:XX:XX:XX:XX:XX

The host (and any docker containers running directly on the host) can access the network perfectly fine. Previously so could my Proxmox guests however all guests now have no network access. Meaning they have two NIC's, one for each bridge, and neither interface seems to be able to send or receive any packets. DHCP fails because of this so I’ve currently give them a static address on the network. This doesn't help though. With static addresses they now seem to valid routes and links but I still can’t ping either the host or the router.

ezgif.com-gif-maker(2).png
ezgif.com-gif-maker(1).png
ezgif.com-gif-maker(3).png

Running brctl on the host show that interfaces have definitely been bound to the bridges.
Code:
$ sudo brctl show
bridge name    bridge id        STP enabled    interfaces  
fwbr109i0        8000.3263d2109bd5    no        fwln109i0
                                                veth109i0
fwbr109i1        8000.ea8496aec78e    no        fwln109i1
                                                veth109i1
vmbr0        8000.42ffff000110    no        bond0
                                            fwpr109p0
vmbr1        8000.42ffff423710    no        bond0.88
                                            fwpr109p1

What’s particularly confusing to me as I have two machines on the same network, both with pretty much exactly the same setup and one works fine but the other does not.

I’ve been doing a whole bunch of fiddling recently with my setup so it’s not obvious to me what if any change I have made has stopped this working. I've scoured the internet and these forums specifically for clues but so far nothing has helped. I'm on the verge of reinstalling the OS (Proxmox). But that would be a pain in the neck to reconfigure services which run on the host like SMB so before I give up I thought I'd post here and see if any of you smart folks have any ideas. Suggestions as to what might be wrong or additional tools that I could use to diagnose the issue would be much appreciated!

Thanks very much :)
 

Attachments

  • ezgif.com-gif-maker.png
    ezgif.com-gif-maker.png
    64.8 KB · Views: 6
Looks like the culprit was docker. No idea why docker and proxmox co-existed peacefully for so long before breaking but this does seem to fix things: https://forum.proxmox.com/threads/tutorial-proxmox-with-docker-and-portainer.77275/
1f615.png
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!