[solved] tap devices, but no containers?

O

otto001

Member
Jul 11, 2019
90
6
13
51
Hi,
since upgrading to proxmox 7 I am having a strange problem.
I do not run any containers, only vms. nevertheless, there are many tap and fwpr devices created and routing is not working as expected anymore (want to say: without a proxy configured, I even cannot run apt-update on the host).
Is there a way to prevent the system of creating this (in my eyes problematic) network devices?
This is my interfaces file:
Code: 
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet manual

auto eth1
iface eth1 inet manual

auto eth2
iface eth2 inet manual

auto eth3
iface eth3 inet manual

auto bond0
iface bond0 inet manual
        bond-slaves eth0 eth1 eth2 eth3
        bond-miimon 100
        bond-mode 802.3ad
        up ip link set up dev bond0
        bond-updelay 200
        bond-downdelay 200

auto bond0.10
iface bond0.10 inet manual

auto vmbr0
iface vmbr0 inet static
        address 192.168.1.10/24
        gateway 192.168.1.1
        bridge-ports bond0
        bridge-stp off
        bridge-fd 0
        bridge_waitport 0

auto vmbr1
iface vmbr1 inet static
        address 10.0.0.2/24
        gateway 10.0.0.9
        bridge-ports bond0.10
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 10

and this is the output of ifconfig
Code: 
bond0: flags=-27581<UP,BROADCAST,RUNNING,MASTER,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.43.162  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::3eec:efff:fe20:d600  prefixlen 64  scopeid 0x20<link>
        ether 3c:ec:ef:20:d6:00  txqueuelen 1000  (Ethernet)
        RX packets 1688077016  bytes 1653302454219 (1.5 TiB)
        RX errors 0  dropped 201845  overruns 2939  frame 0
        TX packets 1740469144  bytes 1820419393834 (1.6 TiB)
        TX errors 0  dropped 13 overruns 0  carrier 0  collisions 0

bond0.10: flags=-28605<UP,BROADCAST,RUNNING,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.168.235  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::3eec:efff:fe20:d600  prefixlen 64  scopeid 0x20<link>
        ether 3c:ec:ef:20:d6:00  txqueuelen 1000  (Ethernet)
        RX packets 304041558  bytes 614431046960 (572.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 291751043  bytes 60549907195 (56.3 GiB)
        TX errors 0  dropped 6 overruns 0  carrier 0  collisions 0

eth0: flags=-26557<UP,BROADCAST,RUNNING,SLAVE,MULTICAST,DYNAMIC>  mtu 1500
        ether 3c:ec:ef:20:d6:00  txqueuelen 1000  (Ethernet)
        RX packets 271197696  bytes 275968808725 (257.0 GiB)
        RX errors 0  dropped 2939  overruns 2939  frame 0
        TX packets 237097022  bytes 280886357260 (261.5 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xc7160000-c717ffff 

eth1: flags=-26557<UP,BROADCAST,RUNNING,SLAVE,MULTICAST,DYNAMIC>  mtu 1500
        ether 3c:ec:ef:20:d6:00  txqueuelen 1000  (Ethernet)
        RX packets 291043006  bytes 136911450046 (127.5 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 211097567  bytes 128884394892 (120.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xc7140000-c715ffff 

eth2: flags=-26557<UP,BROADCAST,RUNNING,SLAVE,MULTICAST,DYNAMIC>  mtu 1500
        ether 3c:ec:ef:20:d6:00  txqueuelen 1000  (Ethernet)
        RX packets 79471693  bytes 71230657375 (66.3 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 884595044  bytes 1212895941822 (1.1 TiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xc7120000-c713ffff 

eth3: flags=-26557<UP,BROADCAST,RUNNING,SLAVE,MULTICAST,DYNAMIC>  mtu 1500
        ether 3c:ec:ef:20:d6:00  txqueuelen 1000  (Ethernet)
        RX packets 1046364621  bytes 1169191538073 (1.0 TiB)
        RX errors 0  dropped 1  overruns 0  frame 0
        TX packets 407679511  bytes 197752699860 (184.1 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xc7100000-c711ffff 

fwbr105i0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::64af:4aff:feff:e1ff  prefixlen 64  scopeid 0x20<link>
        inet6 fd40:85f0:966d:0:64af:4aff:feff:e1ff  prefixlen 64  scopeid 0x0<global>
        ether 66:af:4a:ff:e1:ff  txqueuelen 1000  (Ethernet)
        RX packets 14450555  bytes 906330747 (864.3 MiB)
        RX errors 0  dropped 6003816  overruns 0  frame 0
        TX packets 112962  bytes 9585667 (9.1 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

fwbr107i0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::c8e:90ff:fe7a:c5f3  prefixlen 64  scopeid 0x20<link>
        inet6 fd40:85f0:966d:0:c8e:90ff:fe7a:c5f3  prefixlen 64  scopeid 0x0<global>
        ether 0e:8e:90:7a:c5:f3  txqueuelen 1000  (Ethernet)
        RX packets 14352496  bytes 900190589 (858.4 MiB)
        RX errors 0  dropped 6004678  overruns 0  frame 0
        TX packets 26123  bytes 2220262 (2.1 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

fwln105i0: flags=-28605<UP,BROADCAST,RUNNING,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.10.164  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::64af:4aff:feff:e1ff  prefixlen 64  scopeid 0x20<link>
        ether 66:af:4a:ff:e1:ff  txqueuelen 1000  (Ethernet)
        RX packets 285232308  bytes 1207157760133 (1.0 TiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 119752744  bytes 1771724057152 (1.6 TiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

fwln107i0: flags=-28605<UP,BROADCAST,RUNNING,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.47.120  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::c8e:90ff:fe7a:c5f3  prefixlen 64  scopeid 0x20<link>
        ether 0e:8e:90:7a:c5:f3  txqueuelen 1000  (Ethernet)
        RX packets 18327967  bytes 1413144690 (1.3 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1151711  bytes 165926751 (158.2 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

fwpr105p0: flags=-28605<UP,BROADCAST,RUNNING,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.245.129  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::dc7f:aeff:fee6:8a2  prefixlen 64  scopeid 0x20<link>
        ether de:7f:ae:e6:08:a2  txqueuelen 1000  (Ethernet)
        RX packets 119752744  bytes 1771724057152 (1.6 TiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 285232308  bytes 1207157760133 (1.0 TiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

fwpr107p0: flags=-28605<UP,BROADCAST,RUNNING,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.248.180  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::d00a:b9ff:fe26:6e2e  prefixlen 64  scopeid 0x20<link>
        ether d2:0a:b9:26:6e:2e  txqueuelen 1000  (Ethernet)
        RX packets 1151711  bytes 165926751 (158.2 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 18327967  bytes 1413144690 (1.3 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Lokale Schleife)
        RX packets 22101377  bytes 4006368407 (3.7 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 22101377  bytes 4006368407 (3.7 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tap102i0: flags=4419<UP,BROADCAST,RUNNING,PROMISC,MULTICAST>  mtu 1500
        ether b2:97:a6:7c:66:e8  txqueuelen 1000  (Ethernet)
        RX packets 90840617  bytes 23326052764 (21.7 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 63854560  bytes 518709676670 (483.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tap103i0: flags=-28349<UP,BROADCAST,RUNNING,PROMISC,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.61.67  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::3c3e:a0ff:fecd:4cc0  prefixlen 64  scopeid 0x20<link>
        ether 3e:3e:a0:cd:4c:c0  txqueuelen 1000  (Ethernet)
        RX packets 49206582  bytes 5690020057 (5.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 85896536  bytes 66533783464 (61.9 GiB)
        TX errors 0  dropped 263 overruns 0  carrier 0  collisions 0

tap105i0: flags=-28349<UP,BROADCAST,RUNNING,PROMISC,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.219.29  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::1483:aff:fe2b:5dbd  prefixlen 64  scopeid 0x20<link>
        ether 16:83:0a:2b:5d:bd  txqueuelen 1000  (Ethernet)
        RX packets 119538221  bytes 1771655597990 (1.6 TiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 284998078  bytes 1207167179893 (1.0 TiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tap107i0: flags=-28349<UP,BROADCAST,RUNNING,PROMISC,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.28.51  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::acde:b1ff:fe21:a3a7  prefixlen 64  scopeid 0x20<link>
        ether ae:de:b1:21:a3:a7  txqueuelen 1000  (Ethernet)
        RX packets 1024012  bytes 104824160 (99.9 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 18197266  bytes 1430502053 (1.3 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tap108i0: flags=-28349<UP,BROADCAST,RUNNING,PROMISC,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.237.139  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::808b:e2ff:fe81:a91f  prefixlen 64  scopeid 0x20<link>
        ether 82:8b:e2:81:a9:1f  txqueuelen 1000  (Ethernet)
        RX packets 208219867  bytes 694088722124 (646.4 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 440925747  bytes 974124362840 (907.2 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tap110i0: flags=-28349<UP,BROADCAST,RUNNING,PROMISC,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.45.62  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::fc4a:87ff:fec0:32b0  prefixlen 64  scopeid 0x20<link>
        ether fe:4a:87:c0:32:b0  txqueuelen 1000  (Ethernet)
        RX packets 2332241  bytes 452064664 (431.1 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 19855372  bytes 2628906533 (2.4 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tap113i0: flags=-28349<UP,BROADCAST,RUNNING,PROMISC,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.243.153  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::3011:aeff:fe97:32ad  prefixlen 64  scopeid 0x20<link>
        ether 32:11:ae:97:32:ad  txqueuelen 1000  (Ethernet)
        RX packets 465004959  bytes 627967347071 (584.8 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 309086724  bytes 60487396198 (56.3 GiB)
        TX errors 0  dropped 1863 overruns 0  carrier 0  collisions 0

tap113i1: flags=-28349<UP,BROADCAST,RUNNING,PROMISC,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.254.136  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::80ed:9ff:fe45:961e  prefixlen 64  scopeid 0x20<link>
        ether 82:ed:09:45:96:1e  txqueuelen 1000  (Ethernet)
        RX packets 291640364  bytes 60490478992 (56.3 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 466799265  bytes 629434667633 (586.2 GiB)
        TX errors 0  dropped 1913 overruns 0  carrier 0  collisions 0

tap114i0: flags=-28349<UP,BROADCAST,RUNNING,PROMISC,MULTICAST,DYNAMIC>  mtu 1500
        inet 169.254.132.136  netmask 255.255.0.0  broadcast 169.254.255.255
        inet6 fe80::6cc5:80ff:fe10:e906  prefixlen 64  scopeid 0x20<link>
        ether 6e:c5:80:10:e9:06  txqueuelen 1000  (Ethernet)
        RX packets 17772759  bytes 101761025572 (94.7 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 32820344  bytes 3379438340 (3.1 GiB)
        TX errors 0  dropped 110 overruns 0  carrier 0  collisions 0

vmbr0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.1.10  netmask 255.255.255.0  broadcast 0.0.0.0
        inet6 fe80::3eec:efff:fe20:d600  prefixlen 64  scopeid 0x20<link>
        ether 3c:ec:ef:20:d6:00  txqueuelen 1000  (Ethernet)
        RX packets 557381060  bytes 2731385024486 (2.4 TiB)
        RX errors 0  dropped 6005210  overruns 0  frame 0
        TX packets 579782895  bytes 3210560924602 (2.9 TiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

vmbr1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.0.0.2  netmask 255.255.255.0  broadcast 0.0.0.0
        inet6 fe80::3eec:efff:fe20:d600  prefixlen 64  scopeid 0x20<link>
        ether 3c:ec:ef:20:d6:00  txqueuelen 1000  (Ethernet)
        RX packets 1124578  bytes 137273629 (130.9 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 7094  bytes 458802 (448.0 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
any help would be great!
Best regards and thanks in advance,
Otto
 
you have 1 tap interface for each vm nic. and fwpr interfaces when firewall checkbox is enabled on the nic.

nothing new here. (same since proxmox 1 ;)


say: without a proxy configured, I even cannot run apt-update on the host).
Click to expand...
can you ping your gateway ? (I suppose that you're doing nat on your gateway for internet access ?
 
spirit said:
you have 1 tap interface for each vm nic. and fwpr interfaces when firewall checkbox is enabled on the nic.

nothing new here. (same since proxmox 1 ;)



can you ping your gateway ? (I suppose that you're doing nat on your gateway for internet access ?
Click to expand...
Thanks.
This is weird. But I dont have firewall enabled on any of my VMs. Still there are 9 tap-devices.
I can not ping my gateway (as I am blocking pings there) - but I can connect using ssh from the host to the Gateway VM (Opnsense).
Hm. One additional thing is crazy:
I have DISABLED IPv6 on the host using
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6=1
in sysctl.conf.
Nevertheless apt _seems_ to try to use IPv6:
Code: 
Fehl:1 http://deb.debian.org/debian bullseye InRelease                                                                                                               
  Verbindung mit deb.debian.org:80 kann nicht aufgebaut werden (2a04:4e42:2d::644). - connect (101: Das Netzwerk ist nicht erreichbar) Verbindung mit deb.debian.org:80 nicht möglich (151.101.190.132) - connect (113: Keine Route zum Zielrechner)
(meaning no route to host, network not reachable).
 
I should add one thing:
When I am using VPN from outside my home net, I can access all the VMs and hosts. But not this Proxmox host. Only if I am using a VM and then ssh to the host.
The gateway has an internal IP in the 192.168.1 subnet and an "external" IP in the 10.0.0 subnet.
I suppose, that the host tries to use the 10.0.0 net for connections to the internet, what will not work. It should use the 192.168.1 net.
Just to clarify:
The gateway is a VM running on this host. The 10.0.0 net is a VLAN on the switch which only can be accessed by this host, the VM of the gateway and the internet router. So all internal traffic must go through the internal IP of the Opnsense VM, which is working flawlessly - only not at this host. (anymore)
So the host needs to have a bridge in the 10.0.0 VLAN, but it should use the other bridge for internet traffic....
This worked until the proxmox upgrade to 7. I had to reconfigure network then.

/update:
I could solve the problem by redefining the default route after writing down the problem above :)
I added
post-up route add default via 192.168.1.1 dev vmbr0 proto static
and
post-up route del default dev vmbr1
to interfaces file....
Now everything works again as it should (internet access of the host and accessing the host using VPN)
Strange anyway....
 
Last edited:
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back