[SOLVED] Cannot add two network bridges

bobnick

New Member
Sep 7, 2018
5
0
1
Hi,

When I try to add two network bridges in /etc/network/interfaces and then restart the server, I get following error after executing the command "systemctl status networking":

Note: More explaining text after the code sections.

Code:
#systemctl status networking
● networking.service - Raise network interfaces
   Loaded: loaded (/lib/systemd/system/networking.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Fri 2018-09-07 07:26:46 CEST; 14min ago
     Docs: man:interfaces(5)
  Process: 2015 ExecStart=/sbin/ifup -a --read-environment (code=exited, status=1/FAILURE)
  Process: 1939 ExecStartPre=/bin/sh -c [ "$CONFIGURE_INTERFACES" != "no" ] && [ -n "$(ifquery --read-environment --list --exclude=lo)" ] && udevadm settle (code=exited, status=0/SUCCESS)
 Main PID: 2015 (code=exited, status=1/FAILURE)
      CPU: 39ms

sep 07 07:26:45 virt systemd[1]: Starting Raise network interfaces...
sep 07 07:26:45 virt ifup[2015]: Waiting for vmbr1 to get ready (MAXWAIT is 10 seconds).
sep 07 07:26:46 virt ifup[2015]: RTNETLINK answers: File exists
sep 07 07:26:46 virt ifup[2015]: ifup: failed to bring up vmbr1
sep 07 07:26:46 virt systemd[1]: networking.service: Main process exited, code=exited, status=1/FAILURE
sep 07 07:26:46 virt systemd[1]: Failed to start Raise network interfaces.
sep 07 07:26:46 virt systemd[1]: networking.service: Unit entered failed state.
sep 07 07:26:46 virt systemd[1]: networking.service: Failed with result 'exit-code'.

The /etc/network/interfaces file:

Code:
auto lo
iface lo inet loopback

allow-hotplug enp1s0
iface enp1s0 inet manual

allow-hotplug eno1
iface eno1 inet manual

auto vmbr0
iface vmbr0 inet static
   address 192.168.2.6
   netmask 255.255.255.0
   gateway 192.168.2.1
   bridge_ports enp1s0
   bridge_stp off
   bridge_fd 0
   bridge_maxwait 10

auto vmbr1
iface vmbr1 inet static
   address 192.168.6.6
   netmask 255.255.255.0
   gateway 192.168.6.1
   bridge_ports eno1
   bridge_stp off
   bridge_fd 0
   bridge_maxwait 10

Executing ip addr:
Code:
 ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eno1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master vmbr1 state DOWN group default qlen 1000
    link/ether 1c:98:ec:1e:f4:be brd ff:ff:ff:ff:ff:ff
3: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UP group default qlen 1000
    link/ether 68:05:ca:43:8d:9f brd ff:ff:ff:ff:ff:ff
4: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 68:05:ca:43:8d:9f brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.6/24 brd 192.168.2.255 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 fe80::6a05:caff:fe43:8d9f/64 scope link
       valid_lft forever preferred_lft forever
5: vmbr1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
    link/ether 1c:98:ec:1e:f4:be brd ff:ff:ff:ff:ff:ff
    inet 192.168.6.6/24 brd 192.168.6.255 scope global vmbr1
       valid_lft forever preferred_lft forever

Executing ip link:
Code:
# ip link
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master vmbr1 state DOWN mode DEFAULT group default qlen 1000
    link/ether 1c:98:ec:1e:f4:be brd ff:ff:ff:ff:ff:ff
3: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 68:05:ca:43:8d:9f brd ff:ff:ff:ff:ff:ff
4: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether 68:05:ca:43:8d:9f brd ff:ff:ff:ff:ff:ff
5: vmbr1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
    link/ether 1c:98:ec:1e:f4:be brd ff:ff:ff:ff:ff:ff

lspci -v command:
Code:
~#  lspci -v
00:00.0 Host bridge: Intel Corporation Skylake Host Bridge/DRAM Registers (rev 07)
        Subsystem: Intel Corporation Skylake Host Bridge/DRAM Registers
        Flags: bus master, fast devsel, latency 0
        Capabilities: [e0] Vendor Specific Information: Len=10 <?>
        Kernel driver in use: ie31200_edac
        Kernel modules: ie31200_edac

00:02.0 VGA compatible controller: Intel Corporation HD Graphics P530 (rev 06) (prog-if 00 [VGA controller])
        Subsystem: Intel Corporation HD Graphics P530
        Flags: bus master, fast devsel, latency 0, IRQ 130
        Memory at de000000 (64-bit, non-prefetchable) [size=16M]
        Memory at c0000000 (64-bit, prefetchable) [size=256M]
        I/O ports at f000 [size=64]
        [virtual] Expansion ROM at 000c0000 [disabled] [size=128K]
        Capabilities: [40] Vendor Specific Information: Len=0c <?>
        Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00
        Capabilities: [ac] MSI: Enable+ Count=1/1 Maskable- 64bit-
        Capabilities: [d0] Power Management version 2
        Capabilities: [100] Process Address Space ID (PASID)
        Capabilities: [200] Address Translation Service (ATS)
        Capabilities: [300] Page Request Interface (PRI)
        Kernel driver in use: i915
        Kernel modules: i915

00:08.0 System peripheral: Intel Corporation Skylake Gaussian Mixture Model
        Subsystem: Intel Corporation Skylake Gaussian Mixture Model
        Flags: fast devsel, IRQ 255
        Memory at df13b000 (64-bit, non-prefetchable) [disabled] [size=4K]
        Capabilities: [90] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [dc] Power Management version 2
        Capabilities: [f0] PCI Advanced Features

00:14.0 USB controller: Intel Corporation Sunrise Point-H USB 3.0 xHCI Controller (rev 31) (prog-if 30 [XHCI])
        Subsystem: Intel Corporation Sunrise Point-H USB 3.0 xHCI Controller
        Flags: bus master, medium devsel, latency 0, IRQ 123
        Memory at df120000 (64-bit, non-prefetchable) [size=64K]
        Capabilities: [70] Power Management version 2
        Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
        Kernel driver in use: xhci_hcd

00:14.2 Signal processing controller: Intel Corporation Sunrise Point-H Thermal subsystem (rev 31)
        Subsystem: Intel Corporation Sunrise Point-H Thermal subsystem
        Flags: fast devsel, IRQ 18
        Memory at df13a000 (64-bit, non-prefetchable) [size=4K]
        Capabilities: [50] Power Management version 3
        Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
        Kernel driver in use: intel_pch_thermal
        Kernel modules: intel_pch_thermal

00:16.0 Communication controller: Intel Corporation Sunrise Point-H CSME HECI #1 (rev 31)
        Subsystem: Intel Corporation Sunrise Point-H CSME HECI
        Flags: bus master, fast devsel, latency 0, IRQ 129
        Memory at df139000 (64-bit, non-prefetchable) [size=4K]
        Capabilities: [50] Power Management version 3
        Capabilities: [8c] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Kernel driver in use: mei_me
        Kernel modules: mei_me

00:17.0 SATA controller: Intel Corporation Sunrise Point-H SATA controller [AHCI mode] (rev 31) (prog-if 01 [AHCI 1.0])
        Subsystem: Intel Corporation Sunrise Point-H SATA controller [AHCI mode]
        Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 124
        Memory at df134000 (32-bit, non-prefetchable) [size=8K]
        Memory at df138000 (32-bit, non-prefetchable) [size=256]
        I/O ports at f090 [size=8]
        I/O ports at f080 [size=4]
        I/O ports at f060 [size=32]
        Memory at df137000 (32-bit, non-prefetchable) [size=2K]
        Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
        Capabilities: [70] Power Management version 3
        Capabilities: [a8] SATA HBA v1.0
        Kernel driver in use: ahci
        Kernel modules: ahci

00:1c.0 PCI bridge: Intel Corporation Sunrise Point-H PCI Express Root Port #7 (rev f1) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 122
        Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
        I/O behind bridge: 0000e000-0000efff
        Memory behind bridge: df000000-df0fffff
        Capabilities: [40] Express Root Port (Slot+), MSI 00
        Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
        Capabilities: [90] Subsystem: Intel Corporation Sunrise Point-H PCI Express Root Port
        Capabilities: [a0] Power Management version 3
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Access Control Services
        Capabilities: [200] L1 PM Substates
        Capabilities: [220] #19
        Kernel driver in use: pcieport
        Kernel modules: shpchp

00:1f.0 ISA bridge: Intel Corporation Sunrise Point-H LPC Controller (rev 31)
        Subsystem: Intel Corporation Sunrise Point-H LPC Controller
        Flags: bus master, medium devsel, latency 0

00:1f.2 Memory controller: Intel Corporation Sunrise Point-H PMC (rev 31)
        Subsystem: Intel Corporation Sunrise Point-H PMC
        Flags: fast devsel
        Memory at df130000 (32-bit, non-prefetchable) [disabled] [size=16K]

00:1f.4 SMBus: Intel Corporation Sunrise Point-H SMBus (rev 31)
        Subsystem: Intel Corporation Sunrise Point-H SMBus
        Flags: medium devsel, IRQ 16
        Memory at df136000 (64-bit, non-prefetchable) [size=256]
        I/O ports at f040 [size=32]
        Kernel driver in use: i801_smbus
        Kernel modules: i2c_i801

00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (2) I219-LM (rev 31)
        Subsystem: Intel Corporation Ethernet Connection (2) I219-LM
        Flags: bus master, fast devsel, latency 0, IRQ 125
        Memory at df100000 (32-bit, non-prefetchable) [size=128K]
        Capabilities: [c8] Power Management version 3
        Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Capabilities: [e0] PCI Advanced Features
        Kernel driver in use: e1000e
        Kernel modules: e1000e

00:1f.7 Non-Essential Instrumentation [1300]: Intel Corporation Sunrise Point-H Northpeak (rev 31)
        Flags: bus master, fast devsel, latency 0, IRQ 16
        Memory at fe100000 (64-bit, non-prefetchable) [size=1M]
        Memory at fe200000 (64-bit, non-prefetchable) [size=2M]
        Capabilities: [40] MSI: Enable- Count=1/1 Maskable- 64bit+
        Kernel driver in use: intel_th_pci
        Kernel modules: intel_th_pci

01:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
        Subsystem: Intel Corporation Gigabit CT Desktop Adapter
        Flags: bus master, fast devsel, latency 0, IRQ 18
        Memory at df0c0000 (32-bit, non-prefetchable) [size=128K]
        Memory at df000000 (32-bit, non-prefetchable) [size=512K]
        I/O ports at e000 [disabled] [size=32]
        Memory at df0e0000 (32-bit, non-prefetchable) [size=16K]
        Expansion ROM at df080000 [disabled] [size=256K]
        Capabilities: [c8] Power Management version 2
        Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [e0] Express Endpoint, MSI 00
        Capabilities: [a0] MSI-X: Enable+ Count=5 Masked-
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 68-05-ca-ff-ff-43-8d-9f
        Kernel driver in use: e1000e
        Kernel modules: e1000e

pveversion -v command:
Code:
# pveversion -v
proxmox-ve: 5.2-2 (running kernel: 4.15.18-4-pve)
pve-manager: 5.2-8 (running version: 5.2-8/fdf39912)
pve-kernel-4.15: 5.2-7
pve-kernel-4.15.18-4-pve: 4.15.18-23
corosync: 2.4.2-pve5
criu: 2.11.1-1~bpo90
glusterfs-client: 3.8.8-1
ksm-control-daemon: not correctly installed
libjs-extjs: 6.0.1-2
libpve-access-control: 5.0-8
libpve-apiclient-perl: 2.0-5
libpve-common-perl: 5.0-38
libpve-guest-common-perl: 2.0-17
libpve-http-server-perl: 2.0-10
libpve-storage-perl: 5.0-25
libqb0: 1.0.1-1
lvm2: 2.02.168-pve6
lxc-pve: 3.0.2+pve1-1
lxcfs: 3.0.0-1
novnc-pve: 1.0.0-2
openvswitch-switch: 2.7.0-3
proxmox-widget-toolkit: 1.0-19
pve-cluster: 5.0-30
pve-container: 2.0-26
pve-docs: 5.2-8
pve-firewall: 3.0-14
pve-firmware: 2.0-5
pve-ha-manager: 2.0-5
pve-i18n: 1.0-6
pve-libspice-server1: 0.12.8-3
pve-qemu-kvm: 2.11.2-1
pve-xtermjs: 1.0-5
qemu-server: 5.0-33
smartmontools: 6.5+svn4324-1
spiceterm: 3.0-5
vncterm: 1.5-3
zfsutils-linux: 0.7.9-pve1~bpo9

With two bridges and the error, the virtual machines (connected to vmbr0) cannot get an IP from my router and cannot access the Internet. The server can ping google.com and 8.8.8.8.

When I remove the vmbr1 part from the interface file and reboot, everthing works fine.
I can also add mutiple OVS bridges along with vmbr0 and it still works.

The error began when I add a 3rd physical network cards (Intel desktop CT) to the server (I have removed the 3rd card before I wrote this post so it did not help).
So I made a fresh install (this post is about the fresh installed Proxmox on the top of Debian Stretch with two physical network cards) and the error is still there.

Removing the two lines "allow-hotplug" did not help either.

I am a bit lost now.
 
you have 2 gateways configured, this will not work
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!