Hi,
When I try to add two network bridges in /etc/network/interfaces and then restart the server, I get following error after executing the command "systemctl status networking":
Note: More explaining text after the code sections.
The /etc/network/interfaces file:
Executing ip addr:
Executing ip link:
lspci -v command:
pveversion -v command:
With two bridges and the error, the virtual machines (connected to vmbr0) cannot get an IP from my router and cannot access the Internet. The server can ping google.com and 8.8.8.8.
When I remove the vmbr1 part from the interface file and reboot, everthing works fine.
I can also add mutiple OVS bridges along with vmbr0 and it still works.
The error began when I add a 3rd physical network cards (Intel desktop CT) to the server (I have removed the 3rd card before I wrote this post so it did not help).
So I made a fresh install (this post is about the fresh installed Proxmox on the top of Debian Stretch with two physical network cards) and the error is still there.
Removing the two lines "allow-hotplug" did not help either.
I am a bit lost now.
When I try to add two network bridges in /etc/network/interfaces and then restart the server, I get following error after executing the command "systemctl status networking":
Note: More explaining text after the code sections.
Code:
#systemctl status networking
● networking.service - Raise network interfaces
Loaded: loaded (/lib/systemd/system/networking.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Fri 2018-09-07 07:26:46 CEST; 14min ago
Docs: man:interfaces(5)
Process: 2015 ExecStart=/sbin/ifup -a --read-environment (code=exited, status=1/FAILURE)
Process: 1939 ExecStartPre=/bin/sh -c [ "$CONFIGURE_INTERFACES" != "no" ] && [ -n "$(ifquery --read-environment --list --exclude=lo)" ] && udevadm settle (code=exited, status=0/SUCCESS)
Main PID: 2015 (code=exited, status=1/FAILURE)
CPU: 39ms
sep 07 07:26:45 virt systemd[1]: Starting Raise network interfaces...
sep 07 07:26:45 virt ifup[2015]: Waiting for vmbr1 to get ready (MAXWAIT is 10 seconds).
sep 07 07:26:46 virt ifup[2015]: RTNETLINK answers: File exists
sep 07 07:26:46 virt ifup[2015]: ifup: failed to bring up vmbr1
sep 07 07:26:46 virt systemd[1]: networking.service: Main process exited, code=exited, status=1/FAILURE
sep 07 07:26:46 virt systemd[1]: Failed to start Raise network interfaces.
sep 07 07:26:46 virt systemd[1]: networking.service: Unit entered failed state.
sep 07 07:26:46 virt systemd[1]: networking.service: Failed with result 'exit-code'.
The /etc/network/interfaces file:
Code:
auto lo
iface lo inet loopback
allow-hotplug enp1s0
iface enp1s0 inet manual
allow-hotplug eno1
iface eno1 inet manual
auto vmbr0
iface vmbr0 inet static
address 192.168.2.6
netmask 255.255.255.0
gateway 192.168.2.1
bridge_ports enp1s0
bridge_stp off
bridge_fd 0
bridge_maxwait 10
auto vmbr1
iface vmbr1 inet static
address 192.168.6.6
netmask 255.255.255.0
gateway 192.168.6.1
bridge_ports eno1
bridge_stp off
bridge_fd 0
bridge_maxwait 10
Executing ip addr:
Code:
ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eno1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master vmbr1 state DOWN group default qlen 1000
link/ether 1c:98:ec:1e:f4:be brd ff:ff:ff:ff:ff:ff
3: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UP group default qlen 1000
link/ether 68:05:ca:43:8d:9f brd ff:ff:ff:ff:ff:ff
4: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 68:05:ca:43:8d:9f brd ff:ff:ff:ff:ff:ff
inet 192.168.2.6/24 brd 192.168.2.255 scope global vmbr0
valid_lft forever preferred_lft forever
inet6 fe80::6a05:caff:fe43:8d9f/64 scope link
valid_lft forever preferred_lft forever
5: vmbr1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
link/ether 1c:98:ec:1e:f4:be brd ff:ff:ff:ff:ff:ff
inet 192.168.6.6/24 brd 192.168.6.255 scope global vmbr1
valid_lft forever preferred_lft forever
Executing ip link:
Code:
# ip link
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eno1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast master vmbr1 state DOWN mode DEFAULT group default qlen 1000
link/ether 1c:98:ec:1e:f4:be brd ff:ff:ff:ff:ff:ff
3: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UP mode DEFAULT group default qlen 1000
link/ether 68:05:ca:43:8d:9f brd ff:ff:ff:ff:ff:ff
4: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
link/ether 68:05:ca:43:8d:9f brd ff:ff:ff:ff:ff:ff
5: vmbr1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT group default qlen 1000
link/ether 1c:98:ec:1e:f4:be brd ff:ff:ff:ff:ff:ff
lspci -v command:
Code:
~# lspci -v
00:00.0 Host bridge: Intel Corporation Skylake Host Bridge/DRAM Registers (rev 07)
Subsystem: Intel Corporation Skylake Host Bridge/DRAM Registers
Flags: bus master, fast devsel, latency 0
Capabilities: [e0] Vendor Specific Information: Len=10 <?>
Kernel driver in use: ie31200_edac
Kernel modules: ie31200_edac
00:02.0 VGA compatible controller: Intel Corporation HD Graphics P530 (rev 06) (prog-if 00 [VGA controller])
Subsystem: Intel Corporation HD Graphics P530
Flags: bus master, fast devsel, latency 0, IRQ 130
Memory at de000000 (64-bit, non-prefetchable) [size=16M]
Memory at c0000000 (64-bit, prefetchable) [size=256M]
I/O ports at f000 [size=64]
[virtual] Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: [40] Vendor Specific Information: Len=0c <?>
Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [ac] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [d0] Power Management version 2
Capabilities: [100] Process Address Space ID (PASID)
Capabilities: [200] Address Translation Service (ATS)
Capabilities: [300] Page Request Interface (PRI)
Kernel driver in use: i915
Kernel modules: i915
00:08.0 System peripheral: Intel Corporation Skylake Gaussian Mixture Model
Subsystem: Intel Corporation Skylake Gaussian Mixture Model
Flags: fast devsel, IRQ 255
Memory at df13b000 (64-bit, non-prefetchable) [disabled] [size=4K]
Capabilities: [90] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [dc] Power Management version 2
Capabilities: [f0] PCI Advanced Features
00:14.0 USB controller: Intel Corporation Sunrise Point-H USB 3.0 xHCI Controller (rev 31) (prog-if 30 [XHCI])
Subsystem: Intel Corporation Sunrise Point-H USB 3.0 xHCI Controller
Flags: bus master, medium devsel, latency 0, IRQ 123
Memory at df120000 (64-bit, non-prefetchable) [size=64K]
Capabilities: [70] Power Management version 2
Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
Kernel driver in use: xhci_hcd
00:14.2 Signal processing controller: Intel Corporation Sunrise Point-H Thermal subsystem (rev 31)
Subsystem: Intel Corporation Sunrise Point-H Thermal subsystem
Flags: fast devsel, IRQ 18
Memory at df13a000 (64-bit, non-prefetchable) [size=4K]
Capabilities: [50] Power Management version 3
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
Kernel driver in use: intel_pch_thermal
Kernel modules: intel_pch_thermal
00:16.0 Communication controller: Intel Corporation Sunrise Point-H CSME HECI #1 (rev 31)
Subsystem: Intel Corporation Sunrise Point-H CSME HECI
Flags: bus master, fast devsel, latency 0, IRQ 129
Memory at df139000 (64-bit, non-prefetchable) [size=4K]
Capabilities: [50] Power Management version 3
Capabilities: [8c] MSI: Enable+ Count=1/1 Maskable- 64bit+
Kernel driver in use: mei_me
Kernel modules: mei_me
00:17.0 SATA controller: Intel Corporation Sunrise Point-H SATA controller [AHCI mode] (rev 31) (prog-if 01 [AHCI 1.0])
Subsystem: Intel Corporation Sunrise Point-H SATA controller [AHCI mode]
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 124
Memory at df134000 (32-bit, non-prefetchable) [size=8K]
Memory at df138000 (32-bit, non-prefetchable) [size=256]
I/O ports at f090 [size=8]
I/O ports at f080 [size=4]
I/O ports at f060 [size=32]
Memory at df137000 (32-bit, non-prefetchable) [size=2K]
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [70] Power Management version 3
Capabilities: [a8] SATA HBA v1.0
Kernel driver in use: ahci
Kernel modules: ahci
00:1c.0 PCI bridge: Intel Corporation Sunrise Point-H PCI Express Root Port #7 (rev f1) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 122
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: 0000e000-0000efff
Memory behind bridge: df000000-df0fffff
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Intel Corporation Sunrise Point-H PCI Express Root Port
Capabilities: [a0] Power Management version 3
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Access Control Services
Capabilities: [200] L1 PM Substates
Capabilities: [220] #19
Kernel driver in use: pcieport
Kernel modules: shpchp
00:1f.0 ISA bridge: Intel Corporation Sunrise Point-H LPC Controller (rev 31)
Subsystem: Intel Corporation Sunrise Point-H LPC Controller
Flags: bus master, medium devsel, latency 0
00:1f.2 Memory controller: Intel Corporation Sunrise Point-H PMC (rev 31)
Subsystem: Intel Corporation Sunrise Point-H PMC
Flags: fast devsel
Memory at df130000 (32-bit, non-prefetchable) [disabled] [size=16K]
00:1f.4 SMBus: Intel Corporation Sunrise Point-H SMBus (rev 31)
Subsystem: Intel Corporation Sunrise Point-H SMBus
Flags: medium devsel, IRQ 16
Memory at df136000 (64-bit, non-prefetchable) [size=256]
I/O ports at f040 [size=32]
Kernel driver in use: i801_smbus
Kernel modules: i2c_i801
00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (2) I219-LM (rev 31)
Subsystem: Intel Corporation Ethernet Connection (2) I219-LM
Flags: bus master, fast devsel, latency 0, IRQ 125
Memory at df100000 (32-bit, non-prefetchable) [size=128K]
Capabilities: [c8] Power Management version 3
Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [e0] PCI Advanced Features
Kernel driver in use: e1000e
Kernel modules: e1000e
00:1f.7 Non-Essential Instrumentation [1300]: Intel Corporation Sunrise Point-H Northpeak (rev 31)
Flags: bus master, fast devsel, latency 0, IRQ 16
Memory at fe100000 (64-bit, non-prefetchable) [size=1M]
Memory at fe200000 (64-bit, non-prefetchable) [size=2M]
Capabilities: [40] MSI: Enable- Count=1/1 Maskable- 64bit+
Kernel driver in use: intel_th_pci
Kernel modules: intel_th_pci
01:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
Subsystem: Intel Corporation Gigabit CT Desktop Adapter
Flags: bus master, fast devsel, latency 0, IRQ 18
Memory at df0c0000 (32-bit, non-prefetchable) [size=128K]
Memory at df000000 (32-bit, non-prefetchable) [size=512K]
I/O ports at e000 [disabled] [size=32]
Memory at df0e0000 (32-bit, non-prefetchable) [size=16K]
Expansion ROM at df080000 [disabled] [size=256K]
Capabilities: [c8] Power Management version 2
Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [e0] Express Endpoint, MSI 00
Capabilities: [a0] MSI-X: Enable+ Count=5 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Device Serial Number 68-05-ca-ff-ff-43-8d-9f
Kernel driver in use: e1000e
Kernel modules: e1000e
pveversion -v command:
Code:
# pveversion -v
proxmox-ve: 5.2-2 (running kernel: 4.15.18-4-pve)
pve-manager: 5.2-8 (running version: 5.2-8/fdf39912)
pve-kernel-4.15: 5.2-7
pve-kernel-4.15.18-4-pve: 4.15.18-23
corosync: 2.4.2-pve5
criu: 2.11.1-1~bpo90
glusterfs-client: 3.8.8-1
ksm-control-daemon: not correctly installed
libjs-extjs: 6.0.1-2
libpve-access-control: 5.0-8
libpve-apiclient-perl: 2.0-5
libpve-common-perl: 5.0-38
libpve-guest-common-perl: 2.0-17
libpve-http-server-perl: 2.0-10
libpve-storage-perl: 5.0-25
libqb0: 1.0.1-1
lvm2: 2.02.168-pve6
lxc-pve: 3.0.2+pve1-1
lxcfs: 3.0.0-1
novnc-pve: 1.0.0-2
openvswitch-switch: 2.7.0-3
proxmox-widget-toolkit: 1.0-19
pve-cluster: 5.0-30
pve-container: 2.0-26
pve-docs: 5.2-8
pve-firewall: 3.0-14
pve-firmware: 2.0-5
pve-ha-manager: 2.0-5
pve-i18n: 1.0-6
pve-libspice-server1: 0.12.8-3
pve-qemu-kvm: 2.11.2-1
pve-xtermjs: 1.0-5
qemu-server: 5.0-33
smartmontools: 6.5+svn4324-1
spiceterm: 3.0-5
vncterm: 1.5-3
zfsutils-linux: 0.7.9-pve1~bpo9
With two bridges and the error, the virtual machines (connected to vmbr0) cannot get an IP from my router and cannot access the Internet. The server can ping google.com and 8.8.8.8.
When I remove the vmbr1 part from the interface file and reboot, everthing works fine.
I can also add mutiple OVS bridges along with vmbr0 and it still works.
The error began when I add a 3rd physical network cards (Intel desktop CT) to the server (I have removed the 3rd card before I wrote this post so it did not help).
So I made a fresh install (this post is about the fresh installed Proxmox on the top of Debian Stretch with two physical network cards) and the error is still there.
Removing the two lines "allow-hotplug" did not help either.
I am a bit lost now.