Error: ipv4: Address already assigned

GTA_doum

Member
May 8, 2023
17
0
6
Hello,
I have four Proxmox servers, updated to the latest verion. Each have their network configured in the same fashion, with multiple network cards, which are either not getting an IPv4, getting one by DHCP or one, vmbr0, having a static assignment.
On vmbr0, each server has its own IP within the same subnet, 10.0.254.0/24, which I dedicated for a second link for the cluster (but it does not seem to work, but that will be for another thread). Two servers are able to start the networking service successfully, two are reporting "Error: ipv4: Address already assigned"! Each server has a unique IP on a unique NIC, which is the bridge vmbr0, for example :

auto vmbr0
iface vmbr0 inet static
address 10.0.254.245/24
bridge-ports enx3c8cf8602e4c
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

iface vmbr0 inet6 auto

From each server, I can ping all other servers within that subnet, which means the vmbr0 bridge has started properly, despite the failure of networking service to start on two servers.

What could cause that and how to fix it?

Thanks.
 
I will show instead one from a working one and one from a non-working one. There is no conflict in the IP addresses of vmbr0 between them :

Working :
**********
auto lo
iface lo inet loopback

iface lo inet6 loopback

iface eno1 inet manual

iface eno1 inet6 manual

auto eno2
iface eno2 inet manual

iface eno2 inet6 manual

auto eno3
iface eno3 inet manual

iface eno3 inet6 manual

iface eno4 inet manual

iface eno4 inet6 manual

auto enx5c857e38f637
iface enx5c857e38f637 inet manual

iface enx5c857e38f637 inet6 manual

iface ens5f0 inet manual

iface ens5f0 inet6 manual

iface ens5f1 inet manual

iface ens5f1 inet6 manual

auto bond3
iface bond3 inet manual
bond-slaves eno2 eno3
bond-miimon 100
bond-mode 802.3ad
bond-xmit-hash-policy layer2

iface bond3 inet6 manual

auto vmbr10
iface vmbr10 inet dhcp
bridge-ports ens5f0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

iface vmbr10 inet6 auto
post-up echo "$(date '+%Y-%m-%d %H:%M:%S') - Running post-up for vmbr10" >> /var/log/network.log
post-up sleep 2 && ip -6 route del 2001:470:b008::/64 dev vmbr10
post-up ip -6 route add 2001:470:b008::/64 dev vmbr10 metric 1

auto vmbr0
iface vmbr0 inet static
address 10.0.254.246/24
bridge-ports enx5c857e38f637
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

iface vmbr0 inet6 auto
post-up echo "$(date '+%Y-%m-%d %H:%M:%S') - Running post-up for vmbr0" >> /var/log/network.log
post-up sleep 2 && ip -6 route del 2001:470:b008::/64 dev vmbr0
post-up ip -6 route add 2001:470:b008::/64 dev vmbr0 metric 10

auto vmbr2
iface vmbr2 inet manual
bridge-ports eno1
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

iface vmbr2 inet6 manual

auto vmbr3
iface vmbr3 inet manual
bridge-ports bond3
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

iface vmbr3 inet6 manual

auto vmbr33
iface vmbr33 inet dhcp
bridge-ports bond3.3
bridge-stp off
bridge-fd 0
hwaddr 92:c5:4c:56:e7:92

iface vmbr33 inet6 auto
**********



Non working :
**********
auto lo
iface lo inet loopback

iface lo inet6 loopback

iface ens3f0 inet manual

iface ens3f0 inet6 manual

iface ens3f1 inet manual

iface ens3f1 inet6 manual

iface eno1 inet manual

iface eno1 inet6 manual

iface eno2 inet manual

iface eno2 inet6 manual

iface eno3 inet manual

iface eno3 inet6 manual

iface eno4 inet manual

iface eno4 inet6 manual

iface enx3c8cf8602e4c inet manual

iface enx3c8cf8602e4c inet6 manual

auto vmbr10
iface vmbr10 inet dhcp
bridge-ports ens3f0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

iface vmbr10 inet6 auto
post-up echo "$(date '+%Y-%m-%d %H:%M:%S') - Running post-up for vmbr10" >> /var/log/network.log
post-up sleep 2 && ip -6 route del 2001:470:b008::/64 dev vmbr10
post-up ip -6 route add 2001:470:b008::/64 dev vmbr10 metric 1

auto vmbr0
iface vmbr0 inet static
address 10.0.254.245/24
bridge-ports enx3c8cf8602e4c
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

iface vmbr0 inet6 auto
post-up echo "$(date '+%Y-%m-%d %H:%M:%S') - Running post-up for vmbr0" >> /var/log/network.log
post-up sleep 2 && ip -6 route del 2001:470:b008::/64 dev vmbr0
post-up ip -6 route add 2001:470:b008::/64 dev vmbr0 metric 10

auto vmbr2
iface vmbr2 inet manual
bridge-ports eno1
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

iface vmbr2 inet6 manual

source /etc/network/interfaces.d/*
**********

The directory interfaces.d is empty.
 
Hello,

On the one I showed previously not working, I activated the second SPF and assigned vmbr0 to it and after a restart, networking came up. There is one still not working. I did the same trick hoping it would help, but networking does not come up, with the same error :
root@Serveur-pve-G6:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host noprefixroute
valid_lft forever preferred_lft forever
2: enp7s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 88:c9:b3:bf:d6:32 brd ff:ff:ff:ff:ff:ff
3: enp3s4f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond3 state UP group default qlen 1000
link/ether 9c:8e:99:1a:86:36 brd ff:ff:ff:ff:ff:ff
4: enp8s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr2 state UP group default qlen 1000
link/ether 88:c9:b3:bf:d6:33 brd ff:ff:ff:ff:ff:ff
5: enp3s4f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond3 state UP group default qlen 1000
link/ether 9c:8e:99:1a:86:36 brd ff:ff:ff:ff:ff:ff permaddr 9c:8e:99:1a:86:37
6: ens4f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr10 state UP group default qlen 1000
link/ether 28:80:23:41:a0:c8 brd ff:ff:ff:ff:ff:ff
altname enp12s0f0
7: ens4f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
link/ether 28:80:23:41:a0:cc brd ff:ff:ff:ff:ff:ff
altname enp12s0f1
8: bond3: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr3 state UP group default qlen 1000
link/ether 9c:8e:99:1a:86:36 brd ff:ff:ff:ff:ff:ff
inet6 2001:470:b008:0:9e8e:99ff:fe1a:8636/64 scope global dynamic mngtmpaddr
valid_lft 85763sec preferred_lft 13763sec
inet6 fe80::9e8e:99ff:fe1a:8636/64 scope link
valid_lft forever preferred_lft forever
9: vmbr10: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 28:80:23:41:a0:c8 brd ff:ff:ff:ff:ff:ff
inet 10.0.0.252/24 brd 10.0.0.255 scope global dynamic vmbr10
valid_lft 15551359sec preferred_lft 15551359sec
inet6 2001:470:b008:0:2a80:23ff:fe41:a0c8/64 scope global dynamic mngtmpaddr
valid_lft 86197sec preferred_lft 14197sec
inet6 fe80::2a80:23ff:fe41:a0c8/64 scope link
valid_lft forever preferred_lft forever
10: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 28:80:23:41:a0:cc brd ff:ff:ff:ff:ff:ff
inet 10.0.254.252/24 brd 10.0.254.255 scope global vmbr0
valid_lft forever preferred_lft forever
inet6 2001:470:b008:0:2a80:23ff:fe41:a0cc/64 scope global dynamic mngtmpaddr
valid_lft 86197sec preferred_lft 14197sec
inet6 fe80::2a80:23ff:fe41:a0cc/64 scope link
valid_lft forever preferred_lft forever
11: vmbr2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 88:c9:b3:bf:d6:33 brd ff:ff:ff:ff:ff:ff
inet6 2001:470:b008:0:8ac9:b3ff:febf:d633/64 scope global dynamic mngtmpaddr
valid_lft 86197sec preferred_lft 14197sec
inet6 fe80::8ac9:b3ff:febf:d633/64 scope link
valid_lft forever preferred_lft forever
12: vmbr3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 9c:8e:99:1a:86:36 brd ff:ff:ff:ff:ff:ff
inet6 2001:470:b008:0:9e8e:99ff:fe1a:8636/64 scope global dynamic mngtmpaddr
valid_lft 86197sec preferred_lft 14197sec
inet6 fe80::9e8e:99ff:fe1a:8636/64 scope link
valid_lft forever preferred_lft forever
13: vmbr33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 9c:8e:99:1a:86:36 brd ff:ff:ff:ff:ff:ff
inet 10.0.3.37/24 brd 10.0.3.255 scope global dynamic vmbr33
valid_lft 15551368sec preferred_lft 15551368sec
inet6 2001:470:b008:3:9e8e:99ff:fe1a:8636/64 scope global dynamic mngtmpaddr
valid_lft 86388sec preferred_lft 14388sec
inet6 fe80::9e8e:99ff:fe1a:8636/64 scope link
valid_lft forever preferred_lft forever
14: bond3.3@bond3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr33 state UP group default qlen 1000
link/ether 9c:8e:99:1a:86:36 brd ff:ff:ff:ff:ff:ff
15: tap301i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN group default qlen 1000
link/ether da:7d:4a:0b:59:e8 brd ff:ff:ff:ff:ff:ff
16: tap301i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr33 state UNKNOWN group default qlen 1000
link/ether 56:b8:6b:8d:27:e3 brd ff:ff:ff:ff:ff:ff
17: tap305i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr10 state UNKNOWN group default qlen 1000
link/ether 6a:22:f6:b2:26:10 brd ff:ff:ff:ff:ff:ff
18: tap305i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr33 state UNKNOWN group default qlen 1000
link/ether 5a:da:08:c5:e9:b1 brd ff:ff:ff:ff:ff:ff
19: veth303i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
link/ether fe:f7:f9:05:06:68 brd ff:ff:ff:ff:ff:ff link-netnsid 0


And this the one now working :
root@Serveur-pve-G9B:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host noprefixroute
valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr2 state UP group default qlen 1000
link/ether 98:f2:b3:25:e6:cc brd ff:ff:ff:ff:ff:ff
altname enp2s0f0
3: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 98:f2:b3:25:e6:cd brd ff:ff:ff:ff:ff:ff
altname enp2s0f1
4: eno3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 98:f2:b3:25:e6:ce brd ff:ff:ff:ff:ff:ff
altname enp2s0f2
5: eno4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 98:f2:b3:25:e6:cf brd ff:ff:ff:ff:ff:ff
altname enp2s0f3
6: ens3f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr10 state UP group default qlen 1000
link/ether 28:80:23:e9:30:18 brd ff:ff:ff:ff:ff:ff
altname enp8s0f0
7: ens3f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
link/ether 28:80:23:e9:30:1c brd ff:ff:ff:ff:ff:ff
altname enp8s0f1
11: vmbr10: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 28:80:23:e9:30:18 brd ff:ff:ff:ff:ff:ff
inet 10.0.0.245/24 brd 10.0.0.255 scope global dynamic vmbr10
valid_lft 15468970sec preferred_lft 15468970sec
inet6 2001:470:b008:0:2a80:23ff:fee9:3018/64 scope global dynamic mngtmpaddr
valid_lft 86399sec preferred_lft 14399sec
inet6 fe80::2a80:23ff:fee9:3018/64 scope link
valid_lft forever preferred_lft forever
12: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 28:80:23:e9:30:1c brd ff:ff:ff:ff:ff:ff
inet 10.0.254.245/24 brd 10.0.254.255 scope global vmbr0
valid_lft forever preferred_lft forever
inet6 2001:470:b008:0:2a80:23ff:fee9:301c/64 scope global dynamic mngtmpaddr
valid_lft 86399sec preferred_lft 14399sec
inet6 fe80::2a80:23ff:fee9:301c/64 scope link
valid_lft forever preferred_lft forever
13: vmbr2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 98:f2:b3:25:e6:cc brd ff:ff:ff:ff:ff:ff
inet6 2001:470:b008:0:9af2:b3ff:fe25:e6cc/64 scope global dynamic mngtmpaddr
valid_lft 86399sec preferred_lft 14399sec
inet6 fe80::9af2:b3ff:fe25:e6cc/64 scope link
valid_lft forever preferred_lft forever
14: tap201i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN group default qlen 1000
link/ether aa:c9:fb:c1:54:5b brd ff:ff:ff:ff:ff:ff
15: tap201i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr2 state UNKNOWN group default qlen 1000
link/ether a6:a9:19:5f:23:2c brd ff:ff:ff:ff:ff:ff
16: tap102i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN group default qlen 1000
link/ether 2e:4e:52:38:aa:16 brd ff:ff:ff:ff:ff:ff
17: veth101i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
link/ether fe:85:62:81:88:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0
18: veth101i1@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr2 state UP group default qlen 1000
link/ether fe:0f:04:b0:af:96 brd ff:ff:ff:ff:ff:ff link-netnsid 0
19: tap107i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr10 state UNKNOWN group default qlen 1000
link/ether d2:68:20:ed:01:71 brd ff:ff:ff:ff:ff:ff
20: tap107i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr2 state UNKNOWN group default qlen 1000
link/ether 16:0a:d0:ee:03:0e brd ff:ff:ff:ff:ff:ff