Hi,
i have a strange network problem. I have three Proxmox Nodes connected to the same switch. On two of them i can't ping the gateway. On the other one it is working.
So far i can see they are all configured the same.
It was working before. I was applying a new SDN configuration to add another VNET. Since then i can't ping two of the three nodes and i can not ping the gateway from them.
To make troubleshooting easier i've reverted the SDN config on all three hosts.
On one of the not working nodes i've booted Debian Live from USB and it is working then.
Here is some information:
10.10.0.0 is the network of the Hosts
10.10.13.0 is the network for ceph
/etc/network/interfaces:
#
# If you want to manage parts of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT read its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!
auto lo
iface lo inet loopback
auto enp5s0f0
iface enp5s0f0 inet manual
auto enp5s0f1
iface enp5s0f1 inet manual
auto enp5s0f2
iface enp5s0f2 inet manual
auto enp5s0f3
iface enp5s0f3 inet manual
auto enp1s0f0np0
iface enp1s0f0np0 inet static
address 10.10.13.23/26
#pve3_ceph
auto enp1s0f1np1
iface enp1s0f1np1 inet manual
auto vmbr0
iface vmbr0 inet static
address 10.10.0.23/24
gateway 10.10.0.1
bridge-ports enp1s0f1np1
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
mtu 1500
source /etc/network/interfaces.d/*
ip addr:
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
2: enp5s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether b4:96:91:0b:9e:60 brd ff:ff:ff:ff:ff:ff
3: enp5s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether b4:96:91:0b:9e:61 brd ff:ff:ff:ff:ff:ff
4: enp5s0f2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether b4:96:91:0b:9e:62 brd ff:ff:ff:ff:ff:ff
5: enp5s0f3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether b4:96:91:0b:9e:63 brd ff:ff:ff:ff:ff:ff
6: enp1s0f0np0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether 98:f2:b3:c8:35:a8 brd ff:ff:ff:ff:ff:ff
inet 10.10.13.23/26 scope global enp1s0f0np0
valid_lft forever preferred_lft forever
7: enp1s0f1np1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
link/ether 98:f2:b3:c8:35:a9 brd ff:ff:ff:ff:ff:ff
9: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 98:f2:b3:c8:35:a9 brd ff:ff:ff:ff:ff:ff
inet 10.10.0.23/24 scope global vmbr0
valid_lft forever preferred_lft forever
ip r:
default via 10.10.0.1 dev vmbr0 proto kernel onlink
10.10.0.0/24 dev vmbr0 proto kernel scope link src 10.10.0.23
10.10.13.0/26 dev enp1s0f0np0 proto kernel scope link src 10.10.13.23
i have a strange network problem. I have three Proxmox Nodes connected to the same switch. On two of them i can't ping the gateway. On the other one it is working.
So far i can see they are all configured the same.
It was working before. I was applying a new SDN configuration to add another VNET. Since then i can't ping two of the three nodes and i can not ping the gateway from them.
To make troubleshooting easier i've reverted the SDN config on all three hosts.
On one of the not working nodes i've booted Debian Live from USB and it is working then.
Here is some information:
10.10.0.0 is the network of the Hosts
10.10.13.0 is the network for ceph
/etc/network/interfaces:
#
# If you want to manage parts of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT read its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!
auto lo
iface lo inet loopback
auto enp5s0f0
iface enp5s0f0 inet manual
auto enp5s0f1
iface enp5s0f1 inet manual
auto enp5s0f2
iface enp5s0f2 inet manual
auto enp5s0f3
iface enp5s0f3 inet manual
auto enp1s0f0np0
iface enp1s0f0np0 inet static
address 10.10.13.23/26
#pve3_ceph
auto enp1s0f1np1
iface enp1s0f1np1 inet manual
auto vmbr0
iface vmbr0 inet static
address 10.10.0.23/24
gateway 10.10.0.1
bridge-ports enp1s0f1np1
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
mtu 1500
source /etc/network/interfaces.d/*
ip addr:
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
2: enp5s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether b4:96:91:0b:9e:60 brd ff:ff:ff:ff:ff:ff
3: enp5s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether b4:96:91:0b:9e:61 brd ff:ff:ff:ff:ff:ff
4: enp5s0f2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether b4:96:91:0b:9e:62 brd ff:ff:ff:ff:ff:ff
5: enp5s0f3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether b4:96:91:0b:9e:63 brd ff:ff:ff:ff:ff:ff
6: enp1s0f0np0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether 98:f2:b3:c8:35:a8 brd ff:ff:ff:ff:ff:ff
inet 10.10.13.23/26 scope global enp1s0f0np0
valid_lft forever preferred_lft forever
7: enp1s0f1np1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
link/ether 98:f2:b3:c8:35:a9 brd ff:ff:ff:ff:ff:ff
9: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 98:f2:b3:c8:35:a9 brd ff:ff:ff:ff:ff:ff
inet 10.10.0.23/24 scope global vmbr0
valid_lft forever preferred_lft forever
ip r:
default via 10.10.0.1 dev vmbr0 proto kernel onlink
10.10.0.0/24 dev vmbr0 proto kernel scope link src 10.10.0.23
10.10.13.0/26 dev enp1s0f0np0 proto kernel scope link src 10.10.13.23