[SOLVED] Why can’t my vmbr1 VM connect to an IP other than the host?

luciferlu · Feb 6, 2024

I added a 10G NIC to my system. This card is connected to a 10G switch. I bridged this card to vmbr1. The problem is, the host can ping the switch IP, but neither the virtual machine nor the container can. What settings do I need to set up so that my virtual machine can access my 10G switch?

Code:

auto lo
iface lo inet loopback
iface eno1 inet manual
iface enp3s0f0np0 inet manual
auto vmbr0
iface vmbr0 inet static
        address 192.168.2.106/24
        gateway 192.168.2.1
        bridge-ports eno1
        bridge-stp off
        bridge-fd 0

iface vmbr0 inet6 dhcp

auto vmbr1
iface vmbr1 inet static
        address 192.168.1.198/24
        bridge-ports enp3s0f0np0
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094

Code:

root@pve001:~# ping 192.168.1.199
PING 192.168.1.199 (192.168.1.199) 56(84) bytes of data.
64 bytes from 192.168.1.199: icmp_seq=1 ttl=64 time=0.272 ms
64 bytes from 192.168.1.199: icmp_seq=2 ttl=64 time=0.292 ms
64 bytes from 192.168.1.199: icmp_seq=3 ttl=64 time=0.256 ms
64 bytes from 192.168.1.199: icmp_seq=4 ttl=64 time=0.274 ms
[root@arch ~]# ping 192.168.1.199
PING 192.168.1.199 (192.168.1.199) 56(84) bytes of data.
From 192.168.1.45 icmp_seq=9 Destination Host Unreachable
From 192.168.1.45 icmp_seq=10 Destination Host Unreachable
From 192.168.1.45 icmp_seq=11 Destination Host Unreachable
From 192.168.1.45 icmp_seq=12 Destination Host Unreachable
From 192.168.1.45 icmp_seq=13 Destination Host Unreachable

xekhz · Feb 6, 2024

Does the container uses the VMBR1 ?

luciferlu · Feb 6, 2024

xekhz said:
Does the container uses the VMBR1 ?

yes both vmbr0 and vmbr1.

xekhz · Feb 6, 2024

luciferlu said:
yes both vmbr0 and vmbr1.

What is the output of

ip route

luciferlu · Feb 6, 2024

xekhz said:
What is the output of

ip route

host

Code:

 root@pve001:~# ip route
default via 192.168.2.1 dev vmbr0
172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1
192.168.1.0/24 dev vmbr1 proto kernel scope link src 192.168.1.198
192.168.2.0/24 dev vmbr0 proto kernel scope link src 192.168.2.106

lcx

Code:

[root@arch ~]# ip route
default via 192.168.2.1 dev eth0 proto static
192.168.1.0/24 dev net1 proto kernel scope link src 192.168.1.45
192.168.2.0/24 dev eth0 proto kernel scope link src 192.168.2.45

xekhz · Feb 6, 2024

luciferlu said:

host

Code:

 root@pve001:~# ip route
default via 192.168.2.1 dev vmbr0
172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1
192.168.1.0/24 dev vmbr1 proto kernel scope link src 192.168.1.198
192.168.2.0/24 dev vmbr0 proto kernel scope link src 192.168.2.106

lcx

Code:

[root@arch ~]# ip route
default via 192.168.2.1 dev eth0 proto static
192.168.1.0/24 dev net1 proto kernel scope link src 192.168.1.45
192.168.2.0/24 dev eth0 proto kernel scope link src 192.168.2.45

lcx

Code:

[root@arch ~]# ip route
default via 192.168.2.1 dev eth0 proto static
192.168.1.0/24 dev net1 proto kernel scope link src 192.168.1.45
192.168.2.0/24 dev eth0 proto kernel scope link src 192.168.2.45

in here .  192.168.1.0/24 dev net1 .. instead net1 shouldnt be vmbr1
in here .  192.168.2.0/24 dev eth0 .. instead eth0 shouldnt be vmbr0 
?????

luciferlu · Feb 7, 2024

xekhz said:

lcx

Code:

[root@arch ~]# ip route
default via 192.168.2.1 dev eth0 proto static
192.168.1.0/24 dev net1 proto kernel scope link src 192.168.1.45
192.168.2.0/24 dev eth0 proto kernel scope link src 192.168.2.45

in here .  192.168.1.0/24 dev net1 .. instead net1 shouldnt be vmbr1
in here .  192.168.2.0/24 dev eth0 .. instead eth0 shouldnt be vmbr0
?????

Code:

sh-5.2# ifconfig
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.2.45  netmask 255.255.255.0  broadcast 192.168.2.255
        inet6 fe80::48d:38ff:fe13:b719  prefixlen 64  scopeid 0x20<link>
        ether 06:8d:38:13:b7:19  txqueuelen 1000  (Ethernet)
        RX packets 454494  bytes 52133448 (49.7 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 59935  bytes 3288079 (3.1 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 105591  bytes 6183333 (5.8 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 105591  bytes 6183333 (5.8 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

net1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.1.45  netmask 255.255.255.0  broadcast 0.0.0.0
        inet6 fe80::4c60:d9ff:fecb:4188  prefixlen 64  scopeid 0x20<link>
        ether 4e:60:d9:cb:41:88  txqueuelen 1000  (Ethernet)
        RX packets 7886  bytes 1564588 (1.4 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 212  bytes 11882 (11.6 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

xekhz · Feb 7, 2024

luciferlu said:

Code:

sh-5.2# ifconfig
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.2.45  netmask 255.255.255.0  broadcast 192.168.2.255
        inet6 fe80::48d:38ff:fe13:b719  prefixlen 64  scopeid 0x20<link>
        ether 06:8d:38:13:b7:19  txqueuelen 1000  (Ethernet)
        RX packets 454494  bytes 52133448 (49.7 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 59935  bytes 3288079 (3.1 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 105591  bytes 6183333 (5.8 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 105591  bytes 6183333 (5.8 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

net1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.1.45  netmask 255.255.255.0  broadcast 0.0.0.0
        inet6 fe80::4c60:d9ff:fecb:4188  prefixlen 64  scopeid 0x20<link>
        ether 4e:60:d9:cb:41:88  txqueuelen 1000  (Ethernet)
        RX packets 7886  bytes 1564588 (1.4 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 212  bytes 11882 (11.6 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

are they all in the same vlan ?

luciferlu · Feb 7, 2024

xekhz said:
are they all in the same vlan ?

eth0 and net1 ? I did not do anything about vlan.
192.168.1.x and 2.x are two authentic network for me.

xekhz · Feb 7, 2024

What is the ip of the switch ? 192.168.1.199

PVE
[ VMBR1 - in interface Inter_1 ] put an ip address in inter_1 192.168.1.200

VM1
bridged VMBR1 with VIRTIO

In VM1 try to ping 192.168.1.200 and 192.168.1.199

luciferlu · Feb 7, 2024

xekhz said:
What is the ip of the switch ? 192.168.1.199

PVE
[ VMBR1 - in interface Inter_1 ] put an ip address in inter_1 192.168.1.200

VM1
bridged VMBR1 with VIRTIO

In VM1 try to ping 192.168.1.200 and 192.168.1.199

YES, I have tried already.
VM1 adds a virtio NIC from vmbr1.
switch: 192.168.1.199
PVE: 192.168.1.198
VM1:192.168.1.100
PVE can ping switch and VM1.
VM1 can only ping PVE.

xekhz · Feb 7, 2024

luciferlu said:
YES, I have tried already.
VM1 adds a virtio NIC from vmbr1.
switch: 192.168.1.199
PVE: 192.168.1.198
VM1:192.168.1.100
PVE can ping switch and VM1.
VM1 can only ping PVE.

Well that is really strange....
Netmaks /24 ?

luciferlu · Feb 7, 2024

luciferlu · Feb 7, 2024

xekhz said:
Well that is really strange....
Netmaks /24 ?

Yes.

xekhz · Feb 7, 2024

I can only think of firewall blocking ...
All i see is correct..

ubu · Feb 7, 2024

check with tcpdump -ni vmbr1 icmp and tcpdump -ni enp3s0f0np0 icmp
if you see traffic whole pinging

luciferlu · Feb 8, 2024

After changing my cx4221a to 82599ES everything goes well.
Proxmox doesnot support cx4221a very well?
Thanks everyone for helping me to solve this.

xekhz said:
I can only think of firewall blocking ...
All i see is correct..

Yes all is correct except the hardware.

Search

Search

[SOLVED] Why can’t my vmbr1 VM connect to an IP other than the host?

luciferlu

Active Member

xekhz

Renowned Member

luciferlu

Active Member

xekhz

Renowned Member

luciferlu

Active Member

xekhz

Renowned Member

luciferlu

Active Member

xekhz

Renowned Member

luciferlu

Active Member

xekhz

Renowned Member

luciferlu

Active Member

xekhz

Renowned Member

luciferlu

Active Member

luciferlu

Active Member

xekhz

Renowned Member

ubu

Renowned Member

luciferlu

Active Member