problem Pci passthrough

[Kaplin Alexey]

Hello.
Faced such a problem, there is 1 physical server on which 4 virtual
10.166.0.107 proxmox server
10.166.0.101 VirtIO (paravirtualized) network card
10.166.0.104 Pci passthrough network card
10.166.0.105 Pci passthrough network card
10.166.0.106 VirtIO (paravirtualized) network card

while with 10.166.0.107 there is access to all virtual machines, but from 10.166.0.101 the traffic reaches only 10.166.0.107 and 10.166.0.106.
from 10.166.0.104 is available 10.166.0.107 and 10.166.0.105

passthrough on the 10.166.0.101 network card and now 10.166.0.107 10.166.0.104 and 10.166.0.105

lspci |grep Eth
02:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
03:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
08:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
08:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
08:10.0 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:10.2 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:10.4 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:10.6 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:11.0 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:11.2 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:11.4 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:11.6 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:12.0 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:12.2 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:12.4 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:12.6 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:13.0 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:13.2 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:13.4 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)
08:13.6 Ethernet controller: Intel Corporation 82599 Ethernet Controller Virtual Function (rev 01)

bootdisk: scsi0
cores: 2
hostpci0: 08:10.0,pcie=1
machine: q35
memory: 2048
name: nas-ipoe01
numa: 1
ostype: l26
scsi0: local-lvm:vm-332-disk-1,size=2G
scsihw: virtio-scsi-pci
smbios1: uuid=ddec1fae-57bf-4d0d-a335-d3bfbf0abcac
sockets: 1

auto enp8s0f0
iface enp8s0f0 inet manual
        up ip li set dev enp8s0f0 up
        up echo '16' > /sys/bus/pci/devices/0000:08:00.0/sriov_numvfs
        down echo '16' > /sys/bus/pci/devices/0000:08:00.0/sriov_numvfs

auto vmbr0
iface vmbr0 inet manual
    bridge_ports enp8s0f0
    bridge_stp off
    bridge_fd 0

auto vmbr0.166
iface vmbr0.166 inet static
        address 10.166.0.107
        netmask 255.255.255.0

brctl show
bridge name    bridge id        STP enabled    interfaces
vmbr0        8000.001b21bc6150    no        enp8s0f0
                            tap331i0

brctl showmacs vmbr0
port no    mac addr        is local?    ageing timer
  1    00:03:0f:26:da:0c    no           5.33
  1    00:03:0f:26:da:0d    no           7.46
  1    00:03:0f:2c:3f:2c    no         126.77
  1    00:03:0f:2c:3f:74    no           0.19
  1    00:11:11:11:11:01    no           3.57  (10.166.0.104)
  1    00:11:11:11:11:02    no           1.35  (10.166.0.105)
  1    00:16:31:f0:df:cc    no           8.67
  1    00:16:31:f0:df:cd    no         103.39
  1    00:1b:21:bc:61:50    yes           0.00
  1    00:1b:21:bc:61:50    yes           0.00
  1    6c:72:20:1b:7e:01    no           0.00
  1    6c:72:20:1b:7e:02    no         126.73
  2    7e:12:b4:b0:1b:e2    yes           0.00
  2    7e:12:b4:b0:1b:e2    yes           0.00
  2    a2:c2:af:95:29:1d    no           0.02  (10.166.0.101)

 

[Kaplin Alexey]

10.166.0.101 arp

Address                  HWtype  HWaddress           Flags Mask            Iface
10.166.0.105                     (incomplete)                              eth0.166
10.166.0.104                     (incomplete)                              eth0.166
10.166.0.107             ether   00:1b:21:bc:61:50   C                     eth0.166