[SOLVED] Network lost after passthrough PCI WIFI+BT card

mazix

New Member
Jun 26, 2023
2
0
1
CPU: ryzen 5 5600g
Motherboard: GA-AB350M-DS3H v2
pci card: Intel AX210 wifi+bt
Kernel 6.2.16-12-pve
PVE 8.0.4

When passthrough pci card, my Internet disappears. At the same time, the port physically stops loading, becomes unavailable locally, only with direct access. I tried, following the example from the forum, to put another PCI Ethernet card, but this did not solve the problem.

root@home-server:~# lspci -nnk 00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne Root Complex [1022:1630] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne Root Complex [1022:1630] 00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne IOMMU [1022:1631] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne IOMMU [1022:1631] 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632] 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632] 00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1453] Kernel driver in use: pcieport 00:02.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1453] Kernel driver in use: pcieport 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632] 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635] Kernel driver in use: pcieport 00:08.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635] Kernel driver in use: pcieport 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 51) Subsystem: Gigabyte Technology Co., Ltd FCH SMBus Controller [1458:5001] Kernel modules: i2c_piix4, sp5100_tco 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51) Subsystem: Gigabyte Technology Co., Ltd FCH LPC Bridge [1458:5001] 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 0 [1022:166a] 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 1 [1022:166b] 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 2 [1022:166c] 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 3 [1022:166d] Kernel driver in use: k10temp Kernel modules: k10temp 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 4 [1022:166e] 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 5 [1022:166f] 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 6 [1022:1670] 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 7 [1022:1671] 01:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset USB 3.1 xHCI Controller [1022:43bb] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset USB 3.1 xHCI Controller [1b21:1142] Kernel driver in use: xhci_hcd Kernel modules: xhci_pci 01:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset SATA Controller [1022:43b7] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset SATA Controller [1b21:1062] Kernel driver in use: ahci Kernel modules: ahci 01:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b2] (rev 02) Subsystem: ASMedia Technology Inc. Device [1b21:0201] Kernel driver in use: pcieport 02:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset PCIe Port [1b21:3306] Kernel driver in use: pcieport 02:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset PCIe Port [1b21:3306] Kernel driver in use: pcieport 02:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset PCIe Port [1b21:3306] Kernel driver in use: pcieport 03:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8161] (rev 15) DeviceName: Broadcom 5762 Subsystem: Realtek Semiconductor Co., Ltd. TP-Link TG-3468 v4.0 Gigabit PCI Express Network Adapter [10ec:8168] Kernel driver in use: r8169 Kernel modules: r8169 04:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 0c) Subsystem: Gigabyte Technology Co., Ltd Onboard Ethernet [1458:e000] Kernel driver in use: r8169 Kernel modules: r8169 05:00.0 Network controller [0280]: Intel Corporation Wi-Fi 6 AX210/AX211/AX411 160MHz [8086:2725] (rev 1a) Subsystem: Intel Corporation Wi-Fi 6 AX210 160MHz [8086:0024] Kernel driver in use: vfio-pci Kernel modules: iwlwifi 06:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [144d:a808] Subsystem: Samsung Electronics Co Ltd SSD 970 EVO [144d:a801] Kernel driver in use: nvme Kernel modules: nvme 07:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cezanne [Radeon Vega Series / Radeon Vega Mobile Series] [1002:1638] (rev c9) Subsystem: Gigabyte Technology Co., Ltd Cezanne [Radeon Vega Series / Radeon Vega Mobile Series] [1458:d000] Kernel driver in use: amdgpu Kernel modules: amdgpu 07:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Renoir Radeon High Definition Audio Controller [1002:1637] Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Renoir Radeon High Definition Audio Controller [1002:1637] Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel 07:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df] Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df] Kernel driver in use: ccp Kernel modules: ccp 07:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639] Subsystem: Gigabyte Technology Co., Ltd Renoir/Cezanne USB 3.1 [1458:5007] Kernel driver in use: xhci_hcd Kernel modules: xhci_pci 07:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639] Subsystem: Gigabyte Technology Co., Ltd Renoir/Cezanne USB 3.1 [1458:5007] Kernel driver in use: xhci_hcd Kernel modules: xhci_pci 07:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller [1022:15e3] Subsystem: Gigabyte Technology Co., Ltd Family 17h/19h HD Audio Controller [1458:a182] Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel 08:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81) Subsystem: Gigabyte Technology Co., Ltd FCH SATA Controller [AHCI mode] [1458:b002] Kernel driver in use: ahci Kernel modules: ahci 08:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81) Subsystem: Gigabyte Technology Co., Ltd FCH SATA Controller [AHCI mode] [1458:b002] Kernel driver in use: ahci Kernel modules: ahci


items 3 and 4 disappear after passthrough
root@home-server:~# ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host noprefixroute valid_lft forever preferred_lft forever 2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UP group default qlen 1000 link/ether 78:8c:b5:d6:f7:66 brd ff:ff:ff:ff:ff:ff altname enp3s0 3: enp4s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether b4:2e:99:67:a8:5b brd ff:ff:ff:ff:ff:ff 4: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 78:8c:b5:d6:f7:66 brd ff:ff:ff:ff:ff:ff inet 192.168.1.84/24 scope global vmbr0 valid_lft forever preferred_lft forever inet6 fe80::7a8c:b5ff:fed6:f766/64 scope link valid_lft forever preferred_lft forever 5: tap100i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN group default qlen 1000 link/ether 3a:27:15:05:ff:c6 brd ff:ff:ff:ff:ff:ff 6: veth101i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000 link/ether 36:e0:eb:8c:76:68 brd ff:ff:ff:ff:ff:ff link-netnsid 0 7: veth102i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000 link/ether 12:3f:a0:f6:a0:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 1 8: veth103i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000 link/ether fe:1c:75:6e:20:31 brd ff:ff:ff:ff:ff:ff link-netnsid 2 9: tap105i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr105i0 state UNKNOWN group default qlen 1000 link/ether 02:2e:14:f2:95:b2 brd ff:ff:ff:ff:ff:ff 10: fwbr105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 1e:6b:b4:d0:84:89 brd ff:ff:ff:ff:ff:ff 11: fwpr105p0@fwln105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000 link/ether 6a:35:58:65:66:8f brd ff:ff:ff:ff:ff:ff 12: fwln105i0@fwpr105p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr105i0 state UP group default qlen 1000 link/ether e6:c0:27:5e:18:5a brd ff:ff:ff:ff:ff:ff

root@home-server:~# cat /etc/modules | grep vfio vfio vfio_iommu_type1 vfio_pci vfio_virqfd

root@home-server:~# cat /etc/modprobe.d/vfio.conf options vfio-pci ids=8086:2725,8086:0024

root@home-server:~# dmesg | grep -e DMAR -e IOMMU -e AMD-Vi [ 0.039303] AMD-Vi: Unknown option - 'on' [ 0.098384] AMD-Vi: Using global IVHD EFR:0x206d73ef22254ade, EFR2:0x0 [ 0.321045] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported [ 0.321646] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40 [ 0.321647] AMD-Vi: Extended features (0x206d73ef22254ade, 0x0): PPR X2APIC NX GT IA GA PC GA_vAPIC [ 0.321651] AMD-Vi: Interrupt remapping enabled [ 0.321652] AMD-Vi: X2APIC enabled [ 0.411686] AMD-Vi: Virtual APIC enabled [ 0.411962] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank). [ 6.944993] AMD-Vi: AMD IOMMUv2 loaded and initialized
 
last edit for grub and this work
GRUB_CMDLINE_LINUX="pcie_acs_override=downstream,multifunction"

1. nano /etc/default/grub
2. edit GRUB_CMDLINE_LINUX
3. update-grub

I hope my experience will help someone
 

Attachments

  • Screenshot_20230912_204646.png
    Screenshot_20230912_204646.png
    50.5 KB · Views: 26
It helped indeed, have a similar HW (GB-B550, Ryzen 5 5600X) and had the same issue, thx for the solution m8.
Now it is time to findout how to configure this on OpnSense :)
 
Last edited: