[SOLVED] Network lost after passthrough PCI WIFI+BT card

mazix

New Member
Jun 26, 2023
2
0
1
CPU: ryzen 5 5600g
Motherboard: GA-AB350M-DS3H v2
pci card: Intel AX210 wifi+bt
Kernel 6.2.16-12-pve
PVE 8.0.4

When passthrough pci card, my Internet disappears. At the same time, the port physically stops loading, becomes unavailable locally, only with direct access. I tried, following the example from the forum, to put another PCI Ethernet card, but this did not solve the problem.

root@home-server:~# lspci -nnk 00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne Root Complex [1022:1630] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne Root Complex [1022:1630] 00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne IOMMU [1022:1631] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne IOMMU [1022:1631] 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632] 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632] 00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1453] Kernel driver in use: pcieport 00:02.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1453] Kernel driver in use: pcieport 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632] 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635] Kernel driver in use: pcieport 00:08.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635] Subsystem: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635] Kernel driver in use: pcieport 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 51) Subsystem: Gigabyte Technology Co., Ltd FCH SMBus Controller [1458:5001] Kernel modules: i2c_piix4, sp5100_tco 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51) Subsystem: Gigabyte Technology Co., Ltd FCH LPC Bridge [1458:5001] 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 0 [1022:166a] 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 1 [1022:166b] 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 2 [1022:166c] 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 3 [1022:166d] Kernel driver in use: k10temp Kernel modules: k10temp 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 4 [1022:166e] 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 5 [1022:166f] 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 6 [1022:1670] 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 7 [1022:1671] 01:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset USB 3.1 xHCI Controller [1022:43bb] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset USB 3.1 xHCI Controller [1b21:1142] Kernel driver in use: xhci_hcd Kernel modules: xhci_pci 01:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset SATA Controller [1022:43b7] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset SATA Controller [1b21:1062] Kernel driver in use: ahci Kernel modules: ahci 01:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b2] (rev 02) Subsystem: ASMedia Technology Inc. Device [1b21:0201] Kernel driver in use: pcieport 02:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset PCIe Port [1b21:3306] Kernel driver in use: pcieport 02:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset PCIe Port [1b21:3306] Kernel driver in use: pcieport 02:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02) Subsystem: ASMedia Technology Inc. 300 Series Chipset PCIe Port [1b21:3306] Kernel driver in use: pcieport 03:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8161] (rev 15) DeviceName: Broadcom 5762 Subsystem: Realtek Semiconductor Co., Ltd. TP-Link TG-3468 v4.0 Gigabit PCI Express Network Adapter [10ec:8168] Kernel driver in use: r8169 Kernel modules: r8169 04:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 0c) Subsystem: Gigabyte Technology Co., Ltd Onboard Ethernet [1458:e000] Kernel driver in use: r8169 Kernel modules: r8169 05:00.0 Network controller [0280]: Intel Corporation Wi-Fi 6 AX210/AX211/AX411 160MHz [8086:2725] (rev 1a) Subsystem: Intel Corporation Wi-Fi 6 AX210 160MHz [8086:0024] Kernel driver in use: vfio-pci Kernel modules: iwlwifi 06:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [144d:a808] Subsystem: Samsung Electronics Co Ltd SSD 970 EVO [144d:a801] Kernel driver in use: nvme Kernel modules: nvme 07:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cezanne [Radeon Vega Series / Radeon Vega Mobile Series] [1002:1638] (rev c9) Subsystem: Gigabyte Technology Co., Ltd Cezanne [Radeon Vega Series / Radeon Vega Mobile Series] [1458:d000] Kernel driver in use: amdgpu Kernel modules: amdgpu 07:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Renoir Radeon High Definition Audio Controller [1002:1637] Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Renoir Radeon High Definition Audio Controller [1002:1637] Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel 07:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df] Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df] Kernel driver in use: ccp Kernel modules: ccp 07:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639] Subsystem: Gigabyte Technology Co., Ltd Renoir/Cezanne USB 3.1 [1458:5007] Kernel driver in use: xhci_hcd Kernel modules: xhci_pci 07:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639] Subsystem: Gigabyte Technology Co., Ltd Renoir/Cezanne USB 3.1 [1458:5007] Kernel driver in use: xhci_hcd Kernel modules: xhci_pci 07:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller [1022:15e3] Subsystem: Gigabyte Technology Co., Ltd Family 17h/19h HD Audio Controller [1458:a182] Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel 08:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81) Subsystem: Gigabyte Technology Co., Ltd FCH SATA Controller [AHCI mode] [1458:b002] Kernel driver in use: ahci Kernel modules: ahci 08:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81) Subsystem: Gigabyte Technology Co., Ltd FCH SATA Controller [AHCI mode] [1458:b002] Kernel driver in use: ahci Kernel modules: ahci


items 3 and 4 disappear after passthrough
root@home-server:~# ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host noprefixroute valid_lft forever preferred_lft forever 2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UP group default qlen 1000 link/ether 78:8c:b5:d6:f7:66 brd ff:ff:ff:ff:ff:ff altname enp3s0 3: enp4s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether b4:2e:99:67:a8:5b brd ff:ff:ff:ff:ff:ff 4: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 78:8c:b5:d6:f7:66 brd ff:ff:ff:ff:ff:ff inet 192.168.1.84/24 scope global vmbr0 valid_lft forever preferred_lft forever inet6 fe80::7a8c:b5ff:fed6:f766/64 scope link valid_lft forever preferred_lft forever 5: tap100i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN group default qlen 1000 link/ether 3a:27:15:05:ff:c6 brd ff:ff:ff:ff:ff:ff 6: veth101i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000 link/ether 36:e0:eb:8c:76:68 brd ff:ff:ff:ff:ff:ff link-netnsid 0 7: veth102i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000 link/ether 12:3f:a0:f6:a0:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 1 8: veth103i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000 link/ether fe:1c:75:6e:20:31 brd ff:ff:ff:ff:ff:ff link-netnsid 2 9: tap105i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr105i0 state UNKNOWN group default qlen 1000 link/ether 02:2e:14:f2:95:b2 brd ff:ff:ff:ff:ff:ff 10: fwbr105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 1e:6b:b4:d0:84:89 brd ff:ff:ff:ff:ff:ff 11: fwpr105p0@fwln105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000 link/ether 6a:35:58:65:66:8f brd ff:ff:ff:ff:ff:ff 12: fwln105i0@fwpr105p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr105i0 state UP group default qlen 1000 link/ether e6:c0:27:5e:18:5a brd ff:ff:ff:ff:ff:ff

root@home-server:~# cat /etc/modules | grep vfio vfio vfio_iommu_type1 vfio_pci vfio_virqfd

root@home-server:~# cat /etc/modprobe.d/vfio.conf options vfio-pci ids=8086:2725,8086:0024

root@home-server:~# dmesg | grep -e DMAR -e IOMMU -e AMD-Vi [ 0.039303] AMD-Vi: Unknown option - 'on' [ 0.098384] AMD-Vi: Using global IVHD EFR:0x206d73ef22254ade, EFR2:0x0 [ 0.321045] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported [ 0.321646] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40 [ 0.321647] AMD-Vi: Extended features (0x206d73ef22254ade, 0x0): PPR X2APIC NX GT IA GA PC GA_vAPIC [ 0.321651] AMD-Vi: Interrupt remapping enabled [ 0.321652] AMD-Vi: X2APIC enabled [ 0.411686] AMD-Vi: Virtual APIC enabled [ 0.411962] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank). [ 6.944993] AMD-Vi: AMD IOMMUv2 loaded and initialized
 
last edit for grub and this work
GRUB_CMDLINE_LINUX="pcie_acs_override=downstream,multifunction"

1. nano /etc/default/grub
2. edit GRUB_CMDLINE_LINUX
3. update-grub

I hope my experience will help someone
 

Attachments

  • Screenshot_20230912_204646.png
    Screenshot_20230912_204646.png
    50.5 KB · Views: 22
It helped indeed, have a similar HW (GB-B550, Ryzen 5 5600X) and had the same issue, thx for the solution m8.
Now it is time to findout how to configure this on OpnSense :)
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!