Warning: UPDATING these packages broke my pci passthrough.

My config has the error for USB controllers on both the motherboard and in PCI slot.

# qm start 107
Cannot bind 0000:10:00.3 to vfio (USB Controller on Motherboard)
# qm start 107
Cannot bind 0000:08:00.0 to vfio (USB Controller on PCI Card)

/etc/modprobe.d/vfio.conf
# Nvidia GTX1660
# 0a:00.0 0300: 10de:2184 (rev a1)
# 0a:00.1 0403: 10de:1aeb (rev a1)
# 0a:00.2 0c03: 10de:1aec (rev a1)
# 0a:00.3 0c80: 10de:1aed (rev a1)
# ASMedia USB
# 08:00.0 0c03: 1b21:2142

# USB on motherboard
# 010:00.3 0c03: 1022:149c

options vfio-pci ids=10de:2184,10de:1aeb,10de:1aec,10de:1aed,1022:149c,1b21:2142 disable_vga=1

lspci -nnk
00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse Root Complex [1043:8808]
00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse IOMMU [1043:8808]
00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse GPP Bridge [1043:8808]
Kernel driver in use: pcieport
00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse GPP Bridge [1043:8808]
Kernel driver in use: pcieport
00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
DeviceName: Onboard IGD
00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse GPP Bridge [1043:8808]
Kernel driver in use: pcieport
00:03.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse GPP Bridge [1043:8808]
Kernel driver in use: pcieport
00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1043:8808]
Kernel driver in use: pcieport
00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1043:8808]
Kernel driver in use: pcieport
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
Subsystem: ASUSTeK Computer Inc. FCH SMBus Controller [1043:87c0]
Kernel driver in use: piix4_smbus
Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
Subsystem: ASUSTeK Computer Inc. FCH LPC Bridge [1043:87c0]
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 0 [1022:1440]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 1 [1022:1441]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 2 [1022:1442]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 3 [1022:1443]
Kernel driver in use: k10temp
Kernel modules: k10temp
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 4 [1022:1444]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 5 [1022:1445]
00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 6 [1022:1446]
00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 7 [1022:1447]
01:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO [144d:a80a]
Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO (SSD 980 PRO) [144d:a801]
Kernel driver in use: nvme
Kernel modules: nvme
02:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse Switch Upstream [1022:57ad]
Kernel driver in use: pcieport
03:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
Subsystem: ASUSTeK Computer Inc. Matisse PCIe GPP Bridge [1043:8808]
Kernel driver in use: pcieport
03:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
Subsystem: ASUSTeK Computer Inc. Matisse PCIe GPP Bridge [1043:8808]
Kernel driver in use: pcieport
03:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
Subsystem: ASUSTeK Computer Inc. Matisse PCIe GPP Bridge [1043:8808]
Kernel driver in use: pcieport
03:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
Subsystem: ASUSTeK Computer Inc. Matisse PCIe GPP Bridge [1043:8808]
Kernel driver in use: pcieport
03:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
Subsystem: ASUSTeK Computer Inc. Matisse PCIe GPP Bridge [1043:8808]
Kernel driver in use: pcieport
03:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
Subsystem: ASUSTeK Computer Inc. Matisse PCIe GPP Bridge [1043:8808]
Kernel driver in use: pcieport
03:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
Subsystem: ASUSTeK Computer Inc. Matisse PCIe GPP Bridge [1043:8808]
Kernel driver in use: pcieport
03:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
Subsystem: ASUSTeK Computer Inc. Matisse PCIe GPP Bridge [1043:8808]
Kernel driver in use: pcieport
03:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
Subsystem: ASUSTeK Computer Inc. Matisse PCIe GPP Bridge [1043:8808]
Kernel driver in use: pcieport
04:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [144d:a808]
Subsystem: Samsung Electronics Co Ltd SSD 970 EVO [144d:a801]
Kernel driver in use: nvme
Kernel modules: nvme
05:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [144d:a808]
Subsystem: Samsung Electronics Co Ltd SSD 970 EVO [144d:a801]
Kernel driver in use: nvme
Kernel modules: nvme
06:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
Subsystem: ASUSTeK Computer Inc. I211 Gigabit Network Connection [1043:85f0]
Kernel driver in use: igb
Kernel modules: igb
07:00.0 Unassigned class [ff00]: Realtek Semiconductor Co., Ltd. Realtek RealManage BMC [10ec:816e] (rev 1a)
Subsystem: Realtek Semiconductor Co., Ltd. Realtek RealManage BMC [10ec:8168]
07:00.1 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 1a)
Subsystem: ASUSTeK Computer Inc. RTL8111/8168/8211/8411 PCI Express Gigabit Ethernet Controller [1043:8783]
Kernel driver in use: r8169
Kernel modules: r8169
07:00.2 Serial controller [0700]: Realtek Semiconductor Co., Ltd. RTL8111xP UART #1 [10ec:816a] (rev 1a)
Subsystem: Realtek Semiconductor Co., Ltd. RTL8111xP UART [10ec:8168]
Kernel driver in use: serial
07:00.4 USB controller [0c03]: Realtek Semiconductor Co., Ltd. RTL811x EHCI host controller [10ec:816d] (rev 1a)
Subsystem: Realtek Semiconductor Co., Ltd. RTL811x EHCI host controller [10ec:8168]
Kernel driver in use: ehci-pci
Kernel modules: ehci_pci
07:00.7 IPMI Interface [0c07]: Realtek Semiconductor Co., Ltd. RTL8111xP IPMI interface [10ec:816c] (rev 1a)
Subsystem: Realtek Semiconductor Co., Ltd. RTL8111xP IPMI interface [10ec:8168]
Kernel modules: ipmi_si
08:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM2142/ASM3142 USB 3.1 Host Controller [1b21:2142]
Subsystem: ASMedia Technology Inc. ASM2142/ASM3142 USB 3.1 Host Controller [1b21:2142]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
09:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO [144d:a80a]
Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO (SSD 980 PRO) [144d:a801]
Kernel driver in use: nvme
Kernel modules: nvme
0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse Reserved SPP [1043:8808]
0a:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
Subsystem: ASUSTeK Computer Inc. Matisse USB 3.0 Host Controller [1043:8808]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
0a:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:148c]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
0b:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
Kernel driver in use: ahci
Kernel modules: ahci
0c:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
Kernel driver in use: ahci
Kernel modules: ahci
0d:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU116 [GeForce GTX 1660] [10de:2184] (rev a1)
Subsystem: ASUSTeK Computer Inc. TU116 [GeForce GTX 1660] [1043:86bb]
Kernel driver in use: vfio-pci
Kernel modules: nvidiafb, nouveau, nvidia_vgpu_vfio, nvidia
0d:00.1 Audio device [0403]: NVIDIA Corporation TU116 High Definition Audio Controller [10de:1aeb] (rev a1)
Subsystem: ASUSTeK Computer Inc. TU116 High Definition Audio Controller [1043:86bb]
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
0d:00.2 USB controller [0c03]: NVIDIA Corporation TU116 USB 3.1 Host Controller [10de:1aec] (rev a1)
Subsystem: ASUSTeK Computer Inc. TU116 USB 3.1 Host Controller [1043:86bb]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
0d:00.3 Serial bus controller [0c80]: NVIDIA Corporation TU116 USB Type-C UCSI Controller [10de:1aed] (rev a1)
Subsystem: ASUSTeK Computer Inc. TU116 USB Type-C UCSI Controller [1043:86bb]
Kernel driver in use: nvidia-gpu
Kernel modules: i2c_nvidia_gpu
0e:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU106 [GeForce RTX 2060 SUPER] [10de:1f06] (rev a1)
Subsystem: Gigabyte Technology Co., Ltd TU106 [GeForce RTX 2060 SUPER] [1458:3fed]
Kernel driver in use: nvidia
Kernel modules: nvidiafb, nouveau, nvidia_vgpu_vfio, nvidia
0e:00.1 Audio device [0403]: NVIDIA Corporation TU106 High Definition Audio Controller [10de:10f9] (rev a1)
Subsystem: Gigabyte Technology Co., Ltd TU106 High Definition Audio Controller [1458:3fed]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
0e:00.2 USB controller [0c03]: NVIDIA Corporation TU106 USB 3.1 Host Controller [10de:1ada] (rev a1)
Subsystem: Gigabyte Technology Co., Ltd TU106 USB 3.1 Host Controller [1458:3fed]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
0e:00.3 Serial bus controller [0c80]: NVIDIA Corporation TU106 USB Type-C UCSI Controller [10de:1adb] (rev a1)
Subsystem: Gigabyte Technology Co., Ltd TU106 USB Type-C UCSI Controller [1458:3fed]
Kernel driver in use: nvidia-gpu
Kernel modules: i2c_nvidia_gpu
0f:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse PCIe Dummy Function [1043:8808]
10:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse Reserved SPP [1043:8808]
10:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse Cryptographic Coprocessor PSPCPP [1043:8808]
Kernel driver in use: ccp
Kernel modules: ccp
10:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
Subsystem: ASUSTeK Computer Inc. Matisse USB 3.0 Host Controller [1043:87c0]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
10:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
Subsystem: ASUSTeK Computer Inc. Starship/Matisse HD Audio Controller [1043:8733]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel

NOTE: If I remove Motherboard USB passthrough and add the softdep I can passthrough PCI cards OK
options vfio-pci ids=10de:2184,10de:1aeb,10de:1aec,10de:1aed,1b21:2142 disable_vga=1
softdep xhci_pci pre: vfio-pci

Hope this helps.
 
dcsapak said:
if somebody could try to apply the following patch: https://lore.proxmox.com/pve-devel/20241105092421.774448-2-d.csapak@proxmox.com/
it would be interesting which file_write has what exact error in the task log when starting & failing with 'cannot bind to vfio-pci'
Click to expand...
applied the patch in /usr/share/perl5/PVE/SysFSTools.pm , no changes, but there is extra log
Code: 
error writing '1022 7901' to '/sys/bus/pci/drivers/vfio-pci/new_id': File exists
TASK ERROR: Cannot bind 0000:08:00.1 to vfio
for me it looks like I have setup hostpci of GPU and sound (AMD) only
Code: 
hostpci0: 0000:07:00.0,pcie=1,romfile=vbios_1636.rom
hostpci1: 0000:07:00.1,pcie=1,romfile=AMDGopDriver.rom
but the error to bind is about SATA controller as it's different ID

Code: 
root@homelab1:~# lspci -nnk
07:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Renoir [1002:1636] (rev db)
    Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Renoir [Radeon Vega Series / Radeon Vega Mobile Series] [1002:1636]
    Kernel driver in use: vfio-pci
    Kernel modules: amdgpu
07:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Renoir Radeon High Definition Audio Controller [1002:1637]
    Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Renoir Radeon High Definition Audio Controller [1002:1637]
    Kernel driver in use: vfio-pci
    Kernel modules: snd_hda_intel
08:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)
    Subsystem: ASRock Incorporation FCH SATA Controller [AHCI mode] [1849:ffff]
    Kernel driver in use: vfio-pci
    Kernel modules: ahci
08:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)
    Subsystem: ASRock Incorporation FCH SATA Controller [AHCI mode] [1849:ffff]
    Kernel driver in use: ahci
    Kernel modules: ahci
 
Last edited:
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back