PCI passthrough ERROR since Kernel 5.13.19-1 (upgrade from 7.0 to 7.1)

derMischka · Dec 6, 2021

after Upgrade to Kernel 5.13.19-1 my PCI-Passthrough (GPU) doesn't work.

Last working Kernel: 5.11.22-7

My Configuration:

Mainboard: Asrock J4105 with Intel J4105
The primary GPU (part of Intel CPU i915) is connected to a VM (the Proxmox-Server self is headless).
On the VM is a Debian Buster (Kernel 4.19).

In the Attachment are the "dmesg-Log" for both Kernel-Versions (I removed the timestamps for better compare).

I think, the problematic logs are the following lines (only present in Kernel 5.13.19-1):

DMAR: No SATC found
DMAR: IOMMU feature fl1gp_support inconsistent
DMAR: IOMMU feature pgsel_inv inconsistent
DMAR: IOMMU feature nwfs inconsistent
DMAR: IOMMU feature eafs inconsistent
DMAR: IOMMU feature prs inconsistent
DMAR: IOMMU feature nest inconsistent
DMAR: IOMMU feature mts inconsistent
DMAR: IOMMU feature sc_support inconsistent
DMAR: IOMMU feature dev_iotlb_support inconsistent

DMAR: [DMA Write] Request device [00:02.0] PASID ffffffff fault addr 0 [fault reason 02] Present bit in context entry is clear
vfio-pci 0000:00:02.0: vfio_ecap_init: hiding ecap 0x1b@0x100
vfio-pci 0000:00:02.0: IGD assignment does not support opregion v2.0 with an extended VBT region
vfio-pci 0000:00:02.0: Failed to setup Intel IGD regions
DMAR: DRHD: handling fault status reg 2
DMAR: [DMA Write] Request device [00:02.0] PASID ffffffff fault addr 0 [fault reason 02] Present bit in context entry is clear

I have no Idea ...

By the way - since the new PVE Version 7.xx the PCI-Passthrouph of a Network-Adapter has also Problems (the Hardware is not present in the VM). After some restarts of the VM it works (this VM uses a Kernel 5.10).

derMischka

mcdull · Dec 8, 2021

Better show your iommu group as well.

derMischka · Dec 9, 2021

List of my iommu groups:

IOMMU Group 0 00:00.0 Host bridge [0600]: Intel Corporation Gemini Lake Host Bridge [8086:31f0] (rev 03)
IOMMU Group 0 00:00.1 Signal processing controller [1180]: Intel Corporation Celeron/Pentium Silver Processor Dynamic Platform and Thermal Framework Processor Participant [8086:318c] (rev 03)
IOMMU Group 1 00:02.0 VGA compatible controller [0300]: Intel Corporation GeminiLake [UHD Graphics 600] [8086:3185] (rev 03)
IOMMU Group 2 00:0e.0 Audio device [0403]: Intel Corporation Celeron/Pentium Silver Processor High Definition Audio [8086:3198] (rev 03)
IOMMU Group 3 00:0f.0 Communication controller [0780]: Intel Corporation Celeron/Pentium Silver Processor Trusted Execution Engine Interface [8086:319a] (rev 03)
IOMMU Group 4 00:12.0 SATA controller [0106]: Intel Corporation Celeron/Pentium Silver Processor SATA Controller [8086:31e3] (rev 03)
IOMMU Group 5 00:13.0 PCI bridge [0604]: Intel Corporation Gemini Lake PCI Express Root Port [8086:31d8] (rev f3)
IOMMU Group 6 00:13.1 PCI bridge [0604]: Intel Corporation Gemini Lake PCI Express Root Port [8086:31d9] (rev f3)
IOMMU Group 7 00:13.2 PCI bridge [0604]: Intel Corporation Gemini Lake PCI Express Root Port [8086:31da] (rev f3)
IOMMU Group 8 00:13.3 PCI bridge [0604]: Intel Corporation Gemini Lake PCI Express Root Port [8086:31db] (rev f3)
IOMMU Group 9 00:15.0 USB controller [0c03]: Intel Corporation Celeron/Pentium Silver Processor USB 3.0 xHCI Controller [8086:31a8] (rev 03)
IOMMU Group 10 00:1f.0 ISA bridge [0601]: Intel Corporation Celeron/Pentium Silver Processor LPC Controller [8086:31e8] (rev 03)
IOMMU Group 10 00:1f.1 SMBus [0c05]: Intel Corporation Celeron/Pentium Silver Processor Gaussian Mixture Model [8086:31d4] (rev 03)
IOMMU Group 11 01:00.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e PCIe Switch Port [1b21:1184]
IOMMU Group 12 02:01.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e PCIe Switch Port [1b21:1184]
IOMMU Group 12 03:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 07)
IOMMU Group 13 02:03.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e PCIe Switch Port [1b21:1184]
IOMMU Group 13 04:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 07)
IOMMU Group 14 02:05.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e PCIe Switch Port [1b21:1184]
IOMMU Group 14 05:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 07)
IOMMU Group 15 02:07.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1184e PCIe Switch Port [1b21:1184]
IOMMU Group 15 06:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 07)
IOMMU Group 16 07:00.0 Network controller [0280]: Qualcomm Atheros QCA986x/988x 802.11ac Wireless Network Adapter [168c:003c]
IOMMU Group 17 08:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 15)
IOMMU Group 18 09:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062 Serial ATA Controller [1b21:0612] (rev 02)

I can't see any problems, Graphic Card has its own group ...
The Qualcomm Atheros Wireless Network Adapter is also not "passthrouph" to the vm (other vm)

derMischka · Dec 9, 2021

Code:

lspci -v

00:00.0 Host bridge: Intel Corporation Gemini Lake Host Bridge (rev 03)
        DeviceName: Onboard - Other
        Subsystem: ASRock Incorporation Gemini Lake Host Bridge
        Flags: bus master, fast devsel, latency 0, IOMMU group 0

00:00.1 Signal processing controller: Intel Corporation Celeron/Pentium Silver Processor Dynamic Platform and Thermal Framework Processor Participant (rev 03)
        DeviceName: Onboard - Other
        Subsystem: ASRock Incorporation Celeron/Pentium Silver Processor Dynamic Platform and Thermal Framework Processor Participant
        Flags: bus master, fast devsel, latency 0, IRQ 24, IOMMU group 0
        Memory at 80000000 (64-bit, non-prefetchable) [size=32K]
        Kernel driver in use: proc_thermal
        Kernel modules: processor_thermal_device

00:02.0 VGA compatible controller: Intel Corporation GeminiLake [UHD Graphics 600] (rev 03) (prog-if 00 [VGA controller])
        DeviceName: Onboard - Video
        Subsystem: ASRock Incorporation UHD Graphics 605
        Flags: fast devsel, IRQ 19, IOMMU group 1
        Memory at a0000000 (64-bit, non-prefetchable) [size=16M]
        Memory at 90000000 (64-bit, prefetchable) [size=256M]
        I/O ports at f000 [size=64]
        Expansion ROM at 000c0000 [virtual] [disabled] [size=128K]
        Kernel driver in use: vfio-pci
        Kernel modules: i915

00:0e.0 Audio device: Intel Corporation Celeron/Pentium Silver Processor High Definition Audio (rev 03)
        DeviceName: Onboard - Sound
        Subsystem: ASRock Incorporation Celeron/Pentium Silver Processor High Definition Audio
        Flags: bus master, fast devsel, latency 0, IRQ 25, IOMMU group 2
        Memory at a1a10000 (64-bit, non-prefetchable) [size=16K]
        Memory at a1300000 (64-bit, non-prefetchable) [size=1M]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel, snd_soc_skl, snd_sof_pci_intel_apl

00:0f.0 Communication controller: Intel Corporation Celeron/Pentium Silver Processor Trusted Execution Engine Interface (rev 03)
        DeviceName: Onboard - Other
        Subsystem: ASRock Incorporation Celeron/Pentium Silver Processor Trusted Execution Engine Interface
        Flags: bus master, fast devsel, latency 0, IRQ 138, IOMMU group 3
        Memory at a1a19000 (64-bit, non-prefetchable) [size=4K]
        Kernel driver in use: mei_me
        Kernel modules: mei_me

00:12.0 SATA controller: Intel Corporation Celeron/Pentium Silver Processor SATA Controller (rev 03) (prog-if 01 [AHCI 1.0])
        DeviceName: Onboard - SATA
        Subsystem: ASRock Incorporation Device 31e3
        Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 130, IOMMU group 4
        Memory at a1a14000 (32-bit, non-prefetchable) [size=8K]
        Memory at a1a18000 (32-bit, non-prefetchable) [size=256]
        I/O ports at f090 [size=8]
        I/O ports at f080 [size=4]
        I/O ports at f060 [size=32]
        Memory at a1a17000 (32-bit, non-prefetchable) [size=2K]
        Kernel driver in use: ahci
        Kernel modules: ahci

00:13.0 PCI bridge: Intel Corporation Gemini Lake PCI Express Root Port (rev f3) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 122, IOMMU group 5
        Bus: primary=00, secondary=01, subordinate=06, sec-latency=0
        I/O behind bridge: 00009000-0000cfff [size=16K]
        Memory behind bridge: a1400000-a17fffff [size=4M]
        Prefetchable memory behind bridge: 0000000080100000-00000000804fffff [size=4M]
        Kernel driver in use: pcieport

00:13.1 PCI bridge: Intel Corporation Gemini Lake PCI Express Root Port (rev f3) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 123, IOMMU group 6
        Bus: primary=00, secondary=07, subordinate=07, sec-latency=0
        I/O behind bridge: [disabled]
        Memory behind bridge: a1000000-a12fffff [size=3M]
        Prefetchable memory behind bridge: [disabled]
        Kernel driver in use: pcieport

00:13.2 PCI bridge: Intel Corporation Gemini Lake PCI Express Root Port (rev f3) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 124, IOMMU group 7
        Bus: primary=00, secondary=08, subordinate=08, sec-latency=0
        I/O behind bridge: 0000e000-0000efff [size=4K]
        Memory behind bridge: a1900000-a19fffff [size=1M]
        Prefetchable memory behind bridge: [disabled]
        Kernel driver in use: pcieport

00:13.3 PCI bridge: Intel Corporation Gemini Lake PCI Express Root Port (rev f3) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 125, IOMMU group 8
        Bus: primary=00, secondary=09, subordinate=09, sec-latency=0
        I/O behind bridge: 0000d000-0000dfff [size=4K]
        Memory behind bridge: a1800000-a18fffff [size=1M]
        Prefetchable memory behind bridge: [disabled]
        Kernel driver in use: pcieport

00:15.0 USB controller: Intel Corporation Celeron/Pentium Silver Processor USB 3.0 xHCI Controller (rev 03) (prog-if 30 [XHCI])
        DeviceName: Onboard - Other
        Subsystem: ASRock Incorporation Celeron/Pentium Silver Processor USB 3.0 xHCI Controller
        Flags: bus master, medium devsel, latency 0, IRQ 136, IOMMU group 9
        Memory at a1a00000 (64-bit, non-prefetchable) [size=64K]
        Kernel driver in use: xhci_hcd
        Kernel modules: xhci_pci

00:1f.0 ISA bridge: Intel Corporation Celeron/Pentium Silver Processor LPC Controller (rev 03)
        DeviceName: Onboard - Other
        Subsystem: ASRock Incorporation Device 31e8
        Flags: bus master, medium devsel, latency 0, IOMMU group 10

00:1f.1 SMBus: Intel Corporation Celeron/Pentium Silver Processor Gaussian Mixture Model (rev 03)
        DeviceName: Onboard - Other
        Subsystem: ASRock Incorporation Celeron/Pentium Silver Processor Gaussian Mixture Model
        Flags: medium devsel, IRQ 20, IOMMU group 10
        Memory at a1a16000 (64-bit, non-prefetchable) [size=256]
        I/O ports at f040 [size=32]
        Kernel driver in use: i801_smbus
        Kernel modules: i2c_i801

01:00.0 PCI bridge: ASMedia Technology Inc. ASM1184e PCIe Switch Port (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 22, IOMMU group 11
        Bus: primary=01, secondary=02, subordinate=06, sec-latency=0
        I/O behind bridge: 00009000-0000cfff [size=16K]
        Memory behind bridge: a1400000-a17fffff [size=4M]
        Prefetchable memory behind bridge: 0000000080100000-00000000804fffff [size=4M]
        Kernel driver in use: pcieport

02:01.0 PCI bridge: ASMedia Technology Inc. ASM1184e PCIe Switch Port (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 126, IOMMU group 12
        Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
        I/O behind bridge: 0000c000-0000cfff [size=4K]
        Memory behind bridge: a1700000-a17fffff [size=1M]
        Prefetchable memory behind bridge: 0000000080400000-00000000804fffff [size=1M]
        Kernel driver in use: pcieport

02:03.0 PCI bridge: ASMedia Technology Inc. ASM1184e PCIe Switch Port (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 127, IOMMU group 13
        Bus: primary=02, secondary=04, subordinate=04, sec-latency=0
        I/O behind bridge: 0000b000-0000bfff [size=4K]
        Memory behind bridge: a1600000-a16fffff [size=1M]
        Prefetchable memory behind bridge: 0000000080300000-00000000803fffff [size=1M]
        Kernel driver in use: pcieport

02:05.0 PCI bridge: ASMedia Technology Inc. ASM1184e PCIe Switch Port (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 128, IOMMU group 14
        Bus: primary=02, secondary=05, subordinate=05, sec-latency=0
        I/O behind bridge: 0000a000-0000afff [size=4K]
        Memory behind bridge: a1500000-a15fffff [size=1M]
        Prefetchable memory behind bridge: 0000000080200000-00000000802fffff [size=1M]
        Kernel driver in use: pcieport

02:07.0 PCI bridge: ASMedia Technology Inc. ASM1184e PCIe Switch Port (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 129, IOMMU group 15
        Bus: primary=02, secondary=06, subordinate=06, sec-latency=0
        I/O behind bridge: 00009000-00009fff [size=4K]
        Memory behind bridge: a1400000-a14fffff [size=1M]
        Prefetchable memory behind bridge: 0000000080100000-00000000801fffff [size=1M]
        Kernel driver in use: pcieport

03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 07)
        Subsystem: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
        Flags: bus master, fast devsel, latency 0, IRQ 23, IOMMU group 12
        I/O ports at c000 [size=256]
        Memory at a1700000 (64-bit, non-prefetchable) [size=4K]
        Memory at 80400000 (64-bit, prefetchable) [size=16K]
        Kernel driver in use: r8169
        Kernel modules: r8169

04:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 07)
        Subsystem: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
        Flags: bus master, fast devsel, latency 0, IRQ 21, IOMMU group 13
        I/O ports at b000 [size=256]
        Memory at a1600000 (64-bit, non-prefetchable) [size=4K]
        Memory at 80300000 (64-bit, prefetchable) [size=16K]
        Kernel driver in use: r8169
        Kernel modules: r8169

05:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 07)
        Subsystem: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
        Flags: bus master, fast devsel, latency 0, IRQ 23, IOMMU group 14
        I/O ports at a000 [size=256]
        Memory at a1500000 (64-bit, non-prefetchable) [size=4K]
        Memory at 80200000 (64-bit, prefetchable) [size=16K]
        Kernel driver in use: r8169
        Kernel modules: r8169

06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 07)
        Subsystem: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
        Flags: bus master, fast devsel, latency 0, IRQ 21, IOMMU group 15
        I/O ports at 9000 [size=256]
        Memory at a1400000 (64-bit, non-prefetchable) [size=4K]
        Memory at 80100000 (64-bit, prefetchable) [size=16K]
        Kernel driver in use: r8169
        Kernel modules: r8169

07:00.0 Network controller: Qualcomm Atheros QCA986x/988x 802.11ac Wireless Network Adapter
        Flags: bus master, fast devsel, latency 0, IRQ 139, IOMMU group 16
        Memory at a1000000 (64-bit, non-prefetchable) [size=2M]
        Expansion ROM at a1200000 [disabled] [size=64K]
        Kernel driver in use: vfio-pci
        Kernel modules: ath10k_pci

08:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15)
        DeviceName: Onboard - RTK Ethernet
        Subsystem: ASRock Incorporation Motherboard (one of many)
        Flags: bus master, fast devsel, latency 0, IRQ 20, IOMMU group 17
        I/O ports at e000 [size=256]
        Memory at a1904000 (64-bit, non-prefetchable) [size=4K]
        Memory at a1900000 (64-bit, non-prefetchable) [size=16K]
        Kernel driver in use: vfio-pci
        Kernel modules: r8169

09:00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial ATA Controller (rev 02) (prog-if 01 [AHCI 1.0])
        Subsystem: ASRock Incorporation Motherboard
        Flags: bus master, fast devsel, latency 0, IRQ 134, IOMMU group 18
        I/O ports at d050 [size=8]
        I/O ports at d040 [size=4]
        I/O ports at d030 [size=8]
        I/O ports at d020 [size=4]
        I/O ports at d000 [size=32]
        Memory at a1800000 (32-bit, non-prefetchable) [size=512]
        Kernel driver in use: ahci
        Kernel modules: ahci

kay_m_k · Dec 10, 2021

Hi @derMischka , Hello everyone

I'm relatively new to proxmox and it's my first setup. Running proxmox 7.1.1 kernel "5.13.19-2-pve" and ran into the same issue.

Hardware used : mini PC from minisforum EliteMini U850, Intel Core i5 10210U processor 4 cores 8 threads, total cache 6MB, equipped with Intel® UHD graphics (300MHz-1.10GHz). CPU speed is limited as the cooling is very primitive but it is serving as my proxmox lab rat for now.

My configuration is here below and I hope it is resolved soon.

Thanks, Kay

dmesg | grep -i -e DMAR -e IOMMU
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.13.19-2-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on video=efifb

ff iommu=pt
[ 0.022774] ACPI: DMAR 0x000000009B15D000 0000A8 (v01 INTEL EDK2 00000002 01000013)
[ 0.022826] ACPI: Reserving DMAR table memory at [mem 0x9b15d000-0x9b15d0a7]
[ 0.058312] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.13.19-2-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on video=efifb

ff iommu=pt
[ 0.058402] DMAR: IOMMU enabled
[ 0.152901] DMAR: Host address width 39
[ 0.152902] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[ 0.152911] DMAR: dmar0: reg_base_addr fed90000 ver 1:0 cap 1c0000c40660462 ecap 19e2ff0505e
[ 0.152916] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[ 0.152921] DMAR: dmar1: reg_base_addr fed91000 ver 1:0 cap d2008c40660462 ecap f050da
[ 0.152925] DMAR: RMRR base: 0x0000009b49b000 end: 0x0000009b6e4fff
[ 0.152928] DMAR: RMRR base: 0x0000009d000000 end: 0x0000009f7fffff
[ 0.152931] DMAR-IR: IOAPIC id 2 under DRHD base 0xfed91000 IOMMU 1
[ 0.152933] DMAR-IR: HPET id 0 under DRHD base 0xfed91000
[ 0.152935] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[ 0.155117] DMAR-IR: Enabled IRQ remapping in x2apic mode
[ 0.408828] iommu: Default domain type: Passthrough (set via kernel command line)
[ 0.481676] DMAR: No ATSR found
[ 0.481676] DMAR: No SATC found
[ 0.481678] DMAR: IOMMU feature fl1gp_support inconsistent
[ 0.481680] DMAR: IOMMU feature pgsel_inv inconsistent
[ 0.481682] DMAR: IOMMU feature nwfs inconsistent
[ 0.481683] DMAR: IOMMU feature pasid inconsistent
[ 0.481684] DMAR: IOMMU feature eafs inconsistent
[ 0.481685] DMAR: IOMMU feature prs inconsistent
[ 0.481686] DMAR: IOMMU feature nest inconsistent
[ 0.481687] DMAR: IOMMU feature mts inconsistent
[ 0.481687] DMAR: IOMMU feature sc_support inconsistent
[ 0.481688] DMAR: IOMMU feature dev_iotlb_support inconsistent
[ 0.481690] DMAR: dmar0: Using Queued invalidation
[ 0.481694] DMAR: dmar1: Using Queued invalidation
[ 0.481885] pci 0000:00:00.0: Adding to iommu group 0
[ 0.481898] pci 0000:00:02.0: Adding to iommu group 1
[ 0.481909] pci 0000:00:08.0: Adding to iommu group 2
[ 0.481926] pci 0000:00:12.0: Adding to iommu group 3
[ 0.481945] pci 0000:00:14.0: Adding to iommu group 4
[ 0.481956] pci 0000:00:14.2: Adding to iommu group 4
[ 0.481976] pci 0000:00:15.0: Adding to iommu group 5
[ 0.481993] pci 0000:00:16.0: Adding to iommu group 6
[ 0.482004] pci 0000:00:17.0: Adding to iommu group 7
[ 0.482014] pci 0000:00:1a.0: Adding to iommu group 8
[ 0.482030] pci 0000:00:1c.0: Adding to iommu group 9
[ 0.482047] pci 0000:00:1c.7: Adding to iommu group 10
[ 0.482065] pci 0000:00:1d.0: Adding to iommu group 11
[ 0.482091] pci 0000:00:1f.0: Adding to iommu group 12
[ 0.482102] pci 0000:00:1f.3: Adding to iommu group 12
[ 0.482114] pci 0000:00:1f.4: Adding to iommu group 12
[ 0.482125] pci 0000:00:1f.5: Adding to iommu group 12
[ 0.482141] pci 0000:01:00.0: Adding to iommu group 13
[ 0.482156] pci 0000:02:00.0: Adding to iommu group 14
[ 0.482171] pci 0000:03:00.0: Adding to iommu group 15
[ 0.482274] DMAR: Intel(R) Virtualization Technology for Directed I/O
[ 1.314348] intel_iommu=on

/etc/modprobe.d/vfio.conf
options vfio-pci ids=8086:9b41 disable_vga=1

/etc/default/grub added GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on video=efifb

ff iommu=pt"

/etc/modprobe.d/pve-blacklist.conf
blacklist i915

/etc/modprobe.d/kvm.conf
options kvm ignore_msrs=1

/etc/modprobe.d/iommu_unsafe_interrupts.conf
options vfio_iommu_type1 allow_unsafe_interrupts=1

/etc/modules
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

Dark26 · Dec 11, 2021

Same problem here.
Works Fine in pve 6.4 before with this
GRUB_CMDLINE_LINUX_DEFAULT="intel_iommu=on iommu=pt net.ifnames=0 biosdevname=0"

now with pve 7.1 with kernel 5.13, block at boot, with dmar mesages from the network card not registered ( intel 10Gigabit )

if i remove intel_iommu=ob, it bot correctly but no passthrough ...

if i boot with kernel 5.4 , no problem.

FYI In 6.4, it was working with kernel 5.11.

Strange. if a i have time i try with kernel 5.15

Dark26 · Dec 11, 2021

update : it's working with kernel 5.15

goseph · Dec 12, 2021

Problem with Gemini Lake Intel HD 600.
Even on Kernel 5.15

Proxmox boots fine for me but i get this error when i try to start he Win10 VM:

Bash:

[Sun Dec 12 17:51:18 2021] vfio-pci 0000:00:02.0: vfio_ecap_init: hiding ecap 0x1b@0x100
[Sun Dec 12 17:51:18 2021] vfio-pci 0000:00:02.0: IGD assignment does not support opregion v2.0 with an extended VBT region
[Sun Dec 12 17:51:18 2021] vfio-pci 0000:00:02.0: Failed to setup Intel IGD regions
[Sun Dec 12 17:51:18 2021] DMAR: DRHD: handling fault status reg 2
[Sun Dec 12 17:51:18 2021] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x0 [fault reason 0x02] Present bit in context entry is clear
[Sun Dec 12 17:51:18 2021] vmbr0: port 3(tap101i0) entered disabled state

k3vinyang · Dec 23, 2021

same issue here. J4125 UHD600 GPU, cannot get passthrough working.

k3vinyang · Dec 23, 2021

Dark26 said:
update : it's working with kernel 5.15

how did you do it?

Dark26 · Dec 23, 2021

k3vinyang said:
how did you do it?

Install the kernel ? it's ont post-it thread on the forum.

But my problem is weird, it's not a problem of kernel, but sometimes it's not working on a cold boot ( with 5.13 or 5.15). If i just reboot after, it works...

k3vinyang · Jan 4, 2022

Dark26 said:
Install the kernel ? it's ont post-it thread on the forum.

But my problem is weird, it's not a problem of kernel, but sometimes it's not working on a cold boot ( with 5.13 or 5.15). If i just reboot after, it works...

after updating the kernel, still got the same issue. UHD600..

Docop2 · Jan 4, 2022

Just plug in a xubuntu iso , do live session and it will give the result directly. new hardware, new kernel, and update on top of that. start with linux, have it fully work... then try windows. the error 43 and so will give you few days of reading. different pc, different config.. lot to read to have the onboard pass in win.

bolzerrr · Jan 12, 2022

I juste move to pve 7.1 and now i am running into the same issue. Was there any solution already?

ellis.abyss · Jan 21, 2022

5.13.19-6 still have the problem ,
same problem here with UHD 750
[ 2286.488165] vfio-pci 0000:00:02.0: vfio_ecap_init: hiding ecap 0x1b@0x100
[ 2286.488226] vfio-pci 0000:00:02.0: Failed to setup Intel IGD regions

bolzerrr · Jan 29, 2022

i tried several things now, like the newer kernel, setting the relevant arg into to grub cmd line but still no success..
Any further advices what to do?

Emilien · Jan 29, 2022

bolzerrr said:
i tried several things now, like the newer kernel, setting the relevant arg into to grub cmd line but still no success..
Any further advices what to do?

Can you post the VM config?
qm config Your_VM_ID

bolzerrr · Jan 29, 2022

Code:

agent: 1,fstrim_cloned_disks=1
balloon: 0
bios: ovmf
boot: order=scsi0
cores: 2
cpu: host,flags=+pdpe1gb;+aes
cpulimit: 2
hostpci0: 0000:00:02,pcie=1
ide2: backup:iso/alpine-virt-3.15.0-x86_642.iso,media=cdrom,size=52M
machine: q35
memory: 2048
meta: creation-qemu=6.1.0,ctime=1642164190
name: APLINEEFI
net0: virtio=FE:C4:76:96:85:09,bridge=vmbr0,firewall=1
numa: 1
ostype: l26
scsi0: local-lvm:vm-104-disk-1,cache=writethrough,discard=on,iothread=1,size=8G,ssd=1
scsihw: virtio-scsi-single
serial0: socket
smbios1: uuid=00665cc0-829f-4522-9c7d-9a310cbf7d52
sockets: 1
tablet: 0
vga: serial0
vmgenid: a11eb44d-c1be-4a2f-af48-e2ab170e2023

Emilien · Jan 29, 2022

Your lspci is the same of this one?

bolzerrr · Jan 29, 2022

Looks like:



00:02.0 VGA compatible controller: Intel Corporation GeminiLake [UHD Graphics 600] (rev 03) (prog-if 00 [VGA controller])
        Subsystem: ASRock Incorporation UHD Graphics 605
        Flags: fast devsel, IRQ 19, IOMMU group 1
        Memory at a0000000 (64-bit, non-prefetchable) [size=16M]
        Memory at 90000000 (64-bit, prefetchable) [size=256M]
        I/O ports at f000 [size=64]
        Expansion ROM at 000c0000 [virtual] [disabled] [size=128K]
        Capabilities: [40] Vendor Specific Information: Len=0c <?>
        Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00
        Capabilities: [ac] MSI: Enable- Count=1/1 Maskable- 64bit-
        Capabilities: [d0] Power Management version 2
        Capabilities: [100] Process Address Space ID (PASID)
        Capabilities: [200] Address Translation Service (ATS)
        Capabilities: [300] Page Request Interface (PRI)
        Kernel driver in use: vfio-pci
        Kernel modules: i915

PCI passthrough ERROR since Kernel 5.13.19-1 (upgrade from 7.0 to 7.1)

Active Member

Attachments

Member

Active Member

Active Member

New Member

Renowned Member

Renowned Member

Renowned Member

New Member

New Member

Renowned Member

New Member

Member

Well-Known Member

New Member

Well-Known Member

Member

Well-Known Member

Member

Well-Known Member