iGPU passthrough issue after CPU upgrade

Mar 8, 2022
48
9
13
36
I replaced my i5-10600K with a i7-11700K (ASUS PRIME Z590-V MB). Booted up and Proxmox detected and identified CPU. Ran updates. Rebooted. Noticed my Open Media Vault VM which I pass through iGPU for plex transcoding is not booting. (*knew I forgot something*) VM still had the PCI passthrough config from previous processor. Updated it according.. or so I thought.


So things that have changed:

- CPU: i5-10600K to i7-11700K

- Updates: Kernel (5.15.35-3-pve to 5.15.39-1-pve)

- VM PCIe passthrough. Remove and update (old config from previous processor was still there)

Verified GVT-d is still enabled in BIOS. IOMMU shows enabled however there are some other "inconsistent" messages that follow:

Code:
dmesg | grep -e DMAR -e IOMMU
[    0.000000] Warning: PCIe ACS overrides enabled; This may allow non-IOMMU protected peer-to-peer DMA
[    0.008456] ACPI: DMAR 0x0000000094246000 000088 (v02 INTEL  EDK2     00000002      01000013)
[    0.008485] ACPI: Reserving DMAR table memory at [mem 0x94246000-0x94246087]
[    0.064823] DMAR: IOMMU enabled
[    0.155259] DMAR: Host address width 39
[    0.155260] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[    0.155263] DMAR: dmar0: reg_base_addr fed90000 ver 4:0 cap 1c0000c40660462 ecap 29a00f0505e
[    0.155265] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[    0.155268] DMAR: dmar1: reg_base_addr fed91000 ver 1:0 cap d2008c40660462 ecap f050da
[    0.155272] DMAR: RMRR base: 0x0000009e000000 end: 0x000000a07fffff
[    0.155274] DMAR-IR: IOAPIC id 2 under DRHD base  0xfed91000 IOMMU 1
[    0.155275] DMAR-IR: HPET id 0 under DRHD base 0xfed91000
[    0.155276] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    0.156775] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    0.297570] pci 0000:00:02.0: DMAR: Skip IOMMU disabling for graphics
[    0.353537] DMAR: No ATSR found
[    0.353538] DMAR: No SATC found
[    0.353539] DMAR: IOMMU feature fl1gp_support inconsistent
[    0.353540] DMAR: IOMMU feature pgsel_inv inconsistent
[    0.353541] DMAR: IOMMU feature nwfs inconsistent
[    0.353541] DMAR: IOMMU feature dit inconsistent
[    0.353542] DMAR: IOMMU feature sc_support inconsistent
[    0.353543] DMAR: IOMMU feature dev_iotlb_support inconsistent
[    0.353544] DMAR: dmar0: Using Queued invalidation
[    0.353546] DMAR: dmar1: Using Queued invalidation
[    0.353725] DMAR: Intel(R) Virtualization Technology for Directed I/O

Some Config:
Code:
root@pm:/var/log# lspci
00:00.0 Host bridge: Intel Corporation Device 4c43 (rev 01)
00:01.0 PCI bridge: Intel Corporation Device 4c01 (rev 01)
00:02.0 VGA compatible controller: Intel Corporation RocketLake-S GT1 [UHD Graphics 750] (rev 04)
00:14.0 USB controller: Intel Corporation Tiger Lake-H USB 3.2 Gen 2x1 xHCI Host Controller (rev 11)
00:14.2 RAM memory: Intel Corporation Tiger Lake-H Shared SRAM (rev 11)
00:15.0 Serial bus controller: Intel Corporation Tiger Lake-H Serial IO I2C Controller #0 (rev 11)
00:16.0 Communication controller: Intel Corporation Tiger Lake-H Management Engine Interface (rev 11)
00:17.0 RAID bus controller: Intel Corporation Device 43d6 (rev 11)
00:1b.0 PCI bridge: Intel Corporation Device 43c0 (rev 11)
00:1c.0 PCI bridge: Intel Corporation Device 43b8 (rev 11)
00:1d.0 PCI bridge: Intel Corporation Tiger Lake-H PCI Express Root Port #9 (rev 11)
00:1f.0 ISA bridge: Intel Corporation Device 4385 (rev 11)
00:1f.3 Audio device: Intel Corporation Tiger Lake-H HD Audio Controller (rev 11)
00:1f.4 SMBus: Intel Corporation Tiger Lake-H SMBus Controller (rev 11)
00:1f.5 Serial bus controller: Intel Corporation Tiger Lake-H SPI Controller (rev 11)
00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (14) I219-V (rev 11)
01:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
02:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller 980
04:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller 980

Code:
00:02.0 VGA compatible controller: Intel Corporation RocketLake-S GT1 [UHD Graphics 750] (rev 04)
        DeviceName: Onboard - Video
        Subsystem: ASUSTeK Computer Inc. Device 8694
        Kernel driver in use: vfio-pci
        Kernel modules: i915

00:02.0 VGA compatible controller [0300]: Intel Corporation RocketLake-S GT1 [UHD Graphics 750] [8086:4c8a] (rev 04) (prog-if 00 [VGA controller])

host conf
Code:
agent: 1
balloon: 0
boot: order=scsi0;net0
cores: 12
hostpci0: 0000:00:02
hostpci3: 0000:01:00.0,pcie=1,rombar=0
machine: q35
memory: 32768
name: OMV
net0: virtio=CA:FA:33:C0:4F:EA,bridge=vmbr0,firewall=1
numa: 0
onboot: 1
ostype: l26
scsi0: storage1:vm-102-disk-0,size=100G
scsi1: storage1:vm-102-disk-1,size=64G
scsihw: virtio-scsi-pci
smbios1: uuid=ae00a3ec-bde4-4434-b241-3883ca0f0f73
sockets: 1
startup: order=2
vmgenid: aac30f78-91b1-41ab-8fbc-2cf923f8943e

/etc/default/grub
Code:
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on i915.enable_gvt=1 debug"

/etc/modules
Code:
# Modules required for PCI passthrough
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

# Modules required for Intel GVT
kvmgt
exngt
vfio-mdev

This was all the same config I used with the i5-10600K but does not seem to work with the new i7-11700K that I dropped in. If there are any more details I can provide please let me know! Any suggestions would be appreciated! Thank you so much humans!!!
 
Last edited:
Maybe it is being passed through? On my OMV VM host I see:

Code:
06:10.0 VGA compatible controller [0300]: Intel Corporation Device [8086:4c8a] (rev 04) (prog-if 00 [VGA controller])

06:10.0 VGA compatible controller: Intel Corporation Device 4c8a (rev 04)
    Subsystem: ASUSTeK Computer Inc. Device 8694
    Kernel modules: i915

That lines up with what is on the PM host. However I have nothing in /dev/dri/rend* (on VM) as I did with the previous CPU iGPU passthrough.

I am also thrown off by the fact that I dont have any MDev type options as I did previously.
1658681222119.png
 
Last edited:
So MDev is a part of VT-g which isnt available on 11th gen. Got it. Thats why I wasn't seeing MDev Type options?

Looks like the iGPU is being passed successfully to the VM but the VM needs a newer kernel. Sadly I don't think OMV 5 will support anything newer then what it has at the moment.

Code:
[    6.607456] i915 0000:06:10.0: Your graphics device 4c8a is not properly supported by the driver in this
           kernel version. To force driver probe anyway, use i915.force_probe=4c8a
           module parameter or CONFIG_DRM_I915_FORCE_PROBE=4c8a configuration option,
           or (recommended) check for kernel updates.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!