Trying to enable IMMOU > No mapped devices found.

[deanfourie]

So i've repurposed a Datto appliance to run some Linux VMS. I'm trying to passthrough to enable intel-vaapi.

Specs are

8 x Intel(R) Xeon(R) CPU D-1521 @ 2.40GHz (1 Socket)
Linux 6.5.11-4-pve (2023-11-20T10:19Z)
8 CPUs
31.23GB

I've enabled VT-x and VT-d in BIOS and all looks good for IOMMU, except there is an issue with remapping.

cat /etc/default/grub

GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on"
GRUB_CMDLINE_LINUX=""

dmesg | grep -e DMAR -e IOMMU
[    0.010319] ACPI: DMAR 0x0000000079B84D80 0000BC (v01 GBT    GBTUACPI 00000001 INTL 20091013)
[    0.010357] ACPI: Reserving DMAR table memory at [mem 0x79b84d80-0x79b84e3b]
[    0.071345] DMAR: IOMMU enabled
[    0.198284] DMAR: Host address width 46
[    0.198285] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1
[    0.198291] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020df
[    0.198294] DMAR: RMRR base: 0x0000007bc09000 end: 0x0000007bc19fff
[    0.198296] DMAR: ATSR flags: 0x0
[    0.198298] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0
[    0.198300] DMAR-IR: IOAPIC id 8 under DRHD base  0xfbffc000 IOMMU 0
[    0.198302] DMAR-IR: IOAPIC id 9 under DRHD base  0xfbffc000 IOMMU 0
[    0.198304] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000
[    0.198305] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit.
[    0.198306] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting.
[    0.198664] DMAR-IR: Enabled IRQ remapping in xapic mode
[    0.624738] DMAR: No SATC found
[    0.624742] DMAR: dmar0: Using Queued invalidation
[    0.629736] DMAR: Intel(R) Virtualization Technology for Directed I/O

dmesg | grep 'remapping'
[    0.198664] DMAR-IR: Enabled IRQ remapping in xapic mode
[    0.198665] x2apic: IRQ remapping doesn't support X2APIC mode

Now, when attempting to passthrough a PCI device I no longer get the error the IOMMU is not enabled, but rather it does not show me my specific devices for this machine. It shows me some random devices?




Is PCI passthrough working? I'm guessing that this is an issue?

[    0.198665] x2apic: IRQ remapping doesn't support X2APIC mode

Thanks for the help!

 

[BobhWasatch]

Did you install a GPU? The Xeon D is a server CPU and as far as I know does not have integrated graphics. I have Xeon D-1541 and the only graphics it has is for the IPMI and that is a 2D-only VGA compatible device.

 

[leesteken]

Now, when attempting to passthrough a PCI device I no longer get the error the IOMMU is not enabled, but rather it does not show me my specific devices for this machine. It shows me some random devices?

It does show you the devices for your machine (under Raw Device). What do you mean with "random devices"?

View attachment 60501

Unless you setup device mappings yourself (see https://pve.proxmox.com/pve-docs/pve-admin-guide.html#resource_mapping ) for convenience when using a cluster, just use the "raw" devices (see https://pve.proxmox.com/pve-docs/pve-admin-guide.html#qm_pci_passthrough ).

View attachment 60502

Those are the PCI(e) devices of your system, that may or may not work properly with passthrough.

Is PCI passthrough working? I'm guessing that this is an issue?

It looks like IOMMU is working fine.

[    0.198665] x2apic: IRQ remapping doesn't support X2APIC mode

This is normal.

 

[deanfourie]

Ok thank you. Just shows differently as another system I have setup where they all show in the first drop down, not the second one