[SOLVED] IOMMU not present on updated Proxmox

[ThomasBlock]

Hi,

i want to activate pcie passthrough. did this for several other dell servers.
But on my supermicro server it is not working. do ypu have any ideas?

TASK ERROR: cannot prepare PCI pass-through, IOMMU not present

Supermicro X10DRGH ( a GPU Server board with many pcie links )
BIOS 3.4
Xeon E5-4673 v3 2.4 Ghz
PVE 7.4-16

Intel Virtualisation: Enabled
Intel VT-D: Enabled

Config as recommended ( pve-docs/chapter-qm.html#qm_pci_passthrough )
GRUB_CMDLINE_LINUX_DEFAULT
/etc/modules
/etc/modprobe.d/pve-blacklist.conf

even tried
options vfio_iommu_type1 allow_unsafe_interrupts=1

dmesg | grep -e DMAR -e IOMMU -e AMD-Vi
[ 0.013663] ACPI: DMAR 0x0000000077741348 00017E (v01 ALASKA A M I 00000001 INTL 20091013)
[ 0.013721] ACPI: Reserving DMAR table memory at [mem 0x77741348-0x777414c5]
[ 1.633019] DMAR: Host address width 46
[ 1.633022] DMAR: DRHD base: 0x000000fbffc000 flags: 0x0
[ 1.633030] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de
[ 1.633035] DMAR: DRHD base: 0x000000c7ffc000 flags: 0x1
[ 1.633040] DMAR: dmar1: reg_base_addr c7ffc000 ver 1:0 cap d2078c106f0466 ecap f020de
[ 1.633045] DMAR: RMRR base: 0x0000007bc18000 end: 0x0000007bc27fff
[ 1.633049] DMAR: RMRR base: 0x00000078612000 end: 0x0000007a621fff
[ 1.633052] DMAR: ATSR flags: 0x0
[ 1.633054] DMAR: RHSA base: 0x000000c7ffc000 proximity domain: 0x0
[ 1.633057] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x1
[ 1.633062] DMAR-IR: IOAPIC id 3 under DRHD base 0xfbffc000 IOMMU 0
[ 1.633065] DMAR-IR: IOAPIC id 1 under DRHD base 0xc7ffc000 IOMMU 1
[ 1.633068] DMAR-IR: IOAPIC id 2 under DRHD base 0xc7ffc000 IOMMU 1
[ 1.633071] DMAR-IR: HPET id 0 under DRHD base 0xc7ffc000
[ 1.633074] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[ 1.633908] DMAR-IR: Enabled IRQ remapping in x2apic mode

 

[ThomasBlock]

The Solution:

i have updated an old proxmox server and the boot method switched from grub to systemd i guess?

nano /etc/kernel/cmdline
root=ZFS=rpool/ROOT/pve-1 boot=zfs intel_iommu=on

( The manual only mentions /etc/default/grub )

dmesg | grep -e DMAR -e IOMMU -e AMD-Vi
[ 0.013511] ACPI: DMAR 0x0000000077741348 00017E (v01 ALASKA A M I 00000001 INTL 20091013)
[ 0.013569] ACPI: Reserving DMAR table memory at [mem 0x77741348-0x777414c5]
[ 0.703707] DMAR: IOMMU enabled
[ 1.625428] DMAR: Host address width 46
[ 1.625430] DMAR: DRHD base: 0x000000fbffc000 flags: 0x0
[ 1.625439] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap d2078c106f0466 ecap f020de
[ 1.625444] DMAR: DRHD base: 0x000000c7ffc000 flags: 0x1
[ 1.625449] DMAR: dmar1: reg_base_addr c7ffc000 ver 1:0 cap d2078c106f0466 ecap f020de
[ 1.625453] DMAR: RMRR base: 0x0000007bc18000 end: 0x0000007bc27fff
[ 1.625457] DMAR: RMRR base: 0x00000078612000 end: 0x0000007a621fff
[ 1.625460] DMAR: ATSR flags: 0x0
[ 1.625463] DMAR: RHSA base: 0x000000c7ffc000 proximity domain: 0x0
[ 1.625466] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x1
[ 1.625470] DMAR-IR: IOAPIC id 3 under DRHD base 0xfbffc000 IOMMU 0
[ 1.625473] DMAR-IR: IOAPIC id 1 under DRHD base 0xc7ffc000 IOMMU 1
[ 1.625476] DMAR-IR: IOAPIC id 2 under DRHD base 0xc7ffc000 IOMMU 1
[ 1.625479] DMAR-IR: HPET id 0 under DRHD base 0xc7ffc000
[ 1.625482] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[ 1.626315] DMAR-IR: Enabled IRQ remapping in x2apic mode
[ 2.269763] DMAR: No SATC found
[ 2.269768] DMAR: dmar0: Using Queued invalidation
[ 2.269783] DMAR: dmar1: Using Queued invalidation
[ 2.328910] DMAR: Intel(R) Virtualization Technology for Directed I/O

 

[leesteken]

( The manual only mentions /etc/default/grub )

Not anymore but it still contains other mistakes...