Enabling IOMMU for LSI 9211-8i passhtrough

virtualfund

New Member
Mar 19, 2024
25
2
3
Just built a new box that I want to use to pass through my HBA card to a TrueNAS VM (LSI 9211-8i). Having a heck of a time trying to get IOMMU activated.
Running an i5-12400 with a ASRock B660M Pro RS Intel B660 motherboard. VT-D is enabled.

Followed the guide here https://pve.proxmox.com/wiki/PCI_Passthrough, but when I run
Code:
dmesg | grep -e DMAR -e IOMMU

I get the following:
[ 0.010039] ACPI: DMAR 0x00000000653A6000 000088 (v01 INTEL EDK2 00000002 01000013)
[ 0.010091] ACPI: Reserving DMAR table memory at [mem 0x653a6000-0x653a6087]
[ 0.203211] DMAR: Host address width 39
[ 0.203213] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[ 0.203219] DMAR: dmar0: reg_base_addr fed90000 ver 4:0 cap 1c0000c40660462 ecap 29a00f0505e
[ 0.203223] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[ 0.203229] DMAR: dmar1: reg_base_addr fed91000 ver 5:0 cap d2008c40660462 ecap f050da
[ 0.203233] DMAR: RMRR base: 0x0000006c000000 end: 0x000000707fffff
[ 0.203238] DMAR-IR: IOAPIC id 2 under DRHD base 0xfed91000 IOMMU 1
[ 0.203240] DMAR-IR: HPET id 0 under DRHD base 0xfed91000
[ 0.203243] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[ 0.204172] DMAR-IR: Enabled IRQ remapping in x2apic mode
[ 0.464485] pci 0000:00:02.0: DMAR: Skip IOMMU disabling for graphics

Trying to add a PCI device to the VM shows:
No IOMMU detected, please activate it.See Documentation for further information.

My grub looks like where I added "pcie_acs_override=downstream" as well :

GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction initcall_blacklist=sysfb_init video=simplefb:eek:ff video=vesafb:eek:ff video=efifb:eek:ff video=vesa:eek:ff disable_vga=1 vfio_iommu_type1.allow_unsafe_interrupts=1 kvm.ignore_msrs=1 pcie_acs_override=downstream modprobe.blacklist=radeon,nouveau,nvidia,nvidiafb,nvidia-gpu,snd_hda_intel,snd_hda_codec_hdmi,i915"


I was able to get this working on another proxmox node (running AMD) with no issues. Not sure why I'm having so many issues here.
 
Took some time, but was able to get it to work. Updated BIOS, enabled SR-IOV, also udpated my grub to just show the below.
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt"
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!