Weird issue with NVMe and PCI Passthrough of LSI Controller

[ianmock2]

Hello, I recently purchased an Epyc 7302 and Supermicro H11SSL-i board to go with it. I got everything up and running except the LSI controller. For reference, I have a 2TB NVMe connected directly to the motherboard via its x4 slot. I also have 8 drives connected in cages via a PCI-E LSI controller in IT mode. Proxmox is able to see the LSI controller in the PCI passthrough options. When I attempt to passthrough the LSI card to a VM, Proxmox takes the NVMe drive offline as if the NVMe is connected to it, however it is not. It's directly connected through PCI-E on the motherboard. I'm a bit at a loss why this would be happening, and I was able to passthrough this specific card on my old Intel based board with no issues before using the same version of Proxmox.

What am I doing wrong?

 

[leesteken]

Did you check the IOMMU groups? Maybe the NVMe devices is in the same groups as the LSI controller. https://pve.proxmox.com/wiki/PCI_Passthrough#Verify_IOMMU_isolation

 

[ianmock2]

Did you check the IOMMU groups? Maybe the NVMe devices is in the same groups as the LSI controller. https://pve.proxmox.com/wiki/PCI_Passthrough#Verify_IOMMU_isolation

Yep, looks like you're right:

 0x010700 │ 0x0072 │ 0000:85:00.0 │         15 │ 0x1000 │ SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]           │      │ 0x3020           │ 9211-8i
├──────────┼────────┼──────────────┼────────────┼────────┼─────────────────────────────────────────────────────────┼──────┼──────────────────┼──────────────────
│ 0x010802 │ 0x8201 │ 0000:84:00.0 │         15 │ 0x1cc1 │ XPG SX8200 Pro PCIe Gen3x4 M.2 2280 Solid State Drive   │      │ 0x8201           │

With some Google-fu, I came across this article:
https://enterprise-support.nvidia.c...s-BIOS-Settings-for-vGPUs-that-Support-SR-IOV

Which linked me to this Supermicro article:
https://www.supermicro.com/support/faqs/faq.cfm?faq=31883

And this resolved the issue. I learned something new today! Thanks again!