Proxmox freezes on Pcie passthrough

[Zetto]

Hey everyone,
been running Proxmox in my homelab for a couple of years now and I love it. I recently upgraded my hardware from a 9th gen intel system to an AM5 AMD system and am in the process of migrating over.
I have a Truenas VM running on my server with an HBA passed trough (I know not recommended but it ran beautifully for 2 years). Now in the new server if I remove the HBA from the hardware configuration the VM boots but with the HBA passed through Proxmox freezes, I can't reach the GUI anymore and if I attach a monitor to the server the following appears.

[9863.348433] EXT4-fs (nvme1n1p1): shut down requested (2)

Sometimes it says nvme2n1p1 so the other nvme that is attached.
Does anyone have an idea what is going on here and how to fix it? Been at it all day. Cheers

 

[leesteken]

Sounds like your NVMe devices are also disconnected from the Proxmox host when passing through other devices to the VM. That suggests that the passed through devices are not alone in their IOMMU groups. Did you check the IOMMU groups of your new motherboard: https://pve.proxmox.com/wiki/PCI_Passthrough (verify isolation) ?

 

[Zetto]

You are correct. I figured it out later. I had IOMMU enabled but Proxmox had the PCiE device in the same IOMMU group as other devices. Such a simple fix caused me so much pain yesterday (mainly because I listened to AI and buggered up the kernel).