[SOLVED] Passthrough PCIe HBA card crash the whole server

[Spaylia]

Hello,

I want to virtualize FreeNAS and so I'd like to passthrough the HBA card directly to the VM, but I when I start the VM, the whole Proxmox crashes and every network interfaces are disconnected (can't SSH anymore, I have to hard reboot or to log in physically to reboot).

I already have a GPU passthrough configured to another VM and I don't have any problem with this one. It doesn't matter if I use the vfio driver or the megaraid-sas driver, the same thing happens in both cases. Though, the VM starts if I don't assign the HBA to it. I haven't found anything relevant in journalctl -e nor dmesg.

Also, I already had the problem with Proxmox 6.1, I thought upgrading to 6.2 would help but it doesn't. Has anyone succeeded in with 2 passthrough at the same time? And/or more specifically an HBD card?

 

[Spaylia]

The problem came from the IOMMU group; the HBA card was in the same group as the ethernet controllers, among other things.
Changing the PCI slot (to a slot in another IOMMU group) solved the problem.

 

[LnxBil]

Thank you for reporting back here after the problem has been solved on reddit.

 

[voodooutt]

This sounds like the same problem I'm having with a network card I'm trying to pass though for pfSense. You think installing the NIC in another PCIe slot will solve it? How to check if that card is in the same IOMMU group? - thanks.

 

[voodooutt]

That was the problem, both were on iommu 2. Physically changed the card to another slot, split them up, working now.

 

[LnxBil]

That was the problem, both were on iommu 2. Physically changed the card to another slot, split them up, working now.

Great that it worked.

How to check if that card is in the same IOMMU group?

Wiki is the place to start.