Blow up my proxmox setup

Mr.Wasp

New Member
Feb 3, 2024
6
0
1
Denmark
Hello!
I am not an expert on Proxmox, but I have been sitting with it for a few hours now.
Everything is very smart and can easily create VMs etc. However, I have hit a challenge. I have made a VM with TrueNAS, and followed various guides to get it to run with OMVF, Q35 and put IOMMU commands in the kernel, etc.

It works very well. Right up until I have to bring my HBA controller into it, then it goes completely wrong. I have a 16 channel controller that is in IT mode. The disks can easily be seen in Proxmox, but since I want passthrough to TrueNAS, the entire controller must be transferred to TrueNAS.But as soon as I select the 2x LSI/Broadcom I can find in the list under raw devices, the entire Proxmox system crashes and the console screen that I have sitting on the VGA output on the server, it switches off.
I have tried rescue boot from the ISO and try go debug mode, but its just hang when i get the choice: Type exit og push CTRL + D for startup.

What am I overlooking?

Bonus info: My LSI HBA controller its named 00:44:00 and 00:46:00 - both time the system has crashed, i have choose first time 44 and second time both 44 and 46.
Later today i will install my Proxmox again, and i hope there its a solution for this :)
 
I have followed the link. I think i have found the problem:
Skærmbillede 2024-02-10 115657.png
My SAS controller and my onboard network shares group. But i dont understand how to split my SAS controller from group 32.
 
My SAS controller and my onboard network shares group. But i dont understand how to split my SAS controller from group 32.
The IOMMU groups are determined by the motherboard PCIe layout and chips (and BIOS). Try putting it in another PCIe slot.
It looks like you have a Ryzen motherboard but which one? The X570(S) is perfect for passthrough, all the others have (severe) limitations.
 
But there its only one x8 PCIe port, the other its x16. and my HBA controller its x8. It will not give any problem to put it in x16 port ?
 
I found this block diagram - i can see the problem here. So if i take a x16 port thats lonely, then i have no problem?
Skærmbillede 2024-02-10 121420.png
 
But there its only one x8 PCIe port, the other its x16. and my HBA controller its x8. It will not give any problem to put it in x16 port ?
PCIe is compatible in both directions, You can connect a x16 to a x1 (with a riser or if the slot is open at the end) and the other way around. Sometimes you can even split slots into 2x8 or 4x4 with a BIOS setting. There is more information on Wikipedia.