Can't figure out how to pass through my PCI harddrives

mstriebeck

Member
Jul 4, 2021
7
0
6
57
Hi,

I am still fairly new to Proxmox, so please excuse if this is a trivial question...

I have supermicro server with an X10DRL-i motherboard. I want to pass through my harddrives to use them in TrueNAS.

The server has a very long list of controllers - here are the non-Xeon ones:

00:11.0 Unassigned class [ff00]: Intel Corporation C610/X99 series chipset SPSR (rev 05)
00:11.4 SATA controller: Intel Corporation C610/X99 series chipset sSATA Controller [AHCI mode] (rev 05)
00:14.0 USB controller: Intel Corporation C610/X99 series chipset USB xHCI Host Controller (rev 05)
00:16.0 Communication controller: Intel Corporation C610/X99 series chipset MEI Controller #1 (rev 05)
00:16.1 Communication controller: Intel Corporation C610/X99 series chipset MEI Controller #2 (rev 05)
00:1a.0 USB controller: Intel Corporation C610/X99 series chipset USB Enhanced Host Controller #2 (rev 05)
00:1c.0 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root Port #1 (rev d5)
00:1c.2 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root Port #3 (rev d5)
00:1c.3 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root Port #4 (rev d5)
00:1d.0 USB controller: Intel Corporation C610/X99 series chipset USB Enhanced Host Controller #1 (rev 05)
00:1f.0 ISA bridge: Intel Corporation C610/X99 series chipset LPC Controller (rev 05)
00:1f.2 SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)
00:1f.3 SMBus: Intel Corporation C610/X99 series chipset SMBus Controller (rev 05)
03:00.0 Non-Volatile memory controller: Seagate Technology PLC Device 5016 (rev 01)
05:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 03)
06:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 30)
07:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)
08:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)

First of all, there are two SATA controllers (00:11.4 and 00:1f.2).

When I try to pass through the first SATA controller, nothing happens (I can't see my disks in TrueNAS)
When I try to pass through the second SATA controller, the whole proxmox server hangs when I try to start TrueNAS.
It starts with several "Bubber I/O error on device db-1" messages (and then there are many more)
- this second controller is in an IOMMU group with 2 other controllers (00:1f.0 and 00:1f.3). It tried to separate it by passing pcie_acs_override=downstream,multifunction to grub, but that didn't change anything.

First: are these the right controller to pass through? And if yes, any idea what to do?

Thanks for any help or pointers
Mark
 
Passing through onboard controllers is always gambling. It may work or not. Easiest is to buy a HBA card and put it in a PCIe slot that is directly connected to the CPU and not the mainboards chipset.
 
  • Like
Reactions: bobmc