Proxmox VE SATA Passthrough not working

[TinyTuna]

Hey, so I've been trying to use the onboard SATA passthrough on my AOOSTAR WTR PRO Ryzen 7 5825u CPU to no avail. Either I just get a connection error when I start my TrueNAS VM with the PCIE device added and I have to fully restart the server OR most of the time I can actually get into TrueNAS but the HDD's aren't there, and they disappear in Proxmox disks as well. I tried shutting down the TrueNAS VM and restarting but I get this error.

error writing '1' to '/sys/bus/pci/devices/0000:05:00.0/reset': Inappropriate ioctl for device
failed to reset PCI device '0000:05:00.0', but trying to continue as not all devices need a reset
error writing '1' to '/sys/bus/pci/devices/0000:05:00.1/reset': Inappropriate ioctl for device
failed to reset PCI device '0000:05:00.1', but trying to continue as not all devices need a reset
kvm: -device vfio-pci,host=0000:05:00.0,id=hostpci1.0,bus=ich9-pcie-port-2,addr=0x0.0,multifunction=on: vfio 0000:05:00.0: Failed to set up TRIGGER eventfd signaling for interrupt INTX-0: VFIO_DEVICE_SET_IRQS failure: No such device
TASK ERROR: start failed: QEMU exited with code 1

Here are my IOMMU groups as well:

IOMMU group 0 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU group 10 01:00.0 Non-Volatile memory controller [0108]: Kingston Technology Company, Inc. NV3 NVMe SSD SM2268XT2 (DRAM-less) [2646:5028] (rev 03)
IOMMU group 11 02:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I226-V [8086:125c] (rev 04)
IOMMU group 12 03:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I226-V [8086:125c] (rev 04)
IOMMU group 13 04:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Barcelo [1002:15e7] (rev c1)
IOMMU group 14 04:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Renoir Radeon High Definition Audio Controller [1002:1637]
IOMMU group 15 04:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df]
IOMMU group 16 04:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639]
IOMMU group 17 04:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1 [1022:1639]
IOMMU group 18 04:00.5 Multimedia controller [0480]: Advanced Micro Devices, Inc. [AMD] ACP/ACP3X/ACP6x Audio Coprocessor [1022:15e2] (rev 01)
IOMMU group 19 04:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller [1022:15e3]
IOMMU group 1 00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [1022:1633]
IOMMU group 20 04:00.7 Signal processing controller [1180]: Advanced Micro Devices, Inc. [AMD] Sensor Fusion Hub [1022:15e4]
IOMMU group 21 05:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function [1022:145a] (rev 81)
IOMMU group 22 05:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7904] (rev 81)
IOMMU group 2 00:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
IOMMU group 3 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU group 4 00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge [1022:1634]
IOMMU group 5 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU group 6 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
IOMMU group 7 00:08.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
IOMMU group 8 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 51)
IOMMU group 8 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU group 9 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 0 [1022:166a]
IOMMU group 9 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 1 [1022:166b]
IOMMU group 9 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 2 [1022:166c]
IOMMU group 9 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 3 [1022:166d]
IOMMU group 9 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 4 [1022:166e]
IOMMU group 9 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 5 [1022:166f]
IOMMU group 9 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 6 [1022:1670]
IOMMU group 9 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 7 [1022:1671]

I've tried this in Proxmox VE 9 and 8.4 and neither work

 

[leesteken]

If you want to passthrough 05:00.1 then don't also passthrough 05:00.0. Maybe you enabled All Functions? That passes through every function of device 05:00, which is 05:00.0 and 05:00.1. Don't do that and maybe the passthrouhg of just 05:00.1 will work.

Your groups look way to good (many groups with few devices) for your platform. Are you using pcie_acs_override which breaks PCI(e) device isolation and to break up the IOMMU groups?
Passthrough always is trial and error and hit or miss and pcie_acs_override cannot fix problems only let's you ignore it as your own peril. Sometimes it just does not work. Sometimes you'll find work-arounds from people with the exact same hardware (which I do not have).

Please show the VM configuration (qm config VM_ID_NUMBER and cat /proc/cmdline) after doing the first change, if you still have issues.

 

[TinyTuna]

If you want to passthrough 05:00.1 then don't also passthrough 05:00.0. Maybe you enabled All Functions? That passes through every function of device 05:00, which is 05:00.0 and 05:00.1. Don't do that and maybe the passthrouhg of just 05:00.1 will work.

Your groups look way to good (many groups with few devices) for your platform. Are you using pcie_acs_override which breaks PCI(e) device isolation and to break up the IOMMU groups?
Passthrough always is trial and error and hit or miss and pcie_acs_override cannot fix problems only let's you ignore it as your own peril. Sometimes it just does not work. Sometimes you'll find work-arounds from people with the exact same hardware (which I do not have).

Please show the VM configuration (qm config VM_ID_NUMBER and cat /proc/cmdline) after doing the first change, if you still have issues.

Oh my god, thank you SO MUCH. I had to disable All Functions, didn't know that it would use the entire group. It's because the AOOSTAR WTR PRO has problems with using both SATA controllers at the same time (one is used for CPU monitoring) and it just stops working, but I thought that they divided it in the new BIOS update and had the 2nd SATA controller with the temp reads at:
"IOMMU group 20 04:00.7 Signal processing controller [1180]: Advanced Micro Devices, Inc. [AMD] Sensor Fusion Hub [1022:15e4]"
But I guess not.

Once again thanks for the quick reply that actually fixed the issue!

 

[esvee]

Oh my god, thank you SO MUCH. I had to disable All Functions, didn't know that it would use the entire group. It's because the AOOSTAR WTR PRO has problems with using both SATA controllers at the same time (one is used for CPU monitoring) and it just stops working, but I thought that they divided it in the new BIOS update and had the 2nd SATA controller with the temp reads at:
"IOMMU group 20 04:00.7 Signal processing controller [1180]: Advanced Micro Devices, Inc. [AMD] Sensor Fusion Hub [1022:15e4]"
But I guess not.

Once again thanks for the quick reply that actually fixed the issue!

Hey there,
I have received the same system but im wary to unbox it in case I have an issue here.

Can you please confirm you managed to get all 4 sata drives to work in truenas AND cpu is still able to boost above 2ghz? Because I see many people a year ago having this issue and none found a solution.

 

[TinyTuna]

Hey there,
I have received the same system but im wary to unbox it in case I have an issue here.

Can you please confirm you managed to get all 4 sata drives to work in truenas AND cpu is still able to boost above 2ghz? Because I see many people a year ago having this issue and none found a solution.

Hey! Unfortunately I can't test all 4 drives, I've only got 2, but it's turboing and working with them. While I'm not ENTIRELY certain but I believe that there are only two onboard SATA passthroughs - 1 for all of the drives, and the second is for the CPU sensors and etc.