[SOLVED] Proxmox IOMMU Passthrough crashes host

Laurenz Rausche

New Member
Apr 21, 2022
10
1
3
I am building a small home server with Proxmox. In my system i have installed:
  • Asus A520m-k
  • Ryzen 5 Pro 5650G
  • 1x SATA Controller (via PCIe)
  • 1x PCIe to M.2 Adapter with an NVME Drive
Now I want to setup a NAS, where I want to virtualize TrueNas Core. I want to passthrough the SATA Controller with 2x 2TB HDDs to the TrueNas instance via IOMMU.

I have enabled IOMMU in the UEFI of my motherboard, I also have setup IOMMU according to the offical Proxmox VE Wiki https://pve.proxmox.com/wiki/Pci_passthrough

With this script i have listed all the IOMMU Groups with their devices:



Code:
IOMMU Group 0 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU Group 1 00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [1022:1633]
IOMMU Group 2 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU Group 3 00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [1022:1634]
IOMMU Group 4 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU Group 4 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
IOMMU Group 4 00:08.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
IOMMU Group 4 08:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cezanne [1002:1638] (rev d9)
IOMMU Group 4 08:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:1637]
IOMMU Group 4 08:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df]
IOMMU Group 4 08:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1 [1022:1639]
IOMMU Group 4 08:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1 [1022:1639]
IOMMU Group 4 08:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller [1022:15e3]
IOMMU Group 4 09:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)
IOMMU Group 5 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 51)
IOMMU Group 5 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 6 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166a]
IOMMU Group 6 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166b]
IOMMU Group 6 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166c]
IOMMU Group 6 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166d]
IOMMU Group 6 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166e]
IOMMU Group 6 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166f]
IOMMU Group 6 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1670]
IOMMU Group 6 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1671]
IOMMU Group 7 01:00.0 Non-Volatile memory controller [0108]: Sandisk Corp WD Blue SN550 NVMe SSD [15b7:5009] (rev 01)
IOMMU Group 8 02:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ec]
IOMMU Group 8 02:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43eb]
IOMMU Group 8 02:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43e9]
IOMMU Group 8 03:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 8 03:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 8 03:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 8 03:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 8 04:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 15)
IOMMU Group 8 06:00.0 SATA controller [0106]: ASMedia Technology Inc. Device [1b21:1064] (rev 02)

The SATA Controller i want to passthrough is the last device from `ASMedia Technology Inc.`

The problem that occurs is, that when i assigned the controller to my VM (currently only running ubuntu) and start it, the Proxmox VE hypervisor kinda crashes, not entirely i can still use the debian shell of Proxmox via keyboard and mouse, but the WEB interface is not active anymore and ssh also don't work. I don't have any clue about IOMMU but what i think happens is that the `Ethernet controller` which is also located in IOMMU group 8 also gets passed trough to the VM and so my Hypervisor is missing it's connection to my Router. (So i would also think that all devices located in group 8 will be passed to the VM).

I don't know if that what I think happens is right, but how would i fix it, so i can only passthrough the SATA Controller with my HDDs.

P.S. If there is any additional log needed notify me, I would like to provide it :D
 
Last edited:
You cannot share devices from the same IOMMU group between VMs and/or the Proxmox host. As soon as you start the VM with passthrough of 06:00.0, the Proxmox host also loses the Ethernet controller, the other SATA controller and a USB controller. It will therefore no longer be reachable via the web GUI or SSH and it won't be able to log anything (including graphs). It appears frozen from the outside and is slowly grinding to a halt.
Only the PCIe x16 slot and the M.2 slot are in separate IOMMU groups because they are connected to the CPU (as are some "onboard" devices), everyhting else is in a big "chipset" group. This is common for all Ryzen boards except X570 (most ATX boards have two x8 slots),

EDIT: You cannot fix this on your hardware, but search for pcie_acs_override on this forum for a work-around that comes with a security risk. Also, the ASMedia SATA controller might not reset properly and therefore not work in a VM. Personally, I suggest using ZFS on the Proxmox host an use a unprivileged container to serve a pool to the local network instead of a virtual NAS. Note that ballooning and KSM won't work when using passthrough (because of DMA) and the VM need a lot of memory for ZFS.

EDIT2: Sorry for the short and dense answer but I've been replying to questions about this same situation a lot lately.
 
Last edited:
  • Like
Reactions: Laurenz Rausche
You cannot share devices from the same IOMMU group between VMs and/or the Proxmox host. As soon as you start the VM with passthrough of 06:00.0, the Proxmox host also loses the Ethernet controller, the other SATA controller and a USB controller. It will therefore no longer be reachable via the web GUI or SSH and it won't be able to log anything (including graphs). It appears frozen from the outside and is slowly grinding to a halt.
Only the PCIe x16 slot and the M.2 slot are in separate IOMMU groups because they are connected to the CPU (as are some "onboard" devices), everyhting else is in a big "chipset" group. This is common for all Ryzen boards except X570 (most ATX boards have two x8 slots),

EDIT: You cannot fix this on your hardware, but search for pcie_acs_override on this forum for a work-around that comes with a security risk. Also, the ASMedia SATA controller might not reset properly and therefore not work in a VM. Personally, I suggest using ZFS on the Proxmox host an use a unprivileged container to serve a pool to the local network instead of a virtual NAS. Note that ballooning and KSM won't work when using passthrough (because of DMA) and the VM need a lot of memory for ZFS.

EDIT2: Sorry for the short and dense answer but I've been replying to questions about this same situation a lot lately.
Hey :D

No Problem at all. I think i will research a bit more. I've tested the ACS Patch and this does not seperate the controller into an own group. I couldn't find ACS in my UEFI so i think i have 2 options:

1. I disconnect my NVME and use this 16x slot for my 1x Sata controller
2. I will connect each drive individually to my VM

I will also contact ASUS if maybe i just overlooked ACS
 
I've tested the ACS Patch and this does not seperate the controller into an own group.
That's weird. Adding pcie_acs_override=downstream,multifunction to the Proxmox kernel parameters should "break all groups". If it has no effect, then it is probably not active. What does cat /proc/cmdline show?

Putting the SATA controller into the x16 slow should work fine. No need to disconnect a NVMe in the M.2 slot. I might have not explained myself very well: both the x16 slot and the M.2 slot are typically in their own separate IOMMU group (and they are not combined).
 
  • Like
Reactions: Laurenz Rausche
That's weird. Adding pcie_acs_override=downstream,multifunction to the Proxmox kernel parameters should "break all groups". If it has no effect, then it is probably not active. What does cat /proc/cmdline show?

Putting the SATA controller into the x16 slow should work fine. No need to disconnect a NVMe in the M.2 slot. I might have not explained myself very well: both the x16 slot and the M.2 slot are typically in their own separate IOMMU group (and they are not combined).
No, the m.2 is attached via an adapter in the 16x slot :D This is similar to the one I use.
 
The groups with the Patch:

Code:
IOMMU Group 0 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU Group 1 00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [1022:1633]
IOMMU Group 2 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU Group 3 00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [1022:1634]
IOMMU Group 4 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU Group 5 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
IOMMU Group 6 00:08.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
IOMMU Group 7 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 51)
IOMMU Group 7 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 8 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166a]
IOMMU Group 8 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166b]
IOMMU Group 8 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166c]
IOMMU Group 8 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166d]
IOMMU Group 8 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166e]
IOMMU Group 8 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166f]
IOMMU Group 8 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1670]
IOMMU Group 8 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1671]
IOMMU Group 9 01:00.0 Non-Volatile memory controller [0108]: Sandisk Corp WD Blue SN550 NVMe SSD [15b7:5009] (rev 01)
IOMMU Group 10 02:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ec]
IOMMU Group 10 02:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43eb]
IOMMU Group 10 02:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43e9]
IOMMU Group 10 03:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 10 03:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 10 03:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 10 03:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 10 04:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 15)
IOMMU Group 10 06:00.0 SATA controller [0106]: ASMedia Technology Inc. Device [1b21:1064] (rev 02)
IOMMU Group 11 08:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cezanne [1002:1638] (rev d9)
IOMMU Group 11 08:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:1637]
IOMMU Group 11 08:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df]
IOMMU Group 11 08:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1 [1022:1639]
IOMMU Group 11 08:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1 [1022:1639]
IOMMU Group 11 08:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller [1022:15e3]
IOMMU Group 12 09:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)

/proc/cmdline
Code:
BOOT_IMAGE=/boot/vmlinuz-5.13.19-6-pve root=/dev/mapper/pve-root ro quiet amd_iommu=on pcie_acs_override=downstream
 
To clearify a bit more, I use 2 m.2 drives

1x No Name Sata m.2 in the mainboard slot (128gb, proxmox install)
1x Sandisk Corp WD Blue SN550 NVMe SSD via pcie adapter in 16x slot (500gb, for vm boot storage)
 
Switch
To clearify a bit more, I use 2 m.2 drives

1x No Name Sata m.2 in the mainboard slot (128gb, proxmox install)
1x Sandisk Corp WD Blue SN550 NVMe SSD via pcie adapter in 16x slot (500gb, for vm boot storage)
Switch them around and put the riser into a x1 PCIe slot, then the larger drive has the most bandwidth (x4 PCIe). Or does the riser not support SATA? Yeah, it probably just passes through the PCIe lanes. Maybe get a SATA converter for the 128GB one?
/proc/cmdline
Code:
BOOT_IMAGE=/boot/vmlinuz-5.13.19-6-pve root=/dev/mapper/pve-root ro quiet amd_iommu=on pcie_acs_override=downstream
Maybe you need pcie_acs_override=downstream,multifunction. And you do not need amd_iommu=on because it is on by default (and on is actually not a valid value).
The groups with the Patch:

Code:
IOMMU Group 10 02:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ec]
IOMMU Group 10 02:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43eb]
IOMMU Group 10 02:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43e9]
IOMMU Group 10 03:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 10 03:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 10 03:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 10 03:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 10 04:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 15)
IOMMU Group 10 06:00.0 SATA controller [0106]: ASMedia Technology Inc. Device [1b21:1064] (rev 02)
IOMMU Group 12 09:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)
Wait a minute! Are you sure you don't want to passthrough 09:00.0, which is now in its own IOMMU group?
 
  • Like
Reactions: Laurenz Rausche
Switch

Switch them around and put the riser into a x1 PCIe slot, then the larger drive has the most bandwidth (x4 PCIe). Or does the riser not support SATA? Yeah, it probably just passes through the PCIe lanes. Maybe get a SATA converter for the 128GB one?

Maybe you need pcie_acs_override=downstream,multifunction. And you do not need amd_iommu=on because it is on by default (and on is actually not a valid value).

Wait a minute! Are you sure you don't want to passthrough 09:00.0, which is now in its own IOMMU group?

1. Yeah it's just connecting the lanes so the SATA ssd wouldn't work
2. I will try your implementation :D
3. Yeah im sure, i've tested it by doing lspcie > 1.txt with the sata card and lspcie > 2.txt without and compared 1.txt and 2.txt with the diff command, their only diffrence is the asm one

Thanks a lot for your help!
 
  • Like
Reactions: leesteken
First, you are a genius :D The multifunction implementation works:


Code:
IOMMU Group 0 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU Group 1 00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [1022:1633]
IOMMU Group 2 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU Group 3 00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [1022:1634]
IOMMU Group 4 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge [1022:1632]
IOMMU Group 5 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
IOMMU Group 6 00:08.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [1022:1635]
IOMMU Group 7 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 51)
IOMMU Group 7 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 8 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166a]
IOMMU Group 8 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166b]
IOMMU Group 8 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166c]
IOMMU Group 8 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166d]
IOMMU Group 8 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166e]
IOMMU Group 8 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:166f]
IOMMU Group 8 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1670]
IOMMU Group 8 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1671]
IOMMU Group 9 01:00.0 Non-Volatile memory controller [0108]: Sandisk Corp WD Blue SN550 NVMe SSD [15b7:5009] (rev 01)
IOMMU Group 10 02:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ec]
IOMMU Group 11 02:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43eb]
IOMMU Group 12 02:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43e9]
IOMMU Group 13 03:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 14 03:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 15 03:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 16 03:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ea]
IOMMU Group 17 04:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 15)
IOMMU Group 18 06:00.0 SATA controller [0106]: ASMedia Technology Inc. Device [1b21:1064] (rev 02)
IOMMU Group 19 08:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Cezanne [1002:1638] (rev d9)
IOMMU Group 20 08:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:1637]
IOMMU Group 21 08:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor [1022:15df]
IOMMU Group 22 08:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1 [1022:1639]
IOMMU Group 23 08:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1 [1022:1639]
IOMMU Group 24 08:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller [1022:15e3]
IOMMU Group 25 09:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 81)

Second: Theoretically i could pass my mainboard sata controller to the vm and use the pcie card for my other storage, but i don't think i will because the 1. one works :D

Thanks so much :D
 
I'm not a fan of pcie_acs_override because it allows the VM show read all memory from the host because they share PCIe devices from the same group. Is there a bigger security risk than that?
Anyway, glad to be of help and best wishes with trying out various combinations of passthrough and work-arounds. Be sure to check if the SATA controller works after stopping and restarting the VM (not rebooting from within the VM).
 
  • Like
Reactions: Laurenz Rausche
For my current Homelab the security risk is not that problematic because i will only run 3 VMs with my own services so that does not really matter. I will install Ubuntu server right now and try the stopping you mentioned :D
 
1650575665571.png

After stopping it from Proxmox UI and starting it again both of my 2TB drives show up. Thanks so much, I would never have figured that out. Really glad that you helped :D
 
Hey,

it's been over one year and I just wanted to thank you again. That's the 20th or so time that i came back to this exact post for the exact issue. Thank you so much!
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!