Is my Setup compatible with GPU Passthrough?

D

DAFY

New Member
Feb 13, 2022
15
0
1
Hi guys. im new to PROXMOX and virtualization and i have an old system i was wondering if i could use to learn the basics.
I was wondering if the system would be able to run PROXMOX and capable of GPU passthrough. i have iommu enabled in the bios.
AMD FX 8350 8 core processor
ASUS M5A99X EVO R2.0
NVIDIA GTX 760
8GB Ram
512GB SSD
Thanks in advance guys...
 
Last edited:
Intel's VT-x is similar to AMD's AMD-V, which is generic virtualization and needed to run VM's at normal speeds.
Intel's VT-d is similar to AMD's AMD-Vi, which is IOMMU virtualization that supports passthrough.

AMD-Vi used to be called IOMMU by AMD. Both the FX8350 and the AMD 990X chipset (from the M5A99X EVO R2.0 manual) support IOMMU. So I think the combination ought to support passthrough, but I have no experience with it so I'm not 100% sure.
 
  • Like
Reactions: DAFY
Maybe reinstall Proxmox and not do multiple guides all at once but take it step by step?
AMD IOMMU is enabled by default if it is turned on in the BIOS. Right after installation, you can have a look at the IOMMU groups to see if passtrhough is supported: for d in /sys/kernel/iommu_groups/*/devices/*; do n=${d#*/iommu_groups/*}; n=${n%%/*}; printf 'IOMMU group %s ' "$n"; lspci -nns "${d##*/}"; done. If everything is in one single group named *, then it is not fully enabled in the BIOS or it is not supported.

EDIT: Or maybe you can tell what is working, what is not working, which guide, what did you change, and such like?
 
Last edited:
root@ME:~# for d in /sys/kernel/iommu_groups/*/devices/*; do n=${d#*/iommu_groups/*}; n=${n%%/*}; printf 'IOMMU group %s ' "$n"; lspci -nns "${d##*/}"; done
IOMMU group 0 00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD/ATI] RD9x0/RX980 Host Bridge [1002:5a14] (rev 02)
IOMMU group 10 00:14.2 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 Azalia (Intel HDA) [1002:4383] (rev 40)
IOMMU group 11 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 LPC host controller [1002:439d] (rev 40)
IOMMU group 12 00:14.4 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI Bridge [1002:4384] (rev 40)
IOMMU group 13 00:14.5 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI2 Controller [1002:4399]
IOMMU group 14 00:16.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
IOMMU group 14 00:16.2 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
IOMMU group 15 01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GK104 [GeForce GTX 760] [10de:1187] (rev a1)
IOMMU group 15 01:00.1 Audio device [0403]: NVIDIA Corporation GK104 HDMI Audio Controller [10de:0e0a] (rev a1)
IOMMU group 16 02:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 09)
IOMMU group 17 03:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller [1b21:1042]
IOMMU group 18 04:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062 Serial ATA Controller [1b21:0612] (rev 01)
IOMMU group 19 05:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller [1b21:1042]
IOMMU group 1 00:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] RD890/RD9x0/RX980 PCI to PCI bridge (PCI Express GFX port 0) [1002:5a16]
IOMMU group 2 00:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] RD890/RD9x0/RX980 PCI to PCI bridge (PCI Express GPP Port 0) [1002:5a18]
IOMMU group 3 00:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] RD890/RD9x0/RX980 PCI to PCI bridge (PCI Express GPP Port 1) [1002:5a19]
IOMMU group 4 00:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] RD890/RD9x0/RX980 PCI to PCI bridge (PCI Express GPP Port 2) [1002:5a1a]
IOMMU group 5 00:07.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] RD890/RD9x0/RX980 PCI to PCI bridge (PCI Express GPP Port 3) [1002:5a1b]
IOMMU group 6 00:11.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] [1002:4391] (rev 40)
IOMMU group 7 00:12.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
IOMMU group 7 00:12.2 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
IOMMU group 8 00:13.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
IOMMU group 8 00:13.2 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
IOMMU group 9 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller [1002:4385] (rev 42

Thanks for the reply, is that ok above?
 
Those groups look excellent! Even better than Ryzen, or did you use pcie_acs_override?
The GTX 760 is in a group of its own, so passthrough is in principle possible. But it looks like it is the only GPU in the system, which can make it more complicated. And you won't have a console anymore to login to the host when something goes wrong, because you give the whole GPU to a VM.
Maybe start with passthrough of one of the USB controllers to a VM, to practice and to be able to use a keyboard and mouse with the VM that gets the GPU? I suggest 00:14.5 from group 13.
 
DAFY said:
I do have another card (GTX 650) which i could use if that makes it any better.
Click to expand...
Yes, if you can make the system use that one for boot and Proxmox console. Check your IOMMU groups again afterwards. Also, the network device name might change when you add PCI(e) devices. You'll need to fix that on the console in /etc/network/interface, if it happens.
 
well i tried adding the second card and the system would not post with the card in either of the other two pci slots. So i guess 2 gpu's is a no no
 
So ive managed to get the motherboard to boot into PROXMOX 7.1 with the second GPU installed but still unable to pass through my GPU. i get stuck on line, /dev/mapper/pve-root: clean, 48752/6291456 files, 1190001/25165824 blocks.
Any Ideas people..?
 
Is it actually stuck or did it just stop displaying boot messages (and is still reachable via the network)?
Does it boot fine when you turn off passthrough (vfio-pci.ids=, blacklisting, etc.).
If you can get it to boot (maybe by removing a GPU), can you find anything in the journalctl about why it got stuck?
 
Sorry, i can still upload ISO's when the line stops at the above message so yes its still reachable via the network and it boots fine before i try and setup the pass through. I've tried setting up the passthrough multiple times and get the same result..
 
Maybe swap the two GPUs and change the configuration in the VMs and /etc/modprobe.d/ etc. accordingly?
As the system is working fine (except for not having a host console and not showing boot messages after that one line), what is the problem or "same result" with the passthrough?
I'm sorry if this should be clear to me from all the posts in this thread, but many things appear to have changed along the way (from one GPU and no IOMMU, to no "boot" and two GPUs).
 
Hi. while going through the Passthrough Guide, when i verify IOMMU is enabled in shell i get a line saying
"[ 0.516142] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40"
is that normal for a AMD system? because the guide says i should see a line saying "DMAR: IOMMU enabled"
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom