[SOLVED] GT710 Passthrough

[diminou]

EDIT : Solved following https://www.reddit.com/r/homelab/comments/b5xpua/the_ultimate_beginners_guide_to_gpu_passthrough/


Hi everyone,

I'm "new" to proxmox and to this community, and I'm requesting a bit of help. I've already set-up a few VMs, and I would like a W10 VM using my GT710 for a bit of experience with passthough, and having a little gaming rig available "anywhere".

I followed https://pve.proxmox.com/wiki/Pci_passthrough and https://forum.proxmox.com/threads/gpu-passthrough-tutorial-reference.34303/ but :

- I can't launch my VM when setting the machine type to q35
- It does not seems to work at all ?

So, here is my vm.conf

agent: 1
balloon: 512
bios: ovmf
bootdisk: scsi0
cores: 4
efidisk0: default:vm-110-disk-0,size=1M
ide2: none,media=cdrom
ide3: none,media=cdrom
memory: 4096
name: Tyche
net0: virtio=26:1D:85:C9:39:DB,bridge=vmbr0,firewall=1
numa: 0
ostype: win10
scsi0: local-lvm:vm-110-disk-0,cache=writeback,size=50G
scsihw: virtio-scsi-pci
smbios1: uuid=7fd2eb03-0d9e-47a2-8523-b03c04d4635c
sockets: 1
vmgenid: f41dd919-d232-4b31-b0cf-d284a4017cf3
hostpci0: 08:00

I'm using an ADM Ryzen 7 2700X, which support IOMMU as seen below (but does not seems to support interrupt remapping... )

root@olympus:~# find /sys/kernel/iommu_groups/ -type l
/sys/kernel/iommu_groups/17/devices/0000:0a:00.0
/sys/kernel/iommu_groups/7/devices/0000:00:07.1
/sys/kernel/iommu_groups/15/devices/0000:09:00.2
/sys/kernel/iommu_groups/5/devices/0000:00:04.0
/sys/kernel/iommu_groups/13/devices/0000:08:00.0
/sys/kernel/iommu_groups/13/devices/0000:08:00.1
/sys/kernel/iommu_groups/3/devices/0000:00:03.0
/sys/kernel/iommu_groups/11/devices/0000:00:18.3
/sys/kernel/iommu_groups/11/devices/0000:00:18.1
/sys/kernel/iommu_groups/11/devices/0000:00:18.6
/sys/kernel/iommu_groups/11/devices/0000:00:18.4
/sys/kernel/iommu_groups/11/devices/0000:00:18.2
/sys/kernel/iommu_groups/11/devices/0000:00:18.0
/sys/kernel/iommu_groups/11/devices/0000:00:18.7
/sys/kernel/iommu_groups/11/devices/0000:00:18.5
/sys/kernel/iommu_groups/1/devices/0000:00:01.3
/sys/kernel/iommu_groups/18/devices/0000:0a:00.2
/sys/kernel/iommu_groups/8/devices/0000:00:08.0
/sys/kernel/iommu_groups/16/devices/0000:09:00.3
/sys/kernel/iommu_groups/6/devices/0000:00:07.0
/sys/kernel/iommu_groups/14/devices/0000:09:00.0
/sys/kernel/iommu_groups/4/devices/0000:00:03.1
/sys/kernel/iommu_groups/12/devices/0000:03:00.0
/sys/kernel/iommu_groups/12/devices/0000:02:07.0
/sys/kernel/iommu_groups/12/devices/0000:02:00.0
/sys/kernel/iommu_groups/12/devices/0000:01:00.2
/sys/kernel/iommu_groups/12/devices/0000:01:00.0
/sys/kernel/iommu_groups/12/devices/0000:02:06.0
/sys/kernel/iommu_groups/12/devices/0000:01:00.1
/sys/kernel/iommu_groups/12/devices/0000:02:01.0
/sys/kernel/iommu_groups/12/devices/0000:02:04.0
/sys/kernel/iommu_groups/2/devices/0000:00:02.0
/sys/kernel/iommu_groups/10/devices/0000:00:14.3
/sys/kernel/iommu_groups/10/devices/0000:00:14.0
/sys/kernel/iommu_groups/0/devices/0000:00:01.0
/sys/kernel/iommu_groups/19/devices/0000:0a:00.3
/sys/kernel/iommu_groups/9/devices/0000:00:08.1

And checking out my lspci give this (already blacklisted drivers and forced the use of vfio-pci)

08:00.0 VGA compatible controller: NVIDIA Corporation GK208 [GeForce GT 710B] (rev a1) (prog-if 00 [VGA controller])
        Subsystem: Gigabyte Technology Co., Ltd GK208B [GeForce GT 710]
        Flags: fast devsel, IRQ 64
        Memory at f5000000 (32-bit, non-prefetchable) [size=16M]
        Memory at e8000000 (64-bit, prefetchable) [size=128M]
        Memory at f0000000 (64-bit, prefetchable) [size=32M]
        I/O ports at e000 [size=128]
        Expansion ROM at 000c0000 [disabled] [size=128K]
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Legacy Endpoint, MSI 00
        Capabilities: [100] Virtual Channel
        Capabilities: [128] Power Budgeting <?>
        Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
        Kernel driver in use: vfio-pci
        Kernel modules: nvidiafb, nouveau

08:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)
        Subsystem: Gigabyte Technology Co., Ltd GK208 HDMI/DP Audio Controller
        Flags: fast devsel, IRQ 67
        Memory at f6080000 (32-bit, non-prefetchable) [size=16K]
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Endpoint, MSI 00
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel

Unfortunately, it seems that the card does not support EFI Bios, but I'm unsure about this since there is an error when checking

root@olympus:~/rom-parser# ./rom-parser /tmp/image.rom
Valid ROM signature found @0h, PCIR offset 190h
        PCIR: type 0 (x86 PC-AT), vendor: 10de, device: 128b, class: 030000
        PCIR: revision 0, vendor revision: 1
Error, ran off the end

If anyone have any idea or needs more information... Thank you in advance for any help that you would be able to provide

 

[apoc]

Please check https://pve.proxmox.com/wiki/Pci_passthrough again.

it says "it will not be possible to use PCI passthrough without interrupt remapping."
And a bit further down the line it also says:

Systems which don't support interrupt remapping:

• All systems using an AMD processor and chipset that have AMD I/O Virtualization (AMD-Vi) support. Such hardware has interrupt remapping support; however, the software support is not yet available upstream.

To my understanding that hardware support is not given due to lack of software feature(s).
If you'd ask me I would say: you are out of luck with the chosen hardware. Sorry :/

 

[dcsapak]

Please check https://pve.proxmox.com/wiki/Pci_passthrough again.

it says "it will not be possible to use PCI passthrough without interrupt remapping."
And a bit further down the line it also says:



To my understanding that hardware support is not given due to lack of software feature(s).
If you'd ask me I would say: you are out of luck with the chosen hardware. Sorry :/

that page is outdated, current amd hardware should support interrupt remapping

- I can't launch my VM when setting the machine type to q35

what does that mean? do you get any error messages?

- It does not seems to work at all ?

what does not work? starting?

Unfortunately, it seems that the card does not support EFI Bios, but I'm unsure about this since there is an error when checking

if the card has no efi bios, try starting the vm with the standard seabios instead (remove the ovmf line from the config)

 

[diminou]

Hello!

Sorry for the delay, I was trying to get that working. I also posted in reddit https://www.reddit.com/r/Proxmox/comments/f10j31/gt710_passthrough_error_43/ which another user pointed me to https://www.reddit.com/r/homelab/comments/b5xpua/the_ultimate_beginners_guide_to_gpu_passthrough/

I solved my issue, this is now working correctly!

Thanks

 

[dcsapak]

I solved my issue, this is now working correctly!

do you know which option exactly fixed your problem? might be helpful for others in the future

 

[diminou]

do you know which option exactly fixed your problem? might be helpful for others in the future

Not exactly unfortunately since I had to try out so many things But for sure using sata cd/dvd drives instead of IDE helped me (at some point I was unable to boot up at all because of this...)

I'll keep notifications open, if anyone else ever have trouble with this, do not hesitate to bump the thread and if I can help/answer I definitely will!

 

[romansoft]

Did you manage to passthru sound too? I mean, the device:
08:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)

I haven't tried recently (my setup is ~3y old...) and I don't know if some things may have changed. I remember I was unable to get both devices (video&audio) working and I ended up buying a cheap usb-audio card.

PD: I'm running Hp Gen8 Microserver with cpu: Intel(R) Xeon(R) CPU E3-1265L V2 @ 2.50GHz

 

[diminou]

Did you manage to passthru sound too? I mean, the device:
08:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)

I haven't tried recently (my setup is ~3y old...) and I don't know if some things may have changed. I remember I was unable to get both devices (video&audio) working and I ended up buying a cheap usb-audio card.

PD: I'm running Hp Gen8 Microserver with cpu: Intel(R) Xeon(R) CPU E3-1265L V2 @ 2.50GHz

I don't know as I was mainly using this without sound. The whole point was to be able to play some small games when bored at work
In any case, this setup did not work for long. A few weeks after resolving this post, for some reason (i did absolutely no changes to the VM nor host) the passthrough stopped working. I'm currently back on this project and I'll surely buy a small factor AMD card for this project.

 

[Dunuin]

I also had no sound with the GT710 and Win10 and the the problem were the disabled Message Signaled Interrupts.
The link to the repo in the wiki is dead but I found a copy of such a tool ins some forums.

Edit:
Was this thread. The tool I used was the "MSI utility v3".

 

[Dunuin]

Video and Sound is now good quality and hardware acceleration is working but if watching Youtube after some minutes the audio gets out of sync.
Someone got an idea how to improve this?