Nvidia Passthrough general Nvidia problems

Y

yamaharacer

Member
Jul 23, 2023
31
0
6
Hello,

I want to passthrough an Nvidia GTX 750TI to a Windows XP VM but it seems that there are serveral problems that I cant solve alone. So I want to ask here If somebody could help me.
My Hardware is:
I7 3770
32GB DDR3 1333MHz
Slot 1 AMD RX 570
Slot 2 GTX 750 TI
Slot 3 empty
Asus P8Z77-V (Bios setting IGPU first, CSM activated, Intel virtualization activated, Memory Remap Feature (VT-d) activated)
Samsung Q860 1TB SSD

First I started a thread in the German forum section. But there we started to setup passthrough from zero thanks to leestaken. The problem is general NVIDIA not only specific 750TI. Also with an GTX 1660 super and a GTX 550 ti.

/etc/default/grub
Code: 
GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=multifunction initcall_blacklist=sysfb_init"
GRUB_CMDLINE_LINUX=""

originaly IOMMU groups were:
Code: 
IOMMU group 0 00:02.0 VGA compatible controller [0300]: Intel Corporation IvyBridge GT2 [HD Graphics 4000] [8086:0162] (rev 09)
IOMMU group 10 00:1c.4 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev c4)
IOMMU group 10 05:00.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1083/1085 PCIe to PCI Bridge [1b21:1080] (rev 03)
IOMMU group 11 00:1c.7 PCI bridge [0604]: Intel Corporation 7 Series/C210 Series Chipset Family PCI Express Root Port 8 [8086:1e1e] (rev c4)
IOMMU group 12 00:1d.0 USB controller [0c03]: Intel Corporation 7 Series/C216 Chipset Family USB Enhanced Host Controller #1 [8086:1e26] (rev 04)
IOMMU group 13 00:1f.0 ISA bridge [0601]: Intel Corporation Z77 Express Chipset LPC Controller [8086:1e44] (rev 04)
IOMMU group 13 00:1f.2 SATA controller [0106]: Intel Corporation 7 Series/C210 Series Chipset Family 6-port SATA Controller [AHCI mode] [8086:1e02] (rev 04)
IOMMU group 13 00:1f.3 SMBus [0c05]: Intel Corporation 7 Series/C216 Chipset Family SMBus Controller [8086:1e22] (rev 04)
IOMMU group 14 04:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062 Serial ATA Controller [1b21:0612] (rev 01)
IOMMU group 15 07:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller [1b21:1042]
IOMMU group 1 00:00.0 Host bridge [0600]: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor DRAM Controller [8086:0150] (rev 09)
IOMMU group 2 00:01.0 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port [8086:0151] (rev 09)
IOMMU group 2 00:01.1 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port [8086:0155] (rev 09)
IOMMU group 2 01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon RX 470/480/570/570X/580/580X/590] [1002:67df] (rev ef)
IOMMU group 2 01:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590] [1002:aaf0]
IOMMU group 2 02:00.0 VGA compatible controller [0300]: NVIDIA Corporation GM107 [GeForce GTX 750 Ti] [10de:1380] (rev a2)
IOMMU group 2 02:00.1 Audio device [0403]: NVIDIA Corporation GM107 High Definition Audio Controller [GeForce 940MX] [10de:0fbc] (rev a1)
IOMMU group 3 00:14.0 USB controller [0c03]: Intel Corporation 7 Series/C210 Series Chipset Family USB xHCI Host Controller [8086:1e31] (rev 04)
IOMMU group 4 00:16.0 Communication controller [0780]: Intel Corporation 7 Series/C216 Chipset Family MEI Controller #1 [8086:1e3a] (rev 04)
IOMMU group 5 00:19.0 Ethernet controller [0200]: Intel Corporation 82579V Gigabit Network Connection [8086:1503] (rev 04)
IOMMU group 6 00:1a.0 USB controller [0c03]: Intel Corporation 7 Series/C216 Chipset Family USB Enhanced Host Controller #2 [8086:1e2d] (rev 04)
IOMMU group 7 00:1b.0 Audio device [0403]: Intel Corporation 7 Series/C216 Chipset Family High Definition Audio Controller [8086:1e20] (rev 04)
IOMMU group 8 00:1c.0 PCI bridge [0604]: Intel Corporation 7 Series/C216 Chipset Family PCI Express Root Port 1 [8086:1e10] (rev c4)
IOMMU group 9 00:1c.3 PCI bridge [0604]: Intel Corporation 7 Series/C216 Chipset Family PCI Express Root Port 4 [8086:1e16] (rev c4)

so I used pcie_acs_override=multifunction in /etc/default/grub

now with a GTX1660 in slot 1 please ignore that GPU I only changed the RX570 for testing if the problem is NVIDIA general or only GTX750TI:
Code: 
root@proxmox:~# for d in /sys/kernel/iommu_groups/*/devices/*; do n=${d#*/iommu_groups/*}; n=${n%%/*}; printf 'IOMMU group %s ' "$n"; lspci -nns "${d##*/}"; done
IOMMU group 0 00:02.0 VGA compatible controller [0300]: Intel Corporation IvyBridge GT2 [HD Graphics 4000] [8086:0162] (rev 09)
IOMMU group 10 00:1c.7 PCI bridge [0604]: Intel Corporation 7 Series/C210 Series Chipset Family PCI Express Root Port 8 [8086:1e1e] (rev c4)
IOMMU group 11 00:1d.0 USB controller [0c03]: Intel Corporation 7 Series/C216 Chipset Family USB Enhanced Host Controller #1 [8086:1e26] (rev 04)
IOMMU group 12 00:1f.0 ISA bridge [0601]: Intel Corporation Z77 Express Chipset LPC Controller [8086:1e44] (rev 04)
IOMMU group 12 00:1f.2 SATA controller [0106]: Intel Corporation 7 Series/C210 Series Chipset Family 6-port SATA Controller [AHCI mode] [8086:1e02] (rev 04)
IOMMU group 12 00:1f.3 SMBus [0c05]: Intel Corporation 7 Series/C216 Chipset Family SMBus Controller [8086:1e22] (rev 04)
IOMMU group 13 06:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller [1b21:1042]
IOMMU group 1 00:00.0 Host bridge [0600]: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor DRAM Controller [8086:0150] (rev 09)
IOMMU group 2 00:01.0 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port [8086:0151] (rev 09)
IOMMU group 2 00:01.1 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port [8086:0155] (rev 09)
IOMMU group 2 01:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU116 [GeForce GTX 1660 SUPER] [10de:21c4] (rev a1)
IOMMU group 2 01:00.1 Audio device [0403]: NVIDIA Corporation TU116 High Definition Audio Controller [10de:1aeb] (rev a1)
IOMMU group 2 01:00.2 USB controller [0c03]: NVIDIA Corporation TU116 USB 3.1 Host Controller [10de:1aec] (rev a1)
IOMMU group 2 01:00.3 Serial bus controller [0c80]: NVIDIA Corporation TU116 USB Type-C UCSI Controller [10de:1aed] (rev a1)
IOMMU group 2 02:00.0 VGA compatible controller [0300]: NVIDIA Corporation GM107 [GeForce GTX 750 Ti] [10de:1380] (rev a2)
IOMMU group 2 02:00.1 Audio device [0403]: NVIDIA Corporation GM107 High Definition Audio Controller [GeForce 940MX] [10de:0fbc] (rev a1)
IOMMU group 3 00:14.0 USB controller [0c03]: Intel Corporation 7 Series/C210 Series Chipset Family USB xHCI Host Controller [8086:1e31] (rev 04)
IOMMU group 4 00:16.0 Communication controller [0780]: Intel Corporation 7 Series/C216 Chipset Family MEI Controller #1 [8086:1e3a] (rev 04)
IOMMU group 5 00:19.0 Ethernet controller [0200]: Intel Corporation 82579V Gigabit Network Connection [8086:1503] (rev 04)
IOMMU group 6 00:1a.0 USB controller [0c03]: Intel Corporation 7 Series/C216 Chipset Family USB Enhanced Host Controller #2 [8086:1e2d] (rev 04)
IOMMU group 7 00:1b.0 Audio device [0403]: Intel Corporation 7 Series/C216 Chipset Family High Definition Audio Controller [8086:1e20] (rev 04)
IOMMU group 8 00:1c.0 PCI bridge [0604]: Intel Corporation 7 Series/C216 Chipset Family PCI Express Root Port 1 [8086:1e10] (rev c4)
IOMMU group 9 00:1c.4 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev c4)
IOMMU group 9 04:00.0 PCI bridge [0604]: ASMedia Technology Inc. ASM1083/1085 PCIe to PCI Bridge [1b21:1080] (rev 03)

vfio.conf:
Code: 
options vfio-pci ids=10de:1380,10de:0fbc disable_vga=1
softdep nouveau pre: vfio-pci
softdep snd_hda_intel pre: vfio-pci


I have tryed following VM settings:

1. pc-i440fx-6.2
Code: 
boot: order=ide0;ide2;net0
cores: 2
cpu: host
ide0: local-lvm:vm-102-disk-0,size=32G
ide2: none,media=cdrom
machine: pc-i440fx-6.2
memory: 4096
meta: creation-qemu=8.0.2,ctime=1691907778
name: Windows-XP
net0: rtl8139=C2:3B:EE:C1:10:2E,bridge=vmbr0,firewall=1
numa: 0
ostype: wxp
smbios1: uuid=10a7fc70-6e99-494e-a05a-fc4dc121cb34
sockets: 1
vmgenid: a9ac4d42-1a36-4e20-8cc7-7ac699b04e75
2 Q35.
Code: 
boot: order=ide0;ide2;net0
cores: 2
cpu: host
ide0: local-lvm:vm-102-disk-0,size=32G
ide2: none,media=cdrom
machine: pc-q35-6.2
memory: 4096
meta: creation-qemu=8.0.2,ctime=1691907778
name: Windows-XP
net0: rtl8139=C2:3B:EE:C1:10:2E,bridge=vmbr0,firewall=1
numa: 0
ostype: wxp
smbios1: uuid=10a7fc70-6e99-494e-a05a-fc4dc121cb34
sockets: 1
vmgenid: a9ac4d42-1a36-4e20-8cc7-7ac699b04e75

After installation I made this:

1. pc-i440fx-6.2
Code: 
boot: order=ide0;ide2;net0
cores: 2
cpu: host
hostpci0: 0000:00:14
hostpci1: 0000:02:00
ide0: local-lvm:vm-102-disk-0,size=32G
ide2: none,media=cdrom
machine: pc-i440fx-6.2
memory: 4096
meta: creation-qemu=8.0.2,ctime=1691907778
name: Windows-XP
net0: rtl8139=C2:3B:EE:C1:10:2E,bridge=vmbr0,firewall=1
numa: 0
ostype: wxp
smbios1: uuid=10a7fc70-6e99-494e-a05a-fc4dc121cb34
sockets: 1
vga: none
vmgenid: a9ac4d42-1a36-4e20-8cc7-7ac699b04e75

2. Q35
Code: 
boot: order=ide0;ide2;net0
cores: 2
cpu: host
hostpci0: 0000:00:14
hostpci1: 0000:02:00,pcie=1
ide0: local-lvm:vm-102-disk-0,size=32G
ide2: none,media=cdrom
machine: pc-q35-6.2
memory: 4096
meta: creation-qemu=8.0.2,ctime=1691907778
name: Windows-XP
net0: rtl8139=C2:3B:EE:C1:10:2E,bridge=vmbr0,firewall=1
numa: 0
ostype: wxp
smbios1: uuid=10a7fc70-6e99-494e-a05a-fc4dc121cb34
sockets: 1
vga: none
vmgenid: a9ac4d42-1a36-4e20-8cc7-7ac699b04e75


It doesnt matter if I use Q35 or pc-i440fx I dont get any screen out. When I use standard vga and look into the console for remote access, device manager shows Code 10 "This device cannot start" But as I read this could be because of using the standard vga option of proxmox.


Also it doesnt matter if I select primary GPU. With primary GPU I get following:
Code: 
kvm: -device vfio-pci,host=0000:02:00.0,id=hostpci1.0,bus=ich9-pcie-port-2,addr=0x0.0,x-vga=on,multifunction=on: vfio 0000:02:00.0: failed getting region info for VGA region index 8: Invalid argument
device does not support requested feature x-vga
TASK ERROR: start failed: QEMU exited with code 1

I have also tryed to use my read out bios rom from GPU-Z:
for example:
hostpci1: 0000:02:00,romfile=GTX750TI-GM107.rom,pcie=1

Maybe someone has solved such problems in the past and could help me. Thank you
 
Last edited:
I have tryed the GTX in another PC with same settings (q35 OVMF) besides the setting of primary gpu.

And there it passthroughs without problems and any error code.

So the problem should any setting or option in combination of my Asus p8z77-v Mainboard.

Maybe someone could give me some help of bios settings or proxmox settings to my Board?
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back