Troubleshooting a GPU passthrough problem

Jay Hova

Member
Oct 20, 2020
18
0
6
58
Houston, Texas
www.softunderbelly.com
I have installed a Quadro M6000 in my Proxmox box. I have an x399d8a-2t with a threadripper. In my windows VM I can see the card but I get this windows error "Windows has stopped this device because it has reported problems. (Code 43)" I get an error at the PVE log in screen [24296.376530] iommu ivhd0: AMD-Vi: [invalid_device_request...]
 
Hi,

please post the complete output of 'dmesg' 'pveversion -v' and the vm config (qm config ID)
 
pveversion -v
proxmox-ve: 7.2-1 (running kernel: 5.15.64-1-pve)
pve-manager: 7.2-15 (running version: 7.2-15/963997e8)
pve-kernel-5.15: 7.2-14
pve-kernel-helper: 7.2-14
pve-kernel-5.4: 6.4-20
pve-kernel-5.15.74-1-pve: 5.15.74-1
pve-kernel-5.15.64-1-pve: 5.15.64-1
pve-kernel-5.4.203-1-pve: 5.4.203-1
pve-kernel-5.4.114-1-pve: 5.4.114-1
pve-kernel-5.4.65-1-pve: 5.4.65-1
pve-kernel-5.4.41-1-pve: 5.4.41-1
pve-kernel-5.4.34-1-pve: 5.4.34-2
ceph-fuse: 14.2.21-1
corosync: 3.1.7-pve1
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown: 0.8.36+pve2
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve2
libproxmox-acme-perl: 1.4.2
libproxmox-backup-qemu0: 1.3.1-1
libpve-access-control: 7.2-5
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.2-8
libpve-guest-common-perl: 4.2-3
libpve-http-server-perl: 4.1-5
libpve-storage-perl: 7.2-12
libqb0: 1.0.5-1
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.0-3
lxcfs: 4.0.12-pve1
novnc-pve: 1.3.0-3
proxmox-backup-client: 2.2.7-1
proxmox-backup-file-restore: 2.2.7-1
proxmox-mini-journalreader: 1.3-1
proxmox-offline-mirror-helper: 0.5.0-1
proxmox-widget-toolkit: 3.5.2
pve-cluster: 7.2-3
pve-container: 4.4-1
pve-docs: 7.2-5
pve-edk2-firmware: 3.20220526-1
pve-firewall: 4.2-7
pve-firmware: 3.5-6
pve-ha-manager: 3.4.0
pve-i18n: 2.7-3
pve-qemu-kvm: 7.1.0-3
pve-xtermjs: 4.16.0-1
qemu-server: 7.2-12
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.8.0~bpo11+2
vncterm: 1.7-1
zfsutils-linux: 2.1.6-pve1
 
vm config (qm config ID)
agent: 1
audio0: device=ich9-intel-hda,driver=spice
bios: ovmf
boot: order=ide2;ide0;net0;sata1
cores: 24
cpu: host
hostpci0: 0000:0b:00.0,pcie=1,x-vga=1
ide0: local-lvm:vm-104-disk-0,size=64G
ide2: none,media=cdrom
machine: pc-q35-7.0
memory: 16384
name: WinVM-104
net0: virtio=AA:9E:D3:1E:2E:B5,bridge=vmbr0,firewall=1
numa: 0
onboot: 1
ostype: win10
sata1: local:iso/virtio-win-0.1.189.iso,media=cdrom,size=488766K
scsihw: virtio-scsi-pci
smbios1: uuid=3a265870-583d-41f3-91a3-93cce42ca0a1
sockets: 1
usb0: host=1-11,usb3=1
vga: none
vmgenid: 0800b010-e213-4908-aff6-d4cc4576c250
 
did you also try the vm with bios instead of ovmf?
 
Another shot in the dark: disable Resizable Bar and disable Above 4G Decoding in BIOS. That did the trick for someone else where only the Windows VM had issues with passthrough. You could try a Ubuntu VM with the same configuration to see if it is only having issues with Windows and NVidia's drivers.
 
Another shot in the dark: disable Resizable Bar and disable Above 4G Decoding in BIOS. That did the trick for someone else where only the Windows VM had issues with passthrough. You could try a Ubuntu VM with the same configuration to see if it is only having issues with Windows and NVidia's drivers.
I have not been able o get this to work. of course I have very little experience in linux. Above 4G is disabled by default
 
Causes the VM not to boot. locks up at loading from disk
did you reinstall the guest? most guest os cannot simply change between these without manually changing or reinstalling
 
Install a 2nd gpu for your host and make sure your vm hardware shows none under display. Then specify the better card as you pci addition in your vm hardware. Next RDP into your vm, update your display driver through device manager and code 43 should go away.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!