Proxmox GPU Passthrough Code 43 Issue

[qwawer]

Hello all,

In this period of containment, I try new things, today I have add a GPU on my server whose config is as follows:

- x8dtl-3f
- 1x xeon L5640
- 32Gb RAM
- GeForce GT640

The problem is the same under WS2019 and W10 Pro.

For that I followed this tutorial: https://www.reddit.com/r/homelab/comments/b5xpua/the_ultimate_beginners_guide_to_gpu_passthrough/
The problem is that the card returns me an error code 43 once the vm config is made:

I installed the NVidia drivers well, I tested several, 395.X, 425.X, 445.X, the result is the same.

Here is my proxmox config:
/etc/default/grub:

GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb:off,efifb:off"

/etc/modules:

vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

/etc/modprobe.d/iommu_unsafe_interrupts.conf:

options vfio_iommu_type1 allow_unsafe_interrupts=1

/etc/modprobe.d/kvm.conf:

options kvm ignore_msrs=1

/etc/modprobe.d/blacklist.conf:

blacklist radeon
blacklist nouveau
blacklist nvidia

/etc/modprobe.d/vfio.conf (Il s'agit bien ici de mes valeurs):

options vfio-pci ids=10de:0fc1,10de:0e1b disable_vga=1

VM Config:

args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off'
bios: ovmf
boot: dcn
bootdisk: ide0
cores: 6
cpu: host,hidden=1,flags=+pcid,hv-vendor-id=proxmox
efidisk0: datassd01:vm-104-disk-1,size=128K
hostpci0: 03:00,pcie=1,x-vga=1
ide0: datassd01:vm-104-disk-0,size=128G
ide2: local:iso/SW_DVD9_Win_Server_STD_CORE_2019_1809.1_64Bit_French_DC_STD_MLF_X22-02971.ISO,media=cdrom,size=4997002K
machine: q35
memory: 4096
name: Test
net0: e1000=66:6B:D7:67:5C:E2,bridge=vmbr10,firewall=1
numa: 0
ostype: win10
scsihw: virtio-scsi-pci
smbios1: uuid=e7d882e8-87a3-48f6-8b98-1f80f30a7769
sockets: 1
vmgenid: 282bb34c-4a7c-498c-81d3-1060122de1e9

That's all, if someone has already experienced this, I'm interested

Thanks in advance,

Quentin.

 

[qwawer]

Up.

 

[dcsapak]

Up.

first, please do not bump your threads without adding new information (especially not when the post is not even a day old)

a few pointers that might help

video=vesafb:off,efifb:off

change this to

video=vesafb:off video=efifb:off

do you have more gpus than this one in your server?

args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off'

remove this line from the config

bios: ovmf

are you sure the gpu you have is capable of efi booting?
if no, set the boot type to seabios instead

 

[qwawer]

first, please do not bump your threads without adding new information (especially not when the post is not even a day old)

a few pointers that might help

video=vesafb:off,efifb:off

change this to

video=vesafb:off video=efifb:off

do you have more gpus than this one in your server?


remove this line from the config



are you sure the gpu you have is capable of efi booting?
if no, set the boot type to seabios instead

Hello,
Sorry for bump, it will not happen again.
I have change grub configuration and reboot server, remove the args line, don't work, same problem, i will try with legacy bios feature this afternoon.

 

[qwawer]

So, I have try to use a Legacy Bios, I have this error when I start the vm:

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,x-vga=on,multifunction=on: vfio 0000:03:00.0: failed getting region info for VGA region index 8: Invalid argument
device does not support requested feature x-vga
TASK ERROR: start failed: command '/usr/bin/kvm -id 103 -name FRMA00NPGAM01 -chardev 'socket,id=qmp,path=/var/run/qemu-server/103.qmp,server,nowait' -mon 'chardev=qmp,mode=control' -chardev 'socket,id=qmp-event,path=/var/run/qmeventd.sock,reconnect=5' -mon 'chardev=qmp-event,mode=control' -pidfile /var/run/qemu-server/103.pid -daemonize -smbios 'type=1,uuid=8cf0c0fa-b664-485b-b65d-6ee66e3f444a' -smp '6,sockets=1,cores=6,maxcpus=6' -nodefaults -boot 'menu=on,strict=on,reboot-timeout=1000,splash=/usr/share/qemu-server/bootsplash.jpg' -vga none -nographic -no-hpet -cpu 'host,+pcid,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=proxmox,hv_spinlocks=0x1fff,hv_vapic,hv_time,hv_reset,hv_vpindex,hv_runtime,hv_relaxed,hv_synic,hv_stimer,hv_ipi,kvm=off' -m 4096 -device 'vmgenid,guid=21c661cb-7b87-491f-aca3-ed311dce8dad' -readconfig /usr/share/qemu-server/pve-q35-4.0.cfg -device 'usb-tablet,id=tablet,bus=ehci.0,port=1' -device 'vfio-pci,host=0000:03:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,x-vga=on,multifunction=on' -device 'vfio-pci,host=0000:03:00.1,id=hostpci0.1,bus=ich9-pcie-port-1,addr=0x0.1' -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' -iscsi 'initiator-name=iqn.1993-08.org.debian:01:e9cbe1bed46a' -drive 'file=/dev/data01/vm-103-disk-0,if=none,id=drive-ide0,format=raw,cache=none,aio=native,detect-zeroes=on' -device 'ide-hd,bus=ide.0,unit=0,drive=drive-ide0,id=ide0,bootindex=100' -drive 'file=/var/lib/vz/template/iso/SW_DVD9_Win_Server_STD_CORE_2019_1809.1_64Bit_French_DC_STD_MLF_X22-02971.ISO,if=none,id=drive-ide2,media=cdrom,aio=threads' -device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=200' -netdev 'type=tap,id=net0,ifname=tap103i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown' -device 'e1000,mac=6A:2E:66:39:3B:73,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' -rtc 'driftfix=slew,base=localtime' -machine 'type=q35+pve1' -global 'kvm-pit.lost_tick_policy=discard'' failed: exit code 1

Impossible to define my GPU as Primary.
Here is the VM Config:

bootdisk: ide0
cores: 6
cpu: host,hidden=1,flags=+pcid,hv-vendor-id=proxmox
hostpci0: 03:00,pcie=1,x-vga=1
ide0: data01:vm-103-disk-0,size=128G
ide2: local:iso/SW_DVD9_Win_Server_STD_CORE_2019_1809.1_64Bit_French_DC_STD_MLF$
machine: q35
memory: 4096
name: FRMA00NPGAM01
net0: e1000=6A:2E:66:39:3B:73,bridge=vmbr10,firewall=1
numa: 0
ostype: win10
scsihw: virtio-scsi-pci
smbios1: uuid=8cf0c0fa-b664-485b-b65d-6ee66e3f444a
sockets: 1
vga: none
vmgenid: 21c661cb-7b87-491f-aca3-ed311dce8dad

And I have the same error to with x-vga off.

 

[dcsapak]

ok, can you post the output of 'lspci -k' ?

And I have the same error to with x-vga off.

which error do you mean? the x-vga one or error 43?

 

[qwawer]

Here is in attachment the lspci -k.
I mean the 43 error in windows

EDIT: I have only 1 GPU in this server.
EDIT2: My GPU isn't compatible with EFI: https://www.techpowerup.com/vgabios/147025/asus-gt640-2048-130813

 

[qwawer]

Hello,
I've made a new vm without EFI, I always have the 43 Code error, here is the VM config file:

agent: 1
balloon: 0
bootdisk: ide0
cores: 6
cpu: host,hidden=1,flags=+pcid,hv-vendor-id=proxmox
hostpci0: 03:00,pcie=1
ide0: local-lvm:vm-102-disk-0,size=128G
ide2: local:iso/WindowsLastGen.iso,media=cdrom
machine: q35
memory: 4096
name: Test
net0: e1000=D2:7E:29:A9:E3:12,bridge=vmbr10,firewall=1
numa: 0
ostype: win10
scsihw: virtio-scsi-pci
smbios1: uuid=8be9a047-d2ca-422b-8bd3-2d3ccef5109d
sockets: 1
vmgenid: 34b4ea32-c261-4a09-a759-e98f0f292e76

I have tested many os like Windows 7, Windows Server 2019 and Windows 10, same verdict.

 

[dcsapak]

mhm... there does not seem to be anything wrong from the config side
some hardware just does not want to work in such setups

what you could still try is to use the default machine (and remove pcie then from the hostpci line)

other than that i have really no further ideas

 

[xdreez]

Same problem, any Solution?