Nvidia vGPU-A40 with proxmox

deepcloud

Active Member
Feb 12, 2021
141
26
38
India
deepcloud.in
have a Nvidia A40 GPU - this is supported
I have proxmox 8.3.0 - With Kernel 6.5.13-6-pve pinned and installed nvidia VGPU Linux drivers - 535.161.05
I have got the responce from nvidia-smi, nvidia-smi vgpu, mdevctl types... all ok
i can even assign the PCIe-vGPU to the VM but cant start it

i get the below errors

qm start 100
swtpm_setup: Not overwriting existing state file.
kvm: -device vfio-pci,sysfsdev=/sys/bus/mdev/devices/00000000-0000-0000-0000-000000000100,id=hostpci0,bus=pci.0,addr=0x10: vfio 00000000-0000-0000-0000-000000000100: failed to setup container for group 63: Failed to set iommu for container: Invalid argument
stopping swtpm instance (pid 27866) due to QEMU startup error
waited 10 seconds for mediated device driver finishing clean up
actively clean up mediated device with UUID 00000000-0000-0000-0000-000000000100
start failed: QEMU exited with code 1

i have tried everything,,, any bright ideas,

I tried downgrading to 7.4 with kernel 5.11 and kernel 6.2 but the same error.

failed to setup container for group 63: Failed to set iommu for container: Invalid argument

- I have tried some settings in the BIOS, disable CSM, reset to defaults etc... everying but nothing seems to help.

looks like ASUS KRPA-U16 might be the culprit - any ideas or suggestions,
I have this doubt as I can get this A40 GPU to work (i mean vGPU on proxmox) on a HP DL385 Gen10 Plus and also on the Gigabyte MZ33-ARO

Update: got it working... Enable ACS ARI and AER
 
Last edited: