Nvidia vGPU-A40 with proxmox

deepcloud

Member
Feb 12, 2021
130
17
23
India
deepcloud.in
have a Nvidia A40 GPU - this is supported
I have proxmox 8.3.0 - With Kernel 6.5.13-6-pve pinned and installed nvidia VGPU Linux drivers - 535.161.05
I have got the responce from nvidia-smi, nvidia-smi vgpu, mdevctl types... all ok
i can even assign the PCIe-vGPU to the VM but cant start it

i get the below errors

qm start 100
swtpm_setup: Not overwriting existing state file.
kvm: -device vfio-pci,sysfsdev=/sys/bus/mdev/devices/00000000-0000-0000-0000-000000000100,id=hostpci0,bus=pci.0,addr=0x10: vfio 00000000-0000-0000-0000-000000000100: failed to setup container for group 63: Failed to set iommu for container: Invalid argument
stopping swtpm instance (pid 27866) due to QEMU startup error
waited 10 seconds for mediated device driver finishing clean up
actively clean up mediated device with UUID 00000000-0000-0000-0000-000000000100
start failed: QEMU exited with code 1

i have tried everything,,, any bright ideas,

I tried downgrading to 7.4 with kernel 5.11 and kernel 6.2 but the same error.

failed to setup container for group 63: Failed to set iommu for container: Invalid argument

- I have tried some settings in the BIOS, disable CSM, reset to defaults etc... everying but nothing seems to help.

looks like ASUS KRPA-U16 might be the culprit - any ideas or suggestions,
I have this doubt as I can get this A40 GPU to work (i mean vGPU on proxmox) on a HP DL385 Gen10 Plus and also on the Gigabyte MZ33-ARO

Update: got it working... Enable ACS ARI and AER
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!