vGPU with nVIDIA on Kernel 6.8

are you sure this has something to do with the guest drivers and not e.g. an update of windows itself?
No, we're sure it has to do something with the host driver. But since we updated to v18 of the Nvidia driver the performance on 22H2 is very bad and upgrading to 24H2 gave errors. We are running new pilots with 24H2 and we go from there.
 
No, we're sure it has to do something with the host driver. But since we updated to v18 of the Nvidia driver the performance on 22H2 is very bad and upgrading to 24H2 gave errors. We are running new pilots with 24H2 and we go from there.
interesting.. is this reproducible on your side? (install 22h2, upgrade to 24h2) if yes, do you want to share a few more details (e.g. which windows version, specific settings, etc.) so i can look into that?
 
I have an nVDIA Tesla P4 card.

I was wondering if anyone has tried installing or successfully installed vGPU driver version 16.11 on proxmox 8.4 (i have 8.4.11 installed) with kernel version 6.8 (i have 6.8.12-13) . Will the stock 16.11 driver available from nVIDIA site work without patching as there is no patch available for 16.11 yet. This version was only released recently in July 2025 so was wondering being a recent version if this would be compatible with kernel 6.8 on proxmox 8.4.

I have also found a patched and ready to download vGPU driver version 19.1 (NVIDIA-Linux-x86_64-580.65.05-vgpu-kvm-custom.run) what is the sitituation for this version on proxmox 8.4 with kernel 6.8. I have read on the guide at PolloLoco-NViDIA vGPU guide that any driver version higher then 16,x will need to be patched for Tesla P4 as nVDIA dropped support for P4 from verion 17.x onwards.
 
Last edited:
I have an nVDIA Tesla P4 card.

I was wondering if anyone has tried installing or successfully installed vGPU driver version 16.11 on proxmox 8.4 (i have 8.4.11 installed) with kernel version 6.8 (i have 6.8.12-13) . Will the stock 16.11 driver available from nVIDIA site work without patching as there is no patch available for 16.11 yet. This version was only released recently in July 2025 so was wondering being a recent version if this would be compatible with kernel 6.8 on proxmox 8.4.

I have also found a patched and ready to download vGPU driver version 19.1 (NVIDIA-Linux-x86_64-580.65.05-vgpu-kvm-custom.run) what is the sitituation for this version on proxmox 8.4 with kernel 6.8. I have read on the guide at PolloLoco-NViDIA vGPU guide that any driver version higher then 16,x will need to be patched for Tesla P4 as nVDIA dropped support for P4 from verion 17.x onwards.
I think the official drivers dropped support such old cards. But i could be wrong. I would use an older version with a patched driver.
 
I think the official drivers dropped support such old cards. But i could be wrong. I would use an older version with a patched driver.
You mean to say that an unpatched driver version 16.11 will also not work (I understand that there could be problems for drivers 17.x and beyond unless properly patched). The nVIDIA resource at NVIDIA® Virtual GPU Software Supported GPUs says that the 16.x is last version supported for Tesla P4. On this basis I was wondering if an unpatched 16.11 will install correctly and build kernel modules for kernel 6.8 on 8.4.4.
 
I am fairly sure 16.11 will build a DKMS module for 6.8 because officially Ubuntu 24.04 is supported. There is no official support for Proxmox in that version yet, but in newer versions there is. You'd have to experiment with newer version numbers.
 
Hi there, I have the following Lenovo workstation: ThinkStation P620
  • Processor: AMD Ryzen™ Threadripper™ PRO
  • 2x NVIDIA GPU: RTX A6000
Details:
  • NVIDIA Driver obtained from NVIDIA Application HUB: NVIDIA-Linux-x86_64-570.158.02-vgpu-kvm.run
  • Fresh Proxmox installation.

I have followed all the steps in Proxmox documentation NVIDIA_vGPU_on_Proxmox_VE regarding vGPU but when I do lspci -d 10de:
, the output is:

Code:
41:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:00.1 Audio device: NVIDIA Corporation GA102 High Definition Audio Controller (rev a1)
61:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
61:00.1 Audio device: NVIDIA Corporation GA102 High Definition Audio Controller (rev a1)

Output of: pveversion -v

Code:
proxmox-ve: 8.4.0 (running kernel: 6.8.12-14-pve)
pve-manager: 8.4.12 (running version: 8.4.12/c2ea8261d32a5020)
proxmox-kernel-helper: 8.1.4
proxmox-kernel-6.8.12-14-pve-signed: 6.8.12-14
proxmox-kernel-6.8: 6.8.12-14
proxmox-kernel-6.8.12-9-pve-signed: 6.8.12-9
ceph-fuse: 17.2.8-pve2
corosync: 3.1.9-pve1
criu: 3.17.1-2+deb12u1
frr-pythontools: 10.2.3-1+pve1
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx11
ksm-control-daemon: 1.5-1
libjs-extjs: 7.0.0-5
libknet1: 1.30-pve2
libproxmox-acme-perl: 1.6.0
libproxmox-backup-qemu0: 1.5.2
libproxmox-rs-perl: 0.3.5
libpve-access-control: 8.2.2
libpve-apiclient-perl: 3.3.2
libpve-cluster-api-perl: 8.1.2
libpve-cluster-perl: 8.1.2
libpve-common-perl: 8.3.4
libpve-guest-common-perl: 5.2.2
libpve-http-server-perl: 5.2.2
libpve-network-perl: 0.11.2
libpve-rs-perl: 0.9.4
libpve-storage-perl: 8.3.7
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 6.0.0-1
lxcfs: 6.0.0-pve2
novnc-pve: 1.6.0-2
proxmox-backup-client: 3.4.6-1
proxmox-backup-file-restore: 3.4.6-1
proxmox-backup-restore-image: 0.7.0
proxmox-firewall: 0.7.1
proxmox-kernel-helper: 8.1.4
proxmox-mail-forward: 0.3.3
proxmox-mini-journalreader: 1.5
proxmox-offline-mirror-helper: 0.6.7
proxmox-widget-toolkit: 4.3.13
pve-cluster: 8.1.2
pve-container: 5.3.0
pve-docs: 8.4.1
pve-edk2-firmware: 4.2025.02-4~bpo12+1
pve-esxi-import-tools: 0.7.4
pve-firewall: 5.1.2
pve-firmware: 3.16-3
pve-ha-manager: 4.0.7
pve-i18n: 3.4.5
pve-qemu-kvm: 9.2.0-7
pve-xtermjs: 5.5.0-2
qemu-server: 8.4.1
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.8-pve1

Output of nvidia-smi vgpu -s

Code:
GPU 00000000:41:00.0
    NVIDIA RTXA6000-1B
    NVIDIA RTXA6000-2B
    NVIDIA RTXA6000-1Q
    NVIDIA RTXA6000-2Q
    NVIDIA RTXA6000-3Q
    NVIDIA RTXA6000-4Q
    NVIDIA RTXA6000-6Q
    NVIDIA RTXA6000-8Q
    NVIDIA RTXA6000-12Q
    NVIDIA RTXA6000-16Q
    NVIDIA RTXA6000-24Q
    NVIDIA RTXA6000-48Q
    NVIDIA RTXA6000-1A
    NVIDIA RTXA6000-2A
    NVIDIA RTXA6000-3A
    NVIDIA RTXA6000-4A
    NVIDIA RTXA6000-6A
    NVIDIA RTXA6000-8A
    NVIDIA RTXA6000-12A
    NVIDIA RTXA6000-16A
    NVIDIA RTXA6000-24A
    NVIDIA RTXA6000-48A

GPU 00000000:61:00.0
    NVIDIA RTXA6000-1B
    NVIDIA RTXA6000-2B
    NVIDIA RTXA6000-1Q
    NVIDIA RTXA6000-2Q
    NVIDIA RTXA6000-3Q
    NVIDIA RTXA6000-4Q
    NVIDIA RTXA6000-6Q
    NVIDIA RTXA6000-8Q
    NVIDIA RTXA6000-12Q
    NVIDIA RTXA6000-16Q
    NVIDIA RTXA6000-24Q
    NVIDIA RTXA6000-48Q
    NVIDIA RTXA6000-1A
    NVIDIA RTXA6000-2A
    NVIDIA RTXA6000-3A
    NVIDIA RTXA6000-4A
    NVIDIA RTXA6000-6A
    NVIDIA RTXA6000-8A
    NVIDIA RTXA6000-12A
    NVIDIA RTXA6000-16A
    NVIDIA RTXA6000-24A
    NVIDIA RTXA6000-48A

What else should I check? Can someone help me identifying the issue?
 
Seems to be functional, what is your issue?
I only see two GPU in Proxmox, not many as in the docs:
Mine:
Code:
root@pve:~# lspci -k | grep -A 3 "VGA"
41:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
        Subsystem: Lenovo GA102GL [RTX A6000]
        Kernel driver in use: nvidia
        Kernel modules: nvidiafb, nouveau, nvidia_vgpu_vfio, nvidia
--
61:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
        Subsystem: Lenovo GA102GL [RTX A6000]
        Kernel driver in use: nvidia
        Kernel modules: nvidiafb, nouveau, nvidia_vgpu_vfio, nvidia
Expected:
Code:
01:00.0 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:00.4 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:00.5 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:00.6 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:00.7 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.0 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.1 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.2 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.3 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.4 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.5 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.6 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.7 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.0 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.1 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.2 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.3 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.4 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.5 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.6 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.7 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:03.0 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:03.1 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:03.2 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:03.3 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)

Also in Proxmox UI I only see 2 GPUs
 
I only see two GPU in Proxmox, not many as in the docs:
Mine:
Code:
root@pve:~# lspci -k | grep -A 3 "VGA"
41:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
        Subsystem: Lenovo GA102GL [RTX A6000]
        Kernel driver in use: nvidia
        Kernel modules: nvidiafb, nouveau, nvidia_vgpu_vfio, nvidia
--
61:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
        Subsystem: Lenovo GA102GL [RTX A6000]
        Kernel driver in use: nvidia
        Kernel modules: nvidiafb, nouveau, nvidia_vgpu_vfio, nvidia
Expected:
Code:
01:00.0 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:00.4 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:00.5 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:00.6 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:00.7 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.0 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.1 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.2 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.3 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.4 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.5 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.6 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:01.7 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.0 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.1 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.2 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.3 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.4 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.5 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.6 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:02.7 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:03.0 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:03.1 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:03.2 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)
01:03.3 3D controller: NVIDIA Corporation GA102GL [RTX A5000] (rev a1)

Also in Proxmox UI I only see 2 GPUs
Never mind, I forgot to use the NVIDIA Display Mode Selector Tool.

Now i correctly visualize the GPU this way:
Code:
root@pve:~# lspci -d 10de:
41:00.0 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:00.4 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:00.5 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:00.6 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:00.7 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:01.0 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:01.1 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:01.2 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:01.3 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:01.4 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:01.5 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:01.6 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:01.7 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:02.0 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:02.1 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:02.2 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:02.3 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:02.4 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:02.5 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:02.6 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:02.7 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:03.0 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:03.1 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:03.2 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:03.3 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:03.4 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:03.5 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:03.6 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:03.7 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:04.0 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:04.1 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:04.2 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
41:04.3 3D controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
61:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
61:00.1 Audio device: NVIDIA Corporation GA102 High Definition Audio Controller (rev a1)