[SOLVED] Nvidia GPU Driver on Proxmox 8

idhamari

New Member
Feb 10, 2022
13
2
3
35
After upgrading to proxmox 8, I had an issue with Windows not recognizing the Nvidia driver anymore (was working on the previous version 7). My hardware is RTX2080ti.

I tried to install the driver on the host using these commands and it works:

Code:
 wget https://us.download.nvidia.com/XFree86/Linux-x86_64/535.54.03/NVIDIA-Linux-x86_64-535.54.03.run
 apt  install pve-headers-6.2.16-4-pve
 ./NVIDIA-Linux-x86_64-535.54.03.run --kernel-source-path /usr/src/linux-headers-6.2.16-4-pve

However the Windows issue is still exist!
 
I am confused. Why are you installing an Nvidia driver on Linux? Aren't you using PCI Passthrough? Have you tried to update your driver on windows?
 
Does the card show up at your windows VM?

I think it is needed for containers.


Yes and yes.
Assuming you only have 1 Nvidia graphic card, you can not use it on Linux and Windows. You do not need to install the Nvidia driver on Poroxmox. In fact it might be part of your problem. Proxmox might claim the Nvidia card which does not make it available for Windows anymore. You have to make sure Proxmox does not use it (usually by blacklisting).

Have you consulted this chapter in the documentation?
 
If you need further help please post the output of lspci -nnk
 
Does the card show up at your windows VM?

yes

Assuming you only have 1 Nvidia graphic card, you can not use it on Linux and Windows.

I have two GPUs.

You do not need to install the Nvidia driver on Poroxmox.
Can one still run containers without installing Nvidia driver on proxmox?
In fact it might be part of your problem. Proxmox might claim the Nvidia card which does not make it available for Windows anymore. You have to make sure Proxmox does not use it (usually by blacklisting).
At least one GPU should work.

Yes, it was working before upgrading proxmox from 7 to 8

If you need further help please post the output of lspci -nnk

Here,
Code:
lspci -nnk
00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse Root Complex [1462:7c35]
00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU [1022:1481]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse IOMMU [1462:7c35]
00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse GPP Bridge [1462:7c35]
        Kernel driver in use: pcieport
00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse GPP Bridge [1462:7c35]
        Kernel driver in use: pcieport
00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse GPP Bridge [1462:7c35]
        Kernel driver in use: pcieport
00:03.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse GPP Bridge [1462:7c35]
        Kernel driver in use: pcieport
00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Subsystem: Device [7c35:1462]
        Kernel driver in use: pcieport
00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
        Subsystem: Device [7c35:1462]
        Kernel driver in use: pcieport
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
        Subsystem: Micro-Star International Co., Ltd. [MSI] FCH SMBus Controller [1462:7c35]
        Kernel driver in use: piix4_smbus
        Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
        Subsystem: Micro-Star International Co., Ltd. [MSI] FCH LPC Bridge [1462:7c35]
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 0 [1022:1440]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 1 [1022:1441]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 2 [1022:1442]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 3 [1022:1443]
        Kernel driver in use: k10temp
        Kernel modules: k10temp
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 4 [1022:1444]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 5 [1022:1445]
00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 6 [1022:1446]
00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 7 [1022:1447]
01:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [144d:a808]
        Subsystem: Samsung Electronics Co Ltd SSD 970 EVO [144d:a801]
        Kernel driver in use: nvme
        Kernel modules: nvme
20:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse Switch Upstream [1022:57ad]
        Kernel driver in use: pcieport
21:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Matisse PCIe GPP Bridge [1462:7c35]
        Kernel driver in use: pcieport
21:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Matisse PCIe GPP Bridge [1462:7c35]
        Kernel driver in use: pcieport
21:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
        Subsystem: Device [7c35:1462]
        Kernel driver in use: pcieport
21:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
        Subsystem: Device [7c35:1462]
        Kernel driver in use: pcieport
21:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
        Subsystem: Device [7c35:1462]
        Kernel driver in use: pcieport
23:00.0 Non-Volatile memory controller [0108]: Intel Corporation SSD 600P Series [8086:f1a5] (rev 03)
        Subsystem: Intel Corporation SSDPEKKW256G7 256GB [8086:390a]
        Kernel driver in use: nvme
        Kernel modules: nvme
27:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller [10ec:8125]
        Subsystem: Micro-Star International Co., Ltd. [MSI] RTL8125 2.5GbE Controller [1462:7c35]
        Kernel driver in use: r8169
        Kernel modules: r8169
2a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse Reserved SPP [1462:7c35]
2a:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Matisse USB 3.0 Host Controller [1462:7c35]
        Kernel driver in use: xhci_hcd
        Kernel modules: xhci_pci
2a:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:148c]
        Kernel driver in use: xhci_hcd
        Kernel modules: xhci_pci
2b:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: ahci
        Kernel modules: ahci
2c:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901]
        Kernel driver in use: ahci
        Kernel modules: ahci
2d:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU102 [GeForce RTX 2080 Ti] [10de:1e04] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU102 [GeForce RTX 2080 Ti] [1462:3711]
        Kernel driver in use: nvidia
        Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia
2d:00.1 Audio device [0403]: NVIDIA Corporation TU102 High Definition Audio Controller [10de:10f7] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU102 High Definition Audio Controller [1462:3711]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
2d:00.2 USB controller [0c03]: NVIDIA Corporation TU102 USB 3.1 Host Controller [10de:1ad6] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU102 USB 3.1 Host Controller [1462:3711]
        Kernel driver in use: xhci_hcd
        Kernel modules: xhci_pci
2d:00.3 Serial bus controller [0c80]: NVIDIA Corporation TU102 USB Type-C UCSI Controller [10de:1ad7] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU102 USB Type-C UCSI Controller [1462:3711]
        Kernel driver in use: nvidia-gpu
        Kernel modules: i2c_nvidia_gpu
2e:00.0 VGA compatible controller [0300]: NVIDIA Corporation TU102 [GeForce RTX 2080 Ti] [10de:1e04] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU102 [GeForce RTX 2080 Ti] [1462:3711]
        Kernel driver in use: nvidia
        Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia
2e:00.1 Audio device [0403]: NVIDIA Corporation TU102 High Definition Audio Controller [10de:10f7] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU102 High Definition Audio Controller [1462:3711]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
2e:00.2 USB controller [0c03]: NVIDIA Corporation TU102 USB 3.1 Host Controller [10de:1ad6] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU102 USB 3.1 Host Controller [1462:3711]
        Kernel driver in use: xhci_hcd
        Kernel modules: xhci_pci
2e:00.3 Serial bus controller [0c80]: NVIDIA Corporation TU102 USB Type-C UCSI Controller [10de:1ad7] (rev a1)
        Subsystem: Micro-Star International Co., Ltd. [MSI] TU102 USB Type-C UCSI Controller [1462:3711]
        Kernel driver in use: nvidia-gpu
        Kernel modules: i2c_nvidia_gpu
2f:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse PCIe Dummy Function [1462:7c35]
30:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse Reserved SPP [1462:7c35]
30:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Matisse USB 3.0 Host Controller [1462:7c35]
        Kernel driver in use: xhci_hcd
        Kernel modules: xhci_pci
30:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse HD Audio Controller [1462:cc35]
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel
 
Last edited:
Solved by:

- removing nvidia driver from the host
- removing and adding the pci again to windows

GPU in containers still does not work, so I am using vm with Ubuntu as an alternative.
 
Proxmox might claim the Nvidia card which does not make it available for Windows anymore.

You have to make sure Proxmox does not use it (usually by blacklisting).
Yes.
But drivers can still be installed on proxmox host, should not cause problems if not used.
Needed for LXC container passthrough use case.

Also for enabling vGPU / GVT-g it seems
* https://www.reddit.com/r/hardware/comments/mnord0/unlock_vgpu_functionality_for_consumer_grade_gpus/
* https://pve.proxmox.com/pve-docs/pve-admin-guide.html#_host_device_passthrough
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!