HI Proxmox community,
I have Proxmox VE 8.3 set up on a fairly well resourced server with 4 NVIDIA L40S GPUs.
I'm running Ubuntu 24.04 VMs, and have successfully set up GPU passthrough on the host + guests thanks to a lot of help from previous posts on this forum.
My weird problem is that GPU passthrough works for 2 GPUs... but fails when I try to add a third. The third device appears in lspci and lshw (no drivers are loaded for it), and when I check into boot logs, I see that the driver initialization for this device failed with the following error:
Now, this is really strange, because all the GPUs are exactly the same, so I know for a fact the driver supports the card. I don't quite understand the error. Does anyone have a hunch as to what's going on?
I have Proxmox VE 8.3 set up on a fairly well resourced server with 4 NVIDIA L40S GPUs.
I'm running Ubuntu 24.04 VMs, and have successfully set up GPU passthrough on the host + guests thanks to a lot of help from previous posts on this forum.
My weird problem is that GPU passthrough works for 2 GPUs... but fails when I try to add a third. The third device appears in lspci and lshw (no drivers are loaded for it), and when I check into boot logs, I see that the driver initialization for this device failed with the following error:
Code:
Sep 24 13:53:17 <HOSTNAME> kernel: NVRM: The NVIDIA GPU 0000:03:00.0 (PCI ID: 10de:26b9)
NVRM: installed in this system is not supported by the
NVRM: NVIDIA 580.65.06 driver release.
NVRM: Please see 'Appendix A - Supported NVIDIA GPU Products'
NVRM: in this release's README, available on the operating system
NVRM: specific graphics driver download page at www.nvidia.com.
Sep 24 13:53:17 <HOSTNAME> kernel: nvidia: probe of 0000:03:00.0 failed with error -1
Sep 24 13:53:17 <HOSTNAME> kernel: NVRM: The NVIDIA probe routine failed for 1 device(s).
Sep 24 13:53:17 <HOSTNAME> kernel: NVRM: loading NVIDIA UNIX x86_64 Kernel Module 580.65.06 Sun Jul 27 07:14:19 UTC 2025Now, this is really strange, because all the GPUs are exactly the same, so I know for a fact the driver supports the card. I don't quite understand the error. Does anyone have a hunch as to what's going on?