Hi there,
I am new to this forum but I have been utilizing Proxmox for over 2 years now. I am starting a new project to run local AI models and have the opportunity to get a hold of some NVIDIA L4s. Does anyone here have experience with passing through NVIDIA L4s in Proxmox to an Ubuntu guest OS? I read on the NVIDIA forums that you it seems the only way to passthrough L4s would be to use the vGPU drivers (with licensing fees) even if one is looking to passthrough the whole GPU to a guest OS, or is it as simple as passing through a NIC or a consumer-grade NVIDIA GPU (e.g. 3090, 4090, etc.) to a guest OS.
I appreciate any insights or experiences you folks have.
dayoi900
I am new to this forum but I have been utilizing Proxmox for over 2 years now. I am starting a new project to run local AI models and have the opportunity to get a hold of some NVIDIA L4s. Does anyone here have experience with passing through NVIDIA L4s in Proxmox to an Ubuntu guest OS? I read on the NVIDIA forums that you it seems the only way to passthrough L4s would be to use the vGPU drivers (with licensing fees) even if one is looking to passthrough the whole GPU to a guest OS, or is it as simple as passing through a NIC or a consumer-grade NVIDIA GPU (e.g. 3090, 4090, etc.) to a guest OS.
I appreciate any insights or experiences you folks have.
dayoi900