Hello everyone.
I'm new to Proxmox and I'm looking for a recommendation on how to install Nvidia drivers, or best practices for using GPU in Proxmox. Now the GPU fans are not controlled and are running at 60%. I tried, it can go to idle on windows, so I guess it should work here too. My question would be, is it better to install all drivers on the host or better to control from a VM with pass through? If I pass the GPU to the VM, then other VMs or containers can access it?
My plan in the future is to use multiple K8S clusters and pass the GPU to them. Using small LLMs and Jellifyn.
Thank you
I'm new to Proxmox and I'm looking for a recommendation on how to install Nvidia drivers, or best practices for using GPU in Proxmox. Now the GPU fans are not controlled and are running at 60%. I tried, it can go to idle on windows, so I guess it should work here too. My question would be, is it better to install all drivers on the host or better to control from a VM with pass through? If I pass the GPU to the VM, then other VMs or containers can access it?
My plan in the future is to use multiple K8S clusters and pass the GPU to them. Using small LLMs and Jellifyn.
Thank you