cuda

Hi everyone, I have an LXC with the following configuration: arch: amd64 cores: 8 features: nesting=1 hostname: Jellyfin memory: 8000 mp0: Movies:114/vm-114-disk-0.raw,mp=/mnt/movies,backup=1,size=1000G net0...

Hi, we are struggeling with vgpus for vllm / pytorch inside a VM. Setup: We operate a node with 4x Nvidia L40S in a Proxmox Cluster (8.4.1). Driver on the host is 580.65.05 and vGPUs are setup correctly and work reliable and flawless for VDIs. For LLM Inference we have mapped 4 vGPUs into a...

Hi all! Is it is necessary to install cuda and optix on the proxmox host in order to utilize them fully inside a container? Or is it enough to simply install the basic driver on the host, and then install cuda and optix only inside the container?

So I have 4 3090RTX GPU's in a Proxmox server. I am having real trouble getting them to all work together. I have done the pass through and can't seem to get them to work on a VM (Not a container) would I need to install the drivers on the Proxmox host first before installing cuda on to any of...