NVIDIA L4 GPU (AD104GL)

[UK SPEED]

"Can an NVIDIA L4 GPU (AD104GL) be passed through to an unprivileged LXC container on Proxmox 8 (Debian 12 base)? If so, what are the required lxc.cgroup2.devices.allow and lxc.mount.entry settings to make NVML and CUDA work inside the container?"

Also dos will this allow me to divide the GPU in any way for these containers

 

[ubu]

Just done exactly that for a customer
Not tested yet, bit nvidia-smi sees the card inside the container, so i think it will work

additional lxc-config entries:
lxc.cgroup2.devices.allow: c 195:* rwm
lxc.cgroup2.devices.allow: c 234:* rwm
lxc.cgroup2.devices.allow: c 509:* rwm
lxc.mount.entry: /dev/nvidia0 dev/nvidia0 none bind,optional,create=file
lxc.mount.entry: /dev/nvidiactl dev/nvidiactl none bind,optional,create=file
lxc.mount.entry: /dev/nvidia-modeset dev/nvidia-modeset none bind,optional,create=file
lxc.mount.entry: /dev/nvidia-uvm dev/nvidia-uvm none bind,optional,create=file
lxc.mount.entry: /dev/nvidia-uvm-tools dev/nvidia-uvm-tools none bind,optional,create=file
lxc.mount.entry: /dev/nvidia-caps/nvidia-cap1 dev/nvidia-caps/nvidia-cap1 none bind,optional,create=file
lxc.mount.entry: /dev/nvidia-caps/nvidia-cap2 dev/nvidia-caps/nvidia-cap2 none bind,optional,create=file

I used the debian-nvidia-installer script from github, since the nvidia-run installer did not work for me:

On Host:
=======

wget https://github.com/devleonardoamara...beta/debian-nvidia-installer_0.14.0_amd64.deb

apt install gdebi-core
gdebi debian-nvidia-installer_0.14.0_amd64.deb

debian-nvidia-installer (i use the 275 open source driver version)

reboot

edit lxc config (see above)



In Guest:
=======

wget https://github.com/devleonardoamara...beta/debian-nvidia-installer_0.14.0_amd64.deb

apt install gdebi-core

gdebi debian-nvidia-installer_0.14.0_amd64.deb

debian-nvidia-installer (i use the 275 open source driver version)

reboot lxc