Can't get GPU passthrough to Emby LXC

[ThaNerd]

I am trying to fix my passthrough but can't get it to work.
When I try to install nvidia drivers I get:

The NVIDIA driver appears to have been installed previously using a different installer. To prevent potential conflicts, it is recommended either to update the existing

But I can't remove the old ones.

Also when I try:

root@pve:~# nvidia-smi

I get:

NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

More info:

root@pve:~# lspci | grep -i nvidia
01:00.0 VGA compatible controller: NVIDIA Corporation GP104GL [Quadro P4000] (rev a1)
01:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)

root@pve:~# nvidia-detect
-bash: nvidia-detect: command not found

root@pve:~# apt install nvidia-driver
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 debianutils : Breaks: x11-common (< 1:7.7+23~) but 1:7.7+22 is to be installed
 libegl-mesa0 : Depends: libgbm1 (= 20.3.5-1) but 22.3.6-1+deb12u1 is to be installed
E: Error, pkgProblemResolver::Resolve generated breaks, this may be caused by held packages.