Graphics Card

I

indgepr

New Member
Apr 8, 2025
3
0
1
Hello,

I am running a machine with V8.3.4 on it I have a container running Debian. The machine has a NVIDIA Quadro M2000 GPU. I want to use this to run Ollama on the Debian container. If I run
lspci -v
I get the following entry

07:00.0 VGA compatible controller: NVIDIA Corporation GM206GL [Quadro M2000] (rev a1) (prog-if 00 [VGA controller])
Subsystem: Dell GM206GL [Quadro M2000]
Physical Slot: 3
Flags: bus master, fast devsel, latency 0, IRQ 44
Memory at f6000000 (32-bit, non-prefetchable) [size=16M]
Memory at e0000000 (64-bit, prefetchable) [size=256M]
Memory at f0000000 (64-bit, prefetchable) [size=32M]
I/O ports at c000
Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: <access denied>
Kernel driver in use: nouveau

Am I correct in concluding that this is NOT a Proxmox problem, but a Debian or Ollama Problem. Asking here as want to work down from the top

Thanks

Phil
 
Is this the only GPU in your system? If you have another GPU you‘ll have to blacklist the NVIDIA driver to prevent PVE from „grabbing“ it.
 
Yes it is the only GPU. when you say blacklist the driver. is this in PVE ? Are there instructions somewhere how to do this ?
 
From the wiki:

echo "blacklist nouveau" >> /etc/modprobe.d/blacklist.conf
echo "blacklist nvidia*" >> /etc/modprobe.d/blacklist.conf

But you‘ll loose the display output on the PVE.
 
I have done the above, now islcpi -v gives

07:00.0 VGA compatible controller: NVIDIA Corporation GM206GL [Quadro M2000] (rev a1) (prog-if 00 [VGA controller])
Subsystem: Dell GM206GL [Quadro M2000]
Physical Slot: 3
Flags: bus master, fast devsel, latency 0, IRQ 11
Memory at f6000000 (32-bit, non-prefetchable) [size=16M]
Memory at e0000000 (64-bit, prefetchable) [size=256M]
Memory at f0000000 (64-bit, prefetchable) [size=32M]
I/O ports at c000
Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: <access denied>

but if I do

nvidia-smi
NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

and

sudo apt install nvidia-driver
[sudo] password for ollama:
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
nvidia-driver is already the newest version (535.216.01-1~deb12u1).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

Any further thoughts about what to do next ?

Thanks

Phil
 
You must log in or register to reply here.
Top Bottom