looking to better utilize proxmox with my gpus, Those who use GPUs (esp Nvidia / Intel ARC), what do you run on them/how are yours configured?

[zenowl77]

i am looking to expand what i use my GPUs for since i have them in a running system all the time, hoping to maybe find some interesting new uses/software projects i can run ontop of proxmox in order to make the most of my server and see how others are using them/have them configured.

i have a Nvidia Tesla P4 8GB and an Asrock Intel ARC A310 4GB,
currently the Nvidia enabled projects i am using are:

currently not using GPU because of running in an LXC and having to choose between vGPU and basic consumer features (still trying to find a way to do both but merged drives have been a fail so far):

• Jellyfin
• immich ( photo/video gallery )
• docker

currently running with vGPU:

• Ollama - LLM AI Text generation - Running on Ubuntu 22.04 with a 4GB vGPU profile
• EasyDiffusion - AI Image generation - Running on Windows 11 with a 4GB vGPU profile

using the Intel ARC A310 4GB in the Windows 11 VM via passthrough with FFMPEG, Handbrake, Hybrid, ShanaEncoder and other encoders for QSV AV1 encoding, thinking about passing it back to the host and trying to get it working with jellyfin and other LXCs maybe with a ubuntu LXC for encoder software or something to get more use out of it, so far it seems ARC support is really lacking for most everything else, but using it for LXCs instead of total passthrough for on vm seems more optimal if i can get it all working right.

is anyone else using an ARC GPU with LXCs?