[SOLVED] How do I keep a GPU for PVE?

pengu1n

Member
Apr 19, 2022
57
5
13
Hello.
I have a node on an AMD Ryzen 5900X with two discrete pcie GPUs, an AMD and an Nvidia one. The AMD is passed through to a VM.
There is a single monitor with selectable HDMI, USB-C and Display ports inputs.
There is an hdmi cable from nvidia card to monitor and a Display port cable from the AMD card to the monitor.
I want to leave the nvidia one for proxmox for when I need to sit at the console directly. Presently what happens is that upon boot, there is some some output to the hdmi port before it stops. We then change input to the Display port and use the VM as main computer.
However if I need to work on proxmox, and select the hdmi input, there is just the frozen initial output.

From a recent kernel upgrade to 5.15.83-1-pve I had to start using grub cmd, vfio, etc.. as the passthrough stopped working without them.
I seek help on how to have the nvidia card for proxmox and leaving the AMD as it is now being passed through to the VM.

These are my current settings from a helpful thread https://forum.proxmox.com/threads/problem-with-gpu-passthrough.55918/page-2 :
1. to add to /etc/default/grub: nomodeset video=vesafb:eek:ff video=efifb:eek:ff video=simplefb:eek:ff to the line GRUB_CMDLINE_LINUX_DEFAULT="quiet". GRUB_CMDLINE_LINUX_DEFAULT="quiet" was my previous value.

2. leave blacklisted nvidia:
/etc/modprobe.d/blacklist.conf
#blacklist amdgpu
#blacklist radeon
#blacklist nouveau
blacklist nvidia

3. also commented out a previous vfio config's failed attempt:
/etc/modprobe.d/vfio.conf
# AMD 6600XT: 1002:73ff (rev c1), 1002:ab28
#options vfio-pci ids=1002:73ff,1002:ab28 disable_vga=1

4. create a cron job with the script /root/fix_gpu_pass.sh, which has the contents:

echo 1 > /sys/bus/pci/devices/0000\:08\:00.0/remove
echo 1 > /sys/bus/pci/rescan

I'll be most grateful for the assistance.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!