Another AMD GPU and another reset bug?

[summerside1967]

Hi Everyone...

Sorry but I need assistance again. I took the RX 6800 XT from my personal PC and put it in my proxmox build to test if there is a reset bug with this card. I was having problems with the original GPU (rx6700xt). Here is my original post:

https://forum.proxmox.com/threads/amd-gpu-passthrough.115348/


I used an old NVidia card for a few months and had no issues with passthrough.

I followed the directions updating grub, blacklists, etc... but I am having the same issues that the card shows an error after a vm reboot. One thing that might be a problem is my motherboard bios settings. Cannot find anything consistence that has suggestions for settings.

Here are some of my details

GRUB

GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt video=efifbff video=simplefbff video=vesafbff"
GRUB_CMDLINE_LINUX=""

VM Config

agent: 1
balloon: 0
bios: ovmf
boot: order=ide2;scsi0;net0;hostpci0;sata0
cores: 6
cpu: host,,hidden=1,flags=+pcid
cpuunits: 1024
efidisk0: VMs:vm-301-disk-0,efitype=4m,size=4M
hostpci0: 0000:03:00,pcie=1,x-vga=1
ide2: local:iso/Windows10.iso,media=cdrom,size=4492992K
machine: pc-q35-7.0
memory: 8192
meta: creation-qemu=7.1.0,ctime=1676234667
name: windows10
net0: virtio=F2:CB:CA4:8D:35,bridge=vmbr0,firewall=1
numa: 0
ostype: win10
sata0: local:iso/virtio-win-0.1.221.iso,media=cdrom,size=519030K
scsi0: VMs:vm-301-disk-1,iothread=1,size=64G
scsihw: virtio-scsi-single
smbios1: uuid=0ad8e939-3359-417e-be00-6c2d4d71c541
sockets: 1
vmgenid: 8936bb4e-07b4-4e8e-8b4e-edc2d0ca6a82

Motherboard

ASUS ProArt Z690-Creator WiFi 6E LGA 1700 (Intel 12th Gen) ATX

CPU

24 x 12th Gen Intel(R) Core(TM) i9-12900K

GPU

Sapphire RX6800XT

Thanks for your help

Edward

 

[leesteken]

Sorry but I need assistance again. I took the RX 6800 XT from my personal PC and put it in my proxmox build to test if there is a reset bug with this card. I was having problems with the original GPU (rx6700xt).

I would not expect reset issues with a 6800XT but it's always possible that your specific make and model does have an issue.

I used an old NVidia card for a few months and had no issues with passthrough.

I followed the directions updating grub, blacklists, etc... but I am having the same issues that the card shows an error after a vm reboot. One thing that might be a problem is my motherboard bios settings. Cannot find anything consistence that has suggestions for settings.

Here are some of my details

GRUB

GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt video=efifbff video=simplefbff video=vesafbff"
GRUB_CMDLINE_LINUX=""

video=efifb:off video=vesafb:off video=simplefb:off no longer work when you try to passthrough the boot GPU since kernel version 5.15.
Either update to kernel 6.1.10 and make sure the amdgpu driver loads for the 6800XT before the VM is started OR use the initcall_blacklist=sysfb_init work-around.

VM Config

agent: 1
balloon: 0
bios: ovmf
boot: order=ide2;scsi0;net0;hostpci0;sata0
cores: 6
cpu: host,,hidden=1,flags=+pcid
cpuunits: 1024
efidisk0: VMs:vm-301-disk-0,efitype=4m,size=4M
hostpci0: 0000:03:00,pcie=1,x-vga=1

Don't use the Primary GPU (x-vga=1) setting with AMD GPUs, it's really designed for NVidia. Just set Display to None.

ide2: local:iso/Windows10.iso,media=cdrom,size=4492992K
machine: pc-q35-7.0

GPU passthrough to Windows VMs works better with pc-q35-6.2 in my (somewhat limited) experience. Windows might struggle with the switch from 7.0 to 6.2 for a boot or two.

memory: 8192
meta: creation-qemu=7.1.0,ctime=1676234667
name: windows10
net0: virtio=F2:CB:CA4:8D:35,bridge=vmbr0,firewall=1
numa: 0
ostype: win10
sata0: local:iso/virtio-win-0.1.221.iso,media=cdrom,size=519030K
scsi0: VMs:vm-301-disk-1,iothread=1,size=64G
scsihw: virtio-scsi-single
smbios1: uuid=0ad8e939-3359-417e-be00-6c2d4d71c541
sockets: 1
vmgenid: 8936bb4e-07b4-4e8e-8b4e-edc2d0ca6a82

 

[summerside1967]

Thanks for the suggestions. I'll take your advice and checks things out tonight after work.

Always appreciated

 

[summerside1967]

Thanks for the suggestions. I'll take your advice and checks things out tonight after work.

Always appreciated

Thanks @leesteken for your help again. Took your advice and implemented the changes you suggested. All is good and everything works!

Cheers