proxmox 6.1 gpu passthrough not working.

[spicyisland]

I succeeded to passthrough my gpu with the following settings in proxmox 6.0 but I can't get it work on proxmox 6.1.

my pc parts are as follows
======================================================================================
motherboard: x570 aorus elite
gpu slot 1: rtx 2070 super
gpu slot 2: rx580
cpu: ryzen 3700x
======================================================================================

my settings are as follows
======================================================================================
/etc/default/grub
GRUB_CMDLINE_LINUX_DEFAULT="quiet amd_iommu=on"

/etc/modules
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

echo "blacklist radeon" >> /etc/modprobe.d/blacklist.conf
echo "blacklist nouveau" >> /etc/modprobe.d/blacklist.conf
echo "blacklist nvidia" >> /etc/modprobe.d/blacklist.conf

echo "options vfio-pci ids=<some ids> disable_vga=1" > /etc/modprobe.d/vfio.conf

echo "options kvm ignore_msrs=1" > /etc/modprobe.d/kvm.conf

update-grub
update-initramfs -u -k all
======================================================================================
args: -cpu host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=1234567890ab,kvm=off
bios: ovmf
bootdisk: scsi0
cores: 4
cpu: host,hidden=1
efidisk0: local-lvm:vm-100-disk-1,size=128K
hostpci0: 09:00,pcie=1,x-vga=1
ide2: local:iso/Win10_1909_English_x64.iso,media=cdrom
machine: pc-q35-3.1
memory: 16384
name: win10-spicyisland
net0: virtio=F2:CD:C6:A8:27:A7,bridge=vmbr0,firewall=1
numa: 1
ostype: win10
sata0: local:iso/virtio-win-0.1.171.iso,media=cdrom,size=363020K
sata1: local:iso/nvidia-driver.iso,media=cdrom,size=587348K
scsi0: local-lvm:vm-100-disk-0,iothread=1,size=200G
scsihw: virtio-scsi-single
smbios1: uuid=55d45ec6-e7a9-42ca-88af-10cf1b80ea8d
sockets: 1
usb0: host=413c:2113
usb1: host=18f8:0fc0
vga: none
======================================================================================

This is what I do in proxmox 6.0

However it's not working on proxmox 6.1.

I tried many settings like
-machine type=q35,kernel_irqchip=on
iommu=pt
echo "options vfio_iommu_type1 allow_unsafe_interrupts=1" > /etc/modprobe.d/iommu_unsafe_interrupts.conf
tried to install windows first and add gpu, add gpu as pci device,
changed q35 to pc-q35-3.1
and so on but non of them worked.

I'd like to use latest features but I can't.
Is this some kind of bug in the kernel or qemu 4.1.1 ?

 

[dcsapak]

what exactly does not work? any error messages?

args: -cpu host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=1234567890ab,kvm=off

why do you need this?
setting win10 as os and x-vga on the pci device achieves mostly the same (see qm showcmd output)

machine: pc-q35-3.1

this should not be needed anymore in pve 6.1 just set it to q35

show your iommu groups, lspci -k and 'cat /proc/cmdline'

 

[maxprox]

Do read this, maybe ask him what he has done ...
obviously something was changed in the new version:
https://forum.proxmox.com/threads/proxmox-ve-6-1-released.61139/post-281235
regards,
maxprox

 

[spicyisland]

lspci -k

BOOT_IMAGE=/boot/vmlinuz-5.3.10-1-pve root=/dev/mapper/pve-root ro quiet amd_iommu=on

cat /proc/cmdline

00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge
Kernel driver in use: pcieport
00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge
Kernel driver in use: pcieport
00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge
Kernel driver in use: pcieport
00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
Kernel driver in use: pcieport
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
Kernel driver in use: pcieport
00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
Kernel driver in use: pcieport
00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
Kernel driver in use: pcieport
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)
Subsystem: Gigabyte Technology Co., Ltd FCH SMBus Controller
Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
Subsystem: Gigabyte Technology Co., Ltd FCH LPC Bridge
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 3
Kernel driver in use: k10temp
Kernel modules: k10temp
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse Device 24: Function 7
01:00.0 Non-Volatile memory controller: Micron/Crucial Technology Device 2263 (rev 03)
Subsystem: Micron/Crucial Technology Device 2263
Kernel driver in use: nvme
02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57ad
Kernel driver in use: pcieport
03:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3
Kernel driver in use: pcieport
03:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3
Kernel driver in use: pcieport
03:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
Kernel driver in use: pcieport
03:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
Kernel driver in use: pcieport
03:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
Kernel driver in use: pcieport
04:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon RX 470/480] (rev e7)
Subsystem: Gigabyte Technology Co., Ltd Ellesmere [Radeon RX 470/480/570/570X/580/580X/590]
Kernel driver in use: amdgpu
Kernel modules: amdgpu
04:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590]
Subsystem: Gigabyte Technology Co., Ltd Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
05:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
Subsystem: Gigabyte Technology Co., Ltd I211 Gigabit Network Connection
Kernel driver in use: igb
Kernel modules: igb
06:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
06:00.1 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
Kernel driver in use: xhci_hcd
06:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
Kernel driver in use: xhci_hcd
07:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
Kernel driver in use: ahci
Kernel modules: ahci
08:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
Kernel driver in use: ahci
Kernel modules: ahci
09:00.0 VGA compatible controller: NVIDIA Corporation Device 1e84 (rev a1)
Subsystem: Gigabyte Technology Co., Ltd Device 400d
Kernel driver in use: vfio-pci
Kernel modules: nvidiafb, nouveau
09:00.1 Audio device: NVIDIA Corporation Device 10f8 (rev a1)
Subsystem: Gigabyte Technology Co., Ltd Device 400d
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
09:00.2 USB controller: NVIDIA Corporation Device 1ad8 (rev a1)
Subsystem: Gigabyte Technology Co., Ltd Device 400d
Kernel driver in use: xhci_hcd
09:00.3 Serial bus controller [0c80]: NVIDIA Corporation Device 1ad9 (rev a1)
Subsystem: Gigabyte Technology Co., Ltd Device 400d
Kernel driver in use: nvidia-gpu
Kernel modules: i2c_nvidia_gpu
0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
0b:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP
Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP
Kernel driver in use: ccp
Kernel modules: ccp
0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
Subsystem: Gigabyte Technology Co., Ltd Matisse USB 3.0 Host Controller
Kernel driver in use: xhci_hcd
0b:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller
Subsystem: Gigabyte Technology Co., Ltd Starship/Matisse HD Audio Controller
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
0c:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
Subsystem: Gigabyte Technology Co., Ltd FCH SATA Controller [AHCI mode]
Kernel driver in use: ahci
Kernel modules: ahci
0d:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
Subsystem: Gigabyte Technology Co., Ltd FCH SATA Controller [AHCI mode]
Kernel driver in use: ahci
Kernel modules: ahci

 

[spicyisland]

I read too old articles...
Now I removed -agrs line and it worked in pve kernel 5.0

bios: ovmf
bootdisk: scsi0
cores: 1
cpu: host
efidisk0: local-lvm:vm-100-disk-1,size=4M
hostpci0: 09:00,pcie=1,x-vga=1
machine: q35
memory: 2048
name: win10-base
net0: virtio=56:60:CF:F8:43:4C,bridge=vmbr0,firewall=1
numa: 1
ostype: win10
sata0: local:iso/Win10_1909_English_x64.iso,media=cdrom,size=5294394K
sata1: local:iso/virtio-win-0.1.171.iso,media=cdrom,size=363020K
sata2: local:iso/nvidia-driver.iso,media=cdrom,size=587348K
scsi0: local-lvm:vm-100-disk-0,cache=writeback,iothread=1,size=32G
scsihw: virtio-scsi-single
smbios1: uuid=efdc1248-3922-4065-aa7e-e3cc9370675e
sockets: 1

 

[spicyisland]

qm show <vmid>

/usr/bin/kvm -id 100 -name win10-base -chardev 'socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait' -mon 'chardev=qmp,mode=control' -chardev 'socket,id=qmp-event,path=/var/run/qmeventd.sock,reconnect=5' -mon 'chardev=qmp-event,mode=control' -pidfile /var/run/qemu-server/100.pid -daemonize -smbios 'type=1,uuid=efdc1248-3922-4065-aa7e-e3cc9370675e' -drive 'if=pflash,unit=0,format=raw,readonly,file=/usr/share/pve-edk2-firmware//OVMF_CODE.fd' -drive 'if=pflash,unit=1,format=raw,id=drive-efidisk0,file=/dev/pve/vm-100-disk-1' -smp '1,sockets=1,cores=1,maxcpus=1' -nodefaults -boot 'menu=on,strict=on,reboot-timeout=1000,splash=/usr/share/qemu-server/bootsplash.jpg' -vga none -nographic -no-hpet -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=proxmox,hv_spinlocks=0x1fff,hv_vapic,hv_time,hv_reset,hv_vpindex,hv_runtime,hv_relaxed,hv_synic,hv_stimer,hv_ipi,kvm=off' -m 2048 -object 'memory-backend-ram,id=ram-node0,size=2048M' -numa 'node,nodeid=0,cpus=0,memdev=ram-node0' -object 'iothread,id=iothread-virtioscsi0' -device 'vmgenid,guid=c3384cc5-d003-4eb8-8b7a-9fb0658f25cc' -readconfig /usr/share/qemu-server/pve-q35-4.0.cfg -device 'usb-tablet,id=tablet,bus=ehci.0,port=1' -device 'vfio-pci,host=0000:09:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,multifunction=on' -device 'vfio-pci,host=0000:09:00.1,id=hostpci0.1,bus=ich9-pcie-port-1,addr=0x0.1' -device 'vfio-pci,host=0000:09:00.2,id=hostpci0.2,bus=ich9-pcie-port-1,addr=0x0.2' -device 'vfio-pci,host=0000:09:00.3,id=hostpci0.3,bus=ich9-pcie-port-1,addr=0x0.3' -device 'usb-host,vendorid=0x413c,productid=0x2113,id=usb0' -device 'usb-host,vendorid=0x18f8,productid=0x0fc0,id=usb1' -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' -iscsi 'initiator-name=iqn.1993-08.org.debian:01:a655ba564986' -device 'virtio-scsi-pci,id=virtioscsi0,bus=pci.3,addr=0x1,iothread=iothread-virtioscsi0' -drive 'file=/dev/pve/vm-100-disk-0,if=none,id=drive-scsi0,cache=writeback,format=raw,aio=threads,detect-zeroes=on' -device 'scsi-hd,bus=virtioscsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,bootindex=100' -device 'ahci,id=ahci0,multifunction=on,bus=pci.0,addr=0x7' -drive 'file=/var/lib/vz/template/iso/Win10_1909_English_x64.iso,if=none,id=drive-sata0,media=cdrom,aio=threads' -device 'ide-cd,bus=ahci0.0,drive=drive-sata0,id=sata0,bootindex=200' -drive 'file=/var/lib/vz/template/iso/virtio-win-0.1.171.iso,if=none,id=drive-sata1,media=cdrom,aio=threads' -device 'ide-cd,bus=ahci0.1,drive=drive-sata1,id=sata1,bootindex=201' -drive 'file=/var/lib/vz/template/iso/nvidia-driver.iso,if=none,id=drive-sata2,media=cdrom,aio=threads' -device 'ide-cd,bus=ahci0.2,drive=drive-sata2,id=sata2,bootindex=202' -netdev 'type=tap,id=net0,ifname=tap100i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' -device 'virtio-net-pci,mac=56:60:CF:F8:43:4C,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' -rtc 'driftfix=slew,base=localtime' -machine 'type=q35+pve1' -global 'kvm-pit.lost_tick_policy=discard'

 

[spicyisland]

It didn't work on 5.3

TASK ERROR: start failed: command '/usr/bin/kvm -id 100 -name win10-base -chardev 'socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait' -mon 'chardev=qmp,mode=control' -chardev 'socket,id=qmp-event,path=/var/run/qmeventd.sock,reconnect=5' -mon 'chardev=qmp-event,mode=control' -pidfile /var/run/qemu-server/100.pid -daemonize -smbios 'type=1,uuid=efdc1248-3922-4065-aa7e-e3cc9370675e' -drive 'if=pflash,unit=0,format=raw,readonly,file=/usr/share/pve-edk2-firmware//OVMF_CODE.fd' -drive 'if=pflash,unit=1,format=raw,id=drive-efidisk0,file=/dev/pve/vm-100-disk-1' -smp '1,sockets=1,cores=1,maxcpus=1' -nodefaults -boot 'menu=on,strict=on,reboot-timeout=1000,splash=/usr/share/qemu-server/bootsplash.jpg' -vga none -nographic -no-hpet -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=proxmox,hv_spinlocks=0x1fff,hv_vapic,hv_time,hv_reset,hv_vpindex,hv_runtime,hv_relaxed,hv_synic,hv_stimer,hv_ipi,kvm=off' -m 2048 -object 'memory-backend-ram,id=ram-node0,size=2048M' -numa 'node,nodeid=0,cpus=0,memdev=ram-node0' -object 'iothread,id=iothread-virtioscsi0' -device 'vmgenid,guid=c3384cc5-d003-4eb8-8b7a-9fb0658f25cc' -readconfig /usr/share/qemu-server/pve-q35-4.0.cfg -device 'usb-tablet,id=tablet,bus=ehci.0,port=1' -device 'vfio-pci,host=0000:09:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,multifunction=on' -device 'vfio-pci,host=0000:09:00.1,id=hostpci0.1,bus=ich9-pcie-port-1,addr=0x0.1' -device 'vfio-pci,host=0000:09:00.2,id=hostpci0.2,bus=ich9-pcie-port-1,addr=0x0.2' -device 'vfio-pci,host=0000:09:00.3,id=hostpci0.3,bus=ich9-pcie-port-1,addr=0x0.3' -device 'usb-host,vendorid=0x413c,productid=0x2113,id=usb0' -device 'usb-host,vendorid=0x18f8,productid=0x0fc0,id=usb1' -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' -iscsi 'initiator-name=iqn.1993-08.org.debian:01:a655ba564986' -device 'virtio-scsi-pci,id=virtioscsi0,bus=pci.3,addr=0x1,iothread=iothread-virtioscsi0' -drive 'file=/dev/pve/vm-100-disk-0,if=none,id=drive-scsi0,cache=writeback,format=raw,aio=threads,detect-zeroes=on' -device 'scsi-hd,bus=virtioscsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,bootindex=100' -device 'ahci,id=ahci0,multifunction=on,bus=pci.0,addr=0x7' -drive 'file=/var/lib/vz/template/iso/Win10_1909_English_x64.iso,if=none,id=drive-sata0,media=cdrom,aio=threads' -device 'ide-cd,bus=ahci0.0,drive=drive-sata0,id=sata0,bootindex=200' -drive 'file=/var/lib/vz/template/iso/virtio-win-0.1.171.iso,if=none,id=drive-sata1,media=cdrom,aio=threads' -device 'ide-cd,bus=ahci0.1,drive=drive-sata1,id=sata1,bootindex=201' -drive 'file=/var/lib/vz/template/iso/nvidia-driver.iso,if=none,id=drive-sata2,media=cdrom,aio=threads' -device 'ide-cd,bus=ahci0.2,drive=drive-sata2,id=sata2,bootindex=202' -netdev 'type=tap,id=net0,ifname=tap100i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' -device 'virtio-net-pci,mac=56:60:CF:F8:43:4C,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' -rtc 'driftfix=slew,base=localtime' -machine 'type=q35+pve1' -global 'kvm-pit.lost_tick_policy=discard'' failed: got timeout

 

[spicyisland]

Sorry I didn't look carefully there were error message in dmesg.

[ 572.327056] xhci_hcd 0000:09:00.2: remove, state 4
[ 572.327059] usb usb6: USB disconnect, device number 1
[ 572.327461] xhci_hcd 0000:09:00.2: USB bus 6 deregistered
[ 572.327465] xhci_hcd 0000:09:00.2: remove, state 4
[ 572.327466] usb usb5: USB disconnect, device number 1
[ 572.328089] xhci_hcd 0000:09:00.2: USB bus 5 deregistered
[ 572.569714] BUG: unable to handle page fault for address: ffffba9200131000
[ 572.571928] #PF: supervisor read access in kernel mode
[ 572.572897] #PF: error_code(0x0000) - not-present page
[ 572.573860] PGD 81b154067 P4D 81b154067 PUD 81b155067 PMD 81b156067 PTE 0
[ 572.574833] Oops: 0000 [#1] SMP NOPTI
[ 572.575798] CPU: 3 PID: 112 Comm: kworker/3:2 Tainted: P O 5.3.10-1-pve #1
[ 572.576763] Hardware name: Gigabyte Technology Co., Ltd. X570 AORUS ELITE/X570 AORUS ELITE, BIOS F10 11/15/2019
[ 572.577708] Workqueue: events ccg_pm_workaround_work [ucsi_ccg]
[ 572.578660] RIP: 0010:gpu_i2c_check_status.isra.5+0x52/0xa0 [i2c_nvidia_gpu]
[ 572.579606] Code: 25 00 00 00 60 3d 00 00 00 60 75 24 be 58 02 00 00 bf f4 01 00 00 e8 cd 16 9a e7 48 8b 05 c6 1c 4e e8 4c 39 e0 79 09 49 8b 06 <8b> 18 85 db 78 ce 48 8b 05 b1 1c 4e e8 49 39 c4 0f 88 b6 02 00 00
[ 572.580591] RSP: 0018:ffffba920058bcc0 EFLAGS: 00010283
[ 572.581571] RAX: ffffba9200131000 RBX: 00000000ffffffff RCX: 0000000000000000
[ 572.582553] RDX: ffff9cee5e6ddb40 RSI: 0000000000000000 RDI: ffffba920058bbf8
[ 572.583527] RBP: ffffba920058bce0 R08: 0000000000000000 R09: 0000000000000003
[ 572.584494] R10: 000000000000000e R11: ffff9cee5e6e94c4 R12: 0000000100010af6
[ 572.585454] R13: ffff9cee5abe5818 R14: ffff9cee5abe5820 R15: 00000001000109fc
[ 572.586408] FS: 0000000000000000(0000) GS:ffff9cee5e6c0000(0000) knlGS:0000000000000000
[ 572.587358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 572.588300] CR2: ffffba9200131000 CR3: 00000008034f6000 CR4: 0000000000340ee0
[ 572.589243] Call Trace:
[ 572.590204] gpu_i2c_master_xfer+0xe8/0x22d [i2c_nvidia_gpu]
[ 572.591152] __i2c_transfer+0x180/0x4d0
[ 572.592087] i2c_transfer+0x88/0x100
[ 572.593011] ccg_read+0x11e/0x170 [ucsi_ccg]
[ 572.593940] ? __switch_to_asm+0x40/0x70
[ 572.594862] ? __switch_to_asm+0x40/0x70
[ 572.595772] ucsi_ccg_sync+0x56/0xb0 [ucsi_ccg]
[ 572.596681] ucsi_notify+0x26/0x120 [typec_ucsi]
[ 572.597591] ccg_pm_workaround_work+0x15/0x20 [ucsi_ccg]
[ 572.598507] process_one_work+0x20f/0x3d0
[ 572.599412] worker_thread+0x34/0x400
[ 572.600313] kthread+0x120/0x140
[ 572.601213] ? process_one_work+0x3d0/0x3d0
[ 572.602111] ? __kthread_parkme+0x70/0x70
[ 572.603004] ret_from_fork+0x22/0x40
[ 572.603894] Modules linked in: tcp_diag inet_diag ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter bpfilter bonding softdog nfnetlink_log nfnetlink edac_mce_amd kvm_amd kvm zfs(PO) zunicode(PO) zlua(PO) zavl(PO) icp(PO) crct10dif_pclmul crc32_pclmul ghash_clmulni_intel snd_hda_codec_generic amdgpu ledtrig_audio aesni_intel snd_hda_codec_hdmi amd_iommu_v2 aes_x86_64 gpu_sched crypto_simd ttm cryptd glue_helper snd_hda_intel snd_usb_audio drm_kms_helper wmi_bmof snd_usbmidi_lib k10temp ucsi_ccg snd_hda_codec snd_rawmidi xpad snd_hda_core snd_seq_device drm typec_ucsi ff_memless mc snd_hwdep typec fb_sys_fops joydev input_leds syscopyarea snd_pcm ccp zcommon(PO) sysfillrect snd_timer sysimgblt snd znvpair(PO) soundcore spl(O) vhost_net vhost tap ib_iser mac_hid rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sunrpc ip_tables x_tables autofs4 btrfs xor
[ 572.603918] zstd_compress raid6_pq dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c usbmouse hid_generic usbkbd usbhid hid uas usb_storage i2c_piix4 i2c_nvidia_gpu ahci libahci igb i2c_algo_bit dca wmi
[ 572.610024] CR2: ffffba9200131000
[ 572.611095] ---[ end trace 2e2ef1650bea31c1 ]---
[ 572.612159] RIP: 0010:gpu_i2c_check_status.isra.5+0x52/0xa0 [i2c_nvidia_gpu]
[ 572.613220] Code: 25 00 00 00 60 3d 00 00 00 60 75 24 be 58 02 00 00 bf f4 01 00 00 e8 cd 16 9a e7 48 8b 05 c6 1c 4e e8 4c 39 e0 79 09 49 8b 06 <8b> 18 85 db 78 ce 48 8b 05 b1 1c 4e e8 49 39 c4 0f 88 b6 02 00 00
[ 572.614320] RSP: 0018:ffffba920058bcc0 EFLAGS: 00010283
[ 572.615416] RAX: ffffba9200131000 RBX: 00000000ffffffff RCX: 0000000000000000
[ 572.616520] RDX: ffff9cee5e6ddb40 RSI: 0000000000000000 RDI: ffffba920058bbf8
[ 572.617617] RBP: ffffba920058bce0 R08: 0000000000000000 R09: 0000000000000003
[ 572.618704] R10: 000000000000000e R11: ffff9cee5e6e94c4 R12: 0000000100010af6
[ 572.619790] R13: ffff9cee5abe5818 R14: ffff9cee5abe5820 R15: 00000001000109fc
[ 572.620865] FS: 0000000000000000(0000) GS:ffff9cee5e6c0000(0000) knlGS:0000000000000000
[ 572.621943] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 572.623013] CR2: ffffba9200131000 CR3: 00000008034f6000 CR4: 0000000000340ee0
[ 572.829227] device tap100i0 entered promiscuous mode
[ 572.843851] fwbr100i0: port 1(fwln100i0) entered blocking state
[ 572.844973] fwbr100i0: port 1(fwln100i0) entered disabled state
[ 572.846125] device fwln100i0 entered promiscuous mode
[ 572.847253] fwbr100i0: port 1(fwln100i0) entered blocking state
[ 572.848350] fwbr100i0: port 1(fwln100i0) entered forwarding state
[ 572.851107] vmbr0: port 2(fwpr100p0) entered blocking state
[ 572.852165] vmbr0: port 2(fwpr100p0) entered disabled state
[ 572.853265] device fwpr100p0 entered promiscuous mode
[ 572.854339] vmbr0: port 2(fwpr100p0) entered blocking state
[ 572.855369] vmbr0: port 2(fwpr100p0) entered forwarding state
[ 572.858186] fwbr100i0: port 2(tap100i0) entered blocking state
[ 572.859207] fwbr100i0: port 2(tap100i0) entered disabled state
[ 572.860250] fwbr100i0: port 2(tap100i0) entered blocking state
[ 572.861235] fwbr100i0: port 2(tap100i0) entered forwarding state
[ 573.214290] vfio-pci 0000:09:00.0: vfio_ecap_init: hiding ecap 0x1e@0x258
[ 573.215519] vfio-pci 0000:09:00.0: vfio_ecap_init: hiding ecap 0x19@0x900

 

[Enyce97]

experiencing the same.

 

[dcsapak]

[ 572.578660] RIP: 0010:gpu_i2c_check_status.isra.5+0x52/0xa0 [i2c_nvidia_gpu]

shows that probably the i2c nvidia driver is in use
either blacklist those drivers, or bind the gpu (also the xhci and i2c functions) to vfio-pci before the nvidia driver loads