Dear experts,
I have a issue with Windows VM & GPU passthrough. I've got it running (GPU is visible in Windows) when I start Windows VM after Proxmox reboot.
When I shutdown Windows and try to run it again I always get:
I also am unable to reboot pc with shutdown -h now - I must use physical button.
I guess that might be infamous vendor_reset issues, but I'm unable to find proper solution. I've tried https://github.com/inga-lovinde/RadeonResetBugFix/releases and https://github.com/gnif/vendor-reset, but latter doesn't support my GPU.
Could You give me a hand?
Configuration details:
I have a issue with Windows VM & GPU passthrough. I've got it running (GPU is visible in Windows) when I start Windows VM after Proxmox reboot.
When I shutdown Windows and try to run it again I always get:
error writing '1' to '/sys/bus/pci/devices/0000:c7:00.0/reset''.I also am unable to reboot pc with shutdown -h now - I must use physical button.
I guess that might be infamous vendor_reset issues, but I'm unable to find proper solution. I've tried https://github.com/inga-lovinde/RadeonResetBugFix/releases and https://github.com/gnif/vendor-reset, but latter doesn't support my GPU.
Could You give me a hand?
Configuration details:
Code:
/etc/kernel/cmdline:
root=ZFS=rpool/ROOT/pve-1 boot=zfs mitigations=off intel_iommu=on iommu=pt nox2apic intremap=no_x2apic_optout
Code:
lspci -nnk
c7:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Phoenix3 [1002:1900] (rev c4)
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Phoenix3 [1002:0124]
Kernel driver in use: vfio-pci
Kernel modules: amdgpu
c7:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
Code:
root@gamepc:~# dmesg | grep -e DMAR -e IOMMU -e AMD-Vi
[ 0.017628] DMAR: IOMMU enabled
[ 0.053929] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR0, rdevid:160
[ 0.053931] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR1, rdevid:160
[ 0.053933] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR2, rdevid:160
[ 0.053934] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR3, rdevid:160
[ 0.053935] AMD-Vi: Using global IVHD EFR:0x246577efa2054ada, EFR2:0x0
[ 0.275749] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[ 0.276729] AMD-Vi: Extended features (0x246577efa2054ada, 0x0): PPR NX GT IA GA PC
[ 0.276736] AMD-Vi: Interrupt remapping enabled
[ 0.279627] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
Code:
root@gamepc:~# dmesg | grep 'remapping'
[ 0.054399] x2apic: IRQ remapping doesn't support X2APIC mode <--- it dissapeared due to nox2apic intremap=no_x2apic_optout in /etc/kernel/cmdline
[ 0.271476] AMD-Vi: Interrupt remapping enabled
Code:
root@gamepc:~# cat /etc/pve/qemu-server/200.conf
agent: 1
balloon: 0
bios: ovmf
boot: order=scsi0
cores: 8
cpu: host
efidisk0: local-zfs:vm-200-disk-0,efitype=4m,pre-enrolled-keys=1,size=1M
hostpci0: 0000:c7:00.0,pcie=1,romfile=vbios_8945.bin,x-vga=1
hostpci1: 0000:c7:00.1,pcie=1
ide0: local:iso/virtio-win-0.1.271.iso,media=cdrom,size=709474K
machine: pc-q35-9.2+pve1
memory: 8192
meta: creation-qemu=9.2.0,ctime=1752500703
name: Win11ProGPU
net0: e1000=BC:24:11:53:7C:FD,bridge=vmbr0,firewall=1
numa: 0
ostype: win11
scsi0: local-zfs:vm-200-disk-1,cache=writeback,discard=on,iothread=1,size=64G,ssd=1
scsihw: virtio-scsi-single
smbios1: uuid=cdf8c786-6696-49db-af66-b1e4e8c6af42
sockets: 1
tpmstate0: local-zfs:vm-200-disk-2,size=4M,version=v2.0
usb0: host=1-3
usb1: host=1-4
vmgenid: 73da5017-de5f-4f49-913e-edd8a7344b8f