[SOLVED] 2060 super can't passthrough, please help~

[xux1217]

Hi, I have a zotac 2060 super plus oc, and now I want to passthrough it to a win10 guest vm, but I can't install the driver successful.

The monitor that inserted to the gpu can display the win10 desktop, and when I install the nvidia driver, the vm would restart and become blue screen.

I have another nvidia 960, the same process (same everything, just instead the gpu and the vbios) and it can successful.

I run the 2060 super in the physical machine(the same machine), the driver is ok and run the 3d mark is normal.

I run the 2060 super in the Ubuntu guest vm, the linux driver is ok and I can use ffmpeg to deal some videos.

Here is my info:

Hard device:
MSI B350 TOMAHAWK
4 X 8G ddr4 2400MHZ
256G Samsung 860 evo ssd
Ryzen7 1700
zotac 2060 super plus oc( insert the first PCIE slot, has vbios)

bios:
UEFI only
CSM disabled

operation:
Proxmox version: 6.0-1 (by official download web site)
kernel version: PVE 5.0.15-1

/etc/default/grub:
just modified the GRUB_CMDLINE_LINUX_DEFAULT field.

# If you change this file, run 'update-grub' afterwards to update
# /boot/grub/grub.cfg.
# For full documentation of the options in this file, see:
#   info -f grub -n 'Simple configuration'

GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR="Proxmox Virtual Environment"
GRUB_CMDLINE_LINUX_DEFAULT="quiet amd_iommu=on iommu=pt nomodeset video=efifb:off"
GRUB_CMDLINE_LINUX=""

# Disable os-prober, it might add menu entries for each guest
GRUB_DISABLE_OS_PROBER=true

# Uncomment to enable BadRAM filtering, modify to suit your needs
# This works with Linux (no patch required) and with any kernel that obtains
# the memory map information from GRUB (GNU Mach, kernel of FreeBSD ...)
#GRUB_BADRAM="0x01234567,0xfefefefe,0x89abcdef,0xefefefef"

# Uncomment to disable graphical terminal (grub-pc only)
#GRUB_TERMINAL=console

# The resolution used on graphical terminal
# note that you can use only modes which your graphic card supports via VBE
# you can see them in real GRUB with the command `vbeinfo'
#GRUB_GFXMODE=640x480

# Uncomment if you don't want GRUB to pass "root=UUID=xxx" parameter to Linux
#GRUB_DISABLE_LINUX_UUID=true

# Disable generation of recovery mode menu entries
GRUB_DISABLE_RECOVERY="true"

# Uncomment to get a beep at grub start
#GRUB_INIT_TUNE="480 440 1"

/etc/modprobe.d/*:

blacklist radeon
blacklist nouveau
blacklist nvidia
options kvm ignore_msrs=1
options kvm report_ignored_msrs=0
blacklist nvidiafb
options vfio-pci ids=10de:1f06,10de:10f9,10de:1ada,10de:1adb disable_vga=1

VM configuration:

agent: 1
balloon: 0
bios: ovmf
boot: cdn
bootdisk: scsi0
cores: 8
cpu: host
efidisk0: local-lvm:base-100-disk-1,size=128K
hostpci0: 1c:00,pcie=1,romfile=2060s.rom,x-vga=1
ide2: local:iso/win10_1903_v1_chinese_x64.iso,media=cdrom
machine: q35
memory: 8192
name: win-gpu
net0: virtio=FA:3F:CF:A1:AE:55,bridge=vmbr0,firewall=1
numa: 0
ostype: win10
sata0: local:iso/virtio-win-0.1.141.iso,media=cdrom,size=309208K
scsi0: local-lvm:base-100-disk-0,size=40G
scsihw: virtio-scsi-pci
smbios1: uuid=86ca15d6-b66d-4fa1-8146-022bfd599816
sockets: 1
template: 1
usb0: host=046d:c534
vmgenid: 4dfbed4c-1b6c-4d63-bbb5-7491ce002bdd

The win10 iso is download by Microsoft official web site.

The nvidia dirver is 436.30 desktop version.

I have two vbios for 2060s. First is exported by nvflash from physical machine(cut the head) , second is exported by "cat /sys/bus/pci/devices/0000:1c:00.0/rom" (the gpu is insert second slot, and passthrough to a win10 guest vm).
I think these vbios are useful, because I use rom-parse to verify and the monitor can display win10 desktop.

Please help me, I search these many days, and I really can't successful.

 

[dcsapak]

there is a bad default in qemu 4 which can lead to such problems

see this thread for workarounds https://forum.proxmox.com/threads/vm-w-pcie-passthrough-not-working-after-upgrading-to-6-0.56021/

 

[xux1217]

Thanks for replay, I solved it by enable the MSI in win10 VM, Thanks very much.