I'm already quite of options what to do next, I had a Server with working GPU passthrough (1050Ti) but I thought I want a new Thing also to game on and now it just not gonna work.
Hardware: Asrock B350 Pro4 Motherboard, 64GB RAM, i5 8600k, Zotac 1070 Mini, iGPU is still enabled in the BIOS because I wanted to use it for kvmgt. Bios ignores setting the iGPU to primary and by default uses the GPU DVI (not displayport or HDMI) and not the iGPU ones.
Software: Updated Proxmox 6, only extra installs are glusterfs-server and git.
After some playing around the following config results in only a black screen and in Windows only a non working display driver is listed.
Only real error messages are here:
Grub:
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb,efifb
ff"
GRUB_CMDLINE_LINUX=""
lspci -v
/etc/modules
/etc/modprobe.d/blacklist
Other Options
kvm.conf
options kvm ignore_msrs=1
iommu...conf
options vfio_iommu_type1 allow_unsafe_interrupts=1
vfio.conf
options vfio-pci ids=10de:1b81,10de:10f0 disable_vga=1
qemu.conf
Hardware: Asrock B350 Pro4 Motherboard, 64GB RAM, i5 8600k, Zotac 1070 Mini, iGPU is still enabled in the BIOS because I wanted to use it for kvmgt. Bios ignores setting the iGPU to primary and by default uses the GPU DVI (not displayport or HDMI) and not the iGPU ones.
Software: Updated Proxmox 6, only extra installs are glusterfs-server and git.
After some playing around the following config results in only a black screen and in Windows only a non working display driver is listed.
Only real error messages are here:
root@server7:~# dmesg | grep vfio
[ 8.137771] vfio-pci 0000:01:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=io+mem
[ 8.159446] vfio_pci: add [10de:1b81[ffffffff:ffffffff]] class 0x000000/00000000
[ 8.179438] vfio_pci: add [10de:10f0[ffffffff:ffffffff]] class 0x000000/00000000
[ 214.054862] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19@0x900
[ 214.056079] vfio-pci 0000:01:00.0: BAR 3: can't reserve [mem 0xb0000000-0xb1ffffff 64bit pref]
[ 214.056287] vfio-pci 0000:01:00.0: No more image in the PCI ROM
[ 983.544596] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19@0x900
[ 983.545567] vfio-pci 0000:01:00.0: BAR 3: can't reserve [mem 0xb0000000-0xb1ffffff 64bit pref]
[ 983.545782] vfio-pci 0000:01:00.0: No more image in the PCI ROM
[ 1432.320898] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19@0x900
[ 1432.321868] vfio-pci 0000:01:00.0: BAR 3: can't reserve [mem 0xb0000000-0xb1ffffff 64bit pref]
[ 1432.322116] vfio-pci 0000:01:00.0: No more image in the PCI ROMGrub:
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb,efifb
ff"GRUB_CMDLINE_LINUX=""
lspci -v
Code:
01:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1) (prog-if 00 [VGA controller])
Subsystem: ZOTAC International (MCO) Ltd. GP104 [GeForce GTX 1070]
Flags: bus master, fast devsel, latency 0, IRQ 16
Memory at 82000000 (32-bit, non-prefetchable) [size=16M]
Memory at a0000000 (64-bit, prefetchable) [size=256M]
Memory at b0000000 (64-bit, prefetchable) [size=32M]
I/O ports at 3000 [size=128]
Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Legacy Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [128] Power Budgeting <?>
Capabilities: [420] Advanced Error Reporting
Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] #19
Kernel driver in use: vfio-pci
Kernel modules: nvidiafb, nouveau
01:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
Subsystem: ZOTAC International (MCO) Ltd. GP104 High Definition Audio Controller
Flags: bus master, fast devsel, latency 0, IRQ 17
Memory at 83080000 (32-bit, non-prefetchable) [size=16K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel/etc/modules
Code:
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd
#vfio-mdev
#kvmgt/etc/modprobe.d/blacklist
Code:
blacklist radeon
blacklist nouveau
blacklist nvidia
blacklist snd_hda_intel
blacklist snd_hda_codec_hdmi
blacklist i915Other Options
kvm.conf
options kvm ignore_msrs=1
iommu...conf
options vfio_iommu_type1 allow_unsafe_interrupts=1
vfio.conf
options vfio-pci ids=10de:1b81,10de:10f0 disable_vga=1
qemu.conf
Code:
GNU nano 3.2 /etc/pve/qemu-server/100.conf
agent: 1
bios: ovmf
bootdisk: scsi0
cores: 1
cpu: host,hidden=1,flags=+pcid
args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off'
efidisk0: node7-ssd1:100/vm-100-disk-1.qcow2,size=128K
hostpci0: 01:00,pcie=1,romfile=vbios.bin,x-vga=1
ide0: node7-ssd1:iso/Win10_1909_German_x64.iso,media=cdrom,size=5315440K
ide2: node7-ssd1:iso/virtio-win-0.1.173.iso,media=cdrom,size=385062K
machine: q35
memory: 8192
name: win10
net0: e1000=D6:2C:E9:39:0D:F7,bridge=vmbr0,firewall=1
net1: virtio=36:25:25:6D:8D:52,bridge=vmbr0,firewall=1
numa: 1
ostype: win10
parent: Installation
scsi0: node7-ssd1:100/vm-100-disk-0.qcow2,discard=on,size=256G,ssd=1
scsihw: virtio-scsi-pci
smbios1: uuid=a2c6a8cb-97fc-49e1-8362-ed929b5c4021
sockets: 2
vmgenid: a36ef9c8-3db5-4ceb-9ade-a1df85b6ab8e
