GPU Passthrough help

Nov 30, 2022
22
0
6
I haven struggling with this since yesterday
i would like to have two screens on a HP Z2 with 4 displayports
one for proxmox and one for VM
i have tried everything i could find and i still cannot get it to work
i have followed wiki and still no luck
is anyone able to help out ?
 
Sorry here is info
pveversion -v
uname -a
proxmox-ve: 8.3.0 (running kernel: 6.8.12-4-pve)
pve-manager: 8.3.0 (running version: 8.3.0/c1689ccb1065a83b)
proxmox-kernel-helper: 8.1.0
proxmox-kernel-6.8: 6.8.12-4
proxmox-kernel-6.8.12-4-pve-signed: 6.8.12-4
ceph-fuse: 17.2.7-pve3
corosync: 3.1.7-pve3
criu: 3.17.1-2+deb12u1
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx11
ksm-control-daemon: 1.5-1
libjs-extjs: 7.0.0-5
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.5.1
libproxmox-backup-qemu0: 1.4.1
libproxmox-rs-perl: 0.3.4
libpve-access-control: 8.2.0
libpve-apiclient-perl: 3.3.2
libpve-cluster-api-perl: 8.0.10
libpve-cluster-perl: 8.0.10
libpve-common-perl: 8.2.9
libpve-guest-common-perl: 5.1.6
libpve-http-server-perl: 5.1.2
libpve-network-perl: 0.10.0
libpve-rs-perl: 0.9.0
libpve-storage-perl: 8.2.9
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 6.0.0-1
lxcfs: 6.0.0-pve2
novnc-pve: 1.5.0-1
proxmox-backup-client: 3.2.9-1
proxmox-backup-file-restore: 3.2.9-1
proxmox-firewall: 0.6.0
proxmox-kernel-helper: 8.1.0
proxmox-mail-forward: 0.3.1
proxmox-mini-journalreader: 1.4.0
proxmox-offline-mirror-helper: 0.6.7
proxmox-widget-toolkit: 4.3.1
pve-cluster: 8.0.10
pve-container: 5.2.2
pve-docs: 8.3.1
pve-edk2-firmware: 4.2023.08-4
pve-esxi-import-tools: 0.7.2
pve-firewall: 5.1.0
pve-firmware: 3.14-1
pve-ha-manager: 4.0.6
pve-i18n: 3.3.1
pve-qemu-kvm: 9.0.2-4
pve-xtermjs: 5.3.0-3
qemu-server: 8.3.0
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.6-pve1
Linux beta 6.8.12-4-pve #1 SMP PREEMPT_DYNAMIC PMX 6.8.12-4 (2024-11-06T15:04Z) x86_64 GNU/Linux

--------------------
Group 0
0000
00
02
0: 0000:00:02.0 [0x038000] 0x8086:0x3e96 (i915)
Group 1
0000
00
00
0: 0000:00:00.0 [0x060000] 0x8086:0x3e18 (skl_uncore)
Group 2
0000
00
01
0: 0000:00:01.0 [0x060400] 0x8086:0x1901 (pcieport)
Group 3
0000
00
12
0: 0000:00:12.0 [0x118000] 0x8086:0xa379 (intel_pch_thermal)
Group 4
0000
00
14
0: 0000:00:14.0 [0x0c0330] 0x8086:0xa36d (xhci_hcd)
Group 4
0000
00
14
2: 0000:00:14.2 [0x050000] 0x8086:0xa36f (driver)
Group 5
0000
00
14
3: 0000:00:14.3 [0x028000] 0x8086:0xa370 (iwlwifi)
Group 6
0000
00
16
0: 0000:00:16.0 [0x078000] 0x8086:0xa360 (mei_me)
Group 7
0000
00
17
0: 0000:00:17.0 [0x010400] 0x8086:0x2822 (ahci)
Group 8
0000
00
1
0: 0000:00:1f.0 [0x060100] 0x8086:0xa309 (driver)
Group 8
0000
00
1
3: 0000:00:1f.3 [0x040300] 0x8086:0xa348 (snd_hda_intel)
Group 8
0000
00
1
4: 0000:00:1f.4 [0x0c0500] 0x8086:0xa323 (i801_smbus)
Group 8
0000
00
1
5: 0000:00:1f.5 [0x0c8000] 0x8086:0xa324 (intel-spi)
Group 8
0000
00
1
6: 0000:00:1f.6 [0x020000] 0x8086:0x15bb (e1000e)
Group 9
0000
01
00
0: 0000:01:00.0 [0x030000] 0x10de:0x1cbc (vfio-pci)
Group 10
0000
01
00
1: 0000:01:00.1 [0x040300] 0x10de:0x0fb9 (vfio-pci)
root@beta:~#

-------------------------
cat /etc/pve/qemu-server/101.conf
agent: 1
args: -cpu host,hv_vendor_id=proxmox,kvm=off
balloon: 1024
bios: ovmf
boot: order=ide0;ide2;net0
cores: 4
cpu: host
efidisk0: local:101/vm-101-disk-0.qcow2,efitype=4m,pre-enrolled-keys=1,size=528K
hostpci0: 01:00.0,pcie=1
hostpci1: 01:00.1,pcie=1
ide0: local:101/vm-101-disk-1.qcow2,size=100G,ssd=1
ide2: local:iso/win11.iso,media=cdrom,size=4018816K
machine: pc-q35-9.0
memory: 8192
meta: creation-qemu=9.0.2,ctime=1740603597
name: WIN100
net0: e1000=BC:24:11:48:07:96,bridge=vmbr0,firewall=1
numa: 0
ostype: win11
scsihw: virtio-scsi-single
smbios1: uuid=75be2d1d-911b-43e1-bcfd-934c0b44044d
sockets: 1
tpmstate0: local:101/vm-101-disk-2.raw,size=4M,version=v2.0
vmgenid: be32b7fd-981a-4115-91ac-07eab5664a13

----------------------

cat /etc/modprobe.d/vfio*
cat /etc/default/grub | grep CMDLINE
options vfio-pci ids=10de:1cbc,10de:0fb9 disable_vga=1 allow_unsafe_interrupts=1
options vfio_pci disable_reset=1 allow_unsafe_interrupts=1
options vfio_pci disable_reset=1
install vfio-pci /usr/local/sbin/vfio-pci-override.sh
#GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt"
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction"
GRUB_CMDLINE_LINUX=""


---------------------------

lspci -v -s 01:00.0
lspci -vnn | grep NVIDIA -A 12
01:00.0 VGA compatible controller: NVIDIA Corporation GP107GLM [Quadro P600 Mobile] (rev a1) (prog-if 00 [VGA controller])
Subsystem: Hewlett-Packard Company GP107GLM [Quadro P600 Mobile]
Flags: bus master, fast devsel, latency 0, IRQ 16, IOMMU group 9
Memory at e1000000 (32-bit, non-prefetchable) [size=16M]
Memory at b0000000 (64-bit, prefetchable) [size=256M]
Memory at c0000000 (64-bit, prefetchable) [size=32M]
I/O ports at 3000
Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [258] L1 PM Substates
Capabilities: [128] Power Budgeting <?>
Capabilities: [420] Advanced Error Reporting
Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] Secondary PCI Express
Kernel driver in use: vfio-pci
Kernel modules: nvidiafb, nouveau

01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP107GLM [Quadro P600 Mobile] [10de:1cbc] (rev a1) (prog-if 00 [VGA controller])
Subsystem: Hewlett-Packard Company GP107GLM [Quadro P600 Mobile] [103c:8458]
Flags: bus master, fast devsel, latency 0, IRQ 16, IOMMU group 9
Memory at e1000000 (32-bit, non-prefetchable) [size=16M]
Memory at b0000000 (64-bit, prefetchable) [size=256M]
Memory at c0000000 (64-bit, prefetchable) [size=32M]
I/O ports at 3000
Expansion ROM at 000c0000 [disabled] [size=128K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
--
01:00.1 Audio device [0403]: NVIDIA Corporation GP107GL High Definition Audio Controller [10de:0fb9] (rev a1)
Subsystem: Hewlett-Packard Company GP107GL High Definition Audio Controller [103c:8458]
Flags: bus master, fast devsel, latency 0, IRQ 17, IOMMU group 10
Memory at e2000000 (32-bit, non-prefetchable) [size=16K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel

root@beta:~#