Looking for some assistance/technical expertise with GPU Passthrough

V

variableman

New Member
Jun 14, 2021
19
2
3
58
Hey folks,

Owner of a Dell R720 running Proxmox 6.4-13. I have installed an Nvidia Quadro P400 and am looking to get GPU passthrough working on either a Windows 10 VM or a Debian-based Linux VM. I have followed the steps associated with GPU passthrough outlined on the Proxmox website but have, so far, been unsuccessful. I'd appreciate any guidance that might be provided in helping me understand what might be going wrong.

Steps Followed

I'm not sure what to provide but will start with the Proxmox syslog related to the starting of a debian linux VM I created using GPU passthrough. Cheers.

Aug 11 11:50:00 variableman systemd[1]: Starting Proxmox VE replication runner...
Aug 11 11:50:01 variableman systemd[1]: pvesr.service: Succeeded.
Aug 11 11:50:01 variableman systemd[1]: Started Proxmox VE replication runner.
Aug 11 11:50:28 variableman pvedaemon[3418056]: VM 109 qmp command failed - VM 109 not running
Aug 11 11:50:34 variableman pvedaemon[3418056]: <root@pam> starting task UPID:variableman:00373902:06B47D20:61141BFA:qmstart:109:root@pam:
Aug 11 11:50:34 variableman pvedaemon[3619074]: start VM 109: UPID:variableman:00373902:06B47D20:61141BFA:qmstart:109:root@pam:
Aug 11 11:50:34 variableman systemd[1]: Started 109.scope.
Aug 11 11:50:35 variableman systemd-udevd[3619081]: Using default interface naming scheme 'v240'.
Aug 11 11:50:35 variableman systemd-udevd[3619081]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Aug 11 11:50:35 variableman systemd-udevd[3619081]: Could not generate persistent MAC address for tap109i0: No such file or directory
Aug 11 11:50:35 variableman kernel: device tap109i0 entered promiscuous mode
Aug 11 11:50:35 variableman systemd-udevd[3619081]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Aug 11 11:50:35 variableman systemd-udevd[3619081]: Could not generate persistent MAC address for fwbr109i0: No such file or directory
Aug 11 11:50:35 variableman systemd-udevd[3619083]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Aug 11 11:50:35 variableman systemd-udevd[3619083]: Using default interface naming scheme 'v240'.
Aug 11 11:50:35 variableman systemd-udevd[3619083]: Could not generate persistent MAC address for fwpr109p0: No such file or directory
Aug 11 11:50:35 variableman systemd-udevd[3619085]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Aug 11 11:50:35 variableman systemd-udevd[3619085]: Using default interface naming scheme 'v240'.
Aug 11 11:50:35 variableman systemd-udevd[3619085]: Could not generate persistent MAC address for fwln109i0: No such file or directory
Aug 11 11:50:35 variableman kernel: fwbr109i0: port 1(fwln109i0) entered blocking state
Aug 11 11:50:35 variableman kernel: fwbr109i0: port 1(fwln109i0) entered disabled state
Aug 11 11:50:35 variableman kernel: device fwln109i0 entered promiscuous mode
Aug 11 11:50:35 variableman kernel: fwbr109i0: port 1(fwln109i0) entered blocking state
Aug 11 11:50:35 variableman kernel: fwbr109i0: port 1(fwln109i0) entered forwarding state
Aug 11 11:50:35 variableman kernel: vmbr0: port 4(fwpr109p0) entered blocking state
Aug 11 11:50:35 variableman kernel: vmbr0: port 4(fwpr109p0) entered disabled state
Aug 11 11:50:35 variableman kernel: device fwpr109p0 entered promiscuous mode
Aug 11 11:50:35 variableman kernel: vmbr0: port 4(fwpr109p0) entered blocking state
Aug 11 11:50:35 variableman kernel: vmbr0: port 4(fwpr109p0) entered forwarding state
Aug 11 11:50:35 variableman kernel: fwbr109i0: port 2(tap109i0) entered blocking state
Aug 11 11:50:35 variableman kernel: fwbr109i0: port 2(tap109i0) entered disabled state
Aug 11 11:50:35 variableman kernel: fwbr109i0: port 2(tap109i0) entered blocking state
Aug 11 11:50:35 variableman kernel: fwbr109i0: port 2(tap109i0) entered forwarding state
Aug 11 11:50:41 variableman pvedaemon[3605410]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Aug 11 11:50:42 variableman pvestatd[1485]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Aug 11 11:50:44 variableman pvestatd[1485]: status update time (7.213 seconds)
Aug 11 11:50:52 variableman pvestatd[1485]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Aug 11 11:50:53 variableman pvestatd[1485]: status update time (7.228 seconds)
Aug 11 11:51:00 variableman systemd[1]: Starting Proxmox VE replication runner...
Aug 11 11:51:01 variableman pvedaemon[3605410]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Aug 11 11:51:01 variableman systemd[1]: pvesr.service: Succeeded.
Aug 11 11:51:01 variableman systemd[1]: Started Proxmox VE replication runner.
Aug 11 11:51:02 variableman pvestatd[1485]: VM 109 qmp command failed - VM 109 qmp command 'query-proxmox-support' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Aug 11 11:51:02 variableman kernel: vfio-pci 0000:04:00.0: vfio_ecap_init: hiding ecap 0x19@0x900
Aug 11 11:51:03 variableman pvestatd[1485]: status update time (6.702 seconds)
Aug 11 11:51:04 variableman pvedaemon[3418056]: VM 109 qmp command failed - VM 109 qmp command 'human-monitor-command' failed - unable to connect to VM 109 qmp socket - timeout after 31 retries
Aug 11 11:51:04 variableman pvedaemon[3418056]: <root@pam> end task UPID:variableman:00373902:06B47D20:61141BFA:qmstart:109:root@pam: OK
Aug 11 11:51:13 variableman kernel: usb 1-1.4: reset full-speed USB device number 3 using ehci-pci
Aug 11 11:51:14 variableman kernel: usb 2-1.2: reset low-speed USB device number 3 using ehci-pci
Aug 11 11:51:59 variableman pvedaemon[3418056]: worker exit
Aug 11 11:51:59 variableman pvedaemon[1515]: worker 3418056 finished
 
Last edited:
Can you show us your IOMMU groups? for d in /sys/kernel/iommu_groups/*/devices/*; do n=${d#*/iommu_groups/*}; n=${n%%/*}; printf 'IOMMU group %s ' "$n"; lspci -nnks "${d##*/}"; done. And the VM configuration? cat /etc/pve/qemu-server/109.conf The log you provided does not give information about what went wrong, only that the VM appears to be non-responsive. Was there any more information in the VM 109 - Start task log in the Proxmox web GUI?

EDIT: Other people also have passthrough issues with Quadro P400. I found more post on this forum about R720 and none so far about successful passthrough, but maybe I did not search hard enough.
 
Last edited:
Thanks for taking a moment to reply, avw. Sadly, I haven't found any successful passthrough stories myself.

My VM Configuration:

Code: 
bios: ovmf
boot: order=scsi0;ide2;net0
cores: 8
efidisk0: local-lvm:vm-109-disk-1,size=4M
hostpci0: 0000:04:00,pcie=1,x-vga=1
ide2: local:iso/pop-os_20.10_amd64_intel_16.iso,media=cdrom
machine: q35
memory: 98304
name: pop-os-20.10
net0: virtio=D6:FD:99:15:7A:50,bridge=vmbr0,firewall=1
numa: 0
ostype: l26
scsi0: local-lvm:vm-109-disk-0,cache=writeback,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=42f5919c-d96e-4e0b-b0da-6d5a3952161c
sockets: 2
vmgenid: 98fb33ef-8646-4c5d-a9c9-74158fcd6974

I'll post the IOMMU group info sequentially (it takes me beyond the 15000 character limit).

Code: 
IOMMU group 0 00:00.0 Host bridge [0600]: Intel Corporation Xeon E5/Core i7 DMI2 [8086:3c00] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 DMI2 [1028:048c]
IOMMU group 10 00:16.0 Communication controller [0780]: Intel Corporation C600/X79 series chipset MEI Controller #1 [8086:1d3a] (rev 05)
        Subsystem: Dell C600/X79 series chipset MEI Controller [1028:048c]
        Kernel modules: mei_me
IOMMU group 10 00:16.1 Communication controller [0780]: Intel Corporation C600/X79 series chipset MEI Controller #2 [8086:1d3b] (rev 05)
        Subsystem: Dell C600/X79 series chipset MEI Controller [1028:048c]
IOMMU group 11 00:1a.0 USB controller [0c03]: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #2 [8086:1d2d] (rev 05)
        Subsystem: Dell C600/X79 series chipset USB2 Enhanced Host Controller [1028:048c]
        Kernel driver in use: ehci-pci
        Kernel modules: ehci_pci
IOMMU group 12 00:1c.0 PCI bridge [0604]: Intel Corporation C600/X79 series chipset PCI Express Root Port 1 [8086:1d10] (rev b5)
        Kernel driver in use: pcieport
IOMMU group 13 00:1c.7 PCI bridge [0604]: Intel Corporation C600/X79 series chipset PCI Express Root Port 8 [8086:1d1e] (rev b5)
        Kernel driver in use: pcieport
IOMMU group 14 00:1d.0 USB controller [0c03]: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #1 [8086:1d26] (rev 05)
        Subsystem: Dell C600/X79 series chipset USB2 Enhanced Host Controller [1028:048c]
        Kernel driver in use: ehci-pci
        Kernel modules: ehci_pci
IOMMU group 15 00:1e.0 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev a5)
IOMMU group 16 00:1f.0 ISA bridge [0601]: Intel Corporation C600/X79 series chipset LPC Controller [8086:1d41] (rev 05)
        Subsystem: Dell C600/X79 series chipset LPC Controller [1028:048c]
        Kernel driver in use: lpc_ich
        Kernel modules: lpc_ich
IOMMU group 16 00:1f.2 SATA controller [0106]: Intel Corporation C600/X79 series chipset 6-Port SATA AHCI Controller [8086:1d02] (rev 05)
        Subsystem: Dell C600/X79 series chipset 6-Port SATA AHCI Controller [1028:048c]
        Kernel driver in use: ahci
        Kernel modules: ahci
IOMMU group 17 01:00.0 Ethernet controller [0200]: Broadcom Limited NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:165f]
        Subsystem: Dell NetXtreme BCM5720 2-port Gigabit Ethernet PCIe [1028:1f5b]
        Kernel driver in use: tg3
        Kernel modules: tg3
IOMMU group 17 01:00.1 Ethernet controller [0200]: Broadcom Limited NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:165f]
        Subsystem: Dell NetXtreme BCM5720 2-port Gigabit Ethernet PCIe [1028:1f5b]
        Kernel driver in use: tg3
        Kernel modules: tg3
IOMMU group 18 02:00.0 Ethernet controller [0200]: Broadcom Limited NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:165f]
        Subsystem: Dell NetXtreme BCM5720 2-port Gigabit Ethernet PCIe [1028:1f5b]
        Kernel driver in use: tg3
        Kernel modules: tg3
IOMMU group 18 02:00.1 Ethernet controller [0200]: Broadcom Limited NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:165f]
        Subsystem: Dell NetXtreme BCM5720 2-port Gigabit Ethernet PCIe [1028:1f5b]
        Kernel driver in use: tg3
        Kernel modules: tg3
IOMMU group 19 03:00.0 RAID bus controller [0104]: LSI Logic / Symbios Logic MegaRAID SAS 2208 [Thunderbolt] [1000:005b] (rev 01)
        Subsystem: Dell PERC H710P Mini (for monolithics) [1028:1f34]
        Kernel driver in use: megaraid_sas
        Kernel modules: megaraid_sas
IOMMU group 1 00:01.0 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1a [8086:3c02] (rev 07)
        Kernel driver in use: pcieport
IOMMU group 20 04:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP107GL [Quadro P400] [10de:1cb3] (rev a1)
        Subsystem: Hewlett-Packard Company GP107GL [Quadro P400] [103c:11be]
        Kernel driver in use: vfio-pci
        Kernel modules: nvidiafb, nouveau
IOMMU group 20 04:00.1 Audio device [0403]: NVIDIA Corporation GP107GL High Definition Audio Controller [10de:0fb9] (rev a1)
        Subsystem: Hewlett-Packard Company GP107GL High Definition Audio Controller [103c:11be]
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
IOMMU group 21 09:00.0 PCI bridge [0604]: Renesas Technology Corp. SH7757 PCIe Switch [PS] [1912:0013]
        Kernel driver in use: pcieport
IOMMU group 22 0a:00.0 PCI bridge [0604]: Renesas Technology Corp. SH7757 PCIe Switch [PS] [1912:0013]
        Kernel driver in use: pcieport
IOMMU group 22 0b:00.0 PCI bridge [0604]: Renesas Technology Corp. SH7757 PCIe-PCI Bridge [PPB] [1912:0012]
IOMMU group 22 0c:00.0 VGA compatible controller [0300]: Matrox Electronics Systems Ltd. G200eR2 [102b:0534]
        Subsystem: Dell G200eR2 [1028:048c]
        Kernel driver in use: mgag200
        Kernel modules: mgag200
IOMMU group 23 0a:01.0 PCI bridge [0604]: Renesas Technology Corp. SH7757 PCIe Switch [PS] [1912:0013]
        Kernel driver in use: pcieport
IOMMU group 24 3f:08.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 QPI Link 0 [8086:3c80] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 QPI Link 0 [8086:0000]
IOMMU group 25 3f:09.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 QPI Link 1 [8086:3c90] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 QPI Link 1 [8086:0000]
IOMMU group 26 3f:0a.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 [8086:3cc0] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 [8086:0000]
IOMMU group 26 3f:0a.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 [8086:3cc1] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 [8086:0000]
IOMMU group 26 3f:0a.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 [8086:3cc2] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 [8086:0000]
IOMMU group 26 3f:0a.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 [8086:3cd0] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 [8086:0000]
IOMMU group 27 3f:0b.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers [8086:3ce0] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers [8086:0000]
IOMMU group 27 3f:0b.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers [8086:3ce3] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers [8086:0000]
IOMMU group 28 3f:0c.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 28 3f:0c.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 28 3f:0c.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 28 3f:0c.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 28 3f:0c.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 [8086:3cf4] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 [8086:0000]
IOMMU group 28 3f:0c.7 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 System Address Decoder [8086:3cf6] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 System Address Decoder [8086:0000]
IOMMU group 29 3f:0d.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 29 3f:0d.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 29 3f:0d.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 29 3f:0d.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 29 3f:0d.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 [8086:3cf5] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 [8086:0000]
IOMMU group 2 00:01.1 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1b [8086:3c03] (rev 07)
        Kernel driver in use: pcieport
 
Last edited:
Code: 
IOMMU group 30 3f:0e.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Processor Home Agent [8086:3ca0] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Processor Home Agent [1028:048c]
IOMMU group 30 3f:0e.1 Performance counters [1101]: Intel Corporation Xeon E5/Core i7 Processor Home Agent Performance Monitoring [8086:3c46] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Processor Home Agent Performance Monitoring [1028:048c]
        Kernel driver in use: snbep_uncore
IOMMU group 31 3f:0f.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers [8086:3ca8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers [8086:0000]
IOMMU group 32 3f:0f.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers [8086:3c71] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers [8086:0000]
IOMMU group 33 3f:0f.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 [8086:3caa] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 [8086:0000]
IOMMU group 34 3f:0f.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 [8086:3cab] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 [8086:0000]
IOMMU group 35 3f:0f.4 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 [8086:3cac] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 [8086:0000]
IOMMU group 36 3f:0f.5 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 [8086:3cad] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 [8086:0000]
IOMMU group 37 3f:0f.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 [8086:3cae] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 [8086:0000]
IOMMU group 38 3f:10.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 [8086:3cb0] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 [8086:0000]
        Kernel driver in use: snbep_uncore
IOMMU group 39 3f:10.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 [8086:3cb1] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 [8086:0000]
        Kernel driver in use: snbep_uncore
IOMMU group 3 00:02.0 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2a [8086:3c04] (rev 07)
        Kernel driver in use: pcieport
IOMMU group 40 3f:10.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 [8086:3cb2] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 [8086:0000]
IOMMU group 41 3f:10.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 [8086:3cb3] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 [8086:0000]
IOMMU group 42 3f:10.4 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 [8086:3cb4] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 [8086:0000]
        Kernel driver in use: snbep_uncore
IOMMU group 43 3f:10.5 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 [8086:3cb5] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 [8086:0000]
        Kernel driver in use: snbep_uncore
IOMMU group 44 3f:10.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 [8086:3cb6] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 [8086:0000]
IOMMU group 45 3f:10.7 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 [8086:3cb7] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 [8086:0000]
IOMMU group 46 3f:11.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 DDRIO [8086:3cb8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 DDRIO [8086:0000]
IOMMU group 47 3f:13.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 R2PCIe [8086:3ce4] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 R2PCIe [8086:0000]
IOMMU group 47 3f:13.1 Performance counters [1101]: Intel Corporation Xeon E5/Core i7 Ring to PCI Express Performance Monitor [8086:3c43] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Ring to PCI Express Performance Monitor [1028:048c]
        Kernel driver in use: snbep_uncore
IOMMU group 47 3f:13.4 Performance counters [1101]: Intel Corporation Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers [8086:3ce6] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers [1028:048c]
IOMMU group 47 3f:13.5 Performance counters [1101]: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor [8086:3c44] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor [1028:048c]
        Kernel driver in use: snbep_uncore
IOMMU group 47 3f:13.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor [8086:3c45] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor [1028:048c]
        Kernel driver in use: snbep_uncore
IOMMU group 48 40:01.0 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1a [8086:3c02] (rev 07)
        Kernel driver in use: pcieport
IOMMU group 49 40:02.0 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2a [8086:3c04] (rev 07)
        Kernel driver in use: pcieport
IOMMU group 4 00:02.2 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2c [8086:3c06] (rev 07)
        Kernel driver in use: pcieport
IOMMU group 50 40:03.0 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3a in PCI Express Mode [8086:3c08] (rev 07)
        Kernel driver in use: pcieport
IOMMU group 51 40:03.2 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3c [8086:3c0a] (rev 07)
        Kernel driver in use: pcieport
IOMMU group 52 40:05.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Address Map, VTd_Misc, System Management [8086:3c28] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Address Map, VTd_Misc, System Management [1028:048c]
IOMMU group 53 40:05.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Control Status and Global Errors [8086:3c2a] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Control Status and Global Errors [1028:048c]
IOMMU group 54 7f:08.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 QPI Link 0 [8086:3c80] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 QPI Link 0 [8086:0000]
IOMMU group 55 7f:09.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 QPI Link 1 [8086:3c90] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 QPI Link 1 [8086:0000]
IOMMU group 56 7f:0a.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 [8086:3cc0] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 [8086:0000]
IOMMU group 56 7f:0a.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 [8086:3cc1] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 [8086:0000]
IOMMU group 56 7f:0a.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 [8086:3cc2] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 [8086:0000]
IOMMU group 56 7f:0a.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 [8086:3cd0] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 [8086:0000]
IOMMU group 57 7f:0b.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers [8086:3ce0] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers [8086:0000]
IOMMU group 57 7f:0b.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers [8086:3ce3] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers [8086:0000]
IOMMU group 58 7f:0c.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 58 7f:0c.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 58 7f:0c.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 58 7f:0c.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 58 7f:0c.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 [8086:3cf4] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 [8086:0000]
IOMMU group 58 7f:0c.7 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 System Address Decoder [8086:3cf6] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 System Address Decoder [8086:0000]
IOMMU group 59 7f:0d.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 59 7f:0d.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 59 7f:0d.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 59 7f:0d.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:3ce8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Unicast Register 0 [8086:0000]
IOMMU group 59 7f:0d.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 [8086:3cf5] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 [8086:0000]
IOMMU group 5 00:03.0 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3a in PCI Express Mode [8086:3c08] (rev 07)
        Kernel driver in use: pcieport
 
Code: 
IOMMU group 60 7f:0e.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Processor Home Agent [8086:3ca0] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Processor Home Agent [1028:048c]
IOMMU group 60 7f:0e.1 Performance counters [1101]: Intel Corporation Xeon E5/Core i7 Processor Home Agent Performance Monitoring [8086:3c46] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Processor Home Agent Performance Monitoring [1028:048c]
        Kernel driver in use: snbep_uncore
IOMMU group 61 7f:0f.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers [8086:3ca8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers [8086:0000]
IOMMU group 62 7f:0f.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers [8086:3c71] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers [8086:0000]
IOMMU group 63 7f:0f.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 [8086:3caa] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 [8086:0000]
IOMMU group 64 7f:0f.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 [8086:3cab] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 [8086:0000]
IOMMU group 65 7f:0f.4 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 [8086:3cac] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 [8086:0000]
IOMMU group 66 7f:0f.5 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 [8086:3cad] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 [8086:0000]
IOMMU group 67 7f:0f.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 [8086:3cae] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 [8086:0000]
IOMMU group 68 7f:10.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 [8086:3cb0] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 [8086:0000]
        Kernel driver in use: snbep_uncore
IOMMU group 69 7f:10.1 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 [8086:3cb1] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 [8086:0000]
        Kernel driver in use: snbep_uncore
IOMMU group 6 00:03.2 PCI bridge [0604]: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3c [8086:3c0a] (rev 07)
        Kernel driver in use: pcieport
IOMMU group 70 7f:10.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 [8086:3cb2] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 [8086:0000]
IOMMU group 71 7f:10.3 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 [8086:3cb3] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 [8086:0000]
IOMMU group 72 7f:10.4 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 [8086:3cb4] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 [8086:0000]
        Kernel driver in use: snbep_uncore
IOMMU group 73 7f:10.5 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 [8086:3cb5] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 [8086:0000]
        Kernel driver in use: snbep_uncore
IOMMU group 74 7f:10.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 [8086:3cb6] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 [8086:0000]
IOMMU group 75 7f:10.7 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 [8086:3cb7] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 [8086:0000]
IOMMU group 76 7f:11.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 DDRIO [8086:3cb8] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 DDRIO [8086:0000]
IOMMU group 77 7f:13.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 R2PCIe [8086:3ce4] (rev 07)
        Subsystem: Intel Corporation Xeon E5/Core i7 R2PCIe [8086:0000]
IOMMU group 77 7f:13.1 Performance counters [1101]: Intel Corporation Xeon E5/Core i7 Ring to PCI Express Performance Monitor [8086:3c43] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Ring to PCI Express Performance Monitor [1028:048c]
        Kernel driver in use: snbep_uncore
IOMMU group 77 7f:13.4 Performance counters [1101]: Intel Corporation Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers [8086:3ce6] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers [1028:048c]
IOMMU group 77 7f:13.5 Performance counters [1101]: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor [8086:3c44] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor [1028:048c]
        Kernel driver in use: snbep_uncore
IOMMU group 77 7f:13.6 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor [8086:3c45] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor [1028:048c]
        Kernel driver in use: snbep_uncore
IOMMU group 7 00:05.0 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Address Map, VTd_Misc, System Management [8086:3c28] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Address Map, VTd_Misc, System Management [1028:048c]
IOMMU group 8 00:05.2 System peripheral [0880]: Intel Corporation Xeon E5/Core i7 Control Status and Global Errors [8086:3c2a] (rev 07)
        Subsystem: Dell Xeon E5/Core i7 Control Status and Global Errors [1028:048c]
IOMMU group 9 00:11.0 PCI bridge [0604]: Intel Corporation C600/X79 series chipset PCI Express Virtual Root Port [8086:1d3e] (rev 05)
        Kernel driver in use: pcieport
 
For completeness.

My grub file entry (note that I have tried the commented version as well):
#GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb:off,efifb:off"
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on"
Click to expand...
My modules file:
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.

vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd
Click to expand...
root@variableman:~# dmesg | grep 'remapping'
[ 0.797268] DMAR-IR: Enabled IRQ remapping in xapic mode
[ 0.797268] x2apic: IRQ remapping doesn't support X2APIC mode
Click to expand...
Modified /etc/modprobe.d/iommu_unsafe_interrupts.conf
options vfio_iommu_type1 allow_unsafe_interrupts=1
Click to expand...
Output of lspci -v command regarding GPU
04:00.0 VGA compatible controller: NVIDIA Corporation GP107GL [Quadro P400] (rev a1) (prog-if 00 [VGA controller])
Subsystem: Hewlett-Packard Company GP107GL [Quadro P400]
Flags: fast devsel, IRQ 15, NUMA node 0
Memory at d8000000 (32-bit, non-prefetchable) [disabled] [size=16M]
Memory at b0000000 (64-bit, prefetchable) [disabled] [size=256M]
Memory at ce000000 (64-bit, prefetchable) [disabled] [size=32M]
I/O ports at ec80 [disabled]
Expansion ROM at d9000000 [disabled] [size=512K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Legacy Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [128] Power Budgeting <?>
Capabilities: [420] Advanced Error Reporting
Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] #19
Kernel driver in use: vfio-pci
Kernel modules: nvidiafb, nouveau

04:00.1 Audio device: NVIDIA Corporation GP107GL High Definition Audio Controller (rev a1)
Subsystem: Hewlett-Packard Company GP107GL High Definition Audio Controller
Flags: bus master, fast devsel, latency 0, IRQ 14, NUMA node 0
Memory at d9ffc000 (32-bit, non-prefetchable) [size=16K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
Click to expand...
 
Your IOMMU group 20 looks good because it only contains the P400. This also indicates that VFIO (PCI passthrough) is enabled on your system. There is no need for pcie_acs_override of any kind. (If you ever need the video= settings, please note that you cannot pass both of those options like that: you need to separate them into two video= settings.) Do you really need allow_unsafe_interrupts?

If you do a lspci -vv -s 04:00.0, it will show if the device support Function Level Reset (FLReset+) or not.

Are you booting with the Matrox/Dell G200eR2 GPU and not seeing any output on the P400 during POST/BIOS/boot? Then you don't need nofb nomodeset video= kernel parameters. Also, those settings make if really hard to troubleshoot because there is no console (when done correctly). If the P400 is used during POST/BIOS, please change some BIOS setting to make it use the other GPU.

It might help if you make sure the nvidiafb and nouveau drivers don't touch the P400. You can do that by blacklisting them or adding a configuration file to /etc/modprobe.d/ that binds vfio-pci to the P400 before loading those other two possible drivers. Or you can add vfio-pci.ids=10de:1cb3,10de:0fb9 to GRUB or /etc/kernel/cmdline (depending on which one is actually used, use cat /proc/cmdline to check which kernel options are actually passed).
 
I think I have blacklisted the drivers.
root@variableman:~# cat /etc/modprobe.d/blacklist.conf
blacklist nouveau
blacklist nvidia
blacklist radeon
Click to expand...
Currently, I have nothing connected to the Quadro P400. The monitor on the server is connected to the server GPU. I'm trying to backtrack to see if I had everything I needed for the GPU install. I'm seeing a reference to a GPU power cable which I do no have. I'm trying to run that to ground now.

I may have things in a frankenstein state because of my troubleshooting. Throwing darts after the first try failed.
 
Did you do a update-initramfs -u and reboot after making changes to files in /etc/modprobe.d/?
Are you seeing the POST/BIOS on the "server GPU"?
I don't know which brand P400 you have, but it does not look like a card that has additional power connectors except for the PCIe slot itself.
 
Not sure what you are asking with, "Are you seeing the POST/BIOS on the server GPU?"

I will do update-initramfs -u. I don't expressly remember that command. I'll reboot and get back to you. And I agree that there doesn't seem to be a need for additional connectors for my GPU.
 
Last edited:
Sorry for being unclear, I will try to be more explicit about my question:
I assume that the system displays Power On Self Test (POST) information on a monitor when you power it on. Probably something like a Dell logo when a prompt to press a certain key to enter the BIOS or UEFI screens. Do you see something like that when you reboot the system? Is the monitor where you see that connected to the P400 or not?

Can you connect the P400 to a monitor and check what it does not display anything (until you start the VM with passthrough)? Then we will know that nothing touched the P400 (if the monitor is working correctly). And then you can try the vfio-pci.ids=10de:1cb3,10de:0fb9 kernel parameters (for example by pressing e in the GRUB boot menu or systemd-boot boot menu and adding it once just to try).
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom