[SOLVED] NIC stopped working while GPU Passthrough

D

dofus

Member
Feb 24, 2021
25
2
8
Hello All,
I have tried to do GPU passthrough using this link also seen Techno Tim Youtube video for reference.
But my Proxmox Server keeps dropping networking and GPU passthrough also doesn't work.
I run alot of networking VMs via Addon NIC cards to my Proxmox server.

I will appreciate if anyone can help me

Here are Specs of my Proxmox Server:

Lenovo C30 2xE5-2640V2
32Gb Ram
1TB 7200
300Gb SAS Drive
4 Port NIC (Gigabit)
2 Port NIC (Gigabit)


Happy to Supply config if that helps understanding issue much better :)

Thanks

===========================================
VM Config
===================
root@pve:/etc/pve/qemu-server# cat 108.conf
agent: 1
args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off'
balloon: 1024
bios: ovmf
boot: order=scsi0;ide2
cores: 4
cpu: host,hidden=1,flags=+pcid
efidisk0: nas:108/vm-108-disk-0.qcow2,size=128K
hostpci0: 03:00,pcie=1,romfile=NVIDIA.QuadroK4000.3072.120813.rom
ide0: GB320:iso/virtio-win-0.1.190.iso,media=cdrom,size=489986K
ide2: GB320:iso/Windows.iso,media=cdrom
machine: q35
memory: 8192
name: Win-10
net0: virtio=52:7F:61:A6:42:CF,bridge=vmbr3,firewall=1
numa: 0
ostype: win10
scsi0: nas:108/vm-108-disk-1.qcow2,cache=writeback,size=60G
scsihw: virtio-scsi-pci
smbios1: uuid=89c07a16-89d5-437b-b7a8-4034d4aa8f34
sockets: 2
vmgenid: 138d7b2f-17ea-4f2d-936a-ca07f85361ba
===================
Grub configuration
===================
# If you change this file, run 'update-grub' afterwards to update
# /boot/grub/grub.cfg.
# For full documentation of the options in this file, see:
# info -f grub -n 'Simple configuration'

GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR="Proxmox Virtual Environment"
#GRUB_CMDLINE_LINUX_DEFAULT="quiet"
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on"
#GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on pcie_acs_override=downstream,multifunction video=efifb:eek:ff"
GRUB_CMDLINE_LINUX=""

# Disable os-prober, it might add menu entries for each guest
GRUB_DISABLE_OS_PROBER=true

# Uncomment to enable BadRAM filtering, modify to suit your needs
# This works with Linux (no patch required) and with any kernel that obtains
# the memory map information from GRUB (GNU Mach, kernel of FreeBSD ...)
#GRUB_BADRAM="0x01234567,0xfefefefe,0x89abcdef,0xefefefef"

# Uncomment to disable graphical terminal (grub-pc only)
#GRUB_TERMINAL=console

# The resolution used on graphical terminal
# note that you can use only modes which your graphic card supports via VBE
# you can see them in real GRUB with the command `vbeinfo'
#GRUB_GFXMODE=640x480

# Uncomment if you don't want GRUB to pass "root=UUID=xxx" parameter to Linux
#GRUB_DISABLE_LINUX_UUID=true

# Disable generation of recovery mode menu entries
GRUB_DISABLE_RECOVERY="true"

# Uncomment to get a beep at grub start
#GRUB_INIT_TUNE="480 440 1"

===================
Modules
===================
root@pve:/# cat /etc/modules
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.

vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd


root@pve:# cat /etc/modprobe.d/iommu_unsafe_interrupts.conf
options vfio_iommu_type1 allow_unsafe_interrupts=1

root@pve:/# cat /etc/modprobe.d/kvm.conf
options kvm ignore_msrs=1


root@pve:/# cat /etc/modprobe.d/blacklist.conf
blacklist nvidia
blacklist nvidiafb
blacklist nouveau


root@pve:/# lspci -n -s 03:00
03:00.0 0300: 10de:11fa (rev a1)
03:00.1 0403: 10de:0e0b (rev a1)

root@pve:/# cat /etc/modprobe.d/vfio.conf
options vfio-pci ids=10de:11fa,10de:0e0b disable_vga=1
=============================
 
Last edited:
Can you show us your IOMMU groups by way of running for d in /sys/kernel/iommu_groups/*/devices/*; do n=${d#*/iommu_groups/*}; n=${n%%/*}; printf 'IOMMU group %s ' "$n"; lspci -nns "${d##*/}"; done? If one device disappears when passing through another, they are often in the same group.
 
avw said:
Can you show us your IOMMU groups by way of running for d in /sys/kernel/iommu_groups/*/devices/*; do n=${d#*/iommu_groups/*}; n=${n%%/*}; printf 'IOMMU group %s ' "$n"; lspci -nns "${d##*/}"; done? If one device disappears when passing through another, they are often in the same group.
Click to expand...
Can you show us your IOMMU groups by way of running for d in /sys/kernel/iommu_groups/*/devices/*; do n=${d#*/iommu_groups/*}; n=${n%%/*}; printf 'IOMMU group %s ' "$n"; lspci -nns "${d##*/}"; done? If one device disappears when passing through another, they are often in the same group.

Here is the output, its group 30 for Nvidia GPU

root@pve:/var/log# for d in /sys/kernel/iommu_groups/*/devices/*; do n=${d#*/iommu_groups/*}; n=${n%%/*}; printf 'IOMMU group %s ' "$n"; lspci -nns "${d##*/}"; done
IOMMU group 0 00:00.0 Host bridge [0600]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 DMI2 [8086:0e00] (rev 04)
IOMMU group 10 00:04.5 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 5 [8086:0e25] (rev 04)
IOMMU group 11 00:04.6 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 6 [8086:0e26] (rev 04)
IOMMU group 12 00:04.7 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 7 [8086:0e27] (rev 04)
IOMMU group 13 00:05.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 VTd/Memory Map/Misc [8086:0e28] (rev 04)
IOMMU group 14 00:05.2 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 IIO RAS [8086:0e2a] (rev 04)
IOMMU group 15 00:05.4 PIC [0800]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 IOAPIC [8086:0e2c] (rev 04)
IOMMU group 16 00:11.0 PCI bridge [0604]: Intel Corporation C600/X79 series chipset PCI Express Virtual Root Port [8086:1d3e] (rev 06)
IOMMU group 17 00:16.0 Communication controller [0780]: Intel Corporation C600/X79 series chipset MEI Controller #1 [8086:1d3a] (rev 05)
IOMMU group 17 00:16.2 IDE interface [0101]: Intel Corporation C600/X79 series chipset IDE-r Controller [8086:1d3c] (rev 05)
IOMMU group 17 00:16.3 Serial controller [0700]: Intel Corporation C600/X79 series chipset KT Controller [8086:1d3d] (rev 05)
IOMMU group 18 00:19.0 Ethernet controller [0200]: Intel Corporation 82579LM Gigabit Network Connection [8086:1502] (rev 06)
IOMMU group 19 00:1a.0 USB controller [0c03]: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #2 [8086:1d2d] (rev 06)
IOMMU group 1 00:01.0 PCI bridge [0604]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 1a [8086:0e02] (rev 04)
IOMMU group 20 00:1b.0 Audio device [0403]: Intel Corporation C600/X79 series chipset High Definition Audio Controller [8086:1d20] (rev 06)
IOMMU group 21 00:1c.0 PCI bridge [0604]: Intel Corporation C600/X79 series chipset PCI Express Root Port 1 [8086:1d10] (rev b6)
IOMMU group 22 00:1c.4 PCI bridge [0604]: Intel Corporation C600/X79 series chipset PCI Express Root Port 5 [8086:1d18] (rev b6)
IOMMU group 23 00:1d.0 USB controller [0c03]: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #1 [8086:1d26] (rev 06)
IOMMU group 24 00:1e.0 PCI bridge [0604]: Intel Corporation 82801 PCI Bridge [8086:244e] (rev a6)
IOMMU group 25 00:1f.0 ISA bridge [0601]: Intel Corporation C600/X79 series chipset LPC Controller [8086:1d41] (rev 06)
IOMMU group 25 00:1f.2 SATA controller [0106]: Intel Corporation C600/X79 series chipset 6-Port SATA AHCI Controller [8086:1d02] (rev 06)
IOMMU group 25 00:1f.3 SMBus [0c05]: Intel Corporation C600/X79 series chipset SMBus Host Controller [8086:1d22] (rev 06)
IOMMU group 25 00:1f.6 Signal processing controller [1180]: Intel Corporation C600/X79 series chipset Thermal Management Controller [8086:1d24] (rev 06)
IOMMU group 26 02:00.0 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU group 27 02:00.1 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU group 28 02:00.2 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU group 29 02:00.3 Ethernet controller [0200]: Intel Corporation 82580 Gigabit Network Connection [8086:150e] (rev 01)
IOMMU group 2 00:01.1 PCI bridge [0604]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 1b [8086:0e03] (rev 04)
IOMMU group 30 03:00.0 VGA compatible controller [0300]: NVIDIA Corporation GK106GL [Quadro K4000] [10de:11fa] (rev a1)
IOMMU group 30 03:00.1 Audio device [0403]: NVIDIA Corporation GK106 HDMI Audio Controller [10de:0e0b] (rev a1)
IOMMU group 31 05:00.0 Serial Attached SCSI controller [0107]: Intel Corporation C602 chipset 4-Port SATA Storage Control Unit [8086:1d6b] (rev 06)
IOMMU group 32 06:00.0 PCI bridge [0604]: Intel Corporation 41210 [Lanai] Serial to Parallel PCI Bridge (A-Segment Bridge) [8086:0340] (rev 09)
IOMMU group 32 06:00.2 PCI bridge [0604]: Intel Corporation 41210 [Lanai] Serial to Parallel PCI Bridge (B-Segment Bridge) [8086:0341] (rev 09)
IOMMU group 32 07:04.0 Ethernet controller [0200]: Broadcom Limited NetXtreme II BCM5706 Gigabit Ethernet [14e4:164a] (rev 02)
IOMMU group 32 08:05.0 Ethernet controller [0200]: Broadcom Limited NetXtreme II BCM5706 Gigabit Ethernet [14e4:164a] (rev 02)
IOMMU group 33 09:00.0 USB controller [0c03]: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller [1912:0014] (rev 03)
IOMMU group 34 1f:08.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 0 [8086:0e80] (rev 04)
IOMMU group 35 1f:09.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Link 1 [8086:0e90] (rev 04)
IOMMU group 36 1f:0a.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 0 [8086:0ec0] (rev 04)
IOMMU group 36 1f:0a.1 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 1 [8086:0ec1] (rev 04)
IOMMU group 36 1f:0a.2 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 2 [8086:0ec2] (rev 04)
IOMMU group 36 1f:0a.3 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Power Control Unit 3 [8086:0ec3] (rev 04)
IOMMU group 37 1f:0b.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers [8086:0e1e] (rev 04)
IOMMU group 37 1f:0b.3 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 UBOX Registers [8086:0e1f] (rev 04)
IOMMU group 38 1f:0c.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers [8086:0ee0] (rev 04)
IOMMU group 38 1f:0c.1 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers [8086:0ee2] (rev 04)
IOMMU group 38 1f:0c.2 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers [8086:0ee4] (rev 04)
IOMMU group 38 1f:0c.3 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers [8086:0ee6] (rev 04)
IOMMU group 39 1f:0d.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers [8086:0ee1] (rev 04)
IOMMU group 39 1f:0d.1 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers [8086:0ee3] (rev 04)
IOMMU group 39 1f:0d.2 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers [8086:0ee5] (rev 04)
IOMMU group 39 1f:0d.3 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Unicast Registers [8086:0ee7] (rev 04)
IOMMU group 3 00:02.0 PCI bridge [0604]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 2a [8086:0e04] (rev 04)
IOMMU group 40 1f:0e.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0 [8086:0ea0] (rev 04)
IOMMU group 40 1f:0e.1 Performance counters [1101]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Home Agent 0 [8086:0e30] (rev 04)
IOMMU group 41 1f:0f.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Target Address/Thermal Registers [8086:0ea8] (rev 04)
IOMMU group 42 1f:0f.1 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 RAS Registers [8086:0e71] (rev 04)
IOMMU group 43 1f:0f.2 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers [808... (rev 04)
IOMMU group 44 1f:0f.3 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers [808... (rev 04)
IOMMU group 45 1f:0f.4 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers [808... (rev 04)
IOMMU group 46 1f:0f.5 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder Registers [808... (rev 04)
IOMMU group 47 1f:10.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 0 [8086:0eb0] (rev 04)
IOMMU group 48 1f:10.1 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 1 [8086:0eb1] (rev 04)
IOMMU group 49 1f:10.2 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 0 [8086:0eb2] (rev 04)
IOMMU group 4 00:03.0 PCI bridge [0604]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 PCI Express Root Port 3a [8086:0e08] (rev 04)
IOMMU group 50 1f:10.3 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 1 [8086:0eb3] (rev 04)
IOMMU group 51 1f:10.4 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 2 [8086:0eb4] (rev 04)
IOMMU group 52 1f:10.5 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 Thermal Control 3 [8086:0eb5] (rev 04)
IOMMU group 53 1f:10.6 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 2 [8086:0eb6] (rev 04)
IOMMU group 54 1f:10.7 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Integrated Memory Controller 1 Channel 0-3 ERROR Registers 3 [8086:0eb7] (rev 04)
IOMMU group 55 1f:13.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe [8086:0e1d] (rev 04)
IOMMU group 55 1f:13.1 Performance counters [1101]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 R2PCIe [8086:0e34] (rev 04)
IOMMU group 55 1f:13.4 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Registers [8086:0e81] (rev 04)
IOMMU group 55 1f:13.5 Performance counters [1101]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 QPI Ring Performance Ring Monitoring [8086:0e36] (rev 04)
IOMMU group 56 1f:16.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 System Address Decoder [8086:0ec8] (rev 04)
IOMMU group 56 1f:16.1 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers [8086:0ec9] (rev 04)
IOMMU group 56 1f:16.2 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Broadcast Registers [8086:0eca] (rev 04)
IOMMU group 57 20:04.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 0 [8086:0e20] (rev 04)
IOMMU group 58 20:04.1 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 1 [8086:0e21] (rev 04)
IOMMU group 59 20:04.2 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 2 [8086:0e22] (rev 04)
IOMMU group 5 00:04.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 0 [8086:0e20] (rev 04)
IOMMU group 60 20:04.3 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 3 [8086:0e23] (rev 04)
IOMMU group 61 20:04.4 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 4 [8086:0e24] (rev 04)
IOMMU group 62 20:04.5 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 5 [8086:0e25] (rev 04)
IOMMU group 63 20:04.6 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 6 [8086:0e26] (rev 04)
IOMMU group 64 20:04.7 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 Crystal Beach DMA Channel 7 [8086:0e27] (rev 04)
IOMMU group 65 20:05.0 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 VTd/Memory Map/Misc [8086:0e28] (rev 04)
IOMMU group 66 20:05.2 System peripheral [0880]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 IIO RAS [8086:0e2a] (rev 04)
IOMMU group 67 20:05.4 PIC [0800]: Intel Corporation Xeon E7 v2/Xeon E5 v2/Core i7 IOAPIC [8086:0e2c] (rev 04)

Also later today I followed Proxmox Wiki for GPu passthrough link .



i checked rom for UEFI compatibility. Here is the output.



root@pve:~/rom-parser# ./rom-parser /tmp/image.rom
Valid ROM signature found @0h, PCIR offset 190h
PCIR: type 0 (x86 PC-AT), vendor: 10de, device: 11fa, class: 030000
PCIR: revision 0, vendor revision: 1
Error, ran off the end


Do you think this can case issues as rom does not show type=3 ?



I also updated grub with video=vesafb:off video=efifb:off but yet to try.
 
It is alone in a group, that's good. It appears to be your only GPU, which means that you might need to video= lines (and will have no output on screen during boot) for it to work. Personally, I have no experience with NVidia, but it might not detach properly from the host (see previous sentence) if it was used by the host during boot. You might also need the x-vga=on option for hostpci for NVidia cards.
All this will be easier to try if you could boot the system from another GPU, so you could at least see the host kernel messages on screen while starting the VM with PCI passthrough..
 
avw said:
It is alone in a group, that's good. It appears to be your only GPU, which means that you might need to video= lines (and will have no output on screen during boot) for it to work. Personally, I have no experience with NVidia, but it might not detach properly from the host (see previous sentence) if it was used by the host during boot. You might also need the x-vga=on option for hostpci for NVidia cards.
All this will be easier to try if you could boot the system from another GPU, so you could at least see the host kernel messages on screen while starting the VM with PCI passthrough..
Click to expand...
ROM info
root@pve:~/rom-parser# ./rom-parser /usr/share/kvm/NVIDIA.QuadroK4000.3072.120813.rom
Valid ROM signature found @600h, PCIR offset 190h
PCIR: type 0 (x86 PC-AT), vendor: 10de, device: 11fa, class: 030000
PCIR: revision 0, vendor revision: 1
Valid ROM signature found @fa00h, PCIR offset 1ch
PCIR: type 3 (EFI), vendor: 10de, device: 11fa, class: 030000
PCIR: revision 3, vendor revision: 0
EFI: Signature Valid, Subsystem: Boot, Machine: X64
Last image


Thank you for your reply.
So looks like no more Proxmox Crash.
I was able to boot Win10 VM but GPU is giving Code 43. Screenshot

Below are the errors i can see in /var/log/syslog


Feb 25 17:30:12 pve kernel: [ 4133.328594] vfio-pci 0000:03:00.0: vfio_ecap_init: hiding ecap 0x19@0x900
Feb 25 17:30:12 pve kernel: [ 4133.330367] vfio-pci 0000:03:00.0: No more image in the PCI ROM
Feb 25 17:30:13 pve pvedaemon[12841]: <root@pam> end task UPID:pve:0000402A:00064CC2:6037DE9F:qmstart:108:root@pam: OK
Feb 25 17:30:13 pve kernel: [ 4135.019979] vfio-pci 0000:03:00.0: No more image in the PCI ROM
Feb 25 17:30:13 pve kernel: [ 4135.020055] vfio-pci 0000:03:00.0: No more image in the PCI ROM

Feb 25 17:31:10 pve kernel: [ 4191.912295] kvm [16444]: vcpu0, guest rIP: 0xfffff8062ed162f8 ignored rdmsr: 0x611
Feb 25 17:31:10 pve kernel: [ 4191.912306] kvm [16444]: vcpu0, guest rIP: 0xfffff8062ed1630e ignored rdmsr: 0x641
Feb 25 17:31:10 pve kernel: [ 4191.912311] kvm [16444]: vcpu0, guest rIP: 0xfffff8062ed16324 ignored rdmsr: 0x606
Feb 25 17:31:10 pve kernel: [ 4191.912315] kvm [16444]: vcpu0, guest rIP: 0xfffff8062ed1613e ignored rdmsr: 0x606
Feb 25 17:31:10 pve kernel: [ 4191.912319] kvm [16444]: vcpu0, guest rIP: 0xfffff8062ed111bc ignored rdmsr: 0x641
Feb 25 17:31:10 pve kernel: [ 4191.912323] kvm [16444]: vcpu0, guest rIP: 0xfffff8062ed11207 ignored rdmsr: 0x611
Feb 25 17:31:11 pve pveproxy[12508]: worker exit

Do you think its rom issue ?
 
Last edited:
Glad you got this far. Sorry, I don't know how to get more information from Microsoft or NVidia about error 43. For non-Quadro cards, it is known that you have to "hide" some virtualization signs for the NVidia driver to work. Did you install the NVidia drivers for that Quadro GPU? Maybe someone else knows more about this.
 
avw said:
Glad you got this far. Sorry, I don't know how to get more information from Microsoft or NVidia about error 43. For non-Quadro cards, it is known that you have to "hide" some virtualization signs for the NVidia driver to work. Did you install the NVidia drivers for that Quadro GPU? Maybe someone else knows more about this.
Click to expand...
No worries :) , Yes i have installed Nvidia GPU drivers.
Thank you for helping so far.

i will await further suggestions from others
 
Adding a Cheap £5 Radeon HD6450 fixed it for me and i moved my K4000 to slot 2
So Please close this thread
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom