GPU Passthrough GTX1050 to Ubuntu [not working]

A

alwindawee

New Member
Dec 24, 2022
3
0
1
Hi :)
I have installed Proxmox on an old laptop and followed the below guides to passthrough gpu.

https://forum.proxmox.com/threads/gpu-passthrough-tutorial-reference.34303/
https://pve.proxmox.com/wiki/Pci_passthrough
https://www.reddit.com/r/homelab/comments/b5xpua/the_ultimate_beginners_guide_to_gpu_passthrough/

checking the pci devices from cli showing its configured correctly, as below.
lscpi -v
01:00.0 3D controller: NVIDIA Corporation GP107M [GeForce GTX 1050 Mobile] (rev a1)
Flags: bus master, fast devsel, latency 0, IRQ 16, IOMMU group 12
Memory at de000000 (32-bit, non-prefetchable) [size=16M]
Memory at c0000000 (64-bit, prefetchable) [size=256M]
Memory at d0000000 (64-bit, prefetchable) [size=32M]
I/O ports at e000
Expansion ROM at df000000 [disabled] [size=512K]
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [258] L1 PM Substates
Capabilities: [128] Power Budgeting <?>
Capabilities: [420] Advanced Error Reporting
Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] Secondary PCI Express
Kernel driver in use: vfio-pci
Kernel modules: nvidiafb, nouveau


dmesg | grep -e DMAR -e IOMMU
[ 0.000000] Warning: PCIe ACS overrides enabled; This may allow non-IOMMU protected peer-to-peer DMA
[ 0.016385] ACPI: DMAR 0x000000007A71DAB8 0000CC (v01 INTEL KBL 00000001 INTL 00000001)
[ 0.016425] ACPI: Reserving DMAR table memory at [mem 0x7a71dab8-0x7a71db83]
[ 0.050697] DMAR: IOMMU enabled
[ 0.134459] DMAR: Host address width 39
[ 0.134460] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[ 0.134465] DMAR: dmar0: reg_base_addr fed90000 ver 1:0 cap 1c0000c40660462 ecap 19e2ff0505e
[ 0.134468] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[ 0.134471] DMAR: dmar1: reg_base_addr fed91000 ver 1:0 cap d2008c40660462 ecap f050da
[ 0.134473] DMAR: RMRR base: 0x00000079e3c000 end: 0x00000079e5bfff
[ 0.134475] DMAR: RMRR base: 0x0000007b800000 end: 0x0000007fffffff
[ 0.134476] DMAR: ANDD device: 1 name: \_SB.PCI0.I2C0
[ 0.134478] DMAR-IR: IOAPIC id 2 under DRHD base 0xfed91000 IOMMU 1
[ 0.134479] DMAR-IR: HPET id 0 under DRHD base 0xfed91000
[ 0.134480] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[ 0.136229] DMAR-IR: Enabled IRQ remapping in x2apic mode
[ 0.669981] DMAR: ACPI device "device:78" under DMAR at fed91000 as 00:15.0
[ 0.669991] DMAR: No ATSR found
[ 0.669992] DMAR: No SATC found
[ 0.669993] DMAR: IOMMU feature fl1gp_support inconsistent
[ 0.669994] DMAR: IOMMU feature pgsel_inv inconsistent
[ 0.669995] DMAR: IOMMU feature nwfs inconsistent
[ 0.669996] DMAR: IOMMU feature pasid inconsistent
[ 0.669997] DMAR: IOMMU feature eafs inconsistent
[ 0.669997] DMAR: IOMMU feature prs inconsistent
[ 0.669998] DMAR: IOMMU feature nest inconsistent
[ 0.669999] DMAR: IOMMU feature mts inconsistent
[ 0.669999] DMAR: IOMMU feature sc_support inconsistent
[ 0.670000] DMAR: IOMMU feature dev_iotlb_support inconsistent
[ 0.670001] DMAR: dmar0: Using Queued invalidation
[ 0.670004] DMAR: dmar1: Using Queued invalidation
[ 0.670618] DMAR: Intel(R) Virtualization Technology for Directed I/O

but when I run nvidia-smi on ubuntu20.04 vm its return "No devices were found"
and dmesg -w on vm its showing below errors.
[ 130.206007] NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
[ 130.206189] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:978)
[ 130.206492] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[ 274.368633] NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
[ 274.368930] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:978)
[ 274.369177] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[ 274.504630] NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
[ 274.504817] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:978)
[ 274.505136] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

although the driver seems being installed using ubuntu wizard, as below
gpu.jpg
please your help.
 
Last edited:
Hi :)
Please find below all configs.

Host details and configs:
Promox Version: 7.3-4

Code: 
# uname -a
Linux proxmox 5.15.83-1-pve #1 SMP PVE 5.15.83-1 (2022-12-15T00:00Z) x86_64 GNU/Linux

Code: 
# cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-5.15.83-1-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb:off initcall_blacklist=sysfb_init


Code: 
# cat /proc/iomem
00000000-00000fff : Reserved
00001000-00057fff : System RAM
00058000-00058fff : Reserved
00059000-0009dfff : System RAM
0009e000-000fffff : Reserved
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  00000000-00000000 : PCI Bus 0000:00
  000a0000-000fffff : PCI Bus 0000:00
    000c0000-000dffff : 0000:00:02.0
    000f0000-000fffff : System ROM
00100000-6cb6ffff : System RAM
6cb70000-6cb70fff : ACPI Non-volatile Storage
6cb71000-6cb71fff : Reserved
6cb72000-76a42fff : System RAM
76a43000-76a71fff : Reserved
76a72000-78580fff : System RAM
78581000-78581fff : Reserved
78582000-79976fff : System RAM
79977000-7a6d3fff : Reserved
7a6d4000-7a71ffff : ACPI Tables
7a720000-7af22fff : ACPI Non-volatile Storage
7af23000-7b38efff : Reserved
7b38f000-7b3fdfff : Unknown E820 type
7b3fe000-7b3fefff : System RAM
7b3ff000-7fffffff : Reserved
80000000-dfffffff : PCI Bus 0000:00
  b0000000-bfffffff : 0000:00:02.0
  c0000000-d1ffffff : PCI Bus 0000:01
    c0000000-cfffffff : 0000:01:00.0
    d0000000-d1ffffff : 0000:01:00.0
  dd000000-ddffffff : 0000:00:02.0
  de000000-df0fffff : PCI Bus 0000:01
    de000000-deffffff : 0000:01:00.0
    df000000-df07ffff : 0000:01:00.0
  df100000-df1fffff : PCI Bus 0000:04
    df100000-df100fff : 0000:04:00.0
      df100000-df100fff : rtsx_pci
  df200000-df2fffff : PCI Bus 0000:03
    df200000-df203fff : 0000:03:00.0
    df204000-df204fff : 0000:03:00.0
      df204000-df204fff : r8169
  df300000-df3fffff : PCI Bus 0000:02
    df300000-df301fff : 0000:02:00.0
      df300000-df301fff : iwlwifi
  df400000-df40ffff : 0000:00:1f.3
  df410000-df41ffff : 0000:00:14.0
    df410000-df41ffff : xhci-hcd
  df420000-df423fff : 0000:00:1f.3
    df420000-df423fff : ICH HD audio
  df424000-df427fff : 0000:00:1f.2
  df428000-df429fff : 0000:00:17.0
    df428000-df429fff : ahci
  df42a000-df42a0ff : 0000:00:1f.4
  df42b000-df42b7ff : 0000:00:17.0
    df42b000-df42b7ff : ahci
  df42c000-df42c0ff : 0000:00:17.0
    df42c000-df42c0ff : ahci
  df42d000-df42dfff : 0000:00:16.0
    df42d000-df42dfff : mei_me
  df42e000-df42efff : 0000:00:15.0
    df42e000-df42e1ff : lpss_dev
      df42e000-df42e1ff : i2c_designware.0 lpss_dev
    df42e200-df42e2ff : lpss_priv
    df42e800-df42efff : idma64.0
      df42e800-df42efff : idma64.0 idma64.0
  df42f000-df42ffff : 0000:00:14.2
    df42f000-df42ffff : Intel PCH thermal driver
  df430000-df430fff : 0000:00:08.0
  dffe0000-dfffffff : pnp 00:04
e0000000-efffffff : PCI MMCONFIG 0000 [bus 00-ff]
  e0000000-efffffff : Reserved
    e0000000-efffffff : pnp 00:04
fd000000-fe7fffff : PCI Bus 0000:00
  fd000000-fdabffff : pnp 00:05
  fdac0000-fdacffff : pnp 00:07
  fdad0000-fdadffff : pnp 00:05
  fdae0000-fdaeffff : pnp 00:07
  fdaf0000-fdafffff : pnp 00:07
  fdb00000-fdffffff : pnp 00:05
    fdc6000c-fdc6000f : iTCO_wdt
  fe000000-fe010fff : Reserved
  fe036000-fe03bfff : pnp 00:05
  fe03d000-fe3fffff : pnp 00:05
  fe410000-fe7fffff : pnp 00:05
fec00000-fec00fff : Reserved
  fec00000-fec003ff : IOAPIC 0
fed00000-fed00fff : Reserved
  fed00000-fed003ff : HPET 0
    fed00000-fed003ff : PNP0103:00
fed10000-fed17fff : pnp 00:04
fed18000-fed18fff : pnp 00:04
fed19000-fed19fff : pnp 00:04
fed20000-fed3ffff : pnp 00:04
fed40000-fed4087f : MSFT0101:00
  fed40000-fed4087f : MSFT0101:00
fed45000-fed8ffff : pnp 00:04
fed90000-fed90fff : dmar0
fed91000-fed91fff : dmar1
fee00000-fee00fff : Local APIC
  fee00000-fee00fff : Reserved
ff000000-ffffffff : Reserved
  ff000000-ffffffff : INT0800:00
    ff000000-ffffffff : pnp 00:04
100000000-47effffff : System RAM
  2d6200000-2d72024c7 : Kernel code
  2d7400000-2d7df9fff : Kernel rodata
  2d7e00000-2d823cdff : Kernel data
  2d8584000-2d8bfffff : Kernel bss
47f000000-47fffffff : RAM buffer

Code: 
# cat /etc/modules
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

Code: 
# lspci -v (for gpu only)
01:00.0 3D controller: NVIDIA Corporation GP107M [GeForce GTX 1050 Mobile] (rev a1)
        Subsystem: ASUSTeK Computer Inc. GP107M [GeForce GTX 1050 Mobile]
        Flags: bus master, fast devsel, latency 0, IRQ 255, IOMMU group 12
        Memory at de000000 (32-bit, non-prefetchable) [size=16M]
        Memory at c0000000 (64-bit, prefetchable) [size=256M]
        Memory at d0000000 (64-bit, prefetchable) [size=32M]
        I/O ports at e000 [disabled] [size=128]
        Expansion ROM at df000000 [disabled] [size=512K]
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Endpoint, MSI 00
        Capabilities: [100] Virtual Channel
        Capabilities: [250] Latency Tolerance Reporting
        Capabilities: [258] L1 PM Substates
        Capabilities: [128] Power Budgeting <?>
        Capabilities: [420] Advanced Error Reporting
        Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
        Capabilities: [900] Secondary PCI Express
        Kernel driver in use: vfio-pci
        Kernel modules: nvidiafb, nouveau

Code: 
# for g in $(find /sys/kernel/iommu_groups/* -maxdepth 0 -type d | sort -V); do     echo "IOMMU Group ${g##*/}:";     for d in $g/devices/*; do         echo -e "\t$(lspci -nns ${d##*/})";     done; done;
IOMMU Group 0:
        00:00.0 Host bridge [0600]: Intel Corporation Xeon E3-1200 v6/7th Gen Core Processor Host Bridge/DRAM Registers [8086:5910] (rev 05)
IOMMU Group 1:
        00:01.0 PCI bridge [0604]: Intel Corporation 6th-10th Gen Core Processor PCIe Controller (x16) [8086:1901] (rev 05)
IOMMU Group 2:
        00:02.0 VGA compatible controller [0300]: Intel Corporation HD Graphics 630 [8086:591b] (rev 04)
IOMMU Group 3:
        00:08.0 System peripheral [0880]: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model [8086:1911]
IOMMU Group 4:
        00:14.0 USB controller [0c03]: Intel Corporation 100 Series/C230 Series Chipset Family USB 3.0 xHCI Controller [8086:a12f] (rev 31)
        00:14.2 Signal processing controller [1180]: Intel Corporation 100 Series/C230 Series Chipset Family Thermal Subsystem [8086:a131] (rev 31)
IOMMU Group 5:
        00:15.0 Signal processing controller [1180]: Intel Corporation 100 Series/C230 Series Chipset Family Serial IO I2C Controller #0 [8086:a160] (rev 31)
IOMMU Group 6:
        00:16.0 Communication controller [0780]: Intel Corporation 100 Series/C230 Series Chipset Family MEI Controller #1 [8086:a13a] (rev 31)
IOMMU Group 7:
        00:17.0 SATA controller [0106]: Intel Corporation HM170/QM170 Chipset SATA Controller [AHCI Mode] [8086:a103] (rev 31)
IOMMU Group 8:
        00:1c.0 PCI bridge [0604]: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #3 [8086:a112] (rev f1)
IOMMU Group 9:
        00:1c.3 PCI bridge [0604]: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #4 [8086:a113] (rev f1)
IOMMU Group 10:
        00:1c.6 PCI bridge [0604]: Intel Corporation 100 Series/C230 Series Chipset Family PCI Express Root Port #7 [8086:a116] (rev f1)
IOMMU Group 11:
        00:1f.0 ISA bridge [0601]: Intel Corporation HM175 Chipset LPC/eSPI Controller [8086:a152] (rev 31)
        00:1f.2 Memory controller [0580]: Intel Corporation 100 Series/C230 Series Chipset Family Power Management Controller [8086:a121] (rev 31)
        00:1f.3 Audio device [0403]: Intel Corporation CM238 HD Audio Controller [8086:a171] (rev 31)
        00:1f.4 SMBus [0c05]: Intel Corporation 100 Series/C230 Series Chipset Family SMBus [8086:a123] (rev 31)
IOMMU Group 12:
        01:00.0 3D controller [0302]: NVIDIA Corporation GP107M [GeForce GTX 1050 Mobile] [10de:1c8d] (rev a1)
IOMMU Group 13:
        02:00.0 Network controller [0280]: Intel Corporation Wireless 7265 [8086:095a] (rev 59)
IOMMU Group 14:
        03:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 15)
IOMMU Group 15:
        04:00.0 Unassigned class [ff00]: Realtek Semiconductor Co., Ltd. RTS5229 PCI Express Card Reader [10ec:5229] (rev 01)

Code: 
# dmesg | grep -e DMAR -e IOMMU
[    0.000000] Warning: PCIe ACS overrides enabled; This may allow non-IOMMU protected peer-to-peer DMA
[    0.016351] ACPI: DMAR 0x000000007A71DAB8 0000CC (v01 INTEL  KBL      00000001 INTL 00000001)
[    0.016391] ACPI: Reserving DMAR table memory at [mem 0x7a71dab8-0x7a71db83]
[    0.050648] DMAR: IOMMU enabled
[    0.134477] DMAR: Host address width 39
[    0.134478] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[    0.134483] DMAR: dmar0: reg_base_addr fed90000 ver 1:0 cap 1c0000c40660462 ecap 19e2ff0505e
[    0.134486] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[    0.134489] DMAR: dmar1: reg_base_addr fed91000 ver 1:0 cap d2008c40660462 ecap f050da
[    0.134491] DMAR: RMRR base: 0x00000079e3c000 end: 0x00000079e5bfff
[    0.134492] DMAR: RMRR base: 0x0000007b800000 end: 0x0000007fffffff
[    0.134493] DMAR: ANDD device: 1 name: \_SB.PCI0.I2C0
[    0.134495] DMAR-IR: IOAPIC id 2 under DRHD base  0xfed91000 IOMMU 1
[    0.134497] DMAR-IR: HPET id 0 under DRHD base 0xfed91000
[    0.134498] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    0.136250] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    0.670028] DMAR: ACPI device "device:78" under DMAR at fed91000 as 00:15.0
[    0.670037] DMAR: No ATSR found
[    0.670038] DMAR: No SATC found
[    0.670039] DMAR: IOMMU feature fl1gp_support inconsistent
[    0.670041] DMAR: IOMMU feature pgsel_inv inconsistent
[    0.670042] DMAR: IOMMU feature nwfs inconsistent
[    0.670042] DMAR: IOMMU feature pasid inconsistent
[    0.670043] DMAR: IOMMU feature eafs inconsistent
[    0.670044] DMAR: IOMMU feature prs inconsistent
[    0.670045] DMAR: IOMMU feature nest inconsistent
[    0.670045] DMAR: IOMMU feature mts inconsistent
[    0.670046] DMAR: IOMMU feature sc_support inconsistent
[    0.670047] DMAR: IOMMU feature dev_iotlb_support inconsistent
[    0.670048] DMAR: dmar0: Using Queued invalidation
[    0.670051] DMAR: dmar1: Using Queued invalidation
[    0.670664] DMAR: Intel(R) Virtualization Technology for Directed I/O

VM config file
Code: 
# cat /etc/pve/qemu-server/100.conf
boot: order=scsi0;ide2;net0
cores: 2
cpu: host,hidden=1
hostpci0: 0000:01:00,pcie=1,romfile=GTX1050Ti.rom
ide2: local:iso/ubuntu-20.04.5-desktop-amd64.iso,media=cdrom,size=3773616K
machine: q35
memory: 4096
meta: creation-qemu=7.1.0,ctime=1672685150
name: Gazebo
net0: virtio=3E:5E:EE:BF:C5:2E,bridge=vmbr0,firewall=1
numa: 0
ostype: l26
scsi0: local-lvm:vm-100-disk-0,iothread=1,size=32G
scsihw: virtio-scsi-single
smbios1: uuid=4ac4dc0b-96b1-432c-8fd2-58ac84ebd36e
sockets: 2
vmgenid: d3b226d2-add2-4853-9023-51adea8a7d73

VM os: ubuntu 20.04
 
alwindawee said:
hostpci0: 0000:01:00,pcie=1,romfile=GTX1050Ti.rom
Click to expand...
The name of the ROM-file seems different from name of the mobile GPU. Is it really a ROM dump of your GTX 1050 Mobile?
You might need special mobile GPU drivers from NVidia but i have no idea how to get, install and load them for Ubuntu.
 
Hi all - I am doing something similar, on a ThinkPad P50.

# PVE host

Code: 
# cat /etc/pve/qemu-server/110.conf
agent: 1,fstrim_cloned_disks=1
bios: ovmf
boot: order=scsi0;ide2;net0
cores: 4
cpu: host
efidisk0: local-lvm:vm-110-disk-0,efitype=4m,pre-enrolled-keys=1,size=4M
hostpci0: mapping=GPU,pcie=1
ide2: local:iso/debian-12.4.0-amd64-DVD-1.iso,media=cdrom,size=3900480K
machine: q35
memory: 4096
meta: creation-qemu=8.1.2,ctime=1705431128
name: GPU
net0: virtio=BC:24:11:8B:92:B1,bridge=vmbr0,firewall=1
numa: 0
ostype: l26
scsi0: backup-synodan:110/vm-110-disk-0.qcow2,backup=0,iothread=1,size=32G
scsihw: virtio-scsi-single
smbios1: uuid=76adda0c-442d-46fd-b51d-4b69f3f46340
sockets: 1
vmgenid: 710df66d-caca-4c82-8df3-8729631d1f0b

Code: 
# dmesg | grep -e DMAR -e IOMMU
[    0.010449] ACPI: DMAR 0x0000000097FD0000 0000A8 (v01 LENOVO TP-N1E   00001480 PTEC 00000002)
[    0.010481] ACPI: Reserving DMAR table memory at [mem 0x97fd0000-0x97fd00a7]
[    0.104439] DMAR: IOMMU enabled
[    0.260951] DMAR: Host address width 39
[    0.260952] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[    0.260958] DMAR: dmar0: reg_base_addr fed90000 ver 1:0 cap 1c0000c40660462 ecap 7e3ff0505e
[    0.260960] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[    0.260964] DMAR: dmar1: reg_base_addr fed91000 ver 1:0 cap d2008c40660462 ecap f050da
[    0.260966] DMAR: RMRR base: 0x000000974af000 end: 0x000000974cefff
[    0.260968] DMAR: RMRR base: 0x0000009a000000 end: 0x0000009e7fffff
[    0.260970] DMAR-IR: IOAPIC id 2 under DRHD base  0xfed91000 IOMMU 1
[    0.260971] DMAR-IR: HPET id 0 under DRHD base 0xfed91000
[    0.260972] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    0.262520] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    0.516618] DMAR: No ATSR found
[    0.516620] DMAR: No SATC found
[    0.516621] DMAR: IOMMU feature fl1gp_support inconsistent
[    0.516622] DMAR: IOMMU feature pgsel_inv inconsistent
[    0.516623] DMAR: IOMMU feature nwfs inconsistent
[    0.516624] DMAR: IOMMU feature eafs inconsistent
[    0.516625] DMAR: IOMMU feature prs inconsistent
[    0.516626] DMAR: IOMMU feature nest inconsistent
[    0.516627] DMAR: IOMMU feature mts inconsistent
[    0.516628] DMAR: IOMMU feature sc_support inconsistent
[    0.516629] DMAR: IOMMU feature dev_iotlb_support inconsistent
[    0.516630] DMAR: dmar0: Using Queued invalidation
[    0.516633] DMAR: dmar1: Using Queued invalidation
[    0.517320] DMAR: Intel(R) Virtualization Technology for Directed I/O


# From the VM with passthrough (Debian)


Code: 
 # lspci -v
01:00.0 VGA compatible controller: NVIDIA Corporation GM107GLM [Quadro M1000M] (rev a2) (prog-if 00 [VGA controller])
        Physical Slot: 0
        Flags: bus master, fast devsel, latency 0, IRQ 16
        Memory at 81000000 (32-bit, non-prefetchable) [size=16M]
        Memory at 7000000000 (64-bit, prefetchable) [size=256M]
        Memory at 7010000000 (64-bit, prefetchable) [size=32M]
        I/O ports at 8000 [size=128]
        Expansion ROM at <ignored> [disabled]
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Endpoint, MSI 00
        Capabilities: [100] Virtual Channel
        Capabilities: [250] Latency Tolerance Reporting
        Capabilities: [128] Power Budgeting <?>
        Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
        Kernel driver in use: nvidia
        Kernel modules: nvidia

I have installed the drivers successfully (I disabled SecureBoot so I didn't have to sign my mods).

Code: 
# lsmod | grep nvidia
nvidia_drm             73728  0
nvidia_modeset       1249280  1 nvidia_drm
video                  65536  1 nvidia_modeset
nvidia              56410112  7 nvidia_modeset
drm_kms_helper        204800  5 bochs,drm_vram_helper,nvidia_drm
drm                   614400  9 drm_kms_helper,bochs,drm_vram_helper,nvidia,drm_ttm_helper,nvidia_drm,ttm

Code: 
# journalctl -b 0 -k | grep -i NVRM
Jan 16 16:40:21 debian-gpu kernel: NVRM: loading NVIDIA UNIX x86_64 Kernel Module  525.147.05  Wed Oct 25 20:27:35 UTC 2023
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0


Code: 
# journalctl -b 0 -k | grep -i nvidia
Jan 16 16:40:21 debian-gpu kernel: nvidia: loading out-of-tree module taints kernel.
Jan 16 16:40:21 debian-gpu kernel: nvidia: module license 'NVIDIA' taints kernel.
Jan 16 16:40:21 debian-gpu kernel: nvidia: module verification failed: signature and/or required key missing - tainting kernel
Jan 16 16:40:21 debian-gpu kernel: nvidia-nvlink: Nvlink Core is being initialized, major device number 242
Jan 16 16:40:21 debian-gpu kernel: nvidia 0000:01:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=none
Jan 16 16:40:21 debian-gpu kernel: NVRM: loading NVIDIA UNIX x86_64 Kernel Module  525.147.05  Wed Oct 25 20:27:35 UTC 2023
Jan 16 16:40:21 debian-gpu kernel: nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  525.147.05  Wed Oct 25 20:21:31 UTC 2023
Jan 16 16:40:21 debian-gpu kernel: audit: type=1400 audit(1705441221.936:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=513 comm="apparmor_parser"
Jan 16 16:40:21 debian-gpu kernel: audit: type=1400 audit(1705441221.936:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=513 comm="apparmor_parser"
Jan 16 16:40:22 debian-gpu kernel: [drm] [nvidia-drm] [GPU ID 0x00000100] Loading driver
Jan 16 16:40:22 debian-gpu kernel: [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:01:00.0 on minor 1
 
did you get it working for
antineutrinos said:
Hi all - I am doing something similar, on a ThinkPad P50.

# PVE host

Code: 
# cat /etc/pve/qemu-server/110.conf
agent: 1,fstrim_cloned_disks=1
bios: ovmf
boot: order=scsi0;ide2;net0
cores: 4
cpu: host
efidisk0: local-lvm:vm-110-disk-0,efitype=4m,pre-enrolled-keys=1,size=4M
hostpci0: mapping=GPU,pcie=1
ide2: local:iso/debian-12.4.0-amd64-DVD-1.iso,media=cdrom,size=3900480K
machine: q35
memory: 4096
meta: creation-qemu=8.1.2,ctime=1705431128
name: GPU
net0: virtio=BC:24:11:8B:92:B1,bridge=vmbr0,firewall=1
numa: 0
ostype: l26
scsi0: backup-synodan:110/vm-110-disk-0.qcow2,backup=0,iothread=1,size=32G
scsihw: virtio-scsi-single
smbios1: uuid=76adda0c-442d-46fd-b51d-4b69f3f46340
sockets: 1
vmgenid: 710df66d-caca-4c82-8df3-8729631d1f0b

Code: 
# dmesg | grep -e DMAR -e IOMMU
[    0.010449] ACPI: DMAR 0x0000000097FD0000 0000A8 (v01 LENOVO TP-N1E   00001480 PTEC 00000002)
[    0.010481] ACPI: Reserving DMAR table memory at [mem 0x97fd0000-0x97fd00a7]
[    0.104439] DMAR: IOMMU enabled
[    0.260951] DMAR: Host address width 39
[    0.260952] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[    0.260958] DMAR: dmar0: reg_base_addr fed90000 ver 1:0 cap 1c0000c40660462 ecap 7e3ff0505e
[    0.260960] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[    0.260964] DMAR: dmar1: reg_base_addr fed91000 ver 1:0 cap d2008c40660462 ecap f050da
[    0.260966] DMAR: RMRR base: 0x000000974af000 end: 0x000000974cefff
[    0.260968] DMAR: RMRR base: 0x0000009a000000 end: 0x0000009e7fffff
[    0.260970] DMAR-IR: IOAPIC id 2 under DRHD base  0xfed91000 IOMMU 1
[    0.260971] DMAR-IR: HPET id 0 under DRHD base 0xfed91000
[    0.260972] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    0.262520] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    0.516618] DMAR: No ATSR found
[    0.516620] DMAR: No SATC found
[    0.516621] DMAR: IOMMU feature fl1gp_support inconsistent
[    0.516622] DMAR: IOMMU feature pgsel_inv inconsistent
[    0.516623] DMAR: IOMMU feature nwfs inconsistent
[    0.516624] DMAR: IOMMU feature eafs inconsistent
[    0.516625] DMAR: IOMMU feature prs inconsistent
[    0.516626] DMAR: IOMMU feature nest inconsistent
[    0.516627] DMAR: IOMMU feature mts inconsistent
[    0.516628] DMAR: IOMMU feature sc_support inconsistent
[    0.516629] DMAR: IOMMU feature dev_iotlb_support inconsistent
[    0.516630] DMAR: dmar0: Using Queued invalidation
[    0.516633] DMAR: dmar1: Using Queued invalidation
[    0.517320] DMAR: Intel(R) Virtualization Technology for Directed I/O


# From the VM with passthrough (Debian)


Code: 
 # lspci -v
01:00.0 VGA compatible controller: NVIDIA Corporation GM107GLM [Quadro M1000M] (rev a2) (prog-if 00 [VGA controller])
        Physical Slot: 0
        Flags: bus master, fast devsel, latency 0, IRQ 16
        Memory at 81000000 (32-bit, non-prefetchable) [size=16M]
        Memory at 7000000000 (64-bit, prefetchable) [size=256M]
        Memory at 7010000000 (64-bit, prefetchable) [size=32M]
        I/O ports at 8000 [size=128]
        Expansion ROM at <ignored> [disabled]
        Capabilities: [60] Power Management version 3
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [78] Express Endpoint, MSI 00
        Capabilities: [100] Virtual Channel
        Capabilities: [250] Latency Tolerance Reporting
        Capabilities: [128] Power Budgeting <?>
        Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
        Kernel driver in use: nvidia
        Kernel modules: nvidia

I have installed the drivers successfully (I disabled SecureBoot so I didn't have to sign my mods).

Code: 
# lsmod | grep nvidia
nvidia_drm             73728  0
nvidia_modeset       1249280  1 nvidia_drm
video                  65536  1 nvidia_modeset
nvidia              56410112  7 nvidia_modeset
drm_kms_helper        204800  5 bochs,drm_vram_helper,nvidia_drm
drm                   614400  9 drm_kms_helper,bochs,drm_vram_helper,nvidia,drm_ttm_helper,nvidia_drm,ttm

Code: 
# journalctl -b 0 -k | grep -i NVRM
Jan 16 16:40:21 debian-gpu kernel: NVRM: loading NVIDIA UNIX x86_64 Kernel Module  525.147.05  Wed Oct 25 20:27:35 UTC 2023
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:22 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:24 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:974)
Jan 16 16:40:25 debian-gpu kernel: NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0


Code: 
# journalctl -b 0 -k | grep -i nvidia
Jan 16 16:40:21 debian-gpu kernel: nvidia: loading out-of-tree module taints kernel.
Jan 16 16:40:21 debian-gpu kernel: nvidia: module license 'NVIDIA' taints kernel.
Jan 16 16:40:21 debian-gpu kernel: nvidia: module verification failed: signature and/or required key missing - tainting kernel
Jan 16 16:40:21 debian-gpu kernel: nvidia-nvlink: Nvlink Core is being initialized, major device number 242
Jan 16 16:40:21 debian-gpu kernel: nvidia 0000:01:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=none
Jan 16 16:40:21 debian-gpu kernel: NVRM: loading NVIDIA UNIX x86_64 Kernel Module  525.147.05  Wed Oct 25 20:27:35 UTC 2023
Jan 16 16:40:21 debian-gpu kernel: nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  525.147.05  Wed Oct 25 20:21:31 UTC 2023
Jan 16 16:40:21 debian-gpu kernel: audit: type=1400 audit(1705441221.936:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=513 comm="apparmor_parser"
Jan 16 16:40:21 debian-gpu kernel: audit: type=1400 audit(1705441221.936:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=513 comm="apparmor_parser"
Jan 16 16:40:22 debian-gpu kernel: [drm] [nvidia-drm] [GPU ID 0x00000100] Loading driver
Jan 16 16:40:22 debian-gpu kernel: [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:01:00.0 on minor 1
Click to expand...
did you get it working on p50 i am stuck at same
 
You must log in or register to reply here.
Top Bottom
Back