[SOLVED] Gotta run 
Hi, I am not able to figure out why I can't do a PCI pass through of the two Western Digital SSDs to a VM (or LXC for that matter).
My motherboard is a Gigabyte Z790 AORUS ELITE AX
I tried to add them to a VM but get this error... I did enable VT-d on the BIOS.
update-grub for changes to take effect Hi, I am not able to figure out why I can't do a PCI pass through of the two Western Digital SSDs to a VM (or LXC for that matter).
My motherboard is a Gigabyte Z790 AORUS ELITE AX
I tried to add them to a VM but get this error... I did enable VT-d on the BIOS.
Code:
root@pod:~# dmesg | grep -e DMAR -e IOMMU
[ 0.016408] ACPI: DMAR 0x00000000342BA000 000088 (v01 INTEL EDK2 00000002 01000013)
[ 0.016458] ACPI: Reserving DMAR table memory at [mem 0x342ba000-0x342ba087]
[ 0.196574] DMAR: Host address width 39
[ 0.196575] DMAR: DRHD base: 0x000000fed90000 flags: 0x0
[ 0.196579] DMAR: dmar0: reg_base_addr fed90000 ver 4:0 cap 1c0000c40660462 ecap 29a00f0505e
[ 0.196581] DMAR: DRHD base: 0x000000fed91000 flags: 0x1
[ 0.196586] DMAR: dmar1: reg_base_addr fed91000 ver 5:0 cap d2008c40660462 ecap f050da
[ 0.196588] DMAR: RMRR base: 0x0000003c000000 end: 0x000000403fffff
[ 0.196590] DMAR-IR: IOAPIC id 2 under DRHD base 0xfed91000 IOMMU 1
[ 0.196591] DMAR-IR: HPET id 0 under DRHD base 0xfed91000
[ 0.196592] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[ 0.197130] DMAR-IR: Enabled IRQ remapping in x2apic mode
[ 2.037540] pci 0000:00:02.0: DMAR: Skip IOMMU disabling for graphics
[ 6.160160] AMD-Vi: AMD IOMMUv2 functionality not available on this system - This is not a bug.
Code:
root@pod:~# dmesg | grep 'remapping'
[ 0.196592] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[ 0.197130] DMAR-IR: Enabled IRQ remapping in x2apic mode
Code:
root@pod:~# cat /etc/default/grub
# If you change this file, run 'update-grub' afterwards to update
# /boot/grub/grub.cfg.
# For full documentation of the options in this file, see:
# info -f grub -n 'Simple configuration'
GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`
#GRUB_CMDLINE_LINUX_DEFAULT="quiet"
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt"
GRUB_CMDLINE_LINUX=""
Code:
root@pod:~# cat /etc/modules
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.
# Parameters can be specified after the module name.
vfio
vfio_iommu_type1
vfio_pci
Code:
root@pod:~# pvesh get /nodes/pod/hardware/pci --pci-class-blacklist ""
┌──────────┬────────┬───────────────┬────────────┬────────┬─────────────────────────────────────────────────────────────────┬──────┬──────────────────┬───────────────────────┬──────────────────┬────────────────────────────────────────┬────────────────────────────────────────┐
│ class │ device │ id │ iommugroup │ vendor │ device_name │ mdev │ subsystem_device │ subsystem_device_name │ subsystem_vendor │ subsystem_vendor_name │ vendor_name │
╞══════════╪════════╪═══════════════╪════════════╪════════╪═════════════════════════════════════════════════════════════════╪══════╪══════════════════╪═══════════════════════╪══════════════════╪════════════════════════════════════════╪════════════════════════════════════════╡
│ 0x010400 │ 0xa77f │ 0000:00:0e.0 │ -1 │ 0x8086 │ Volume Management Device NVMe RAID Controller Intel Corporation │ │ 0x0000 │ │ 0x8086 │ Intel Corporation │ Intel Corporation │
├──────────┼────────┼───────────────┼────────────┼────────┼─────────────────────────────────────────────────────────────────┼──────┼──────────────────┼───────────────────────┼──────────────────┼────────────────────────────────────────┼────────────────────────────────────────┤
│ 0x010601 │ 0x7a62 │ 10000:e0:17.0 │ -1 │ 0x8086 │ │ │ 0xb005 │ │ 0x1458 │ Gigabyte Technology Co., Ltd │ Intel Corporation │
├──────────┼────────┼───────────────┼────────────┼────────┼─────────────────────────────────────────────────────────────────┼──────┼──────────────────┼───────────────────────┼──────────────────┼────────────────────────────────────────┼────────────────────────────────────────┤
│ 0x010802 │ 0x5416 │ 10000:e1:00.0 │ -1 │ 0x1344 │ │ │ 0x1100 │ │ 0x1344 │ Micron Technology Inc │ Micron Technology Inc │
├──────────┼────────┼───────────────┼────────────┼────────┼─────────────────────────────────────────────────────────────────┼──────┼──────────────────┼───────────────────────┼──────────────────┼────────────────────────────────────────┼────────────────────────────────────────┤
│ 0x010802 │ 0x5030 │ 10000:e2:00.0 │ -1 │ 0x15b7 │ Western Digital WD Black SN850X NVMe SSD │ │ 0x5030 │ │ 0x15b7 │ Sandisk Corp │ Sandisk Corp │
├──────────┼────────┼───────────────┼────────────┼────────┼─────────────────────────────────────────────────────────────────┼──────┼──────────────────┼───────────────────────┼──────────────────┼────────────────────────────────────────┼────────────────────────────────────────┤
│ 0x010802 │ 0x5030 │ 10000:e3:00.0 │ -1 │ 0x15b7 │ Western Digital WD Black SN850X NVMe SSD │ │ 0x5030 │ │ 0x15b7 │ Sandisk Corp │ Sandisk Corp │
├──────────┼────────┼───────────────┼────────────┼────────┼─────────────────────────────────────────────────────────────────┼──────┼──────────────────┼───────────────────────┼──────────────────┼────────────────────────────────────────┼────────────────────────────────────────┤
│ 0x020000 │ 0x8125 │ 0000:06:00.0 │ -1 │ 0x10ec │ RTL8125 2.5GbE Controller │ │ 0xe000 │ │ 0x1458 │ Gigabyte Technology Co., Ltd │ Realtek Semiconductor Co., Ltd. │
├──────────┼────────┼───────────────┼────────────┼────────┼─────────────────────────────────────────────────────────────────┼──────┼──────────────────┼───────────────────────┼──────────────────┼────────────────────────────────────────┼────────────────────────────────────────┤
│ 0x028000 │ 0x7a70 │ 0000:00:14.3 │ -1 │ 0x8086 │
Last edited:
