AMD Integrated GPU (iGPU) passthrough on X570 motherboard - possible?

[AxAn]

I basically just want to pass my integrated GPU, from my Asrock X570M Pro4 motherboard + AMD 3400G CPU, to use in a VM running Kodi and other stuff (trying RetroElec).
As far as I understand this can not be done without also having a graphics card, so I have added an Radeon HD 8670 for this purpose.

I've been trying everything I can think of for 3 days now without getting this to work.
Is this a possible thing to do?
Can the iGPU be passed to a VM while Proxmox is using the other GPU or is this not possible to do?

lspci -nnk | grep "VGA\|Audio"
03:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Oland XT [Radeon HD 8670 / R7 250/350] [1002:6610] (rev 81)
03:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series] [1002:aab0]
        Subsystem: Dell Oland/Hainan/Cape Verde/Pitcairn HDMI Audio [Radeon HD 7000 Series] [1028:aab0]
08:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Picasso [1002:15d8] (rev c8)
08:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Raven/Raven2/Fenghuang HDMI/DP Audio Controller [1002:15de]
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Raven/Raven2/Fenghuang HDMI/DP Audio Controller [1002:15de]
08:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller [1022:15e3]
        Subsystem: ASRock Incorporation Family 17h (Models 10h-1fh) HD Audio Controller [1849:1202]

So both the GPU's seem to be accessible.

I then followed the pass-through guide but not matter which GPU I select I can't get any video output. The screen just says "No hdmi signal".

The console output when I try to start the VM is this, where the last row just keeps repeating:

xhci_hcd 0000:08:00.3: xHCI host controller not responding, assume dead
snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0xXXXXXXX
snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0xXXXXXXX
snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0xXXXXXXX
snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0xXXXXXXX

The device "0000:08:00.3" and "0000:08:00.6" seems to be:

08:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Raven USB 3.1 [1022:15e0]
        Subsystem: ASRock Incorporation Raven USB 3.1 [1849:ffff]
        Kernel driver in use: vfio-pci
08:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller [1022:15e3]
        Subsystem: ASRock Incorporation Family 17h (Models 10h-1fh) HD Audio Controller [1849:1202]
        Kernel modules: snd_hda_intel

One odd things was that since I want to add a 4xm.2 adapter card in the top motherboard slot (x16) I put the Radeon HD 8670 card in the bottom slot.
I then needed to disable CSM in the bios (found another post about that).
I do not think this is an issue since I've also tried putting the card in the top slot from time to time.

Can this be done with the hardware I'm using?
Anyone got this running?

 

[dcsapak]

hi,

can you post your vm config and the iommu groups?
you can only passthrough devices which are isolated in a iommu group or all devices from a group
(so i guess you would have to pass through all of 08:00

also please post the (complete) output of 'lspci -k' and the log while the vm starts

 

[AxAn]

This would be the iommu groups:

find /sys/kernel/iommu_groups/ -type l
/sys/kernel/iommu_groups/17/devices/0000:09:00.0
/sys/kernel/iommu_groups/7/devices/0000:01:00.0
/sys/kernel/iommu_groups/15/devices/0000:08:00.0
/sys/kernel/iommu_groups/5/devices/0000:00:14.3
/sys/kernel/iommu_groups/5/devices/0000:00:14.0
/sys/kernel/iommu_groups/13/devices/0000:03:00.0
/sys/kernel/iommu_groups/13/devices/0000:03:00.1
/sys/kernel/iommu_groups/3/devices/0000:00:08.1
/sys/kernel/iommu_groups/11/devices/0000:02:09.0
/sys/kernel/iommu_groups/11/devices/0000:06:00.0
/sys/kernel/iommu_groups/1/devices/0000:00:01.2
/sys/kernel/iommu_groups/8/devices/0000:02:02.0
/sys/kernel/iommu_groups/16/devices/0000:08:00.4
/sys/kernel/iommu_groups/16/devices/0000:08:00.2
/sys/kernel/iommu_groups/16/devices/0000:08:00.3
/sys/kernel/iommu_groups/16/devices/0000:08:00.1
/sys/kernel/iommu_groups/16/devices/0000:08:00.6
/sys/kernel/iommu_groups/6/devices/0000:00:18.3
/sys/kernel/iommu_groups/6/devices/0000:00:18.1
/sys/kernel/iommu_groups/6/devices/0000:00:18.6
/sys/kernel/iommu_groups/6/devices/0000:00:18.4
/sys/kernel/iommu_groups/6/devices/0000:00:18.2
/sys/kernel/iommu_groups/6/devices/0000:00:18.0
/sys/kernel/iommu_groups/6/devices/0000:00:18.7
/sys/kernel/iommu_groups/6/devices/0000:00:18.5
/sys/kernel/iommu_groups/14/devices/0000:04:00.0
/sys/kernel/iommu_groups/4/devices/0000:00:08.2
/sys/kernel/iommu_groups/12/devices/0000:07:00.0
/sys/kernel/iommu_groups/12/devices/0000:02:0a.0
/sys/kernel/iommu_groups/2/devices/0000:00:08.0
/sys/kernel/iommu_groups/10/devices/0000:05:00.3
/sys/kernel/iommu_groups/10/devices/0000:05:00.1
/sys/kernel/iommu_groups/10/devices/0000:05:00.0
/sys/kernel/iommu_groups/10/devices/0000:02:08.0
/sys/kernel/iommu_groups/0/devices/0000:00:01.0
/sys/kernel/iommu_groups/9/devices/0000:02:06.0

I'll get back with the other info when I get back home and fire up Proxmox again.

 

[AxAn]

VM config:

balloon: 0
bios: ovmf
bootdisk: scsi0
cores: 1
efidisk0: TreeGB:vm-100-disk-1,size=128K
hostpci0: 08:00,pcie=1,rombar=0,x-vga=1
ide2: local:iso/RetroELEC-Generic.x86_64-9.1-devel-20200111203939-ea8d1e1.img,media=cdrom
machine: q35
memory: 6000
name: GameTest
net0: virtio=E2:B6:7E:15:64:7C,bridge=vmbr0,firewall=1
numa: 0
ostype: l26
scsi0: TreeGB:vm-100-disk-0,size=16G
scsihw: virtio-scsi-pci
smbios1: uuid=e774ee4a-a519-4b31-ac4c-72ca5d9731fe
sockets: 1
vmgenid: fb4cb33a-b136-4208-a0f1-f7c1ea3cdf19

VM log:

Jan 16 19:57:49 nas pvedaemon[1784]: start VM 100: UPID:nas:000006F8:0000210A:5E20B22D:qmstart:100:root@pam:
Jan 16 19:57:49 nas pvedaemon[1514]: <root@pam> starting task UPID:nas:000006F8:0000210A:5E20B22D:qmstart:100:root@pam:
Jan 16 19:57:50 nas kernel: [   84.771858] xhci_hcd 0000:08:00.4: remove, state 4
Jan 16 19:57:50 nas kernel: [   84.771880] usb usb8: USB disconnect, device number 1
Jan 16 19:57:50 nas kernel: [   84.772284] xhci_hcd 0000:08:00.4: USB bus 8 deregistered
Jan 16 19:57:50 nas kernel: [   84.772302] xhci_hcd 0000:08:00.4: remove, state 1
Jan 16 19:57:50 nas kernel: [   84.772307] usb usb7: USB disconnect, device number 1
Jan 16 19:57:50 nas kernel: [   84.772310] usb 7-1: USB disconnect, device number 2
Jan 16 19:57:50 nas kernel: [   84.816096] xhci_hcd 0000:08:00.4: USB bus 7 deregistered
Jan 16 19:57:50 nas kernel: [   84.839609] xhci_hcd 0000:08:00.3: remove, state 4
Jan 16 19:57:50 nas kernel: [   84.839628] usb usb6: USB disconnect, device number 1
Jan 16 19:57:50 nas kernel: [   84.840006] xhci_hcd 0000:08:00.3: USB bus 6 deregistered
Jan 16 19:57:50 nas kernel: [   84.840022] xhci_hcd 0000:08:00.3: remove, state 1
Jan 16 19:57:50 nas kernel: [   84.840026] usb usb5: USB disconnect, device number 1
Jan 16 19:57:50 nas kernel: [   84.840029] usb 5-4: USB disconnect, device number 2
Jan 16 19:57:55 nas kernel: [   90.023638] xhci_hcd 0000:08:00.3: xHCI host not responding to stop endpoint command.
Jan 16 19:57:55 nas kernel: [   90.023664] xhci_hcd 0000:08:00.3: xHCI host controller not responding, assume dead
Jan 16 19:57:55 nas kernel: [   90.085012] xhci_hcd 0000:08:00.3: USB bus 5 deregistered
Jan 16 19:57:58 nas kernel: [   93.246266] snd_hda_intel 0000:08:00.6: azx_get_response timeout, switching to polling mode: last cmd=0x00170500
Jan 16 19:57:59 nas kernel: [   94.253870] snd_hda_intel 0000:08:00.6: No response from codec, disabling MSI: last cmd=0x00170500
Jan 16 19:58:00 nas kernel: [   95.261502] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x00170500
Jan 16 19:58:00 nas systemd[1]: Starting Proxmox VE replication runner...
Jan 16 19:58:01 nas kernel: [   96.265178] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x00270500
Jan 16 19:58:01 nas pvesr[1817]: invalid json data in '/var/lib/pve-manager/pve-replication-state.json'
Jan 16 19:58:01 nas systemd[1]: pvesr.service: Main process exited, code=exited, status=255/EXCEPTION
Jan 16 19:58:01 nas systemd[1]: pvesr.service: Failed with result 'exit-code'.
Jan 16 19:58:01 nas systemd[1]: Failed to start Proxmox VE replication runner.
Jan 16 19:58:02 nas kernel: [   97.272845] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x00370500
Jan 16 19:58:03 nas kernel: [   98.280508] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x00470500
Jan 16 19:58:04 nas kernel: [   99.288269] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x00570500
Jan 16 19:58:05 nas kernel: [  100.300006] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x00670500
Jan 16 19:58:06 nas kernel: [  101.307755] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x00870500
Jan 16 19:58:07 nas kernel: [  102.315525] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x00970500
Jan 16 19:58:08 nas kernel: [  103.323310] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x01070500
Jan 16 19:58:09 nas kernel: [  104.331111] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x01170500
Jan 16 19:58:10 nas kernel: [  105.338920] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x01470500
Jan 16 19:58:11 nas kernel: [  106.346742] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x01570500
Jan 16 19:58:12 nas kernel: [  107.354577] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x01670500
Jan 16 19:58:13 nas kernel: [  108.362420] snd_hda_intel 0000:08:00.6: No response from codec, resetting bus: last cmd=0x01770500
...

 

[AxAn]

lspci -k

00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Root Complex
        Subsystem: ASRock Incorporation Raven/Raven2 Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 IOMMU
        Subsystem: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 IOMMU
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe GPP Bridge [6:0]
        Kernel driver in use: pcieport
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Internal PCIe GPP Bridge 0 to Bus A
        Kernel driver in use: pcieport
00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Internal PCIe GPP Bridge 0 to Bus B
        Kernel driver in use: pcieport
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)
        Subsystem: ASRock Incorporation FCH SMBus Controller
        Kernel driver in use: piix4_smbus
        Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
        Subsystem: ASRock Incorporation FCH LPC Bridge
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 3
        Kernel driver in use: k10temp
        Kernel modules: k10temp
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 7
01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57ad
        Kernel driver in use: pcieport
02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3
        Kernel driver in use: pcieport
02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3
        Kernel driver in use: pcieport
02:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
        Kernel driver in use: pcieport
02:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
        Kernel driver in use: pcieport
02:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
        Kernel driver in use: pcieport
03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Oland XT [Radeon HD 8670 / R7 250/350] (rev 81)
        Subsystem: Dell Oland XT [Radeon HD 8670 / R7 250/350]
        Kernel modules: radeon, amdgpu
03:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series]
        Subsystem: Dell Oland/Hainan/Cape Verde/Pitcairn HDMI Audio [Radeon HD 7000 Series]
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel
04:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
        Subsystem: ASRock Incorporation I211 Gigabit Network Connection
        Kernel driver in use: igb
        Kernel modules: igb
05:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
05:00.1 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
        Kernel driver in use: xhci_hcd
05:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
        Kernel driver in use: xhci_hcd
06:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
        Kernel driver in use: ahci
        Kernel modules: ahci
07:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
        Kernel driver in use: ahci
        Kernel modules: ahci
08:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Picasso (rev c8)
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Picasso
        Kernel driver in use: vfio-pci
        Kernel modules: amdgpu
08:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Raven/Raven2/Fenghuang HDMI/DP Audio Controller
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Raven/Raven2/Fenghuang HDMI/DP Audio Controller
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
08:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor
        Kernel driver in use: vfio-pci
08:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Raven USB 3.1
        Subsystem: ASRock Incorporation Raven USB 3.1
        Kernel driver in use: xhci_hcd
08:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Raven USB 3.1
        Subsystem: ASRock Incorporation Raven USB 3.1
        Kernel driver in use: xhci_hcd
08:00.6 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller
        Subsystem: ASRock Incorporation Family 17h (Models 10h-1fh) HD Audio Controller
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel
09:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 61)
        Subsystem: ASRock Incorporation FCH SATA Controller [AHCI mode]
        Kernel driver in use: ahci
        Kernel modules: ahci

 

[AxAn]

/etc/modprobe.d/vfio.conf

options vfio-pci ids=1002:15d8,1002:15de,1022:15df,1849:ffff,1849:1202 disable_vga=1

I have tried with and without disable_vga=1 and also changing some of the ids.

As far as I can tell I'm now passing all of 08:00 so it should not be a problem?

I can't find any option for ACS in the bios.

 

[AxAn]

I started over and reinstalled everything and it seems that part of the problem was that the image file I tried to boot was of an incorrect format. I downloaded the Ubuntu Minimal and got that working on the secondary GPU, but still nothing on the iGPU.

Here are some new output from my clean install:

find /sys/kernel/iommu_groups/ -type l
/sys/kernel/iommu_groups/7/devices/0000:01:00.0
/sys/kernel/iommu_groups/5/devices/0000:00:14.3
/sys/kernel/iommu_groups/5/devices/0000:00:14.0
/sys/kernel/iommu_groups/13/devices/0000:07:00.0
/sys/kernel/iommu_groups/13/devices/0000:07:00.1
/sys/kernel/iommu_groups/3/devices/0000:08:00.4
/sys/kernel/iommu_groups/3/devices/0000:00:08.0
/sys/kernel/iommu_groups/3/devices/0000:08:00.2
/sys/kernel/iommu_groups/3/devices/0000:08:00.0
/sys/kernel/iommu_groups/3/devices/0000:00:08.1
/sys/kernel/iommu_groups/3/devices/0000:08:00.3
/sys/kernel/iommu_groups/3/devices/0000:08:00.6
/sys/kernel/iommu_groups/11/devices/0000:06:00.0
/sys/kernel/iommu_groups/11/devices/0000:02:0a.0
/sys/kernel/iommu_groups/1/devices/0000:00:01.2
/sys/kernel/iommu_groups/8/devices/0000:02:06.0
/sys/kernel/iommu_groups/6/devices/0000:00:18.3
/sys/kernel/iommu_groups/6/devices/0000:00:18.1
/sys/kernel/iommu_groups/6/devices/0000:00:18.6
/sys/kernel/iommu_groups/6/devices/0000:00:18.4
/sys/kernel/iommu_groups/6/devices/0000:00:18.2
/sys/kernel/iommu_groups/6/devices/0000:00:18.0
/sys/kernel/iommu_groups/6/devices/0000:00:18.7
/sys/kernel/iommu_groups/6/devices/0000:00:18.5
/sys/kernel/iommu_groups/14/devices/0000:09:00.0
/sys/kernel/iommu_groups/4/devices/0000:00:08.2
/sys/kernel/iommu_groups/12/devices/0000:03:00.0
/sys/kernel/iommu_groups/2/devices/0000:00:01.3
/sys/kernel/iommu_groups/10/devices/0000:02:09.0
/sys/kernel/iommu_groups/10/devices/0000:05:00.0
/sys/kernel/iommu_groups/0/devices/0000:00:01.0
/sys/kernel/iommu_groups/9/devices/0000:04:00.3
/sys/kernel/iommu_groups/9/devices/0000:04:00.1
/sys/kernel/iommu_groups/9/devices/0000:02:08.0
/sys/kernel/iommu_groups/9/devices/0000:04:00.0

VM config:

bios: ovmf
bootdisk: scsi0
cores: 1
efidisk0: TreeDisk:vm-100-disk-1,size=1M
hostpci0: 08:00,pcie=1,x-vga=on
ide2: none,media=cdrom
machine: q35
memory: 1024
name: UbuntuTest
net0: virtio=9A:A1:1B:7A:BF:22,bridge=vmbr0,firewall=1
numa: 0
ostype: l26
scsi0: TreeDisk:vm-100-disk-0,size=10G
scsihw: virtio-scsi-pci
smbios1: uuid=060a5737-9e0c-4f31-ba34-cfaada60edc8
sockets: 1
vmgenid: 096d895b-a1f8-4785-a650-f869990fef92

 

[AxAn]

lspci -k
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Root Complex
        Subsystem: ASRock Incorporation Raven/Raven2 Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 IOMMU
        Subsystem: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 IOMMU
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe GPP Bridge [6:0]
        Kernel driver in use: pcieport
00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 PCIe GPP Bridge [6:0]
        Kernel driver in use: pcieport
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Internal PCIe GPP Bridge 0 to Bus A
        Kernel driver in use: pcieport
00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Internal PCIe GPP Bridge 0 to Bus B
        Kernel driver in use: pcieport
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)
        Subsystem: ASRock Incorporation FCH SMBus Controller
        Kernel driver in use: piix4_smbus
        Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
        Subsystem: ASRock Incorporation FCH LPC Bridge
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 3
        Kernel driver in use: k10temp
        Kernel modules: k10temp
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Raven/Raven2 Device 24: Function 7
01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57ad
        Kernel driver in use: pcieport
02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3
        Kernel driver in use: pcieport
02:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
        Kernel driver in use: pcieport
02:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
        Kernel driver in use: pcieport
02:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4
        Kernel driver in use: pcieport
03:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
        Subsystem: ASRock Incorporation I211 Gigabit Network Connection
        Kernel driver in use: igb
        Kernel modules: igb
04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
04:00.1 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
        Kernel driver in use: xhci_hcd
04:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
        Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
        Kernel driver in use: xhci_hcd
05:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
        Kernel driver in use: ahci
        Kernel modules: ahci
06:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
        Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
        Kernel driver in use: ahci
        Kernel modules: ahci
07:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Oland XT [Radeon HD 8670 / R7 250/350] (rev 81)
        Subsystem: Dell Oland XT [Radeon HD 8670 / R7 250/350]
        Kernel modules: radeon, amdgpu
07:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series]
        Subsystem: Dell Oland/Hainan/Cape Verde/Pitcairn HDMI Audio [Radeon HD 7000 Series]
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel
08:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function (rev c8)
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Zeppelin/Raven/Raven2 PCIe Dummy Function
08:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor
        Kernel driver in use: vfio-pci
08:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Raven USB 3.1
        Subsystem: ASRock Incorporation Raven USB 3.1
        Kernel driver in use: xhci_hcd
08:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Raven USB 3.1
        Subsystem: ASRock Incorporation Raven USB 3.1
        Kernel driver in use: xhci_hcd
08:00.6 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller
        Subsystem: ASRock Incorporation Family 17h (Models 10h-1fh) HD Audio Controller
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel
09:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 61)
        Subsystem: ASRock Incorporation FCH SATA Controller [AHCI mode]
        Kernel driver in use: ahci
        Kernel modules: ahci

 

[AxAn]

The VM log:

Jan 17 00:35:44 nas pvedaemon[1510]: <root@pam> starting task UPID:nas:000006B7:00001865:5E20F350:qmstart:100:root@pam:
Jan 17 00:35:44 nas pvedaemon[1719]: start VM 100: UPID:nas:000006B7:00001865:5E20F350:qmstart:100:root@pam:
Jan 17 00:35:44 nas kernel: [   62.233905] xhci_hcd 0000:08:00.4: remove, state 4
Jan 17 00:35:44 nas kernel: [   62.233914] usb usb8: USB disconnect, device number 1
Jan 17 00:35:44 nas kernel: [   62.234072] xhci_hcd 0000:08:00.4: USB bus 8 deregistered
Jan 17 00:35:44 nas kernel: [   62.234083] xhci_hcd 0000:08:00.4: remove, state 4
Jan 17 00:35:44 nas kernel: [   62.234085] usb usb7: USB disconnect, device number 1
Jan 17 00:35:44 nas kernel: [   62.234543] xhci_hcd 0000:08:00.4: USB bus 7 deregistered
Jan 17 00:35:44 nas kernel: [   62.312252] xhci_hcd 0000:08:00.3: remove, state 4
Jan 17 00:35:44 nas kernel: [   62.312271] usb usb6: USB disconnect, device number 1
Jan 17 00:35:44 nas kernel: [   62.312686] xhci_hcd 0000:08:00.3: USB bus 6 deregistered
Jan 17 00:35:44 nas kernel: [   62.312699] xhci_hcd 0000:08:00.3: remove, state 4
Jan 17 00:35:44 nas kernel: [   62.312703] usb usb5: USB disconnect, device number 1
Jan 17 00:35:44 nas kernel: [   62.313371] xhci_hcd 0000:08:00.3: USB bus 5 deregistered
Jan 17 00:35:44 nas systemd[1]: Created slice qemu.slice.
Jan 17 00:35:44 nas systemd[1]: Started 100.scope.
Jan 17 00:35:44 nas systemd-udevd[1724]: Using default interface naming scheme 'v240'.
Jan 17 00:35:44 nas systemd-udevd[1724]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Jan 17 00:35:44 nas systemd-udevd[1724]: Could not generate persistent MAC address for tap100i0: No such file or directory
Jan 17 00:35:45 nas kernel: [   62.920670] device tap100i0 entered promiscuous mode
Jan 17 00:35:45 nas systemd-udevd[1724]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Jan 17 00:35:45 nas systemd-udevd[1724]: Could not generate persistent MAC address for fwbr100i0: No such file or directory
Jan 17 00:35:45 nas systemd-udevd[1731]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Jan 17 00:35:45 nas systemd-udevd[1731]: Using default interface naming scheme 'v240'.
Jan 17 00:35:45 nas systemd-udevd[1731]: Could not generate persistent MAC address for fwln100i0: No such file or directory
Jan 17 00:35:45 nas systemd-udevd[1724]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Jan 17 00:35:45 nas systemd-udevd[1724]: Could not generate persistent MAC address for fwpr100p0: No such file or directory
Jan 17 00:35:45 nas kernel: [   62.944312] fwbr100i0: port 1(fwln100i0) entered blocking state
Jan 17 00:35:45 nas kernel: [   62.944314] fwbr100i0: port 1(fwln100i0) entered disabled state
Jan 17 00:35:45 nas kernel: [   62.944380] device fwln100i0 entered promiscuous mode
Jan 17 00:35:45 nas kernel: [   62.944422] fwbr100i0: port 1(fwln100i0) entered blocking state
Jan 17 00:35:45 nas kernel: [   62.944423] fwbr100i0: port 1(fwln100i0) entered forwarding state
Jan 17 00:35:45 nas kernel: [   62.947144] vmbr0: port 2(fwpr100p0) entered blocking state
Jan 17 00:35:45 nas kernel: [   62.947145] vmbr0: port 2(fwpr100p0) entered disabled state
Jan 17 00:35:45 nas kernel: [   62.947220] device fwpr100p0 entered promiscuous mode
Jan 17 00:35:45 nas kernel: [   62.947266] vmbr0: port 2(fwpr100p0) entered blocking state
Jan 17 00:35:45 nas kernel: [   62.947267] vmbr0: port 2(fwpr100p0) entered forwarding state
Jan 17 00:35:45 nas kernel: [   62.949518] fwbr100i0: port 2(tap100i0) entered blocking state
Jan 17 00:35:45 nas kernel: [   62.949520] fwbr100i0: port 2(tap100i0) entered disabled state
Jan 17 00:35:45 nas kernel: [   62.949607] fwbr100i0: port 2(tap100i0) entered blocking state
Jan 17 00:35:45 nas kernel: [   62.949609] fwbr100i0: port 2(tap100i0) entered forwarding state
Jan 17 00:35:45 nas kernel: [   63.177887] vfio-pci 0000:08:00.0: vfio_ecap_init: hiding ecap 0x19@0x270
Jan 17 00:35:45 nas kernel: [   63.197732] vfio-pci 0000:08:00.2: enabling device (0000 -> 0002)
Jan 17 00:35:45 nas kernel: [   63.200062] vfio-pci 0000:08:00.3: enabling device (0000 -> 0002)
Jan 17 00:35:45 nas kernel: [   63.239555] vfio-pci 0000:08:00.4: enabling device (0000 -> 0002)
Jan 17 00:35:45 nas kernel: [   63.297596] vfio-pci 0000:08:00.6: enabling device (0000 -> 0002)

 

[AxAn]

/etc/modprobe.d/vfio.conf

options vfio-pci ids=1002:15d8,1002:15de,1022:15df,1022:15e0,1022:15e1,1022:15e3 disable_vga=1

I also tried to add "0000:00:08.0" and "0000:00:08.1" since those are in the same iommu group, but same problem:

options vfio-pci ids=1002:15d8,1002:15de,1022:15df,1022:15e0,1022:15e1,1022:15e3,1022:1452,1022:15db disable_vga=1

I do get things working if I flip things around and output the VM to the Radeon HD 8670 and set the boot display to the iGPU for Proxmox,
but I can still not get the VM to use the iGPU.
The Ubuntu VM responds to "Shutdown" etc so it seems to be working ok but just not showing any output to the iGPU.

 

[AxAn]

It doesn't s seem to be possible to passthrough an integrated GPU (APU) according to this post.
That was 4-5 wasted days.