iommu pci-e passthrough problem with gpu

  • Thread starter Thread starter vibe
  • Start date Start date
V

vibe

Guest
Failed to assign device "hostpci0" : Operation not permitted
kvm: -device pci-assign,host=01:00.0,id=hostpci0,bus=pci.0,addr=0x1 0: Device 'pci-assign' could not be initialized


tried also add hostpci0: 00:02.0 and hostpci1: 01:00.0 to my virtual server conf but so success :/


I used this quide and unbinded device from host kernel driver -> http://www.linux-kvm.org/page/How_to...th_VT-d_in_KVM


dmesg shows iommu enabled


AMD-Vi: Enabling IOMMU at 0000:00:00.2 cap 0x40
AMD-Vi: Lazy IO/TLB flushing enabled
AMD-Vi: Initialized for Passthrough Mode


Ideas?


More details down ->


00:00.0 0600: 1002:5a14 (rev 02)
00:00.2 0806: 1002:5a23
00:02.0 0604: 1002:5a16
00:04.0 0604: 1002:5a18
00:05.0 0604: 1002:5a19
00:0b.0 0604: 1002:5a1f
00:0c.0 0604: 1002:5a20
00:0d.0 0604: 1002:5a1e
00:11.0 0106: 1002:4391 (rev 40)
00:12.0 0c03: 1002:4397
00:12.2 0c03: 1002:4396
00:13.0 0c03: 1002:4397
00:13.2 0c03: 1002:4396
00:14.0 0c05: 1002:4385 (rev 42)
00:14.2 0403: 1002:4383 (rev 40)
00:14.3 0601: 1002:439d (rev 40)
00:14.4 0604: 1002:4384 (rev 40)
00:14.5 0c03: 1002:4399
00:15.0 0604: 1002:43a0
00:15.1 0604: 1002:43a1
00:16.0 0c03: 1002:4397
00:16.2 0c03: 1002:4396
00:18.0 0600: 1022:1200
00:18.1 0600: 1022:1201
00:18.2 0600: 1022:1202
00:18.3 0600: 1022:1203
00:18.4 0600: 1022:1204
01:00.0 0300: 1002:6898
01:00.1 0403: 1002:aa50
02:00.0 0101: 197b:2362 (rev 10)
03:00.0 0101: 197b:2362 (rev 10)
04:00.0 0300: 1002:6898
04:00.1 0403: 1002:aa50
05:00.0 0300: 1002:6898
05:00.1 0403: 1002:aa50
06:00.0 0300: 1002:6898
06:00.1 0403: 1002:aa50
07:07.0 0c00: 1106:3044 (rev c0)
08:00.0 0300: 1002:6898
08:00.1 0403: 1002:aa50
09:00.0 0200: 10ec:8168 (rev 06)


00:00.0 Host bridge [0600]: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (external gfx0 port B) [1002:5a14] (rev 02)
00:00.2 IOMMU [0806]: Advanced Micro Devices [AMD] nee ATI RD990 I/O Memory Management Unit (IOMMU) [1002:5a23]
00:02.0 PCI bridge [0604]: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (PCI express gpp port B) [1002:5a16]
00:04.0 PCI bridge [0604]: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (PCI express gpp port D) [1002:5a18]
00:05.0 PCI bridge [0604]: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (PCI express gpp port E) [1002:5a19]
00:0b.0 PCI bridge [0604]: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (NB-SB link) [1002:5a1f]
00:0c.0 PCI bridge [0604]: Advanced Micro Devices [AMD] nee ATI Device [1002:5a20]
00:0d.0 PCI bridge [0604]: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (external gfx1 port B) [1002:5a1e]
00:11.0 SATA controller [0106]: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] [1002:4391] (rev 40)
00:12.0 USB controller [0c03]: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
00:12.2 USB controller [0c03]: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
00:13.0 USB controller [0c03]: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
00:13.2 USB controller [0c03]: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
00:14.0 SMBus [0c05]: Advanced Micro Devices [AMD] nee ATI SBx00 SMBus Controller [1002:4385] (rev 42)
00:14.2 Audio device [0403]: Advanced Micro Devices [AMD] nee ATI SBx00 Azalia (Intel HDA) [1002:4383] (rev 40)
00:14.3 ISA bridge [0601]: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 LPC host controller [1002:439d] (rev 40)
00:14.4 PCI bridge [0604]: Advanced Micro Devices [AMD] nee ATI SBx00 PCI to PCI Bridge [1002:4384] (rev 40)
00:14.5 USB controller [0c03]: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI2 Controller [1002:4399]
00:15.0 PCI bridge [0604]: Advanced Micro Devices [AMD] nee ATI SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) [1002:43a0]
00:15.1 PCI bridge [0604]: Advanced Micro Devices [AMD] nee ATI SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) [1002:43a1]
00:16.0 USB controller [0c03]: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
00:16.2 USB controller [0c03]: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
00:18.0 Host bridge [0600]: Advanced Micro Devices [AMD] Family 10h Processor HyperTransport Configuration [1022:1200]
00:18.1 Host bridge [0600]: Advanced Micro Devices [AMD] Family 10h Processor Address Map [1022:1201]
00:18.2 Host bridge [0600]: Advanced Micro Devices [AMD] Family 10h Processor DRAM Controller [1022:1202]
00:18.3 Host bridge [0600]: Advanced Micro Devices [AMD] Family 10h Processor Miscellaneous Control [1022:1203]
00:18.4 Host bridge [0600]: Advanced Micro Devices [AMD] Family 10h Processor Link Control [1022:1204]
01:00.0 VGA compatible controller [0300]: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] [1002:6898]
01:00.1 Audio device [0403]: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series] [1002:aa50]
02:00.0 IDE interface [0101]: JMicron Technology Corp. JMB362 SATA Controller [197b:2362] (rev 10)
03:00.0 IDE interface [0101]: JMicron Technology Corp. JMB362 SATA Controller [197b:2362] (rev 10)
04:00.0 VGA compatible controller [0300]: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] [1002:6898]
04:00.1 Audio device [0403]: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series] [1002:aa50]
05:00.0 VGA compatible controller [0300]: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] [1002:6898]
05:00.1 Audio device [0403]: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series] [1002:aa50]
06:00.0 VGA compatible controller [0300]: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] [1002:6898]
06:00.1 Audio device [0403]: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series] [1002:aa50]
07:07.0 FireWire (IEEE 1394) [0c00]: VIA Technologies, Inc. VT6306/7/8 [Fire II(M)] IEEE 1394 OHCI Controller [1106:3044] (rev c0)
08:00.0 VGA compatible controller [0300]: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] [1002:6898]
08:00.1 Audio device [0403]: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series] [1002:aa50]
09:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller [10ec:8168] (rev 06)


-[0000:00]-+-00.0
+-00.2
+-02.0-[01]--+-00.0
| \-00.1
+-04.0-[02]----00.0
+-05.0-[03]----00.0
+-0b.0-[04]--+-00.0
| \-00.1
+-0c.0-[05]--+-00.0
| \-00.1
+-0d.0-[06]--+-00.0
| \-00.1
+-11.0
+-12.0
+-12.2
+-13.0
+-13.2
+-14.0
+-14.2
+-14.3
+-14.4-[07]----07.0
+-14.5
+-15.0-[08]--+-00.0
| \-00.1
+-15.1-[09]----00.0
+-16.0
+-16.2
+-18.0
+-18.1
+-18.2
+-18.3
\-18.4


00:00.0 Host bridge: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (external gfx0 port B) (rev 02)
Subsystem: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (external gfx0 port B)
Flags: fast devsel
Capabilities: [f0] HyperTransport: MSI Mapping Enable+ Fixed+
Capabilities: [c4] HyperTransport: Slave or Primary Interface
Capabilities: [40] HyperTransport: Retry Mode
Capabilities: [54] HyperTransport: UnitID Clumping
Capabilities: [9c] HyperTransport: #1a
Capabilities: [70] MSI: Enable- Count=1/4 Maskable- 64bit-


00:00.2 IOMMU: Advanced Micro Devices [AMD] nee ATI RD990 I/O Memory Management Unit (IOMMU)
Subsystem: Advanced Micro Devices [AMD] nee ATI RD990 I/O Memory Management Unit (IOMMU)
Flags: fast devsel, IRQ 56
Capabilities: [40] Secure device <?>
Capabilities: [54] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [64] HyperTransport: MSI Mapping Enable+ Fixed+


00:02.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (PCI express gpp port B) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: 0000e000-0000efff
Memory behind bridge: fea00000-feafffff
Prefetchable memory behind bridge: 00000000c0000000-00000000cfffffff
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Root Port (Slot+), MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [b0] Subsystem: Advanced Micro Devices [AMD] nee ATI Device 5a14
Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [190] Access Control Services


00:04.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (PCI express gpp port D) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
I/O behind bridge: 0000d000-0000dfff
Memory behind bridge: fe900000-fe9fffff
Prefetchable memory behind bridge: 00000000d0100000-00000000d01fffff
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Root Port (Slot+), MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [b0] Subsystem: Advanced Micro Devices [AMD] nee ATI Device 5a14
Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [190] Access Control Services


00:05.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (PCI express gpp port E) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
I/O behind bridge: 0000c000-0000cfff
Memory behind bridge: fe800000-fe8fffff
Prefetchable memory behind bridge: 00000000d0200000-00000000d02fffff
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Root Port (Slot+), MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [b0] Subsystem: Advanced Micro Devices [AMD] nee ATI Device 5a14
Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [190] Access Control Services


00:0b.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (NB-SB link) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
I/O behind bridge: 0000b000-0000bfff
Memory behind bridge: fe700000-fe7fffff
Prefetchable memory behind bridge: 00000000b0000000-00000000bfffffff
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Root Port (Slot+), MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [b0] Subsystem: Advanced Micro Devices [AMD] nee ATI Device 5a14
Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [190] Access Control Services


00:0c.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI Device 5a20 (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
I/O behind bridge: 0000a000-0000afff
Memory behind bridge: fe600000-fe6fffff
Prefetchable memory behind bridge: 00000000a0000000-00000000afffffff
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Root Port (Slot+), MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [b0] Subsystem: Advanced Micro Devices [AMD] nee ATI Device 5a14
Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [190] Access Control Services


00:0d.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI RD890 PCI to PCI bridge (external gfx1 port B) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=06, subordinate=06, sec-latency=0
I/O behind bridge: 00009000-00009fff
Memory behind bridge: fe500000-fe5fffff
Prefetchable memory behind bridge: 0000000090000000-000000009fffffff
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Root Port (Slot+), MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [b0] Subsystem: Advanced Micro Devices [AMD] nee ATI Device 5a14
Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [190] Access Control Services


00:11.0 SATA controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40) (prog-if 01 [AHCI 1.0])
Subsystem: ASUSTeK Computer Inc. Device 84dd
Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 19
I/O ports at f040
I/O ports at f030
I/O ports at f020
I/O ports at f010
I/O ports at f000
Memory at feb0b000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [70] SATA HBA v1.0
Capabilities: [a4] PCI Advanced Features
Kernel driver in use: ahci


00:12.0 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller (prog-if 10 [OHCI])
Subsystem: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 18
Memory at feb0a000 (32-bit, non-prefetchable) [size=4K]
Kernel driver in use: ohci_hcd


00:12.2 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller (prog-if 20 [EHCI])
Subsystem: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller
Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 17
Memory at feb09000 (32-bit, non-prefetchable)
Capabilities: [c0] Power Management version 2
Capabilities: [e4] Debug port: BAR=1 offset=00e0
Kernel driver in use: ehci_hcd


00:13.0 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller (prog-if 10 [OHCI])
Subsystem: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 20
Memory at feb08000 (32-bit, non-prefetchable) [size=4K]
Kernel driver in use: ohci_hcd


00:13.2 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller (prog-if 20 [EHCI])
Subsystem: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller
Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 21
Memory at feb07000 (32-bit, non-prefetchable)
Capabilities: [c0] Power Management version 2
Capabilities: [e4] Debug port: BAR=1 offset=00e0
Kernel driver in use: ehci_hcd


00:14.0 SMBus: Advanced Micro Devices [AMD] nee ATI SBx00 SMBus Controller (rev 42)
Subsystem: Advanced Micro Devices [AMD] nee ATI SBx00 SMBus Controller
Flags: 66MHz, medium devsel
Kernel driver in use: piix4_smbus


00:14.2 Audio device: Advanced Micro Devices [AMD] nee ATI SBx00 Azalia (Intel HDA) (rev 40)
Subsystem: ASUSTeK Computer Inc. Device 8436
Flags: bus master, slow devsel, latency 32, IRQ 16
Memory at feb00000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [50] Power Management version 2
Kernel driver in use: HDA Intel


00:14.3 ISA bridge: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 LPC host controller (rev 40)
Subsystem: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 LPC host controller
Flags: bus master, 66MHz, medium devsel, latency 0


00:14.4 PCI bridge: Advanced Micro Devices [AMD] nee ATI SBx00 PCI to PCI Bridge (rev 40) (prog-if 01 [Subtractive decode])
Flags: bus master, VGA palette snoop, 66MHz, medium devsel, latency 64
Bus: primary=00, secondary=07, subordinate=07, sec-latency=64
I/O behind bridge: 00008000-00008fff
Memory behind bridge: fe400000-fe4fffff


00:14.5 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI2 Controller (prog-if 10 [OHCI])
Subsystem: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI2 Controller
Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 18
Memory at feb06000 (32-bit, non-prefetchable) [size=4K]
Kernel driver in use: ohci_hcd


00:15.0 PCI bridge: Advanced Micro Devices [AMD] nee ATI SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=08, subordinate=08, sec-latency=0
I/O behind bridge: 00007000-00007fff
Memory behind bridge: fe300000-fe3fffff
Prefetchable memory behind bridge: 0000000080000000-000000008fffffff
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Root Port (Slot-), MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [b0] Subsystem: Advanced Micro Devices [AMD] nee ATI Device 0000
Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>


00:15.1 PCI bridge: Advanced Micro Devices [AMD] nee ATI SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=09, subordinate=09, sec-latency=0
I/O behind bridge: 00006000-00006fff
Prefetchable memory behind bridge: 00000000d0000000-00000000d00fffff
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Root Port (Slot-), MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [b0] Subsystem: Advanced Micro Devices [AMD] nee ATI Device 0000
Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>


00:16.0 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller (prog-if 10 [OHCI])
Subsystem: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 22
Memory at feb05000 (32-bit, non-prefetchable) [size=4K]
Kernel driver in use: ohci_hcd


00:16.2 USB controller: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller (prog-if 20 [EHCI])
Subsystem: Advanced Micro Devices [AMD] nee ATI SB7x0/SB8x0/SB9x0 USB EHCI Controller
Flags: bus master, 66MHz, medium devsel, latency 32, IRQ 23
Memory at feb04000 (32-bit, non-prefetchable)
Capabilities: [c0] Power Management version 2
Capabilities: [e4] Debug port: BAR=1 offset=00e0
Kernel driver in use: ehci_hcd


00:18.0 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor HyperTransport Configuration
Flags: fast devsel
Capabilities: [80] HyperTransport: Host or Secondary Interface


00:18.1 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Address Map
Flags: fast devsel


00:18.2 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor DRAM Controller
Flags: fast devsel
Kernel driver in use: amd64_edac


00:18.3 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Miscellaneous Control
Flags: fast devsel
Capabilities: [f0] Secure device <?>
Kernel driver in use: k10temp


00:18.4 Host bridge: Advanced Micro Devices [AMD] Family 10h Processor Link Control
Flags: fast devsel


01:00.0 VGA compatible controller: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] (prog-if 00 [VGA controller])
Subsystem: PC Partner Limited Device e140
Flags: bus master, fast devsel, latency 0, IRQ 24
Memory at c0000000 (64-bit, prefetchable) [size=256M]
Memory at fea20000 (64-bit, non-prefetchable) [size=128K]
I/O ports at e000
Expansion ROM at fea00000 [disabled] [size=128K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: pci-stub


01:00.1 Audio device: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series]
Subsystem: PC Partner Limited Device aa50
Flags: bus master, fast devsel, latency 0, IRQ 59
Memory at fea40000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: HDA Intel


02:00.0 IDE interface: JMicron Technology Corp. JMB362 SATA Controller (rev 10) (prog-if 85 [Master SecO PriO])
Subsystem: ASUSTeK Computer Inc. P8P67 Deluxe Motherboard
Flags: bus master, fast devsel, latency 0, IRQ 44
I/O ports at d040
I/O ports at d030
I/O ports at d020
I/O ports at d010
I/O ports at d000
Memory at fe910000 (32-bit, non-prefetchable)
[virtual] Expansion ROM at d0100000 [disabled] [size=64K]
Capabilities: [8c] Power Management version 3
Capabilities: [50] Express Legacy Endpoint, MSI 00
Kernel driver in use: pata_jmicron


03:00.0 IDE interface: JMicron Technology Corp. JMB362 SATA Controller (rev 10) (prog-if 85 [Master SecO PriO])
Subsystem: ASUSTeK Computer Inc. P8P67 Deluxe Motherboard
Flags: bus master, fast devsel, latency 0, IRQ 46
I/O ports at c040
I/O ports at c030
I/O ports at c020
I/O ports at c010
I/O ports at c000
Memory at fe810000 (32-bit, non-prefetchable)
[virtual] Expansion ROM at d0200000 [disabled] [size=64K]
Capabilities: [8c] Power Management version 3
Capabilities: [50] Express Legacy Endpoint, MSI 00
Kernel driver in use: pata_jmicron


04:00.0 VGA compatible controller: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] (prog-if 00 [VGA controller])
Subsystem: PC Partner Limited Device e140
Flags: bus master, fast devsel, latency 0, IRQ 60
Memory at b0000000 (64-bit, prefetchable) [size=256M]
Memory at fe720000 (64-bit, non-prefetchable) [size=128K]
I/O ports at b000
Expansion ROM at fe700000 [disabled] [size=128K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: radeon


04:00.1 Audio device: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series]
Subsystem: PC Partner Limited Device aa50
Flags: bus master, fast devsel, latency 0, IRQ 61
Memory at fe740000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: HDA Intel


05:00.0 VGA compatible controller: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] (prog-if 00 [VGA controller])
Subsystem: Hightech Information System Ltd. Device 2289
Flags: bus master, fast devsel, latency 0, IRQ 62
Memory at a0000000 (64-bit, prefetchable) [size=256M]
Memory at fe620000 (64-bit, non-prefetchable) [size=128K]
I/O ports at a000
Expansion ROM at fe600000 [disabled] [size=128K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: radeon


05:00.1 Audio device: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series]
Subsystem: Hightech Information System Ltd. Device aa50
Flags: bus master, fast devsel, latency 0, IRQ 63
Memory at fe640000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: HDA Intel


06:00.0 VGA compatible controller: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] (prog-if 00 [VGA controller])
Subsystem: Advanced Micro Devices [AMD] nee ATI Device 0b00
Flags: bus master, fast devsel, latency 0, IRQ 64
Memory at 90000000 (64-bit, prefetchable) [size=256M]
Memory at fe520000 (64-bit, non-prefetchable) [size=128K]
I/O ports at 9000
Expansion ROM at fe500000 [disabled] [size=128K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: radeon


06:00.1 Audio device: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series]
Subsystem: Advanced Micro Devices [AMD] nee ATI Cypress HDMI Audio [Radeon HD 5800 Series]
Flags: bus master, fast devsel, latency 0, IRQ 65
Memory at fe540000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: HDA Intel


07:07.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6306/7/8 [Fire II(M)] IEEE 1394 OHCI Controller (rev c0) (prog-if 10 [OHCI])
Subsystem: ASUSTeK Computer Inc. M4A series motherboard
Flags: bus master, medium devsel, latency 32, IRQ 22
Memory at fe400000 (32-bit, non-prefetchable) [size=2K]
I/O ports at 8000
Capabilities: [50] Power Management version 2
Kernel driver in use: firewire_ohci


08:00.0 VGA compatible controller: Advanced Micro Devices [AMD] nee ATI Cypress XT [Radeon HD 5870] (prog-if 00 [VGA controller])
Subsystem: Advanced Micro Devices [AMD] nee ATI Device 0b00
Flags: bus master, fast devsel, latency 0, IRQ 66
Memory at 80000000 (64-bit, prefetchable) [size=256M]
Memory at fe320000 (64-bit, non-prefetchable) [size=128K]
I/O ports at 7000
Expansion ROM at fe300000 [disabled] [size=128K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: radeon
 
Now I got guest to see one gpu with "options kvm allow_unsafe_assigned_interrupts=1"


I would like to add more gpus to guest, but with two gpus guest can't boot.. (hostpci0 and hostpci1)


and with hotplugging I get ->


qm> device_add pci-assign,host=04:00.0,id=gpu1
Bus 'pci.0' does not support hotplugging


and


# qm set 100 -hostpci2 04:00.0
Unknown option: hostpci2
400 unable to parse option
qm set <vmid> [OPTIONS]




qm> info pci
Bus 0, device 0, function 0:
Host bridge: PCI device 8086:1237
id ""
Bus 0, device 1, function 0:
ISA bridge: PCI device 8086:7000
id ""
Bus 0, device 1, function 1:
IDE controller: PCI device 8086:7010
BAR4: I/O at 0xc260 [0xc26f].
id ""
Bus 0, device 1, function 2:
USB controller: PCI device 8086:7020
IRQ 11.
BAR4: I/O at 0xc240 [0xc25f].
id ""
Bus 0, device 2, function 0:
VGA controller: PCI device 1013:00b8
BAR0: 32 bit prefetchable memory at 0xfc000000 [0xfdffffff].
BAR1: 32 bit memory at 0xf0060000 [0xf0060fff].
BAR6: 32 bit memory at 0xffffffffffffffff [0x0000fffe].
id ""
Bus 0, device 10, function 0:
SCSI controller: PCI device 1af4:1001
IRQ 10.
BAR0: I/O at 0xc200 [0xc23f].
BAR1: 32 bit memory at 0xf0061000 [0xf0061fff].
id "virtio0"
Bus 0, device 17, function 0:
VGA controller: PCI device 1002:6898 (my graphic card)
IRQ 10.
BAR0: 32 bit memory at 0xe0000000 [0xefffffff].
BAR2: 32 bit memory at 0xf0000000 [0xf001ffff].
BAR4: I/O at 0xc000 [0xc0ff].
BAR6: 32 bit memory at 0xffffffffffffffff [0x0001fffe].
id "hostpci1"
Bus 0, device 18, function 0:
Ethernet controller: PCI device 10ec:8139
IRQ 10.
BAR0: I/O at 0xc100 [0xc1ff].
BAR1: 32 bit memory at 0xf0062000 [0xf00620ff].
BAR6: 32 bit memory at 0xffffffffffffffff [0x0000fffe].
id "net0"



How could I add multiple gpus to one guest?
 
We only support 2 hostpci devcies (hostpci0 and hostpci1) currently.

Ok. Would be nice to do bitcoin mining with multiple gpus in proxmox. You are going to support in future?

Using hostpci0 and hostpci1 virtual machine can't boot. Gives blank screen.

Ideas for this?