I have a FreeNAS VM with PCIe Passthrough for a LSI HBA/RAID card. The VM was working before upgrading to Proxmox 6.0. After upgrading it seems that the PCIe card is not getting attached to the VM (based on the qm monitor and that I can't see the disks nor card in the VM). The steps in the PCI(e) Passthrough wiki page were re-checked after noticing this issue. The PCIe card is getting detected by lspci on the host.
this appears in dmesg every time I start the VM:
Attachments:
EDIT: clarity note
Code:
Bus 0, device 0, function 0:
Host bridge: PCI device 8086:29c0
PCI subsystem 1af4:1100
id ""
Bus 0, device 1, function 0:
VGA controller: PCI device 1234:1111
PCI subsystem 1af4:1100
BAR0: 32 bit prefetchable memory at 0xc0000000 [0xc0ffffff].
BAR2: 32 bit memory at 0xc230b000 [0xc230bfff].
BAR6: 32 bit memory at 0xffffffffffffffff [0x0000fffe].
id "vga"
Bus 0, device 26, function 0:
USB controller: PCI device 8086:2937
PCI subsystem 1af4:1100
IRQ 16.
BAR4: I/O at 0xe100 [0xe11f].
id "uhci-4"
Bus 0, device 26, function 1:
USB controller: PCI device 8086:2938
PCI subsystem 1af4:1100
IRQ 17.
BAR4: I/O at 0xe0e0 [0xe0ff].
id "uhci-5"
Bus 0, device 26, function 2:
USB controller: PCI device 8086:2939
PCI subsystem 1af4:1100
IRQ 18.
BAR4: I/O at 0xe0c0 [0xe0df].
id "uhci-6"
Bus 0, device 26, function 7:
USB controller: PCI device 8086:293c
PCI subsystem 1af4:1100
IRQ 19.
BAR0: 32 bit memory at 0xc230a000 [0xc230afff].
id "ehci-2"
Bus 0, device 27, function 0:
Audio controller: PCI device 8086:293e
PCI subsystem 1af4:1100
IRQ 16.
BAR0: 32 bit memory at 0xc2300000 [0xc2303fff].
id "audio0"
Bus 0, device 28, function 0:
PCI bridge: PCI device 1b36:000c
IRQ 16.
BUS 0.
secondary bus 1.
subordinate bus 1.
IO range [0xd000, 0xdfff]
memory range [0xc2000000, 0xc21fffff]
prefetchable memory range [0xfffffffffff00000, 0x000fffff]
BAR0: 32 bit memory at 0xc2309000 [0xc2309fff].
id "ich9-pcie-port-1"
Bus 1, device 0, function 0:
SAS controller: PCI device 1000:0087
PCI subsystem 1000:3020
IRQ 10.
BAR0: I/O at 0xd000 [0xd0ff].
BAR1: 64 bit memory at 0xc2040000 [0xc204ffff].
BAR3: 64 bit memory at 0xc2000000 [0xc203ffff].
BAR6: 32 bit memory at 0xffffffffffffffff [0x000ffffe].
id "hostpci0"
Bus 0, device 28, function 1:
PCI bridge: PCI device 1b36:000c
IRQ 16.
BUS 0.
secondary bus 2.
subordinate bus 2.
IO range [0xc000, 0xcfff]
memory range [0xc1e00000, 0xc1ffffff]
prefetchable memory range [0xfffffffffff00000, 0x000fffff]
BAR0: 32 bit memory at 0xc2308000 [0xc2308fff].
id "ich9-pcie-port-2"
Bus 0, device 28, function 2:
PCI bridge: PCI device 1b36:000c
IRQ 16.
BUS 0.
secondary bus 3.
subordinate bus 3.
IO range [0xb000, 0xbfff]
memory range [0xc1c00000, 0xc1dfffff]
prefetchable memory range [0xfffffffffff00000, 0x000fffff]
BAR0: 32 bit memory at 0xc2307000 [0xc2307fff].
id "ich9-pcie-port-3"
Bus 0, device 28, function 3:
PCI bridge: PCI device 1b36:000c
IRQ 16.
BUS 0.
secondary bus 4.
subordinate bus 4.
IO range [0xa000, 0xafff]
memory range [0xc1a00000, 0xc1bfffff]
prefetchable memory range [0xfffffffffff00000, 0x000fffff]
BAR0: 32 bit memory at 0xc2306000 [0xc2306fff].
id "ich9-pcie-port-4"
Bus 0, device 29, function 0:
USB controller: PCI device 8086:2934
PCI subsystem 1af4:1100
IRQ 16.
BAR4: I/O at 0xe0a0 [0xe0bf].
id "uhci-1"
Bus 0, device 29, function 1:
USB controller: PCI device 8086:2935
PCI subsystem 1af4:1100
IRQ 17.
BAR4: I/O at 0xe080 [0xe09f].
id "uhci-2"
Bus 0, device 29, function 2:
USB controller: PCI device 8086:2936
PCI subsystem 1af4:1100
IRQ 18.
BAR4: I/O at 0xe060 [0xe07f].
id "uhci-3"
Bus 0, device 29, function 7:
USB controller: PCI device 8086:293a
PCI subsystem 1af4:1100
IRQ 19.
BAR0: 32 bit memory at 0xc2305000 [0xc2305fff].
id "ehci"
Bus 0, device 30, function 0:
PCI bridge: PCI device 8086:244e
BUS 0.
secondary bus 5.
subordinate bus 9.
IO range [0x6000, 0x9fff]
memory range [0xc1000000, 0xc18fffff]
prefetchable memory range [0x800000000, 0x8000fffff]
id "pcidmi"
Bus 5, device 1, function 0:
PCI bridge: PCI device 1b36:0001
IRQ 21.
BUS 5.
secondary bus 6.
subordinate bus 6.
IO range [0x9000, 0x9fff]
memory range [0xc1600000, 0xc17fffff]
prefetchable memory range [0x800000000, 0x8000fffff]
BAR0: 64 bit memory at 0xc1800000 [0xc18000ff].
id "pci.0"
Bus 6, device 10, function 0:
SCSI controller: PCI device 1af4:1001
PCI subsystem 1af4:0002
IRQ 23.
BAR0: I/O at 0x9000 [0x907f].
BAR1: 32 bit memory at 0xc1601000 [0xc1601fff].
BAR4: 64 bit prefetchable memory at 0x800004000 [0x800007fff].
id "virtio0"
Bus 6, device 18, function 0:
Ethernet controller: PCI device 1af4:1000
PCI subsystem 1af4:0001
IRQ 23.
BAR0: I/O at 0x9080 [0x909f].
BAR1: 32 bit memory at 0xc1600000 [0xc1600fff].
BAR4: 64 bit prefetchable memory at 0x800000000 [0x800003fff].
BAR6: 32 bit memory at 0xffffffffffffffff [0x0003fffe].
id "net0"
Bus 5, device 2, function 0:
PCI bridge: PCI device 1b36:0001
IRQ 22.
BUS 5.
secondary bus 7.
subordinate bus 7.
IO range [0x8000, 0x8fff]
memory range [0xc1400000, 0xc15fffff]
prefetchable memory range [0xfffffffffff00000, 0x000fffff]
BAR0: 64 bit memory at 0xc1801000 [0xc18010ff].
id "pci.1"
Bus 5, device 3, function 0:
PCI bridge: PCI device 1b36:0001
IRQ 23.
BUS 5.
secondary bus 8.
subordinate bus 8.
IO range [0x7000, 0x7fff]
memory range [0xc1200000, 0xc13fffff]
prefetchable memory range [0xfffffffffff00000, 0x000fffff]
BAR0: 64 bit memory at 0xc1802000 [0xc18020ff].
id "pci.2"
Bus 5, device 4, function 0:
PCI bridge: PCI device 1b36:0001
IRQ 20.
BUS 5.
secondary bus 9.
subordinate bus 9.
IO range [0x6000, 0x6fff]
memory range [0xc1000000, 0xc11fffff]
prefetchable memory range [0xfffffffffff00000, 0x000fffff]
BAR0: 64 bit memory at 0xc1803000 [0xc18030ff].
id "pci.3"
Bus 0, device 31, function 0:
ISA bridge: PCI device 8086:2918
PCI subsystem 1af4:1100
id ""
Bus 0, device 31, function 2:
SATA controller: PCI device 8086:2922
PCI subsystem 1af4:1100
IRQ 16.
BAR4: I/O at 0xe040 [0xe05f].
BAR5: 32 bit memory at 0xc2304000 [0xc2304fff].
id ""
Bus 0, device 31, function 3:
SMBus: PCI device 8086:2930
PCI subsystem 1af4:1100
IRQ 16.
BAR4: I/O at 0xe000 [0xe03f].
id ""
this appears in dmesg every time I start the VM:
Code:
[ 6138.508905] vfio-pci 0000:81:00.0: enabling device (0400 -> 0403)
[ 6138.616771] vfio_ecap_init: 0000:81:00.0 hiding ecap 0x19@0x1e0
Attachments:
- Proxmox GUI info for LSI card
- VM Hardware
- Output of lspci from within the VM
EDIT: clarity note