solved - HBA unable to passthrough

[mihaib]

Hi all,

I moved my truenas scale drives from sata to a HBA controller flashed in IT Mode.
on the proxmox:
lspci -nn | grep LSI
01:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072] (rev 03)
---
lsmod | grep vfio
vfio_pci 16384 0
vfio_pci_core 86016 1 vfio_pci
vfio_iommu_type1 49152 0
vfio 65536 4 vfio_pci_core,vfio_iommu_type1,vfio_pci
iommufd 94208 1 vfio
irqbypass 12288 2 vfio_pci_core,kvm
-----
dmesg | grep mpt3
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-6.8.12-16-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on iommu=pt mpt3sas.max_queue_depth=10000
[ 0.284495] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.8.12-16-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on iommu=pt mpt3sas.max_queue_depth=10000
[ 2.033228] mpt3sas version 43.100.00.00 loaded
[ 581.425084] mpt2sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x4433221103000000)
[ 581.425103] mpt2sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x4433221102000000)
[ 581.425112] mpt2sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x4433221104000000)
[ 581.425142] mpt2sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x4433221105000000)
[ 581.425158] mpt2sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x4433221106000000)
[ 581.425173] mpt2sas_cm0: mpt3sas_transport_port_remove: removed: sas_addr(0x4433221107000000)

cat /etc/modules
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.
# Parameters can be specified after the module name.
nvidia
nvidia-modeset
nvidia_uvm

# load nvidia modules
nvidia-drm
nvidia-uvm

#load vfio
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

----
now, I see the disks attached to the controller and as well listed under disk. When I try to passthrough to my TrueNAS VM, they disappear from Proxmox, but the VM is not booting. remains stuck in "booking from disk"

Any advice?
thank you

 

[Impact]

If you can see the disks on the node you did not properly prepare the HBA for passthrough. Please share the information from here: https://gist.github.com/Impact123/3...mmands-for-diagnostic-or-when-asking-for-help
Also see: https://forum.proxmox.com/threads/pci-hba-passthrough-causes-vm-boot-to-hang.179814/

 

[mihaib]

problem fixed. there was an option on the controller to be set for boot. this needs to be disabled. then the vm boots ok.
thank you.