I'm a new Proxmox user, just getting set up with my first install. It's gone well, but I'm now having trouble starting a VM after I added a passthrough HBA to its hardware.
I think I've set up PCI passthrough correctly, and IOMMU and vfio are all activated and show up in my dmesg output.
I created a new VM to run TrueNAS Scale, and installed it, and this initially booted quickly and correctly. I then shut down the VM, and added three PCIe hardware devices: an HBA and two other PCIe hard drives. After this, the VM has trouble booting. When I watch the console, SeaBIOS hangs for some time (showing the SeaBIOS version line, and the Machine UUID), then gives various messages indicating that it's having trouble booting. (It might show an "Initializing..." spinner, maybe a Proxmox logo, then something about an iPXE command line, then something about no boot device being available, then it'll go back to the SeaBIOS version/Machine UUID line.) Sometimes it shows all of the passed-through drives as available, then it can't find the boot disk. (The VM options in Proxmox show "sci0, net0" for the boot options, but apparently sometimes SeaBIOS is attempting to boot from the passed-through drives, which are _not_ selected as boot options.)
I've tried rebooting a number of times; once and only once it _did_ go through to the installed TrueNAS, and everything looked fine--all the passed-through disks were visible to it. But when I rebooted the VM, it once again hung for a while and then got stuck in the same loop. I've also tried deleting the VM entirely and installing it, with the same result--it's fast and successful until I add the passed-through devices, then it gets stuck at boot.
Running TrueNAS is in fact my main purpose for this installation, so I'd love to figure out how to get this to work. I can do my best to provide additional information about my setup. Thank you.
I think I've set up PCI passthrough correctly, and IOMMU and vfio are all activated and show up in my dmesg output.
I created a new VM to run TrueNAS Scale, and installed it, and this initially booted quickly and correctly. I then shut down the VM, and added three PCIe hardware devices: an HBA and two other PCIe hard drives. After this, the VM has trouble booting. When I watch the console, SeaBIOS hangs for some time (showing the SeaBIOS version line, and the Machine UUID), then gives various messages indicating that it's having trouble booting. (It might show an "Initializing..." spinner, maybe a Proxmox logo, then something about an iPXE command line, then something about no boot device being available, then it'll go back to the SeaBIOS version/Machine UUID line.) Sometimes it shows all of the passed-through drives as available, then it can't find the boot disk. (The VM options in Proxmox show "sci0, net0" for the boot options, but apparently sometimes SeaBIOS is attempting to boot from the passed-through drives, which are _not_ selected as boot options.)
I've tried rebooting a number of times; once and only once it _did_ go through to the installed TrueNAS, and everything looked fine--all the passed-through disks were visible to it. But when I rebooted the VM, it once again hung for a while and then got stuck in the same loop. I've also tried deleting the VM entirely and installing it, with the same result--it's fast and successful until I add the passed-through devices, then it gets stuck at boot.
Running TrueNAS is in fact my main purpose for this installation, so I'd love to figure out how to get this to work. I can do my best to provide additional information about my setup. Thank you.