[PMX8] Intel VFIO issues - console "locks up" but VM's all start fine.

[dlasher]

pve-manager/8.0.4/d258a813cfa6b390 (running kernel: 6.2.16-12-pve)
Dual Intel x5690 CPU (also tested with Intel 26xx v1/v2 series)
Nvidia GT720 VGA outout (also tested with motherboard VGA (matrox) output)
Using VFIO to pass through cards to several VM's.

Problem: As soon as the console booting process gets to the "VFIO" output, the console "freezes" - no additional output, doesn't respond to keyboard input etc. HOWEVER, once the boot process finishes, you can SSH into the host, all VM's started, etc, so machine is ALIVE, but console is frozen.

have tried:

nomodeset video=vesafb:off video=efifb:off

etc etc, no change in behavior.

I've spent a couple days going through the forum posts, tried everything I can find, nothing changes behavior.

My only hint, perhaps, is that while IOMMU/etc is working, the passthrough hardware has to be added as "RAW Device" because the "Mapped Device" list is completely empty - which is unique to this machine.

help? ideas?

 

[dlasher]

This appears to work for now, the only change I made was to UNCOMMENT the "GRUB_TERMINAL=console" line.

GRUB_CMDLINE_LINUX_DEFAULT="ixgbe.allow_unsupported_sfp=1 iommu=pt intel_iommu=on nomodeset video=vesafb:off video=efifb:off"
GRUB_GFXMODE=800x600
GRUB_GFXPAYLOAD_LINUX=keep
GRUB_CMDLINE_LINUX="root=ZFS=rpool/ROOT/pve-1 boot=zfs"


# Uncomment to disable graphical terminal (grub-pc only)
GRUB_TERMINAL=console