[PMX8] Intel VFIO issues - console "locks up" but VM's all start fine.

dlasher

Renowned Member
Mar 23, 2011
247
33
93
pve-manager/8.0.4/d258a813cfa6b390 (running kernel: 6.2.16-12-pve)
Dual Intel x5690 CPU (also tested with Intel 26xx v1/v2 series)
Nvidia GT720 VGA outout (also tested with motherboard VGA (matrox) output)
Using VFIO to pass through cards to several VM's.

Problem: As soon as the console booting process gets to the "VFIO" output, the console "freezes" - no additional output, doesn't respond to keyboard input etc. HOWEVER, once the boot process finishes, you can SSH into the host, all VM's started, etc, so machine is ALIVE, but console is frozen.

have tried:
Code:
nomodeset video=vesafb:off video=efifb:off
etc etc, no change in behavior.

I've spent a couple days going through the forum posts, tried everything I can find, nothing changes behavior.

My only hint, perhaps, is that while IOMMU/etc is working, the passthrough hardware has to be added as "RAW Device" because the "Mapped Device" list is completely empty - which is unique to this machine.

help? ideas?
 

Attachments

  • Screen Shot 2023-09-28 at 10.27.13 AM.png
    Screen Shot 2023-09-28 at 10.27.13 AM.png
    34.8 KB · Views: 5
Last edited:
This appears to work for now, the only change I made was to UNCOMMENT the "GRUB_TERMINAL=console" line.


Code:
GRUB_CMDLINE_LINUX_DEFAULT="ixgbe.allow_unsupported_sfp=1 iommu=pt intel_iommu=on nomodeset video=vesafb:off video=efifb:off"
GRUB_GFXMODE=800x600
GRUB_GFXPAYLOAD_LINUX=keep
GRUB_CMDLINE_LINUX="root=ZFS=rpool/ROOT/pve-1 boot=zfs"


# Uncomment to disable graphical terminal (grub-pc only)
GRUB_TERMINAL=console