Hi all,
Working on a small personal homelab project where I'm setting up a dedicated gateway/firewall VM on a mini PC node (running Proxmox VE 8.2 with kernel 6.8.4-3-pve).
I have two onboard Intel i226-V 2.5GbE interfaces. One is used for vmbr0 (management), and I'm passing the second one directly via PCIe passthrough (vfio-pci) to a Debian-based gateway VM.
IOMMU is enabled and the NIC is in its own isolated IOMMU group:
IOMMU Group 14: 03:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I226-V [8086:125c] (rev 04)
In /etc/default/grub:
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_aspm=off"
The issue:
Whenever the VM boots or reboots, the link drops on both ports for about 3-5 seconds, and dmesg on the PVE host gets flooded with PCIe AER (Advanced Error Reporting) corrected errors:
pcieport 0000:00:1c.4: AER: Corrected error received: 0000:03:00.0
igc 0000:03:00.0: PCIe link lost, resetting device...
Once the VM is fully booted, traffic flows fine and speeds reach ~2.35 Gbps over iperf3, but the momentary link flap drops my host management connection for a few seconds every time.
Has anyone dealt with this specific i226 PCIe reset issue during VFIO handover? Should I try pci=noaer or is there a specific kernel module parameter for igc or ASPM in bios that I should tweak?
Any pointers appreciated!
Working on a small personal homelab project where I'm setting up a dedicated gateway/firewall VM on a mini PC node (running Proxmox VE 8.2 with kernel 6.8.4-3-pve).
I have two onboard Intel i226-V 2.5GbE interfaces. One is used for vmbr0 (management), and I'm passing the second one directly via PCIe passthrough (vfio-pci) to a Debian-based gateway VM.
IOMMU is enabled and the NIC is in its own isolated IOMMU group:
IOMMU Group 14: 03:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I226-V [8086:125c] (rev 04)
In /etc/default/grub:
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_aspm=off"
The issue:
Whenever the VM boots or reboots, the link drops on both ports for about 3-5 seconds, and dmesg on the PVE host gets flooded with PCIe AER (Advanced Error Reporting) corrected errors:
pcieport 0000:00:1c.4: AER: Corrected error received: 0000:03:00.0
igc 0000:03:00.0: PCIe link lost, resetting device...
Once the VM is fully booted, traffic flows fine and speeds reach ~2.35 Gbps over iperf3, but the momentary link flap drops my host management connection for a few seconds every time.
Has anyone dealt with this specific i226 PCIe reset issue during VFIO handover? Should I try pci=noaer or is there a specific kernel module parameter for igc or ASPM in bios that I should tweak?
Any pointers appreciated!