[SOLVED] Error: Passtrough Intel x520-DA2 | VMs won't start

N

nstr

New Member
Apr 30, 2024
3
2
3
Hello!

I am fighting since many days with my Intel x520-DA2 NIC to passtrough it in a VM.
As im not able to find a solution, i want to try to ask you for help.

Important context:
This is a new machine and i use proxmox the first time. The installation was around 2-3 weeks ago.
Proxmox is updated. The Kernel as of now is: proxmox-kernel-6.8.4-3-pve-signed (6.8.4-3)
My System has a built-in 2.5GB Lan-Port from the motherboard. I added 1x Intel XXV710-AM2 (fs.com branded) & 1x Intel x520-DA2.

I can passtrough the XXV710-AM2 without any problems, it worked directly and has no problems so far.
However when trying to passtrough the x520-DA2 i get following errors when trying to startup the vm.
The VM will not start but stop instantly after trying to start it. (This is a list with all errors, when switching PCI settings):

VM Settings:
Ram: 8GB
Processors: 6 (host)
Machine: q35
SCSI Controller: VirtIO SCSI single


Code: 
All Functions: Y, ROM-Bar: Y, PCI-Express: Y

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,multifunction=on: vfio 0000:03:00.0: hardware reports invalid configuration, MSIX PBA outside of specified BAR
TASK ERROR: start failed: QEMU exited with code 1


All Functions: Y, ROM-Bar: Y, PCI-Express: N

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0.0,bus=pci.0,addr=0x10.0,multifunction=on: vfio 0000:03:00.0: hardware reports invalid configuration, MSIX PBA outside of specified BAR
TASK ERROR: start failed: QEMU exited with code 1


All Functions: Y, ROM-Bar: N, PCI-Express: N

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0.0,bus=pci.0,addr=0x10.0,rombar=0,multifunction=on: vfio 0000:03:00.0: hardware reports invalid configuration, MSIX PBA outside of specified BAR
TASK ERROR: start failed: QEMU exited with code 1


All Functions: Y, ROM-Bar: N, PCI-Express: Y

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0.0,bus=ich9-pcie-port-1,addr=0x0.0,rombar=0,multifunction=on: vfio 0000:03:00.0: hardware reports invalid configuration, MSIX PBA outside of specified BAR
TASK ERROR: start failed: QEMU exited with code 1


All Functions: N, ROM-Bar: Y, PCI-Express: Y

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0,bus=ich9-pcie-port-1,addr=0x0: vfio 0000:03:00.0: hardware reports invalid configuration, MSIX PBA outside of specified BAR
TASK ERROR: start failed: QEMU exited with code 1


All Functions: N, ROM-Bar: Y, PCI-Express: N

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0,bus=pci.0,addr=0x10: vfio 0000:03:00.0: hardware reports invalid configuration, MSIX PBA outside of specified BAR
TASK ERROR: start failed: QEMU exited with code 1


All Functions: N, ROM-Bar: N, PCI-Express: Y

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0,bus=ich9-pcie-port-1,addr=0x0,rombar=0: vfio 0000:03:00.0: hardware reports invalid configuration, MSIX PBA outside of specified BAR
TASK ERROR: start failed: QEMU exited with code 1


All Functions: N, ROM-Bar: N, PCI-Express: N

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0,bus=pci.0,addr=0x10,rombar=0: vfio 0000:03:00.0: hardware reports invalid configuration, MSIX PBA outside of specified BAR
TASK ERROR: start failed: QEMU exited with code 1

I have also tried several VM-Types but the error stays. So this seems to be not Vm-Type related.
There are many wikis and tutorials i read and i tried basicly everything, but the error just stays.
I don't know where to look and what further steps i can take to solve this.
It would make my day if someone could have a look and maybe give me some hints.


Here are the relevant configs:

Code: 
GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on"
GRUB_CMDLINE_LINUX="intel_iommu=on"

Code: 
/etc/modules:

vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

Code: 
/etc/modprobe.d/pve-blacklist.conf:

blacklist nvidiafb
blacklist ixgbe


/etc/modprobe.d/vfio-pci.conf :

options vfio-pci ids=8086:158b,8086:10fb

Edit:
I just found following entries in dmesg, maybe this has soemthing to do with the problem:

[ 0.285354] pci 0000:03:00.0: BAR 0 [mem size 0x00100000 pref]: can't assign; no space
[ 0.285355] pci 0000:03:00.0: BAR 0 [mem size 0x00100000 pref]: failed to assign
[ 0.285356] pci 0000:03:00.1: BAR 0 [mem size 0x00100000 pref]: can't assign; no space
[ 0.285357] pci 0000:03:00.1: BAR 0 [mem size 0x00100000 pref]: failed to assign
[ 0.285358] pci 0000:03:00.0: BAR 3 [mem size 0x00004000 pref]: can't assign; no space
[ 0.285358] pci 0000:03:00.0: BAR 3 [mem size 0x00004000 pref]: failed to assign
[ 0.285359] pci 0000:03:00.0: VF BAR 0 [mem 0x4017100000-0x40171fffff 64bit pref]: assigned
[ 0.285370] pci 0000:03:00.0: VF BAR 3 [mem 0x4017200000-0x40172fffff 64bit pref]: assigned
[ 0.285374] pci 0000:03:00.1: BAR 3 [mem size 0x00004000 pref]: can't assign; no space
[ 0.285375] pci 0000:03:00.1: BAR 3 [mem size 0x00004000 pref]: failed to assign
[ 0.285376] pci 0000:03:00.1: VF BAR 0 [mem 0x4017300000-0x40173fffff 64bit pref]: assigned
[ 0.285380] pci 0000:03:00.1: VF BAR 3 [mem 0x4017400000-0x40174fffff 64bit pref]: assigned
[ 0.285385] pci 0000:03:00.0: BAR 0 [mem size 0x00100000 pref]: can't assign; no space
[ 0.285385] pci 0000:03:00.0: BAR 0 [mem size 0x00100000 pref]: failed to assign
[ 0.285386] pci 0000:03:00.1: BAR 0 [mem size 0x00100000 pref]: can't assign; no space
[ 0.285387] pci 0000:03:00.1: BAR 0 [mem size 0x00100000 pref]: failed to assign
[ 0.285387] pci 0000:03:00.0: BAR 3 [mem size 0x00004000 pref]: can't assign; no space
[ 0.285388] pci 0000:03:00.0: BAR 3 [mem size 0x00004000 pref]: failed to assign
[ 0.285389] pci 0000:03:00.1: BAR 3 [mem size 0x00004000 pref]: can't assign; no space
[ 0.285390] pci 0000:03:00.1: BAR 3 [mem size 0x00004000 pref]: failed to assign
[ 0.285390] pci 0000:03:00.1: VF BAR 3 [mem 0x4017100000-0x40171fffff 64bit pref]: assigned
[ 0.285395] pci 0000:03:00.1: VF BAR 0 [mem 0x4017200000-0x40172fffff 64bit pref]: assigned
[ 0.285399] pci 0000:03:00.0: VF BAR 3 [mem 0x4017300000-0x40173fffff 64bit pref]: assigned
[ 0.285403] pci 0000:03:00.0: VF BAR 0 [mem 0x4017400000-0x40174fffff 64bit pref]: assigned
 
Last edited:
Here are some commands i run to get more info:



Code: 
#modinfo ixgbe



filename:       /lib/modules/6.8.4-2-pve/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko

license:        GPL v2

description:    Intel(R) 10 Gigabit PCI Express Network Driver

author:         Intel Corporation, <linux.nics@intel.com>

srcversion:     2C95716B67142A1D16E4197

alias:          pci:v00008086d000015E5sv*sd*bc*sc*i*

alias:          pci:v00008086d000015E4sv*sd*bc*sc*i*

alias:          pci:v00008086d000015CEsv*sd*bc*sc*i*

alias:          pci:v00008086d000015C8sv*sd*bc*sc*i*

alias:          pci:v00008086d000015C7sv*sd*bc*sc*i*

alias:          pci:v00008086d000015C6sv*sd*bc*sc*i*

alias:          pci:v00008086d000015C4sv*sd*bc*sc*i*

alias:          pci:v00008086d000015C3sv*sd*bc*sc*i*

alias:          pci:v00008086d000015C2sv*sd*bc*sc*i*

alias:          pci:v00008086d000015AEsv*sd*bc*sc*i*

alias:          pci:v00008086d000015ACsv*sd*bc*sc*i*

alias:          pci:v00008086d000015ADsv*sd*bc*sc*i*

alias:          pci:v00008086d000015ABsv*sd*bc*sc*i*

alias:          pci:v00008086d000015B0sv*sd*bc*sc*i*

alias:          pci:v00008086d000015AAsv*sd*bc*sc*i*

alias:          pci:v00008086d000015D1sv*sd*bc*sc*i*

alias:          pci:v00008086d00001563sv*sd*bc*sc*i*

alias:          pci:v00008086d00001560sv*sd*bc*sc*i*

alias:          pci:v00008086d0000154Asv*sd*bc*sc*i*

alias:          pci:v00008086d00001557sv*sd*bc*sc*i*

alias:          pci:v00008086d00001558sv*sd*bc*sc*i*

alias:          pci:v00008086d0000154Fsv*sd*bc*sc*i*

alias:          pci:v00008086d0000154Dsv*sd*bc*sc*i*

alias:          pci:v00008086d00001528sv*sd*bc*sc*i*

alias:          pci:v00008086d000010F8sv*sd*bc*sc*i*

alias:          pci:v00008086d0000151Csv*sd*bc*sc*i*

alias:          pci:v00008086d00001529sv*sd*bc*sc*i*

alias:          pci:v00008086d0000152Asv*sd*bc*sc*i*

alias:          pci:v00008086d000010F9sv*sd*bc*sc*i*

alias:          pci:v00008086d00001514sv*sd*bc*sc*i*

alias:          pci:v00008086d00001507sv*sd*bc*sc*i*

alias:          pci:v00008086d000010FBsv*sd*bc*sc*i*

alias:          pci:v00008086d00001517sv*sd*bc*sc*i*

alias:          pci:v00008086d000010FCsv*sd*bc*sc*i*

alias:          pci:v00008086d000010F7sv*sd*bc*sc*i*

alias:          pci:v00008086d00001508sv*sd*bc*sc*i*

alias:          pci:v00008086d000010DBsv*sd*bc*sc*i*

alias:          pci:v00008086d000010F4sv*sd*bc*sc*i*

alias:          pci:v00008086d000010E1sv*sd*bc*sc*i*

alias:          pci:v00008086d000010F1sv*sd*bc*sc*i*

alias:          pci:v00008086d000010ECsv*sd*bc*sc*i*

alias:          pci:v00008086d000010DDsv*sd*bc*sc*i*

alias:          pci:v00008086d0000150Bsv*sd*bc*sc*i*

alias:          pci:v00008086d000010C8sv*sd*bc*sc*i*

alias:          pci:v00008086d000010C7sv*sd*bc*sc*i*

alias:          pci:v00008086d000010C6sv*sd*bc*sc*i*

alias:          pci:v00008086d000010B6sv*sd*bc*sc*i*

depends:        dca,xfrm_algo,mdio

retpoline:      Y

intree:         Y

name:           ixgbe

vermagic:       6.8.4-2-pve SMP preempt mod_unload modversions

sig_id:         PKCS#7

signer:         Build time autogenerated kernel key

sig_key:        18:F8:E0:A8:57:52:1C:85:DF:C8:08:47:94:11:01:8A:01:C3:85:E9

sig_hashalgo:   sha512

signature:      59:7A:18:8E:AF:D4:83:94:08:B9:69:5C:19:3C:55:CC:66:E1:9E:3E:

                84:20:CF:FF:01:60:D1:E9:71:1F:27:DA:EC:48:90:48:A2:E1:7B:B4:

                A6:59:13:A6:9B:52:35:5C:44:C8:25:2F:AA:1B:FE:8A:89:DE:39:1C:

                D3:8E:9B:11:EA:68:B5:24:96:D0:B4:58:07:D6:90:67:D3:67:F0:95:

                69:7D:3F:DE:7A:B2:80:0E:18:D1:1E:15:2A:E8:6E:5E:0A:74:45:96:

                92:EC:6C:3D:E3:AA:F2:10:86:4E:93:7E:78:C3:7A:CC:6A:04:E6:C4:

                D3:75:DF:7F:DC:88:FA:9D:78:8B:4A:80:5A:25:4C:1F:21:27:D6:4A:

                54:A2:EE:B8:93:4C:63:1A:8F:35:36:7B:46:24:AD:26:35:D4:35:66:

                5F:7F:B2:18:77:39:41:D6:07:1A:55:C7:0A:C1:2C:84:48:29:89:14:

                E4:9D:BE:36:DE:E8:32:33:E5:78:89:77:AA:A5:F8:46:A8:40:1E:74:

                7E:B2:2E:6E:CE:19:27:64:1A:85:EC:3E:9F:DB:D9:0B:C8:AB:33:F2:

                55:F4:D6:5D:F1:2E:76:97:E6:CB:E4:98:CC:6D:27:EF:EB:97:99:55:

                7D:4D:C0:C0:9C:13:22:37:36:D3:EF:06:43:AE:28:CE:3C:1F:26:2E:

                ED:4B:08:51:EE:1C:EE:73:48:AF:E5:00:8A:39:B4:E4:43:BC:5F:FB:

                BA:2E:92:CA:5E:59:F5:E4:A7:69:F3:0D:F8:45:60:4B:90:A8:2F:F5:

                CC:5E:BE:67:AF:16:0A:A3:F3:FF:8A:40:B5:70:2F:2A:C0:35:B7:D1:

                1F:8C:E1:A7:AF:2D:20:02:66:A5:CD:D1:ED:20:47:7E:AB:5C:DC:C9:

                4A:F8:B6:E8:69:67:48:3E:EF:08:48:DB:5F:C5:A7:9C:8D:95:5C:38:

                CC:ED:A3:9A:34:33:B1:B9:F7:92:DF:F3:BF:66:95:9E:C9:89:69:40:

                72:0E:CE:05:B6:2C:A2:B8:B6:CD:36:EB:94:D3:BD:FB:76:92:AE:CA:

                C9:68:E1:B4:1F:E7:32:75:11:00:0B:E5:4C:BB:4F:DC:2C:23:1B:80:

                35:1B:A0:3D:BD:41:65:7B:D0:8D:9F:FA:EC:9E:8F:1A:50:E7:5C:03:

                21:AF:0A:2C:7B:2C:E2:FC:66:F7:97:03:1D:49:FB:A0:BA:F5:37:43:

                68:00:37:0D:DF:6A:E5:BD:9D:F1:C3:5D:FB:C3:40:51:08:AA:64:F1:

                BF:E5:52:2D:99:7D:CD:0E:C0:62:14:02:76:99:04:7B:53:80:E7:EC:

                F5:C7:63:3B:36:0E:33:34:B1:58:7D:4B

parm:           max_vfs:Maximum number of virtual functions to allocate per physical function - default is zero and maximum value is 63. (Deprecated) (uint)

parm:           allow_unsupported_sfp:Allow unsupported and untested SFP+ modules on 82599-based adapters (bool)

parm:           debug:Debug level (0=none,...,16=all) (int)



Code: 
#lspci -k



00:00.0 Host bridge: Intel Corporation Device 4650 (rev 05)

        Subsystem: ASRock Incorporation Device 4650

00:01.0 PCI bridge: Intel Corporation 12th Gen Core Processor PCI Express x16 Controller #1 (rev 05)

        Subsystem: ASRock Incorporation 12th Gen Core Processor PCI Express x16 Controller

        Kernel driver in use: pcieport

00:02.0 VGA compatible controller: Intel Corporation Alder Lake-S GT1 [UHD Graphics 730] (rev 0c)

        Subsystem: ASRock Incorporation Alder Lake-S GT1 [UHD Graphics 730]

        Kernel driver in use: i915

        Kernel modules: i915, xe

00:06.0 PCI bridge: Intel Corporation 12th Gen Core Processor PCI Express x4 Controller #0 (rev 05)

        Kernel driver in use: pcieport

00:14.0 USB controller: Intel Corporation Device 7a60 (rev 11)

        Subsystem: ASRock Incorporation Device 7a60

        Kernel driver in use: xhci_hcd

        Kernel modules: mei_me, xhci_pci

00:14.2 RAM memory: Intel Corporation Device 7a27 (rev 11)

00:15.0 Serial bus controller: Intel Corporation Device 7a4c (rev 11)

        Subsystem: ASRock Incorporation Device 7a4c

        Kernel driver in use: intel-lpss

        Kernel modules: intel_lpss_pci

00:16.0 Communication controller: Intel Corporation Device 7a68 (rev 11)

        Subsystem: ASRock Incorporation Device 7a68

        Kernel driver in use: mei_me

        Kernel modules: mei_me

00:1c.0 PCI bridge: Intel Corporation Device 7a38 (rev 11)

        Subsystem: ASRock Incorporation Device 7a38

        Kernel driver in use: pcieport

00:1d.0 PCI bridge: Intel Corporation Device 7a36 (rev 11)

        Subsystem: ASRock Incorporation Device 7a36

        Kernel driver in use: pcieport

00:1f.0 ISA bridge: Intel Corporation Device 7a06 (rev 11)

        Subsystem: ASRock Incorporation Device 7a06

00:1f.4 SMBus: Intel Corporation Device 7a23 (rev 11)

        Subsystem: ASRock Incorporation Device 7a23

        Kernel driver in use: i801_smbus

        Kernel modules: i2c_i801

00:1f.5 Serial bus controller: Intel Corporation Device 7a24 (rev 11)

        Subsystem: ASRock Incorporation Device 7a24

        Kernel driver in use: intel-spi

        Kernel modules: spi_intel_pci

01:00.0 Ethernet controller: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 (rev 02)

        Subsystem: Intel Corporation Ethernet Network Adapter XXV710-2

        Kernel driver in use: vfio-pci

        Kernel modules: i40e

01:00.1 Ethernet controller: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 (rev 02)

        Subsystem: Intel Corporation Ethernet Network Adapter XXV710

        Kernel driver in use: vfio-pci

        Kernel modules: i40e

02:00.0 Non-Volatile memory controller: Solidigm P44 Pro NVMe SSD [Hollywood Beach]

        Subsystem: Solidigm P44 Pro NVMe SSD [Hollywood Beach]

        Kernel driver in use: nvme

        Kernel modules: nvme

03:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

        Subsystem: Intel Corporation Ethernet Server Adapter X520-2

        Kernel driver in use: vfio-pci

        Kernel modules: ixgbe

03:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

        Subsystem: Intel Corporation Ethernet Server Adapter X520-2

        Kernel driver in use: vfio-pci

        Kernel modules: ixgbe

04:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 05)

        Subsystem: ASRock Incorporation RTL8125 2.5GbE Controller

        Kernel driver in use: r8169

        Kernel modules: r8169



Code: 
root@proxmox1# lspci -nn

00:00.0 Host bridge [0600]: Intel Corporation Device [8086:4650] (rev 05)

00:01.0 PCI bridge [0604]: Intel Corporation 12th Gen Core Processor PCI Express x16 Controller #1 [8086:460d] (rev 05)

00:02.0 VGA compatible controller [0300]: Intel Corporation Alder Lake-S GT1 [UHD Graphics 730] [8086:4692] (rev 0c)

00:06.0 PCI bridge [0604]: Intel Corporation 12th Gen Core Processor PCI Express x4 Controller #0 [8086:464d] (rev 05)

00:14.0 USB controller [0c03]: Intel Corporation Device [8086:7a60] (rev 11)

00:14.2 RAM memory [0500]: Intel Corporation Device [8086:7a27] (rev 11)

00:15.0 Serial bus controller [0c80]: Intel Corporation Device [8086:7a4c] (rev 11)

00:16.0 Communication controller [0780]: Intel Corporation Device [8086:7a68] (rev 11)

00:1c.0 PCI bridge [0604]: Intel Corporation Device [8086:7a38] (rev 11)

00:1d.0 PCI bridge [0604]: Intel Corporation Device [8086:7a36] (rev 11)

00:1f.0 ISA bridge [0601]: Intel Corporation Device [8086:7a06] (rev 11)

00:1f.4 SMBus [0c05]: Intel Corporation Device [8086:7a23] (rev 11)

00:1f.5 Serial bus controller [0c80]: Intel Corporation Device [8086:7a24] (rev 11)

01:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02)

01:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02)

02:00.0 Non-Volatile memory controller [0108]: Solidigm P44 Pro NVMe SSD [Hollywood Beach] [025e:f1ac]

03:00.0 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)

03:00.1 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)

04:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller [10ec:8125] (rev 05)



Code: 
# for d in /sys/kernel/iommu_groups/*/devices/*; do n=${d#*/iommu_groups/*}; n=${n%%/*}; printf 'IOMMU group %s ' "$n"; lspci -nns "${d##*/}"; done



IOMMU group 0 00:02.0 VGA compatible controller [0300]: Intel Corporation Alder Lake-S GT1 [UHD Graphics 730] [8086:4692] (rev 0c)

IOMMU group 10 01:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02)

IOMMU group 11 01:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller XXV710 for 25GbE SFP28 [8086:158b] (rev 02)

IOMMU group 12 02:00.0 Non-Volatile memory controller [0108]: Solidigm P44 Pro NVMe SSD [Hollywood Beach] [025e:f1ac]

IOMMU group 13 03:00.0 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)

IOMMU group 14 03:00.1 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)

IOMMU group 15 04:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller [10ec:8125] (rev 05)

IOMMU group 1 00:00.0 Host bridge [0600]: Intel Corporation Device [8086:4650] (rev 05)

IOMMU group 2 00:01.0 PCI bridge [0604]: Intel Corporation 12th Gen Core Processor PCI Express x16 Controller #1 [8086:460d] (rev 05)

IOMMU group 3 00:06.0 PCI bridge [0604]: Intel Corporation 12th Gen Core Processor PCI Express x4 Controller #0 [8086:464d] (rev 05)

IOMMU group 4 00:14.0 USB controller [0c03]: Intel Corporation Device [8086:7a60] (rev 11)

IOMMU group 4 00:14.2 RAM memory [0500]: Intel Corporation Device [8086:7a27] (rev 11)

IOMMU group 5 00:15.0 Serial bus controller [0c80]: Intel Corporation Device [8086:7a4c] (rev 11)

IOMMU group 6 00:16.0 Communication controller [0780]: Intel Corporation Device [8086:7a68] (rev 11)

IOMMU group 7 00:1c.0 PCI bridge [0604]: Intel Corporation Device [8086:7a38] (rev 11)

IOMMU group 8 00:1d.0 PCI bridge [0604]: Intel Corporation Device [8086:7a36] (rev 11)

IOMMU group 9 00:1f.0 ISA bridge [0601]: Intel Corporation Device [8086:7a06] (rev 11)

IOMMU group 9 00:1f.4 SMBus [0c05]: Intel Corporation Device [8086:7a23] (rev 11)

IOMMU group 9 00:1f.5 Serial bus controller [0c80]: Intel Corporation Device [8086:7a24] (rev 11)
 
After following down the rabbit hole of the NIC BAR not able to assign memory, i managed to solve it.
I want to share my solution for the small chance someone is having the same issue and lands at this post somehow.

The problem with the memory assigning is because the x520 NIC operates in 32bit BAR, while the system uses 64bit BAR.
This is also the reason why the XXV710 card worked perfectly, as this card runs default in 64bit BAR mode.
As soon as I have recognized the connection, i only had to use the Intel BootUtil to first enabling flashing the card with:

Bash: 
BOOTUTIL64E.EFI -NIC=x -FLASHENABLE

After that i had to reboot and use the tool again to set the 64bit BAR mode with:

Bash: 
BOOTUTIL64E.EFI -NIC=x -64e

I had to do it for every interface on the card, as they are listed seperate. To get the list i just run the BootUtil without any arguments.
Then i had to reboot again and after that the Intel x520 just perfectly worked.
 
  • Like
Reactions: celemine1gig and leesteken
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back