ifupdown2 fails on reboot - Oracle 25G Dual SFP PCIe card on Proxmox 8.3.0

M

meckhardt

Member
Sep 23, 2020
3
0
21
36
Hello everyone!


First of all, sorry for bothering with what seems like a simple issue, but I can't figure out why this is happening.


I am performing fresh installations of Proxmox 8.3.0 on multiple servers, Dell R750 and Oracle X8-2L. The only thing they have in common is that both have a dual SFP 25G PCIe network card from Oracle.


The installation completes without any issues, it detects the DHCP-assigned IP and recognizes all interfaces.


However, the problem arises after every reboot: ifupdown2 fails, leaving the system without network connectivity. Sometimes, running systemctl restart networking once resolves the issue, but other times I have to run it twice.


I am currently using the onboard network interface (eno1) for the connection, but the same issue occurs even when using the fiber interface from the PCIe card.


I also updated to Proxmox 8.3.5, hoping it would fix the issue, but the problem persists.


I am attaching screenshots of the boot error and journalctl logs.


I would really appreciate any help!


Thanks and best regards!
 

Attachments

  • Screenshot 2025-03-12 at 5.00.21 PM.png
    Screenshot 2025-03-12 at 5.00.21 PM.png
    38.9 KB · Views: 1
  • Screenshot 2025-03-12 at 5.41.24 PM.png
    Screenshot 2025-03-12 at 5.41.24 PM.png
    53.6 KB · Views: 1
  • Screenshot 2025-03-12 at 5.42.06 PM.png
    Screenshot 2025-03-12 at 5.42.06 PM.png
    71.8 KB · Views: 1
Keeping in mind that DHCP is not a recommended mode of operation for PVE, I would recommend ensuring that you have latest and greatest firmware.
Oracle doesn't manufacture network cards, so they are likely Broadcom based on Kernel driver being used, with possibly proprietary Oracle firmware.

Additionally, it seems that InfiniBand is enabled . If you are not using it - disable it in NIC BIOS.

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
Thanks, my friend! We are not using DHCP. During installation, the suggested IP comes from what DHCP assigned at boot, but we always set it statically.

this is what iDrac recognices for my Oracle Cards BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller .


I hadn’t noticed the InfiniBand part—I’ll checked the BIOS to see where I can disable it but there is no option at least in the R750. Appreciate the heads-up!
 
The Problem was RDMA enabled in this ones Oracle Cards BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller .

Disabled in Bios, and everything worked fine.
 
meckhardt said:
The Problem was RDMA enabled in this ones Oracle Cards BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller .

Disabled in Bios, and everything worked fine.
Click to expand...
Glad that worked. It's always a good idea to minimize number of unnecessary features on these complex cards. It makes everything work smoother.

Cheers

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
You must log in or register to reply here.
Top Bottom