mellanox connectx-4

Here is how i was able to get proxmox working with Infiniband and SR-IOV. Hardware used is a mellanox switch (sx6036) and a mellanox Cx-4 100gbps EDR dual (or single) port card. Make sure the firmware is latest. AS FAR AS IM AWARE, THIS WILL NOT WORK WITH OPENSM AND MUST HAVE A MELLANOX SWITCH...

Hi I have 2 pve servers (cluster) which I updated to 6.5.11-8 and rebooted yesterday. Since then, one of the two mellanox adapters stopped functioning normally. Each server has 2 ConnectX-4 Lx adapters 1 x MCX4121A-ACA_Ax PCIE x8 - FW 14.32.1010 - Not working 1 x MCX4621A-ACA_Ax OCP 3.0 - FW...

I'm trying to pave the way for migrating Proxmox 7 to 8. One warning thrown by pve7to8 is about an installed dkms module - which is version 4.18.0 of the mellanox drivers, as previously, my ConnectX-4 was not working reliably. I googled and found that this module will probably cause issues...