Proxmox MLNX_OFED and priority flow control issues

myro1

New Member
Jun 26, 2023
2
0
1
Hello,

I was hoping to get some assistance getting Mellanox drivers working correctly in proxmox. I am evaluating proxmox 7.4.3 (kernel PVE 5.15.107-1) for use in our environment but in order to be able to successfully use it I need to ensure priority flow control (pfc) is enabled in our network cards (connectX5 and connectX6 cards). This is needed for RoCE to perform in a lossless setup.

By default pfc is disabled and needs to be enabled using the mlnx_qos tool. You cannot configure pfc using the Nvidia Firmware Tools (MFT), as far as I'm aware mlnx_qos is not available there.

When trying to install the MLNX_OFED drivers to provide access to mlnx_qos (required to configure pfc) the install script prompts to remove a list of pve packages which would break pve.

What is the recommend/supported method of getting a PVE host running with functioning MLNX OFED?

Thanks for the help!