Thanks for the tips.
We make heavy use of SR-IOV, which seems to work better when using current OFED drivers.
With regards to performance, pause-frame based flow control and PFC is disabled across our network, so we are keen to experiment with drivers.
As a comparison, I'm running a 15TB mdadm ext4 array on the following hardware:
EPYC 7443P 24-core CPU
256GB 8-channel RAM
8x Samsung PM9A3 Gen4 NVME U.2 1.92TB drives, connected via 2x AOC-SLG4-4E4T-O bifurcation re-timer cards
Seeing ~40GB/s read and ~20GB/s write via a sequential FIO test.
Thank you for the quick reply!
I'll check the firmware, but would also like to know if it's currently possible to install OFED drivers on Proxmox 7. Would OFED for Ubuntu 21 work?
I'm also having issues with poor performance using Mellanox ConnectX-4 25Gb SFP28 cards on Proxmox 7.
Have you had any luck installing an OFED driver? How about the one intended for Ubuntu 21?
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.