Hello everyone,
I have been trying to setup two servers to communicate over infiniband using some ConnectX-3 cards. I finally got them working but anytime i start a truenas vm with a hba passed though opensm starts to spam [2C2006C0] 0x01 -> umad_receiver: ERR 5404: recv error on MAD sized umad (Input/output error error in the opensm log file and eventually fills up the root drive. I think it might be caused by the hba and the ConnectX-3 being in the same iommu group?
Thanks!
I have been trying to setup two servers to communicate over infiniband using some ConnectX-3 cards. I finally got them working but anytime i start a truenas vm with a hba passed though opensm starts to spam [2C2006C0] 0x01 -> umad_receiver: ERR 5404: recv error on MAD sized umad (Input/output error error in the opensm log file and eventually fills up the root drive. I think it might be caused by the hba and the ConnectX-3 being in the same iommu group?
Thanks!