[SOLVED] Having problems with Infiniband.

[levicnelson]

My setup: Two SuperMicro blade servers running with an internal infiniband module.

I've followed this wiki here: http://pve.proxmox.com/wiki/Infiniband

The problem arises when I try and issue the command "ifup ib0". It says that /sys/class/net/ib0 doesn't exist. Also there is nothing in the /sys/class/infiniband/ which leads me to believe it doesn't recognize the infiniband modules as an infiniband device. I have another blade in the cluster that is currently running centOS and the same infiniband module is working in it.

Has anyone had to do anything more than what is in the wiki to get infiniband working?

Thanks for your help,
Levi

 

[spirit]

My setup: Two SuperMicro blade servers running with an internal infiniband module.

I've followed this wiki here: http://pve.proxmox.com/wiki/Infiniband

The problem arises when I try and issue the command "ifup ib0". It says that /sys/class/net/ib0 doesn't exist. Also there is nothing in the /sys/class/infiniband/ which leads me to believe it doesn't recognize the infiniband modules as an infiniband device. I have another blade in the cluster that is currently running centOS and the same infiniband module is working in it.

Has anyone had to do anything more than what is in the wiki to get infiniband working?

Thanks for your help,
Levi

seem like the module driver is missing in proxmox kernel.
Could you tell us your infiniband controller model ? what is the module loaded on your centos ?

 

[levicnelson]

seem like the module driver is missing in proxmox kernel.
Could you tell us your infiniband controller model ? what is the module loaded on your centos ?

module: mlx4_ib: Mellanox ConnectX InfiniBand driver v1.0 (April 4, 2008)

And BTW we fixed it by installing the official ofed drivers. Thanks!

(If anyone else ever has this problem, email me at levicnelson @ gmail. I don't mind helping.)