Proxmox/Ceph Infiniband?

[paradox55]

Will they both support Infiniband (IPOIB) without VPI?

 

[wolfgang]

Hi,

You have to install all necessary packages but it will work with (IPOIB).
The IPOIB stack is the Vendor/Debian part and not included in Proxmox VE.
So the enterprise support does not cover this stack.

 

[paradox55]

So is the RDMA patch included with your build of ceph @wolfgang or would ceph have to be manually compiled with it?

Got any notes for that?

Or will IPOIB work without that on ceph.

 

[wolfgang]

The Ceph package is compiled with RDMA, but IPOIB will also work without it.

 

[paradox55]

The Ceph package is compiled with RDMA, but IPOIB will also work without it.

Does your build also fix the monitor ram issue with RDMA? IIRC it hits 100% ram and crashes after a day or two.

Thanks!

 

[wolfgang]

I'm not deep enough in the ceph code to answer this question 100%.
But we have an RDMA patch what fix the "msg-async-rdma-uninitialized-variable-fix"
I guess this is what you are talking about.