Ceph crashes

[Dragon19]

When using rdma with connect-x 3 cards ceph crashes.

I know rdma support is iffy with ceph and don't mind sticking with ipoib but it would be nice if it did work.

 

[Stoiko Ivanov]

Not the most common setup - so maybe it won't work. However please provide some more detailed infos:
* logs
* how does it crash?
* any additional preconditions?

else it's hard to try to find a solution

Thanks

 

[Dragon19]

Not the most common setup - so maybe it won't work. However please provide some more detailed infos:
* logs
* how does it crash?
* any additional preconditions?

else it's hard to try to find a solution

Thanks

I was able to replicate the issue on other distros so it must be something with my configuration.

I'm likely not understanding how to setup rdma in the configuration file or my switch doesn't support it. It's a fairly cheap switch and it's unmanaged.

Either way ipoib works for me. I'll keep looking into rdma as the end goal.