RoCE / RDMA for Ceph and Proxmox

[MDL]

Hello there !

Could you tell if it is possible to leverage RDMA / RoCE with Ceph Jewel (and for Proxmox cluster communications too ideally...) ?

If yes, is there some documentation available for the configuration of the hosts and the switches ?

Thanks.

 

[udo]

Hello there !

Could you tell if it is possible to leverage RDMA / RoCE with Ceph Jewel (and for Proxmox cluster communications too ideally...) ?

If yes, is there some documentation available for the configuration of the hosts and the switches ?

Thanks.

Hi,
looks that's not ready yet - no answer:
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2016-December/014883.html
with kraken:
https://www.mail-archive.com/ceph-users@lists.ceph.com/msg36194.html

Udo

 

[Proxmox India]

Do you think if the scenario has changed now with Ceph 12.2 Luminous being released as stable.

is it a good idea now to have a Proxmox + Infiniband + Ceph Setup ?

 

[MDL]

Or Proxmox + RoCE + Ceph...

 

[alexskysilk]

https://forum.proxmox.com/threads/c...nvme-56gbit-ethernet.35360/page-3#post-184641

it sort of works, but performance is unimpressive and I would consider it alpha quality and not for production.