rdma

I have a small cluster with 3 machines - all Dell R720s. Proxmox was running well. I updated the least used machine to the latest version and ever since the network has refused to start up. I have been working at this for a week solid. I've read every post on the forum or the internet trying...

Hi, PVE geekers: I build a pve cluster on three server (with ceph), with pve & ceph package version as follow: root@node01:~# pveversion pve-manager/7.3-3/c3928077 (running kernel: 5.15.74-1-pve) root@node01:~# ceph --version ceph version 16.2.13 (b81a1d7f978c8d41cf452da7af14e190542d2ee2)...

I'm having issues getting iSER over iWARP to work properly with Proxmox (or any other OS) and Intel has been very unhelpful about getting me to a working state. I do need the added bandwidth/latency offered by RDMA; so I'm looking into alternatives. I'm making this post to get any input from...

Hi, I have 2x ConnectX-2 Cards and need to setup infiniband, RDMA over NFS on Proxmox 5.4. I followed a few guides online but I'm unable to change protocol type from ETH to IB. What is correct way of setting the port type on Proxmox?

I want to share following testing with you 4 PVE Nodes cluster with 3 Ceph Bluestore Node, total of 36 OSD. OSD: st6000nm0034 block.db & block.wal device: Samsung sm961 512GB NIC: Mellanox Connectx3 VPI dual port 40 Gbps Switch: Mellanox sx6036T Network: IPoIB separated public network &...

Hi Folks, Whis performanche shoud i expect for this cluster ? are my settings ok ? 4 nodes: system: Supermicro 2028U-TN24R4T+ 2 port Mellanox connect x3pro 56Gbit 4 port intel 10GigE memory: 768 GBytes CPU DUAL Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz ceph: 28 osds 24 Intel Nvme 2000GB...

Hello there ! Could you tell if it is possible to leverage RDMA / RoCE with Ceph Jewel (and for Proxmox cluster communications too ideally...) ? If yes, is there some documentation available for the configuration of the hosts and the switches ? Thanks.

Has anyone managed to implement accelio for a Ceph cluster in Proxmox? I've been toying with this idea for some time as it has the potential to have a much lower overall latency then using IPOIB. I'd be really interested in hearing about your experience and potential pitfalls

Hello, is there any change to get SCST together with srpt and the required kernel-modules in the releases ? Current scst compiles fine against Kernel 4.4.6 and in-tree ofed / rdma packages. Having those packages / kernel modules in the release would skip the need to compile / build with each...