Hello, i want to know if Ceph or Proxmox have a Multipaht stategy? I have 5 nodes, eache node have 4 ethernet connector and i could establish a net over these connection. But my transfer perfomance is limited to only one link, i thought that i can leverage the 3 other links over the other nodes to get mor bandwith, but this didn't worked. I tried protocols like babel and batman combined with mptcp but this didn't worked. Because Proxmox and Ceph are cluster Software i think there should be an integrated solution for this. If sombody can help me where i can find a setup which can do this, this would help me really much.
Proxmox\Ceph Multipath strategy?
- Thread starter Hurtz1234
- Start date
I have a 5 node setup but all i tried didn't worked. LACP is when you have additional network adpater but it not good supporting routes over additional nodes and a switch wich is unmanged. I tried bable, batman, ospf6 all have the same issue that it always use the direct link but not the linke over the other two nodes.
Last edited:
Here what i tested so far:Below you se my setup. Eache Node hase 5 Ethernet Ports. Each node is connected to the other node wit 1gbit ethernet also all nodes are connected to an unmanaged switch with 10gbit.
I tried a little bit testing protocols. My experice:
1. Frr -->fabricd
I do not know why, but the fabricd protocol always uses the slow connection between nodes. 10 Gbit is nerver used
2. Frr -- Ospf6
Works fine but i hoped to se a little bit more. I get only 10Gbit when everything is connect. When i disconnect 10gibt i thought i get more than 1gibt because i thought that the Protcols can use multiple pathe to the node to get more bandwidh, but this dident happend. Ospf6 exposes also the Routs so that MpTcp can maybe use it, but it never used it.
3. Babel
Same like Ospf6 but easyier to install
4. Batman-adv
Easiest to install but strange behaviour. When i connect 10g Switch connection, i get 3-4 Gbits, when i disconnect i get only 1 Gbit. So ther is something strange with the installation.
The most disapointing is, that i didn't found a protocol which can make easy use of the addional routes about the nodes inbetween. If sombody has a solution for this i will be thankfull .
I tried a little bit testing protocols. My experice:
1. Frr -->fabricd
I do not know why, but the fabricd protocol always uses the slow connection between nodes. 10 Gbit is nerver used
2. Frr -- Ospf6
Works fine but i hoped to se a little bit more. I get only 10Gbit when everything is connect. When i disconnect 10gibt i thought i get more than 1gibt because i thought that the Protcols can use multiple pathe to the node to get more bandwidh, but this dident happend. Ospf6 exposes also the Routs so that MpTcp can maybe use it, but it never used it.
3. Babel
Same like Ospf6 but easyier to install
4. Batman-adv
Easiest to install but strange behaviour. When i connect 10g Switch connection, i get 3-4 Gbits, when i disconnect i get only 1 Gbit. So ther is something strange with the installation.
The most disapointing is, that i didn't found a protocol which can make easy use of the addional routes about the nodes inbetween. If sombody has a solution for this i will be thankfull .