Hi,
I recently set up a Ceph cluster (on top of my PVE cluster) with its own dedicated network.
Now, in order to improve throughput (I only have 1gbe NICs available) I want to add another NIC on each node to the Ceph network.
But I am wondering how to do that:
1) I guess I could simply create a new bond that includes both the current and the additional NICs. But how do I tell Ceph to use the bond instead of the current single NIC? I don't see anything in the web gui. After the initial configuration of Ceph, I seem to be able to only view the config, but not change it anymore. So do I have to amend some config files? If so, will it just take up the new config, or do I issue some additional commands or do I need to reboot the node?
2) Also not sure what type of bond to choose. To me, round-robin sounds the most appealing: It will give me fault tolerance and (under normal circumstances) double the speed. But I am cautious that the descriptions of some of the other types state that these other types do not require support from the switch. Does that mean that round-robin requires special support from the switch? Because I am pretty sure my switch does not offer special support for this. I have a simple switch for the Ceph network and I added another simple switch (in order to avoid a SPOF in the switch) for the second NIC. Naively, I thought, that this will work no matter what. But maybe I was too optimistic. Given my simple switch, what options do I have? (The manual also says that for cluster traffic, only the backup mode is supported - but I am guessing this applies to PVE cluster traffic and not also to Ceph cluster traffic?)
Thanks!
I recently set up a Ceph cluster (on top of my PVE cluster) with its own dedicated network.
Now, in order to improve throughput (I only have 1gbe NICs available) I want to add another NIC on each node to the Ceph network.
But I am wondering how to do that:
1) I guess I could simply create a new bond that includes both the current and the additional NICs. But how do I tell Ceph to use the bond instead of the current single NIC? I don't see anything in the web gui. After the initial configuration of Ceph, I seem to be able to only view the config, but not change it anymore. So do I have to amend some config files? If so, will it just take up the new config, or do I issue some additional commands or do I need to reboot the node?
2) Also not sure what type of bond to choose. To me, round-robin sounds the most appealing: It will give me fault tolerance and (under normal circumstances) double the speed. But I am cautious that the descriptions of some of the other types state that these other types do not require support from the switch. Does that mean that round-robin requires special support from the switch? Because I am pretty sure my switch does not offer special support for this. I have a simple switch for the Ceph network and I added another simple switch (in order to avoid a SPOF in the switch) for the second NIC. Naively, I thought, that this will work no matter what. But maybe I was too optimistic. Given my simple switch, what options do I have? (The manual also says that for cluster traffic, only the backup mode is supported - but I am guessing this applies to PVE cluster traffic and not also to Ceph cluster traffic?)
Thanks!