Hi there!
I am looking for a way to redundantly configure CEPH for a new pve cluster.
The nodes have 1x10GBE and 2xGBE ports.
The nice way would be to have 2x10GBE ports per node and bond them together and make different VLANs for CEPH, cluster comm, separate cluster network, WAN, LANd, DMZ , etc....
Now how can I achieve something like this with 1 10GBE and 2 GBE ports? To make problems more difficult, i have one full 10GBE switch and one GBE switch. There is a GBe port on the 10GBE switch, so the 2 switches can send the same vlans through, but i can't do MC-LAG between them...
There are various budget constrains at work here...
I am supporting the comapny from 200 Km away so I would like to prepare for network problem shenigans......
What I came up with so far:
If I leave the 10GBIT ports unbonded and run every traffic through them via vlans, and then send the vlans through the gbit switch a trunked gbit port. On the Gigabit switch I have untagged ports for WAN, LAN and so forth.
Then in the gigabit switch I can LAG together the 2GBE ports of the servers. I can then send the separate cluster comm through these ports.
The only network redundancy I have this way is that the cluster communications wont fall apart if the 10GBE switch goes up in flames.
How can one do better?
I am looking for a way to redundantly configure CEPH for a new pve cluster.
The nodes have 1x10GBE and 2xGBE ports.
The nice way would be to have 2x10GBE ports per node and bond them together and make different VLANs for CEPH, cluster comm, separate cluster network, WAN, LANd, DMZ , etc....
Now how can I achieve something like this with 1 10GBE and 2 GBE ports? To make problems more difficult, i have one full 10GBE switch and one GBE switch. There is a GBe port on the 10GBE switch, so the 2 switches can send the same vlans through, but i can't do MC-LAG between them...
There are various budget constrains at work here...
I am supporting the comapny from 200 Km away so I would like to prepare for network problem shenigans......
What I came up with so far:
If I leave the 10GBIT ports unbonded and run every traffic through them via vlans, and then send the vlans through the gbit switch a trunked gbit port. On the Gigabit switch I have untagged ports for WAN, LAN and so forth.
Then in the gigabit switch I can LAG together the 2GBE ports of the servers. I can then send the separate cluster comm through these ports.
The only network redundancy I have this way is that the cluster communications wont fall apart if the 10GBE switch goes up in flames.
How can one do better?