10Gbe high availability without switches?

[Magneto]

Hi

I wonder if this is at all possible: If I setup a 3 node CEPH or GlusterFS cluster and I want to dedicated a 4port 10Gbe NIC in each server for storage network. Can I set it up in such a way that I don't need a switch, but still achieve high availability?

i.e. run cables from:

• From Server1/Port1 to Server2/Port1
• from Server1/Port2 to Server3/Port1
• from Server2/Port2 to Server2/Port2

This would create 2 paths from each server to each other. In theory, it would create high availability, but how do I set this up in Proxmox / Linux?


P.S. We haven't brought any equipment yet, still planning

 

[Magneto]

I guess no one has tried to do something like this yet?

 

[mac.linux.free]

I guess no one has tried to do something like this yet?

guess you have to simply bridge the ports on any server

 

[Magneto]

guess you have to simply bridge the ports on any server

That's what I don't know. I don't have the hardware yet, still researching to see if it can be done like this

 

[tschanness]

There is a wiki entry for exactly this problem.

Regards

 

[Magneto]

There is a wiki entry for exactly this problem.

Regards

Interesting. I didn't see it earlier, will go check the wiki

 

[alexskysilk]

https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server