Hi All,
In reference to the https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server
Is there any issue with putting a switch between 2 nodes. Reason is I am getting rid of my 2 NAS units, moving to TrueNAS running on ProxMox VE for file shares and would anticipate taking out 2 of my MikroTik 8 port 10Gb switches. End goal to save some electricity.
I'd still like to access the 10Gb network for a single client MAC for video editing storage if possible but have a smaller MikroTik 4 port 10Gb switch I can use for that. The MAC has a 10Gb SFP+ adapter which is getting good speed to the share on the NAS currently.
So referencing the mesh network where each node has direct connection to 2 other nodes I'd put a switch in between say node 1 and 2. Cluster traffic would be seperated to a vlan whilst a share on TrueNAS hosted on a ProxMox node would serve as a SMB share to the clients on a seperate vlan on the same 10Gb network.
I'm competent at the networking bit so it is jus the feasibility if this would work but unsure on the ProxMox side. I already have the cluster using a 2nd vlan for cluster/corosync traffic on the 10Gb network.
I have a good number of Intel X520-DA2 (dual 10Gb SFP+) cards and 2 of the nodes have these in already with a 3rd node to join shortly replacing a small desktop that I can install another in. At the moment I use one 10Gb connection from each node to each switch then the switches are connected to each other. Both NAS units are also connected to each switch. Defo over kill for a home setup, lol.
In reference to the https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server
Is there any issue with putting a switch between 2 nodes. Reason is I am getting rid of my 2 NAS units, moving to TrueNAS running on ProxMox VE for file shares and would anticipate taking out 2 of my MikroTik 8 port 10Gb switches. End goal to save some electricity.
I'd still like to access the 10Gb network for a single client MAC for video editing storage if possible but have a smaller MikroTik 4 port 10Gb switch I can use for that. The MAC has a 10Gb SFP+ adapter which is getting good speed to the share on the NAS currently.
So referencing the mesh network where each node has direct connection to 2 other nodes I'd put a switch in between say node 1 and 2. Cluster traffic would be seperated to a vlan whilst a share on TrueNAS hosted on a ProxMox node would serve as a SMB share to the clients on a seperate vlan on the same 10Gb network.
I'm competent at the networking bit so it is jus the feasibility if this would work but unsure on the ProxMox side. I already have the cluster using a 2nd vlan for cluster/corosync traffic on the 10Gb network.
I have a good number of Intel X520-DA2 (dual 10Gb SFP+) cards and 2 of the nodes have these in already with a 3rd node to join shortly replacing a small desktop that I can install another in. At the moment I use one 10Gb connection from each node to each switch then the switches are connected to each other. Both NAS units are also connected to each switch. Defo over kill for a home setup, lol.
Last edited: