Hi,
We currently have 3 node HCI cluster where we have 4 SSD drives in each node. This cluster is currently running in full meshed connectivity for Ceph traffic.
Within the next 2 months, we shall procure 4 more nodes, where each node will have 4 NVMe drives and 4 SSD drives. We shall create class-based CRUSH rules to segregate the drive classes.
In total, we shall have 7 nodes. In the future probably we shall increase 3 more nodes, which will make it 10 in total.
To accommodate this, we need a high-performing storage switch that would support fast Ceph traffic. The connectivity that we are planning is mentioned below:

These switches will only handle Ceph traffic and nothing else. They should be in Stack. The existing servers have 10G network ports to handle Ceph traffic. We are planning to migrate to 25G NIC cards.
25G x2 ports will be bonded together. One link will go to Switch 1, and the other link will go to Switch 2. We shall create port-channels in the stacked switches to support bond. Server NIC port Bonds and Switch port-channels will have LACP enabled to support 50G traffic.
We need a suggestion on a suitable switch to cover this scenario. Please note, we prefer switches that support Physical stacking rather than Virtual stacking.
We currently have 3 node HCI cluster where we have 4 SSD drives in each node. This cluster is currently running in full meshed connectivity for Ceph traffic.
Within the next 2 months, we shall procure 4 more nodes, where each node will have 4 NVMe drives and 4 SSD drives. We shall create class-based CRUSH rules to segregate the drive classes.
In total, we shall have 7 nodes. In the future probably we shall increase 3 more nodes, which will make it 10 in total.
To accommodate this, we need a high-performing storage switch that would support fast Ceph traffic. The connectivity that we are planning is mentioned below:

These switches will only handle Ceph traffic and nothing else. They should be in Stack. The existing servers have 10G network ports to handle Ceph traffic. We are planning to migrate to 25G NIC cards.
25G x2 ports will be bonded together. One link will go to Switch 1, and the other link will go to Switch 2. We shall create port-channels in the stacked switches to support bond. Server NIC port Bonds and Switch port-channels will have LACP enabled to support 50G traffic.
We need a suggestion on a suitable switch to cover this scenario. Please note, we prefer switches that support Physical stacking rather than Virtual stacking.