10G switch Mikrotik?

[xtriglavx]

Hello,

please, is MikroTik CRS309-1G-8S+IN good for connect 3 PVE servers on 10GBe network for Ceph and cluster network? I want separate network for Ceph and for PVE cluster, but I want this networks on 10Gb networks, because I need faster copy/move nodes and etc between this servers. This Mikrotik is very cheap, but I don't have experience with this switch.

Today I have 3 Servers connected via 10Gb SFP+ only for Ceph, not for PVE cluster, this is only on 1Gbs network.

https://mikrotik.com/product/crs309_1g_8s_in

Thanks for any helpful and answer.

 

[Stefan_R]

Don't see why it wouldn't be good. For 3 nodes it really shouldn't matter that much which switch is in use, if it supports the speed you're going for and has good latency.

Keep in mind that the idea between seperating the cluster and ceph networks is so that Ceph traffic does not cause dropouts for Corosync, which may lead to cluster problems. If you intend to use the full capacity of the secondary 10G network for migration and such, it might be a good idea to go for a third network, 1G if you want, solely dedicated to corosync (you can set the migration network in the datacenter configuration).

 

[iprigger]

Hi,

we have a bunch of installations running with microtic switches... they do work fine - but are a bit buggy sometimes. Speed ist quite OK (CRS326-10s2q series)

Tobias

 

[rsvg]

I got that exact switch 3 weeks ago and I hate it. I wish I wouldn't have updated to the newest firmware, it's worse now than before. Have to unplug the power on the switch in order to get it to activate a new sfp+ plugged in. Unacceptable

 

[iprigger]

I got that exact switch 3 weeks ago and I hate it. I wish I wouldn't have updated to the newest firmware, it's worse now than before. Have to unplug the power on the switch in order to get it to activate a new sfp+ plugged in. Unacceptable

you can downgrade... btw... don't forget to upgrade the routerboard firmware, too - otherwise you're going to have some nasty effects (like the one you're experiencing... had that in the past when not upgrading routerboard as well)

 

[rsvg]

Thanks for the tip. I’ll try upgrading the router board as well! Hopefully then I like it

 

[iprigger]

Thanks for the tip. I’ll try upgrading the router board as well! Hopefully then I like it

... and... try to stay on the "stable" path for the moment...

Tobias

 

[rsvg]

When you say routerboard firmware, do you mean the routeros packages? I just updated router os packages. Thanks

 

[rsvg]

My links still show unplugged even though they work.

 

[iprigger]

Hi,

Do a /system routerboard print
routerboard: yes
model: CRS326-24S+2Q+
serial-number: AEF60A26983E
firmware-type: qca9531L
factory-firmware: 6.44.3
current-firmware: 6.48.1
upgrade-firmware: 6.48.1

if the "current-firmware" isn't showing the same as your os firmware do:

/system routerboard upgrade

NOTE: You have to reboot your switch after that. If the SFPs still don't come online check the SFPs... sometimes there are incompatibilities... I personally made quite well experiences with FS.COM Cisco compatible...

Tobias

 

[rsvg]

Thanks that’s super helpful!

 

[andaris]

Try to use the LTS firmware (6.47.9) for such use cases, the current stable is IMHO ok for testing and SOHO usage, but not stable enough for data center production yet.

 

[iprigger]

Try to use the LTS firmware (6.47.9) for such use cases, the current stable is IMHO ok for testing and SOHO usage, but not stable enough for data center production yet.

Depends a bit on what you're doing - and what possibility you have for testing. I currently use Stable - but have failed back to LTS on occasion.

Software-Quality is definitely something Mikrotik needs to work on!