After running CEPH for a year, I decided to replace a node as the performance was not what I expected. (Two days later, insert multiple expletives, one less keyboard and a few grey hairs)
First thing - double check you have put in the right network card.
-> those 2x 10GB look very similar to...