Hello,
I have made a PoC with 3 nodes, 3 OSD HDD of 3To per node (so 9 OSDs, replication size of 3 on the hosts, min of 1, test with Filestore (journal on OSD), then Bluestore. Perf in reading are too bad with BS (as mentioned in the documentation, the cluster is too small, specially with HDD...