not sure where you got this from - you need to set a special option in the ceph configuration file to even allow starting bluestore OSDs, which is aptly called "enable experimental unrecoverable data corrupting features = bluestore". it's about as far away from being the default as possible, short of not being compiled in at all.
basically do what ceph-deploy does (replace MDSINSTANCENAME with something of your choice):
Code:
mkdir -p /var/lib/ceph/mds/ceph-MDSINSTANCENAME
chown -R ceph:ceph /var/lib/ceph/mds/ceph-MDSINSTANCENAME
ceph --cluster ceph --name client.bootstrap-mds --keyring /var/lib/ceph/bootstrap-mds/ceph.keyring auth get-or-create mds.MDSINSTANCENAME osd 'allow rwx' mds 'allow' mon 'allow profile mds' -o /var/lib/ceph/mds/ceph-MDSINSTANCENAME/keyring
systemctl start ceph-mds@MDSINSTANCENAME
systemctl enable ceph-mds@MDSINSTANCENAME
rinse, repeat for as many MDS instances as you want.
then follow
http://docs.ceph.com/docs/master/cephfs/createfs/ and
http://docs.ceph.com/docs/master/cephfs/kernel/
but again, I am not sure where you get "CephFS is already HA active-activate in Luminous" - while there have been lots of fixes in that area, multimds is explicitly still marked as experimental:
similar limitations apply to running multiple file systems in one cluster, as well as snapshotting directories on cephfs.
The ones in Debian and the ones provided by the Ceph project (which ours are based on) use different Debian packaging - one has the logrotate in ceph-common, the other in ceph-base, and neither cares about the others' quirks. Since our pve-qemu-kvm package depends on ceph-common, you initially get the ceph-common package from Debian Stretch installed. When you then install the Ceph packages from our repository (e.g., via "pveceph install"), the old logrotate script is not cleaned up because it is a conffile. We'll include some kind of cleanup in our next Luminous packages (based on 12.0.3).
