3 node Ceph-cluster upgrade from 7.0-13 to current - Ceph?

[zaphyre]

Hi am running a 3-node proxmox/ceph cluster which is sheduled for an upgrade to the current PVE version, which as of today, is 7.3.
The plan was to perform a "rolling" upgrade, starting with upgrading one node at first, and then after a week, also upgrade the remaining two nodes.

When preparing this in a staging area and performing an upgrade on one node from "pve201 pve-manager/7.2-11/b76d3178 Ceph 16.2.9" to "pve201 pve-manager/7.3-6/723bb6ec Ceph 16.2.11" everything went smooth as usual with Proxmox but the Ceph Status shows a warning about "Outdated OSDs" (listing all the OSDs on the not yet updated two servers).

Question: Is this a safe state - and safe to operate different minor Ceph versions in a cluster?
At least for some limited time period? I had several other proxmox clusters running different minor versions of pve - without ceph - with no problems at all. Ceph, well, it still keeps me a little bit frightened sometimes.... so, safe to go with this?

Thanks for any help with this!

 

[mr44er]

Question: Is this a safe state - and safe to operate different minor Ceph versions in a cluster?

Short answer: yes

But I personally wouldn't use new features (if introduced with the newer version) or do bigger changes (PG number) until every OSD is updated.
And in general I would keep the pve- and osd-version very tight together, so 1-2 weeks apart should be ok.

 

[zaphyre]

Thanks for your answer!