PVE and CEPH Upgrade

[B3rt_PX]

Hi All,

I have a cluster of 4 nodes with Proxmox 7.1-9 and Ceph Pacific v.16.2.7. This weekend I would like to upgrade Proxmox to 7.3 and Ceph to Quincy(the latest version). My Ceph Cluster is made of 1 pool, consisting of 8xSSD to each nodes.

The question are these:
-The 7.3 PVE version is compatible with the 16.2.7 Pacific CEPH version?
-Do you suggest me to update fisrt the cluster PVE nodes'version and then the cluster CEPH? Or is better to update first the cluster CEPH and then the cluster PVE nodes?
-Before to update the cluster CEPH version from 16.2.7 to 17.2.x, do you suggest me to update the current CEPH version until the Pacific latest version(16.2.9)?

Important: I don't have the possibility to shutdown/reboot all the nodes at the same time.

Thank you!

 

[sterzy]

Hi,

-The 7.3 PVE version is compatible with the 16.2.7 Pacific CEPH version?

Yes.

-Do you suggest me to update fisrt the cluster PVE nodes'version and then the cluster CEPH? Or is better to update first the cluster CEPH and then the cluster PVE nodes?

First PVE then Ceph Pacific to Quincy. Although, this is more relevant for major versions of PVE (so e.g. 6.x to 7.x). However, our upgrade guide for Ceph Quincy assumes at least PVE 7.2 [1].

-Before to update the cluster CEPH version from 16.2.7 to 17.2.x, do you suggest me to update the current CEPH version until the Pacific latest version(16.2.9)?

I'd recommend you follow the Ceph Pacific to Quincy upgrade guide [1]. Please read i carefully before you take any steps.

Important: I don't have the possibility to shutdown/reboot all the nodes at the same time.

That is fine, upgrading one node at a time is the recommended way in case you have HA requirements etc. anyway.

[1]: https://pve.proxmox.com/wiki/Ceph_Pacific_to_Quincy

 

[B3rt_PX]

Thank @sterzy to answering my questions.

I have some last questions for you:
- Is it necessary and recommended update the CEPH version from Pacific 16.2.7 to Quincy? Or can I proceed to use Pacific version?

- Considering that I have to update both PVE and the CEPH, after update the PVE version of the node1, do you suggest me to update immediately the CEPH version(from Pacific to Quincy) on the node1, or is better to update first the other PVE version of the nodes (to make sure I have the same PVE version on all nodes before upgrading CEPH) ?

Thanks again

 

[sterzy]

Hi,

- Is it necessary and recommended update the CEPH version from Pacific 16.2.7 to Quincy? Or can I proceed to use Pacific version?

you can use Pacific for a bit longer, but you'll need to upgrade early next year anyway. For more info see the Ceph docu [1].

- Considering that I have to update both PVE and the CEPH, after update the PVE version of the node1, do you suggest me to update immediately the CEPH version(from Pacific to Quincy) on the node1, or is better to update first the other PVE version of the nodes (to make sure I have the same PVE version on all nodes before upgrading CEPH) ?

First upgrade all PVE nodes, then the Ceph upgrade.

[1]: https://docs.ceph.com/en/latest/releases/index.html

 

[B3rt_PX]

Thank @sterzy to answering my questions.

When I proceed to update the PVE version of the nodes, do you suggest me to uncheck some OSD flags for the CEPH options during the update time?

 

[Zerstoiber]

Thank @sterzy to answering my questions.

When I proceed to update the PVE version of the nodes, do you suggest me to uncheck some OSD flags for the CEPH options during the update time?
View attachment 44902

regarding the CEPH Upgrade, you should follow this guide word by word
https://pve.proxmox.com/wiki/Ceph_Pacific_to_Quincy (@sterzy tried to post that link, but used the internal one on their intranet^^)
-> it sets the noout flag in that guide

Regarding "what to do with CEPH during normal Host upgrades", i think it is the same, you can set the noout
I didn't find an official best practice right now, but was taught to do it like that in a Proxmox training.
It's also mentioned and recommended here for example:
https://forum.proxmox.com/threads/updating-nodes-with-ceph.54540/

 

[sterzy]

regarding the CEPH Upgrade, you should follow this guide word by word
https://pve.proxmox.com/wiki/Ceph_Pacific_to_Quincy (@sterzy tried to post that link, but used the internal one on their intranet^^)
-> it sets the noout flag in that guide

Ah whoops, thanks for spotting that!

Regarding "what to do with CEPH during normal Host upgrades", i think it is the same, you can set the noout
I didn't find an official best practice right now, but was taught to do it like that in a Proxmox training.
It's also mentioned and recommended here for example:
https://forum.proxmox.com/threads/updating-nodes-with-ceph.54540/

It's probably a good idea. However, to my understanding, as long as your reboots of single nodes during the update don't take too long you should be fine too. Don't forget to unset it afterwards, though.

 

[n0bie]

we use PVE 7.4 and still using ceph pacific. do u think that is okay?