Recommendations for PVE 9 upgrade with Ceph

[apollo13]

Hi there,

we usually follow the Ceph upgrade notes at https://pve.proxmox.com/wiki/Ceph_Reef_to_Squid for minor versions as well. This has served us well in the past. We are currently on PVE 8 with Ceph 19.2.1-pve3. When adjusting the sources to trixie we see that the update wants to install 19.2.3-pve1. How are we supposed to handle this, multiple options come to mind but I am not really sure which is the best one:

* Manually update only the ceph packages on all hosts and follow the normal ceph upgrade procedure. This doesn't seem to be easy due to dependency issues.
* Upgrade host by host and accept the different ceph versions (that would also mean that managers, monitors & osds on a host would be restarted with the new version while the others are still running the old one).
* Pin the ceph packages to the existing version and then upgrade ceph after the pve 9 migration.

Out of those, option two sounds best to me assuming Ceph 19.2.1 and Ceph 19.2.3 can run in parallel. The upgrade docs for pve itself don't make much mention of it, aside from the fact that ceph squid is required…

Thanks,
Florian

 

[Hannes Laimer]

Hey,

ceph has its own file under /etc/apt/sources.d/, you can change that to use bookworm temporarily. Then apt update shouldn't pull in any new minor versions as bookworm is a little behind trixie. But ceph really does not mind having small deviations in minor version within one cluster, so yes, doing the ceph minor update with the PVE one is what I'd recommend here.

 

[apollo13]

Hi Hannes,

ceph has its own file under /etc/apt/sources.d/, you can change that to use bookworm temporarily. Then apt update shouldn't pull in any new minor versions as bookworm is a little behind trixie.

I thought of that but the ceph packages also seem to be part of the normal enterprise repository which would again pull them in.

But ceph really does not mind having small deviations in minor version within one cluster, so yes, doing the ceph minor update with the PVE one is what I'd recommend here.

Thanks, worked fine!

Cheers,
Florian