Update & Risk Management Best Practices? How to ensure real HA between Clusters

fstrankowski

fstrankowski

Renowned Member
Nov 28, 2016
82
19
73
Hamburg
Hey guys,

today in one of our standup meetings we thought about improving out update strategy. Currently we run multiple clusters running on different versions of Proxmox. So far, to ensure we have our HA services always running, we update one cluster at a time, let it run to ensure its stable and roughly a month later its counterpart.
We do have development clusters in place to test the most recent Proxmox changes but we can never assure the exact software version on each cluster we tested.

What we are looking for is a historically saved set/version for all incoming Proxmox updates (like "Update-Packages"), to ensure if you update a machine you can update it to a SPECIFIC set of packages. Like if we tested the "most recent version" from 01. January 2025 on our Dev cluster, it looks good, we want to run THIS version on our live-clusters a month later.

How do you guys approach this? I am really looking forward to find ideas and solutions to that.

Florian
 
Last edited:
one option would be to laverage POM and it's snapshots [1]. you could simply take a snapshot, update your dev cluster from it and then once you consider that stable enough use the same snapshot to update your production cluster.

[1]: https://pom.proxmox.com/
 
  • Like
Reactions: fstrankowski
sterzy said:
one option would be to laverage POM and it's snapshots [1]. you could simply take a snapshot, update your dev cluster from it and then once you consider that stable enough use the same snapshot to update your production cluster.

[1]: https://pom.proxmox.com/
Click to expand...
My god, this is an excellent idea. Does the POM support Mirroring Debian base packages aswell, not just Proxmox packages? So we do not run into problems using a Proxmox Snapshot from the POM but install more recent debian base updates alongside?


Is it possible to specify a snapshot-id on our cluster-nodes when updating via POM? (e.g. Like apt-get upgrade snapshot-id <id>) ??
 
  • Like
Reactions: Johannes S
fstrankowski said:
Does the POM support Mirroring Debian base packages aswell, not just Proxmox packages? So we do not run into problems using a Proxmox Snapshot from the POM but install more recent debian base updates alongside?
Click to expand...
yes mirroring the debian repositories is also possible, the setup wizzard even has options to simplify setting that up.

fstrankowski said:
Is it possible to specify a snapshot-id on our cluster-nodes when updating via POM? (e.g. Like apt-get upgrade snapshot-id <id>) ??
Click to expand...
not directly no, apt will simply use the latest packages it finds. however, you can use different medias that you sync with specific snapshots to approximate that [2].

[2]: https://pom.proxmox.com/offline-media.html#using-a-medium
 
You must log in or register to reply here.
Top Bottom