Background: After a failed mixed Proxmox 8/9 upgrade broke Ceph, I did a full Ceph reinstall on a 5-node Proxmox 9.1 cluster running Ceph 19.2.3 (Squid). After reinstall I could not get cephx working — enabling it causes monitors to lose quorum, OSDs and managers fail to start.
Symptoms:
With...