Search results

  1. R

    How to recover from loosing all but 1 ceph monitor

    Aha! I was able to recover a single node and its monitor! Back to needing to recover from a single monitor. Any assistance greatly appreciated!
  2. R

    How to recover from loosing all but 1 ceph monitor

    I have lost all monitors at this point (2 nodes have failed). How would I go about recovering from a loss of all monitors? Thanks for your help @AlexLup
  3. R

    How to recover from loosing all but 1 ceph monitor

    Hi all, Today out of the blue my ceph cluster had all clients disconnected. Ceph dashboard still shows healthy (lies), but proxmox shows both my vm storage (based on rdb) and cephfs as in an "unknown state". When I started to dive in further, I found that on every node, ceph health hangs. osd's...
  4. R

    [SOLVED] I managed to create a ghost ceph monitor

    I hit this again the other day, which resulted in me regretting not writing down clearly what I did to resolve it. To reproduce this issue: 1. Add a new proxmox node, but before adding it to the cluster, install and configure ceph (the key part here is that you completed the configuration) 2...
  5. R

    [SOLVED] I managed to create a ghost ceph monitor

    I saw this behavior after a node crashed and needed to be completely replaced (somewhat of a long story that is not fully relevant). When bringing up the new proxmox replacement node, I noticed the following: The systemd service for the nodes monitor was enabled and running but intermittently...
  6. R

    [SOLVED] Cluster no longer exists after node failure

    Thanks @Stoiko Ivanov for the documentation reference!
  7. R

    [SOLVED] Recover vm template from ceph block storage

    @sg90 this is exactly what I ended up doing. Thanks! @dietmar unfortunatly I did not have a backup and only had the vm disk in ceph rbd storage.
  8. R

    [SOLVED] Recover vm template from ceph block storage

    I lost a node that contained all of my vm templates. Unfortunately, vm templates are tied to a node, so though the underlying images still exist in my ceph pool, I can no longer use them from the proxmox ui (they can be seen with rbd ls -p <pool>. What is the recommended approach to resolving...
  9. R

    [SOLVED] Cluster no longer exists after node failure

    I found out the answer to my issue on my own, but I thought I'd post it for others. I was editing the wrong corosync.conf file. I needed to edit the cluster synced version in /etc/pve/corosync.conf. Once I did this and restarted corosync, pveproxy, and pve-cluster, the cluster appeared again in...
  10. R

    [SOLVED] Cluster no longer exists after node failure

    I have a 3 node hobby cluster running on lenovo rd330's with ceph across all three nodes. I recently had disk failures in one of the nodes that required it be completely replaced. I reinstalled the node and went to add it to the cluster, however the old node was still being shown in the cluster...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!