replace node in cluster

[ildar94]

Hi all!
I have a pve cluster and a cef storage of 3 nodes. On one node, both OSDs are in the down and out status.
I need to replace this node with another node.
I added a new node to the proxmox cluster, installed cef.
Tell me what are my next steps?
Do I need to delete the OSD on the node I want to remove from the cluster?
Or do I first need to create an OSD on a new node and add them to the pool?

 

[Lukas Moravek]

Hi @ildar94

- First, add the new OSDs on your new node to the cluster
- Wait for the cluster to rebalance
- Only after rebalancing is complete, remove the failed OSD
- Remove Monitor / Managers from failed node
- Clean up the old node:
-- If you want to completely remove the node from the Ceph cluster, remove it from the CRUSH map: ceph osd crush rm {node-name}

Additional docs:

https://dzone.com/articles/how-to-remove-node-from-proxmox-cluster#:~:text=To remove a node from,and clean up Ceph components.&text=If you are learning Proxmox,is build a Proxmox cluster.

https://pve.proxmox.com/pve-docs/pve-admin-guide.html#_remove_a_cluster_node

 

[ildar94]

I just created two OSDs on a new node. The new OSDs show up as ghost OSDs. Maybe I also need to add the monitor, manager and meta services to the new node to start the cluster rebalance process?

 

[Lukas Moravek]

Can you show me the OSDs "tab" ? Did you make the new ones UP / IN ?

 

[ildar94]

Can you show me the OSDs "tab" ? Did you make the new ones UP / IN ?

No, I dont see new osd on osd tab