Production node to new Ceph cluster

[SudsMaker]

Team,
I have 3 hosts but one is in production (v8.1.3).
The production server (non-Ceph) is hosting ~20 VM's and 2 Containers.
Can I setup a 2 node cluster (v8.1.4) with Ceph enabled and join the production server to that cluster?
I would then want to migrate all the VM's and Containers to the other hosts on the Ceph disks.

Is this going to work?
Will it take an outage?

Thanks for your input in advance.

 

[bbgeek17]

https://pve.proxmox.com/pve-docs/pve-admin-guide.html#pvecm_join_node_to_cluster

All existing configuration in /etc/pve is overwritten when joining a cluster. In particular, a joining node cannot
 hold any guests, since guest  IDs could otherwise conflict, and the node will inherit the cluster’s storage configuration..
 To join a node with existing guest, as a workaround, you  can create a backup of each guest (using vzdump) and restore 
it under a different ID after joining. If the node’s storage layout differs, you will need to re-add the node’s storages, 
and adapt each storage’s node restriction to reflect on which nodes the storage is actually available.

In addition, Ceph is not supported/recommended on 2 nodes.

You should join the two new nodes, one by one to your _existing_ production node, thus forming a 3 node cluster. Where you can then build a supported Ceph configuration.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[SudsMaker]

My apologies for the late response.
So if I add my other hosts to the existing cluster that has the prod server in it with VM's and Containers.
Should I setup Ceph on the 2 nodes and then migrate the VM's off the prod server that does not have Ceph setup?
I would imagine that if I enable Ceph on the production node with running VM's that I would loose all the VM's and Containers?

 

[bbgeek17]

Should I setup Ceph on the 2 nodes and then migrate the VM's off the prod server that does not have Ceph setup?

You should not setup Ceph on two nodes in production. You can, but its a bad idea.

I would imagine that if I enable Ceph on the production node with running VM's that I would loose all the VM's and Containers?

There is no reason to loose anything by adding another storage type. I would recommend against experimenting on your production server as, frankly, you dont seem to have a good understanding of what Ceph is and what the requirements are.

You have a Virtualization environment available to you. You can install a virtual nested PVE and experiment there.

Best of luck

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox