Merging CEPH storage clusters

martijnk

Member
May 4, 2020
43
5
8
46
Hi all,

Currently I'm running 2 CEPH clusters, one NVMe cluster on 3 nodes, one SATA cluster on 4 nodes. I want to reinstall my NVMe cluster and make it member of the SATA cluster but all VM OS/boot disks are running on that cluster.

What I want to do is temporay migrate all that storage to the SATA cluster, empty the NVMe cluster, delete it, reinstall it. Then migrate the storage again back to the NVMe pool.

Problem is I have like 300 VMs which would be a lot of work to migrate them all manually through the web interface. Is there any script I can use to migrate all storage back and forth with a single command?

Thanks!
 
You will have to do some manual/scripted work.

The biggest issue up front are the VMIDs. Do you have the same VMIDs in use in both clusters?

If you do, then the simplest way (also scriptable) would be to create backups of the VMs and restore them on the other cluster and provide a differennt VMID when restoring the backup.

If none of the VMIDs is already present in both clusters, there would be other approaches that could reduce the downtime quite a bit.

Is the network setup in a similar way? Meaning, is the same vmbrX used for the guest traffic?