Migrate VM images between 2 Ceph Clusters

[stefws]

Want to upgrade an old 3.4 testlab connected to a Hammer Ceph cluster (i know

Plan is first to migrate VM images to a newly installed Ceph Mimic cluster, would it be possible to connect to both Ceph Cluster (eg. maybe by upgrading Ceph Client to +Jewel)?

 

[spirit]

yes sure.

upgrading librbd to jewel should work (stop/start vm after, or do a livemigration, to run the vmon new librbd), then the simply use move disk feature to migrate between storage.

 

[stefws]

Thought something like that, wondering though howto define the new Ceph cluster as storage (naming the new key ring etc.)

 

[alexskysilk]

the SAFEST thing to do is to backup the vms and restore them on the new cluster. To just mount a foreign ceph mount you'd need to make an entry in /etc/pve/storage.cfg (I dont remember if 3.4 had an option to add in the GUI) and follow @spirit's instructions. you can specify a key as you normally would (see https://pve.proxmox.com/wiki/Ceph_Server#Ceph_Client)

 

[stefws]

3.4 got GUI support for Ceph, but it also works fine to manual add in storage.cfg, thanks I forgot about the naming schem for keyring(s)...
Anyone knows where I might find Jewel packages for Debian Wheezy as they seems EoL

apt-get update against:
deb http://ceph.com/debian-jewel wheezy main
=>
W: Failed to fetch http://ceph.com/debian-jewel/dists/wheezy/main/binary-amd64/Packages 301 Moved Permanently

 

[stefws]

the SAFEST thing to do is to backup the vms and restore them on the new cluster.

Got VM backups dumped on two CephFS, just wants to release old Hammer HW to build a new PVE 5.x cluster and then connect that to the new Mimic Cluster

 

[Alwin]

Anyone knows where I might find Jewel packages for Debian Wheezy as they seems EoL

The packages in debian are already jewel. But I am not sure that you can access Mimic with it.

 

[stefws]

The packages in debian are already jewel. But I am not sure that you can access Mimic with it.

I don't think so, possible only ceph-deploy not all other needs packages ImHO

I also tried EU mirror with:

deb http://eu.ceph.com/debian-jewel wheezy main

but this don't update my ceph packages from Hammer on apt-get update + upgrade :/

 

[stefws]

The packages in debian are already jewel. But I am not sure that you can access Mimic with it.

Gregory Farnum@Redhat seems to think so:

>Got an old Hammer Cluster where I would like to migrate it’s data (rbd images) to a newly installed Mimic Cluster.
>Would this be possible if I could upgrade the clients from Hammer to Jewel(ie. would Jewel be able to connect to both clusters)?
Yes; that should work without any issues

 

[Alwin]

I don't think so, possible only ceph-deploy not all other needs packages ImHO

True, I should be more precise, in Debian 9 (PVE 5.x) they are. But this way you could have one node as 5.x (standalone) and connect it to both ceph clusters, with the same storage naming. This way you would just need to copy the vmid.conf from the 3.x node to the 5.x and could keep the downtime small.

 

[stefws]

True, I should be more precise, in Debian 9 (PVE 5.x) they are. But this way you could have one node as 5.x (standalone) and connect it to both ceph clusters, with the same storage naming. This way you would just need to copy the vmid.conf from the 3.x node to the 5.x and could keep the downtime small.

Right that might be another path, remove a node from the current old 3.4, install it as a first 5.x node w/Ceph Jewel as client and connect to both Ceph Clusters and manually copy vmid.conf files between PVE nodes.

 

[stefws]

Attempted to compile Ceph Jewel from source, but it is hard to near impossible to compile under Wheezy as it's gcc < 4.8 which are missing 'emplace' a C++11 feature among other things... Will properly attempt with a PVE 5.x node Jewel client