How to migrate VM from one PVE cluster to another

This is an awesome feature, thanks y'all! Is there a way to get it to work with ceph? Currently trying to migrate with Ceph disks hits "ERROR: no export formats for 'cephtwo:vm-1046-disk-0' - check storage plugin support!"
 
not at the moment, but we will extend the volume handling code to allow moving a volume from and to RBD.
 
Ironically it works for live migration, just not for offline migration. In any case, just managed to move a full cluster over a frustratingly slow WAN link, awesome feature! Took a week, but there were zero hiccups outside of having to comment out the checks that prevent migration if the VM was based on a snapshot of an image (which presumably just meant more disk usage on the target cluster, but otherwise appears to have left disks totally fine on the other side).
 
Ironically it works for live migration, just not for offline migration. In any case, just managed to move a full cluster over a frustratingly slow WAN link, awesome feature! Took a week, but there were zero hiccups outside of having to comment out the checks that prevent migration if the VM was based on a snapshot of an image (which presumably just meant more disk usage on the target cluster, but otherwise appears to have left disks totally fine on the other side).

great to hear :) RBD (offline) support is definitely on the todo list, and (including) snapshots is also up on the table since we want to take a stab at snapshot-based RBD replication at some point as well.
 
  • Like
Reactions: hellfire
the cross cluster ("remote") migration feature exists, but it is still marked as experimental.
 
the cross cluster ("remote") migration feature exists, but it is still marked as experimental.
Thanks for the update. I am using proxmox in my homelab to get away from some non-genuine vmware keys and loving pve so far. I am also at an org the is very close to going with proxmox or xen and has 2 large data centers. The only concerns they had were native support for iscsi and the single pane of glass multi-cluster management. Which isn't really the need. The need was cross cluster migration. once that makes enterprise and can be tested, our org will likely make the jump over.
 
it works quite well for many cases already, but there are still some kinks to be ironed out :)
 
I've been runnig the command-line migration for a while now in various projects, seems to work really well, even migration between a cluster and single host (and vice versa) works. Hopefully we get a nice GUI for this at some point. :)
 
it's included as a preview/experimental feature, see the commands pct remote_migrate and qm remote_mgirate. you'll need an API token with the relevant privileges (the command will error out if your are missing them) and I would strongly suggest playing around with it in a test lab setting before letting it near a production environment - as I said, it's a preview/experimental feature and might still have bugs and rough edges.

among the things not yet supported are:
- snapshots (this requires some refactoring of our privilege checks, nothing else blocking it since we re-use the same storage migration code)
- pending changes (this requires some refactoring of our privilege checks, nothing else blocking it)
- replication (this one is a bit of a bigger feature, but definitely planned)
- non-dir based shared storages for offline/container migration (this one just lacks some implemented functions in the storage plugins and should be easiest of them all to implement)
old thread, but fyi :
I have successfully used the 'qm remote_migrate' tool between prox7.4 clusters, but it seems to fail when migrating a vm form a 7.4 to a 8.4 cluster
I wouldn't be surprised if this is expected behavior (since different major release) but this might be interesting to someone
Using the backup-restore (using a shared storage) between 7.4 and 8.4 works as expected