Feature Request: Show VM Migration progress

marsian

Active Member
Sep 27, 2016
55
5
28
Hi there,

not sure if this is the right way, but let's try ;)

One thing that bugged me for quite some time is that when migrating VMs between nodes with local storage, no progress indicator is given. I understand that maybe forecasting an overall percentage etc. might be not as easy as expected (various network parameters involved etc.), but it would be helpful if for the migration job of a storage device of the VM at least some progress of the copying job could be shown in the task details (amount of data written), similar to the status when performing a backup? :)

Right now we're doing our migration forecasting based on Network load, but which is not as accurate as it should be, as you can imagine.

Thanks!
 
  • Like
Reactions: eugenevdm and rnmkr

LnxBil

Famous Member
Feb 21, 2015
6,323
783
163
Saarland, Germany
I understand that maybe forecasting an overall percentage etc. might be not as easy as expected (various network parameters involved etc.), but it would be helpful if for the migration job of a storage device of the VM at least some progress of the copying job could be shown in the task details (amount of data written), similar to the status when performing a backup? :)

On my system, there is a progress indicator:

Code:
[..]
migration status: active (transferred 104728736, remaining 180310016), total 286072832)
[..]
 

marsian

Active Member
Sep 27, 2016
55
5
28
Interesting, we're currently still running a recent 5.4.x cluster, and there's no progress indication:

Code:
2020-03-14 23:07:38 starting migration of VM 103 to node 'pveXXX' (XX.XX.XX.XX)
2020-03-14 23:07:38 found local disk 'local-lvm:vm-103-disk-0' (in current VM config)
2020-03-14 23:07:38 copying disk images
  Using default stripesize 64.00 KiB.
  For thin pool auto extension activation/thin_pool_autoextend_threshold should be below 100.
  Logical volume "vm-103-disk-0" created.
  WARNING: Sum of all thin volume sizes (2.23 TiB) exceeds the size of thin pool pve/data and the size of whole volume group (1.64 TiB)!
(Ignore the thin-pool message :) )

It stays like that until it's finished, and where some additional feedback will be given (taken from another migration we did earlier today):

Code:
2097152+0 records in
2097152+0 records out
137438953472 bytes (137 GB, 128 GiB) copied, 1197.12 s, 115 MB/s
66+8324367 records in
66+8324367 records out
137438953472 bytes (137 GB, 128 GiB) copied, 1200.63 s, 114 MB/s
  Logical volume "vm-105-disk-0" successfully removed
2020-03-14 22:39:17 migration finished successfully (duration 00:20:03)
TASK OK

But nothing in between on the actual copying progress...
 

LnxBil

Famous Member
Feb 21, 2015
6,323
783
163
Saarland, Germany
Interesting, we're currently still running a recent 5.4.x cluster, and there's no progress indication:

[...]

But nothing in between on the actual copying progress...

Ah, now I get what you want. I also tried on PVE 5.4 and we have a shared storage, so the actual disk image copy stuff is not seen, because there is nothing to be done. The whole migration task log is this:

Code:
2020-03-14 23:07:05 starting migration of VM 2012 to node 'proxmox3' (10.192.0.243)
2020-03-14 23:07:05 copying disk images
2020-03-14 23:07:05 starting VM 2012 on remote node 'proxmox3'
2020-03-14 23:07:08 start remote tunnel
2020-03-14 23:07:09 ssh tunnel ver 1
2020-03-14 23:07:09 starting online/live migration on tcp:10.192.0.243:60000
2020-03-14 23:07:09 migrate_set_speed: 8589934592
2020-03-14 23:07:09 migrate_set_downtime: 0.1
2020-03-14 23:07:09 set migration_caps
2020-03-14 23:07:09 set cachesize: 33554432
2020-03-14 23:07:09 start migrate command to tcp:10.192.0.243:60000
2020-03-14 23:07:10 migration status: active (transferred 104728736, remaining 180310016), total 286072832)
2020-03-14 23:07:10 migration xbzrle cachesize: 33554432 transferred 0 pages 0 cachemiss 0 overflow 0
2020-03-14 23:07:11 migration status: active (transferred 224721217, remaining 58880000), total 286072832)
2020-03-14 23:07:11 migration xbzrle cachesize: 33554432 transferred 0 pages 0 cachemiss 0 overflow 0
2020-03-14 23:07:12 migration speed: 85.33 MB/s - downtime 48 ms
2020-03-14 23:07:12 migration status: completed
2020-03-14 23:07:16 migration finished successfully (duration 00:00:12)
TASK OK
 

rnmkr

Member
Mar 10, 2019
13
2
8
28
This feature is much needed. After 1 hour I'm still wondering what's the progress of the migration.

I have found a way to show progress of the migration!

If you run pkill -USR1 dd command on the proxmox server, it reports the current migration status on the web output.

Thanks to this guy.
 
Last edited:
  • Like
Reactions: bekreyev

Dominic

Proxmox Staff Member
Staff member
Mar 18, 2019
1,388
176
68
Note that by adding yourself to the CC list (located at top right) of the respective enhancement request on Bugzilla you will get email notifications when something interesting happens. Additionally, there is also a button to watch this forum thread above the opening post.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!