qm live migrate storage lvm

gizmo15

Member
Sep 20, 2015
12
0
21
Hi,

This is the situation, i have 3 nodes with Proxmox 5 with this specs :
storage full lvm
no HA activate
no shared storage
1GB links dedicated to admin/migraiton

I want to migrate some VMs from node 2 to node 3.

Packages version on node 2 :
Code:
root@guerech:~# pveversion -v
proxmox-ve: 5.1-35 (running kernel: 4.10.17-3-pve)
pve-manager: 5.1-41 (running version: 5.1-41/0b958203)
pve-kernel-4.13.13-4-pve: 4.13.13-35
pve-kernel-4.10.17-4-pve: 4.10.17-24
pve-kernel-4.10.17-2-pve: 4.10.17-20
pve-kernel-4.10.17-3-pve: 4.10.17-23
libpve-http-server-perl: 2.0-8
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-19
qemu-server: 5.0-18
pve-firmware: 2.0-3
libpve-common-perl: 5.0-25
libpve-guest-common-perl: 2.0-14
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.1-15
pve-qemu-kvm: 2.9.1-5
pve-container: 2.0-18
pve-firewall: 3.0-5
pve-ha-manager: 2.0-4
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.1-2
lxcfs: 2.0.8-1
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.3-pve1~bpo9

Packages version on node 3 :
Code:
root@barbetorte:/etc/pve# pveversion -v
proxmox-ve: 5.1-35 (running kernel: 4.10.17-3-pve)
pve-manager: 5.1-41 (running version: 5.1-41/0b958203)
pve-kernel-4.13.13-4-pve: 4.13.13-35
pve-kernel-4.10.17-2-pve: 4.10.17-20
pve-kernel-4.10.17-3-pve: 4.10.17-23
libpve-http-server-perl: 2.0-8
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-19
qemu-server: 5.0-18
pve-firmware: 2.0-3
libpve-common-perl: 5.0-25
libpve-guest-common-perl: 2.0-14
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.1-15
pve-qemu-kvm: 2.9.1-5
pve-container: 2.0-18
pve-firewall: 3.0-5
pve-ha-manager: 2.0-4
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.1-2
lxcfs: 2.0.8-1
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.3-pve1~bpo9

I use this command to launch the migration :
Code:
root@guerech:/etc/pve# qm migrate 700 barbetorte --with-local-disks 1 --online

When it failed, i have this result :
Code:
drive-virtio0: transferred: 6234832896 bytes remaining: 15240003584 bytes total: 21474836480 bytes progression: 29.03 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6320816128 bytes remaining: 15154020352 bytes total: 21474836480 bytes progression: 29.43 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6407847936 bytes remaining: 15066988544 bytes total: 21474836480 bytes progression: 29.84 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6496976896 bytes remaining: 14977859584 bytes total: 21474836480 bytes progression: 30.25 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6581911552 bytes remaining: 14892924928 bytes total: 21474836480 bytes progression: 30.65 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6668943360 bytes remaining: 14805893120 bytes total: 21474836480 bytes progression: 31.05 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6753878016 bytes remaining: 14720958464 bytes total: 21474836480 bytes progression: 31.45 % busy: 1 ready: 0
drive-virtio0: Cancelling block job
drive-virtio1: Cancelling block job
drive-virtio1: Done.
drive-virtio0: Done.
2018-01-10 00:13:02 ERROR: online migrate failure - mirroring error: drive-virtio1: mirroring has been cancelled
2018-01-10 00:13:02 aborting phase 2 - cleanup resources
2018-01-10 00:13:02 migrate_cancel
2018-01-10 00:13:08 ERROR: command '/usr/bin/ssh -e none -o 'BatchMode=yes' -o 'HostKeyAlias=barbetorte' root@172.17.0.20 pvesm free VMData:vm-700-disk-2' failed: exit code 5
2018-01-10 00:13:14 ERROR: command '/usr/bin/ssh -e none -o 'BatchMode=yes' -o 'HostKeyAlias=barbetorte' root@172.17.0.20 pvesm free VMData:vm-700-disk-1' failed: exit code 5
2018-01-10 00:13:17 ERROR: migration finished with problems (duration 00:09:49)

The VM that i try to migrate have to local disk.
The conf file of this VM :
Code:
root@guerech:/etc/pve/qemu-server# cat 700.conf
boot: cdn
bootdisk: virtio1
cores: 1
ide2: none,media=cdrom
memory: 512
name: morvan
net0: e1000=66:65:64:62:63:31,bridge=vmbr1
net1: e1000=7E:C7:A3:77:56:7D,bridge=vmbr0
numa: 0
onboot: 1
ostype: l26
serial0: socket
smbios1: uuid=bf537cf3-1efa-42d5-9d7f-50b398ad07ed
sockets: 1
virtio0: VMData:vm-700-disk-1,format=raw,size=20G
virtio1: VMData:vm-700-disk-2,format=raw,size=32G

I see on this forum sometimes it can perform live migration with local storage, sometines it's not, i don't know what to think. For example :
https://forum.proxmox.com/threads/live-kvm-migration-without-share-storage.16200/
https://forum.proxmox.com/threads/proxmox-5-0-live-migration-fails.35629/

I don't know where to search or what i need to see.

Can you help me?

Thanks!
 
Last edited:

gizmo15

Member
Sep 20, 2015
12
0
21
Thanks for the information!

I move our cluster from lvm to qcow2 and live migration works fine.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE and Proxmox Mail Gateway. We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!