qm live migrate storage lvm

[gizmo15]

Hi,

This is the situation, i have 3 nodes with Proxmox 5 with this specs :
storage full lvm
no HA activate
no shared storage
1GB links dedicated to admin/migraiton

I want to migrate some VMs from node 2 to node 3.

Packages version on node 2 :

root@guerech:~# pveversion -v
proxmox-ve: 5.1-35 (running kernel: 4.10.17-3-pve)
pve-manager: 5.1-41 (running version: 5.1-41/0b958203)
pve-kernel-4.13.13-4-pve: 4.13.13-35
pve-kernel-4.10.17-4-pve: 4.10.17-24
pve-kernel-4.10.17-2-pve: 4.10.17-20
pve-kernel-4.10.17-3-pve: 4.10.17-23
libpve-http-server-perl: 2.0-8
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-19
qemu-server: 5.0-18
pve-firmware: 2.0-3
libpve-common-perl: 5.0-25
libpve-guest-common-perl: 2.0-14
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.1-15
pve-qemu-kvm: 2.9.1-5
pve-container: 2.0-18
pve-firewall: 3.0-5
pve-ha-manager: 2.0-4
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.1-2
lxcfs: 2.0.8-1
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.3-pve1~bpo9

Packages version on node 3 :

root@barbetorte:/etc/pve# pveversion -v
proxmox-ve: 5.1-35 (running kernel: 4.10.17-3-pve)
pve-manager: 5.1-41 (running version: 5.1-41/0b958203)
pve-kernel-4.13.13-4-pve: 4.13.13-35
pve-kernel-4.10.17-2-pve: 4.10.17-20
pve-kernel-4.10.17-3-pve: 4.10.17-23
libpve-http-server-perl: 2.0-8
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-19
qemu-server: 5.0-18
pve-firmware: 2.0-3
libpve-common-perl: 5.0-25
libpve-guest-common-perl: 2.0-14
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.1-15
pve-qemu-kvm: 2.9.1-5
pve-container: 2.0-18
pve-firewall: 3.0-5
pve-ha-manager: 2.0-4
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.1-2
lxcfs: 2.0.8-1
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.3-pve1~bpo9

I use this command to launch the migration :

root@guerech:/etc/pve# qm migrate 700 barbetorte --with-local-disks 1 --online

When it failed, i have this result :

drive-virtio0: transferred: 6234832896 bytes remaining: 15240003584 bytes total: 21474836480 bytes progression: 29.03 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6320816128 bytes remaining: 15154020352 bytes total: 21474836480 bytes progression: 29.43 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6407847936 bytes remaining: 15066988544 bytes total: 21474836480 bytes progression: 29.84 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6496976896 bytes remaining: 14977859584 bytes total: 21474836480 bytes progression: 30.25 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6581911552 bytes remaining: 14892924928 bytes total: 21474836480 bytes progression: 30.65 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6668943360 bytes remaining: 14805893120 bytes total: 21474836480 bytes progression: 31.05 % busy: 1 ready: 0
drive-virtio1: transferred: 34361769984 bytes remaining: 0 bytes total: 34361769984 bytes progression: 100.00 % busy: 0 ready: 1
drive-virtio0: transferred: 6753878016 bytes remaining: 14720958464 bytes total: 21474836480 bytes progression: 31.45 % busy: 1 ready: 0
drive-virtio0: Cancelling block job
drive-virtio1: Cancelling block job
drive-virtio1: Done.
drive-virtio0: Done.
2018-01-10 00:13:02 ERROR: online migrate failure - mirroring error: drive-virtio1: mirroring has been cancelled
2018-01-10 00:13:02 aborting phase 2 - cleanup resources
2018-01-10 00:13:02 migrate_cancel
2018-01-10 00:13:08 ERROR: command '/usr/bin/ssh -e none -o 'BatchMode=yes' -o 'HostKeyAlias=barbetorte' root@172.17.0.20 pvesm free VMData:vm-700-disk-2' failed: exit code 5
2018-01-10 00:13:14 ERROR: command '/usr/bin/ssh -e none -o 'BatchMode=yes' -o 'HostKeyAlias=barbetorte' root@172.17.0.20 pvesm free VMData:vm-700-disk-1' failed: exit code 5
2018-01-10 00:13:17 ERROR: migration finished with problems (duration 00:09:49)

The VM that i try to migrate have to local disk.
The conf file of this VM :

root@guerech:/etc/pve/qemu-server# cat 700.conf
boot: cdn
bootdisk: virtio1
cores: 1
ide2: none,media=cdrom
memory: 512
name: morvan
net0: e1000=66:65:64:62:63:31,bridge=vmbr1
net1: e1000=7E:C7:A3:77:56:7D,bridge=vmbr0
numa: 0
onboot: 1
ostype: l26
serial0: socket
smbios1: uuid=bf537cf3-1efa-42d5-9d7f-50b398ad07ed
sockets: 1
virtio0: VMData:vm-700-disk-1,format=raw,size=20G
virtio1: VMData:vm-700-disk-2,format=raw,size=32G

I see on this forum sometimes it can perform live migration with local storage, sometines it's not, i don't know what to think. For example :
https://forum.proxmox.com/threads/live-kvm-migration-without-share-storage.16200/
https://forum.proxmox.com/threads/proxmox-5-0-live-migration-fails.35629/

I don't know where to search or what i need to see.

Can you help me?

Thanks!

 

[gizmo15]

up

 

[aderumier]

Hi,

I just see your message on https://www.frsag.org/pipermail/frsag/2018-January/009207.html,

I have sent patch to fix it recently, and I should be fixed with last proxmox updates

https://git.proxmox.com/?p=qemu-server.git;a=commit;h=87955688fda3f11440b7bc292e22409d22d8112f

 

[gizmo15]

Thanks for the information!

I move our cluster from lvm to qcow2 and live migration works fine.