Proxmox Cluster Migration error

Ajith

New Member
Mar 23, 2017
6
0
1
39
Hi,

We have done new setup with 3 hosts HA Cluster, We are doing migration from Host1 to Host2/Host3, its showing error

Offline Migration Issue:

When we do offline migration its migrating to other Host, but while starting VM in other Host its getting below error "TASK ERROR: volume 'OVI10:251/vm-251-disk-1.qcow2' does not exist"
Code:
root@SRV1:~# cat /etc/pve/qemu-server/251.conf
bootdisk: scsi0
cores: 1
ide2: OVI10:iso/CentOS-7-x86_64-Minimal-1503-01.iso,media=cdrom
memory: 20000
net0: e1000=72:A2:E7:5E:79:F5,bridge=vmbr0
numa: 0
ostype: l26
scsi0: OVI10:251/vm-251-disk-1.qcow2,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=2539c7de-d114-4346-9070-22cfe78804a8
sockets: 1
Online Migration Issue:
Code:
Mar 23 12:05:18 starting migration of VM 251 to node 'SRV2' (xxxxxxx)
Mar 23 12:05:18 copying disk images
Mar 23 12:05:18 starting VM 251 on remote node 'SRV2'
Mar 23 12:05:19 volume 'OVI10:251/vm-251-disk-1.qcow2' does not exist
Mar 23 12:05:19 ERROR: online migrate failure - command '/usr/bin/ssh -o 'BatchMode=yes' root@xxxxxx qm start 251 --skiplock --migratedfrom SRV1 --migration_type secure --stateuri unix --machine pc-i440fx-2.7' failed: exit code 255
Mar 23 12:05:19 aborting phase 2 - cleanup resources
Mar 23 12:05:19 migrate_cancel
Mar 23 12:05:19 ERROR: migration finished with problems (duration 00:00:01)
TASK ERROR: migration problems
We are using same pveversion in all the hosts and also ISO and DISK image is under shared storage
 

fabian

Proxmox Staff Member
Staff member
Jan 7, 2016
3,702
569
133
please also include the output of "pveversion -v" and the storage configuration ("/etc/pve/storage.cfg")
 

udo

Famous Member
Apr 22, 2009
5,879
163
83
Ahrensburg; Germany
Hi,

We have done new setup with 3 hosts HA Cluster, We are doing migration from Host1 to Host2/Host3, its showing error

Offline Migration Issue:

When we do offline migration its migrating to other Host, but while starting VM in other Host its getting below error "TASK ERROR: volume 'OVI10:251/vm-251-disk-1.qcow2' does not exist"
Code:
root@SRV1:~# cat /etc/pve/qemu-server/251.conf
bootdisk: scsi0
cores: 1
ide2: OVI10:iso/CentOS-7-x86_64-Minimal-1503-01.iso,media=cdrom
memory: 20000
net0: e1000=72:A2:E7:5E:79:F5,bridge=vmbr0
numa: 0
ostype: l26
scsi0: OVI10:251/vm-251-disk-1.qcow2,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=2539c7de-d114-4346-9070-22cfe78804a8
sockets: 1
Online Migration Issue:
Code:
Mar 23 12:05:18 starting migration of VM 251 to node 'SRV2' (xxxxxxx)
Mar 23 12:05:18 copying disk images
Mar 23 12:05:18 starting VM 251 on remote node 'SRV2'
Mar 23 12:05:19 volume 'OVI10:251/vm-251-disk-1.qcow2' does not exist
Mar 23 12:05:19 ERROR: online migrate failure - command '/usr/bin/ssh -o 'BatchMode=yes' root@xxxxxx qm start 251 --skiplock --migratedfrom SRV1 --migration_type secure --stateuri unix --machine pc-i440fx-2.7' failed: exit code 255
Mar 23 12:05:19 aborting phase 2 - cleanup resources
Mar 23 12:05:19 migrate_cancel
Mar 23 12:05:19 ERROR: migration finished with problems (duration 00:00:01)
TASK ERROR: migration problems
We are using same pveversion in all the hosts and also ISO and DISK image is under shared storage
Hi,
looks that you marked the storage OVI10 as shared, but on the destination-node the storage don't excist (or an simple non-shared one).

Udo
 

Ajith

New Member
Mar 23, 2017
6
0
1
39
Hi,
Storage is shared storage and its configured all the hosts, pls check storage and pverversion below

Host 1 Storage Config
Code:
root@SRV1:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        shared 1
        content iso,backup,vztmpl
        maxfiles 1

lvmthin: local-lvm
        vgname pve
        thinpool data
        content rootdir,images

dir: OVI10
        path /var/lib/vz/data_ovi
        shared 1
        nodes SRV1,SRV3,SRV2
        content iso,images
        maxfiles 1
Host1 Pve version

Code:
proxmox-ve: 4.4-82 (running kernel: 4.4.40-1-pve)
pve-manager: 4.4-12 (running version: 4.4-12/e71b7a74)
pve-kernel-4.4.35-1-pve: 4.4.35-77
pve-kernel-4.4.40-1-pve: 4.4.40-82
lvm2: 2.02.116-pve3
corosync-pve: 2.4.2-1
libqb0: 1.0-1
pve-cluster: 4.0-48
qemu-server: 4.0-109
pve-firmware: 1.1-10
libpve-common-perl: 4.0-92
libpve-access-control: 4.0-23
libpve-storage-perl: 4.0-76
pve-libspice-server1: 0.12.8-2
vncterm: 1.3-1
pve-docs: 4.4-3
pve-qemu-kvm: 2.7.1-4
pve-container: 1.0-94
pve-firewall: 2.0-33
pve-ha-manager: 1.0-40
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u3
lxc-pve: 2.0.7-3
lxcfs: 2.0.6-pve1
criu: 1.6.0-1
novnc-pve: 0.5-8
smartmontools: 6.5+svn4324-1~pve80
zfsutils: 0.6.5.9-pve15~bpo80
Host 2 Storage Config
Code:
root@SRV2:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        shared 1
        content iso,backup,vztmpl
        maxfiles 1

lvmthin: local-lvm
        vgname pve
        thinpool data
        content rootdir,images

dir: OVI10
        path /var/lib/vz/data_ovi
        shared 1
        nodes SRV1,SRV3,SRV2
        content iso,images
        maxfiles 1
Host 2 Pve Version
Code:
proxmox-ve: 4.4-82 (running kernel: 4.4.40-1-pve)
pve-manager: 4.4-12 (running version: 4.4-12/e71b7a74)
pve-kernel-4.4.35-1-pve: 4.4.35-77
pve-kernel-4.4.40-1-pve: 4.4.40-82
lvm2: 2.02.116-pve3
corosync-pve: 2.4.2-1
libqb0: 1.0-1
pve-cluster: 4.0-48
qemu-server: 4.0-109
pve-firmware: 1.1-10
libpve-common-perl: 4.0-92
libpve-access-control: 4.0-23
libpve-storage-perl: 4.0-76
pve-libspice-server1: 0.12.8-2
vncterm: 1.3-1
pve-docs: 4.4-3
pve-qemu-kvm: 2.7.1-4
pve-container: 1.0-94
pve-firewall: 2.0-33
pve-ha-manager: 1.0-40
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u3
lxc-pve: 2.0.7-3
lxcfs: 2.0.6-pve1
criu: 1.6.0-1
novnc-pve: 0.5-8
smartmontools: 6.5+svn4324-1~pve80
zfsutils: 0.6.5.9-pve15~bpo80
 

Ajith

New Member
Mar 23, 2017
6
0
1
39
We have mounted /var/lib/vz/data_ovi as a seperate drive in SAN volume group and its shared storage for all the three hosts
 

Ajith

New Member
Mar 23, 2017
6
0
1
39
Hi dietmar,

Mounted with ext4 file system in SAN LUN. Once VM created in host1, in host2 vm disk file not showing in Host2 ==> Storage ==> Content . After remounting the shared storage partition from Host2 Vm disk file is showing in Host2 ==> Storage ==> Content.

VM disk file is not populating automatically to all the Hosts
 

Ajith

New Member
Mar 23, 2017
6
0
1
39
Mounted with ext4 file system in SAN LUN. Once VM created in host1, in host2 vm disk file not showing in Host2 ==> Storage ==> Content . After remounting the shared storage LUN partition from Host2 Vm disk file is showing in Host2 ==> Storage ==> Content.

VM disk file is not populating automatically to all the Hosts. We are using Multipath concept
 

fabian

Proxmox Staff Member
Staff member
Jan 7, 2016
3,702
569
133
ext4 is not a cluster file system.
 
  • Like
Reactions: Ajith

dietmar

Proxmox Staff Member
Staff member
Apr 28, 2005
16,597
338
103
Austria
www.proxmox.com
Ext4 is not a shared file system, so you can mount it only once. But it will lead to data loss if you mount the same share on multiple hosts using ext4 (never do that).
 
  • Like
Reactions: Ajith

Ajith

New Member
Mar 23, 2017
6
0
1
39
Thank you. Please suggest me a way to configure SAN storage in cluster. Our main objective is to provide VM's to our customer on high availability, pls suggest us how do we connect storage to the proxmox servers. (We are setting up 4 node clusters with FC SAN storage)
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE and Proxmox Mail Gateway. We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!