Proxmox Cluster Migration error

A

Ajith

New Member
Mar 23, 2017
6
0
1
44
Hi,

We have done new setup with 3 hosts HA Cluster, We are doing migration from Host1 to Host2/Host3, its showing error

Offline Migration Issue:
When we do offline migration its migrating to other Host, but while starting VM in other Host its getting below error "TASK ERROR: volume 'OVI10:251/vm-251-disk-1.qcow2' does not exist"
Code: 
root@SRV1:~# cat /etc/pve/qemu-server/251.conf
bootdisk: scsi0
cores: 1
ide2: OVI10:iso/CentOS-7-x86_64-Minimal-1503-01.iso,media=cdrom
memory: 20000
net0: e1000=72:A2:E7:5E:79:F5,bridge=vmbr0
numa: 0
ostype: l26
scsi0: OVI10:251/vm-251-disk-1.qcow2,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=2539c7de-d114-4346-9070-22cfe78804a8
sockets: 1

Online Migration Issue:
Code: 
Mar 23 12:05:18 starting migration of VM 251 to node 'SRV2' (xxxxxxx)
Mar 23 12:05:18 copying disk images
Mar 23 12:05:18 starting VM 251 on remote node 'SRV2'
Mar 23 12:05:19 volume 'OVI10:251/vm-251-disk-1.qcow2' does not exist
Mar 23 12:05:19 ERROR: online migrate failure - command '/usr/bin/ssh -o 'BatchMode=yes' root@xxxxxx qm start 251 --skiplock --migratedfrom SRV1 --migration_type secure --stateuri unix --machine pc-i440fx-2.7' failed: exit code 255
Mar 23 12:05:19 aborting phase 2 - cleanup resources
Mar 23 12:05:19 migrate_cancel
Mar 23 12:05:19 ERROR: migration finished with problems (duration 00:00:01)
TASK ERROR: migration problems

We are using same pveversion in all the hosts and also ISO and DISK image is under shared storage
 
please also include the output of "pveversion -v" and the storage configuration ("/etc/pve/storage.cfg")
 
Ajith said:
Hi,

We have done new setup with 3 hosts HA Cluster, We are doing migration from Host1 to Host2/Host3, its showing error

Offline Migration Issue:
When we do offline migration its migrating to other Host, but while starting VM in other Host its getting below error "TASK ERROR: volume 'OVI10:251/vm-251-disk-1.qcow2' does not exist"
Code: 
root@SRV1:~# cat /etc/pve/qemu-server/251.conf
bootdisk: scsi0
cores: 1
ide2: OVI10:iso/CentOS-7-x86_64-Minimal-1503-01.iso,media=cdrom
memory: 20000
net0: e1000=72:A2:E7:5E:79:F5,bridge=vmbr0
numa: 0
ostype: l26
scsi0: OVI10:251/vm-251-disk-1.qcow2,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=2539c7de-d114-4346-9070-22cfe78804a8
sockets: 1

Online Migration Issue:
Code: 
Mar 23 12:05:18 starting migration of VM 251 to node 'SRV2' (xxxxxxx)
Mar 23 12:05:18 copying disk images
Mar 23 12:05:18 starting VM 251 on remote node 'SRV2'
Mar 23 12:05:19 volume 'OVI10:251/vm-251-disk-1.qcow2' does not exist
Mar 23 12:05:19 ERROR: online migrate failure - command '/usr/bin/ssh -o 'BatchMode=yes' root@xxxxxx qm start 251 --skiplock --migratedfrom SRV1 --migration_type secure --stateuri unix --machine pc-i440fx-2.7' failed: exit code 255
Mar 23 12:05:19 aborting phase 2 - cleanup resources
Mar 23 12:05:19 migrate_cancel
Mar 23 12:05:19 ERROR: migration finished with problems (duration 00:00:01)
TASK ERROR: migration problems

We are using same pveversion in all the hosts and also ISO and DISK image is under shared storage
Click to expand...
Hi,
looks that you marked the storage OVI10 as shared, but on the destination-node the storage don't excist (or an simple non-shared one).

Udo
 
Hi,
Storage is shared storage and its configured all the hosts, pls check storage and pverversion below

Host 1 Storage Config
Code: 
root@SRV1:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        shared 1
        content iso,backup,vztmpl
        maxfiles 1

lvmthin: local-lvm
        vgname pve
        thinpool data
        content rootdir,images

dir: OVI10
        path /var/lib/vz/data_ovi
        shared 1
        nodes SRV1,SRV3,SRV2
        content iso,images
        maxfiles 1

Host1 Pve version

Code: 
proxmox-ve: 4.4-82 (running kernel: 4.4.40-1-pve)
pve-manager: 4.4-12 (running version: 4.4-12/e71b7a74)
pve-kernel-4.4.35-1-pve: 4.4.35-77
pve-kernel-4.4.40-1-pve: 4.4.40-82
lvm2: 2.02.116-pve3
corosync-pve: 2.4.2-1
libqb0: 1.0-1
pve-cluster: 4.0-48
qemu-server: 4.0-109
pve-firmware: 1.1-10
libpve-common-perl: 4.0-92
libpve-access-control: 4.0-23
libpve-storage-perl: 4.0-76
pve-libspice-server1: 0.12.8-2
vncterm: 1.3-1
pve-docs: 4.4-3
pve-qemu-kvm: 2.7.1-4
pve-container: 1.0-94
pve-firewall: 2.0-33
pve-ha-manager: 1.0-40
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u3
lxc-pve: 2.0.7-3
lxcfs: 2.0.6-pve1
criu: 1.6.0-1
novnc-pve: 0.5-8
smartmontools: 6.5+svn4324-1~pve80
zfsutils: 0.6.5.9-pve15~bpo80
Host 2 Storage Config
Code: 
root@SRV2:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        shared 1
        content iso,backup,vztmpl
        maxfiles 1

lvmthin: local-lvm
        vgname pve
        thinpool data
        content rootdir,images

dir: OVI10
        path /var/lib/vz/data_ovi
        shared 1
        nodes SRV1,SRV3,SRV2
        content iso,images
        maxfiles 1

Host 2 Pve Version
Code: 
proxmox-ve: 4.4-82 (running kernel: 4.4.40-1-pve)
pve-manager: 4.4-12 (running version: 4.4-12/e71b7a74)
pve-kernel-4.4.35-1-pve: 4.4.35-77
pve-kernel-4.4.40-1-pve: 4.4.40-82
lvm2: 2.02.116-pve3
corosync-pve: 2.4.2-1
libqb0: 1.0-1
pve-cluster: 4.0-48
qemu-server: 4.0-109
pve-firmware: 1.1-10
libpve-common-perl: 4.0-92
libpve-access-control: 4.0-23
libpve-storage-perl: 4.0-76
pve-libspice-server1: 0.12.8-2
vncterm: 1.3-1
pve-docs: 4.4-3
pve-qemu-kvm: 2.7.1-4
pve-container: 1.0-94
pve-firewall: 2.0-33
pve-ha-manager: 1.0-40
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u3
lxc-pve: 2.0.7-3
lxcfs: 2.0.6-pve1
criu: 1.6.0-1
novnc-pve: 0.5-8
smartmontools: 6.5+svn4324-1~pve80
zfsutils: 0.6.5.9-pve15~bpo80
 
We have mounted /var/lib/vz/data_ovi as a seperate drive in SAN volume group and its shared storage for all the three hosts
 
Hi dietmar,

Mounted with ext4 file system in SAN LUN. Once VM created in host1, in host2 vm disk file not showing in Host2 ==> Storage ==> Content . After remounting the shared storage partition from Host2 Vm disk file is showing in Host2 ==> Storage ==> Content.

VM disk file is not populating automatically to all the Hosts
 
Mounted with ext4 file system in SAN LUN. Once VM created in host1, in host2 vm disk file not showing in Host2 ==> Storage ==> Content . After remounting the shared storage LUN partition from Host2 Vm disk file is showing in Host2 ==> Storage ==> Content.

VM disk file is not populating automatically to all the Hosts. We are using Multipath concept
 
ext4 is not a cluster file system.
 
  • Like
Reactions: Ajith
Ext4 is not a shared file system, so you can mount it only once. But it will lead to data loss if you mount the same share on multiple hosts using ext4 (never do that).
 
  • Like
Reactions: Ajith
Thank you. Please suggest me a way to configure SAN storage in cluster. Our main objective is to provide VM's to our customer on high availability, pls suggest us how do we connect storage to the proxmox servers. (We are setting up 4 node clusters with FC SAN storage)
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back