1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Live migration on local shared storage

Discussion in 'Proxmox VE: Installation and configuration' started by Leo David, May 17, 2017 at 10:45.

  1. Leo David

    Leo David New Member

    Joined:
    Apr 25, 2017
    Messages:
    22
    Likes Received:
    0
    Hi,
    I've configured a 3 bare-metal nodes cluster, and regarding storage each of one is configured with a separated ssd LVM named "data".
    I've added then Datacenter LVM volume "ssd-data", based on LVM name "data", shared, enabled, no restrictions.
    Created a VM, alocated a disk on "ssd-data" storage on node1. So far , so good.
    The problem comes when a try to migrate the vm to node2, it sais:
    "TASK ERROR: can't activate LV '/dev/data/vm-100-disk-2': Failed to find logical volume "data/vm-100-disk-2"
    Is it possible to live migrate vm's or lxc's ( manual or ha mode ) between nodes on nodes' local shared storages ?
     
  2. dietmar

    dietmar Proxmox Staff Member
    Staff Member

    Joined:
    Apr 28, 2005
    Messages:
    15,030
    Likes Received:
    142
    The 'shared' flag is a flag to indicate that the storage is shared. It makes no sense to set that on a local storage.
     
  3. Leo David

    Leo David New Member

    Joined:
    Apr 25, 2017
    Messages:
    22
    Likes Received:
    0
    Ok.
    So un-sharing local storage will permit migration ?
    The problem is that with local storage unshared, it seems i cannot clone vm's between nodes anymore.
    Is there a best practice for migration / clonning regarding storage configuration and type ( shared/unshared ) ?
     
  4. dietmar

    dietmar Proxmox Staff Member
    Staff Member

    Joined:
    Apr 28, 2005
    Messages:
    15,030
    Likes Received:
    142
    You need to use a real shared storage for that.
     
  5. Leo David

    Leo David New Member

    Joined:
    Apr 25, 2017
    Messages:
    22
    Likes Received:
    0
    Thank you,
    So the best way to have full clonning & migration capabilities is to have attached to Proxmox cluster a "shared" network storage. Either NFS, Gluster, Ceph, and so on...
     
  6. jim.bond.9862

    jim.bond.9862 Member

    Joined:
    Apr 17, 2015
    Messages:
    69
    Likes Received:
    1
    can't he use DRDB + Ceph or GlusterFS or NFS ?
    I know that DRDB is not part of VE4 but still can be installed.
     
  7. Leo David

    Leo David New Member

    Joined:
    Apr 25, 2017
    Messages:
    22
    Likes Received:
    0
    I don't necesarilly need to stick to local storage. Just need to know recommended storage type configuration that permits ha, migration, clonning. I have to build-up a proxmox based project for production needs ( considering subscriptions of course ).
    Meanwhile, I configured an external ceph storage, it seems to work pretty good for existing vm's.
    Just need to know if local storage ( shared/not shared ) is suitable for ha, migration, clonning.
     
  8. jim.bond.9862

    jim.bond.9862 Member

    Joined:
    Apr 17, 2015
    Messages:
    69
    Likes Received:
    1
    from everything i have read so far, using local storage for HA, while possible with some extra steps, is not recommended and has it's issues. definitely not recommended for Production use if you can avoid it.
    I am running a windows Hyper-V cluster on 2 nodes with local storage but I really had no choice in the matter.
     
  9. Leo David

    Leo David New Member

    Joined:
    Apr 25, 2017
    Messages:
    22
    Likes Received:
    0
    Thank you. Yes, makes sense to have non-local shared storage ( including ceph on proxmox ) for these features.
    I'll stick on ceph for a while though...:)
     
  10. Leo David

    Leo David New Member

    Joined:
    Apr 25, 2017
    Messages:
    22
    Likes Received:
    0
    Hi,
    Using an external Ceph storage, live migration works like a charm.
    However, I dont'really understand why HA feature requires a vm reboot, and is not acting like a automatic live migration, without any downtime of vm's provided services.
    In my case, it takes about 2-3 minutes until the auto-migrated vm starts from the moment a disconnect one pve node from the cluster.
    Is it possible ? To have HA doing an automatic live migration ?
    Thank you,
    Have a nice weekend !
     
  11. spirit

    spirit Well-Known Member
    Proxmox VE Subscriber

    Joined:
    Apr 2, 2010
    Messages:
    2,942
    Likes Received:
    69
    That's would require some kind of continous memory replication between hosts, to have fault tolerance HA.
    qemu have added support for this recently (2.9), some features are still pending for qemu 2.10.
    it's not yet implement in proxmox.


    https://github.com/qemu/qemu/blob/master/docs/COLO-FT.txt
     

Share This Page