Storage "local" and "local-zfs"

Discussion in 'Proxmox VE: Installation and configuration' started by metainformatica, Jan 8, 2017.

  1. metainformatica

    metainformatica New Member

    Joined:
    Oct 18, 2011
    Messages:
    9
    Likes Received:
    0
    Hi all!!

    I installed proxmox 4.4 on HP DL380 G7 server 2x cpu X5670, 72 GB ram, p410 controller, 2 hdd Wd red 1TB.
    Before installation I create single disk RAID-0 volumes, not JBOD because p410 controller not support it.
    During installation process I chose "zfs (RAID0)" in "target disk options",.

    After installation I see 2 storage: "local" and "local-zfs" (see image below), can you help me to understand?

    maybe a problem with single disk RAID-0 configuration?
    Is better to use a dedicated HBA/JBOD controller?

    Thanks
    Marco

    upload_2017-1-8_11-16-41.png


    upload_2017-1-8_11-21-53.png

    upload_2017-1-8_11-19-50.png

    upload_2017-1-8_11-22-54.png
     
  2. dietmar

    dietmar Proxmox Staff Member
    Staff Member

    Joined:
    Apr 28, 2005
    Messages:
    16,484
    Likes Received:
    314
    This is expected behavior (what is the problem?).

    Besides, using RAID0 for zfs is not recommended, so I would suggest to use simple BOD controller.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  3. metainformatica

    metainformatica New Member

    Joined:
    Oct 18, 2011
    Messages:
    9
    Likes Received:
    0
    First of all many thanks for your answer!

    I would understand why I see 2 local storage on the same level... which one I have to use?

    I never used ZFS and I would like to learn the basics.. where can I find information or manual?
    can you suggest me?

    there will be training courses in Italy in the near future??

    thank you again

    Marco
     
  4. dietmar

    dietmar Proxmox Staff Member
    Staff Member

    Joined:
    Apr 28, 2005
    Messages:
    16,484
    Likes Received:
    314
    local: file-level storage - you can upload iso images and place backups there.

    local-zfs: this is used to store VM images.

    Note: Both resides on the same zfs pool.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
    joshin likes this.
  5. metainformatica

    metainformatica New Member

    Joined:
    Oct 18, 2011
    Messages:
    9
    Likes Received:
    0
    in local storage I see usage 4,84GB of 877GB..
    in local-zfs storage I see 12,68GB of 885GB..
    as if they where 2 separated hard drives!!


    upload_2017-1-8_19-22-27.png


    upload_2017-1-8_19-22-49.png
     
  6. LnxBil

    LnxBil Well-Known Member

    Joined:
    Feb 21, 2015
    Messages:
    3,937
    Likes Received:
    365
    Please post the output of

    Code:
    zfs list
    and we'll explain what you see. For further ZFS information, the manpage is really, really good. Manpage of zpool and zfs.
     
  7. metainformatica

    metainformatica New Member

    Joined:
    Oct 18, 2011
    Messages:
    9
    Likes Received:
    0
    upload_2017-1-8_22-26-8.png

    thank you again
     
  8. LnxBil

    LnxBil Well-Known Member

    Joined:
    Feb 21, 2015
    Messages:
    3,937
    Likes Received:
    365
    I'd say that different values are from the compression and the fill grade of your system.
     
  9. vkhera

    vkhera Member
    Proxmox Subscriber

    Joined:
    Feb 24, 2015
    Messages:
    192
    Likes Received:
    12
    As your screenshots show, the "local" is a directory. It just happens to live on a ZFS file system.

    Your "local-zfs" is a ZFS storage, which means that when you create a disk, it will create a ZFS volume to store the raw data. This is the most efficient storage you can have for this purpose, and you can use ZFS feature individually on each such volume (such as setting compression, snapshots and zfs send/receive to copy them, etc.) You see your vm-100 disk is built this way.

    Because it is a separate ZFS object, its storage is reported differently from the zfs file system.
     
  10. metainformatica

    metainformatica New Member

    Joined:
    Oct 18, 2011
    Messages:
    9
    Likes Received:
    0
    thank you vkhera
     
  11. Uni211

    Uni211 New Member

    Joined:
    May 11, 2017
    Messages:
    2
    Likes Received:
    0
    How can I find the image that is on local-zfs?
    I want to replace it for the new image.
     
  12. Uni211

    Uni211 New Member

    Joined:
    May 11, 2017
    Messages:
    2
    Likes Received:
    0
    No one knows?
     
  13. eiger3970

    eiger3970 Member

    Joined:
    Sep 9, 2012
    Messages:
    234
    Likes Received:
    1
    Without zfs, the VM.iso image is in /var/lib/vz/template/iso.
    With zfs, I can't find VM.iso myself?
     
  14. ckhung

    ckhung New Member

    Joined:
    Jan 26, 2018
    Messages:
    1
    Likes Received:
    1
    The iso images are in /var/lib/vz/template/iso/

    As for the installed system, it lives in a block device, not in a qemu image file (If you chose local-zfs when installing the vm),
    For example, in my system "zfs list" shows "rpool/data/vm-207-disk-1" among other things.
    So the device file for my vm#207 is /dev/zvol/rpool/data/vm-207-disk-1
    and I can mount it to look into it.

    I am not a zfs expert but this picture from my blog may help you get started. zfs.png
    If you wan to learn systematically, Aaron Toponce has a series of articles about zfs on linux.
    (Sorry I am not allowed to post links yet.)
     
    timlok likes this.
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice