Ceph or Gluster ?

[yakakliker]

New question ...

I am looking for the "perfect solution" (Yes Santa Claus exist ...)

After looking NAS/SAN soluces, i am studiing distributed file system (Ceph & Gluster).

So my question :

What system do you prefer with Proxmox and why ? ... if I can ask ...

 

[tom]

ceph is already implemented and best tested (gluster support is still in planning status)

if you store your VM images on ceph, also live snapshots, live backups, templates and cloning will work in near future.

 

[yakakliker]

ceph is already implemented and best tested (gluster support is still in planning status)

if you store your VM images on ceph, also live snapshots, live backups, templates and cloning will work in near future.

Thanks for answer.

You are right and on my tests, Ceph is relatively simple to install & configure (i have to test more).

Ceph is apparently very used with Openstack but Gluster was acquired by Red Hat and is older than Ceph (less bugs ??? more perfs ???).

So the choice is not simple ...

 

[spirit]

from my test, glusterfs was slower.

But next version (3.4), not yet released, will have a native qemu integration (no fuse), so maybe it'll be faster.

I"ll try to make a proxmox storage plugin when 3.4 will be released.


also rbd have some advantages (snapshots,clones,....)

 

[tarax]

also rbd have some advantages (snapshots,clones,....)

Even with Gluster support in Qemu, aren't they qcow2 images that are stored on the FS ?
If so, couldn't Gluster storage benefit from these formats capabilities ?

Bests

 

[Toshik]

Maybe we should add Sheepdog (in case VM image storage solution) to compare?

 

[spirit]

Even with Gluster support in Qemu, aren't they qcow2 images that are stored on the FS ?
If so, couldn't Gluster storage benefit from these formats capabilities ?

Bests

The qemu gluster plugin (not yet included in proxmox) use gluster as a block storage. (without use fuse).
So no file like raw,qcow2,....

But seem that snapshot is maybe possible, I don't have read to much the documentation , as we need to wait for gluster 3.4 release.

I'll try to make a plugin for proxmox when gluster 3.4 will be released.