Clustered storage status (ceph & sheepdog)

[Jon Auer]

Has there been any progress on integrating ceph or sheepdog for VM storage?

When can we expect to see one of them working in Proxmox VE?

 

[cristianm]

Please add ceph support. Is really easy add rbd support. I use it with openstack and works very well.

 

[dietmar]

That is already in git (Alexandre started that last week).

 

[cristianm]

Thanks! Any idea when will be release? And what storage options will have. Example, attach an rbd volume to a VM.

 

[tom]

Thanks! Any idea when will be release?

basically, everything will be released as soon as its ready for testing, but you can also work with the git (if you are familiar with it).

 

[mlanner]

Very exciting! Looking forward to the first beta release.

 

[spirit]

Hi, you can test try with pvetest repository now.

add a rados block storage to /etc/pve/storage.cfg

rbd: myrbdstorage
monhost X.X.X.X:6789;X.X.X.X:6789;X.X.X.X:6789
pool mypool
username admin
authsupported cephx;none
content images

where monhost are your ceph monitor servers.

you need to copy your ceph.keyring to /etc/pve/priv/ceph/myrbdstorage.keyring , with the name of your storage.

that's all!

you should be able to create images to your ceph cluster and start your vm.

(Note that's only the client side, we don't implement ceph server on proxmox for the moment)

 

[mlanner]

That's great news. I need to find another server to install Proxmox on now in the same data center as my storage machines. I have three older, non-VT, test machines ready for Ceph deployment. Will report back with any progress and/or questions. Thanks for the update.

 

[cristianm]

Perfect. I will test when put in one week aprox a new server. Currently I only have proxmox with vps into production.

 

[cristianm]

I will test it. This support ceph 0.48?

 

[cristianm]

I check. The ceph-common is 0.47.2. Is possible that update to 0.48? Is the major stable release of ceph and change the internal mode of work.

 

[tom]

yes, we will update soon.

 

[cristianm]

Thanks

 

[cristianm]

Is possible use ceph repo to upgrade ceph-common? Are compatible?

 

[spirit]

mmm, you can, but I don't know how it's works, as qemu-kvm was compiled with librbd 0.47.

We'll upgrade to stable 0.48 next week.

 

[cristianm]

Any new about the version 0.48?

 

[spirit]

pve-test repository have been updated to 0.48 last week

https://git.proxmox.com/?p=pve-qemu-kvm.git;a=commit;h=9e06363b5362f4b571f08146e1a044cabe822a4c

 

[cristianm]

I have some issue. I use this tutorial: http://pve.proxmox.com/wiki/Storage:_Ceph but I can´t find the rbd storage when create a VM or check the storages. How I refresh the storage.cfg into the gui?

 

[badji]

Hi,

How many Discs have you used on each server? 5 Discs storage to do RAID5?

Good luck for the future, this is a good cluster storage.

Merci beaucoup.

 

[dietmar]

I have some issue. I use this tutorial: http://pve.proxmox.com/wiki/Storage:_Ceph but I can´t find the rbd storage when create a VM or check the storages.

What is the output of

# pvesm status

Is the storage in that list?