Ceph plans for Proxmox 4.2

[LasseKongo]

Hi,

What are the plans regarding Ceph version in Proxmox 4.2 ? I currently use an external Ceph cluster based on the Hammer release, but I would like to upgrade to Jewel as soon as it is released. To use all the features, I guess the Ceph version on my Proxmox servers should be the same. Jewel seems to be really close to a stable release now, 10.1.0 was released yesterday.

Is there a chance that Jewel will end up in Proxmox 4.2, or is it too late in the release cycle ?

 

[dietmar]

Is there a chance that Jewel will end up in Proxmox 4.2, or is it too late in the release cycle ?

IMHO it is too late for 4.2.

 

[LasseKongo]

IMHO it is too late for 4.2.

Thanks for the response, guess 4.2 will be Hammer based then, as Infernalis is a non LTS release.
Anyway, good to know, should probably hold back on my cluster upgrade for a while.

 

[PigLover]

That's really too bad. Jewel brings a usable CephFS - and that's potentially huge.

 

[tom]

That's really too bad. Jewel brings a usable CephFS - and that's potentially huge.

AFAIK Jewel is not yet released. As soon as its stable, we start testing and integration.

 

[spirit]

You can add jewel repos if you want, they are no api change, so it'll work out of the box with current proxmox code.

The only thing we need to be carefull, is that daemons don't run with root user anymore, but ceph user.
So a chmod need to be done on osd files, before restarting daemons.

 

[PigLover]

AFAIK Jewel is not yet released. As soon as its stable, we start testing and integration.

Fair play to that. Jewel is close to release - but I imagine Proxmox 4.2 is closer so it won't make the cut. That is disappointing but understandable.

You can add jewel repos if you want, they are no api change, so it'll work out of the box with current proxmox code.

The only thing we need to be carefull, is that daemons don't run with root user anymore, but ceph user.
So a chmod need to be done on osd files, before restarting daemons.

I gave that a shot with Infernalis but was never successful getting the permissions right so that things would launch.

May try it again with Jewel. Thanks.

 

[PigLover]

I know its probably too late to make it into 4.2, but FYI:

http://ceph.com/releases/v10-2-0-jewel-released/

 

[wosp]

I also like the new features in Jewel, but I really hope Proxmox VE wait at least until PVE 4.3 or later before it starts using Jewel. There's nothing wrong with a conservative policy for this kind of major updates. Especially within enterprise products like PVE is. If you are not on a production envoirement you can test yourself like @spirit wrote. Anything in production should wait a bit longer before starting to use Jewel, I think.

 

[spirit]

I'm begin to test jewel with proxmox.
For the client, no problem, it's working fine. (volume create/snapshot/clone ).

Just be careful with lxc / krbd, by default jewel use new features for rbd volume creation, incompatible with krbd. (workaround is to add a config in ceph.conf, to disable theses new features).

For ceph-server on proxmox, they use now systemd by default, so some minor changes need to be done in proxmox api for starting mon & osd

 

[spirit]

Hi,

here some news :

current debian ceph jewel packages are buggy, they are missing files for systemd and also small minors bugs in packaging.
So please wait before install.

 

[pixel]

If we already have a ceph cluster running jewel, is it possible to use it with proxmox without breaking your future plans?

theres no /etc/ceph directory, or ceph.conf anywhere, so where are these things set?

i tried installing jewel from cephs repository, and it worked just fine for both kvm and lxc on my test cluster. even tried migration and failover. but, i dont want to break proxmox when you do update to jewel. we have a support contract, and dont want to break that either.

 

[chrone]

AFAIK Jewel is not yet released. As soon as its stable, we start testing and integration.

Looking forward to have CephFS integration either for running VMs/CTs, storing backup, storing templates, or whatsoever.

If we already have a ceph cluster running jewel, is it possible to use it with proxmox without breaking your future plans?

theres no /etc/ceph directory, or ceph.conf anywhere, so where are these things set?

i tried installing jewel from cephs repository, and it worked just fine for both kvm and lxc on my test cluster. even tried migration and failover. but, i dont want to break proxmox when you do update to jewel. we have a support contract, and dont want to break that either.

Yes, you can use running Jewel in Proxmox. We use it ourselves.

Just copy your ceph authentication to Proxmox, or create a limited user for Proxmox with read and write privileges to RBD pool. Look for the Authentication section in this following wiki: https://pve.proxmox.com/wiki/Storage:_Ceph

Hope this helps.