Ceph Jewel on pve4.4-1

[Leo David]

Hello everyone,
I am tring to install Jewel release on some fresh and updated nodes, but i get this error:

pveceph install --version jewel
400 Parameter verification failed.
version: value 'jewel' does not have a value in the enumeration 'hammer'

I've changed to "deb http://download.proxmox.com/debian jessie pve-no-subscription" in sources.list, but no luck.
What could be the problem ?
Is that because I'm under the free license ?

 

[Leo David]

Solved by folowing this post:
https://forum.proxmox.com/threads/issues-getting-proxmox-4-4-ceph-jewel-running.32053/#post-158736

 

[Leo David]

Hi,
Still having issues with jewel on pve4 install...
I've done as follows:
node 1:
rm /etc/apt/sources.list.d/pve-enterprise.list
echo "deb http://download.ceph.com/debian-jewel jessie main" > /etc/apt/sources.list.d/ceph.list
added "deb http://download.proxmox.com/debian jessie pve-no-subscription: to /etc/apt/sources.list
system update from UI
pveceph init network x.x.x.x
pveceph createmon

node 2:
all previous steps but the pveceph commands

After that, from UI a try to add node2 as second monitor, and it fails with the following error:

"command 'ceph-mon --mkfs -i 1 --monmap /tmp/monmap --keyring /etc/pve/priv/ceph.mon.keyring' failed: open3: exec of ceph-mon --mkfs -i 1 --monmap /tmp/monmap --keyring /etc/pve/priv/ceph.mon.keyring failed at /usr/share/perl5/PVE/Tools.pm line 411."

If i try to deploy mon on another node ( node 3 ) that has not modified repolist ( only fresh install & UI updated ) , it gives me:

"unable to create symlink '/etc/ceph/ceph.conf' - No such file or directory (500"

Do you have any ideea what could be the problem ?
Is there a best practice procedure or a how to for having Jewel running on top of pve4 ?

Thank you !

 

[fabian]

Hi,
Still having issues with jewel on pve4 install...
I've done as follows:
node 1:
rm /etc/apt/sources.list.d/pve-enterprise.list
echo "deb http://download.ceph.com/debian-jewel jessie main" > /etc/apt/sources.list.d/ceph.list
added "deb http://download.proxmox.com/debian jessie pve-no-subscription: to /etc/apt/sources.list
system update from UI
pveceph init network x.x.x.x
pveceph createmon

node 2:
all previous steps but the pveceph commands

After that, from UI a try to add node2 as second monitor, and it fails with the following error:

"command 'ceph-mon --mkfs -i 1 --monmap /tmp/monmap --keyring /etc/pve/priv/ceph.mon.keyring' failed: open3: exec of ceph-mon --mkfs -i 1 --monmap /tmp/monmap --keyring /etc/pve/priv/ceph.mon.keyring failed at /usr/share/perl5/PVE/Tools.pm line 411."

If i try to deploy mon on another node ( node 3 ) that has not modified repolist ( only fresh install & UI updated ) , it gives me:

"unable to create symlink '/etc/ceph/ceph.conf' - No such file or directory (500"

Do you have any ideea what could be the problem ?
Is there a best practice procedure or a how to for having Jewel running on top of pve4 ?

Thank you !

you need to run "pveceph install --version jewel" on all nodes where you want to run local Ceph services (like monitors or OSDs) before creating any service instances on them.

 

[Leo David]

Thank you.
But:
pveceph install --version jewel
400 Parameter verification failed.
version: value 'jewel' does not have a value in the enumeration 'hammer'
pveceph install [OPTIONS]

So what would be the correct order of steps to do from a fresh install of pve4, to have "pveceph install --version jewel" working ?
( modify repolist, updated from UI, update from cli, etc. )

 

[Leo David]

It seems that the following steps are ok after pve4 fresh install:

rm /etc/apt/sources.list.d/pve-enterprise.list
echo "deb http://download.ceph.com/debian-jewel jessie main" > /etc/apt/sources.list.d/ceph.list
echo "deb http://download.proxmox.com/debian jessie pve-no-subscription" >> /etc/apt/sources.list
apt-get update
apt-get dist-upgrade

pveceph install --version jewel

 

[fabian]

Thank you.
But:
pveceph install --version jewel
400 Parameter verification failed.
version: value 'jewel' does not have a value in the enumeration 'hammer'
pveceph install [OPTIONS]

So what would be the correct order of steps to do from a fresh install of pve4, to have "pveceph install --version jewel" working ?
( modify repolist, updated from UI, update from cli, etc. )

update to the current PVE 4.4 packages (see https://pve.proxmox.com/pve-docs/pve-admin-guide.html#sysadmin_package_repositories and https://pve.proxmox.com/pve-docs/pve-admin-guide.html#_system_software_updates), then jewel is available.

 

[Leo David]

Thank you !
Now is running 4.4-13.
We are actually testing 8 pve nodes on an esx environment for the moment. Next, we are planing to do bare-metal deployments, and buy support / repos subcriptions. But i have some worries.
Will a machine that has payed subscription benefit of a more straight-through installation ?
I mean, would it be necesarilly to do those repo changes and updates to get ( for example ) Jewel installed ?

 

[fabian]

Thank you !
Now is running 4.4-13.
We are actually testing 8 pve nodes on an esx environment for the moment. Next, we are planing to do bare-metal deployments, and buy support / repos subcriptions. But i have some worries.
Will a machine that has payed subscription benefit of a more straight-through installation ?
I mean, would it be necesarilly to do those repo changes and updates to get ( for example ) Jewel installed ?

the installer sets up the pve-enterprise repository out of the box. so if you have a subscription, you just need to activate it and install the regular upgrades before starting to set up ceph - no need to change any repository configuration whatsoever.

 

[Leo David]

Thank you. This is great !
We'll need to spec some c6xxx dell's for.
Have a great weekend !