[SOLVED] Fresh install not able to install ceph-cluster

[moep90]

That does not make any difference unfortunalty....
@fresh installed proxmox 5.0

when using:
https://pve.proxmox.com/wiki/Ceph_Server

cat /etc/*release
PRETTY_NAME="Debian GNU/Linux 9 (stretch)"
NAME="Debian GNU/Linux"
VERSION_ID="9"
VERSION="9 (stretch)"
ID=debian
[..]

pveversion -v
proxmox-ve: 5.0-15 (running kernel: 4.10.15-1-pve)
pve-manager: 5.0-23 (running version: 5.0-23/af4267bf)
pve-kernel-4.10.15-1-pve: 4.10.15-15
libpve-http-server-perl: 2.0-5
lvm2: 2.02.168-pve2
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-10
qemu-server: 5.0-12
pve-firmware: 2.0-2
libpve-common-perl: 5.0-16
libpve-guest-common-perl: 2.0-11
libpve-access-control: 5.0-5
libpve-storage-perl: 5.0-12
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-2
pve-docs: 5.0-6
pve-qemu-kvm: 2.9.0-2
pve-container: 2.0-14
pve-firewall: 3.0-1
pve-ha-manager: 2.0-2
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.0.8-3
lxcfs: 2.0.7-pve2
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.6.5.9-pve16~bpo90

ls -lsah /etc/apt/sources.list.d/
total 12K
4.0K drwxr-xr-x 2 root root 4.0K Aug 11 14:13 .
4.0K drwxr-xr-x 6 root root 4.0K Aug 11 14:13 ..
4.0K -rw-r--r-- 1 root root   69 Jul  4 11:50 pve-enterprise.list

apt-get update ; apt-get upgrade ; pveceph install --version jewel
[...]
Reading package lists... Done
Building dependency tree
Reading state information... Done
Calculating upgrade... Done
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
400 Parameter verification failed.
version: value 'jewel' does not have a value in the enumeration 'luminous'
pveceph install  [OPTIONS]

 

[fabian]

there is no Jewel support in PVE 5.0 - only Luminous, which is currently a technology preview. also, you are not running current packages, probably because you haven't setup your package repositories correctly: https://pve.proxmox.com/pve-docs/pve-admin-guide.html#sysadmin_package_repositories

 

[moep90]

there is no Jewel support in PVE 5.0 - only Luminous, which is currently a technology preview. also, you are not running current packages, probably because you haven't setup your package repositories correctly: https://pve.proxmox.com/pve-docs/pve-admin-guide.html#sysadmin_package_repositories

This is not the case, it is a fresh install.

So it is not possible to run ceph with proxmox 5.0 you say?

cat /etc/apt/sources.list
deb [url for debain mirror] stretch main contrib

# security updates
deb [url for debain mirror] stretch/updates main contrib


cat /etc/apt/sources.list.d/pve-enterprise.list
deb https://enterprise.proxmox.com/debian/pve stretch pve-enterprise

 

[fabian]

This is not the case, it is a fresh install.

So it is not possible to run ceph with proxmox 5.0 you say?

It is possible to test Ceph with PVE 5.0, but only Ceph Luminous, not Ceph Jewel. You are attempting to install Ceph Jewel. Once Ceph Luminous is stable enough, it will be fully supported in PVE 5.0.

cat /etc/apt/sources.list
deb [url for debain mirror] stretch main contrib

# security updates
deb [url for debain mirror] stretch/updates main contrib


cat /etc/apt/sources.list.d/pve-enterprise.list
deb https://enterprise.proxmox.com/debian/pve stretch pve-enterprise

the enterprise repository only works with a subscription key - if you don't have a subscription, you need to use the pve-no-subscription repository.

 

[moep90]

Okay, fair enough.
I replaced the enterprise repo with the non-sub-repo.

Now I did it try to install ceph as described in your youtube video, which uses jewel btw on proxmox 5.0

The video is called... :
Install Ceph Server on Proxmox VE

pveceph install --version luminous
pveceph init --network <public network>/24

# public-network is the same as the cluster network because I dont have another one for date atm

As you see, there is no manager active which should provide me the ability to add OSD'S

ceph status
  cluster:
    id:     dfb89daf-2b66-4ed8-b667-d5db7ded93e3
    health: HEALTH_OK

  services:
    mon: 3 daemons, quorum 0,1,2
    mgr: no daemons active
    osd: 0 osds: 0 up, 0 in

  data:
    pools:   0 pools, 0 pgs
    objects: 0 objects, 0 bytes
    usage:   0 kB used, 0 kB / 0 kB avail
    pgs:

 

[tom]

If you run current 5.0, ceph mgr should be created together with the monitors.

If you have already monitors created before you upgraded to latest version, you need to create the manager manually on each monitor node.

> pveceph createmgr

 

[moep90]

If you run current 5.0, ceph mgr should be created together with the monitors.

If you have already monitors created before you upgraded to latest version, you need to create the manager manually on each monitor node.

> pveceph createmgr

This was the last thing I missed. Couldnt find it in the documentation though.

pveceph createmgr

Thanks guys, have a nice weekend! Cheers

 

[tom]

This was the last thing I missed. Couldnt find it in the documentation though.

pveceph createmgr

Thanks guys, have a nice weekend! Cheers

thanks for feedback and yes, this is quite new and we will improve documentation next week.