Initial ceph setup error

serkem

Member
Jun 2, 2021
1
0
6
22
Hello everyone,

I currently have a problem with the initial setup of Ceph. I'm trying to install Ceph on a freshly set up test cluster using the GUI. There are no errors during the installation, but when PVE tries to create a manager it times out.

I currently have the following systems:

pve-01, pve-02 => 2x E3-1320v2 with 32GB RAM, connected with 1x Gbit/s 2x240GB SSD, 1x1TB SSD
PVE-03 => 1x VM on a E3-1230v2, virtualized with ESXi, 6 Cores with 27GB RAM, 2x240GB HDD, 1x1TB HDD

When I try to finish the installation, two tasks are created:
1. Ceph Monitor mon.pve-01 - Create
2. Ceph Manager mgr.pve-01 - Create

The first task is completed successfully and a monitor is created (at least according to the task log).
Log 1:
creating new monitor keyring
creating /etc/pve/priv/ceph.mon.keyring
importing contents of /etc/pve/priv/ceph.client.admin.keyring into /etc/pve/priv/ceph.mon.keyring
monmaptool: monmap file /tmp/monmap
monmaptool: generated fsid 59ca53d3-a273-40d9-b670-ac2f60f687b9
epoch 0
fsid 59ca53d3-a273-40d9-b670-ac2f60f687b9
last_changed 2021-06-02 17:46:53.541391
created 2021-06-02 17:46:53.541391
min_mon_release 0 (unknown)
0: [v2:10.10.10.22:3300/0,v1:10.10.10.22:6789/0] mon.pve-01
monmaptool: writing epoch 0 to /tmp/monmap (1 monitors)
created the first monitor, assume it's safe to disable insecure global ID reclaim for new setup
Created symlink /etc/systemd/system/ceph-mon.target.wants/ceph-mon@pve-01.service -> /lib/systemd/system/ceph-mon@.service.
TASK OK

The second task unfortunately failed:
Log 2:
creating manager directory '/var/lib/ceph/mgr/ceph-pve-01'
creating keys for 'mgr.pve-01'
TASK ERROR: got timeout

This is what it looks like in the GUI:
2021-06-02 18_58_28-pve-01 - Proxmox Virtual Environment.png

I have already reinstalled all systems several times, but the error keeps coming back.

Code:
root@pve-01:~# pveversion
pve-manager/6.4-4/337d6701 (running kernel: 5.4.106-1-pve)
root@pve-01:~# ceph version
ceph version 14.2.20 (886a8c9442681274213d1c7e897b12624edf6c8a) nautilus (stable)
I've tried Ceph 14 and 15.

Does anyone know where this error can come from and how to fix it?

Best regards
Sergej
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!