New CEPH OSD

[Ashley]

Hello,

Since the most recent CEPH Jewel update I am unable to create an OSD, I tried via the GUI and got an error of 1.

I tried via the CLI to see if I got any more information and received the following:

pveceph createosd /dev/sdc -journal_dev /dev/sdm
create OSD on /dev/sdc (xfs)
using device '/dev/sdm' for journal
ceph-disk: Error: journal specified but not allowed by osd backend
command 'ceph-disk prepare --zap-disk --fs-type xfs --cluster ceph --cluster-uuid 51c1b5c5-e510-4ed3-8b09-417214edb3f4 --journal-dev /dev/sdc /dev/sdm' failed: exit code 1


To me it seems like maybe its trying to use bluestore which does not support a Journal, nothing has changed apart from this new node is running the latest Jewel release, has anyone seen this before a quick google of the error brought nothing up.

 

[udo]

Hi,
does the same happens, if you use an partition for the journal, like /dev/sdm1 ?

Udo

 

[Ashley]

Exactly the same :

pveceph createosd /dev/sdc -journal_dev /dev/sdm1
create OSD on /dev/sdc (xfs)
using device '/dev/sdm1' for journal
ceph-disk: Error: journal specified but not allowed by osd backend
command 'ceph-disk prepare --zap-disk --fs-type xfs --cluster ceph --cluster-uuid 51c1b5c5-e510-4ed3-8b09-417214edb3f4 --journal-dev /dev/sdc /dev/sdm1' failed: exit code 1

 

[Ashley]

So I rolled back the new server to 10.2.5, and the issue has gone away.

Looks like maybe there has been a change in 10.2.6 which no longer works with the above command.

 

[Ashley]

Just a heads up, have tried the latest CEPH release 10.2.* and is the same issue via the GUI / Proxmox CLI, I had to manually create the OSD via the CEPH commands.