Help! Ceph configure

[Alex_bor]

I tried using the ceph configuration guide from youtube. But have a problems.
Hardware 4 Nodes: every have 1ssd 16Gb(Proxmox) 1ssd 250Gb 1 Hdd 1 TB.
I want create 2 pools (SSD and HDD). But I want save journal of hdd and ssd pool only on ssd disk. And use ssd as cache for hdd. I have not found a suitable instruction anywhere. Web-Proxmox does not allow me to do this. Can any body write short guide how to do it.

 

[Alwin]

Go through our and ceph's documentation for more informtion on how to prepare and setup ceph.
https://pve.proxmox.com/pve-docs/chapter-pveceph.html
http://docs.ceph.com/docs/luminous/start/intro/

 

[Alex_bor]

I can create this scheme, only with lvm (sda1:ssd 240G, sdb1:SAS:1TB) :

pvcreate /dev/sda1  /dev/sdb1
vgcreate vg_ssd /dev/sda1
vgcreate vg_hdd /dev/sdb1
lvcreate -L 2G -n lv_hddjl vg_ssd
lvcreate -L 2G -n lv_hdddb vg_ssd
lvcreate -L 2G -n lv_ssddb vg_ssd
lvcreate -L 2G -n lv_ssdjl vg_ssd
vgdisplay                      
lvcreate -l 55185 -n lv_ssddata vg_ssd
lvcreate -l 238466 -n lv_hdd vg_hdd        

ceph-volume lvm prepare --bluestore --data vg_hdd/lv_hdd --block.wal vg_ssd/lv_hddjl --block.db vg_ssd/lv_hdddb
ceph-volume lvm prepare --bluestore --data vg_ssd/lv_ssddata --block.wal vg_ssd/lv_ssdjl --block.db vg_ssd/lv_ssddb
ceph-volume lvm activate --all

It's true practice or not?
Now I try to do it on second node and take error.

root@sblade2-s2:~# ceph-volume lvm prepare --bluestore --data vg_hdd/lv_hdd --block.wal vg_ssd/lv_hddjl --block.db vg_ssd/lv_hdddb
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new 232dcf96-15a6-41d0-8208-c9ee2b523c3b
 stderr: 2018-09-05 09:57:31.503719 7ffa7a1f7700  0 librados: client.bootstrap-osd authentication error (1) Operation not permitted
 stderr: [errno 1] error connecting to the cluster
-->  RuntimeError: Unable to create a new OSD id

 

[AlexLup]

A journal can be set in the proxmox gui, selecting sda1 will automagically create the journal (.wal is autocreated on the SSD when sepcifying this, according to ceph documentation).

For SSD cache check http://technik.blogs.nde.ag/2017/07/14/ceph-caching-for-image-pools/
Do note that if you need the SSD cache, you will need to add another SSD to each node as ceph cannot take partitions..