CEPH - Add another node

[TwiX]

Hi,

I'm actually using a pve 4.4 ceph cluster with 3 nodes. Everything is working as expected.
I'm wondering how to add another ceph node. Is there a way to do it in the GUI or via cli commands ?

Thanks in advanced !

 

[udo]

Hi,
like the wiki (https://pve.proxmox.com/wiki/Ceph_Server#Create_initial_Ceph_configuration ) discribed:

pveceph install -version jewel
pveceph init

Udo

 

[TwiX]

Hi, thanks
I thought it is only used for the initial setup

 

[TwiX]

pveceph install -version jewel
pveceph init

Executing these commands before or after joining new node to the cluster ?

 

[Ashley]

pveceph install -version jewel
pveceph init

Executing these commands before or after joining new node to the cluster ?

After

 

[TwiX]

Hi,

Are these commands still valid on proxmox 5.1 in order to add node(s) and osds ?
Seems that it disappeared on the wiki.

Thanks a lot

 

[dietmar]

Are these commands still valid on proxmox 5.1 in order to add node(s) and osds ?
Seems that it disappeared on the wiki.

see https://pve.proxmox.com/wiki/Manage_Ceph_Services_on_Proxmox_VE_Nodes

 

[TwiX]

Hi,

Thanks but I still cannot see what to do in order to add a new node.
From my understanding :

- Prepare new node
- Join existing cluster
- execute : pveceph install -version luminous
- Then what ?

Thanks again

 

[jeffwadsworth]

First of all, what version of Ceph are you running? Luminous requires the addition of manager's, etc. Quite different from "jewel".

 

[TwiX]

Hello, my 3 nodes cluster is running pve 5.1 with ceph luminous.
I just want to add a 4th node and install new osds from it.

 

[udo]

Hello, my 3 nodes cluster is running pve 5.1 with ceph luminous.
I just want to add a 4th node and install new osds from it.

Hi,
three mons are enough, so simply install OSDs only on the fourth node.

Udo

 

[TwiX]

Ok, after joining new nodes to the cluster we just have to (on new nodes) :
- pveceph install
- pveceph init

After that, we could add new osds/ mons if we need to.

I also noticed that ceph is working (I mean mounting/migrate vms) without install ceph luminous, because some ceph packages are installed (eg ceph-common) but these packages are related to jewel version.

 

[cikoshel]

Hi TwiX,

Do we need to specify the --network option when run the command "pveceph init --network xxx like first time we do it. I am in the midst of add new osd node to the running cluster.

Thanks

 

[TwiX]

Hi.

No you don't need to specify network option