[SOLVED] Adding New Ceph Node

overly-caffeinated

New Member
Nov 11, 2024
2
1
3
I have a two node PVE cluster, working perfectly. Both nodes are currently members of a Ceph cluster, also working just fine. My intention was always to acquire & join a third node so that Ceph could do... Ceph things.

I did end up getting & joining a third node to the PVE cluster -- no issues there. However, I cannot get the third node to join the Ceph cluster. Identical versions of PVE and Ceph are installed on all three, and the symlink from `/etc/ceph/ceph.conf -> /etc/pve/ceph.conf` exists. `pveceph init` completed without any output. However, the node appears 'stuck' now, and all `ceph` / `pveceph` operations time out. The only thing I can think of is that I need to add an entry in the global `mon_host` config, but the new node does not yet have any monitors (as `pveceph mon create` times out).

Any advice would be greatly appreciated!
 
...please ignore. In pretty standard fashion, as soon as I asked, I caught the mistake.

I have the three nodes connected to each other using FRR (following this article). The third node could reach the other two, but not vise versa; looking back at the `/etc/frr/frr.conf` file I realized that I'd left the CIDR suffix as /24 instead of /32. Corrected, restarted relevant services, and things came right up.
 
  • Like
Reactions: leesteken

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!