[SOLVED] Adding New Ceph Node

overly-caffeinated

New Member
Nov 11, 2024
2
1
3
I have a two node PVE cluster, working perfectly. Both nodes are currently members of a Ceph cluster, also working just fine. My intention was always to acquire & join a third node so that Ceph could do... Ceph things.

I did end up getting & joining a third node to the PVE cluster -- no issues there. However, I cannot get the third node to join the Ceph cluster. Identical versions of PVE and Ceph are installed on all three, and the symlink from `/etc/ceph/ceph.conf -> /etc/pve/ceph.conf` exists. `pveceph init` completed without any output. However, the node appears 'stuck' now, and all `ceph` / `pveceph` operations time out. The only thing I can think of is that I need to add an entry in the global `mon_host` config, but the new node does not yet have any monitors (as `pveceph mon create` times out).

Any advice would be greatly appreciated!
 
...please ignore. In pretty standard fashion, as soon as I asked, I caught the mistake.

I have the three nodes connected to each other using FRR (following this article). The third node could reach the other two, but not vise versa; looking back at the `/etc/frr/frr.conf` file I realized that I'd left the CIDR suffix as /24 instead of /32. Corrected, restarted relevant services, and things came right up.
 
  • Like
Reactions: leesteken