Add 4th node to existing 3 node cluster with Ceph

mattboy9921

Member
Jan 19, 2020
2
0
21
28
I currently have a 3 node cluster set up, each has equal drives set up as OSDs in Ceph. The nodes are connected via 10 GB direct attach cables (without a switch or router, just broadcast) for Ceph, alongside the Ceph CN and regular network.

I'd like to add a 4th node that will not have any drives to be set up for Ceph, nor will it be connected to the Ceph network, just the regular network. How can I have it see the Ceph storage and be able to host VMs from it?

The reason I ask is I've tried installing Ceph on the 4th node, thinking it'd see the storage and work, but it just returns Error 500 when looking at the Ceph panel.
 
Hi,

The problem is if you have no connection to the ceph network from this node, how should the hoist use it as storage?
The fourth node must be connected to the ceph public network if you like to use the ceph storage.
 
Thank you for your response wolfgang! I am now in the process of setting up a 10 gig switch for my Ceph network.

As a follow up, I have my Ceph public network separate from my cluster network. Would I have to give the 4th node access to the cluster network as well?
 
Would I have to give the 4th node access to the cluster network as well?
If it will be only a client, no you need not.
The Cluster network is only for OSD's.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!