Change the cluster network in an existing Ceph cluster

ropelletier

New Member
Jan 5, 2023
4
0
1
When I installed Ceph I had not yet created a separate network for the cluster. I have since done this and want to change the cluster network.

I have three nodes, all are configured as monitors, managers, and metadata servers.

I can't seem to find a known recommended procedure. This cluster is not in production yet, so there are no running VMs. However, I really, really don;t want to tear it down and start from scratch. In a perfect world, I would just need to change the config and restart each node. I have also read that all the OSDs need to be restarted.

I greatly appreciate the assistance.



Here is my config (changed a little from actual config for privacy)


Code:
[global]
     auth_client_required = cephx
     auth_cluster_required = cephx
     auth_service_required = cephx
     cluster_network = 192.168.100.5/24
     mon_allow_pool_delete = true
     mon_host = 192.168.100.5 192.168.100.7 192.168.100.8
     ms_bind_ipv4 = true
     ms_bind_ipv6 = false
     osd_pool_default_min_size = 2
     osd_pool_default_size = 3
     public_network = 192.168.100.5/24


[client]
     keyring = /etc/pve/priv/$cluster.$name.keyring

[mds]
     keyring = /var/lib/ceph/mds/ceph-$id/keyring

[mds.district-pve1]
     host = district-pve1
     mds_standby_for_name = pve

[mds.district-pve3]
     host = district-pve3
     mds standby for name = pve


[mds.district-pve4]
     host = district-pve4
     mds_standby_for_name = pve


[mon.district-pve1]
     public_addr = 192.168.100.5


[mon.district-pve3]
     public_addr = 192.168.100.7


[mon.district-pve4]
     public_addr = 192.168.100.8
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!