[SOLVED] CEPH separate public/cluster network

[kokel]

Hi,

we have set up a 3-node Proxmox VE/CEPH Cluster with one network/VLAN/IP-range for both public and cluster network.
Now we decided to separate public and cluster network into 2 VLANs/IP ranges.

1. Is there a way to do this in an easy way? (we don't have workload, yet - so service interruption isn't a thing)
2. Currently we use Jumbo Frames - and for the separated Cluster Network this will be enabled. But is this also good for Public Network? I don't think so because we plan to get Ceph Clients connected to the storage outside the public network, so traffic will be routed. I would appreciate your thoughts here.

Thanks,
Kokel

 

[czechsys]

Two ways (based on non workload - so assume ceph pool is empty):
1] monitor's ip stays - manually change ceph config file and set cluster network, reboot
2] monitor's ip change - remove all monitors, change ceph configfile, recreate monitors

Public (aka internet) network will never work with 9k MTU without problems.

 

[kokel]

Thanks for your answer.

The Ceph Pool isn't empty, there are 2 HDDs of Test VMs. Will they be lost?

 

[kokel]

Thanks @czechsys ,
we have managed this by changing the cluster network, while the public network stays the same.