Unable to create Ceph monitor - No Active IP for public network

Sep 11, 2019
26
1
8
55
I have a 12 node cluster, 6 at each of two location. Location one nodes use .2.0/24, the other .39.0/24

Nodes can all ping one another but when trying to create a ceph monitor on any node at the second location (.39) the error states:

Code:
Multiple Ceph public networks detected on putsproxp07: 192.168.2.0/24 192.168.39.0/24
Networks must be capable of routing to each other.
No active IP found for the requested ceph public network '192.168.2.0/24' on node 'putsproxp07'



Here is the start of my conf

Code:
[global]
     auth_client_required = cephx
     auth_cluster_required = cephx
     auth_service_required = cephx
     bluestore_block_db_size = 343597383680
     cluster_network = 10.10.27.32/27
     fsid = fbfde291-2831-4005-802f-5a01e95c9615
     mon_allow_pool_delete = true
     mon_host = 10.10.27.34 10.10.27.36 10.10.27.38
     osd_journal_size = 5120
     osd_pool_default_min_size = 2
     osd_pool_default_size = 3
     public_network = 192.168.2.0/24 192.168.39.0/24
 
you can create the mons on the cli via 'pveceph mon create' and there you can give the option '--mon-address' to overwrite the ip autodetection