i /&%¤ up my ceph

[pefman]

Hi all!

I was changing the ip adresses on my proxmox cluster, but it seems like my ceph cluster just stopped working completly.
I have tried looking thru the logs to find any errors, but its all timeouts and services restarting to quickly.

Could anybody give a hand?

ceph.conf

[global]
         auth_client_required = cephx
         auth_cluster_required = cephx
         auth_service_required = cephx
         cluster_network = 10.0.1.101/24
         fsid = 814bbcf5-0235-4418-b6c8-739b85662ecc
         mon_allow_pool_delete = true
         mon_host = 10.0.2.101 10.0.2.102 10.0.2.103
         osd_pool_default_min_size = 2
         osd_pool_default_size = 3
         public_network = 10.0.2.101/24

[client]
         keyring = /etc/pve/priv/$cluster.$name.keyring

[mon.gr-pve-1]
         public_addr = 10.0.2.101

[mon.gr-pve-2]
         public_addr = 10.0.2.102

[mon.gr-pve-3]
         public_addr = 10.0.2.103

corosync.conf

logging {
  debug: off
  to_syslog: yes
}

nodelist {
  node {
    name: gr-pve-1
    nodeid: 1
    quorum_votes: 1
    ring0_addr: 10.0.1.101
  }
  node {
    name: gr-pve-2
    nodeid: 2
    quorum_votes: 1
    ring0_addr: 10.0.1.102
  }
  node {
    name: gr-pve-3
    nodeid: 3
    quorum_votes: 1
    ring0_addr: 10.0.1.103
  }
}

quorum {
  provider: corosync_votequorum
}

totem {
  cluster_name: gr-pve-cluster
  config_version: 3
  interface {
    linknumber: 0
  }
  ip_version: ipv4-6
  link_mode: passive
  secauth: on
  version: 2
}

This is my network configuration, where the notes pretty much explains the traffic. this is the first node though, the second node used 102 and the third 103.

 

[Alwin]

I was changing the ip adresses on my proxmox cluster, but it seems like my ceph cluster just stopped working completly.

It depends on which IPs you changed. As the change of Ceph's public_network range can't only be done in the config. The MONs will need to be moved as well.