Is there a reason to limit the number of monitors? ( unable to find usable monitor id )

Discussion in 'Proxmox VE: Installation and configuration' started by ravib123, Mar 5, 2017.

  1. ravib123

    ravib123 Member

    Joined:
    Nov 27, 2012
    Messages:
    47
    Likes Received:
    0
    I was trying to get some OSDs to appear and running into a problem getting a monitor running on each node in a hyper converged ceph environment with 8 nodes.

    I was looking for the error unable to find usable monitor id quite a bit and hitting some walls with my results so I looked at /usr/share/perl5/PVE/API2/Ceph.pm

    I noticed the below lines and change the 7 to an 8 so I could add a monitor to the last node.

    I wanted to make sure this wouldn't cause problems down the road?




    my $monid;

    for (my $i = 0; $i < 7; $i++) {

    if (!$cfg->{"mon.$i"}) {

    $monid = $i;

    last;

    }

    }

    die "unable to find usable monitor id\n" if !defined($monid);
     
  2. Ashley

    Ashley Member

    Joined:
    Jun 28, 2016
    Messages:
    267
    Likes Received:
    14
    You should keep the mounter count to an un-even number. CEPH suggest only 3 unless you have a huge enviornment.

    So your current amount of MON's is much higher than the recommend
     
  3. ravib123

    ravib123 Member

    Joined:
    Nov 27, 2012
    Messages:
    47
    Likes Received:
    0
    The only reason I added more is because there seemed to be an issue semi-documented about adding OSDs to non-mon nodes.

    In such a case how would you have an even number of nodes?
     
  4. Ashley

    Ashley Member

    Joined:
    Jun 28, 2016
    Messages:
    267
    Likes Received:
    14
    You just need to run
    pveceph init on a node you wish to use without a MON installed.
     
  5. ravib123

    ravib123 Member

    Joined:
    Nov 27, 2012
    Messages:
    47
    Likes Received:
    0
    easy enough, removed half the mons.

    Now if I can just get more than 14 OSDs to show up....
     
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice