ceph failed ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.0.pi

jgarcia

Well-Known Member
Feb 13, 2015
33
0
46
Hi guys,

I am trying to create a cluster with ceph, but when I create a monitor with,
pveceph createmon it hangs, and I start receiving the message
failed: 'ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.0.pid -c /etc/pve/ceph.conf --cluster ceph ', I have alfready altered the number of processes files and opened files to everyone:
* soft nofile 50000
* hard nofile 50000
root soft nofile 50000
root hard nofile 50000
* soft nproc 50000
* hard nproc 50000


On /etc/security/limits.conf and also rebooted the machine.

Any hint o what's going on
Thanks in advance.
 
Re: ceph failed ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.

Hi guys,

I am trying to create a cluster with ceph, but when I create a monitor with,
pveceph createmon it hangs, and I start receiving the message
failed: 'ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.0.pid -c /etc/pve/ceph.conf --cluster ceph ', I have alfready altered the number of processes files and opened files to everyone:
* soft nofile 50000
* hard nofile 50000
root soft nofile 50000
root hard nofile 50000
* soft nproc 50000
* hard nproc 50000


On /etc/security/limits.conf and also rebooted the machine.

Any hint o what's going on
Thanks in advance.
Hi,
I guess the second part failed and not the first?!
Does an simple
Code:
ulimit -n 32768
work?

Udo
 
Re: ceph failed ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.

No, It does not work.
 
Re: ceph failed ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.

# whoami
root

# ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 11788
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 32768
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 11788
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited

# sysctl fs.file-nr
fs.file-nr = 1760 0 150843
 
Re: ceph failed ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.

Sorry I forgot to mention that, If I run from the cli I got the error:

# ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.0.pid -c /etc/pve/ceph.conf --cluster ceph
error: monitor data filesystem reached concerning levels of available storage space (available: 2% 48868 kB)
you may adjust 'mon data avail crit' to a lower value to make this go away (default: 5%)

How I can adjust this settings ???

Thanks.
 
Re: ceph failed ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.

Sorry I forgot to mention that, If I run from the cli I got the error:

# ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.0.pid -c /etc/pve/ceph.conf --cluster ceph
error: monitor data filesystem reached concerning levels of available storage space (available: 2% 48868 kB)
you may adjust 'mon data avail crit' to a lower value to make this go away (default: 5%)

How I can adjust this settings ???

Thanks.
Hi,
your root partition is to full?!

looks with
Code:
df -h
Udo
 
Re: ceph failed ulimit -n 32768; /usr/bin/ceph-mon -i 0 --pid-file /var/run/ceph/mon.

Hi,

ulimit -n did not work, the problem was exactly the space on the root partition
so I needed to reinstall all servers with better partitioning.

But just for the case is there a way that I can overcome the space situation??

Thanks.