Help Needed with Ceph on Proxmox - "Binary not installed - ceph-mon (500)"

[Bohem]

Hello,

I am currently trying to learn Ceph for production use.

I have a 3-node setup with 12 OSDs, 3 monitors, and 3 managers. It took several attempts to get to this point, as I encountered nearly every error that can occur with Ceph. After a full reinstall of Proxmox, everything seems to be working fine.

However, I am facing one issue: when I try to create a pool, I receive the following error:
Binary not installed - ceph-mon (500)

When I run whereis ceph-mon, it returns:
ceph-mon: /usr/bin/ceph-mon /usr/share/man/man8/ceph-mon.8.gz

The command apt install ceph-mon runs without any issues, and both apt update and apt upgrade are up to date.

I have performed several reinstalls and still face the same issue across all 3 Proxmox nodes.

For reference, my Proxmox version is 8.3.3, and I am using the latest version of Ceph (Squid).

I have searched extensively online and in the Proxmox forums but haven’t found any solutions. I’m feeling stuck and would appreciate any guidance.

Thank you!

 

[aaron]

don't do apt install ceph-mon manually. Either run pveceph install --version reef --repository {repo} or go via the GUI. This will install all the needed packages and dependencies on the Proxmox VE node.

 

[Bohem]

Thats what I did in the first place to create the first ceph configuration ! Tried to get back ceph-mon manually via apt but Ceph il already installed !

 

[aaron]

okay, the other thing is, with whereis, you might need to specify that you look for the binary: whereis -b ceph-mon. Personally I use the which tool for this.

another question I have is, how do you create a pool? Are you using the CLI or GUI? If you use the CLI, do you use the Ceph native tools or pveceph?

 

[Bohem]

Thanks for the help, im kinda still a noob with Ceph, proxmox and storage management !
whereis -b ceph-mon => ceph-mon: /usr/bin/ceph-mon
which ceph-mon => /usr/bin/ceph-mon

Actually I only use the GUI button "create" on Ceph => Pools menu. I didnt try to do it in CLI yet since I have many issues to solve and im afraid to break things again

In other hands, CephFS is working great and the button "create" from this menu create a pool whitout any issue, but thats not what I need (I didnt find a wait to use CephFS to use as a storage for my VMs)

EDIT : I used the command ceph osd pool create Data_BDD 512 replicated and it did create the pool "Data_BDD" which I needed. The pool shows up in the Ceph GUI. Also did ceph osd pool application enable Data_BDD rbd. Seems like a big step for me, now I need to understand how to put this newly created RBD Ceph pool as storage for the cluster