Totally lost with Ceph

100percentjake

New Member
Jan 3, 2017
20
0
1
28
So I got ceph running, got OSDs on each node (three nodes), but I'm totally lost on how to properly pool them together so that I can spin up a virtual machine and have high availability. Can anyone shine some light on how to go about just spinning up VMs and having them mirrored/checksummed across my nodes?
 
Within the browser for one of your nodes, select a node on the left-hand list. Under the CEPH option, find the Pool button. Once you create a pool, you choose the Datacenter button. Under storage, select RBD to set up a shared storage connection.
 
  • Like
Reactions: 100percentjake
I have the default pool, called 'rbd', on all of my nodes. I went to Datacenter and then created a new RBD called "ceph" with the IPs of the Monitors (my three cluster nodes each have a monitor daemon), the default 'admin' user name, and "Disk Image" and "Container", "enable", etc. but when I go to create a VM and choose the "Ceph" RDB disk as my destination it returns a Capacity of zero bytes.
 
Yes, I have been following that wiki page to set this cluster up. Keyring is copied as "ceph.keyring" in accordance with the name of my RBD as dictated in /etc/pve/storage.cfg. On any node I can go to Ceph->OSD in the GUI and see the OSD on each node and how big it is, but the RBD is showing 0 bytes still.
 
I figured it out. I had not capitalized "Ceph.keyring" as it is in /etc/pve/storage.cfg . I suppose coming from the lawless capitalization-ignorant land of Windows has made me sloppy. Thanks for your time everyone. I just spun up a Debian test server and it looks to be working brilliantly but I'm sure I'll be back on the forums with more questions eventually, haha.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!