'Simple' Ceph Storage Questions

tycoonbob

Member
Aug 25, 2014
67
0
6
So I have a 2 node (will be a 3 node soon) cluster running Proxmox 3.2. I'm currently hosting ~15 VM's, using a shared NFS share on a different server. I want to implement Ceph, and am planning to start with a single 512GB SSD in each of my 3 nodes.

1) Does Ceph replicate data across all the drive, like a thee way mirror? i.e., with a single 512GB SSD in each, will I only have a total of 512GB total storage available?

2) Is the replication (assuming this is the correct term to use) configurable? i.e., can I configure a two-way mirror with 3 512GB drives, giving me a total of 768GB of available storage?

3) Can I expand my Ceph array(?) by adding more drives, or would I have to create a new array(?) when I add more drives?

4) I plan to start with a single 512GB drive in each box, but would later like to add additional 512GB drives to each server (each server is a Dell R610 with 6 x 2.5" bays, and using 2 10K SAS drives in hardware RAID1 for proxmox install -- leaving 4 bays for Ceph storage drives). If I add additional drives later, can I do one drive at a time, or would I have to add one drive to each server at the same time? i.e., can I have 2 512GB SSDs in one server, while the other 2 servers only have 1 512GB SSD, and (assuming I can do a two-way mirror) have ~1TB available storage?


Hope my questions make sense, and thanks in advance for your assistance! I've been playing with Proxmox for about a week now and am really enjoying it (tonight I am migrating everything from my Hyper-V 2012 box to Proxmox, which will free up my third Proxmox node), and I'm looking forward to really setting things up nicely in my home lab.
 
Last edited:
1) Does Ceph replicate data across all the drive, like a thee way mirror? i.e., with a single 512GB SSD in each, will I only have a total of 512GB total storage available?

Only if you configure replication factor 3.

2) Is the replication (assuming this is the correct term to use) configurable? i.e., can I configure a two-way mirror with 3 512GB drives, giving me a total of 768GB of available storage?

yes

3) Can I expand my Ceph array(?) by adding more drives, or would I have to create a new array(?) when I add more drives?

yes

If I add additional drives later, can I do one drive at a time

yes.