Ceph Single Node?

dragon2611

Active Member
Jul 2, 2010
79
4
33
Would I be crazy to run Ceph on a single node? configured for OSD level redundancy (instead of host level).

Was thinking of using Ceph as I can change the resiliency settings, or replace disks with larger ones and re-balance easier than if it was just a static ZFS. (This is assuming I can put the raid controller into HBA mode in the first place but it looks like it might be possible, controller is a p420i)


This is a semi-production node in the sense it will be running VM's I use, but it's just a personal box so if it did fall over it's not world ending
 

aaron

Proxmox Staff Member
Staff member
Jun 3, 2019
3,155
540
118
Well, if you want to get some experience with Ceph, why not. But a lot of the things you would experience in a decently sized cluster cannot be replicated on a single node.

You also have quite a bit more overhead than using some local storage as you need a MON and a MGR plus all the OSD services that take up resources.
 

dragon2611

Active Member
Jul 2, 2010
79
4
33
I have a Ceph cluster on extremely under powered USFF nodes at home to learn/experience ceph (Actually pleasantly surprised with how that's performing).

Do you know what the overhead will be.

System has 64GB ram at the moment, it may end up with more once it gets here and I see what the memory configuration is. (It's an ebay special)
 

aaron

Proxmox Staff Member
Staff member
Jun 3, 2019
3,155
540
118
Well, a few hundred MB to a few GB per service plus the CPU resource they will consume.
 

ness1602

Well-Known Member
Oct 28, 2014
346
46
53
Serbia
I have 3 node AMD a8-7800 with 16gb ram, and they are great for learning purposes, so i would recommend that you get whatever you can to get to 3 nodes
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!