Hello! I'm looking to rebuild my homelab and upgrade my hardware in the process. I did some labbing to confirm my intended config will work but I don't have a good way to confirm I'm purchasing beefy enough hardware without purchasing it first. Currently, I have a 2-node Proxmox cluster with external quorum and storage. Each node is 2x Xeon E5-2643 v4 (6c/12t 3.4/3.7Ghz) and 128 GB of DDR3. One Docker host VM floats between the nodes and consumes about 10-12 threads at a time + 32GB of RAM.
My plan is to setup a 3-node Proxmox + Ceph cluster to support a cluster of microk8s VMs. Each new node will be 2x Xeon Silver 4215 (8c/16t 2.5/3.5GHz), 128GB of DDR4, 2x 4TB SSDs, and 3x 22TB HDDs. In Ceph, I'm planning on setting up four replica pools; one RBD on SSDs, one RBD on HDDs, one CephFS on SSDs, and one CephFS on HDDs. I'm planning one OSD per disk.
I can easily bump up the CPUs, now, before I buy but I don't want to overkill it and waste a bunch of power. Does this capacity sound about right? My containers alone will only consume 1/3 of the new cluster capacity + 1/3 for failover capacity. Will the remaining 1/3 be enough for Ceph and the uplift from Docker standalone to a mikrok8s cluster?
My plan is to setup a 3-node Proxmox + Ceph cluster to support a cluster of microk8s VMs. Each new node will be 2x Xeon Silver 4215 (8c/16t 2.5/3.5GHz), 128GB of DDR4, 2x 4TB SSDs, and 3x 22TB HDDs. In Ceph, I'm planning on setting up four replica pools; one RBD on SSDs, one RBD on HDDs, one CephFS on SSDs, and one CephFS on HDDs. I'm planning one OSD per disk.
I can easily bump up the CPUs, now, before I buy but I don't want to overkill it and waste a bunch of power. Does this capacity sound about right? My containers alone will only consume 1/3 of the new cluster capacity + 1/3 for failover capacity. Will the remaining 1/3 be enough for Ceph and the uplift from Docker standalone to a mikrok8s cluster?