Ceph on 10GB NiC, which NVME?

[g7s]

Greetings, I have just created my account here, since I am assembling a HOMELAB Proxmox Cluster with 3 Nodes, each having Dual 10GB NiCs.

I want to use Ceph as a backend for the VM storage for learning purposes. While I also wish to migrate my own infrastructure onto Proxmox soon, as I hope it will replace other "unfavourable" Hypervisors in the current enterprise world

I am aware that you cannot have super high speed Ceph Storage with only 10GB NiC, but that is what I have. Can somebody recommend some NVME drives for this kind of setup?

Kind regards

g7s

 

[UdoB]

I am aware that you cannot have super high speed Ceph Storage with only 10GB NiC, but that is what I have.

It is not only the speed. Three nodes is the absolute minimum to work with Ceph. There are some more pitfalls. Be sure to know (and possibly ignore them intentionally) before you go productive:

[TUTORIAL] Thread 'FabU: can I use Ceph in a _very_ small cluster?'

Dec 26, 2024

Ceph is great, but it needs some resources above the theoretical minimum to work reliably. My assumptions for the following text:

• you want to use Ceph because... why not?
• you want to use High Availability - which requires Shared Storage (note that a complete solution needs more things like a redundant network stack and power supplies)
• you want to start as small (and cheap) as possible, because this is... “only” a Homelab

You plan for three Nodes. Each node has s single dedicated disk for use as an “OSD”. This is the documented...

• UdoB
• ceph cluster mini pc minimize shared filesystem storage
• Replies: 25
• Forum: Proxmox VE: Installation and configuration

•