Proxmox / Ceph 5-Nodes Setup

[Tarasque1337]

Hello,

i'm planning a small production cluster and wanted to check up with your
opinions.

I have the following servers:

HPe servers 1HU with unfortunately only 4LFF.

So my idea on disk configuration for each server is:

1x OS HDD(SATA or SSD?)
1x Journal SSD
2x OSD (2TB SATA)

For the network i was thinking of:

2x 2G LACP bond for each Proxmox Public / Cluster-Traffic

Every server will act as a Proxmox VMhost including Ceph.

Is this a sane configuration to go productive? Do i need to upgrade the servers for more disks
to be safe?

 

[Klaus Steinberger]

instead of the disk configuration you mentioned:

3x 2TB Sata + 1 Journal SSD or alternativ: 4 x 2TB Sata + 1 M.2 NVME SSD (on a cheap PCIe M,2 Adapter)


For the network: 1G Ethernet is a little bit slow for CEPH, better to use 10 G Ethernet
Maybe the following: 2 x 1 G Ports LACP for VM Traffic, 2 x 10 GE Ports for CEPH

 

[Tarasque1337]

Thanks for the hints. I'll have to evaluate if we can go for 10G, seems to be mandatory for Ceph / Proxmox.

3x 2TB SATA + 1 Journal SSDs -> That means the Proxmox OS will be on one of the OSDs correct? Or
do something like install it on a USB Stick? I'll also check for some PCIe Adapters, seems like an good idea.

 

[Klaus Steinberger]

Ahh, sorry was a misreading from me, of course the first disk should be OS only, so:

2 x TB Sata + Journal SSD or the alternative with 3 Disks and the PCI NVME Adapter (delock has cheap NVME Adapters)

I would not recommend installing OS on USB Stick, they would not live long enough .......