New Project

N

netpana

New Member
Jun 5, 2024
7
1
3
Good Morning all,

I have a project to buid and I need some advise,
I would like to create a cluster with CEPH with 3 nodes ( for now, will put 2 more later on time, maybe a year or so)

My intention is to buy 3 servers like this:
CPU
  • 2 × Intel Xeon Silver 4316 (20C 30M Cache 2.3GHz)
RAM
  • 4 × 64GB DDR4 LRDIMM 3200MHz
RAID (8 DISKS 2 TB SSD)
  • RAID Dell S150 (Only sata disks) (8 DISK MAX)
  • iDRAC 9 Enterprise
  • 2x Dell 800W Hot-Plug
  • 2 port 1Gb/s (Integrated)
  • 4 ports 10GB SFP+ PCI-e
This all will be on a datacenter:
2 x CCR2216-1G-12XS-2XQ (VRRP)
4 X S5736-S48T4XC (huawei 10G (STACK)

1728891145148.png

This needs to be fully working with HA 24/7 without data lost and downtime accepted.

It will be running lots of LXC and some VM (no windows expected but maybe 1 or 2 )

the LXC will be mostly ram (512-1gb) and disk (10/80gb)
the VM will be ram (2-8gb) and disk (100-1000gb)

Budget: 50K (better if is 40)

HUAWEY
8000​
SERVERS
17000​
ROUTERS
4000​
TRANSCEIVERS / CABLES
1500​
30500​

¿Some advise for this configuration?

Many thanks in advance.

​

 
Thanks lukas,

Network will be separated by vlans and ports on the switch.
Each server has 4 10Gb connections
2 for data a and 2 for ceph
 
  • Like
Reactions: Lukas Moravek
netpana said:
2 × Intel Xeon Silver 4316 (20C 30M Cache 2.3GHz)
Click to expand...
I'd go with more GHz ... always.


netpana said:
  • 2 port 1Gb/s (Integrated)
  • 4 ports 10GB SFP+ PCI-e
Click to expand...
As your picture shows, you'll not use the 1 GBE ports, just drop them (no LOM) and put in a OCP 4x 10/25 GBE.


netpana said:
Network will be separated by vlans and ports on the switch.
Click to expand...
That is not enough, you need also something like DSCP in order to prioritize CoroSync traffic.


netpana said:
RAID Dell S150 (Only sata disks) (8 DISK MAX)
Click to expand...
Don't use a RAID controller with CEPH, or can it just passthrough?


What server is this, a 1 HE? Have you tried to configure an AMD EPYC one? Those are normally cheaper and more powerfull than their Intel counterpart (just configured for another project a non-PVE system R360 vs. R6615 and the AMD is more than 1k€ cheaper with the same specs).
 
You must log in or register to reply here.
Top Bottom