Hello,
does someone have a nice hardware recommendation for a 3 Node Cluster.
Right now we have such nodes:
1U Rackmount / Supermicro SuperServer 1019P-WTR
1x CPU Intel Xeon Silver 4114 10C - 2.2 GHz Intel Xeon Silver 4114, 2.20GHz, 10C/20T, LGA 3647, tray
6x Stk 16GB Samsung DDR4-2666 CL19 (2Gx4) ECC reg. SR
2x Stk Supermicro Add-on Card 2-port SFP+ 10GbE Standard LP
1x Supermicro Add-on Card S3108L-H8IR-16DD AOC-S3108L-H8IR-16DD 8 internal ports low-profile 12Gb/s.
1x Supermicro CacheVault BTR-CV3108-U1
2x 500W Redundant Platinum Level power supplies
For about 5.000EUR/ per Node in 04/2019. Ceph-Cluster is connected by 10GBit Fiber Links.
We are quite happy with it. We put 2,5" 960GB Intel Enterprise SSD into it.
Right now our bottle neck seems to be RAM, closely followed by disk space and IO
Now we need more Hardware and dont want to upgrade the existing one or add a 4th node to the cluster. Things we could improve ( i think):
- AMD CPU? Maybe even Dual? Does that make sense for 25VMs/per Node?
- more than 96GB RAM
- 1 or 2 M2 NVM for OSD Metadata?
- SSDs for the rest?
- no hardware raid anymore?
We aim to run about 25VMs on it per Node.
Mostly Webservers and some Postgresql DBs.
So they idle until a peak comes in
Does anyone have a Setup he wants to share? (its not about who´s got the biggest pe** here).
Or is there a stick thread/link/page i missed?
Budget (without the Disks) are 4-5k.
Thanks,
Michael
does someone have a nice hardware recommendation for a 3 Node Cluster.
Right now we have such nodes:
1U Rackmount / Supermicro SuperServer 1019P-WTR
1x CPU Intel Xeon Silver 4114 10C - 2.2 GHz Intel Xeon Silver 4114, 2.20GHz, 10C/20T, LGA 3647, tray
6x Stk 16GB Samsung DDR4-2666 CL19 (2Gx4) ECC reg. SR
2x Stk Supermicro Add-on Card 2-port SFP+ 10GbE Standard LP
1x Supermicro Add-on Card S3108L-H8IR-16DD AOC-S3108L-H8IR-16DD 8 internal ports low-profile 12Gb/s.
1x Supermicro CacheVault BTR-CV3108-U1
2x 500W Redundant Platinum Level power supplies
For about 5.000EUR/ per Node in 04/2019. Ceph-Cluster is connected by 10GBit Fiber Links.
We are quite happy with it. We put 2,5" 960GB Intel Enterprise SSD into it.
Right now our bottle neck seems to be RAM, closely followed by disk space and IO
Now we need more Hardware and dont want to upgrade the existing one or add a 4th node to the cluster. Things we could improve ( i think):
- AMD CPU? Maybe even Dual? Does that make sense for 25VMs/per Node?
- more than 96GB RAM
- 1 or 2 M2 NVM for OSD Metadata?
- SSDs for the rest?
- no hardware raid anymore?
We aim to run about 25VMs on it per Node.
Mostly Webservers and some Postgresql DBs.
So they idle until a peak comes in
Does anyone have a Setup he wants to share? (its not about who´s got the biggest pe** here).
Or is there a stick thread/link/page i missed?
Budget (without the Disks) are 4-5k.
Thanks,
Michael
