Building Ceph / Proxmox Cluster

[Doktorake]

Hello,

we will deploy a staging enviroment in form as a prox/ceph next year,
and i want to validate with you guys if that setup (Hyperconvergent) seems like a good idea:

We have:

5x DL380G8
Raidcontroller
10G SFP+ 2 Port NIC
1G Copper 4 Port NIC
2x CPU 2620
-------------
The Disk layout should be as following:

Each Server:
Option A)
2x small SSD in RAID1 for OS
6x 480GB SSD
Option B)
2x small SSD in RAID1 for OS
1x Journal-SSD
5x 2TB HDD
------
Network:
2G-Bond for Access / Intert
1x 10G for Ceph
1x 10G for Proxmox
------------

Does this seems like a reasonable setup? Would it make sense to prefer the All flash solution albeit the lesser storage? Should i think about getting another SFP+ NIC to bond the Ceph/Proxmox link also?

Thank you for any advise.

 

[Richard]

Hello,

we will deploy a staging enviroment in form as a prox/ceph next year,
and i want to validate with you guys if that setup (Hyperconvergent) seems like a good idea:

We have:

5x DL380G8
Raidcontroller
10G SFP+ 2 Port NIC
1G Copper 4 Port NIC
2x CPU 2620
-------------
The Disk layout should be as following:

Each Server:
Option A)
2x small SSD in RAID1 for OS
6x 480GB SSD
Option B)
2x small SSD in RAID1 for OS
1x Journal-SSD
5x 2TB HDD
------
Network:
2G-Bond for Access / Intert
1x 10G for Ceph
1x 10G for Proxmox
------------

Does this seems like a reasonable setup? Would it make sense to prefer the All flash solution albeit the lesser storage? Should i think about getting another SFP+ NIC to bond the Ceph/Proxmox link also?

Regarding the storage a general advice cannot be given, it depends on your specific needs. Just to mention: Disk used for ZFS or Ceph MUST NOT be behind a HW RAID controller, use HBA instead.


Assuming saying "Proxmox" network you mean the corosync cluster: The latency and reliabilty is important, but it does not cause such a big amount of traffic. AFAICS you have 2x 1GB interfaces left - you can use them (bonded) as corosync LAN and the 2nd 10GB also for Ceph instead.