hardware ceph question

ilia987

Member
Sep 9, 2019
237
10
23
35
i planning to add some more nodes to the grid ( we need mainly more computational power cpu\ram )
but i thought to add an HDD ceph storage for low accsess\archive storage (we have existing 5 node ssd based servers for to support heavy read tasks )
i am thinking to do the following 3x 6027TR-D71RF+ ( total 6 more ceph servers each with 6 HDDs)
 

ilia987

Member
Sep 9, 2019
237
10
23
35
Right I forgot .

Is it a good idea to make multiple ceph agents with small amount of osds. In this case each will have up to 6.

Or better to get server with better capacity. (More hdds sleds )
 

ph0x

Renowned Member
Jul 5, 2020
1,221
194
63
/dev/null
I would say that a Xeon E5 can easily handle more than six OSDs, on the other hand there's more failure tolerance with more hosts, so this remains up to you.
You said you wanted to add mainly compute power. Then I would recommend fewer OSDs per node to not waste the power on storage tasks.
 

ilia987

Member
Sep 9, 2019
237
10
23
35
do i need another lsi card? or the onboard is good enough ?
i plan one of the following models 6027TR-DTRF+ 6027TR-D71RF+ 6027TR-D70RF+
 

ph0x

Renowned Member
Jul 5, 2020
1,221
194
63
/dev/null
SAS2 is 6 Gbps, just like SATA3. In order to facilitate 12 Gbps you would need another HBA, yes.
 

ilia987

Member
Sep 9, 2019
237
10
23
35
The plane is to use HDD (not ssd, so 6gbs should be good enoth) for ceph storage. so for 6gbs can i use the onboard controller to work with ceph?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!