What is "Normal" Ceph performance?

maomaocake

Member
Feb 13, 2022
43
2
13
21
As the title suggests, I wanna find out what are the performance of other people's clusters.

I'll start:
Node Count: 3
Networking: 1 gbe shared with proxmox
Disks:
  1. 3 x 3TB 7200RPM
  2. 2 x 1TB 7200RPM
  3. 1 x 1TB 5400RPM


using this Benchmarking Tutorial here's my result
 

Attachments

  • Screenshot from 2023-07-19 10-06-06.png
    Screenshot from 2023-07-19 10-06-06.png
    86.8 KB · Views: 21
  • Screenshot from 2023-07-19 10-06-40.png
    Screenshot from 2023-07-19 10-06-40.png
    46.9 KB · Views: 19
The performance is expected. Every write has to go through every node and you only have one 5400RPM HDD in the third node. This disk is hit with every write operation.

You should balance the disks (and the capacity) evenly across the nodes. This is important especially in such a small cluster. Move one 1TB and one 3TB disk to each node.
 
The performance is expected. Every write has to go through every node and you only have one 5400RPM HDD in the third node. This disk is hit with every write operation.
yes im aware of the performance i have a new 1tb 7200rpm hdd coming in the mail and moving my wal and db to a separate ssd, I just want to see if other people gets around as shitty performance as I do.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!