Ceph, proxmox4, monitor load

Melanxolik

Well-Known Member
Dec 18, 2013
86
0
46
Hi, I have problem with performance ceph. One of many customers create load on ceph storage, at LVM storage I can run: iostat -x 1 -N and search LVM drive with need me problem customer, but How can I control problem client at ceph storage?
I need control iops and mbps/rw per customer.

I know about disk throttle, but I need monitor disks performance.

Could you help me with this?
 
In ceph you have the following command:
"ceph -w" it tells you in real time whats happening on your cluster with regards to reads/writes and iops. However that does not tell you where its coming from.

I'd go via "datacenter > node > vm > summary" and have a look at Disk IO for the time period in question, to figure out who it is.

I am not aware how you'd QOS in Ceph on a pool basis. I'd use the "Disk throttle" function to rate-limit the customers vDisk via proxmox/rdb. Never comes up in our use-case, so i can not give you any gurantees on that.

ps.: if it turns out its a general issue of your ceph-cluster (unable to handle iops from multiple customers) you might wanna look into
SSD / M.2 NVME based Cache-Tiers: http://docs.ceph.com/docs/master/rados/operations/cache-tiering/

can tell you from experience they truly work wonders.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!