I'm hoping to find a utility like 'top' or 'iotop' to monitor Ceph RBD usage. We host a variety of VMs and want to track down clients that are taking more than their fair share of storage throughput or IOPS. Can't throttle what we can't measure...
Ceph - Monitor VM usage
- Thread starter David Herselman
- Start date
It appears this has been asked for before and that there is a blue print for it... Just no active development (yet):
http://pad.ceph.com/p/ceph-top
Would be nice if Proxmox provided I/O and IOPS counters for VMs accessing RBD...
http://pad.ceph.com/p/ceph-top
Would be nice if Proxmox provided I/O and IOPS counters for VMs accessing RBD...
There are perf counters, but I didn't see specific ones for RBD images (on the ceph trello there is a card with rbd-image stats open).
http://docs.ceph.com/docs/master/dev/perf_counters/
https://collectd.org/documentation/manpages/collectd.conf.5.shtml#plugin_ceph
A possible way would be to use the KRBD plugin and monitor the disk access from there. But this would need a switch from librbd.
Involves raising the log level and could be a performance hit.
https://github.com/cernceph/ceph-scripts/blob/master/tools/rbd-io-stats.pl
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042076.html
PVE metrics to external server: https://pve.proxmox.com/wiki/External_Metric_Server
http://docs.ceph.com/docs/master/dev/perf_counters/
https://collectd.org/documentation/manpages/collectd.conf.5.shtml#plugin_ceph
A possible way would be to use the KRBD plugin and monitor the disk access from there. But this would need a switch from librbd.
Involves raising the log level and could be a performance hit.
https://github.com/cernceph/ceph-scripts/blob/master/tools/rbd-io-stats.pl
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-August/042076.html
PVE metrics to external server: https://pve.proxmox.com/wiki/External_Metric_Server