External Metric Server - field name documentation?

PonyoHam

Member
May 23, 2018
20
1
8
40
Hi,

I just configured a metric server on my proxmox test install to see what kind of metrics I can pull. My whole monitoring system is based on Logstash/Elasticsearch and even though the documentation mentions only Influxdb is officially supported, getting the data into Logstash/Elasticsearch is very easy.

It does appear to create some unnecessary nested fields but that isn't hard to filter out.

Logstash filter config
Code:
filter {
  kv {
    field_split => ", "
  }
}

However there are a fair few fields that I'm not sure of what information they hold. Is there any documentation on the value represented by fields? E.g. I'm not sure what flush operations, rd operations, highest offset etc. are supposed to mean.

Logstash output
Code:
{
       "invalid_rd_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
           "wr_highest_offset" => [
        [0] "0",
        [1] "0",
        [2] "26842497024"
    ],
                         "pid" => "19251",
        "failed_wr_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
                    "nodename" => [
        [0] "proxmox",
        [1] "proxmox",
        [2] "proxmox",
        [3] "proxmox",
        [4] "proxmox",
        [5] "proxmox"
    ],
                        "host" => [
        [0] "Windows10-test",
        [1] "Windows10-test",
        [2] "Windows10-test",
        [3] "Windows10-test",
        [4] "Windows10-test",
        [5] "Windows10-test"
    ],
            "rd_total_time_ns" => [
        [0] "62867857570",
        [1] "56787022",
        [2] "317861949477"
    ],
                     "maxdisk" => "26843545600",
                 "last_update" => "1531360674",
                "idle_time_ns" => [
        [0] "2150540925128",
        [1] "2329265323541",
        [2] "39273510653"
    ],
                   "rd_merged" => [
        [0] "0",
        [1] "0",
        [2] "11178"
    ],
               "rd_operations" => [
        [0] "187249",
        [1] "260",
        [2] "138790"
    ],
                   "diskwrite" => "12249858560",
                      "uptime" => "5185",
               "wr_operations" => [
        [0] "0",
        [1] "0",
        [2] "207655"
    ],
         "flush_total_time_ns" => [
        [0] "0",
        [1] "0",
        [2] "16538396799"
    ],
                    "wr_bytes" => [
        [0] "0",
        [1] "0",
        [2] "12249858560"
    ],
                    "diskread" => "10582400512",
        "failed_rd_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
                      "maxmem" => "2147483648",
                    "instance" => [
        [0] "ide2",
        [1] "ide3",
        [2] "virtio0",
        [3] "tap102i0"
    ],
                        "disk" => "0",
                    "@version" => "1",
                    "rd_bytes" => [
        [0] "2796218368",
        [1] "3051520",
        [2] "7783130624"
    ],
                         "cpu" => "0.0500030797036851",
                   "qmpstatus" => "running",
            "wr_total_time_ns" => [
        [0] "0",
        [1] "0",
        [2] "812524462796"
    ],
    "invalid_flush_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
                      "object" => [
        [0] "qemu",
        [1] "qemu",
        [2] "qemu",
        [3] "qemu",
        [4] "qemu",
        [5] "qemu"
    ],
                       "netin" => [
        [0] "60618899",
        [1] "60618899"
    ],
                        "vmid" => [
        [0] "102",
        [1] "102",
        [2] "102",
        [3] "102",
        [4] "102",
        [5] "102"
    ],
                        "name" => "Windows10-test",
     "failed_flush_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
                  "@timestamp" => 2018-07-12T02:36:40.446Z,
                         "mem" => "1371847796",
                      "netout" => [
        [0] "13457364",
        [1] "13457364"
    ],
                      "status" => "running",
                     "balloon" => "2147483648",
       "invalid_wr_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
            "flush_operations" => [
        [0] "0",
        [1] "0",
        [2] "21811"
    ],
                     "max_mem" => "2147483648",
                      "actual" => "2147483648",
                        "cpus" => "4",
                   "wr_merged" => [
        [0] "0",
        [1] "0",
        [2] "19165"
    ]
}
 
Hey there, almost a year later, what ELK stack versions did you use? what proxmox version?
did you use influxdb definition in /etc/pve/status.cfg?
 
  • Like
Reactions: gentoo9ball