External Metric Server - field name documentation?

[PonyoHam]

Hi,

I just configured a metric server on my proxmox test install to see what kind of metrics I can pull. My whole monitoring system is based on Logstash/Elasticsearch and even though the documentation mentions only Influxdb is officially supported, getting the data into Logstash/Elasticsearch is very easy.

It does appear to create some unnecessary nested fields but that isn't hard to filter out.

Logstash filter config

filter {
  kv {
    field_split => ", "
  }
}

However there are a fair few fields that I'm not sure of what information they hold. Is there any documentation on the value represented by fields? E.g. I'm not sure what flush operations, rd operations, highest offset etc. are supposed to mean.

Logstash output

{
       "invalid_rd_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
           "wr_highest_offset" => [
        [0] "0",
        [1] "0",
        [2] "26842497024"
    ],
                         "pid" => "19251",
        "failed_wr_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
                    "nodename" => [
        [0] "proxmox",
        [1] "proxmox",
        [2] "proxmox",
        [3] "proxmox",
        [4] "proxmox",
        [5] "proxmox"
    ],
                        "host" => [
        [0] "Windows10-test",
        [1] "Windows10-test",
        [2] "Windows10-test",
        [3] "Windows10-test",
        [4] "Windows10-test",
        [5] "Windows10-test"
    ],
            "rd_total_time_ns" => [
        [0] "62867857570",
        [1] "56787022",
        [2] "317861949477"
    ],
                     "maxdisk" => "26843545600",
                 "last_update" => "1531360674",
                "idle_time_ns" => [
        [0] "2150540925128",
        [1] "2329265323541",
        [2] "39273510653"
    ],
                   "rd_merged" => [
        [0] "0",
        [1] "0",
        [2] "11178"
    ],
               "rd_operations" => [
        [0] "187249",
        [1] "260",
        [2] "138790"
    ],
                   "diskwrite" => "12249858560",
                      "uptime" => "5185",
               "wr_operations" => [
        [0] "0",
        [1] "0",
        [2] "207655"
    ],
         "flush_total_time_ns" => [
        [0] "0",
        [1] "0",
        [2] "16538396799"
    ],
                    "wr_bytes" => [
        [0] "0",
        [1] "0",
        [2] "12249858560"
    ],
                    "diskread" => "10582400512",
        "failed_rd_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
                      "maxmem" => "2147483648",
                    "instance" => [
        [0] "ide2",
        [1] "ide3",
        [2] "virtio0",
        [3] "tap102i0"
    ],
                        "disk" => "0",
                    "@version" => "1",
                    "rd_bytes" => [
        [0] "2796218368",
        [1] "3051520",
        [2] "7783130624"
    ],
                         "cpu" => "0.0500030797036851",
                   "qmpstatus" => "running",
            "wr_total_time_ns" => [
        [0] "0",
        [1] "0",
        [2] "812524462796"
    ],
    "invalid_flush_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
                      "object" => [
        [0] "qemu",
        [1] "qemu",
        [2] "qemu",
        [3] "qemu",
        [4] "qemu",
        [5] "qemu"
    ],
                       "netin" => [
        [0] "60618899",
        [1] "60618899"
    ],
                        "vmid" => [
        [0] "102",
        [1] "102",
        [2] "102",
        [3] "102",
        [4] "102",
        [5] "102"
    ],
                        "name" => "Windows10-test",
     "failed_flush_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
                  "@timestamp" => 2018-07-12T02:36:40.446Z,
                         "mem" => "1371847796",
                      "netout" => [
        [0] "13457364",
        [1] "13457364"
    ],
                      "status" => "running",
                     "balloon" => "2147483648",
       "invalid_wr_operations" => [
        [0] "0",
        [1] "0",
        [2] "0"
    ],
            "flush_operations" => [
        [0] "0",
        [1] "0",
        [2] "21811"
    ],
                     "max_mem" => "2147483648",
                      "actual" => "2147483648",
                        "cpus" => "4",
                   "wr_merged" => [
        [0] "0",
        [1] "0",
        [2] "19165"
    ]
}

 

[tbardin]

Same here.

 

[dami]

Hey there, almost a year later, what ELK stack versions did you use? what proxmox version?
did you use influxdb definition in /etc/pve/status.cfg?