Script to get Snapshots from Ceph and Merge it with VM-Name

K

kev1904

Well-Known Member
Feb 11, 2019
61
4
48
32
I make a smal but Helpfull Script to get Snapshots from ceph.


Bash: 
#!/bin/bash


vmlist=$(pvesh get /cluster/resources --type vm --output-format json)
declare -A snapshots

vmcount=$(echo "${vmlist}" | jq '. | length')
for (( i = 0; i < ${vmcount}; i++ ))
do
  vminfo=$(echo "${vmlist}" | jq ".[$i]")
  vmid=$(echo "${vminfo}" | jq ".vmid")
  vmname=$(echo "${vminfo}" | jq ".name" | sed 's/"//g')
  snapshots["${vmid}"]="${vmname}"
done

printf "%4s %-20s %s\n" "ID" "VM-Name" "Snapshot-Name"

for stor in "CEPH-POOL1" "CEPH-POOL2"
do
  snaplist=$(rbd ls -l "${stor}" | awk '{print $1}' | grep @ | grep -v base)
 
  while read -r snap
  do
    vmid=$(echo "${snap}" | cut -d '-' -f 2)
    vmname=${snapshots[${vmid}]}
    snapname=$(echo "${snap}" | cut -d '@' -f 2)
    printf "%4d %-20s %s\n" ${vmid} ${vmname} ${snapname}
  done < <(echo "${snaplist}")
done

exit 0

Output is like this:

root@proxstore1:~# ./getsnap.sh
ID VM-Name Snapshot-Name
125 VMname6 snap1
126 VMname5 snap2
127 VMname3 snap3
128 VMname4 snap4
129 VMname2 snap5
130 VMname1 snap6
 
Last edited:
  • Like
Reactions: VictorSTS and itNGO
Good job!

I would add a "preflight" or "safety" check for "jq", as it is not installed by default:

Code: 
command -v jq > /dev/null || { echo "ERROR: jq not found!! ABORTING" 2>&1; exit 1; }

Also, it would be nice that the script looks for the storage names by itself instead of relying on a variable.
 
  • Like
Reactions: kev1904
We do something similar, just not via the API, to get a list of Ceph RBD images we want to backup by searching for parts of the VM names:

Code: 
get_disk () {
  # Limit to first 25 lines to hopefully avoid including snapshot images
  # Convert template clone names to rbd names   ie: rbd_hdd:base-116-disk-0/vm-117-disk-0 -> rbd_hdd/vm-117-disk-0
  # Convert vm disk names to rbd names          ie: rbd_hdd:vm-103-disk-0                 -> rbd_hdd/vm-103-disk-0
  for vmconf in /etc/pve/nodes/*/qemu-server/$1.conf; do
    head -n 25 $vmconf | grep disk- | perl -pe 's/^\S+ (.*?):(.*?),.*/\1\/\2/g;s/(.*)\/.*(\/.*)/\1\2/g;' | sort | uniq;
  done
}

network_ceph_backup () {
  name=`grep name /etc/pve/nodes/*/qemu-server/$1.conf | head -n 1 | perl -pe 's/.*name:\s+(.*)/\1/g'`;
  num=0;
  for disk in `get_disk $1`; do
    IFS='/' read pool image <<< $disk;
    echo benji::backup::ceph "$name""-disk$num" "$pool" "$image" "AutomatedBackup";
    let "num++";
  done
}


# Backup appliances:
for f in /etc/pve/nodes/*/qemu-server/*.conf; do
  if [ `grep -Pc 'name:.*(firewall|router|sip|template)' $f` -gt 0 ]; then
    f=${f#/etc/*/qemu-server/};
    f=${f%.conf};
    network_ceph_backup $f;
  fi;
done

Sample output:
Code: 
benji::backup::ceph abc-sip-disk0 rbd_ssd vm-168-disk-0 AutomatedBackup
benji::backup::ceph def-router-disk0 rbd_ssd vm-248-disk-0 AutomatedBackup
benji::backup::ceph ghi-firewall-disk0 rbd_ssd vm-291-disk-0 AutomatedBackup
benji::backup::ceph jkl-sip-mysql-disk0 rbd_ssd vm-332-disk-0 AutomatedBackup
benji::backup::ceph mno-template-disk0 rbd_ssd vm-397-disk-0 AutomatedBackup
 
The following sort of does this in reverse, it connects to each node in the cluster and collects 2 minutes worth of 'iostat' results before then parsing the output by making reference to the VM name:

Code: 
#!/bin/bash
time='60';
filter='rbd_';

function getstats() {
  for host in `ls -1A /etc/pve/nodes`; do
    if [[ "$HOSTNAME" == "$host" ]]; then
      iostat -xkdy $time 1 | grep '^rbd' > /tmp/"$host"_iostat &
    else
      ( ssh -o StrictHostKeyChecking=no admin@$host "iostat -xkdy $time 1 | grep '^rbd'" > /tmp/"$host"_iostat ) &
    fi
  done
  sleep $[$time+5];
}

function getrbdnames() {
  rm -f /tmp/io_stats;
  for file in /tmp/*_iostat; do
    temp=${file#/tmp/};
    host=${temp%_iostat};
    if [[ "$HOSTNAME" == "$host" ]]; then
      rbd showmapped | grep -P '^\d+\s+' | perl -pe 's/\d+\s+(\S+)\s+(\S+).*\/dev\/(\S+).*/\3 \1\\\\\/\2/g' | while read dev name; do
        perl -i -pe "s/^$dev\s+/$name\t/g" $file;
      done
    else
      ssh -o StrictHostKeyChecking=no admin@$host "rbd showmapped" | grep -P '^\d+\s+' | perl -pe 's/\d+\s+(\S+)\s+(\S+).*\/dev\/(\S+).*/\3 \1\\\\\/\2/g' | while read dev name; do
        perl -i -pe "s/^$dev\s+/$name\t/g" $file;
      done
    fi
    grep $filter $file >> /tmp/io_stats;
    rm -f $file;
  done
}

function getvmnames() {
  cat /tmp/io_stats | while read block other; do
    temp=${block#*/*-};
    id=${temp%-disk*};
    temp=`grep -m1 name /etc/pve/nodes/*/qemu-server/$id.conf 2> /dev/null`;
    [ $? -ne 0 ] && temp='name: unknown';
    block=`echo $block | perl -nle 'print quotemeta'`;
    name=`printf "%-30s" ${temp#name: } | perl -nle 'print quotemeta'`;
    perl -i -pe "s/^($block)/$name\t\1/g" /tmp/io_stats;
  done
}

function showtop() {
  for fields in \
    '5 rrqm merged read requests per second' \
    '3 r/s reads per second' \
    '4 rkB/s KB read per second' \
    '11 wrqm merged write requests per second' \
    '9 w/s writes per second' \
    '10 wkB/s KB written per second'; do
    echo $fields | while read column name desc; do
      echo -e "Top $name ($desc):";
      echo "vm_name                         ceph_rbd_image           r/s     rkB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wkB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dkB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util";
      sort -g -k $column -r /tmp/io_stats | head -n 15;
      echo -e "\n";
    done
  done
}

case "$1" in
  g|-g|--get)
    getstats;
    getrbdnames; # Replace block device references and consolidate
    getvmnames;  # Prefix VM name
  ;;
  t|-t|--top)
    showtop;
  ;;
  *)
    echo "Argument does not define any operation."
    echo "";
    echo "g|-g|--get    Get cluster IO statistics, for $time seconds";
    echo "t|-t|--top    Show top VM disc statistics, for last 'get'";
    echo "";
    echo "Auxiliary commands:";
    echo "  for f in 180 235; do echo -n \"\$f: \"; grep name /etc/pve/nodes/*/qemu-server/\$f.conf; done";
  ;;
esac


Sample output:
Code: 
[admin@kvm5a ~]# ./aggregate-disk-io g; ./aggregate-disk-io t
Top rrqm (merged read requests per second):
vm_name                         ceph_rbd_image           r/s     rkB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wkB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dkB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
abcdefghijklmnopqrstuvwx        rbd_ssd/vm-420-disk-0   0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.00   0.00
abcdefghijklmnopqrstuvw2        rbd_ssd/vm-419-disk-0   0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.00   0.00
abcdefgh                        rbd_ssd/vm-169-disk-1   0.02      0.07     0.00   0.00    1.00     4.00    0.23      1.87     0.23  50.00    3.57     8.00    0.02      0.07     0.00   0.00    0.00     4.00    0.00    0.00    0.00   0.07
abcdefghi                       rbd_ssd/vm-238-disk-1   0.02      0.07     0.00   0.00    2.00     4.00    0.22      1.13     0.07  23.53    3.31     5.23    0.02      0.07     0.00   0.00    0.00     4.00    0.00    0.00    0.00   0.07
abcdefghijklmnopqr              rbd_ssd/vm-126-disk-1   0.00      0.00     0.00   0.00    0.00     0.00    0.07      0.60     0.08  55.56    3.75     9.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.00   0.03
abcdefghijklmnopqrs             rbd_ssd/vm-457-disk-0   0.00      0.00     0.00   0.00    0.00     0.00    2.08     31.07     5.68  73.18    5.10    14.91    0.05      0.20     0.00   0.00    0.00     4.00    0.00    0.00    0.01   0.41
abcdefghijklmnopqrstuvw3        rbd_ssd/vm-455-disk-0   0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.00   0.00
abcdefghijklm                   rbd_ssd/vm-440-disk-0   0.03      0.13     0.00   0.00    1.00     4.00    0.40     13.93     3.08  88.52    5.08    34.83    0.15     11.53     0.07  30.77    1.89    76.89    0.00    0.00    0.00   0.12
abcdefghijklmnop                rbd_ssd/vm-414-disk-0   0.00      0.00     0.00   0.00    0.00     0.00    2.83     45.67     8.58  75.18    4.92    16.12    0.08      3.60     0.03  28.57    1.60    43.20    0.00    0.00    0.01   0.61
abcdefghijklmnopqrstu           rbd_ssd/vm-227-disk-0   0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.00   0.00
abcdefghijklmnopqr              rbd_ssd/vm-222-disk-0   0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.00   0.00
abcdefghijk                     rbd_ssd/vm-310-disk-0   0.00      0.00     0.00   0.00    0.00     0.00    3.50     32.20     4.55  56.52   19.79     9.20    0.08      0.33     0.00   0.00    0.00     4.00    0.00    0.00    0.07   0.67
abcdefghijklmnop                rbd_ssd/vm-309-disk-0   0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.00   0.00
abcdefghijklm                   rbd_ssd/vm-349-disk-0   0.08      0.33     0.00   0.00    1.00     4.00    2.75     38.73     6.93  71.60    4.81    14.08    0.12      0.93     0.00   0.00    0.14     8.00    0.00    0.00    0.01   0.65
abcdefghijklmn                  rbd_ssd/vm-425-disk-1   0.00      0.00     0.00   0.00    0.00     0.00    0.17      1.13     0.12  41.18    8.20     6.80    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.00   0.08


Top r/s (reads per second):
vm_name                         ceph_rbd_image           r/s        rkB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wkB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dkB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
abcdefghijkl                    rbd_ssd/vm-391-disk-3   1159.13 295348.67     0.00   0.00    8.25   254.80    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    9.56  99.39
abcdefghijklmnopq2              rbd_ssd/vm-374-disk-1   1049.48 134232.00     0.00   0.00    1.59   127.90    1.48     66.27    15.08  91.05    4.71    44.67    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.68  99.51
abcdefghijk5                    rbd_ssd/vm-393-disk-2   950.87  121403.60     0.00   0.00    1.74   127.68    0.40      4.67     0.77  65.71    5.42    11.67    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.65  99.71
abcdefghijklmnopqr              rbd_ssd/vm-286-disk-2   368.07   30465.53     0.00   0.00    1.49    82.77  131.28   6356.47  1457.83  91.74    3.94    48.42    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.07  93.60
abcdefghijkl                    rbd_ssd/vm-391-disk-4   214.65     858.60     0.00   0.00    1.01     4.00   16.55  55158.60 13773.10  99.88   36.29  3332.85    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.82  36.17
abcdefghijklmnop                rbd_ssd/vm-336-disk-0   98.12     2554.80     0.00   0.00    1.21    26.04   17.32    241.07    42.95  71.27    7.74    13.92    0.13      6.00     0.10  42.86    0.00    45.00    0.00    0.00    0.25  22.21
abcdefghijklmnop                rbd_ssd/vm-336-disk-1   77.42     2464.33     0.00   0.00    1.43    31.83   32.48   2847.80   677.57  95.43   17.91    87.67  329.30 1340659.47     0.00   0.00    0.30  4071.24    0.00    0.00    0.79  18.23
abcdefghijkl                    rbd_ssd/vm-391-disk-2   62.40     2218.80     0.00   0.00    6.83    35.56    0.20      0.80     0.00   0.00    8.17     4.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.43   2.36
abcdefghijk                     rbd_ssd/vm-356-disk-1   20.83       91.27     0.00   0.00    0.78     4.38    9.45    304.53    66.68  87.59    4.05    32.23    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.05   9.11
abcdefghijk7                    rbd_ssd/vm-343-disk-1   15.55     3621.87     0.00   0.00    3.71   232.92    2.20    562.81   138.52  98.44    6.63   255.82    0.12      0.80     0.00   0.00    0.00     6.86    0.00    0.00    0.07   3.80
abcdefghijklmno2                rbd_ssd/vm-421-disk-1   12.63       68.33     0.00   0.00    3.57     5.41    0.77     11.53     2.12  73.41    3.87    15.04    0.13      6.73     0.07  33.33    0.88    50.50    0.00    0.00    0.05   2.37
abcdefghijklmnop2               rbd_ssd/vm-179-disk-1   10.02       69.73     0.00   0.00    1.22     6.96    2.73     18.27     1.83  40.15    3.52     6.68    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.02   1.97
abcdefghijk8                    rbd_ssd/vm-364-disk-1   4.32       157.67     0.00   0.00    0.96    36.53    0.55      4.33     0.53  49.23    3.85     7.88    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.01   0.79
abcdefghijklmnop                rbd_ssd/vm-163-disk-0   4.13       187.87     0.00   0.00    1.82    45.45   13.48    510.13   114.05  89.43    4.58    37.83    0.02      0.07     0.00   0.00    0.00     4.00    0.00    0.00    0.07   3.07
abcdefghij3                     rbd_ssd/vm-381-disk-0   3.93        15.73     0.00   0.00    0.73     4.00    8.72    121.93    21.77  71.41    5.94    13.99    1.15     68.53     0.98  46.09    0.19    59.59    0.00    0.00    0.05   1.70


Top rkB/s (KB read per second):
vm_name                         ceph_rbd_image           r/s        rkB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wkB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dkB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
abcdefghijkl                    rbd_ssd/vm-391-disk-3   1159.13 295348.67     0.00   0.00    8.25   254.80    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    9.56  99.39
abcdefghijklmnopq2              rbd_ssd/vm-374-disk-1   1049.48 134232.00     0.00   0.00    1.59   127.90    1.48     66.27    15.08  91.05    4.71    44.67    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.68  99.51
abcdefghijk5                    rbd_ssd/vm-393-disk-2   950.87  121403.60     0.00   0.00    1.74   127.68    0.40      4.67     0.77  65.71    5.42    11.67    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.65  99.71
abcdefghijklmnopqr              rbd_ssd/vm-286-disk-2   368.07   30465.53     0.00   0.00    1.49    82.77  131.28   6356.47  1457.83  91.74    3.94    48.42    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.07  93.60
abcdefghijk7                    rbd_ssd/vm-343-disk-1   15.55     3621.87     0.00   0.00    3.71   232.92    2.20    562.81   138.52  98.44    6.63   255.82    0.12      0.80     0.00   0.00    0.00     6.86    0.00    0.00    0.07   3.80
abcdefghijklmnop                rbd_ssd/vm-336-disk-0   98.12     2554.80     0.00   0.00    1.21    26.04   17.32    241.07    42.95  71.27    7.74    13.92    0.13      6.00     0.10  42.86    0.00    45.00    0.00    0.00    0.25  22.21
abcdefghijklmnop                rbd_ssd/vm-336-disk-1   77.42     2464.33     0.00   0.00    1.43    31.83   32.48   2847.80   677.57  95.43   17.91    87.67  329.30 1340659.47     0.00   0.00    0.30  4071.24    0.00    0.00    0.79  18.23
abcdefghijkl                    rbd_ssd/vm-391-disk-2   62.40     2218.80     0.00   0.00    6.83    35.56    0.20      0.80     0.00   0.00    8.17     4.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.43   2.36
abcdefghijkl                    rbd_ssd/vm-391-disk-4   214.65     858.60     0.00   0.00    1.01     4.00   16.55  55158.60 13773.10  99.88   36.29  3332.85    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.82  36.17
abcdefghijklmnop                rbd_ssd/vm-163-disk-0   4.13       187.87     0.00   0.00    1.82    45.45   13.48    510.13   114.05  89.43    4.58    37.83    0.02      0.07     0.00   0.00    0.00     4.00    0.00    0.00    0.07   3.07
abcdefghijk8                    rbd_ssd/vm-364-disk-1   4.32       157.67     0.00   0.00    0.96    36.53    0.55      4.33     0.53  49.23    3.85     7.88    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.01   0.79
abcdefghijk                     rbd_ssd/vm-356-disk-1   20.83       91.27     0.00   0.00    0.78     4.38    9.45    304.53    66.68  87.59    4.05    32.23    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.05   9.11
abcdefghijk5                    rbd_ssd/vm-393-disk-0   1.55        91.20     0.00   0.00    1.18    58.84    4.12     81.73    16.32  79.85    4.18    19.85    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.02   2.45
abcdefghijkl                    rbd_ssd/vm-391-disk-1   3.02        75.93     0.00   0.00    3.27    25.17   12.20    550.47   125.42  91.13    4.97    45.12    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.07   4.86
abcdefghijklmnopq2              rbd_ssd/vm-374-disk-0   1.90        71.40     0.00   0.00    1.45    37.58    6.92    161.60    33.48  82.88    4.96    23.36    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.04   1.84
 
  • Like
Reactions: VictorSTS and kev1904
Continued:
Code: 
Top wrqm (merged write requests per second):
vm_name                         ceph_rbd_image           r/s       rkB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wkB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dkB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
abcdefghijkl                    rbd_ssd/vm-391-disk-4   214.65    858.60     0.00   0.00    1.01     4.00   16.55  55158.60 13773.10  99.88   36.29  3332.85    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.82  36.17
abcdefghijklmnopqr              rbd_ssd/vm-286-disk-2   368.07  30465.53     0.00   0.00    1.49    82.77  131.28   6356.47  1457.83  91.74    3.94    48.42    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.07  93.60
abcdefghijk2                    rbd_ssd/vm-370-disk-0   0.45        2.73     0.00   0.00    0.85     6.07    5.23   3283.53   815.65  99.36   11.32   627.43    0.52     47.73     0.22  29.55    1.55    92.39    0.00    0.00    0.06   1.76
abcdefghijk3                    rbd_nvme/vm-295-disk-2  0.00        0.00     0.00   0.00    0.00     0.00   71.07   3124.33   690.83  90.67    1.63    43.96    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.12  20.42
abcdefghijklmnop                rbd_ssd/vm-336-disk-1   77.42    2464.33     0.00   0.00    1.43    31.83   32.48   2847.80   677.57  95.43   17.91    87.67  329.30 1340659.47     0.00   0.00    0.30  4071.24    0.00    0.00    0.79  18.23
abcdefghijk4                    rbd_ssd/vm-449-disk-1   0.57        3.73     0.00   0.00    1.74     6.59  113.45   2860.87   601.68  84.14    9.55    25.22   18.10  20972.00     1.28   6.62    4.50  1158.67    0.00    0.00    1.17  18.25
abcdefghijk3                    rbd_ssd/vm-295-disk-1   0.00        0.00     0.00   0.00    0.00     0.00   60.57   2057.13   419.78  87.39    9.20    33.96    3.13    765.07     0.22   6.47    0.94   244.17    0.00    0.00    0.56   7.63
abcdefghijk5                    rbd_ssd/vm-448-disk-0   0.77        4.07     0.00   0.00    1.07     5.30  123.20   1623.53   282.85  69.66    4.95    13.18    5.12   1539.93     1.43  21.88    1.99   300.96    0.00    0.00    0.62  38.52
abcdefghijkl6                   rbd_ssd/vm-450-disk-1   0.00        0.00     0.00   0.00    0.00     0.00   79.73   1445.87   281.73  77.94    6.28    18.13   41.03    917.80     1.88   4.39    0.11    22.37    0.00    0.00    0.50  40.87
abcdefghijk6                    rbd_ssd/vm-447-disk-0   0.00        0.00     0.00   0.00    0.00     0.00   95.77   1255.93   217.93  69.47    4.78    13.11    1.37   2453.47     0.58  29.91    1.32  1795.22    0.00    0.00    0.46  34.45
abcdefghij                      rbd_ssd/vm-146-disk-1   1.10       48.33     0.00   0.00    1.21    43.94   24.38    840.93   185.85  88.40    5.13    34.49    0.03      0.53     0.00   0.00    0.00    16.00    0.00    0.00    0.13   4.53
abcdefghijklmnopq               rbd_ssd/vm-338-disk-0   0.08        0.33     0.00   0.00    0.80     4.00   31.70    733.00   151.55  82.70   13.49    23.12    0.07      0.27     0.00   0.00    0.00     4.00    0.00    0.00    0.43   2.49
abcdefghijk7                    rbd_ssd/vm-343-disk-1   15.55    3621.87     0.00   0.00    3.71   232.92    2.20    562.81   138.52  98.44    6.63   255.82    0.12      0.80     0.00   0.00    0.00     6.86    0.00    0.00    0.07   3.80
abcdefghijklmnopqrstuvw         rbd_ssd/vm-100-disk-0   0.80        3.20     0.00   0.00    1.17     4.00    7.27    561.67   133.15  94.82   11.78    77.29    1.95     25.87     0.07   3.31    0.18    13.26    0.00    0.00    0.09   2.44
abcdefghijklmno5                rbd_ssd/vm-427-disk-0   0.38        9.40     0.00   0.00    0.96    24.52   21.42    609.67   131.00  85.95    4.37    28.47    0.17      1.33     0.00   0.00    0.10     8.00    0.00    0.00    0.09   7.99


Top w/s (writes per second):
vm_name                         ceph_rbd_image           r/s       rkB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wkB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dkB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
abcdefghijklmnopqr              rbd_ssd/vm-286-disk-2   368.07  30465.53     0.00   0.00    1.49    82.77  131.28   6356.47  1457.83  91.74    3.94    48.42    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.07  93.60
abcdefghijk5                    rbd_ssd/vm-448-disk-0   0.77        4.07     0.00   0.00    1.07     5.30  123.20   1623.53   282.85  69.66    4.95    13.18    5.12   1539.93     1.43  21.88    1.99   300.96    0.00    0.00    0.62  38.52
abcdefghijk4                    rbd_ssd/vm-449-disk-1   0.57        3.73     0.00   0.00    1.74     6.59  113.45   2860.87   601.68  84.14    9.55    25.22   18.10  20972.00     1.28   6.62    4.50  1158.67    0.00    0.00    1.17  18.25
abcdefghijk6                    rbd_ssd/vm-447-disk-0   0.00        0.00     0.00   0.00    0.00     0.00   95.77   1255.93   217.93  69.47    4.78    13.11    1.37   2453.47     0.58  29.91    1.32  1795.22    0.00    0.00    0.46  34.45
abcdefghijkl6                   rbd_ssd/vm-450-disk-1   0.00        0.00     0.00   0.00    0.00     0.00   79.73   1445.87   281.73  77.94    6.28    18.13   41.03    917.80     1.88   4.39    0.11    22.37    0.00    0.00    0.50  40.87
abcdefghijk3                    rbd_nvme/vm-295-disk-2  0.00        0.00     0.00   0.00    0.00     0.00   71.07   3124.33   690.83  90.67    1.63    43.96    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.12  20.42
abcdefghijk3                    rbd_ssd/vm-295-disk-1   0.00        0.00     0.00   0.00    0.00     0.00   60.57   2057.13   419.78  87.39    9.20    33.96    3.13    765.07     0.22   6.47    0.94   244.17    0.00    0.00    0.56   7.63
abcdefghijk4                    rbd_ssd/vm-449-disk-0   0.00        0.00     0.00   0.00    0.00     0.00   34.05    405.53    67.32  66.41    4.76    11.91    4.27    652.47     1.25  22.66    0.14   152.92    0.00    0.00    0.16   5.58
abcdefghijk8                    rbd_ssd/vm-260-disk-1   0.48        2.87     0.00   0.00    1.45     5.93   33.18    354.80    55.53  62.60    3.24    10.69    2.28     38.93     0.23   9.27    0.01    17.05    0.00    0.00    0.11  10.67
abcdefghijklmnop                rbd_ssd/vm-336-disk-1   77.42    2464.33     0.00   0.00    1.43    31.83   32.48   2847.80   677.57  95.43   17.91    87.67  329.30 1340659.47     0.00   0.00    0.30  4071.24    0.00    0.00    0.79  18.23
abcdefghijklmnopq               rbd_ssd/vm-338-disk-0   0.08        0.33     0.00   0.00    0.80     4.00   31.70    733.00   151.55  82.70   13.49    23.12    0.07      0.27     0.00   0.00    0.00     4.00    0.00    0.00    0.43   2.49
abcdefghij                      rbd_ssd/vm-146-disk-1   1.10       48.33     0.00   0.00    1.21    43.94   24.38    840.93   185.85  88.40    5.13    34.49    0.03      0.53     0.00   0.00    0.00    16.00    0.00    0.00    0.13   4.53
abcdefghijklmnopqr              rbd_ssd/vm-286-disk-1   0.15        0.80     0.00   0.00    1.44     5.33   21.68    377.27    72.63  77.01   10.80    17.40    0.35      1.40     0.00   0.00    0.05     4.00    0.00    0.00    0.23   2.21
abcdefghijklmno5                rbd_ssd/vm-427-disk-0   0.38        9.40     0.00   0.00    0.96    24.52   21.42    609.67   131.00  85.95    4.37    28.47    0.17      1.33     0.00   0.00    0.10     8.00    0.00    0.00    0.09   7.99
abcdefghijklmnop                rbd_ssd/vm-336-disk-0   98.12    2554.80     0.00   0.00    1.21    26.04   17.32    241.07    42.95  71.27    7.74    13.92    0.13      6.00     0.10  42.86    0.00    45.00    0.00    0.00    0.25  22.21


Top wkB/s (KB written per second):
vm_name                         ceph_rbd_image           r/s       rkB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wkB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dkB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
abcdefghijkl                    rbd_ssd/vm-391-disk-4   214.65    858.60     0.00   0.00    1.01     4.00   16.55  55158.60 13773.10  99.88   36.29  3332.85    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.82  36.17
abcdefghijklmnopqr              rbd_ssd/vm-286-disk-2   368.07  30465.53     0.00   0.00    1.49    82.77  131.28   6356.47  1457.83  91.74    3.94    48.42    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    1.07  93.60
abcdefghijk2                    rbd_ssd/vm-370-disk-0   0.45        2.73     0.00   0.00    0.85     6.07    5.23   3283.53   815.65  99.36   11.32   627.43    0.52     47.73     0.22  29.55    1.55    92.39    0.00    0.00    0.06   1.76
abcdefghijk3                    rbd_nvme/vm-295-disk-2  0.00        0.00     0.00   0.00    0.00     0.00   71.07   3124.33   690.83  90.67    1.63    43.96    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.12  20.42
abcdefghijk4                    rbd_ssd/vm-449-disk-1   0.57        3.73     0.00   0.00    1.74     6.59  113.45   2860.87   601.68  84.14    9.55    25.22   18.10  20972.00     1.28   6.62    4.50  1158.67    0.00    0.00    1.17  18.25
abcdefghijklmnop                rbd_ssd/vm-336-disk-1   77.42    2464.33     0.00   0.00    1.43    31.83   32.48   2847.80   677.57  95.43   17.91    87.67  329.30 1340659.47     0.00   0.00    0.30  4071.24    0.00    0.00    0.79  18.23
abcdefghijk3                    rbd_ssd/vm-295-disk-1   0.00        0.00     0.00   0.00    0.00     0.00   60.57   2057.13   419.78  87.39    9.20    33.96    3.13    765.07     0.22   6.47    0.94   244.17    0.00    0.00    0.56   7.63
abcdefghijk5                    rbd_ssd/vm-448-disk-0   0.77        4.07     0.00   0.00    1.07     5.30  123.20   1623.53   282.85  69.66    4.95    13.18    5.12   1539.93     1.43  21.88    1.99   300.96    0.00    0.00    0.62  38.52
abcdefghijkl6                   rbd_ssd/vm-450-disk-1   0.00        0.00     0.00   0.00    0.00     0.00   79.73   1445.87   281.73  77.94    6.28    18.13   41.03    917.80     1.88   4.39    0.11    22.37    0.00    0.00    0.50  40.87
abcdefghijk6                    rbd_ssd/vm-447-disk-0   0.00        0.00     0.00   0.00    0.00     0.00   95.77   1255.93   217.93  69.47    4.78    13.11    1.37   2453.47     0.58  29.91    1.32  1795.22    0.00    0.00    0.46  34.45
abcdefghij                      rbd_ssd/vm-146-disk-1   1.10       48.33     0.00   0.00    1.21    43.94   24.38    840.93   185.85  88.40    5.13    34.49    0.03      0.53     0.00   0.00    0.00    16.00    0.00    0.00    0.13   4.53
abcdefghijklmnopq               rbd_ssd/vm-338-disk-0   0.08        0.33     0.00   0.00    0.80     4.00   31.70    733.00   151.55  82.70   13.49    23.12    0.07      0.27     0.00   0.00    0.00     4.00    0.00    0.00    0.43   2.49
abcdefghijklmno5                rbd_ssd/vm-427-disk-0   0.38        9.40     0.00   0.00    0.96    24.52   21.42    609.67   131.00  85.95    4.37    28.47    0.17      1.33     0.00   0.00    0.10     8.00    0.00    0.00    0.09   7.99
abcdefghijk7                    rbd_ssd/vm-343-disk-1   15.55    3621.87     0.00   0.00    3.71   232.92    2.20    562.81   138.52  98.44    6.63   255.82    0.12      0.80     0.00   0.00    0.00     6.86    0.00    0.00    0.07   3.80
abcdefghijklmnopqrstuvw         rbd_ssd/vm-100-disk-0   0.80        3.20     0.00   0.00    1.17     4.00    7.27    561.67   133.15  94.82   11.78    77.29    1.95     25.87     0.07   3.31    0.18    13.26    0.00    0.00    0.09   2.44
 
  • Like
Reactions: kev1904
You must log in or register to reply here.
Top Bottom