One thing you could attempt, would be to use relaxed ordering. That needs to be set in the BIOS and on the Mellonx cards. Yet, on our system that didn't yield any benefit. But I assume that for one the CPU doesn't have enough cores per complex and that our 100 GbE cards are ConnectX-4.
#!/bin/bash
LOGDIR=/root
exec >$LOGDIR/$(basename $0 .sh)-$(date +%F-%H_%M).log
exec 2>$LOGDIR/$(basename $0 .sh)-$(date +%F-%H_%M).err
BLOCKSIZES="4M 64K 8K 4K"
for BS in $BLOCKSIZES; do
TEST="rados bench 600 --pool ceph-proxmox-VMs write --run-name $(hostname) -t 16 --no-cleanup -b $BS"
echo ${TEST}
eval ${TEST}
sleep 120
TEST="rados bench 600 --pool ceph-proxmox-VMs seq --run-name $(hostname) -t 16"
echo ${TEST}
eval ${TEST}
sleep 120
doneWell, just don't.
Packages from the pve-no-subscription repository will mostly land in the pve-enterprise. It's the most widely used repository and if no issues arise the package gets pushed to pve-enterprise.At some point a reissue will not be possible and it has to be manually unlocked.
The data for these graphs is collected by Zabbix agents into a Zabbix DB. From there I used the Zabbix plugin in Grafana. Our decision to use Zabbix is 10 years old and we moved away from Nagios. As long as we are still able to monitor everything (really everything!) in Zabbix we do not even look at other solutions.
