PBS 4.0.12 and Metric

G

gislard33

New Member
Aug 1, 2025
7
1
3
Hello,

I'm having a little trouble setting up metrics in PBS 4.0.12. I configured my InfluxDB metric as follows
Code: 
influxdb-http: InfluxDBPBS
        bucket Bucket
        comment InfluxDB/Grafana
        organization MyOrg
        token VNiqXlGi5JnV6tSOGcN2l7U0vweErEEerFuUob1qtHx1D2sbjtnAsYoXMAy8LKL9itsUcVLY0zlbcwa0TZY7XDg==
        url http://xxx.xxx.xxx.xxx:8086.
InfluxDB is 2.7.11.

The proxmox-backup-proxy.service and proxmox-backup.service services do not display any errors, nor do the logs,

yet I do not see any transactions to my InfluxDB database. The bucket, organization, and token are OK and work via a direct curl request to my InfluxDB database: have I missed something?

Thank you for your help.
Best regards,
David
 
I tried to reproduce this here, also with Proxmox Backup Server 4.0.12 and InfluxDB 2.7.11 (installed via Docker). Works fine here.
Just to be sure, are you positive that journalctl -u proxmox-backup-proxy does not show any errors concerning metric servers/influx?

Could you provide me with the output of proxmox-backup-manager versions --verbose ?

Thanks!
 
Thanks for your reply. here the version
Code: 
proxmox-backup-manager versions --verbose
proxmox-backup                      4.0.0        running kernel: 6.14.8-2-pve
proxmox-backup-server               4.0.12-1     running version: 4.0.12
proxmox-kernel-helper               9.0.3
proxmox-kernel-6.14.8-2-pve-signed  6.14.8-2
proxmox-kernel-6.14                 6.14.8-2
proxmox-kernel-6.8.12-13-pve-signed 6.8.12-13
proxmox-kernel-6.8                  6.8.12-13
proxmox-kernel-6.8.12-9-pve-signed  6.8.12-9
ifupdown2                           3.3.0-1+pmx9
libjs-extjs                         7.0.0-5
proxmox-backup-docs                 4.0.12-1
proxmox-backup-client               4.0.12-1
proxmox-mail-forward                1.0.2
proxmox-mini-journalreader          1.6
proxmox-offline-mirror-helper       0.7.0
proxmox-widget-toolkit              5.0.5
pve-xtermjs                         5.5.0-2
smartmontools                       7.4-pve1
zfsutils-linux                      2.3.3-pve1
i restart proxmox-backup-proxy. here the journal :
Code: 
systemctl restart proxmox-backup-proxy.service
root@proxmoxbackup-bdx:~# journalctl -u proxmox-backup-proxy -f
Aug 11 15:36:31 proxmoxbackup-bdx systemd[1]: Stopping proxmox-backup-proxy.service - Proxmox Backup API Proxy Server...
Aug 11 15:36:31 proxmoxbackup-bdx systemd[1]: proxmox-backup-proxy.service: Deactivated successfully.
Aug 11 15:36:31 proxmoxbackup-bdx systemd[1]: Stopped proxmox-backup-proxy.service - Proxmox Backup API Proxy Server.
Aug 11 15:36:31 proxmoxbackup-bdx systemd[1]: proxmox-backup-proxy.service: Consumed 24.703s CPU time, 28.7M memory peak.
Aug 11 15:36:31 proxmoxbackup-bdx systemd[1]: Starting proxmox-backup-proxy.service - Proxmox Backup API Proxy Server...
Aug 11 15:36:31 proxmoxbackup-bdx proxmox-backup-proxy[58287]: catching shutdown signal
Aug 11 15:36:31 proxmoxbackup-bdx proxmox-backup-proxy[58287]: catching reload signal
Aug 11 15:36:31 proxmoxbackup-bdx systemd[1]: Started proxmox-backup-proxy.service - Proxmox Backup API Proxy Server.
Aug 11 15:36:31 proxmoxbackup-bdx proxmox-backup-proxy[58287]: applied rrd journal (1782 entries in 0.015 seconds)
Aug 11 15:36:31 proxmoxbackup-bdx proxmox-backup-proxy[58287]: rrd journal successfully committed (20 files in 0.087 seconds)
and the status
Code: 
proxmox-backup-proxy.service - Proxmox Backup API Proxy Server
     Loaded: loaded (/usr/lib/systemd/system/proxmox-backup-proxy.service; enabled; preset: enabled)
     Active: active (running) since Mon 2025-08-11 15:36:31 CEST; 2min 43s ago
 Invocation: 5ca81089e76c41988744b36e1280114e
   Main PID: 58287 (proxmox-backup-)
      Tasks: 6 (limit: 2217)
     Memory: 9.7M (peak: 10.5M)
        CPU: 652ms
     CGroup: /system.slice/proxmox-backup-proxy.service
             └─58287 /usr/lib/x86_64-linux-gnu/proxmox-backup/proxmox-backup-proxy

Aug 11 15:36:31 proxmoxbackup-bdx systemd[1]: Starting proxmox-backup-proxy.service - Proxmox Backup API Proxy Server...
Aug 11 15:36:31 proxmoxbackup-bdx proxmox-backup-proxy[58287]: catching shutdown signal
Aug 11 15:36:31 proxmoxbackup-bdx proxmox-backup-proxy[58287]: catching reload signal
Aug 11 15:36:31 proxmoxbackup-bdx systemd[1]: Started proxmox-backup-proxy.service - Proxmox Backup API Proxy Server.
Aug 11 15:36:31 proxmoxbackup-bdx proxmox-backup-proxy[58287]: applied rrd journal (1782 entries in 0.015 seconds)
Aug 11 15:36:31 proxmoxbackup-bdx proxmox-backup-proxy[58287]: rrd journal successfully committed (20 files in 0.087 seconds)

● proxmox-backup.service - Proxmox Backup API Server
     Loaded: loaded (/usr/lib/systemd/system/proxmox-backup.service; enabled; preset: enabled)
     Active: active (running) since Mon 2025-08-11 12:59:57 CEST; 2h 39min ago
 Invocation: 4f70ef59a39a469589cf338c82c47fb3
   Main PID: 28988 (proxmox-backup-)
      Tasks: 5 (limit: 2217)
     Memory: 20.9M (peak: 37.1M)
        CPU: 2min 28.951s
     CGroup: /system.slice/proxmox-backup.service
             └─28988 /usr/lib/x86_64-linux-gnu/proxmox-backup/proxmox-backup-api

Aug 11 12:59:57 proxmoxbackup-bdx systemd[1]: Starting proxmox-backup.service - Proxmox Backup API Server...
Aug 11 12:59:57 proxmoxbackup-bdx proxmox-backup-api[28988]: catching shutdown signal
Aug 11 12:59:57 proxmoxbackup-bdx proxmox-backup-api[28988]: catching reload signal
Aug 11 12:59:57 proxmoxbackup-bdx systemd[1]: Started proxmox-backup.service - Proxmox Backup API Server.
Aug 11 13:31:08 proxmoxbackup-bdx login[34875]: pam_unix(login:session): session opened for user root(uid=0) by root(uid=0)
Aug 11 13:31:08 proxmoxbackup-bdx login[34875]: ROOT LOGIN ON pts/1

With PVE, i have no problems

Thanks!
 
nothing :
Code: 
journalctl -u influxdb -f
août 11 15:12:59 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:12:59.055275Z lvl=info msg="Pruning shard groups after retention check (start)" log_id=0yE6Y37W000 service=retention op_name=retention_delete_check op_name=retention_prune_shard_groups op_event=start
août 11 15:12:59 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:12:59.055296Z lvl=info msg="Pruning shard groups after retention check (end)" log_id=0yE6Y37W000 service=retention op_name=retention_delete_check op_name=retention_prune_shard_groups op_event=end op_elapsed=0.023ms
août 11 15:12:59 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:12:59.055328Z lvl=info msg="Retention policy deletion check (end)" log_id=0yE6Y37W000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.735ms
août 11 15:18:58 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:18:58.569488Z lvl=info msg="Cache snapshot (start)" log_id=0yE6Y37W000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot op_event=start
août 11 15:18:58 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:18:58.664146Z lvl=info msg="Snapshot for path written" log_id=0yE6Y37W000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot path=/var/lib/influxdb/engine/data/26b6a27828a3eef7/autogen/9 duration=94.669ms
août 11 15:18:58 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:18:58.664207Z lvl=info msg="Cache snapshot (end)" log_id=0yE6Y37W000 service=storage-engine engine=tsm1 op_name=tsm1_cache_snapshot op_event=end op_elapsed=94.737ms
août 11 15:42:59 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:42:59.054277Z lvl=info msg="Retention policy deletion check (start)" log_id=0yE6Y37W000 service=retention op_name=retention_delete_check op_event=start
août 11 15:42:59 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:42:59.054775Z lvl=info msg="Pruning shard groups after retention check (start)" log_id=0yE6Y37W000 service=retention op_name=retention_delete_check op_name=retention_prune_shard_groups op_event=start
août 11 15:42:59 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:42:59.054797Z lvl=info msg="Pruning shard groups after retention check (end)" log_id=0yE6Y37W000 service=retention op_name=retention_delete_check op_name=retention_prune_shard_groups op_event=end op_elapsed=0.024ms
août 11 15:42:59 grafana-bdx influxd-systemd-start.sh[1211]: ts=2025-08-11T13:42:59.054805Z lvl=info msg="Retention policy deletion check (end)" log_id=0yE6Y37W000 service=retention op_name=retention_delete_check op_event=end op_elapsed=0.543ms
Nothing, it's as if there were no requests?
 
Could you try running tcpdump -i any tcp dst port 8086 -v on the Proxmox Backup Server node for ~30 seconds and check if you see any outgoing connections to the InfluxDB Server?

The proxy process should be sending metrics every 10 seconds.
 
on my PBS :
Code: 
 tcpdump -nn -A dst xxx.xxx.xxx.196 and port 8086


 
07:52:29.441720 IP xxx.xxx.xxx.195.51954 > xxx.xxx.xxx.196.8086: Flags [P.], seq 0:1377, ack 1, win 502, options [nop,nop,TS val 3613379116 ecr 1480789342], length 1377
E.....@.@.:..~...~.......m..u.......0......
._.,XC.^POST /api/v2/write?org=MyORG&bucket=PBS HTTP/1.1
authorization: Token VNiqXlGi5JnV6tSOGcN2l7U0vwUxOuGjFuUob1qtDdddd2sbjtnAsYoXMAy8LKL9itsUcVLY0zlbcwa0TZY7XDg==
user-agent: proxmox-simple-http-client/0.1
host: xxx.xxx.xxx.196:8086
content-length: 1119

cpustat,object=host,host=proxmoxbackup-bdx avg1=0.05,avg15=0.0,avg5=0.05,cpu=0.024048096192384794,cpu_count=1,guest=0,guest_nice=0,idle=6828658,iowait=356035,iowait_percent=0.002,irq=0,nice=3,softirq=42828,steal=196,system=249419,total=7639635,user=162496 1754977949000000000
memory,host=proxmoxbackup-bdx,object=host memavailable=1601200128,memfree=1370624000,memshared=0,memtotal=2058657792,memused=457457664,swapfree=2095042560,swaptotal=2147479552,swapused=52436992 1754977949000000000
nics,object=host,instance=lo,host=proxmoxbackup-bdx device="lo",receive=79718280,send=79718280,ty="Virtual" 1754977949000000000
nics,host=proxmoxbackup-bdx,instance=ens18,object=host device="ens18",receive=229600751218,send=21619476293,ty="Physical" 1754977949000000000
blockstat,object=host,host=proxmoxbackup-bdx avail=36859252736,io_ticks=769,read_bytes=4740269056,read_ios=108703,total=43405893632,used=4308770816,write_bytes=1164402688,write_ios=239752 1754977949000000000
blockstat,host=proxmoxbackup-bdx,datastore=backupProxmox,object=host avail=11000344477696,total=23025551540224,used=12025207062528 1754977949000000000

07:52:29.444820 IP xxx.xxx.xxx.195.51954 > xxx.xxx.xxx.196.8086: Flags [.], ack 117, win 502, options [nop,nop,TS val 3613379119 ecr 1480789346], length 0
E..4..@.@.@I.~...~.......m.iu.......*......
._./XCb
07:52:29.445493 IP xxx.xxx.xxx.195.51954 > xxx.xxx.xxx.196.8086: Flags [F.], seq 1377, ack 117, win 502, options [nop,nop,TS val 3613379120 ecr 1480789346], length 0
E..4..@.@.@H.~...~.......m.iu.......*......
._.0XCb
07:52:29.445594 IP xxx.xxx.xxx.195.51954 > xxx.xxx.xxx.196.8086: Flags [.], ack 118, win 502, options [nop,nop,TS val 3613379120 ecr 1480789346], length 0
E..4..@.@.@G.~...~.......m.ju.......*......
._.0XCb

on my InfluxDB server
Code: 
07:58:09.478219 IP xxx.xxx.xxx.195.53404 > xxx.xxx.xxx.196.8086: Flags [.], ack 1761438194, win 502, options [nop,nop,TS val 3613719152 ecr 1481129378], length 0
E..4t.@.@....~...~......8...h.i.....*......
.d.pXH=.
07:58:09.478261 IP xxx.xxx.xxx.195.53404 > xxx.xxx.xxx.196.8086: Flags [P.], seq 0:1377, ack 1, win 502, options [nop,nop,TS val 3613719152 ecr 1481129378], length 1377
E...t.@.@....~...~......8...h.i.....0......
.d.pXH=.POST /api/v2/write?org=MyORG&bucket=PBS HTTP/1.1
authorization: Token VNiqXlGi5JnV6tSOGcN2l7U0vwUxOuGjFuUob1qtDdddd2sbjtnAsYoXMAy8LKL9itsUcVLY0zlbcwa0TZY7XDg==
user-agent: proxmox-simple-http-client/0.1
host: xxx.xxx.xxx.196:8086
content-length: 1119

cpustat,host=proxmoxbackup-bdx,object=host avg1=0.04,avg15=0.0,avg5=0.03,cpu=0.025025025025025016,cpu_count=1,guest=0,guest_nice=0,idle=6861153,iowait=356217,iowait_percent=0.004,irq=0,nice=3,softirq=42834,steal=196,system=250096,total=7673570,user=163071 1754978289000000000
memory,object=host,host=proxmoxbackup-bdx memavailable=1608339456,memfree=1376878592,memshared=0,memtotal=2058657792,memused=450318336,swapfree=2095046656,swaptotal=2147479552,swapused=52432896 1754978289000000000
nics,host=proxmoxbackup-bdx,object=host,instance=lo device="lo",receive=80052704,send=80052704,ty="Virtual" 1754978289000000000
nics,instance=ens18,host=proxmoxbackup-bdx,object=host device="ens18",receive=229601511273,send=21620928341,ty="Physical" 1754978289000000000
blockstat,host=proxmoxbackup-bdx,object=host avail=36859142144,io_ticks=773,read_bytes=4740301824,read_ios=108711,total=43405893632,used=4308881408,write_bytes=1168543744,write_ios=240789 1754978289000000000
blockstat,object=host,host=proxmoxbackup-bdx,datastore=backupProxmox avail=11000344477696,total=23025551540224,used=12025207062528 1754978289000000000

07:58:09.481445 IP xxx.xxx.xxx.195.53404 > xxx.xxx.xxx.196.8086: Flags [.], ack 117, win 502, options [nop,nop,TS val 3613719155 ecr 1481129381], length 0
E..4t.@.@..,.~...~......8...h.jf....*......
 
Last edited:
Interesting, so it seems like PBS sends the metrics but Influx somehow chooses to ignore them.

How do you verify that there is no data stored? Do you do some query in Grafana, or do you use Influx's web interface? Are you sure that your query is correct?
 
I think I understand. I am receiving the metrics, but only those from the PBS server itself and not the metrics from jobs, snapshots, etc., which is why I am confused.
I imagine I need to use pbs-exporter for this?
I tried it, but I only get the basic server metrics and no metrics of the pbs_snapshot type as described here https://github.com/natrontech/pbs-exporter. Is this the official version?
Thank you very much for your help.
 
gislard33 said:
I think I understand. I am receiving the metrics, but only those from the PBS server itself and not the metrics from jobs, snapshots, etc., which is why I am confused.
Click to expand...

Ah yeah, the integrated metric server integration only includes some basic host metrics and disk usage stats for datastores, but no data on job, snapshots, etc - as you correctly observed. It might make sense to expand these in the future.

gislard33 said:
I tried it, but I only get the basic server metrics and no metrics of the pbs_snapshot type as described here https://github.com/natrontech/pbs-exporter. Is this the official version?
Click to expand...

This exporter is not official in any capacity; I've never tried it out and cannot vouch for its quality. If you have problems with it it's probably a good idea to raise an issue on the Github page. :)
 
You must log in or register to reply here.
Top Bottom