Monitor Disk(s) and network activity

[vaschthestampede]

Can we do that in proxmox?
If yes how?

I try to explain myself better.
I see that in proxmox there is a log of the firewall activities, even at the single VM level.

How can I export it? Maybe in real time?
How is it interpreted?
Is it possible to increase the level of detail of the log?

Is there such a thing as the level of activity on the disks?

 

[Lorenz.S]

You can use the PVE API to get the same statistical data which is used in the front end [0]. There, the disk and network usage of each VM is recorded via RRD [1]. The API is available in some formats, including JSON, and via pvesh [3] you may use the api via a normal shell.

Some endpoints, which might be interesting for you:

• /node/{node}/rrddata
• /node/{node}/qemu/{vmid}/rrddata
• /node/{node}/qemu/{vmid}/status
• /node/{node}/storage/{storage}/rrddata
• /node/{node}/storage/{storage}/status
• /cluster/tasks
• /cluster/log

But you probably find more endpoints which fit your needs

The PVE uses RRDtool [1] to store its statistical data.

You are probably also interested in the HTML API (which purpose is to make debugging or researching easier) [2].

But keep in mind, that the PVE is not a monitoring solution. There are perhaps other and better solutions.

[0] https://pve.proxmox.com/pve-docs/api-viewer/index.html
[1] https://en.wikipedia.org/wiki/RRDtool
[2] https://<YOUR-IP>:8006/api2/html
[3] https://pve.proxmox.com/pve-docs/pvesh.1.html

 

[vaschthestampede]

I'm not interested in statistical data.
I'm interested in the activities carried out.

Something like (proxmox firewall log):

116 7 tap116i0-IN 07/Jun/2021:15:36:12 +0200 ACCEPT: IN=fwbr116i0 OUT=fwbr116i0 PHYSIN=fwln116i0 PHYSOUT=tap116i0 MAC=01:00:5e:7e:7f:3f:78:8a:20:89:19:2b:08:00 SRC=10.1.1.139 DST=239.254.127.63 LEN=116 TOS=0x00 PREC=0x00 TTL=64 ID=4632 DF PROTO=UDP SPT=48000 DPT=48000 LEN=96

It could be a good start, but I'd like to have something more in-depth.

 

[vaschthestampede]

Is there no way to export these logs?

 

[Lorenz.S]

As the firewall [0] logs directly to the system journal (unit pvefw-logger) it is possible to use any syslog daemon (e.g. syslogd) to send this to a specified syslog server. This should result in a near real-time logging of firewall events.

[0] https://pve.proxmox.com/wiki/Firewall#_logging_of_firewall_rules