I don't have ballooning enabled since I had problems with that during memory pressure.
Proxmox reports 2.5G, while the OPNsense GUI reports 2.4G, so very close.
If I disable the qemu guest agent the Proxmox report is completely wrong though.
Tried to do some more analysis on the 100mb...