You should consider the use of a vpn to link the two offices together, if I understand your current setup as described *anyone* with your public IP can connect to your proxmox host and from there, potentially, to your entire LAN
Normally, you would use an IPSec VPN link to connect two remote...