Thank you so much! Should probably have found it out from the documentation, but didn't..
Putting
LISTEN_IP="0.0.0.0"
into /etc/default/pveproxy solved it after restarting the service.
Sorry for the late follow up, been away from the system over the last few weeks - it's stable at least :D