We got this working by converting networking to OvS and simultaneously applying the latest kernel during the restart to change networking.
I assume the non VLAN aware bridge was at fault here, probably worth mentioning on the Proxmox firewall Wiki, if it's a known issue.