Just added the same SMB share to my testing VM directly using map network drive and it is getting the expected speeds of a 4G LAG for read, writing not so much, but not so much a requirement, however this proves that it has to be proxmox breaking it somehow.