Very, very slow (~800 KB/s) download-connections from Proxmox-Server, upload is OK

Still the same issue :/. The only thing that comes to my mind for ruling out that the Proxmox installation is doing something weird is (if possible) booting the system from some desktop ISO and running the same iperf3 test on that.