Update on this, for anyone interested:
Issue moved with the movement from the Realtek 10GBe R8169 driver to a different NIC (different chipset and different kernel driver Realtek 2.5GBe,) but still on the motherboard.
Anecdotally, it appeared to get better with the most recent Proxmox...