Epyc Milan Vm to VM Communication Slow

dizzydre21

Member
Apr 10, 2023
80
2
13
Hello all,

I was recently testing VM to VM bandwidth/speed on various machines in my homelab. I was doing these tests with iperf3 from within several VMs because I was not quite getting 25gb speeds accross my network. I eventually got to the point where I was looking at both the Proxmox BIOS config of the server that was slowest. It is buy far the most powerful of the bunch (Epyc Milan), yet I cannot exceed ~20gbit/s over the network or accross VMs on the same machine with a dedicated VMBR1 bridge (no assigned physical NIC.

I'm using the AMD pstate driver on both AMD machines, but all of them are typically set to powersave and balanced_performance

I'd be very grateful for advice on how to troubleshoot this.


Some of the hardware:
AMD Eypc 7443p
Asrock Romed2-2t mobo
256GB 3200MHz ECC Rdimms (8x32GB)
Samsung 870 500GB (boot disk)
Samsung PMA93 x2 ZFS Mirror (VM OS disks)

Tiny machine with better VM to VM comms (~25gbit/s):
Lenovo P330 Tiny
Intel i7-8700T
2x16GB RAM
WD CL SN720 x2 ZZFS Mirror (Boot and VM disks)

Third tested machine (~45gbit/s):
AMD Ryzen 7800x3d
Supermicro H13 mobo
2x32GB 5200MHz ECC Udimms