Which is faster ( 1-Socket & 12 Cores ) or ( 2-Sockets & 6 Cores ) -or- ( 4 Sockets & 3 Cores )

[NorthIdahoTomJones]

1'st - some info:
I have a Proxmox 8.2.4 on a physical machine with ( 48 x Intel(R) Xeon(R) Gold 6136 CPU @ 3.00GHz (4 Sockets) ) )
( note - Four physical 12-Core CPUs ).
2'nd - I am running some vm VyOS routers ( VyOS BGP routers & VyOS OSPF routers & VyOS NAT routers )
VyOS 1.5-rolling-202407300021

Which Proxmox setting should give me the fastest virtual VyOS router(s):

• ( 1 Socket & 12 Cores )
• ( 2 Sockets & 6 Cores )
• ( 4 Sockets & 3 Cores )
• – All three above configurations are set with Enable-NUMA ( enabled ).
  – I am not using SR-IOV or special dedicated network card configurations in Proxmox.

BIOS HT - disabled
VyOS set for performance
40-Gig NICs ( normal average sustained throughput is 3 to 7-Gig )

I’ve searched and googled and was unable to find a clear answer , so I thought I would ask here ( and also ask in the VyOS forums ).

Thanks for any answers. — Like everybody else , I’m trying to find & understand what works the fastest.


North Idaho Tom Jones

EDIT - added a note:
I have all memory banks filled.
I have a single 40-Gig two-port card. One port for NFS and the other port for VMs ( vmbr ).
My virtual VyOS router has two virtual interfaces ( wan & lan ). Each virtual interface ( both virtual interfaces ) is set for 6-Multiqueue ( this is tested the fastest when iperf testing ).

 

[sva]

The answer with most of these things - It depends! At a high level in most situations, you want to ensure that the following things are all on the same NUMA Node on a single socket with 12 cores:

• CPU
• RAM
• PCIe Slots for Storage
• PCIe Slots for Network

Scheduler should handle most of this for you if it is aware of the sockets/cores/etc and NUMA is enabled.

I am a big fan of benchmarks - strongly recommend defining a handful of benchmarks to compare between these configs and confirming. For example iperf3/netperf/stress-ng/VyOS specific.