Putting this here in case anyone else is affected by this issue.
We've been having an issues with VM performance after upgrading our cluster to PVE9 on kernel 7.0.2-6-pve. This has been happening for a few of months and we finally managed to...
Thanks for the info !
Personnally, I'm using mellanox connect-x since multiple year with vxlan && bgp-evpn, and I never had problem with vxlan offloading
I don't trust intel && broadcom anymore, too much bugs in their drivers
It's mainly when you have a lot of (small) packets per second incoming. (If I remember, qemu is around 2millions pps with 1 core)
try an iperf3 with 64bytes packets (to simulate a syn flood for example)
cluster network is for osd->osd replication.
osd->monitor && osd->client is done on public network.
They are differents hearbeats, osd hearbeat between osd (on clusternetwork)
hearbeat from monitor-> osd (on public network)...
your pg number seem quite low, it could impact write performance with pg_lock.
try to set pg target ratio to 1.0 in your ceph pool
Also, verify in your bios that your server is set to max performance profile. (you want cpu always at their max...