PVE + Cumulus Linux network configuration

[RobFantini]

So what you recommend?
Behind bond2, I do have an ex3300 with trunk bond configured.
Behind that, I do have 2x pfsenses.

try this:

#  m5300
auto bond21
iface bond21
    alias bond21 on swp21
    bond-slaves swp21
    clag-id 21
    mtu 1500
    bond-miimon 100
    bond-mode 802.3ad
    bond-xmit-hash-policy layer3+4

then there are the different macs to use for peerlink.4094 etc.