Proxmox SDN VLAN works on same node but not across cluster nodes

[luksti]

I am currently trying to implement SDN in a three-node cluster environment, as we use a large number of different VLANs.
Each of the three hosts has two uplinks dedicated to VM traffic. I have combined these two uplinks into bond0.

#Transport Bond
auto bond0
iface bond0 inet manual
        bond-slaves nic9 nic7
        bond-miimon 100
        bond-mode active-backup
#Transport Bond

On top of bond0, I created vmbr999 as a "transport bridge".

#SDN-Transport
auto vmbr999
iface vmbr999 inet manual
        bridge-ports bond0
        bridge-stp off
        bridge-fd 0
#SDN-Transport

On the switch uplink ports, VLAN 7 is configured as tagged.
In SDN, I deployed a transport zone (VLAN) and configured vnet07 with VLAN tag 7 within this zone.
I now have one VM on each of two different hosts, with their network interfaces connected to vnet07.
The Proxmox Firewall is disabled on the VM.
If both VMs are running on the same host, they can ping each other without any issues. If I configure VLAN 7 using a regular vmbr bridge in the /etc/network/interfaces instead of SDN, communication also works between VMs running on different hosts.
However, when using SDN configured VNET07, communication between different hosts does not work.
Using tcpdump, I can see that the ARP requests arrive at bond0, but I cannot see them on the bridge or on vnet07.
I tried to fix my Problem with different AI but they are turning around......

Is there a conceptual mistake in my SDN setup or am I misunderstanding how the VLAN transport between the hosts is supposed to work?

 

[xda3m0n]

do you already tag on the port every host at switch for the vlan? the traffic should routed to the switch before communicate to another host.

 

[luksti]

Hello xda3m0n, yes the vlan Tag is on all 6 Uplinks.
If ping from from proxmox-host2 vm to a promox-host1 vm i can see the arp request on proxmox-host1 bond0 so i think the chain th host is ok.


If i create a manual bridge for example like that:

#vlan07
auto vmbr07
iface vmbr07 inet manual
bridge-ports bond0.07
bridge-stp off
bridge-fd 0
#vlan07

It will work, so i think my Uplinks and Switch Setup should be correct

 

[shanreich]

Please post your full network configuration in the non-working state:

cat /etc/network/interfaces
cat /etc/network/interfaces.d/sdn

As well as the network configuration of both VMs:

qm config <VMID>

 

[luksti]

Hello Stefan, in the moment i found my error.
In One Interfaces File was vlan aware active on two hosts not.
After Removing vlan aware it works, Problem solved

Best regards
Lukas