SD WAN/zone/subnet

[scherian]

We have 4 identical nodes
Each node has 4 NICs - 2 x 25 G and 2 x 10 G
We were hoping to setup the 2 x 25 Gs as a bond on vmbr0 and use that for ceph on its own VLAN plus other VLANs
and the 2 x 10 G nics as a bond on vmbr1 and use that for various VLANs.
We created a VLAN zone - associated with vmbr1 (vlan aware)
Under the above zone we created a vnet (vlan aware) tagged with vlan 299

We applied the vnet to a Windows VM, but are not able to get connectivity, it says unidentified network.
The corresponding switch port is set to tag vlan 299 and has connectivity back to the router that has VLAN 299 defined and is reachable.
We are assigning a static IP to the VM on VLAN 299 but not able to reach it or neither is the VM able to ping the v299 gateway.

Any suggestions?
/=

 

[shanreich]

Can you post your network configuration as well as SDN configuration?

cat /etc/network/interfaces
head -n-0 * /etc/pve/sdn

 

[scherian]

Thank you so much for your response Stefan.
See below,
On our mikrotik switch we have set the interfaces facing eno1np0 as an access port with VLAN 299 as tagged
port facing ens5f0 is set as a trunk port with vlan 299 as tagged


root@prox1:~# cat /etc/network/interfaces

auto lo
iface lo inet loopback

iface eno1np0 inet manual

iface ens5f0 inet manual

iface ens5f1 inet manual

iface eno2np1 inet manual

auto vmbr0
iface vmbr0 inet static
address 10.200.1.30/24
gateway 10.200.1.1
bridge-ports eno1np0
bridge-stp off
bridge-fd 0

auto vmbr1
iface vmbr1 inet manual
bridge-ports ens5f0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094

source /etc/network/interfaces.d/*

The head command below

root@prox1:/etc/pve/sdn# head -n-1 *
==> vnets.cfg <==
vnet: PubSA
zone PublicZ
alias Public Subnet A
tag 299
vlanaware 1

==> zones.cfg <==
vlan: PublicZ
bridge vmbr1
ipam pve

 

[shanreich]

Did you set a VLAN in the Windows VM as well? How does the VM configuration look like? (qm config <vmid>). Setting vlan-aware on vmbr1 makes sense, but setting vlanaware on the vnet itself should not be necessary, that would enable QinQ.

edit: I forgot: Can you send me the output of cat /etc/network/interfaces.d/sdn

 

[scherian]

I created two NICs on the VM, in case the virtio was to be used instead of e1000
name: VM100
net0: e1000=BC:24:11:93:88:15,bridge=PubSA,firewall=1
net1: virtio=BC:24:11:4F:A9:12,bridge=PubSA,firewall=1

below output of sdn AFTER removing vlan aware on the vnet PubSA and leaving the Tag as 299

auto PubSA
iface PubSA
bridge_ports vmbr1.299
bridge_stp off
bridge_fd 0
alias Public Subnet A

Thank you so much for your responses - we are stuck