[SOLVED] SDN broken after underlying network change

[spirit]

The config seem correctly generated now
for example

iface vmbr0v11
    bridge_ports  enlan2.11 pr_VLAN11
    bridge_stp off
    bridge_fd 0

iface pr_VLAN11
    link-type veth
    veth-peer-name ln_VLAN11

auto ln_VLAN11
iface ln_VLAN11
    link-type veth
    veth-peer-name pr_VLAN11

auto VLAN11
iface VLAN11
    bridge_ports ln_VLAN11
    bridge_stp off
    bridge_fd 0
    alias VLAN 11 for Productive Eng

enlan2.11---->vmbr0v11<-----------VLAN11 (vnet)<-----------vm should be plugged here

so I really don't known why it's not working.

do you have any error in sdn status ? can you send result of "ifquery -a -c" ? (It's used by status to compare running config && config from /etc/network/..)

 

[lifeboy]

do you have any error in sdn status ? can you send result of "ifquery -a -c" ? (It's used by status to compare running config && config from /etc/network/..)

Spoiler: NodeB

# ifquery -a -c
auto lo
iface lo inet loopback


auto enlan0
iface enlan0 inet manual


auto enlan1
iface enlan1 inet static                                            [pass]
    address 172.16.10.2/24                                      [pass]


auto enlan1
iface enlan1 inet static                                            [pass]
    address 172.16.5.202/24                                     [pass]


auto enlan3
iface enlan3 inet static                                            [pass]
    address 10.10.10.2/24                                       [pass]


auto enlan2
iface enlan2 inet manual


auto enlan2.25
iface enlan2.25 inet manual


auto enlan2.35
iface enlan2.35 inet manual


auto vmbr1
iface vmbr1 inet manual                                             [pass]
    bridge-ports enlan0 (tap101i1)                              [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]


auto vmbr2
iface vmbr2 inet manual                                             [pass]
    bridge-ports enlan2.25 (tap101i2) (fwpr186p0)               [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]


auto vmbr4
iface vmbr4 inet static                                             [pass]
    bridge-ports enlan2.35 (tap101i4)                           [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    address 192.168.151.2/24                                    [pass]


auto vmbr0
iface vmbr0 inet static                                             [pass]
    bridge-ports enlan2 (veth132i0) (fwpr128p0) (fwpr103p0) (fwpr139p0) (fwpr152p0) (fwpr197p0) (fwpr167p0) (tap101i0) (fwpr191p0) (fwpr124p0) (tap163i0) (veth104i0)     [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    address 192.168.131.2/24                                    [pass]


auto VLAN10
iface VLAN10                                                        [pass]
    bridge-ports ln_VLAN10 (tap101i3)                           [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias VLAN 10 for NSFAS                                     [pass]


auto VLAN11
iface VLAN11                                                        [pass]
    bridge-ports ln_VLAN11 (tap101i5)                           [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias VLAN 11 for Productive Eng                            [pass]


auto VLAN12
iface VLAN12                                                        [pass]
    bridge-ports ln_VLAN12 (tap101i6)                           [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias GTS_Abellard                                          [pass]


auto VLAN13
iface VLAN13                                                        [pass]
    bridge-ports ln_VLAN13 (tap101i7)                           [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias VLAN for VO                                           [pass]


auto VLAN14
iface VLAN14                                                        [pass]
    bridge-ports ln_VLAN14 (tap101i8)                           [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias VLAN for Zenware                                      [pass]


auto ln_VLAN10
iface ln_VLAN10                                                     [pass]
    link-type veth                                              [pass]


auto ln_VLAN11
iface ln_VLAN11                                                     [pass]
    link-type veth                                              [pass]


auto ln_VLAN12
iface ln_VLAN12                                                     [pass]
    link-type veth                                              [pass]


auto ln_VLAN13
iface ln_VLAN13                                                     [pass]
    link-type veth                                              [pass]


auto ln_VLAN14
iface ln_VLAN14                                                     [pass]
    link-type veth                                              [pass]


auto pr_VLAN10
iface pr_VLAN10                                                     [pass]
    link-type veth                                              [pass]


auto pr_VLAN11
iface pr_VLAN11                                                     [pass]
    link-type veth                                              [pass]


auto pr_VLAN12
iface pr_VLAN12                                                     [pass]
    link-type veth                                              [pass]


auto pr_VLAN13
iface pr_VLAN13                                                     [pass]
    link-type veth                                              [pass]


auto pr_VLAN14
iface pr_VLAN14                                                     [pass]
    link-type veth                                              [pass]


auto vmbr0v10
iface vmbr0v10                                                      [pass]
    bridge-ports enlan2.10 pr_VLAN10                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]


auto vmbr0v11
iface vmbr0v11                                                      [pass]
    bridge-ports enlan2.11 pr_VLAN11                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]


auto vmbr0v12
iface vmbr0v12                                                      [pass]
    bridge-ports enlan2.12 pr_VLAN12                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]


auto vmbr0v13
iface vmbr0v13                                                      [pass]
    bridge-ports enlan2.13 pr_VLAN13                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]


auto vmbr0v14
iface vmbr0v14                                                      [pass]
    bridge-ports enlan2.14 pr_VLAN14                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]

Spoiler: NodeC

# ifquery -a -c
auto lo
iface lo inet loopback

auto enlan0
iface enlan0 inet manual

auto enlan1
iface enlan1 inet static                                            [pass]
    address 172.16.10.3/24                                      [pass]

auto enlan1
iface enlan1 inet static                                            [pass]
    address 172.16.5.203/24                                     [pass]

auto enlan1
iface enlan1 inet static                                            [pass]
    address 192.168.1.3/24                                      [pass]

auto enlan3
iface enlan3 inet static                                            [pass]
    address 10.10.10.3/24                                       [pass]

auto enlan2
iface enlan2 inet manual

auto enlan2.25
iface enlan2.25 inet manual

auto enlan2.35
iface enlan2.35 inet manual

auto vmbr1
iface vmbr1 inet manual                                             [pass]
    bridge-ports enlan0                                         [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]

auto vmbr2
iface vmbr2 inet manual                                             [pass]
    bridge-ports enlan2.25                                      [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]

auto vmbr4
iface vmbr4 inet static                                             [pass]
    bridge-ports enlan2.35 (tap126i1) (tap126i0)                [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    address 192.168.151.3/24                                    [pass]

auto vmbr0
iface vmbr0 inet static                                             [pass]
    bridge-ports enlan2 (fwpr169p0) (veth134i0) (veth140i0) (veth153i0) (fwpr122p0) (veth161i0) (tap144i0) (tap111i0) (fwpr115p0) (veth106i0) (tap143i0) (veth119i0) (veth105i0) (tap112i0) (tap142i0)     [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    address 192.168.131.3/24                                    [pass]

auto VLAN10
iface VLAN10                                                        [pass]
    bridge-ports ln_VLAN10                                      [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias VLAN 10 for NSFAS                                     [pass]

auto VLAN11
iface VLAN11                                                        [pass]
    bridge-ports ln_VLAN11                                      [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias VLAN 11 for Productive Eng                            [pass]

auto VLAN12
iface VLAN12                                                        [pass]
    bridge-ports ln_VLAN12                                      [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias GTS_Abellard                                          [pass]

auto VLAN13
iface VLAN13                                                        [pass]
    bridge-ports ln_VLAN13                                      [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias VLAN for VO                                           [pass]

auto VLAN14
iface VLAN14                                                        [pass]
    bridge-ports ln_VLAN14                                      [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]
    alias VLAN for Zenware                                      [pass]

auto ln_VLAN10
iface ln_VLAN10                                                     [pass]
    link-type veth                                              [pass]

auto ln_VLAN11
iface ln_VLAN11                                                     [pass]
    link-type veth                                              [pass]

auto ln_VLAN12
iface ln_VLAN12                                                     [pass]
    link-type veth                                              [pass]

auto ln_VLAN13
iface ln_VLAN13                                                     [pass]
    link-type veth                                              [pass]

auto ln_VLAN14
iface ln_VLAN14                                                     [pass]
    link-type veth                                              [pass]

auto pr_VLAN10
iface pr_VLAN10                                                     [pass]
    link-type veth                                              [pass]

auto pr_VLAN11
iface pr_VLAN11                                                     [pass]
    link-type veth                                              [pass]

auto pr_VLAN12
iface pr_VLAN12                                                     [pass]
    link-type veth                                              [pass]

auto pr_VLAN13
iface pr_VLAN13                                                     [pass]
    link-type veth                                              [pass]

auto pr_VLAN14
iface pr_VLAN14                                                     [pass]
    link-type veth                                              [pass]

auto vmbr0v10
iface vmbr0v10                                                      [pass]
    bridge-ports enlan2.10 pr_VLAN10                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]

auto vmbr0v11
iface vmbr0v11                                                      [pass]
    bridge-ports enlan2.11 pr_VLAN11                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]

auto vmbr0v12
iface vmbr0v12                                                      [pass]
    bridge-ports enlan2.12 pr_VLAN12                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]

auto vmbr0v13
iface vmbr0v13                                                      [pass]
    bridge-ports enlan2.13 pr_VLAN13                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]

auto vmbr0v14
iface vmbr0v14                                                      [pass]
    bridge-ports enlan2.14 pr_VLAN14                            [pass]
    bridge-stp no                                               [pass]
    bridge-fd 0                                                 [pass]

 

[lifeboy]

Maybe there's a problem with these SDN ports in pfSense. I have 2 pfSense VM's that act as router firewalls. The default gateway on each network an SDN interface on these pfSense machines. It's actuall a CARP ip address that "floats" between the two firewalls and redirects to the actual interface of the whichever of the 2 is the active one at the time.

 

[spirit]

I really don't known, the running config seem to be ok

 

[lifeboy]

Maybe there's a problem with these SDN ports in pfSense. I have 2 pfSense VM's that act as router firewalls. The default gateway on each network an SDN interface on these pfSense machines. It's actuall a CARP ip address that "floats" between the two firewalls and redirects to the actual interface of the whichever of the 2 is the active one at the time.

From the pfSense on NodeB, I can ping a VM on nodeC on VLAN12, which then mean it is actually working! There is not other way to that a ping from 192.168.161.253 (pfSense VLAN12 gateway on running on NodeB) could reach a VM on NodeC!

Since I have only done the changes for Node B and C, testing with Node A (where the active pfSense gateway is currently running) in the mix will not give me correct results.

So the SDN works with the underlying ethernet ports named enlan<x>.