No Internet when adding Linux Bridges to pfSense

[bufu]

Hi,

so I am trying to virtualize pfSense and I am having some issues. When I add a virtual NIC (Linux or OVS bridge) to a VM, it either just gets an IP address from the DHCP server on pfSense and then no other connectivity at all, or it can't even get the network configuration.

My desired setup is:

pfSense VM with 4 NIC Intel card passed through. igb0 is used for WAN and igb1 is LAN for physical and management devices on the range 10.10.10.0/24. I want to add virtual NICs in Proxmox to pfSense for my VMs, e.g. vmnic0 on 10.10.20.0/24 for security stuff (Kali, CommandoVM, SIEM) and vmnic1 for an ActiveDirectory lab on 10.10.30.0/24. I will make a diagram tomorrow and update the post, for now I am too tired.

I have tried both Linux bridges and OVS bridges I also tried Linux VLAN and OVS Int and added the appropriate VLANs in pfSense as well and assigned the interfaces. When I do happen get an IP assigned, I can ping the gateway, but nothing else works. No DNS, no pinging other devices. Adding allow any firewall rules for the interfaces in pfsense also did not fix it, I am not sure the packets are even going to pfsense after the VM gets an IP.

This is my proxmox network configuration.



I will update this post with more info, screenshots and diagrams tomorrow, since after 6 hours of Googling and trying to fix this my brain is just completely fried. I really appreciate any tips and help you can give me.

 

[Dunuin]

Output of cat /etc/network/interfaces would be useful to for example see if you set those vmbr1 and vmbr2 to manual or dhcp. Not that DHCP will assign the PVE node a new gateway or something like that or screw up routing by having two IPs in the same subnet.

 

[bufu]

Output of cat /etc/network/interfaces would be useful to for example see if you set those vmbr1 and vmbr2 to manual or dhcp. Not that DHCP will assign the PVE node a new gateway or something like that or screw up routing by having two IPs in the same subnet.

Okay so for some reason it worked this morning, although I did the exact same thing yesterday a billion times and it didn't. I create a new OVS bridge in proxmox, created 2 OVS INT ports, added the bridge to pfSense and assigned the VLANs. Now I get connectivity as expected.

Here is my /etc/network/interfaces:

auto lo
iface lo inet loopback

iface enp2s0f0 inet manual

iface enp2s0f1 inet manual

auto vmbr1_20
iface vmbr1_20 inet manual
        ovs_type OVSIntPort
        ovs_bridge vmbr1
        ovs_options tag=20
#VMNET0

auto vmbr1_30
iface vmbr1_30 inet manual
        ovs_type OVSIntPort
        ovs_bridge vmbr1
        ovs_options tag=30
#VMNET1

auto vmbr0
iface vmbr0 inet static
        address 10.10.10.6/24
        gateway 10.10.10.1
        bridge-ports enp2s0f0
        bridge-stp off
        bridge-fd 0
#MGMT

auto vmbr1
iface vmbr1 inet manual
        ovs_type OVSBridge
        ovs_ports vmbr1_20 vmbr1_30
#VMNET

Next project will be adding a SPAN port in either proxmox or pfsense, hopefully that project goes better