Host cannot access Internet and unable to access Proxmox GUI from pfSense

[Its Not Okay]

I bought a pfsense box with 6x2.5 gb nics and I'm trying to run pfsense in a vm on my proxmox server this is my current config:

- I have the wan (172.16.10.2) set to vmbr1 which is the lan (172.16.10.1) of my openwrt vm which gets its connection via cellular modem
- I have vmbr2 set in pfsense as lan (192.168.100.1)
- I passed through a USB gigabit adapter (that's connect to a wifi access point) to pfsense (OPT1) and have DHCP setup and allow all in rules setup, interface setup as 192.168.110.1

Issues I'm having:

- From any wifi device (subnet 192.168.110.0/24) I'm unable to access the proxmox gui (192.168.100.3:8006) and none of the wifi device are able to access the internet
- I'm unable to access the openwrt web interface (lan: 172.16.10.1) from any device
What I want to do:
- Passthrough (do I need to?) the 6x2.5gb nics to pfsense so they just act like ports on a switch and are connected the same subnet as LAN
- Setup my proxmox host to get internet from pfsense which right now it can't

/etc/network/interfaces:

auto lo
iface lo inet loopback
iface enp1s0 inet manual
iface enp2s0 inet manual
iface enp3s0 inet manual
iface enp4s0 inet manual
iface enp5s0 inet manual
iface enp6s0 inet manual
auto enx000ec6ca3c39
iface enx000ec6ca3c39 inet manual

auto vmbr0
iface vmbr0 inet static
   address 192.168.100.3/24
   gateway 192.168.100.2
   bridge-ports enp1s0
   bridge-stp off
   bridge-fd 0
#Proxmox LAN
auto vmbr1
iface vmbr1 inet manual
   bridge-ports none
   bridge-stp off
   bridge-fd 0
#Cellular WAN

auto vmbr2
iface vmbr2 inet manual
   bridge-ports none
   bridge-stp off
   bridge-fd 0
#PfSense LAN

IP link from WiFi device:

default via 192.168.110.1 dev wlan0 proto static metric 600
192.168.110.0/24 dev wlan0 proto kernel scope link src 192.168.110.15 metric 600

 

[vesalius]

Let's try this again:
1. what is enp1s0 connected to? similar question, what is the 192.168.100.2 gateway connected to vmbr0? is this gateway the isp router/modem and does it do DHCP?
2. take screen shots of the network connections from the proxmox gui of OpenWRT vm and the pfSense VM. Trying to understand exactly how you have this chain from isp router through pfSense physically/virtually connected to give better suggestions.
3. out Of curiousity why do you need both openwrt and pfSense? What is one doing for the other cant?

 

[Its Not Okay]

Let's try this again:
1. what is enp1s0 connected to? similar question, what is the 192.168.100.2 gateway connected to vmbr0? is this gateway the isp router/modem and does it do DHCP?
2. take screen shots of the network connections from the proxmox gui of OpenWRT vm and the pfSense VM. Trying to understand exactly how you have this chain from isp router through pfSense physically/virtually connected to give better suggestions.
3. out Of curiousity why do you need both openwrt and pfSense? What is one doing for the other cant?

1. enp1s0 is connected to port 0 on the pfsense box and in to a opt port on my wifi router. Whereas the wifi routers WAN port is plugged into the gigabit usb adapter which is passedthrough into the pfsense vm.
3. I need openwrt (goldenorb rooter variant) as my wan is a Quectel RM502Q-AE 5g modem connected to USB into the proxmox host and passedthrough to the VM. I couldn't get it working in pfsense and openwrt makes it much easier to manage the cell modem.

 

[Its Not Okay]

2.0 Proxmox gui screenshots

 

[Its Not Okay]

The odd thing is, if I try to ping any website or access them it says failed to load. But on my phone, connected to WiFi (router plugged into USB adapter that's WIRELESS (subnet 192.168.110.1)) the instagram app loads fine.

 

[vesalius]

Thank you. Lots of things going on here and still trying to conceptually unravel what you have connected to what and how.

Answer 1 you say enp1s0 is connected to pfsense box? Confusing is this the pfsense vm or another separate pfsense box? You never answered specifically what box/device holds the 192.168.100.2 ip?

From these pics neither pfsense vm nor openwrt vm are using vmbr0 at all.

both pfSense vm and the openwrt vm have a USB Ethernet adapter passed through. is this 2 different usb adapters? Second part why use them when you have many unused ethernet ports on the Proxmox host to spare?

 

[Its Not Okay]

Thank you. Lots of things going on here and still trying to conceptually unravel what you have connected to what and how.

Answer 1 you say enp1s0 is connected to pfsense box? Confusing is this the pfsense vm or another separate pfsense box? You never answered specifically what box/device holds the 192.168.100.2 ip?

From these pics neither pfsense vm nor openwrt vm are using vmbr0 at all.

both pfSense vm and the openwrt vm have a USB Ethernet adapter passed through. is this 2 different usb adapters? Second part why use them when you have many unused ethernet ports on the Proxmox host to spare?

enp1s0 is connected to the proxmox box that has a openwrt vm and pfsense vm. The other end of that cable is plugged into the wifi router in one of it's lan ports (the white cable seen above). You're right, neither pfsense vm nor openwrt are using vmbr0, openwrt is using vmbr1 as it's lan which is also being used in the pfsense vm as it's wan. Openwrt doesn't have an ethernet adapter passed through, it has a 5g cellular modem which is how I get my WAN connection. Right now I have the other unused ethernet ports (5x2.5gb) ethernet as I wanted to use them for wired devices on the same subnet as proxmox host (192.168.100.1), I just haven't gotten that far ahead yet.

This box has 6 gigabit ethernet ports I want to use them all in VLAN 10 in pfsense (wired devices (would I have to passthrough all 6 adapters to pfsense for this?)), have a VLAN 20 which is enx000ec6ca3c39 (gigabit usb adapter) connected the wifi router in access point mode and have another VLAN 30 connected to another gigabit usb adapter and a poe switch for Cameras.

 

[vesalius]

So looks like things are setup appropriately from the
5G modem -> passthrough USB-> to OpenWRT->vmbr1->pfSense->vmbr2(lan)

right now the pfSense lan (vmbr2) is not physically or virtually connected to anything else from what I can tell.

1.what Is the pfSense lan gateway address?
2. What is the pfSense lan DHCP range?
3. What static ip do you want Proxmox to have in the pfSense lan subnet?