New to proxmox, but I know non-virtualized networking and Linux quite well. I have a CS degree but I'm a developer, not a network engineer. I'm used to laying out ethernet with physical switches connected to dedicated ports and all that. Been reading the forums and watching videos to get set up. I'm mostly there.
I have a new 4-NIC mini pc (32GB RAM/1TB NVME) connected to my ISP modem/router box. My ISP does not allow users to modify settings on their box. I can't even see the dashboard. They granted me one favor by bridging ETH1 so that my box can pull the IP address. I don't use their wifi or plug into any other ports on their box. This has worked for 5 years using Tomato routers as well as a Google Home Wifi mesh.
The first NIC is configured to pull the IP from the ISP into enp2s0/vmbr0. That seems to be working.
The second NIC at enp3s0/vmbr2 is configured to go an opnsense VM and out to a TP-Link SG108PE to serve the LAN. On the LAN, I have ethernet to my office, 2 TP-Link POE EAP610s going to ends of the house, and one POE EAP610 outdoor model up on my antenna mast. All are working and I can log into their admin screens.
So far, so good. All the devices on the LAN can access the network.
My problem is I can't access the internet from the proxmox shell. I can ping some IP addresses, like 8.8.8.8 and 1.1.1.1. The DNS comes through with what I believe to be my ISP's DNS server (199.73.103.190). The proxmox admin screen shows their DNS address and 8.8.8.8 for the backup. I cannot ping the ISP DNS server from the shell. If I try to ping the ISP gateway, I get a message: ping: Do you want to ping broadcast? Then -b. If not, check your local firewall rules
When I issue "ip a show vmbr0", I show the what I assume is my ISP-assigned IP address. However, when I go to sites that show your IP address, it's on an adjacent subnet assigned to my ISP. I'm not sure how to verify which is correct, since I can't see their modem dashboard.
FWIW, my LAN is on 192.168.3.X because my ISP modem assigns every address in 192.168.1.X and won't make the config change to limit assignment to a subset of the subnet.
I have a dynamic IP, but I have previously paid for a static IP from the ISP. They charge $10/month and if it helps get me going, I'll happily pay it.
/etc/network/interfaces
/etc/hosts
ip address
Another issue that I haven't addressed yet is devices on the LAN seem to have a delay when connecting to the internet. I wonder if it's another case of the ISP DNS server being unreachable. I can't ping the ISP DNS from a wired Windows PC or a Linux box that is also wired. opnsense is set up to use AdGuardHome, Cloudflare, and Quad9 for DNS.
Appreciate any clues!
I have a new 4-NIC mini pc (32GB RAM/1TB NVME) connected to my ISP modem/router box. My ISP does not allow users to modify settings on their box. I can't even see the dashboard. They granted me one favor by bridging ETH1 so that my box can pull the IP address. I don't use their wifi or plug into any other ports on their box. This has worked for 5 years using Tomato routers as well as a Google Home Wifi mesh.
The first NIC is configured to pull the IP from the ISP into enp2s0/vmbr0. That seems to be working.
The second NIC at enp3s0/vmbr2 is configured to go an opnsense VM and out to a TP-Link SG108PE to serve the LAN. On the LAN, I have ethernet to my office, 2 TP-Link POE EAP610s going to ends of the house, and one POE EAP610 outdoor model up on my antenna mast. All are working and I can log into their admin screens.
So far, so good. All the devices on the LAN can access the network.
My problem is I can't access the internet from the proxmox shell. I can ping some IP addresses, like 8.8.8.8 and 1.1.1.1. The DNS comes through with what I believe to be my ISP's DNS server (199.73.103.190). The proxmox admin screen shows their DNS address and 8.8.8.8 for the backup. I cannot ping the ISP DNS server from the shell. If I try to ping the ISP gateway, I get a message: ping: Do you want to ping broadcast? Then -b. If not, check your local firewall rules
When I issue "ip a show vmbr0", I show the what I assume is my ISP-assigned IP address. However, when I go to sites that show your IP address, it's on an adjacent subnet assigned to my ISP. I'm not sure how to verify which is correct, since I can't see their modem dashboard.
FWIW, my LAN is on 192.168.3.X because my ISP modem assigns every address in 192.168.1.X and won't make the config change to limit assignment to a subset of the subnet.
I have a dynamic IP, but I have previously paid for a static IP from the ISP. They charge $10/month and if it helps get me going, I'll happily pay it.
/etc/network/interfaces
Code:
auto lo
iface lo inet loopback
auto enp2s0
iface enp2s0 inet dhcp
iface enp3s0 inet manual
iface enp4s0 inet manual
iface enp5s0 inet manual
auto vmbr0
iface vmbr0 inet dhcp
bridge-ports enp2s0
bridge-stp off
bridge-fd 0
#ETH0 - WAN
iface wlp6s0 inet manual
auto vmbr2
iface vmbr2 inet static
address 192.168.3.1/24
bridge-ports enp3s0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
#ETH1 - LAN/etc/hosts
Code:
127.0.0.1 localhost.localdomain localhost
192.168.3.1 pve.cloud pve
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhostsip address
Code:
root@pve:~# [B]ip a show enp2s0[/B]
2: enp2s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
link/ether a8:b8:e0:00:8d:85 brd ff:ff:ff:ff:ff:ff
root@pve:~# [B]ip a show vmbr0[/B]
7: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether a8:b8:e0:00:8d:85 brd ff:ff:ff:ff:ff:ff
inet 199.116.92.80/24 brd 199.116.92.255 scope global dynamic vmbr0
valid_lft 3247sec preferred_lft 3247sec
inet6 fe80::aab8:e0ff:fe00:8d85/64 scope link
valid_lft forever preferred_lft forever
root@pve:~# [B]ip a show enp3s0[/B]
3: enp3s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr2 state UP group default qlen 1000
link/ether a8:b8:e0:00:8d:86 brd ff:ff:ff:ff:ff:ff
root@pve:~# [B]ip a show vmbr2[/B]
8: vmbr2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether a8:b8:e0:00:8d:86 brd ff:ff:ff:ff:ff:ff
inet 192.168.3.1/24 scope global vmbr2
valid_lft forever preferred_lft forever
inet6 fe80::aab8:e0ff:fe00:8d86/64 scope link
valid_lft forever preferred_lft foreverAnother issue that I haven't addressed yet is devices on the LAN seem to have a delay when connecting to the internet. I wonder if it's another case of the ISP DNS server being unreachable. I can't ping the ISP DNS from a wired Windows PC or a Linux box that is also wired. opnsense is set up to use AdGuardHome, Cloudflare, and Quad9 for DNS.
Appreciate any clues!
Last edited: