Gateway routing (Hetzner vSwitch)

randydeb

New Member
Jul 29, 2022
2
0
1
Hi,

I need some help with routing on a Proxmox server.

Currently i have 2 dedicated servers at Hetzner. The old server is running ESXi7 with 2 external ip addresses and pfSense as firewall/gateway.
Now i added a second server and decided to go for proxmox instead. Both servers are on the same vSwitch.


ESXi guest network = 10.0.0.0/16
This host mainly run a kubernetes cluster where all nodes are in the 10.0.0.0/24 netwerk and the ingress run on 10.0.1.0/24 network with NAT from pfSense on external IP.
For the vSwitch, i added a 3the network interface to pfSense on 10.10.0.0/24 network (ip = 10.10.0.100 / gateway 10.10.0.1)

As for the proxmox server, i have 1 interface with the external ip. Just like the esx server, this is the management ip, which is only reachable from my home IP.
I made the configuration for the vSwitch and i'm able to communicate between both server.
LXC containers or VM's on the proxmox can access the 10.10.0.0/24 machines (so abel to access the 10.10.0.100 pfSense interface on esxi server)
VM's on the esxi running on the 10.0.0.0/24 network can access the 10.10.0.0/24 network, so the kubernetes machines on the esxi can access the VM's on the proxmox server.

The main issue i have is that the LXC containers or VM's on the proxmox have no internet access, so i cannot install any packages on them.

Here is my proxmox network config.
Code:
auto lo
iface lo inet loopback

iface lo inet6 loopback

auto enp4s0
iface enp4s0 inet static
        address 88.99.xxx.xxx/26
        gateway 88.99.xxx.xxx
        up route add -net 88.99.xxx.xxx netmask 255.255.xxx.xxx gw 88.99.xxx.xxx dev enp4s0
# route 88.99.xxx.xxx/26 via 88.99.xxx.xxx

iface enp4s0 inet6 static
        address 2a01:4f8:xxx:xxx::2/64
        gateway xxx::1

auto enp4s0.4000
iface enp4s0.4000 inet manual
        mtu 1400

auto vmbr0
iface vmbr0 inet static
        address 10.10.0.2/24
        bridge-ports enp4s0.4000
        bridge-stp off
        bridge-fd 0
        mtu 1400

Guest vm's on the proxmox server use ip 10.10.0.x with gateway 10.10.0.1.

Do i need to add a static route between the "vmbr0" and "enp4s0" to give them internet access?
Optionaly, i was thinking about a route to go trough the pfSense on the esxi and give them access to the 10.0.0.0/16 range as well.
So:
(proxmox vm) => 10.10.0.1 => 10.10.0.100 => internet
(proxmox vm) => 10.10.0.1 => 10.10.0.100 => 10.10.0.x

I'm not a network specialist and never made static routes, so examples on how to make them would be more as welcome ;)

Extra info:
The VM's on the proxmox don't need to be accessible from outside. I just want to offload some machines from the esxi to the proxmox server (elastic/mongo)

Kind regards,
Randy
 
Last edited:
Currently used a work-around till i found a solution.

All proxmox vm's use 10.10.0.1 as gateway, 10.10.0.100 (pfsense on esxi server) as DNS and squid proxy on the pfsense to access packages.
Code:
add route 10.0.0.0/16 via 10.10.0.100
allows me to communicate from the proxmox vm's to the esxi vm's

Not an optimal solution