Routed network for proxmox on debian10 at Hetzner

HelloProxmox

New Member
Dec 28, 2020
3
0
1
35
Hello,

I would like to have 3 nodes running on my proxmox, and 2 container on each node.

After reading the hetzner doc : https://community.hetzner.com/tutorials/install-and-configure-proxmox_ve I think the routed network is the case that suits me the best. ( I only have 1 Ipv4, and a whole ipv6 subnetwork)

I succeeded to create a bridged network locally (on a test device) using IPv4.
Now, as I'm trying to configure the routed network using IPv6, i face some issues.

Here is my /etc/network/interfaces
Code:
etc/network/interfaces
source /etc/network/interfaces.d/*

auto lo
iface lo inet loopback

iface lo inet6 loopback

auto enp36s0
iface enp36s0 inet static
    address XXX.XXX.XXX.XXX/26
    gateway YYY.YYY.YYY.GGG
    up route add -net YYY.YYY.YYY.NNN netmask 255.255.255.NNN gw YYY.YYY.YYY.GGG dev enp36s0
# route YYY.YYY.YYY.NNN/26 via YYY.YYY.YYY.GGG

iface enp36s0 inet6 static
    address IPV6::2/64
    gateway fe80::1

auto vmbr0
iface vmbr0 inet6 static
    address IPv6:4/64
    bridge-ports none
    bridge-stp off
    bridge-fd 0
    up ip -6 route add IPV6::5/64


with :
Code:
YYY.YYY.YYY.XXX being the hetzner ipv4 address
GGG being my gateway
255.255.255.NNN being my netmask
I did not forget to add a route to my first vm inside the proxmox ( to have a test vm).

I deployed a VM by full cloning a vm with a cloud-init file using the CLI :
Code:
qm set {vm.id} --ciuser {vm.username } --cipassword {vm.password} --cores {vm.cores} --ipconfig0 ip6={vm.ip6}
==> Everything is okay except no internet.

When i tried to
Code:
ifdown vmbr0 then ifup vmbr0
on the hetzner, I Get the following error :
Code:
warning: vmbr0: up cmd 'ip -6 route add {ip6}::5/64' failed: returned 2 (RTNETLINK answers: No such device
)

What could be my error here ? I assume it's in the interfaces file, but where ?

thanks for reading, I'd really appreciate your help !
 
After reading the doc again, i modified my
Code:
interfaces
to look like


Code:
auto lo
iface lo inet loopback


auto enp35s0
iface enp35s0 inet static
  address XXX.XXX.XXX.XXX/26
  pointopoint YYY.YYY.YYY.GGG
  gateway YYY.YYY.YYY.GGG

iface enp35s0 inet6 static
  address IPV6::2/64
  gateway fe80::1
  up sysctl -p

# for single-IPs
auto vmbr0
iface vmbr0 inet static
  address XXX.XXX.XXX.XXX/26
  bridge_ports none
  bridge_stp off
  bridge_fd 0


iface vmbr0 inet6 static
  address IPV6::3/64
  netmask 64
  up ip -6 route add IPV6::/64 dev vmbr0

and my guest :

Code:
auto lo   
iface lo inet loopack
    address IPV6::5/64
    gateway fe80::1

Everything looks OK according to the documentation, but i can't ping the vm or can't acces internet from the vm.
Has anyone an idea ?
 
I configured the routed network as indicated in the official documentation : https://community.hetzner.com/tutorials/install-and-configure-proxmox_ve

So, for the proxmox interface i have :

Code:
# network interface settings; autogenerated
# Please do NOT modify this file directly, unless you know what
# you're doing.
#
# If you want to manage parts of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT read its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!

source /etc/network/interfaces.d/*

auto lo
iface lo inet loopback

iface lo inet6 loopback

# device: enp35s0
auto enp35s0
iface enp35s0 inet static
    address XXX.XXX.XXX.XXX
    netmask 255.255.255.192
    pointopoint XXX.XXX.XXX.YYY
    gateway XXX.XXX.XXX.YYY


iface enp35s0 inet6 static
    address vvvv:vvvv:vvvv:vvvv::2
    netmask 128
    pointopoint fe80::1
    gateway fe80::1
    up sysctl -p


auto vmbr0
iface vmbr0 inet static
    address xxx.xxx.xxx.xxx #same as in enp35s0
    netmask 255.255.255.255
    bridge_ports none
    bridge_stp off
    bridge_fd 0

iface vmbr0 inet6 static
    address vvvv:vvvv:vvvv:vvvv::3
    netmask 64
    up ip -6 route add vvvv:vvvv:vvvv:vvvv::/64 dev vmbr0 #same vvvv as enp35s0

And in my VMs :

Code:
auto lo
iface lo inet loopback

auto ens18
iface ens18 inet6 static
    address vvvv:vvvv:vvvv:vvvv::9/64 #The 9 is a different number for every vm
    pointopoint vvvv:vvvv:vvvv:vvvv::3
    gateway vvvv:vvvv:vvvv:vvvv::3

- I can ping my guests from my server AND outside ( with my home machine)
- I can ssh from one guest to another
- I CAN NOT ssh from the proxmox server or my home machine.

Does someone have a clue about my error ?