Proxmox default gateway

m3a2r1

Active Member
Feb 23, 2020
162
5
38
47
I'm trying to understand how routing in Proxmox works but I can't.
I set bridge vmbr1 on sfp for vm so it should communicate via sfp but it doesn't it. My default bridge (vmbr0) is on ethernet and I suppose that it routes all traces via ethernet and I've got only 1Gbit testing iperf.
Should I set default bridge on sfp?
 
Exactly, I mean 10Gbit fiber transceiver. If I test the same vlan, I've got 10Gbit transfer, but if I use 2 different vlans, I've got only 1Gbit.
 
You have to be more specific.
What nic do you use?
Is the transceiver compatible with this nic?
Please send the network config and explain the interfaces.
 
Code:
iface eno1 inet manual

iface ens2f0 inet manual

auto ens2f0.10
iface ens2f0.10 inet manual

auto vmbr0
iface vmbr0 inet static
        address 172.16.1.69/24
        gateway 172.16.1.1
        bridge-ports eno1
        bridge-stp off
        bridge-fd 0

auto vmbr010
iface vmbr010 inet static
        address 172.16.0.13/24
        bridge-ports ens2f0.10
        bridge-stp off
        bridge-fd 0

auto vmbr1
iface vmbr1 inet manual
        bridge-ports ens2f0
        bridge-stp off
        bridge-fd 0

eno1 - 1Gbit ethernet interface
ens2f0 - 10Gbit sfp+ interface
ens2f0.10 - vlan10 on interface
vmbr010 - bridge for vlan10

I've tested with iperf, second iperf host is linux vm on another physical machine.
Main router is connected only to 10Gbit interface so I suppose that issue is on my pve host network.
 
If you like to use VLAN just activate VLAN awareness on the bridge.

Code:
iface eno1 inet manual

iface ens2f0 inet manual

auto vmbr0
iface vmbr0 inet static
        address 172.16.1.69/24
        gateway 172.16.1.1
        bridge-ports eno1
        bridge-stp off
        bridge-fd 0

auto vmbr1
iface vmbr1 inet manual
        bridge-ports ens2f0
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094

If you need an IP address in a VLAN on the host you can add a VLAN dev
For this ifupdown2 is necessary

Code:
apt install ifupdown2

Then you can configure the virtual device with VLAN.

Code:
iface vlan
        address 172.16.0.13/24
        vlan-id 10
        vlan-raw-device vmbr1
 
Bridge-vlan-aware doesn't change anything with bandwidth. It only allows me assign vlans on vms and not to create bridge for every vlan.
If both test machines are on the same vlan, it works on 10Gbps, if in other vlans, speed is only 1Gbps and I don't know why.
 
After series of tests I came to conclusion that is not pve related issue. It's rather router related.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!