Bridge - Lowest speed

[Giggling3999]

Hi

I've just got a new router (2.5G) and along with this I got some 5G network cards

I've swapped it all over and got the drivers working.

I have 2 NICS in the server - One is connected to the access point at 2.5G, however I've connected the other directly my pc with another 5G card; I was hoping to get 5G between them

It seems the bridge in proxmox is limiting to the slowest speed in the bridge though ? 2.5G

How should I set this up to get the full 5G but allow access to the rest of the network etc

 

[Hannes Laimer]

Hey,

how did you test the speed? Just to be sure, you mean a 5G ethernet adapter, right? Could you post your /etc/network/interfaces file, remove any public IPs, if it should contain any. Also, could you post the output of ethtool <INTERFACE> for both interfaces.

Generally, a normal linux bridge is basically as fast as the RAM, so no, that is very very likely not the bottleneck.

 

[Giggling3999]

Hey,

how did you test the speed? Just to be sure, you mean a 5G ethernet adapter, right? Could you post your /etc/network/interfaces file, remove any public IPs, if it should contain any. Also, could you post the output of ethtool <INTERFACE> for both interfaces.

Generally, a normal linux bridge is basically as fast as the RAM, so no, that is very very likely not the bottleneck.

Really appreciate the help.

I tested the speed with iperf3. Having run internal tests between VMs etc, I have had huge gb speeds.

They are network pcie cards, ethernet adapters, yeah.

/etc/network/interfaces... The OVS bridge is empty. Last night I was able to test that instead of the linux bridge with JUST the 5g NIC. Still the same speed.

auto lo
iface lo inet loopback

auto enx00e04a69b238
iface enx00e04a69b238 inet manual

iface enlan0 inet manual

iface enlan2 inet manual

iface enlan1 inet manual

auto vmbr0
iface vmbr0 inet static
        address 192.168.212.2/24
        gateway 192.168.212.1
        bridge-ports enlan0 enlan1 enlan2 enx00e04a69b238
        bridge-stp off
        bridge-fd 0

auto vmbr1
iface vmbr1 inet manual
        ovs_type OVSBridge

source /etc/network/interfaces.d/*

I had read somewhere that a bridge will perform at the lowest device speed...But you don't seem to think that is the case?
I'll post the ethtool in a few mins (Just on a laptop)

 

[Hannes Laimer]

Why OVS though? You don't really want OVS almost ever, unless you need it for a very specific thing. Also, it looks like you have multiple ports for the same network on the same bridge, you don't want that. If you want to use multiple interfaces consider setting up a bond[1], and making that the bridge port.

[1] https://pve.proxmox.com/wiki/Network_Configuration#sysadmin_network_bond

 

[Giggling3999]

I was just testing whether OVS made a difference. It didn't.

The other ports are the old devices - I thought I would keep them until I had fully sorted out everything.

enx being my trusty usb failsafe & enlan0 being the old NIC.

Let me have a read on bond. I thought it was for links to the same device. The two I use at the moment are enlan1 and enlan2.

enlan1 = Access Point
enlan2 = Direct PC connection

Again - Appreciate the help - Thanks very much

 

[Giggling3999]

Ethtools
ProxMox

ethtool enlan1
Settings for enlan1:
        Supported ports: [ TP ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
                                2500baseT/Full
                                5000baseT/Full
        Supported pause frame use: Symmetric Receive-only
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
                                2500baseT/Full
                                5000baseT/Full
        Advertised pause frame use: Symmetric Receive-only
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Link partner advertised link modes:  10baseT/Half 10baseT/Full
                                             100baseT/Half 100baseT/Full
                                             1000baseT/Full
                                             2500baseT/Full
                                             5000baseT/Full
        Link partner advertised pause frame use: Symmetric Receive-only
        Link partner advertised auto-negotiation: Yes
        Link partner advertised FEC modes: Not reported
        Speed: 5000Mb/s
        Duplex: Full
        Auto-negotiation: on
        Port: Twisted Pair
        PHYAD: 0
        Transceiver: internal
        MDI-X: on
        Supports Wake-on: pumbg
        Wake-on: g
        Current message level: 0x00000033 (51)
                               drv probe ifdown ifup
        Link detected: yes

PC

Settings for enp9s0:
    Supported ports: [ TP ]
    Supported link modes:   10baseT/Half 10baseT/Full
                            100baseT/Half 100baseT/Full
                            1000baseT/Full
                            2500baseT/Full
                            5000baseT/Full
    Supported pause frame use: Symmetric Receive-only
    Supports auto-negotiation: Yes
    Supported FEC modes: Not reported
    Advertised link modes:  10baseT/Half 10baseT/Full
                            100baseT/Half 100baseT/Full
                            1000baseT/Full
                            2500baseT/Full
                            5000baseT/Full
    Advertised pause frame use: Symmetric Receive-only
    Advertised auto-negotiation: Yes
    Advertised FEC modes: Not reported
    Link partner advertised link modes:  10baseT/Half 10baseT/Full
                                         100baseT/Half 100baseT/Full
                                         1000baseT/Full
                                         2500baseT/Full
                                         5000baseT/Full
    Link partner advertised pause frame use: Symmetric Receive-only
    Link partner advertised auto-negotiation: Yes
    Link partner advertised FEC modes: Not reported
    Speed: 5000Mb/s
    Duplex: Full
    Auto-negotiation: on
    Port: Twisted Pair
    PHYAD: 0
    Transceiver: internal
    MDI-X: on
netlink error: Operation not permitted
        Current message level: 0x00000033 (51)
                               drv probe ifdown ifup
    Link detected: yes