QuadFeed

New Member
Dec 17, 2021
3
0
1
28
im trying to setup a network bridge between my 10gbit cards

so my computer has a network card with 2 10gbit ports that i want to set up as a bridge in windows to effectively get "20gbit" between proxmox and my pc.
proxmox server is behind my computer.

so i have 2 10gbit in main pc going to proxmox server, its bridged in windows so i get internet on my proxmox server.
is there a way to setup a bridge on proxmox to effectively get 20gbit throughput?
thank you for any help :)
 

bobmc

Renowned Member
May 17, 2018
631
105
63
65
Before anything else, you don't get '20Gbit/sec' between pc and server so don't be disappointed in your transfer speeds. However, if you have one server and two pc's then you could see each pc running at 10Gbit simultaneously giving a combined throughput of 20Gbit with a bonded interface.

If you do still want to use a bond then you can do this via the GUI, select Linux Bond, choose your interfaces, create a bond, then link your vmbr0 to the bond.
 
  • Like
Reactions: QuadFeed

QuadFeed

New Member
Dec 17, 2021
3
0
1
28
Thank you. i did that.
using LACP layer3+4
if i run "iperf3 -c 192.168.86.21 -P 2 -t 30"
i get 16.9Gbits/sec.
but transferring a file is only 800Mbps
so transferring files is lower than normal gigabit witch i find strange..

heres my /etc/network/interfaces

auto lo
iface lo inet loopback

auto enp1s0f0np0
iface enp1s0f0np0 inet manual
mtu 9000

auto enp1s0f1np1
iface enp1s0f1np1 inet manual
mtu 9000

iface wlo1 inet manual

auto bond0
iface bond0 inet manual
bond-slaves enp1s0f0np0 enp1s0f1np1
bond-miimon 100
bond-mode 802.3ad
bond_downdelay 200
bond_updelay 200
bond-xmit-hash-policy layer3+4
bond_lacp_rate fast
mtu 9000

auto vmbr0
iface vmbr0 inet static
address 192.168.86.21/24
gateway 192.168.86.1
bridge-ports bond0
bridge-stp off
bridge-fd 0
mtu 9000


Using ftp im getting 250 or so Mbs. so thats abit better. on unraid i got 1Gb write speeds. so far away :p
 
Last edited:
Mar 25, 2022
1
0
1
lacp 802.3ad correct speed is 10Gbit + 10Gbit (showing 20Gbit) .. in one tcp/udp stream you can reach only 10Gbit maximum, but with two streams you can reach almost 20Gbit.

FYI: right now we have fixed the problem with improper bonding composition - one NIC 1Gbit auto and second 10Gbit auto after reboot or turning server OFF and back again ON..

NIC driver: bnxt_en
NIC chip: Broadcom BCM57414 NetXtreme-E 10Gb/25Gb Ethernet

before NIC firmware upgrade:
ethtool -i enp4s0f0np0
firmware-version: 218.0.153.0/pkg 218.0.169.0
after NIC firmware upgrade:
firmware-version: 220.0.59.0/pkg 220.0.83.0

firmware upgraded using tool bnxtnvm
 

QuadFeed

New Member
Dec 17, 2021
3
0
1
28
lacp 802.3ad correct speed is 10Gbit + 10Gbit (showing 20Gbit) .. in one tcp/udp stream you can reach only 10Gbit maximum, but with two streams you can reach almost 20Gbit.

FYI: right now we have fixed the problem with improper bonding composition - one NIC 1Gbit auto and second 10Gbit auto after reboot or turning server OFF and back again ON..

NIC driver: bnxt_en
NIC chip: Broadcom BCM57414 NetXtreme-E 10Gb/25Gb Ethernet

before NIC firmware upgrade:
ethtool -i enp4s0f0np0
firmware-version: 218.0.153.0/pkg 218.0.169.0
after NIC firmware upgrade:
firmware-version: 220.0.59.0/pkg 220.0.83.0

firmware upgraded using tool bnxtnvm
hi thank you for reply.

with ethtool this is the output


root@uglystation:/home# ethtool -i enp1s0f0np0
driver: sfc
version: 5.15.35-1-pve
firmware-version: 6.2.7.1001 rx0 tx0
expansion-rom-version:
bus-info: 0000:01:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: yes
supports-priv-flags: no
root@uglystation:/home# ethtool -i enp1s0f1np1
driver: sfc
version: 5.15.35-1-pve
firmware-version: 6.2.7.1001 rx0 tx0
expansion-rom-version:
bus-info: 0000:01:00.1
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: yes
supports-priv-flags: no

this is the card im using
01:00.0 Ethernet controller: Solarflare Communications SFC9120 10G Ethernet Controller (rev 01)
01:00.1 Ethernet controller: Solarflare Communications SFC9120 10G Ethernet Controller (rev 01)

i dont know how to use that firmware tool. can that work on solarflare cards?

Thank you
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!