[SOLVED] Cant exeed gigabit speed on 2.5gb realtek nic

H

hexrebuilt

Member
Jan 3, 2023
12
3
8
Hi veveryone,

I'm trying to use a realtek R815 2.5GBe card with my proxmox and i'm having a few issues with being able to exceed gigabit speed from other machines in the network.
i have a couple of vms, one of which is truenas scale.

I would like to still be able to have full speed between the VMs, but still be able to access to the data stored in truenas at 2.5gbit.

It appears that the main node it is still connected as gigabit, even if the 2.5gbit light on the network card blinks.
Code: 
root@bigboi:~# lshw -C network
  *-network                 
       description: Ethernet interface
       product: I211 Gigabit Network Connection
       vendor: Intel Corporation
       physical id: 0
       bus info: pci@0000:05:00.0
       logical name: enp5s0
       version: 03
       serial: e0:d5:5e:2e:5c:58
       size: 1Gbit/s
       capacity: 1Gbit/s
       width: 32 bits
       clock: 33MHz
       capabilities: pm msi msix pciexpress bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=igb driverversion=6.8.12-8-pve duplex=full firmware=0. 6-1 latency=0 link=yes multicast=yes port=twisted pair speed=1Gbit/s
       resources: irq:24 memory:fc400000-fc41ffff ioport:d000(size=32) memory:fc420000-fc423fff
  *-network
       description: Ethernet interface
       product: RTL8125 2.5GbE Controller
       vendor: Realtek Semiconductor Co., Ltd.
       physical id: 0
       bus info: pci@0000:06:00.0
       logical name: enp6s0
       version: 04
       serial: 40:ae:30:60:09:b3
       capacity: 1Gbit/s
       width: 64 bits
       clock: 33MHz
       capabilities: pm msi pciexpress msix vpd bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=r8125 driverversion=9.014.01-NAPI duplex=full latency=0 link=yes multicast=yes port=twisted pair
       resources: irq:36 ioport:c000(size=256) memory:fc300000-fc30ffff memory:fc310000-fc313fff

How do i fix this? i did installed the correct driver, blackisting the gigabit one.
Code: 
06:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller [10ec:8125] (rev 04)
        Subsystem: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller [10ec:8125]
        Kernel driver in use: r8125
        Kernel modules: r8169, r8125



This is the output of the ethool comand on the card:
Code: 
root@bigboi:~# ethtool enp6s0
Settings for enp6s0:
        Supported ports: [ TP    MII ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
                                2500baseT/Full
        Supported pause frame use: Symmetric Receive-only
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
                                2500baseT/Full
        Advertised pause frame use: Symmetric Receive-only
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Link partner advertised link modes:  10baseT/Half 10baseT/Full
                                             100baseT/Half 100baseT/Full
                                             1000baseT/Full
                                             2500baseT/Full
        Link partner advertised pause frame use: Symmetric
        Link partner advertised auto-negotiation: Yes
        Link partner advertised FEC modes: Not reported
        Speed: 2500Mb/s
        Duplex: Full
        Auto-negotiation: on
        master-slave cfg: preferred slave
        master-slave status: slave
        Port: Twisted Pair
        PHYAD: 0
        Transceiver: external
        MDI-X: Unknown
        Supports Wake-on: pumbg
        Wake-on: d
        Link detected: yes

but if i try the connection speed via iperf3 this is the output
  1. Mac M4 10gbe to proxmox node:
    Code: 
    [ ID][Role] Interval           Transfer     Bitrate         Retr                                                                 
[  5][TX-C]   0.00-10.00  sec  1.08 GBytes   925 Mbits/sec                  sender                                               
[  5][TX-C]   0.00-10.02  sec  1.08 GBytes   923 Mbits/sec                  receiver                                             
[  7][RX-C]   0.00-10.00  sec  1.03 GBytes   888 Mbits/sec    0            sender                                                
[  7][RX-C]   0.00-10.02  sec  1.03 GBytes   884 Mbits/sec                  receiver
/CODE]
[*]Mac M4 10gbe to truenas
[CODE]
[ ID][Role] Interval           Transfer     Bitrate         Retr
[  5][TX-C]   0.00-10.00  sec  1.10 GBytes   942 Mbits/sec                  sender
[  5][TX-C]   0.00-10.02  sec  1.10 GBytes   939 Mbits/sec                  receiver
[  7][RX-C]   0.00-10.00  sec  1.06 GBytes   910 Mbits/sec    0            sender
[  7][RX-C]   0.00-10.02  sec  1.06 GBytes   906 Mbits/sec                  receiver
  2. proxmox to truenas vm
    Code: 
    [ ID] Interval           Transfer     Bitrate         Retr[  5]   0.00-10.00  sec  13.2 GBytes  11.3 Gbits/sec  1362             sender
[  5]   0.00-10.00  sec  13.2 GBytes  11.3 Gbits/sec                  receiver
  3. ubuntu vm to truenas vm
    Code: 
    [ ID] Interval           Transfer     Bitrate         Retr[  5]   0.00-10.00  sec  13.9 GBytes  12.0 Gbits/sec    8             sender
[  5]   0.00-10.00  sec  13.9 GBytes  12.0 Gbits/sec                  receiver
3 and 4 does not suprise me (luckily) but i wanted to use my connection at the full available speed
 
news said:
Then your cables are bad or your switch can only handle 1 GBit/s.
Click to expand...
The switch is "fine" i think. is a dummy one from aliexpress with 2 10gbe port and 5 2.5

cable wise i don't know how to check honestly. i tried different ones with the same result. all of them are cat6

Do i have to change some settings in proxmox?
Code: 
       product: RTL8125 2.5GbE Controller
       vendor: Realtek Semiconductor Co., Ltd.
       physical id: 0
       bus info: pci@0000:06:00.0
       logical name: enp6s0
       version: 04
       serial: 40:ae:30:60:09:b3
       capacity: 1Gbit/s
       width: 64 bits
       clock: 33MHz

Maybe something to force it to use 2.5gigabit on the capacity field?
 
you can check the real speed with CAT 6 Cable direct 1:1 to the NIC of 2 Proxmox VE/ Debian PCs.
then run iperf3
 
i feel so dumb.

for a sanity check i run also an iperf3 on windows.

Code: 
PS C:\Users\simon> E:\Downloads\iperf-3.18-win64\iperf3.exe -c 192.168.0.100
Connecting to host 192.168.0.100, port 5201
[  5] local 192.168.0.5 port 50644 connected to 192.168.0.100 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   286 MBytes  2.40 Gbits/sec
[  5]   1.00-2.00   sec   283 MBytes  2.37 Gbits/sec
[  5]   2.00-3.00   sec   283 MBytes  2.37 Gbits/sec
[  5]   3.00-4.00   sec   283 MBytes  2.37 Gbits/sec
[  5]   4.00-5.00   sec   283 MBytes  2.37 Gbits/sec
[  5]   5.00-6.00   sec   283 MBytes  2.37 Gbits/sec
[  5]   6.00-7.00   sec   283 MBytes  2.37 Gbits/sec
[  5]   7.00-8.00   sec   283 MBytes  2.37 Gbits/sec
[  5]   8.00-9.00   sec   283 MBytes  2.37 Gbits/sec
[  5]   9.00-10.00  sec   283 MBytes  2.37 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  2.77 GBytes  2.38 Gbits/sec                  sender
[  5]   0.00-10.01  sec  2.77 GBytes  2.37 Gbits/sec                  receiver

The switch is fine. the "10G sfp+/rj45" adapter are not 10g but 1g. i should have not trusted the local seller and red the recieved lable.

I'll mark this as "solved"
 
  • Like
Reactions: Johannes S and waltar
You must log in or register to reply here.
Top Bottom