I can't exceed 1GB of internet with a 10GB network card

Poly98

New Member
Feb 1, 2023
8
0
1
Hi, I just installed 10 Gb of internet and I want proxmox to use the 10gb of internet for the virtual machines, but I am encountering multiple problems.

I have a router compatible with 10GB of internet and a cat8 cable which I have tested on a computer and it works perfectly at 10gb.

I have a DL380P server with a HP FlexFabric 10Gb 2-port 533FLR-T Adapter network card.


And when I try to change the base speed to 1000Mbs I lose the connection with the network card until I put it back to 1000, when I am inside a virtual machine with VIRTIO it tells me that the network card is 10GB and it is correct, but when it comes to do a speed test it does not reach more than 1GB, I have tried to create a Linux bond along with a linux bridge as in other forums, but we got nowhere.


1686397617981.png1686397282415.png1686397698079.png
 

Attachments

  • 1686397293471.png
    1686397293471.png
    486.9 KB · Views: 94
Hello,

to what kind of equipment is this server connected to? Can you check the port on the other end?
 
Hola,

¿A qué tipo de equipo está conectado este servidor? ¿Puedes comprobar el puerto en el otro extremo?
Good, it connects directly to the 10GB router I have tried with another computer and it works perfectly, now proxmox detects the 10000mbps but in a linux virtual machine it works at 1.1 max with virtio.
 
Hi, I want to update the thread, we are still trying to virtualize a Windows to get 10 Gbps out of it, but we are not getting it in any way, we have tried the following:

Components:
Server: DL380P with proxmox, along with a 10 Gbps HP FlexFabric 533FLR-T 10 Gb 10 Gb network card and 2 10 Gbps ports.
X2Intel Xeon E5-2660 V2
Cable: Cat8


1. Change the adapters to VirTIO and install the driver in Windows, (Detects the 10 gbps card, but does not go beyond 1 Gbps.
2. We tested a non-virtualized machine with the network card and cat8 cable, got the 10 gbps correctly and downloaded as we want.
3. We have tested a wired connection between our server with proxmox and a windows VM connected to a computer with another 10 Gbps card, locally it does not work transfers at 10 gbps (But when pinging outside the network it is limited to 1 Gbps if virtualized).
4. We enabled the multiple queue from 1 to 20 and did not notice any difference.
5. We tried to join Layer 3/4 as in this thread and it doesn't work either https://forum.proxmox.com/threads/bond-on-local-lan-transfer-speed-only-1gbps. 119915/
6. We have tried to install vmxnet3 on proxmox, but it did not work, we switched to that network card.
7. We installed on a virtualbox machine to try the same process, but also found a limitation of 1 Gbps.
8. We tried to change the MTU to 9000.


Code:
Settings for eno1:
        Supported ports: [ TP ]
        Supported link modes:   100baseT/Half 100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Supported pause frame use: Symmetric Receive-only
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  100baseT/Half 100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Advertised pause frame use: Symmetric Receive-only
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Link partner advertised link modes:  10baseT/Half 10baseT/Full
                                             100baseT/Half 100baseT/Full
                                             1000baseT/Half 1000baseT/Full
                                             10000baseT/Full
        Link partner advertised pause frame use: No
        Link partner advertised auto-negotiation: Yes
        Link partner advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Full
        Auto-negotiation: on
        Port: Twisted Pair
        PHYAD: 17
        Transceiver: internal
        MDI-X: Unknown
        Supports Wake-on: g
        Wake-on: g
        Current message level: 0x00000000 (0)
                             
        Link detected: yes

Code:
auto lo
iface lo inet loopback

auto eno2
iface eno2 inet manual

auto eno1
iface eno1 inet manual

auto vmbr0
iface vmbr0 inet static
        address 192.168.1.117/24
        gateway 192.168.1.1
        bridge-ports eno1
        bridge-stp off
        bridge-fd 0

Virtual machine configuration:

1686650995449.png
 
Last edited:
I see ethtool says "Speed: 1000Mb/s" (suppose this is on the PVE server itself, not in VM), can you enforce it to 10000Mb/s? Something like "
ethtool -s eno1 autoneg on speed 10000 duplex full". Keep in mind you may get disconnected from the server, so I suggest doing it via IPMI or direct console.

Regards
 
I see ethtool says "Speed: 1000Mb/s" (suppose this is on the PVE server itself, not in VM), can you enforce it to 10000Mb/s? Something like "
ethtool -s eno1 autoneg on speed 10000 duplex full". Keep in mind you may get disconnected from the server, so I suggest doing it via IPMI or direct console.

Regards
Good, sorry, I have modified the thread by a mistake when copying it, I also tried to force it with the command that you have put the other day to be at 10000 and the result is still 10,000Mb/s but it does not work inside the vm
Code:
Settings for eno1:
        Supported ports: [ TP ]
        Supported link modes:   100baseT/Half 100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Supported pause frame use: Symmetric Receive-only
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  100baseT/Half 100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Advertised pause frame use: Symmetric Receive-only
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Link partner advertised link modes:  10baseT/Half 10baseT/Full
                                             100baseT/Half 100baseT/Full
                                             1000baseT/Half 1000baseT/Full
                                             10000baseT/Full
        Link partner advertised pause frame use: No
        Link partner advertised auto-negotiation: Yes
        Link partner advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Full
        Auto-negotiation: on
        Port: Twisted Pair
        PHYAD: 17
        Transceiver: internal
        MDI-X: Unknown
        Supports Wake-on: g
        Wake-on: g
        Current message level: 0x00000000 (0)
                            
        Link detected: yes
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!