I can't exceed 1GB of internet with a 10GB network card

[Poly98]

Hi, I just installed 10 Gb of internet and I want proxmox to use the 10gb of internet for the virtual machines, but I am encountering multiple problems.

I have a router compatible with 10GB of internet and a cat8 cable which I have tested on a computer and it works perfectly at 10gb.

I have a DL380P server with a HP FlexFabric 10Gb 2-port 533FLR-T Adapter network card.


And when I try to change the base speed to 1000Mbs I lose the connection with the network card until I put it back to 1000, when I am inside a virtual machine with VIRTIO it tells me that the network card is 10GB and it is correct, but when it comes to do a speed test it does not reach more than 1GB, I have tried to create a Linux bond along with a linux bridge as in other forums, but we got nowhere.

 

[TodorPetkov]

Hello,

to what kind of equipment is this server connected to? Can you check the port on the other end?

 

[Poly98]

Hola,

¿A qué tipo de equipo está conectado este servidor? ¿Puedes comprobar el puerto en el otro extremo?

Good, it connects directly to the 10GB router I have tried with another computer and it works perfectly, now proxmox detects the 10000mbps but in a linux virtual machine it works at 1.1 max with virtio.

 

[TodorPetkov]

Hi,

enable multiqueue and try again (https://www.reddit.com/r/Proxmox/comments/w7ongm/10gb_to_vm/)

 

[Poly98]

Hola,

habilite la cola múltiple e intente nuevamente ( https://www.reddit.com/r/Proxmox/comments/w7ongm/10gb_to_vm/ )

Good, we have also tried this and changing the MTU to 9000, we have even put 24 in multiple, it has improved to 1.3 but we still can't reach 8 GB symmetric.

 

[Poly98]

Hi, I want to update the thread, we are still trying to virtualize a Windows to get 10 Gbps out of it, but we are not getting it in any way, we have tried the following:

Components:
Server: DL380P with proxmox, along with a 10 Gbps HP FlexFabric 533FLR-T 10 Gb 10 Gb network card and 2 10 Gbps ports.
X2Intel Xeon E5-2660 V2
Cable: Cat8


1. Change the adapters to VirTIO and install the driver in Windows, (Detects the 10 gbps card, but does not go beyond 1 Gbps.
2. We tested a non-virtualized machine with the network card and cat8 cable, got the 10 gbps correctly and downloaded as we want.
3. We have tested a wired connection between our server with proxmox and a windows VM connected to a computer with another 10 Gbps card, locally it does not work transfers at 10 gbps (But when pinging outside the network it is limited to 1 Gbps if virtualized).
4. We enabled the multiple queue from 1 to 20 and did not notice any difference.
5. We tried to join Layer 3/4 as in this thread and it doesn't work either https://forum.proxmox.com/threads/bond-on-local-lan-transfer-speed-only-1gbps. 119915/
6. We have tried to install vmxnet3 on proxmox, but it did not work, we switched to that network card.
7. We installed on a virtualbox machine to try the same process, but also found a limitation of 1 Gbps.
8. We tried to change the MTU to 9000.

Settings for eno1:
        Supported ports: [ TP ]
        Supported link modes:   100baseT/Half 100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Supported pause frame use: Symmetric Receive-only
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  100baseT/Half 100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Advertised pause frame use: Symmetric Receive-only
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Link partner advertised link modes:  10baseT/Half 10baseT/Full
                                             100baseT/Half 100baseT/Full
                                             1000baseT/Half 1000baseT/Full
                                             10000baseT/Full
        Link partner advertised pause frame use: No
        Link partner advertised auto-negotiation: Yes
        Link partner advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Full
        Auto-negotiation: on
        Port: Twisted Pair
        PHYAD: 17
        Transceiver: internal
        MDI-X: Unknown
        Supports Wake-on: g
        Wake-on: g
        Current message level: 0x00000000 (0)
                             
        Link detected: yes

auto lo
iface lo inet loopback

auto eno2
iface eno2 inet manual

auto eno1
iface eno1 inet manual

auto vmbr0
iface vmbr0 inet static
        address 192.168.1.117/24
        gateway 192.168.1.1
        bridge-ports eno1
        bridge-stp off
        bridge-fd 0

Virtual machine configuration:

 

[TodorPetkov]

I see ethtool says "Speed: 1000Mb/s" (suppose this is on the PVE server itself, not in VM), can you enforce it to 10000Mb/s? Something like "
ethtool -s eno1 autoneg on speed 10000 duplex full". Keep in mind you may get disconnected from the server, so I suggest doing it via IPMI or direct console.

Regards

 

[Poly98]

I see ethtool says "Speed: 1000Mb/s" (suppose this is on the PVE server itself, not in VM), can you enforce it to 10000Mb/s? Something like "
ethtool -s eno1 autoneg on speed 10000 duplex full". Keep in mind you may get disconnected from the server, so I suggest doing it via IPMI or direct console.

Regards

Good, sorry, I have modified the thread by a mistake when copying it, I also tried to force it with the command that you have put the other day to be at 10000 and the result is still 10,000Mb/s but it does not work inside the vm

Settings for eno1:
        Supported ports: [ TP ]
        Supported link modes:   100baseT/Half 100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Supported pause frame use: Symmetric Receive-only
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  100baseT/Half 100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Advertised pause frame use: Symmetric Receive-only
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Link partner advertised link modes:  10baseT/Half 10baseT/Full
                                             100baseT/Half 100baseT/Full
                                             1000baseT/Half 1000baseT/Full
                                             10000baseT/Full
        Link partner advertised pause frame use: No
        Link partner advertised auto-negotiation: Yes
        Link partner advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Full
        Auto-negotiation: on
        Port: Twisted Pair
        PHYAD: 17
        Transceiver: internal
        MDI-X: Unknown
        Supports Wake-on: g
        Wake-on: g
        Current message level: 0x00000000 (0)
                            
        Link detected: yes