Very slow network speed

[AlbertK]

We have proxmox ve version 7.1 installed in a 3 node cluster...

We have now very slow network and transfer speeds.
50MB/s on a 1GB connectiion.

We have 3 node cluster, on the test node the config as follow.

2 NIC, linux bond, balance-alb.
On the VM Windows 11, with virtio network drivers

If i put a usb disk on the VM, its also slow.......

We have 3 cisco 1 GB switches.

This problem was also in proxmox version 6.......

 

[AlbertK]

I hope someone knows a solution for this big problem...

 

[tom]

How do you measure the network speed and what speed do you expect?

Try iperf.

 

[AlbertK]

Hello Tom,

Iperf is not installed.

On the E1000 card i get 50MB/s
On a USB 3 i get 5MB/sec

If i use the vertio network drivers its slower then the E1000...

I was copying a big file from one pc to another.

So we have the following setup:
Node 1: 4 network cards (1GB) 3x in a bond and 1x for proxmox
Node 2: 2 network cards (1GB) 1x in a bond and 1x for proxmox
Node 3: 2 network cards (1GB) 1x in a bond and 1x for proxmox

And i use balance-tlb

Switches:
1x cisco SG-100
2x cisco sg-300

Greetings,

Albert

 

[birdy]

50MB/s on a 1GB connectiion.

Be aware not to mixup GB(ytes/sec) and Gb(its/sec). At least your switch will be 1Gb/s and not 1GB/s. If 50MB/s (= approx 500Mb/s) is right then you are using your 1Gb/s port at 50%.

 

[AlbertK]

Hello Birdy,

But why is the vertio driver then slower??
in windows 11 its sasy 10/10Gb but its slower then the E1000 driver.

 

[birdy]

But why is the vertio driver then slower??
in windows 11 its sasy 10/10Gb but its slower then the E1000 driver.

Can´t help you with that. I have no experience with Windows(11) on PVE. I just wanted you to be aware to not compare apples and oranges.

 

[Dunuin]

You should always benchmark with tools like iperf because these write to the RAM so slow disks can be excluded as a problem/bottleneck.
And virtio should be way faster in general than E1000 because virtio is paravirtualized. So the question is why virtio is slower.
And bonds often degrade performance. You should check if the performance is better if you temporarily remove that bond.

 

[AlbertK]

Oke. what is then the best option to setup network? I have now a bond - balance-tlb.
If i remove it all trafic goes over the vmbr0.

This is for the cluster and login to the interface.
Or miss i somthing?

 

[spirit]

do you you have tried with a simple active-backup bond ?

 

[AlbertK]

What i have done now is:

Server has two network ports:
First i made a bond0 with LACP with port eno2

I made a vmbr1 with port bond0

eno1 is used for vmbr0, and i put vmbr1 with it.
Otherwise i cant get internet access.


Then i use vmbr1 to used with the VM's

Hope this is the way.

 

[AlbertK]

On windows 11 i got with the vertio drivers first 100 MB/s and on 50% it drops to 10 MB/s
The same is with the E1000 drivers.....

 

[jpdm]

On windows 11 i got with the vertio drivers first 100 MB/s and on 50% it drops to 10 MB/s
The same is with the E1000 drivers.....

Were you able to fix this? My network is throttling similar to this. VirtIO is slower than E1000.