[SOLVED] iperf uses wrong nic, even when bound to other NIC?

[James Crook]

I have no idea what i've done, but after chasing retrys in iperf 7000+ when trying to push past 1G throughtput on the host (pushing past 1G throughput works fine in a VM or CT on a bridge on that NIC)
i've opened iftop on enp10s0 (my 10Gbe) and enp6s0 (my 1Gbe0) and when i iperf to a ct or vm attached to enp10s0 i can all the traffic as expected.
When i iperf -B 192.168.1.11 -s (thats the IP of the vlan on host attached to the 10Gbe) i can see all the traffic hitting enp6s0 (which has an ip of .100)

I've changed my default gateway to be only set on the Vlan attched to the 10Gbe connection, but this didn't help (and really it shouldn't as it no going off network)

any one able to point me in the right direction ?

EDIT ** this is my route -n which i think might need adjusting ?

root@pve1:~# route -n
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         192.168.1.1     0.0.0.0         UG    0      0        0 enp6s0
192.168.1.0     0.0.0.0         255.255.255.0   U     0      0        0 enp6s0
192.168.1.0     0.0.0.0         255.255.255.0   U     0      0        0 vlan1

# network interface settings; autogenerated
# Please do NOT modify this file directly, unless you know what
# you're doing.
#
# If you want to manage parts of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT read its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!

auto lo
iface lo inet loopback

auto enp6s0
iface enp6s0 inet static
    address 192.168.1.100/24
#OnBoardLAN

iface enp10s0 inet manual
#10GB

auto vmbr1
iface vmbr1 inet manual
    bridge-ports enp10s0
    bridge-stp off
    bridge-fd 0
    bridge-vlan-aware yes
    bridge-vids 2-4094
#BridgeForVMCT

auto vlan1
iface vlan1 inet static
    address 192.168.1.11/24
    gateway 192.168.1.1
    vlan-raw-device enp10s0
#Vlan1 10Gbe

 

[shanreich]

You have the same subnet configured twice on two different interfaces, so traffic can take either way (usually the first entry). You will need to use different subnets then it should work properly.

 

[James Crook]

You have the same subnet configured twice on two different interfaces, so traffic can take either way (usually the first entry). You will need to use different subnets then it should work properly.

on the routing or in the proxmox network setup ?
i kinda watched to have the web/shh management on 192.168.1.100 for the host, then the SMB/NFS on .11

 

[shanreich]

You want to use two different subnets then, since you have two different interfaces / vlans i.e. 192.168.1.0/24 for management and 192.168.2.0/24 for your VLAN.

 

[James Crook]

just tried with setting metrics on the interfaces, glad i did a backup of the config file, i made quite mess