Connect proxmox directly to windows PC

thphon

New Member
Sep 22, 2024
8
1
3
Hi all,

I'm trying to connect my proxmox directly to a windows pc while both are already connected to the router, this is because the router has 2.5gbps x1 and 1gbps x3 ports and I have spare 10gbps nics on both machines. I'm trying to avoid upgrading the router or buying a 10gbps switch and I believe it's possible to have the connection to the router to access internet and the direct connection for the LAN at higher speeds but I can't get it to work.
My setup is the following:

proxmox has 3 nics, enp1s0 is connected to the router and it's using vmbr0, enp35s0f0 is connected to the windows machine
windows has 2 nics, one is connected to the router and the other to the proxmox machine.

cat /etc/network/interfaces
Rich (BB code):
auto lo
iface lo inet loopback


iface enp1s0 inet manual
        pre-up /usr/sbin/ethtool -s enp1s0 advertise 0x1800000001028


iface enp35s0f0 inet manual
        pre-up /usr/sbin/ethtool -s enp35s0f0 advertise 0x1800000001028
#LAN


iface enp35s0f1 inet manual
        pre-up /usr/sbin/ethtool -s enp35s0f1 advertise 0x1800000001028
#LAN


auto vmbr0
iface vmbr0 inet static
        address 192.168.1.100/24
        gateway 192.168.1.254
        bridge-ports enp1s0
        bridge-stp off
        bridge-fd 0


auto vmbr1
iface vmbr1 inet manual
        bridge-ports enp35s0f0
        bridge-stp off
        bridge-fd 0


source /etc/network/interfaces.d/*

I tried giving vmbr1 an IP in the same subnet as vmbr0 and different one (always matching it on the windows side), but every time I assign an IP I lose connection the proxmox web interface. If I don't assign an IP it doesn't get one assigned.

ip a
Rich (BB code):
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute
       valid_lft forever preferred_lft forever
2: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
    link/ether 04:7b:cb:46:3d:1e brd ff:ff:ff:ff:ff:ff
3: enp35s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP group default qlen 1000
    link/ether b4:96:91:8f:5d:a4 brd ff:ff:ff:ff:ff:ff
4: enp35s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether b4:96:91:8f:5d:a6 brd ff:ff:ff:ff:ff:ff
5: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 04:7b:cb:46:3d:1e brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.100/24 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 fe80::67b:cbff:fe46:3d1e/64 scope link
       valid_lft forever preferred_lft forever
6: tap103i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr103i0 state UNKNOWN group default qlen 1000
    link/ether e6:98:cd:27:29:b0 brd ff:ff:ff:ff:ff:ff
7: fwbr103i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether d6:57:72:86:a9:8a brd ff:ff:ff:ff:ff:ff
8: fwpr103p0@fwln103i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
    link/ether 26:69:cb:a7:f0:66 brd ff:ff:ff:ff:ff:ff
9: fwln103i0@fwpr103p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr103i0 state UP group default qlen 1000
    link/ether d6:57:72:86:a9:8a brd ff:ff:ff:ff:ff:ff
14: veth105i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr105i0 state UP group default qlen 1000
    link/ether fe:c3:a8:a6:b8:9e brd ff:ff:ff:ff:ff:ff link-netnsid 1
15: fwbr105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether fa:7d:eb:29:85:cd brd ff:ff:ff:ff:ff:ff
16: fwpr105p0@fwln105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
    link/ether 32:5b:8b:71:bc:32 brd ff:ff:ff:ff:ff:ff
17: fwln105i0@fwpr105p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr105i0 state UP group default qlen 1000
    link/ether fa:7d:eb:29:85:cd brd ff:ff:ff:ff:ff:ff
32: veth104i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr104i0 state UP group default qlen 1000
    link/ether fe:83:af:23:b8:10 brd ff:ff:ff:ff:ff:ff link-netnsid 2
45: fwbr104i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 16:4a:0a:7f:5e:cf brd ff:ff:ff:ff:ff:ff
46: fwpr104p0@fwln104i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
    link/ether d2:f9:d1:21:78:b1 brd ff:ff:ff:ff:ff:ff
47: fwln104i0@fwpr104p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr104i0 state UP group default qlen 1000
    link/ether 16:4a:0a:7f:5e:cf brd ff:ff:ff:ff:ff:ff
50: vmbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether b4:96:91:8f:5d:a4 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::b696:91ff:fe8f:5da4/64 scope link
       valid_lft forever preferred_lft forever


I assume at some point I need to add vmbr1 to the vms but I can't get it to work with the host first. What am I missing? Maybe something on the router?
I appreciate any help, thanks in advance
 
I believe I'm halfway there, adding enp35s0f0 to vmbr0 I get 10gbps on iperf3 between windows<-> proxmox, and windows<->all vms and lxcs within Proxmox. The problem is one of the VMs is TrueNAS Scale and when I copy files only randomly I get 10gbps speeds, usually I get 1gbps.
Is there a way for the vm to use a specific port from the bridge?
 
/etc/network/interfaces

Code:
auto lo
iface lo inet loopback


iface enp1s0 inet manual
        pre-up /usr/sbin/ethtool -s enp1s0 advertise 0x1800000001028


iface enp35s0f0 inet manual
        pre-up /usr/sbin/ethtool -s enp35s0f0 advertise 0x1800000001028
#LAN


iface enp35s0f1 inet manual
        pre-up /usr/sbin/ethtool -s enp35s0f1 advertise 0x1800000001028
#LAN


auto vmbr0
iface vmbr0 inet static
        address 192.168.1.100/24
        gateway 192.168.1.254
        bridge-ports enp35s0f0 enp1s0
        bridge-stp off
        bridge-fd 0


source /etc/network/interfaces.d/*

before the bridge-ports order was "enp1s0 enp35s0f0" after flipping it I get 10gbps speeds every now and then. Any idea what I'm missing? I feel I'm closer but not sure if something can be done about it.