Connect proxmox directly to windows PC

thphon

New Member
Sep 22, 2024
8
1
3
Hi all,

I'm trying to connect my proxmox directly to a windows pc while both are already connected to the router, this is because the router has 2.5gbps x1 and 1gbps x3 ports and I have spare 10gbps nics on both machines. I'm trying to avoid upgrading the router or buying a 10gbps switch and I believe it's possible to have the connection to the router to access internet and the direct connection for the LAN at higher speeds but I can't get it to work.
My setup is the following:

proxmox has 3 nics, enp1s0 is connected to the router and it's using vmbr0, enp35s0f0 is connected to the windows machine
windows has 2 nics, one is connected to the router and the other to the proxmox machine.

cat /etc/network/interfaces
Rich (BB code):
auto lo
iface lo inet loopback


iface enp1s0 inet manual
        pre-up /usr/sbin/ethtool -s enp1s0 advertise 0x1800000001028


iface enp35s0f0 inet manual
        pre-up /usr/sbin/ethtool -s enp35s0f0 advertise 0x1800000001028
#LAN


iface enp35s0f1 inet manual
        pre-up /usr/sbin/ethtool -s enp35s0f1 advertise 0x1800000001028
#LAN


auto vmbr0
iface vmbr0 inet static
        address 192.168.1.100/24
        gateway 192.168.1.254
        bridge-ports enp1s0
        bridge-stp off
        bridge-fd 0


auto vmbr1
iface vmbr1 inet manual
        bridge-ports enp35s0f0
        bridge-stp off
        bridge-fd 0


source /etc/network/interfaces.d/*

I tried giving vmbr1 an IP in the same subnet as vmbr0 and different one (always matching it on the windows side), but every time I assign an IP I lose connection the proxmox web interface. If I don't assign an IP it doesn't get one assigned.

ip a
Rich (BB code):
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute
       valid_lft forever preferred_lft forever
2: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
    link/ether 04:7b:cb:46:3d:1e brd ff:ff:ff:ff:ff:ff
3: enp35s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP group default qlen 1000
    link/ether b4:96:91:8f:5d:a4 brd ff:ff:ff:ff:ff:ff
4: enp35s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether b4:96:91:8f:5d:a6 brd ff:ff:ff:ff:ff:ff
5: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 04:7b:cb:46:3d:1e brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.100/24 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 fe80::67b:cbff:fe46:3d1e/64 scope link
       valid_lft forever preferred_lft forever
6: tap103i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr103i0 state UNKNOWN group default qlen 1000
    link/ether e6:98:cd:27:29:b0 brd ff:ff:ff:ff:ff:ff
7: fwbr103i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether d6:57:72:86:a9:8a brd ff:ff:ff:ff:ff:ff
8: fwpr103p0@fwln103i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
    link/ether 26:69:cb:a7:f0:66 brd ff:ff:ff:ff:ff:ff
9: fwln103i0@fwpr103p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr103i0 state UP group default qlen 1000
    link/ether d6:57:72:86:a9:8a brd ff:ff:ff:ff:ff:ff
14: veth105i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr105i0 state UP group default qlen 1000
    link/ether fe:c3:a8:a6:b8:9e brd ff:ff:ff:ff:ff:ff link-netnsid 1
15: fwbr105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether fa:7d:eb:29:85:cd brd ff:ff:ff:ff:ff:ff
16: fwpr105p0@fwln105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
    link/ether 32:5b:8b:71:bc:32 brd ff:ff:ff:ff:ff:ff
17: fwln105i0@fwpr105p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr105i0 state UP group default qlen 1000
    link/ether fa:7d:eb:29:85:cd brd ff:ff:ff:ff:ff:ff
32: veth104i0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr104i0 state UP group default qlen 1000
    link/ether fe:83:af:23:b8:10 brd ff:ff:ff:ff:ff:ff link-netnsid 2
45: fwbr104i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 16:4a:0a:7f:5e:cf brd ff:ff:ff:ff:ff:ff
46: fwpr104p0@fwln104i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
    link/ether d2:f9:d1:21:78:b1 brd ff:ff:ff:ff:ff:ff
47: fwln104i0@fwpr104p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr104i0 state UP group default qlen 1000
    link/ether 16:4a:0a:7f:5e:cf brd ff:ff:ff:ff:ff:ff
50: vmbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether b4:96:91:8f:5d:a4 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::b696:91ff:fe8f:5da4/64 scope link
       valid_lft forever preferred_lft forever


I assume at some point I need to add vmbr1 to the vms but I can't get it to work with the host first. What am I missing? Maybe something on the router?
I appreciate any help, thanks in advance
 
I believe I'm halfway there, adding enp35s0f0 to vmbr0 I get 10gbps on iperf3 between windows<-> proxmox, and windows<->all vms and lxcs within Proxmox. The problem is one of the VMs is TrueNAS Scale and when I copy files only randomly I get 10gbps speeds, usually I get 1gbps.
Is there a way for the vm to use a specific port from the bridge?
 
/etc/network/interfaces

Code:
auto lo
iface lo inet loopback


iface enp1s0 inet manual
        pre-up /usr/sbin/ethtool -s enp1s0 advertise 0x1800000001028


iface enp35s0f0 inet manual
        pre-up /usr/sbin/ethtool -s enp35s0f0 advertise 0x1800000001028
#LAN


iface enp35s0f1 inet manual
        pre-up /usr/sbin/ethtool -s enp35s0f1 advertise 0x1800000001028
#LAN


auto vmbr0
iface vmbr0 inet static
        address 192.168.1.100/24
        gateway 192.168.1.254
        bridge-ports enp35s0f0 enp1s0
        bridge-stp off
        bridge-fd 0


source /etc/network/interfaces.d/*

before the bridge-ports order was "enp1s0 enp35s0f0" after flipping it I get 10gbps speeds every now and then. Any idea what I'm missing? I feel I'm closer but not sure if something can be done about it.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!