[SOLVED] Networking via thunderbolt

[rossd]

I have two nucs (pve0 - a nuc 11 & pve1 - a nuc 10) connected via a thunderbolt 4 cable.

I have the thunderbolt modules loaded:

root@pve0:~# lsmod | grep thunderbolt
thunderbolt_net        49152  0
thunderbolt           475136  1 thunderbolt_net



root@pve1:~# lsmod | grep thunderbolt
intel_wmi_thunderbolt    16384  0
thunderbolt_net        49152  0
thunderbolt           475136  1 thunderbolt_net
wmi                    40960  3 video,intel_wmi_thunderbolt,wmi_bmof

I have the following in my networks config:

root@pve0:~# cat /etc/network/interfaces | grep thunder
auto thunderbolt0
iface thunderbolt0 inet static address 10.0.0.1/29 mtu 65520

root@pve1:~# cat /etc/network/interfaces | grep thunder
auto thunderbolt0
iface thunderbolt0 inet static address 10.0.0.2/29 mtu 65520

I've executed ip link set thunderbolt0 up on both nodes

running ip a on pve0 shows:

4: thunderbolt0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether 12:fa:4f:0f:24:82 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::10fa:4fff:fe0f:2482/64 scope link
       valid_lft forever preferred_lft forever

and on pve 1 shows

20: thunderbolt0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether 02:00:44:e8:bc:a4 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::44ff:fee8:bca4/64 scope link
       valid_lft forever preferred_lft forever

but neither have the ip4 static addresses I assigned.


running this on pve0 shows it's getting something from pve1:

root@pve0:/sys/bus/thunderbolt/devices/0-0/0-3# cat device_name
pve1

and from pve1:

root@pve1:/sys/bus/thunderbolt/devices/0-0/0-1# cat device_name
(none)

I can see this:

root@pve0:/sys/bus/thunderbolt/devices/0-0/0-3/0-3.0/net/thunderbolt0/statistics# cat rx_bytes
45558
root@pve0:/sys/bus/thunderbolt/devices/0-0/0-3/0-3.0/net/thunderbolt0/statistics# cat tx_bytes
46614

and

root@pve1:/sys/bus/thunderbolt/devices/0-1/0-1.0/net/thunderbolt0/statistics# cat rx_bytes
44670
root@pve1:/sys/bus/thunderbolt/devices/0-1/0-1.0/net/thunderbolt0/statistics# cat tx_bytes
44820

I've tried pinging the ipv6 address and that doesn't work either:

root@pve0:~# ping fe80::44ff:fee8:bca4 -6
PING fe80::44ff:fee8:bca4(fe80::44ff:fee8:bca4) 56 data bytes
From fe80::2e0:4cff:fe9f:528b%vmbr0 icmp_seq=1 Destination unreachable: Address unreachable

Any ideas would be really helpful!

 

[rossd]

I setup a linux bridge using the thundbolt0 and that fixed it!

 

[Finale3333]

Posting the solution for other users

iface thunderbolt0 inet manual

auto vmbr10
iface vmbr10 inet static
    address 192.168.XXX.XXX/24
    bridge-ports thunderbolt0
    bridge-stp off
    bridge-fd 0

then run ip link set vmbr10 up

You should also see the interfaces in PVE web GUI