[SOLVED] linkdown on second NIC

nve

Member
Oct 17, 2018
2
0
21
46
Hi all,

I've been browsing this forum all day to fix my problem but I can't seem to find a solution. Here is the situation:

I have installed Proxmox VE on a bare-metal server. This server has got 2 NICs:
- One 1Gbps NIC which is connected to the company LAN (which is 1Gbp)
- One 10Gbps NIC which is directly connected by a RJ45 cable to a Synology NAS equipped with a 10 Gbps NIC too. These are the only two equipments in my company with 10Gbps NICs.

The reason why I bought the 10Gbps NICs for the server and the NAS is that I intend to install guests on iSCSI targets on the NAS. I hope this is not a stupid idea (I'm very new to server virtualization).

Until now, I have not been able to ping the NAS through the 2nd NIC. Here is my /etc/network/interfaces file:

Code:
auto lo
iface lo inet loopback

iface enp5s0 inet manual

iface enp10s0 inet manual

auto vmbr0
iface vmbr0 inet static
        address  192.168.0.250
        netmask  255.255.255.0
        gateway  192.168.0.1
        bridge_ports enp5s0
        bridge_stp off
        bridge_fd 0

auto vmbr1
iface vmbr1 inet static
        address  192.168.10.250
        netmask  255.255.255.0
        bridge_ports enp10s0
        bridge_stp off
        bridge_fd 0

Nevertheless, the command "ip route" gives me:
Code:
default via 192.168.0.1 dev vmbr0 onlink
192.168.0.0/24 dev vmbr0 proto kernel scope link src 192.168.0.250
192.168.10.0/24 dev vmbr1 proto kernel scope link src 192.168.10.250 linkdown

And indeed I cannot ping the NAS (its 10G NIC has the IP address 192.168.10.100)

Waht am I doing wrong?

Thanks!
 
92.168.10.0/24 dev vmbr1 proto kernel scope link src 192.168.10.250 linkdown
the `linkdown` in the line above suggests that the 10G nic does not have a link (is not connected) - you can verify that, by checking the output of
`ip link` (the line for vmbr1 and enp10s0 needs to contain UP and LOWER_UP)

the output of dmesg might indicate why there is no link, and you should also check the synology, maybe there is some information there
 
Thank you for your help. I figured it out: it was a driver issue.
My 10G nic is a ASUS XG-C100C. My PVE installation was running kernel 4.15.17-1-pve.
By digging the internet, I found out that for some reason, the nic does not work with this kernel.
After upgrading the kernel to 4.15.18-7-pve, the nic works out of the box.
I hope this can help anyone.
 
Glad you found a solution!
Please mark the post as solved - that helps others know that they can expect a solution at its end :)