Onboard intel nic issue or something else?

[daaw_gees]

Recently deployed a new server and created a cluster. New node has an onboard intel nic (I've heard these can be troublesome) - but the problem here is that it is not getting anywhere near the advertised speed. I've checked and replaced cables and this is what i get:

new node:
root@pve2:~# ethtool enp3s0 Settings for enp3s0: Supported ports: [ TP ] Supported link modes: 10baseT/Half 10baseT/Full 100baseT/Half 100baseT/Full 1000baseT/Full Supported pause frame use: Symmetric Supports auto-negotiation: Yes Supported FEC modes: Not reported Advertised link modes: 10baseT/Half 10baseT/Full 100baseT/Half 100baseT/Full 1000baseT/Full Advertised pause frame use: Symmetric Advertised auto-negotiation: Yes Advertised FEC modes: Not reported Speed: 100Mb/s Duplex: Full Auto-negotiation: on Port: Twisted Pair PHYAD: 1 Transceiver: internal MDI-X: on (auto) Supports Wake-on: pumbg Wake-on: g Current message level: 0x00000007 (7) drv probe link Link detected: yes

old node:
root@Fanti-Pve:~# ethtool enp6s0
Settings for enp6s0:
Supported ports: [ TP MII ]
Supported link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Supported pause frame use: Symmetric Receive-only
Supports auto-negotiation: Yes
Supported FEC modes: Not reported
Advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Advertised pause frame use: Symmetric Receive-only
Advertised auto-negotiation: Yes
Advertised FEC modes: Not reported
Link partner advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Half 1000baseT/Full
Link partner advertised pause frame use: Symmetric Receive-only
Link partner advertised auto-negotiation: Yes
Link partner advertised FEC modes: Not reported
Speed: 1000Mb/s
Duplex: Full
Auto-negotiation: on
master-slave cfg: preferred slave
master-slave status: slave
Port: Twisted Pair
PHYAD: 0
Transceiver: external
MDI-X: Unknown
Supports Wake-on: pumbg
Wake-on: d
Link detected: yes

Not sure if this is another case of needing to go buy a pcie card that isn't based on intel (had to do that with the original node: with that one, the connection was constantly dropping). Any thoughts? And what other information can I provide?

 

[daaw_gees]

I also noticed this in the gui syslog after a reboot of the new node:

Dec 09 13:38:05 pve2 kernel: igb 0000:03:00.0 enp3s0: igb: enp3s0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX Dec 09 13:38:06 pve2 pvestatd[1076]: storage 'VM-Restore' is not online Dec 09 13:38:06 pve2 pvestatd[1076]: status update time (5.086 seconds) Dec 09 13:38:07 pve2 kernel: igb 0000:03:00.0: exceed max 2 second Dec 09 13:38:07 pve2 kernel: igb 0000:03:00.0 enp3s0: igb: enp3s0 NIC Link is Down Dec 09 13:38:08 pve2 kernel: igb 0000:03:00.0 enp3s0: igb: enp3s0 NIC Link is Up 100 Mbps Full Duplex, Flow Control: RX/TX Dec 09 13:38:08 pve2 kernel: vmbr0: port 1(enp3s0) entered blocking state Dec 09 13:38:08 pve2 kernel: vmbr0: port 1(enp3s0) entered forwarding state