Intel i350 GB Dual Port adapter - shown but not working

C

chrisu

Renowned Member
Jun 5, 2012
41
0
71
Hello,

I am quit new to Proxmox VE and setup a Dell Server R420 with two BCM onboard adapters running Proxmox VE 2.3. Those adaptes seem not to be supported, so I installed a dual port Intel i350-T2 adapter. The adapter show in the configuration (ifconfig results shows correct vmbr0 and eth0) but I cannot get any network access. Are there some issues with those adapters known?

Greetings,

Chris
 
Hi,
I guess your numbering of NICs are not in the "right" order.
Look with '"ifconfig -a" if you see four NICs.
The ordering is done due to this file:
Code: 
cat /etc/udev/rules.d/70-persistent-net.rules
You can edit that file to get the numbering you like (reboot after that).

Udo
 
Hello Udo,
thanks for the reply, I tried to change eth0 interface to the other port but still no success. ifconfig shows eth0, lo venet0-00 and vmbr0. Interesting is that only one eth interface is shown but two are in the 70-persistent-net.rule file listed.

Any idea?

Greetings,

Chris
 
chrisu said:
Hello Udo,
thanks for the reply, I tried to change eth0 interface to the other port but still no success. ifconfig shows eth0, lo venet0-00 and vmbr0. Interesting is that only one eth interface is shown but two are in the 70-persistent-net.rule file listed.

Any idea?

Greetings,

Chris
Click to expand...
Hi Chris,
are the onboard nics enabled in the bios?

Please post the output of following commands to find the issue:
Code: 
ifconfig -a
lspci -v | egrep "^[0-9]|Kernel"
cat /etc/udev/rules.d/70-persistent-net.rules
dmesg | grep eth
Udo
 
chrisu said:
Hello,

I am quit new to Proxmox VE and setup a Dell Server R420 with two BCM onboard adapters running Proxmox VE 2.3. Those adaptes seem not to be supported, so I installed a dual port Intel i350-T2 adapter. The adapter show in the configuration (ifconfig results shows correct vmbr0 and eth0) but I cannot get any network access. Are there some issues with those adapters known?

Greetings,

Chris
Click to expand...
This is strange. On R420 the adapters are supported by the kernel for PVE 2.2. No problems at all. Might need to be cautious with upgrading those servers. Using the I350 adapters as well on PVE 2.2, they also work without problems. It might be entirely config related.
 
Hello Udo,
thank you for you reply. The onboard nics are disabled.
It will take a little to capture the information, especially as I have started to play with the network config (removed the bridge, added an ip-address to the second port of the i350,..) and I have to undo the changes or reinstall proxmox first.
Greetings,

Chris
 
chrisu said:
Hello Udo,
thank you for you reply. The onboard nics are disabled.
It will take a little to capture the information, especially as I have started to play with the network config (removed the bridge, added an ip-address to the second port of the i350,..) and I have to undo the changes or reinstall proxmox first.
Greetings,

Chris
Click to expand...
Hi,
reinstallation is not nessesary - all network related configs are in few files and can easily changed:
/etc/network/interfaces
/etc/resolv.conf
/etc/udev/rules.d/70-persistent-net.rules

BTW. why remove the bridge? Bridging is the normal way to provide a network to the VMs (depends on your networksetup - hosted system can be different (e.g. if only one mac-address is allowed)).

Udo
 
Hello Udo,
sorry for delay due to that Í am on vacation at the moment.
I removed the bridge only to reduce complexity for me at the moment. I know bridging is standard and works fine (usually).

Here is the output of the different files.
ifconfig -a:
eth0 Link encap:Ethernet HWaddr a0:36:9f:1c:52:ca
inet addr:10.200.1.100 Bcast:10.200.1.255 Mask:255.255.255.0
inet6 addr: fe80::a236:9fff:fe1c:52ca/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:910 errors:0 dropped:0 overruns:0 frame:0
TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:117614 (114.8 KiB) TX bytes:468 (468.0 B)

eth1 Link encap:Ethernet HWaddr a0:36:9f:1c:52:cb
inet addr:192.168.13.15 Bcast:192.168.13.255 Mask:255.255.255.0
inet6 addr: fe80::a236:9fff:fe1c:52cb/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:2650 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:111732 (109.1 KiB)

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:1800 errors:0 dropped:0 overruns:0 frame:0
TX packets:1800 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:182876 (178.5 KiB) TX bytes:182876 (178.5 KiB)

venet0 Link encap:UNSPEC HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
inet6 addr: fe80::1/128 Scope:Link
UP BROADCAST POINTOPOINT RUNNING NOARP MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:3 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

lspci:
00:00.0 Host bridge: Intel Corporation Xeon E5/Core i7 DMI2 (rev 07)
00:01.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1a (rev 07) (prog-if 00 [Normal decode])
Kernel driver in use: pcieport
00:03.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3a in PCI Express Mode (rev 07) (prog-if 00 [Normal decode])
Kernel driver in use: pcieport
00:05.0 System peripheral: Intel Corporation Xeon E5/Core i7 Address Map, VTd_Misc, System Management (rev 07)
00:05.2 System peripheral: Intel Corporation Xeon E5/Core i7 Control Status and Global Errors (rev 07)
00:11.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Virtual Root Port (rev 05) (prog-if 00 [Normal decode])
Kernel driver in use: pcieport
00:16.0 Communication controller: Intel Corporation C600/X79 series chipset MEI Controller #1 (rev 05)
00:16.1 Communication controller: Intel Corporation C600/X79 series chipset MEI Controller #2 (rev 05)
00:1a.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #2 (rev 05) (prog-if 20 [EHCI])
Kernel driver in use: ehci_hcd
00:1c.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 1 (rev b5) (prog-if 00 [Normal decode])
Kernel driver in use: pcieport
00:1c.4 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 5 (rev b5) (prog-if 00 [Normal decode])
Kernel driver in use: pcieport
00:1c.7 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 8 (rev b5) (prog-if 00 [Normal decode])
Kernel driver in use: pcieport
00:1d.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #1 (rev 05) (prog-if 20 [EHCI])
Kernel driver in use: ehci_hcd
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5) (prog-if 01 [Subtractive decode])
00:1f.0 ISA bridge: Intel Corporation C600/X79 series chipset LPC Controller (rev 05)
00:1f.2 SATA controller: Intel Corporation C600/X79 series chipset 6-Port SATA AHCI Controller (rev 05) (prog-if 01 [AHCI 1.0])
Kernel driver in use: ahci
01:00.0 RAID bus controller: LSI Logic / Symbios Logic MegaRAID SAS 2008 [Falcon] (rev 03)
Kernel driver in use: megaraid_sas
03:00.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe Switch [PS] (prog-if 00 [Normal decode])
04:00.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe Switch [PS] (prog-if 00 [Normal decode])
04:01.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe Switch [PS] (prog-if 00 [Normal decode])
05:00.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe-PCI Bridge [PPB] (prog-if 00 [Normal decode])
06:00.0 VGA compatible controller: Matrox Electronics Systems Ltd. G200eR2 (prog-if 00 [VGA controller])
0a:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
Kernel driver in use: igb
0a:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
Kernel driver in use: igb
3f:08.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 0 (rev 07)
3f:09.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 1 (rev 07)
3f:0a.0 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 (rev 07)
3f:0a.1 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 (rev 07)
3f:0a.2 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 (rev 07)
3f:0a.3 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 (rev 07)
3f:0b.0 System peripheral: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers (rev 07)
3f:0b.3 System peripheral: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers (rev 07)
3f:0c.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 (rev 07)
3f:0c.7 System peripheral: Intel Corporation Xeon E5/Core i7 System Address Decoder (rev 07)
3f:0d.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 (rev 07)
3f:0e.0 System peripheral: Intel Corporation Xeon E5/Core i7 Processor Home Agent (rev 07)
3f:0e.1 Performance counters: Intel Corporation Xeon E5/Core i7 Processor Home Agent Performance Monitoring (rev 07)
3f:0f.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers (rev 07)
Kernel driver in use: sbridge_edac
3f:0f.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers (rev 07)
3f:0f.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 (rev 07)
3f:0f.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 (rev 07)
3f:0f.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 (rev 07)
3f:0f.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 (rev 07)
3f:0f.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 (rev 07)
3f:10.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 (rev 07)
3f:10.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 (rev 07)
3f:10.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 (rev 07)
3f:10.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 (rev 07)
3f:10.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 (rev 07)
3f:10.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 (rev 07)
3f:10.7 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 (rev 07)
3f:11.0 System peripheral: Intel Corporation Xeon E5/Core i7 DDRIO (rev 07)
3f:13.0 System peripheral: Intel Corporation Xeon E5/Core i7 R2PCIe (rev 07)
3f:13.1 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to PCI Express Performance Monitor (rev 07)
3f:13.4 Performance counters: Intel Corporation Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers (rev 07)
3f:13.5 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor (rev 07)
3f:13.6 System peripheral: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor (rev 07)

dmesg:
igb 0000:0a:00.0: eth0: (PCIe:5.0GT/s:Width x4)
igb 0000:0a:00.0: eth0: MAC: a0:36:9f:1c:52:ca
igb 0000:0a:00.0: eth0: PBA No: G15138-002
igb 0000:0a:00.1: eth1: (PCIe:5.0GT/s:Width x4)
igb 0000:0a:00.1: eth1: MAC: a0:36:9f:1c:52:cb
igb 0000:0a:00.1: eth1: PBA No: G15138-002
ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff88082ccd6df8), AE_NOT_EXIST
ACPI Error (psparse-0537): Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff88082ccd6e98), AE_NOT_EXIST
ADDRCONF(NETDEV_UP): eth0: link is not ready
ADDRCONF(NETDEV_UP): eth1: link is not ready
igb: eth1 NIC Link is Up 100 Mbps Half Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
eth1: no IPv6 routers present
eth0: no IPv6 routers present
ADDRCONF(NETDEV_UP): eth1: link is not ready
igb: eth1 NIC Link is Up 100 Mbps Half Duplex, Flow Control: RX/TX
ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
eth1: no IPv6 routers present
igb: eth1 NIC Link is Down
igb: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None

The link speed switching is caused by multiple attemps to change the port speed on the lan switch. I have tried to use a different physical port on the switch without success.

btw. the adapter with 10.200.1.x is back to back link with my storage device running FreeNAS and and i350-T2 adapter to. This link works!?


Thank you for any assistance!

Greetings,

Chris
The Broadcom NIC are disabled in the BIOS.
 
chrisu said:
Hello Udo,
sorry for delay due to that Í am on vacation at the moment.
I removed the bridge only to reduce complexity for me at the moment. I know bridging is standard and works fine (usually).

Here is the output of the different files.
ifconfig -a:
eth0 Link encap:Ethernet HWaddr a0:36:9f:1c:52:ca
inet addr:10.200.1.100 Bcast:10.200.1.255 Mask:255.255.255.0
inet6 addr: fe80::a236:9fff:fe1c:52ca/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:910 errors:0 dropped:0 overruns:0 frame:0
TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:117614 (114.8 KiB) TX bytes:468 (468.0 B)

eth1 Link encap:Ethernet HWaddr a0:36:9f:1c:52:cb
inet addr:192.168.13.15 Bcast:192.168.13.255 Mask:255.255.255.0
inet6 addr: fe80::a236:9fff:fe1c:52cb/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:2650 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:111732 (109.1 KiB)
...


The Broadcom NIC are disabled in the BIOS.
Click to expand...
Hi,
looks like an demaged cable/switchport/nic-port on eth1 (nothing received).
Do you have switched cable between eth0 and eth1 (and also IPs) to see if the physical port is ok?

What's about enabling the broadcom-nic? Not that I will say that broadcom nics are more reliable than intel-nics ;)

Udo
 
Hi Udo,
thanks for reply. I was thinking of replacing the cabling. I have already tested switching the two interfaces (back2back and LAN) and the back2back link always worked. According yours and kobukis feedback I will try using the Broadcom adapters.
Due to the fact that I am still abroad, I will be able to do testing on tuesday evening earliest.

Thanks for your assistance, I'll post news as soon as they are available.

Best greetings,

Chris

- - - Updated - - -

Hi,

thanks for the info that the broadcom nics should work and that there are running setups with that nics. I am gonna give it another try this week.

Greetings,

Chris
 
Hi Udo,

replaced the cabling and suddenly the nics work. Bad thing, I haven't though of a cable being the reason for all the troubles. To be honest, the cables were brand new...
I have reactivated the Broadcom onboard adapters. Maybe I am gonna give them a try the next days.

Thanks for the assistance!

Best Greetings,

Chris
 
Hi,
to complete this thread. Finally I reactivated the onboard Broadcom adapters and found again problems accessing the network. It seemed that the broadcom nic was pass through the i350 intel nic but additional testing showed that the network switch seemed to work not properly. Replacing the switch made the intel nics and the Broadcoms work. All strange behavior is gone and both nic work fine now. (Btw the replace cables work on the other switch fine......)

Thanks again for support!
Greeting Chris
 
chrisu said:
Hi,
to complete this thread. Finally I reactivated the onboard Broadcom adapters and found again problems accessing the network. It seemed that the broadcom nic was pass through the i350 intel nic but additional testing showed that the network switch seemed to work not properly. Replacing the switch made the intel nics and the Broadcoms work. All strange behavior is gone and both nic work fine now. (Btw the replace cables work on the other switch fine......)

Thanks again for support!
Greeting Chris
Click to expand...


Hi, I have the problem with network card interface intel in proxmox 3.3:

02:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
02:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)

The eth1 down sometimes...every 3 minutes, error vmbr1(eth1) state down...

Dec 2 14:09:26 sd-52153 kernel: igb 0000:02:00.1: eth1: igb: eth1 NIC Link is Down
Dec 2 14:09:26 sd-52153 kernel: vmbr1: port 1(eth1) entering disabled state
^C
root@sd-52153:~# tail -f /var/log/syslog | grep -i eth
Dec 2 14:09:26 sd-52153 kernel: device veth802.0 entered promiscuous mode
Dec 2 14:09:26 sd-52153 kernel: vmbr1: port 4(veth802.0) entering forwarding state
Dec 2 14:09:26 sd-52153 kernel: igb 0000:02:00.1: eth1: igb: eth1 NIC Link is Down
Dec 2 14:09:26 sd-52153 kernel: vmbr1: port 1(eth1) entering disabled state
Dec 2 14:11:31 sd-52153 kernel: igb 0000:02:00.1: eth1: igb: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
Dec 2 14:11:31 sd-52153 kernel: vmbr1: port 1(eth1) entering forwarding state
Dec 2 14:11:32 sd-52153 kernel: igb 0000:02:00.1: eth1: igb: eth1 NIC Link is Down
Dec 2 14:11:32 sd-52153 kernel: vmbr1: port 1(eth1) entering disabled state

I have update the igb driver intel:

root@sd-52153:~# modinfo igb
filename: /lib/modules/2.6.32-34-pve/kernel/drivers/net/igb/igb.ko
version: 5.2.9.4
license: GPL


But the result is the same...

Can I help me please?
 
maykel535 said:
Hi, I have the problem with network card interface intel in proxmox 3.3:

02:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
02:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)

The eth1 down sometimes...every 3 minutes, error vmbr1(eth1) state down...

Dec 2 14:09:26 sd-52153 kernel: igb 0000:02:00.1: eth1: igb: eth1 NIC Link is Down
Dec 2 14:09:26 sd-52153 kernel: vmbr1: port 1(eth1) entering disabled state
^C
root@sd-52153:~# tail -f /var/log/syslog | grep -i eth
Dec 2 14:09:26 sd-52153 kernel: device veth802.0 entered promiscuous mode
Dec 2 14:09:26 sd-52153 kernel: vmbr1: port 4(veth802.0) entering forwarding state
Dec 2 14:09:26 sd-52153 kernel: igb 0000:02:00.1: eth1: igb: eth1 NIC Link is Down
Dec 2 14:09:26 sd-52153 kernel: vmbr1: port 1(eth1) entering disabled state
Dec 2 14:11:31 sd-52153 kernel: igb 0000:02:00.1: eth1: igb: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
Dec 2 14:11:31 sd-52153 kernel: vmbr1: port 1(eth1) entering forwarding state
Dec 2 14:11:32 sd-52153 kernel: igb 0000:02:00.1: eth1: igb: eth1 NIC Link is Down
Dec 2 14:11:32 sd-52153 kernel: vmbr1: port 1(eth1) entering disabled state

I have update the igb driver intel:

root@sd-52153:~# modinfo igb
filename: /lib/modules/2.6.32-34-pve/kernel/drivers/net/igb/igb.ko
version: 5.2.9.4
license: GPL


But the result is the same...

Can I help me please?
Click to expand...


Hi,

Did you ever fixed this?
We have the same problem with some servers with I350. Sometimes one nic goes down and we have to reboot the host to fix it.
We have a few servers with I350 and it only happened on some but it is random.
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back