I lose connectivity when adding other network interfaces.

R

rickygm

Renowned Member
Proxmox Subscriber
Sep 16, 2015
136
6
83
Hi everyone, I have a situation in my cluster that I want to discuss with you, I am putting another 10GB interface to my nodes, but when I add the other interface and restart the node, this start but was without network connection, I put another card thinking that that could be failed and the same situation, I put it in another node and it is the same.

the model of the card I am adding is X540-AT2 , I'm already using another one for my iSCSI connection and the san network

lspci | egrep -i --color 'network|ethernet' 05:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01) 05:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01) 07:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01) 07:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01) 09:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (rev 06) 09:00.1 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (rev 06) 0a:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 0b:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection

lshw -c network *-network:0 description: Ethernet interface product: Ethernet Controller 10-Gigabit X540-AT2 vendor: Intel Corporation physical id: 0 bus info: pci@0000:05:00.0 logical name: enp5s0f0 version: 01 serial: a0:36:9f:1f:de:cc size: 10Gbit/s capacity: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi msix pciexpress bus_master cap_list rom ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.1.0-k duplex=full firmware=0x80000389 latency=0 link=yes multicast=yes port=twisted pair speed=10Gbit/s resources: irq:38 memory:dd200000-dd3fffff memory:dd404000-dd407fff memory:dee80000-deefffff memory:df200000-df2fffff memory:df100000-df1fffff *-network:1 description: Ethernet interface product: Ethernet Controller 10-Gigabit X540-AT2 vendor: Intel Corporation physical id: 0.1 bus info: pci@0000:05:00.1 logical name: enp5s0f1 version: 01 serial: a0:36:9f:1f:de:ce size: 10Gbit/s capacity: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi msix pciexpress bus_master cap_list rom ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.1.0-k duplex=full firmware=0x80000389 latency=0 link=yes multicast=yes port=twisted pair speed=10Gbit/s resources: irq:77 memory:dd000000-dd1fffff memory:dd400000-dd403fff memory:dee00000-dee7ffff memory:df000000-df0fffff memory:def00000-deffffff *-network:0 DISABLED description: Ethernet interface product: Ethernet Controller 10-Gigabit X540-AT2 vendor: Intel Corporation physical id: 0 bus info: pci@0000:07:00.0 logical name: enp7s0f0 version: 01 serial: a0:36:9f:4e:13:a4 capacity: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi msix pciexpress vpd bus_master cap_list rom ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.1.0-k firmware=0x800004db, 15.0.28 latency=0 link=no multicast=yes port=twisted pair resources: irq:103 memory:dcc00000-dcdfffff memory:dce04000-dce07fff memory:de980000-de9fffff memory:ded00000-dedfffff memory:dec00000-decfffff *-network:1 DISABLED description: Ethernet interface product: Ethernet Controller 10-Gigabit X540-AT2 vendor: Intel Corporation physical id: 0.1 bus info: pci@0000:07:00.1 logical name: enp7s0f1 version: 01 serial: a0:36:9f:4e:13:a6 capacity: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi msix pciexpress vpd bus_master cap_list rom ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.1.0-k firmware=0x800004db, 15.0.28 latency=0 link=no multicast=yes port=twisted pair resources: irq:129 memory:dca00000-dcbfffff memory:dce00000-dce03fff memory:de900000-de97ffff memory:deb00000-debfffff memory:dea00000-deafffff *-network:0 DISABLED description: Ethernet interface product: 82571EB Gigabit Ethernet Controller vendor: Intel Corporation physical id: 0 bus info: pci@0000:09:00.0 logical name: enp9s0f0 version: 06 serial: 00:15:17:d2:60:06 capacity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi pciexpress bus_master cap_list rom ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=3.2.6-k firmware=5.6-2 latency=0 link=no multicast=yes port=twisted pair resources: irq:37 memory:df780000-df79ffff memory:df760000-df77ffff ioport:7020(size=32) memory:df740000-df75ffff *-network:1 DISABLED description: Ethernet interface product: 82571EB Gigabit Ethernet Controller vendor: Intel Corporation physical id: 0.1 bus info: pci@0000:09:00.1 logical name: enp9s0f1 version: 06 serial: 00:15:17:d2:60:07 capacity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi pciexpress bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=3.2.6-k firmware=5.6-2 latency=0 link=no multicast=yes port=twisted pair resources: irq:43 memory:df720000-df73ffff memory:df700000-df71ffff ioport:7000(size=32) *-network description: Ethernet interface product: 82574L Gigabit Network Connection vendor: Intel Corporation physical id: 0 bus info: pci@0000:0a:00.0 logical name: enp10s0 version: 00 serial: 0c:c4:7a:c3:5e:9a size: 1Gbit/s capacity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi pciexpress msix bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=3.2.6-k duplex=full firmware=2.1-2 latency=0 link=yes multicast=yes port=twisted pair speed=1Gbit/s resources: irq:16 memory:df600000-df61ffff ioport:6000(size=32) memory:df620000-df623fff *-network DISABLED description: Ethernet interface product: 82574L Gigabit Network Connection vendor: Intel Corporation physical id: 0 bus info: pci@0000:0b:00.0 logical name: enp11s0 version: 00 serial: 0c:c4:7a:c3:5e:9b size: 1Gbit/s capacity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi pciexpress msix bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=3.2.6-k duplex=full firmware=2.1-2 latency=0 link=no multicast=yes port=twisted pair speed=1Gbit/s resources: irq:17 memory:df500000-df51ffff ioport:5000(size=32) memory:df520000-df523fff *-network:0 description: Ethernet interface physical id: 2 logical name: vmbr4 serial: 3a:4f:96:0b:92:ad capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A link=yes multicast=yes *-network:1 description: Ethernet interface physical id: 3 logical name: vmbr0 serial: 2a:9a:af:dd:d3:46 capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A ip=192.168.11.52 link=no multicast=yes *-network:2 description: Ethernet interface physical id: 4 logical name: vmbr3 serial: 0c:c4:7a:c3:5e:9a capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A ip=192.168.12.52 link=yes multicast=yes *-network:3 description: Ethernet interface physical id: 5 logical name: bond0 serial: 2a:9a:af:dd:d3:46 capabilities: ethernet physical configuration: autonegotiation=off broadcast=yes driver=bonding driverversion=3.7.1 firmware=2 link=no master=yes multicast=yes *-network:4 description: Ethernet interface physical id: 6 logical name: vmbr2 serial: a0:36:9f:1f:de:ce capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A ip=10.10.10.2 link=yes multicast=yes *-network:5 description: Ethernet interface physical id: 7 logical name: vmbr1 serial: a0:36:9f:1f:de:cc capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A ip=10.10.9.2 link=yes multicast=yes

dmesg | grep eth [ 2.978583] e1000e 0000:09:00.0 eth0: (PCI Express:2.5GT/s:Width x4) 00:15:17:d2:60:06 [ 2.978585] e1000e 0000:09:00.0 eth0: Intel(R) PRO/1000 Network Connection [ 2.978660] e1000e 0000:09:00.0 eth0: MAC: 0, PHY: 4, PBA No: C57721-005 [ 3.146513] e1000e 0000:09:00.1 eth1: (PCI Express:2.5GT/s:Width x4) 00:15:17:d2:60:07 [ 3.146515] e1000e 0000:09:00.1 eth1: Intel(R) PRO/1000 Network Connection [ 3.146590] e1000e 0000:09:00.1 eth1: MAC: 0, PHY: 4, PBA No: C57721-005 [ 3.250030] e1000e 0000:0a:00.0 eth2: (PCI Express:2.5GT/s:Width x1) 0c:c4:7a:c3:5e:9a [ 3.250032] e1000e 0000:0a:00.0 eth2: Intel(R) PRO/1000 Network Connection [ 3.250121] e1000e 0000:0a:00.0 eth2: MAC: 3, PHY: 8, PBA No: FFFFFF-0FF [ 3.354058] e1000e 0000:0b:00.0 eth3: (PCI Express:2.5GT/s:Width x1) 0c:c4:7a:c3:5e:9b [ 3.354060] e1000e 0000:0b:00.0 eth3: Intel(R) PRO/1000 Network Connection [ 3.354150] e1000e 0000:0b:00.0 eth3: MAC: 3, PHY: 8, PBA No: FFFFFF-0FF [ 3.355788] e1000e 0000:0a:00.0 enp10s0: renamed from eth2 [ 3.370201] e1000e 0000:0b:00.0 enp11s0: renamed from eth3 [ 3.403089] e1000e 0000:09:00.0 enp9s0f0: renamed from eth0 [ 3.446069] e1000e 0000:09:00.1 enp9s0f1: renamed from eth1 [ 5.298734] ixgbe 0000:05:00.0 enp5s0f0: renamed from eth2 [ 5.350072] ixgbe 0000:05:00.1 enp5s0f1: renamed from eth0 [ 5.406330] ixgbe 0000:07:00.1 enp7s0f1: renamed from eth3 [ 5.434155] ixgbe 0000:07:00.0 enp7s0f0: renamed from eth1


pveversion -v proxmox-ve: 6.4-1 (running kernel: 5.4.119-1-pve) pve-manager: 6.4-9 (running version: 6.4-9/5f5c0e3f) pve-kernel-5.4: 6.4-3 pve-kernel-helper: 6.4-3 pve-kernel-5.4.119-1-pve: 5.4.119-1 pve-kernel-5.4.106-1-pve: 5.4.106-1 pve-kernel-5.4.73-1-pve: 5.4.73-1 ceph-fuse: 12.2.11+dfsg1-2.1+b1 corosync: 3.1.2-pve1 criu: 3.11-3 glusterfs-client: 5.5-3 ifupdown: 0.8.35+pve1 ksm-control-daemon: 1.3-1 libjs-extjs: 6.0.1-10 libknet1: 1.20-pve1 libproxmox-acme-perl: 1.1.0 libproxmox-backup-qemu0: 1.0.3-1 libpve-access-control: 6.4-3 libpve-apiclient-perl: 3.1-3 libpve-common-perl: 6.4-3 libpve-guest-common-perl: 3.1-5 libpve-http-server-perl: 3.2-3 libpve-storage-perl: 6.4-1 libqb0: 1.0.5-1 libspice-server1: 0.14.2-4~pve6+1 lvm2: 2.03.02-pve4 lxc-pve: 4.0.6-2 lxcfs: 4.0.6-pve1 novnc-pve: 1.1.0-1 proxmox-backup-client: 1.1.10-1 proxmox-mini-journalreader: 1.1-1 proxmox-widget-toolkit: 2.5-6 pve-cluster: 6.4-1 pve-container: 3.3-5 pve-docs: 6.4-2 pve-edk2-firmware: 2.20200531-1 pve-firewall: 4.1-4 pve-firmware: 3.2-4 pve-ha-manager: 3.1-1 pve-i18n: 2.3-1 pve-qemu-kvm: 5.2.0-6 pve-xtermjs: 4.7.0-3 qemu-server: 6.4-2 smartmontools: 7.2-pve2 spiceterm: 3.1-1 vncterm: 1.6-2 zfsutils-linux: 2.0.4-pve1

any idea what might cause this behavior
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom