I lose connectivity when adding other network interfaces.

R

rickygm

Renowned Member
Proxmox Subscriber
Sep 16, 2015
138
6
83
Hi everyone, I have a situation in my cluster that I want to discuss with you, I am putting another 10GB interface to my nodes, but when I add the other interface and restart the node, this start but was without network connection, I put another card thinking that that could be failed and the same situation, I put it in another node and it is the same.

the model of the card I am adding is X540-AT2 , I'm already using another one for my iSCSI connection and the san network

lspci | egrep -i --color 'network|ethernet' 05:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01) 05:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01) 07:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01) 07:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10-Gigabit X540-AT2 (rev 01) 09:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (rev 06) 09:00.1 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (rev 06) 0a:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 0b:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection

lshw -c network *-network:0 description: Ethernet interface product: Ethernet Controller 10-Gigabit X540-AT2 vendor: Intel Corporation physical id: 0 bus info: pci@0000:05:00.0 logical name: enp5s0f0 version: 01 serial: a0:36:9f:1f:de:cc size: 10Gbit/s capacity: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi msix pciexpress bus_master cap_list rom ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.1.0-k duplex=full firmware=0x80000389 latency=0 link=yes multicast=yes port=twisted pair speed=10Gbit/s resources: irq:38 memory:dd200000-dd3fffff memory:dd404000-dd407fff memory:dee80000-deefffff memory:df200000-df2fffff memory:df100000-df1fffff *-network:1 description: Ethernet interface product: Ethernet Controller 10-Gigabit X540-AT2 vendor: Intel Corporation physical id: 0.1 bus info: pci@0000:05:00.1 logical name: enp5s0f1 version: 01 serial: a0:36:9f:1f:de:ce size: 10Gbit/s capacity: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi msix pciexpress bus_master cap_list rom ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.1.0-k duplex=full firmware=0x80000389 latency=0 link=yes multicast=yes port=twisted pair speed=10Gbit/s resources: irq:77 memory:dd000000-dd1fffff memory:dd400000-dd403fff memory:dee00000-dee7ffff memory:df000000-df0fffff memory:def00000-deffffff *-network:0 DISABLED description: Ethernet interface product: Ethernet Controller 10-Gigabit X540-AT2 vendor: Intel Corporation physical id: 0 bus info: pci@0000:07:00.0 logical name: enp7s0f0 version: 01 serial: a0:36:9f:4e:13:a4 capacity: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi msix pciexpress vpd bus_master cap_list rom ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.1.0-k firmware=0x800004db, 15.0.28 latency=0 link=no multicast=yes port=twisted pair resources: irq:103 memory:dcc00000-dcdfffff memory:dce04000-dce07fff memory:de980000-de9fffff memory:ded00000-dedfffff memory:dec00000-decfffff *-network:1 DISABLED description: Ethernet interface product: Ethernet Controller 10-Gigabit X540-AT2 vendor: Intel Corporation physical id: 0.1 bus info: pci@0000:07:00.1 logical name: enp7s0f1 version: 01 serial: a0:36:9f:4e:13:a6 capacity: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi msix pciexpress vpd bus_master cap_list rom ethernet physical tp 100bt-fd 1000bt-fd 10000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=ixgbe driverversion=5.1.0-k firmware=0x800004db, 15.0.28 latency=0 link=no multicast=yes port=twisted pair resources: irq:129 memory:dca00000-dcbfffff memory:dce00000-dce03fff memory:de900000-de97ffff memory:deb00000-debfffff memory:dea00000-deafffff *-network:0 DISABLED description: Ethernet interface product: 82571EB Gigabit Ethernet Controller vendor: Intel Corporation physical id: 0 bus info: pci@0000:09:00.0 logical name: enp9s0f0 version: 06 serial: 00:15:17:d2:60:06 capacity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi pciexpress bus_master cap_list rom ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=3.2.6-k firmware=5.6-2 latency=0 link=no multicast=yes port=twisted pair resources: irq:37 memory:df780000-df79ffff memory:df760000-df77ffff ioport:7020(size=32) memory:df740000-df75ffff *-network:1 DISABLED description: Ethernet interface product: 82571EB Gigabit Ethernet Controller vendor: Intel Corporation physical id: 0.1 bus info: pci@0000:09:00.1 logical name: enp9s0f1 version: 06 serial: 00:15:17:d2:60:07 capacity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi pciexpress bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=3.2.6-k firmware=5.6-2 latency=0 link=no multicast=yes port=twisted pair resources: irq:43 memory:df720000-df73ffff memory:df700000-df71ffff ioport:7000(size=32) *-network description: Ethernet interface product: 82574L Gigabit Network Connection vendor: Intel Corporation physical id: 0 bus info: pci@0000:0a:00.0 logical name: enp10s0 version: 00 serial: 0c:c4:7a:c3:5e:9a size: 1Gbit/s capacity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi pciexpress msix bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=3.2.6-k duplex=full firmware=2.1-2 latency=0 link=yes multicast=yes port=twisted pair speed=1Gbit/s resources: irq:16 memory:df600000-df61ffff ioport:6000(size=32) memory:df620000-df623fff *-network DISABLED description: Ethernet interface product: 82574L Gigabit Network Connection vendor: Intel Corporation physical id: 0 bus info: pci@0000:0b:00.0 logical name: enp11s0 version: 00 serial: 0c:c4:7a:c3:5e:9b size: 1Gbit/s capacity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi pciexpress msix bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=3.2.6-k duplex=full firmware=2.1-2 latency=0 link=no multicast=yes port=twisted pair speed=1Gbit/s resources: irq:17 memory:df500000-df51ffff ioport:5000(size=32) memory:df520000-df523fff *-network:0 description: Ethernet interface physical id: 2 logical name: vmbr4 serial: 3a:4f:96:0b:92:ad capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A link=yes multicast=yes *-network:1 description: Ethernet interface physical id: 3 logical name: vmbr0 serial: 2a:9a:af:dd:d3:46 capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A ip=192.168.11.52 link=no multicast=yes *-network:2 description: Ethernet interface physical id: 4 logical name: vmbr3 serial: 0c:c4:7a:c3:5e:9a capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A ip=192.168.12.52 link=yes multicast=yes *-network:3 description: Ethernet interface physical id: 5 logical name: bond0 serial: 2a:9a:af:dd:d3:46 capabilities: ethernet physical configuration: autonegotiation=off broadcast=yes driver=bonding driverversion=3.7.1 firmware=2 link=no master=yes multicast=yes *-network:4 description: Ethernet interface physical id: 6 logical name: vmbr2 serial: a0:36:9f:1f:de:ce capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A ip=10.10.10.2 link=yes multicast=yes *-network:5 description: Ethernet interface physical id: 7 logical name: vmbr1 serial: a0:36:9f:1f:de:cc capabilities: ethernet physical configuration: broadcast=yes driver=bridge driverversion=2.3 firmware=N/A ip=10.10.9.2 link=yes multicast=yes

dmesg | grep eth [ 2.978583] e1000e 0000:09:00.0 eth0: (PCI Express:2.5GT/s:Width x4) 00:15:17:d2:60:06 [ 2.978585] e1000e 0000:09:00.0 eth0: Intel(R) PRO/1000 Network Connection [ 2.978660] e1000e 0000:09:00.0 eth0: MAC: 0, PHY: 4, PBA No: C57721-005 [ 3.146513] e1000e 0000:09:00.1 eth1: (PCI Express:2.5GT/s:Width x4) 00:15:17:d2:60:07 [ 3.146515] e1000e 0000:09:00.1 eth1: Intel(R) PRO/1000 Network Connection [ 3.146590] e1000e 0000:09:00.1 eth1: MAC: 0, PHY: 4, PBA No: C57721-005 [ 3.250030] e1000e 0000:0a:00.0 eth2: (PCI Express:2.5GT/s:Width x1) 0c:c4:7a:c3:5e:9a [ 3.250032] e1000e 0000:0a:00.0 eth2: Intel(R) PRO/1000 Network Connection [ 3.250121] e1000e 0000:0a:00.0 eth2: MAC: 3, PHY: 8, PBA No: FFFFFF-0FF [ 3.354058] e1000e 0000:0b:00.0 eth3: (PCI Express:2.5GT/s:Width x1) 0c:c4:7a:c3:5e:9b [ 3.354060] e1000e 0000:0b:00.0 eth3: Intel(R) PRO/1000 Network Connection [ 3.354150] e1000e 0000:0b:00.0 eth3: MAC: 3, PHY: 8, PBA No: FFFFFF-0FF [ 3.355788] e1000e 0000:0a:00.0 enp10s0: renamed from eth2 [ 3.370201] e1000e 0000:0b:00.0 enp11s0: renamed from eth3 [ 3.403089] e1000e 0000:09:00.0 enp9s0f0: renamed from eth0 [ 3.446069] e1000e 0000:09:00.1 enp9s0f1: renamed from eth1 [ 5.298734] ixgbe 0000:05:00.0 enp5s0f0: renamed from eth2 [ 5.350072] ixgbe 0000:05:00.1 enp5s0f1: renamed from eth0 [ 5.406330] ixgbe 0000:07:00.1 enp7s0f1: renamed from eth3 [ 5.434155] ixgbe 0000:07:00.0 enp7s0f0: renamed from eth1


pveversion -v proxmox-ve: 6.4-1 (running kernel: 5.4.119-1-pve) pve-manager: 6.4-9 (running version: 6.4-9/5f5c0e3f) pve-kernel-5.4: 6.4-3 pve-kernel-helper: 6.4-3 pve-kernel-5.4.119-1-pve: 5.4.119-1 pve-kernel-5.4.106-1-pve: 5.4.106-1 pve-kernel-5.4.73-1-pve: 5.4.73-1 ceph-fuse: 12.2.11+dfsg1-2.1+b1 corosync: 3.1.2-pve1 criu: 3.11-3 glusterfs-client: 5.5-3 ifupdown: 0.8.35+pve1 ksm-control-daemon: 1.3-1 libjs-extjs: 6.0.1-10 libknet1: 1.20-pve1 libproxmox-acme-perl: 1.1.0 libproxmox-backup-qemu0: 1.0.3-1 libpve-access-control: 6.4-3 libpve-apiclient-perl: 3.1-3 libpve-common-perl: 6.4-3 libpve-guest-common-perl: 3.1-5 libpve-http-server-perl: 3.2-3 libpve-storage-perl: 6.4-1 libqb0: 1.0.5-1 libspice-server1: 0.14.2-4~pve6+1 lvm2: 2.03.02-pve4 lxc-pve: 4.0.6-2 lxcfs: 4.0.6-pve1 novnc-pve: 1.1.0-1 proxmox-backup-client: 1.1.10-1 proxmox-mini-journalreader: 1.1-1 proxmox-widget-toolkit: 2.5-6 pve-cluster: 6.4-1 pve-container: 3.3-5 pve-docs: 6.4-2 pve-edk2-firmware: 2.20200531-1 pve-firewall: 4.1-4 pve-firmware: 3.2-4 pve-ha-manager: 3.1-1 pve-i18n: 2.3-1 pve-qemu-kvm: 5.2.0-6 pve-xtermjs: 4.7.0-3 qemu-server: 6.4-2 smartmontools: 7.2-pve2 spiceterm: 3.1-1 vncterm: 1.6-2 zfsutils-linux: 2.0.4-pve1

any idea what might cause this behavior
 
You must log in or register to reply here.
Top Bottom