[SOLVED] Newly added NIC does not work in cluster nodes

[Cocky]

Hello,
it is my first thread so sorry in advance for errors.
So just some context. I have an cluster with 6 nodes, all on PVE 8.4- Currently they are running on the internal network interface on the mainboard. I need to add an NIC and let it run over it and use the internal one for intel KVM.

Now the Problem. When i shutdwon the node add the NIC and change the /etc/network/interfaces file correctly, I only get connection for like 2 to 30 seconds. After that nothing. Offline in the Web GUI and can´t ping anything. I tested a lot of things and it works flawlessly when i add and change the Network interface on nodes that are not in the Cluster.
I tried removing a node from the Cluster and changing it but it still failed, but i am not sure if i removed everything corectly, because on boot a Ceph Volume was still discovered.

Does anyone have an Idea waht i could do besides reinstalling Proxmox. That is what i will do now, but i would really like to understand this Problem.

The NIC is a X540-10G-T2-X8 (ixgbe)

thank you in advance

​

 

[mkoeppl]

When i shutdwon the node add the NIC and change the /etc/network/interfaces file correctly

What is "correctly"? Can you post the content of /etc/network/interfaces please? How are you assigning IP addresses to the nodes?

Also: did you have a look at this?

 

[Cocky]

What is "correctly"? Can you post the content of /etc/network/interfaces please? How are you assigning IP addresses to the nodes?

Also: did you have a look at this?

Thats my /etc/network/interfaces

auto lo
iface lo inet loopback

iface enp1s0f0 inet manual

auto vmbr0
iface vmbr0 inet static
address 192.168.241.3/21
gateway 192.168.10.1
bridge-ports enp1s0f0
bridge-stp off
bridge-fd 0

i already checked the corosync, but there are no differences, because the ip dosent change. So the corosync is still correct

 

[Cocky]

Seems that it is a Hardware Issue. Strangely our identical Testnode is the only one of 4 we tested that works with the NIC. So i wrongly concluded it is only about nodes in the cluster