[SOLVED] Active-Passive Bond DELL Server (Intel(R) Ethernet 10G 4P X710)

[mario01]

Hi everyone,

I'am struggeling with an bonding-konfiguration. Normally we use lacp within the bonds and everything works fine. (PVE 7.0)
In my actually usecase we have to use an active-passive konfiguration. As long as it is connected the bond works, only the failover did not work.

In my understanding if i use miimon, it will only detect interface-down states for failover to the passive nic. It seams that the interface status i can see in
ip a -> Interface "up" to "down" and
cat /sys/class/net/eno3/carrier -> changes from "1" -> "0"

BUT in Bond status MII always is UP, so no failover will be trigger.
cat /proc/net/bonding/bond1

Ethernet Channel Bonding Driver: v5.11.22-2-pve

Bonding Mode: fault-tolerance (active-backup)
Primary Slave: None
Currently Active Slave: eno3
MII Status: up
MII Polling Interval (ms): 0
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0

Slave Interface: eno3
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: *****
Slave queue ID: 0

Slave Interface: eno4
MII Status: up
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: *****
Slave queue ID: 0

This is the bond-part of the interfaces-konfiguration:

auto lo
iface lo inet loopback

iface eno1 inet manual
iface eno2 inet manual
iface eno3 inet manual
iface eno4 inet manual
auto eno1
auto eno2
auto eno3
auto eno4

#### Bonding

# LAN-Bond0
auto bond0
        iface bond0 inet manual
        bond-slaves eno1 eno2
        bond-miimon 100
        bond-mode 802.3ad
# LAN-Bond0

# LAN-Bond1
auto bond1
        iface bond1 inet manual
        bond-slaves eno3 eno4
        bond-mode active-backup
#       bond-downdelay 200
#       bond-updelay 200
# LAN-Bond1

Did anyone have the same issue and maybe a solution for me?

Kind regards,
Mario

 

[floh8]

Speed: Unknown
Duplex: Unknown

First, i see the eno4 with no connection.
second, u have no bond-miimon for bond1
third, maybe u choose an other way to test failure - maybe cut the cable

 

[spirit]

I think 1 user on the forum had this problem with mellanox card, and it was a firmware bug.

 

[mario01]

First, i see the eno4 with no connection.
second, u have no bond-miimon for bond1
third, maybe u choose an other way to test failure - maybe cut the cable

Thanks. You are right, my fault. Thats the solution. I added the parameter and it works.

Can anybody give me a link, where i can find all possible options/parameters for proxmox (debian) bonding. For example how to define the a primary interface, or time for failover, what exakt means "bond-miimon 100" etc?
Thanks

 

[dirks]

https://www.kernel.org/doc/html/latest/networking/bonding.html

And yes bringing an interface down via OS does not necessarily mean the link is seen as down on the switch side, see https://forum.proxmox.com/threads/8...ing-a-slave-interface-down.87390/#post-383527

 

[mario01]

Thank you. That is what I'am looking for.
How can i mark the thread solved?