Switch Not Reachable via Bonded Subnet Interface

Bhupinder

Member
Jan 12, 2022
25
0
6
I look for support and guidance around where I am going wrong in a PROXMOX environment that I am setting up. I have one server that is connected and working for the Test Environment. It is running on the 172.16.0.15/16 network.
We have three more servers that we have set up in cluster. The cluster of these three nodes is created. The management port is common for all the four machines. The machines are accessible. For running the machines we want to use a separate Subnet. 172.20.0.10/24.

For this subnet the VLANS have been defined at the FIREWALL level (PALO ALTO 820) Firewall. The firewall is connected to a MELLANOX SN2100 Switch. The switch has been configured for the VLANS. The VLANs sub interfaces between the Firewall and the Switch are pinging both ways. The ports are bonded and LACP enabled at the.

AT the P-1 machine Level we have created network interface this file that is as under:

auto lo
iface lo inet loopback
iface enp3s0f0 inet manual
iface enp3s0f1 inet manual

auto ens4f1np1

iface ens4f1np1 inet manual

auto ens4f0np0

iface ens4f0np0 inet manual

auto bond1
iface bond1 inet static
bond-slaves ens4f0np0 ens4f1np1
bond-miimon 100
bond-mode 802.3ad
bond-xmit-hash-policy layer2+3


auto vmbr0
iface vmbr0 inet static
address 172.16.100.31/16
gateway 172.16.0.1
bridge-ports enp3s0f0
bridge-stp off
bridge-fd 0

auto vmbr3
iface vmbr3 inet static
address 172.20.124.5/24
bridge-ports bond1
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4092

THE bond1 – is called up within VMBR3 and this is what we propose to use by calling up in the VMs to be installed. A separate public IP will connect to this subnet and allow the traffic to come to this subnet.

VMBRO continues to the management plane. We will continue to run the management interface on VMBR 0.

PROBLEM: We are unable to ping the Proxmox Bond1 or VMBr3 from the Switch and vice versa. Pinging does not happen.
Look for guidance as to what we need to do and modify.
 

Attachments

  • Mellaonx -Screen shot.JPG
    Mellaonx -Screen shot.JPG
    26 KB · Views: 2
  • Network Interface Screenshot-1.png
    Network Interface Screenshot-1.png
    61 KB · Views: 1
i think you need to set bond1 to manual, not static.
static expects there to be an ip configuration which you dont have.

so it should be
Code:
iface bond1 inet manual
instead of
Code:
iface bond1 inet static
 
@beisser
Thanks for the response and guidance:

Checked I had corrected it the corrected values are:

auto bond1
iface bond1 inet manual
bond-slaves ens4f0np0 ens4f1np1
bond-miimon 100
bond-mode 802.3ad
bond-xmit-hash-policy layer2+3

I have added a separate gateway for this in VMB3 as under:
auto vmbr3

iface vmbr3 inet static
address 172.20.124.5/24
gateway 172.20.0.1
bridge-ports bond1
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4092

Shall be grateful if you could validate this approach.
The VMBR0 --- Separate public IP and subnet only used for management

This traffic via the switch goes to the separate Public IP

Shall wait the validation
 
Still not working Unable to ping switch.
Should I remove the bridge VMBR3 and add the gateway to the Bond?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!