vmbr0 can't ping/connect another prox node

[MrHumpty]

Hi All,

'A bit strange this one.
I have two version 4 proxmoxs, they both have dual NIC, so are bonded into a Cisco SG300 Switch.

My main proxmox sits on a class C at .101, standby prox, sits at .102.

I can get at both proxmoxs from hosts on the LAN, be it my pc, or my laptop..and manage the VMs etc.

but I can't talk from prox one (.101) to prox two .(102)...or visa versa. (I want to set up ve-sync after recently building prox02)

I port mirrored/wiresharked the bond/vlan ports on the Cisco, (no packet trace as not a proper catalyst switch)
I can see lots of lovely arp requets and icmp when pinging my gateway. but ... when I try to ping the other prox, I see ARP requests go out on tcpdump on the local console, but nothing on the port mirror via the switch...
I did pve-firewall stop on both boxes to make sure which was confirmed with status.

.... I'm a little preplexed!


Configs below, Prox one is much the same in network/interfaces.

Mark


root@proxmox02:~# cat /etc/network/interfaces
# network interface settings; autogenerated
# Please do NOT modify this file directly, unless you know what
# you're doing.
#
# If you want to manage part of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!

auto lo
iface lo inet loopback

iface eth1 inet manual

iface eth2 inet manual

auto bond0
iface bond0 inet manual
slaves eth1 eth2
bond_miimon 100
bond_mode 802.3ad

auto vmbr0
iface vmbr0 inet static
address x.x.x.102
netmask 255.255.255.0
gateway x.x.x.254
bridge_ports bond0
bridge_stp off
bridge_fd 0

root@proxmox02:~#

root@proxmox02:~# ifconfig
bond0 Link encap:Ethernet HWaddr 00:15:17:21:34:4a
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:4756 errors:0 dropped:107 overruns:0 frame:0
TX packets:1800 errors:0 dropped:3 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:428221 (418.1 KiB) TX bytes:430825 (420.7 KiB)

eth1 Link encap:Ethernet HWaddr 00:15:17:21:34:4a
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:1697 errors:0 dropped:1 overruns:0 frame:0
TX packets:1502 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:156499 (152.8 KiB) TX bytes:398053 (388.7 KiB)
Interrupt:16 Memory:fe880000-fe8a0000

eth2 Link encap:Ethernet HWaddr 00:15:17:21:34:4a
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:3059 errors:0 dropped:5 overruns:0 frame:0
TX packets:298 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:271722 (265.3 KiB) TX bytes:32772 (32.0 KiB)
Interrupt:17 Memory:fe8c0000-fe8e0000

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:140 errors:0 dropped:0 overruns:0 frame:0
TX packets:140 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:15672 (15.3 KiB) TX bytes:15672 (15.3 KiB)

vmbr0 Link encap:Ethernet HWaddr 00:15:17:21:34:4a.
inet addr: x.x.x.102 Bcast:x.x.x.255 Mask:255.255.255.0
inet6 addr: fe80::215:17ff:fe21:344a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:4541 errors:0 dropped:1 overruns:0 frame:0
TX packets:1635 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:325300 (317.6 KiB) TX bytes:403023 (393.5 KiB)

 

[kotakomputer]

Better you post both /etc/network/interfaces so we can see exactly the config there.
Make sure no pending interface setting on Proxmox UI.

 

[MrHumpty]

ok folks, stand easy!
a bit more digging, seems we have a switch or bonding issue......