vlan bonding trunk : vm first to boot win a connection !

groy

New Member
Oct 6, 2012
15
0
1
France
Hi,


I have a strange problem with my config.
The problem :
If I start VM1, it connect without any problem but if i start VM2 (in a second time) VM2 it can't connect.
If I start VM2, it connect without any problem but if i start VM1 (in a second time) VM1 it can't connect.
( I have checked the MAC of interfaces of VM1 and 2, this is not the same)


=> in other words : first VM to boot win !

ON THE HOST :
eth0 : vmbr0 (crossover cable for cluster)
eth1 : vmbr99 (management interface)
eth2
eth3 : bond0 (production interfaces)


below, my /etc/network/interfaces :

Code:
auto lo
iface lo inet loopback
iface eth0 inet manual
iface eth1 inet manual
iface eth2 inet manual
iface eth3 inet manual



auto bond0
iface bond0 inet manual
        slaves eth2 eth3
        bond_miimon 100
        bond_mode 802.3ad


auto vmbr0
iface vmbr0 inet static
	address 10.0.0.1
	netmask 255.255.255.0
	gateway 10.0.0.2
	bridge_ports eth0
	bridge_stp off
	bridge_fd 0
	pre-up ifconfig eth0 mtu 9000


auto vmbr99
iface vmbr99 inet static
	address 192.168.149.101
	netmask 255.255.255.0
	gateway 192.168.149.251
	bridge_ports eth1
	bridge_stp off
	bridge_fd 0


]auto vmbr10
iface vmbr10 inet manual
	bridge_ports bond0
	bridge_stp off
	bridge_fd 0

below, ifconfig on the host after the 2 vms start with bridge tag per vlan (vmbr10v150 and vmbr10v4090) :

Code:
bond0     Link encap:Ethernet  HWaddr 00:0a:f7:10:a2:78  
          adr inet6: fe80::20a:f7ff:fe10:a278/64 Scope:Lien
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1
          RX packets:1188 errors:0 dropped:0 overruns:0 frame:0
          TX packets:807 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:503959 (492.1 KiB)  TX bytes:79270 (77.4 KiB)


bond0.150 Link encap:Ethernet  HWaddr 00:0a:f7:10:a2:78  
          adr inet6: fe80::20a:f7ff:fe10:a278/64 Scope:Lien
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1
          RX packets:300 errors:0 dropped:0 overruns:0 frame:0
          TX packets:387 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:13844 (13.5 KiB)  TX bytes:20812 (20.3 KiB)


bond0.4090 Link encap:Ethernet  HWaddr 00:0a:f7:10:a2:78  
          adr inet6: fe80::20a:f7ff:fe10:a278/64 Scope:Lien
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1
          RX packets:394 errors:0 dropped:0 overruns:0 frame:0
          TX packets:363 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:434895 (424.7 KiB)  TX bytes:41370 (40.4 KiB)


eth0      Link encap:Ethernet  HWaddr 08:9e:01:87:ca:7e  
          adr inet6: fe80::a9e:1ff:fe87:ca7e/64 Scope:Lien
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:10829 errors:0 dropped:0 overruns:0 frame:0
          TX packets:11377 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:1000 
          RX bytes:2026240 (1.9 MiB)  TX bytes:2359770 (2.2 MiB)


eth1      Link encap:Ethernet  HWaddr 08:9e:01:87:ca:7f  
          adr inet6: fe80::a9e:1ff:fe87:ca7f/64 Scope:Lien
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:21848 errors:0 dropped:0 overruns:0 frame:0
          TX packets:20312 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:1000 
          RX bytes:3457994 (3.2 MiB)  TX bytes:11060394 (10.5 MiB)


eth2      Link encap:Ethernet  HWaddr 00:0a:f7:10:a2:78  
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:756 errors:0 dropped:0 overruns:0 frame:0
          TX packets:788 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:1000 
          RX bytes:470435 (459.4 KiB)  TX bytes:76838 (75.0 KiB)


eth3      Link encap:Ethernet  HWaddr 00:0a:f7:10:a2:78  
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:432 errors:0 dropped:0 overruns:0 frame:0
          TX packets:19 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:1000 
          RX bytes:33524 (32.7 KiB)  TX bytes:2432 (2.3 KiB)


lo        Link encap:Boucle locale  
          inet adr:127.0.0.1  Masque:255.0.0.0
          adr inet6: ::1/128 Scope:Hôte
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:12597 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12597 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:2336859 (2.2 MiB)  TX bytes:2336859 (2.2 MiB)


tap110i0  Link encap:Ethernet  HWaddr c2:3a:7c:d5:b6:50  
          adr inet6: fe80::c03a:7cff:fed5:b650/64 Scope:Lien
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:375 errors:0 dropped:0 overruns:0 frame:0
          TX packets:20 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:500 
          RX bytes:19868 (19.4 KiB)  TX bytes:1416 (1.3 KiB)


tap111i0  Link encap:Ethernet  HWaddr 56:9e:53:14:1a:84  
          adr inet6: fe80::549e:53ff:fe14:1a84/64 Scope:Lien
          UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
          RX packets:354 errors:0 dropped:0 overruns:0 frame:0
          TX packets:398 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:500 
          RX bytes:40596 (39.6 KiB)  TX bytes:440855 (430.5 KiB)


venet0    Link encap:UNSPEC  HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00  
          adr inet6: fe80::1/128 Scope:Lien
          UP BROADCAST POINTOPOINT RUNNING NOARP  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:3 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)


vmbr0     Link encap:Ethernet  HWaddr 08:9e:01:87:ca:7e  
          inet adr:10.0.0.1  Bcast:10.0.0.255  Masque:255.255.255.0
          adr inet6: fe80::a9e:1ff:fe87:ca7e/64 Scope:Lien
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:10814 errors:0 dropped:0 overruns:0 frame:0
          TX packets:11354 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:1829542 (1.7 MiB)  TX bytes:2312513 (2.2 MiB)


vmbr10    Link encap:Ethernet  HWaddr 00:0a:f7:10:a2:78  
          adr inet6: fe80::20a:f7ff:fe10:a278/64 Scope:Lien
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:292 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:15144 (14.7 KiB)  TX bytes:468 (468.0 B)


vmbr99    Link encap:Ethernet  HWaddr 08:9e:01:87:ca:7f  
          inet adr:192.168.149.101  Bcast:192.168.149.255  Masque:255.255.255.0
          adr inet6: fe80::a9e:1ff:fe87:ca7f/64 Scope:Lien
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:21786 errors:0 dropped:0 overruns:0 frame:0
          TX packets:16466 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:3062967 (2.9 MiB)  TX bytes:10726623 (10.2 MiB)


vmbr10v150 Link encap:Ethernet  HWaddr 00:0a:f7:10:a2:78  
          adr inet6: fe80::8c42:daff:fe46:a234/64 Scope:Lien
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:371 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:14490 (14.1 KiB)  TX bytes:468 (468.0 B)


vmbr10v4090 Link encap:Ethernet  HWaddr 00:0a:f7:10:a2:78  
          adr inet6: fe80::1080:57ff:fe7e:3161/64 Scope:Lien
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:93 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 lg file transmission:0 
          RX bytes:6308 (6.1 KiB)  TX bytes:468 (468.0 B)




therefore interfaces, bond and bridges seems to be ok ?!

i don't think the problem come to the config of my switch or router because each vlan work fine if i start only one VM...

VM1:
add: 192.168.150.201/24
gw : 192.168.150.251


VM2:
add : 192.168.152.201/24
gw : 192.168.152.251


SWITCH : Cisco SG-300
LAG 1(front of eth2 eth3) is in Trunk (vlan 150, 4090)


ROUTER : Cisco ISA 500
vlan 150 and 4090 (dmz) are ok


SWITCH to ROUTER :
one link in trunk for vlan150, 151, etc
one link in access for dmz vlan4090


Any suggestion ?
I can not see anything now...

Thanks,
GR
 
Ok, i have find..

That's the bond_mode was wrong.
I have passed my bond0 in "balance-rr" and now it's good.

On my switch, lacp is disabled on my LAG1 (front off bond0).
So, in fact no problem with my proxmox config.

Regards,
GR
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!