Migrating ESXi vSwitch0 to Proxmox Cluster layer 2

[nleistad]

on ESXi, 2 10G ports w/ 8 tagged vlans(2,55,65,164,172,192 ...) supply port groups by VLAN stripping tags. Devices connected to each port group based on vlan membership. Addressing and routing come from Core Router above this "switch", no IPs assigned to the port groups.

pve network config:

auto vmbr10
iface vmbr10 inet manual
bridge-ports ens2f0 ens2f1
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2,55,65,164,172,192,216,551,1055
#Trunk Port

auto vmbr7
iface vmbr7 inet manual
bridge-ports vmbr10.216
bridge-stp off
bridge-fd 0
#VLAN216_x.x.x.248/29

then VM etho attached to vmbr7 bridge (this one has static address assigned).

Local host interface is UP, but can't ping gateway of x.x.x.254 that lives on router ve216

It's like it's connected but no traffic passes. the VM has never looked for vlan tag.

I obviously don't understand the linux network stack well enough. Should it be Linux VLAN rather than Linux Bridge?

Hopefully once I grok this for ONE VM, I can migrate the other 30+

I tried vmbr10.216 as the VM eth0 connection also to no avail. Grasping....

 

[spirit]

Hi,
the vlan part seem to be ok. (You could also use sdn at datacenter level to do the same, using a vlan zone with a vnet instead vmbr7, It's construct exactly same config)


I'm not sure about

"bridge-ports ens2f0 ens2f1"

you should group them in a bond, or you could have a network loop if both interfaces are in the same switch/network.

 

[nleistad]

face-plant! Router admin hadn't added vlans or trunk to router config.
connectivity now fixed. both of the following config methods appear to work (for a single host so far).

next question:
assuming vmbr0 is a vlan aware bridge with vlan 10, 20, 30

should a vlan10 VM be connected to vmbr0.10
should a vlan20 VM be connected to vmbr0.20
should a vlan30 VM be connected to vmbr0.30
or
should there be a vmbr10 bridge with a bridge-port vmbr0.10 with VM connected to vmbr10
should there be a vmbr20 bridge with a bridge-port vmbr0.20 with VM connected to vmbr20
should there be a vmbr30 bridge with a bridge-port vmbr0.30 with VM connected to vmbr30

additional VMs in each vlan then address to respective vmbr?0 bridges?

which is the preferred method? is there a performance difference?

would like to keep it "simple" for the obtuse.

 

[spirit]

the vmbr0.X are vlan interfaces not bridge, so you can't plug vm on it.

so you need to use your vmbrx. (Or use sdn vnet, which is doing the same, but you don't need to define it host by host).


Another possiblity, simply defined vlan tag on vm nic, and use the main vmbr10 bridge.

 

[nleistad]

Thanks for clarifying. I had considered using tag on VM but maybe separate bridges is more obvious and easier to understand. (more for those that follow on after me, rather than for myself).