the vm traffic is goinf through the vxlan (vxlan_remoteip ...), so it's use peers ip address.
if you want to split management && vm traffic on 2 nic, you need to setup 2 differents ip address on each host on different subnet. (1 for management, 1 for peers). Also, don't need vmbr0 or vmbr1...