Virtual Switch with cluster

[nsscorp]

In out Cluster Environment we have two ProxMox server with two physical network cards per server and also one Linux Bridge per interface (vmbr0, vmbr1).We want the network of some VMs to be completely separated from the physical, so we have created a new Linux Bridge per server (vmbr2). We noticed that the two new bridges are not in the same network and if we put a machine with the LAN interface into vmbr2 on the first server and a second VM with the LAN interface using vmbr2 on the other server of course they cannot communicate.How can we "connect" the two separate Linux Bridges between the two servers ?

 

[anthonysomerset]

you need to bridge them with a physical interface thats linking the servers

 

[Raymond Burns]

I did something similar with this.
I have a quad NIC in each server.
eth0 = vmbr0
eth1 = vmbr1
eth2 = vmbr2
eth3 = vmbr3 = Linux Bridge

I wanted a DMZ for internal servers and placed all the Linux VM's on vmbr3. This is mirrored on my Second Proxmox system, where I have a pfSense firewall on vmbr3(LAN)::vmbr0(WAN). Now I have access, only through pfSense to the completely separate vmbr3 zone. But to answer your question, you need a link with the separated networks between the two Prox systems, whether it's a physcial network and switch, or a simple vlan.

Correct me if I'm wrong

 

[mir]

The vmbr2 on both proxmox must be on the same network. When vmbr2 is on the same network on both promox vm's attached this bridge will be able to communicate even if there is no physical connection.

 

[Raymond Burns]

The vmbr2 on both proxmox must be on the same network. When vmbr2 is on the same network on both promox vm's attached this bridge will be able to communicate even if there is no physical connection.

Now I'm confused.

Scenario:
I have Proxmox clustered across 192.168.0.0/24 network which is eth0/vmbr0
I have a LAN network MIRRORED 10.100.1.0/24 network which is eth1/vmbr1 on both Prox systems.

eth0 is connected to Switch 1
eth1 is connected to Switch 2

According to your explanation, if both Proxmox systems have vmbr2 on 192.168.2.0/24 network WITHOUT any connection to any ethernet port, they will still share that network?

That does not sound correct to me. My understanding is that vmbr2 must be on the same physical network, whether that is a link/switch/vlan.
If that is not the case, then is the traffic shared across the clustering network of vmbr0? How does Proxmox server #2 connect to a bridge on server #1 without a PHYSICAL connection?

 

[nsscorp]

@mir: Of course it works this way. But what happens when I want to use a Linux Bridge without physical connection ?In our installation we are using a VM with SOPHOS UTM where the WAN interface is using vmbr0 and the LAN interface is using vmbr2 (the virtual Linux Bridge without IP). All VMs are using vmbr2 so they are completely separated from the physical network. When the UTM and the VMs are in the same Proxmox server it works like a charm, but when we want to Migrate a machine to another cluster member it looses (of course) the LAN connection with the UTM. So the question is: is it possible to distribute a Linux Bridge across all members of the cluster WITHOUT physical interface ?

 

[Raymond Burns]

I'm going to go out on a limb and say there is no way this can work between two separate Proxmox machines, even clustered. There must be a connection, either Physical or VLAN.

https://pve.proxmox.com/wiki/Network_Model

Bridges are like physical network switches implemented in software on the Proxmox VE host. All VMs can share one bridge as if virtual network cables from each guest were all plugged into the same switch. For connecting VMs to the outside world, bridges are attached to physical network cards assigned a TCP/IP configuration.