What is wrong with my vlan and network configuration (Proxmox 3.1) ?

[oluuxpsk]

I'm trying to get to work the following configuration:

this is proxmox /etc/network/interfaces

auto lo
iface lo inet loopback

iface eth0 inet manual

auto vmbr0
iface vmbr0 inet static
    address  10.99.205.250
    netmask  255.255.255.0
    gateway  10.99.205.1
    bridge_ports eth0
    bridge_stp off
    bridge_fd 0


auto vmbr101
iface vmbr101 inet static
    address 192.168.101.1
    netmask 255.255.255.0
    network 192.168.101.0
    bridge_ports eth0.101
    bridge_stp off
    bridge_fd 0

this is openvz container /etc/network/interfaces

auto lo
iface lo inet loopback

auto eth0
iface eth0 inet static
    address 192.168.101.3
    netmask 255.255.255.0
    network 192.168.101.0
    broadcast 192.168.101.255
    gateway 192.168.101.1

Also on switch I add port linked with proxmox server to vlan 101, make it tag and 'GENERAL' type in Tp-Link notation.
Proxmox server and openvz container can communicate with each other.
Tying to make arpscan on switch from 192.168.101.1 - 192.168.101.10 in 101 vlan I can see on eth0 at proxmox server with help of tcpdump (tcpdump -i eth0 vlan 101)

22:04:17.031993 ARP, Request who-has 192.168.101.1 tell 10.99.205.235, length 46
22:04:17.044672 ARP, Request who-has 192.168.101.2 tell 10.99.205.235, length 46

But no one answers.
So I suppose what I not fully set up connection between vmbr101 and eth0.
What should I do to get a working configuration?

 

[mir]

Try changing this:
iface eth0 inet manual
to
auto eth0
iface eth0 inet manual

 

[oluuxpsk]

It was my mistake, I change it to auto eth0 but the result remained the same. Сan't ping anything but the virtual machines bridged with this vmbr101.

 

[mir]

Something is missing in your equation. I do not see any indication of a device/router which is responsible for routing traffic on network 192.168.101.0. Is routing on this network handled external?

 

[oluuxpsk]

In the beginning I wanted to setup two proxmox servers with two different vlan within each. Something like this:

vm1 - vlan101           [ switch  ]           vlan101 -vm1
           \             |       |            /
           proxmox01 -----        ----- proxmox02  
          /                                   \  
vm1 - vlan102                                  vlan102 -vm2

But I did not get it done. So I decide to make simple configuration, just to understand how it all works.

vm1 - vlan - proxmox01 - switch


vm1 (192.168.101.2)
vmbr101 interface in proxmox01 (192.168.101.1) and vmbr0 interface (10.99.205.250)
switch (native vlan - 10.99.205.0/24 and vlan101 - 192.168.101.0/24)

I am expecting that the vlan should work this:

eth0(inside vm1) bridge to vmbr101, which in turn bridge to eth0.101 (vlan101). Virtual interface eth0.101 marks packets by vlan id and send to link port of switch.

So I think switch should see both vlan, native and 101, because I try make arpscan network 192.168.101.0/24 and expecting see 192.168.101.2 and 192.168.101.1 in vlan 101 instead see 192.168.101.1 in vlan1.

In this simple configuration vm1 - vlan -proxmox01 - switch I think routing is not required or am I wrong?

 

[screenie]

looks like your switch only have an ip address in vlan 1 and not in vlan 101

 

[mir]

In this simple configuration vm1 - vlan -proxmox01 - switch I think routing is not required or am I wrong?

As long as more than one network is involved somewhere something must be responsible for routing traffic between the two networks. If you have a layer 3 switch your switch could be doing this.

 

[oluuxpsk]

As long as more than one network is involved somewhere something must be responsible for routing traffic between the two networks. If you have a layer 3 switch your switch could be doing this.

Huh, is vlan does not work on the level 2?

I mean, I thought vmb101 + eth0.101 would be transparently transmit ethernet frames from vm1 eth0 interface to switch and marked them by vlan id.

 

[mir]

Your default route(vmbr0) is on this net: 10.99.205.0/24
vmbr101 if on this net: 192.168.101.0/24
So you need something routing packages from 192.168.101.0/24 to 10.99.205.0/24.

 

[oluuxpsk]

So if on proxmox server interfaces looks like this

auto lo
iface lo inet loopback

auto eth0
iface eth0 inet manual


auto vlan101
iface vlan101 inet manual
    vlan-raw-device eth0

auto vmbr0
iface vmbr0 inet static
    address  10.99.205.250
    netmask  255.255.255.0
    gateway  10.99.205.1
    bridge_ports eth0
    bridge_stp off
    bridge_fd 0


auto vmbr101
iface vmbr101 inet static
    address 192.168.101.1
    netmask 255.255.255.0
    network 192.168.101.0
    bridge_ports vlan101
    bridge_stp off
    bridge_fd 0

and on workstation (not on proxmox server, a separate machine) interfaces looks like this

auto lo
iface lo inet loopback

auto eth0
iface eth0 inet dhcp

auto vlan101
iface vlan101 inet manual
    address 192.168.101.8
    netmask 255.255.255.0
    broadcast 192.168.101.255
    vlan-raw-device eth0

On switch I set up link ports to proxmox server and workstation as GENERAL type to make them available in two vlans (101 and 1), and added them to vlan 101 as TAGGED ports.

The command from proxmox server

ping 192.168.101.8

should pass, but instead I get: Destination Host Unreachable

And at proxmox server

tcpdump -i eth0 vlan 101

01:18:47.126695 ARP, Request who-has 192.168.101.8 tell 192.168.101.1, length 28
01:18:47.126872 ARP, Reply 192.168.101.8 is-at 2c:41:38:b8:76:4e (oui Unknown), length 42
01:18:48.126694 ARP, Request who-has 192.168.101.8 tell 192.168.101.1, length 28
01:18:48.126904 ARP, Reply 192.168.101.8 is-at 2c:41:38:b8:76:4e (oui Unknown), length 42

and
tcpdump -i vlan101 or tcpdump -i vmbr101

01:19:59.144690 ARP, Request who-has 192.168.101.8 tell 192.168.101.1, length 28
01:20:00.144694 ARP, Request who-has 192.168.101.8 tell 192.168.101.1, length 28

For me it looks like eth0 send and receive ethernet frames with vlan 101 tag but not transmit frames between eth0 and vmbr101.

These configurations on proxmox server and workstation are correct? If it is then I set up incorrectly my switch? And if not what I should do to make host 192.168.101.8 available from 192.168.101.1 (proxmox server)?

 

[screenie]

On switch I set up link ports to proxmox server and workstation as GENERAL type to make them available in two vlans (101 and 1), and added them to vlan 101 as TAGGED ports.

Not sure what you mean with 'GENERAL' but i guess it's based to your switch model and software;

If you have on the switch VLAN101 defined and added to the interfaces you need to create the VLAN interfaces on the server and workstation;

# vlan for Server
auto eth0.101
iface eth0.101 inet manual

# bridge interface for vlan101 on Server
auto vmbr101
iface vmbr101 inet manual
bridge_ports eth0.101
bridge_stp off
bridge_fd 0


# native interface on workstation
auto eth0
iface eth0 inet dhcp

# vlan for workstation
auto eth0.101
iface eth0.101 inet static
address 192.168.101.8
netmask 255.255.255.0
broadcast 192.168.101.255

and of course you need to have modul 8021q loaded on server and workstation