[TUTORIAL] Dell r630 VLAN Problems

I

ITACTC

New Member
Jun 1, 2025
3
1
3
EDIT: Last Post Covers Solution / Tutorial

I have spent the last two days trying to get VLANs to work on a dell r630. It has two GBE interfaces, I plan to use one for ceph and one for everything else.

A configuration that works completely fine on a desktop PC fails completely on the r630. Specifically, whenever I try to configure VMs and the management interface on VLANs networking stops working completely after a reboot. Before the reboot the VMs don't get internet due to VLAN issues.

I know the managed switch they are attached to works because I can access the management interface over a tagged VLAN.

Here was my first config: (Didn't work)

Code: 
auto lo
iface lo inet loopback

iface eno1np0 inet manual
#Public

iface eno2np1 inet manual
#Ceph.

auto Ceph
iface Ceph inet static
        address 10.30.0.1/24
        bridge-ports eno2np1
        bridge-stp off
        bridge-fd 0
#Ceph

auto vmbr0
iface vmbr0 inet manual
        bridge-ports eno1np0
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094
#Main

auto vmbr0.10
iface vmbr0.10 inet static
        address 10.10.1.75/21
        gateway 10.10.0.1
#Management

source /etc/network/interfaces.d/*

This Config works, but the instant i add a bridge to eno1np0 it stops working again.
Code: 
auto lo
iface lo inet loopback

iface eno1np0 inet manual
#Public

iface eno2np1 inet manual
#Ceph

auto Ceph
iface Ceph inet static
        address 10.30.0.3/24
        bridge-ports eno2np1
        bridge-stp off
        bridge-fd 0
#Ceph

auto Management
iface Management inet static
        address 10.10.1.75/21
        gateway 10.10.0.1
        vlan-id 10
        vlan-raw-device eno1np0
#Management

source /etc/network/interfaces.d/*

The only ideas I have are try and attach the VM network devices to a Linux VLAN instead of a Linux Bridge or to use OVS configurations.
Thanks
 
Last edited:
Hello.

I think you should create a Linux Bridge vmbr1 set up with VLAN aware and connected to port eno1np0, and then create a Linux VLAN Management connected to vmbr1.

Vlodek
 
Was this what you had in mind?

Code: 
auto lo
iface lo inet loopback

iface eno1np0 inet manual
#Public

iface eno2np1 inet manual
#Ceph.

auto Ceph
iface Ceph inet static
        address 10.30.0.1/24
        bridge-ports eno2np1
        bridge-stp off
        bridge-fd 0
#Ceph

auto vmbr1
iface vmbr1 inet manual
        bridge-ports eno1np0
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094
#Main

auto Management
iface Management inet static
        address 10.10.1.75/21
        gateway 10.10.0.1
        vlan-id 10
        vlan-raw-device vmbr1
#Management

source /etc/network/interfaces.d/*


I tried this, but lost networking after a restart like before. Thanks for the suggestion! Any other ideas?
 
I have resolved the issue using OVS (Open vSwitch), explanation below.


Note: You will need a managed network switch and will need to switch between access and trunk mode to maintain GUI access. The /etc/network/interfaces file will be posted below if you cannot access GUI.

Other Note: OVS is more complicated than standard "Linux Bridge," "Linux VLAN," and "Linux Bond." I am using it because those options are not functioning properly with my specific hardware. (Dell r630)
  1. Install OVS (shell)
    1. apt-get update
    2. apt-get install openvswitch-switch
  2. Remove existing network interfaces
    1. I left the two physical interfaces and the Linux Bridge for my Ceph cluster
  3. Create OVS Bridge
    1. 1748875931345.png
  4. Create OVS IntPort
    1. 1748875991225.png
  5. Check your numbers (So you don't get locked out of GUI)
  6. Hit Apply Configuration
To add a VM to a VLAN, simply attach the virtual network device to the OVS bridge and set the VLAN Tag.
Config File: (/etc/network/interfaces/)
Code: 
auto lo
iface lo inet loopback

iface eno2np1 inet manual
#Ceph.

auto eno1np0
iface eno1np0 inet manual
        ovs_type OVSPort
        ovs_bridge Main

auto management
iface management inet static
        address 10.10.1.75/21
        gateway 10.10.0.1
        ovs_type OVSIntPort
        ovs_bridge Main
        ovs_options tag=10
#Management

auto Ceph
iface Ceph inet static
        address 10.30.0.1/24
        bridge-ports eno2np1
        bridge-stp off
        bridge-fd 0
#Ceph

auto Main
iface Main inet manual
        ovs_type OVSBridge
        ovs_ports eno1np0 management
#Main

source /etc/network/interfaces.d/*




Good Luck!
 
  • Like
Reactions: Vlodek
You must log in or register to reply here.
Top Bottom