Multiple NICs/network bridge on same subnet?

[mandibleman]

Hello all!
I'm trying to setup a bunch of systems to serve as uploaders for large files internally on our network. All four of the NICs on the host are all on the same switch, on the same subnet. My thought was that I could assign one VM per NIC, and each VM would be able to utilize the full GBit bandwidth. The Proxmox installer created one bridge for eno1, and I tried to create three more bridges (for each NIC), but when I tried, the UI complained that it had the same gateway as the existing bridge. Am I doing or expecting something wrong?
Thanks!

 

[Milkwyrm]

Just set up the bridges assigned to each network interface without any configuration (except one, you still need to access the host machine on it). Its complaining because you are setting the IP addresses for the host and of course you can only have one primary gateway. Just assign the bridge/s as you intended and the IP config within the VM will take care of everything.

 

[mandibleman]

OK, I see now.
My mistake was thinking that I needed to fully setup the network settings for the bridge.
I've setup the VM bridges and VMs as described and things seem to be working just fine.
Thanks for the help!

 

[DaSilva]

My Setup 3 Servers (Cluster), 4 port GB NIC for Proxmox and 2 25GB per Server for Shared Storage with CEPH

Initially, I setup the Proxmox with a single NIC (eno1) on each Serverr. No issues. Now I want to bridge the other 3 NICs (eno2, eno3 and eno4) on each server for redundancy) I added eno2 to the VMBR0 Bridge created during the Proxmox install, but it seemed that it didn't like it, i lost access to the server. I removed the eno2 from the VMBR0 bridge, and it's all good again. Then I created a new Bridge named VMs for testing and, added eno2 and eno3, moved one VM to this new bridge instead of the default VMBR0, no issues.

My question. I tried to migrate the VM to (Server 1), and it failed, as expected since the new bridge (VMs) was created at the NODE level (Server 2). So i have to create bridges on every singleServerr? Since it is a cluster, is there a way to create a bridge at the cluster level?

Im new to Proxmox

 

[fba]

Yes, the bridge you created has to be created on every node separately. Otherwise it wouldn't be possible to to use physically different servers within a cluster.

Nevertheless, PVE also has SDN. This is working cluster-wide.
https://pve.proxmox.com/pve-docs/chapter-pvesdn.html

J

[SOLVED] Thread 'Is there a cluster bridge or cluster-level networking?'

Mar 17, 2023

Hi, first time post, long time reader. I have question that I can't quite figure out what to search for, as the terms seem pretty common. So here goes.

Is there any kind of cluster-level networking that would allow vms on various nodes to share a separate lan without a physical smart (vlan aware) switch?

I know this sounds like a vlan, but I don't have a spare smart switch to hand and would like to start testing with a dumb (but fast) inexpensive switch.

I have a lab cluster and I would like to test some things that would best be separated from my regular lan. It's a small office...

• jptechnical
• Replies: 14
• Forum: Proxmox VE: Networking and Firewall