Thanks for responding spirit.
it's possible for a single host to have a bridge without physical interface
Well I guess I am not enough of an outside the box thinker to have thought to create a bridge without giving it a physical interface. However, the problem exists that every time I created one of these a reboot would be required. Not a good option on a production system. I am hoping that Open vSwitch provides this feature, allowing networks to be created without using a physical interface or vlan and not require a reboot.
proxmox1 -> proxmox 2/3 will be never supported.
But can't you used a dedicated vlan for theses internal network?
Well yes I could do that and I thought that was a stupid question after I asked it, but if I had not asked it, I would not have gotten the response below about vxlan and gre which may exactly be what I want.
Alternatively, it can be done with openvswitch and vxlan. Maybe linux bridge with vxlan too (kernel 3.10), but I'm not sure.
With openvswitch, each host can have a GRE tunnel between each openvswitch.
This is interesting. Why burn a real vlan for internal only networks if there is an option like this? Hopefully, the performance is good.
dynamic vlan (without reboot) are already implemented in current proxmox. (kvm only), just setup the vlan tag in guest network interface.
Only bridge create/delete through proxmox gui need reboot. (but you can do it manually with command line and /etc/network/interfaces without reboot)
Since you stated KVM only, I assume you mean that this works at the VM level, but that is not a real workable solution for an enterprise providing VMs to less technically knowledgeable clients and it requires more work as every VM needs additional network settings. It's a solution that requires people start out with work arounds as few installers support setting vlans and few if any post installer network setup systems support this. You have to get on the vlan after the install. What if a client wants to install from their own network? Now they have to build in the ability to set a VLAN and reset that vlan with every reboot, something they would not do except for Proxmox. When if the install solution is PXE boot. Yes, some network PXE boot options do allow VLANs, but that is not a common use. People expect the network stack to do all the network magic so normal uninteresting stuff is done at the OS level.
If you did not mean VLAN at the OS level I need some help, as I do not see or understand how to create VLANs that any VM can use in the GUI. I assume that I would have to manually do this at the CLI, but when I do this does the Proxmox GUI see these cli network changes without a reboot and allow these networks to be selected?
This is one of the things that I hope Open vSwitch would solve. The only thing in the network tab would be the interface needed to access Proxmox and then vSwitch to add vlans to that interface and make use of other interfaces, vlans or not, with out requiring reboots.
Is this true today?
If not, will it be true in the future?
Finally, if I use the vxlan for internal only vlans, will I be able to create vlans that actually go over a switch without traffic for the real vlans traversing the vxlan gre network. To be more clear, this would make it so that server to server VM traffic for internal vlans would communicate through gre, but server to server VM traffic for real network interfaces and vlans would go through a switch.
we have talked about this on the dev mailing list, maybe for 2014
You above statement was about network interface permissions. This would be so awesome. In network appliances which Proxmox is in this context, you usually have a management interface and then everything else. So I have one dedicated not vlaned link to manage Proxmox and do not want traffic other than management traffic going over this interface. I then have another physical connection that is vlaned for that same network and others and that is what I want people to use. This makes it so there is nothing special about the management interface, so in a pinch it should not break and if the links used by VLANs are saturated, the management interface can be reached.
firewall feature should come really soon, proxmox 3.3 I think. But for bridge only currently. (not openvswitch yet, because you can't use iptables)
This seems promising, sweet.
Thanks again,
Rhongomiant