[SOLVED] 2 node "subnet" (network noob)

[svennd]

Hey,

Perhaps I'm looking for something that doesn't exist or perhaps its just one checkbox away, all help is welcome !

I setup a 2 node cluster, and i setup a simple zone with ipam (pve). vnet0 gives out ip's 10.0.0.0/24. To all vm's and lxc that have vnet0. This works perfectly.

When I however migrate from node rocky to rocky-b even though the lxc/vm has the same IP (10.0.0.0/24) and can connect to the internet. It can't connect to the other node containers. (so rocky-b machines can't talk to rocky machines over 10.0.0.0/24 network) Is this possible ? I tried using vlan instead of simple but then it doesn't seem to be possible to have dhcp inside that vlan ? (again I know verry little about networking)



/etc/network/interfaces (eno2 is cluster network)



/etc/network/interfaces.d/sdn


So in short, how can I have use ipam over 2-nodes and the vm's / lxc talk to each other.

thanks.

 

[shanreich]

Simple Zones are node-local and you cannot reach VMs on the other node from them. If you want to reach VMs from the other node you'd either have to use a default bridge and attach the nodes to a switch or use the VXLAN SDN zone.

Automatic DHCP currently only works with the Simple Zone, hence why it is broken as soon as you switch to the VLAN zone.

 

[svennd]

Hey Stefan,

Thanks for the reply, i set up a VXLAN SDN zone, as I don't quit understand what you mean with a default bridge. I need to setup manual IP's for VXLAN but that is okay. Works as requested!

 

[shanreich]

as I don't quit understand what you mean with a default bridge

I meant creating a new Bridge via the Network tab, when you click on a node in the left sidebar. On each node you have a dedicated NIC that is plugged into a switch. That NIC gets added to the bridge port.

 

[svennd]

Ah yes, in a physical switch. Yes, that ofcourse also makes sense. Thank you for the help!