Proxmox 3.x Two-Node Cluster

[samwayne]

Hello All,

I am a new member who has been following this project as well as a couple of others including OpenStack and OpenNebula for more than a year but decided that Proxmox was more suitable for our needs. I have played with the older 1.X and 2.X versions briefly via VMWare Fusion on my iMac but decided to jump in properly at Version 3.X to setup a production system especially since there is better support for Ceph.

So I am looking to setup a Two-Node cluster and have a couple questions as follows:

1) Is the procedure exactly the same for creating a version 2.X TwoNode cluster as http://pve.proxmox.com/wiki/Two-Node_High_Availability_Cluster

2) Both Proxmox 3.x Nodes are on the same VLAN with a public IP range that can be moved / Shared between the 2-Nodes as I thought this would have been necessary in the case of Live migration of KVM VMs. So are there any special network configuration requirements that I need to consider?

Any other comments or assistance would be greatly appreciated.

Thanks in Advance

Samwayne

 

[tom]

Hello All,

I am a new member who has been following this project as well as a couple of others including OpenStack and OpenNebula for more than a year but decided that Proxmox was more suitable for our needs. I have played with the older 1.X and 2.X versions briefly via VMWare Fusion on my iMac but decided to jump in properly at Version 3.X to setup a production system especially since there is better support for Ceph.

So I am looking to setup a Two-Node cluster and have a couple questions as follows:

1) Is the procedure exactly the same for creating a version 2.X TwoNode cluster as http://pve.proxmox.com/wiki/Two-Node_High_Availability_Cluster

yes, but a two-node HA cluster is not recommended. If you want a trouble free setup, use at least 3 nodes. of just go with a normal cluster, no HA.

 

[samwayne]

Hi Tom,

Thanks for your prompt response.

Yes I am aware that a minimum of 3 Nodes are required for true HA however, this setup is only for testing at the moment and to "get my hands dirty". I really want to test live migration especially so please if you could also answer question two that would be great.

2) Both Proxmox 3.x Nodes are on the same VLAN with a public IP range that can be moved / Shared between the 2-Nodes as I thought this would have been necessary in the case of Live migration of KVM VMs. So are there any special network configuration requirements that I need to consider?

Thanks again.

 

[tom]

just to note, for live migration you do not need HA, a simple cluster is enough.

see the requirements for the cluster without HA:
http://pve.proxmox.com/wiki/Proxmox_VE_2.0_Cluster

 

[m.ardito]

2) Both Proxmox 3.x Nodes are on the same VLAN with a public IP range that can be moved / Shared between the 2-Nodes as I thought this would have been necessary in the case of Live migration of KVM VMs.

Hi, the machine "live migrated" needs its own ip, public if you wish to do so, and it only has to be routable by both nodes, i think.
Just create the same vmbrX on both nodes, since the moved vm expect identical configuration (storage, networks, etc)

Marco

 

[samwayne]

Hi Marco,

Thanks this is what I was actually trying to confirm. All the VMs will have public IPs and basically I figured I needed to add the routable IP Range to both Nodes (correct me if I am wrong) for example:

1) First I need add net.ipv4.ip_forward=1 to /etc/sysctl.conf to enable ip forwarding.

2) Then for the Nodes config (192.168.x.x private ip range only used as example):

Node 1

auto vmbr0
iface vmbr0 inet static
address 192.168.25.10
netmask 255.255.255.248
bridge_ports none
bridge_stp off
bridge_fd 0
post-up route add -host 192.168.25.100 dev vmbr0
post-up route add -host 192.168.25.101 dev vmbr0
post-up route add -host 192.168.25.102 dev vmbr0
post-up route add -host 192.168.25.103 dev vmbr0
post-up route add -host 192.168.25.104 dev vmbr0
post-up route add -host 192.168.25.106 dev vmbr0

Node 2

auto vmbr0
iface vmbr0 inet static
address 192.168.25.11
netmask 255.255.255.248
bridge_ports none
bridge_stp off
bridge_fd 0
post-up route add -host 192.168.25.100 dev vmbr0
post-up route add -host 192.168.25.101 dev vmbr0
post-up route add -host 192.168.25.102 dev vmbr0
post-up route add -host 192.168.25.103 dev vmbr0
post-up route add -host 192.168.25.104 dev vmbr0
post-up route add -host 192.168.25.106 dev vmbr0

So am I correct here that the ips .100 - .106 would be routable on both Nodes?

Thanks again

Samwayne

 

[anthonysomerset]

you should not need to setup the static routes for your IP's if its routed to your VLAN correctly then this will have no effect.

 

[samwayne]

Ok I was following these instructions:

http://wiki.hetzner.de/index.php/Proxmox_VE/en

http://dobrev.co/proxmox-on-a-dedic...hop-additional-ips-from-different-networks-2/

I guess I will delete the forwarding and make some test to confirm the IPs are routed to the VLAN correctly.

Thanks again.

 

[RobFantini]

We used a 2 node drbd pve cluster for close to two years .

Prior to that we used DRBD for 3 years . DRBD saved our data many times and is something we will continue to use but not on the same host as PVE.

Unless you are very familiar with DRBD and PVE then do not try a 2 node drbd cluster. Both pve and drbd need to be able shoot the other node in the head [STONITH ] .