Cluster with IPsec from pfsense VM

[Wiwi]

Hello everyone !
I was wondering if it was possible to start a Proxmox cluster through an IPsec VPN managed by 2 pfSense in VMs on each node.

I have 2 servers at Kimsufi (1 NIC, no Vrack) and I installed a pfsense VM on each.
First point, I only have 1 public IP per server, so I'm using NAT in order to forward everything to the pfSense (only 2 exceptions : SSH and 8006).
By playing a little bit I could start an IPsec VPN between the 2 pfSense and routing my networks

I know it's far from the requirement, but is that possible ?
The latency looks to be arround 100 ms, is it too much even for testing ?
My VPN tunnel will still work if I try to create the cluster ?
What about restarting a node, can pfsense VM start before any cluster communication ?

These 2 servers are my lab, I'm plyaing with proxmox since a year now, but I never could play with clustering.
And I got this second server recently for cheap price, so it was a good opportunity for trying some things !

Thanks

 

[milocheri]

Hi did you manage to setup this?

 

[Wiwi]

Hi milocheri,
At the end I didn't manage my cheap cluster through the IPsec.
Instead I use tinc vpn between my 2 nodes, once VPN was up, I was able to join them in the same cluster.
Latency was not bad, but it still not recommended as corosync need really low latency.

In my case, I was note really using my nodes as a "cluster", it was just more convenient for migrating LXC to a node to an other one, or I was able to easily shared some storage.

I don't have this setup anymore, but it was working really fine for my testing uses case.