Problems on creating proxmox 4 cluster

[embb]

Hi,

Trying to setup my proxmox 4 first cluster on online.net and I'm having the following issue.
When I follow this article to use a specific nic: https://pve.proxmox.com/wiki/Separate_Cluster_Network

When I run the command to add the node (from the new node) is hangs on the quorum and then on all three nodes I have some strange configuration since it shows 3 nodes on the total votes but only one node on the membership.
On each node the member that it shows is the local IP of that node.

What am I doing wrong ?


output of pvecm status on any note is something like this:


Quorum information
------------------
Date: Sun Nov 22 16:53:31 2015
Quorum provider: corosync_votequorum
Nodes: 1
Node ID: 0x00000001
Ring ID: 40
Quorate: No


Votequorum information
----------------------
Expected votes: 3
Highest expected: 3
Total votes: 1
Quorum: 2 Activity blocked
Flags:


Membership information
----------------------
Nodeid Votes Name
0x00000001 1 xx.xx.xx.xx (local)



Thanks
embb

 

[Q-wulf]

can you post the output of "ifconfig" and "cat /etc/hosts" and "cat /etc/pve/corosync.conf" ???



you mention you do this on "online.net".

• Do the servers come with private networks/ Vlans ?
• Or do the servers have 2 seperate "public ip's" you use for this ?

 

[embb]

Just talked with online.net support. Seems that online.net RPN does not support multicast, so making a vpn tunnel seems the only known workarround to make it work.
Folowing this one to test it: http://myatus.com/p/poor-mans-proxmox-cluster/

 

[Q-wulf]

[...]online.net RPN does not support multicast, so making a vpn tunnel seems the only known workarround to make it work.
Folowing this one to test it: http://myatus.com/p/poor-mans-proxmox-cluster/

That tutorial definitely works. I did it in 12/2013 on OVH-servers based on that tut for proxmox 3.x for personal use. (since ovh did not offer vlans for acceptable prices back then)

 

[embb]

Thanks for your feedback. It's good to know that this is a working solution.
Don't understand why they don't support multicast on their own vlan solution (they call it RPN)

 

[Q-wulf]

just guessing here:
- because its not part of their "core business"
- puts strain it on their most likely way way underprovisioned network infrastructure
- The reason they offer rpn is probably to upsell RPN-Options like "Sync/SAN/VPN". Its all based on junipers virtual chassis-technology according to https://www.online.net/en/dedicated-server/rpn
As such they generally want to discourage the usage of switch-intensive use-cases.



Back when i was a OVH-customer they did it similarly by blocking intra-network udp-traffic to 5 Mbit/s per source.