I managed to find this guide, I am going to try it out but it looks amazing
https://www-pivert-org.translate.goog/comment-ajouter-un-storage-network-a-ceph-sur-proxmox/?_x_tr_sl=auto&_x_tr_tl=en&_x_tr_hl=en&_x_tr_pto=wapp
Hi all. I found this works well to completely remove ceph and config
systemctl stop ceph-mon.target
systemctl stop ceph-mgr.target
systemctl stop ceph-mds.target
systemctl stop ceph-osd.target
rm -rf /etc/systemd/system/ceph*
killall -9 ceph-mon ceph-mgr ceph-mds
rm -rf /var/lib/ceph/mon/...
Here is the syslog of the node3 trying to join the cluster
https://pastebin.com/PV7n1WBY
Futher to this - my /etc/hosts is correct with the correct IP's and hostnames
Ok So these were my findings:
MPLS/VPLS&VLAN - Tries to connect, establishes connection but throughput too slow, eventually collpases [1.96MBps]
L2TP/EoIP&VLAN - Connects and joins, waiting for quorum, all nodes reboot and the entire cluster dies, have to forcefully remove remote node and wait...
I most certainly will share - I just want to know from @Alwin if that would suit the Promox VE6 cluster to join over WAN as he suggested.
I will try connect the cluster during the week and post my results
Thank you
I was referring to this post
https://forum.proxmox.com/threads/pve6-and-mikrotik-eoip.59536/post-274785
The std dev was too great to accommodate a cluster over WAN
I more than happy to change the network for it operate more efficiently.
I will try the proxy-arp
What suggestions do you have for me to change the network.
Thank you
Hi there.
We have a CCR in the data centre that node1 and node2 are connected directly with SFP+
We then have a RB3011 in our satellite office, an L2TP vpn connection between them and then the EoIP on top of the L2TP.
I have setup L2TP because the satellite office is being provided...
Thank you so much
I tried again last night and it failed again
I have setup a QDevice on that node3 and setup HA
Thank you once again for all your assistance
I don't want it to join the storage - I just need this machine to act as a voting node for the HA between node1 and node2
I will try again tonight and post results
Thank you so so much for you assistance! and such an amazing piece of software
I will investigate this
I will try again tonight and publish results
unicast seems to be working
I have checked the logs and it appears that node3 was trying to access local-zfs like the other 2 but I have set that up differently. Could that have caused the "hang". I have restricted the...
Please can anyone assist me.
I am trying to connect node3 to my cluster, I have a Mikrotik EoIP tunnel with all the vlans setup etc - unicast and multicast 100% successful, however - when I try join the node to the cluster:
waiting for quorum .. OK
and then it just waits, I see the interfaces...
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.